Bridge girder exposed reinforcement damage degree evaluation method based on unmanned aerial vehicle

CN119091336AInactive Publication Date: 2024-12-06SHENZHEN URBAN TRANSPORT PLANNING CENT CO LTD
View PDF 5 Cites 0 Cited by

Patent Information

Application Number
CN202411594934.2
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-11-11
Publication Date
2024-12-06
Estimated Expiration
Not applicable · inactive patent

AI Technical Summary

Technical Problem

In the prior art, the exposed rib detection method of the main beam of bridge is difficult to accurately evaluate the degree of exposed rib damage, resulting in an increase in structural safety hazards and an increase in maintenance costs, and it is not possible to achieve rapid identification and analysis.

Method used

The drone-based evaluation method for the damage degree of the exposed rib of the main beam of the bridge is adopted. By planning the shortest flight path, the image matrix is ​​collected for image quality enhancement, and the loss functions of the basic model, auxiliary model and reinforcement model are trained to identify and classify the main beam. Severe of damage to exposed tendons.

Benefits of technology

It improves the accuracy and efficiency of the identification of exposed ribs of the main beam of the bridge, ensures the safety and maintenance priority of the bridge structure, reduces the difficulty and cost of maintenance, and extends the service life of the bridge.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119091336A_ABST
    Figure CN119091336A_ABST
Patent Text Reader

Abstract

The invention discloses a bridge girder exposed reinforcement damage degree evaluation method based on an unmanned aerial vehicle, and belongs to the technical field of bridge damage assessment. The problem that in the prior art, a traditional bridge girder exposed rib detection method is difficult to evaluate the exposed rib degree of a bridge girder is solved. The shortest flight path of the unmanned aerial vehicle is planned according to parameter information and operation information of the unmanned aerial vehicle; acquiring a bridge girder image to generate an image matrix, and performing image quality enhancement on the image matrix to obtain a new image matrix; in combination with the disease information, constructing a data set, establishing and training three models, and fusing loss functions to obtain a fused loss function; and taking the trained basic model as a final model, and outputting a final girder exposed reinforcement recognition result. And in the identified main beam exposed reinforcement region, analyzing various factors and combining with a given factor standard value to obtain a main beam exposed reinforcement damage degree classification. The damage degree of the exposed reinforcement of the main beam is classified, and the method can be applied to bridge maintenance.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to a method for evaluating the degree of damage of exposed reinforcement bars in a bridge main beam, and in particular to a method for evaluating the degree of damage of exposed reinforcement bars in a bridge main beam based on an unmanned aerial vehicle, and belongs to the technical field of bridge damage assessment. Background Art

[0002] During the service of a bridge, the concrete may crack or peel off due to environmental factors (such as erosion and chemical corrosion), load (overload or collision), and construction quality problems (loose pouring or improper maintenance), which may eventually expose the steel bars. The exposed steel bars will directly affect the structural strength and durability of the bridge, resulting in a decrease in bearing capacity and increased safety hazards. If not handled in a timely manner, it may aggravate structural damage, increase the difficulty and cost of maintenance, and may even cause the bridge structure to become unstable or collapse. Rapid and intelligent identification of exposed steel bars in bridge main beams is crucial to maintaining bridge safety. It can help detect problems in a timely manner and save maintenance costs. At the same time, it can optimize safety monitoring and ensure the continued safe operation of the bridge.

[0003] At present, there is a lack of research on UAV inspection paths during bridge main beam inspection, which leads to increased UAV flight time and energy waste, and also causes some bridge disease areas to not be thoroughly inspected, affecting the comprehensiveness and accuracy of disease detection. It may also increase the risk of UAV operation and increase the probability of accidents. It is of great significance to conduct research on the method of determining the shortest flight path of UAVs. First, it can improve the operating efficiency of UAVs in bridge inspection, save time and energy, and reduce wear and tear on the UAV itself, extending its service life. Secondly, accurate flight path planning can ensure that the UAV can cover all key areas, improve the comprehensiveness and accuracy of disease detection, and finally, the optimized flight path can also help reduce safety risks during flight and improve overall operational safety.

[0004] On the other hand, the analysis of the degree of damage to exposed reinforcement in bridge main beams plays a vital role in ensuring structural safety, formulating repair priorities and strategies, extending the service life of bridges, and improving maintenance efficiency. Evaluating the degree of damage to exposed reinforcement in bridge main beams helps managers allocate resources rationally and repair key damages in a timely manner. At the same time, through systematic monitoring and data accumulation, it supports long-term health monitoring and optimizes long-term maintenance plans, thereby ensuring the long-term stability and safety of bridges.

[0005] In the prior art, a patent document with a publication (announcement) number of CN109087295A discloses a visual detection method for exposed rebar in bridges based on a grayscale projection method, which utilizes the grayscale projection method to effectively locate and identify exposed rebar in bridges, and eliminates complex background interference by analyzing the grayscale value distribution in the image, thereby improving the accuracy and efficiency of detection; however, the above invention does not involve a rapid identification technology for exposed rebar in main beams, which may lead to the problem of exposed rebar being ignored or delayed in processing, thereby causing increased structural safety hazards, increased maintenance costs, and potential risks of bridge structure failure. At the same time, the analysis of the degree of damage to the exposed rebar in the main beam has not yet been considered.

[0006] Therefore, a method for evaluating the damage degree of exposed reinforcement in bridge main beams based on drones is needed. Summary of the invention

[0007] A brief overview of the present invention is provided below in order to provide a basic understanding of certain aspects of the present invention. It should be understood that this overview is not an exhaustive overview of the present invention. It is not intended to identify key or important parts of the present invention, nor is it intended to limit the scope of the present invention. Its purpose is merely to present certain concepts in a simplified form as a prelude to a more detailed description discussed later.

[0008] In view of this, in order to solve the problem that the traditional bridge main beam exposed rebar detection method in the prior art is difficult to assess the degree of exposed rebar in the bridge main beam, the present invention provides a bridge main beam exposed rebar damage degree assessment method based on a drone.

[0009] The technical solution is as follows: A method for evaluating the degree of exposed reinforcement damage of bridge main beams based on drones includes the following steps: S1. Plan the shortest flight path of the drone based on the drone parameter information and operation information; S2. Collect the bridge main beam image along the shortest flight path of the UAV to generate an image matrix, and enhance the image quality to obtain a new image matrix; S3. construct a data set based on the new image matrix combined with disease information, input the data set into the established basic model, auxiliary model and enhanced model for training, and fuse the loss functions of the three models to obtain the fused loss function; S4. Establish an inter-layer loss function from the enhanced model to the basic model, combine the fused loss function to obtain the total loss function, train the three models, use the trained basic model as the final model, and output the final main beam exposed reinforcement recognition result; S5. Based on the final main beam exposed reinforcement identification results, in the identified main beam exposed reinforcement area, the main beam exposed reinforcement damage degree classification is obtained by analyzing various factors and combining them with given factor standard values.

[0010] Furthermore, the S1 specifically includes the following steps: S11. Determine the take-off and landing points of the drone and select the observation position of the operator; S12. Determine the flight altitude AVh according to the focal length and sensor size of the camera carried by the drone, obtain the image coverage and resolution, and set the drone flight speed to AVv; S13. Develop the shortest flight path based on the take-off and landing points of the drone, and determine the coordinate information of the bridge main beam and the location information of the drone shooting points; In S13, the take-off point coordinates are AVo (AVoX, AVoY, AVoZ). On this basis, all drone shooting points are determined. The number of any drone shooting point is p, and its corresponding drone shooting point coordinates are AVp (AVpX, AVpY, AVpZ). The number set of drone shooting points is expressed as {1, 2, 3, ..., XN}, and the corresponding drone shooting point coordinate set is expressed as {AV1 (AV1X, AV1Y, AV1Z), AV2 (AV2X, AV2Y, AV2Z), ..., AVXN (AVXNX, AVXNY, AVXNZ)}, where XN is the number of drone shooting points. The adjacent distance between any drone shooting point AVp and its adjacent drone shooting point AV (p+1) is calculated. ; Taking the take-off point AVo as the starting point, according to the distance between any drone shooting point and the take-off point , calculate the distance between all drone shooting points and the take-off point, select the three drone shooting points corresponding to the minimum distance, and randomly select them to obtain the first drone shooting point that the drone arrives at after departing from the take-off point; After determining the first shooting point that the drone arrives at, calculate the distance between all shooting points and the first shooting point that is arrived at, screen out the three drone shooting points corresponding to the smallest distance, and randomly select them to obtain the second shooting point that the drone arrives at after departing from the first shooting point it arrives at. Repeat the above steps until all the shooting points that the drone arrives at are obtained. According to the different random selections each time, calculate the total distance TDis1 of the drone's flight under the first flight mode. Repeat the above steps, the number of repetitions is CN, and integrate to obtain the total distance set of the drone's flight under different flight modes {TDis1, TDis2, TDis3, TDis4, …, TDisCN}, arrange them in order from small to large, and select the total distances and corresponding flight routes ranked in the top TN, TN is the preset value, count the intersection information of TN flight routes, and select the flight route with the largest number of intersections to obtain the shortest flight path of the drone.

[0011] Furthermore, the step S2 specifically includes the following steps: S21. Using the high-definition camera on the drone, collect the bridge girder image ph along the shortest flight path of the drone, and the corresponding image matrix is ​​PH; S22. Construct a 5th-order denoising kernel function N, normalize all elements in the kernel function, and obtain the normalized denoising kernel function ; S23. According to the normalized denoising kernel function , perform denoising kernel function processing on the image to obtain a new image matrix P to achieve image quality enhancement; In S22, the fifth-order denoising kernel function N is expressed as: ; ; Where x=1, 2, 3, 4 or 5, x is the row number of the matrix, and y=1, 2, 3, 4 or 5, y is the column number of the matrix. is the standard deviation of all elements in the kernel function, is the base of natural logarithms; Normalized denoising kernel function It is expressed as: ; In S23, the new image matrix P is expressed as: ; Among them, PH is the image matrix corresponding to the apparent image ph of the bridge railing collected along the shortest flight path of the UAV.

[0012] Furthermore, the step S3 specifically includes the following steps: S31. Based on the new image matrix, all images containing exposed reinforcement, cracks, rust and spalling of the main beam are selected as input images; S32. Through manual annotation, the exposed reinforcement area of ​​the main beam and other three diseases are selected in the input image, a data set is constructed, and the data set is divided into a training set and a test set in a ratio of 8:2; S33. According to the data set, a basic model, an auxiliary model and an enhanced model are constructed, and the loss functions of the three models are calculated and integrated to obtain a fused loss function; In S32, the exposed reinforcement area of ​​the main beam is marked as Reinforcement, and the three diseases, namely cracks, corrosion and spalling, are marked as other1, other2 and other3 respectively; In S33, a network structure of a basic model, i.e., a deep learning model A, is constructed, wherein the deep learning model A consists of 1 input layer, 5 convolutional layers, 5 activation layers, 4 pooling layers, 1 global average pooling layer and 1 output layer; Input the data set into the deep learning model A, calculate the weights and biases of the neural network units of the deep learning model A through the error back propagation algorithm, complete the training of the deep learning model A, and obtain the trained deep learning model A and its loss function ; The output value of the output unit node corresponding to the deep learning model A is , respectively, are the output values ​​of the first output unit node , the output value of the second output unit node , the output value of the third output unit node and the output value of the fourth output unit node , according to the exponential function First, the output values ​​of the four output unit nodes corresponding to the deep learning model A are initially converted into the probability values ​​of the first preliminary output value and the first preliminary output value. , and then further optimize and transform it to obtain the first optimized output value and the enhanced probability value of the first optimized output value ; The enhanced probability value using the first optimized output value And the data set, combined with the error chain derivative rule, continue to train the deep learning model A. After the training is completed, the output value of the first disease is obtained The actual disease annotations corresponding to the nodes in the output layer of the deep learning model A , the output value of the first disease They are the exposed reinforcement output values ​​of the first main beam respectively , the output value of the first crack , the first rust output value and the first peeling output value ; Construct the first auxiliary model, namely deep learning model B, which consists of 1 input layer, 10 convolutional layers, 10 activation layers, 5 pooling layers, 1 global average pooling layer and 1 output layer; Input the data set into the deep learning model B, calculate the weights and biases of the neural network units of the deep learning model B through the error back propagation algorithm, complete the training of the deep learning model B, and obtain the trained deep learning model B and its loss function ; The output value of the output unit node corresponding to the deep learning model B is , respectively, are the output values ​​of the fifth output unit node , the output value of the sixth output unit node , the output value of the seventh output unit node and the output value of the eighth output unit node , according to the exponential function First, the output values ​​of the four output unit nodes corresponding to the deep learning model B are initially converted into the second preliminary output value and the probability value of the second preliminary output value , and then further optimize and transform it to obtain the second optimized output value and the enhanced probability value of the second optimized output value ; The enhanced probability value using the second optimized output value And the data set, combined with the error chain derivative rule, continue to train the deep learning model B. After the training is completed, the output value of the second disease is obtained The actual disease annotations corresponding to the nodes in the output layer of the deep learning model B , the output value of the second disease They are the exposed reinforcement output values ​​of the second main beam respectively , the output value of the second crack , Second rust output value and the second peeling output value ; Construct the second auxiliary model, namely the deep learning model C, which consists of 1 input layer, 15 convolutional layers, 15 activation layers, 5 pooling layers, 1 global average pooling layer and 1 output layer; Input the data set into the deep learning model C, calculate the weights and biases of the neural network units of the deep learning model C through the error back propagation algorithm, complete the training of the deep learning model C, and obtain the trained deep learning model C and its loss function ; The output value of the output unit node corresponding to the deep learning model C is , respectively, are the output values ​​of the ninth output unit node , the output value of the tenth output unit node , the output value of the eleventh output unit node and the output value of the twelfth output unit node , according to the exponential function First, the output values ​​of the four output unit nodes corresponding to the deep learning model C are initially converted into the third preliminary output value and the probability value of the third preliminary output value , and then further optimize and transform it to obtain the third optimized output value and the enhanced probability value of the third optimized output value ; The enhanced probability value using the third optimized output value And the data set, combined with the error chain derivative rule, continue to train the deep learning model C. After the training is completed, the output value of the third disease is obtained The actual disease annotations corresponding to the nodes in the output layer of the deep learning model B , the third disease output value They are the exposed reinforcement output values ​​of the third main beam respectively , the output value of the third crack , the third rust output value and the third peeling output value ; Construct a reinforcement model, namely a deep learning model D, which consists of 1 input layer, 19 convolutional layers, 19 activation layers, 5 pooling layers, 1 global average pooling layer and 1 output layer; Input the data set into the deep learning model D, calculate the weights and biases of the neural network units of the deep learning model D through the error back propagation algorithm, complete the training of the deep learning model D, and obtain the trained deep learning model D and its loss function ; The output value of the output unit node corresponding to the deep learning model D is , respectively, are the output values ​​of the thirteenth output unit node , the output value of the fourteenth output unit node , the output value of the fifteenth output unit node and the output value of the sixteenth output unit node , according to the exponential function First, the output values ​​of the four output unit nodes corresponding to the deep learning model D are initially converted into the fourth preliminary output value and the probability value of the fourth preliminary output value , and then further optimize and transform it to obtain the fourth optimized output value and the enhanced probability value of the fourth optimized output value ; The enhanced probability value using the fourth optimized output value And the data set, combined with the error chain derivative rule, continue to train the deep learning model D. After the training is completed, the output value of the fourth disease is obtained The actual disease annotations corresponding to the nodes in the output layer of the deep learning model D , the output value of the fourth disease They are the exposed reinforcement output values ​​of the fourth main beam respectively , the output value of the fourth crack , the fourth rust output value and the fourth peeling output value ; According to the second disease output value is and the enhanced probability value of the first optimized output value , construct the loss function between deep learning model B and deep learning model A , get the corresponding weight coefficient; Probability value based on the first preliminary output value The actual disease annotations corresponding to the nodes in the output layer of the deep learning model A , construct the probability value considering the first preliminary output value The loss function of the deep learning model A is , get the corresponding weight coefficient; Based on the loss function between deep learning model B and deep learning model A and the probability value considering the first preliminary output value The loss function of the deep learning model A is , establish the relationship loss function between the output layer of deep learning model B and deep learning model A ; According to the above operations, the relationship loss function between the output layers of deep learning model C and deep learning model B is established. , the relationship loss function between the output layer of deep learning model C and deep learning model A , the relationship loss function between the output layer of deep learning model D and deep learning model A The relationship loss function between the output layers of deep learning model D and deep learning model C .

[0013] Furthermore, the step S4 specifically includes the following steps: S41. Establish an inter-layer loss function from the enhanced model to the basic model, and combine the fused loss function to obtain the total loss function; S42. Based on the chain derivation rule, the three models are trained by error back propagation to obtain the trained deep learning model A, i.e., the optimal model; In the S41, the selected layers of the deep learning model A are connected to the selected layers of the deep learning model D, the selected layers in the deep learning model A include the second layer: convolution layer 1, the third layer: activation layer 1, the fourth layer: pooling layer 1 and the seventeenth layer: output layer, and the selected layers of the deep learning model D include the fourth layer: convolution layer 2, the sixth layer: pooling layer 1, the tenth layer: activation layer 4 and the forty-sixth layer: output layer; The selected layers of the deep learning model A are , the corresponding size is ,in, =2, 3, 4 and 17, is the selected number of layers of the deep learning model A, is the selected layer width of the deep learning model A, is the selected layer length of the deep learning model A, is the number of channels of the selected layer of deep learning model A, and the selected layer of deep learning model D is , the corresponding size is ,in, =4, 6, 10 and 46, is the selected number of layers of the deep learning model D, is the selected layer width of the deep learning model D, is the selected layer length of the deep learning model D, is the number of selected layer channels of the deep learning model D; when When , a convolution operation is added to the selected layer output of the deep learning model A, with a convolution kernel size of 1×1 and a number of convolution kernels. , get the selected layer output of deep learning model A , and the corresponding output value of each channel is , =1, 2, 3, ..., , Output channel number for the selected layer of deep learning model A and the selected layer of deep learning model D The corresponding output values ​​of each channel are , =1, 2, 3, ..., , Output channel number for the selected layer of deep learning model D, and establish the loss function between the selected layer of deep learning model A and the selected layer of deep learning model D ; when When , a convolution operation is added to the selected layer output of the deep learning model D, with a convolution kernel size of 1×1 and a number of convolution kernels. , the selected layer output of the deep learning model D is , and the corresponding output value of each channel is , the selected layers of the deep learning model D The corresponding output values ​​of each channel are , establish the loss function between the selected layer of deep learning model A and the selected layer of deep learning model D ; According to the above calculation, the loss function between the second layer of deep learning model A and the fourth layer of deep learning model D is obtained , the loss function between the third layer of deep learning model A and the sixth layer of deep learning model D And the loss function between the fourth layer of deep learning model A and the tenth layer of deep learning model D , combining the relationship loss function between the output layers of deep learning model B and deep learning model A , the relationship loss function between the output layers of deep learning model C and deep learning model B , the relationship loss function between the output layer of deep learning model C and deep learning model A , the relationship loss function between the output layer of deep learning model D and deep learning model A The relationship loss function between the output layers of deep learning model D and deep learning model C , define the total loss function .

[0014] Furthermore, the S5 specifically includes the following steps: S51. Establish a classification standard for the degree of damage of exposed reinforcement bars in the main beam based on five factors: the exposed reinforcement length CD of the main beam, the exposed reinforcement diameter KD of the main beam, the degree of corrosion CF, the degree of accelerated corrosion KF and the number of exposed reinforcement bars in the main beam SL; S52. Classify the degree of damage to the exposed reinforcement bars of the main beams of the bridge according to the classification standard for the degree of damage to the exposed reinforcement bars of the main beams; In S51, standard values ​​are given for the factors corresponding to the classification standard of the degree of damage of exposed reinforcement of each type of main beam, so as to obtain the standard value of the exposed reinforcement length of the main beam. , Standard value of exposed reinforcement diameter of main beam , Standard value of rust degree , the degree of corrosion acceleration And the standard value of the number of exposed reinforcement bars in the main beam ,in, , NL is the classification number of the classification standard for the degree of exposed reinforcement damage of the main beam; On this basis, a classification standard matrix for the degree of exposed reinforcement damage of main beams is established for each type of exposed reinforcement damage classification standard. ; Classification standard matrix of exposed reinforcement damage degree of main beam It is expressed as: ; In S52, facing the NW bridges, the bridges are numbered 1-NW in sequence, and the main beam image of the bridge numbered u is collected by the drone, and the image containing the exposed reinforcement of the main beam is identified to extract the exposed reinforcement length of the main beam. , Main beam exposed reinforcement diameter , Degree of rust , the degree of corrosion acceleration And the number of exposed reinforcement bars in the main beam , construct the classification matrix of exposed reinforcement damage degree of the main beam of the u-th bridge , , the classification matrix of exposed reinforcement damage degree of the main beam of the u-th bridge is calculated Classification standard matrix of exposed reinforcement damage degree of all main beams The distance between ; The classification matrix of the exposed reinforcement damage degree of the main beam of the u-th bridge Classification standard matrix of exposed reinforcement damage degree of all main beams The distance between It is expressed as: ; in, The weight coefficient between the exposed reinforcement length of the main beam and the standard value of the exposed reinforcement length of the main beam. The weight coefficient between the exposed reinforcement diameter of the main beam and the standard value of the exposed reinforcement diameter of the main beam. is the weight coefficient between the degree of rust and the standard value of the degree of rust, is the weight coefficient between the degree of corrosion acceleration and the standard value of corrosion acceleration, The weight coefficient between the number of exposed reinforcement bars in the main beam and the standard value of the number of exposed reinforcement bars in the main beam; Calculate and select the classification matrix of the exposed reinforcement damage degree of the main beam of the u-th bridge Classification standard matrix of exposed reinforcement damage degree of all main beams The distance between The maximum value in , the main beam exposed reinforcement damage degree classification standard corresponding to the maximum value is the main beam exposed reinforcement damage degree classification corresponding to the u-th bridge; Repeat the above steps to calculate the distance between all NW bridges and their corresponding main beam exposed reinforcement damage degree classification standard matrix, which is expressed as , calculate the maximum value of the distance between each bridge and the matrix of all main beam exposed reinforcement damage degree classification standards respectively. The main beam exposed reinforcement damage degree classification standard corresponding to the maximum value is the main beam exposed reinforcement damage degree classification corresponding to the corresponding bridge. So far, the main beam exposed reinforcement damage degree classification of all bridges is obtained through integration.

[0015] Furthermore, in S33, the layers in the network structure of the deep learning model A are connected in the following order: Input layer: image size 227×227×3; Convolution layer 1: kernel size 3×3, number of kernels 32, Stride: 1, Padding: Same; Activation layer 1: ReLU; Pooling layer 1: Type: Max pooling; Pooling size: 2×2; Stride: 2; Convolutional layer 2: kernel size 3×3, number of kernels 64, Stride: 1, Padding: Same; Activation layer 2: ReLU; Pooling layer 2: Type: max pooling, pooling size: 2×2, stride: 2; Convolution layer 3: convolution kernel size 3×3, number of convolution kernels 128, stride: 1, padding: same; Activation layer 3: ReLU; Pooling layer 3: Type: Max pooling, pooling size: 2×2, Stride: 2; Convolutional layer 4: convolution kernel size 3×3, number of convolution kernels 256, stride: 1, padding: same; Activation layer 4: ReLU; Convolution layer 5: kernel size 3×3, number of kernels 256, stride: 1, padding: same; Activation layer 5: ReLU; Pooling layer 4: Type: Max pooling, pooling size: 2×2, Stride: 2; Global average pooling layer 1; Output layer: Type: Softmax, Number of neurons: 4.

[0016] Furthermore, in S33, the layers in the network structure of the deep learning model B are connected in the following order: Input layer: image size 227×227×3; Convolution layer 1: kernel size 3×3, number of kernels 32, Stride: 1, Padding: Same; Activation layer 1: ReLU; Convolutional layer 2: kernel size 3×3, number of kernels 64, Stride: 1, Padding: Same; Activation layer 2: ReLU; Pooling layer 1: Type: Max pooling, pooling size: 2×2, Stride: 2; Convolution layer 3: convolution kernel size 3×3, number of convolution kernels 64, stride: 1, padding: same; Activation layer 3: ReLU; Convolutional layer 4: kernel size 3×3, number of kernels 64, Stride: 1, Padding: Same; Activation layer 4: ReLU; Pooling layer 2: Type: max pooling, pooling size: 2×2, stride: 2; Convolution layer 5: kernel size 3×3, number of kernels 128, Stride: 1, Padding: Same; Activation layer 5: ReLU; Convolution layer 6: kernel size 3×3, number of kernels 128, Stride: 1, Padding: Same; Activation layer 6: ReLU; Pooling layer 3: Type: Max pooling, pooling size: 2×2, Stride: 2; Convolution layer 7: kernel size 3×3, number of kernels 256, Stride: 1, Padding: Same; Activation layer 7: ReLU; Convolution layer 8: kernel size 3×3, number of kernels 256, Stride: 1, Padding: Same; Activation layer 8: ReLU; Convolution layer 9: kernel size 3×3, number of kernels 256, Stride: 1, Padding: Same; Activation layer 9: ReLU; Pooling layer 4: Type: Max pooling, pooling size: 2×2, Stride: 2; Convolution layer 10: kernel size 3×3, number of kernels 512, Stride: 1, Padding: Same; Activation layer 10: ReLU; Pooling layer 5: Type: Max pooling, pooling size: 2×2, Stride: 2; Global average pooling layer 1; Output layer: Type: Softmax, Number of neurons: 4.

[0017] Furthermore, in S33, the layers in the network structure of the deep learning model C are connected in the following order: Input layer: image size 227×227×3; Convolution layer 1: kernel size 3×3, number of kernels 64, Stride: 1, Padding: Same; Activation layer 1: ReLU; Convolutional layer 2: kernel size 3×3, number of kernels 64, Stride: 1, Padding: Same; Activation layer 2: ReLU; Pooling layer 1: Type: Max pooling, pooling size: 2×2, Stride: 2; Convolution layer 3: convolution kernel size 3×3, number of convolution kernels 128, stride: 1, padding: same; Activation layer 3: ReLU; Convolutional layer 4: kernel size 3×3, number of kernels 128, Stride: 1, Padding: Same; Activation layer 4: ReLU; Pooling layer 2: Type: max pooling, pooling size: 2×2, stride: 2; Convolution layer 5: kernel size 3×3, number of kernels 256, stride: 1, padding: same; Activation layer 5: ReLU; Convolution layer 6: kernel size 3×3, number of kernels 256, Stride: 1, Padding: Same; Activation layer 6: ReLU; Convolution layer 7: kernel size 3×3, number of kernels 256, Stride: 1, Padding: Same; Activation layer 7: ReLU; Pooling layer 3: Type: Max pooling, pooling size: 2×2, Stride: 2; Convolutional layer 8: kernel size 3×3, number of kernels 512, Stride: 1, Padding: Same; Activation layer 8: ReLU; Convolution layer 9: kernel size 3×3, number of kernels 512, Stride: 1, Padding: Same; Activation layer 9: ReLU; Convolution layer 10: kernel size 3×3, number of kernels 512, Stride: 1, Padding: Same; Activation layer 10: ReLU; Pooling layer 4: Type: Max pooling, pooling size: 2×2, Stride: 2; Convolution layer 11: kernel size 3×3, number of kernels 512, Stride: 1, Padding: Same; Activation layer 11: ReLU; Convolution layer 12: kernel size 3×3, number of kernels 512, Stride: 1, Padding: Same; Activation layer 12: ReLU; Convolution layer 13: kernel size 3×3, number of kernels 512, Stride: 1, Padding: Same; Activation layer 13: ReLU; Convolution layer 14: kernel size 3×3, number of kernels 512, Stride: 1, Padding: Same; Activation layer 14: ReLU; Convolution layer 15: kernel size 3×3, number of kernels 512, Stride: 1, Padding: Same; Activation layer 15: ReLU; Pooling layer 5: Type: Max pooling, pooling size: 2×2, Stride: 2; Global average pooling layer 1; Output layer: Type: Softmax, Number of neurons: 4.

[0018] Furthermore, in S33, the layers in the network structure of the deep learning model D are connected in the following order: Input layer: image size 227×227×3; Convolution layer 1: kernel size 3×3, number of kernels 64, Stride: 1, Padding: Same; Activation layer 1: ReLU; Convolutional layer 2: kernel size 3×3, number of kernels 64, Stride: 1, Padding: Same; Activation layer 2: ReLU; Pooling layer 1: Type: Max pooling, pooling size: 2×2, Stride: 2; Convolution layer 3: convolution kernel size 3×3, number of convolution kernels 128, stride: 1, padding: same; Activation layer 3: ReLU; Convolutional layer 4: kernel size 3×3, number of kernels 128, Stride: 1, Padding: Same; Activation layer 4: ReLU; Pooling layer 2: Type: max pooling, pooling size: 2×2, stride: 2; Convolution layer 5: kernel size 3×3, number of kernels 256, stride: 1, padding: same; Activation layer 5: ReLU; Convolution layer 6: kernel size 3×3, number of kernels 256, Stride: 1, Padding: Same; Activation layer 6: ReLU; Convolution layer 7: kernel size 3×3, number of kernels 256, Stride: 1, Padding: Same; Activation layer 7: ReLU; Convolution layer 8: kernel size 3×3, number of kernels 256, Stride: 1, Padding: Same; Activation layer 8: ReLU; Pooling layer 3: Type: Max pooling, pooling size: 2×2, Stride: 2; Convolution layer 9: kernel size 3×3, number of kernels 512, Stride: 1, Padding: Same; Activation layer 9: ReLU; Convolution layer 10: kernel size 3×3, number of kernels 512, Stride: 1, Padding: Same; Activation layer 10: ReLU; Convolution layer 11: kernel size 3×3, number of kernels 512, Stride: 1, Padding: Same; Activation layer 11: ReLU; Convolution layer 12: kernel size 3×3, number of kernels 512, Stride: 1, Padding: Same; Activation layer 12: ReLU; Convolution layer 13: kernel size 3×3, number of kernels 512, Stride: 1, Padding: Same; Activation layer 13: ReLU; Convolution layer 14: kernel size 3×3, number of kernels 512, Stride: 1, Padding: Same; Activation layer 14: ReLU; Pooling layer 4: Type: Max pooling, pooling size: 2×2, Stride: 2; Convolution layer 15: kernel size 3×3, number of kernels 512, Stride: 1, Padding: Same; Activation layer 15: ReLU; Convolution layer 16: kernel size 3×3, number of kernels 512, Stride: 1, Padding: Same; Activation layer 16: ReLU; Convolution layer 17: kernel size 3×3, number of kernels 512, Stride: 1, Padding: Same; Activation layer 17: ReLU; Convolution layer 18: kernel size 3×3, number of kernels 512, Stride: 1, Padding: Same; Activation layer 18: ReLU; Convolution layer 19: kernel size 3×3, number of kernels 512, Stride: 1, Padding: Same; Activation layer 19: ReLU; Pooling layer 5: Type: Max pooling, pooling size: 2×2, Stride: 2; Global average pooling layer 1; Output layer: Type: Softmax, Number of neurons: 4.

[0019] The beneficial effects of the present invention are as follows: the present invention constructs a basic model, an auxiliary model and an enhanced model to realize the intelligent identification of exposed rebar in the main beam of the bridge. By fusing the loss function of the model, the basic model can learn more robust and accurate feature representations from the auxiliary and enhanced models, and can combine the advantages of each model to improve its performance in the exposed rebar identification task; the present invention constructs the interlayer loss function of the basic model, the auxiliary model and the enhanced model to obtain the total loss function, trains the three models, and uses the trained basic model as the final model, which further improves the recognition performance of the basic model for exposed rebar in the main beam; the present invention takes into account five factors, namely, the exposed rebar length CD of the main beam, the exposed rebar diameter KD of the main beam, the degree of corrosion CF, the degree of accelerated corrosion KF and the number of exposed rebars SL in the main beam, analyzes the damage degree of the exposed rebar in the main beam, and obtains the classification of the damage degree of the exposed rebar in the main beam, which can be used to guide maintenance personnel to reasonably allocate maintenance resources, repair key damages in time, and ensure the long-term stability and safety of the bridge. BRIEF DESCRIPTION OF THE DRAWINGS

[0020] The drawings described herein are used to provide a further understanding of the present invention and constitute a part of the present invention. The exemplary embodiments of the present invention and their descriptions are used to explain the present invention and do not constitute an improper limitation of the present invention. In the drawings: Figure 1 This is a flow chart of the UAV-based bridge main beam exposed reinforcement damage degree evaluation method. DETAILED DESCRIPTION

[0021] In order to make the technical solutions and advantages of the embodiments of the present invention more clearly understood, the exemplary embodiments of the present invention are further described in detail below in conjunction with the accompanying drawings. Obviously, the described embodiments are only part of the embodiments of the present invention, rather than an exhaustive list of all the embodiments. It should be noted that the embodiments of the present invention and the features in the embodiments can be combined with each other without conflict.

[0022] refer to Figure 1 The present embodiment is described in detail. The method for evaluating the degree of exposed reinforcement damage of a bridge main beam based on a drone specifically comprises the following steps: S1. Plan the shortest flight path of the drone based on the drone parameter information and operation information; S2. Collect the bridge main beam image along the shortest flight path of the UAV to generate an image matrix, and enhance the image quality to obtain a new image matrix; S3. construct a data set based on the new image matrix combined with disease information, input the data set into the established basic model, auxiliary model and enhanced model for training, and fuse the loss functions of the three models to obtain the fused loss function; S4. Establish an inter-layer loss function from the enhanced model to the basic model, combine the fused loss function to obtain the total loss function, train the three models, use the trained basic model as the final model, and output the final main beam exposed reinforcement recognition result; S5. Based on the final main beam exposed reinforcement identification results, in the identified main beam exposed reinforcement area, the main beam exposed reinforcement damage degree classification is obtained by analyzing various factors and combining them with given factor standard values.

[0023] Furthermore, the S1 specifically includes the following steps: S11. Determine the take-off and landing points of the drone and select the observation position of the operator; Specifically, before the drone takes off, it is necessary to choose a location where the drone can take off and land safely, away from people and traffic, and avoid high-voltage wires and large metal structures that may interfere with the drone's navigation system. At the same time, choose an observation position with a good field of view so that the operator can maintain a good line of sight and facilitate operation; S12. Determine the appropriate flight altitude AVh according to the focal length and sensor size of the camera carried by the drone, obtain sufficient image coverage and resolution, and set the drone flight speed to AVv; S13. Develop a flight path based on the take-off and landing points of the drone. Based on the drawing parameters of the bridge, combined with the field of view and clarity of the camera carried by the drone, determine the coordinate information of the bridge main beam and the shooting point information of the drone. Ensure that the images of all point information can fully and clearly cover the bridge main beam, and design the shortest flight path of the drone. In S13, the take-off point coordinates are AVo (AVoX, AVoY, AVoZ). On this basis, all drone shooting points are determined. The number of any drone shooting point is p, and its corresponding drone shooting point coordinates are AVp (AVpX, AVpY, AVpZ). The number set of drone shooting points is expressed as {1, 2, 3, ..., XN}, and the corresponding drone shooting point coordinate set is expressed as {AV1 (AV1X, AV1Y, AV1Z), AV2 (AV2X, AV2Y, AV2Z), ..., AVXN (AVXNX, AVXNY, AVXNZ)}, where XN is the number of drone shooting points. The adjacent distance between any drone shooting point AVp and its adjacent drone shooting point AV (p+1) is calculated. ; Adjacent distance It is expressed as: ; Among them, (AVpX, AVpY, AVpZ) are the coordinates of any drone shooting point, and (AV(p+1)X, AV(p+1)Y, AV(p+1)Z) are the coordinates of the drone shooting point adjacent to any drone shooting point; Taking the take-off point AVo as the starting point, according to the distance between any drone shooting point and the take-off point , calculate the distance between all drone shooting points and the take-off point, select the three drone shooting points corresponding to the minimum distance, and randomly select them to obtain the first drone shooting point that the drone arrives at after departing from the take-off point; distance It is expressed as: ; After determining the first shooting point that the drone arrives at, calculate the distance between all shooting points and the first shooting point that is arrived at, screen out the three drone shooting points corresponding to the smallest distance, and randomly select them to obtain the second shooting point that the drone arrives at after departing from the first shooting point that it arrives at. It should be noted that the route of the drone will not return, that is, the drone will not fly to the same shooting point twice. Repeat the above steps until all the shooting points arrived at by the drone are obtained. According to the difference in each random selection, calculate the total flight distance TDis1 of the drone under the first flight mode, repeat the above steps, the number of repetitions is CN, and integrate to obtain the total flight distance set of the drone under different flight modes {TDis1, TDis2, TDis3, TDis4, …, TDisCN}, arrange them in order from small to large, and select the total distance and corresponding flight route ranked in the top TN, TN is a preset value, count the intersection information of TN flight routes, and select the flight route with the largest number of intersections to obtain the shortest flight path of the drone.

[0024] Furthermore, the step S2 specifically includes the following steps: S21. Using the high-definition camera on the drone, collect the bridge girder image ph along the shortest flight path of the drone, and the corresponding image matrix is ​​PH; S22. Construct a 5th-order denoising kernel function N, normalize all elements in the kernel function, and obtain the normalized denoising kernel function ; S23. According to the normalized denoising kernel function , perform denoising kernel function processing on the image to obtain a new image matrix P to achieve image quality enhancement; In S22, the fifth-order denoising kernel function N is expressed as: ; ; Where x=1, 2, 3, 4 or 5, x is the row number of the matrix, and y=1, 2, 3, 4 or 5, y is the column number of the matrix. is the standard deviation of all elements in the kernel function, is the base of natural logarithms; Normalized denoising kernel function It is expressed as: ; In S23, the new image matrix P is expressed as: ; Among them, PH is the image matrix corresponding to the apparent image ph of the bridge railing collected along the shortest flight path of the UAV; Specifically, the bridge girder images collected by drones contain noise, which is mainly caused by environmental factors such as wind, vibration, and changes in lighting, as well as the flight stability of the drone itself and the imaging quality of the camera. These factors may cause image blur, improper exposure, or stray pixels, thus forming noise; noise has a significant impact on the identification of exposed reinforcement in bridge girders, reducing the clarity and contrast of the image, making it difficult to distinguish between exposed reinforcement and the surrounding environment, and increasing the risk of misidentification and missed detection. Noise may also interfere with the image analysis algorithm, resulting in increased computational complexity in the recognition process, affecting the accuracy and efficiency of detection, so the quality of the bridge girder images is enhanced.

[0025] Furthermore, the step S3 specifically includes the following steps: S31. Based on the new image matrix, all images containing exposed reinforcement, cracks, rust and spalling of the main beam are selected as input images; S32. Through manual annotation, the exposed reinforcement area of ​​the main beam and other three diseases are selected in the input image, a data set is constructed, and the data set is divided into a training set and a test set in a ratio of 8:2; S33. According to the data set, a basic model, an auxiliary model and an enhanced model are constructed, and the loss functions of the three models are calculated and integrated to obtain a fused loss function; In S32, the exposed reinforcement area of ​​the main beam is marked as Reinforcement, and the three diseases, namely cracks, corrosion and spalling, are marked as other1, other2 and other3 respectively; In S33, a network structure of a basic model, i.e., a deep learning model A, is constructed, wherein the deep learning model A consists of 1 input layer, 5 convolutional layers, 5 activation layers, 4 pooling layers, 1 global average pooling layer and 1 output layer; Input the data set into the deep learning model A, calculate the weights and biases of the neural network units of the deep learning model A through the error back propagation algorithm, complete the training of the deep learning model A, and obtain the trained deep learning model A and its loss function ; Loss function of the trained deep learning model A It is expressed as: ; in, is the total number of data samples in the dataset of deep learning model A, For the The true labels of samples, For deep learning model A, predict The probability that a sample is of category 1, is the natural logarithm; The output value of the output unit node corresponding to the deep learning model A is , respectively, are the output values ​​of the first output unit node , the output value of the second output unit node , the output value of the third output unit node and the output value of the fourth output unit node , according to the exponential function First, the output values ​​of the four output unit nodes corresponding to the deep learning model A are initially converted into the probability values ​​of the first preliminary output value and the first preliminary output value. , and then further optimize and transform it to obtain the first optimized output value and the enhanced probability value of the first optimized output value ; Probability value of the first preliminary output value It is expressed as: ; The enhanced probability value of the first optimized output value It is expressed as: ; in, G is the enhancement coefficient; The enhanced probability value using the first optimized output value And the data set, combined with the error chain derivative rule, continue to train the deep learning model A. After the training is completed, the output value of the first disease is obtained The actual disease annotations corresponding to the nodes in the output layer of the deep learning model A , the output value of the first disease They are the exposed reinforcement output values ​​of the first main beam respectively , the output value of the first crack , the first rust output value and the first peeling output value ; Construct the first auxiliary model, namely deep learning model B, which consists of 1 input layer, 10 convolutional layers, 10 activation layers, 5 pooling layers, 1 global average pooling layer and 1 output layer; Input the data set into the deep learning model B, calculate the weights and biases of the neural network units of the deep learning model B through the error back propagation algorithm, complete the training of the deep learning model B, and obtain the trained deep learning model B and its loss function ; Loss function of the trained deep learning model B It is expressed as: ; in, is the total number of data samples in the dataset of deep learning model B, For the The true labels of samples, For deep learning model B to predict The probability that a sample is class 1; The output value of the output unit node corresponding to the deep learning model B is , respectively, are the output values ​​of the fifth output unit node , the output value of the sixth output unit node , the output value of the seventh output unit node and the output value of the eighth output unit node , according to the exponential function First, the output values ​​of the four output unit nodes corresponding to the deep learning model B are initially converted into the second preliminary output value and the probability value of the second preliminary output value , and then further optimize and transform it to obtain the second optimized output value and the enhanced probability value of the second optimized output value ; Probability value of the second preliminary output value It is expressed as: ; The enhanced probability value of the second optimized output value It is expressed as: ; The enhanced probability value using the second optimized output value And the data set, combined with the error chain derivative rule, continue to train the deep learning model B. After the training is completed, the output value of the second disease is obtained The actual disease annotations corresponding to the nodes in the output layer of the deep learning model B , the output value of the second disease They are the exposed reinforcement output values ​​of the second main beam respectively , the output value of the second crack , Second rust output value and the second peeling output value ; Construct the second auxiliary model, namely the deep learning model C, which consists of 1 input layer, 15 convolutional layers, 15 activation layers, 5 pooling layers, 1 global average pooling layer and 1 output layer; Input the data set into the deep learning model C, calculate the weights and biases of the neural network units of the deep learning model C through the error back propagation algorithm, complete the training of the deep learning model C, and obtain the trained deep learning model C and its loss function ; Loss function of the trained deep learning model C It is expressed as: ; in, is the total number of data samples in the dataset of the deep learning model C, For the The true labels of samples, For the deep learning model C to predict The probability that a sample is class 1; The output value of the output unit node corresponding to the deep learning model C is , respectively, are the output values ​​of the ninth output unit node , the output value of the tenth output unit node , the output value of the eleventh output unit node and the output value of the twelfth output unit node , according to the exponential function First, the output values ​​of the four output unit nodes corresponding to the deep learning model C are initially converted into the third preliminary output value and the probability value of the third preliminary output value , and then further optimize and transform it to obtain the third optimized output value and the enhanced probability value of the third optimized output value ; The probability value of the third preliminary output value It is expressed as: ; The enhanced probability value of the third optimized output value It is expressed as: ; The enhanced probability value using the third optimized output value And the data set, combined with the error chain derivative rule, continue to train the deep learning model C. After the training is completed, the output value of the third disease is obtained The actual disease annotations corresponding to the nodes in the output layer of the deep learning model B , the third disease output value They are the exposed reinforcement output values ​​of the third main beam respectively , the output value of the third crack , the third rust output value and the third peeling output value ; Construct a reinforcement model, namely a deep learning model D, which consists of 1 input layer, 19 convolutional layers, 19 activation layers, 5 pooling layers, 1 global average pooling layer and 1 output layer; Input the data set into the deep learning model D, calculate the weights and biases of the neural network units of the deep learning model D through the error back propagation algorithm, complete the training of the deep learning model D, and obtain the trained deep learning model D and its loss function ; Loss function of the trained deep learning model D It is expressed as: ; in, is the total number of data samples in the dataset of the deep learning model D, For the The true labels of samples, For the deep learning model D to predict The probability that a sample is class 1; The output value of the output unit node corresponding to the deep learning model D is , respectively, are the output values ​​of the thirteenth output unit node , the output value of the fourteenth output unit node , the output value of the fifteenth output unit node and the output value of the sixteenth output unit node , according to the exponential function First, the output values ​​of the four output unit nodes corresponding to the deep learning model D are initially converted into the fourth preliminary output value and the probability value of the fourth preliminary output value , and then further optimize and transform it to obtain the fourth optimized output value and the enhanced probability value of the fourth optimized output value ; Probability value of the fourth preliminary output value It is expressed as: ; Enhanced probability value of the fourth optimized output value It is expressed as: ; The enhanced probability value using the fourth optimized output value And the data set, combined with the error chain derivative rule, continue to train the deep learning model D. After the training is completed, the output value of the fourth disease is obtained The actual disease annotations corresponding to the nodes in the output layer of the deep learning model D , the output value of the fourth disease They are the exposed reinforcement output values ​​of the fourth main beam respectively , the output value of the fourth crack , the fourth rust output value and the fourth peeling output value ; According to the second disease output value is and the enhanced probability value of the first optimized output value , construct the loss function between deep learning model B and deep learning model A , get the corresponding weight coefficient; Loss function between deep learning model B and deep learning model A It is expressed as: ; Probability value based on the first preliminary output value The actual disease annotations corresponding to the nodes in the output layer of the deep learning model A , construct the probability value considering the first preliminary output value The loss function of the deep learning model A is , get the corresponding weight coefficient; Consider the probability value of the first preliminary output value The loss function of the deep learning model A is It is expressed as: ; Based on the loss function between deep learning model B and deep learning model A and the probability value considering the first preliminary output value The loss function of the deep learning model A is , establish the relationship loss function between the output layer of deep learning model B and deep learning model A ; The relationship loss function between the output layer of deep learning model B and deep learning model A It is expressed as: ; in, is the loss function between deep learning model B and deep learning model A The weight coefficient of is the probability value considering the first preliminary output value The loss function of the deep learning model A is The weight coefficient of According to the above operations, the relationship loss function between the output layers of deep learning model C and deep learning model B is established. , the relationship loss function between the output layer of deep learning model C and deep learning model A , the relationship loss function between the output layer of deep learning model D and deep learning model A The relationship loss function between the output layers of deep learning model D and deep learning model C ; Loss function between deep learning model C and deep learning model B It is expressed as: ; Consider the probability value of the second preliminary output value The loss function of the deep learning model B is It is expressed as: ; The relationship loss function between the output layers of deep learning model C and deep learning model B It is expressed as: ; in, is the loss function between deep learning model C and deep learning model B The weight coefficient of is the probability value considering the second preliminary output value The loss function of the deep learning model B is The weight coefficient of Loss function between deep learning model C and deep learning model A It is expressed as: ; The relationship loss function between the output layer of deep learning model C and deep learning model A It is expressed as: ; in, is the loss function between deep learning model C and deep learning model A The weight coefficient of Loss function between deep learning model D and deep learning model A It is expressed as: ; The relationship loss function between the output layer of deep learning model D and deep learning model A It is expressed as: ; in, is the loss function between deep learning model D and deep learning model A The weight coefficient of Loss function between deep learning model D and deep learning model C It is expressed as: ; Consider the probability value of the third preliminary output value The loss function of the deep learning model C It is expressed as: ; The relationship loss function between the output layers of deep learning model D and deep learning model C It is expressed as: ; in, is the loss function between deep learning model D and deep learning model C The weight coefficient of Specifically, when establishing the fast intelligent recognition model of exposed steel bars in main beams, namely the basic model, auxiliary model and reinforcement model, the images collected by the drone will show the exposed areas of steel bars, which contrast with other elements in the environment (such as cracks, spots or shadows). Exposed steel bars usually appear as irregular geometric shapes and are difficult to identify due to background noise, lighting conditions and changes in viewing angles. In order to accurately identify the features of the exposed steel bar area in the main beam, the model structure includes an input layer, a convolutional layer, an activation layer, a pooling layer, a global average pooling layer and an output layer. The functions of each structural layer are as follows: Input layer: receives the main beam image data collected by the drone and provides the model with the original pixel value input; Convolution layer: is responsible for extracting features in the image. The convolution layer detects local features in the image, such as edges, textures, and shapes, by applying multiple filters. For exposed rebar recognition, the features include the straight lines, boundaries, and specific textures of the exposed rebar surface; Activation layer: there is usually an activation layer after each convolution layer to introduce nonlinearity, so that the model can capture more complex feature representations, which helps the model distinguish between exposed rebar and surrounding concrete with low contrast features; Pooling layer: reduces the amount of calculation by reducing the spatial resolution of the feature map and increases the model's sensitivity to small locations The pooling layer can help the model better extract key features from large amounts of data and reduce sensitivity to specific image noise and distortion. Global average pooling layer: In the deeper part of the network, the global average pooling layer takes the average value of each feature map as output, which helps to reduce the number of parameters of the model, reduces the risk of overfitting, and provides a form of spatial information compression, so that the model focuses more on detecting the presence of exposed rebar rather than its specific location. Output layer: Converts feature maps into final classification decisions. In the scenario of exposed rebar identification in main beams, the output layer predicts whether the image contains exposed rebar, or performs classification at the pixel level to provide the specific location of the exposed rebar.

[0026] Furthermore, the step S4 specifically includes the following steps: S41. Establish an inter-layer loss function from the enhanced model to the basic model, and combine the fused loss function to obtain the total loss function; S42. Based on the chain derivation rule, the three models are trained by error back propagation to obtain the trained deep learning model A, i.e., the optimal model; In the S41, the selected layers of the deep learning model A are connected to the selected layers of the deep learning model D, the selected layers in the deep learning model A include the second layer: convolution layer 1, the third layer: activation layer 1, the fourth layer: pooling layer 1 and the seventeenth layer: output layer, and the selected layers of the deep learning model D include the fourth layer: convolution layer 2, the sixth layer: pooling layer 1, the tenth layer: activation layer 4 and the forty-sixth layer: output layer; The selected layers of the deep learning model A are , the corresponding size is ,in, =2, 3, 4 and 17, is the selected number of layers of the deep learning model A, is the selected layer width of the deep learning model A, is the selected layer length of the deep learning model A, is the number of channels of the selected layer of deep learning model A, and the selected layer of deep learning model D is , the corresponding size is ,in, =4, 6, 10 and 46, is the selected number of layers of the deep learning model D, is the selected layer width of the deep learning model D, is the selected layer length of the deep learning model D, is the number of selected layer channels of the deep learning model D; when When , a convolution operation is added to the selected layer output of the deep learning model A, with a convolution kernel size of 1×1 and a number of convolution kernels. , get the selected layer output of deep learning model A , and the corresponding output value of each channel is , =1, 2, 3, ..., , Output channel number for the selected layer of deep learning model A and the selected layer of deep learning model D The corresponding output values ​​of each channel are , =1, 2, 3, ..., , Output channel number for the selected layer of deep learning model D, and establish the loss function between the selected layer of deep learning model A and the selected layer of deep learning model D ; when When , the loss function between the selected layer of deep learning model A and the selected layer of deep learning model D It is expressed as: ; when When , a convolution operation is added to the selected layer output of the deep learning model D, with a convolution kernel size of 1×1 and a number of convolution kernels. , the selected layer output of the deep learning model D is , and the corresponding output value of each channel is , the selected layers of the deep learning model D The corresponding output values ​​of each channel are , establish the loss function between the selected layer of deep learning model A and the selected layer of deep learning model D ; when When , the loss function between the selected layer of deep learning model A and the selected layer of deep learning model D It is expressed as: ; According to the above calculation, the loss function between the second layer of deep learning model A and the fourth layer of deep learning model D is obtained , the loss function between the third layer of deep learning model A and the sixth layer of deep learning model D And the loss function between the fourth layer of deep learning model A and the tenth layer of deep learning model D , combining the relationship loss function between the output layers of deep learning model B and deep learning model A , the relationship loss function between the output layers of deep learning model C and deep learning model B , the relationship loss function between the output layer of deep learning model C and deep learning model A , the relationship loss function between the output layer of deep learning model D and deep learning model A The relationship loss function between the output layers of deep learning model D and deep learning model C , define the total loss function ; Total loss function It is expressed as: ; in, is the loss function between the second layer of deep learning model A and the fourth layer of deep learning model D The corresponding weight coefficient is, is the loss function between the third layer of deep learning model A and the sixth layer of deep learning model D The corresponding weight coefficient is, is the loss function between the fourth layer of deep learning model A and the tenth layer of deep learning model D The corresponding weight coefficient; Specifically, in order to enrich the feature representation capability of the basic model A, an inter-layer association relationship is established between the basic model (small model) and the enhanced model (large model), so that features at different levels in the enhanced model can be transferred to the basic model, further improving the performance of the basic model.

[0027] Furthermore, the S5 specifically includes the following steps: S51. Establish a classification standard for the degree of damage of exposed reinforcement bars in the main beam based on five factors: the exposed reinforcement length CD of the main beam, the exposed reinforcement diameter KD of the main beam, the degree of corrosion CF, the degree of accelerated corrosion KF and the number of exposed reinforcement bars in the main beam SL; S52. Classify the degree of damage to the exposed reinforcement bars of the main beams of the bridge according to the classification standard for the degree of damage to the exposed reinforcement bars of the main beams; In S51, standard values ​​are given for the factors corresponding to the classification standard of the degree of damage of exposed reinforcement of each type of main beam, so as to obtain the standard value of the exposed reinforcement length of the main beam. , Standard value of exposed reinforcement diameter of main beam , Standard value of rust degree , the degree of corrosion acceleration And the standard value of the number of exposed reinforcement bars in the main beam ,in, , NL is the classification number of the classification standard for the degree of exposed reinforcement damage of the main beam; On this basis, a classification standard matrix for the degree of exposed reinforcement damage of main beams is established for each type of exposed reinforcement damage classification standard. ; Classification standard matrix of exposed reinforcement damage degree of main beam It is expressed as: ; In S52, facing the NW bridges, the bridges are numbered 1-NW in sequence, and the main beam image of the bridge numbered u is collected by the drone, and the image containing the exposed reinforcement of the main beam is identified to extract the exposed reinforcement length of the main beam. , Main beam exposed reinforcement diameter , Degree of rust , the degree of corrosion acceleration And the number of exposed reinforcement bars in the main beam , construct the classification matrix of exposed reinforcement damage degree of the main beam of the u-th bridge , , the classification matrix of exposed reinforcement damage degree of the main beam of the u-th bridge is calculated Classification standard matrix of exposed reinforcement damage degree of all main beams The distance between ; The classification matrix of the exposed reinforcement damage degree of the main beam of the u-th bridge Classification standard matrix of exposed reinforcement damage degree of all main beams The distance between It is expressed as: ; in, The weight coefficient between the exposed reinforcement length of the main beam and the standard value of the exposed reinforcement length of the main beam. The weight coefficient between the exposed reinforcement diameter of the main beam and the standard value of the exposed reinforcement diameter of the main beam. is the weight coefficient between the degree of rust and the standard value of the degree of rust, is the weight coefficient between the degree of corrosion acceleration and the standard value of corrosion acceleration, The weight coefficient between the number of exposed reinforcement bars in the main beam and the standard value of the number of exposed reinforcement bars in the main beam; Calculate and select the classification matrix of the exposed reinforcement damage degree of the main beam of the u-th bridge Classification standard matrix of exposed reinforcement damage degree of all main beams The distance between The maximum value in , the main beam exposed reinforcement damage degree classification standard corresponding to the maximum value is the main beam exposed reinforcement damage degree classification corresponding to the u-th bridge; Repeat the above steps to calculate the distance between all NW bridges and their corresponding main beam exposed reinforcement damage degree classification standard matrix, which is expressed as , calculate the maximum value of the distance between each bridge and the matrix of all main beam exposed reinforcement damage degree classification standards respectively. The main beam exposed reinforcement damage degree classification standard corresponding to the maximum value is the main beam exposed reinforcement damage degree classification corresponding to the corresponding bridge. So far, the main beam exposed reinforcement damage degree classification of all bridges is obtained through integration.

[0028] Furthermore, in S33, the layers in the network structure of the deep learning model A are connected in the following order: Input layer: image size 227×227×3; Convolution layer 1: kernel size 3×3, number of kernels 32, Stride: 1, Padding: Same; Activation layer 1: ReLU; Pooling layer 1: Type: Max pooling; Pooling size: 2×2; Stride: 2; Convolutional layer 2: kernel size 3×3, number of kernels 64, Stride: 1, Padding: Same; Activation layer 2: ReLU; Pooling layer 2: Type: max pooling, pooling size: 2×2, stride: 2; Convolution layer 3: convolution kernel size 3×3, number of convolution kernels 128, stride: 1, padding: same; Activation layer 3: ReLU; Pooling layer 3: Type: Max pooling, pooling size: 2×2, Stride: 2; Convolutional layer 4: convolution kernel size 3×3, number of convolution kernels 256, stride: 1, padding: same; Activation layer 4: ReLU; Convolution layer 5: kernel size 3×3, number of kernels 256, stride: 1, padding: same; Activation layer 5: ReLU; Pooling layer 4: Type: Max pooling, pooling size: 2×2, Stride: 2; Global average pooling layer 1; Output layer: Type: Softmax, Number of neurons: 4.

[0029] Furthermore, in S33, the layers in the network structure of the deep learning model B are connected in the following order: Input layer: image size 227×227×3; Convolution layer 1: kernel size 3×3, number of kernels 32, Stride: 1, Padding: Same; Activation layer 1: ReLU; Convolutional layer 2: kernel size 3×3, number of kernels 64, Stride: 1, Padding: Same; Activation layer 2: ReLU; Pooling layer 1: Type: Max pooling, pooling size: 2×2, Stride: 2; Convolution layer 3: convolution kernel size 3×3, number of convolution kernels 64, stride: 1, padding: same; Activation layer 3: ReLU; Convolutional layer 4: kernel size 3×3, number of kernels 64, Stride: 1, Padding: Same; Activation layer 4: ReLU; Pooling layer 2: Type: max pooling, pooling size: 2×2, stride: 2; Convolution layer 5: kernel size 3×3, number of kernels 128, Stride: 1, Padding: Same; Activation layer 5: ReLU; Convolution layer 6: kernel size 3×3, number of kernels 128, Stride: 1, Padding: Same; Activation layer 6: ReLU; Pooling layer 3: Type: Max pooling, pooling size: 2×2, Stride: 2; Convolution layer 7: kernel size 3×3, number of kernels 256, Stride: 1, Padding: Same; Activation layer 7: ReLU; Convolution layer 8: kernel size 3×3, number of kernels 256, Stride: 1, Padding: Same; Activation layer 8: ReLU; Convolution layer 9: kernel size 3×3, number of kernels 256, Stride: 1, Padding: Same; Activation layer 9: ReLU; Pooling layer 4: Type: Max pooling, pooling size: 2×2, Stride: 2; Convolution layer 10: kernel size 3×3, number of kernels 512, Stride: 1, Padding: Same; Activation layer 10: ReLU; Pooling layer 5: Type: Max pooling, pooling size: 2×2, Stride: 2; Global average pooling layer 1; Output layer: Type: Softmax, Number of neurons: 4.

[0030] Furthermore, in S33, the layers in the network structure of the deep learning model C are connected in the following order: Input layer: image size 227×227×3; Convolution layer 1: kernel size 3×3, number of kernels 64, Stride: 1, Padding: Same; Activation layer 1: ReLU; Convolutional layer 2: kernel size 3×3, number of kernels 64, Stride: 1, Padding: Same; Activation layer 2: ReLU; Pooling layer 1: Type: Max pooling, pooling size: 2×2, Stride: 2; Convolution layer 3: convolution kernel size 3×3, number of convolution kernels 128, stride: 1, padding: same; Activation layer 3: ReLU; Convolutional layer 4: kernel size 3×3, number of kernels 128, Stride: 1, Padding: Same; Activation layer 4: ReLU; Pooling layer 2: Type: max pooling, pooling size: 2×2, stride: 2; Convolution layer 5: kernel size 3×3, number of kernels 256, stride: 1, padding: same; Activation layer 5: ReLU; Convolution layer 6: kernel size 3×3, number of kernels 256, Stride: 1, Padding: Same; Activation layer 6: ReLU; Convolution layer 7: kernel size 3×3, number of kernels 256, Stride: 1, Padding: Same; Activation layer 7: ReLU; Pooling layer 3: Type: Max pooling, pooling size: 2×2, Stride: 2; Convolutional layer 8: kernel size 3×3, number of kernels 512, Stride: 1, Padding: Same; Activation layer 8: ReLU; Convolution layer 9: kernel size 3×3, number of kernels 512, Stride: 1, Padding: Same; Activation layer 9: ReLU; Convolution layer 10: kernel size 3×3, number of kernels 512, Stride: 1, Padding: Same; Activation layer 10: ReLU; Pooling layer 4: Type: Max pooling, pooling size: 2×2, Stride: 2; Convolution layer 11: kernel size 3×3, number of kernels 512, Stride: 1, Padding: Same; Activation layer 11: ReLU; Convolution layer 12: kernel size 3×3, number of kernels 512, Stride: 1, Padding: Same; Activation layer 12: ReLU; Convolution layer 13: kernel size 3×3, number of kernels 512, Stride: 1, Padding: Same; Activation layer 13: ReLU; Convolution layer 14: kernel size 3×3, number of kernels 512, Stride: 1, Padding: Same; Activation layer 14: ReLU; Convolution layer 15: kernel size 3×3, number of kernels 512, Stride: 1, Padding: Same; Activation layer 15: ReLU; Pooling layer 5: Type: Max pooling, pooling size: 2×2, Stride: 2; Global average pooling layer 1; Output layer: Type: Softmax, Number of neurons: 4.

[0031] Furthermore, in S33, the layers in the network structure of the deep learning model D are connected in the following order: Input layer: image size 227×227×3; Convolution layer 1: kernel size 3×3, number of kernels 64, Stride: 1, Padding: Same; Activation layer 1: ReLU; Convolutional layer 2: kernel size 3×3, number of kernels 64, Stride: 1, Padding: Same; Activation layer 2: ReLU; Pooling layer 1: Type: Max pooling, pooling size: 2×2, Stride: 2; Convolution layer 3: convolution kernel size 3×3, number of convolution kernels 128, stride: 1, padding: same; Activation layer 3: ReLU; Convolutional layer 4: kernel size 3×3, number of kernels 128, Stride: 1, Padding: Same; Activation layer 4: ReLU; Pooling layer 2: Type: max pooling, pooling size: 2×2, stride: 2; Convolution layer 5: kernel size 3×3, number of kernels 256, stride: 1, padding: same; Activation layer 5: ReLU; Convolution layer 6: kernel size 3×3, number of kernels 256, Stride: 1, Padding: Same; Activation layer 6: ReLU; Convolution layer 7: kernel size 3×3, number of kernels 256, Stride: 1, Padding: Same; Activation layer 7: ReLU; Convolution layer 8: kernel size 3×3, number of kernels 256, Stride: 1, Padding: Same; Activation layer 8: ReLU; Pooling layer 3: Type: Max pooling, pooling size: 2×2, Stride: 2; Convolution layer 9: kernel size 3×3, number of kernels 512, Stride: 1, Padding: Same; Activation layer 9: ReLU; Convolution layer 10: kernel size 3×3, number of kernels 512, Stride: 1, Padding: Same; Activation layer 10: ReLU; Convolution layer 11: kernel size 3×3, number of kernels 512, Stride: 1, Padding: Same; Activation layer 11: ReLU; Convolution layer 12: kernel size 3×3, number of kernels 512, Stride: 1, Padding: Same; Activation layer 12: ReLU; Convolution layer 13: kernel size 3×3, number of kernels 512, Stride: 1, Padding: Same; Activation layer 13: ReLU; Convolution layer 14: kernel size 3×3, number of kernels 512, Stride: 1, Padding: Same; Activation layer 14: ReLU; Pooling layer 4: Type: Max pooling, pooling size: 2×2, Stride: 2; Convolution layer 15: kernel size 3×3, number of kernels 512, Stride: 1, Padding: Same; Activation layer 15: ReLU; Convolution layer 16: kernel size 3×3, number of kernels 512, Stride: 1, Padding: Same; Activation layer 16: ReLU; Convolution layer 17: kernel size 3×3, number of kernels 512, Stride: 1, Padding: Same; Activation layer 17: ReLU; Convolution layer 18: kernel size 3×3, number of kernels 512, Stride: 1, Padding: Same; Activation layer 18: ReLU; Convolution layer 19: kernel size 3×3, number of kernels 512, Stride: 1, Padding: Same; Activation layer 19: ReLU; Pooling layer 5: Type: Max pooling, pooling size: 2×2, Stride: 2; Global average pooling layer 1; Output layer: Type: Softmax, Number of neurons: 4.

[0032] Although the present invention has been described according to a limited number of embodiments, it will be apparent to those skilled in the art, with the benefit of the above description, that other embodiments may be envisioned within the scope of the invention thus described. In addition, it should be noted that the language used in this specification is selected primarily for readability and teaching purposes, rather than for explaining or defining the subject matter of the present invention. Therefore, many modifications and variations will be apparent to those skilled in the art without departing from the scope and spirit of the appended claims. The disclosure of the present invention is illustrative, not restrictive, with respect to the scope of the present invention, which is defined by the appended claims.

Claims

1. Evaluation method of exposed reinforcement damage degree of bridge main beam based on drone, It is characterized in that The following steps are involved: S1. Plan the shortest flight path of the drone based on the drone parameter information and operation information; S2. Collect the bridge main beam image along the shortest flight path of the UAV to generate an image matrix, and enhance the image quality to obtain a new image matrix; S3. construct a data set based on the new image matrix combined with disease information, input the data set into the established basic model, auxiliary model and enhanced model for training, and fuse the loss functions of the three models to obtain the fused loss function; S4. Establish an inter-layer loss function from the enhanced model to the basic model, combine the fused loss function to obtain the total loss function, train the three models, use the trained basic model as the final model, and output the final main beam exposed reinforcement recognition result; S5. Based on the final main beam exposed reinforcement identification results, in the identified main beam exposed reinforcement area, the main beam exposed reinforcement damage degree classification is obtained by analyzing various factors and combining them with given factor standard values.

2. According to the method for evaluating the degree of exposed reinforcement damage of bridge main beams based on drones in claim 1, It is characterized in that The S1 specifically includes the following steps: S11. Determine the take-off and landing points of the drone and select the observation position of the operator; S12. Determine the flight altitude AVh according to the focal length and sensor size of the camera carried by the drone, obtain the image coverage and resolution, and set the drone flight speed to AVv; S13. Develop the shortest flight path based on the take-off and landing points of the drone, and determine the coordinate information of the bridge main beam and the location information of the drone shooting points; In S13, the take-off point coordinates are AVo (AVoX, AVoY, AVoZ). On this basis, all drone shooting points are determined. The number of any drone shooting point is p, and its corresponding drone shooting point coordinates are AVp (AVpX, AVpY, AVpZ). The number set of drone shooting points is expressed as {1, 2, 3, ..., XN}, and the corresponding drone shooting point coordinate set is expressed as {AV1 (AV1X, AV1Y, AV1Z), AV2 (AV2X, AV2Y, AV2Z), ..., AVXN (AVXNX, AVXNY, AVXNZ)}, where XN is the number of drone shooting points. The adjacent distance between any drone shooting point AVp and its adjacent drone shooting point AV (p+1) is calculated. ; Taking the take-off point AVo as the starting point, according to the distance between any drone shooting point and the take-off point , calculate the distance between all drone shooting points and the take-off point, select the three drone shooting points corresponding to the minimum distance, and randomly select them to obtain the first drone shooting point that the drone arrives at after departing from the take-off point; After determining the first shooting point that the drone arrives at, calculate the distance between all shooting points and the first shooting point that is arrived at, screen out the three drone shooting points corresponding to the smallest distance, and randomly select them to obtain the second shooting point that the drone arrives at after departing from the first shooting point it arrives at. Repeat the above steps until all the shooting points that the drone arrives at are obtained. According to the different random selections each time, calculate the total distance TDis1 of the drone's flight under the first flight mode. Repeat the above steps, the number of repetitions is CN, and integrate to obtain the total distance set of the drone's flight under different flight modes {TDis1, TDis2, TDis3, TDis4, …, TDisCN}, arrange them in order from small to large, and select the total distances and corresponding flight routes ranked in the top TN, TN is the preset value, count the intersection information of TN flight routes, and select the flight route with the largest number of intersections to obtain the shortest flight path of the drone.

3. According to the method for evaluating the degree of exposed reinforcement damage of bridge main beams based on drones in claim 2, It is characterized in that The S2 specifically includes the following steps: S21. Using the high-definition camera on the drone, collect the bridge girder image ph along the shortest flight path of the drone, and the corresponding image matrix is ​​PH; S22. Construct a 5th-order denoising kernel function N, normalize all elements in the kernel function, and obtain the normalized denoising kernel function ; S23. According to the normalized denoising kernel function , perform denoising kernel function processing on the image to obtain a new image matrix P to achieve image quality enhancement; In S22, the fifth-order denoising kernel function N is expressed as: ; ; Where x=1, 2, 3, 4 or 5, x is the row number of the matrix, and y=1, 2, 3, 4 or 5, y is the column number of the matrix. is the standard deviation of all elements in the kernel function, is the base of natural logarithms; Normalized denoising kernel function It is expressed as: ; In S23, the new image matrix P is expressed as: ; Among them, PH is the image matrix corresponding to the apparent image ph of the bridge railing collected along the shortest flight path of the UAV.

4. According to the method for evaluating the degree of exposed reinforcement damage of bridge main beams based on drones in claim 3, It is characterized in that The S3 specifically includes the following steps: S31. Based on the new image matrix, all images containing exposed reinforcement, cracks, rust and spalling of the main beam are selected as input images; S32. Through manual annotation, the exposed reinforcement area of ​​the main beam and other three diseases are selected in the input image, a data set is constructed, and the data set is divided into a training set and a test set in a ratio of 8:2; S33. According to the data set, a basic model, an auxiliary model and an enhanced model are constructed, and the loss functions of the three models are calculated and integrated to obtain a fused loss function; In S32, the exposed reinforcement area of ​​the main beam is marked as Reinforcement, and the three diseases, namely cracks, corrosion and spalling, are marked as other1, other2 and other3 respectively; In S33, a network structure of a basic model, i.e., a deep learning model A, is constructed, wherein the deep learning model A consists of 1 input layer, 5 convolutional layers, 5 activation layers, 4 pooling layers, 1 global average pooling layer and 1 output layer; Input the data set into the deep learning model A, calculate the weights and biases of the neural network units of the deep learning model A through the error back propagation algorithm, complete the training of the deep learning model A, and obtain the trained deep learning model A and its loss function ; The output value of the output unit node corresponding to the deep learning model A is , respectively, are the output values ​​of the first output unit node , the output value of the second output unit node , the output value of the third output unit node and the output value of the fourth output unit node , according to the exponential function First, the output values ​​of the four output unit nodes corresponding to the deep learning model A are initially converted into the probability values ​​of the first preliminary output value and the first preliminary output value. , and then further optimize and transform it to obtain the first optimized output value and the enhanced probability value of the first optimized output value ; The enhanced probability value using the first optimized output value And the data set, combined with the error chain derivative rule, continue to train the deep learning model A. After the training is completed, the output value of the first disease is obtained The actual disease annotations corresponding to the nodes in the output layer of the deep learning model A , the output value of the first disease They are the exposed reinforcement output values ​​of the first main beam respectively , the output value of the first crack , the first rust output value and the first peeling output value ; Construct the first auxiliary model, namely deep learning model B, which consists of 1 input layer, 10 convolutional layers, 10 activation layers, 5 pooling layers, 1 global average pooling layer and 1 output layer; Input the data set into the deep learning model B, calculate the weights and biases of the neural network units of the deep learning model B through the error back propagation algorithm, complete the training of the deep learning model B, and obtain the trained deep learning model B and its loss function ; The output value of the output unit node corresponding to the deep learning model B is , respectively, are the output values ​​of the fifth output unit node , the output value of the sixth output unit node , the output value of the seventh output unit node and the output value of the eighth output unit node , according to the exponential function First, the output values ​​of the four output unit nodes corresponding to the deep learning model B are initially converted into the second preliminary output value and the probability value of the second preliminary output value , and then further optimize and transform it to obtain the second optimized output value and the enhanced probability value of the second optimized output value ; The enhanced probability value using the second optimized output value And the data set, combined with the error chain derivative rule, continue to train the deep learning model B. After the training is completed, the output value of the second disease is obtained The actual disease annotations corresponding to the nodes in the output layer of the deep learning model B , the output value of the second disease They are the exposed reinforcement output values ​​of the second main beam respectively , the output value of the second crack , Second rust output value and the second peeling output value ; Construct the second auxiliary model, namely the deep learning model C, which consists of 1 input layer, 15 convolutional layers, 15 activation layers, 5 pooling layers, 1 global average pooling layer and 1 output layer; Input the data set into the deep learning model C, calculate the weights and biases of the neural network units of the deep learning model C through the error back propagation algorithm, complete the training of the deep learning model C, and obtain the trained deep learning model C and its loss function ; The output value of the output unit node corresponding to the deep learning model C is , respectively, are the output values ​​of the ninth output unit node , the output value of the tenth output unit node , the output value of the eleventh output unit node and the output value of the twelfth output unit node , according to the exponential function First, the output values ​​of the four output unit nodes corresponding to the deep learning model C are initially converted into the third preliminary output value and the probability value of the third preliminary output value , and then further optimize and transform it to obtain the third optimized output value and the enhanced probability value of the third optimized output value ; The enhanced probability value using the third optimized output value And the data set, combined with the error chain derivative rule, continue to train the deep learning model C. After the training is completed, the output value of the third disease is obtained The actual disease annotations corresponding to the nodes in the output layer of the deep learning model B , the third disease output value They are the exposed reinforcement output values ​​of the third main beam respectively , the output value of the third crack , the third rust output value and the third peeling output value ; Construct a reinforcement model, namely a deep learning model D, which consists of 1 input layer, 19 convolutional layers, 19 activation layers, 5 pooling layers, 1 global average pooling layer and 1 output layer; Input the data set into the deep learning model D, calculate the weights and biases of the neural network units of the deep learning model D through the error back propagation algorithm, complete the training of the deep learning model D, and obtain the trained deep learning model D and its loss function ; The output value of the output unit node corresponding to the deep learning model D is , respectively, are the output values ​​of the thirteenth output unit node , the output value of the fourteenth output unit node , the output value of the fifteenth output unit node and the output value of the sixteenth output unit node , according to the exponential function First, the output values ​​of the four output unit nodes corresponding to the deep learning model D are initially converted into the fourth preliminary output value and the probability value of the fourth preliminary output value , and then further optimize and transform it to obtain the fourth optimized output value and the enhanced probability value of the fourth optimized output value ; The enhanced probability value using the fourth optimized output value And the data set, combined with the error chain derivative rule, continue to train the deep learning model D. After the training is completed, the output value of the fourth disease is obtained The actual disease annotations corresponding to the nodes in the output layer of the deep learning model D , the output value of the fourth disease They are the exposed reinforcement output values ​​of the fourth main beam respectively , the output value of the fourth crack , the fourth rust output value and the fourth peeling output value ; According to the second disease output value is and the enhanced probability value of the first optimized output value , construct the loss function between deep learning model B and deep learning model A , get the corresponding weight coefficient; Probability value based on the first preliminary output value The loss function of the deep learning model A is , get the corresponding weight coefficient; Based on the loss function between deep learning model B and deep learning model A and the probability value considering the first preliminary output value The loss function of the deep learning model A is , establish the relationship loss function between the output layer of deep learning model B and deep learning model A ; According to the above operations, the relationship loss function between the output layers of deep learning model C and deep learning model B is established. , the relationship loss function between the output layer of deep learning model C and deep learning model A , the relationship loss function between the output layer of deep learning model D and deep learning model A The relationship loss function between the output layers of deep learning model D and deep learning model C .

5. According to the method for evaluating the degree of exposed reinforcement damage of bridge main beams based on drones as described in claim 4, It is characterized in that The S4 specifically includes the following steps: S41. Establish an inter-layer loss function from the enhanced model to the basic model, and combine the fused loss function to obtain the total loss function; S42. Based on the chain derivation rule, the three models are trained by error back propagation to obtain the trained deep learning model A, i.e., the optimal model; In the S41, the selected layers of the deep learning model A are connected to the selected layers of the deep learning model D, the selected layers in the deep learning model A include the second layer: convolution layer 1, the third layer: activation layer 1, the fourth layer: pooling layer 1 and the seventeenth layer: output layer, and the selected layers of the deep learning model D include the fourth layer: convolution layer 2, the sixth layer: pooling layer 1, the tenth layer: activation layer 4 and the forty-sixth layer: output layer; The selected layers of the deep learning model A are , the corresponding size is ,in, =2, 3, 4 and 17, is the selected number of layers of the deep learning model A, is the selected layer width of the deep learning model A, is the selected layer length of the deep learning model A, is the number of channels of the selected layer of deep learning model A, and the selected layer of deep learning model D is , the corresponding size is ,in, =4, 6, 10 and 46, is the selected number of layers of the deep learning model D, is the selected layer width of the deep learning model D, is the selected layer length of the deep learning model D, is the number of selected layer channels of the deep learning model D; when When , a convolution operation is added to the selected layer output of the deep learning model A, with a convolution kernel size of 1×1 and a number of convolution kernels. , get the selected layer output of deep learning model A , and the corresponding output value of each channel is , =1, 2, 3, ..., , Output channel number for the selected layer of deep learning model A and the selected layer of deep learning model D The corresponding output values ​​of each channel are , =1, 2, 3, ..., , Output channel number for the selected layer of deep learning model D, and establish the loss function between the selected layer of deep learning model A and the selected layer of deep learning model D ; when When , a convolution operation is added to the selected layer output of the deep learning model D, with a convolution kernel size of 1×1 and a number of convolution kernels. , the selected layer output of the deep learning model D is , and the corresponding output value of each channel is , the selected layers of the deep learning model D The corresponding output values ​​of each channel are , establish the loss function between the selected layer of deep learning model A and the selected layer of deep learning model D ; According to the above calculation, the loss function between the second layer of deep learning model A and the fourth layer of deep learning model D is obtained , the loss function between the third layer of deep learning model A and the sixth layer of deep learning model D And the loss function between the fourth layer of deep learning model A and the tenth layer of deep learning model D , combining the relationship loss function between the output layers of deep learning model B and deep learning model A , the relationship loss function between the output layers of deep learning model C and deep learning model B , the relationship loss function between the output layer of deep learning model C and deep learning model A , the relationship loss function between the output layer of deep learning model D and deep learning model A The relationship loss function between the output layers of deep learning model D and deep learning model C , define the total loss function .

6. According to the method for evaluating the degree of exposed reinforcement damage of bridge main beams based on drones in claim 5, It is characterized in that The S5 specifically includes the following steps: S51. Establish a classification standard for the degree of damage of exposed reinforcement bars in the main beam based on five factors: the exposed reinforcement length CD of the main beam, the exposed reinforcement diameter KD of the main beam, the degree of corrosion CF, the degree of accelerated corrosion KF and the number of exposed reinforcement bars in the main beam SL; S52. Classify the degree of damage to the exposed reinforcement bars of the main beams of the bridge according to the classification standard for the degree of damage to the exposed reinforcement bars of the main beams; In S51, standard values ​​are given for the factors corresponding to the classification standard of the degree of damage of exposed reinforcement of each type of main beam, so as to obtain the standard value of the exposed reinforcement length of the main beam. , Standard value of exposed reinforcement diameter of main beam , Standard value of rust degree , the degree of corrosion acceleration And the standard value of the number of exposed reinforcement bars in the main beam ,in, , NL is the classification number of the classification standard for the degree of exposed reinforcement damage of the main beam; On this basis, a classification standard matrix for the degree of exposed reinforcement damage of main beams is established for each type of exposed reinforcement damage classification standard. ; Classification standard matrix of exposed reinforcement damage degree of main beam It is expressed as: ; In S52, facing the NW bridges, the bridges are numbered 1-NW in sequence, and the main beam image of the bridge numbered u is collected by the drone, and the image containing the exposed reinforcement of the main beam is identified to extract the exposed reinforcement length of the main beam. , Main beam exposed reinforcement diameter , Degree of rust , the degree of corrosion acceleration And the number of exposed reinforcement bars in the main beam , construct the classification matrix of exposed reinforcement damage degree of the main beam of the u-th bridge , , the classification matrix of exposed reinforcement damage degree of the main beam of the u-th bridge is calculated Classification standard matrix of exposed reinforcement damage degree of all main beams The distance between ; The classification matrix of the exposed reinforcement damage degree of the main beam of the u-th bridge Classification standard matrix of exposed reinforcement damage degree of all main beams The distance between It is expressed as: ; in, The weight coefficient between the exposed reinforcement length of the main beam and the standard value of the exposed reinforcement length of the main beam. The weight coefficient between the exposed reinforcement diameter of the main beam and the standard value of the exposed reinforcement diameter of the main beam. is the weight coefficient between the degree of rust and the standard value of the degree of rust, is the weight coefficient between the degree of corrosion acceleration and the standard value of corrosion acceleration, The weight coefficient between the number of exposed reinforcement bars in the main beam and the standard value of the number of exposed reinforcement bars in the main beam; Calculate and select the classification matrix of the exposed reinforcement damage degree of the main beam of the u-th bridge Classification standard matrix of exposed reinforcement damage degree of all main beams The distance between The maximum value in , the main beam exposed reinforcement damage degree classification standard corresponding to the maximum value is the main beam exposed reinforcement damage degree classification corresponding to the u-th bridge; Repeat the above steps to calculate the distance between all NW bridges and their corresponding main beam exposed reinforcement damage degree classification standard matrix, which is expressed as , calculate the maximum value of the distance between each bridge and the matrix of all main beam exposed reinforcement damage degree classification standards respectively. The main beam exposed reinforcement damage degree classification standard corresponding to the maximum value is the main beam exposed reinforcement damage degree classification corresponding to the corresponding bridge. So far, the main beam exposed reinforcement damage degree classification of all bridges is obtained through integration.

7. The method for evaluating the degree of exposed reinforcement damage of bridge main beams based on drones according to claim 6, It is characterized in that In S33, the layers in the network structure of the deep learning model A are connected in the following order: Input layer: image size 227×227×3; Convolution layer 1: kernel size 3×3, number of kernels 32, Stride: 1, Padding: Same; Activation layer 1: ReLU; Pooling layer 1: Type: Max pooling; Pooling size: 2×2; Stride: 2; Convolutional layer 2: kernel size 3×3, number of kernels 64, Stride: 1, Padding: Same; Activation layer 2: ReLU; Pooling layer 2: Type: max pooling, pooling size: 2×2, stride: 2; Convolution layer 3: convolution kernel size 3×3, number of convolution kernels 128, stride: 1, padding: same; Activation layer 3: ReLU; Pooling layer 3: Type: Max pooling, pooling size: 2×2, Stride: 2; Convolutional layer 4: convolution kernel size 3×3, number of convolution kernels 256, stride: 1, padding: same; Activation layer 4: ReLU; Convolution layer 5: kernel size 3×3, number of kernels 256, stride: 1, padding: same; Activation layer 5: ReLU; Pooling layer 4: Type: Max pooling, pooling size: 2×2, Stride: 2; Global average pooling layer 1; Output layer: Type: Softmax, Number of neurons:

4.

8. The method for evaluating the degree of exposed reinforcement damage of bridge main beams based on drones according to claim 7, It is characterized in that In S33, the layers in the network structure of the deep learning model B are connected in the following order: Input layer: image size 227×227×3; Convolution layer 1: kernel size 3×3, number of kernels 32, Stride: 1, Padding: Same; Activation layer 1: ReLU; Convolutional layer 2: kernel size 3×3, number of kernels 64, Stride: 1, Padding: Same; Activation layer 2: ReLU; Pooling layer 1: Type: Max pooling, pooling size: 2×2, Stride: 2; Convolution layer 3: convolution kernel size 3×3, number of convolution kernels 64, stride: 1, padding: same; Activation layer 3: ReLU; Convolutional layer 4: kernel size 3×3, number of kernels 64, Stride: 1, Padding: Same; Activation layer 4: ReLU; Pooling layer 2: Type: max pooling, pooling size: 2×2, stride: 2; Convolution layer 5: kernel size 3×3, number of kernels 128, Stride: 1, Padding: Same; Activation layer 5: ReLU; Convolution layer 6: kernel size 3×3, number of kernels 128, Stride: 1, Padding: Same; Activation layer 6: ReLU; Pooling layer 3: Type: Max pooling, pooling size: 2×2, Stride: 2; Convolution layer 7: kernel size 3×3, number of kernels 256, Stride: 1, Padding: Same; Activation layer 7: ReLU; Convolution layer 8: kernel size 3×3, number of kernels 256, Stride: 1, Padding: Same; Activation layer 8: ReLU; Convolution layer 9: kernel size 3×3, number of kernels 256, Stride: 1, Padding: Same; Activation layer 9: ReLU; Pooling layer 4: Type: Max pooling, pooling size: 2×2, Stride: 2; Convolution layer 10: kernel size 3×3, number of kernels 512, Stride: 1, Padding: Same; Activation layer 10: ReLU; Pooling layer 5: Type: Max pooling, pooling size: 2×2, Stride: 2; Global average pooling layer 1; Output layer: Type: Softmax, Number of neurons:

4.

9. The method for evaluating the degree of exposed reinforcement damage of bridge main beams based on drones according to claim 8, It is characterized in that In S33, the layers in the network structure of the deep learning model C are connected in the following order: Input layer: image size 227×227×3; Convolution layer 1: kernel size 3×3, number of kernels 64, Stride: 1, Padding: Same; Activation layer 1: ReLU; Convolutional layer 2: kernel size 3×3, number of kernels 64, Stride: 1, Padding: Same; Activation layer 2: ReLU; Pooling layer 1: Type: Max pooling, pooling size: 2×2, Stride: 2; Convolution layer 3: convolution kernel size 3×3, number of convolution kernels 128, stride: 1, padding: same; Activation layer 3: ReLU; Convolutional layer 4: kernel size 3×3, number of kernels 128, Stride: 1, Padding: Same; Activation layer 4: ReLU; Pooling layer 2: Type: max pooling, pooling size: 2×2, stride: 2; Convolution layer 5: kernel size 3×3, number of kernels 256, stride: 1, padding: same; Activation layer 5: ReLU; Convolution layer 6: kernel size 3×3, number of kernels 256, Stride: 1, Padding: Same; Activation layer 6: ReLU; Convolution layer 7: kernel size 3×3, number of kernels 256, Stride: 1, Padding: Same; Activation layer 7: ReLU; Pooling layer 3: Type: Max pooling, pooling size: 2×2, Stride: 2; Convolution layer 8: kernel size 3×3, number of kernels 512, Stride: 1, Padding: Same; Activation layer 8: ReLU; Convolution layer 9: kernel size 3×3, number of kernels 512, Stride: 1, Padding: Same; Activation layer 9: ReLU; Convolution layer 10: kernel size 3×3, number of kernels 512, Stride: 1, Padding: Same; Activation layer 10: ReLU; Pooling layer 4: Type: Max pooling, pooling size: 2×2, Stride: 2; Convolution layer 11: kernel size 3×3, number of kernels 512, Stride: 1, Padding: Same; Activation layer 11: ReLU; Convolution layer 12: kernel size 3×3, number of kernels 512, Stride: 1, Padding: Same; Activation layer 12: ReLU; Convolution layer 13: kernel size 3×3, number of kernels 512, Stride: 1, Padding: Same; Activation layer 13: ReLU; Convolution layer 14: kernel size 3×3, number of kernels 512, stride: 1, padding: same; Activation layer 14: ReLU; Convolution layer 15: kernel size 3×3, number of kernels 512, Stride: 1, Padding: Same; Activation layer 15: ReLU; Pooling layer 5: Type: Max pooling, pooling size: 2×2, Stride: 2; Global average pooling layer 1; Output layer: Type: Softmax, Number of neurons:

4.

10. The method for evaluating the degree of exposed reinforcement damage of bridge main beams based on drones according to claim 9, It is characterized in that In S33, the layers in the network structure of the deep learning model D are connected in the following order: Input layer: image size 227×227×3; Convolution layer 1: kernel size 3×3, number of kernels 64, Stride: 1, Padding: Same; Activation layer 1: ReLU; Convolutional layer 2: kernel size 3×3, number of kernels 64, Stride: 1, Padding: Same; Activation layer 2: ReLU; Pooling layer 1: Type: Max pooling, pooling size: 2×2, Stride: 2; Convolution layer 3: convolution kernel size 3×3, number of convolution kernels 128, stride: 1, padding: same; Activation layer 3: ReLU; Convolutional layer 4: kernel size 3×3, number of kernels 128, Stride: 1, Padding: Same; Activation layer 4: ReLU; Pooling layer 2: Type: max pooling, pooling size: 2×2, stride: 2; Convolution layer 5: kernel size 3×3, number of kernels 256, stride: 1, padding: same; Activation layer 5: ReLU; Convolution layer 6: kernel size 3×3, number of kernels 256, Stride: 1, Padding: Same; Activation layer 6: ReLU; Convolution layer 7: kernel size 3×3, number of kernels 256, Stride: 1, Padding: Same; Activation layer 7: ReLU; Convolution layer 8: kernel size 3×3, number of kernels 256, Stride: 1, Padding: Same; Activation layer 8: ReLU; Pooling layer 3: Type: Max pooling, pooling size: 2×2, Stride: 2; Convolution layer 9: kernel size 3×3, number of kernels 512, Stride: 1, Padding: Same; Activation layer 9: ReLU; Convolution layer 10: kernel size 3×3, number of kernels 512, Stride: 1, Padding: Same; Activation layer 10: ReLU; Convolution layer 11: kernel size 3×3, number of kernels 512, Stride: 1, Padding: Same; Activation layer 11: ReLU; Convolution layer 12: kernel size 3×3, number of kernels 512, Stride: 1, Padding: Same; Activation layer 12: ReLU; Convolution layer 13: kernel size 3×3, number of kernels 512, Stride: 1, Padding: Same; Activation layer 13: ReLU; Convolution layer 14: kernel size 3×3, number of kernels 512, stride: 1, padding: same; Activation layer 14: ReLU; Pooling layer 4: Type: Max pooling, pooling size: 2×2, Stride: 2; Convolution layer 15: kernel size 3×3, number of kernels 512, Stride: 1, Padding: Same; Activation layer 15: ReLU; Convolution layer 16: kernel size 3×3, number of kernels 512, Stride: 1, Padding: Same; Activation layer 16: ReLU; Convolution layer 17: kernel size 3×3, number of kernels 512, Stride: 1, Padding: Same; Activation layer 17: ReLU; Convolution layer 18: kernel size 3×3, number of kernels 512, Stride: 1, Padding: Same; Activation layer 18: ReLU; Convolution layer 19: kernel size 3×3, number of kernels 512, Stride: 1, Padding: Same; Activation layer 19: ReLU; Pooling layer 5: Type: Max pooling, pooling size: 2×2, Stride: 2; Global average pooling layer 1; Output layer: Type: Softmax, Number of neurons: 4.

Citation Information

Patent Citations

  • Bridge disease real-time detection method based on model pruning

    CN111832607A

  • Multi-model combined unmanned aerial vehicle garbage classification method for smart garden

    CN113627481A

  • Bridge apparent damage binocular vision intelligent detection method and system fused with deep learning

    CN115908276A

  • YOLOv6-based bridge disease inspection method and system

    CN117151680A

  • Novel bridge inspection method

    CN117853403A