Urban traffic infrastructure performance diagnosis method, electronic equipment and storage medium
The on-board camera collects images and uses neural network models to identify the operating status indicators of the traffic infrastructure, which solves the problem of independent detection of facilities in the existing technology, and realizes comprehensive performance diagnosis and security guarantees of urban traffic infrastructure.
Patent Information
- Application Number
- CN202411594991.0
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-11-11
- Publication Date
- 2024-12-06
AI Technical Summary
Existing urban transportation infrastructure testing methods are used to independently inspect each facility, and it is difficult to consider the mutual influence and linkage between different facilities, resulting in wasted information islands and resources, and inefficient.
Vehicle cameras are used to collect traffic infrastructure images, identify operating status indicators through manual annotation and neural network models (basic model, auxiliary model, reinforcement model), and build intelligent identification models to achieve comprehensive diagnosis of traffic infrastructure performance.
It has achieved comprehensive performance diagnosis of urban transportation infrastructure, improved maintenance efficiency, extended facility life, reduced maintenance costs, and ensured traffic safety.
Smart Images

Figure CN119091392A_ABST
Abstract
Description
Technical Field
[0001] The present invention belongs to the technical field of urban traffic infrastructure detection, and in particular relates to an urban traffic infrastructure performance diagnosis method, electronic equipment and a storage medium. Background Art
[0002] Urban transportation infrastructure includes roads, bridges, tunnels and other facilities. The safety of transportation infrastructure is directly related to the safety of public life and property. It can help identify early diseases and damage, take necessary maintenance and reinforcement measures, and extend the service life of transportation facilities. Timely maintenance and repair can prevent small problems from turning into major failures, avoid unnecessary high maintenance costs and facility replacement costs. Reduce traffic congestion and delays caused by poor facility conditions, improve traffic efficiency, and ensure transportation safety.
[0003] At present, the inspection of transportation infrastructure is carried out independently according to the type of facility, that is, road inspection, bridge inspection, and tunnel inspection are carried out separately, resulting in independent data, making it difficult to consider the mutual influence and linkage between different facilities, leading to the neglect of potential problems. Data and inspection results of different types of facilities are difficult to share effectively, resulting in information islands and affecting the overall operation and maintenance efficiency. At the same time, the inspection scope and content between different facilities may be repeated, leading to repeated inspections and waste of resources, increasing manpower and material costs.
[0004] At present, urban transportation infrastructure is complex and diverse, and traditional evaluation methods are inefficient and lack systematicity. However, advances in sensors, the Internet of Things, big data and artificial intelligence technologies have made it possible to obtain and analyze large amounts of infrastructure data in real time. Summary of the invention
[0005] The problem to be solved by the present invention is to conduct a comprehensive diagnosis of the performance of urban traffic infrastructure, and to propose a method for diagnosing the performance of urban traffic infrastructure, an electronic device and a storage medium.
[0006] To achieve the above object, the present invention is implemented through the following technical solutions: A method for diagnosing performance of urban transportation infrastructure comprises the following steps: S1. Using a vehicle-mounted camera, collect the appearance images of traffic infrastructure during the driving process of the vehicle, define the operation status indicators of traffic infrastructure, and then select all the images including the operation status indicators of traffic infrastructure from the collected appearance images of traffic infrastructure, and annotate the operation status indicators by manual annotation to obtain a data set for urban traffic infrastructure performance diagnosis; S2. Construct an intelligent identification model for traffic infrastructure operation status indicators, including a basic model, a first auxiliary model, a second auxiliary model, and an enhanced model; S3. Construct the loss function among the output layers of the basic model, the first auxiliary model, the second auxiliary model, and the enhanced model; S4. constructing the inter-layer loss function of the enhanced model and the basic model; then combining the loss function between the basic model, the first auxiliary model, the second auxiliary model and the output layer of the enhanced model obtained in step S3 to construct the overall loss function of the intelligent identification model of the operation status index of the transportation infrastructure; S5. Using the data set for urban transportation infrastructure performance diagnosis obtained in step S1, the constructed basic model, the first auxiliary model, the second auxiliary model, and the enhanced model are trained to obtain the trained basic model as the final intelligent identification model of transportation infrastructure operation status indicators; S6. Constructing a model of urban transportation infrastructure performance diagnosis method based on the intelligent identification model of transportation infrastructure operation status indicators obtained in step S5; S7. Based on the intelligent identification model of traffic infrastructure operation status indicators obtained in step S5 and the model of a method for diagnosing the performance of urban traffic infrastructure obtained in step S6, a digital twin model is constructed.
[0007] Furthermore, the specific implementation method of step S1 includes the following steps: S1.1. Using a vehicle-mounted camera, collect images of traffic infrastructure, including images of roads, bridges, and tunnels, while the vehicle is in motion; S1.2. Define the operating status indicators of transportation infrastructure: The operating status indicators of roads include: road cracks, rutting, waves, potholes, oil spills, repairs, looseness, voids, and hollows; the operating status indicators of bridges include: bridge cracks, spalling, steel corrosion, water seepage, honeycombs, rough surfaces, demoulding defects, cable corrosion, cable corrosion, and cable breakage; the operating status indicators of tunnels include: tunnel cracks, spalling, steel corrosion, water seepage, drainage system blockage, fire inside the tunnel, landslides, and traffic accidents inside the tunnel; S1.3. Manually select the surface images of the transportation infrastructure collected in step S1.1, and then manually label the operating status indicators of roads, bridges, and tunnels; S1.4. The labeled traffic infrastructure surface images are used as a dataset for urban traffic infrastructure performance diagnosis and are divided into a training set and a test set in a ratio of 7:3.
[0008] Furthermore, the specific implementation method of step S2 includes the following steps: S2.1. Basic model for constructing intelligent identification model of traffic infrastructure operation status indicators: S2.1.1. The basic model A consists of 1 input layer, 14 convolutional layers, 14 activation layers, 5 pooling layers, 1 feature splitting layer, 4 concatenation layers, 4 convolutional upsampling layers, and 1 output layer: S2.1.2. Input the training set obtained in step S1 into the basic model A, calculate the weights and biases of the neural network units through the error back propagation algorithm, complete the training of the basic model A, and obtain the trained basic model A; The calculation formula of the loss function of the basic model A is: ; in, is the loss function of the basic model A; is the total number of data samples in the basic model A; For the ia The true labels of samples, Based on the prediction of model A ia The probability that a sample is class 1; S2.1.3. The node output values of the 27 output units corresponding to the basic model A are a1, a2, a3, a4, ..., a27. The node output values of the 27 output units are initially converted to obtain the output values The corresponding probability value The calculation formula is: ; In order to amplify the probability difference between the output values and enhance the model's ability to distinguish, the 27 node outputs are further optimized and converted into: ; in, G is the enhancement coefficient, and then the actual disease corresponding to each node is marked as ; S2.1.4. Adoption The training set obtained in step S1 is combined with the error chain derivation rule to train the basic model A. After the training is completed, the output values of the 27 types of diseases corresponding to the basic model A are obtained, which are recorded as , , , , …, ; S2.2. Constructing the first auxiliary model of the intelligent identification model of traffic infrastructure operation status indicators: S2.2.1. The first auxiliary model B consists of 1 input layer, 18 convolutional layers, 18 activation layers, 5 pooling layers, 1 feature splitting layer, 4 concatenation layers, 4 convolution upsampling layers, and 1 output layer: S2.2.2. Input the training set obtained in step S1 into the first auxiliary model B, calculate the weights and biases of the neural network units through the error back propagation algorithm, complete the training of the first auxiliary model B, and obtain the trained first auxiliary model B; The calculation formula of the loss function of the first auxiliary model B is: ; in, is the loss function of the first auxiliary model B; is the total number of data samples in the first auxiliary model B; For the ib The true labels of samples, The first auxiliary model B predicts ib The probability that a sample is class 1; S2.2.3. The node output values of the 27 output units corresponding to the first auxiliary model B are b1, b2, b3, b4, ..., b27. The node output values of the 27 output units are initially converted to obtain the output values b i The corresponding probability value The calculation formula is: ; Then the node output values of the 27 output units are further optimized and converted to obtain the output value b i The corresponding enhancement probability value The calculation formula is: ; S2.2.4. Adoption The training set obtained in step S1 is combined with the error chain derivation rule to train the first auxiliary model B. After the training is completed, the disease output value corresponding to the first auxiliary model B is obtained as , among the 27 nodes in the output layer, the actual disease corresponding to each node is marked as , i =1,2,3,…,27; S2.3. Constructing the second auxiliary model of the intelligent identification model of traffic infrastructure operation status indicators: S2.3.1. The second auxiliary model C consists of 1 input layer, 22 convolutional layers, 22 activation layers, 6 pooling layers, 1 feature splitting layer, 5 concatenation layers, 5 convolution upsampling layers, and 1 output layer; S2.3.2. Input the training set obtained in step S1 into the second auxiliary model C, calculate the weights and biases of the neural network units through the error back propagation algorithm, complete the training of the second auxiliary model C, and obtain the trained second auxiliary model C; The calculation formula of the loss function of the second auxiliary model C is: ; in, is the loss function of the second auxiliary model C; is the total number of data samples in the second auxiliary model C; For the ic The true labels of samples, The second auxiliary model C predicts ic The probability that a sample is class 1; S2.3.3. The node output values of the 27 output units corresponding to the second auxiliary model C are c1, c2, c3, c4, ..., c27. The node output values of the 27 output units are initially converted to obtain The corresponding probability value The calculation formula is: ; Then the node output values of the 27 output units are further optimized and converted to obtain the output value The corresponding enhancement probability value The calculation formula is: ; in, G is the enhancement coefficient, and then the actual disease corresponding to each node is marked as ; S2.3.4. Adoption The training set obtained in step S1 is combined with the error chain derivation rule to train the second auxiliary model C. After the training is completed, the output values of the 27 types of diseases corresponding to the second auxiliary model C are obtained as follows: ; S2.4. Constructing an enhanced model for intelligent identification of traffic infrastructure operation status indicators: S2.4.1. The enhanced model D consists of 1 input layer, 26 convolutional layers, 26 activation layers, 7 pooling layers, 1 feature splitting layer, 6 concatenation layers, 6 convolutional upsampling layers, and 1 output layer; S2.4.2. Input the training set obtained in step S1 into the enhanced model D, calculate the weights and biases of the neural network units through the error back propagation algorithm, complete the training of the enhanced model D, and obtain the trained enhanced model D; The loss function of the enhanced model D is calculated as: ; in, is the loss function of the enhanced model D; is the total number of data samples in the reinforcement model D; For the id The true labels of samples, To strengthen the model D to predict the id The probability that a sample is class 1; S2.4.3. The node output values of the 27 output units corresponding to the enhanced model D are d1, d2, d3, d4, ..., d27. The node output values of the 27 output units are initially converted to obtain The corresponding probability value The calculation formula is: ; Then the node output values of the 27 output units are further optimized and converted to obtain the output value The corresponding enhancement probability value The calculation formula is: ; in, G is the enhancement coefficient, and then the actual disease corresponding to each node is marked as ; S2.4.4. Adoption The training set obtained in step S1 is combined with the error chain derivation rule to train the enhanced model D. After the training is completed, the output values of the 27 types of diseases corresponding to the enhanced model D are obtained as follows: .
[0009] Furthermore, the specific implementation method of step S3 includes the following steps: S3.1. Based on and , establish the loss function between the first auxiliary model B and the output layer of the basic model A, and the calculation formula is: ; based on and , construct the output value The corresponding probability value The loss function of the base model A , the calculation formula is: ; based on and , establish the relationship loss function between the output layer of the first auxiliary model B and the basic model A , the calculation formula is: ; in, for The weight coefficient of for The weight coefficient of S3.2. Establish the relationship loss function between the output layer of the second auxiliary model C and the first auxiliary model B , the expression is: ; in, for The weight coefficient of for The weight coefficient of Based on and The loss function of Based on and The loss function of The calculation formula is: ; The calculation formula is: ; S3.3. Establish the relationship loss function between the output layer of the second auxiliary model C and the basic model A , the expression is: ; in, for The weight coefficient of for The weight coefficient of Based on and The loss function is Based on and The loss function of The calculation formula is: ; The calculation formula is: ; S3.4. Establish the relationship loss function between the output layer of the enhanced model D and the basic model A , the expression is: ; in, for The weight coefficient of for The weight coefficient of Based on and The loss function of The calculation formula is: ; S3.5. Establish the relationship loss function between the output layer of the reinforcement model D and the second auxiliary model C , the expression is: ; in, for The weight coefficient of for The weight coefficient of Based on and The loss function is Based on and The loss function of The calculation formula is: ; The calculation formula is: .
[0010] Furthermore, the specific implementation method of step S4 includes the following steps: S4.1. Assuming a small model a and large models d , build a small model a The second, third, fourth and output layers in the large model are d Establish connections between the fourth, sixth, tenth layers and the output layer; S4.2. For the second layer in the small model and the large model d The fourth layer in the small model establishes relationships a The output of the second layer is recorded as , the corresponding size of width × length × number of channels is Large Model d The output of the fourth layer is recorded as , the corresponding size of width × length × number of channels is ; For size comparison, When , a convolution operation is added to the second layer output of the small model, the convolution kernel size is 1×1, and the number of convolution kernels is , the output is ,at this time, The corresponding output values of each channel are , k i is the channel number, The corresponding output values of each channel are ; Build on Small model a The second floor with the large model d The loss function between the fourth layers , the calculation formula is: ; when When in the large model d In the output of the fourth layer, a convolution operation is added, the convolution kernel size is 1×1, and the number of convolution kernels is , the output is ;at this time, The corresponding output values of each channel are: , The corresponding output values of each channel are ; Establish Small model a The second floor with the large model d The loss function between the fourth layers , the calculation formula is: ; S4.3. For the third layer in the small model and the large model b The sixth layer in the relationship is established to obtain a small model a The third floor and the large model b Loss function between the sixth layers ; S4.4. For the fourth layer in the small model and the large model b The tenth layer in the relationship is established to obtain a small model a Fourth floor and large model b Loss function between the tenth layer ; S4.5. When the small model is the base model A, the small model a The second, third, and fourth layers in the graph are the output of pooling layer 1, pooling layer 2, and pooling layer 4 of the basic model A, respectively. When the large model is the enhanced model D, the large model d The fourth, sixth, and tenth layers in are the output of pooling layer 2, the output of pooling layer 3, and the output of pooling layer 5 of the enhanced model D respectively; S4.6. Define the total loss function based on the loss function between the output layer of the enhanced model D and the output layer of the base model A and the inter-layer loss function. , the calculation formula is: ; in, for The corresponding weight coefficient is, for The corresponding weight coefficient is, for The corresponding weight coefficient.
[0011] Furthermore, the specific implementation method of step S5 is to use the data set for urban traffic infrastructure performance diagnosis obtained in step S1, based on the chain derivative rule, and train the basic model, the first auxiliary model, the second auxiliary model, and the enhanced model constructed for rutting recognition through error back propagation. When the overall loss function obtained in step S4 When is minimum, the corresponding model parameters are optimal, and the trained basic model A is the final intelligent identification model for transportation infrastructure operation status indicators.
[0012] Furthermore, the specific implementation method of step S6 includes the following steps: S6.1. Propose a diagnostic method for road durability and safety performance based on road infrastructure operating status indicators; S6.1.1. Setting based on crack length LCD , crack width LKD , rutting area CMJ , wave area BMJ , pit area KMJ , Oil spill area FMJ , Repair area XMJ , loose area SMJ , establish road operation status evaluation standards and divide the road operation status standards into 5 levels; Establish a road operation status standard matrix for each level of road operation status standard : , na The road operation status standard is graded as 1, 2, 3, 4, and 5. , , , , , , , They are the standard values of the grades corresponding to crack length, crack width, rutting area, wave area, pothole area, oil spill area, repair area, and loose area; Based on the target road collection image, the intelligent recognition model of traffic infrastructure operation status indicators is used to identify the yx Cracks, ruts, waves, potholes, oil spills, repairs, loose diseases of the road, and measure and calculate the yx Length of cracks on roads , crack width , rutting area , wave area , pit area , Oil spill area , Repair area , loose area , and establish the road operation status matrix : ; Calculate the road operation status matrix Road Operation Status Standard Matrix The distance between , the calculation formula is: ; in, is the weight coefficient corresponding to the pavement crack length; is the weight coefficient corresponding to the width of the pavement crack; is the weight coefficient corresponding to the road rutting area; is the weight coefficient corresponding to the road surface wave area; is the weight coefficient corresponding to the pothole area; is the weight coefficient corresponding to the oil spill area on the road surface; is the weight coefficient corresponding to the road repair area; is the weight coefficient corresponding to the loose area of the road surface; Compare the distance between the road operation status matrix of all roads and the road operation status standard matrix, and calculate the maximum value ,get The corresponding road operation status standard level is the road operation status classification level, which is recorded as ; S6.1.2. Based on internal void clear height KDG , void volume KDT , Clearance height TKG , empty volume TKT , establish safety performance evaluation standards and divide road operation safety performance into four warning levels; Establish a road safety performance standard matrix for each level of road safety performance standard , , ba is the warning level number, which is 1, 2, 3, and 4; , , , They are the standard values corresponding to the void clear height, void volume, void clear height and void volume respectively; Based on the internal image of the road, an intelligent recognition model of traffic infrastructure operation status indicators is used to identify the yx Measure and calculate the clear height of the cavities and gaps in the road , the volume of the void and clearance height , the empty volume , and establish the yx Road Safety Performance Matrix for Roads , ; Calculate the yx Road Safety Performance Matrix for Roads Matrix with road safety performance standards The distance between : ; in, is the weight coefficient corresponding to the net height of the cavity; is the weight coefficient corresponding to the volume of the void; is the weight coefficient corresponding to the clear height of the void; is the weight coefficient corresponding to the empty volume; Compare the distance between the road safety performance matrix of all roads and the road safety performance standard matrix, and calculate the maximum value , the road safety performance level corresponding to this value is the road safety performance classification level, recorded as LAQ; S6.2. Propose a diagnostic method for bridge durability and safety performance based on the infrastructure operation status indicators of bridges; S6.2.1. Set the length of cracks based on the bridge surface. QCD , crack width QKD , peeling area QBL , Steel bar corrosion area QXS , Seepage area QSS , Cell area QFW , pockmarked surface area QMM , demoulding defect area QTM , establish the bridge operation status evaluation standard and divide the bridge operation status standard into 5 levels; Establish a bridge operating condition standard matrix for each level of bridge operating condition standard , , nb The grade numbers for the bridge operation status standards are 1, 2, 3, 4, and 5; , , , , , , , They are the standard values of the grades corresponding to the crack length, crack width, peeling area, steel bar corrosion area, water seepage area, honeycomb area, pitting area, and demoulding defect area; Based on the collected images of the target bridge, the intelligent recognition model of traffic infrastructure operation status indicators is used to identify the yx bridge cracks, spalling, steel bar corrosion, water seepage, honeycomb, pockmarks, demoulding defects, and measure and calculate the yx Length of cracks in bridges , crack width , peeling area , Steel bar corrosion area , Seepage area , Cell area , pockmarked surface area , demoulding defect area , and establish the yx Bridge operation status matrix : .
[0013] Calculate the yx Bridge operation status matrix Matrix with bridge operation status standards The distance between , the calculation formula is: ; in, is the weight coefficient corresponding to the length of the bridge crack; is the weight coefficient corresponding to the width of the bridge crack; is the weight coefficient corresponding to the bridge spalling area; is the weight coefficient corresponding to the corrosion area of bridge reinforcement; is the weight coefficient corresponding to the bridge seepage area; is the weight coefficient corresponding to the bridge honeycomb area; is the weight coefficient corresponding to the bridge pitting area; is the weight coefficient corresponding to the bridge demoulding defect area; Compare the distance between the entire bridge operation status matrix and the bridge operation status standard matrix, and calculate the maximum value ,get The corresponding bridge operation status standard level is the bridge operation status classification level, which is recorded as ; S6.2.2. Corrosion area of bridge-based cables XLX , Corrosion area of cable XLF、Number of cable breaks XLD 2. Establish safety performance evaluation standards and divide bridge operation safety performance into four warning levels; Establish a bridge safety performance standard matrix for each level of bridge safety performance standard , , bb are the grade numbers of the bridge safety performance standards, which are 1, 2, 3, and 4. , , They are the standard values corresponding to the rust area of the inclined cable, the corrosion area of the inclined cable, and the number of broken inclined cables; Based on yx The images of bridges were collected, and the intelligent recognition model of traffic infrastructure operation status indicators was used to identify the rust area, corrosion area, and number of fractures of bridge cables, and to measure and calculate the rust area of the cables. , Corrosion area of cable 、Number of cable breaks , and establish the yx Bridge Safety Performance Matrix , ; Calculate the yx Bridge Safety Performance Matrix Matrix of Bridge Safety Performance Standards The distance between : ; in, is the weight coefficient corresponding to the corrosion area of the inclined cable, is the weight coefficient corresponding to the corrosion area of the inclined cable; is the weight coefficient corresponding to the number of cable fractures; Compare the distances between the entire bridge safety performance matrix and the bridge safety performance standard matrix, and then calculate the maximum value , the bridge safety performance level corresponding to this value is the bridge safety performance classification level, recorded as QAQ; S6.3. Based on the infrastructure operation status indicators of the tunnel, propose a diagnostic method for the durability and safety performance of the tunnel; S6.3.1. Set the crack length based on the tunnel surface SCD , crack width SKD , peeling area SBL , Steel bar corrosion area SXS , Seepage area SSS 、Number of drainage system blockages SSD , establish tunnel operation status evaluation standards and divide the tunnel operation status standards into 5 levels; Establish a tunnel operation status standard matrix for each level of tunnel operation status standard , , nc The level numbers for the tunnel operation status standards are 1, 2, 3, 4, and 5; , , , , , They are the standard values corresponding to crack length, crack width, peeling area, steel bar corrosion area, water seepage area, and number of drainage system blockages; Based on the collected images of the target tunnel, the intelligent recognition model of traffic infrastructure operation status indicators is used to identify the yx The tunnels are tested for cracks, spalling, steel bar corrosion, water seepage, drainage system blockage and other defects, and the crack length is measured and calculated. , crack width , peeling area , Steel bar corrosion area , Seepage area 、Number of drainage system blockages , establish the tunnel operation status matrix : .
[0014] Calculate the tunnel operation state matrix The distance from the tunnel operation status standard matrix SBZnc , the calculation formula is: ; in, is the weight coefficient corresponding to the tunnel crack length; is the weight coefficient corresponding to the tunnel crack width; is the weight coefficient corresponding to the tunnel spalling area; is the weight coefficient corresponding to the tunnel reinforcement corrosion area; is the weight coefficient corresponding to the tunnel seepage area; is the weight coefficient corresponding to the number of blockages in the tunnel drainage system; Compare the distances between all tunnel operation status matrices and the tunnel operation status standard matrix and calculate the maximum value ,get The corresponding tunnel operation status standard level is the tunnel operation status classification level, which is recorded as ; S6.3.2. Based on the number of fires inside the tunnel SHZ , Number of landslides SHP , Number of traffic accidents inside tunnelsSJT , establish tunnel safety performance evaluation standards and divide tunnel operation safety performance into four warning levels; Establish a tunnel safety performance standard matrix for each level of tunnel safety performance standard , , bc The level numbers for tunnel safety performance standards are 1, 2, 3, and 4. , , They are the standard values corresponding to the number of fires inside the tunnel, the number of landslides, and the number of traffic accidents inside the tunnel; Based on yx The tunnels were imaged and the intelligent recognition model of traffic infrastructure operation status indicators was used to identify the yx Tunnel fire, landslide, tunnel traffic accident, calculate the yx Number of fires inside tunnels , Number of landslides , Number of traffic accidents inside tunnels , and establish the yx Tunnel Safety Performance Matrix , ; Calculate the yx Tunnel Safety Performance Matrix Safety Performance Standards Matrix The distance between : ; in, is the weight coefficient corresponding to the number of fires inside the tunnel; is the weight coefficient corresponding to the number of landslides; is the weight coefficient corresponding to the number of traffic accidents inside the tunnel; Calculate the distance between the safety performance matrix of all tunnels and the safety performance standard matrix, and then calculate the maximum value , the tunnel safety performance level corresponding to this value is the tunnel safety performance classification level, recorded as SAQ; S6.4. Develop a comprehensive diagnostic method for transportation infrastructure performance; S6.4.1. Construct a comprehensive evaluation level of transportation infrastructure durability , the calculation formula is: ; in, is the weight of the road's corresponding durability, is the weight of the corresponding durability of the bridge, is the weight of the corresponding durability of the tunnel; S6.4.2. Construct a comprehensive evaluation scale for transportation infrastructure safety , the calculation formula is: ; in, is the weight of the road's corresponding safety, is the weight of the corresponding safety of the bridge, is the weight of the corresponding safety of the tunnel; completes the construction of a model of urban transportation infrastructure performance diagnosis method, which is used to diagnose the performance of urban transportation infrastructure.
[0015] Furthermore, the specific implementation method of step S7 includes the following steps: S7.1. Export the intelligent identification model of the traffic infrastructure operation status indicator obtained in step S5 and the urban traffic infrastructure performance diagnosis method model obtained in step S6 as a deployment file suitable for independent services, including one of a pt file, a pth file, a json file, and a txt file; S7.2. Construct an information model of urban transportation infrastructure; S7.2.1. Collect information on the location, length, width, and layout of urban transportation infrastructure; S7.2.2. The data obtained in step S7.2.1 is stored in a database, and a basic three-dimensional model of urban transportation infrastructure is constructed, wherein the basic three-dimensional model of urban transportation infrastructure includes geometric information of roads; S7.2.3. Based on step S7.2.2, add material properties, design specifications, and historical maintenance data to the basic three-dimensional model of the urban transportation infrastructure to obtain an urban transportation infrastructure information model; S7.2.4. Export the urban transportation infrastructure information model into a format file supported by the Web application, including a json file and a js file; S7.3. In the digital twin platform, import the deployment files of the intelligent identification model of the operation status indicators of the transportation infrastructure and the model of the performance diagnosis method of the urban transportation infrastructure obtained in step S7.1, and import the format file of the urban transportation infrastructure information model obtained in step S7.2; S7.4. Use Python to construct an API interface between an intelligent identification model for operating status indicators of transportation infrastructure and a model for a method for diagnosing the performance of urban transportation infrastructure and an urban transportation infrastructure information model, so that the operating status indicators and performance diagnosis information of urban transportation infrastructure identified and diagnosed by the intelligent identification model for operating status indicators of transportation infrastructure and a model for diagnosing the performance of urban transportation infrastructure can be updated to the database in the urban transportation infrastructure information model through the API interface, thereby completing the construction of the digital twin model.
[0016] An electronic device includes a memory and a processor. The memory stores a computer program. When the processor executes the computer program, the steps of the method for diagnosing the performance of urban transportation infrastructure are implemented.
[0017] A computer-readable storage medium stores a computer program, which, when executed by a processor, implements the method for diagnosing the performance of urban transportation infrastructure.
[0018] Beneficial effects of the present invention: The function of each structural layer of the urban transportation infrastructure performance diagnosis method described in the present invention is as follows: input layer: responsible for receiving the original input transportation infrastructure image data; convolution layer: scanning the local area of the image through the convolution kernel to extract low-level to high-level features. The low-level features include the edges, textures and other features of the transportation infrastructure acquisition image, and the high-level features include the overall features of the transportation infrastructure operation status indicators. By sharing parameters, the model parameters are significantly reduced and the calculation efficiency is improved. Feature splitting layer: decomposing and reorganizing the extracted transportation infrastructure operation status indicator features, so that the feature expression is clearer and independent, which is convenient for the processing of subsequent layers. Activation layer: performing nonlinear transformation on the linear combination of the convolution layer output, increasing the expression ability of the model, so that it can learn more complex transportation infrastructure operation status indicator features. Pooling layer: reducing the size of the feature map through downsampling operations, reducing the amount of calculation, while retaining important features and enhancing the noise resistance of the model. Splicing layer: splicing or merging the features from different convolutional layers or pooling layers, integrating feature information at different levels, and enhancing the expression ability of the transportation infrastructure operation status indicator recognition model.
[0019] Convolution upsampling layer: restores the feature map to the same resolution as the input image, generates a refined segmentation result, and improves the accuracy of feature extraction of traffic infrastructure operation status indicators. Output layer: generates the final traffic infrastructure operation status indicator recognition result based on the features extracted and processed by the previous layers.
[0020] The urban transportation infrastructure performance diagnosis method described in the present invention not only improves maintenance and management efficiency through accurate diagnosis and optimized resource allocation, but also ensures traffic safety and extends the life of infrastructure. It can perform comprehensive diagnosis of roads, bridges, and tunnels to ensure the safe operation of transportation infrastructure.
[0021] The urban transportation infrastructure performance diagnosis method described in the present invention can integrate multi-dimensional data, conduct comprehensive performance evaluation and diagnosis, timely warn and deal with potential risks, extend the life of infrastructure, and reduce long-term maintenance costs. Comprehensive diagnosis and digital twin methods help preventive maintenance, reduce the frequency of large-scale repairs, and improve the quality of public services and citizens' travel experience. It will have a far-reaching impact and significant improvements on the management and maintenance of urban transportation infrastructure. BRIEF DESCRIPTION OF THE DRAWINGS
[0022] Figure 1 The present invention is a flowchart of the method for diagnosing the performance of urban transportation infrastructure. DETAILED DESCRIPTION
[0023] In order to make the purpose, technical solution and advantages of the present invention more clear, the present invention is further described in detail below in conjunction with the accompanying drawings and specific embodiments. It should be understood that the specific embodiments described herein are only used to explain the present invention and are not used to limit the present invention, that is, the specific embodiments described are only part of the embodiments of the present invention, rather than all of the specific embodiments. The components of the specific embodiments of the present invention described and shown in the drawings herein can be arranged and designed in various different configurations, and the present invention can also have other embodiments.
[0024] Therefore, the following detailed description of the specific embodiments of the present invention provided in the accompanying drawings is not intended to limit the scope of the invention claimed for protection, but merely represents the selected specific embodiments of the present invention. Based on the specific embodiments of the present invention, all other specific embodiments obtained by those skilled in the art without making creative work are within the scope of protection of the present invention.
[0025] In order to further understand the content, features and effects of the present invention, the following specific implementation methods are given as examples, and the attached Figure 1 The detailed instructions are as follows:
[0026] Embodiment 1: A method for diagnosing performance of urban transportation infrastructure comprises the following steps: S1. Using a vehicle-mounted camera, collect the appearance images of traffic infrastructure during the driving process of the vehicle, define the operation status indicators of traffic infrastructure, and then select all the images including the operation status indicators of traffic infrastructure from the collected appearance images of traffic infrastructure, and annotate the operation status indicators by manual annotation to obtain a data set for urban traffic infrastructure performance diagnosis; Furthermore, the specific implementation method of step S1 includes the following steps: S1.1. Using a vehicle-mounted camera, collect images of traffic infrastructure, including images of roads, bridges, and tunnels, while the vehicle is in motion; S1.2. Define the operating status indicators of transportation infrastructure: The operating status indicators of roads include: road cracks, rutting, waves, potholes, oil spills, repairs, looseness, voids, and hollows; the operating status indicators of bridges include: bridge cracks, spalling, steel corrosion, water seepage, honeycombs, rough surfaces, demoulding defects, cable corrosion, cable corrosion, and cable breakage; the operating status indicators of tunnels include: tunnel cracks, spalling, steel corrosion, water seepage, drainage system blockage, fire inside the tunnel, landslides, and traffic accidents inside the tunnel; S1.3. Manually select the surface images of the transportation infrastructure collected in step S1.1, and then manually label the operating status indicators of roads, bridges, and tunnels; S1.4. The labeled traffic infrastructure surface images are used as a dataset for urban traffic infrastructure performance diagnosis and are divided into a training set and a test set in a ratio of 7:3.
[0027] S2. Construct an intelligent identification model for traffic infrastructure operation status indicators, including a basic model, a first auxiliary model, a second auxiliary model, and an enhanced model; Furthermore, the specific implementation method of step S2 includes the following steps: S2.1. Basic model for constructing intelligent identification model of traffic infrastructure operation status indicators: S2.1.1. The basic model A consists of 1 input layer, 14 convolutional layers, 14 activation layers, 5 pooling layers, 1 feature splitting layer, 4 concatenation layers, 4 convolution upsampling layers, and 1 output layer. The specific network structure is the following structure connected in sequence: Input layer: image size 227×227×3; Convolution layer 1: convolution kernel size 3×3; number of convolution kernels 32; stride: 1; Activation layer 1: The activation function is LeakyReLU; Convolutional layer 2: convolution kernel size 3×3; number of convolution kernels 32; Stride: 1; Activation layer 2: The activation function is LeakyReLU; Pooling layer 1: Type is maximum pooling; pooling size: 2×2; Stride: 2; Convolution layer 3: convolution kernel size 3×3; number of convolution kernels 64; stride: 1; Activation layer 3: The activation function is LeakyReLU; Convolutional layer 4: convolution kernel size 3×3; number of convolution kernels 64; Stride: 1; Activation layer 4: The activation function is LeakyReLU; Pooling layer 2: Type is maximum pooling; pooling size: 2×2; Stride: 2; Convolution layer 5: convolution kernel size 3×3; number of convolution kernels 128; stride: 1; Activation layer 5: The activation function is LeakyReLU; Convolution layer 6: convolution kernel size 3×3; number of convolution kernels 128; stride: 1; Activation layer 6: The activation function is LeakyReLU; Pooling layer 3: Type is maximum pooling; pooling size: 2×2; Stride: 2; Convolution layer 7: convolution kernel size 3×3; number of convolution kernels 256; stride: 1; Activation layer 7: The activation function is LeakyReLU; Convolution layer 8: convolution kernel size 3×3; number of convolution kernels 256; stride: 1; Activation layer 8: The activation function is LeakyReLU; Pooling layer 4: Type is maximum pooling; pooling size: 2×2; Stride: 2; Convolution layer 9: convolution kernel size 3×3; number of convolution kernels 512; stride: 1; Activation layer 9: The activation function is LeakyReLU; Convolution layer 10: kernel size 3×3; number of kernels 512; stride: 1; Activation layer 10: The activation function is LeakyReLU; Pooling layer 5: Type is maximum pooling; pooling size: 2×2; Stride: 2; Feature splitting layer: Split the 512-dimensional vector obtained above into two 256-dimensional vectors, where For the first 256-dimensional vector, perform the following operations: 1. Convolution layer 1-1: convolution kernel size 3×3; number of convolution kernels 256; stride: 1; 2. Convolutional layer 1-2: convolution kernel size 3×3; number of convolution kernels 256; stride: 1; 3. Convolutional layers 1-3: kernel size 3×3; number of kernels 256; Stride: 1; 4. Convolutional layers 1-4: kernel size 3×3; number of kernels 256; Stride: 1; 5. Feature addition layer: Add the output vectors of convolutional layers 1-2 and 1-4 to obtain a 256-dimensional vector; 6. Feature connection layer: connect the first 256-dimensional vector, the output of convolutional layers 1-2, and the data of the feature addition layer through channels, and output a 768-dimensional vector; For the second 256-dimensional vector, perform the following operations: 1. Perform channel connection with the output of the sixth feature connection layer in the first 256-dimensional vector to output a 1024-dimensional vector; 2. Convolutional layer 2-1: convolution kernel size 3×3; number of convolution kernels 512; Stride: 1; Convolution upsampling 1: Use 2×2 transposed convolution upsampling, and the output channels are halved to 256; Concatenation layer 1: connects the feature map with the output of activation layer 8, and the number of channels increases to 512; Convolution layer 11: convolution kernel size 3×3; number of convolution kernels 256; stride: 1; Activation layer 11: The activation function is LeakyReLU; Convolution upsampling 2: Use 2×2 transposed convolution upsampling, and the output channels are halved to 128; Concatenation layer 2: connects the feature map with the output of activation layer 6, and the number of channels increases to 256; Convolution layer 12: convolution kernel size 3×3; number of convolution kernels 128; stride: 1; Activation layer 12: The activation function is LeakyReLU; Convolution upsampling 3: Use 2×2 transposed convolution upsampling, and the output channels are halved to 64; Concatenation layer 3: connects the feature map with the output of activation layer 4, and the number of channels increases to 128; Convolution layer 13: kernel size 3×3; number of kernels 64; stride: 1; Activation layer 13: The activation function is LeakyReLU; Convolution upsampling 4: Use 2×2 transposed convolution upsampling, and the output channels are halved to 32; Concatenation layer 4: connects the feature map with the output of activation layer 2, and the number of channels increases to 64; Convolution layer 14: kernel size 3×3; number of kernels 32; stride: 1; Activation layer 14: the activation function is LeakyReLU; Output layer: type is normalized exponential function Softmax; number of neurons: 27; S2.1.2. Input the training set obtained in step S1 into the basic model A, calculate the weights and biases of the neural network units through the error back propagation algorithm, complete the training of the basic model A, and obtain the trained basic model A; The calculation formula of the loss function of the basic model A is: ; in, is the loss function of the basic model A; is the total number of data samples in the basic model A; For the ia The true labels of samples, Based on the prediction of model A ia The probability that a sample is class 1; S2.1.3. The node output values of the 27 output units corresponding to the basic model A are a1, a2, a3, a4, ..., a27. The node output values of the 27 output units are initially converted to obtain the output values The corresponding probability value The calculation formula is: ; In order to amplify the probability difference between the output values and enhance the model's ability to distinguish, the 27 node outputs are further optimized and converted into: ; in, G is the enhancement coefficient, and then the actual disease corresponding to each node is marked as ; Furthermore, cracks, ruts, waves, potholes, oil spills, repairs, looseness, internal cavities, and hollowing of roads; cracks, spalling, steel corrosion, water seepage, honeycombs, pitting, demoulding defects, cable corrosion, cable corrosion, cable breakage; cracks, spalling, steel corrosion, water seepage, drainage system blockage, fire inside the tunnel, landslides, and traffic accidents inside the tunnel; =1~27; S2.1.4. Adoption The training set obtained in step S1 is combined with the error chain derivation rule to train the basic model A. After the training is completed, the output values of the 27 types of diseases corresponding to the basic model A are obtained, which are recorded as , , , , …, ; S2.2. Constructing the first auxiliary model of the intelligent identification model of traffic infrastructure operation status indicators: S2.2.1. The first auxiliary model B consists of 1 input layer, 18 convolutional layers, 18 activation layers, 5 pooling layers, 1 feature splitting layer, 4 concatenation layers, 4 convolution upsampling layers, and 1 output layer. The specific network structure is the following structure connected in sequence: Input layer: image size 227×227×3; Convolution layer 1: convolution kernel size 3×3; number of convolution kernels 64; Stride: 1; Activation layer 1: The activation function is LeakyReLU; Convolutional layer 2: convolution kernel size 3×3; number of convolution kernels 64; stride: 1; Activation layer 2: The activation function is LeakyReLU; Pooling layer 1: Type is maximum pooling; pooling size: 2×2; Stride: 2; Convolution layer 3: convolution kernel size 3×3; number of convolution kernels 128; stride: 1; Activation layer 3: The activation function is LeakyReLU; Convolution layer 4: convolution kernel size 3×3; number of convolution kernels 128; stride: 1; Activation layer 4: The activation function is LeakyReLU; Pooling layer 2: Type is maximum pooling; pooling size: 2×2; Stride: 2; Convolution layer 5: convolution kernel size 3×3; number of convolution kernels 256; stride: 1; Activation layer 5: The activation function is LeakyReLU; Convolution layer 6: convolution kernel size 3×3; number of convolution kernels 256; stride: 1; Activation layer 6: The activation function is LeakyReLU; Pooling layer 3: Type is maximum pooling; pooling size: 2×2; Stride: 2; Convolution layer 7: kernel size 3×3; number of kernels 512; stride: 1; Activation layer 7: The activation function is LeakyReLU; Convolution layer 8: convolution kernel size 3×3; number of convolution kernels 512; stride: 1; Activation layer 8: The activation function is LeakyReLU; Pooling layer 4: Type is maximum pooling; pooling size: 2×2; Stride: 2; Convolution layer 9: convolution kernel size 3×3; number of convolution kernels 1024; stride: 1; Activation layer 9: The activation function is LeakyReLU; Convolution layer 10: kernel size 3×3; number of kernels 1024; stride: 1; Activation layer 10: The activation function is LeakyReLU; Pooling layer 5: Type is maximum pooling; pooling size: 2×2; Stride: 2; Feature splitting layer: Split the 1024-dimensional vector obtained above into two 512-dimensional vectors, where For the first 512-dimensional vector, perform the following operations: 1. Convolution layer 1-1: convolution kernel size 3×3; number of convolution kernels 512; stride: 1; 2. Convolutional layer 1-2: convolution kernel size 3×3; number of convolution kernels 512; stride: 1; 3. Convolutional layers 1-3: kernel size 3×3; number of kernels 512; Stride: 1; 4. Convolutional layers 1-4: kernel size 3×3; number of kernels 512; Stride: 1; 5. Feature addition layer: Add the output vectors of convolutional layers 1-2 and 1-4 to obtain a 512-dimensional vector; 6. Feature connection layer: connect the first 512-dimensional vector, the output of convolution layer 1-2, and the data of feature addition layer through channels, and output a 1536-dimensional vector; For the second 512-dimensional vector, perform the following operations: 1. Perform channel connection with the output of the feature connection layer in step 6 above and output a 2048-dimensional vector; 2. Convolutional layer 2-1: convolution kernel size 3×3; number of convolution kernels 1024; stride: 1; Convolution upsampling 1: Use 2×2 transposed convolution upsampling, and the output channels are halved to 512; Concatenation layer 1: connects the feature map with the output of activation layer 8, and the number of channels increases to 1024; Convolution layer 11: convolution kernel size 3×3; number of convolution kernels 512; stride: 1; Activation layer 11: The activation function is LeakyReLU; Convolution layer 12: convolution kernel size 3×3; number of convolution kernels 512; stride: 1; Activation layer 12: LeakyReLU; Convolution upsampling 2: Use 2×2 transposed convolution upsampling, and the output channels are halved to 256; Concatenation layer 2: connects the feature map with the output of activation layer 6, and the number of channels increases to 512; Convolution layer 13: convolution kernel size 3×3; number of convolution kernels 256; stride: 1; Activation layer 13: The activation function is LeakyReLU; Convolution layer 14: kernel size 3×3; number of kernels 256; stride: 1; Activation layer 14: the activation function is LeakyReLU; Convolution upsampling 3: Use 2×2 transposed convolution upsampling, and the output channels are halved to 128; Concatenation layer 3: connects the feature map with the output of activation layer 4, and the number of channels increases to 256; Convolution layer 15: convolution kernel size 3×3; number of convolution kernels 128; stride: 1; Activation layer 15: The activation function is LeakyReLU; Convolution layer 16: kernel size 3×3; number of kernels 128; stride: 1; Activation layer 16: The activation function is LeakyReLU; Convolution upsampling 4: Use 2×2 transposed convolution upsampling, and the output channels are halved to 64; Concatenation layer 4: connects the feature map with the output of activation layer 2, and the number of channels increases to 128; Convolution layer 17: kernel size 3×3; number of kernels 64; stride: 1; Activation layer 17: The activation function is LeakyReLU; Convolution layer 18: convolution kernel size 3×3; number of convolution kernels 64; stride: 1; Activation layer 18: The activation function is LeakyReLU; Output layer: type is normalized exponential function Softmax; number of neurons: 27; S2.2.2. Input the training set obtained in step S1 into the first auxiliary model B, calculate the weights and biases of the neural network units through the error back propagation algorithm, complete the training of the first auxiliary model B, and obtain the trained first auxiliary model B; The calculation formula of the loss function of the first auxiliary model B is: ; in, is the loss function of the first auxiliary model B; is the total number of data samples in the first auxiliary model B; For the ib The true labels of samples, The first auxiliary model B predicts ib The probability that a sample is class 1; S2.2.3. The node output values of the 27 output units corresponding to the first auxiliary model B are b1, b2, b3, b4, ..., b27. The node output values of the 27 output units are initially converted to obtain the output values b i The corresponding probability value The calculation formula is: ; Then the node output values of the 27 output units are further optimized and converted to obtain the output value b i The corresponding enhancement probability value The calculation formula is: ; S2.2.4. Adoption The training set obtained in step S1 is combined with the error chain derivation rule to train the first auxiliary model B. After the training is completed, the disease output value corresponding to the first auxiliary model B is obtained as , among the 27 nodes in the output layer, the actual disease corresponding to each node is marked as , i =1,2,3,…,27; Furthermore, cracks, ruts, waves, potholes, oil spills, repairs, looseness, internal cavities, and hollowing of roads; cracks, spalling, steel corrosion, water seepage, honeycombs, pitting, demoulding defects, cable corrosion, cable corrosion, cable breakage; cracks, spalling, steel corrosion, water seepage, drainage system blockage, fire inside the tunnel, landslides, and traffic accidents inside the tunnel; =1~27; S2.3. Constructing the second auxiliary model of the intelligent identification model of traffic infrastructure operation status indicators: S2.3.1. The second auxiliary model C consists of 1 input layer, 22 convolutional layers, 22 activation layers, 6 pooling layers, 1 feature splitting layer, 5 concatenation layers, 5 convolution upsampling layers, and 1 output layer. The specific network structure is the following structure connected in sequence: Input layer: image size 227×227×3; Convolution layer 1: convolution kernel size 3×3; number of convolution kernels 32; Stride: 1; Activation layer 1: The activation function is LeakyReLU; Convolutional layer 2: convolution kernel size 3×3; number of convolution kernels 32; Stride: 1; Activation layer 2: The activation function is LeakyReLU; Pooling layer 1: Type is maximum pooling; pooling size: 2×2; Stride: 2; Convolution layer 3: convolution kernel size 3×3; number of convolution kernels 64; stride: 1; Activation layer 3: The activation function is LeakyReLU; Convolutional layer 4: convolution kernel size 3×3; number of convolution kernels 64; Stride: 1; Activation layer 4: The activation function is LeakyReLU; Pooling layer 2: Type is maximum pooling; pooling size: 2×2; Stride: 2; Convolution layer 5: convolution kernel size 3×3; number of convolution kernels 128; stride: 1; Activation layer 5: The activation function is LeakyReLU; Convolution layer 6: convolution kernel size 3×3; number of convolution kernels 128; stride: 1; Activation layer 6: The activation function is LeakyReLU; Pooling layer 3: Type is maximum pooling; pooling size: 2×2; Stride: 2; Convolution layer 7: convolution kernel size 3×3; number of convolution kernels 256; stride: 1; Activation layer 7: The activation function is LeakyReLU; Convolution layer 8: convolution kernel size 3×3; number of convolution kernels 256; stride: 1; Activation layer 8: The activation function is LeakyReLU; Pooling layer 4: Type is maximum pooling; pooling size: 2×2; Stride: 2; Convolution layer 9: convolution kernel size 3×3; number of convolution kernels 512; stride: 1; Activation layer 9: The activation function is LeakyReLU; Convolution layer 10: kernel size 3×3; number of kernels 512; stride: 1; Activation layer 10: The activation function is LeakyReLU; Pooling layer 5: Type is maximum pooling; pooling size: 2×2; Stride: 2; Convolution layer 11: convolution kernel size 3×3; number of convolution kernels 1024; stride: 1; Activation layer 11: The activation function is LeakyReLU; Convolution layer 12: kernel size 3×3; number of kernels 1024; stride: 1; Activation layer 12: The activation function is LeakyReLU; Pooling layer 6: Type is maximum pooling; pooling size: 2×2; Stride: 2; Feature splitting layer: Split the 1024-dimensional vector obtained above into two 512-dimensional vectors, where For the first 512-dimensional vector, perform the following operations: 1. Convolution layer 1-1: convolution kernel size 3×3; number of convolution kernels 512; stride: 1; 2. Convolutional layer 1-2: convolution kernel size 3×3; number of convolution kernels 512; stride: 1; 3. Convolutional layers 1-3: kernel size 3×3; number of kernels 512; Stride: 1; 4. Convolutional layers 1-4: kernel size 3×3; number of kernels 512; Stride: 1; 5. Feature addition layer: Add the output vectors of convolutional layers 1-2 and 1-4 to obtain a 512-dimensional vector; 6. Feature connection layer: connect the first 512-dimensional vector, the output of convolution layer 1-2, and the data of feature addition layer through channels, and output a 1536-dimensional vector; For the second 512-dimensional vector, perform the following operations: 1. Perform channel connection with the output of the feature connection layer in step 6 above and output a 2048-dimensional vector; 2. Convolutional layer 2-1: convolution kernel size 3×3; number of convolution kernels 1024; stride: 1; Convolution upsampling 1: Use 2×2 transposed convolution upsampling, and the output channels are halved to 512; Concatenation layer 1: connects the feature map with the output of activation layer 10, and the number of channels increases to 1024; Convolution layer 13: kernel size 3×3; number of kernels 512; stride: 1; Activation layer 13: The activation function is LeakyReLU; Convolution layer 14: kernel size 3×3; number of kernels 512; stride: 1; Activation layer 14: the activation function is LeakyReLU; Convolution upsampling 2: Use 2×2 transposed convolution upsampling, and the output channels are halved to 256; Concatenation layer 2: connects the feature map with the output of activation layer 8, and the number of channels increases to 512; Convolution layer 15: kernel size 3×3; number of kernels 256; stride: 1; Activation layer 15: The activation function is LeakyReLU; Convolution layer 16: convolution kernel size 3×3; number of convolution kernels 256; stride: 1; Activation layer 16: The activation function is LeakyReLU; Convolution upsampling 3: Use 2×2 transposed convolution upsampling, and the output channels are halved to 128; Concatenation layer 3: connects the feature map with the output of activation layer 6, and the number of channels increases to 256; Convolution layer 17: convolution kernel size 3×3; number of convolution kernels 128; stride: 1; Activation layer 17: The activation function is LeakyReLU; Convolution layer 18: convolution kernel size 3×3; number of convolution kernels 128; stride: 1; Activation layer 18: The activation function is LeakyReLU; Convolution upsampling 4: Use 2×2 transposed convolution upsampling, and the output channels are halved to 64; Concatenation layer 4: connects the feature map with the output of activation layer 4, and the number of channels increases to 128; Convolution layer 19: convolution kernel size 3×3; number of convolution kernels 64; stride: 1; Activation layer 19: The activation function is LeakyReLU; Convolutional layer 20: convolution kernel size 3×3; number of convolution kernels 64; stride: 1; Activation layer 20: The activation function is LeakyReLU; Convolution upsampling 5: Use 2×2 transposed convolution upsampling, and the output channels are halved to 32; Concatenation layer 5: connects the feature map with the output of activation layer 2, and the number of channels increases to 64; Convolution layer 21: convolution kernel size 3×3; number of convolution kernels 32; stride: 1; Activation layer 21: The activation function is LeakyReLU; Convolutional layer 22: convolution kernel size 3×3; number of convolution kernels 32; stride: 1; Activation layer 22: The activation function is LeakyReLU; Output layer: Type: Softmax; Number of neurons: 27; S2.3.2. Input the training set obtained in step S1 into the second auxiliary model C, calculate the weights and biases of the neural network units through the error back propagation algorithm, complete the training of the second auxiliary model C, and obtain the trained second auxiliary model C; The calculation formula of the loss function of the second auxiliary model C is: ; in, is the loss function of the second auxiliary model C; is the total number of data samples in the second auxiliary model C; For the ic The true labels of samples, The second auxiliary model C predicts ic The probability that a sample is class 1; S2.3.3. The node output values of the 27 output units corresponding to the second auxiliary model C are c1, c2, c3, c4, ..., c27. The node output values of the 27 output units are initially converted to obtain The corresponding probability value The calculation formula is: ; Then the node output values of the 27 output units are further optimized and converted to obtain the output value The corresponding enhancement probability value The calculation formula is: ; in, G is the enhancement coefficient, and then the actual disease corresponding to each node is marked as ; Furthermore, cracks, ruts, waves, potholes, oil spills, repairs, looseness, internal cavities, and hollowing of roads; cracks, spalling, steel corrosion, water seepage, honeycombs, pitting, demoulding defects, cable corrosion, cable corrosion, cable breakage; cracks, spalling, steel corrosion, water seepage, drainage system blockage, fire inside the tunnel, landslides, and traffic accidents inside the tunnel; =1~27; S2.3.4. Adoption The training set obtained in step S1 is combined with the error chain derivation rule to train the second auxiliary model C. After the training is completed, the output values of the 27 types of diseases corresponding to the second auxiliary model C are obtained as follows: ; S2.4. Constructing an enhanced model for intelligent identification of traffic infrastructure operation status indicators: S2.4.1. The enhanced model D consists of 1 input layer, 26 convolutional layers, 26 activation layers, 7 pooling layers, 1 feature splitting layer, 6 concatenation layers, 6 convolution upsampling layers, and 1 output layer. The specific network structure is the following structure connected in sequence: Input layer: image size 227×227×3; Convolution layer 1: convolution kernel size 3×3; number of convolution kernels 32; Stride: 1; Activation layer 1: The activation function is LeakyReLU; Convolutional layer 2: convolution kernel size 3×3; number of convolution kernels 32; Stride: 1; Activation layer 2: The activation function is LeakyReLU; Pooling layer 1: Type is maximum pooling; pooling size: 2×2; Stride: 2; Convolution layer 3: convolution kernel size 3×3; number of convolution kernels 64; stride: 1; Activation layer 3: The activation function is LeakyReLU; Convolutional layer 4: convolution kernel size 3×3; number of convolution kernels 64; Stride: 1; Activation layer 4: The activation function is LeakyReLU; Pooling layer 2: Type is maximum pooling; pooling size: 2×2; Stride: 2; Convolution layer 5: convolution kernel size 3×3; number of convolution kernels 128; stride: 1; Activation layer 5: The activation function is LeakyReLU; Convolution layer 6: convolution kernel size 3×3; number of convolution kernels 128; stride: 1; Activation layer 6: The activation function is LeakyReLU; Pooling layer 3: Type is maximum pooling; pooling size: 2×2; Stride: 2; Convolution layer 7: convolution kernel size 3×3; number of convolution kernels 256; stride: 1; Activation layer 7: The activation function is LeakyReLU; Convolution layer 8: convolution kernel size 3×3; number of convolution kernels 256; stride: 1; Activation layer 8: The activation function is LeakyReLU; Pooling layer 4: Type is maximum pooling; pooling size: 2×2; Stride: 2; Convolution layer 9: convolution kernel size 3×3; number of convolution kernels 512; stride: 1; Activation layer 9: The activation function is LeakyReLU; Convolution layer 10: kernel size 3×3; number of kernels 512; stride: 1; Activation layer 10: The activation function is LeakyReLU; Pooling layer 5: Type is maximum pooling; pooling size: 2×2; Stride: 2; Convolution layer 11: convolution kernel size 3×3; number of convolution kernels 1024; stride: 1; Activation layer 11: The activation function is LeakyReLU; Convolution layer 12: kernel size 3×3; number of kernels 1024; stride: 1; Activation layer 12: The activation function is LeakyReLU; Pooling layer 6: Type is maximum pooling; pooling size: 2×2; Stride: 2; Convolution layer 13: kernel size 3×3; number of kernels 2048; stride: 1; Activation layer 13: The activation function is LeakyReLU; Convolution layer 14: kernel size 3×3; number of kernels 2048; stride: 1; Activation layer 14: the activation function is LeakyReLU; Pooling layer 7: Type is max pooling; pooling size: 2×2; stride: 2; Feature splitting layer: Split the 2048-dimensional vector obtained above into two 1024-dimensional vectors, where For the first 512-dimensional vector, perform the following operations: 1. Convolution layer 1-1: convolution kernel size 3×3; number of convolution kernels 1024; stride: 1; 2. Convolutional layer 1-2: convolution kernel size 3×3; number of convolution kernels 1024; stride: 1; 3. Convolutional layers 1-3: kernel size 3×3; number of kernels 1024; Stride: 1; 4. Convolutional layers 1-4: kernel size 3×3; number of kernels 1024; Stride: 1; 5. Feature addition layer: Add the output vectors of convolutional layers 1-2 and 1-4 to obtain a 1024-dimensional vector; 6. Feature connection layer: connect the first 512-dimensional vector, the output of convolutional layers 1-2, and the data of the feature addition layer through channels, and output a 3072-dimensional vector; For the second 1024-dimensional vector, perform the following operations: 1. Perform channel connection with the output of the feature connection layer in step 6 above and output a 4096-dimensional vector; 2. Convolutional layer 2-1: convolution kernel size 3×3; number of convolution kernels 2048; stride: 1; Convolution upsampling 1: Use 2×2 transposed convolution upsampling, and the output channels are halved to 1024; Concatenation layer 1: connects the feature map with the output of activation layer 12, and the number of channels increases to 2048; Convolution layer 15: kernel size 3×3; number of kernels 1024; stride: 1; Activation layer 15: The activation function is LeakyReLU; Convolution layer 16: kernel size 3×3; number of kernels 1024; stride: 1; Activation layer 16: The activation function is LeakyReLU; Convolution upsampling 2: Use 2×2 transposed convolution upsampling, and the output channels are halved to 512; Concatenation layer 2: connects the feature map with the output of activation layer 10, and the number of channels increases to 1024; Convolution layer 17: kernel size 3×3; number of kernels 512; stride: 1; Activation layer 17: The activation function is LeakyReLU; Convolution layer 18: kernel size 3×3; number of kernels 512; stride: 1; Activation layer 18: The activation function is LeakyReLU; Convolution upsampling 3: Use 2×2 transposed convolution upsampling, and the output channels are halved to 256; Concatenation layer 3: connects the feature map with the output of activation layer 8, and the number of channels increases to 512; Convolution layer 19: convolution kernel size 3×3; number of convolution kernels 256; stride: 1; Activation layer 19: The activation function is LeakyReLU; Convolutional layer 20: convolution kernel size 3×3; number of convolution kernels 256; stride: 1; Activation layer 20: The activation function is LeakyReLU; Convolution upsampling 4: Use 2×2 transposed convolution upsampling, and the output channels are halved to 128; Concatenation layer 4: connects the feature map with the output of activation layer 6, and the number of channels increases to 256; Convolutional layer 21: convolution kernel size 3×3; number of convolution kernels 128; stride: 1; Activation layer 21: The activation function is LeakyReLU; Convolutional layer 22: convolution kernel size 3×3; number of convolution kernels 128; stride: 1; Activation layer 22: The activation function is LeakyReLU; Convolution upsampling 5: Use 2×2 transposed convolution upsampling, and the output channels are halved to 64; Concatenation layer 5: connects the feature map with the output of activation layer 4, and the number of channels increases to 128; Convolution layer 23: convolution kernel size 3×3; number of convolution kernels 64; stride: 1; Activation layer 23: The activation function is LeakyReLU; Convolutional layer 24: convolution kernel size 3×3; number of convolution kernels 64; stride: 1; Activation layer 24: the activation function is LeakyReLU; Convolution upsampling 6: Use 2×2 transposed convolution upsampling, and the output channels are halved to 32; Concatenation layer 6: connects the feature map with the output of activation layer 2, and the number of channels increases to 64; Convolutional layer 25: convolution kernel size 3×3; number of convolution kernels 32; stride: 1; Activation layer 25: the activation function is LeakyReLU; Convolution layer 26: convolution kernel size 3×3; number of convolution kernels 32; stride: 1; Activation layer 26: The activation function is LeakyReLU; Output layer: Type: Softmax; Number of neurons: 27; S2.4.2. Input the training set obtained in step S1 into the enhanced model D, calculate the weights and biases of the neural network units through the error back propagation algorithm, complete the training of the enhanced model D, and obtain the trained enhanced model D; The loss function of the enhanced model D is calculated as: ; in, is the loss function of the enhanced model D; is the total number of data samples in the reinforcement model D; For the id The true labels of samples, To strengthen the model D to predict the id The probability that a sample is class 1; S2.4.3. The node output values of the 27 output units corresponding to the enhanced model D are d1, d2, d3, d4, ..., d27. The node output values of the 27 output units are initially converted to obtain The corresponding probability value The calculation formula is: ; Then the node output values of the 27 output units are further optimized and converted to obtain the output value The corresponding enhancement probability value The calculation formula is: ; in, G is the enhancement coefficient, and then the actual disease corresponding to each node is marked as ; Furthermore, cracks, ruts, waves, potholes, oil spills, repairs, looseness, internal cavities, and hollowing of roads; cracks, spalling, steel corrosion, water seepage, honeycombs, pitting, demoulding defects, cable corrosion, cable corrosion, cable breakage; cracks, spalling, steel corrosion, water seepage, drainage system blockage, fire inside the tunnel, landslides, and traffic accidents inside the tunnel; =1~27; S2.4.4. Adoption The training set obtained in step S1 is combined with the error chain derivation rule to train the enhanced model D. After the training is completed, the output values of the 27 types of diseases corresponding to the enhanced model D are obtained as follows: .
[0028] S3. Construct the loss function among the output layers of the basic model, the first auxiliary model, the second auxiliary model, and the enhanced model; Furthermore, the specific implementation method of step S3 includes the following steps: S3.1. Based on and , establish the loss function between the first auxiliary model B and the output layer of the basic model A, and the calculation formula is: ; based on and , construct the output value The corresponding probability value The loss function of the base model A , the calculation formula is: ; based on and , establish the relationship loss function between the output layer of the first auxiliary model B and the basic model A , the calculation formula is: ; in, for The weight coefficient of for The weight coefficient of S3.2. Establish the relationship loss function between the output layer of the second auxiliary model C and the first auxiliary model B , the expression is: ; in, for The weight coefficient of for The weight coefficient of Based on and The loss function of Based on and The loss function of The calculation formula is: ; The calculation formula is: ; S3.3. Establish the relationship loss function between the output layer of the second auxiliary model C and the basic model A , the expression is: ; in, for The weight coefficient of for The weight coefficient of Based on and The loss function is Based on and The loss function of The calculation formula is: ; The calculation formula is: ; S3.4. Establish the relationship loss function between the output layer of the enhanced model D and the basic model A , the expression is: ; in, for The weight coefficient of for The weight coefficient of Based on and The loss function of The calculation formula is: ; S3.5. Establish the relationship loss function between the output layer of the reinforcement model D and the second auxiliary model C , the expression is: ; in, for The weight coefficient of for The weight coefficient of Based on and The loss function is Based on and The loss function of The calculation formula is: ; The calculation formula is: .
[0029] S4. constructing the inter-layer loss function of the enhanced model and the basic model; then combining the loss function between the basic model, the first auxiliary model, the second auxiliary model and the output layer of the enhanced model obtained in step S3 to construct the overall loss function of the intelligent identification model of the operation status index of the transportation infrastructure; Furthermore, the specific implementation method of step S4 includes the following steps: S4.1. Assuming a small model a and large models d , build a small model a The second, third, fourth and output layers in the large model are d Establish connections between the fourth, sixth, tenth layers and the output layer; S4.2. For the second layer in the small model and the large model d The fourth layer in the small model establishes relationships a The output of the second layer is recorded as , the corresponding size of width × length × number of channels is Large Model d The output of the fourth layer is recorded as , the corresponding size of width × length × number of channels is ; For size comparison, When , a convolution operation is added to the second layer output of the small model, the convolution kernel size is 1×1, and the number of convolution kernels is , the output is ,at this time, The corresponding output values of each channel are , k i is the channel number, The corresponding output values of each channel are ; Build on Small model a The second floor with the large model d The loss function between the fourth layers , the calculation formula is: ; when When in the large model d In the output of the fourth layer, a convolution operation is added, the convolution kernel size is 1×1, and the number of convolution kernels is , the output is ;at this time, The corresponding output values of each channel are: , The corresponding output values of each channel are ; Establish Small model a The second floor with the large model d The loss function between the fourth layers , the calculation formula is: ; S4.3. For the third layer in the small model and the large model b The sixth layer in the relationship is established to obtain a small model a The third floor and the large model b Loss function between the sixth layers ; S4.4. For the fourth layer in the small model and the large model b The tenth layer in the relationship is established to obtain a small model a Fourth floor and large model b Loss function between the tenth layer ; S4.5. When the small model is the base model A, the small model a The second, third, and fourth layers in the graph are the output of pooling layer 1, pooling layer 2, and pooling layer 4 of the basic model A, respectively. When the large model is the enhanced model D, the large model d The fourth, sixth, and tenth layers in are the output of pooling layer 2, the output of pooling layer 3, and the output of pooling layer 5 of the enhanced model D respectively; S4.6. Define the total loss function based on the loss function between the output layer of the enhanced model D and the output layer of the base model A and the inter-layer loss function. , the calculation formula is: ; in, for The corresponding weight coefficient is, for The corresponding weight coefficient is, for The corresponding weight coefficient.
[0030] S5. Using the data set for urban transportation infrastructure performance diagnosis obtained in step S1, the constructed basic model, the first auxiliary model, the second auxiliary model, and the enhanced model are trained to obtain the trained basic model as the final intelligent identification model of transportation infrastructure operation status indicators; Furthermore, the specific implementation method of step S5 is to use the data set for urban traffic infrastructure performance diagnosis obtained in step S1, based on the chain derivative rule, and train the basic model, the first auxiliary model, the second auxiliary model, and the enhanced model constructed for rutting recognition through error back propagation. When the overall loss function obtained in step S4 When is minimum, the corresponding model parameters are optimal, and the trained basic model A is the final intelligent identification model for transportation infrastructure operation status indicators.
[0031] S6. Constructing a model of urban transportation infrastructure performance diagnosis method based on the intelligent identification model of transportation infrastructure operation status indicators obtained in step S5; Furthermore, the specific implementation method of step S6 includes the following steps: S6.1. Propose a diagnostic method for road durability and safety performance based on road infrastructure operating status indicators; S6.1.1. Setting based on crack length LCD , crack width LKD , rutting area CMJ , wave area BMJ , pit area KMJ , Oil spill area FMJ , Repair areaXMJ , loose area SMJ , establish road operation status evaluation standards and divide the road operation status standards into 5 levels; Establish a road operation status standard matrix for each level of road operation status standard : , na The road operation status standard is graded as 1, 2, 3, 4, and 5. , , , , , , , They are the standard values of the grades corresponding to crack length, crack width, rutting area, wave area, pothole area, oil spill area, repair area, and loose area; Based on the target road collection image, the intelligent recognition model of traffic infrastructure operation status indicators is used to identify the yx Cracks, ruts, waves, potholes, oil spills, repairs, loose diseases of the road, and measure and calculate the yx Length of cracks on roads , crack width , rutting area , wave area , pit area , Oil spill area , Repair area , loose area , and establish the road operation status matrix : ; Calculate the road operation status matrix Road Operation Status Standard Matrix The distance between , the calculation formula is: ; in, is the weight coefficient corresponding to the pavement crack length; is the weight coefficient corresponding to the width of the pavement crack; is the weight coefficient corresponding to the road rutting area; is the weight coefficient corresponding to the road surface wave area; is the weight coefficient corresponding to the pothole area; is the weight coefficient corresponding to the oil spill area on the road surface; is the weight coefficient corresponding to the road repair area; is the weight coefficient corresponding to the loose area of the road surface; Compare the distance between the road operation status matrix of all roads and the road operation status standard matrix, and calculate the maximum value ,get The corresponding road operation status standard level is the road operation status classification level, which is recorded as ; S6.1.2. Based on internal void clear height KDG , void volume KDT , Clearance height TKG , empty volume TKT , establish safety performance evaluation standards and divide road operation safety performance into four warning levels; Establish a road safety performance standard matrix for each level of road safety performance standard , , ba is the warning level number, which is 1, 2, 3, and 4; , , , They are the standard values corresponding to the void clear height, void volume, void clear height and void volume respectively; Based on the internal image of the road, an intelligent recognition model of traffic infrastructure operation status indicators is used to identify the yx Measure and calculate the clear height of the cavities and gaps in the road , the volume of the void and clearance height , the empty volume , and establish the yx Road Safety Performance Matrix for Roads , ; Calculate the yx Road Safety Performance Matrix for Roads Matrix with road safety performance standards The distance between : ; in, is the weight coefficient corresponding to the net height of the cavity; is the weight coefficient corresponding to the volume of the void; is the weight coefficient corresponding to the clear height of the void; is the weight coefficient corresponding to the empty volume; Compare the distance between the road safety performance matrix of all roads and the road safety performance standard matrix, and calculate the maximum value , the road safety performance level corresponding to this value is the road safety performance classification level, recorded as LAQ; S6.2. Propose a diagnostic method for bridge durability and safety performance based on the infrastructure operation status indicators of bridges; S6.2.1. Set the length of cracks based on the bridge surface. QCD , crack width QKD , peeling area QBL , Steel bar corrosion area QXS , Seepage area QSS , Cell area QFW , pockmarked surface area QMM , demoulding defect area QTM , establish the bridge operation status evaluation standard and divide the bridge operation status standard into 5 levels; Establish a bridge operating condition standard matrix for each level of bridge operating condition standard , , nb The grade numbers for the bridge operation status standards are 1, 2, 3, 4, and 5; , , , , , , , They are the standard values of the grades corresponding to the crack length, crack width, peeling area, steel bar corrosion area, water seepage area, honeycomb area, pitting area, and demoulding defect area; Based on the collected images of the target bridge, the intelligent recognition model of traffic infrastructure operation status indicators is used to identify the yx bridge cracks, spalling, steel bar corrosion, water seepage, honeycomb, pockmarks, demoulding defects, and measure and calculate the yx Length of cracks in bridges , crack width , peeling area , Steel bar corrosion area , Seepage area , Cell area , pockmarked surface area , demoulding defect area , and establish the yx Bridge operation status matrix : ; Calculate the yx Bridge operation status matrix Matrix with bridge operation status standards The distance between , the calculation formula is: ; in, is the weight coefficient corresponding to the length of the bridge crack; is the weight coefficient corresponding to the width of the bridge crack; is the weight coefficient corresponding to the bridge spalling area; is the weight coefficient corresponding to the corrosion area of bridge reinforcement; is the weight coefficient corresponding to the bridge seepage area; is the weight coefficient corresponding to the bridge honeycomb area; is the weight coefficient corresponding to the bridge pitting area; is the weight coefficient corresponding to the bridge demoulding defect area; Compare the distance between the entire bridge operation status matrix and the bridge operation status standard matrix, and calculate the maximum value ,get The corresponding bridge operation status standard level is the bridge operation status classification level, which is recorded as ; S6.2.2. Corrosion area of bridge-based cables XLX , Corrosion area of cable XLF 、Number of cable breaks XLD 2. Establish safety performance evaluation standards and divide bridge operation safety performance into four warning levels; Establish a bridge safety performance standard matrix for each level of bridge safety performance standard , , bb are the grade numbers of the bridge safety performance standards, which are 1, 2, 3, and 4. , , They are the standard values corresponding to the rust area of the inclined cable, the corrosion area of the inclined cable, and the number of broken inclined cables; Based on yx The images of bridges were collected, and the intelligent recognition model of traffic infrastructure operation status indicators was used to identify the rust area, corrosion area, and number of fractures of bridge cables, and to measure and calculate the rust area of the cables. , Corrosion area of cable 、Number of cable breaks , and establish the yx Bridge Safety Performance Matrix , ; Calculate the yx Bridge Safety Performance Matrix Matrix of Bridge Safety Performance Standards The distance between : ; in, is the weight coefficient corresponding to the corrosion area of the inclined cable, is the weight coefficient corresponding to the corrosion area of the inclined cable; is the weight coefficient corresponding to the number of cable fractures; Compare the distances between the entire bridge safety performance matrix and the bridge safety performance standard matrix, and then calculate the maximum value , the bridge safety performance level corresponding to this value is the bridge safety performance classification level, recorded as QAQ; S6.3. Based on the infrastructure operation status indicators of the tunnel, propose a diagnostic method for the durability and safety performance of the tunnel; S6.3.1. Set the crack length based on the tunnel surface SCD , crack width SKD , peeling area SBL , Steel bar corrosion area SXS , Seepage area SSS 、Number of drainage system blockages SSD , establish tunnel operation status evaluation standards and divide the tunnel operation status standards into 5 levels; Establish a tunnel operation status standard matrix for each level of tunnel operation status standard , , nc The level numbers for the tunnel operation status standards are 1, 2, 3, 4, and 5; , , , , , They are the standard values corresponding to crack length, crack width, peeling area, steel bar corrosion area, water seepage area, and number of drainage system blockages; Based on the collected images of the target tunnel, the intelligent recognition model of traffic infrastructure operation status indicators is used to identify the yx The tunnels are tested for cracks, spalling, steel bar corrosion, water seepage, drainage system blockage and other defects, and the crack length is measured and calculated. , crack width , peeling area , Steel bar corrosion area , Seepage area 、Number of drainage system blockages , establish the tunnel operation status matrix : .
[0032] Calculate the tunnel operation state matrix The distance from the tunnel operation status standard matrix SBZnc , the calculation formula is: ; in, is the weight coefficient corresponding to the tunnel crack length; is the weight coefficient corresponding to the tunnel crack width; is the weight coefficient corresponding to the tunnel spalling area; is the weight coefficient corresponding to the tunnel reinforcement corrosion area; is the weight coefficient corresponding to the tunnel seepage area; is the weight coefficient corresponding to the number of blockages in the tunnel drainage system; Compare the distances between all tunnel operation status matrices and the tunnel operation status standard matrix and calculate the maximum value ,get The corresponding tunnel operation status standard level is the tunnel operation status classification level, which is recorded as ; S6.3.2. Based on the number of fires inside the tunnel SHZ , Number of landslides SHP , Number of traffic accidents inside tunnels SJT , establish tunnel safety performance evaluation standards and divide tunnel operation safety performance into four warning levels; Establish a tunnel safety performance standard matrix for each level of tunnel safety performance standard , , bc The level numbers for tunnel safety performance standards are 1, 2, 3, and 4. , , They are the standard values corresponding to the number of fires inside the tunnel, the number of landslides, and the number of traffic accidents inside the tunnel; Based on yx The tunnels were imaged and the intelligent recognition model of traffic infrastructure operation status indicators was used to identify the yx Tunnel fire, landslide, tunnel traffic accident, calculate the yx Number of fires inside tunnels , Number of landslides , Number of traffic accidents inside tunnels , and establish the yx Tunnel Safety Performance Matrix , ; Calculate the yx Tunnel Safety Performance Matrix Safety Performance Standards Matrix The distance between : ; in, is the weight coefficient corresponding to the number of fires inside the tunnel; is the weight coefficient corresponding to the number of landslides; is the weight coefficient corresponding to the number of traffic accidents inside the tunnel; Calculate the distance between the safety performance matrix of all tunnels and the safety performance standard matrix, and then calculate the maximum value , the tunnel safety performance level corresponding to this value is the tunnel safety performance classification level, recorded as SAQ; S6.4. Develop a comprehensive diagnostic method for transportation infrastructure performance; S6.4.1. Construct a comprehensive evaluation level of transportation infrastructure durability , the calculation formula is: ; in, is the weight of the road's corresponding durability, is the weight of the corresponding durability of the bridge, is the weight of the corresponding durability of the tunnel; S6.4.2. Construct a comprehensive evaluation scale for transportation infrastructure safety , the calculation formula is: ; in, is the weight of the road's corresponding safety, is the weight of the corresponding safety of the bridge, is the weight of the corresponding safety of the tunnel; completes the construction of a model of urban transportation infrastructure performance diagnosis method, which is used to diagnose the performance of urban transportation infrastructure.
[0033] Based on the intelligent identification model of traffic infrastructure operation status indicators obtained in step S5 and the urban traffic infrastructure performance diagnosis method model obtained in step S6, a digital twin model is constructed.
[0034] Furthermore, the specific implementation method of step S7 includes the following steps: S7.1. Export the intelligent identification model of the traffic infrastructure operation status indicator obtained in step S5 and the urban traffic infrastructure performance diagnosis method model obtained in step S6 as a deployment file suitable for independent services, including one of a pt file, a pth file, a json file, and a txt file; S7.2. Construct an information model of urban transportation infrastructure; S7.2.1. Collect information on the location, length, width, and layout of urban transportation infrastructure; S7.2.2. The data obtained in step S7.2.1 is stored in a database, and a basic three-dimensional model of urban transportation infrastructure is constructed, wherein the basic three-dimensional model of urban transportation infrastructure includes geometric information of roads; S7.2.3. Based on step S7.2.2, add material properties, design specifications, and historical maintenance data to the basic three-dimensional model of the urban transportation infrastructure to obtain an urban transportation infrastructure information model; S7.2.4. Export the urban transportation infrastructure information model into a format file supported by the Web application, including a json file and a js file; S7.3. In the digital twin platform, import the deployment files of the intelligent identification model of the operation status indicators of the transportation infrastructure and the model of the performance diagnosis method of the urban transportation infrastructure obtained in step S7.1, and import the format file of the urban transportation infrastructure information model obtained in step S7.2; S7.4. Use Python to construct an API interface between an intelligent identification model for operating status indicators of transportation infrastructure and a model for a method for diagnosing the performance of urban transportation infrastructure and an urban transportation infrastructure information model, so that the operating status indicators and performance diagnosis information of urban transportation infrastructure identified and diagnosed by the intelligent identification model for operating status indicators of transportation infrastructure and a model for diagnosing the performance of urban transportation infrastructure can be updated to the database in the urban transportation infrastructure information model through the API interface, thereby completing the construction of the digital twin model.
[0035] Embodiment 2: An electronic device includes a memory and a processor, wherein the memory stores a computer program, and the processor implements the steps of a method for diagnosing performance of urban transportation infrastructure described in Example 1 when executing the computer program.
[0036] The computer device of the present invention may be a device including a processor and a memory, such as a single chip microcomputer including a central processing unit, etc. Moreover, the processor is used to implement the steps of the above-mentioned method for diagnosing the performance of urban transportation infrastructure when executing the computer program stored in the memory.
[0037] The processor may be a central processing unit (CPU), other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), field-programmable gate arrays (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. A general-purpose processor may be a microprocessor or any conventional processor, etc.
[0038] The memory may mainly include a program storage area and a data storage area, wherein the program storage area may store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc.; the data storage area may store data created according to the use of the mobile phone (such as audio data, a phone book, etc.), etc. In addition, the memory may include a high-speed random access memory, and may also include a non-volatile memory, such as a hard disk, a memory, a plug-in hard disk, a smart memory card (Smart Media Card, SMC), a secure digital (Secure Digital, SD) card, a flash card (Flash Card), at least one disk storage device, a flash memory device, or other volatile solid-state storage devices.
[0039] Embodiment 3: A computer-readable storage medium stores a computer program, which, when executed by a processor, implements a method for diagnosing performance of urban transportation infrastructure as described in Example 1.
[0040] The computer-readable storage medium of the present invention can be any form of storage medium that can be read by a processor of a computer device, including but not limited to non-volatile memory, volatile memory, ferroelectric memory, etc. A computer program is stored on the computer-readable storage medium. When the processor of the computer device reads and executes the computer program stored in the memory, the steps of the above-mentioned urban transportation infrastructure performance diagnosis method can be implemented.
[0041] The computer program includes computer program code, which may be in source code form, object code form, executable file or some intermediate form, etc. The computer readable medium may include: any entity or device capable of carrying the computer program code, recording medium, USB flash drive, mobile hard disk, magnetic disk, optical disk, computer memory, read-only memory (ROM), random access memory (RAM), electric carrier signal, telecommunication signal and software distribution medium, etc.
[0042] The key points and intended protection points of the present invention are: (1) A method for rapid and intelligent identification of operating status indicators of urban transportation infrastructure (2) A method for constructing inter-layer loss functions of basic models, auxiliary models, and enhanced models for urban transportation infrastructure (3) A comprehensive diagnostic method for urban transportation infrastructure performance (4) A digital twin approach to urban transportation infrastructure performance It should be noted that relational terms such as "first" and "second" are used only to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the sentence "comprise a ..." do not exclude the existence of other identical elements in the process, method, article or device including the elements.
[0043] Although the present application has been described above with reference to specific embodiments, various modifications may be made thereto and parts thereof may be replaced with equivalents without departing from the scope of the present application. In particular, as long as there is no structural conflict, the various features in the specific embodiments disclosed in the present application may be used in combination with each other in any manner, and the fact that these combinations are not exhaustively described in this specification is only for the sake of omitting space and saving resources. Therefore, the present application is not limited to the specific embodiments disclosed herein, but includes all technical solutions falling within the scope of the claims.
Claims
1. A method for diagnosing the performance of urban transportation infrastructure, characterized in that: The steps include: S1. Using a vehicle-mounted camera, collect the appearance images of traffic infrastructure during the driving process of the vehicle, define the operation status indicators of traffic infrastructure, and then select all the images including the operation status indicators of traffic infrastructure from the collected appearance images of traffic infrastructure, and annotate the operation status indicators by manual annotation to obtain a data set for urban traffic infrastructure performance diagnosis; S2. Construct an intelligent identification model for traffic infrastructure operation status indicators, including a basic model, a first auxiliary model, a second auxiliary model, and an enhanced model; S3. Construct the loss function among the output layers of the basic model, the first auxiliary model, the second auxiliary model, and the enhanced model; S4. constructing the inter-layer loss function of the enhanced model and the basic model; then combining the loss function between the basic model, the first auxiliary model, the second auxiliary model and the output layer of the enhanced model obtained in step S3 to construct the overall loss function of the intelligent identification model of the operation status index of the transportation infrastructure; S5. Using the data set for urban transportation infrastructure performance diagnosis obtained in step S1, the constructed basic model, the first auxiliary model, the second auxiliary model, and the enhanced model are trained to obtain the trained basic model as the final intelligent identification model of transportation infrastructure operation status indicators; S6. Constructing a model of urban transportation infrastructure performance diagnosis method based on the intelligent identification model of transportation infrastructure operation status indicators obtained in step S5; S7. Based on the intelligent identification model of traffic infrastructure operation status indicators obtained in step S5 and the model of a method for diagnosing the performance of urban traffic infrastructure obtained in step S6, a digital twin model is constructed.
2. The method for diagnosing the performance of urban transportation infrastructure according to claim 1, characterized in that: The specific implementation method of step S1 includes the following steps: S1.
1. Using a vehicle-mounted camera, collect images of traffic infrastructure, including images of roads, bridges, and tunnels, while the vehicle is in motion; S1.
2. Define the operating status indicators of transportation infrastructure: The operating status indicators of roads include: road cracks, rutting, waves, potholes, oil spills, repairs, looseness, voids, and hollows; the operating status indicators of bridges include: bridge cracks, spalling, steel corrosion, water seepage, honeycombs, rough surfaces, demoulding defects, cable corrosion, cable corrosion, and cable breakage; the operating status indicators of tunnels include: tunnel cracks, spalling, steel corrosion, water seepage, drainage system blockage, fire inside the tunnel, landslides, and traffic accidents inside the tunnel; S1.
3. Manually select the surface images of the transportation infrastructure collected in step S1.1, and then manually label the operating status indicators of roads, bridges, and tunnels; S1.
4. The labeled traffic infrastructure surface images are used as a dataset for urban traffic infrastructure performance diagnosis and are divided into a training set and a test set in a ratio of 7:
3.
3. A method for diagnosing the performance of urban transportation infrastructure according to claim 1 or 2, characterized in that: The specific implementation method of step S2 includes the following steps: S2.
1. Basic model for constructing intelligent identification model of traffic infrastructure operation status indicators: S2.1.
1. The basic model A consists of 1 input layer, 14 convolutional layers, 14 activation layers, 5 pooling layers, 1 feature splitting layer, 4 concatenation layers, 4 convolutional upsampling layers, and 1 output layer. S2.1.
2. Input the training set obtained in step S1 into the basic model A, calculate the weights and biases of the neural network units through the error back propagation algorithm, complete the training of the basic model A, and obtain the trained basic model A; The calculation formula of the loss function of the basic model A is: ; in, is the loss function of the basic model A; is the total number of data samples in the basic model A; For the ia The true labels of samples, Based on the prediction of model A ia The probability that a sample is class 1; S2.1.
3. The node output values of the 27 output units corresponding to the basic model A are a1, a2, a3, a4, ..., a27. The node output values of the 27 output units are initially converted to obtain the output values The corresponding probability value The calculation formula is: ; In order to amplify the probability difference between the output values and enhance the model's ability to distinguish, the 27 node outputs are further optimized and converted into: ; in, G is the enhancement coefficient, and then the actual disease corresponding to each node is marked as ; S2.1.
4. Adoption The training set obtained in step S1 is combined with the error chain derivation rule to train the basic model A. After the training is completed, the output values of the 27 types of diseases corresponding to the basic model A are obtained, which are recorded as , , , , …, ; S2.
2. Constructing the first auxiliary model of the intelligent identification model of traffic infrastructure operation status indicators: S2.2.
1. The first auxiliary model B consists of 1 input layer, 18 convolutional layers, 18 activation layers, 5 pooling layers, 1 feature splitting layer, 4 concatenation layers, 4 convolutional upsampling layers, and 1 output layer; S2.2.
2. Input the training set obtained in step S1 into the first auxiliary model B, calculate the weights and biases of the neural network units through the error back propagation algorithm, complete the training of the first auxiliary model B, and obtain the trained first auxiliary model B; The calculation formula of the loss function of the first auxiliary model B is: ; in, is the loss function of the first auxiliary model B; is the total number of data samples in the first auxiliary model B; For the ib The true labels of samples, The first auxiliary model B predicts ib The probability that a sample is class 1; S2.2.
3. The node output values of the 27 output units corresponding to the first auxiliary model B are b1, b2, b3, b4, ..., b27. The node output values of the 27 output units are initially converted to obtain the output values b i The corresponding probability value The calculation formula is: ; Then the node output values of the 27 output units are further optimized and converted to obtain the output value b i The corresponding enhancement probability value The calculation formula is: ; S2.2.
4. Adoption The training set obtained in step S1 is combined with the error chain derivation rule to train the first auxiliary model B. After the training is completed, the disease output value corresponding to the first auxiliary model B is obtained as , among the 27 nodes in the output layer, the actual disease corresponding to each node is marked as , i =1,2,3,…,27; S2.
3. Constructing the second auxiliary model of the intelligent identification model of traffic infrastructure operation status indicators: S2.3.
1. The second auxiliary model C consists of 1 input layer, 22 convolutional layers, 22 activation layers, 6 pooling layers, 1 feature splitting layer, 5 concatenation layers, 5 convolution upsampling layers, and 1 output layer; S2.3.
2. Input the training set obtained in step S1 into the second auxiliary model C, calculate the weights and biases of the neural network units through the error back propagation algorithm, complete the training of the second auxiliary model C, and obtain the trained second auxiliary model C; The calculation formula of the loss function of the second auxiliary model C is: ; in, is the loss function of the second auxiliary model C; is the total number of data samples in the second auxiliary model C; For the ic The true labels of samples, The second auxiliary model C predicts ic The probability that a sample is class 1; S2.3.
3. The node output values of the 27 output units corresponding to the second auxiliary model C are c1, c2, c3, c4, ..., c27. The node output values of the 27 output units are initially converted to obtain The corresponding probability value The calculation formula is: ; Then the node output values of the 27 output units are further optimized and converted to obtain the output value The corresponding enhancement probability value The calculation formula is: ; in, G is the enhancement coefficient, and then the actual disease corresponding to each node is marked as ; S2.3.
4. Adoption The training set obtained in step S1 is combined with the error chain derivation rule to train the second auxiliary model C. After the training is completed, the output values of the 27 types of diseases corresponding to the second auxiliary model C are obtained as follows: ; S2.
4. Constructing an enhanced model for intelligent identification of traffic infrastructure operation status indicators: S2.4.
1. The enhanced model D consists of 1 input layer, 26 convolutional layers, 26 activation layers, 7 pooling layers, 1 feature splitting layer, 6 concatenation layers, 6 convolutional upsampling layers, and 1 output layer; S2.4.
2. Input the training set obtained in step S1 into the enhanced model D, calculate the weights and biases of the neural network units through the error back propagation algorithm, complete the training of the enhanced model D, and obtain the trained enhanced model D; The loss function of the enhanced model D is calculated as: ; in, is the loss function of the enhanced model D; is the total number of data samples in the reinforcement model D; For the id The true labels of samples, To strengthen the model D to predict the id The probability that a sample is class 1; S2.4.
3. The node output values of the 27 output units corresponding to the enhanced model D are d1, d2, d3, d4, ..., d27. The node output values of the 27 output units are initially converted to obtain The corresponding probability value The calculation formula is: ; Then the node output values of the 27 output units are further optimized and converted to obtain the output value The corresponding enhancement probability value The calculation formula is: ; in, G is the enhancement coefficient, and then the actual disease corresponding to each node is marked as ; S2.4.
4. Adoption The training set obtained in step S1 is combined with the error chain derivation rule to train the enhanced model D. After the training is completed, the output values of the 27 types of diseases corresponding to the enhanced model D are obtained as follows: .
4. The method for diagnosing the performance of urban transportation infrastructure according to claim 3, characterized in that: The specific implementation method of step S3 includes the following steps: S3.
1. Based on and , establish the loss function between the first auxiliary model B and the output layer of the basic model A, and the calculation formula is: ; based on and , construct the output value The corresponding probability value The loss function of the base model A , the calculation formula is: ; based on and , establish the relationship loss function between the output layer of the first auxiliary model B and the basic model A , the calculation formula is: ; in, for The weight coefficient of for The weight coefficient of S3.
2. Establish the relationship loss function between the output layer of the second auxiliary model C and the first auxiliary model B , the expression is: ; in, for The weight coefficient of for The weight coefficient of Based on and The loss function of Based on and The loss function of The calculation formula is: ; The calculation formula is: ; S3.
3. Establish the relationship loss function between the output layer of the second auxiliary model C and the basic model A , the expression is: ; in, for The weight coefficient of for The weight coefficient of Based on and The loss function is Based on and The loss function of The calculation formula is: ; The calculation formula is: ; S3.
4. Establish the relationship loss function between the output layer of the enhanced model D and the basic model A , the expression is: ; in, for The weight coefficient of for The weight coefficient of Based on and The loss function of The calculation formula is: ; S3.
5. Establish the relationship loss function between the output layer of the reinforcement model D and the second auxiliary model C , the expression is: ; in, for The weight coefficient of for The weight coefficient of Based on and The loss function is Based on and The loss function of The calculation formula is: ; The calculation formula is: 。 5. The method for diagnosing the performance of urban transportation infrastructure according to claim 4, characterized in that: The specific implementation method of step S4 includes the following steps: S4.
1. Assuming a small model a and large models d , build a small model a The second, third, fourth and output layers in the large model are d Establish connections between the fourth, sixth, tenth layers and the output layer; S4.
2. For the second layer in the small model and the large model d The fourth layer in the small model establishes relationships a The output of the second layer is recorded as , the corresponding size of width × length × number of channels is Large Model d The output of the fourth layer is recorded as , the corresponding size of width × length × number of channels is ; For size comparison, When , a convolution operation is added to the second layer output of the small model, the convolution kernel size is 1×1, and the number of convolution kernels is , the output is ,at this time, The corresponding output values of each channel are , k i is the channel number, The corresponding output values of each channel are ; Build on Small model a The second floor with the large model d The loss function between the fourth layers , the calculation formula is: ; when When in the large model d In the output of the fourth layer, a convolution operation is added, the convolution kernel size is 1×1, and the number of convolution kernels is , the output is ;at this time, The corresponding output values of each channel are: , The corresponding output values of each channel are ; Establish Small model a The second floor with the large model d The loss function between the fourth layers , the calculation formula is: ; S4.
3. For the third layer in the small model and the large model b The sixth layer in the relationship is established to obtain a small model a The third floor and the large model b Loss function between the sixth layers ; S4.
4. For the fourth layer in the small model and the large model b The tenth layer in the relationship is established to obtain a small model a Fourth floor and large model b Loss function between the tenth layer ; S4.
5. When the small model is the base model A, the small model a The second, third, and fourth layers in the graph are the output of pooling layer 1, pooling layer 2, and pooling layer 4 of the basic model A, respectively. When the large model is the enhanced model D, the large model d The fourth, sixth, and tenth layers in are the output of pooling layer 2, the output of pooling layer 3, and the output of pooling layer 5 of the enhanced model D respectively; S4.
6. Define the total loss function based on the loss function between the output layer of the enhanced model D and the output layer of the base model A and the inter-layer loss function. , the calculation formula is: ; in, for The corresponding weight coefficient is, for The corresponding weight coefficient is, for The corresponding weight coefficient.
6. The method for diagnosing the performance of urban transportation infrastructure according to claim 5, characterized in that: The specific implementation method of step S5 is to use the data set for urban traffic infrastructure performance diagnosis obtained in step S1, based on the chain derivative rule, and train the basic model, the first auxiliary model, the second auxiliary model, and the enhanced model for rutting recognition by means of error back propagation. When the overall loss function obtained in step S4 is When is minimum, the corresponding model parameters are optimal, and the trained basic model A is the final intelligent identification model for transportation infrastructure operation status indicators.
7. The method for diagnosing the performance of urban transportation infrastructure according to claim 6, characterized in that: The specific implementation method of step S6 includes the following steps: S6.
1. Propose a diagnostic method for road durability and safety performance based on road infrastructure operating status indicators; S6.1.
1. Setting based on crack length LCD , crack width LKD , rutting area CMJ , wave area BMJ , pit area KMJ , Oil spill area FMJ , Repair area XJ , loose area SMJ , establish road operation status evaluation standards and divide the road operation status standards into 5 levels; Establish a road operation status standard matrix for each level of road operation status standard : , na The road operation status standard is graded as 1, 2, 3, 4, and 5. , , , , , , , They are the standard values of the grades corresponding to crack length, crack width, rutting area, wave area, pothole area, oil spill area, repair area, and loose area; Based on the target road collection image, the intelligent recognition model of traffic infrastructure operation status indicators is used to identify the yx Cracks, ruts, waves, potholes, oil spills, repairs, loose diseases of the road, and measure and calculate the yx Length of cracks on roads , crack width , rutting area , wave area , pit area , Oil spill area , Repair area , loose area , and establish the road operation status matrix : ; Calculate the road operation status matrix Road Operation Status Standard Matrix The distance between , the calculation formula is: ; in, is the weight coefficient corresponding to the pavement crack length; is the weight coefficient corresponding to the width of the pavement crack; is the weight coefficient corresponding to the road rutting area; is the weight coefficient corresponding to the road surface wave area; is the weight coefficient corresponding to the pothole area; is the weight coefficient corresponding to the oil spill area on the road surface; is the weight coefficient corresponding to the road repair area; is the weight coefficient corresponding to the loose area of the road surface; Compare the distance between the road operation status matrix of all roads and the road operation status standard matrix, and calculate the maximum value ,get The corresponding road operation status standard level is the road operation status classification level, which is recorded as ; S6.1.
2. Based on internal void clear height KDG , void volume KDT , Clearance height TKG , empty volume TKT , establish safety performance evaluation standards and divide road operation safety performance into four warning levels; Establish a road safety performance standard matrix for each level of road safety performance standard , , ba is the warning level number, which is 1, 2, 3, and 4; , , , They are the standard values corresponding to the void clear height, void volume, void clear height and void volume respectively; Based on the internal image of the road, an intelligent recognition model of traffic infrastructure operation status indicators is used to identify the yx Measure and calculate the clear height of the cavities and gaps in the road , the volume of the void and clearance height , the empty volume , and establish the yx Road Safety Performance Matrix for Roads , ; Calculate the yx Road Safety Performance Matrix for Roads Matrix with road safety performance standards The distance between : ; in, is the weight coefficient corresponding to the net height of the cavity; is the weight coefficient corresponding to the volume of the void; is the weight coefficient corresponding to the clear height of the void; is the weight coefficient corresponding to the empty volume; Compare the distance between the road safety performance matrix of all roads and the road safety performance standard matrix, and calculate the maximum value , the road safety performance level corresponding to this value is the road safety performance classification level, recorded as LAQ; S6.
2. Propose a diagnostic method for bridge durability and safety performance based on the infrastructure operation status indicators of bridges; S6.2.
1. Set the length of cracks based on the bridge surface. QCD , crack width QKD , peeling area QBL , Steel bar corrosion area QXS , Seepage area QSS , Cell area QW , pockmarked surface area QMM , demoulding defect area QTM , establish the bridge operation status evaluation standard and divide the bridge operation status standard into 5 levels; Establish a bridge operating condition standard matrix for each level of bridge operating condition standard , , nb The grade numbers for the bridge operation status standards are 1, 2, 3, 4, and 5; , , , , , , , They are the standard values of the grades corresponding to the crack length, crack width, peeling area, steel bar corrosion area, water seepage area, honeycomb area, pitting area, and demoulding defect area; Based on the collected images of the target bridge, the intelligent recognition model of traffic infrastructure operation status indicators is used to identify the yx bridge cracks, spalling, steel bar corrosion, water seepage, honeycomb, pockmarks, demoulding defects, and measure and calculate the yx Length of cracks in bridges , crack width , peeling area , Steel bar corrosion area , Seepage area , Cell area , pockmarked surface area , demoulding defect area , and establish the yx Bridge operation status matrix : ; Calculate the yx Bridge operation status matrix Matrix with bridge operation status standards The distance between , the calculation formula is: ; in, is the weight coefficient corresponding to the length of the bridge crack; is the weight coefficient corresponding to the width of the bridge crack; is the weight coefficient corresponding to the bridge spalling area; is the weight coefficient corresponding to the corrosion area of bridge reinforcement; is the weight coefficient corresponding to the bridge seepage area; is the weight coefficient corresponding to the bridge honeycomb area; is the weight coefficient corresponding to the bridge pitting area; is the weight coefficient corresponding to the bridge demoulding defect area; Compare the distance between the entire bridge operation status matrix and the bridge operation status standard matrix, and calculate the maximum value ,get The corresponding bridge operation status standard level is the bridge operation status classification level, which is recorded as ; S6.2.
2. Corrosion area of bridge-based cables XL , Corrosion area of cable XLF 、Number of cable breaks XLD 2. Establish safety performance evaluation standards and divide bridge operation safety performance into four warning levels; Establish a bridge safety performance standard matrix for each level of bridge safety performance standard , , bb are the grade numbers of the bridge safety performance standards, which are 1, 2, 3, and 4. , , They are the standard values corresponding to the rust area of the inclined cable, the corrosion area of the inclined cable, and the number of broken inclined cables; Based on yx The images of bridges were collected, and the intelligent recognition model of traffic infrastructure operation status indicators was used to identify the rust area, corrosion area, and number of fractures of bridge cables, and to measure and calculate the rust area of the cables. , Corrosion area of cable 、Number of cable breaks , and establish the yx Bridge Safety Performance Matrix , ; Calculate the yx Bridge Safety Performance Matrix Matrix of Bridge Safety Performance Standards The distance between : ; in, is the weight coefficient corresponding to the corrosion area of the inclined cable, is the weight coefficient corresponding to the corrosion area of the inclined cable; is the weight coefficient corresponding to the number of cable fractures; Compare the distances between the entire bridge safety performance matrix and the bridge safety performance standard matrix, and then calculate the maximum value , the bridge safety performance level corresponding to this value is the bridge safety performance classification level, recorded as QAQ; S6.
3. Based on the infrastructure operation status indicators of the tunnel, propose a diagnostic method for the durability and safety performance of the tunnel; S6.3.
1. Set the crack length based on the tunnel surface SCD , crack width SKD , peeling area SBL , Steel bar corrosion area SXS , Seepage area SSS 、Number of drainage system blockages SSD , establish tunnel operation status evaluation standards and divide the tunnel operation status standards into 5 levels; Establish a tunnel operation status standard matrix for each level of tunnel operation status standard , , nc The level numbers for the tunnel operation status standards are 1, 2, 3, 4, and 5; , , , , , They are the standard values corresponding to crack length, crack width, peeling area, steel bar corrosion area, water seepage area, and number of drainage system blockages; Based on the collected images of the target tunnel, the intelligent recognition model of traffic infrastructure operation status indicators is used to identify the yx The tunnels are tested for cracks, spalling, steel bar corrosion, water seepage, drainage system blockage and other defects, and the crack length is measured and calculated. , crack width , peeling area , Steel bar corrosion area , Seepage area 、Number of drainage system blockages , establish the tunnel operation status matrix : ; Calculate the tunnel operation state matrix The distance from the tunnel operation status standard matrix SBZnc , the calculation formula is: ; in, is the weight coefficient corresponding to the tunnel crack length; is the weight coefficient corresponding to the tunnel crack width; is the weight coefficient corresponding to the tunnel spalling area; is the weight coefficient corresponding to the tunnel reinforcement corrosion area; is the weight coefficient corresponding to the tunnel seepage area; is the weight coefficient corresponding to the number of blockages in the tunnel drainage system; Compare the distances between all tunnel operation status matrices and the tunnel operation status standard matrix and calculate the maximum value ,get The corresponding tunnel operation status standard level is the tunnel operation status classification level, which is recorded as ; S6.3.
2. Based on the number of fires inside the tunnel SZ , Number of landslides SHP , Number of traffic accidents inside tunnels SJT , establish tunnel safety performance evaluation standards and divide tunnel operation safety performance into four warning levels; Establish a tunnel safety performance standard matrix for each level of tunnel safety performance standard , , bc The level numbers for tunnel safety performance standards are 1, 2, 3, and 4. , , They are the standard values corresponding to the number of fires inside the tunnel, the number of landslides, and the number of traffic accidents inside the tunnel; Based on yx The tunnels were imaged and the intelligent recognition model of traffic infrastructure operation status indicators was used to identify the yx Tunnel fire, landslide, tunnel traffic accident, calculate the yx Number of fires inside tunnels , Number of landslides , Number of traffic accidents inside tunnels , and establish the yx Tunnel Safety Performance Matrix , ; Calculate the yx Tunnel Safety Performance Matrix Safety Performance Standards Matrix The distance between : ; in, is the weight coefficient corresponding to the number of fires inside the tunnel; is the weight coefficient corresponding to the number of landslides; is the weight coefficient corresponding to the number of traffic accidents inside the tunnel; Calculate the distance between the safety performance matrix of all tunnels and the safety performance standard matrix, and then calculate the maximum value , the tunnel safety performance level corresponding to this value is the tunnel safety performance classification level, recorded as SAQ; S6.
4. Develop a comprehensive diagnostic method for transportation infrastructure performance; S6.4.
1. Construct a comprehensive evaluation level of transportation infrastructure durability , the calculation formula is: ; in, is the weight of the road's corresponding durability, is the weight of the corresponding durability of the bridge, is the weight of the corresponding durability of the tunnel; S6.4.
2. Construct a comprehensive evaluation scale for transportation infrastructure safety , the calculation formula is: ; in, is the weight of the road's corresponding safety, is the weight of the corresponding safety of the bridge, is the weight of the corresponding safety of the tunnel; completes the construction of a model of urban transportation infrastructure performance diagnosis method, which is used to diagnose the performance of urban transportation infrastructure.
8. The method for diagnosing the performance of urban transportation infrastructure according to claim 6, characterized in that: The specific implementation method of step S7 includes the following steps: S7.
1. Export the intelligent identification model of the traffic infrastructure operation status indicator obtained in step S5 and the urban traffic infrastructure performance diagnosis method model obtained in step S6 as a deployment file suitable for independent services, including one of a pt file, a pth file, a json file, and a txt file; S7.
2. Construct an information model of urban transportation infrastructure; S7.2.
1. Collect information on the location, length, width, and layout of urban transportation infrastructure; S7.2.
2. The data obtained in step S7.2.1 is stored in a database, and a basic three-dimensional model of urban transportation infrastructure is constructed, wherein the basic three-dimensional model of urban transportation infrastructure includes geometric information of roads; S7.2.
3. Based on step S7.2.2, add material properties, design specifications, and historical maintenance data to the basic three-dimensional model of the urban transportation infrastructure to obtain an urban transportation infrastructure information model; S7.2.
4. Export the urban transportation infrastructure information model into a format file supported by the Web application, including a json file and a js file; S7.
3. In the digital twin platform, import the deployment files of the intelligent identification model of the operation status indicators of the transportation infrastructure and the model of the performance diagnosis method of the urban transportation infrastructure obtained in step S7.1, and import the format file of the urban transportation infrastructure information model obtained in step S7.2; S7.
4. Use Python to construct an API interface between an intelligent identification model for operating status indicators of transportation infrastructure and a model for a method for diagnosing the performance of urban transportation infrastructure and an urban transportation infrastructure information model, so that the operating status indicators and performance diagnosis information of urban transportation infrastructure identified and diagnosed by the intelligent identification model for operating status indicators of transportation infrastructure and a model for diagnosing the performance of urban transportation infrastructure can be updated to the database in the urban transportation infrastructure information model through the API interface, thereby completing the construction of the digital twin model.
9. An electronic device, characterized in that: The method comprises a memory and a processor, wherein the memory stores a computer program, and the processor implements the steps of a method for diagnosing the performance of urban transportation infrastructure as claimed in any one of claims 1 to 8 when executing the computer program.
10. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the method for diagnosing the performance of urban transportation infrastructure as described in any one of claims 1 to 8 is implemented.
Citation Information
Patent Citations
Urban bridge group state evaluation method based on axle coupling and digital twinning
CN114444983A
Holographic inspection monitoring method and system for traffic infrastructure
CN117078045A
Intelligent traffic infrastructure inspection management platform based on artificial intelligence
CN118887805A
System for assessmenting potential risk of traffic accident and method thereof
KR102453688B1
System and method for constructing digital twin based on road traffic
KR102679822B1
