A highway disease positioning method and system based on detection and treatment integration
Patent Information
- Application Number
- CN202310424560.9
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2023-04-20
- Publication Date
- 2026-10-30
- Estimated Expiration
- 2043-04-20
AI Technical Summary
[0002]高速公路路面、桥梁、隧道等结构物的检测、养护过程中,面临着两个主要问题:一是如何快速找到对应的病害,二是病害库的维护及应用
[0015]本申请所提供的基于检养一体化的公路病害定位方法及系统,其通过接收检测人员所提供的检测数据,获取公路病害信息,将公路病害信息同步更新至病害库;配合养护人员所提供的养护数据,将养护数据与相应的病害进行匹配,在病害库中更新公路病害的养护信息记录。由此,本申请能够通过比对公路病害信息、病害养护信息,实现病害信息同步,跟踪同一编号病害的演化过程以便后续对病害发展过程的分析,获得病害之间的衍生关系,以及特定位置范围内病害之间的关联关系,实现对养护方法实施效果的有效评估。本申请对病害过程的监控还能有效避免重复养护现象,提升养护效率。
Smart Images

Figure CN116681416B_ABST
Abstract
Description
Technical Field
[0001] This application relates to the field of highway maintenance technology, and more specifically to a method and system for locating highway defects based on integrated inspection and maintenance. Background Technology
[0002] In the process of inspecting and maintaining structures such as highway pavements, bridges, and tunnels, two main problems are faced: first, how to quickly identify the corresponding defects; and second, the maintenance and application of the defect database.
[0003] Current technologies for locating road surface defects mainly rely on satellite positioning, which often fails to provide accurate location information in urban centers with significant building obstructions, tunnels, and mountainous areas. When accurate location information is unavailable, maintenance personnel must expend extra effort to pinpoint the location of the defects, impacting operational efficiency.
[0004] The existing disease database only records the location information and general types of road diseases. It cannot compare the development of diseases before and after maintenance, cannot provide the system with disease prediction information, and cannot effectively track the maintenance effect of diseases. Summary of the Invention
[0005] This application addresses the shortcomings of existing technologies by providing a method and system for locating highway defects based on integrated inspection and maintenance. This application integrates multiple location methods and uses feature matching to track and record road defects in a defect database. Specifically, this application can adopt the following technical solution.
[0006] First, to achieve the above objectives, a highway defect location method based on integrated inspection and maintenance is proposed. The steps include: receiving inspection data provided by inspectors, acquiring highway defect information, recording inspection time, inspection method, defect type, defect severity, and defect images, and synchronously updating the highway defect information to the defect database; receiving maintenance data provided by maintenance personnel, matching the maintenance data with the corresponding defects, and updating the highway defect maintenance information records in the defect database; synchronizing the highway defect information, defect maintenance information, and BIM 3D model; then, based on the highway defect information and defect maintenance information recorded in the defect database, tracking the evolution process of defects with the same number, tracking the frequency of defect recurrence after maintenance within the same location error range, analyzing the derivative relationship between the same defect and other defects, analyzing the correlation relationship between defects within the same location error range, locating highway defects, evaluating the implementation effect of maintenance methods, and identifying duplicate maintenance phenomena.
[0007] Optionally, in any of the above-described highway defect location methods based on integrated inspection and maintenance, the specific steps for matching maintenance data with corresponding defects include: for pavement defects, first determining whether satellite positioning is effective; if satellite positioning is effective, preferably simultaneously determining whether maintenance data matches defect location in the defect database based on satellite positioning data, defect image features, and manual confirmation results; secondly, determining whether maintenance data matches defect location in the defect database based on both satellite positioning data and manual confirmation results; if satellite positioning is invalid, preferably simultaneously determining whether maintenance data matches defect location in the defect database based on both highway station number, defect image features, and manual confirmation results; secondly, determining whether maintenance data matches defect location in the defect database based on both highway station number and manual confirmation results.
[0008] Optionally, in any of the above-described highway defect location methods based on integrated inspection and maintenance, the specific steps for matching maintenance data with corresponding defects include: for bridge defects, first determining whether satellite positioning is valid; if satellite positioning is valid, preferably simultaneously determining whether maintenance data matches defect location in the defect database based on satellite positioning data, bridge grid-based QR codes, defect image features, and manual confirmation results; secondly, determining whether maintenance data matches defect location in the defect database based on satellite positioning data, defect image features, and manual confirmation results; if satellite positioning is invalid, preferably simultaneously determining whether maintenance data matches defect location in the defect database based on bridge BIM 3D model, bridge grid-based QR codes, defect image features, and manual confirmation results; secondly, determining whether maintenance data matches defect location in the defect database based on bridge BIM 3D model, defect image features, and manual confirmation results; finally, determining whether maintenance data matches defect location in the defect database based on bridge BIM 3D model and manual confirmation results.
[0009] Optionally, in any of the above-mentioned highway defect location methods based on integrated inspection and maintenance, the specific steps for matching maintenance data with corresponding defects include: for tunnel defects, preferably, simultaneously judging whether the maintenance data matches the defect location in the defect database based on the tunnel BIM 3D model, the tunnel grid division QR code, defect image features, and manual confirmation results; secondly, judging whether the maintenance data matches the defect location in the defect database based on the tunnel BIM 3D model, defect image features, and manual confirmation results; and finally, judging whether the maintenance data matches the defect location in the defect database based on the tunnel BIM 3D model and manual confirmation results.
[0010] Optionally, in any of the above-described highway defect location methods based on integrated inspection and maintenance, the correlation between defects within the same location error range is determined jointly based on whether the defect image features match and the conclusion of manual judgment. After determining that there is a correlation between defects within the same location error range, the following steps are further performed: determining whether the defect has been maintained; if the defect has not been maintained, analyzing the changes in the defect and adding a new record under the defect's number; simultaneously detecting newly added defects in the surrounding area and generating associated defect records; if the defect has been maintained, performing feature matching on the defect images before and after maintenance and analyzing the occurrence of surrounding defects.
[0011] Optionally, in any of the above-mentioned integrated inspection and maintenance method for locating highway defects, if it is difficult to determine whether defects within the same location error range are the same defect through defect image feature matching or manual judgment, new highway defect information is added. The newly received highway defect information records the detection time, detection method, defect type, defect severity, and defect image of the newly received highway defect.
[0012] To achieve the above objectives, this application also provides a highway defect location system based on any of the methods described above, comprising: a detection system for receiving detection data provided by inspection personnel, acquiring highway defect information, recording detection time, detection method, defect type, defect severity, and defect images, and synchronously updating the defect database; a maintenance system for receiving maintenance data provided by maintenance personnel, matching the maintenance data with the corresponding defects detected by the detection system, and updating the highway defect maintenance information records in the defect database; and a defect database for receiving and recording the highway defect information uploaded by the detection system. The system receives and records road damage and maintenance information uploaded by the maintenance system, and compares the road damage and maintenance information with the BIM 3D model to synchronize the damage information. The damage analysis module connects to the damage database, tracks the evolution of damage with the same number based on the road damage and maintenance information recorded in the database, tracks the frequency of recurrence of damage after maintenance within the same location error range, analyzes the derivative relationship between the same damage and other damages, analyzes the correlation between damages within the same location error range, locates road damage, evaluates the implementation effect of maintenance methods, and identifies duplicate maintenance phenomena.
[0013] Optionally, the highway defect location system described above further includes a detection database, which acquires road defect information through a road defect detection device. While storing defect information in the defect database, it simultaneously records the detection time, detection method, defect type, and defect severity, acquires defect images of the road surface to be tested, and the BeiDou / GPS latitude and longitude information of the shooting location or the corresponding highway station number, grid division QR code, and BIM 3D model location. The detection database also generates multiple defect records simultaneously for the same BeiDou / GPS information when there are multiple defects at the same BeiDou / GPS location, storing the defect structure type, defect discovery time, defect number, defect location, defect type, defect severity, and defect image.
[0014] Optionally, the highway defect location system described above also includes a maintenance database, which acquires defect images of the road surface to be maintained through a handheld terminal processing system. While storing defect maintenance information in the defect database, it simultaneously records road surface defect maintenance information, including maintenance time, maintenance method, defect images before maintenance, and defect images after maintenance for the corresponding defect number. Beneficial effects
[0015] The highway defect location method and system based on integrated inspection and maintenance provided in this application acquires highway defect information by receiving inspection data provided by inspectors and synchronously updating the defect information to a defect database. In conjunction with maintenance data provided by maintenance personnel, the system matches the maintenance data with corresponding defects and updates the maintenance information records of highway defects in the defect database. Therefore, this application can achieve synchronized defect information by comparing highway defect information and defect maintenance information, track the evolution process of defects with the same number for subsequent analysis of defect development, obtain the derivative relationships between defects, and the correlation relationships between defects within a specific location range, thus enabling effective evaluation of the implementation effect of maintenance methods. The monitoring of the defect process in this application can also effectively avoid duplicate maintenance and improve maintenance efficiency.
[0016] Other features and advantages of this application will be set forth in the following description and will be apparent in part from the description or may be learned by practicing the application. Attached Figure Description
[0017] The accompanying drawings are provided to further illustrate the present application and form part of the specification. Together with the embodiments of the present application, they serve to explain the present application but do not constitute a limitation thereof. In the drawings: Figure 1 This is a data flow diagram of the highway defect location system based on integrated inspection and maintenance provided in this application; Figure 2 This is a schematic diagram of the ER model of the highway defect location system based on integrated inspection and maintenance provided in this application; Figure 3 This is a schematic diagram of the process of constructing a pavement defect database in the highway defect location method based on integrated inspection and maintenance provided in this application; Figure 4 This is a schematic diagram of the bridge defect database construction process in the highway defect location method based on integrated inspection and maintenance provided in this application; Figure 5 This is a schematic diagram of the tunnel defect database construction process in the highway defect location method based on integrated inspection and maintenance provided in this application. Implementation
[0018] To make the objectives and technical solutions of the embodiments of this application clearer, the technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some, not all, of the embodiments of this application. All other embodiments obtained by those skilled in the art based on the described embodiments of this application without creative effort are within the scope of protection of this application.
[0019] Those skilled in the art will understand that, unless otherwise defined, all terms used herein (including technical and scientific terms) have the same meaning as commonly understood by one of ordinary skill in the art to which this application pertains. It should also be understood that terms such as those defined in general dictionaries should be understood to have the same meaning as in the context of the prior art, and should not be interpreted in an idealized or overly formal sense unless defined as herein.
[0020] The term "connection" as used in this application can mean a direct connection between components or an indirect connection between components through other components.
[0021] Figure 1 According to this application, a highway defect location system based on integrated inspection and maintenance includes: The detection system is used to receive detection data provided by inspectors, obtain information on highway defects, record detection time, detection method, defect type, defect severity, and defect images, and update the defect database synchronously. The maintenance system is used to receive maintenance data provided by maintenance personnel, match the maintenance data with the corresponding defects detected by the detection system, and update the maintenance information records of highway defects in the defect database. The disease database receives and records highway disease information uploaded by the detection system and disease maintenance information uploaded by the maintenance system, and compares the highway disease information and disease maintenance information with the BIM 3D model to achieve disease information synchronization. The disease analysis module connects to a disease database. Based on the road disease information and maintenance information recorded in the database, it tracks the evolution of diseases with the same number, tracks the frequency of disease recurrence after maintenance within the same location error range, analyzes the derivative relationship between the same disease and other diseases, analyzes the correlation between diseases within the same location error range, locates road diseases, evaluates the implementation effect of maintenance methods, and identifies repeated maintenance phenomena.
[0022] After receiving the inspection data provided by the inspectors, the above system can locate road surface defects in the following ways: (1) First, road surface defect information is obtained through the road surface defect detection device, including detection time, detection method, defect type, defect severity, etc. At the same time, defect images of the road surface to be tested and the Beidou / GPS latitude and longitude information of the shooting location are obtained and stored synchronously. If there are multiple defects at the same Beidou / GPS location, multiple defect records are generated simultaneously for the same Beidou / GPS information. One defect image corresponds to only one defect, but the same defect can correspond to multiple defect images. Each defect image must correspond to the entry of information such as the defect type of one defect. (2) When the pavement disease detection information is stored in the detection database, it is also stored in the disease database. The main fields include: structure type, disease discovery time, disease number, disease location, disease type, disease severity, and disease image. (3) For the location of road surface defects, based on the defect detection, the BeiDou / GPS positioning information of the location reached by the maintenance personnel is matched with the BeiDou / GPS positioning information in the detection record. Alternatively, the BeiDou / GPS information can be converted into station numbers first, and the station number matching method can be used. Considering the BeiDou / GPS positioning error, the matching is performed within the positioning error range. The matching range is [Xi+△x,Yi+△y]∩[xi,yi], where Xi is the longitude position of defect number i, Yi is the latitude position of defect number i, △x is the longitude positioning error, △y is the latitude positioning error, and xi and yi are the road surface range near the defect location. (4) During the maintenance process, the system searches for defects on-site within the designated location range and obtains defect images of the road surface to be maintained through a handheld terminal processing system. Multiple images of the same defect can be obtained. The system performs feature matching between these images and defect images within the same location error range in the defect database. Because there are various types of cameras that capture images from different angles and positions, the features of this point must be unchanging with translation, scaling, and rotation. Based on automatic image feature matching combined with manual confirmation, the system achieves matching of the same defect during detection and maintenance. On this basis, the system adds defect records to the maintenance database according to the defect maintenance information and stores them in the maintenance database. (5) When storing pavement defects maintenance information into the maintenance database, the defects database is stored simultaneously. During storage, the maintenance images are matched with the detection images to determine the defects database records that need to be updated. The main fields to be updated include: maintenance time, maintenance method, defects before maintenance, and defects after maintenance.
[0023] Alternatively, after receiving the inspection data provided by the inspectors, the above system can locate bridge defects in the following ways: (1) For bridge defect detection and location, firstly, based on the detection location, the Beidou / GPS information of the bridge defect location is obtained. According to the bridge structure, the bridge is divided into grids using QR codes. At the same time, the correspondence between bridge components and QR codes is established in the BIM 3D model. The same QR code can correspond to multiple components, but the same component can only correspond to one QR code. When scanning the QR code, the handheld terminal displays the bridge area covered by each QR code through the BIM 3D model. At the same time, according to the three-dimensional characteristics of the covered area, the covered area is further divided in the BIM 3D model. For example, the vertical space is divided into three sub-areas: upper, middle, and lower. The horizontal plane area is divided into 3*3 sub-areas according to the horizontal and vertical directions. The three-dimensional area is divided into four sub-areas: front, rear, left, and right. The above divisions can be combined into multiple sub-areas according to the regional characteristics. The inspection personnel input the sub-area where the defect is located, enter the defect information, and obtain the defect image to generate a defect detection record. At the same time, the BIM 3D model displays the corresponding defect information at the corresponding location. (2) When the bridge defect detection information is stored in the detection database, it is simultaneously stored in the defect database. The main fields include structure type, defect discovery time, defect corresponding QR code, defect number, defect location, defect sub-region, defect type, defect severity, and defect image. (3) For bridge defect maintenance location, based on defect detection, the BeiDou / GPS positioning information of the location reached by maintenance personnel is matched with the BeiDou / GPS positioning information in the detection record. Alternatively, the BeiDou / GPS information can be converted into station numbers first, and the station number matching method can be used. The location is displayed on the handheld terminal through BeiDou / GPS positioning or station number. Corresponding to the BeiDou / GPS positioning or station number location, the system displays the distribution of surrounding defects through the BIM 3D model. During maintenance, scanning the QR code will highlight the area covered by the QR code and the distribution of defects. The system combines sub-region positioning to perform feature matching between the defect images taken during maintenance and the defect images in the corresponding sub-regions covered by the QR code in the defect database. Combined with manual confirmation, the same defect matching for detection and maintenance is completed. After the defect is maintained, the image of the defect location after maintenance is acquired again. (4) Bridge disease maintenance information is stored in the disease database at the same time as the maintenance database. The main fields to be updated include maintenance time, maintenance method, disease images before maintenance, and disease images after maintenance.
[0024] Alternatively, after receiving the inspection data provided by the inspectors, the above system can locate tunnel defects in the following ways: (1) For tunnel defect detection and location records, the tunnel detection area is divided into grids using QR codes, and the QR codes are sequentially numbered according to the tunnel driving direction, etc. At the same time, the correspondence between the detection area and the QR code is established in the BIM 3D model. When scanning the QR code, the handheld terminal displays the tunnel area covered by each QR code through the BIM 3D model. At the same time, according to the three-dimensional features of the covered area, the 3D model further divides the covered area, such as dividing it into 3*3 areas according to the horizontal and vertical directions. The inspection personnel input the sub-area where the defect is located, enter the defect information, and obtain the defect image to generate the detection defect record. At the same time, the BIM 3D model displays the corresponding detection defect information at the corresponding position. (2) When the tunnel defect detection information is stored in the detection database, it is simultaneously stored in the defect database. The main fields include: structure type, defect discovery time, defect corresponding QR code number, defect number, defect type, defect severity, and defect image. (3) For tunnel defect maintenance location, based on defect detection, the maintenance handheld terminal displays the location of the defect through the BIM 3D model and corresponds it with the QR code number. Maintenance personnel arrive at the location to be maintained according to the QR code number, and by scanning the QR code, the BIM 3D model highlights the area covered by the QR code and the distribution of defects. The maintenance personnel obtain the defect image, and the system performs feature matching between this image and the defect images in the corresponding sub-area covered by the QR code in the defect database. Combined with manual confirmation, the matching of the same defect for detection and maintenance is completed. After the defect is maintained, the image of the defect location after maintenance is obtained again. (4) When storing tunnel defects in the maintenance database, the defects database is stored simultaneously. The main fields to be updated include maintenance time, maintenance method, defect images before maintenance, and defect images after maintenance.
[0025] Therefore, the system of this application, after acquiring highway defect information, recording defect information such as detection time, detection method, defect type, defect severity, and defect images, and synchronously updating the defect information to the defect database, can match it with the maintenance data provided by maintenance personnel, update the highway defect maintenance information records in the defect database, and thereby synchronize the highway defect information and defect maintenance information with the BIM 3D model to achieve defect information synchronization. Then, based on the highway defect information and defect maintenance information recorded in the defect database, it tracks the evolution process of defects with the same number, tracks the frequency of defect recurrence after maintenance within the same positioning error range, analyzes the derivative relationship between the same defect and other defects, analyzes the correlation relationship between defects within the same positioning error range, evaluates the implementation effect of maintenance methods, and judges the phenomenon of repeated maintenance.
[0026] When specifically matching and locating each disease, this application may adopt the following disease location downgrading processing method to identify whether the disease being detected and maintained is the same disease.
[0027] refer to Figure 3 The aforementioned system can specifically match pavement maintenance data with corresponding defects in the following manner to construct a pavement defect database: First, determine whether satellite positioning is effective. When satellite positioning is effective, it is preferable to simultaneously determine whether the maintenance data matches the disease location in the disease database based on satellite positioning data, disease image features, and manual confirmation results. The next best option is to determine whether the maintenance data matches the disease location in the disease database based on satellite positioning data and manual confirmation results. When satellite positioning is ineffective, the preferred approach is to simultaneously determine whether the maintenance data matches the location of the disease in the disease database based on the highway station number, the characteristics of the disease image, and the results of manual confirmation. The second-best approach is to simultaneously determine whether the maintenance data matches the location of the disease in the disease database based on the highway station number and the results of manual confirmation. After matching with existing diseases in the database, the corresponding maintenance information and on-site conditions are stored in the disease maintenance database based on the images of the diseases after maintenance, and the disease database is updated.
[0028] refer to Figure 4 The aforementioned system can match bridge defect maintenance data with corresponding defects in the following manner to construct a bridge defect database: First, determine whether satellite positioning is effective. When satellite positioning is effective, it is preferable to simultaneously determine whether the maintenance data matches the location of the disease in the disease database based on satellite positioning data, bridge grid division QR code, disease image features, and manual confirmation results. The next best option is to determine whether the maintenance data matches the location of the disease in the disease database based on satellite positioning data, disease image features, and manual confirmation results. When satellite positioning is ineffective, the preferred method is to simultaneously determine whether the maintenance data matches the location of the defects in the defect database based on the bridge BIM 3D model, the bridge grid division QR code, the defect image features, and the manual confirmation results. The second best method is to determine whether the maintenance data matches the location of the defects in the defect database based on the bridge BIM 3D model, the defect image features, and the manual confirmation results. The worst method is to determine whether the maintenance data matches the location of the defects in the defect database based on the bridge BIM 3D model and the manual confirmation results. After matching with existing diseases in the database, the corresponding maintenance information and on-site conditions are stored in the disease maintenance database based on the images of the diseases after maintenance, and the disease database is updated.
[0029] refer to Figure 5The aforementioned system can match maintenance data for tunnel defects with corresponding defects in the following manner to construct a tunnel defect database: The optimal approach is to simultaneously determine whether the maintenance data matches the defect location in the database based on the tunnel BIM 3D model, the tunnel gridded QR code, defect image features, and manual verification results; the next optimal approach is to determine whether the maintenance data matches the defect location in the database based on the tunnel BIM 3D model, defect image features, and manual verification results; the least optimal approach is to determine whether the maintenance data matches the defect location in the database based on the tunnel BIM 3D model and manual verification results. After matching with existing defects in the database, the system stores the corresponding maintenance information and on-site conditions into the defect maintenance database based on the post-maintenance images of the defects and updates the database accordingly.
[0030] exist Figure 2 In the embodiments shown, the system of this application can also be used in... Figure 1 Further modifications are made based on the system shown.
[0031] The detection database acquires pavement defect information through pavement defect detection devices. While storing defect information in the defect database, it simultaneously records the detection time, detection method, defect type, defect severity, and acquires defect images of the pavement to be tested, as well as the Beidou / GPS latitude and longitude information of the shooting location or the corresponding highway station number, grid division QR code, and BIM 3D model location. The maintenance database acquires images of road surface defects to be maintained through a handheld terminal processing system. While storing defect maintenance information in the defect database, it simultaneously records road surface defect maintenance information, including maintenance time, maintenance method, before maintenance defect image, and after maintenance defect image for the corresponding defect number.
[0032] The detection database can also generate multiple disease records simultaneously for the same BeiDou / GPS information when there are multiple diseases at the same BeiDou / GPS location. These records store the type of disease structure, the time of disease discovery, the disease number, the location of the disease, the type of disease, the degree of disease, and the image of the disease.
[0033] During this process, the correlation between diseases within the same location error range can be determined by both whether the disease image features match and the conclusion of manual judgment. After determining that there is a correlation between defects within the same location error range, the following steps are further performed: Determine whether the corresponding maintenance has been carried out. If the disease has not been maintained, analyze the changes in the disease and add a new record under the disease number. At the same time, detect new diseases in the surrounding area and generate related disease records. If the disease has been maintained, perform feature matching on the disease images before and after maintenance and analyze the occurrence of surrounding diseases.
[0034] If it is difficult to determine whether the defects within the same location error range are the same defect through defect image feature matching or manual judgment, then new highway defect information is added. The newly received highway defect information records the detection time, detection method, defect type, defect severity, and defect image of the newly received highway defect.
[0035] In practice, the system can also perform feature matching when re-detecting relevant locations, based on the newly detected disease images and existing disease images within that location range, including images of untreated and treated diseases. If there are existing diseases that have not been maintained, analyze the changes in the diseases and add relevant records for the changes in the diseases with the same number. At the same time, check whether there are any new diseases in the surrounding area. If new diseases are detected, generate related disease records. If existing diseases have already been treated, feature matching is performed with images of the treated disease locations to analyze the occurrence of surrounding diseases. If it is difficult to determine whether it is the same disease through image matching or manual judgment, it is recorded as a new disease.
[0036] The above are merely embodiments of this application, and their descriptions are quite specific and detailed, but they should not be construed as limiting the scope of this patent application. It should be noted that those skilled in the art can make various modifications and improvements without departing from the concept of this application, and these all fall within the protection scope of this application.
Claims
1. A method for locating highway defects based on integrated inspection and maintenance, characterized by the following steps: include: Receive inspection data provided by inspectors, obtain highway disease information, record inspection time, inspection method, disease type, disease severity, and disease images, and update the highway disease information to the disease database simultaneously; Receive maintenance data provided by maintenance personnel, match the maintenance data with the corresponding defects, and update the maintenance information records of highway defects in the defect database; By comparing highway defect information and defect maintenance information with the BIM 3D model to synchronize defect information, the evolution process of defects with the same number is tracked based on the highway defect information and defect maintenance information recorded in the defect database. The frequency of defect recurrence after maintenance is tracked within the same location error range. The derivative relationship between the same defect and other defects is analyzed. The correlation relationship between defects within the same location error range is analyzed. Highway defects are located and the implementation effect of maintenance methods is evaluated. The phenomenon of repeated maintenance is identified. The specific steps for matching maintenance data with corresponding diseases include: To address road surface defects, first determine if satellite positioning is effective. When satellite positioning is effective, the maintenance data is judged to match the disease location in the disease database based on satellite positioning data, disease image features, and manual confirmation results. Alternatively, the maintenance data can be judged to match the disease location in the disease database based on satellite positioning data and manual confirmation results. When satellite positioning is ineffective, the maintenance data is judged to match the location of the disease in the disease database based on the highway station number, the characteristics of the disease image, and the results of manual confirmation. Alternatively, the maintenance data can be judged to match the location of the disease in the disease database based on the highway station number and the results of manual confirmation. The specific steps for matching maintenance data with corresponding diseases include: To address bridge defects, first determine if satellite positioning is effective. When satellite positioning is effective, the maintenance data is judged to match the disease location in the disease database based on satellite positioning data, bridge grid division QR code, disease image features, and manual confirmation results. Alternatively, the maintenance data can be judged to match the disease location in the disease database based on satellite positioning data, disease image features, and manual confirmation results. When satellite positioning is invalid, the system simultaneously determines whether the maintenance data matches the location of the defects in the defect database based on the bridge BIM 3D model, bridge grid division QR code, defect image features, and manual confirmation results. Alternatively, it can determine whether the maintenance data matches the location of the defects in the defect database based on the bridge BIM 3D model, defect image features, and manual confirmation results. Finally, it can determine whether the maintenance data matches the location of the defects in the defect database based on the bridge BIM 3D model and manual confirmation results. The specific steps for matching maintenance data with corresponding diseases include: For tunnel defects, the maintenance data is determined to match the defect locations in the defect database based on the tunnel's BIM 3D model, tunnel grid-based QR codes, defect image features, and manual verification results. Secondly, the maintenance data is determined by combining the tunnel BIM 3D model, the characteristics of the defect images, and the results of manual verification to see if they match the location of defects in the defect database. Finally, the selection was based on a joint assessment of the tunnel BIM 3D model and manual confirmation results to determine whether the maintenance data matched the location of the defects in the defect database. The correlation between diseases within the same location error range is determined by both whether the disease image features match and the conclusion of manual judgment. After determining that there is a correlation between defects within the same location error range, the following steps are further performed: Determine whether the corresponding maintenance has been carried out. If the disease has not been maintained, analyze the changes in the disease and add a new record under the disease number. At the same time, detect new diseases in the surrounding area and generate related disease records. If the disease has been maintained, perform feature matching on the disease images before and after maintenance and analyze the occurrence of surrounding diseases.
2. The method for locating highway defects based on integrated inspection and maintenance as described in claim 1, characterized in that, If it is difficult to determine whether the defects within the same location error range are the same defect through defect image feature matching or manual judgment, then add new highway defect information. In the new highway defect information, record the detection time, detection method, defect type, defect severity, and defect image of the newly received highway defect.
3. A highway defect location system based on the integrated inspection and maintenance method for highway defect location according to any one of claims 1-2, characterized in that, include: The detection system is used to receive detection data provided by inspectors, obtain information on highway defects, record detection time, detection method, defect type, defect severity, and defect images, and update the defect database synchronously. The maintenance system is used to receive maintenance data provided by maintenance personnel, match the maintenance data with the corresponding defects detected by the detection system, and update the maintenance information records of highway defects in the defect database. The disease database receives and records highway disease information uploaded by the detection system and disease maintenance information uploaded by the maintenance system, and compares the highway disease information and disease maintenance information with the BIM 3D model to achieve disease information synchronization. The disease analysis module connects to the disease database. Based on the highway disease information and disease maintenance information recorded in the disease database, it tracks the evolution process of diseases with the same number, tracks the frequency of disease recurrence after maintenance within the same location error range, analyzes the derivative relationship between the same disease and other diseases, analyzes the correlation relationship between diseases within the same location error range, locates highway diseases and evaluates the implementation effect of maintenance methods, and identifies the phenomenon of repeated maintenance. It also includes a detection database, which obtains road surface defect information through road surface defect detection devices. While storing defect information in the defect database, it simultaneously records the detection time, detection method, defect type, defect degree, and obtains defect images of the road surface to be tested, as well as the Beidou / GPS latitude and longitude information of the shooting location or the corresponding highway station number, grid division QR code, and BIM 3D model location. The detection database also generates multiple disease records simultaneously for the same BeiDou / GPS information when there are multiple diseases at the same BeiDou / GPS location, storing the disease structure type, disease discovery time, disease number, disease location, disease type, disease severity, and disease image. It also includes a maintenance database, which uses a handheld terminal processing system to acquire images of road surface defects to be maintained. While storing defect maintenance information in the defect database, it simultaneously records road surface defect maintenance information, including maintenance time, maintenance method, before maintenance defect images, and after maintenance defect images for the corresponding defect number.
Citation Information
Patent Citations
Road surface damage data space-time analysis method based on multi-source feature fusion
CN112800913A
Highway intelligent inspection method and device based on digital twinborn technology
CN115705699A
