A tunnel quality inspection instrument based on multimodal data fusion

By using a tunnel quality inspection instrument that integrates multimodal data fusion, combined with a linear array camera and a laser scanning unit, to acquire texture and point cloud information of the tunnel rock wall, the shortcomings of tunnel inspection equipment in terms of accuracy and efficiency have been solved, and high-precision tunnel defect detection has been achieved.

CN224985345UActive Publication Date: 2026-11-17HUNAN KAIZHUO INTELLIGENT TECH CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202522653112.3
Authority / Receiving Office
CN · China
Patent Type
Utility models(China)
Current Assignee / Owner
Filing Date
2025-12-15
Publication Date
2026-11-17
Estimated Expiration
2035-12-15

AI Technical Summary

Technical Problem

Existing tunnel inspection equipment has low accuracy in single-mode detection of tunnel rock wall defects, is easily affected by environmental factors, has a high rate of missed detection, and is difficult to meet the requirements of high precision.

Method used

A tunnel quality inspection instrument employing multimodal data fusion integrates a linear array camera unit and a laser scanning unit. It acquires texture and point cloud information of the tunnel rock wall through a control unit and performs information fusion for defect detection.

Benefits of technology

It improves the accuracy and efficiency of tunnel quality inspection, reduces the rate of missed detection, achieves high-precision defect detection, has high equipment integration, is easy to operate, has strong adaptability, and has low cost.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN224985345U_ABST
    Figure CN224985345U_ABST
Patent Text Reader

Abstract

This utility model discloses a multimodal data fusion tunnel quality inspection instrument, relating to the field of tunnel inspection equipment. The instrument includes a housing, multiple linear array camera units, multiple laser scanning units, and a control unit. Each linear array camera unit and each laser scanning unit is arranged at intervals around a vertical axis. The control unit is electrically connected to each linear array camera unit and each laser scanning unit. The control unit controls each linear array camera unit to acquire texture information of the target tunnel rock wall, and simultaneously controls each laser scanning unit to acquire point cloud information of the target tunnel rock wall. The texture information and point cloud information are then fused to detect defects in the target tunnel rock wall. This inspection instrument, by fusing the acquired texture information and point cloud information of the tunnel rock wall for defect detection, can significantly improve the accuracy and efficiency of tunnel quality inspection. It features timely data processing with short latency, high equipment integration, and simple and convenient operation.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This utility model belongs to the field of tunnel inspection equipment, specifically a tunnel quality inspection instrument with multimodal data fusion. Background Technology

[0002] With the rapid increase in the mileage of rail transit and highway tunnels, the demand for tunnel health monitoring is becoming increasingly urgent. Monitoring allows construction personnel to quickly and effectively understand the condition of the tunnel walls, facilitating the development of effective construction plans to locate defects in the tunnel walls.

[0003] In related technologies, images of tunnel walls are captured by camera equipment to determine whether there are defects. However, judging defects solely from images is greatly affected by environmental factors, such as vibration interference during travel, resulting in relatively low detection accuracy and a high rate of missed detections. This problem urgently needs to be solved. Utility Model Content

[0004] The purpose of this invention is to provide a tunnel quality inspection instrument based on multimodal data fusion, which can improve the accuracy and efficiency of tunnel quality inspection.

[0005] To achieve the above objectives, this utility model provides the following technical solution: This utility model provides a tunnel quality inspection instrument with multimodal data fusion, including a housing and multiple linear array camera units, multiple laser scanning units and a control unit disposed within the housing; Each linear scan camera unit and each laser scanning unit are arranged at intervals around a vertical axis, and the control unit is electrically connected to each linear scan camera unit and each laser scanning unit; The control unit is used to control each linear array camera unit to acquire texture information of the target tunnel rock wall, and at the same time control each laser scanning unit to acquire point cloud information of the target tunnel rock wall, and fuse the texture information and point cloud information to detect defects in the target tunnel rock wall.

[0006] As a further embodiment of this invention, the line scan camera unit is located below the laser scanning unit, and the line scan camera unit is tilted upwards.

[0007] As a further improvement of this utility model, it also includes: The camera, mounted on the top of the housing, is used to acquire images of the surrounding environment.

[0008] As a further embodiment of this utility model, the line scan camera unit includes a mounting sleeve, a line scan camera body, and a lens assembly, with the mounting sleeve connected to the outer wall of the housing. The line scan camera body is inserted into the mounting sleeve, and the lens assembly is connected to the side of the mounting sleeve away from the axis of the housing and cooperates with the line scan camera body.

[0009] As a further embodiment of this utility model, the lens assembly includes a lens sleeve, a lens module, and a protective lens, with the lens sleeve connected to the side of the mounting sleeve opposite to the axis of the housing. The lens module is inserted into the lens case, and the protective lens is connected to the side of the lens case away from the axis of the housing and cooperates with the lens module.

[0010] As a further embodiment of this utility model, the laser scanning unit includes a base plate and a laser scanner body connected to the base plate, with the laser scanner body facing away from the axis of the housing.

[0011] As a further embodiment of this utility model, the housing includes a base assembly and a cover assembly connected to the upper end of the base assembly, with each line scan camera unit disposed on the outer wall of the base assembly and each laser scanning unit disposed inside the cover assembly.

[0012] As a further improvement of this utility model, it also includes: The heat dissipation unit includes a first heat-conducting element and a fan assembly. The first heat-conducting element contacts the lower surface of each laser scanning unit and extends into the base assembly. The fan assembly is disposed in the base assembly and is used to dissipate heat from the first heat-conducting element.

[0013] As a further embodiment of this utility model, the fan assembly includes a duct and a fan disposed within the duct, and the duct is disposed within a base assembly. The upper end of the duct is close to the bottom of the first heat-conducting component, and the lower end of the duct extends to the outside of the base assembly.

[0014] As a further embodiment of this invention, the heat dissipation unit also includes a second heat-conducting element, which abuts against the upper surface of each laser scanning unit and the inner top surface of the cover assembly.

[0015] Compared with the prior art, the beneficial effect of this utility model is that the multimodal data fusion tunnel quality inspection instrument includes a housing and multiple linear array camera units, multiple laser scanning units and a control unit disposed in the housing. Each linear array camera unit and each laser scanning unit is arranged at intervals around a vertical axis. The control unit is electrically connected to each linear array camera unit and each laser scanning unit. The control unit controls each linear array camera unit to acquire the texture information of the target tunnel rock wall, and simultaneously controls each laser scanning unit to acquire the point cloud information of the target tunnel rock wall. The texture information and the point cloud information are fused to detect defects in the target tunnel rock wall.

[0016] Therefore, the tunnel quality inspection instrument based on the multimodal data fusion provided by this utility model can detect defects by fusing the obtained texture information and point cloud information of the tunnel rock wall. This can significantly improve the accuracy and efficiency of tunnel quality inspection, with timely data processing and short delay time, high equipment integration, and simple and convenient operation. Attached Figure Description

[0017] To facilitate understanding by those skilled in the art, the present invention will be further described below with reference to the accompanying drawings.

[0018] Figure 1 A schematic diagram of the structure of the tunnel quality inspection instrument for multimodal data fusion provided by this utility model; Figure 2 for Figure 1 A cross-sectional view along section AA.

[0019] Figure label: 100. Housing; 110. Base assembly; 120. Cover assembly; 200. Line scan camera unit; 210. Mounting sleeve; 220. Line scan camera body; 230. Lens assembly; 231. Lens cover; 232. Lens module; 233. Protective lens; 300. Laser scanning unit; 310. Base plate; 320. Laser scanner body; 400. Camera; 500, Heat dissipation unit; 510, First heat conduction component; 520, Fan assembly; 521, Air duct; 522, Fan; 530, Second heat conduction component. Detailed Implementation

[0020] The embodiments of this utility model are described in detail below. Examples of these embodiments are shown in the accompanying drawings, wherein the same or similar reference numerals denote the same or similar elements or elements having the same or similar functions throughout. The embodiments described below with reference to the accompanying drawings are exemplary and are only used to explain this utility model, and should not be construed as limiting this utility model.

[0021] In the description of this utility model, it should be understood that the directional descriptions, such as up, down, front, back, left, right, etc., indicate the directional or positional relationship based on the directional or positional relationship shown in the accompanying drawings. They are only for the convenience of describing this utility model and simplifying the description, and do not indicate or imply that the device or element referred to must have a specific orientation, or be constructed and operated in a specific orientation. Therefore, they should not be construed as limitations on this utility model.

[0022] In the description of this utility model, "several" means one or more, "multiple" means two or more, "greater than," "less than," and "exceeding" are understood to exclude the stated number, while "above," "below," and "within" are understood to include the stated number. If "first" or "second" is used in the description, it is only for the purpose of distinguishing technical features and should not be construed as indicating or implying relative importance, or implicitly indicating the number of indicated technical features, or implicitly indicating the order of the indicated technical features.

[0023] In the description of this utility model, unless otherwise explicitly defined, terms such as "setting," "installation," and "connection" should be interpreted broadly, and those skilled in the art can reasonably determine the specific meaning of the above terms in this utility model in conjunction with the specific content of the technical solution.

[0024] To make the objectives, technical solutions, and advantages of this utility model clearer, the present utility model will be further described in detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only for explaining the present utility model and are not intended to limit the present utility model; that is, the described embodiments are only some embodiments of the present utility model, and not all embodiments. The components of the embodiments of the present utility model described and shown in the accompanying drawings can generally be arranged and designed in various different configurations.

[0025] Therefore, the following detailed description of the embodiments of the present invention provided in the accompanying drawings is not intended to limit the scope of the claimed invention, but merely to illustrate selected embodiments of the invention. All other embodiments obtained by those skilled in the art based on the embodiments of the present invention without inventive effort are within the scope of protection of the present invention.

[0026] Existing tunnel inspection vehicles generally suffer from low sensor integration, making it impossible to simultaneously achieve high-precision detection of surface defects, structural deformation, and track parameters. For example, domestic equipment often adopts a single detection mode (such as detecting only cracks or only water leakage), resulting in a false negative rate of over 10%. While foreign equipment supports multi-parameter detection, its high cost makes it difficult to popularize.

[0027] Please see Figure 1-2 As shown, this utility model embodiment provides a tunnel quality inspection instrument for multimodal data fusion, including a housing 100 and multiple linear array camera units 200, multiple laser scanning units 300 and a control unit disposed within the housing 100.

[0028] Each line scan camera unit 200 and each laser scanning unit 300 are arranged at intervals around a vertical axis, and the control unit is electrically connected to each line scan camera unit 200 and each laser scanning unit 300.

[0029] The control unit controls each linear array camera unit 200 to acquire texture information of the target tunnel rock wall, and controls each laser scanning unit 300 to acquire point cloud information of the target tunnel rock wall. The texture information and point cloud information are then fused together to detect defects in the target tunnel rock wall.

[0030] In this embodiment, the housing 100 has a storage cavity for storing the line scan camera unit 200, the laser scanning unit 300, and the control unit. The housing 100 can be a rotating body structure with its axis arranged vertically.

[0031] The line scan camera unit 200 in this embodiment can achieve high-speed scanning and image acquisition. Multiple line scan camera units 200 are evenly distributed and spaced around the axis of the housing 100. For example, 12 groups are provided, each spaced 200mm apart, and equipped with a fisheye compensated lens (FOV 120°), with an imaging resolution of 4096×512 pixels.

[0032] The laser scanning unit 300 in this embodiment can achieve high-speed scanning and acquisition of three-dimensional point clouds. Multiple laser scanning units 300 are evenly distributed and spaced around the axis of the housing 100. The sampling rate is 1.016MHz, including a rotating prism (rotation speed 6000 rpm) and an APD detector, and the scanning frequency is 200 lines / second.

[0033] In this embodiment, the control unit is used to control the simultaneous acquisition of information by each linear array camera unit 200 and laser scanning unit 300, and can fuse the acquired information. It can identify defects such as cracks (>0.2 mm) and water leakage (>10 cm²) based on the deep learning algorithm of the FRN-UNet model, and output a detection report with a confidence level of >95% (missed detection rate <5%). Combined with the SpringBoot+HBase architecture, it realizes multi-source data fusion and is compatible with multiple heterogeneous data.

[0034] In practical use, the detector can be installed on a testing vehicle. The control unit is initialized, each sensor performs a self-test, the linear array camera unit 200 performs white balance calibration, the laser scanning unit 300 performs optical path alignment verification, and the point cloud acquisition unit loads pre-calibrated parameters (including the tunnel cross-section reference coordinates). When moving in the tunnel environment, it can collect information about the rock wall. Texture information can be extracted from the images acquired by the linear array camera unit 200, and point cloud information can be extracted from the information acquired by the laser scanning unit 300. The control unit then fuses the texture information and the point cloud information to detect defects in the tunnel rock wall, such as surface defects (cracks / water leakage) and structural deformation (horizontal convergence / arch subsidence) in a full-dimensional manner, which facilitates accurate construction in the next step.

[0035] It is worth noting that, in response to the high cost, inefficiency, safety hazards and compatibility defects of existing technologies, this invention has built an economical and efficient (30% cost reduction), highly adaptable to the environment (stable performance at 95% humidity), and highly intelligent (real-time data processing) detection system based on multimodal sensing fusion and modular design, thereby promoting technological upgrades in the fields of rail transit, industrial manufacturing and new energy.

[0036] Therefore, compared to the single method of judging defects by simply acquiring images, the application of the multimodal data fusion tunnel quality inspection instrument provided by this utility model improves the detection efficiency (10km / h) and accuracy (dynamic error <0.2mm) by fusing the acquired texture information and point cloud information of the tunnel rock wall. It can significantly improve the accuracy and efficiency of tunnel quality inspection. By introducing an edge computing architecture, the data processing delay is compressed to less than 5 minutes. The data processing is timely and the delay time is short. The equipment has a high degree of integration, is simple to operate and easy to use, and meets the high-precision inspection requirements of rail transit.

[0037] In some embodiments, the line scan camera unit 200 is located below the laser scanning unit 300, and the line scan camera unit 200 is tilted upward.

[0038] In this way, such as Figure 2 As shown, the 12 linear scan camera units 200 arranged in a ring (covering a field of view of 270°) have a light source brightness of ≥5000 lumens and support stable imaging in environments with humidity >95%. By rationally arranging the orientation of the linear scan camera units 200 and the laser scanning unit 300, the comprehensiveness of information acquisition can be ensured, errors can be reduced, and thus the accuracy of quality inspection can be further improved.

[0039] Specifically, the storage cavity 110 can be divided into three sections from top to bottom. The uppermost section is the inlet section 111, whose upper end is connected to the inlet 101 and is inclined downwards to prevent the medicine bottles 10 from falling vertically, thus providing a certain cushioning effect and protecting the medicine bottles 10. The upper end of the middle section 112 is connected to the lower end of the inlet section 111, and it can be arranged straight downwards or in a curved shape. The lowermost section is the outlet section 113, whose upper end is connected to the lower end of the middle section 112, and whose lower end is connected to the outlet 102. In this way, more medicine bottles 10 can be stored, while protecting the medicine bottles 10 to a certain extent.

[0040] In some embodiments, the tunnel quality detector based on multimodal data fusion provided in this utility model further includes: Camera 400, which is mounted on top of housing 100, is used to acquire on-site environmental image information.

[0041] In this way, the camera 400 can monitor the on-site industrial control environment during operation, avoiding unexpected situations and improving safety. The camera 400 can be installed at the axis of the housing 100. The specific model can be determined according to actual needs, and no specific limitation is made in this embodiment.

[0042] In some embodiments, the line scan camera unit 200 includes a mounting sleeve 210, a line scan camera body 220, and a lens assembly 230, with the mounting sleeve 210 connected to the outer wall of the housing 100.

[0043] The line scan camera body 220 is inserted into the mounting sleeve 210, and the lens assembly 230 is connected to the side of the mounting sleeve 210 away from the axis of the housing 100 and cooperates with the line scan camera body 220.

[0044] Specifically, such as Figure 2 As shown, the mounting sleeve 210 can be fixed to the outer wall of the housing 100 by means of screws, snaps, etc. The line scan camera body 220 is fastened inside the mounting sleeve 210, and the lens assembly 230 is installed on the side of the mounting sleeve 210 away from the axis of the housing 100. This facilitates the manufacturing of individual parts and subsequent assembly, as well as maintenance and replacement.

[0045] Furthermore, in this embodiment, the lens assembly 230 includes a lens sleeve 231, a lens module 232, and a protective lens 233. The lens sleeve 231 is connected to the mounting sleeve 210 on the side opposite to the axis of the housing 100.

[0046] The lens module 232 is inserted into the lens cover 231, and the protective lens 233 is connected to the side of the lens cover 231 away from the axis of the housing 100 and cooperates with the lens module 232.

[0047] Specifically, such as Figure 2 As shown, the lens cover 231 can be connected to the mounting cover 210 by means of screws, snaps, etc. The protective lens 233 can play a role in rain protection and dust protection. This detachable structure makes it easy to replace quickly after damage.

[0048] In some embodiments, the laser scanning unit 300 includes a base plate 310 and a laser scanner body 320 connected to the base plate 310, with the laser scanner body 320 facing away from the axis of the housing 100.

[0049] Specifically, the laser scanner body 320 is used to generate a high-brightness laser line. The various laser scanner bodies 320 are connected together via the base plate 310, facilitating component integration and shared power supply and control. It should be noted that the side wall of the housing 100 should have transparent windows or transparent glass for the laser beam to pass through on each laser scanner body 320.

[0050] Furthermore, in this embodiment, the housing 100 includes a base assembly 110 and a cover assembly 120 connected to the upper end of the base assembly 110. Each line scan camera unit 200 is disposed on the outer wall of the base assembly 110, and each laser scanning unit 300 is disposed inside the cover assembly 120.

[0051] Specifically, such as Figure 2 As shown, the base assembly 110 can be a hollow cylindrical structure, and each line scan camera unit 200 can be detachably installed on the outer wall of the base assembly 110. The cover assembly 120 can also be a hollow shell structure, which facilitates the installation of each laser scanning unit 300 inside. The base assembly 110 and the cover assembly 120 can be connected by screws, snaps, or other means.

[0052] Both the base assembly 110 and the cover assembly 120 can be made of aluminum alloy. In addition, the base assembly 110 can be connected to the inspection vehicle using a quick-release buckle (the fixing plate matches the through slot) for easy and quick assembly and disassembly.

[0053] Furthermore, in this embodiment, the multimodal data fusion tunnel quality detector provided by this utility model also includes: The heat dissipation unit 500 includes a first heat-conducting element 510 and a fan assembly 520. The first heat-conducting element 510 contacts the lower surface of each laser scanning unit 300 and extends into the base assembly 110. The fan assembly 520 is disposed in the base assembly 110 and is used to conduct heat from the first heat-conducting element 510.

[0054] In this way, such as Figure 2 As shown, the first heat-conducting component 510 can be a heat-dissipating shark fin copper sheet. Most of the heat generated by each laser scanning unit 300 is quickly discharged from the base assembly 110 through the first heat-conducting component 510 and under the action of the fan assembly 520.

[0055] Furthermore, in this embodiment, the fan assembly 520 includes a duct 521 and a fan 522 disposed within the duct 521, and the duct 521 is disposed within the base assembly 110.

[0056] The upper end of the duct 521 is close to the bottom of the first heat-conducting element 510, and the lower end of the duct 521 extends to the outside of the base assembly 110.

[0057] In this way, such as Figure 2 As shown, the duct 521 can selectively dissipate heat from the first heat-conducting element 510, and the lower end of the duct 521 extends out from the bottom of the base assembly 110. It should be noted that a wire opening can also be left at the bottom of the base assembly 110, but after the wire passes through, the opening needs to be sealed to avoid the influence of external environmental factors.

[0058] Furthermore, in this embodiment, the heat dissipation unit 500 also includes a second heat-conducting element 530, which abuts against the upper surface of each laser scanning unit 300 and the inner top surface of the cover assembly 120.

[0059] Specifically, such as Figure 2 As shown, the second heat-conducting component 530 can be a contact heat dissipation copper sheet, roughly in the shape of a U-shape, which facilitates the conduction of heat generated by each laser scanning unit 300 to the outer casing, further improving heat dissipation performance.

[0060] The above description is merely an example and illustration of the structure of this utility model. Those skilled in the art can make various modifications or additions to the specific embodiments described or use similar methods to replace them, as long as they do not deviate from the structure of the utility model or exceed the scope defined in the claims, they should all fall within the protection scope of this utility model.

Claims

1. A multi-modal data fusion based tunnel quality detector, characterized in that, It includes a housing (100) and a plurality of linear array camera units (200), a plurality of laser scanning units (300) and a control unit disposed within the housing (100); Each of the line scan camera units (200) and each of the laser scanning units (300) are arranged at intervals around a vertical axis, and the control unit is electrically connected to each of the line scan camera units (200) and each of the laser scanning units (300); The control unit is used to control each of the linear array camera units (200) to acquire the texture information of the target tunnel rock wall, and at the same time control each of the laser scanning units (300) to acquire the point cloud information of the target tunnel rock wall, and fuse the texture information and the point cloud information to detect defects in the target tunnel rock wall.

2. The multi-modal data fusion based tunnel quality detector as claimed in claim 1, wherein, The line scan camera unit (200) is located below the laser scanning unit (300), and the line scan camera unit (200) is tilted upward.

3. The tunnel quality inspection instrument based on multimodal data fusion according to claim 1, characterized in that, Also includes: A camera (400), which is mounted on top of the housing (100), is used to acquire on-site environmental image information.

4. The tunnel quality inspection instrument based on multimodal data fusion according to any one of claims 1 to 3, characterized in that, The line scan camera unit (200) includes a mounting sleeve (210), a line scan camera body (220), and a lens assembly (230), wherein the mounting sleeve (210) is connected to the outer wall of the housing (100); The line scan camera body (220) is inserted into the mounting sleeve (210), and the lens assembly (230) is connected to the side of the mounting sleeve (210) away from the axis of the housing (100) and cooperates with the line scan camera body (220).

5. The tunnel quality inspection instrument based on multimodal data fusion according to claim 4, characterized in that, The lens assembly (230) includes a lens sleeve (231), a lens module (232), and a protective lens (233). The lens sleeve (231) is connected to the mounting sleeve (210) on the side opposite to the axis of the housing (100). The lens module (232) is inserted into the lens sleeve (231), and the protective lens (233) is connected to the side of the lens sleeve (231) away from the axis of the housing (100) and cooperates with the lens module (232).

6. The tunnel quality inspection instrument based on multimodal data fusion according to any one of claims 1 to 3, characterized in that, The laser scanning unit (300) includes a base plate (310) and a laser scanner body (320) connected to the base plate (310), the laser scanner body (320) facing away from the axis of the housing (100).

7. The tunnel quality inspection instrument based on multimodal data fusion according to claim 6, characterized in that, The housing (100) includes a base assembly (110) and a cover assembly (120) connected to the upper end of the base assembly (110). Each of the line scan camera units (200) is disposed on the outer wall of the base assembly (110), and each of the laser scanning units (300) is disposed inside the cover assembly (120).

8. The tunnel quality inspection instrument based on multimodal data fusion according to claim 7, characterized in that, Also includes: The heat dissipation unit (500) includes a first heat-conducting element (510) and a fan assembly (520). The first heat-conducting element (510) contacts the lower surface of each of the laser scanning units (300) and extends into the base assembly (110). The fan assembly (520) is disposed in the base assembly (110) and is used to dissipate heat from the first heat-conducting element (510).

9. The tunnel quality inspection instrument based on multimodal data fusion according to claim 8, characterized in that, The fan assembly (520) includes a duct (521) and a fan (522) disposed within the duct (521), the duct (521) and the base assembly (110); The upper end of the duct (521) is close to the bottom of the first heat-conducting element (510), and the lower end of the duct (521) extends to the outside of the base assembly (110).

10. The tunnel quality inspection instrument based on multimodal data fusion according to claim 8, characterized in that, The heat dissipation unit (500) further includes a second heat-conducting element (530), which abuts against the upper surface of each of the laser scanning units (300) and the inner top surface of the cover assembly (120).