A monitoring device and method for monitoring deformation status of tunnel surrounding rock

Through the automated ranging technology of laser sensors and cameras, combined with matlab calibration tools and watershed segmentation algorithm, the accuracy and efficiency problems in the deformation monitoring of surrounding rocks in coal mine tunnels are solved, and efficient and real-time monitoring effects are achieved.

CN118009907BActive Publication Date: 2024-11-12XIAN UNIV OF SCI & TECH
View PDF 0 Cites 1 Cited by

Patent Information

Application Number
CN202410129809.8
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2024-01-31
Publication Date
2024-11-12
Estimated Expiration
2044-01-31

AI Technical Summary

Technical Problem

The existing coal mine tunnel surrounding rock deformation monitoring technology has low measurement accuracy, delayed information and low collection frequency, making it difficult to accurately obtain the deformation of surrounding rock in real time, especially in complex environments, and is difficult to achieve efficient monitoring.

Method used

Using a monitoring device including laser sensor module, camera, fill light, control module and power supply, the target is arranged on the same monitoring section of the surrounding rock of the tunnel, and the laser sensor and camera are used for automatic ranging, combining matlab calibration tools and watershed segmentation. The algorithm calculates the distance changes between each target and monitors the deformation trend of the surrounding rock in the tunnel in real time.

Benefits of technology

It realizes high-precision and rapid acquisition of roadway surrounding rock deformation data, improves monitoring efficiency and safety, simplifies the installation process, and improves applicability and lighting conditions.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118009907B_ABST
    Figure CN118009907B_ABST
Patent Text Reader

Abstract

The invention discloses a monitoring device and method for monitoring the deformation situation of tunnel surrounding rock, which relates to the field of intelligent monitoring of tunnel surrounding rock. The device comprises a bearing platform and a laser sensor module, a camera, a fill light, a control module and a power supply arranged on the bearing platform. The laser sensor module is connected to the control module, the camera is connected to the control module, the control module has a built-in wireless communication module, and the wireless communication module is connected to a computer. The monitoring device has a simple structure and is easy to install. The control module controls the rotation of the laser sensor according to the received target image, sequentially aims at each target for distance measurement, and further obtains the change in the distance between each target. The whole process is automatically monitored with high measurement accuracy, and the deformation situation of the surrounding rock can be obtained in real time and efficiently.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the field of intelligent monitoring of tunnels, and in particular to a monitoring device and method for monitoring the deformation situation of surrounding rocks in tunnels. Background Art

[0002] Coal is a basic energy source. In order to improve the production efficiency of coal mines and achieve safe, green and intelligent mining, artificial intelligence technology has been widely used in coal mine construction to realize automated, unmanned and intelligent mining. Intelligent monitoring of tunnel surrounding rock is an important part of coal mine intelligence. During the excavation process of the working face, the steady-state surrounding rock situation of the tunnel surrounding rock will be disturbed, the stable structure inside the surrounding rock will be destroyed, and the surrounding rock will be deformed. Coal mine disasters such as roof fall, bottom drum, and side deformation will occur, which will seriously affect the safe production of coal mines. By monitoring the deformation of the tunnel surrounding rock, the changing state of the tunnel surrounding rock can be grasped, and early warnings can be issued in time according to the degree of damage to the tunnel surrounding rock. It can also provide data support for tunnel support, realize the safe and efficient operation of tunnel operations, and provide a safe production environment for the intelligent and efficient excavation of the working face.

[0003] At present, the traditional tunnel monitoring technologies commonly used in coal mines include cross measurement method, convergence instrument measurement method and Bassett convergence measurement method. These methods usually require manual operation of instruments to measure the convergence of tunnel surrounding rock. The measurement accuracy is low, the data acquisition frequency is low, and there is interference from human factors, making it difficult to obtain a large amount of deformation data over a continuous period of time. In addition, there are some monitoring methods with a high degree of automation, such as 3D laser scanning modeling, fiber optic sensing technology, close-range photogrammetry, etc. These methods also have some shortcomings in practical applications. 3D laser scanning technology often uses multi-line laser scanners, which obtain a large amount of data, are difficult to process quickly, and have large errors. At the same time, manual operation is required during use, making it difficult to complete the scanning of long-distance tunnel surrounding rock in a short time. Fiber optic sensing technology requires the laying of a large number of optical fibers, and the installation process is complicated. It requires professional technicians to debug, the cost is high, and it is easy to miss detection, and long-distance transmission will be affected by the environment. Close-range photogrammetry requires the installation of cameras in the tunnel, so it has high requirements for lighting conditions and is greatly affected by the environment, making it difficult to achieve measurements under ideal conditions.

[0004] It can be seen that in actual working conditions, the surrounding rock of the tunnel has the characteristics of complex environment, few light sources and continuous destruction. The existing coal mine tunnel surrounding rock deformation monitoring technology has the problems of low measurement accuracy, information lag, low acquisition frequency and difficulty in real-time and accurate acquisition of the surrounding rock deformation in actual working conditions. Summary of the invention

[0005] The present invention provides a monitoring device and method for monitoring the deformation status of tunnel surrounding rock, so as to solve the problems of low measurement accuracy and difficulty in obtaining the deformation amount of surrounding rock in real time and efficiently in the existing coal mine tunnel surrounding rock deformation monitoring technology under actual working conditions.

[0006] A monitoring device and method for monitoring the deformation situation of surrounding rock in a tunnel of the present invention adopts the following technical solutions:

[0007] A monitoring device for monitoring the deformation status of surrounding rock in a tunnel, comprising: a bearing platform and a laser sensor module, a camera, a fill light, a control module and a power supply arranged on the bearing platform;

[0008] The laser sensor module includes a laser sensor, a rotating shaft fixed at the bottom of the laser sensor, a vertical plate movably connected to the rotating shaft, and a motor connected to the rotating shaft; the motor is connected to the control module;

[0009] The camera is connected to the control module;

[0010] The control module has a built-in wireless communication module, and the wireless communication module is connected to a computer;

[0011] The power supply is used to supply power to the laser sensor, camera, fill light and control module.

[0012] Preferably, an infrared camera is arranged on the supporting platform, the infrared camera is connected to the control module, and the infrared camera is powered by a power supply.

[0013] Preferably, there are two fill lights, which are respectively arranged on both sides of the camera, and the turning on and off of the fill lights is controlled by a power switch.

[0014] Preferably, the camera is an RGB camera.

[0015] A monitoring method for monitoring the deformation situation of surrounding rock of a tunnel, the method comprising:

[0016] Step 1: n targets are arranged in sequence on the same monitoring section of the tunnel surrounding rock, the monitoring device is moved to the bottom of the n targets, and the control module controls the motor to drive the laser sensor to rotate until the laser beam emitted by the laser sensor is projected to the center of target 1, and the initial position of the laser sensor is determined; wherein target 1 is the first target from one side of the monitoring section, the i-th target is target i, i is a positive integer, and 1≤i≤n;

[0017] Step 2: The control module uses the MATLAB calibration tool to jointly calibrate the camera and the laser sensor at the initial position to obtain the rotation matrix R from the camera to the laser sensor at the initial position. L and the translation matrix T L ;

[0018] Step 3: The camera captures an image containing n targets and returns the image containing n targets to the control module. The control module uses a watershed segmentation algorithm to segment the received image to obtain an image of n targets.

[0019] Step 4: The control module calculates the rotation matrix R from target i to the camera ic and the translation matrix T ic ;

[0020] Step 5: The control module calculates the rotation matrix R from the target i to the laser sensor at the initial pose im and the translation matrix T im , where the rotation matrix R im The calculation formula is: im =R ic ·R L ; Translation matrix T im The calculation formula is: im =R ic ·T L +T ic ;

[0021] Step 6: The control module is based on the rotation matrix R im and the translation matrix T im , calculate the angle θ that the laser sensor needs to rotate from its initial position to the target i i , where P is a point on target i. i (x i ,y i ,z i ), then click P i The coordinates transformed into the laser sensor's coordinate system are:

[0022]

[0023] Assume P i ′=(x i ′,y i ′,z i '),So

[0024] Step 7: The control module controls the laser sensor to rotate θ from the initial position i Aim at target i and measure the distance d between target i and laser sensor i ;

[0025] Step 8: The control module determines the distance d between the target i and the laser sensor. i And the angle θ that the laser sensor needs to rotate from the initial position to the target i i, calculate the distance between target i and target u Wherein, u is a positive integer, and 1≤u≤n, u≠i;

[0026] Step 9: Repeat steps 2 to 8 to obtain the distance d between each target at different time nodes iu , d iu The difference at different time nodes is the convergence amount of the tunnel surrounding rock.

[0027] Preferably, in step 7, the control module controls the laser sensor to align with the target i from the initial position, then returns to the initial position and rotates θ i+1 Aim at target i+1.

[0028] Compared with the prior art, the present invention has the following beneficial effects:

[0029] 1. The camera of the present invention can capture and identify the target position, and feed back the target image to the control module. The control module controls the rotation of the laser sensor according to the received target image, and sequentially aims at each target for distance measurement. The control module calculates the distance between each target. The change in the distance between each target measured at different time nodes can reflect the deformation trend of the tunnel surrounding rock. The whole process is automatically monitored, and the laser sensor itself has high measurement accuracy. Compared with the error caused by manual measurement, the automatic measurement using the laser sensor has higher accuracy and measurement efficiency, and can obtain a large amount of measurement data in real time in a short time, thereby accurately obtaining the deformation of the tunnel surrounding rock.

[0030] 2. The present invention adopts laser sensor for distance measurement, directly obtains the distance to the target, the data is small and clear, and the control module can quickly process the acquired measurement data, saving time, timely predicting the deformation of the tunnel surrounding rock, and improving the safety of the tunnel.

[0031] 3. The monitoring device of the present invention has a simple structure and is easy to install. It is also equipped with a fill light to improve the lighting conditions of the monitoring environment and also improve the applicability of the monitoring device. BRIEF DESCRIPTION OF THE DRAWINGS

[0032] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0033] Figure 1 It is a structural schematic diagram of the monitoring device of the present invention;

[0034] Figure 2It is a schematic diagram of the structure of the target and monitoring device of the present invention;

[0035] Figure 3 The present invention is a flow chart of the method.

[0036] Description of Reference Numerals

[0037] 1. Loading platform;

[0038] 2. Laser sensor module; 21. Laser sensor; 22. Rotation axis; 23. Vertical plate;

[0039] 3. Camera;

[0040] 4. Fill light;

[0041] 5. Control module;

[0042] 6. Power supply;

[0043] 7. Infrared camera. DETAILED DESCRIPTION

[0044] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0045] A monitoring device for monitoring the deformation status of surrounding rock in a tunnel according to the present invention is as follows: Figure 1 As shown, the device comprises:

[0046] A carrying platform 1 and a laser sensor module 2, a camera 3, a fill light 4, a control module 5 and a power supply 6 arranged on the carrying platform 1;

[0047] The laser sensor module 2 includes a laser sensor 21, a rotating shaft 22 fixed at the bottom of the laser sensor 21, a vertical plate 23 movably connected to the rotating shaft 22, and a motor connected to the rotating shaft 22; the motor is connected to the control module 5;

[0048] The camera 3 is connected to the control module 5;

[0049] The control module 5 has a built-in wireless communication module, and the wireless communication module is connected to the computer;

[0050] The power supply 6 is used to supply power to the laser sensor 21 , the camera 3 , the fill light 4 and the control module 5 .

[0051] It should be noted that the monitoring device is arranged as a whole on a movable chassis, and moves with the movable chassis in the tunnel, so as to facilitate mobile monitoring of different monitoring sections. Each equipment in the monitoring device adopts special explosion-proof products for coal mines.

[0052] It should be noted that the support platform 1 includes three layers: upper, middle and lower. The laser sensor module 2, camera 3 and fill light 4 are arranged on the upper layer of the support platform 1, the control module 5 is arranged on the middle layer of the support platform 1, and the power supply 6 is arranged on the lower layer of the support platform 1.

[0053] It should be noted that the lens of the camera 3 is perpendicular to the support platform 1 and faces upward, and the lens of the fill light 4 is also perpendicular to the support platform 1 and faces upward. Under the action of the fill light 4, the camera 3 can capture a clearer target image, which is convenient for identifying and locating the target.

[0054] It should be noted that the laser sensor 21 can rotate around the vertical plate 23 under the action of the motor, and the motor is controlled by the control module 5, that is, the control module 5 can control the rotation of the laser sensor 21;

[0055] It should be noted that the monitoring device is equipped with an independent power supply 6 to ensure that the monitoring device can work independently and continuously.

[0056] It should be noted that the control module 5 may adopt an FPGA development board, on which a control program, a calculation program, and an image processing program are implanted.

[0057] In this embodiment, an infrared camera 7 is disposed on the supporting platform 1 . The infrared camera 7 is connected to the control module 5 , and the infrared camera 7 is powered by a power supply 6 .

[0058] In this embodiment, it should be noted that the infrared camera 7 does not require an additional light source and is suitable for use in a lane environment.

[0059] When this embodiment is actually used, the lens of the infrared camera 7 faces the forward direction of the monitoring device. The infrared camera 7 timely obtains the environmental information in front of the monitoring device and timely feeds back the environmental information in front to the control module 5 to achieve the effect of early warning and obstacle avoidance.

[0060] In this embodiment, there are two fill lights 4, which are respectively arranged on both sides of the camera 3, and the opening and closing of the fill lights 4 are controlled by the switch of the power supply 6.

[0061] In this embodiment, the camera 3 is an RGB camera.

[0062] A monitoring method for monitoring the deformation situation of surrounding rock in a tunnel according to the present invention is as follows: Figures 2 to 3 As shown, the method includes:

[0063] Step 1: n targets are arranged in sequence on the same monitoring section of the tunnel surrounding rock, the monitoring device is moved to the bottom of the n targets, and the control module controls the motor to drive the laser sensor 21 to rotate until the laser beam emitted by the laser sensor 21 is projected to the center of target 1, and the initial position of the laser sensor 21 is determined; wherein target 1 is the first target from one side of the monitoring section, the i-th target is target i, i is a positive integer, and 1≤i≤n;

[0064] Step 2: The control module 5 uses the MATLAB calibration tool to jointly calibrate the camera 3 and the laser sensor 21 at the initial position, and obtains the rotation matrix R from the camera 3 to the laser sensor 21 at the initial position. L and the translation matrix T L ;

[0065] Step 3: The camera 3 captures an image containing n targets, and returns the image containing n targets to the control module 5. The control module 5 uses a watershed segmentation algorithm to segment the received image to obtain an image of the n targets;

[0066] Step 4: Control module 5 calculates the rotation matrix R from target i to camera 3 ic and the translation matrix T ic ;

[0067] Step 5: The control module 5 calculates the rotation matrix R from the target i to the laser sensor 21 at the initial position im and the translation matrix T im , where the rotation matrix R im The calculation formula is: im =R ic ·R L ; Translation matrix T im The calculation formula is: im =R ic ·T L +T ic ;

[0068] Step 6: Control module 5 according to the rotation matrix R im and the translation matrix T im , calculate the angle θ that the laser sensor 21 needs to rotate from its initial position to the target i i , where P is a point on target i. i (x i ,y i ,z i ), then click P i The coordinates transformed into the coordinate system of the laser sensor 21 are:

[0069]

[0070] Assume P i ′=(x i ′,y i ′,z i '),So

[0071] Step 7: The control module 5 controls the laser sensor 21 to rotate from the initial position to θ i Aim at target i and measure the distance d between target i and laser sensor 21 i ;

[0072] Step 8: The control module 5 determines the distance d between the target i and the laser sensor 21. i And the angle θ that the laser sensor needs to rotate from the initial position to the target i i , the distance between target i and target u Wherein, u is a positive integer, and 1≤u≤n, u≠i;

[0073] Step 9: Repeat steps 2 to 8 to obtain the distance d between each target at different time nodes iu , d iu The difference at different time nodes is the convergence amount of the tunnel surrounding rock.

[0074] It should be noted that in step 1, n targets are arranged in sequence in the same monitoring section of the tunnel surrounding rock, from left to right, namely target 1, target 2, ..., target n, where n is the total number of targets, and all of the n targets are in a checkerboard pattern.

[0075] It should be noted that in step 2, the control module 5 uses the MATLAB calibration tool to jointly calibrate the camera 3 and the laser sensor 21 at the initial position. Please refer to "Joint external parameter calibration of laser radar and monocular camera based on MATLAB" for the specific method.

[0076] It should be noted that in step 2, the optical center of camera 3 is taken as the origin O A , the direction perpendicular to the support platform 1 is the X-axis, the direction perpendicular to the side of the lane is the Y-axis, and the Z-axis is perpendicular to O A XY plane, establish the coordinate system O of camera 2 A XYZ; with the laser emitter of the laser sensor 21 as the origin O B , the direction perpendicular to the support platform 1 is the Y axis, the direction perpendicular to the side of the lane is the X axis, and the Z axis is perpendicular to the O B XY plane, establish the coordinate system O of the laser sensor 21 B XYZ.

[0077] It should be noted that, in step 2, the control module 5 uses the MATLAB calibration tool to jointly calibrate the camera 3 and the laser sensor 21 at the initial position to obtain the internal parameters of the camera 3.

[0078] It should be noted that the laser sensor 21 is B Rotation in the XY plane.

[0079] It should be noted that in step 3, the control module 5 uses the watershed segmentation algorithm, with specific reference to "Image Segmentation Based on Watershed Algorithm" to perform image segmentation on the received image.

[0080] It should be noted that before step 4, the upper left corner of the chessboard is taken as the origin O i , with the origin O i The two adjacent sides of the chessboard are the X-axis and the Y-axis (the X-axis points to the side of the tunnel), and the direction perpendicular to the chessboard surface is the Z-axis. The coordinate system O of the target i in the chessboard pattern is established. i XYZ.

[0081] It should be noted that step 4 specifically includes:

[0082] Step 401: The control module 5 uses the numpy library of Python to write a function to generate the three-dimensional coordinates of each corner point in the target i coordinate system. The specific generation order is as follows: i As the starting point, define the three-dimensional coordinates for all the corner points of the chessboard one by one according to the priority along the Y axis direction and along the X axis direction;

[0083] Step 402: the control module 5 uses the findChessboardCorners function and the comerSubPix function in the Opencv library to extract the sub-pixel coordinates of the corner points corresponding to the three-dimensional coordinates of all the corner points of the chessboard of the target i;

[0084] Step 403: The control module 5 inputs the sub-pixel coordinates and three-dimensional coordinates of the corner points of the target i as parameters into the opencv pose estimation function solvePnP, and the function solvePnP calculates the rotation matrix and translation matrix from the target i to the camera 3;

[0085] Step 404: Repeat steps 401 to 403 to obtain the rotation matrix R from each target i to camera 3 ic and the translation matrix T ic .

[0086] It should be noted that in step 6, P i (x i ,y i ,z i ) is any point on target i in the coordinate system of target i.

[0087] It should be noted that in step 8, d u Represents the distance from target u to laser sensor 21.

[0088] It should be noted that in the above steps 1 to 9, i represents from 1 to n, and u represents from 1 to n; for example, to calculate θ i , it means that we need to calculate θ1, θ2, ..., θ n , calculate d iu , it means that d needs to be calculated in sequence 12 ,d 13 ,……,d 1n ,d 23 ,……,d 2n ,……,d n(n-1) .

[0089] In this embodiment, in step 7, the control module 5 controls the laser sensor 21 to align with the target i from the initial position, and then returns to the initial position and rotates θ i+1 Aim at target i+1.

[0090] The above are only preferred embodiments of the present invention and are not intended to limit the present invention. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of the present invention should be included in the protection scope of the present invention.

Claims

1. A monitoring method for monitoring the deformation status of surrounding rock in a tunnel, the device used in the method comprising a bearing platform (1) and a laser sensor module (2), a camera (3), a fill light (4), a control module (5) and a power supply (6) arranged on the bearing platform (1); the laser sensor module (2) comprises a laser sensor (21), a rotating shaft (22) fixed at the bottom of the laser sensor (21), a vertical plate (23) movably connected to the rotating shaft (22), and a motor connected to the rotating shaft (22); the motor is connected to the control module (5); the camera (3) is connected to the control module (5); the control module (5) has a built-in wireless communication module, and the wireless communication module is connected to a computer; the power supply (6) is used to supply power to the laser sensor (21), the camera (3), the fill light (4) and the control module (5); the characteristics are as follows: The monitoring method comprises the following steps: Step 1: n targets are arranged in sequence on the same monitoring section of the surrounding rock of the tunnel, the monitoring device is moved to the bottom of the n targets, and the control module controls the motor to drive the laser sensor (21) to rotate until the laser beam emitted by the laser sensor (21) is projected to the center of target 1, and the initial position of the laser sensor (21) is determined; wherein target 1 is the first target from one side of the monitoring section, the i-th target is target i, i is a positive integer, and 1≤i≤n; Step 2: The control module (5) uses the MATLAB calibration tool to jointly calibrate the camera (3) and the laser sensor (21) at the initial position, and obtains the rotation matrix R from the camera (3) to the laser sensor (21) at the initial position. L and the translation matrix T L ; Step 3: The camera (3) captures an image containing the n targets, and returns the image containing the n targets to the control module (5). The control module (5) uses a watershed segmentation algorithm to perform image segmentation on the received image to obtain an image containing the n targets. Step 4: The control module (5) calculates the rotation matrix from target i to camera (3) and translation matrix ; Step 5: The control module (5) calculates the rotation matrix from the target i to the laser sensor (21) at the initial position and translation matrix , where the rotation matrix The calculation formula is: ; Translation matrix The calculation formula is: ; Step 6: The control module (5) is based on the rotation matrix and translation matrix , calculate the angle that the laser sensor (21) needs to rotate from its initial position to the target i , where a point on target i is ( , , ), then The coordinates transformed into the coordinate system of the laser sensor (21) are: ; Assumptions ,So Step 7: The control module (5) controls the laser sensor (21) from the initial position Rotate and align the target i, and measure the distance between the target i and the laser sensor (21) ; Step 8: The control module (5) determines the distance between the target i and the laser sensor (21). , the distance from target u to laser sensor (21) and the angle that the laser sensor (21) needs to rotate from the initial position to the target i , calculate the distance between target i and target u , where u is a positive integer, and 1≤u≤n, u≠i; Step 9: Repeat steps 2 to 8 to obtain the distances between targets at different time points. , The difference at different time nodes is the convergence amount of the tunnel surrounding rock.

2. A monitoring method for monitoring deformation status of tunnel surrounding rock according to claim 1, characterized in that: An infrared camera (7) is arranged on the support platform (1); the infrared camera (7) is connected to the control module (5); and the infrared camera (7) is powered by a power supply (6).

3. A monitoring method for monitoring deformation status of tunnel surrounding rock according to claim 1, characterized in that: There are two fill-in lights (4), which are respectively arranged on both sides of the camera (3); the turning on and off of the fill-in lights (4) is controlled by the switch of the power supply (6).

4. A monitoring method for monitoring deformation status of tunnel surrounding rock according to claim 1, characterized in that: The camera (3) is an RGB camera.

5. The method for monitoring deformation of surrounding rock in a tunnel according to claim 1, characterized in that: In step 7, the control module (5) controls the laser sensor (21) to align with the target i from the initial position, then returns to the initial position and rotates Aim at target i+1.

Citation Information

Cited By

  • Wireless target distance measuring device adopting non-contact method for measurement

    CN224436589U