Wireless intelligent laser displacement sensor system and monitoring method
Through the wireless intelligent laser displacement sensor system, using laser ranging and spot image processing technology, real-time three-dimensional displacement monitoring at the civil engineering construction site is realized, solving the problems of high equipment costs and discontinuous monitoring in the existing technology, and providing cost-effectiveness monitoring solutions.
Patent Information
- Application Number
- CN202411149148.1
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Priority Date
- 2024-01-31
- Filing Date
- 2024-08-21
- Publication Date
- 2024-11-19
AI Technical Summary
The existing civil engineering displacement monitoring methods have problems such as high equipment costs, cumbersome monitoring processes, over-specialized operators, and inability to achieve real-time and continuous monitoring, making it difficult to meet the efficient real-time monitoring needs of the construction site.
Adopt a wireless intelligent laser displacement sensor system, combining laser ranging module, laser receiving board, camera and spot image processing terminal, to calculate the displacement of the monitoring point by identifying the position changes of the laser spot, and use the wireless transmission module to realize real-time data transmission, simplifying the equipment Layout and operation process.
Real-time and continuous three-dimensional displacement monitoring of civil engineering construction sites is realized, equipment costs are reduced, operation steps are simplified, real-time monitoring needs of foundation pits and other projects are met, and timely warning capabilities are provided.
Smart Images

Figure CN118980319A_ABST
Abstract
Description
Technical Field
[0001] The invention belongs to the field of civil engineering monitoring, and in particular relates to a wireless intelligent laser displacement sensor system and a monitoring method suitable for three-dimensional displacement of civil engineering. Background Art
[0002] Displacement monitoring has always been an extremely important part of civil engineering construction. Through displacement monitoring data, we can promptly discover problems in the project and provide an important reference for ensuring project safety and preventing potential risks. Civil engineering construction scenarios are diverse, and the parts and displacement data that need to be monitored are also different.
[0003] For example, during the construction and use of bridges, we need to constantly monitor the displacement changes of key parts of the bridge, such as piers and towers, so as to determine the structural safety of the bridge and predict its service life; in the daily use of the dam, especially during the reservoir water storage and flood discharge, the displacement of the dam changes significantly, and we need timely and accurate displacement data to evaluate the safety of the dam; in the construction of highways, by effectively monitoring the settlement and displacement of the road surface, we can determine the condition of the road surface and provide a basis for the maintenance and upkeep of the highway; in the construction of tunnels, we need to monitor the displacement and deformation of the tunnel wall to evaluate the construction quality and safety of the tunnel and provide an important reference for the construction party; in slope engineering, we need to continuously monitor the displacement changes of the slope, evaluate the stability and safety of the slope through data, and provide a reference for engineering design and construction; in building structure monitoring, we need to accurately monitor the displacement changes of key parts of the building, and through these data, we can evaluate the structural safety and service life of the building. Especially in some important buildings, such as super-high-rise civil engineering projects, large sports stadiums, etc., real-time and accurate displacement monitoring is of great significance for ensuring the safety of buildings and preventing potential risks... There are countless scenarios like the above, so displacement monitoring is an indispensable part in the construction process of civil engineering projects.
[0004] Traditional civil engineering displacement monitoring methods mainly use equipment such as theodolites, total stations, and inclinometers. The theodolite can use the sight line method to obtain the horizontal displacement of the monitoring point by measuring the deviation between the reference point-monitoring point connection line and the original sight line. The principle of this method is intuitive, but it requires sufficient space around the monitored object; the total station can use the polar coordinate method to establish a coordinate system with the reference point as the coordinate origin, and obtain the displacement of the measuring point by measuring the coordinate change of the monitoring point. This method has a small workload and is more flexible in setting the station location. It can be applied to projects with complex surrounding environments, but the price of the total station is high, and it is less economical for monitoring small and medium-sized projects; the inclinometer can obtain the horizontal displacement of the soil layer at different depths of the monitoring point by reading the inclination angle and depth of the inclinometer tube, but this method requires the arrangement of a large number of monitoring points, and it is easy to obtain the monitoring results in a timely manner. The above traditional methods all require manual operation, and the monitoring data is not continuous, so it is impossible to obtain engineering displacement information in real time and issue timely warnings.
[0005] At present, some new technologies have also emerged, such as geodetic GPS, three-dimensional laser scanning, and machine vision. Geodetic GPS uses global positioning system technology to obtain the three-dimensional coordinates of the monitoring point and then calculate the displacement of the measuring point. However, the sampling frequency of GPS is limited and the anti-interference ability is low, which makes it difficult to be used in actual civil engineering monitoring. Three-dimensional laser scanning uses laser ranging technology to obtain the three-dimensional coordinates of the surface point cloud of the measured object. This method has high measurement accuracy and can work all-weather. It is suitable for engineering monitoring scenarios with complex environments, but the equipment cost is relatively high. Machine vision uses computer vision technology to obtain the displacement of the measuring point by identifying the displacement of natural features or artificial signs of the monitoring point. However, the machine vision method is easily affected by weather and obstacles, and has high requirements for camera lenses and photosensitive elements when the monitoring distance is far. The above new methods all have defects such as high equipment cost, complicated monitoring process, and over-specialized operators, so it is difficult to promote and apply them in actual monitoring.
[0006] Based on the above engineering background, in order to monitor the three-dimensional displacement of civil engineering efficiently and in real time and ensure a certain economy, it is very valuable to develop a new type of civil engineering three-dimensional displacement monitoring system by combining electronic information technology and computer science and technology. Summary of the invention
[0007] The purpose of the present invention is to overcome the shortcomings of the prior art, combine electronic information science, wireless sensor technology, stereo geometry and computer vision, and provide a wireless intelligent laser displacement sensor system and monitoring method, so that it can economically and reasonably perform real-time three-dimensional displacement monitoring of foundation pits under construction.
[0008] To this end, the present invention adopts the following technical solution: a wireless intelligent laser displacement sensor system, including a laser ranging module, a laser receiving board and a camera, characterized in that the laser receiving board is connected to the camera to form a receiving device, and the receiving device is separable from the laser ranging module, and also includes a laser spot image processing terminal. The laser ranging module emits laser to the laser receiving board, and the laser spot image processing terminal calculates the displacement of the monitoring point by identifying the change of the spot position on the receiving screen.
[0009] Preferably, a three-axis displacement platform is also included, which can apply a known displacement to the laser ranging module or the acquisition device, so as to calibrate the coordinate relationship between the laser ranging module and the laser receiving board.
[0010] Preferably, a three-axis tilt module is also included, which is used to measure the rotation angle that may occur when the laser ranging module or the laser receiving plate is displaced.
[0011] Preferably, it also includes a pole support for rigidly connecting a laser rangefinder or a receiving device that emits laser light to the monitoring point.
[0012] Preferably, a wireless transmission module is also included for wirelessly transmitting information monitored by the system.
[0013] Preferably, one receiving device corresponds to multiple laser ranging modules.
[0014] The present invention also discloses a displacement monitoring method, which is implemented by using the above-mentioned wireless laser displacement sensor. The wireless laser displacement sensor is implemented by setting a laser ranging module at a monitoring point and a receiving device at a reference point, or setting the receiving device at a monitoring point and a laser ranging module at a reference point. The laser of the laser ranging module is projected onto the receiving device. By applying a known number of displacements to the ranging module or the receiving device, multiple groups of ranging information and spot images are obtained. The relative position relationship between the laser ranging module and the receiving device is calculated by a laser spot image processing terminal. The relative displacement change between the two is calculated by processing the ranging information and spot image after monitoring.
[0015] The specific implementation process is as follows:
[0016] (1) Arrange the front end of the wireless laser transmitter at the monitoring point, which includes a ranging module that can emit laser, a three-axis slide module, a three-axis tilt module and a wireless transmission module; arrange the wireless laser receiver relay at the reference point, which includes a laser spot receiving board, a camera module, a wireless transmission module and a shell; arrange the laser spot image processing terminal at the monitoring end, which includes a PC and a wireless transmission module. Define the monitoring coordinate system at the monitoring point m X m Y m Z m As follows, X lAxis, Y l Axis and Z l The axes coincide with the three axes of the front three-axis slide module respectively, and the origin method has no effect on the calculation of displacement; define the receiving plate coordinate system O at the reference point b X b Y b A plane coordinate system defined for visual landmarks.
[0017] (2) The terminal issues a command, and the relay takes a photo of the receiving board and transmits it to the terminal. The terminal applies image recognition algorithms to extract the pixel coordinates of the black dot array. Combined with the known actual spacing of the dot array, the Zhang Zhengyou calibration algorithm is used to solve the internal and external parameters and distortion coefficients of the camera.
[0018] (3) The terminal issues a command, the front end projects the laser and transmits the ranging information and the three-axis tilt angle, and the relay captures the laser spot image on the receiving board and transmits it. The terminal first uses the distortion coefficient obtained in step (2) to dedistort the laser spot image, and then uses the laser spot image recognition algorithm to extract the pixel coordinates of the spot mass center. Finally, based on the monocular camera pinhole imaging distortion-free model, the internal and external parameters of the camera obtained in step (2) are used to solve the coordinates of the spot mass center in the receiving board coordinate system.
[0019] (4) According to the derivation, the displacement of the laser ranging module in the monitoring coordinate system is related to the change in the coordinates of the light spot receiving plate and the change in the ranging:
[0020]
[0021] in, is the displacement of the laser ranging module in the monitoring coordinate system at time t, is the transformation matrix from the receiving plate coordinate system to the monitoring coordinate system, is the change in the coordinates of the laser spot receiving plate relative to the initial value at time t, Δl t is the change of the laser ranging result relative to the initial value at time t, is the direction vector of the laser beam in the monitoring coordinate system. Note that The z-direction component of is always 0, and the above formula can be specifically written as:
[0022]
[0023] Among them, r ij (i=1,2,3;j=1,2) is the transformation matrix Elements of
[0024] In order to solve the 9 unknown parameters in the above formula, it is necessary to apply at least 3 known displacements to the laser ranging module, and the point set formed by all new emission points and the initial emission points must not be coplanar.
[0025] (5) The terminal issues a command to drive the front-end three-axis slide module to apply a known displacement to the laser ranging module. After the displacement is completed, the front end performs laser ranging and the relay performs spot shooting. The terminal operates according to step (3) to obtain the receiving plate coordinates of the laser spot corresponding to the new laser emission point, calculates its change relative to the initial coordinates, and calculates the change of the ranging result relative to the initial value.
[0026] (6) Repeat step (5) at least twice to obtain at least three sets of sample information of laser ranging module displacement, spot receiving plate coordinate change, and ranging change:
[0027]
[0028] The terminal solves the unknown parameters through numerical optimization algorithms.
[0029] (7) The terminal issues a command, and the front-end three-axis slide module restores the laser ranging module to its initial position and fixes it. The front end begins to project the laser continuously or at a certain time interval, and transmits the ranging information and the three-axis inclination angle. According to the image of the light spot taken by the relay, the terminal can obtain the coordinates of the laser spot receiving plate according to the process in step (3). Then, according to the system parameters obtained in step (6), the displacement of the front-end laser ranging module, that is, the three-dimensional displacement of the monitoring point, can be calculated. In addition, the terminal compares the three-axis inclination angle with the initial value obtained in step (3). If the change is higher than the set threshold, it is considered that a large angle has occurred at the monitoring point, and an alarm message is issued to remind manual inspection.
[0030] (8) Complete three-dimensional displacement monitoring.
[0031] In particular, in the present invention, the positions of the laser transmitter front end and the laser receiver relay can be exchanged, that is, the laser receiver can be arranged at the monitoring point and the laser transmitter can be fixed at the reference point.
[0032] Compared with the prior art, the present invention has the following beneficial effects:
[0033] 1. This method transmits the laser from the monitoring point to a receiving screen close to the camera, and further calculates the displacement of the monitoring point by identifying the change in the position of the light spot on the receiving screen, rather than directly photographing the monitoring point and extracting features to track the displacement. This reduces the requirements for camera lenses and photosensitive elements, and reduces equipment costs.
[0034] 2. Within the working distance of the laser ranging module, there are no requirements for the angles between the laser beam and the receiving screen, or between the camera lens plane and the receiving screen, which is more conducive to practical applications.
[0035] 3. The receiving screen and the calibration plate are combined into one. There is no need to remove the calibration plate before installing the receiving screen, which simplifies the use steps and avoids the error introduced by the camera external parameter matrix no longer being applicable due to the inconsistent installation positions of the receiving screen and the calibration plate.
[0036] 4. The measurement data is continuous and can meet the requirements of real-time monitoring and timely warning of foundation pits. BRIEF DESCRIPTION OF THE DRAWINGS
[0037] Figure 1 It is a schematic diagram of the structure of the front end of the wireless laser transmitter in the present invention.
[0038] Figure 2 The figure is a schematic diagram of the appearance of the front end of the wireless laser transmitter in the present invention.
[0039] Figure 3 It is a schematic diagram of the structure of the wireless laser receiver relay in the present invention.
[0040] Figure 4 It is a flow chart of the laser spot recognition algorithm in the present invention.
[0041] Figure 5 It is a schematic diagram of the monitoring coordinate system, receiving plate coordinate system, camera coordinate system, normalized camera plane and pixel coordinate system in the present invention. DETAILED DESCRIPTION
[0042] The present invention is further described below in conjunction with specific embodiments.
[0043] like Figure 1-Figure 2 A wireless intelligent laser displacement sensor system shown includes a wireless laser transmitter front end, a wireless laser receiver relay and a laser spot image processing terminal. The wireless laser transmitter front end is composed of a laser ranging module 1, a three-axis tilt module 2 and a wireless transmission module 3, and its exterior includes an antenna 5, an interface 4 and a mounting screw hole 6.
[0044] like Figure 3 As shown, the wireless laser receiver relay consists of a receiving screen 8 with a backlight and a calibration function, a camera module 10, a wireless transmission module and a housing 7. The camera is installed on a bracket 11, and a marker 9 is displayed on the receiving screen 8.
[0045] like Figure 4 As shown, the laser spot image processing terminal consists of a PC and a wireless transmission module. The front end of the wireless laser transmitter transmits the laser from the monitoring point to a receiving screen that is close to the camera module. The laser spot image processing terminal calculates the displacement of the monitoring point by identifying the change in the spot position on the receiving screen.
[0046] The wireless laser transmitter front end of the present invention has functions such as laser emission, laser ranging, three-axis tilt angle measurement and wireless transmission, the wireless laser receiver relay has functions such as laser spot receiving screen camera and wireless transmission, and the laser spot image processing terminal has functions such as laser spot center recognition, camera internal and external parameter calibration, relay receiving screen coordinate system and front end world coordinate system transformation matrix solution, foundation pit surface three-dimensional displacement calculation, etc. It also includes a three-axis displacement platform, which can apply known displacement to the laser ranging module or acquisition device, and is used to calibrate the coordinate relationship between the laser rangefinder and the light screen.
[0047] like Figure 5 As shown, the monitoring method of the three-dimensional displacement of the foundation pit of the present invention is as follows:
[0048] (1) Arrange the front end of the wireless laser transmitter at the monitoring point, which includes a ranging module that can emit laser, a three-axis slide module, a three-axis tilt module and a wireless transmission module; arrange the wireless laser receiver relay at the reference point, which includes a laser spot receiving board, a camera module, a wireless transmission module and a shell; arrange the laser spot image processing terminal at the monitoring end, which includes a PC and a wireless transmission module. Define the monitoring coordinate system at the monitoring point m X m Y m Z m As follows, X l Axis, Y l Axis and Z l The axes coincide with the three axes of the front three-axis slide module respectively, and the origin method has no effect on the calculation of displacement; define the receiving plate coordinate system O at the reference point b X b Y b A plane coordinate system defined for visual landmarks.
[0049] (2) The terminal issues a command, and the relay takes a photo of the receiving board and transmits it to the terminal. The terminal applies image recognition algorithms to extract the pixel coordinates of the visual markers. Combined with the known actual spacing of the markers, the Zhang Zhengyou calibration algorithm is used to solve the camera's intrinsic parameter matrix K, distortion coefficients k1, k2, p1, p2, k3, and extrinsic parameter matrix in is the rotation matrix from the receiving plate coordinate system to the camera coordinate system, is the translation vector.
[0050] (3) The terminal issues a command, and the front end starts to project the laser and transmits the three-axis tilt angle and ranging information to the terminal. The relay takes a picture of the light spot and transmits it to the terminal. The terminal dedistorts the light spot picture according to the internal parameter matrix and distortion coefficient obtained in step (2), and then applies the laser spot recognition algorithm to obtain the coordinates P of the center of the light spot in the pixel coordinate system. p =(x p ,y p )T . Figure 4 The process of laser spot recognition algorithm is shown. First, a certain brightness threshold is set, and pixels above the threshold are extracted in the HSV color space. Then, morphological operations are used to divide the set of these pixels into several connected components. For each connected component, area calculation is performed to exclude areas that are too large or too small, shape fitting is performed to exclude non-elliptical areas, and color judgment is performed to exclude non-red areas. Finally, the laser spot area is obtained, and the centroid method is used to calculate the centroid pixel coordinates P in the spot. p .
[0051] (4) Figure 5 This includes the process of obtaining the coordinates of the receiving plate through the monocular camera pinhole imaging distortion-free model. In step (3), the pixel coordinates P of the centroid of the dedistorted laser spot are obtained. p Then, according to the internal parameter matrix obtained in step (2) The coordinates of the laser spot on the normalized plane of the camera coordinate system can be obtained The coordinates of the light spot in the camera coordinate system are According to the external parameter matrix obtained in step (3) and The coordinate transformation relationship from the receiving plate coordinate system to the camera coordinate system can be obtained Specifically expanded as follows: Notice Known, it can be organized into about x b ,y b ,z c The three-variable linear equation system is: From this, the coordinates P of the laser spot in the receiving plate coordinate system can be solved. b =(x b ,y b ,0) T .
[0052] (5) According to the derivation, the displacement of the laser ranging module in the monitoring coordinate system is related to the change in the coordinates of the light spot receiving plate and the change in the ranging:
[0053]
[0054] in, is the displacement of the laser ranging module in the monitoring coordinate system at time t, is the transformation matrix from the receiving plate coordinate system to the monitoring coordinate system, is the change in the coordinates of the laser spot receiving plate relative to the initial value at time t, Δl t is the change of the laser ranging result relative to the initial value at time t, is the direction vector of the laser beam in the monitoring coordinate system. Note that The z-direction component of is always 0, and the above formula can be specifically written as:
[0055]
[0056] Among them, r ij (i=1,2,3;j=1,2) is the transformation matrix Elements of
[0057] In order to solve the 9 unknown parameters in the above formula, it is necessary to apply at least 3 known displacements to the laser ranging module, and the point set formed by all new emission points and the initial emission points must not be coplanar.
[0058] (6) The terminal issues a command to drive the front-end three-axis slide module to apply a known displacement to the laser ranging module. After the displacement is completed, the front end performs laser ranging and the relay performs spot shooting. The terminal operates according to steps (3) and (4) to obtain the receiving plate coordinates of the laser spot corresponding to the new laser emission point, calculate its change relative to the initial coordinates, and calculate the change of the ranging result relative to the initial value.
[0059] (7) Repeat step (6) at least twice to obtain at least three sets of sample information of laser ranging module displacement, spot receiving plate coordinate change, and ranging change:
[0060]
[0061] In the i-th group of samples D i Optimize the residual function
[0062]
[0063] The unknown parameter vector X = (r 11 ,r 12 ,r 21 ,r 22 ,r 31 ,r 32 ,a,b,c) T .
[0064] To reduce the dimension of parameter space, quaternion (x, y, z, w) is used to describe the transformation matrix The corresponding relationship between the two is:
[0065]
[0066] Substitute into the optimized residual function f i have to
[0067]
[0068] Then the optimized residual function can be established on all samples D
[0069] We also need to consider the parameter constraints, quaternion square and normalization: 2 +y 2 +z 2 +w 2 =1; the quaternion adopts the rule that the real part is always positive: w≥0; the laser beam direction vector is a unit vector: a 2 +b 2 +c 2 =1.
[0070] The optimization objective function can be taken as the second norm of the optimized residual function f(X; D), and the final optimization problem can be written as:
[0071] min||f(X)||
[0072] stx 2 +y 2 +z 2 +w 2 =1,
[0073] w≥0,
[0074] a 2 +b 2 +c 2 =1.
[0075] The terminal uses the trust region method to optimize and solve the unknown parameters.
[0076] (8) The terminal issues a command, and the front-end three-axis slide module restores the laser ranging module to its initial position and fixes it. The front end begins to project the laser continuously or at a certain time interval, and transmits the ranging information and the three-axis inclination angle. Based on the light spot image taken by the relay, the terminal can obtain the coordinates of the laser spot receiving plate according to the process in steps (3) and (4). Then, based on the system parameters obtained in step (7), the displacement of the front-end laser ranging module, that is, the three-dimensional displacement of the monitoring point, can be calculated. In addition, the terminal compares the three-axis inclination angle with the initial value obtained in step (3). If the change is higher than the set threshold, it is considered that a large rotation angle has occurred at the monitoring point, and an alarm message is issued to remind manual inspection.
[0077] (9) Complete three-dimensional displacement monitoring.
[0078] In particular, the positions of the laser transmitter front end and the laser receiver relay in the present invention can be exchanged, that is, the laser receiver can be arranged at the monitoring point, and the laser transmitter can be fixed at the reference point. The corresponding specific technical process is as follows:
[0079] (1) Arrange a wireless laser receiver relay at the monitoring point, which includes a laser spot receiving board, a three-axis slide module, a three-axis tilt module, a camera module, a wireless transmission module and a shell; arrange a wireless laser transmitter front end at the reference point, which includes a ranging module that can emit laser and a wireless transmission module; arrange a laser spot image processing terminal at the monitoring end, which includes a PC and a wireless transmission module. Define the monitoring coordinate system at the monitoring point m X m Y m Z m As follows, X l Axis, Y l Axis and Z l The axes coincide with the three axes of the front three-axis slide module respectively. The origin has no effect on the displacement calculation. Define the receiving plate coordinate system O at the monitoring point b X b Y b A plane coordinate system defined for visual landmarks.
[0080] (2) The terminal issues a command, and the relay takes a photo of the receiving board and transmits it to the terminal. The terminal applies image recognition algorithms to extract the pixel coordinates of the visual markers. Combined with the known actual spacing of the markers, the Zhang Zhengyou calibration algorithm is used to solve the camera's intrinsic parameter matrix K, distortion coefficients k1, k2, p1, p2, k3, and extrinsic parameter matrix
[0081] in is the rotation matrix from the receiving plate coordinate system to the camera coordinate system, is the translation vector.
[0082] (3) The terminal issues a command, and the front end starts to project the laser and transmits the distance measurement information to the terminal. The relay takes a picture of the light spot, measures the three-axis inclination angle, and transmits it to the terminal. The terminal dedistorts the light spot picture according to the internal parameter matrix and distortion coefficient obtained in step (2), and then applies the laser spot recognition algorithm to obtain the coordinates P of the center of the light spot in the pixel coordinate system. p =(x p ,y p ) T . Figure 4 The process of laser spot recognition algorithm is shown. First, a certain brightness threshold is set, and pixels above the threshold are extracted in the HSV color space. Then, morphological operations are used to divide the set of these pixels into several connected components. For each connected component, area calculation is performed to exclude areas that are too large or too small, shape fitting is performed to exclude non-elliptical areas, and color judgment is performed to exclude non-red areas. Finally, the laser spot area is obtained, and the centroid method is used to calculate the centroid pixel coordinates P in the spot. p .
[0083] (4) Figure 5This includes the process of obtaining the coordinates of the receiving plate through the monocular camera pinhole imaging distortion-free model. In step (3), the pixel coordinates P of the centroid of the dedistorted laser spot are obtained. p Then, according to the internal parameter matrix obtained in step (2) The coordinates of the laser spot on the normalized plane of the camera coordinate system can be obtained The coordinates of the light spot in the camera coordinate system are According to the external parameter matrix obtained in step (3) and The coordinate transformation relationship from the receiving plate coordinate system to the camera coordinate system can be obtained Specifically expanded as follows: Note that b =0, Known, it can be organized into about x b ,y b ,z c The three-variable linear equation system is: From this, the coordinates P of the laser spot in the receiving plate coordinate system can be solved. b =(x b ,y b ,0) T .
[0084] (5) According to the derivation, the displacement of the receiving plate in the monitoring coordinate system is related to the change in the coordinates of the light spot receiving plate and the change in the distance measurement as follows:
[0085]
[0086] in, is the displacement of the receiving plate in the monitoring coordinate system at time t, is the transformation matrix from the receiving plate coordinate system to the monitoring coordinate system, is the change in the coordinates of the laser spot receiving plate relative to the initial value at time t, Δl t is the change of the laser ranging result relative to the initial value at time t, is the direction vector of the laser beam in the monitoring coordinate system. Note that The z-direction component of is always 0, and the above formula can be specifically written as:
[0087]
[0088] Among them, r ij (i=1,2,3;j=1,2) is the transformation matrix Elements of
[0089] In order to solve the 9 unknown parameters in the above formula, at least 3 known displacements need to be applied to the receiving plate, and the point set formed by all new emission points and the initial emission points must not be coplanar.
[0090] (6) The terminal issues a command to drive the relay three-axis slide module to apply a known displacement to the receiving plate. After the displacement is completed, the front end performs laser ranging and the relay performs spot shooting. The terminal operates according to steps (3) and (4) to obtain the receiving plate coordinates of the laser spot corresponding to the new laser emission point, calculate its change relative to the initial coordinates, and calculate the change of the ranging result relative to the initial value.
[0091] (7) Repeat step (6) at least twice to obtain at least three sets of sample information of receiving plate displacement, light spot receiving plate coordinate change, and ranging change:
[0092]
[0093] In the i-th group of samples D i Optimize the residual function
[0094]
[0095] The unknown parameter vector X = (r 11 ,r 12 ,r 21 ,r 22 ,r 31 ,r 32 ,a,b,c) T .
[0096] To reduce the dimension of parameter space, quaternion (x, y, z, w) is used to describe the transformation matrix The corresponding relationship between the two is:
[0097]
[0098] Substitute into the optimized residual function f i have to
[0099]
[0100] Then the optimized residual function can be established on all samples D
[0101] We also need to consider the parameter constraints, quaternion square and normalization: 2 +y 2 +z 2 +w 2 =1; the quaternion adopts the rule that the real part is always positive: w≥0; the laser beam direction vector is a unit vector: a2 +b 2 +c 2 =1.
[0102] The optimization objective function can be taken as the second norm of the optimized residual function f(X; D), and the final optimization problem can be written as:
[0103] min||f(X)||
[0104] stx 2 +y 2 +z 2 +w 2 =1,
[0105] w≥0,
[0106] a 2 +b 2 +c 2 =1.
[0107] The terminal uses the trust region method to optimize and solve the unknown parameters.
[0108] (8) The terminal issues a command, and the relay three-axis slide module restores the receiving plate to the initial position and fixes it. The front end starts to project laser continuously or at a certain time interval and transmits distance measurement information; the relay takes a laser spot image and measures the three-axis inclination angle. Based on the spot image taken by the relay, the terminal can obtain the coordinates of the laser spot receiving plate according to the process in steps (3) and (4). Then, based on the system parameters obtained in step (7), the displacement of the relay receiving plate, that is, the three-dimensional displacement of the monitoring point, can be calculated. In addition, the terminal compares the three-axis inclination angle with the initial value obtained in step (3). If the change is higher than the set threshold, it is considered that a large rotation angle has occurred at the monitoring point, and an alarm message is issued to remind manual inspection.
[0109] (9) Complete three-dimensional displacement monitoring.
[0110] The present invention realizes wireless automatic intelligent monitoring of the whole process, avoids the problem of easy damage to cables, saves human resource costs, and at the same time, the measurement data is continuous, which can meet the real-time displacement monitoring needs of deep foundation pits and other projects. It reduces the requirements for camera lenses and photosensitive elements and reduces equipment costs.
[0111] It should be understood that these embodiments are only used to illustrate the present invention and are not used to limit the scope of the present invention. In addition, it should be understood that after reading the content taught by the present invention, those skilled in the art can make various changes or modifications to the present invention, and these equivalent forms also fall within the scope limited by the appended claims of the application.
Claims
1. A wireless intelligent laser displacement sensor system, including a laser ranging module, a laser receiving board and a camera, characterized in that The laser receiving board is connected to the camera to form a receiving device. The receiving device is separable from the laser ranging module and also includes a laser spot image processing terminal. The laser ranging module emits laser light to the laser receiving board. The laser spot image processing terminal calculates the displacement of the monitoring point by identifying the change in the spot position on the receiving screen.
2. A wireless intelligent laser displacement sensor system according to claim 1, characterized in that It also includes a three-axis translation stage, which can apply a known displacement to the laser ranging module or the acquisition device, and is used to calibrate the coordinate relationship between the laser ranging module and the laser receiving board.
3. A wireless intelligent laser displacement sensor system according to claim 2, characterized in that It also includes a three-axis tilt module, which is used to measure the rotation angle that may occur when the laser ranging module or the laser receiving plate is displaced.
4. A wireless intelligent laser displacement sensor system according to claim 2 or 3, characterized in that It also includes a pole support for rigidly connecting a laser rangefinder or a receiving device that emits laser light to a monitoring point.
5. The wireless intelligent laser displacement sensor system according to claim 1, characterized in that It also includes a wireless transmission module for wirelessly transmitting system monitoring information.
6. The wireless intelligent laser displacement sensor system according to claim 1, characterized in that One receiving device corresponds to multiple laser ranging modules.
7. A displacement monitoring method, characterized in that The wireless laser displacement sensor according to any one of claims 1 to 6 is adopted, wherein the laser ranging module is set at the monitoring point and the receiving device is set at the reference point, or the receiving device is set at the monitoring point and the laser ranging module is set at the reference point, the laser of the laser ranging module is projected onto the receiving device, and a plurality of sets of ranging information and spot images are obtained by applying a known number of displacements to the ranging module or the receiving device. The relative position relationship between the laser ranging module and the receiving device is obtained by processing and calculating by the laser spot image processing terminal, and the relative displacement change between the two is calculated by processing the ranging information and the spot image after monitoring.
8. A displacement monitoring method according to claim 7, characterized in that: (1) Arrange the front end of the wireless laser transmitter at the monitoring point, which includes a ranging module that can emit laser, a three-axis slide module, a three-axis tilt module and a wireless transmission module; arrange the wireless laser receiver relay at the reference point, which includes a laser spot receiving board, a camera module, a wireless transmission module and a shell; arrange the laser spot image processing terminal at the monitoring end, which includes a PC and a wireless transmission module, and define the monitoring coordinate system at the monitoring point. m X m Y m Z m As follows, X l Axis, Y l Axis and Z l The axes coincide with the three axes of the front-end three-axis slide module respectively. The origin method has no effect on the calculation of displacement; define the receiving plate coordinate system O at the reference point b X b Y b Plane coordinate system determined for visual landmarks; (2) The terminal issues a command, and the relay takes a photo of the receiving board and transmits it to the terminal. The terminal applies image recognition algorithms to extract the pixel coordinates of the black dot array. Combined with the known actual spacing of the dot array, the Zhang Zhengyou calibration algorithm is applied to solve the internal and external parameters and distortion coefficients of the camera; (3) The terminal issues a command, the front end projects a laser and transmits the ranging information and the three-axis tilt angle, the relay shoots the laser spot image on the receiving plate and transmits it, the terminal first uses the distortion coefficient obtained in step (2) to dedistort the laser spot image, and then applies the laser spot image recognition algorithm to extract the pixel coordinates of the spot centroid, and finally based on the monocular camera pinhole imaging distortion-free model, uses the camera internal and external parameters obtained in step (2) to solve the coordinates of the spot centroid in the receiving plate coordinate system; (4) According to the derivation, the displacement of the laser ranging module in the monitoring coordinate system is related to the change in the coordinates of the light spot receiving plate and the change in the ranging: in, is the displacement of the laser ranging module in the monitoring coordinate system at time t, is the transformation matrix from the receiving plate coordinate system to the monitoring coordinate system, is the change in the coordinates of the laser spot receiving plate relative to the initial value at time t, Δl t is the change of the laser ranging result relative to the initial value at time t, is the direction vector of the laser beam in the monitoring coordinate system, noting that The z-direction component is always 0, and the above formula can be specifically written as: Among them, r ij (i=1,2,3;j=1,2) is the transformation matrix Elements, To solve the nine unknown parameters in the above equation, the laser ranging module must be subjected to at least three known displacements, and the point set formed by all new emission points and the initial emission point must not be coplanar. (5) The terminal issues a command to drive the front-end three-axis slide module to apply a known displacement to the laser ranging module. After the displacement is completed, the front-end performs laser ranging and the relay performs spot shooting. The terminal operates according to step (3) to obtain the receiving plate coordinates of the laser spot corresponding to the new laser emission point, calculates the change relative to the initial coordinates, and calculates the change of the ranging result relative to the initial value; (6) Repeat step (5) at least twice to obtain at least three sets of sample information of laser ranging module displacement, spot receiving plate coordinate change, and ranging change: The terminal solves unknown parameters through numerical optimization algorithms; (7) The terminal issues a command, and the front-end three-axis slide module restores the laser ranging module to its initial position and fixes it. The front-end starts to project the laser continuously or at a certain time interval, and transmits the ranging information and the three-axis tilt angle. The terminal obtains the coordinates of the laser spot receiving plate according to the process in step (3) based on the spot image taken by the relay. Then, the system parameters obtained in step (6) can be used to calculate the displacement of the front-end laser ranging module, that is, the three-dimensional displacement of the monitoring point. In addition, the terminal compares the three-axis tilt angle with the initial value obtained in step (3). If the change is higher than the set threshold, it is considered that a large angle has occurred at the monitoring point, and an alarm message is issued to remind manual inspection; (8) Complete three-dimensional displacement monitoring.
Citation Information
Patent Citations
Laser image real time monitoring method measuring relative displacement
CN104897067A
Automatic monitoring system of laser surface displacement
CN106705857A
Method for monitoring structural displacement and rotation angle based on machine vision
CN109458991A
Monitoring method for detecting three-dimensional displacement of bridge in real time
CN110375654A
Slope stability three-dimensional deformation auxiliary monitoring device and method
CN113188464A
