Three-dimensional deformation automatic monitoring equipment and measuring method thereof

Through visual measurement technology, laser ranging technology and gimbal control technology, combined with intelligent algorithms, domestic three-dimensional deformation automatic monitoring equipment is realized, solving the problems of high cost and insufficient accuracy of existing equipment, and achieving high accuracy and low cost 3D deformation monitoring and large-area coverage.

CN118936344APending Publication Date: 2024-11-12SICHUAN JIAOAO INTELLIGENT CONTROL PROTECTION TECH CO LTD +1
View PDF 0 Cites 2 Cited by

Patent Information

Application Number
CN202410989458.8
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-07-23
Publication Date
2024-11-12

AI Technical Summary

Technical Problem

The existing three-dimensional deformation monitoring equipment is costly and has insufficient accuracy. It is difficult to cover a large area based on visual measurement technology and can only obtain two-dimensional deformation data.

Method used

Using visual measurement technology, laser ranging technology and gimbal control technology, combined with intelligent algorithms, the domestic three-dimensional deformation automatic monitoring equipment is realized, and three-dimensional coordinate calculation is performed through vision modules, laser rangefinders and two-dimensional gimbals to generate control commands To achieve three-dimensional deformation measurement.

Benefits of technology

It realizes high-precision and low-cost three-dimensional deformation monitoring, solves the problems of high equipment costs and insufficient accuracy, and can cover a large area to obtain three-dimensional deformation data.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118936344A_ABST
    Figure CN118936344A_ABST
Patent Text Reader

Abstract

The invention discloses three-dimensional deformation automatic monitoring equipment and a measuring method thereof, and the equipment comprises a visual module which is used for achieving the visual measurement of all observation points in a monitoring range; the laser range finder is used for realizing distance measurement of all observation points in the monitoring range; the two-dimensional holder is used for installing the visual module and the laser range finder; and the main control module is used for acquiring measurement data of the vision module and the laser range finder, and the horizontal angle and the pitching angle of rotation of the two-dimensional holder, calculating the three-dimensional coordinate of each observation point in the monitoring range, and controlling the horizontal movement and the pitching movement of the two-dimensional platform. According to the invention, the visual measurement technology and the laser ranging technology are combined with the holder control technology to realize the three-dimensional deformation measurement of the observation point, and the measurement can be realized only by adopting the domestic holder equipment, the visual measurement equipment and the laser range finder and combining with the intelligent algorithm, so that the complete localization replacement is realized, the cost is saved, and the measurement efficiency is improved. And the precision and the reliability are relatively high.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application belongs to the field of deformation measurement technology, and specifically relates to a three-dimensional deformation automatic monitoring device and a measurement method thereof. Background Art

[0002] There is an increasing demand for deformation measurement in industries such as tunnels. Fully automatic total stations are usually used to achieve three-dimensional deformation measurement of observation points. However, due to the insufficient measurement accuracy of domestic fully automatic total stations, especially the angle measurement accuracy is difficult to reach 0.5", which cannot meet the deformation measurement needs. Therefore, imported fully automatic total stations are generally used, such as Leica, Sokkia, Tianbao, etc., which have the advantages of long measurement distance, high accuracy, and one-time acquisition of three-dimensional deformation information of observation points. However, imported fully automatic total stations are expensive. In addition, in special scenarios, such as measurement in tunnels, due to the curves in the tunnel and the easy overlap of multiple observation points on the same plane, the monitoring distance of the fully automatic total station is only about 100m in most cases. Therefore, it is difficult to give full play to its advantages of long measurement distance, resulting in poor economy and other disadvantages.

[0003] With the advancement of science and technology, deformation measurement technology based on visual measurement has been promoted and applied. Visual measurement has the advantages of high precision and low cost. However, it has shortcomings such as short measurement distance, small field of view, difficulty in covering a large area, and only being able to obtain two-dimensional deformation data. Summary of the invention

[0004] In view of the defects of using fully automatic total stations such as high measurement cost and insufficient accuracy, as well as the shortcomings of vision measurement-based technology that is difficult to cover large areas and can only obtain two-dimensional deformation data, the present application proposes a three-dimensional deformation automatic monitoring device and its measurement method. The present application adopts vision measurement technology, laser ranging technology and combines pan-tilt control technology to achieve three-dimensional deformation measurement of observation points. It only needs to use domestic pan-tilt equipment, vision measurement equipment and laser rangefinder combined with intelligent algorithms to achieve complete domestic substitution, saves costs, and has high accuracy and reliability.

[0005] This application is implemented through the following technical solutions:

[0006] A three-dimensional deformation automatic monitoring device, the three-dimensional deformation automatic monitoring device comprising:

[0007] A visual module, wherein the visual module is used to realize visual measurement of all observation points within the monitoring range, wherein the observation points are deformation measurement points, and targets are set at all observation points;

[0008] A laser rangefinder, which is used to measure the distances of all observation points within the monitoring range;

[0009] A two-dimensional pan-tilt platform, on which the visual module and the laser rangefinder are mounted;

[0010] And, a main control module, the main control module is used to obtain the measurement data of the visual module and the laser rangefinder, as well as the horizontal angle and pitch angle of the two-dimensional pan-tilt rotation, calculate the three-dimensional coordinates of each observation point within the monitoring range according to a preset algorithm, and generate control instructions to control the horizontal movement and pitch movement of the two-dimensional platform.

[0011] In some embodiments, the main control module includes:

[0012] A central control unit, the central control unit is used to receive and calculate the three-dimensional coordinates of each observation point within the monitoring range according to the data collected by the visual module and the laser rangefinder, as well as the horizontal angle and the pitch angle of the two-dimensional pan-tilt platform, and output the horizontal offset angle and the pitch offset angle of the two-dimensional pan-tilt platform corresponding to each observation point;

[0013] And, a gimbal control unit, which outputs a two-dimensional gimbal drive mechanism control instruction according to the two-dimensional gimbal horizontal offset angle and pitch offset angle corresponding to each observation point output by the central control unit, and drives the two-dimensional gimbal to move the corresponding horizontal offset angle and pitch offset angle.

[0014] In some embodiments, the main control module includes:

[0015] A central control unit, the central control unit is used to receive and calculate the three-dimensional coordinates of each observation point within the monitoring range according to the data collected by the visual module and the laser rangefinder, as well as the horizontal angle and pitch angle of the two-dimensional pan-tilt platform, and output the horizontal angle and pitch angle of the two-dimensional pan-tilt platform corresponding to each observation point;

[0016] And, a gimbal control unit, which outputs a gimbal drive mechanism control instruction according to the two-dimensional gimbal horizontal angle and pitch angle corresponding to each observation point output by the central control unit, and drives the two-dimensional gimbal to move to the corresponding horizontal angle and pitch angle.

[0017] In some embodiments, the driving mechanism of the two-dimensional pan-tilt platform adopts a stepping motor.

[0018] In some embodiments, the vision module further comprises:

[0019] A fill light is used to supplement light during visual measurement.

[0020] On the other hand, the present application also proposes a three-dimensional deformation automatic measurement method, which is implemented based on the above-mentioned three-dimensional deformation automatic monitoring device, and includes:

[0021] Initialization step: controlling the rotation of the two-dimensional pan-tilt platform so that the visual measurement range of the visual module covers the reference point, and the visual measurement range can also cover at least one observation point, and one of the at least one observation point is used as a working base point, so as to determine the first field of view; wherein the reference point is a stable point, and a target is set at the reference point;

[0022] Alignment step: controlling the rotation of the two-dimensional pan-tilt platform to align the laser rangefinder with an observation point in the current field of view, and recording the horizontal angle and pitch angle of the two-dimensional pan-tilt platform;

[0023] Three-dimensional measurement step: obtaining the distance of the observation point by the laser rangefinder, and calculating the three-dimensional coordinates of the observation point by using trigonometric function relationship according to the distance of the observation point and the horizontal angle and pitch angle of the two-dimensional pan-tilt platform;

[0024] Deformation calculation step: repeating the alignment step and the three-dimensional measurement step to obtain the three-dimensional coordinates of the observation point after the change, and using the three-dimensional coordinates of the observation point before and after the change to obtain the three-dimensional deformation value of the observation point;

[0025] Repeat the alignment step, the three-dimensional measurement step and the deformation calculation step to perform the three-dimensional deformation measurement of the next observation point in the current field of view until the three-dimensional deformation measurement of all observation points in the current field of view is completed;

[0026] Field of view switching step: according to the field of view switching mode, controlling the rotation of the two-dimensional pan-tilt platform to make the visual module enter the next field of view, and returning to the alignment step to perform three-dimensional deformation measurement of all observation points in the next field of view until the three-dimensional deformation measurement of all observation points within the monitoring range is completed;

[0027] Among them, the field of view switching method is: the working base point of the previous field of view is within the coverage range of the next field of view, and the working base point of the previous field of view is used as the reference point of the next field of view. The next field of view also includes at least one observation point, one of which is used as the working base point of the field of view.

[0028] In some embodiments, the alignment step specifically includes:

[0029] The offset data measured by the visual module is combined with the horizontal angle and the pitch angle of the two-dimensional pan-tilt platform to calculate the offset of each observation point relative to the reference point;

[0030] According to the offset of each observation point relative to the reference point, combined with the distance of each observation point measured by the laser rangefinder, the angle change value of each observation point relative to the initial position is calculated through the trigonometric function relationship, and the rotation of the two-dimensional pan-tilt platform is controlled according to the angle change value, so that the laser emitted by the laser rangefinder is realigned with the target;

[0031] The initial position refers to the position where the laser line emitted by the original laser rangefinder is aimed at the center of the target.

[0032] In some embodiments, the alignment step specifically includes:

[0033] The offset data of each observation point relative to the central axis of the window measured by the visual module is combined with the distance of each observation point, and the horizontal angle and pitch angle of each observation point deviating from the central axis of the window are calculated through trigonometric function relationship;

[0034] According to the horizontal angle and the pitch angle of each observation point deviating from the central axis of the window, the two-dimensional gimbal is controlled to rotate so that the laser emitted by the laser rangefinder is realigned with the target;

[0035] In some embodiments, the three-dimensional coordinates are calculated as follows:

[0036] After alignment, the horizontal angle and the pitch angle of the two-dimensional pan-tilt platform are recorded, and the distance of the observation point is measured by the laser rangefinder;

[0037] According to the horizontal angle and pitch angle of the two-dimensional gimbal, and the distance of the observation point, the three-dimensional coordinates of the observation point in the measurement coordinate system are calculated using the trigonometric function relationship. By transforming the coordinate system, the three-dimensional coordinates of the observation point in the geodetic coordinate system can be obtained.

[0038] In some embodiments, the aligning step further comprises:

[0039] After alignment, check whether it is aligned. If it is not aligned, perform the next alignment according to the alignment method;

[0040] The verification method adopted is: determining whether the target center coincides with the center line of the window through the visual module, if so, it is aligned, otherwise it is not aligned.

[0041] The present application proposes a three-dimensional deformation automatic monitoring device and a measurement method thereof, which adopts visual measurement technology, laser ranging technology and pan-tilt control technology to realize three-dimensional deformation measurement. It only needs to adopt domestic pan-tilt equipment, visual measurement equipment and laser rangefinder in combination with intelligent algorithm to realize it, realizing complete domestic substitution, solving the problems of high cost and technological blockade of existing three-dimensional deformation monitoring equipment that relies on foreign equipment, and the inability of existing deformation monitoring equipment based on visual measurement technology to realize three-dimensional deformation measurement, limited measurement range and low accuracy.

[0042] The present application proposes a three-dimensional deformation automatic monitoring device and a measurement method thereof, which mainly utilizes the trigonometric function relationship to realize the calculation of the three-dimensional coordinates of the observation point, so as to quickly and accurately obtain the three-dimensional deformation amount of the observation point. The algorithm is simple, easy to implement, and has high accuracy and reliability.

[0043] The present application proposes a three-dimensional deformation automatic monitoring device and a measurement method thereof, which adopts an alignment control technology to ensure that the laser rangefinder can be aligned with the observation point for each measurement of each observation point, thereby improving the accuracy and reliability of the measurement. BRIEF DESCRIPTION OF THE DRAWINGS

[0044] The drawings described herein are used to provide a further understanding of the embodiments of the present application, constitute a part of the present application, and do not constitute a limitation on the embodiments of the present application. In the drawings:

[0045] Figure 1 This is a principle block diagram of the automatic monitoring device of an embodiment of the present application;

[0046] Figure 2 This is a flow chart of three-dimensional deformation measurement according to an embodiment of the present application;

[0047] Figure 3 This is a schematic diagram of the field of view switching principle of an embodiment of the present application;

[0048] Figure 4 This is a schematic diagram of the three-dimensional coordinate calculation principle of an embodiment of the present application. DETAILED DESCRIPTION

[0049] Hereinafter, the term "include" or "may include" used in various embodiments of the present application indicates the presence of the invented function, operation or element, and does not limit the addition of one or more functions, operations or elements. In addition, as used in various embodiments of the present application, the terms "include", "have" and their cognates are intended only to indicate specific features, numbers, steps, operations, elements, components or a combination of the foregoing items, and should not be understood as first excluding the presence of one or more other features, numbers, steps, operations, elements, components or a combination of the foregoing items or the possibility of adding one or more features, numbers, steps, operations, elements, components or a combination of the foregoing items.

[0050] In various embodiments of the present application, the expression "or" or "at least one of A or / and B" includes any combination or all combinations of the words listed at the same time. For example, the expression "A or B" or "at least one of A or / and B" may include A, may include B, or may include both A and B.

[0051] The expressions (such as "first", "second", etc.) used in the various embodiments of the present application may modify the various constituent elements in the various embodiments, but may not limit the corresponding constituent elements. For example, the above expressions do not limit the order and / or importance of the elements. The above expressions are only used for the purpose of distinguishing one element from other elements. For example, the first user device and the second user device indicate different user devices, although both are user devices. For example, without departing from the scope of the various embodiments of the present application, the first element may be referred to as the second element, and similarly, the second element may also be referred to as the first element.

[0052] It should be noted that if it is described that one component element is “connected” to another component element, the first component element may be directly connected to the second component element, and a third component element may be “connected” between the first component element and the second component element. Conversely, when one component element is “directly connected” to another component element, it can be understood that there is no third component element between the first component element and the second component element.

[0053] The terms used in the various embodiments of the application are only used to describe the purpose of specific embodiments and are not intended to limit the various embodiments of the application. As used herein, the singular form is intended to also include the plural form, unless the context clearly indicates otherwise. Unless otherwise limited, all terms used here (including technical terms and scientific terms) have the same meaning as the meanings commonly understood by ordinary technicians in the field of the various embodiments of the application. The terms (such as the terms defined in the dictionary generally used) will be interpreted as having the same meaning as the contextual meaning in the relevant technical field and will not be interpreted as having an idealized meaning or an overly formal meaning, unless clearly defined in the various embodiments of the application.

[0054] In order to make the objectives, technical solutions and advantages of the present application more clearly understood, the present application is further described in detail below in conjunction with examples and drawings. The illustrative implementation scheme of the present application and its description are only used to explain the present application and are not intended to limit the present application.

[0055] Example:

[0056] At present, automated deformation monitoring mainly relies on imported fully automatic total stations, but their cost is high. At the same time, in some special scenarios, such as measurement in tunnels, the advantages of fully automatic total stations such as long measurement distance are difficult to play out, resulting in defects such as poor economy. The existing automatic deformation monitoring equipment based on visual measurement cannot take into account the contradiction between coverage and measurement accuracy. In addition, the existing automatic deformation monitoring equipment based on visual measurement cannot obtain three-dimensional deformation data of observation points, and the use of multiple visual superposition methods leads to problems such as high cost and reduced reliability. In view of this, this embodiment proposes a three-dimensional deformation automatic monitoring device. The device proposed in this embodiment adopts visual measurement technology, laser ranging technology and combines pan-tilt control technology to realize three-dimensional deformation measurement of observation points. It only needs to use domestic pan-tilt equipment, visual measurement equipment and laser rangefinder combined with intelligent algorithms to achieve complete domestic substitution, save costs, and have high accuracy and reliability.

[0057] like Figure 1 As shown, the three-dimensional deformation automatic monitoring device proposed in this embodiment includes:

[0058] A visual module, which includes a camera and a lens. The visual module is used to achieve visual measurement of all observation points (i.e., deformation measurement points) within the monitoring range. Optionally, the visual module may also include a fill light, which can be used to supplement light during visual measurement to reduce the impact of the environment on measurement accuracy. It is particularly suitable for some special application scenarios, such as measurement in tunnels. It should be noted that the fill light may not be used in an environment with sufficient light. Optionally, the camera may use but is not limited to an ultra-high pixel industrial camera, the lens may use but is not limited to a continuous zoom industrial lens, and the fill light may use but is not limited to a concentrated infrared fill light.

[0059] Laser rangefinder, which is used to measure the distance of all observation points (i.e. deformation measurement points) within the monitoring range. The laser rangefinder and the visual module form a whole and are installed on a two-dimensional pan-tilt platform. During the installation process, ensure that the laser emitted by the laser rangefinder coincides with the center line of the field of view of the visual module. It should be noted that due to mechanical matching errors, there is a certain offset between the laser emitted by the laser rangefinder and the center line of the field of view of the visual module. As long as the offset is within a certain error range, for example, the distance between the laser and the center line of the field of view is within 3 cm or the angle is within 0.2°. The offset can be obtained by measurement and corrected using an algorithm.

[0060] A two-dimensional gimbal is provided with a visual module and a laser rangefinder. The two-dimensional gimbal can realize 360° horizontal rotation and 180° pitch rotation. Optionally, the two-dimensional gimbal adopts but is not limited to a high-precision gimbal.

[0061] And, a main control module, which is used to obtain the measurement data obtained by the visual module and the laser rangefinder, calculate the three-dimensional coordinates of each observation point within the monitoring range according to a preset algorithm, and generate control instructions to control the horizontal and pitch movements of the two-dimensional pan-tilt platform.

[0062] In one implementation mode, the main control module mainly includes a central control unit and a gimbal control unit, wherein the central control unit is used to receive and calculate the three-dimensional coordinates of each observation point within the monitoring range according to the data collected by the visual module and the laser rangefinder and the horizontal angle and pitch angle of the two-dimensional gimbal rotation, and the central control unit also outputs the gimbal horizontal offset angle and pitch offset angle corresponding to each observation point to the gimbal control unit. The gimbal control unit outputs a gimbal drive mechanism control instruction according to the gimbal horizontal offset angle and pitch offset angle corresponding to each observation point output by the central control unit, and drives the gimbal to move the corresponding horizontal offset angle and pitch offset angle.

[0063] In another embodiment, the central control unit may also output the horizontal angle and pitch angle of the gimbal corresponding to each observation point within the monitoring range to the gimbal control unit. The gimbal control unit outputs the gimbal drive mechanism control instruction according to the horizontal angle and pitch angle of the gimbal corresponding to each observation point output by the central control unit, and drives the gimbal to move to the corresponding horizontal angle and pitch angle.

[0064] Furthermore, the pan / tilt can be driven by a stepper motor, so the pan / tilt control unit can convert the angle into the number of steps of the motor, thereby realizing pan / tilt rotation control. It should be noted that other drive mechanisms can also be used, but the driving principle is the same, that is, the pan / tilt control unit outputs control instructions to the drive mechanism, and then performs corresponding pan / tilt rotation (horizontal or pitch) control according to the control instructions.

[0065] The measurement principle of the equipment proposed in this embodiment is as follows: first, by controlling the pan-tilt rotation, the visual measurement range of the visual module covers the reference point, and at the same time, the visual measurement range can also cover at least one observation point (i.e., deformation measurement point), which is used as the first field of view, wherein the reference point is a target installed in a stable position (fixed position), and the observation point is a target installed at the measurement position. One of the at least one observation point is used as the working base point of the first field of view, and the working base point is used as the reference point of the next field of view, that is, when the field of view is switched, the working base point of the previous field of view is within the coverage range of the next field of view. The pan-tilt rotation is controlled in accordance with the above-mentioned field of view switching method to achieve field of view switching until the measurement of all observation points within the monitoring range is completed. Then, the pan-tilt rotation is controlled to make the laser rangefinder aim at the target. Optionally, the visual module can also be used to determine whether it is aimed. If it is not aimed, correction is made. Finally, the gimbal is controlled to rotate, and the distance of each observation point from the laser rangefinder and the horizontal and pitch angles of the gimbal are obtained. According to the distance and angle data and the trigonometric function relationship, the three-dimensional coordinates of the corresponding observation point can be calculated. According to the three-dimensional coordinate data before and after the change, the three-dimensional change value of the observation point can be obtained, thereby realizing three-dimensional deformation measurement.

[0066] The device proposed in this embodiment realizes three-dimensional deformation measurement through visual measurement technology and laser rangefinder. It only needs to adopt domestically produced pan-tilt heads, visual equipment and laser rangefinders to achieve complete domestic substitution, saving costs while ensuring measurement accuracy. In addition, the device proposed in this embodiment only uses a set of visual measurement equipment, combined with corresponding algorithms to achieve deformation measurement over a large coverage range, and realizes three-dimensional deformation measurement, reducing costs and improving reliability.

[0067] This embodiment also proposes a three-dimensional deformation measurement method based on the above-mentioned three-dimensional deformation automatic detection device, such as Figure 2 As shown, the three-dimensional deformation measurement method specifically includes the following steps:

[0068] Step 100, initialization step: controlling the rotation of the two-dimensional pan-tilt head so that the visual measurement range of the visual module covers the reference point, and the visual measurement range can also cover at least one observation point, and one of the observation points is used as the working base point, that is, determining the first field of view;

[0069] Step 200, an alignment step: controlling the rotation of the two-dimensional pan-tilt platform to align the laser rangefinder with an observation point, and recording the horizontal angle and the pitch angle of the two-dimensional pan-tilt platform;

[0070] Step 300, three-dimensional measurement step: obtaining the distance of the observation point by a laser rangefinder, and calculating the three-dimensional coordinates of the observation point by using a trigonometric function relationship according to the distance from the observation point to the laser rangefinder and the horizontal angle and pitch angle of the two-dimensional pan-tilt platform;

[0071] Step 400, deformation calculation step: repeating steps 200 to 300 to obtain the three-dimensional coordinates of the observation point after the change, and using the three-dimensional coordinates of the observation point before and after the change to obtain the three-dimensional deformation value of the observation point;

[0072] Step 500, repeating steps 200 to 400 to complete the three-dimensional measurement of all observation points in the field of view;

[0073] Step 600, field of view switching step: according to the field of view switching mode, control the two-dimensional pan-tilt head to rotate, so that the visual module enters the next field of view, and repeat steps 200-500 to complete the three-dimensional measurement of all observation points in the next field of view. The field of view switching mode is: the working base point of the previous field of view is within the coverage range of the next field of view, the working base point of the previous field of view is used as the reference point of the next field of view, and the next field of view also includes at least one observation point, one of which is used as the working base point of the field of view, such as Figure 3 As shown in the figure, the monitoring range can be divided into three fields of view (coverage range of the visual module window), and the PTZ operation is controlled according to the time interval to switch the fields of view (windows), wherein the first field of view (i.e., the first window area) is the initial field of view, including a reference point and several observation points, one of the several observation points is the working base point of the first field of view, i.e., working base point 1, which can be covered by the first field of view and the second field of view (i.e., located in the cross-coverage area of ​​the first field of view and the second field of view), and working base point 1 is also the reference point of the second field of view (i.e., the second window area), and the second field of view includes working base point 1 and several observation points. Point, one of the observation points is the working base point of the second field of view, namely working base point 2, which can be covered by the second field of view and the third field of view (that is, located in the cross-coverage area of ​​the second field of view and the third field of view), and working base point 2 is also the reference point of the third field of view. The third field of view includes working base point 2 and several observation points. One of the observation points is used as the working base point of the third field of view, namely working base point 3, and so on. In other words, except for the initial field of view, during the switching process of other fields of view, it should be satisfied that the working base point of the previous field of view can be covered by the next field of view at the same time and serve as the reference point of the next field of view. It should be noted that, Figure 3 This is only a principle description of the field of view switching method and does not limit the field of view switching results.

[0074] Step 700, repeating step 600 until the three-dimensional deformation measurement of all observation points within the monitoring range is completed.

[0075] In one implementation mode, the alignment method in step 200 may adopt an alignment method based on a reference point, which is specifically as follows: the offset of each observation point relative to the reference point in the left-right direction (X-axis direction) and the up-down direction (Z-axis direction) is obtained through a visual module in combination with the pan-tilt rotation angle, and the distance of each observation point from the laser rangefinder is added. The angle change value of each observation point offset from the initial position is calculated through trigonometric functions, so that the laser emitted by the laser rangefinder can be re-aimed at the target. The so-called initial position refers to the original (i.e., before the change, initial) position where the laser line emitted by the laser rangefinder is aligned with the center of the target.

[0076] In another embodiment, the alignment method in step 200 may adopt an alignment method based on the central axis of the window, which is specifically as follows: the offset distance of each observation point relative to the central axis of the window (including the offset in the X-axis direction and the offset in the Z-axis direction) is obtained through a visual module, and the distance of each observation point from the laser rangefinder is added, and the horizontal angle and pitch angle of each observation point deviating from the central axis of the window are calculated through trigonometric functions, so that the laser emitted by the laser rangefinder can be re-aimed at the target, that is, the gimbal is controlled to rotate to the horizontal angle and pitch angle of each observation point deviating from the central axis of the window.

[0077] It should be noted that the X-axis, Y-axis and Z-axis defined in this embodiment are measurement coordinate systems, wherein the laser emission point of the laser rangefinder is taken as the origin O, the laser transmission direction emitted by the laser rangefinder is taken as the Y-axis, the direction perpendicular to the Y-axis and forming a horizontal plane XOY with the Y-axis is the X-axis, and the Z-axis is the direction perpendicular to the XOY plane.

[0078] This embodiment uses an alignment control method to ensure that the laser rangefinder can align with the observation point every time it is measured at each observation point (whether before or after the change), thereby improving the accuracy and reliability of the measurement.

[0079] Furthermore, the three-dimensional coordinates are calculated as follows:

[0080] After alignment, record the horizontal and pitch angles of the 2D gimbal, and measure the distance of the observation point (target) using a laser rangefinder;

[0081] According to the horizontal and elevation angles, as well as the distance of the observation point, the three-dimensional coordinates of the observation point in the measurement coordinate system can be calculated using the trigonometric function relationship. By transforming the coordinate system, the three-dimensional coordinates of the observation point in the geodetic coordinate system can be obtained. The specific trigonometric function relationship is as follows: Figure 4 As shown, the distance of the observation point P is XJ. If the horizontal angle of the gimbal is α and the pitch angle is β, the X, Y, and Z coordinates P (x, y, z) of the observation point P can be calculated by the following formulas (1) to (3):

[0082] x=cos(β)*XJ*cos(90-a) / / Slant distance is projected onto XOY, then onto the X axis

[0083] y=cos(a)*XJ*cos(β) / / Slant distance is projected onto XOY, then onto the Y axis

[0084] z=cos(a)*XJ*sin(β) / / Slant distance is projected on YOZ and then projected onto the Z axis

[0085] Furthermore, the above three-dimensional deformation measurement method also includes:

[0086] In step 200, it also includes checking whether the alignment is achieved. If not, the next alignment is performed according to the alignment method. The verification method adopted may be: using a visual module to determine whether the target center coincides with the center line of the window. If they coincide, the alignment is achieved. Otherwise, the alignment is not achieved.

[0087] Those skilled in the art will appreciate that the embodiments of the present application may be provided as methods, systems, or computer program products. Therefore, the present application may adopt the form of a complete hardware embodiment, a complete software embodiment, or an embodiment in combination with software and hardware. Moreover, the present application may adopt the form of a computer program product implemented in one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) that include computer-usable program code.

[0088] The present application is described with reference to the flowcharts and / or block diagrams of the methods, devices (systems), and computer program products according to the embodiments of the present application. It should be understood that each process and / or box in the flowchart and / or block diagram, as well as the combination of the processes and / or boxes in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to generate a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.

[0089] These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing device to operate in a specific manner, so that the instructions stored in the computer-readable memory produce an article of manufacture comprising an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.

[0090] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operating steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing instructions for implementing the process. Figure 1 A process or multiple processes and / or boxes Figure 1 A step that specifies a function in one or more boxes.

[0091] The specific implementation methods described above further illustrate the purpose, technical solutions and beneficial effects of the present application in detail. It should be understood that the above description is only the specific implementation method of the present application and is not intended to limit the scope of protection of the present application. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of the present application should be included in the scope of protection of the present application.

Claims

1. A three-dimensional deformation automatic monitoring device, characterized in that: The three-dimensional deformation automatic monitoring device comprises: A visual module, wherein the visual module is used to realize visual measurement of all observation points within the monitoring range, wherein the observation points are deformation measurement points, and targets are set at all observation points; A laser rangefinder, which is used to measure the distances of all observation points within the monitoring range; A two-dimensional pan-tilt platform, on which the visual module and the laser rangefinder are mounted; And, a main control module, the main control module is used to obtain the measurement data of the visual module and the laser rangefinder, as well as the horizontal angle and pitch angle of the two-dimensional pan-tilt rotation, calculate the three-dimensional coordinates of each observation point within the monitoring range according to a preset algorithm, and generate control instructions to control the horizontal movement and pitch movement of the two-dimensional platform.

2. The three-dimensional deformation automatic monitoring device according to claim 1, characterized in that: The main control module comprises: A central control unit, the central control unit is used to receive and calculate the three-dimensional coordinates of each observation point within the monitoring range according to the data collected by the visual module and the laser rangefinder, as well as the horizontal angle and the pitch angle of the two-dimensional pan-tilt platform, and output the horizontal offset angle and the pitch offset angle of the two-dimensional pan-tilt platform corresponding to each observation point; And, a gimbal control unit, which outputs a two-dimensional gimbal drive mechanism control instruction according to the two-dimensional gimbal horizontal offset angle and pitch offset angle corresponding to each observation point output by the central control unit, and drives the two-dimensional gimbal to move the corresponding horizontal offset angle and pitch offset angle.

3. The three-dimensional deformation automatic monitoring device according to claim 1, characterized in that: The main control module comprises: A central control unit, the central control unit is used to receive and calculate the three-dimensional coordinates of each observation point within the monitoring range according to the data collected by the visual module and the laser rangefinder, as well as the horizontal angle and pitch angle of the two-dimensional pan-tilt platform, and output the horizontal angle and pitch angle of the two-dimensional pan-tilt platform corresponding to each observation point; And, a gimbal control unit, which outputs a gimbal drive mechanism control instruction according to the two-dimensional gimbal horizontal angle and pitch angle corresponding to each observation point output by the central control unit, and drives the two-dimensional gimbal to move to the corresponding horizontal angle and pitch angle.

4. The three-dimensional deformation automatic monitoring device according to claim 2 or 3, characterized in that: The driving mechanism of the two-dimensional pan-tilt platform adopts a stepping motor.

5. The three-dimensional deformation automatic monitoring device according to claim 1, characterized in that: The visual module also includes: A fill light is used to supplement light during visual measurement.

6. A three-dimensional deformation automatic measurement method, characterized in that: The three-dimensional deformation automatic measurement method is implemented based on the three-dimensional deformation automatic monitoring device according to any one of claims 1 to 5, comprising: Initialization step: controlling the rotation of the two-dimensional pan-tilt platform so that the visual measurement range of the visual module covers the reference point, and the visual measurement range can also cover at least one observation point, and one of the at least one observation point is used as a working base point, so as to determine the first field of view; wherein the reference point is a stable point, and a target is set at the reference point; Alignment step: controlling the rotation of the two-dimensional pan-tilt platform to align the laser rangefinder with an observation point in the current field of view, and recording the horizontal angle and pitch angle of the two-dimensional pan-tilt platform; Three-dimensional measurement step: obtaining the distance of the observation point by the laser rangefinder, and calculating the three-dimensional coordinates of the observation point by using trigonometric function relationship according to the distance of the observation point and the horizontal angle and pitch angle of the two-dimensional pan-tilt platform; Deformation calculation step: repeating the alignment step and the three-dimensional measurement step to obtain the three-dimensional coordinates of the observation point after the change, and using the three-dimensional coordinates of the observation point before and after the change to obtain the three-dimensional deformation value of the observation point; Repeat the alignment step, the three-dimensional measurement step and the deformation calculation step to perform the three-dimensional deformation measurement of the next observation point in the current field of view until the three-dimensional deformation measurement of all observation points in the current field of view is completed; Field of view switching step: according to the field of view switching mode, controlling the rotation of the two-dimensional pan-tilt platform to make the visual module enter the next field of view, and returning to the alignment step to perform three-dimensional deformation measurement of all observation points in the next field of view until the three-dimensional deformation measurement of all observation points within the monitoring range is completed; Among them, the field of view switching method is: the working base point of the previous field of view is within the coverage range of the next field of view, and the working base point of the previous field of view is used as the reference point of the next field of view. The next field of view also includes at least one observation point, one of which is used as the working base point of the field of view.

7. The method for automatic three-dimensional deformation measurement according to claim 6, characterized in that: The alignment step specifically includes: The offset data measured by the visual module is combined with the horizontal angle and the pitch angle of the two-dimensional pan-tilt platform to calculate the offset of each observation point relative to the reference point; According to the offset of each observation point relative to the reference point, combined with the distance of each observation point measured by the laser rangefinder, the angle change value of each observation point relative to the initial position is calculated through the trigonometric function relationship, and the rotation of the two-dimensional pan-tilt platform is controlled according to the angle change value, so that the laser emitted by the laser rangefinder is realigned with the target; The initial position refers to the position where the laser line emitted by the original laser rangefinder is aimed at the center of the target.

8. The method for automatic three-dimensional deformation measurement according to claim 6, characterized in that: The alignment step specifically includes: The offset data of each observation point relative to the central axis of the window measured by the visual module is combined with the distance of each observation point, and the horizontal angle and pitch angle of each observation point deviating from the central axis of the window are calculated through trigonometric function relationship; According to the horizontal angle and the pitch angle of each observation point deviating from the central axis of the window, the two-dimensional gimbal is controlled to rotate so that the laser emitted by the laser rangefinder is realigned with the target; 9. The method for automatic three-dimensional deformation measurement according to claim 6, characterized in that: The three-dimensional coordinates are calculated as follows: After alignment, the horizontal angle and the pitch angle of the two-dimensional pan-tilt platform are recorded, and the distance of the observation point is measured by the laser rangefinder; According to the horizontal angle and pitch angle of the two-dimensional gimbal, and the distance of the observation point, the three-dimensional coordinates of the observation point in the measurement coordinate system are calculated using the trigonometric function relationship. By transforming the coordinate system, the three-dimensional coordinates of the observation point in the geodetic coordinate system can be obtained.

10. A three-dimensional deformation automatic measurement method according to claim 7 or 8, characterized in that: The alignment step further comprises: After alignment, check whether it is aligned. If it is not aligned, perform the next alignment according to the alignment method; The verification method adopted is: determining whether the target center coincides with the center line of the window through the visual module, if so, it is aligned, otherwise it is not aligned.

Citation Information

Cited By

  • Structural three-dimensional deformation monitoring method based on machine vision and laser ranging

    CN121655413A

  • A method for monitoring three-dimensional structural deformation based on machine vision and laser ranging

    CN121655413B