Deformation monitoring method based on phase correlation algorithm

Abstract

The embodiment of the invention discloses a GNSS auxiliary deformation monitoring method based on a phase correlation algorithm, and relates to the technical field of deformation monitoring, and the method comprises the steps: obtaining a monitoring image of a target or a target end collected by each sensor unit at a preset time interval; comparing the monitoring images collected at a plurality of moments to calculate sub-displacement amounts of the corresponding sensor units; calculating a rotation angle of the sensor unit relative to the axis based on the sub-displacement amount; and accumulating the sub-displacement and the rotation angle of each sensor unit to obtain the rolling displacement and the vertical displacement of the to-be-measured structural body. By adopting the method provided by the invention, the displacement between the images in different periods is determined by using the phase correlation algorithm, and an accurate deformation calculation result can be efficiently provided; the GNSS is used as a coordinate reference, so that the accuracy of coordinates is further ensured.

Description

Technical Field

[0001] The present application relates to the technical field of deformation monitoring, and in particular to a deformation monitoring method based on a phase correlation algorithm. Background Art

[0002] With the development of global satellite navigation technology (GNSS, Global Navigation Satellite System), positioning data is becoming more and more accurate and is being fully applied to building monitoring systems. GNSS monitoring stations can be installed on structures such as buildings and mountains, and GNSS data can be used to monitor the total displacement of the corresponding structure, and then analyze whether the structure has deformed, thereby realizing the monitoring of structural deformation.

[0003] However, this method can only monitor the overall deformation of the structure and can only provide a hint of macroscopic structural deformation. That is, GNSS data only shows the total displacement of the structure and can only be used to describe the top displacement of the structure, but cannot be used to analyze the deformation inside or at the bottom of the structure, nor can it analyze the causes of structural deformation.

[0004] Therefore, GNSS observations alone cannot accurately analyze the deformation of the structure and the cause of the deformation, nor can they analyze the details of the internal deformation of the structure, making it difficult to accurately and efficiently monitor the deformation of the structure. Summary of the invention

[0005] The embodiments of the present application provide a deformation monitoring method, system, device and storage medium based on a phase correlation algorithm to solve the defects of the above-mentioned related technologies. The technical solution is as follows:

[0006] In a first aspect, an embodiment of the present application provides a deformation monitoring method based on a phase correlation algorithm, comprising a plurality of sensor units arranged along an axis perpendicular to a ground plane and a plurality of sensor units arranged along an axis parallel to the ground plane in a structure to be measured, wherein an image acquisition end of each sensor unit is aligned with a target or a target end of another sensor unit along a corresponding axis;

[0007] The deformation monitoring method comprises:

[0008] Acquire the monitoring image of the target or the target end collected by each sensor unit at each preset time interval;

[0009] Compare the monitoring images collected at multiple times to calculate the sub-displacement of the corresponding sensor unit;

[0010] Calculating a rotation angle of the sensor unit relative to the axis based on the sub-displacement;

[0011] The sub-displacement and the rotation angle of each sensor unit located on the axis perpendicular to the ground plane are accumulated to obtain the roll displacement of the structure to be measured; the sub-displacement and the rotation angle of each sensor unit located on the axis parallel to the ground plane are accumulated to obtain the vertical displacement of the structure to be measured.

[0012] In an optional solution of the first aspect, before acquiring the monitoring image of the target or the target end collected by each sensor unit at each preset time interval, the method further includes:

[0013] Determining an initial position of each of the sensor units, and determining an initial pixel position of each target in a corresponding monitoring image;

[0014] The arrangement position of each sensor unit is adjusted based on the initial position and the initial pixel position until the difference between the initial position and the preset position is less than a preset position difference threshold and the difference between the initial pixel position and the preset pixel position is less than a preset pixel position difference threshold.

[0015] In an optional solution of the first aspect, the step of comparing monitoring images collected at multiple moments to calculate the sub-displacement of the corresponding sensor unit includes:

[0016] Based on the monitoring images collected by each sensor unit at multiple times, determine the image center point of the monitoring image collected at each time and the coordinates of the image center point in the image, and calculate the first displacement of the corresponding sensor unit based on the coordinate change of the image center point in the monitoring image collected at each time;

[0017] Determine the target center point in the monitoring image collected at each moment, determine the target center point of each monitoring image and the coordinates of the target center point in the monitoring image, and calculate the second displacement of the corresponding sensor unit based on the coordinate change of the target center point in the monitoring image collected at each moment;

[0018] The sub-displacement of each sensor unit is calculated based on the first displacement and the second displacement.

[0019] In an optional solution of the first aspect, the calculating based on the first displacement and the second displacement to obtain the sub-displacement of each sensor unit includes:

[0020] Performing displacement conversion on the image center point of the monitoring image based on the first displacement amount;

[0021] The resolution of the image is acquired, and based on the resolution, the second displacement is converted from a pixel displacement to a displacement of a preset unit, and output to obtain the sub-displacement.

[0022] In an optional solution of the first aspect, the step of comparing monitoring images collected at multiple moments to calculate the sub-displacement of the corresponding sensor unit includes:

[0023] Based on the monitoring images collected by each of the sensor units at multiple times, the formula is applied:

[0024] f A (x,y)=f B (xx 0 ,yy 0 );

[0025]

[0026] Among them, f A (x, y) is one of the monitoring images, f B (x, y) is another monitoring image, (x 0 ,y 0 ) represents the relative displacement between the two images, f AA (u, v) is f A The Fourier transform of (x,y), f B (u, v) is f B The Fourier transform of (x, y), R is the cross spectrum, is the complex conjugate of F;

[0027] The pulse function is obtained by performing inverse Fourier transform on the cross spectrum:

[0028] F -1 (R) = δ(xx 0 ,yy 0 );

[0029] When the impulse function takes a maximum value, determining a relative displacement between the two images;

[0030] The sub-displacement of the sensor unit is obtained based on the relative displacement between the monitoring images collected at multiple moments.

[0031] In an optional solution of the first aspect, calculating the rotation angle of the sensor unit relative to the axis based on the horizontal displacement includes:

[0032] Calculate the rotation angle corresponding to the horizontal displacement based on polar coordinates, and apply the formula:

[0033] f A (x,y)=f B (xcosθ 0 -y sinθ 0 -x 0 ,x sin θ0 +y cosθ 0 -y 0 );

[0034]

[0035] |F A (ρ,θ)|=|F B (ρ,θ-θ 0 )|;

[0036] Among them, ρ represents the polar diameter, θ 0 represents the rotation angle.

[0037] In an optional solution of the first aspect, the direction of the image acquisition end of the bottommost sensor unit located on the axis perpendicular to the ground plane is perpendicular to the axis, the image acquisition end of the bottommost sensor unit is aligned with the external target along the axis parallel to the ground plane, and the image acquisition ends of other sensor units are aligned with the target ends of adjacent sensor units;

[0038] Acquire GNSS data through a sensor unit arranged on the axis perpendicular to the ground plane and located on the top of the structure to be measured; determine a reference coordinate system based on the external target material and the GNSS data;

[0039] After obtaining the roll displacement of the structure to be measured and after obtaining the vertical displacement of the structure to be measured, the method further includes:

[0040] The roll displacement and the vertical displacement are projected to the reference coordinate system.

[0041] In a second aspect, the embodiment of the present application further provides a GNSS-assisted deformation monitoring system based on a phase correlation algorithm, comprising:

[0042] Sensor units, each of which has an image acquisition end aligned with a target or a target end of another sensor unit along a corresponding axis; the structure to be measured includes a plurality of sensor units arranged along an axis perpendicular to the ground plane and a plurality of sensor units arranged along an axis parallel to the ground plane;

[0043] An image acquisition unit, used to acquire a monitoring image of the target or the target end acquired by each sensor unit at each preset time interval;

[0044] A calculation unit is used to compare the monitoring images collected at multiple moments to calculate the sub-displacement of the corresponding sensor unit; and is also used to calculate the rotation angle of the sensor unit relative to the axis on which it is located based on the sub-displacement; and to accumulate the sub-displacement and rotation angle of each sensor unit located on the axis perpendicular to the ground plane to obtain the roll displacement of the structure to be measured; and to accumulate the sub-displacement and rotation angle of each sensor unit located on the axis parallel to the ground plane to obtain the vertical displacement of the structure to be measured.

[0045] In a third aspect, an embodiment of the present application further provides an electronic device, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein when the processor executes the program, the method provided in the first aspect of the embodiment of the present application or any one of the implementation methods of the first aspect is implemented.

[0046] In a fourth aspect, the present application also provides a non-transitory computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements the method provided by the first aspect of the embodiment of the present application or any one of the implementations of the first aspect.

[0047] The beneficial effects brought about by the technical solutions provided by some embodiments of the present application include at least:

[0048] A deformation monitoring method based on a phase correlation algorithm is provided in an embodiment of the present application. By arranging sensor units in a structure, an interconnected chain system can be constructed through multiple sensor units to achieve relative measurement. By acquiring the monitoring image of the target or the target end collected by each sensor unit at each preset time interval, the displacement inside the structure in the lateral and horizontal directions can be obtained, so that the change of the structural geometric parameters under the influence of external factors or loads can be determined, thereby predicting the displacement in a given observation period, reflecting the internal structural changes, and reducing the influence of error accumulation and external errors; using the phase correlation algorithm to determine the relative displacement between images in different periods can efficiently provide accurate deformation calculation results; by using GNSS as the coordinate reference, the accuracy of the coordinates is further ensured.

[0049] Furthermore, the related technology only considers the absolute displacement of structures such as buildings, that is, the total displacement of the outside of the structure, and can only determine whether the structure is deformed from a macro perspective, but cannot provide deformation information inside the structure. The present application determines the displacement of the structure in each internal sub-interval through sensor units arranged inside the building, so that the deformation of the internal structure can be calculated through the displacement of multiple sub-intervals, thereby providing accurate and reliable data for deformation monitoring. BRIEF DESCRIPTION OF THE DRAWINGS

[0050] In order to more clearly illustrate the technical solutions in the present application or related technologies, the drawings required for use in the embodiments or related technical descriptions are briefly introduced below. Obviously, the drawings described below are some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0051] Figure 1 is a schematic diagram of an application scenario of a GNSS-assisted deformation monitoring method based on a phase correlation algorithm provided in an embodiment of the present application;

[0052] Figure 2 is a structural schematic diagram of a sensor unit provided in an embodiment of the present application;

[0053] Figure 3 It is a flow chart of a GNSS-assisted deformation monitoring method based on a phase correlation algorithm provided in an embodiment of the present application;

[0054] Figure 4 It is a structural schematic diagram of a GNSS-assisted deformation monitoring system based on a phase correlation algorithm provided in an embodiment of the present application;

[0055] Figure 5 It is a schematic diagram of the structure of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0056] In order to make the purpose, technical solutions and advantages of this application clearer, the technical solutions in this application will be clearly and completely described below in conjunction with the drawings in this application. Obviously, the described embodiments are part of the embodiments of this application, not all of them. Based on the embodiments in this application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0057] The terms "including" and "having" and any variations thereof in the specification and claims of the present application and the above drawings are intended to cover non-exclusive inclusions. For example, a process, method, system, product or device including a series of steps or modules is not limited to the listed steps or modules, but may optionally include steps or modules that are not listed, or may optionally include other steps or modules that are inherent to these processes, methods, products or devices.

[0058] It should be noted that the terms "first\second" involved in the present application are only used to distinguish similar objects, and do not represent a specific order for the objects. It is understandable that "first\second" can be interchanged with a specific order or sequence where permitted. It should be understood that the objects distinguished by "first\second" can be interchanged where appropriate, so that the embodiments of the present application described herein can be implemented in an order other than those described or illustrated herein.

[0059] like Figure 1 As shown, it is a schematic diagram of the application scenario of the GNSS-assisted deformation monitoring method based on the phase correlation algorithm provided in the embodiment of the present application. In the embodiment of the present application, the structure to be measured is a building, and multiple sensor units can be installed in the structure to be measured, for example, installed on a vertical column or wall. The multiple sensor units are arranged in the structure to be measured along an axis perpendicular to the ground plane, and a monitoring chain of multiple sensor units can be formed along different axes. The image acquisition end of each sensor unit is aligned with the target end of the sensor unit adjacent to the sensor unit on the same monitoring chain, that is, from high to low in the same monitoring chain, the image acquisition end of the sensor unit at a high position is aligned with the target end of the sensor unit located below the sensor unit.

[0060] Specifically, multiple sensor units can also be arranged along an axis parallel to the ground plane, for example, installed on a wall, and the image acquisition end of the sensor unit is aligned with the target or the target end of another sensor unit along the axis parallel to the ground plane, forming a monitoring chain parallel to the ground plane.

[0061] In some embodiments, the monitoring chain can be an "L"-shaped monitoring chain composed of a monitoring chain parallel to the ground plane and a monitoring chain perpendicular to the ground plane. For example, sensor units are arranged in sequence from the top of the structure to be measured downward along the direction perpendicular to the ground plane, and the acquisition direction of the image acquisition end of the sensor unit at the bottom is parallel to the ground plane and aimed at another target. The target can be any external target or the target end of another sensor unit.

[0062] It can be understood that the image acquisition end of the sensor unit is aligned with a target or the target end of another sensor unit, which can be understood as the optical axis of the image acquisition end being perpendicular to the plane where the target or the target end is located. It can be understood that the spacing between each sensor unit and the adjacent sensor unit can be adjusted according to actual needs and / or the internal structure of the structure to be measured, and the spacing between every two adjacent sensor units can be the same or different. The resolution and other camera parameters of the image acquisition end of the sensor unit can be adjusted according to the spacing between every two adjacent sensor units, and the embodiments of the present application are not limited to this.

[0063] Specifically, the sensor unit located at the top of the structure to be measured is also used to obtain GNSS data. The acquisition direction of the image acquisition end of the sensor unit located at the bottom of the structure to be measured is perpendicular to the axis of the monitoring chain and is directed toward an external target material arranged outside the structure to be measured. Therefore, the reference coordinate system can be determined based on the external target material and GNSS data, thereby improving the accuracy and sensitivity of deformation monitoring.

[0064] Specifically, see Figure 2 , Figure 2 A sensor unit provided in an embodiment of the present application is shown, which may include a camera module 240 (image acquisition end), a target material 210, a data storage unit 220, an image processing unit 230 and a data transmission unit 250, wherein the camera module 240 may use a long focal length lens.

[0065] It should be noted that the sensor unit may be in the shape of a cuboid, the target material may be arranged on any surface except the surface where the image acquisition end is located, and at least one target material may be arranged on the sensor unit.

[0066] It can be understood that the target material can be a QR code, an identification graphic, etc., and specifically can be a QR code with embedded LED lamp beads, which is not limited in the embodiments of the present application.

[0067] The present application is described in detail below with reference to specific embodiments.

[0068] Next, combine Figure 1 and Figure 2 , introduces the GNSS-assisted deformation monitoring method based on phase correlation algorithm provided by the embodiment of the present application. For details, please refer to Figure 3 , Figure 3 A flow chart of a GNSS-assisted deformation monitoring method based on a phase correlation algorithm provided in an embodiment of the present application is shown, and the method comprises the following steps:

[0069] S301, acquiring a monitoring image of a target or a target end collected by each sensor unit at every preset time interval.

[0070] S302, comparing monitoring images collected at multiple moments to calculate the sub-displacement of the corresponding sensor unit.

[0071] S303: Calculate a rotation angle of the sensor unit relative to its axis based on the sub-displacement.

[0072] S304, accumulating the sub-displacement and rotation angle of each sensor unit located on the axis perpendicular to the ground plane to obtain the roll displacement of the structure to be measured; accumulating the sub-displacement and rotation angle of each sensor unit located on the axis parallel to the ground plane to obtain the vertical displacement of the structure to be measured.

[0073] It can be understood that in the above steps, the sensor units are arranged in the structure to be measured according to a given axis parallel to or perpendicular to the ground plane, and the monitoring image of the aligned target is captured by the image acquisition end on the sensor unit, and then the position change of the sensor unit that captures the monitoring image can be calculated according to the position change of the target in the monitoring image; the sub-displacement at the sensor installation position can be reflected by a unit corresponding to each sensor unit-target, and then the internal deformation of the structure to be measured at this position can be reflected, which is conducive to analyzing the specific position and cause of the deformation of the structure.

[0074] Furthermore, by accumulating the sub-displacements of multiple sensor units, the roll displacement and vertical displacement can be obtained, that is, the relative displacement relative to the coordinate system of the structure to be measured, which can more accurately reflect the total deformation of the structure to be measured and avoid the defect that GNSS data can only reflect the top displacement but not the internal displacement.

[0075] It should be noted that the relevant technology does not deploy sensors inside the building. It only determines the absolute displacement of the entire building through the GNSS signal based on the GNSS receiving device installed on the top of the building. The absolute displacement cannot reflect the deformation inside the building and cannot be used to analyze the cause of the deformation. It can only provide an overall deformation value, that is, the relevant technology can only provide macro information.

[0076] The embodiment of the present application arranges vertical and horizontal sensors inside the building, and each sensor captures a target adjacent to it. The displacement of the sensor relative to the target can be sensitively calculated through the position change of the target in the sensor image, so that the displacement of the building in the sub-interval between the sensor and the target can be quickly determined. In this way, the displacement of multiple sub-intervals inside the building can be ensured, thereby outputting the deformation amount inside the building, which is conducive to analyzing the area where the building is deformed and the cause of the deformation, and overcomes the defect that the related technology only measures the absolute displacement and cannot analyze the deformation amount inside the building.

[0077] In some embodiments, before acquiring the monitoring image of the target or the target end collected by each sensor unit at each preset time interval in S301, the method further includes:

[0078] The initial position of each of the sensor units is determined, and the initial pixel position of each target in the corresponding monitoring image is determined.

[0079] The arrangement position of each sensor unit is adjusted based on the initial position and the initial pixel position until the difference between the initial position and the preset position is less than a preset position difference threshold and the difference between the initial pixel position and the preset pixel position is less than a preset pixel position difference threshold.

[0080] Through such a setting, in the first observation cycle, it can be ensured that each sensor unit and the relative observation target (target or target end of the sensor unit) are aligned in the horizontal and vertical directions. This can be specifically judged by the image and the position of the target center in the image, thereby establishing a benchmark for subsequent deformation monitoring.

[0081] In some embodiments, in step S302, calculating the sub-displacement of the corresponding sensor unit based on comparing monitoring images collected at multiple moments includes:

[0082] Based on the monitoring images collected by each sensor unit at multiple times, the image center point of each monitoring image and the coordinates of the image center point in the image are determined, and based on the coordinate change of the image center point in the multiple images, the first displacement of the corresponding sensor unit is calculated.

[0083] Determine the target center point in each of the monitoring images, determine the target center point of each of the monitoring images and the coordinates of the target center point in the monitoring image, and calculate the second displacement of the corresponding sensor unit based on the coordinate change of the target center point in the monitoring image collected at each moment.

[0084] The horizontal displacement of each sensor unit is calculated based on the first displacement and the second displacement.

[0085] Exemplarily, for a sensor unit S1, images of the target material of the adjacent sensor unit S2 are taken within a period of time. Each new image can be used as a reference image and the old image as a comparison image. The center point of each image is then searched and the change of the center point of the comparison image relative to the center point of the reference image is calculated. The displacement of the sensor unit S1 in the corresponding time is calculated, that is, the first displacement mentioned above.

[0086] Exemplarily, for a sensor unit S1, images of the target material of the adjacent sensor unit S2 are taken within a period of time. Each new image can be used as a reference image and the old image as a comparison image. The target material in each image is then searched to determine the center point of the target material. The change in the center point of the comparison target material relative to the center point of the target material in the reference image is calculated, and the pixel displacement of the sensor unit S2 in the corresponding time is calculated, that is, the second displacement mentioned above.

[0087] Furthermore, based on unit conversion, it is easy to convert the second displacement amount from displacement / pixel to displacement / millimeter according to the first displacement amount, which will not be described in detail in the embodiments of the present application.

[0088] Preferably, a monitoring image collected at a certain moment can be selected as a reference image, and other monitoring images collected at subsequent preset intervals can be used as input to search for the displacement of the image center point and the target center point of each other monitoring image relative to the reference image, thereby calculating the above-mentioned first displacement and second displacement, and then calculating the sub-displacement of the sensor unit.

[0089] In some embodiments, in S302, calculating the sub-displacement of each sensor unit based on the first displacement and the second displacement includes:

[0090] Based on the monitoring images collected by each of the sensor units at multiple times, the formula is applied:

[0091] f A (x,y)=f B (xx 0 ,yy 0 );

[0092]

[0093] Among them, f A (x, y) is one of the monitoring images, f B (x, y) is another monitoring image, (x 0 ,y 0 ) represents the relative displacement between the two images, f A (u, v) is f A The Fourier transform of (x,y), f B (u, v) is f B The Fourier transform of (x, y), R is the cross spectrum, is the complex conjugate of F;

[0094] The pulse function is obtained by performing inverse Fourier transform on the cross spectrum:

[0095] F -1 (R) = δ(xx 0 ,yy 0 );

[0096] When the impulse function takes a maximum value, determining a relative displacement between the two images;

[0097] The sub-displacement of the sensor unit is based on the relative displacement between monitoring images collected at multiple moments.

[0098] In some embodiments, in S303, calculating the rotation angle of the sensor unit relative to the sensor-target axis based on the sub-displacement includes:

[0099] Calculate the rotation angle corresponding to the horizontal displacement based on polar coordinates, and apply the formula:

[0100] f A (x,y)=f B (xconθ 0 -ysinθ 0 -x 0 ,xsinθ 0 +ycosθ 0 -y 0 );

[0101]

[0102] |F A (ρ,θ)|=|F B (ρ,θ-θ 0 )|;

[0103] Among them, ρ represents the polar diameter, θ 0 Indicates the corresponding rotation angle.

[0104] In some embodiments, in the GNSS-assisted deformation monitoring method based on the phase correlation algorithm provided in the present application, the measured displacement can be converted into a standard coordinate system corresponding to the GNSS based on the GNSS data, including:

[0105] The direction of the image acquisition end of the bottommost sensor unit located on an axis perpendicular to the ground plane is perpendicular to the axis, and the image acquisition end of the bottommost sensor unit is aligned with the external target along the axis parallel to the ground plane, and the image acquisition ends of other sensor units are aligned with the target ends of the adjacent sensor units. GNSS data can be obtained by the sensor unit arranged on the axis perpendicular to the ground plane and located at the top of the structure to be measured.

[0106] With such an arrangement, the top coordinates can be determined by the sensor unit on the top, and the lateral coordinates can be determined by the external target set on the external structure, and then the reference coordinate system can be determined based on the external target material and GNSS data.

[0107] After the roll displacement of the structure to be measured is calculated and obtained in S104, and after the vertical displacement of the structure to be measured is obtained, the roll displacement and the vertical displacement can be projected into a reference coordinate system.

[0108] In some embodiments, deformation monitoring can be performed based on the sub-displacement between each sensor unit-target, and whether the deformation change of the internal structure exceeds the deformation threshold is determined according to the sub-displacement. If the threshold is reached, a warning message is issued to indicate that deformation has occurred at the location of the corresponding sensor unit-target. For example, the sensor unit can be arranged on a column along an axis perpendicular to the ground plane.

[0109] If the sub-deformation variable measured by the sensor unit is greater than the corresponding threshold, it means that the deformation variable of the column is large and the structural deformation needs to be checked so that the deformation can be monitored and timely warning can be given according to the value of the deformation variable.

[0110] It can be understood that the corresponding deformation threshold can be set according to each sensor unit-target interval, and the size of the deformation threshold depends on the parameters of the structure corresponding to the interval, which is not limited in the embodiment of the present application.

[0111] The following are system embodiments of the present application, which can be used to execute the method embodiments of the present application. For details not disclosed in the system embodiments of the present application, please refer to the method embodiments of the present application.

[0112] See next Figure 4 , is a schematic diagram of the structure of a GNSS-assisted deformation monitoring system based on a phase correlation algorithm provided by an exemplary embodiment of the present application. The system can be implemented as all or part of a terminal through software, hardware, or a combination of both, and can also be integrated on a server as an independent module. The GNSS-assisted deformation monitoring system based on a phase correlation algorithm in the embodiment of the present application can be applied to a terminal or a cloud. The system 40 includes a sensor unit 410, an image acquisition unit 420, and a computing unit 430, wherein:

[0113] The sensor unit 410, each of which has an image acquisition end aligned with a target or a target end of another sensor unit along a corresponding axis; the structure to be measured includes a plurality of sensor units arranged along an axis perpendicular to the ground plane and a plurality of sensor units arranged along an axis parallel to the ground plane;

[0114] An image acquisition unit 420 is used to acquire a monitoring image of the target or the target end acquired by each sensor unit at each preset time interval;

[0115] The calculation unit 430 is used to compare the monitoring images collected at multiple moments to calculate the sub-displacement of the corresponding sensor unit; and is also used to calculate the rotation angle of the sensor unit relative to the axis on which it is located based on the sub-displacement; and to accumulate the sub-displacement and rotation angle of each sensor unit located on the axis perpendicular to the ground plane to obtain the roll displacement of the structure to be measured; and to accumulate the sub-displacement and rotation angle of each sensor unit located on the axis parallel to the ground plane to obtain the vertical displacement of the structure to be measured.

[0116] It should be noted that the system 40 provided in the above embodiment only uses the division of the above functional modules as an example when executing the GNSS-assisted deformation monitoring method based on the phase correlation algorithm. In actual applications, the above functions can be assigned to different functional modules as needed, that is, the internal structure of the device is divided into different functional modules to complete all or part of the functions described above. In addition, the system provided in the above embodiment and the embodiment of the GNSS-assisted deformation monitoring method based on the phase correlation algorithm belong to the same concept, and its implementation process is detailed in the method embodiment, which will not be repeated here.

[0117] An embodiment of the present application also provides an electronic device, including a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements the steps of any of the above-mentioned method embodiments when executing the program.

[0118] See also Figure 5 , which is a structural block diagram of an electronic device provided in an embodiment of the present application.

[0119] like Figure 5 As shown, the electronic device 500 includes: a processor 501 and a memory 502 .

[0120] In the embodiment of the present application, the processor 501 is the control center of the computer system, which can be a processor of a physical machine or a processor of a virtual machine. The processor 501 may include one or more processing cores, such as a 4-core processor, an 8-core processor, etc. The processor 501 may be implemented in at least one hardware form of DSP (Digital Signal Processing), FPGA (Field-Programmable Gate Array), and PLA (Programmable Logic Array).

[0121] The processor 501 may also include a main processor and a coprocessor. The main processor is a processor for processing data in the awake state, also called a CPU (Central Processing Unit); the coprocessor is a low-power processor for processing data in the standby state.

[0122] The memory 502 may include one or more computer-readable storage media, which may be non-transitory. The memory 502 may also include a high-speed random access memory, and a non-volatile memory, such as one or more disk storage devices, flash memory storage devices. In some embodiments of the present application, the non-transitory computer-readable storage medium in the memory 502 is used to store at least one instruction, which is used to be executed by the processor 501 to implement the method in the embodiment of the present application.

[0123] In some embodiments, the electronic device 500 further includes: a peripheral device interface 503 and at least one peripheral device 504. The processor 501, the memory 502 and the peripheral device interface 503 can be connected via a bus or a signal line. Each peripheral device 504 can be connected to the peripheral device interface 503 via a bus, a signal line or a circuit board. Specifically, the peripheral device 504 includes: a display screen, a camera and an audio circuit. The peripheral device interface 503 can be used to connect at least one peripheral device related to I / O (Input / Output) to the processor 501 and the memory 502.

[0124] In some embodiments of the present application, the processor 501, the memory 502, and the peripheral device interface 503 are integrated on the same chip or circuit board; in some other embodiments of the present application, any one or two of the processor 501, the memory 502, and the peripheral device interface 503 can be implemented on a separate chip or circuit board. This embodiment of the present application does not specifically limit this.

[0125] The electronic device structure block diagram shown in the embodiment of the present application does not constitute a limitation on the electronic device 500. The electronic device 500 may include more or fewer components than shown in the figure, or combine certain components, or adopt a different component arrangement.

[0126] The embodiment of the present application also provides a computer-readable storage medium, on which a computer program is stored, and when the program is executed by a processor, the steps of the method of any of the above embodiments are implemented. The computer-readable storage medium may include, but is not limited to, any type of disk, including a floppy disk, an optical disk, a DVD, a CD-ROM, a micro drive, and a magneto-optical disk, a ROM, a RAM, an EPROM, an EEPROM, a DRAM, a VRAM, a flash memory device, a magnetic card or an optical card, a nanosystem (including a molecular memory IC), or any type of medium or device suitable for storing instructions and / or data.

[0127] Through the description of the above implementation methods, those skilled in the art can clearly understand that each implementation method can be implemented by means of software plus a necessary general hardware platform, and of course, by hardware. Based on this understanding, the above technical solution can be essentially or in other words, the part that contributes to the relevant technology can be embodied in the form of a software product, which can be stored in a computer-readable storage medium, such as ROM / RAM, a disk, an optical disk, etc., including a number of instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) to execute the methods described in each embodiment or some parts of the embodiment.

[0128] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit it. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. However, these modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present application.

Claims

1. A deformation monitoring method based on phase correlation algorithm, characterized in that: A plurality of sensor units are arranged along an axis perpendicular to the ground plane and a plurality of sensor units are arranged along an axis parallel to the ground plane in the structure to be measured, and an image acquisition end of each sensor unit is aligned with a target or a target end of another sensor unit along the corresponding axis; The deformation monitoring method comprises: Acquire a monitoring image of the target or the target end collected by each sensor unit at each preset time interval; Compare the monitoring images collected at multiple times to calculate the sub-displacement of the corresponding sensor unit; Calculating a rotation angle of the sensor unit relative to the axis based on the sub-displacement; The sub-displacement and the rotation angle of each sensor unit located on the axis perpendicular to the ground plane are accumulated to obtain the roll displacement of the structure to be measured; the sub-displacement and the rotation angle of each sensor unit located on the axis parallel to the ground plane are accumulated to obtain the vertical displacement of the structure to be measured.

2. The deformation monitoring method based on phase correlation algorithm according to claim 1 is characterized in that: Before acquiring the monitoring image of the target or the target end collected by each sensor unit at each preset time interval, the method further includes: Determining an initial position of each of the sensor units, and determining an initial pixel position of each target in a corresponding monitoring image; The arrangement position of each sensor unit is adjusted based on the initial position and the initial pixel position until the difference between the initial position and the preset position is less than a preset position difference threshold and the difference between the initial pixel position and the preset pixel position is less than a preset pixel position difference threshold.

3. The deformation monitoring method based on phase correlation algorithm according to claim 1 is characterized in that: The step of comparing monitoring images collected at multiple moments to calculate the sub-displacement of the corresponding sensor unit includes: Based on the monitoring images collected by each sensor unit at multiple times, determine the image center point of the monitoring image collected at each time and the coordinates of the image center point in the image, and calculate the first displacement of the corresponding sensor unit based on the coordinate change of the image center point in the monitoring image collected at each time; Determine the target center point in the monitoring image collected at each moment, determine the target center point of each monitoring image and the coordinates of the target center point in the monitoring image, and calculate the second displacement of the corresponding sensor unit based on the coordinate change of the target center point in the monitoring image collected at each moment; The sub-displacement of each sensor unit is calculated based on the first displacement and the second displacement.

4. The deformation monitoring method based on phase correlation algorithm according to claim 3 is characterized in that: The calculating of the sub-displacement of each sensor unit based on the first displacement and the second displacement includes: Performing displacement conversion on the image center point of the monitoring image based on the first displacement amount; The resolution of the image is acquired, and based on the resolution, the second displacement is converted from a pixel displacement to a displacement of a preset unit, and output to obtain the sub-displacement.

5. The deformation monitoring method based on phase correlation algorithm according to claim 1 is characterized in that: The step of comparing monitoring images collected at multiple moments to calculate the sub-displacement of the corresponding sensor unit includes: Based on the monitoring images collected by each of the sensor units at multiple times, the formula is applied: f A (x,y)=f B (x-x0,y-y0); Among them, f A (x, y) is one of the monitoring images, f B (x, y) is another monitoring image, (x0, y0) represents the relative displacement between the two images, and f A (u, v) is f A The Fourier transform of (x, y), f B (u, v) is f B The Fourier transform of (x, y), R is the cross spectrum, is the complex conjugate of F; The pulse function is obtained by performing inverse Fourier transform on the cross spectrum: F- 1 (r)=δ(x-x0,y-y0); When the impulse function takes a maximum value, determining a relative displacement between the two images; The sub-displacement of the sensor unit is obtained based on the relative displacement between the monitoring images collected at multiple moments.

6. The deformation monitoring method based on phase correlation algorithm according to claim 5 is characterized in that: The step of calculating the rotation angle of the sensor unit relative to the axis where the sensor-target is located based on the sub-displacement comprises: Based on the polar coordinates, the rotation angle corresponding to the sub-displacement is calculated using the formula: f A (x,y)=f B (x cosθ0-y sinθ0-x0,x sinθ0+y cosθ0-y0); |F A (ρ,θ)|=|F B (ρ,θ-θ0)|; Wherein, ρ represents the polar diameter, and θ0 represents the rotation angle.

7. A deformation monitoring method based on phase correlation algorithm according to any one of claims 1 to 6, characterized in that: The method further comprises: The image acquisition end of the bottommost sensor unit located on the axis perpendicular to the ground plane is oriented perpendicular to the axis, the image acquisition end of the bottommost sensor unit is aligned with the external target along the axis parallel to the ground plane, and the image acquisition ends of other sensor units are aligned with the target ends of adjacent sensor units; Acquire GNSS data through a sensor unit arranged on the axis perpendicular to the ground plane and located on the top of the structure to be measured; determine a reference coordinate system based on the external target material and the GNSS data; After obtaining the roll displacement of the structure to be measured and after obtaining the vertical displacement of the structure to be measured, the method further includes: The roll displacement and the vertical displacement are projected to the reference coordinate system.

8. A deformation monitoring system based on phase correlation algorithm, characterized in that: include: Sensor units, each of which has an image acquisition end aligned with a target or a target end of another sensor unit along a corresponding axis; the structure to be measured includes a plurality of sensor units arranged along an axis perpendicular to the ground plane and a plurality of sensor units arranged along an axis parallel to the ground plane; An image acquisition unit, used to acquire a monitoring image of the target or the target end acquired by each sensor unit at each preset time interval; A calculation unit is used to compare the monitoring images collected at multiple moments to calculate the sub-displacement of the corresponding sensor unit; and is also used to calculate the rotation angle of the sensor unit relative to the axis on which it is located based on the sub-displacement; and to accumulate the sub-displacement and rotation angle of each sensor unit located on the axis perpendicular to the ground plane to obtain the roll displacement of the structure to be measured; and to accumulate the sub-displacement and rotation angle of each sensor unit located on the axis parallel to the ground plane to obtain the vertical displacement of the structure to be measured.

9. An electronic device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein: When the processor executes the program, the steps of the method according to any one of claims 1 to 7 are implemented.

10. A non-transitory computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 7 are implemented.

Images