A method, device and medium for monitoring deformation of an abutment based on visual measurement

Abstract

The application discloses a kind of based on visual measurement's abutment deformation monitoring method, equipment and medium, it is related to optical measurement technical field, comprising: by real horizontal displacement sequence and real height interval sequence, construct height slope distribution and extract slope variation, combine abutment measurement total height to calculate top and bottom corner amount, according to slope variation to top and bottom corner amount is consistent correction, form abutment overall corner amount;According to abutment overall corner amount to real horizontal displacement sequence is linearly reconstructed, obtain linearly reconstructed real horizontal displacement sequence, utilize the difference of linearly reconstructed real horizontal displacement sequence and real horizontal displacement sequence and extract consistency residual quantity, and from real horizontal displacement sequence separate abutment overall translation, form abutment deformation monitoring quantity.The application is linearly reconstructed according to abutment overall corner amount and calculates consistency residual quantity, realizes the separation representation of abutment overall translation, abutment overall corner amount and consistency residual quantity.

Description

Technical Field

[0001] This invention relates to the field of optical measurement technology, and in particular to a method, device and medium for monitoring bridge abutment deformation based on vision measurement. Background Technology

[0002] As a crucial load-bearing component of the bridge substructure, the horizontal displacement and tilt changes of bridge abutments directly affect the stress state and support stability of the superstructure. In engineering practice, monitoring the deformation of bridge abutment facades typically employs total stations, levels, or visual measurement methods based on industrial cameras. This involves acquiring the coordinates of marked points on the structural surface and performing geometric calculations to achieve quantitative analysis of horizontal displacement and tilt angle. With the improvement of image acquisition equipment accuracy and the development of sub-pixel positioning algorithms, non-contact monitoring based on visual measurement can provide continuous observation data without altering the structural stress state, gradually becoming an important path for bridge structural condition perception.

[0003] However, existing methods still have two limitations: First, when deformations with vertical distribution differences occur along the abutment, monitoring data are often presented as a number of displacement points or overall linear indices, making it difficult to extract comparable gradient change features from the vertical sequence and reflect nonlinear fluctuations. Second, when overall rotation and overall translation are superimposed and accompanied by local deviations, traditional inclination angle derivation is mostly expressed by top-bottom difference or a single fitting parameter, making it difficult to complete the differentiation and consistency quantification of overall rotation, overall translation and deviation degree in the same data chain. Summary of the Invention

[0004] In view of the aforementioned existing problems, the present invention is proposed.

[0005] Therefore, this invention provides a bridge abutment deformation monitoring method based on visual measurement, which solves the problems of difficulty in structurally expressing the vertical deformation gradient of bridge abutments and difficulty in quantitatively distinguishing overall rotation, overall translation and nonlinear deviation.

[0006] To solve the above-mentioned technical problems, the present invention provides the following technical solution: In a first aspect, the present invention provides a method for monitoring bridge abutment deformation based on visual measurement, comprising: acquiring an initial image of the bridge abutment facade and measuring the true height spacing between adjacent strip-shaped observation areas; performing sub-pixel geometric center fusion processing on visual targets within the strip-shaped observation areas to form an initial horizontal pixel coordinate sequence and a true height spacing sequence in height order, and accumulating the true height spacing sequence to obtain the total measured height of the bridge abutment; extracting the current horizontal pixel coordinate sequence of the strip-shaped observation areas based on the bridge abutment facade monitoring image, combining it with the initial horizontal pixel coordinate sequence to form a horizontal pixel displacement sequence, obtaining a pixel length ratio coefficient, and then... The displacement sequence is converted into a true horizontal displacement sequence. A height slope distribution is constructed using the true horizontal displacement sequence and the true height spacing sequence, and the slope variation is extracted. The top and bottom rotation angles are calculated based on the total measured height of the abutment. Consistency correction is applied to the top and bottom rotation angles based on the slope variation to form the overall rotation angle of the abutment. The true horizontal displacement sequence is linearly reconstructed based on the overall rotation angle of the abutment to obtain a linearly reconstructed true horizontal displacement sequence. The consistency residual is extracted using the difference between the linearly reconstructed true horizontal displacement sequence and the true horizontal displacement sequence. The overall translational displacement of the abutment is then separated from the true horizontal displacement sequence to form the abutment deformation monitoring quantity.

[0007] As a preferred embodiment of the bridge abutment deformation monitoring method based on visual measurement described in this invention, the sub-pixel geometric center fusion processing of visual targets within the strip-shaped observation area includes: performing region separation processing on visual targets within the strip-shaped observation area in the initial image of the bridge abutment facade to obtain a visual target region image; performing contour extraction processing on the visual target region image to obtain the contour pixel coordinates of the visual targets; calculating the ellipse center coordinates of the visual targets based on the contour pixel coordinates of the visual targets, and using the horizontal component of the ellipse center coordinates as the sub-pixel horizontal pixel center coordinates of the visual targets; performing fusion calculation on the sub-pixel horizontal pixel center coordinates of all visual targets within the same strip-shaped observation area, the fusion calculation using the arithmetic mean method, and using the average value of the horizontal components of all sub-pixel horizontal pixel center coordinates as the initial horizontal pixel coordinates of the corresponding strip-shaped observation area; arranging all the initial horizontal pixel coordinates in the order from bottom to top of the strip-shaped observation area to form an initial horizontal pixel coordinate sequence.

[0008] As a preferred embodiment of the visual measurement-based bridge abutment deformation monitoring method of the present invention, wherein: the step of accumulating the true height spacing sequence to obtain the total bridge abutment measurement height includes accumulating all true height spacings in the true height spacing sequence in order of arrangement from bottom to top of the strip-shaped observation area to obtain the total bridge abutment measurement height.

[0009] As a preferred embodiment of the bridge abutment deformation monitoring method based on visual measurement described in this invention, the step of converting the lateral pixel displacement sequence into a true horizontal displacement sequence includes: performing sub-pixel geometric center fusion processing on visual targets within a strip-shaped observation area in the bridge abutment facade monitoring image to form a current lateral pixel coordinate sequence for the strip-shaped observation area; calculating the difference between the current lateral pixel coordinates and the corresponding initial lateral pixel coordinates for each strip according to the correspondence between the current lateral pixel coordinate sequence and the initial lateral pixel coordinate sequence in the strip-shaped observation area from bottom to top, to form a lateral pixel displacement sequence; setting up a calibration plate near the bridge abutment facade, with two calibration points on the calibration plate, acquiring images of the calibration plate and obtaining the sub-pixel lateral pixel center coordinate difference between the two calibration points, calculating a pixel length ratio coefficient based on the true calibration length and the sub-pixel lateral pixel center coordinate difference; and performing length conversion on all lateral pixel displacements in the lateral pixel displacement sequence according to the pixel length ratio coefficient to form a true horizontal displacement sequence.

[0010] As a preferred embodiment of the visual measurement-based bridge abutment deformation monitoring method of the present invention, the step of constructing a height slope distribution and extracting slope variation includes: selecting the true horizontal displacement of two adjacent strip-shaped observation areas and the true height spacing of corresponding adjacent height segments according to the bottom-to-top arrangement order of the true horizontal displacement sequence and the true height spacing of the corresponding adjacent height segments, using the ratio of the change in true horizontal displacement to the true height spacing as the height dispersion slope, calculating the height dispersion slope of all adjacent height segments and arranging them in vertical order to form a height slope distribution; and performing an absolute value summation operation on all difference amplitudes according to the difference amplitude between adjacent height dispersion slopes in the height slope distribution to obtain the slope variation.

[0011] As a preferred embodiment of the bridge abutment deformation monitoring method based on visual measurement described in this invention, the step of calculating the top and bottom rotation angle based on the total measured height of the bridge abutment and performing consistency correction on the top and bottom rotation angle based on the slope variation to form the overall rotation angle of the bridge abutment includes: obtaining the true horizontal displacement of the highest strip-shaped observation area and the true horizontal displacement of the lowest strip-shaped observation area based on the true horizontal displacement sequence, calculating the top and bottom displacement difference, and using the ratio of the top and bottom displacement difference to the total measured height of the bridge abutment as the top and bottom rotation angle; constructing a consistency correction coefficient based on the amplitude ratio relationship between the slope variation and the top and bottom rotation angle, and using the consistency correction coefficient as a proportional adjustment factor for the top and bottom rotation angle to perform amplitude adjustment processing on the top and bottom rotation angle to form the overall rotation angle of the bridge abutment.

[0012] As a preferred embodiment of the visual measurement-based bridge abutment deformation monitoring method of the present invention, the method for separating the overall translational amount of the bridge abutment includes: performing sequential accumulation operation according to the arrangement order of the true height spacing sequence in adjacent height segments from bottom to top to construct a cumulative height sequence; calculating the difference between the true horizontal displacement and the rotational contribution at each strip-shaped observation area position according to the true horizontal displacement sequence, the cumulative height sequence and the overall rotational amount of the bridge abutment, the difference is used as a translational component, and all translational components are arranged in the order of the strip-shaped observation area from bottom to top to form a translational component sequence; performing an arithmetic mean operation on the translational component sequence, and using the arithmetic mean as the overall translational amount of the bridge abutment.

[0013] As a preferred embodiment of the visual measurement-based bridge abutment deformation monitoring method of the present invention, the method for forming bridge abutment deformation monitoring quantities includes: calculating the linearly reconstructed true horizontal displacement at each strip-shaped observation area location based on the overall translational amount, overall rotational amount, and cumulative height sequence of the bridge abutment; establishing a linearly reconstructed true horizontal displacement sequence in the order of the strip-shaped observation areas from bottom to top; calculating the consistency residual at each strip-shaped observation area location based on the true horizontal displacement sequence and the linearly reconstructed true horizontal displacement sequence, using the difference between the true horizontal displacement and the linearly reconstructed true horizontal displacement as the consistency residual; arranging all the consistency residuals in the order of the strip-shaped observation areas from bottom to top to form a consistency residual sequence; performing an accumulation operation on the absolute values ​​of each consistency residual in the consistency residual sequence, and using the ratio between the accumulated value and the total measured height of the bridge abutment as the consistency residual quantity; and combining the overall translational amount, overall rotational amount, and consistency residual quantity of the bridge abutment to form the bridge abutment deformation monitoring quantity.

[0014] In a second aspect, the present invention provides a computer device including a memory and a processor, wherein the memory stores a computer program, wherein when the computer program is executed by the processor, it implements any step of the visual measurement-based bridge abutment deformation monitoring method as described in the first aspect of the present invention.

[0015] Thirdly, the present invention provides a computer-readable storage medium having a computer program stored thereon, wherein: when the computer program is executed by a processor, it implements any step of the visual measurement-based bridge abutment deformation monitoring method described in the first aspect of the present invention.

[0016] The beneficial effects of this invention are as follows: by constructing a height slope distribution and extracting the slope variation, a distributed characterization of the vertical variation characteristics of the real horizontal displacement sequence is realized; by performing linear reconstruction based on the overall rotation of the abutment and calculating the consistency residual, the overall translation of the abutment, the overall rotation of the abutment and the consistency residual are separated and characterized. Attached Figure Description

[0017] To more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings used in the following description of the embodiments will be briefly introduced. Obviously, the drawings described below are only some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0018] Figure 1 This is a flowchart of a vision-based method for monitoring bridge abutment deformation.

[0019] Figure 2 The flowchart is for the initial image acquisition and the generation of the true horizontal displacement sequence.

[0020] Figure 3 A flowchart for constructing the height slope distribution and calculating the overall rotation angle of the abutment.

[0021] Figure 4 A flowchart for calculating the deformation monitoring data of bridge abutments.

[0022] Figure 5 The image shows the slope distribution curve of the bridge abutment height and a magnified comparison of the local area.

[0023] Figure 6 This image shows a comparison between the actual horizontal displacement and the linearly reconstructed actual horizontal displacement, along with a magnified view of a local area. Detailed Implementation

[0024] To make the above-mentioned objects, features and advantages of the present invention more apparent and understandable, the specific embodiments of the present invention will be described in detail below with reference to the accompanying drawings.

[0025] Many specific details are set forth in the following description in order to provide a full understanding of the invention. However, the invention may also be practiced in other ways different from those described herein, and those skilled in the art can make similar extensions without departing from the spirit of the invention. Therefore, the invention is not limited to the specific embodiments disclosed below.

[0026] Secondly, the term "one embodiment" or "embodiment" as used herein refers to a specific feature, structure, or characteristic that may be included in at least one implementation of the present invention. The phrase "in one embodiment" appearing in different places in this specification does not necessarily refer to the same embodiment, nor is it a single or selective embodiment that is mutually exclusive with other embodiments.

[0027] Reference Figures 1-6 As one embodiment of the present invention, this embodiment provides a method for monitoring bridge abutment deformation based on visual measurement, including the following steps: S1. Acquire the initial image of the bridge abutment facade and measure the true height spacing between adjacent strip-shaped observation areas. Perform sub-pixel geometric center fusion processing on the visual targets within the strip-shaped observation areas to form an initial horizontal pixel coordinate sequence and a true height spacing sequence in height order. Accumulate the true height spacing sequence to obtain the total measured height of the bridge abutment.

[0028] Furthermore, before the bridge abutment deformation monitoring begins, at least three strip-shaped observation areas are divided vertically on the bridge abutment facade. Each strip-shaped observation area extends continuously horizontally along the bridge abutment and is arranged at intervals in the vertical direction. At least two visual targets are set up in each strip-shaped observation area.

[0029] A strip-shaped observation area refers to a narrow, elongated area on the bridge abutment facade that is divided vertically. Each strip-shaped observation area extends continuously in the transverse direction of the bridge abutment and is spaced apart from adjacent strip-shaped observation areas in the vertical direction. The strip-shaped observation area is used to define the deployment range of visual targets, so that visual targets within the same strip-shaped observation area have approximately the same height position in the vertical direction. Different strip-shaped observation areas correspond to different height segments on the bridge abutment facade. The strip-shaped observation area is a spatial division structure and does not constitute an independent component.

[0030] A visual target is a marker component set within a strip-shaped observation area. The visual target employs a graphic form with clear outlines and high contrast, enabling stable extraction of the sub-pixel lateral pixel center coordinates during image acquisition. The visual target maintains a consistent spatial motion with the bridge abutment facade; when the bridge abutment shifts or rotates, the visual target synchronously changes displacement with the facade. By extracting the changes in the sub-pixel lateral pixel center coordinates of the visual target, visual measurement of the bridge abutment facade displacement is achieved. The material, attachment method, and manufacturing process of the visual target are not limited, as long as they form a clear and identifiable outline in the image.

[0031] Furthermore, after completing the division of the strip-shaped observation area and the deployment of visual targets, an industrial camera was installed directly in front of the bridge abutment.

[0032] The industrial camera is installed on the extended line of the normal direction of the bridge abutment facade, so that the optical axis of the industrial camera is approximately perpendicular to the bridge abutment facade. By adjusting the installation height and pitch angle of the industrial camera, the visual targets in the entire strip-shaped observation area are placed within the imaging field of view of the industrial camera. The spatial position of the industrial camera is adjusted by tripod or supporting components, and the attitude of the industrial camera is corrected by a level instrument to ensure that the imaging plane of the industrial camera maintains a stable correspondence with the bridge abutment facade.

[0033] After the industrial camera is installed, start the industrial camera to acquire static images and obtain the initial image of the bridge abutment facade. The initial image of the bridge abutment facade should ensure that the outline of the visual target is clearly distinguishable. The image exposure time should be adjusted according to the on-site lighting conditions so that the contrast of the visual target boundary meets the requirements of sub-pixel center extraction accuracy.

[0034] Furthermore, after completing the initial image acquisition of the bridge abutment facade, a laser rangefinder or steel tape measure was used to measure the actual height distance between adjacent strip-shaped observation areas one by one.

[0035] During measurement, the height of the geometric center of the visual target in the adjacent strip-shaped observation area is used as a reference benchmark. Distance is measured vertically on the bridge abutment elevation to obtain the true height spacing between each pair of adjacent strip-shaped observation areas. The true height spacing between each pair of adjacent strip-shaped observation areas is recorded sequentially from bottom to top according to the strip-shaped observation areas to form a true height spacing sequence.

[0036] The total measured height of the bridge abutment is obtained by performing an accumulation operation on all the true height spacings in the true height spacing sequence in the recorded order.

[0037] Furthermore, the subpixel geometric center fusion processing includes the subpixel geometric center extraction process and fusion calculation.

[0038] After obtaining the initial image of the bridge abutment facade, a sub-pixel geometric center extraction process is performed on the visual targets within the strip-shaped observation area to obtain the sub-pixel horizontal pixel center coordinates of the visual targets. Specifically, the Otsu's method is used to separate the regions of each visual target in the initial image of the bridge abutment facade, extracting the visual target regions from the background regions to obtain visual target region images. The Canny edge detection algorithm is used to calculate the gray-level gradient and extract edge pixels in the visual target region images to obtain binary images of visual target edges. The connected component labeling method is used to extract the coordinates of visual target contour pixels in the binary images of visual target edges to form a sequence of visual target contour pixel coordinates. Elliptical least squares fitting is performed on the sequence of visual target contour pixel coordinates to obtain the coordinates of the ellipse center. The horizontal component of the ellipse center coordinates is used as the sub-pixel horizontal pixel center coordinates of the visual targets.

[0039] Within the same strip-shaped observation area, the horizontal pixel center coordinates of all visual targets are obtained. A fusion calculation is performed on all the horizontal pixel center coordinates of all the sub-pixels. The fusion calculation uses the arithmetic mean method to calculate the average value of the horizontal components of all the horizontal pixel center coordinates of all the sub-pixels. The average value is used as the initial horizontal pixel coordinates of the corresponding strip-shaped observation area. All the initial horizontal pixel coordinates are arranged in the order from bottom to top of the strip-shaped observation area to form the initial horizontal pixel coordinate sequence.

[0040] It should be noted that each element in the initial horizontal pixel coordinate sequence corresponds to the horizontal pixel reference position of different vertical sections of the bridge abutment facade, and the initial horizontal pixel coordinate sequence and the actual height spacing sequence are consistent in arrangement order.

[0041] The initial horizontal pixel coordinate sequence, the actual height spacing sequence, and the total measured height of the abutment together constitute the geometric benchmark for the visual measurement of the abutment facade.

[0042] S2. Extract the current horizontal pixel coordinate sequence of the strip-shaped observation area based on the bridge abutment facade monitoring image, combine it with the initial horizontal pixel coordinate sequence to form a horizontal pixel displacement sequence, obtain the pixel length ratio coefficient, and convert the horizontal pixel displacement sequence into a true horizontal displacement sequence.

[0043] Furthermore, during the bridge abutment facade monitoring phase, the installation position, orientation, and exposure parameters of the industrial camera are kept consistent with those during the initial image acquisition of the bridge abutment facade to obtain monitoring images of the bridge abutment facade.

[0044] The same subpixel geometric center fusion process as the initial image of the bridge abutment facade is performed on the visual targets within the strip-shaped observation area in the bridge abutment facade monitoring image to form the current horizontal pixel coordinate sequence of the strip-shaped observation area. Specifically, the subpixel geometric center extraction process is performed on the visual targets in the bridge abutment facade monitoring image to obtain the subpixel horizontal pixel center coordinates of the visual targets in each strip-shaped observation area. Within the same strip-shaped observation area, the fusion calculation is performed on all subpixel horizontal pixel center coordinates, and the fusion result is used as the current horizontal pixel coordinates of the corresponding strip-shaped observation area. All current horizontal pixel coordinates are arranged in the order of bottom to top of the strip-shaped observation area to form the current horizontal pixel coordinate sequence of the strip-shaped observation area.

[0045] The sub-pixel geometric center extraction process includes the Otsu's method, the Canny edge detection algorithm, the connected component labeling method, and the ellipse least squares fitting calculation; the fusion calculation uses the arithmetic mean method.

[0046] Furthermore, based on the identical bottom-to-top arrangement of the current horizontal pixel coordinate sequence and the initial horizontal pixel coordinate sequence in the strip-shaped observation area, a one-to-one correspondence between the two sets of horizontal pixel coordinates is established. For each strip-shaped observation area, the difference between the current horizontal pixel coordinate and the corresponding initial horizontal pixel coordinate is calculated as the horizontal pixel displacement. All horizontal pixel displacements are recorded according to the bottom-to-top arrangement of the strip-shaped observation area to form a horizontal pixel displacement sequence.

[0047] Furthermore, a calibration plate is set near the bridge abutment facade. The calibration plate is on the same plane as the bridge abutment facade, or while maintaining a parallel relationship, the distance from the calibration plate to the industrial camera along the optical axis of the industrial camera is the same as that from the bridge abutment facade. The calibration plate is placed within the imaging field of view of the industrial camera. Two calibration points are set on the calibration plate. The actual calibration length between the two calibration points is obtained by measuring with a steel tape measure. The unit of the actual calibration length is millimeters.

[0048] Keeping the industrial camera's installation position and orientation unchanged, acquire images of the calibration board; perform a sub-pixel geometric center extraction process on two calibration points in the calibration board image to obtain the sub-pixel horizontal pixel center coordinates of the two calibration points; calculate the sub-pixel horizontal pixel center coordinate difference between the two calibration points, and use the sub-pixel horizontal pixel center coordinate difference as the calibration pixel length.

[0049] The pixel length ratio coefficient is calculated based on the ratio of the actual calibration length to the calibration pixel length. The unit of the pixel length ratio coefficient is millimeters per pixel. The pixel length ratio coefficient is taken as the ratio of the actual calibration length to the calibration pixel length.

[0050] Furthermore, for each horizontal pixel displacement value in the horizontal pixel displacement sequence, a pixel length scaling factor is used for length conversion. The horizontal pixel displacement value is multiplied by the pixel length scaling factor to obtain the true horizontal displacement value. All true horizontal displacement values ​​are arranged in order from bottom to top according to the strip-shaped observation area to form the true horizontal displacement sequence.

[0051] The actual horizontal displacement sequence and the actual height spacing sequence are arranged in the same order.

[0052] S3. Construct a height slope distribution and extract slope variation through the real horizontal displacement sequence and the real height spacing sequence. Combine the total height of the abutment measurement to calculate the top and bottom rotation angle. Perform consistency correction on the top and bottom rotation angle based on the slope variation to form the overall rotation angle of the abutment.

[0053] Furthermore, the strip-shaped observation areas are numbered vertically from bottom to top, and the true horizontal displacement sequence is stored sequentially in the same order for each strip-shaped observation area. The first element of the true horizontal displacement sequence corresponds to the true horizontal displacement of the lowest strip-shaped observation area, and the last element corresponds to the true horizontal displacement of the highest strip-shaped observation area. Adjacent height segments are numbered vertically from bottom to top, and each adjacent height segment is enclosed by two adjacent strip-shaped observation areas. The true height spacing sequence is stored sequentially in the same order for the true height spacing of each adjacent height segment. The first element of the true height spacing sequence corresponds to the true height spacing between the lowest strip-shaped observation area and the adjacent upper strip-shaped observation area, and the last element corresponds to the true height spacing between the highest strip-shaped observation area and the adjacent lower strip-shaped observation area.

[0054] Based on the identical arrangement order of the true horizontal displacement sequence and the true height spacing sequence from bottom to top within the strip-shaped observation area, the true horizontal displacement of two adjacent strip-shaped observation areas is selected, as well as the true height spacing between two adjacent strip-shaped observation areas. Within adjacent height segments, the ratio of the change in true horizontal displacement to the true height spacing is used as the height dispersion slope, expressed as: ; in, For the first The height dispersion slope of each adjacent height segment; The first in the true horizontal displacement sequence The true horizontal displacement of each strip-shaped observation area; The first in the true horizontal displacement sequence The true horizontal displacement of each strip-shaped observation area; The first in the true height spacing sequence The actual height spacing between adjacent height segments; The sequence number of adjacent height segments; The serial number of the strip-shaped observation area; This represents the number of strip-shaped observation areas.

[0055] After obtaining the height dispersion slopes of all adjacent height segments, arrange all the height dispersion slopes in the order of adjacent height segments from bottom to top to form a height slope distribution.

[0056] Furthermore, based on the height dispersion slope of two adjacent height segments in the height slope distribution, the difference between adjacent height dispersion slopes is calculated, and the absolute values ​​of all difference amplitudes are summed to obtain the slope variation, expressed as: ; in, This is the slope variation. The first in the height slope distribution The height dispersion slope of each adjacent height segment; This is the absolute value operator.

[0057] The slope variation is used to characterize the degree of nonlinear change in the height slope distribution along the vertical direction. An increase in the slope variation indicates that the difference in the height dispersion slope of adjacent height segments is increasing, while a decrease in the slope variation indicates that the difference in the height dispersion slope of adjacent height segments is decreasing.

[0058] It should be noted that, to verify that a vision-based bridge abutment deformation monitoring method can construct a height discrete slope based on the true horizontal displacement sequence and the true height spacing sequence, and output the vertical deformation gradient change of the bridge abutment along the height direction in the form of a height slope distribution, strip-shaped observation areas were set up along the height direction of the bridge abutment facade in the experimental environment. The current horizontal pixel coordinate sequence of the strip-shaped observation area was collected, and the true horizontal displacement sequence was obtained by combining the pixel length ratio coefficient. The true height spacing sequence of adjacent strip-shaped observation areas was recorded simultaneously and accumulated to obtain the cumulative height. The ratio of the true horizontal displacement change to the true height spacing was calculated between adjacent strips to form a height discrete slope sequence, and arranged from bottom to top to obtain the height slope distribution, which was used to compare the consistency and difference of the vertical deformation gradient distribution under different working conditions.

[0059] like Figure 5 As shown, the horizontal axis represents cumulative height, and the vertical axis represents the height dispersion slope. The three curves represent the height slope distributions obtained under local nonlinear deviation intensities of 0.0 mm, 1.5 mm, and 3.0 mm, respectively, used to compare the slope distribution differences corresponding to different deviation intensities at the same cumulative height position. The red dashed rectangle marks the magnified interval, which selects the height range where the variation amplitude of the height dispersion slope is relatively concentrated. The sub-figure below shows the local comparison of the three curves within the magnified interval. The red dashed leader is used to establish the correspondence between the magnified interval of the overview diagram and the magnified local diagram. The characteristic peak marked in the magnified local diagram corresponds to the local maximum value of the height dispersion slope, and the characteristic valley corresponds to the local minimum value of the height dispersion slope. The two together define the main fluctuation range of the slope variation. When the local nonlinear deviation intensity increases from 0.0 mm to 3.0 mm, the difference in the amplitude of the height dispersion slope at the characteristic peak and the characteristic valley increases, indicating that the height slope distribution can output the concentrated range of vertical deformation gradient changes under the same height coordinate system and form a comparable result for the strength of deviation.

[0060] Furthermore, based on the bottom-to-top arrangement of the strip-shaped observation areas, the first element of the true horizontal displacement sequence corresponds to the true horizontal displacement of the lowest strip-shaped observation area, and the last element of the true horizontal displacement sequence corresponds to the true horizontal displacement of the highest strip-shaped observation area. The top-to-bottom displacement difference is calculated based on the true horizontal displacements of the highest and lowest strip-shaped observation areas, and the ratio of this top-to-bottom displacement difference to the total measured height of the abutment is used as the top-to-bottom rotation angle, expressed as: ; in, Measurements for top and bottom corners; This represents the true horizontal displacement of the highest strip-shaped observation area in the true horizontal displacement sequence. This represents the true horizontal displacement of the lowest strip-shaped observation area in the true horizontal displacement sequence. Measure the total height of the bridge abutment.

[0061] The ratio between the top-bottom displacement difference and the total measured height of the abutment is used to characterize the inclination of the abutment facade. Therefore, the ratio between the top-bottom displacement difference and the total measured height of the abutment is defined as the top-bottom rotation angle.

[0062] The top-bottom rotation angle is used to characterize the overall tilt of the bridge abutment facade from the lowest strip observation area to the highest strip observation area. An increase in the absolute value of the top-bottom rotation angle indicates that the top-bottom displacement difference relative to the total measured height of the bridge abutment increases, while a decrease in the absolute value of the top-bottom rotation angle indicates that the top-bottom displacement difference relative to the total measured height of the bridge abutment decreases.

[0063] Furthermore, based on the slope variation and the top and bottom angles, a consistency correction coefficient is calculated. The consistency correction coefficient is taken as the ratio of the absolute value of the top and bottom angles to the sum of the absolute value of the top and bottom angles and the slope variation. When the sum of the absolute value of the top and bottom angles and the slope variation is zero, the consistency correction coefficient is taken as 1.

[0064] Consistency correction is applied to the top and bottom rotation angles based on the consistency correction coefficient. When the absolute value of the top and bottom rotation angles plus the slope variation is zero, the overall rotation angle of the abutment is taken as the top and bottom rotation angle. When the absolute value of the top and bottom rotation angles plus the slope variation is non-zero, the overall rotation angle of the abutment is calculated by multiplying the top and bottom rotation angles by the consistency correction coefficient, as follows: ; in, This refers to the overall rotation angle of the bridge abutment.

[0065] An increase in slope variation indicates a stronger nonlinear change in the height slope distribution, which in turn reduces the consistency correction coefficient and decreases the overall abutment rotation angle. A decrease in slope variation indicates that the height slope distribution is closer to a linear change, which in turn increases the consistency correction coefficient and makes the overall abutment rotation angle closer to the top and bottom rotation angles.

[0066] S4. Based on the overall rotation angle of the bridge abutment, the true horizontal displacement sequence is linearly reconstructed to obtain the linearly reconstructed true horizontal displacement sequence. The consistency residual is extracted by using the difference between the linearly reconstructed true horizontal displacement sequence and the true horizontal displacement sequence. The overall translation of the bridge abutment is separated from the true horizontal displacement sequence to form the bridge abutment deformation monitoring quantity.

[0067] Furthermore, based on the bottom-to-top arrangement of the true height interval sequence within adjacent height segments, a sequential accumulation operation is performed on the true height interval sequence. The sequentially accumulated value is used as the cumulative height of the corresponding upper strip-shaped observation area, while the cumulative height of the lowest strip-shaped observation area is set to zero. Each true height interval in the true height interval sequence corresponds to an adjacent height segment. The sequential accumulation of the cumulative height sequence is performed according to the bottom-to-top order of adjacent height segments, as shown below: ; in, This represents the cumulative height of the lowest strip-shaped observation area in the cumulative height sequence; For the cumulative height sequence, the first The cumulative height of each strip-shaped observation area.

[0068] After completing the cumulative height calculation for all strip-shaped observation areas, the cumulative heights are arranged in order from bottom to top to form a cumulative height sequence. The cumulative height sequence is consistent with the actual horizontal displacement sequence in terms of arrangement.

[0069] Furthermore, based on the overall rotation angle and cumulative height sequence of the abutment, a translation component sequence is extracted from the actual horizontal displacement sequence. The translation component sequence is taken as the remaining component after deducting the rotation angle contribution from the actual horizontal displacement, and the arithmetic mean is performed on the translation component sequence to obtain the overall translation of the abutment.

[0070] Specifically, based on the true horizontal displacement sequence, the cumulative height sequence, and the overall rotation of the abutment, the difference between the true horizontal displacement and the rotation contribution is calculated at each strip-shaped observation area. The difference is used as the translation component, and all translation components are arranged in order from bottom to top according to the strip-shaped observation area to form a translation component sequence.

[0071] The translation component is represented as: ; in, For the translation component sequence, the first... Translational components of each strip-shaped observation area.

[0072] Perform an arithmetic mean operation on the translation component sequence, and use the arithmetic mean as the overall translation of the abutment, expressed as: ; in, This represents the overall translation of the bridge abutment.

[0073] Furthermore, based on the overall translational displacement, overall rotational displacement, and cumulative height sequence of the abutment, linear reconstruction of the true horizontal displacement is performed at each strip-shaped observation area. The linear reconstruction of the true horizontal displacement uses the overall translational displacement of the abutment as the translational reference value, and the product of the overall rotational displacement and cumulative height as the rotational contribution value. The sum of the translational reference value and the rotational contribution value is taken as the linear reconstruction of the true horizontal displacement, expressed as: ; in, For the first Linear reconstruction of the true horizontal displacement of each strip-shaped observation area.

[0074] After completing the linear reconstruction of the true horizontal displacement calculation for all strip-shaped observation areas, arrange all the linearly reconstructed true horizontal displacements in order from bottom to top of the strip-shaped observation areas to form a sequence of linearly reconstructed true horizontal displacements.

[0075] Furthermore, based on the true horizontal displacement sequence and the linearly reconstructed true horizontal displacement sequence, consistency residuals are calculated at each strip-shaped observation area. The consistency residual is calculated using the difference between the true horizontal displacement and the linearly reconstructed true horizontal displacement as the consistency residual. The consistency residual is used as the deviation of the true horizontal displacement from the linearly reconstructed true horizontal displacement, expressed as: ; in, For the first Consistency residuals for each strip-shaped observation area.

[0076] After completing the consistency residual calculation for all strip-shaped observation areas, arrange all consistency residuals in order from bottom to top according to the strip-shaped observation areas to form a consistency residual sequence.

[0077] Furthermore, based on the consistency residual sequence, the absolute value of the consistency residual is taken at each strip-shaped observation area location. This absolute value of the consistency residual is used as the deviation magnitude, and the absolute values ​​of the consistency residuals for all strip-shaped observation areas are accumulated to obtain the accumulated absolute value of the consistency residuals. The ratio of the accumulated absolute value of the consistency residuals to the total measured height of the abutment is taken as the consistency residual amount, expressed as: ; in, This refers to the consistency residual. For the first The absolute value of the consistency residuals for each strip-shaped observation area.

[0078] After completing the consistency residual calculation, the overall translation of the abutment, the overall rotation of the abutment, and the consistency residual are used as components of the abutment deformation monitoring quantity, and are written into the abutment deformation monitoring quantity in the order of overall translation of the abutment, overall rotation of the abutment, and consistency residual.

[0079] The bridge abutment deformation monitoring quantities include three types of values: overall bridge abutment translation, overall bridge abutment rotation, and consistency residual. The bridge abutment deformation monitoring quantities are used to characterize the overall translation degree, overall tilt degree, and linear consistency deviation degree of the true horizontal displacement sequence.

[0080] It should be noted that, to verify that a vision-based bridge abutment deformation monitoring method can linearly reconstruct the true horizontal displacement sequence based on the overall rotation angle of the bridge abutment, and to obtain a consistency residual sequence and consistency residual quantity by using the difference between the linearly reconstructed true horizontal displacement sequence and the true horizontal displacement sequence, thereby separating the linear component and the linear consistency deviation component of the output true horizontal displacement sequence, a strip-shaped observation area was arranged along the bridge abutment facade in the experiment, and the current lateral pixel coordinate sequence of the strip-shaped observation area was collected. The true horizontal displacement sequence was obtained by combining the pixel length scaling factor; and the true height spacing sequence was accumulated according to the execution order to form... The cumulative height sequence is used to calculate the angle contribution of the abutment's overall rotation and the cumulative height sequence. The angle contribution is subtracted from the actual horizontal displacement sequence to form a translation component sequence. The translation component sequence is arithmetically averaged to obtain the overall translation of the abutment. Based on the overall translation of the abutment, the overall rotation of the abutment, and the cumulative height sequence, the linear reconstructed actual horizontal displacement of each strip position is calculated to form a linear reconstructed actual horizontal displacement sequence. The difference between the actual horizontal displacement and the linear reconstructed actual horizontal displacement is calculated at each strip position to obtain a consistency residual sequence. The absolute value of the consistency residual is summed and then compared with the total measured height of the abutment to obtain the consistency residual amount.

[0081] like Figure 6As shown, the horizontal axis represents cumulative height, and the vertical axis represents horizontal displacement / residual. The three curves represent the true horizontal displacement sequence, the linearly reconstructed true horizontal displacement sequence, and the consistency residual sequence, respectively. The true horizontal displacement sequence represents the distribution of the true horizontal displacement of each strip observation area under the cumulative height coordinate. The linearly reconstructed true horizontal displacement sequence represents the linear component distribution obtained by using the overall translation of the abutment as the translation reference and superimposing the overall rotation of the abutment multiplied by the cumulative height. The consistency residual sequence represents the deviation distribution of the true horizontal displacement sequence from the linearly reconstructed true horizontal displacement sequence. The red dashed rectangle marks the magnified range, which selects the height range where the difference between the true horizontal displacement sequence and the linearly reconstructed true horizontal displacement sequence is relatively concentrated. Below... The sub-figures show a local comparison of the two displacement curves within the magnified range. The red dashed lines are used to establish the correspondence between the magnified range of the overview figure and the local magnified figure. The characteristic peak in the local magnified figure corresponds to the local maximum value of the true horizontal displacement sequence within the magnified range. At the location of the characteristic peak, the difference between the true horizontal displacement and the linearly reconstructed true horizontal displacement reaches a local maximum, indicating that the linear consistency deviation occurs concentratedly in the corresponding cumulative height segment. The consistency residual is composed of the ratio of the cumulative absolute value of the consistency residual to the total measured height of the abutment, which makes the linear consistency deviation comparable under a unified scale across different detection periods or different working conditions. This supports the separate characterization of the abutment deformation monitoring quantity for the overall translational degree, the overall tilting degree, and the degree of linear consistency deviation.

[0082] This embodiment also provides a computer device applicable to the bridge abutment deformation monitoring method based on vision measurement, including: a memory and a processor; the memory is used to store computer-executable instructions, and the processor is used to execute the computer-executable instructions to implement the bridge abutment deformation monitoring method based on vision measurement as proposed in the above embodiment.

[0083] The computer device can be a terminal, comprising a processor, memory, communication interface, display screen, and input devices connected via a system bus. The processor provides computing and control capabilities. The memory includes non-volatile storage media and internal memory. The non-volatile storage media stores the operating system and computer programs. The internal memory provides an environment for the operation of the operating system and computer programs stored in the non-volatile storage media. The communication interface is used for wired or wireless communication with external terminals; wireless communication can be achieved through Wi-Fi, carrier networks, NFC (Near Field Communication), or other technologies. The display screen can be an LCD screen or an e-ink screen. The input devices can be a touch layer covering the display screen, buttons, a trackball, or a touchpad on the computer device's casing, or an external keyboard, touchpad, or mouse.

[0084] This embodiment also provides a storage medium storing a computer program, which, when executed by a processor, implements the bridge abutment deformation monitoring method based on vision measurement as proposed in the above embodiments. The storage medium can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as Static Random Access Memory (SRAM), Electrically Erasable Programmable Read-Only Memory (EEPROM), Erasable Programmable Read Only Memory (EPROM), Programmable Red-Only Memory (PROM), Read-Only Memory (ROM), magnetic storage, flash memory, magnetic disk, or optical disk.

[0085] In summary, this invention achieves a distributed characterization of the vertical variation characteristics of the real horizontal displacement sequence by constructing a height slope distribution and extracting slope variation; and achieves the separate characterization of the overall translation of the abutment, the overall rotation of the abutment, and the consistency residual by performing linear reconstruction based on the overall rotation of the abutment and calculating the consistency residual.

[0086] It should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention and are not intended to limit it. Although the present invention has been described in detail with reference to preferred embodiments, those skilled in the art should understand that modifications or equivalent substitutions can be made to the technical solutions of the present invention without departing from the spirit and scope of the technical solutions of the present invention, and all such modifications or substitutions should be covered within the scope of the claims of the present invention.

Claims

1. A method for monitoring bridge abutment deformation based on visual measurement, characterized in that, include: The initial image of the bridge abutment facade was acquired and the true height spacing between adjacent strip-shaped observation areas was measured. Subpixel geometric center fusion processing was performed on the visual targets within the strip-shaped observation areas to form an initial horizontal pixel coordinate sequence and a true height spacing sequence in height order. The true height spacing sequence was then accumulated to obtain the total measured height of the bridge abutment. Based on the bridge abutment facade monitoring image, the current horizontal pixel coordinate sequence of the strip-shaped observation area is extracted, and the horizontal pixel displacement sequence is formed by combining the initial horizontal pixel coordinate sequence. The pixel length ratio coefficient is obtained and the horizontal pixel displacement sequence is converted into the true horizontal displacement sequence. By constructing the height slope distribution and extracting the slope variation through the real horizontal displacement sequence and the real height spacing sequence, the top and bottom rotation angle is calculated by combining the total height of the abutment measurement. The top and bottom rotation angle is then corrected for consistency based on the slope variation to form the overall rotation angle of the abutment. Linear reconstruction of the actual horizontal displacement sequence is performed based on the overall rotation angle of the bridge abutment to obtain the linearly reconstructed actual horizontal displacement sequence. The consistency residual is extracted by using the difference between the linearly reconstructed actual horizontal displacement sequence and the actual horizontal displacement sequence. The overall translation of the bridge abutment is then separated from the actual horizontal displacement sequence to form the bridge abutment deformation monitoring quantity.

2. The bridge abutment deformation monitoring method based on vision measurement as described in claim 1, characterized in that, The subpixel geometric center fusion processing of visual targets within the strip-shaped observation area includes performing region separation processing on visual targets within the strip-shaped observation area in the initial image of the bridge abutment facade to obtain a visual target area image. Perform contour extraction processing on the image of the visual target region to obtain the coordinates of the visual target contour pixels. The coordinates of the center of the ellipse of the visual target are calculated based on the pixel coordinates of the visual target outline, and the horizontal component of the center of the ellipse coordinates is used as the sub-pixel horizontal pixel center coordinates of the visual target. Within the same strip-shaped observation area, the fusion calculation is performed on the horizontal pixel center coordinates of all visual targets. The fusion calculation adopts the arithmetic mean method, and the average value of the horizontal components of the horizontal pixel center coordinates of all sub-pixels is used as the initial horizontal pixel coordinates of the corresponding strip-shaped observation area. All initial horizontal pixel coordinates are arranged in order from bottom to top according to the strip-shaped observation area to form an initial horizontal pixel coordinate sequence.

3. The bridge abutment deformation monitoring method based on vision measurement as described in claim 1, characterized in that, The process of accumulating the true height interval sequence to obtain the total abutment measurement height involves sequentially accumulating all true height intervals in the true height interval sequence according to the order of the strip-shaped observation area from bottom to top to obtain the total abutment measurement height.

4. The method for monitoring bridge abutment deformation based on vision measurement as described in claim 1 or 2, characterized in that, The step of converting the horizontal pixel displacement sequence into a true horizontal displacement sequence includes performing sub-pixel geometric center fusion processing on the visual target in the strip-shaped observation area of ​​the bridge abutment facade monitoring image to form the current horizontal pixel coordinate sequence of the strip-shaped observation area. Based on the correspondence between the current horizontal pixel coordinate sequence and the initial horizontal pixel coordinate sequence in the strip-shaped observation area from bottom to top, the difference between the current horizontal pixel coordinate and the corresponding initial horizontal pixel coordinate is calculated for each strip to form a horizontal pixel displacement sequence. A calibration plate is set up near the bridge abutment facade, with two calibration points set on the calibration plate. The calibration plate image is acquired and the sub-pixel horizontal pixel center coordinate difference between the two calibration points is obtained. The pixel length ratio coefficient is calculated based on the actual calibration length and the sub-pixel horizontal pixel center coordinate difference. The length of all horizontal pixel displacements in the horizontal pixel displacement sequence is converted according to the pixel length scaling factor to form the true horizontal displacement sequence.

5. The bridge abutment deformation monitoring method based on vision measurement as described in claim 4, characterized in that, The construction of the height slope distribution and extraction of slope variation includes: according to the arrangement order of the true horizontal displacement sequence and the true height spacing sequence in the strip-shaped observation area from bottom to top, selecting the true horizontal displacement of two adjacent strip-shaped observation areas and the true height spacing of corresponding adjacent height segments, using the ratio of the change in true horizontal displacement to the true height spacing as the height dispersion slope, calculating the height dispersion slope of all adjacent height segments and arranging them in vertical order to form a height slope distribution; Based on the difference between adjacent discrete slopes in the height slope distribution, the absolute values ​​of all differences are summed to obtain the slope variation.

6. The bridge abutment deformation monitoring method based on vision measurement as described in claim 5, characterized in that, The calculation of the top and bottom rotation angle based on the total height of the bridge abutment measurement, and the consistency correction of the top and bottom rotation angle based on the slope variation to form the overall rotation angle of the bridge abutment, includes obtaining the true horizontal displacement of the highest strip observation area and the true horizontal displacement of the lowest strip observation area based on the true horizontal displacement sequence, calculating the top and bottom displacement difference, and taking the ratio of the top and bottom displacement difference to the total height of the bridge abutment measurement as the top and bottom rotation angle. Based on the amplitude ratio between the slope variation and the top and bottom rotation, a consistency correction coefficient is constructed. This consistency correction coefficient is then used as a proportional adjustment factor for the top and bottom rotation to adjust the amplitude of the top and bottom rotation, thus forming the overall rotation of the abutment.

7. The bridge abutment deformation monitoring method based on vision measurement as described in claim 6, characterized in that, The overall translation of the separated bridge abutment includes performing sequential accumulation operations based on the arrangement order from bottom to top of adjacent height segments according to the actual height spacing sequence to construct a cumulative height sequence; Based on the actual horizontal displacement sequence, cumulative height sequence and overall abutment rotation, the difference between the actual horizontal displacement and rotation contribution is calculated at each strip observation area. The difference is used as the translation component, and all translation components are arranged in the order from bottom to top of the strip observation area to form a translation component sequence. Perform an arithmetic mean operation on the translation component sequence, and use the arithmetic mean as the overall translation amount of the bridge abutment.

8. The bridge abutment deformation monitoring method based on vision measurement as described in claim 7, characterized in that, The formation of bridge abutment deformation monitoring data includes calculating the linear reconstruction of the true horizontal displacement at each strip-shaped observation area based on the overall translation of the bridge abutment, the overall rotation of the bridge abutment, and the cumulative height sequence, and establishing a linear reconstruction of the true horizontal displacement sequence in the order of the strip-shaped observation areas from bottom to top. Based on the true horizontal displacement sequence and the linearly reconstructed true horizontal displacement sequence, the consistency residual is calculated at each strip-shaped observation area. The consistency residual is calculated using the difference between the true horizontal displacement and the linearly reconstructed true horizontal displacement. All consistency residuals are arranged in the order of the strip-shaped observation area from bottom to top to form a consistency residual sequence. The absolute values ​​of each consistency residual in the consistency residual sequence are summed, and the ratio between the summed value and the total measured height of the abutment is used as the consistency residual amount. The overall translational amount of the bridge abutment, the overall rotational amount of the bridge abutment, and the consistency residual amount constitute the bridge abutment deformation monitoring quantities.

9. A computer device comprising a memory and a processor, wherein the memory stores a computer program, characterized in that, When the processor executes the computer program, it implements the steps of the bridge abutment deformation monitoring method based on vision measurement as described in any one of claims 1 to 8.

10. A computer-readable storage medium having a computer program stored thereon, characterized in that, When the computer program is executed by the processor, it implements the steps of the bridge abutment deformation monitoring method based on vision measurement as described in any one of claims 1 to 8.

Images