Bridge displacement monitoring method and system based on phase information

Abstract

The application provides a bridge displacement monitoring method and system based on phase information, which comprises the following steps: performing pyramid decomposition on the processed video data through multi-scale direction decomposition, filtering the phase spectrum in the time domain to extract the interested frequency band, and amplifying the amplitude spectrum; obtaining a structure displacement signal according to the amplified signal and the central phase, and generating a pixel point displacement signal based on the structure displacement signal; establishing a physical coordinate system in each frame of image in the video data, converting the physical coordinate system into a modal coordinate system, and mapping the pixel point displacement signal on the modal coordinate system, so as to take the pixel point displacement signal on the modal coordinate system as an input signal; constructing a modal analysis model, and identifying the modal response of the input signal based on the modal analysis model to obtain bridge monitoring information. The application can accurately and comprehensively monitor the displacement information of the bridge.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of bridge monitoring, in particular to a bridge displacement monitoring method and system based on phase information. BACKGROUND

[0002] The bridge is an important facility connecting cities and cities, villages and villages, and is also an important infrastructure of modern transportation. The bridge generally refers to the structure erected on rivers, lakes and seas, so that vehicles and pedestrians can pass smoothly. In order to adapt to the modern high-speed development of the transportation industry, the bridge is also extended to the building erected to cross the ravine, poor geology or meet other traffic needs to make the traffic more convenient.

[0003] Structural health monitoring is a technology that obtains structural environment and load action, overall and local response data by laying various types of sensors on the structure, and analyzes the monitoring data to judge the safety state of the structure. The overall deformation of the structure is an important monitoring content. The structural displacement is mainly caused by load, temperature change, support settlement and time-varying of structural material properties. The commonly used structural displacement measurement technology is mainly through acceleration integration and GPS direct measurement. These methods are mostly traditional contact measurement methods, which generally need to arrange instruments on the surface (inside) of the measured structure in advance, and the preparation work is complicated and is easily affected by environmental conditions. These methods have single measurement points, complex arrangement conditions, increase the burden of the structure, require high working strength, and are high in cost, which do not meet the requirements of real-time multi-point dynamic monitoring of structural deformation.

[0004] In the prior art, the preparation work of the contact type monitoring bridge is complicated, and the monitoring result is easily affected by the environmental conditions. The non-contact monitoring mostly uses laser to monitor, which is not only high in cost, but also has single monitoring mode and measurement point. The radar monitoring also affects the monitoring accuracy due to the measurement distance. SUMMARY

[0005] Therefore, the purpose of the present application is to provide a bridge displacement monitoring method and system based on phase information to solve the above problems in the prior art.

[0006] In the first aspect, the present application provides a bridge displacement monitoring method based on phase information, which comprises:

[0007] Real-time acquisition of video data of the bridge, and processing of the video data to obtain processed video data;

[0008] Pyramid decomposition of the processed video data through multi-scale direction decomposition to obtain phase spectrum and amplitude spectrum, filtering of the phase spectrum in time domain to extract the frequency band of interest, and amplification of the amplitude spectrum;

[0009] amplify the frequency band of interest based on the structural displacement and in combination with the amplified amplitude spectrum to obtain an amplified signal, obtain a structural displacement signal according to the amplified signal and a central phase, and generate a pixel point displacement signal based on the structural displacement signal;

[0010] establish a physical coordinate system in each frame of image in the video data, convert the physical coordinate system into a modal coordinate system, and map the pixel point displacement signal on the modal coordinate system to take the pixel point displacement signal on the modal coordinate system as an input signal;

[0011] construct a modal analysis model, and identify a modal response of the input signal based on the modal analysis model to obtain bridge monitoring information.

[0012] Compared with the prior art, the beneficial effects of the present application are: through pyramid decomposition of the video data of the bridge by multi-scale directional decomposition, the phase spectrum and the amplitude spectrum of the bridge can be obtained, and more comprehensive phase information of the bridge can be obtained, through amplification of the amplitude spectrum and generation of the pixel point displacement signal from the obtained structural displacement signal, the modal analysis model can identify the pixel point displacement signal, so that the displacement information of the bridge and other conditions can be obtained, and the displacement information of the bridge can be accurately and comprehensively monitored.

[0013] Further, the step of collecting the video data of the bridge in real time and processing the video data comprises:

[0014] obtaining bridge video data collected in real time by a high-definition network camera;

[0015] performing noise reduction processing on the bridge video data, eliminating interference in the bridge video data by using an adaptive space-time filtering algorithm, and further processing the bridge video data by histogram equalization.

[0016] Further, the expression of the pyramid decomposition is:

[0017] ;

[0018] In the formula, represents a pixel value of the output image at the layer of the image pyramid function, represents a pixel value of the output image at the layer of the image pyramid function, represents the processed video data, , respectively represent a row coordinate of the image in the processed video data and a column coordinate of the image in the processed video data, , respectively represent a row direction offset amount, a column direction offset amount, represents a weight kernel function.

[0019] Further, the step of obtaining a structure displacement signal according to the amplified signal and the center phase, and generating a pixel displacement signal based on the structure displacement signal comprises:

[0020] a fixed reference frame, and obtaining a center phase based on the fixed reference frame and a sequence of video data;

[0021] obtaining a multiple relationship between a true displacement and the center phase to obtain structure displacement information contained in the center phase in a spatial scale, and obtaining a structure displacement signal based on the structure displacement information and the amplified signal, wherein an expression of the structure displacement is:

[0022] ;

[0023] wherein, represents a structure displacement, represents a ratio of a true displacement to a center phase, represents a constant phase offset amount;

[0024] based on a pixel point in the structure displacement signal and the center phase, to generate a pixel displacement signal.

[0025] Further, the expression of amplifying the amplitude spectrum is:

[0026] ;

[0027] wherein, represents a complex signal of the amplified amplitude spectrum, represents a spatial position, represents time, represents an angular frequency, represents a base number of a natural logarithm, represents an imaginary unit, represents a scaling constant, represents a constant phase offset amount, represents a real value amplitude of a signal in an angular frequency , a spatial position , and time . a center frequency, represents a time-dependent displacement.

[0028] Further, the step of establishing a physical coordinate system in each frame of the video data, converting the physical coordinate system into a modal coordinate system, and mapping the pixel point displacement signal on the modal coordinate system to take the pixel point displacement signal on the modal coordinate system as an input signal comprises:

[0029] Each frame of the video data is calibrated based on the position set, and a two-dimensional physical coordinate system is established;

[0030] The modal basis vector of the dominant vibration mode is selected based on the finite element model of the bridge or the experimental modal analysis result, and the two-dimensional physical coordinate system is projected onto the modal coordinate system through the coordinate transformation matrix;

[0031] The pixel point displacement field of the continuous frame picture of the video data is extracted, the displacement field is converted to the two-dimensional physical coordinate system, and the physical displacement is mapped to the modal coordinate system through modal projection to serve as an input signal.

[0032] Further, the step of constructing a modal analysis model and identifying the modal response of the input signal based on the modal analysis model comprises:

[0033] A modal analysis model is established based on the motion equation of the pixel point displacement signal in the physical coordinate system;

[0034] The pixel point displacement information in the input signal is identified based on the modal analysis model.

[0035] In a second aspect, the application further provides a bridge displacement monitoring system based on phase information, the system comprising:

[0036] The acquisition and processing module is configured to acquire video data of the bridge in real time and process the video data to obtain processed video data;

[0037] The decomposition and extraction module is configured to perform pyramid decomposition on the processed video data through multi-scale directional decomposition to obtain a phase spectrum and an amplitude spectrum, filter and extract a frequency band of interest from the phase spectrum in the time domain, and amplify the amplitude spectrum;

[0038] The amplification generation module is configured to amplify the frequency band of interest based on the structural displacement and in combination with the amplified amplitude spectrum to obtain an amplified signal, obtain a structural displacement signal according to the amplified signal and a center phase, and generate a pixel point displacement signal based on the structural displacement signal;

[0039] establishing a mapping module, for establishing a physical coordinate system in each frame of image in the video data, converting the physical coordinate system into a modal coordinate system, and mapping the pixel point displacement signal on the modal coordinate system, so as to take the pixel point displacement signal on the modal coordinate system as an input signal;

[0040] constructing an identification module, for constructing a modal analysis model, and identifying a modal response of the input signal based on the modal analysis model, so as to obtain bridge monitoring information.

[0041] In a third aspect, the present application further provides an electronic device, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, and the processor implements the bridge displacement monitoring method based on phase information when executing the computer program.

[0042] In a fourth aspect, the present application further provides a storage medium, which stores a computer program executable by a processor to implement the bridge displacement monitoring method based on phase information. BRIEF DESCRIPTION OF DRAWINGS

[0043] Figure 1 a flow chart of the bridge displacement monitoring method based on phase information in the first embodiment of the present application;

[0044] Figure 2 a structural block diagram of the bridge displacement monitoring system based on phase information in the second embodiment of the present application;

[0045] Figure 3 a structural block diagram of the electronic device in the third embodiment of the present application.

[0046] MAIN ELEMENT SYMBOL EXPLANATION

[0047] 10, acquisition and processing module; 20, decomposition and extraction module; 30, amplification and generation module; 40, establishing mapping module; 50, constructing identification module;

[0048] 60, bus; 61, processor; 62, memory; 63, communication interface.

[0049] The following specific embodiments will further illustrate the present application in combination with the above-mentioned drawings. DETAILED DESCRIPTION

[0050] In order to facilitate the understanding of the present application, the present application will be described more fully below with reference to the related drawings. The drawings show several embodiments of the present application. However, the present application can be realized in many different forms and is not limited to the embodiments described herein. On the contrary, the purpose of providing these embodiments is to make the disclosure of the present application more thorough and comprehensive.

[0051] It is to be understood that where an element such as a layer, region or substrate is described as being "on" another element, it can be directly on the other element or intervening elements can also be present. Where an element is described as being "connected" or "coupled" to another element, it can be directly connected or coupled or intervening elements can be present. As used herein the term "and / or" includes any and all combinations of one or more of the associated listed items.

[0052] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this application belongs. The terminology used in the description herein is for describing particular embodiments only and is not intended to be limiting of the application. As used herein, the term "and / or" includes any and all combinations of one or more of the associated listed items.

[0053] Embodiment one

[0054] Referring to Figure 1 , a bridge displacement monitoring method based on phase information in the first embodiment of the present application is shown, which comprises steps S1 to S5:

[0055] S1, real-time acquisition of bridge video data, and processing of the video data to obtain processed video data;

[0056] Specifically, the step S1 comprises steps S11 to S12:

[0057] S11, obtaining bridge video data collected by a high-definition network camera in real time;

[0058] S12, noise reduction processing of the bridge video data, using an adaptive space-time filtering algorithm to eliminate interference in the bridge video data, and further processing the bridge video data through histogram equalization;

[0059] It can be understood that the adaptive space-time filtering algorithm is used to filter the pictures in the bridge video data to eliminate the interference of weather such as rain and fog in the video, and the histogram equalization is used to optimize the bridge video data to further eliminate the interference in the video pictures.

[0060] S2, pyramid decomposition of the processed video data through multi-scale directional decomposition to obtain a phase spectrum and an amplitude spectrum, extraction of a frequency band of interest in the time domain through filtering of the phase spectrum, and amplification of the amplitude spectrum;

[0061] It can be understood that the pyramid decomposition is used to extract the amplitude and the local phase of the decomposed video data through the steerable localized non-aliased subbands, so that the phase spectrum and the amplitude spectrum can be obtained, and the image multi-scale decomposition is used to find the optimal structure scale, and the pyramid is steerable, so that the frequency band of interest is extracted in the phase spectrum, and the amplitude spectrum is amplified, and in the embodiment, the expression of the pyramid decomposition is as follows:

[0062] ;

[0063] In the formula, represents the pixel value of the i-th layer of the output image at the coordinate , , represents the image pyramid function, represents the processed video data, , respectively represent the row coordinate of the image in the processed video data and the column coordinate of the image in the processed video data, , respectively represent the row direction offset and the column direction offset, represents the weight kernel function;

[0064] The expression of amplifying the amplitude spectrum is as follows:

[0065] ;

[0066] In the formula, represents the complex signal of the amplified amplitude spectrum, represents the spatial position, represents the time, represents the angular frequency, represents the base of the natural logarithm, represents the imaginary unit, represents the scaling constant, represents the constant phase offset, represents the real value amplitude of the signal at the angular frequency , the spatial position , and the time , the center frequency, represents the time-dependent displacement.

[0067] S3, based on the structure displacement and in combination with the amplified amplitude spectrum, the frequency band of interest is amplified to obtain an amplified signal, a structure displacement signal is obtained according to the amplified signal and the center phase, and a pixel point displacement signal is generated based on the structure displacement signal;

[0068] Specifically, the step S3 comprises steps S31-S33:

[0069] S31, fixing a reference frame, and obtaining a center phase based on the fixed reference frame and a sequence of video data;

[0070] S32, obtaining a multiple relationship between a real displacement and the center phase to obtain structural displacement information contained in the center phase in a spatial scale, and obtaining a structural displacement signal based on the structural displacement information and the amplified signal, wherein an expression of the structural displacement is:

[0071]

[0072] In the formula, d represents the structural displacement, represents a ratio of the real displacement to the center phase, represents a constant phase offset;

[0073] S33, generating a pixel displacement signal based on a pixel point in the structural displacement signal and the center phase.

[0074] It can be understood that, by fixing a reference frame, calculating a center phase after time domain filtering of a sequence of video data, measuring a structural displacement by a displacement measurement method, and obtaining a ratio of the displacement to the center phase in multiple scales, the center phase in a spatial scale contains structural displacement information, the real structural displacement and the center phase are in a multiple relationship, and after the complex direction controllable pyramid is applied to a video frame, the center phase contains structural vibration displacement information in each spatial scale, then a structural displacement signal is obtained based on the structural displacement information and the amplified signal, and a pixel displacement signal is generated based on a pixel point in the structural displacement signal and the center phase.

[0075] S4, establishing a physical coordinate system in each image in the video data, converting the physical coordinate system into a modal coordinate system, and mapping the pixel displacement signal on the modal coordinate system to take the pixel displacement signal on the modal coordinate system as an input signal;

[0076] Specifically, the step S4 comprises steps S41-S43:

[0077] S41, calibrating each image of the video data based on a preset position, and establishing a two-dimensional physical coordinate system;

[0078] It can be understood that, for each image of the video data, a two-dimensional physical coordinate system is established based on a preset position calibration device such as a checkerboard calibration board, a laser reference point or a physical reference object with a known size, and an origin and an axial unit of the coordinate system are defined; ​​

[0079] S42, selecting a modal base vector of a dominant vibration mode based on a finite element model of the bridge or an experimental modal analysis result, and projecting the two-dimensional physical coordinate system to a modal coordinate system through a coordinate transformation matrix;

[0080] S43, extracting a pixel point displacement field of a continuous frame picture of the video data, converting the displacement field to the two-dimensional physical coordinate system, and mapping the physical displacement to the modal coordinate system through modal projection as an input signal;

[0081] It can be understood that, according to the dynamic characteristics of the target bridge, the modal base vector of the dominant vibration mode is selected through the finite element model of the bridge or the experimental modal analysis result, and the displacement vector in the physical coordinate system is projected to the modal coordinate system through the coordinate transformation matrix to obtain the purpose of modal coordinate conversion. By extracting the continuous frame pixel point displacement field, in this embodiment, the optical flow method can be used to convert the displacement field to the two-dimensional physical coordinate system, and the physical displacement is mapped to the modal coordinate through the modal projection.

[0082] S5, constructing a modal analysis model, and identifying a modal response of the input signal based on the modal analysis model to obtain bridge monitoring information;

[0083] Specifically, the step S5 includes steps S51 to S52:

[0084] S51, establishing a modal analysis model based on a motion equation of the pixel point displacement signal in the physical coordinate system;

[0085] S52, identifying the pixel point displacement information in the input signal based on the modal analysis model;

[0086] It can be understood that the finite element method is used to discretize the structure, and the modal analysis model is established based on the motion equation of the pixel point displacement signal in the physical coordinate system. The modal analysis model uses stochastic subspace identification and dynamic modal parameter tracking to effectively identify the pixel point displacement information in the input signal, so as to judge the displacement of the bridge according to the pixel point displacement information, and effectively monitor the bridge.

[0087] In summary, the bridge displacement monitoring method based on phase information in the above embodiment of the application can obtain the phase spectrum and amplitude spectrum of the bridge by performing multi-scale directional decomposition pyramid decomposition on the video data of the bridge, and can obtain more comprehensive phase information of the bridge. By amplifying the amplitude spectrum and generating the pixel point displacement signal from the obtained structure displacement signal, the modal analysis model can identify the pixel point displacement signal, so as to obtain the displacement information of the bridge and other conditions, and then accurately and comprehensively monitor the displacement information of the bridge.

[0088] Embodiment Two

[0089] The second embodiment of the present application also provides a bridge displacement monitoring system based on phase information, please refer to Figure 2 , which is a bridge displacement monitoring system based on phase information in the second embodiment of the present application, the system comprises:

[0090] The acquisition processing module 10 is used for real-time acquisition of video data of the bridge, and processing of the video data to obtain processed video data;

[0091] The decomposition extraction module 20 is used for pyramidal decomposition of the processed video data through multi-scale directional decomposition to obtain a phase spectrum and an amplitude spectrum, filtering and extracting a frequency band of interest of the phase spectrum in a time domain, and amplifying the amplitude spectrum, and an expression of the pyramidal decomposition is:

[0092] ;

[0093] In the formula, represents a pixel value of an output image at a coordinate represents an image pyramidal function, represents processed video data, , respectively represent a row coordinate of an image in the processed video data and a column coordinate of the image in the processed video data, , respectively represent a row direction offset and a column direction offset, represents a weight kernel function; An expression of the amplification of the amplitude spectrum is:

[0094]

[0095] ;

[0096] In the formula, represents a complex signal of the amplified amplitude spectrum, represents a spatial position, represents time, represents an angular frequency, represents a base number of a natural logarithm, represents an imaginary unit, represents a scaling constant, represents a constant phase offset, represents a real value amplitude of a signal at the angular frequency , the spatial position , and the time , central frequency,​​ representing time-dependent displacement;

[0097] an amplification generation module 30 configured to amplify the frequency band of interest based on the structural displacement and in combination with the amplified amplitude spectrum to obtain an amplified signal, to obtain a structural displacement signal according to the amplified signal and the central phase, and to generate a pixel displacement signal based on the structural displacement signal;

[0098] a mapping module 40 configured to establish a physical coordinate system in each frame of the video data, to convert the physical coordinate system into a modal coordinate system, and to map the pixel displacement signal on the modal coordinate system to take the pixel displacement signal on the modal coordinate system as an input signal;

[0099] a recognition module 50 configured to construct a modal analysis model and to recognize a modal response of the input signal based on the modal analysis model to obtain bridge monitoring information.

[0100] In some optional embodiments, the acquisition processing module 10 comprises:

[0101] an acquisition unit configured to acquire bridge video data collected in real time by a high-definition network camera;

[0102] a processing unit configured to perform noise reduction processing on the bridge video data, to eliminate interference in the bridge video data by using an adaptive space-time filtering algorithm, and to further process the bridge video data by histogram equalization.

[0103] In some optional embodiments, the amplification generation module 30 comprises:

[0104] a fixing unit configured to fix a reference frame and to obtain a central phase based on the fixed reference frame and a sequence of video data;

[0105] an acquisition amplification unit configured to acquire a multiple relationship between a true displacement and the central phase to obtain structural displacement information contained in the central phase in a spatial scale, and to obtain a structural displacement signal based on the structural displacement information and the amplified signal, wherein an expression of the structural displacement is:

[0106] ;

[0107] in the expression, represents the structural displacement, represents a ratio of the true displacement to the central phase, represents a constant phase offset;

[0108] a generation unit configured to generate a pixel displacement signal based on pixels in the structural displacement signal and the central phase.

[0109] In some optional embodiments, the mapping establishing module 40 comprises:

[0110] a calibration establishing unit configured to calibrate each frame image of the video data based on the position of the bridge and establish a two-dimensional physical coordinate system;

[0111] a selection projecting unit configured to select a modal base vector of a dominant vibration mode based on a finite element model or experimental modal analysis result of the bridge, and project the two-dimensional physical coordinate system onto a modal coordinate system through a coordinate transformation matrix;

[0112] an extraction converting unit configured to extract a pixel point displacement field of consecutive frame images of the video data, convert the displacement field to the two-dimensional physical coordinate system, and map the physical displacement onto the modal coordinate system through modal projection as an input signal.

[0113] In some optional embodiments, the construction recognition module 50 comprises:

[0114] an establishing unit configured to establish a modal analysis model based on a motion equation of the pixel point displacement signal in the physical coordinate system;

[0115] a recognition unit configured to recognize pixel point displacement information in the input signal based on the modal analysis model.

[0116] The functions or operation steps realized when the above modules and units are executed are generally the same as those of the above method embodiments, and thus will not be described here again.

[0117] The bridge displacement monitoring system based on phase information provided by the embodiments of the present application has the same implementation principle, technical effects and the above method embodiments. For brevity, the part of the system embodiments not mentioned can be referred to the corresponding content in the above method embodiments.

[0118] Embodiment Three

[0119] In the third embodiment of the present application, an electronic device is also provided. Please refer to FIG. 6, which shows the electronic device in the third embodiment of the present application. Figure 3

[0120] The electronic device can include a processor 61 and a memory 62 having computer program instructions stored therein.

[0121] Specifically, the above processor 61 can include a central processing unit (CPU), or an application specific integrated circuit (ASIC), or can be configured as one or more integrated circuits that implement the present application. ​

[0122] The memory 62 can include a mass storage for data or instructions. By way of example, and not limitation, the memory 62 can include a Hard Disk Drive (HDD), a floppy disk drive, a Solid State Drive (SSD), a flash drive, a Compact Disc Read Only Memory (CD-ROM), a magneto-optical disk, a magnetic tape, or a Universal Serial Bus (USB) drive or a combination of two or more of these. The memory 62 can be removable and / or non-removable (or fixed) as appropriate. The memory 62 can be internal or external as appropriate. In certain embodiments, the memory 62 is a non-volatile memory. In certain embodiments, the memory 62 includes a Read-Only Memory (ROM) and a Random-Access Memory (RAM). The ROM can be a Mask-Programmed ROM, a Programmable ROM (PROM), an Erasable PROM (EPROM), an Electrically EPROM (EEPROM), an Electrically Alterable ROM (EAROM), or a FLASH memory, or a combination of two or more of these, as appropriate. The RAM can be a Static Random-Access Memory (SRAM) or a Dynamic Random-Access Memory (DRAM), which can be a Fast Page Mode Dynamic Random-Access Memory (FPMDRAM), an Extended Data Output Dynamic Random-Access Memory (EDODRAM), a Synchronous Dynamic Random-Access Memory (SDRAM), or the like, as appropriate.

[0123] The memory 62 can be used to store or buffer various data files required for processing and / or communication, and possible computer program instructions executed by the processor 61.

[0124] The processor 61 reads and executes the computer program instructions stored in the memory 62 to implement the bridge displacement monitoring method based on phase information of the above-mentioned embodiment one.

[0125] In some embodiments, the electronic device can further include a communication interface 63 and a bus 60. In which, as shown in the figure, the processor 61, the memory 62, the communication interface 63 are connected through the bus 60 and complete the communication between each other. Figure 3

[0126] The communication interface 63 is used to realize the communication between the modules, devices, units and / or equipment in the present application. The communication interface 63 can also realize data communication with other components, such as: external equipment, image / data acquisition equipment, database, external storage and image / data processing workstation, etc.

[0127] ​Bus 60 includes hardware, software, or both, to couple components of the device to each other and to couple components of the device to other devices. What is considered a component of the device can vary depending on the particular view of the device that is considered. By way of example, a bus 60 can be a Data Bus, an Address Bus, a Control Bus, an Expansion Bus, a Local Bus, or a combination of one or more of these buses. By way of example and not limitation, bus 60 can include an Accelerated Graphics Port (AGP) or other graphics bus, an Extended Industry Standard Architecture (EISA) bus, a Front Side Bus (FSB), a Hyper Transport (HT) interconnect, an Industry Standard Architecture (ISA) bus, an InfiniBand (IB) interconnect, a Low Pin Count (LPC) bus, a memory bus, a Micro Channel Architecture (MCA) bus, a Peripheral Component Interconnect (PCI) bus, a PCI-Express (PCI-X) bus, a Serial Advanced Technology Attachment (SATA) bus, a Video Electronics Standards Association Local (VLB) bus, or another suitable bus or combination of two or more of these buses. Where appropriate, bus 60 can include one or more buses. Although the application is described and shown with respect to particular types of bus, the application contemplates any suitable bus or interconnect.

[0128] The electronic device can obtain a bridge displacement monitoring system based on phase information, and execute the bridge displacement monitoring method based on phase information of the first embodiment.

[0129] In addition, in combination with the bridge displacement monitoring method based on phase information in the above-mentioned first embodiment, the application can provide a storage medium to realize. The storage medium has computer program instructions stored thereon; the computer program instructions are executed by the processor to realize the bridge displacement monitoring method based on phase information in the above-mentioned first embodiment.

[0130] In the description of the present specification, the description of the terms "one embodiment", "some embodiments", "an example", "a specific example", or "some examples" and the like means that the specific features, structures, materials or characteristics described in connection with the embodiment or example are included in at least one embodiment or example of the present application. In the present specification, the illustrative expressions of the above terms do not necessarily refer to the same embodiment or example. Furthermore, the specific features, structures, materials or characteristics described can be combined in any one or more embodiments or examples in a suitable manner.

[0131] The above-described embodiments only express several implementation manners of the present application, which are described in a more specific and detailed manner, but cannot be understood as a limitation on the patent scope of the present application. It should be noted that, for those skilled in the art, several modifications and improvements can be made without departing from the concept of the present application, which are all within the protection scope of the present application. Therefore, the protection scope of the patent of the present application should be subject to the appended claims.

Claims

1. A bridge displacement monitoring method based on phase information, characterized in that, The method comprises: Real-time acquisition of video data of a bridge, and processing of the video data to obtain processed video data; Pyramid decomposition of the processed video data through multi-scale directional decomposition to obtain a phase spectrum and an amplitude spectrum, filtering of the phase spectrum in a time domain to extract a frequency band of interest, and amplification of the amplitude spectrum; Amplification of the frequency band of interest based on structural displacement and in combination with the amplified amplitude spectrum to obtain an amplified signal, obtaining of a structural displacement signal from the amplified signal and a central phase, and generation of a pixel point displacement signal based on the structural displacement signal, which specifically comprises: The step of obtaining a structural displacement signal from the amplified signal and a central phase, and generating a pixel point displacement signal based on the structural displacement signal comprises: Fixing a reference frame, and obtaining a central phase based on the fixed reference frame and a sequence of video data; Obtaining a multiple relationship between a true displacement and the central phase to obtain structural displacement information contained in the central phase in a spatial scale, and obtaining a structural displacement signal based on the structural displacement information and the amplified signal, wherein an expression of the structural displacement is: ； wherein denotes the structural displacement, denotes the ratio of the true displacement to the center phase, denotes the constant phase offset; Based on pixel points in the structural displacement signal and the central phase, a pixel point displacement signal is generated; Establishing a physical coordinate system in each frame of image in the video data, converting the physical coordinate system into a modal coordinate system, and mapping the pixel point displacement signal on the modal coordinate system to take the pixel point displacement signal on the modal coordinate system as an input signal; Constructing a modal analysis model, and identifying a modal response of the input signal based on the modal analysis model to obtain bridge monitoring information.

2. The phase information based bridge displacement monitoring method of claim 1, wherein, The step of real-time acquisition of video data of a bridge, and processing of the video data comprises: Obtaining bridge video data collected in real time by a high-definition network camera; Performing noise reduction processing on the bridge video data, eliminating interference in the bridge video data by using an adaptive space-time filtering algorithm, and further processing the bridge video data through histogram equalization.

3. The phase information based bridge displacement monitoring method of claim 1, wherein, An expression of the pyramid decomposition is: ； In the formula, represents a pixel value of the output image at coordinates represents a pixel value of the output image at coordinates represents a pixel value of the output image at coordinates represents an image pyramid function, represents processed video data, , respectively represent a row coordinate of an image in the processed video data, a column coordinate of the image in the processed video data, , respectively represent a row direction offset, a column direction offset, represents a filter kernel function.

4. The phase information based bridge displacement monitoring method of claim 1, wherein, An expression of the amplification of the amplitude spectrum is: ； wherein represents a complex signal of the amplified amplitude spectrum, represents a spatial position, represents a time, represents an angular frequency, represents the base of the natural logarithm, represents the imaginary unit, represents a scaling constant, represents a constant phase offset, represents the real-valued amplitude of a signal at a frequency band corresponding to the filter kernel function, a spatial position and a time, a center frequency, represents a time-dependent displacement.

5. The phase information based bridge displacement monitoring method of claim 1, wherein, The step of establishing a physical coordinate system in each frame of image in the video data, converting the physical coordinate system into a modal coordinate system, and mapping the pixel point displacement signal on the modal coordinate system to take the pixel point displacement signal on the modal coordinate system as an input signal comprises: Calibrating each frame of image of the video data based on a set position, and establishing a two-dimensional physical coordinate system; Selecting a modal basis vector of a dominant vibration mode based on a finite element model of a bridge or an experimental modal analysis result, and projecting the two-dimensional physical coordinate system onto a modal coordinate system through a coordinate transformation matrix; Extracting a pixel point displacement field of consecutive frame pictures of the video data, converting the displacement field to the two-dimensional physical coordinate system, and mapping a physical displacement to the modal coordinate system through modal projection to serve as an input signal.

6. The phase information based bridge displacement monitoring method of claim 1, wherein, The step of constructing a modal analysis model, and identifying a modal response of the input signal based on the modal analysis model comprises: A modal analysis model is established based on a motion equation of the pixel point displacement signal in the physical coordinate system; Pixel point displacement information in the input signal is identified based on the modal analysis model.

7. A bridge displacement monitoring system based on phase information, characterized by, The system comprises: A collection processing module is configured to collect video data of a bridge in real time and process the video data to obtain processed video data; A decomposition extraction module is configured to perform pyramid decomposition on the processed video data through multi-scale directional decomposition to obtain a phase spectrum and an amplitude spectrum, filter and extract a frequency band of interest in the time domain from the phase spectrum, and amplify the amplitude spectrum; An amplification generation module is configured to amplify the frequency band of interest based on structural displacement and the amplified amplitude spectrum to obtain an amplification signal, obtain a structural displacement signal based on the amplification signal and a center phase, and generate a pixel point displacement signal based on the structural displacement signal; The amplification generation module comprises: A fixing unit is configured to fix a reference frame and obtain a center phase based on the fixed reference frame and a sequence of video data; An acquisition amplification unit is configured to obtain a multiple relationship between a true displacement and the center phase to obtain structural displacement information contained in the center phase in a spatial scale, and obtain a structural displacement signal based on the structural displacement information and the amplification signal, wherein an expression of the structural displacement is: ； wherein denotes the structural displacement, denotes the ratio of the true displacement to the center phase, denotes the constant phase offset; A generation unit is configured to generate a pixel point displacement signal based on a pixel point in the structural displacement signal and the center phase; An establishment mapping module is configured to establish a physical coordinate system in each frame of image in the video data, convert the physical coordinate system into a modal coordinate system, and map the pixel point displacement signal on the modal coordinate system to take the pixel point displacement signal on the modal coordinate system as an input signal; A construction identification module is configured to construct a modal analysis model and identify a modal response of the input signal based on the modal analysis model to obtain bridge monitoring information.

8. An electronic device comprising a memory, a processor, and a computer program stored on the memory and executable on the processor, characterized in that, The processor executes the computer program to implement the bridge displacement monitoring method based on phase information according to any one of claims 1-6.

9. A storage medium having stored thereon a computer program, characterized in that The program is executed by the processor to implement the bridge displacement monitoring method based on phase information according to any one of claims 1-6.

Images