High-precision displacement estimation method and device, storage medium and product
By employing Fast Fourier Transform and Complex Controlled Pyramid Decomposition techniques, the accuracy problem of displacement estimation in low-resolution images using DIC technology was solved, achieving efficient displacement estimation, reducing computational load, and improving accuracy.
Patent Information
- Application Number
- CN202410847533.7
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-06-27
- Publication Date
- 2024-11-19
- Estimated Expiration
- Not applicable · inactive patent
AI Technical Summary
Existing DIC technology struggles to guarantee displacement estimation accuracy when image resolution is reduced, sometimes even exhibiting issues such as shifts of several times or loss of correlation. Furthermore, motion magnification technology suffers from extremely high computational demands.
The image is transformed from the spatial domain to the frequency domain by Fast Fourier Transform. Complex controllable pyramid decomposition is applied to decompose the image into multi-scale and multi-directional sub-bands. The target phase difference between the sub-band and the reference sub-band is amplified and superimposed with the original phase data. Synthesis and inverse transformation are performed to reconstruct the phase-amplified video. Finally, displacement estimation is performed.
It reduces the computational load of video upscaling, improves the displacement estimation accuracy of low-resolution images, avoids offset or loss of correlation problems, and improves the detection accuracy of minute displacements.
Smart Images

Figure CN118982576A_ABST
Abstract
Description
Technical Field
[0001] The present invention belongs to the technical field of structure detection and monitoring, and in particular relates to a high-precision displacement estimation method, device, storage medium and product based on joint image magnification and DIC (Digital Image Correlation) technology. Background Art
[0002] The bridge vibration measurement method based on computer vision technology has the advantages of non-contact, high efficiency, low cost and full-field measurement. In recent years, it has been widely used in the fields of damage detection, displacement measurement, modal identification and other fields related to structural health monitoring. Computer vision technology has developed rapidly and has been applied to various fields of structural health monitoring of civil infrastructure, such as building wind vibration testing, bridge structure vibration measurement and defect detection, slope deformation monitoring, etc. Computer vision technology provides a new possibility for long-distance displacement measurement of engineering structures, and it has an incomparable advantage in monitoring the displacement of large structures at long distances.
[0003] However, in visual deformation monitoring applications, the distance between the camera and the target is generally very far, and the environment is complex, which results in poor quality images with a larger GSD (Ground Sampling Distance). Therefore, it is often more difficult to achieve high-precision displacement estimation. Most existing sub-pixel motion estimation methods focus on proposing powerful interpolation techniques or identifying interesting properties of the cross-power spectrum that can improve image registration results, but these methods cannot overcome the lower limit of sub-pixel accuracy. To this end, some scholars have proposed a solution to introduce motion amplification technology into structural displacement measurement. Amplifying sub-pixel displacement can better estimate its true value, thereby improving the displacement estimation accuracy of blurred images on the basis of accurately estimating the true value.
[0004] For example, the patent document with the authorization announcement number CN114993452B discloses a method and system for measuring structural micro-vibrations based on broadband phase motion magnification (BPMM). Through machine vision technologies such as noise removal, filtering amplification, and sub-pixel template matching to calculate displacement, the amplification of the amplitude of structural micro-vibration displacement is achieved. Although the processing flow of this technology is too cumbersome, it is still a useful attempt to combine motion amplification technology with template matching technology and apply it to deformation measurement and health warning of bridges. Therefore, it is of practical significance to study the combined motion amplification and DIC technology to improve the accuracy of bridge displacement monitoring.
[0005] In general, DIC technology has good measurement results, but as the resolution of the target image of the structure to be measured decreases, it is difficult for DIC technology to play its original measurement advantages, making it difficult to ensure the accuracy of displacement matching, and even causing several times of offset or loss of correlation. The amount of calculation required for a series of processes in motion magnification technology is very large. Often, the time required to perform a video motion magnification process is dozens or even hundreds of times the time of the video itself. Low-resolution images just reduce the amount of calculation, making it less time-consuming to apply this technology and achieving a higher-precision displacement effect. Summary of the invention
[0006] The purpose of the present invention is to provide a high-precision displacement estimation method, device, storage medium and product to solve the problem that DIC technology is difficult to ensure the displacement estimation accuracy when the image resolution is reduced, and even an offset of several times or loss of correlation occurs, and the problem that the motion magnification technology has a very large amount of calculation.
[0007] The present invention solves the above technical problems through the following technical solutions: a high-precision displacement estimation method, the estimation method comprising the following steps:
[0008] Acquire a micro-motion video of the object to be estimated, and obtain a target video image of the object to be estimated based on the micro-motion video;
[0009] Transforming, decomposing and filtering each of the target video images to obtain original phase data, original amplitude data and target phase data of each sub-band in the corresponding target video image;
[0010] Obtaining new phase data of the corresponding sub-frequency band according to the original phase data and the target phase data of the sub-frequency band;
[0011] synthesizing and inversely transforming the new phase data and the original amplitude data of all sub-bands of the same target video image to obtain an inversely transformed image;
[0012] Reconstruct the phase-amplified video from all inverse-transformed images;
[0013] The displacement of the phase-amplified video is estimated to obtain the actual displacement.
[0014] Further, obtaining a target video image of the object to be estimated according to the micro-motion video specifically includes:
[0015] Performing frame extraction processing on the micro-motion video to obtain a series of video images;
[0016] A ROI region is selected for each of the video images to obtain a target video image of the object to be estimated.
[0017] Furthermore, each of the target video images is transformed, decomposed and filtered, specifically including:
[0018] Using fast Fourier transform to transform the target video image from the spatial domain to the frequency domain to obtain a corresponding spectrum diagram;
[0019] Performing complex controllable pyramid decomposition on the spectrum graph to obtain a set of sub-bands of different scales and directions; wherein each sub-band includes original phase data and original amplitude data;
[0020] The original phase data of each sub-frequency band is subjected to frequency domain bandpass filtering to obtain target phase data of the corresponding sub-frequency band.
[0021] Further, obtaining new phase data of the corresponding sub-frequency band according to the original phase data and the target phase data of the sub-frequency band specifically includes:
[0022] For each sub-frequency band, performing a difference process on the target phase data of the sub-frequency band and the target phase data of the reference sub-frequency band to obtain a target phase difference;
[0023] The target phase difference is amplified, and the amplified target phase difference is superimposed with the original phase data of the sub-frequency band to obtain new phase data of the sub-frequency band.
[0024] Furthermore, performing displacement estimation on the phase-amplified video specifically includes:
[0025] Performing frame extraction processing on the phase-amplified video to obtain a series of magnified images;
[0026] Calculate the pixel displacement between each enlarged image and the reference image;
[0027] According to the preset scale factor, the pixel displacement is converted into an actual displacement, and the specific calculation formula of the actual displacement is:
[0028] d actual =scale×d pixel ;
[0029] Among them, d actual represents the actual displacement, scale represents the preset scale factor, d pixel Indicates pixel displacement.
[0030] Furthermore, the pixel displacement between each enlarged image and the reference image is calculated, specifically including:
[0031] Calculating a cross power spectrum between the enlarged image and a reference image;
[0032] Performing inverse Fourier transform on the cross power spectrum to obtain a Dirac function;
[0033] Solving for the peak point of the Dirac function;
[0034] A method such as bilinear interpolation is used to perform fine matching near the peak point to obtain sub-pixel coordinates; and the pixel displacement is calculated according to the sub-pixel coordinates.
[0035] Based on the same concept, the present invention also provides a terminal device, including a memory, a processor, and a computer program / instruction stored in the memory, wherein the processor executes the computer program / instruction to implement the high-precision displacement estimation method as described above.
[0036] Based on the same concept, the present invention also provides a computer-readable storage medium on which a computer program / instruction is stored. When the computer program / instruction is executed by a processor, the high-precision displacement estimation method as described above is implemented.
[0037] Based on the same concept, the present invention also provides a computer program product, including a computer program / instruction, which implements the high-precision displacement estimation method as described above when executed by a processor.
[0038] Beneficial Effects
[0039] Compared with the prior art, the advantages of the present invention are:
[0040] The present invention transforms a target video image in a spatial domain into a frequency domain image (i.e., a spectrum diagram) by using a fast Fourier transform, and then decomposes it into multi-scale, multi-directional sub-bands by using a complex controllable pyramid decomposition, amplifies the target phase difference between the sub-band and the reference sub-band, and then superimposes it with the original phase data to obtain new phase data of the sub-band, then synthesizes and inversely transforms all sub-bands, and then reconstructs a phase-amplified video, and finally uses the phase-amplified video to estimate displacement; the present invention not only reduces the amount of calculation for video amplification processing and improves estimation efficiency, but also improves the displacement estimation accuracy of low-resolution images, improves the detection accuracy of small displacements, and avoids the problem of offset or loss of correlation. BRIEF DESCRIPTION OF THE DRAWINGS
[0041] In order to more clearly illustrate the technical solution of the present invention, the drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only one embodiment of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.
[0042] Figure 1 is a flow chart of a high-precision displacement estimation method in an embodiment of the present invention;
[0043] Figure 2 The low-resolution videos obtained when the target moves 0 mm, 2 mm, 4 mm, and 6 mm respectively in the embodiment of the present invention;
[0044] Figure 3 The original video of the target is obtained by downsampling by 4 times and downsampling by 8 times in the embodiment of the present invention;
[0045] Figure 4 The video is a video obtained by amplifying the original video of the target, the video downsampled by 4 times, and the video downsampled by 8 times in the embodiment of the present invention;
[0046] Figure 5 These are videos obtained by magnifying the target by 4 times and 8 times, respectively, after the target is downsampled by 4 times in the embodiment of the present invention;
[0047] Figure 6 is a comparison diagram of the calculation results of the method of the present invention and the displacement estimation method based on the DIC technology at the same magnification and different resolutions in the embodiment of the present invention;
[0048] Figure 7 This is a comparison chart of the calculation results of the method of the present invention and the displacement estimation method based on the DIC technology at different magnifications and the same resolution in an embodiment of the present invention. DETAILED DESCRIPTION
[0049] The following is a clear and complete description of the technical solutions in the present invention in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.
[0050] The technical solution of the present application is described in detail with specific embodiments below. The following specific embodiments can be combined with each other, and the same or similar concepts or processes may not be described in detail in some embodiments.
[0051] Example 1
[0052] like Figure 1 As shown, a high-precision displacement estimation method provided by an embodiment of the present invention includes the following steps:
[0053] Step S1: acquiring a micro-motion video of an object to be estimated, and obtaining a target video image of the object to be estimated based on the micro-motion video;
[0054] Step S2: transforming, decomposing and filtering each of the target video images to obtain original phase data, original amplitude data and target phase data of each sub-band in the corresponding target video image;
[0055] Step S3: obtaining new phase data of the corresponding sub-frequency band according to the original phase data and the target phase data of the sub-frequency band;
[0056] Step S4: synthesizing and inversely transforming the new phase data and the original amplitude data of all sub-bands of the same target video image to obtain an inversely transformed image;
[0057] Step S5: reconstructing the phase-amplified video according to all the inverse transformed images;
[0058] Step S6: performing displacement estimation on the phase-amplified video to obtain actual displacement.
[0059] In step S1, obtaining a target video image of the object to be estimated according to the micro-motion video specifically includes:
[0060] Step S1.1: performing frame extraction processing on the micro-motion video to obtain a series of video images;
[0061] Step S1.2: Select a ROI (Region of Interest) for each of the video images (including rotation, cropping, scaling, etc.) to obtain a target video image of the object to be estimated.
[0062] In step S2, each of the target video images is transformed, decomposed and filtered, specifically including:
[0063] Step S2.1: Use two-dimensional fast Fourier transform to transform the target video image from the spatial domain to the frequency domain to obtain the corresponding spectrum diagram, that is, transform the target video image in the spatial domain into the spectrum diagram in the frequency domain. The specific formula is:
[0064] I(x, y, 0) = f(x, y) (1)
[0065] I(x,y,t)=f(x+δ(x,t),y+δ(y,t)) (2)
[0066]
[0067]
[0068] Among them, I(x, y, t) represents the image grayscale of the target video image at the two-dimensional spatial position (x, y) at time t; δ(x, t) and δ(y, t) represent displacement functions, which respectively represent the displacement changes in the x direction and y direction from 0 to time t, that is, the slight movement of the structure; A ωrepresents the original amplitude data of the sub-band with a frequency of ω, e represents the base of the natural logarithm, i represents the imaginary unit, ω(x, y) and ω(x+δ(x, t), y+δ(y, t)) represent the original phase data contained in the sub-band with a frequency of ω when t=0 and t>0, respectively.
[0069] Step S2.2: Perform complex controllable pyramid decomposition in the frequency domain on the spectrum graph to obtain a set of sub-bands of different scales and directions; each sub-band includes original phase data and original amplitude data; the specific formula is:
[0070] S ω =A ω e iω(x+δ(x,t),y+δ(y,t)) (5)
[0071] Among them, S ω represents the sub-band with frequency ω.
[0072] Step S2.3: Perform frequency domain bandpass filtering on the original phase data of each sub-band, extract all frequencies of interest, and obtain the target phase data of the corresponding sub-band.
[0073] In step S3, new phase data of the corresponding sub-frequency band is obtained according to the original phase data and the target phase data of the sub-frequency band, which specifically includes:
[0074] Step S3.1: For the ith sub-band, perform a difference process on the target phase data of the ith sub-band and the target phase data of the reference sub-band to obtain a target phase difference. The specific formula is:
[0075] B ω =ω(x+δ(x,t),y+δ(y,t))-ω(x,y)=ω(δ(x,t),δ(y,t)) (6)
[0076] Among them, ω(x+δ(x, t), y+δ(y, t)) represents the target phase data of the ith sub-band after frequency domain bandpass filtering, ω(x, y) represents the target phase data of the reference sub-band, and B ω represents the target phase difference, and ω(δ(x, t), δ(y, t)) represents the target phase difference of the ith sub-band in the x direction and the y direction.
[0077] Step S3.2: amplify the target phase difference, and superimpose the amplified target phase difference with the original phase data of the i-th sub-frequency band to obtain new phase data of the i-th sub-frequency band.
[0078] In this embodiment, the magnification factor of the target phase difference is 5. The i-th sub-band after amplification can be expressed as:
[0079]
[0080] in, represents the amplified sub-band; α represents the amplification factor; ω(x+(1+α)δ(x, t), y+(1+α)δ(y, t)) represents the new phase data of the ith sub-band.
[0081] In this embodiment, the reference sub-frequency band refers to the sub-frequency band of the first frame of the target video image, and the scale and direction of the sub-frequency band correspond to the scale and direction of the i-th sub-frequency band.
[0082] In step S4, the new phase data and the original amplitude data of all sub-bands of the same target video image are synthesized to obtain a corresponding synthetic spectrum map, and weighted Gaussian denoising is performed on the synthetic spectrum map. Then, the synthetic spectrum map after weighted Gaussian denoising is inversely transformed (i.e., two-dimensional inverse fast Fourier transform) to obtain an inverse transformed image, that is, the synthetic spectrum map in the frequency domain is transformed into an image in the spatial domain.
[0083] In this embodiment, the specific formula for weighted Gaussian noise reduction processing is:
[0084]
[0085] G(u,v)=H(u,v)·F(u,v)(9)
[0086]
[0087] Among them, H(u, v) represents the weighted Gaussian filter, D(u, v) represents the distance function in the frequency domain, σ represents the standard deviation of the Gaussian function, F(u, v) represents the synthetic spectrum, G(u, v) represents the synthetic spectrum after weighted Gaussian denoising, g(x, y) represents the inverse transformed image, represents the inverse Fourier transform.
[0088] In step S5, all the inverse transformation images are synthesized to reconstruct the phase-amplified video, and then the phase-amplified video is used to estimate the displacement. In a specific embodiment of the present invention, the displacement estimation of the phase-amplified video specifically includes:
[0089] Step S6.1: performing frame extraction processing on the phase-amplified video to obtain a series of magnified images;
[0090] Step S6.2: Calculate the pixel displacement between each enlarged image and the reference image;
[0091] Step S6.3: According to the preset scale factor, the pixel displacement is converted into the actual displacement. The specific calculation formula is:
[0092] d actual=scale×d pixel (11)
[0093] Among them, d actual represents the actual displacement, scale represents the preset scale factor, d pixel Indicates pixel displacement.
[0094] In this embodiment, the reference image is the first frame of enlarged image, and the pixel displacement between other enlarged images (i.e., other enlarged images in a series of enlarged images except the first frame of enlarged image) and the reference image is calculated, specifically including:
[0095] Step S6.21: Calculate the cross power spectrum between the enlarged image and the reference image;
[0096] Step S6.22: Perform inverse Fourier transform on the cross power spectrum to obtain the Dirac function;
[0097] Step S6.23: solving the peak point of the Dirac function;
[0098] Step S6.24: Use a bilinear interpolation method to perform refined matching near the peak point to obtain sub-pixel coordinates.
[0099] Step S6.25: Calculate the pixel displacement according to the sub-pixel coordinates.
[0100] Before calculating the cross power spectrum, the amplified image and the reference image are transformed from the spatial domain to the frequency domain, and then the cross power spectrum between the two is calculated.
[0101] Example 2
[0102] The displacement estimation of a target with a small movement is used as an example to illustrate the high-precision displacement estimation method of the present invention. The target mounted on the slide is manually moved by 0 mm, 2 mm, 4 mm, and 6 mm, respectively, thereby obtaining a target video with a small movement feature, such as Figure 2 As shown; the low-resolution videos obtained by downsampling the target video by 4 times and 8 times are shown in Figure 3 As shown; the target video, the video after downsampling 4 times and the low-resolution video after downsampling 8 times are enlarged and the enlarged video is shown as follows Figure 4 As shown; the low-resolution video after downsampling 4 times is enlarged 4 times and 8 times respectively, and the obtained video is as follows Figure 5 shown.
[0103] The displacement of videos with different magnifications and resolutions is estimated, and the displacement estimation accuracy is compared. The specific comparison results are shown in Table 1, Table 2, Figure 6 and Figure 7 shown.
[0104] Table 1 and Figure 6 The comparison results of displacement estimation accuracy (RMSE, root mean square error) of the present invention and DIC technology at the same magnification and different resolutions are shown in Table 2 and Figure 7 The comparison results of displacement estimation accuracy between the present invention and DIC technology at different magnifications and the same resolution are shown. Figure 6 It can be seen that the displacement estimation accuracy of the video after amplification is higher and closer to the displacement estimation accuracy of the target video; from Table 2 and Figure 7 It can be seen that the displacement accuracy of the method of the present invention is higher when processing 4 times down-sampled target videos.
[0105] Table 1 Comparison results of displacement estimation accuracy at the same magnification and different resolutions
[0106] Target Video 4x downsampling 8x downsampling Displacement estimation method based on DIC technology 0.06 0.16 1.15 Method of the present invention —— 0.13 0.75
[0107] Table 2 Comparison results of displacement estimation accuracy at different magnifications and the same resolution
[0108] Target Video 4x downsampling Displacement estimation method based on DIC technology 0.06 0.16 The method of the present invention (magnification is 4) —— 0.11 The method of the present invention (magnification is 8) —— 0.14
[0109] Obviously, compared with the displacement estimation method based on DIC technology, the present invention combines motion amplification and DIC technology, and enables DIC technology to smoothly capture the motion changes in low-resolution images by amplifying the phase of structural motion. It can improve the accuracy of displacement estimation on the basis of low-resolution images, and the amount of calculation in the amplification process is greatly reduced, thereby improving the efficiency of displacement estimation.
[0110] Example 3
[0111] An embodiment of the present invention further provides a terminal device, which includes: a memory, a processor, and a computer program / instruction stored in the memory, and the processor executes the computer program / instruction to implement the high-precision displacement estimation method as described above.
[0112] Although not shown, the terminal device includes a processor, which can perform various appropriate operations and processes according to the program and / or data stored in the read-only memory (ROM) or the program and / or data loaded from the storage part to the random access memory (RAM). The processor can be a multi-core processor, or it can include multiple processors. In some embodiments, the processor can include a general main processor and one or more special coprocessors, such as a central processing unit, a graphics processing unit (GPU), a neural network processor (NPU), a digital signal processor (DSP), etc. In RAM, various programs and data required for the operation of the terminal device are also stored. The processor, ROM and RAM are connected to each other via a bus. The input / output (I / O) interface is also connected to the bus.
[0113] The processor and memory are used together to execute the program / instructions stored in the memory. When the program / instructions are executed by the computer, the methods, steps or functions described in the above embodiments can be implemented.
[0114] Although not shown, an embodiment of the present invention further provides a computer-readable storage medium having a computer program / instruction stored thereon, which implements the high-precision displacement estimation method as described above when executed by a processor.
[0115] Storage media in embodiments of the present invention include permanent and non-permanent, removable and non-removable items that can be implemented by any method or technology to store information. Examples of storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technology, compact disk read-only memory (CD-ROM), digital versatile disk (DVD) or other optical storage, magnetic cassettes, magnetic disk storage or other magnetic storage devices or any other non-transmission medium that can be used to store information that can be accessed by a computing device.
[0116] Readable storage media include permanent and non-permanent, removable and non-removable media that can be implemented by any method or technology to store information. Information can be computer-readable instructions, data structures, program modules or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technology, compact disk read-only memory (CD-ROM), digital versatile disk (DVD) or other optical storage, magnetic cassettes, disk storage or other magnetic storage devices or any other non-transmission media that can be used to store information that can be accessed by a computing device. As defined herein, computer-readable media does not include temporary computer-readable media (transitory media), such as modulated data signals and carrier waves.
[0117] Although not shown, an embodiment of the present invention further provides a computer program product, including: a computer program / instruction, which implements the high-precision displacement estimation method as described above when executed by a processor.
[0118] What is disclosed above is only a specific implementation mode of the present invention, but the protection scope of the present invention is not limited thereto. Any technician familiar with the technical field can easily think of changes or modifications within the technical scope disclosed in the present invention, which should be covered within the protection scope of the present invention.
Claims
1. A high-precision displacement estimation method, It is characterized in that The estimation method comprises the following steps: Acquire a micro-motion video of the object to be estimated, and obtain a target video image of the object to be estimated based on the micro-motion video; Transforming, decomposing and filtering each of the target video images to obtain original phase data, original amplitude data and target phase data of each sub-band in the corresponding target video image; Obtaining new phase data of the corresponding sub-frequency band according to the original phase data and the target phase data of the sub-frequency band; synthesizing and inversely transforming the new phase data and the original amplitude data of all sub-bands of the same target video image to obtain an inversely transformed image; Reconstruct the phase-amplified video from all inverse-transformed images; The displacement of the phase-amplified video is estimated to obtain the actual displacement.
2. The high-precision displacement estimation method according to claim 1, It is characterized in that Obtaining a target video image of the object to be estimated according to the micro-motion video specifically includes: Performing frame extraction processing on the micro-motion video to obtain a series of video images; A ROI region is selected for each of the video images to obtain a target video image of the object to be estimated.
3. The high-precision displacement estimation method according to claim 1, It is characterized in that Each of the target video images is transformed, decomposed and filtered, specifically including: Using fast Fourier transform to transform the target video image from the spatial domain to the frequency domain to obtain a corresponding spectrum diagram; Performing complex controllable pyramid decomposition on the spectrum graph to obtain a set of sub-bands of different scales and directions; wherein each sub-band includes original phase data and original amplitude data; The original phase data of each sub-frequency band is subjected to frequency domain bandpass filtering to obtain target phase data of the corresponding sub-frequency band.
4. The high-precision displacement estimation method according to claim 1, It is characterized in that Obtaining new phase data of the corresponding sub-frequency band according to the original phase data and the target phase data of the sub-frequency band specifically includes: For each sub-frequency band, performing a difference process on the target phase data of the sub-frequency band and the target phase data of the reference sub-frequency band to obtain a target phase difference; The target phase difference is amplified, and the amplified target phase difference is superimposed with the original phase data of the sub-frequency band to obtain new phase data of the sub-frequency band.
5. The high-precision displacement estimation method according to any one of claims 1 to 4, It is characterized in that The displacement estimation is performed on the phase-amplified video, specifically comprising: Performing frame extraction processing on the phase-amplified video to obtain a series of magnified images; Calculate the pixel displacement between each enlarged image and the reference image; According to the preset scale factor, the pixel displacement is converted into an actual displacement, and the specific calculation formula of the actual displacement is: d actual =scale×d pixel ; Among them, d actual represents the actual displacement, scale represents the preset scale factor, d pixel Indicates pixel displacement.
6. The high-precision displacement estimation method according to claim 5, It is characterized in that Calculate the pixel displacement between each enlarged image and the reference image, including: Calculating a cross power spectrum between the enlarged image and a reference image; Performing inverse Fourier transform on the cross power spectrum to obtain a Dirac function; Solving for the peak point of the Dirac function; A bilinear interpolation method is used to perform refined matching near the peak point to obtain sub-pixel coordinates; and the pixel displacement is calculated according to the sub-pixel coordinates.
7. A terminal device comprising a memory, a processor and a computer program / instruction stored in the memory, It is characterized in that The processor executes the computer program / instructions to implement the high-precision displacement estimation method according to any one of claims 1 to 6.
8. A computer-readable storage medium having a computer program / instructions stored thereon, It is characterized in that When the computer program / instructions are executed by a processor, the high-precision displacement estimation method according to any one of claims 1 to 6 is implemented.
9. A computer program product comprising a computer program / instructions, It is characterized in that When the computer program / instructions are executed by a processor, the high-precision displacement estimation method according to any one of claims 1 to 6 is implemented.
Citation Information
Patent Citations
A Method and System for Measuring Micro-Vibrations of Structures Based on Broadband Phase Motion Amplification
CN114993452B
Linear motor rotor position detecting method based on extended phase correlation algorithm
CN106767958A
Trembling function image imaging method based on video
CN107492117A
Method for measuring position of linear motor mover based on machine vision
CN109341529A
Camouflage human body target detection method under complex background based on computer vision
CN110544259A
