Motion blur removing imaging method and device based on intensity correlation

Through the demotion blur imaging method based on intensity correlation, the time-varying speckle field and Fourier transform algorithm are used to solve the problem of image blur in high-speed motion scenes, and high-resolution real-time imaging is achieved, simplifying the system structure and reducing the The cost.

CN119052620AActive Publication Date: 2024-11-29SUZHOU UNIV

Patent Information

Application Number
CN202411094429.1
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-08-09
Publication Date
2024-11-29
Estimated Expiration
2044-08-09

Smart Images

  • Figure CN119052620A_ABST
    Figure CN119052620A_ABST
Patent Text Reader

Abstract

The invention relates to a motion blur removing imaging method and device based on intensity correlation. Light beams emitted by the laser irradiate the phase modulator, the phase modulator generates a time-varying speckle field to irradiate a moving object to be measured, light intensity information penetrating through the moving object to be measured is converged on the charge coupled device (CCD) through the lens, and the CCD records light intensity distribution information after target transmission and stores the light intensity distribution information in the computer. During imaging, the phase modulator and the CCD are synchronously triggered and controlled by a synchronizing signal generator to work, the computer extracts Fourier transform frequency spectrum information of an object by performing correlation operation on light intensity distribution information recorded by the CCD, and performs phase recovery reconstruction on the frequency spectrum information to obtain a high-resolution real space image of the moving object to be measured. The imaging device provided by the invention is simple in structure and reconstruction algorithm, and is suitable for high-resolution imaging application scenes in which tangential and axial relative movement exists at the same time.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The invention relates to a method and device for removing motion blur imaging based on intensity association, and belongs to the technical field of optical imaging. Background Art

[0002] Real-time acquisition of dynamic scene information is of great significance for application fields such as remote sensing reconnaissance, key defense, biomedical imaging and detection. However, in actual applications, due to the limitations of system imaging frame rate and detection sensitivity, when there is relative motion between the detection target and the imaging system, long sampling time will cause image blur, making it difficult to obtain images that meet the actual application requirements.

[0003] At present, there are three main methods to solve the image blur caused by relative motion and obtain high-definition imaging. One is to improve the sensitivity of the detector and shorten the sampling time as much as possible, so that the image blur caused by the detection target and the imaging system does not exceed the size of a single pixel of the detector. However, the degree of improvement of this method is relatively limited. On the one hand, from the perspective of imaging mechanism, reducing the exposure will lead to a decrease in the image signal-to-noise ratio, resulting in image quality that cannot meet application requirements; on the other hand, this method is difficult to improve in many detection bands (such as infrared and terahertz), and improving the detection sensitivity often requires the addition of related refrigeration devices, which will not only lead to a significant increase in system costs, but also increase the volume and power consumption of the system, thereby limiting its use in certain application platforms. The second is the system compensation method. For example: optical image motion compensation method, mechanical image motion compensation method, integrated image motion compensation method, etc. The most representative is the de-motion blurring method based on target tracking system compensation, which achieves the purpose of eliminating motion blur by compensating and correcting the relative motion between the target to be measured and the imaging system in real time. However, this method is not only expensive, but also can only perform high-resolution imaging on targets that only move in the tangential direction, move at a low speed, and have a relatively stable speed change. In addition, for application scenarios with high-speed axial relative motion, the imaging resolution of this method will drop sharply. The third method is to improve motion blur through motion estimation and image post-processing methods. For example: non-blind deblurring method, blind deblurring method, motion estimation method, etc., see the literature Ghost imaging of a moving target with an unknown constant speed [J]. Applied Physics Letters, 2014, 104 (25). However, such methods usually have the problems of large computational complexity and weak generalization ability, and the degree of image quality improvement is often limited. Therefore, there is an urgent need to explore and develop an imaging solution that does not require a compensation system, has a simple system structure, and can simultaneously eliminate tangential and axial motion blur. Summary of the invention

[0004] In view of the shortcomings of existing de-motion blurring methods and technologies, the present invention provides a de-motion blurring imaging method and device based on intensity correlation, which has a simple structure and reconstruction algorithm and is suitable for high-resolution imaging application scenarios with simultaneous tangential and axial relative motion.

[0005] The technical solution for achieving the purpose of the present invention is a de-motion blur imaging device based on intensity correlation, which includes a laser, a phase modulator, a lens, a charge-coupled device (CCD) and a computer; the phase modulator and the charge-coupled device (CCD) are synchronously triggered and controlled by a synchronization signal generator to work, the light beam emitted by the laser is irradiated on the phase modulator, the phase modulator generates a time-varying speckle field to irradiate the moving object to be measured, the light intensity information transmitted by the moving object to be measured is converged on the charge-coupled device (CCD) by the lens, the light intensity distribution information after the target is transmitted is recorded by the CCD and stored in the computer, and a high-resolution real-space image of the moving object to be measured is output after intensity correlation calculation and image reconstruction processing.

[0006] The technical solution of the present invention also includes a de-motion blur imaging method based on intensity association, the steps are as follows: (1) Acquisition of detection signals of moving objects to be detected The phase modulator and CCD are controlled by a synchronous signal generator to work synchronously. The light beam emitted by the laser irradiates the phase modulator, and a time-varying speckle field is generated by the phase modulator. After the light field propagates freely, it irradiates the moving object to be measured. The lens gathers the light intensity information transmitted by the moving object to be measured on the CCD, and the CCD records the light intensity distribution information after the target is transmitted and stores it in the computer. (2) Extraction of Fourier transform spectrum image of the moving object to be measured CCD acquisition and recording S The instantaneous light intensity picture corresponds to k The instantaneous light intensity picture is recorded as ,in: m and n Respectively represent the horizontal and vertical pixel positions of the recorded image; according to the instantaneous light intensity image obtained, the Fourier transform spectrum image of the moving object to be measured is obtained , is the light intensity distribution of the object to be measured, represents Fourier transform, and intensity correlation operation is performed according to formula (1). (1) in: M and N Indicates the total number of horizontal and vertical pixels of the image recorded by the CCD; (3) High-resolution image reconstruction of the moving object to be measured The phase recovery algorithm is used to reconstruct the Fourier transform spectrum image of the moving object to be measured, so as to obtain a high-resolution real-space image of the moving object to be measured.

[0007] The moving object to be measured in the present invention moves both horizontally and axially within a certain range, and the horizontal movement range of the object is smaller than the effective aperture of the lens. The phase modulator is loaded with a time-varying random phase that satisfies uniform distribution.

[0008] The present invention can use GS or HIO phase recovery algorithm to reconstruct the image.

[0009] The technical solution provided by the present invention is that within the sampling time, the tangential motion range of the object to be measured is usually not larger than the effective aperture of the lens and cannot perform rotational motion, but can perform random tangential and axial motion between the phase modulator and the lens. Optimizing the phase distribution of the phase modulator can effectively reduce the number of samples for obtaining the Fourier transform spectrum image of the moving object to be measured, thereby improving the imaging speed.

[0010] Compared with the prior art, the present invention has the following technical effects: (1) Based on physical principles, the present invention has the ability to resist image blur caused by tangential and axial motion, and has no restrictions on motion trajectory and speed.

[0011] (2) The device of the present invention has a simple system structure and does not require a compensation system and a subsequent de-motion blur estimation algorithm.

[0012] (3) The spatial resolution of existing speckle illumination imaging systems is usually limited by the lateral size of the speckle field at the surface of the object to be measured. However, in the present invention, the distance between the moving object to be measured and the phase modulator and the lens can be relatively far, and its spatial resolution is no longer limited by the lateral size of the speckle field at the surface of the object to be measured. In addition, the larger size of the speckle field can reduce the number of samples required to obtain high-quality Fourier transform spectrum images. BRIEF DESCRIPTION OF THE DRAWINGS

[0013] Figure 1 It is a structural schematic diagram of a de-motion blur imaging device based on intensity association provided in an embodiment of the present invention.

[0014] In the figure: 1 is a laser; 2 is a phase modulator; 3 is a moving object to be measured; 4 is a lens; 5 is a charge-coupled device (CCD); and 6 is a computer.

[0015] Figure 2 It is the Fourier transform spectrum image of the moving object to be detected extracted by the embodiment of the invention.

[0016] Figure 3It is a high-resolution real-space image of the moving object to be detected reconstructed by an embodiment of the present invention. DETAILED DESCRIPTION

[0017] The technical solution of the present invention is further described below in conjunction with the accompanying drawings and specific embodiments, but the embodiments are not intended to limit the present invention.

[0018] See attached Figure 1 , which is a structural schematic diagram of the intensity correlation-based de-motion blur imaging device provided in this embodiment.

[0019] By the attached Figure 1 It can be seen that the de-motion blur imaging device based on intensity correlation provided in this embodiment includes a laser 1, a phase modulator 2, a moving object to be measured 3, a lens 4, a CCD 5, and a computer 6.

[0020] The light beam emitted by the laser 1 is irradiated on the phase modulator 2, and the time-varying speckle field generated by the phase modulator 2 is irradiated on the moving object 3 to be measured. The light intensity information transmitted by the moving object 3 to be measured is converged on the CCD5 by the lens 4, and the light intensity distribution information after the target is transmitted is recorded by the CCD5 and stored in the computer 6. The phase modulator 2 and CCD5 are synchronously triggered and controlled by a synchronous signal generator to work. The Fourier transform spectrum information of the object is extracted by correlating the light intensity distribution information recorded by the CCD5, and the high-resolution image of the moving object to be measured can be obtained by performing phase recovery and reconstruction on the spectrum information.

[0021] Using the device provided in this embodiment, the imaging method steps are as follows: The first step is to obtain the detection signal of the moving object to be detected The phase modulator 2 and CCD5 are controlled by a synchronous triggering signal generator to work.

[0022] The object 3 to be measured moves both laterally and axially within a certain range, and the lateral movement range of the object must be smaller than the effective aperture of the lens. The light beam emitted by the laser 1 is irradiated on the phase modulator 2, and a time-varying speckle field is generated by the phase modulator 2. After the light field is freely propagated, it is irradiated on the moving object 3 to be measured; then, the lens 4 converges the light intensity information transmitted by the moving object 3 to be measured on the CCD5, and the CCD5 records the light intensity distribution information after the target is transmitted and stores it in the computer 6. For this method, the time-varying random phase loaded by the phase modulator satisfies the uniform distribution. If the phase distribution of the phase modulator is optimized, the number of samples required for high-resolution imaging can be reduced to a certain extent, thereby improving the imaging speed of the system.

[0023] In this embodiment, the object to be measured 3 is a three-slit with a slit width of 200 μm, a slit spacing of 800 μm, and a slit height of 2.5 mm. The lateral movement range is 2 mm, the axial movement range is 8 cm, the distance between the phase modulator 2 and the lens 4 is 400 mm, the diameter of the light beam emitted by the laser 1 is D=3 mm, and the focal length of the lens 4 is 200 mm.

[0024] The second step is to extract the Fourier transform spectrum image of the moving object to be tested Assume that CCD5 collects and records a total of S The instantaneous light intensity picture corresponds to k The instantaneous light intensity picture is recorded as ;in: m and n Respectively represent the horizontal and vertical pixel positions of the recorded image. According to the instantaneous light intensity image obtained, the Fourier transform spectrum image of the moving object to be measured can be obtained through intensity correlation operation processing, that is:

[0025] in: M and N Indicates the total number of horizontal and vertical pixels of the image recorded by CCD5. , is the light intensity distribution of the object to be measured, In this embodiment, CCD5 collects and records S = 20,000 instantaneous light intensity images. The total number of horizontal and vertical pixels recorded by CCD5 is M =61, N =201, the Fourier transform spectrum image of the moving object to be tested is shown in the attached Figure 2 .

[0026] The third step is to reconstruct the high-resolution image of the moving object to be measured. Based on the Fourier transform spectrum image of the moving object to be measured, the real spatial image information can be obtained by reconstructing it through the phase recovery algorithm.

[0027] Usually, GS or HIO phase recovery algorithm can be used for image reconstruction. Taking HIO algorithm as an example, first, the amplitude and phase initial estimation of the moving object to be measured is given. ,in is the initial amplitude distribution, is the initial phase distribution, and its amplitude and phase information are updated through an iterative process. k The iteration process is as follows (where k =1,2,3…): (1) Real-space image Perform Fourier transform to obtain its frequency domain image .

[0028] (2) Keep the original phase information unchanged and use the Fourier transform spectrum image of the moving object to be measured obtained in the second step replace ,Right now: .

[0029] (3) Perform inverse Fourier transform on the replaced frequency domain image to obtain the real space image and calculate it according to the set spatial constraints. Calculate and get the spatial domain image of the next iteration:

[0030] in: It is an adjustable parameter and can be set according to the actual situation. Through multiple iterative operations, a high-resolution real-space image of the moving object to be measured can be reconstructed.

[0031] See attached Figure 3 , is a high-resolution real-space image of the moving object to be detected reconstructed in this embodiment.

[0032] In order to explain the physical mechanism of deblurring in the present invention, the following will explain it from the perspective of the coherence theory of the light field and the physical principle of intensity correlation imaging. According to the coherence theory of the light field, taking the one-dimensional case as an example, the second-order cross-correlation function It can be expressed as formula (1): (1) in: is the first-order cross-correlation function of the light beam emitted by laser 1 after being modulated by phase modulator 2, is the coordinate on the plane of phase modulator 2, is the impulse response function from the phase modulator 2 plane to the CCD5 plane, is the conjugate of the impulse response function, are the coordinates of the CCD5 plane.

[0033] Assuming that the light field generated by the laser beam 1 after random modulation by the phase modulator 2 is uniform and incoherent, the first-order mutual interference function is It can be expressed as formula (2): (2) For the attached Figure 1 For the optical system shown in the figure, under the condition of satisfying the paraxial approximation, the impulse response function from the phase modulator 2 plane to the CCD 5 plane can be expressed as formula (3): (3) in fis the focal length of lens 4, is the transmittance function of the object to be measured, for t The distance from the object to be measured to the plane of phase modulator 2 at the moment, for t The lateral distance from the center of the object to be measured to the optical axis of the detection system at any moment, z is the distance between the plane of the phase modulator 2 and the lens 4, then t The distance from the object to be measured to the lens 4 at the moment is .

[0034] Substituting equations (2) and (3) into equation (1), we get x 1 The integral can be obtained as formula (4): (4) If the spot size of the light beam emitted by laser 1 irradiating phase modulator 2 is large enough, equation (4) can be simplified to equation (5): (5) in Express Perform Fourier transform. x t When '=0, we have formula (6): (6) From equations (5) and (6), we can see that: Figure 1 In the system structure shown, even if the object to be measured has tangential and axial motion, the result obtained by the correlation operation is the same as the case where the object to be measured is in a stationary state, that is, the modulus square of the Fourier transform of the transmittance intensity distribution of the object to be measured. Therefore, the device and method provided by the present invention can obtain a high-resolution real-space image of the moving object to be measured.

Claims

1. Motion blur removal imaging device based on intensity correlation, Features: It comprises a laser (1), a phase modulator (2), a lens (4), a charge coupled device (CCD) (5) and a computer (6); the phase modulator and the charge coupled device (CCD) are controlled by a synchronous triggering signal generator to work, the light beam emitted by the laser is irradiated on the phase modulator, the phase modulator generates a time-varying speckle field to irradiate the moving object to be measured, the light intensity information transmitted by the moving object to be measured is converged on the charge coupled device (CCD) by the lens, the CCD records the light intensity distribution information after the target is transmitted and stores it in the computer, and after intensity correlation operation and image reconstruction processing, a high-resolution real-space image of the moving object to be measured is output.

2. A motion blur removal imaging method based on intensity correlation, Features The following steps are involved: (1) Acquisition of detection signals of moving objects to be detected The phase modulator and CCD are controlled by a synchronous signal generator to work synchronously. The light beam emitted by the laser irradiates the phase modulator, and a time-varying speckle field is generated by the phase modulator. After the light field propagates freely, it irradiates the moving object to be measured. The lens gathers the light intensity information transmitted by the moving object to be measured on the CCD, and the CCD records the light intensity distribution information after the target is transmitted and stores it in the computer. (2) Extraction of Fourier transform spectrum image of the moving object to be measured CCD acquisition and recording S The instantaneous light intensity picture corresponds to k The instantaneous light intensity picture is recorded as ,in: m and n Respectively represent the horizontal and vertical pixel positions of the recorded image; according to the instantaneous light intensity image obtained, the Fourier transform spectrum image of the moving object to be measured is obtained , is the light intensity distribution of the object to be measured, represents Fourier transform, and intensity correlation operation is performed according to formula (1). (1) in: M and N Indicates the total number of horizontal and vertical pixels of the image recorded by the CCD; (3) High-resolution image reconstruction of the moving object to be measured The phase recovery algorithm is used to reconstruct the Fourier transform spectrum image of the moving object to be measured, so as to obtain a high-resolution real-space image of the moving object to be measured.

3. The method for de-motion blurring imaging based on intensity correlation according to claim 2, Features: The moving object to be measured moves both laterally and axially within a certain range, and the lateral movement range of the object is smaller than the effective light aperture of the lens.

4. The method for de-motion blurring imaging based on intensity correlation according to claim 2, Features: The phase modulator is loaded with a time-varying random phase that satisfies a uniform distribution.

5. The method for de-motion blurring imaging based on intensity correlation according to claim 2, Features: Image reconstruction was performed using the GS or HIO phase retrieval algorithm.

Citation Information

Patent Citations

  • Moving target real-time capture single-pixel imaging method and device

    CN114859377A

  • Speckle compensation ghost imaging method and system suitable for transverse movement of target

    CN116482869A

  • Motion deblurring

    US20150042829A1

  • Optical imaging system and method based on random light field spatial structure engineering

    US20230314309A1

  • Motion blur for light-field images

    US9900510B1

Cited By

  • Glass abnormality detection system

    CN119804502A

  • Correlation imaging method based on lightweight network

    CN120599076A