Speckle correlation scattering imaging method based on complex virtual point spread function

Through the speckle-related scattering imaging method based on complex virtual point expansion function, the light intensity transmission equation and phase-type spatial light modulator are used to solve the problem of phase information recovery in scattering media, achieving efficient and high-speed imaging, and improving medical imaging resolution and contrast.

CN119024573APending Publication Date: 2024-11-26HARBIN UNIV OF SCI & TECH
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202411378756.X
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-09-29
Publication Date
2024-11-26

AI Technical Summary

Technical Problem

Existing scattering imaging techniques are difficult to effectively restore phase information in highly scattered media, resulting in reduced imaging quality, especially in medical imaging, and difficult to clearly display lesion tissue. Existing methods such as iterative algorithms and Fourier transform methods are complex in calculations and noise-sensitive. , Deep learning methods rely on a large amount of data and complex parameter adjustment.

Method used

The speckle-related scattering imaging method based on complex virtual point expansion function is adopted, and the phase information of the scattering medium is solved through the light intensity transmission equation, and phase modulation is performed using a phase-type spatial light modulator to realize complex virtual point expansion function and object speckle complex Cross-correlation imaging of amplitudes avoids iterative processes and improves speed and accuracy.

Benefits of technology

It realizes high-efficiency, high-speed and high-precision imaging in scattering media, improves the resolution and contrast of scattering imaging, simplifies the phase recovery process, and is suitable for medical imaging and other fields.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119024573A_ABST
    Figure CN119024573A_ABST
Patent Text Reader

Abstract

The invention relates to a speckle correlation scattering imaging method based on a complex virtual point spread function, and belongs to the field of computational optical imaging. The method comprises the following steps: S1, recording an intensity diagram of speckles penetrating through a scattering medium to solve the phase of the scattering medium; s2, loading the phase of a scattering medium on the phase-type spatial light modulator; s3, recording a speckle intensity graph of the virtual point spread function of the ideal object point to solve the phase of the speckle intensity graph; s4, recording the speckle intensity diagram of the object to solve the phase of the object; and S5, performing cross-correlation imaging on the complex virtual point spread function and the object speckle complex amplitude. Most existing scattering imaging phase recovery technologies are high in calculation cost and low in speed. The scattering medium phase information of the speckle pattern is solved by using the light intensity transmission equation, phase modulation is performed through the phase type spatial light modulator, the complex virtual point spread function and the object speckle complex amplitude are subjected to cross-correlation imaging, and the method has the advantages of high speed and high precision.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The invention relates to the field of scattering medium optical imaging, belongs to the field of computational optical imaging, and in particular to a speckle correlation scattering imaging method based on a complex virtual point spread function. Background Art

[0002] Scattering imaging is a technology that analyzes the scattering phenomenon of light during its propagation in a medium to perform imaging. In different media, the propagation of light will be affected by the inhomogeneity of the medium, resulting in a variety of complex scattering phenomena such as Rayleigh scattering, Mie scattering, and inelastic scattering. These scattering processes pose a huge challenge to traditional imaging techniques, especially in highly scattering media such as biological tissues or haze environments, where the imaging quality is often significantly reduced. Therefore, in scattering imaging, phase information is crucial for reconstructing high-quality images. However, since phase information is easily lost or becomes complicated during the scattering process, direct measurement becomes extremely difficult, and the phase recovery problem is particularly critical.

[0003] Phase recovery algorithms can effectively improve the resolution and contrast of scatter imaging, thereby improving the overall quality of the image. This is particularly important in medical imaging. For example, in breast imaging and brain imaging, diseased tissue can be displayed more clearly, which is helpful for early diagnosis and treatment. The existing scatter imaging phase recovery technologies mainly include iterative algorithms, Fourier transform optical methods, and deep learning-based technologies. Iterative algorithms, such as the Gerchberg-Saxton algorithm and the Fienup algorithm, gradually approach the real image by repeatedly updating the phase and amplitude information, but such methods usually require a lot of calculations and are prone to fall into local optimal solutions. The Fourier transform optical method uses the diffraction and interference principles of light to obtain phase information through Fourier transform, but it has strict requirements on experimental conditions and is highly sensitive to noise. In recent years, methods based on deep learning have gradually emerged. By training neural networks to learn the laws of phase recovery from a large amount of data, this method has strong generalization ability and computational efficiency, but it relies on a large amount of high-quality training data, and the network training process is complex and parameter adjustment is difficult.

[0004] In view of the above problems, the present invention proposes a speckle correlation scattering imaging method based on complex virtual point spread function, which realizes imaging through scattering media. The system uses the light intensity transmission equation technology to solve the speckle pattern and then restore the phase information of the scattering medium. Phase modulation is performed through the phase spatial light modulator PSLM (Phase Spatial Light Modulator), and the complex amplitude of the solved system virtual point spread function VPSF (Virtual Point Spread Function) is cross-correlated with the complex amplitude of the object speckle to form an image. This method does not require iteration and has the advantages of fast speed and high accuracy. Summary of the invention

[0005] The purpose of the present invention is to propose a speckle correlation scattering imaging method based on a complex virtual point spread function to achieve high-efficiency and high-precision imaging through a scattering medium.

[0006] The method comprises the following five steps: S1, recording the speckle intensity map transmitted through the scattering medium to solve the phase of the scattering medium; S2, loading the phase of the scattering medium on the phase-type spatial light modulator PSLM; S3, recording the speckle intensity map of the ideal object point virtual point spread function VPSF to solve its phase; S4, recording the speckle intensity map of the object to solve its phase; S5, cross-correlating the complex virtual point spread function CVPSF (Complex Virtual Point Spread Function) with the complex amplitude of the object speckle to form an image.

[0007] For the convenience of representation, the abbreviation of optical element is given: beam splitter BS (Beam Splitter).

[0008] A speckle correlation scattering imaging method based on a complex virtual point spread function, wherein the specific optical system comprises: a laser (1), an attenuation plate (2), a microscope objective lens (3), a pinhole (4), a first convex lens (5), a second convex lens (6), a BS (7), an imaging object (8), a PSLM (9), a third convex lens (10), a scattering medium (11), a fourth convex lens (12) and an image sensor (13).

[0010] S1: Record the speckle intensity map through the scattering medium to solve the phase of the scattering medium;

[0011] The pixel coordinates of any point on any plane perpendicular to the propagation direction of the light beam are defined as (x, y).

[0012] First, the imaging object is removed from the optical path. The laser (1) emits a light beam, which is adjusted in intensity by an attenuation plate (2). The light beam is then filtered by a microscope objective lens (3) and a pinhole (4). The light beam is transformed into an expanded parallel light beam after passing through a first convex lens (5) and a second convex lens (6). The parallel light beam is divided into a transmitted light beam and a reflected light beam by passing through a BS (7). The transmitted light beam of the BS (7) is reflected on a PSLM (9). The reflected light beam is split by passing through the BS (7). The split reflected light beam passes through a third convex lens (1 0) is focused onto a scattering medium (11), light scattered by the scattering medium is incident on an image sensor (13) via a fourth convex lens (12), the third convex lens (10) and the fourth convex lens (12) form a 4f system, the image sensor (13) records a focused speckle intensity map I(x, y, z) at a focused position, and records a defocused speckle intensity map I(x, y, z+Δz) at a defocused position Δz, where z is an axial coordinate parallel to the propagation direction of the light beam at the image focused position, and Δz is a defocused distance.

[0013] The light intensity transmission equation is as follows: Where I(x,y,z) is the intensity distribution at the focal plane, is the phase distribution at the focal plane, is the derivative of the intensity map on the z-axis, is the gradient operator.

[0014] It can be expressed as follows using the differential approximation of two slightly defocused adjacent intensity distributions: Given the intensity distribution I(x, y, z) at the focal plane, the phase φ of the scattering medium (11) is solved by the light intensity transmission equation.

[0015] S2: Loading the phase of the scattering medium on the phase-type spatial light modulator PSLM;

[0016] The phase φ of the scattering medium (11) solved in S1 above is loaded onto the PLSM (9).

[0017] S3: Record the speckle intensity map of the ideal object point virtual point spread function VPSF to solve its phase;

[0018] Assume that the ideal object point is located at the axial position z in front of PSLM (9) m At , load the wavefront S(x,y,z m ), after phase modulation by PLSM (9), the focused VPSF speckle intensity images I are collected at the axial distance z and z+Δz respectively. VPSF(x,y,z) and defocused VPSF speckle intensity map I VPSF (x,y,z+Δz).

[0019] Calculated Solving the phase φ of VPSF by using the light intensity transmission equation VPSF .

[0020] S4: Record the object’s speckle intensity map to solve its phase;

[0021] Place the imaging object in the optical path at an axial position z in front of the PSLM (9). m At , only the phase φ of the scattering medium (11) solved in S2 is loaded on PLSM (9), and the object focused speckle intensity map I is collected at the axial distance z and z+Δz respectively. O (x, y, z) and the object defocused speckle intensity map I O (x,y,z+Δz).

[0022] Calculated Solving the object speckle phase φ by using the light intensity transmission equation O .

[0023] S5: cross-correlation imaging of the complex virtual point spread function CVPSF and the complex amplitude of the object speckle;

[0024] It is known that the speckle intensity map I collected at the focal plane VPSF (x,y,z) and I O (x,y,z), get the VPSF amplitude A from the intensity map VPSF and the object speckle amplitude A O , and finally get the complex virtual point spread function U VPSF (x, y) and the complex amplitude of the object speckle U O (x,y), as shown below: U VPSF (x,y)=A VPSF ·exp(iφ VPSF ) U O (x,y)=A O ·exp(iφ O )

[0025] During the imaging process, the expression of CVPSF is obtained as follows: where φ is the phase of the scattering medium (11), S(x, y) is the complex amplitude of the ideal object point, and Q(a) = exp[iπaλ -1 (x 2 +y 2)], d1 is the distance from the laser (1) to the PSLM (9), d2 is the distance from the PSLM (9) to the image sensor (13), and “*” indicates a convolution operation.

[0026] The complex amplitude of the object speckle is expressed as: Where E(x,y) is the complex amplitude of the object.

[0027] The complex virtual point spread function U is transformed into VPSF (x,y) and the complex amplitude U of the object speckle O (x, y) for cross-correlation imaging, object intensity I E (x,y) is as follows: in, U E (x,y) is the complex amplitude of the cross-correlation imaging, represents the cross-correlation operation, and δ represents the Dirac function. BRIEF DESCRIPTION OF THE DRAWINGS

[0028] Figure 1 A system schematic diagram of a speckle correlation scattering imaging method based on complex virtual point spread function.

[0029] Figure 2 A flow chart for implementing a speckle correlation scattering imaging method based on complex virtual point spread function.

[0030] Figure 3 Speckle intensity images of scattering media: (a) focused speckle intensity image, (b) defocused speckle intensity image.

[0031] Figure 4 Phase diagram of scattering media.

[0032] Figure 5 Complex amplitude results: (a) CVPSF, (b) complex amplitude of object speckle.

[0033] Figure 6 Cross-correlation imaging intensity map of the object.

[0034] Description of reference numerals:

[0035] 1. Laser, 2. Attenuation plate, 3. Microscope objective, 4. Pinhole, 5. First convex lens, 6. Second convex lens, 7. BS, 8. Imaging object, 9. PSLM, 10. Third convex lens, 11. Scattering medium, 12. Fourth convex lens, 13. Image sensor. DETAILED DESCRIPTION

[0036] In order to better explain the implementation process of the present invention, the present invention will be further described in detail with reference to an embodiment below, but the present invention is not limited to this embodiment.

[0037] Example

[0038] The pixel coordinates of any point on any plane perpendicular to the propagation direction of the light beam are defined as (x, y).

[0039] like Figure 1 As shown, the imaging object is first removed from the optical path, the laser (1) emits a light beam, the light intensity is adjusted by the attenuation plate (2), and then filtered by the microscope objective lens (3) and the 25μm pinhole (4). The light beam is transformed into an expanded parallel light beam after passing through the first convex lens (5) and the second convex lens (6). The focal length of the first convex lens (5) is f1, the focal length of the second convex lens (6) is f2, and the distance between the two lenses is f1+f2. The parallel light beam is divided into a transmission light beam and a reflection light beam through BS (7), the transmission light beam of BS (7) is reflected on PSLM (9), and the reflection light beam is split through BS (7), wherein the split reflected light is focused to the scattering medium (11) through the third convex lens (10), and the light scattered by the scattering medium is incident to the image sensor (13) through the fourth convex lens (12), the third convex lens (10) and the fourth convex lens (12) form a 4f system, the distance between them is f3+f4, the focal length of the third convex lens (10) is f3, and the focal length of the fourth convex lens (12) is f4. The image sensor (13) records the focus speckle intensity map I (x, y, z) at the focus position as shown in Figure 3 As shown in (a), the defocused speckle intensity map I(x, y, z+Δz) is recorded at the defocused position Δz. Figure 3 As shown in (b), z is the axial coordinate parallel to the beam propagation direction at the image focusing position, and Δz is the defocus distance.

[0040] The light intensity transmission equation is as follows: Where I(x,y,z) is the intensity distribution at the focal plane, is the phase distribution at the focal plane, is the derivative of the intensity map on the z-axis, is the gradient operator.

[0041] It can be expressed as follows using the differential approximation of two slightly defocused adjacent intensity distributions: Given the intensity distribution at the focal plane, the phase φ of the scattering medium (11) can be solved by the light intensity transmission equation, as Figure 4 shown.

[0042] The phase φ of the scattering medium (11) solved above is loaded onto the PLSM (9), assuming that the ideal point light source is located at an axial position z in front of the PSLM (9). m At , load the wavefront S(x,y,z m ), after phase modulation by PLSM (9), the focused VPSF speckle intensity images I are collected at the axial distance z and z+Δz respectively. VPSF (x,y,z) and defocused VPSF speckle intensity map I VPSF (x,y,z+Δz).

[0043] Place the imaging object in the optical path at an axial position z in front of the PSLM (9). m At , only the phase φ of the scattering medium (11) solved in S2 is loaded on PLSM (9), and the object focused speckle intensity map I is collected at the axial distance z and z+Δz respectively. O (x, y, z) and the object defocused speckle intensity map I O (x,y,z+Δz).

[0044] Calculated as well as Then, the VPSF phase φ is solved by the light intensity transmission equation. VPSF and the object speckle phase φ O , it is known that the speckle intensity map I collected at the focal plane VPSF (x,y,z) and I O (x,y,z), get the VPSF amplitude A from the intensity map VPSF and the object speckle amplitude A O , and finally get the complex virtual point spread function U VPSF (x,y) Figure 5 (a) shows the complex amplitude U of the object speckle O (x,y), such as Figure 5 (b) as shown: U VPSF (x,y)=A VPSF ·exp(iφ VPSF ) U O (x,y)=A O ·exp(iφ O )

[0045] During the imaging process, the CVPSF is expressed as: where φ is the phase of the scattering medium (11), S(x, y) is the complex amplitude of the ideal object point, and Q(a) = exp[iπaλ-1 (x 2 +y 2 )], d1 is the distance from the laser (1) to the PSLM (9), d2 is the distance from the PSLM (9) to the image sensor (13), and “*” indicates a convolution operation.

[0046] The complex amplitude of the object speckle is expressed as: Where E(x,y) is the complex amplitude of the object.

[0047] The complex virtual point spread function U is transformed into VPSF (x,y) and the complex amplitude U of the object speckle O (x,y) for cross-correlation imaging, intensity I E (x,y) Figure 6 As shown: in, U E (x,y) is the complex amplitude of the cross-correlation imaging, represents the cross-correlation operation, and δ represents the Dirac function.

[0048] The above description is only a preferred implementation example of the present invention and does not represent the protection scope of the present invention. Any modifications, equivalent substitutions, improvements, etc. made within the principles of the present invention are included in the protection scope of the present invention.

Claims

1. A speckle correlation scattering imaging method based on complex virtual point spread function, characterized in that: The method is specifically implemented by a device comprising a laser, an attenuation plate, a microscope objective lens, a pinhole, a first convex lens, a second convex lens, a beam splitter BS (BeamSplitter), an imaging object, a phase spatial light modulator PSLM (Phase Spatial Light Modulator), a third convex lens, a scattering medium, a fourth convex lens and an image sensor; The method comprises the following five steps: S1, record the speckle intensity map transmitted through the scattering medium to solve the phase of the scattering medium: the pixel coordinates of any point on any plane perpendicular to the propagation direction of the light beam are defined as (x, y); the imaging object is removed from the optical path, the attenuation plate adjusts the light intensity of the light beam emitted by the laser, the microscope objective and the pinhole filter the laser, and the first convex lens and the second convex lens convert the laser into a beam-expanded parallel beam; the parallel beam is divided into a transmitted beam and a reflected beam by the BS, the PLSM reflects the transmitted beam, the reflected beam is split through the BS, the third convex lens focuses the split reflected light onto the scattering medium, and forms a 4f system with the fourth convex lens, and the image sensor records the focused speckle intensity map I(x, y, z) at the focused position, and records the defocused speckle intensity map I(x, y, z+Δz) at the defocused position Δz, where z is the axial coordinate parallel to the propagation direction of the light beam at the image focused position, and Δz is the defocus distance; The light intensity transmission equation is as follows: Where I(x,y,z) is the intensity distribution at the focal plane, is the phase distribution at the focal plane, is the derivative of the intensity map on the z-axis, is the gradient operator; It can be expressed as follows using the differential approximation of two slightly defocused adjacent intensity distributions: The intensity distribution I(x, y, z) at the focal plane is known, and the phase φ of the scattering medium is solved by the light intensity transmission equation; S2, loading the phase of the scattering medium on the phase-type spatial light modulator PSLM: loading the scattering medium phase φ solved in the above S2 onto the PLSM; S3, record the speckle intensity diagram of the virtual point spread function VPSF (Virtual Point Spread Function) of the ideal object point to solve its phase: Assume that the ideal point light source is located at a distance of z from the front axial position of the PSLM m At the PLSM, a wavefront S(x, y, z m ), after the PLSM phase modulation, the focused VPSF speckle intensity image I is collected at the axial distance z and z+Δz respectively. VPSF (x,y,z) and defocused VPSF speckle intensity map I VPSF (x,y,z+Δz); Calculated Solving the VPSF phase φ by using the light intensity transmission equation VPSF ; S4, record the speckle intensity map of the object to solve its phase: put the imaging object into the optical path at an axial position z from the front of the PSLM m At , only the scattering medium phase φ solved in S2 is loaded on the PLSM, and the object focused speckle intensity image I is collected at the axial distance z and z+Δz respectively. O (x, y, z) and the object defocused speckle intensity map I O (x,y,z+Δz); Calculated Solving the object speckle phase φ by using the light intensity transmission equation O ; S5, cross-correlate the complex virtual point spread function CVPSF with the complex amplitude of the object speckle to form an image: It is known that the speckle intensity image I collected at the focal plane VPSF (x,y,z) and I O (x,y,z), get the VPSF amplitude A from the intensity map VPSF and the object speckle amplitude A O , and finally get the complex virtual point spread function U VPSF (x, y) and the complex amplitude of the object speckle U O (x,y), as shown below: U VPSF (x,y)=A VPSF ·exp(iφ VPSF ) U O (x,y)=A O ·exp(iφ O ) During the imaging process, the CVPSF is expressed as: Where φ is the phase of the scattering medium, S(x,y) is the complex amplitude of the ideal object point, Q(a) = exp[iπaλ -1 (x 2 +y 2 )], d1 is the distance from the laser to the PSLM, d2 is the distance from the PSLM to the image sensor, and "*" represents a convolution operation; The complex amplitude of the object speckle is expressed as: Where E(x,y) is the complex amplitude of the object; The complex virtual point spread function U is transformed into VPSF (x,y) and the complex amplitude U of the object speckle O (x,y) for cross-correlation imaging, intensity I E (x,y) is as follows: in, U E (x,y) is the complex amplitude of the cross-correlation imaging, represents the cross-correlation operation, and δ represents the Dirac function.