Transmitting scattering medium imaging method based on vector transmission matrix and cross-correlation reconstruction
By using vector transmission matrix and cross-correlation reconstruction technology in complex scattering media environments, the problem of distortion of imaging results is solved and more accurate imaging effects are achieved.
Patent Information
- Application Number
- CN202411061267.1
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-08-03
- Publication Date
- 2024-11-12
AI Technical Summary
In complex scattering media environments, traditional imaging techniques are difficult to achieve accurate imaging results, resulting in large distortion of imaging results.
Using a method based on vector transmission matrix and cross-correlation reconstruction, the focus light field and imaging light field are recorded by measuring the vector transmission matrix, and image reconstruction is carried out using cross-correlation algorithm to obtain more accurate imaging results.
This method can more accurately reconstruct the imaging results, reduce imaging distortion caused by scattering media, and improve imaging quality.
Smart Images

Figure CN118945482A_ABST
Abstract
Description
Technical Field
[0001] The invention relates to the field of scattering medium optical imaging, belongs to the field of computational optical imaging, and in particular to a method for imaging through scattering media based on vector transfer matrix and cross-correlation reconstruction. Background Art
[0002] Scattering media are widely present in nature, such as the atmosphere, water, biological tissues, etc. When light waves pass through these media, they are scattered due to the microscopic inhomogeneity of the media, causing the propagation direction of the light waves to change. This scattering phenomenon poses a challenge to traditional imaging technology because scattering can cause light wavefront distortion and image distortion. Therefore, it is very meaningful to image objects behind scattering media.
[0003] In order to image objects through scattering media, researchers have proposed the transmission matrix TM (Transmission Matrix) technology, which is a wavefront shaping scattering imaging technology; the basic idea of TM is to represent the relationship between the incident light field and the outgoing light field with a matrix. The incident light field is represented by a vector, and the outgoing light field is also represented by a vector, then TM is the matrix connecting these two vectors. Once this matrix is obtained, the outgoing light field can be indirectly controlled by controlling the incident light field, thereby achieving imaging or other light manipulation purposes. At the same time, since TM only needs to be measured once to achieve the modulation of multiple different light fields, it has broad application prospects. Studies have found that the scattering effect of complex media on light is not only reflected in the disturbance of amplitude and phase, but also in the disturbance of its polarization information. Therefore, TM has been widely studied on amplitude, phase and polarization disturbances.
[0004] Since the real scattering environment is very complex, it is still challenging to achieve accurate imaging results. To this end, the present invention proposes a method for imaging through scattering media based on vector transfer matrix and cross-correlation reconstruction. After wavefront correction is performed by TM to obtain the focused light field and the imaging light field, the complex amplitude of the focused light field and the complex amplitude of the imaging light field are cross-correlated and reconstructed using a cross-correlation algorithm, thereby obtaining a more accurate imaging result. Summary of the invention
[0005] The purpose of the present invention is to propose a method for imaging through scattering media based on vector transfer matrix and cross-correlation reconstruction, so as to solve the problem of large distortion of imaging results caused by complex scattering imaging environment.
[0006] The method comprises the following three steps: S1, measuring a vector transmission matrix VTM (Vector Transmission Matrix); S2, recording a focused light field and an imaging light field respectively; and S3, reconstructing an image by cross-correlation.
[0007] The horizontal direction of the cross section perpendicular to the beam propagation direction is defined as 0°, and the counterclockwise direction is the positive direction.
[0008] For the convenience of representation, the abbreviations of optical components are given as follows: beam splitter BS (Beam Splitter); polarizing beam splitter PBS (Polarizing Beam Splitter); phase spatial light modulator PSLM (Phase Spatial Light Modulator).
[0009] A method for imaging through a scattering medium based on vector transfer matrix and cross-correlation reconstruction, wherein the specific optical system comprises: a laser (1), an attenuation plate (2), a microscope objective lens (3), a pinhole (4), a first convex lens (5), a second convex lens (6), a BS (7), a PBS (8), a 1 / 2 wave plate (9), a first PSLM (10), a second PSLM (11), a third convex lens (12), a scattering medium (13), a fourth convex lens (14), a polarizing plate (15) and an image sensor (16).
[0010] S1: measurement vector transfer matrix VTM;
[0011] A laser (1) emits a light beam with a linear polarization degree of 45°, the light intensity of which is adjusted by an attenuation plate (2), and then filtered by a microscope objective lens (3) and a pinhole (4). The light beam passes through a first convex lens (5) and a second convex lens (6) to become an expanded parallel light beam, and the parallel light beam passes through a BS (7) to be divided into a transmitted light beam and a reflected light beam. The transmitted light beam of the BS (7) is divided into horizontal linear polarized light and vertical linear polarized light by a PBS (8), wherein the transmitted light beam of the PBS (8) is horizontal linear polarized light, and the reflected light beam of the PBS (8) is vertical linear polarized light.
[0012] The horizontal linear polarized light transmitted by the PBS (8) is adjusted to vertical linear polarized light by using a half wave plate (9) and aligned with the modulation polarization axis of the first PSLM (10). The modulation polarization axis of the second PSLM (11) is aligned with the vertical linear polarized light reflected by the PBS (8). The second PSLM (11) is first blocked, and a Hadamard basis is loaded on the first PSLM (10) and four different phase values of 0, π / 2, π and 3π / 2 are loaded in sequence. The reflected light of the first PSLM (10) is converted into horizontal polarized light after passing through the half wave plate (9), transmitted through the PBS (8), and then split by the BS (7). The split reflected light is focused onto a scattering medium (13) through a third convex lens (12). The third convex lens (12) and the fourth convex lens (14) form a 4f system. The polarizer (15) analyzes the light beam. The image sensor (16) collects the speckle intensity images corresponding to the four different phase values in sequence, which are respectively recorded as and Where n represents the nth output mode.
[0013] The phase shift calculation of the four speckle intensity images is performed to obtain the transmission matrix in the horizontal polarization direction, as shown below: Wherein, H represents the horizontal polarization direction.
[0014] Similarly, the first PSLM (10) is blocked, and the Hadamard basis is loaded on the first PSLM (11) and four different phase values of 0, π / 2, π and 3π / 2 are loaded in sequence. The image sensor (16) collects the speckle intensity images corresponding to the four different phase values in sequence, and the transmission matrix S in the vertical polarization direction is obtained by phase shift calculation. V , V represents the vertical polarization direction, and finally VTM is obtained.
[0015] S2: Record the focused light field and the imaging light field respectively;
[0016] The pixel coordinates of any point on any plane perpendicular to the propagation direction of the light beam are defined as (x, y).
[0017] A laser (1) emits a light beam with a linear polarization degree of 45°, the light intensity of which is adjusted by an attenuation plate (2), and then filtered by a microscope objective lens (3) and a pinhole (4). The light beam passes through a first convex lens (5) and a second convex lens (6) to become an expanded parallel light beam, and the parallel light beam passes through a BS (7) to be divided into a transmitted light beam and a reflected light beam. The transmitted light beam of the BS (7) is divided into horizontal linear polarized light and vertical linear polarized light by a PBS (8), wherein the transmitted light beam of the PBS (8) is horizontal linear polarized light, and the reflected light beam of the PBS (8) is vertical linear polarized light.
[0018] A 1 / 2 wave plate (9) is used to adjust the horizontal linear polarized light transmitted by the PBS (8) into vertical linear polarized light, which is aligned with the modulation polarization axis of the first PSLM (10). The modulation polarization axis of the second PSLM (11) is aligned with the vertical linear polarized light reflected by the PBS (8). The horizontal transmission matrix S is loaded on the first PSLM (10) and the second PSLM (11) respectively. H With the vertical transfer matrix S V The two light beams are reflected by the first PSLM (10) and the second PSLM (11) in sequence, and then the horizontal polarized light and the vertical polarized light are combined by the PBS (8). The combined light is split by the BS (7). The split reflected light is focused onto the scattering medium (13) by the third convex lens (12). The third convex lens (12) and the fourth convex lens (14) form a 4f system. The polarizer (15) analyzes the light beams. The image sensor (16) collects the intensity diagram of the focused light field and the imaging light field of the letter E in sequence. The complex amplitudes of the two light fields are obtained by the intensity transmission equation. as well as Where S is VTM, is the transpose conjugate operation, is the phase of the transposed conjugate of the VTM, φ M is the phase of the scattering medium, is the complex amplitude of the ideal object point, is the complex amplitude of the ideal letter E, Q(a) = exp[iπaλ -1 (x 2 +y 2 )],d 1 is the distance from the ideal object point or the ideal letter E to the PSLM, d 2 is the distance from PSLM to the image sensor, and “*” indicates the convolution operation.
[0019] S3: cross-correlation reconstructed image;
[0020] The complex amplitude of the focused light field is obtained by using the cross-correlation algorithm The complex amplitude of the imaging light field with the letter E Perform cross-correlation reconstruction to obtain accurate imaging results I X (x,y): in, “*” indicates convolution operation. represents the correlation operation, and δ represents the Dirac function. BRIEF DESCRIPTION OF THE DRAWINGS
[0021] Figure 1 System diagram of a method for imaging through scattering media based on vector transfer matrix and cross-correlation reconstruction.
[0022] Figure 2 A flowchart for implementing a method for imaging through scattering media based on vector transfer matrix and cross-correlation reconstruction.
[0023] Figure 3 Measuring VTM results:
[0024] Figure 4 Complex amplitude recording results: (a) complex amplitude of the focused light field, (b) complex amplitude of the imaging light field of the letter E.
[0025] Figure 5 Comparison of reconstruction intensity results: (a) imaging light field of the letter E, (b) cross-correlation reconstruction result.
[0026] Description of reference numerals:
[0027] 1. Laser, 2. Attenuation plate, 3. Microscope objective, 4. Pinhole, 5. First convex lens, 6. Second convex lens, 7. BS, 8. PBS, 9. 1 / 2 wave plate, 10. First PSLM, 11. Second PSLM, 12. Third convex lens, 13. Scattering medium, 14. Fourth convex lens, 15. Polarizer, 16. Image sensor. DETAILED DESCRIPTION
[0028] In order to better explain the implementation process of the present invention, the present invention will be further described in detail with reference to an embodiment below, but the present invention is not limited to this embodiment.
[0029] Example
[0030] like Figure 1 As shown, the laser (1) emits a beam with a linear polarization degree of 45°, the light intensity is adjusted by the attenuation plate (2), and then filtered by the microscope objective lens (3) and the 25μm pinhole (4). The beam becomes a beam of expanded parallel light after passing through the first convex lens (5) and the second convex lens (6). The focal length of the first convex lens (5) is f 1 , the focal length of the second convex lens (6) is f 2 , the distance between the two lenses is f 1 +f 2 The parallel light beam is divided into a transmitted light beam and a reflected light beam through BS (7), and the transmitted light beam of BS (7) is divided into horizontal linear polarized light and vertical linear polarized light through PBS (8). The angle of the 1 / 2 wave plate (9) is set to 45°, and the transmitted horizontal linear polarized light is adjusted to vertical linear polarized light through the 1 / 2 wave plate (9), and is aligned with the modulation polarization axis of the first PSLM (10), and the modulation polarization axis of the second PSLM (11) is aligned with the vertical linear polarized light reflected by PBS (8). A Hadamard basis is loaded in a first PSLM (10) and a second PSLM (11) respectively, and four different phase values are loaded in sequence respectively. The two light beams are reflected by the first PSLM (10) and the second PSLM (11) respectively. The second PSLM (11) is first blocked. The reflected light of the first PSLM (10) is converted into horizontally polarized light after passing through a 1 / 2 wave plate (9). The reflected light is transmitted through a PBS (8) and then split through a BS (7). The split reflected light is focused onto a scattering medium (13) through a third convex lens (12). The third convex lens (12) and the fourth convex lens (14) form a 4f system, and the distance between them is f. 3 +f 4 , the focal length of the third convex lens is f 3 , the focal length of the fourth convex lens is f 4 The polarizer (15) analyzes the light beam, and the image sensor (16) sequentially collects the speckle intensity images corresponding to four different phase values. and Where n represents the nth output mode.
[0031] The phase shift calculation of the four speckle intensity images is performed to obtain the transmission matrix in the horizontal polarization direction, as shown below: Wherein, H represents the horizontal polarization direction. Similarly, the first PSLM (10) is blocked, and the Hadamard basis is loaded on the first PSLM (11) and four different phase values of 0, π / 2, π and 3π / 2 are loaded in sequence. The image sensor (16) collects the speckle intensity images of the four different phase values in sequence, and the transmission matrix S in the vertical polarization direction is obtained by phase shift calculation. V , V represents the vertical polarization direction, and finally VTM is obtained. like Figure 3 As shown in (a), like Figure 3 (b) It is a transposed conjugate operation, where the diagonal solid line is basically continuous and presents a strong diagonal pattern, which indicates that the measured TM has a high accuracy.
[0032] The pixel coordinates of any point on any plane perpendicular to the propagation direction of the light beam are defined as (x, y).
[0033] Reload S in the first PSLM (10) and the second PSLM (11) respectively. H With S V The two light beams are reflected by the first PSLM (10) and the second PSLM (11) respectively, and then the horizontal polarized light and the vertical polarized light are combined by the PBS (8). The combined light is split by the BS (7), and the split reflected light is focused to the scattering medium (13) by the third convex lens (12). The third convex lens (12) and the fourth convex lens (14) form a 4f system, and the distance between them is f. 3 +f 4 , the focal length of the third convex lens is f 3 , the focal length of the fourth convex lens is f 4 The polarizer (15) analyzes the light beam, and the focused light field and the imaging light field are collected in sequence by the image sensor (16). The intensity transmission equation is used to obtain: Figure 4 (a) shows the complex amplitude of the focused light field like Figure 4 (b) The complex amplitude of the imaging light field of letter E shown Where S is VTM, is the transpose conjugate operation, is the phase of the transposed conjugate of the VTM, φ M is the phase of the scattering medium, is the complex amplitude of the ideal object point, is the complex amplitude of the ideal letter E, Q(a) = exp[iπaλ -1 (x 2 +y 2 )],d 1 is the distance from the ideal object point or the ideal letter E to the PSLM, d 2 is the distance from PSLM to the image sensor, and “*” indicates the convolution operation.
[0034] The complex amplitude of the focused light field is obtained by using the cross-correlation algorithm The complex amplitude of the imaging light field with the letter E Cross-correlation reconstruction is performed, where the imaging light field intensity of the letter E is as follows: Figure 5 As shown in (a), the reconstruction is obtained as Figure 5 (b) The precise imaging result I X (x,y): in, represents the correlation operation, and δ represents the Dirac function.
[0035] The above description is only a preferred implementation example of the present invention and does not represent the protection scope of the present invention. Any modifications, equivalent substitutions, improvements, etc. made within the principles of the present invention are included in the protection scope of the present invention.
Claims
1. A method for imaging through scattering media based on vector transfer matrix and cross-correlation reconstruction, characterized in that: The method is specifically implemented by a device comprising a laser, an attenuation plate, a microscope objective lens, a pinhole, a first convex lens, a second convex lens, a beam splitter BS (Beam Splitter), a polarizing beam splitter PBS (Polarizing Beam Splitter), a 1 / 2 wave plate, a first phase spatial light modulator PSLM (Phase Spatial Light Modulator), a second PSLM, a third convex lens, a scattering medium, a fourth convex lens, a polarizer and an image sensor; Define the horizontal direction of the section perpendicular to the propagation direction of the light path as 0°, and the counterclockwise direction as the positive direction; The method comprises the following three steps: S1, measure the vector transmission matrix VTM (Vector Transmission Matrix): use the Hadamard basis and the four-step phase shift method to measure the VTM elements, the elements of the Hadamard basis are 1 or -1; the attenuation plate adjusts the light intensity of the linear polarization beam with a degree of 45° emitted by the laser, the microscope objective and the pinhole filter the laser, the first convex lens and the second convex lens convert the laser into an expanded parallel beam; the parallel beam is divided into a transmitted beam and a reflected beam by the BS, and the PBS divides one of the transmitted beams into a transmitted horizontal linear polarized light and a reflected vertical linear polarized light; the 1 / 2 wave plate adjusts the transmitted horizontal linear polarized light to a vertical linear polarized light, which is aligned with the modulation polarization axis of the first PSLM; the The modulation polarization axis of the second PSLM is aligned with the vertical linear polarized light reflected by the PBS; the Hadamard basis is loaded on the first PSLM and the second PSLM, and four different phase values of 0, π / 2, π and 3π / 2 are loaded in sequence respectively; the first PSLM and the second PSLM respectively reflect two beams of light, wherein the second PSLM is first blocked, the reflected light of the first PSLM is transmitted through the PBS, and then split by the BS, the third convex lens focuses the split reflected light onto the scattering medium, and forms a 4f system with the fourth convex lens, and then the polarizer is used for polarization analysis, and the image sensor collects four speckle intensity maps with different phase values, which are respectively recorded as and Where n represents the nth output mode. Then the phase shift of the four speckle intensity images is calculated to obtain the transmission matrix in the horizontal polarization direction: Where H represents the horizontal polarization direction; Similarly, the first PSLM is blocked again, and the Hadamard basis is loaded on the first PSLM and four different phase values of 0, π / 2, π and 3π / 2 are loaded in sequence. The image sensor collects the speckle intensity images of the four different phase values in sequence, and the transmission matrix S in the vertical polarization direction is obtained by phase shift calculation. V , V represents the vertical polarization direction, and finally VTM is obtained; S2, respectively records the focused light field and the imaged light field: the pixel coordinates of any point on any plane perpendicular to the propagation direction of the light beam are defined as (x, y); the attenuation plate adjusts the light intensity emitted by the laser, the microscope objective and the pinhole filter the laser, and the first convex lens and the second convex lens convert the laser into a beam-expanded parallel light beam; the parallel light beam is divided into a transmitted light beam and a reflected light beam by the BS, and the PBS divides one of the transmitted light beams into a transmitted horizontal linear polarized light and a reflected vertical linear polarized light; the 1 / 2 wave plate adjusts the transmitted horizontal linear polarized light to a vertical linear polarized light, which is aligned with the modulation polarization axis of the first PSLM; the modulation polarization axis of the second PSLM is aligned with the vertical linear polarized light reflected by the PBS; S is loaded in the first PSLM and the second PSLM respectively. H With S V , the first PSLM and the second PSLM respectively reflect two beams of light, and then the horizontal polarized light and the vertical polarized light are combined by the PBS; the combined light is split by the BS, and the third convex lens focuses the split reflected light onto the scattering medium, and forms a 4f system with the fourth convex lens, and then the polarizer is used for polarization analysis, and the image sensor collects the focused light field and the imaging light field intensity of the letter E in turn, and obtains the complex amplitudes of the two light fields respectively through the intensity transmission equation as well as Wherein, S is the VTM, is the transpose conjugate operation, is the phase of the transposed conjugate of the VTM, φ M is the phase of the scattering medium, is the complex amplitude of the ideal object point, is the complex amplitude of the ideal letter E, Q(a) = exp[iπaλ -1 (x 2 +y 2 )], d1 is the distance from the ideal object point or the ideal letter E to the PSLM, d2 is the distance from the PSLM to the image sensor, and "*" represents a convolution operation; S3, cross-correlation image reconstruction: using the cross-correlation algorithm to obtain the complex amplitude of the focused light field The complex amplitude of the imaging light field with the letter E Perform cross-correlation reconstruction to obtain accurate imaging results I X (x,y): in, represents the correlation operation, and δ represents the Dirac function.
Citation Information
Cited By
Optical system for realizing focusing of multi-polarization-state light field at ectopic point based on scattering focusing
CN119960200A
