Edge detection device and edge detection method based on speckle correlation scattering matrix

Through the edge detection method based on the speckle-related scattering matrix, the media transmission matrix is ​​measured using a laser and a spatial light modulator, and the speckle-related scattering matrix is ​​calculated to obtain edge information, which solves the cumbersome and instability of the interference optical path in the prior art. Problem, improving measurement accuracy and efficiency.

CN118967701AActive Publication Date: 2024-11-15NANKAI UNIV

Patent Information

Application Number
CN202411011488.8
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-07-26
Publication Date
2024-11-15
Estimated Expiration
2044-07-26

AI Technical Summary

Technical Problem

When the prior art realizes edge detection through the transmission matrix method, additional interference optical paths are required to measure speckle phase, resulting in cumbersome experimental optical paths, high time cost and unstable system.

Method used

Using edge detection devices and methods based on speckle-related scattering matrix, the transmission matrix of the medium is measured by lasers, spatial light modulators, scattering medium and image sensors, and combining Hadamachi phase encoding and four-step phase shift method, speckle is calculated The correlation scattering matrix is ​​used to obtain edge information, avoiding the introduction of additional interference optical paths.

Benefits of technology

Improve measurement accuracy, simplify the experimental optical path, reduce time costs, and avoid system instability.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118967701A_ABST
    Figure CN118967701A_ABST
Patent Text Reader

Abstract

The invention belongs to the technical field of optical measurement, and discloses an edge detection device and method based on a speckle correlation scattering matrix, and the device comprises the steps: transmitting a first light beam through a laser; a signal light modulation area of the spatial light modulator receives the first light beam and outputs a signal light beam; the reference light modulation area receives the first light beam and outputs a reference light beam; the scattering medium outputs a scattered signal light beam and a reference light beam to the image sensor; the spatial light modulator loads different phase coding light fields to obtain the intensity of an interference light field of the scattered signal light beam and the reference light beam, and a transmission matrix is obtained through calculation; the spatial light modulator loads an image to be detected, the image sensor collects speckle intensity, data collected by the image sensor is processed to obtain a speckle correlation scattering matrix, and then an edge information value is obtained through calculation. The phase of the speckle of the image to be measured does not need to be measured by introducing an additional interference light path, instability caused by introduction of the additional interference light path is avoided, and time cost is saved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention belongs to the technical field of optical measurement, and in particular relates to an edge detection device and an edge detection method based on a speckle correlation scattering matrix. Background Art

[0002] Optical imaging has always been one of the important ways for people to obtain information, especially in biomedical imaging. However, in complex environments such as the atmosphere, ocean, and biological tissues, due to the uneven distribution of refractive index, photons no longer propagate in a straight line after being acted on multiple times by particles of the same order of magnitude as the wavelength of light in the complex environment medium. Their propagation direction deviates and spreads in all directions. The output light field also increases randomness due to multiple scattering. This phenomenon is called scattering, and the medium that interacts with photons is called a random scattering medium.

[0003] As an important branch of imaging, edge detection has important applications in image segmentation and recognition. To achieve edge detection through scattering media, the current existing technology is based on the transmission matrix method, that is, after measuring the transmission matrix of the medium, the matrix is ​​subjected to spiral phase filtering in the spatial frequency domain. The filtered transmission matrix is ​​combined with the target image speckle light field information obtained by measuring the additional interference optical path, including intensity and phase, to achieve edge information detection of the target image.

[0004] The existing technology requires additional speckle phase information to achieve edge detection, because CCD cameras can only measure the intensity of speckles, which leads to the need to introduce additional interference light paths to measure the phase of speckles. In this way, not only is the experimental light path cumbersome and time-consuming, but the additional interference light path will introduce system instability.

[0005] Based on this, the art urgently needs an edge detection device and an edge detection method based on a speckle correlation scattering matrix to solve the above technical problems. Summary of the invention

[0006] In view of this, an object of the present invention is to solve the above problems and to provide an edge detection device and an edge detection method based on a speckle correlation scattering matrix.

[0007] In order to solve the above technical problems, the present invention provides an edge detection device based on a speckle correlation scattering matrix, comprising:

[0008] A laser, configured to emit a first light beam;

[0009] A spatial light modulator, comprising a signal light modulation area and a reference light modulation area, wherein the signal light modulation area is used to receive the first light beam and output a signal light beam, and the reference light modulation area is used to receive the first light beam and output a reference light beam;

[0010] a scattering medium, the scattering medium being used to receive the signal beam, scatter the signal beam, and output the scattered signal beam; the scattering medium being also used to receive the reference beam, scatter the reference beam, and output the scattered reference beam;

[0011] An image sensor, the image sensor is used to receive the scattered signal beam and the scattered reference beam, and the image sensor collects the speckle intensity of the image to be measured;

[0012] a data processing module, wherein the data processing module is used to control the spatial light modulator to load different phase-encoded light fields, obtain the intensity of the interference light field of the scattered signal light beam and the scattered reference light beam, perform algorithmic processing on the intensity of the interference light field to obtain the transmission matrix of the scattering medium, the data processing module controls the spatial light modulator to load the image to be measured in the signal light modulation area, the data processing module controls the image sensor to collect the speckle intensity of the image to be measured, calculates and processes all data collected by the image sensor to obtain a speckle-related scattering matrix, and calculates and processes the speckle-related scattering matrix to obtain an edge information value.

[0013] As a further improvement of the present invention, a first prism, a first convex lens, a second convex lens, a total reflection mirror and a second prism are sequentially arranged between the laser and the spatial light modulator along the optical path direction, the first prism performs polarization processing on the first light beam to output a second light beam, the first convex lens performs beam expansion processing on the second light beam to output a third light beam, the second convex lens performs collimation processing on the third light beam to output a fourth light beam, the total reflection mirror receives the fourth light beam and vertically inputs the fourth light beam to the second prism, and the second prism receives the fourth light beam and performs spectral processing on the fourth light beam and outputs it.

[0014] As a further improvement of the present invention, a 4f light group and a microscope objective lens are sequentially arranged between the spatial light modulator and the scattering medium along the light path direction;

[0015] The second prism transmits the signal light beam to the 4f light group, the 4f light group performs filtering processing on the signal light beam to output a fifth light beam, and the microscope objective performs focusing processing on the fifth light beam and outputs it;

[0016] The second prism transmits the reference beam to the 4f light group, the 4f light group performs filtering processing on the reference beam to output a sixth beam, and the microscope objective performs focusing processing on the sixth beam and outputs it.

[0017] As a further improvement of the present invention, a fifth convex lens and a polarizing plate are sequentially arranged between the scattering medium and the image sensor along the light path direction;

[0018] The fifth convex lens converges the scattered modulated light beam to the polarizer, and the polarizer filters out the vertical polarized light component of the scattered signal light beam and outputs it;

[0019] The fifth convex lens converges the scattered reference beam to the polarizer, and the polarizer filters out the vertical polarized light component of the scattered reference beam and outputs it.

[0020] As a further improvement of the present invention, the scattering medium is frosted glass.

[0021] The present invention also provides an edge detection method based on a speckle correlation scattering matrix, the method comprising:

[0022] S1: Measure the transmission matrix of the scattering medium using the Hadamard phase-coded light field and the four-step phase shift method;

[0023] S2: collecting speckle intensity, loading the image to be measured into the signal light modulation area of ​​the spatial light modulator, and the image sensor collecting the speckle intensity of the image to be measured;

[0024] S3: Obtain edge information, process the filtered transmission matrix and the acquired speckle intensity algorithm of the image to be measured to obtain a speckle correlation scattering matrix, and obtain the eigenvector corresponding to the maximum eigenvalue of the speckle correlation scattering matrix to obtain the edge information value of the image to be measured.

[0025] As a further improvement of the present invention, in step S1, using the Hadamard basis and four-step phase shift method to measure the scattering medium transmission matrix includes:

[0026] S11: Measure the interference light field intensity of the signal light beam and the reference light beam when the phase offset is 0, π / 2, 3π / 2, and π respectively:

[0027]

[0028] Among them, m represents the mth output channel, n corresponds to the nth dimension of the Hadamard input light field, is the vector corresponding to the nth column of the Hadamard basis matrix, s m is the reference optical complex amplitude used by the mth transmission channel, For m Hermitian conjugate, α represents the phase offset in the four-step phase shift, and the element of the Hadamard basis is 1 or -1; wherein 1 can be represented as the complex amplitude A exp(i0), and -1 can be represented as the complex amplitude A exp(iπ);

[0029] S12: Solve the Difference The next mn :

[0030]

[0031] in, is the vector corresponding to the nth column of the Hadamard basis matrix, s m is the reference light complex amplitude adopted by the mth transmission channel;

[0032] S13: Solve for all t mn , forming the optical transmission matrix T under the Hadamard basis H , converted into a matrix T under the Cartesian basis through the basis vector.

[0033] As a further improvement of the present invention, in S13: solving all t mn , forming the optical transmission matrix T under the Hadamard basis H , after the basis vector is converted into the matrix T under the Cartesian basis, it also includes:

[0034] S14: Perform spiral phase filtering on the matrix T in the spatial frequency domain:

[0035]

[0036] Where fft2 represents a two-dimensional Fourier transform of each row of the transmission matrix T, k = (k x , k y ) represents the spatial frequency domain;

[0037] S15: Perform a two-dimensional inverse Fourier transform back to the spatial domain to obtain the overall filtered transmission matrix T filt :

[0038]

[0039] Among them, fft2 -1 Represents a two-dimensional inverse Fourier transform of each row of the transmission matrix T, and performs spatial filtering to obtain

[0040] As a further improvement of the present invention, in S3, the speckle-related scattering matrix obtained by processing the filtered transmission matrix and the speckle intensity algorithm of the image to be measured is:

[0041]

[0042] in, Corresponding to the filtered transmission matrix T filt In the i-th column, y represents the scattered field, y*y represents the speckle intensity, and is the normalization factor.

[0043] As a further improvement of the present invention, in S3, obtaining the edge information value by obtaining the eigenvector corresponding to the maximum eigenvalue of the speckle correlation scattering matrix Z is specifically as follows: obtaining the eigenvector corresponding to the maximum eigenvalue of the speckle correlation scattering matrix Z to obtain the complex-valued coefficient x of the incident field, and the modulus of the complex-valued x is the required edge information value.

[0044] Compared with the prior art, the present invention provides an edge detection device and method based on speckle correlation scattering matrix. After the medium transmission matrix is ​​measured by the device, the image sensor collects a piece of speckle intensity information of the image to be measured, calculates the speckle correlation scattering matrix in combination with the transmission matrix, and obtains the eigenvector corresponding to the maximum eigenvalue of the matrix, so as to obtain the edge information of the target image. Compared with the prior art that uses an additional interference optical path to measure the speckle phase to achieve edge detection, the cumbersome experimental optical path and time cost waste caused by the introduction of an interference optical path to measure the speckle phase are avoided, and the system instability introduced by the additional interference optical path is also avoided, thereby improving the measurement accuracy. BRIEF DESCRIPTION OF THE DRAWINGS

[0045] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only part of the embodiments of the present invention, rather than all of the embodiments. For ordinary technicians in this field, without paying creative work, other drawings obtained based on these drawings all fall within the scope of protection of this application.

[0046] Figure 1 is a schematic diagram of an edge detection device and method based on a speckle correlation scattering matrix provided in an embodiment of the present invention;

[0047] Figure 2 is a method flow chart of an edge detection device and method based on a speckle correlation scattering matrix provided by an embodiment of the present invention;

[0048] Figure 3 is an architecture diagram of an edge detection device and method based on a speckle correlation scattering matrix provided in an embodiment of the present invention;

[0049] Figure 4 It is a distribution diagram of the signal light modulation area and the reference light modulation area of ​​the spatial light modulator of the edge detection device and method based on the speckle correlation scattering matrix provided by the embodiment of the present invention;

[0050] Figure 5 1 is a measurement process diagram of an edge detection device and method based on a speckle correlation scattering matrix provided by an embodiment of the present invention, (a) an image to be measured, (b) speckle of the image to be measured, and (c) an edge of the image to be measured;

[0051] Figure 6 These are experimental results of an edge detection device and method based on a speckle correlation scattering matrix provided in an embodiment of the present invention, including (a) theoretically calculated edge and (b) experimentally measured edge.

[0052] Description of reference numerals:

[0053] 1 is a laser, 2 is a first prism, 3 is a first convex lens, 4 is a second convex lens, 5 is a total reflection mirror, 6 is a spatial light modulator, 7 is a second prism, 8 is a third convex lens, 9 is a filter hole, 10 is a fourth convex lens, 11 is a microscope objective lens, 12 is a scattering medium, 13 is a fifth convex lens, 14 is a polarizer, and 15 is an image sensor. DETAILED DESCRIPTION

[0054] In order to make the purpose, technical solution and advantages of the present invention more clearly understood, the present invention is further described in detail below in conjunction with the accompanying drawings and specific embodiments. It should be understood that the specific embodiments described herein are only used to explain the present invention and are not used to limit the present invention.

[0055] In order to make the description of the disclosed content more detailed and complete, the following is an illustrative description of the implementation mode and specific examples of the present invention; however, this is not the only form of implementing or applying the specific embodiments of the present invention. The implementation mode covers the features of multiple specific embodiments and the method steps and their sequence for constructing and operating these specific embodiments. However, other specific embodiments can also be used to achieve the same or equal functions and step sequences. Based on the embodiments in this application, all other embodiments obtained by ordinary technicians in this field without making creative work are within the scope of protection of this application.

[0056] It should be noted that the terms "first", "second", etc. in the specification and claims of the present invention and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchangeable where appropriate, so that the embodiments of the present application described herein can be implemented in an order other than those illustrated or described herein. In addition, the terms "including" and "having" and any of their variations are intended to cover non-exclusive inclusions, for example, a process, method, system, product or device that includes a series of steps or units is not necessarily limited to those steps or units that are clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.

[0057] In the several embodiments provided in the present application, it should be understood that the disclosed systems, devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic. For example, the division of the units is only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be an indirect coupling or communication connection through some interfaces, devices or units, which can be electrical, mechanical or other forms.

[0058] In the description of the embodiments of the present invention, unless otherwise specified, “ / ” means or, for example, A / B can mean A or B; “and / or” in the text is merely a description of the association relationship of associated objects, indicating that three relationships may exist, for example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone. In addition, in the description of the embodiments of the present application, “multiple” refers to two or more than two, and other quantifiers are similar. It should be understood that the preferred embodiments described herein are only used to illustrate and explain the present invention, and are not used to limit the present invention, and the embodiments of the present application and the features in the embodiments may be combined with each other without conflict.

[0059] Please refer to Figure 1-Figure 6 The present invention provides an edge detection device and method based on a speckle-related scattering matrix. The prior art introduces an additional interference optical path to measure the phase of the speckle for edge detection. Not only is the experimental optical path cumbersome and time-consuming, but the additional interference optical path also introduces system instability.

[0060] For details, please refer to Figure 1 , the present invention provides an edge detection device based on a speckle correlation scattering matrix, comprising a laser 1, a spatial light modulator 6, a scattering medium 12 and an image sensor 15 arranged in sequence along the optical path direction, wherein the spatial light modulator 6 and the image sensor 15 are both electrically connected to a data processing module. The present invention provides an edge detection device based on a speckle correlation scattering matrix. After the medium transmission matrix is ​​measured by the device, the image sensor 15 collects a piece of speckle intensity information of the image to be measured, calculates the speckle correlation scattering matrix in combination with the transmission matrix, and obtains the eigenvector corresponding to the maximum eigenvalue of the speckle correlation scattering matrix, thereby obtaining the edge information of the image to be measured. Compared with the prior art that requires an additional interference optical path to measure the speckle phase to achieve edge detection, the cumbersome experimental optical path and the waste of time cost caused by the additional interference optical path introduced due to the measurement of the speckle phase are avoided, and the instability introduced by the additional interference optical path is also avoided, thereby improving the measurement accuracy.

[0061] Specifically, the laser 1 emits a first light beam; the signal light modulation area of ​​the spatial light modulator 6 receives the first light beam and outputs a signal light beam, and the reference light modulation area of ​​the spatial light modulator 6 receives the first light beam and outputs a reference light beam; the scattering medium 12 receives the signal light beam, scatters the signal light beam, and outputs a scattered signal light beam; the scattering medium 12 receives the reference light beam, scatters the reference light beam, and outputs a scattered reference light beam; the image sensor 15 receives the scattered signal light beam and the scattered reference light beam. In a specific embodiment, the laser wavelength emitted by the laser 1 of the present invention is 532nm.

[0062] Further, the data processing module controls the spatial light modulator 6 to load different phase-coded light fields, and correspondingly, the image sensor 15 receives the scattered signal light beam and the scattered reference light beam under different phase-coded light fields, thereby obtaining the intensity of the interference light field of the scattered signal light beam and the scattered reference light beam, and the data processing module calculates the transmission matrix of the scattering medium based on the data collected by the image sensor 15; the data processing module controls the spatial light modulator 6 to load the image to be measured in the signal light modulation area, and the data processing module controls the image sensor 15 to collect the speckle intensity of the image to be measured, and algorithmically processes all the data collected by the image sensor 15 in combination with the transmission matrix of the scattering medium to obtain a speckle-related scattering matrix, and calculates the speckle-related scattering matrix to obtain an edge information value.

[0063] As a further improvement of the present invention, a first prism 2, a first convex lens 3, a second convex lens 4, a total reflection mirror 5, and a second prism 7 are sequentially arranged along the optical path between the laser emitter and the spatial light modulator 6. The first prism 2 performs polarization processing on the first light beam to output a second light beam. The first convex lens 3 performs beam expansion processing on the second light beam to output a third light beam. The second convex lens 4 performs collimation processing on the third light beam to output a fourth light beam. The total reflection mirror 5 receives the fourth light beam and vertically inputs the fourth light beam to the second prism 7. The second prism 7 receives the fourth light beam and performs beam splitting processing on the fourth light beam and outputs it. Specifically, the first prism 2 is used to perform polarization processing on the first light beam to obtain horizontal linear polarized light. Preferably, the first prism 2 is a Glan prism. The first convex lens 3 and the second convex lens 4 form a collimation and expansion system to expand and collimate the incident light beam to obtain a light beam of preset width.

[0064] As a further improvement of the present invention, a 4f light group and a microscope objective lens 11 are sequentially arranged between the spatial light modulator 6 and the scattering medium 12 along the optical path direction; the second prism 7 transmits the signal light beam to the 4f light group, the 4f light group filters the signal light beam to output a fifth light beam, and the microscope objective lens 11 focuses and outputs the fifth light beam; the second prism 7 transmits the reference light beam to the 4f light group, the 4f light group filters the reference light beam to output a sixth light beam, and the microscope objective lens 11 focuses and outputs the sixth light beam. Specifically, the 4f light group includes a third convex lens 8, a filter hole 9 and a fourth convex lens 10 which are arranged in sequence along the light path direction. The 4f light group performs diffraction light order filtering on the incident light beam. The filter hole 9 extracts the +1-order light which is collimated by the fourth convex lens 10 and then enters the microscope objective 11. The microscope objective 11 focuses the incident light beam. Preferably, the focal length f of the third convex lens 8 and the fourth convex lens 10 is 100 mm, and the numerical aperture NA of the microscope objective 11 is 0.25.

[0065] As a further improvement of the present invention, a fifth convex lens 13 and a polarizer 14 are sequentially arranged between the scattering medium 12 and the image sensor 15 along the optical path direction; the fifth convex lens 13 converges the scattered signal light beam to the polarizer 14, and the polarizer 14 filters out the vertical polarized light component of the scattered signal light beam and outputs it; the fifth convex lens 13 collects and converges the scattered reference light beam to the polarizer 14, and the polarizer 14 filters out the vertical polarized light component of the scattered reference light beam and outputs it. Specifically, the fifth convex lens 13 is used to collect and converge the light beam scattered by the scattering medium 12. Due to the depolarization effect of the scattering medium 12, when the incident light beam is in the horizontal polarization direction, the outgoing scattered light has not only a horizontal polarization component but also a vertical polarization component. The polarizer 14 is used to filter out the speckle intensity of the vertical polarization component in the scattered signal beam and the scattered reference beam.

[0066] As a further improvement of the present invention, the scattering medium 12 must meet the use conditions of the speckle correlation scattering matrix method: its transmission matrix satisfies the orthogonality of column vectors, and the scattering field scattered by it satisfies the complex Gaussian random distribution. Preferably, the scattering medium 12 is frosted glass.

[0067] In a specific installation method, first fix the spatial light modulator 6, install the image sensor 15 on the right side of the spatial light modulator, and make the optical axis of the image sensor 15 pass through the center of the control light area of ​​the spatial light modulation device; then install the second prism 7, the third lens, the filter hole 9, the fourth lens, the microscope objective lens 11, the scattering medium 12, the fifth convex lens 13 and the polarizer 14 between the spatial light modulator 6 and the image sensor 15, and ensure that the second prism 7, the third convex lens 8, the filter hole 9, the fourth convex lens 10, the microscope objective lens 11, the scattering medium 12, the fifth lens and the polarizer 14 are installed coaxially, and then install the total reflection mirror 5 with a 45° tilt above the second prism 7, and install the second convex lens 4, the first convex lens 3 and the laser 1 in turn on the reflection light path of the total reflection mirror 5, so that all the light emitted by the laser 1 is reflected onto the second prism 7.

[0068] The setting of the positional relationship of each module in the system of the above installation method is only an example of this embodiment. Those skilled in the art can also make settings according to actual conditions, and the present invention is not limited here.

[0069] The present invention also provides an edge detection method based on speckle correlation scattering matrix, see Figure 2-5 , the method comprising:

[0070] S1: measuring the transmission matrix of the scattering medium 12, using the Hadamard phase coded light field and the four-step phase shift method to measure the transmission matrix of the scattering medium 12;

[0071] It should be noted that this embodiment adopts the incident mode number N=32*32, adopts the macro pixel method, each incident mode or incident channel corresponds to 16*16 pixels of the spatial light modulator 6, and the pixel size of the spatial light modulator 6 is 8μm. Figure 4 , the reference light modulation area and the signal light modulation area of ​​the spatial light modulator 6 are located in the same optical arm, the rectangular area in the middle of the spatial light modulator 5 is the dynamic signal light modulation area, and the part within the circle and outside the rectangular area is the static reference light modulation area. Preferably, in the entire light-transmitting area of ​​the spatial light modulator 6, the reference light modulation area and the signal light modulation area account for 35% and 65% respectively. Adjust the optical path so that the size of a single speckle is equivalent to the pixel of the image sensor 15, and select M = 512*512 pixels at the output end as the output mode sampling number. Then the transmission matrix The Hadamard basis is used to measure the optical transmission matrix because the pixels of the Hadamard basis at the same modulus are 1 or -1, where 1 can represent the complex amplitude Aexp(j0) and -1 can represent the complex amplitude Aexp(jπ), both of which have the same amplitude, A=1, and the phase difference is π. This not only separates the intensity information from the phase information, but also allows all elements on the spatial light modulator 6 to transmit light, retaining the maximum intensity of the input light beam, so that sufficient energy is used for subsequent transmission through the scattering medium 12, reducing the sensitivity of the experiment to noise.

[0072] S2: collecting speckle intensity, loading the image to be measured into the signal light modulation area of ​​the spatial light modulator 6, and the image sensor 15 collecting the speckle intensity of the image to be measured.

[0073] It should be noted that the image hologram to be detected is loaded into the signal light area of ​​the spatial light modulator 6, and the size is also N=32*32 macro pixels. Correspondingly, the speckle intensity value is measured at the image sensor 15 end.

[0074] S3: Obtain edge information, process the filtered transmission matrix and the detected acquired speckle intensity algorithm to obtain a speckle correlation scattering matrix, and obtain the eigenvector corresponding to the maximum eigenvalue of the speckle correlation scattering matrix to obtain the edge information value.

[0075] As a further improvement of the present invention, in step S1, using the Hadamard basis and four-step phase shift method to measure the transmission matrix of the scattering medium 12 includes:

[0076] S11: Measure the interference light field intensity of the signal light beam and the reference light beam when the phase offset is 0, π / 2, 3π / 2, and π respectively:

[0077]

[0078] Among them, m represents the mth output channel, n corresponds to the nth dimension of the Hadamard incident light field, is the vector corresponding to the nth column of the Hadamard basis matrix, s m is the reference optical complex amplitude used by the mth transmission channel, For m Hermitian conjugate, α represents the phase offset in the four-step phase shift, and the element of the Hadamard basis is 1 or -1; wherein 1 can be represented as the complex amplitude A exp(i0), and -1 can be represented as the complex amplitude A exp(iπ);

[0079] S12: Solve the Difference The next mn :

[0080]

[0081] in, is the vector corresponding to the nth column of the Hadamard basis matrix, s m is the reference light complex amplitude adopted by the mth transmission channel;

[0082] S13: Solve for all t mn , forming the optical transmission matrix T under the Hadamard basis H , converted into a matrix T under the Cartesian basis through the basis vector.

[0083] As a further improvement of the present invention, in S13: solving all t mn , forming the optical transmission matrix T under the Hadamard basis H , after the basis vector is converted into the matrix T under the Cartesian basis, it also includes:

[0084] S14: Perform spiral phase filtering on the matrix T in the spatial frequency domain:

[0085]

[0086] Where fft2 represents a two-dimensional Fourier transform of each row of the transmission matrix T, k = (k x , k y ) represents the spatial frequency domain, and spatial filtering is performed to obtain

[0087] S15: Perform a two-dimensional inverse Fourier transform back to the spatial domain to obtain the overall filtered transmission matrix T filt :

[0088]

[0089] As a further improvement of the present invention, in S3, the speckle-related scattering matrix obtained by algorithm processing the filtered transmission matrix and the acquired speckle intensity of the image to be measured is:

[0090]

[0091] in, Corresponding to the filtered transmission matrix T filt In the i-th column, y represents the scattered field, y*y is the speckle intensity, and is the normalization factor. The multiplication between the sub-vectors in the above formula is the multiplication between their corresponding elements, and the multiplication between the sub-vectors is the Hadamard product.

[0092] As a further improvement of the present invention, in S3, obtaining the edge information value by obtaining the eigenvector corresponding to the maximum eigenvalue of the speckle correlation scattering matrix Z is specifically as follows: obtaining the eigenvector corresponding to the maximum eigenvalue of the speckle correlation scattering matrix Z to obtain the complex-valued coefficient X of the incident field, and the modulus of the complex-valued X is the required edge information value.

[0093] For further information, see Figure 5-6 , Figure 5 (a) is an image to be tested according to the present invention, Figure 5 (b) is the speckle obtained by the image to be measured through a scattering system in which the scattering medium 12 is a 120-mesh frosted glass scattering system, Figure 5 (c) is the edge of the image to be measured calculated by the speckle correlation scattering matrix method; Figure 6 is an experimental result of an edge detection device and method based on a speckle correlation scattering matrix provided by an embodiment of the present invention, Figure 6 The embodiment in the embodiment reaches more than 0.9, Figure 6 (a) Theoretical calculation edge, (b) experimental measurement edge, the Pearson correlation coefficient is used to measure the correlation between the image enhancement information and the theoretical image enhancement information, which is 0.9380, which means that the method proposed in the present invention can accurately detect the edge of the image to be tested.

[0094] The technical features of the above embodiments may be combined arbitrarily. To make the description concise, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.

[0095] The above embodiments only express the preferred implementation modes of the present invention, and the descriptions thereof are relatively specific and detailed, and therefore cannot be understood as limiting the scope of the patent application. It should be pointed out that, for a person of ordinary skill in the art, several modifications and improvements can be made without departing from the concept of the present invention, and these all belong to the protection scope of the present invention. Therefore, the protection scope of the present invention shall be subject to the attached claims.

Claims

1. Edge detection device based on speckle correlation scattering matrix, It is characterized in that include: a laser, for emitting a first light beam; A spatial light modulator, comprising a signal light modulation area and a reference light modulation area, wherein the signal light modulation area is used to receive the first light beam and output a signal light beam, and the reference light modulation area is used to receive the first light beam and output a reference light beam; a scattering medium, the scattering medium being used to receive the signal beam, scatter the signal beam, and output the scattered signal beam; the scattering medium being also used to receive the reference beam, scatter the reference beam, and output the scattered reference beam; An image sensor, the image sensor is used to receive the scattered signal beam and the scattered reference beam, and the image sensor collects the speckle intensity of the image to be measured; a data processing module, wherein the data processing module is used to control the spatial light modulator to load different phase-encoded light fields, obtain the intensity of the interference light field of the scattered signal light beam and the scattered reference light beam, perform algorithmic processing on the intensity of the interference light field to obtain the transmission matrix of the scattering medium, the data processing module controls the spatial light modulator to load the image to be measured in the signal light modulation area, the data processing module controls the image sensor to collect the speckle intensity of the image to be measured, calculates and processes all data collected by the image sensor to obtain a speckle-related scattering matrix, and calculates and processes the speckle-related scattering matrix to obtain an edge information value.

2. The edge detection device based on speckle correlation scattering matrix according to claim 1, It is characterized in that Between the laser emitter and the spatial light modulator, a first prism, a first convex lens, a second convex lens, a total reflection mirror and a second prism are sequentially arranged along the optical path direction. The first prism performs polarization processing on the first light beam to output a second light beam. The first convex lens performs beam expansion processing on the second light beam to output a third light beam. The second convex lens performs collimation processing on the third light beam to output a fourth light beam. The total reflection mirror receives the fourth light beam and vertically inputs the fourth light beam to the second prism. The second prism receives the fourth light beam and performs spectral processing on the fourth light beam and outputs it.

3. The edge detection device based on speckle correlation scattering matrix according to claim 1, It is characterized in that A 4f light group and a microscope objective lens are sequentially arranged between the spatial light modulator and the scattering medium along the light path direction; The second prism transmits the signal light beam to the 4f light group, the 4f light group performs filtering processing on the signal light beam to output a fifth light beam, and the microscope objective performs focusing processing on the fifth light beam and outputs it; The second prism transmits the reference beam to the 4f light group, the 4f light group performs filtering processing on the reference beam to output a sixth beam, and the microscope objective lens performs focusing processing on the sixth beam and outputs it.

4. The edge detection device based on speckle correlation scattering matrix according to claim 1, It is characterized in that A fifth convex lens and a polarizing plate are sequentially arranged between the scattering medium and the image sensor along the light path direction; The fifth convex lens converges the scattered modulated light beam to the polarizer, and the polarizer filters out the vertical polarized light component of the scattered signal light beam and outputs it; The fifth convex lens converges the scattered reference beam to the polarizer, and the polarizer filters out the vertical polarized light component of the scattered reference beam and outputs it.

5. The edge detection device based on speckle correlation scattering matrix according to claim 1, It is characterized in that The scattering medium is frosted glass.

6. Edge detection method based on speckle correlation scattering matrix, It is characterized in that The method comprises: S1: Measure the transmission matrix of the scattering medium using the Hadamard phase-coded light field and the four-step phase shift method; S2: collecting speckle intensity, loading the image to be measured into the signal light modulation area of ​​the spatial light modulator, and the image sensor collecting the speckle intensity of the image to be measured; S3: Obtain edge information, process the filtered transmission matrix and the acquired speckle intensity algorithm of the image to be measured to obtain a speckle correlation scattering matrix, and obtain the eigenvector corresponding to the maximum eigenvalue of the speckle correlation scattering matrix to obtain the edge information value of the image to be measured.

7. The edge detection method based on speckle correlation scattering matrix according to claim 6, It is characterized in that In step S1, using the Hadamard basis and four-step phase shift method to measure the scattering medium transmission matrix includes: S11: Measure the interference light field intensity of the signal light beam and the reference light beam when the phase offset is 0, π / 2, 3π / 2, and π respectively: Among them, m represents the mth output channel, n corresponds to the nth dimension of the Hadamard input light field, is the vector corresponding to the nth column of the Hadamard basis matrix, s m is the reference optical complex amplitude used by the mth transmission channel, s m For m Hermitian conjugate, α represents the phase offset in the four-step phase shift, and the elements of the Hadamard basis are 1 or -1; wherein 1 can be represented as the complex amplitude Aexo(i0), and -1 can be represented as the complex amplitude Aexo(iπ); S12: Solve the Difference The next t mn : in, is the vector corresponding to the nth column of the Hadamard basis matrix, s m is the reference light complex amplitude adopted by the mth transmission channel; S13: Solve for all t mn , forming the optical transmission matrix T under the Hadamard basis H , converted into a matrix T under the Cartesian basis through the basis vector.

8. The edge detection method based on speckle correlation scattering matrix according to claim 7, It is characterized in that In S13: Solve for all t mn , forming the optical transmission matrix T under the Hadamard basis H , after the basis vector is converted into the matrix T under the Cartesian basis, it also includes: S14: Perform spiral phase filtering on the matrix T in the spatial frequency domain: Where fft2 represents a two-dimensional Fourier transform of each row of the transmission matrix T, k = (k x , k y ) represents the spatial frequency domain; S15: Perform a two-dimensional inverse Fourier transform back to the spatial domain to obtain the overall filtered transmission matrix T filt : Among them, fft2 -1 Represents a two-dimensional inverse Fourier transform of each row of the transmission matrix T, and performs spatial filtering to obtain 9. The edge detection method based on speckle correlation scattering matrix according to claim 6, It is characterized in that In S3, the speckle-related scattering matrix obtained by processing the filtered transmission matrix and the speckle intensity algorithm of the image to be measured is: in, Corresponding to the filtered transmission matrix T filt The i-th column of y represents the scattered field, y * y represents the speckle intensity, and is the normalization factor.

10. The edge detection method based on speckle correlation scattering matrix according to claim 9, It is characterized in that In S3, obtaining the edge information value by obtaining the eigenvector corresponding to the maximum eigenvalue of the speckle correlation scattering matrix Z is specifically as follows: obtaining the eigenvector corresponding to the maximum eigenvalue of the speckle correlation scattering matrix Z is to obtain the complex value coefficient X of the incident field, and the modulus of the complex value X is the required edge information value.

Citation Information

Patent Citations

  • Image transmitting bundle large-view-field three-dimensional imaging device and method based on light field regulation and control

    CN114967104A

  • Lidar imaging system with heterodyne detection such as fmcw comprising a reference signal phase correction device

    EP4012453A1

  • Systems and methods for tissue characterization using multiple aperture ultrasound

    WO2022086521A1

Cited By

  • An edge detection method, system, device and storage medium for single-pixel imaging

    CN122906033A