Multi-target scattering imaging method, device and equipment and storage medium thereof
By separating and processing the intensity distribution data of speckle patterns, using autocorrelation technology and phase recovery algorithm, combined with point diffusion function positioning method, multi-objective scattering imaging beyond the range of optical memory effects is achieved, and the existing technology is limited by The problem of optical memory effect range achieves high-precision target image reconstruction.
Patent Information
- Application Number
- CN202410855535.0
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-06-28
- Publication Date
- 2024-12-06
AI Technical Summary
In the prior art, the multi-objective scattering imaging method is limited by the optical memory effect range, and it is difficult to achieve imaging beyond this range.
By obtaining the intensity distribution data of the speckle pattern based on the imaging system, multiple sub-target speckles are separated and obtained, and the phase and amplitude information of the sub-target are obtained by using speckle autocorrelation technology and iterative phase recovery algorithm, and the positions related to the point diffusion function are combined with the speckle autocorrelation technology and iterative phase recovery algorithm. Estimation method to realize the positioning and reconstruction of multi-objective images.
Multi-objective scattering imaging within the ultra-optical memory effect range is realized, target images are reconstructed accurately and reliably, and the problem of limiting the range of optical memory effect is overcome.
Smart Images

Figure CN119086511A_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the technical field of scatter imaging, and in particular to a multi-target scatter imaging method, device, equipment and storage medium thereof. Background Art
[0002] In nature, when light passes through some medium with uneven internal distribution, it will scatter inside and on its surface, forming a complex and disordered speckle pattern, and the target information is hidden in the speckle pattern. We call this kind of medium a scattering medium, which includes fog, haze, clouds, turbid liquids, biological tissues, etc. in the atmosphere. The study of scattering imaging has important research value in the fields of biomedicine, military security, atmospheric safety, and remote sensing mapping.
[0003] According to the principle of speckle autocorrelation and optical memory effect, the amplitude of the target image after hiding the scattering medium can be obtained by the autocorrelation of the speckle pattern, and the phase can be obtained by the phase recovery algorithm to recover the target. However, due to the limitation of the range of optical memory effect, it is difficult to achieve multi-target scattering imaging beyond the range of optical memory effect. Summary of the invention
[0004] The purpose of the present application is to provide a multi-target scattering imaging method, device, equipment and storage medium thereof, so as to solve the problem that the current multi-target scattering imaging method is limited by the scope of optical memory effect.
[0005] To achieve the above objectives, this application provides the following technical solutions:
[0006] In a first aspect, the present application proposes a technical solution for a multi-target scattering imaging method, the method comprising:
[0007] Based on an imaging system, a speckle pattern formed by a fluorescent object hidden behind a scattering medium under different intensity distributions is obtained; the imaging system is pre-established;
[0008] Acquiring a plurality of sub-target speckles based on the intensity distribution data of the speckle pattern;
[0009] Based on the plurality of sub-target speckles, acquiring a plurality of sub-target images;
[0010] The intensity distributions of the multiple sub-target speckles and the imaging areas of the multiple sub-target images are located to obtain the target image.
[0011] As a specific solution in the technical solution of the present application, the imaging system includes a non-correlated light source, a speckle mirror, a spatial light modulator, a speckle medium, a microscope and a camera.
[0012] As a specific solution in the technical solution of the present application, the step of acquiring multiple sub-target speckles based on the intensity distribution data of the speckle pattern includes:
[0013] Acquiring area and intensity information when the spatial light modulator performs structured light intensity modulation;
[0014] Based on the camera, acquiring intensity distribution data of a plurality of speckle patterns modulated by a spatial light modulator;
[0015] Based on the intensity distribution data of the plurality of speckle patterns, a plurality of sub-target speckles are separately acquired.
[0016] As a specific solution in the technical solution of the present application, the acquiring of multiple sub-target images based on the multiple sub-target speckles includes:
[0017] Based on the speckle autocorrelation technology, phase information of multiple sub-targets is obtained from the multiple sub-target speckles;
[0018] Based on the phase information of the plurality of sub-targets, acquiring Fourier amplitude information of the plurality of sub-targets;
[0019] Based on an iterative phase recovery algorithm and Fourier amplitude information of the plurality of sub-targets, phases corresponding to the speckles of the plurality of sub-targets are acquired;
[0020] Based on the phases and amplitudes corresponding to the multiple sub-target speckles, multiple sub-target images are acquired.
[0021] As a specific solution in the technical solution of the present application, the intensity distribution of multiple sub-target speckles and the imaging areas of multiple sub-target images are positioned to obtain the target image, including:
[0022] Based on the intensity information of the plurality of sub-target speckles, estimating the intensity distribution of the imaging area of the plurality of sub-target speckles;
[0023] Based on a position estimation method related to a point spread function, the relative positions of the plurality of sub-targets are relocated to reconstruct the target image.
[0024] In a second aspect, the present application proposes a multi-target scattering imaging device, the device comprising:
[0025] An acquisition module, used for acquiring, based on an imaging system, a speckle pattern formed by a fluorescent object hidden behind a scattering medium under different intensity distributions; the imaging system is pre-established;
[0026] A processing module, configured to obtain a plurality of sub-target speckles based on the intensity distribution data of the speckle pattern;
[0027] and, based on the plurality of said sub-target speckles, acquiring a plurality of sub-target images;
[0028] And, the intensity distributions of the multiple sub-target speckles and the imaging areas of the multiple sub-target images are located to acquire the target image.
[0029] As a specific solution in the technical solution of the present application, the imaging system includes a non-correlated light source, a speckle mirror, a spatial light modulator, a speckle medium, a microscopic device and a camera;
[0030] As a specific solution in the technical solution of the present application, the acquisition module is also used to obtain the area and intensity information when the spatial light modulator performs structured light intensity modulation;
[0031] and, based on the camera, acquiring intensity distribution data of a plurality of speckle patterns modulated by a spatial light modulator;
[0032] The processing module is further used to separately obtain a plurality of sub-target speckles based on the intensity distribution data of the plurality of speckle patterns.
[0033] As a specific solution in the technical solution of the present application, the processing module is further used to obtain phase information of multiple sub-targets from the multiple sub-target speckles based on the speckle autocorrelation technology;
[0034] and, based on the phase information of the plurality of sub-targets, acquiring Fourier amplitude information of the plurality of sub-targets;
[0035] And, based on an iterative phase recovery algorithm and Fourier amplitude information of the plurality of sub-targets, acquiring phases corresponding to the plurality of sub-target speckles;
[0036] And, based on the phases and amplitudes corresponding to the plurality of sub-target speckles, a plurality of sub-target images are acquired.
[0037] As a specific solution in the technical solution of the present application, the processing module is further used to estimate the intensity distribution of the imaging area of the plurality of sub-target speckles based on the intensity information of the plurality of sub-target speckles;
[0038] Furthermore, based on a position estimation method related to a point spread function, the relative positions of the plurality of sub-targets are relocated to reconstruct a target image.
[0039] In a third aspect, the present application proposes a technical solution for a multi-target scattering imaging device, the device comprising:
[0040] A reader, for acquiring, based on an imaging system, a speckle pattern formed by a fluorescent object hidden behind a scattering medium under different intensity distributions; the imaging system is pre-established;
[0041] A processor, configured to obtain a plurality of sub-target speckles based on the intensity distribution data of the speckle pattern;
[0042] and, based on the plurality of said sub-target speckles, acquiring a plurality of sub-target images;
[0043] And, the intensity distributions of the multiple sub-target speckles and the imaging areas of the multiple sub-target images are located to acquire the target image.
[0044] As a specific solution of the technical solution of the present application, the imaging system includes a non-correlated light source, a speckle mirror, a spatial light modulator, a speckle medium, a microscopic device and a camera.
[0045] As a specific solution in the technical solution of the present application, the reader is also used to obtain the area and intensity information when the spatial light modulator performs structured light intensity modulation;
[0046] and, based on the camera, acquiring intensity distribution data of a plurality of speckle patterns modulated by a spatial light modulator;
[0047] The processor is further configured to separately acquire a plurality of sub-target speckles based on the intensity distribution data of the plurality of speckle patterns.
[0048] As a specific solution in the technical solution of the present application, the processor is further used to obtain phase information of multiple sub-targets from the multiple sub-target speckles based on the speckle autocorrelation technology;
[0049] and, based on the phase information of the plurality of sub-targets, acquiring Fourier amplitude information of the plurality of sub-targets;
[0050] And, based on an iterative phase recovery algorithm and Fourier amplitude information of the plurality of sub-targets, acquiring phases corresponding to the plurality of sub-target speckles;
[0051] And, based on the phases and amplitudes corresponding to the plurality of sub-target speckles, a plurality of sub-target images are acquired.
[0052] As a specific solution in the technical solution of the present application, the processor is also used to estimate the imaging area intensity distribution of multiple sub-target speckles based on the intensity information of the multiple sub-target speckles; and to perform secondary positioning on the relative positions of the multiple sub-targets based on a position estimation method related to a point spread function to reconstruct a target image.
[0053] In a fourth aspect, the present application proposes a technical solution of a computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, a multi-target scatter imaging method as described in any one of the first aspects is implemented.
[0054] Compared with the prior art, the beneficial effects of this application are:
[0055] The present application separates the speckles of different sub-targets and restores the sub-target images by modulating the intensity change of the target during imaging, and estimates the image area based on the intensity distribution of the sub-targets, and performs accurate secondary positioning according to the relationship of the scattering point spread function of the target area to achieve accurate and reliable target image reconstruction. That is, the present application can achieve multi-target scattering imaging within the range of super-optical memory effect. BRIEF DESCRIPTION OF THE DRAWINGS
[0056] Figure 1 A schematic diagram of the structure of an imaging system proposed in an embodiment of the present application;
[0057] Figure 2 A schematic diagram of a process flow of a multi-target scatter imaging method proposed in an embodiment of the present application;
[0058] Figure 3 A schematic diagram of the structure of a multi-target scattering imaging device proposed in an embodiment of the present application;
[0059] Figure 4 A schematic diagram of the structure of a multi-target scattering imaging device proposed in an embodiment of the present application;
[0060] Figure 5 A schematic diagram of a speckle pattern proposed in an embodiment of the present application;
[0061] Figure 6 A schematic diagram of multiple sub-target speckles proposed in an embodiment of the present application;
[0062] Figure 7 A schematic diagram of multiple sub-target images proposed in an embodiment of the present application;
[0063] Figure 8 A schematic diagram of a target image proposed in an embodiment of the present application.
[0064] In the figure: 1. Non-correlated light source; 2. Target; 3. Spectroscope; 4. Spatial light modulator; 5. Scattering medium; 6. Microscope device; 7. Camera. DETAILED DESCRIPTION
[0065] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.
[0066] The technical solutions in the embodiments of the present application will be described clearly and completely below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.
[0067] In addition, the terms "including" and "having" and any of their variations are intended to cover non-exclusive inclusions. For example, a process, method, system, product or device that includes a series of steps or modules is not necessarily limited to those steps or modules that are clearly listed, but may include other steps or modules that are not clearly listed or inherent to these processes, methods, products or devices. The division of modules that appear in the embodiments of the present application is only a logical division. There may be other division methods when implemented in actual applications. For example, multiple modules can be combined or integrated into another system, or some features can be ignored or not executed. In addition, the coupling or direct coupling or communication connection between each other shown or discussed can be through some interfaces, and the indirect coupling or communication connection between modules can be electrical or other similar forms, which are not limited in the embodiments of the present application. In addition, the modules or submodules described as separate components may or may not be physically separated, may or may not be physical modules, or may be distributed in multiple circuit modules, and some or all of the modules can be selected according to actual needs to achieve the purpose of the embodiment of the present application.
[0068] Before understanding the embodiments of the present application, it should be clear that the optical memory effect range refers to that within a certain range, when the incident angle of the illumination beam is changed, the speckle intensity map recorded behind the scattering medium will shift with the change of the incident angle, but the characteristics of the entire speckle intensity map remain unchanged, and there is a high correlation between the speckle intensity maps within this range. The range of the memory effect is related to the equivalent thickness of the scattering medium, and the relationship between the speckle correlation value and the angle is expressed as follows:
[0069] C(|θ|)=[kθl / sinh(kθl)] 2
[0070] Where k is the wave vector, θ is the angle between the illumination light and the optical axis, and l is the equivalent thickness of the scattering medium.
[0071] Speckle autocorrelation imaging based on the optical memory effect is simple, fast, and non-destructive, and has unique advantages. Speckle autocorrelation imaging is to illuminate an object with incoherent light, such as an LED light, and the light reflected from the object passes through a scattering medium and is collected by a digital camera. Looking directly at the image captured by the digital camera, it is just some irregularly undulating speckles, and no information about the object can be seen. However, a clear image of the object can be obtained by performing autocorrelation operations on the speckle field and reconstructing the algorithm. The field of view of speckle autocorrelation imaging depends on the range of the memory effect, which is generally very small. This is the bottleneck that limits speckle autocorrelation imaging.
[0072] In order to solve the technical problem that the prior art multi-target scattering imaging method is limited by the scope of optical memory effect, thus limiting the application of multi-target scattering imaging. This application proposes a multi-target scattering imaging method, such as Figure 2 As shown, the method includes steps S100 to S400.
[0073] Step S100: Based on the imaging system, a speckle pattern formed by a fluorescent object (ie, target 2) hidden behind a scattering medium is acquired.
[0074] It should be clear that in the embodiments of the present application, the imaging system is pre-established. Figure 1 As shown, the imaging system includes a non-correlated light source 1, a beam splitter 3, a spatial light modulator 4, a speckle medium 5, a microscope 6 and a camera 7.
[0075] In this application, the fluorescence of the target is excited by a non-correlated light source as the actual light source. The light containing the target information is modulated by the spatial light modulator when passing through the spectroscope, and then passes through the scattering medium and the microscopic device, and is finally captured by the camera. The experimental light path is as follows: Figure 1 Specifically, the obtained speckle pattern is as follows Figure 5 shown.
[0076] Step S200: acquiring a plurality of sub-target speckles based on the intensity distribution data of the speckle pattern.
[0077] In the embodiment of the present application, step S200 refers to the following Figure 5 The speckle pattern shown in Figure 6 In the embodiment of the present application, any method can be used based on the following example: Figure 5 The speckle pattern shown in Figure 6 Multiple sub-target speckles are shown.
[0078] In a specific embodiment of the present application, step S200, based on the intensity distribution data of the speckle pattern, acquires a plurality of sub-target speckles, including steps S210 to S230.
[0079] Step S210: obtaining the area and intensity information of the spatial light modulator 4 when performing structured light intensity modulation.
[0080] It should be clear that in this step, the area where the spatial light modulator 4 performs different structured light modulation is set. Generally, the spatial light modulator 4 should be divided into rectangles of the same size, and the output intensity corresponding to the rectangles should be recorded. A column vector can be used to record the structured light intensity at this time:
[0081] A=[a 1 a 2 a 3 a 4 ...a n ] T
[0082] When divided into n regions, it is necessary to perform n intensity changes corresponding to the n regions and obtain n speckle patterns, and there should be no targets at the edges of the regions, and n is a positive integer greater than or equal to 1.
[0083] Step S220 : Based on the camera 7 , intensity distribution data of a plurality of speckle patterns modulated by the spatial light modulator 4 is acquired.
[0084] It should be clear that in this step, corresponding to the segmented areas of the spatial light modulator 4, the target has sub-targets O in different areas. i ,When there is no sub-target in the region, the matrix representing the sub-target is replaced by a zero matrix.
[0085] During the imaging process, the light source excited by the target, after structured light modulation, has different intensity a for different sub-targets. i , the goal at this time can be expressed as a linear superposition of sub-goals:
[0086] O=[a 1 O 1 a 2 O 2 a 3 O 3 a 4 O 4 ...a n O n ] T
[0087] The distances between different sub-targets exceed the optical memory effect, so they are independent of each other in the scattering imaging process. The speckle collected by the camera is a linear superposition of the speckles of different sub-targets:
[0088]
[0089] in, is the collected speckle image, I i represents the speckle generated by the unmodulated sub-target, S i Sub-goal O i The corresponding point spread function.
[0090] Step S230: Separately acquiring a plurality of sub-target speckles based on the intensity distribution data of the plurality of speckle patterns.
[0091] It should be clear that in this step, according to different structured light partitions, the modulation intensity during single imaging changes, changing the intensity distribution state of the acquired speckle. 1 b 2 b 3 b 4 ...b n ], the intensity of the modulated target changes, O = [b 1 O 1 b 2 O 2 b 3 O 3 b 4 O 4 ...b n O n ]. Since the front and rear positions of the target do not change during this process, the sub-targets have the same point spread function, and the speckle at this time can be expressed as:
[0092]
[0093] The unmodulated speckle can be represented as a column vector I:
[0094]
[0095] The modulated speckle can be expressed as the product of the structured light intensity vector and the unmodulated speckle vector.
[0096] Taking four segmented areas as an example, different speckles can be obtained by setting different structured light intensity distribution vectors. These speckles can be represented by the speckles of sub-targets:
[0097]
[0098] By constructing these structured light intensity vectors into a matrix W, we can get the relationship between the acquired speckle and the speckle formed by different sub-targets. By constructing a reversible matrix W, the speckle formed by different sub-targets can be separated from the acquired speckle:
[0099]
[0100] Step S300: acquiring a plurality of sub-target images based on the plurality of sub-target speckles.
[0101] In the embodiment of the present application, since each sub-target speckle corresponds to a sub-target image, multiple sub-target images can be acquired based on the multiple sub-target speckles. Figure 6 and Figure 7 As shown by Figure 6 The four sub-target speckles can be obtained as follows Figure 7 The four corresponding sub-target images are shown.
[0102] In a specific embodiment of the present application, step S300, based on the plurality of sub-target speckles, acquires a plurality of sub-target images, including steps S310 to S340.
[0103] Step S310: Based on the speckle autocorrelation technology, phase information of multiple sub-targets is obtained from the multiple sub-target speckles.
[0104] In an embodiment of the present application, the autocorrelation and amplitude of the sub-target are calculated based on the speckle of the separated sub-target. The autocorrelation operation is performed on the speckle of the separated sub-target:
[0105] I(x)★I(x)=[O(x)*S(x)]★[O(x)*S(x)]=[O(x)★O(x)]*[S(x)★S(x)]
[0106] Among them, ★ represents the correlation operation. Since different sub-targets are within the range of the optical memory effect, the autocorrelation of the point spread function can be approximated as a pulse function. Therefore, the autocorrelation of the speckle can be approximately equivalent to the autocorrelation of the target image:
[0107] I(x)★I(x)≈[O(x)★O(x)]
[0108] Step S320: Based on the phase information of the multiple sub-targets, obtain the Fourier amplitude information of the multiple sub-targets.
[0109] In an embodiment of the present application, according to the VenaSchin theorem, the Fourier amplitude of the target is calculated by Fourier transform of the speckle pattern autocorrelation:
[0110]
[0111] When the phase and amplitude information of an image is known, the image can be reconstructed.
[0112] Step S330: based on the iterative phase recovery algorithm and the Fourier amplitude information of the multiple sub-targets, the phases corresponding to the multiple sub-target speckles are acquired.
[0113] In the embodiment of the present application, the HIO-ER iterative phase recovery algorithm is used, the autocorrelation image of the target is used as a priori, the random matrix is used as the initial phase value, and the amplitude information of the image is used as a priori information. The sub-target images are iteratively restored in sequence, and the autocorrelation of the sub-target satisfies the constraint:
[0114]
[0115] Step S340: acquiring a plurality of sub-target images based on the phases and amplitudes corresponding to the plurality of sub-target speckles.
[0116] It should be clear that acquiring multiple sub-target images based on the phases and amplitudes corresponding to the multiple sub-target speckles is a mature technology and will not be described in detail here.
[0117] Step S400: Positioning the intensity distributions of multiple sub-target speckles and the imaging areas of multiple sub-target images to acquire a target image.
[0118] It should be clear that in the embodiment of the present application, step S400 is performed as follows: Figure 7 The four sub-target images shown are reconstructed as follows Figure 8 The target image is shown.
[0119] As a specific solution in the technical solution of the present application, step S400, positioning the intensity distribution of multiple sub-target speckles and the imaging areas of multiple sub-target images to obtain a target image, includes step S410 and step S420.
[0120] Step S410: estimating the imaging area intensity distribution of the plurality of sub-target speckles based on the intensity information of the plurality of sub-target speckles.
[0121] It should be clear that in the embodiment of the present application, the distribution relationship between the imaging area and the spatial light modulator is determined based on the intensity information of the sub-target speckle, and the imaging area of the sub-target is inferred to perform the first positioning.
[0122] Step S420: Based on a position estimation method related to a point spread function, secondary positioning is performed on the relative positions of the plurality of sub-targets to reconstruct a target image.
[0123] In an embodiment of the present application, a point spread function centered on the sub-target is calculated based on the speckle of the separated sub-target and the restored sub-target image:
[0124] S = Deconv(I,O)
[0125] Among them, Deconv() represents the deconvolution operation.
[0126] The position information between the imaging areas is calculated based on the point spread functions of different sub-targets to perform secondary positioning of the sub-targets:
[0127]
[0128] Pos{} indicates the coordinates of the maximum intensity point in the two-dimensional space, and indicates the position information of the maximum intensity point of the restored sub-target at this time. Through the positional relationship between the imaging area and the sub-target intensity extreme value, high-precision positioning between sub-targets can be achieved, and combined with the restored sub-target image, an accurate reconstructed target image can be obtained.
[0129] The embodiment of a multi-target scattering imaging method proposed in the present application separates different sub-target speckles and restores sub-target images by modulating the intensity change of the target during imaging, and estimates the image area based on the intensity distribution of the sub-target, and performs accurate secondary positioning according to the relationship of the scattering point spread function of the target area, so as to achieve accurate and reliable target image reconstruction. That is, the multi-target scattering imaging method proposed in the present application can achieve multi-target scattering imaging within the range of super optical memory effect.
[0130] After introducing the embodiment of the multi-target scattering imaging method proposed in the present application, the following introduces a multi-target scattering imaging device proposed in the present application. Figure 3 As shown, the multi-target scattering imaging device 10 includes:
[0131] An acquisition module 11 is used to acquire, based on an imaging system, a speckle pattern formed by a fluorescent object hidden behind a scattering medium under different intensity distributions; the imaging system is established in advance;
[0132] A processing module 12, configured to obtain a plurality of sub-target speckles based on the intensity distribution data of the speckle pattern;
[0133] and, based on the plurality of said sub-target speckles, acquiring a plurality of sub-target images;
[0134] And, the intensity distributions of the multiple sub-target speckles and the imaging areas of the multiple sub-target images are located to acquire the target image.
[0135] As a specific embodiment of the present application, the imaging system includes a non-correlated light source 1, a beam splitter 3, a spatial light modulator 4, a speckle medium 5, a microscope 6 and a camera 7.
[0136] As a specific embodiment of the present application, the acquisition module 11 is further used to acquire the area and intensity information when the spatial light modulator 4 performs structured light intensity modulation;
[0137] and, based on the camera 7, acquiring intensity distribution data of a plurality of speckle patterns modulated by the spatial light modulator 4;
[0138] The processing module 12 is further configured to separately obtain a plurality of sub-target speckles based on the intensity distribution data of the plurality of speckle patterns.
[0139] As a specific embodiment of the present application, the processing module 12 is further configured to obtain phase information of multiple sub-targets from the multiple sub-target speckles based on the speckle autocorrelation technology;
[0140] and, based on the phase information of the plurality of sub-targets, acquiring Fourier amplitude information of the plurality of sub-targets;
[0141] And, based on an iterative phase recovery algorithm and Fourier amplitude information of the plurality of sub-targets, acquiring phases corresponding to the speckles of the plurality of sub-targets;
[0142] And, based on the phases and amplitudes corresponding to the plurality of sub-target speckles, a plurality of sub-target images are acquired.
[0143] As a specific embodiment of the present application, the processing module 12 is further used to estimate the imaging area intensity distribution of the plurality of sub-target speckles based on the intensity information of the plurality of sub-target speckles;
[0144] Furthermore, based on a position estimation method related to a point spread function, the relative positions of the plurality of sub-targets are relocated to reconstruct a target image.
[0145] The embodiment of the multi-target scattering imaging device proposed in the present application separates the speckles of different sub-targets and restores the sub-target images by modulating the intensity change of the target during the imaging process, and estimates the image area based on the intensity distribution of the sub-targets, and performs accurate secondary positioning according to the relationship of the scattering point spread function of the target area, so as to achieve accurate and reliable target image reconstruction. That is, the multi-target scattering imaging device proposed in the present application can achieve multi-target scattering imaging within the range of super optical memory effect.
[0146] After introducing the embodiment of the multi-target scattering imaging device proposed in the present application, the following introduces a multi-target scattering imaging device proposed in the present application, such as Figure 4 As shown, the multi-target scattering imaging device 20 includes: a reader 21, which is used to obtain a speckle pattern formed by a fluorescent object hidden behind a scattering medium under different intensity distributions based on an imaging system; the imaging system is pre-established;
[0147] A processor 22, configured to obtain a plurality of sub-target speckles based on the intensity distribution data of the speckle pattern;
[0148] and, based on the plurality of said sub-target speckles, acquiring a plurality of sub-target images;
[0149] And, the intensity distributions of the multiple sub-target speckles and the imaging areas of the multiple sub-target images are located to acquire the target image.
[0150] As a specific embodiment of the present application, the imaging system includes a non-correlated light source 1, a beam splitter 3, a spatial light modulator 4, a speckle medium 5, a microscope 6 and a camera 7.
[0151] As a specific embodiment of the present application, the reader 21 is also used to obtain the area and intensity information when the spatial light modulator 4 performs structured light intensity modulation;
[0152] and, based on the camera 7, acquiring intensity distribution data of a plurality of speckle patterns modulated by the spatial light modulator 4;
[0153] The processor 22 is further configured to separately obtain a plurality of sub-target speckles based on the intensity distribution data of the plurality of speckle patterns.
[0154] As a specific embodiment of the present application, the processor 22 is further configured to obtain phase information of multiple sub-targets from the multiple sub-target speckles based on a speckle autocorrelation technique;
[0155] and, based on the phase information of the plurality of sub-targets, acquiring Fourier amplitude information of the plurality of sub-targets;
[0156] And, based on an iterative phase recovery algorithm and Fourier amplitude information of the plurality of sub-targets, acquiring phases corresponding to the speckles of the plurality of sub-targets;
[0157] And, based on the phases and amplitudes corresponding to the plurality of sub-target speckles, a plurality of sub-target images are acquired.
[0158] As a specific embodiment of the present application, the processor 22 is further configured to estimate the imaging area intensity distribution of the plurality of sub-target speckles based on the intensity information of the plurality of sub-target speckles;
[0159] Furthermore, based on a position estimation method related to a point spread function, the relative positions of the plurality of sub-targets are relocated to reconstruct a target image.
[0160] The embodiment of the multi-target scattering imaging device proposed in the present application separates the speckles of different sub-targets and restores the sub-target images by modulating the intensity change of the target during the imaging process, and estimates the image area based on the intensity distribution of the sub-targets, and performs accurate secondary positioning according to the relationship of the scattering point spread function of the target area, so as to achieve accurate and reliable target image reconstruction. That is, the multi-target scattering imaging device proposed in the present application can achieve multi-target scattering imaging within the range of super optical memory effect.
[0161] After introducing the embodiments of the multi-target scattering imaging device proposed in the present application, the following introduces a computer-readable storage medium proposed in the present application, on which a computer program is stored. When the computer program is executed by a processor, a multi-target scattering imaging method as described in any of the above embodiments is implemented.
[0162] It should be clear that the computer-readable storage media in this application include permanent and non-permanent, removable and non-removable media that can be used to store information by any method or technology. Information can be computer-readable instructions, data structures, modules of programs or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technology, read-only compact disk read-only memory (CD-ROM), digital versatile disk (DVD) or other optical storage, magnetic cassettes, magnetic tape magnetic disk storage or other magnetic storage devices or any other non-transmission media that can be used to store information that can be accessed by a computing device. As defined herein, computer-readable media does not include transitory media such as modulated data signals and carrier waves.
[0163] In the above embodiments, the description of each embodiment has its own emphasis. For parts that are not described in detail in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.
[0164] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working processes of the methods, devices and equipment described above can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.
[0165] In the several embodiments provided in the embodiments of the present application, it should be understood that the disclosed devices, apparatuses and methods can be implemented in other ways. For example, the device embodiments described above are only schematic. For example, the division of the modules is only a logical function division. There may be other division methods in actual implementation, such as multiple modules or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be an indirect coupling or communication connection through some interfaces, devices or modules, which can be electrical, mechanical or other forms.
[0166] The modules described as separate components may or may not be physically separated, and the components shown as modules may or may not be physical modules, that is, they may be located in one place or distributed on multiple network modules. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of this embodiment.
[0167] In addition, each functional module in each embodiment of the present application can be integrated into a processing module, or each module can exist physically separately, or two or more modules can be integrated into one module. The above-mentioned integrated module can be implemented in the form of hardware or in the form of a software functional module. If the integrated module is implemented in the form of a software functional module and sold or used as an independent product, it can be stored in a computer-readable storage medium.
[0168] In the above embodiments, all or part of the embodiments may be implemented by software, hardware, firmware or any combination thereof. When implemented by software, all or part of the embodiments may be implemented in the form of a computer program product.
[0169] The computer program product includes one or more computer instructions. When the computer program is loaded and executed on a computer, the process or function described in the embodiment of the present application is generated in whole or in part. The computer may be a general-purpose computer, a special-purpose computer, a computer network, or other programmable devices. The computer instructions may be stored in a computer-readable storage medium, or transmitted from one computer-readable storage medium to another computer-readable storage medium. For example, the computer instructions may be transmitted from a website site, a computer, a server, or a data center by wired (e.g., coaxial cable, optical fiber, digital subscriber line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) mode to another website site, computer, server, or data center. The computer-readable storage medium may be any available medium that a computer can store or a data storage device such as a server or a data center that includes one or more available media integrations. The available medium may be a magnetic medium, (e.g., a floppy disk, a hard disk, a tape), an optical medium (e.g., a DVD), or a semiconductor medium (e.g., a solid-state hard disk Solid State Disk (SSD)), etc.
[0170] Although the embodiments of the present application have been shown and described, it will be appreciated by those skilled in the art that various changes, modifications, substitutions and variations may be made to the embodiments without departing from the principles and spirit of the present application, and that the scope of the present application is defined by the appended claims and their equivalents.
Claims
1. A multi-target scattering imaging method, characterized in that: The method comprises: Based on an imaging system, a speckle pattern formed by a fluorescent object hidden behind a scattering medium under different intensity distributions is obtained; the imaging system is pre-established; Acquiring a plurality of sub-target speckles based on the intensity distribution data of the speckle pattern; Based on the plurality of sub-target speckles, acquiring a plurality of sub-target images; The intensity distributions of the multiple sub-target speckles and the imaging areas of the multiple sub-target images are located to obtain the target image.
2. The multi-target scattering imaging method according to claim 1, characterized in that: The imaging system comprises a non-correlated light source (1), a beam splitter (3), a spatial light modulator (4), a speckle medium (5), a microscope (6) and a camera (7).
3. The multi-target scattering imaging method according to claim 2, characterized in that: The step of acquiring a plurality of sub-target speckles based on the intensity distribution data of the speckle pattern comprises: Acquiring area and intensity information when the spatial light modulator (4) performs structured light intensity modulation; Based on the camera (7), intensity distribution data of a plurality of speckle patterns modulated by the spatial light modulator (4) are acquired; Based on the intensity distribution data of the plurality of speckle patterns, a plurality of sub-target speckles are separately acquired.
4. The multi-target scattering imaging method according to any one of claims 1 to 3, characterized in that: The acquiring a plurality of sub-target images based on the plurality of sub-target speckles comprises: Based on the speckle autocorrelation technology, phase information of multiple sub-targets is obtained from the multiple sub-target speckles; Based on the phase information of the plurality of sub-targets, acquiring Fourier amplitude information of the plurality of sub-targets; Based on an iterative phase recovery algorithm and Fourier amplitude information of the plurality of sub-targets, phases corresponding to the speckles of the plurality of sub-targets are acquired; Based on the phases and amplitudes corresponding to the multiple sub-target speckles, multiple sub-target images are acquired.
5. The multi-target scattering imaging method according to claim 1, characterized in that: The method of positioning the intensity distributions of the multiple sub-target speckles and the imaging areas of the multiple sub-target images to obtain the target image includes: Based on the intensity information of the plurality of sub-target speckles, estimating the intensity distribution of the imaging area of the plurality of sub-target speckles; Based on a position estimation method related to a point spread function, the relative positions of the plurality of sub-targets are relocated to reconstruct the target image.
6. A multi-target scattering imaging device, characterized in that: include: An acquisition module, used for acquiring, based on an imaging system, a speckle pattern formed by a fluorescent object hidden behind a scattering medium under different intensity distributions; The imaging system is pre-established; A processing module, configured to obtain a plurality of sub-target speckles based on the intensity distribution data of the speckle pattern; and, based on the plurality of said sub-target speckles, acquiring a plurality of sub-target images; And, the intensity distributions of the multiple sub-target speckles and the imaging areas of the multiple sub-target images are located to acquire the target image.
7. The multi-target scattering imaging device according to claim 6, characterized in that: The acquisition module is also used to acquire the area and intensity information when the spatial light modulator (4) performs structured light intensity modulation; and, based on the camera (7), acquiring intensity distribution data of a plurality of speckle patterns modulated by the spatial light modulator (4); The processing module is further used to separately obtain a plurality of sub-target speckles based on the intensity distribution data of the plurality of speckle patterns.
8. The multi-target scattering imaging device according to claim 6 or 7, characterized in that: The processing module is also used to obtain phase information of multiple sub-targets from the multiple sub-target speckles based on the speckle autocorrelation technology; and, based on the phase information of the plurality of sub-targets, acquiring Fourier amplitude information of the plurality of sub-targets; And, based on an iterative phase recovery algorithm and Fourier amplitude information of the plurality of sub-targets, acquiring phases corresponding to the plurality of sub-target speckles; And, based on the phases and amplitudes corresponding to the plurality of sub-target speckles, a plurality of sub-target images are acquired.
9. A multi-target scattering imaging device, characterized in that: include: A reader, used for acquiring, based on an imaging system, a speckle pattern formed by a fluorescent object hidden behind a scattering medium under different intensity distributions; The imaging system is pre-established; A processor, configured to obtain a plurality of sub-target speckles based on the intensity distribution data of the speckle pattern; and, based on the plurality of said sub-target speckles, acquiring a plurality of sub-target images; And, the intensity distributions of the multiple sub-target speckles and the imaging areas of the multiple sub-target images are located to acquire the target image.
10. A computer-readable storage medium, characterized in that: A computer program is stored thereon, and when the computer program is executed by a processor, a multi-target scattering imaging method as claimed in any one of claims 1 to 5 is implemented.
Citation Information
Cited By
Method for carrying out single shooting imaging on target in thick scattering medium by using near-infrared light
CN119715455A
Wafer detection method and device
CN120609825A
Time-sharing modulation positioning method and device for multi-target optical imaging and electronic equipment
CN120668022A
