Compressive ultrafast holographic quantitative phase imaging method, system, device, and medium

By encoding and compressing multiple interference images of the sample, combined with deep denoising technology, the problems of unclear hologram sequence reconstruction and long running time in the existing technology are solved, and fast and efficient hologram reconstruction is achieved.

CN115857304BActive Publication Date: 2025-12-30WUYI UNIV
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202211661318.5
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2022-12-23
Publication Date
2025-12-30
Estimated Expiration
2042-12-23

AI Technical Summary

Technical Problem

Existing compressed ultrafast imaging techniques produce unclear outlines and fail to distinguish the boundaries between stripes when reconstructing holographic sequences. Furthermore, the reconstruction results lack robustness and have long processing times.

Method used

By encoding multiple interference images of the sample, coded images are obtained and compressed. Then, the undecoded interference images are obtained by inverse modeling with pre-initialized parameters. Iterative total variation image denoising is performed, and combined with depth denoising techniques, holographic sequence frames are reconstructed and phase reconstruction is carried out.

Benefits of technology

It accelerates the image reconstruction process, improves the robustness and clarity of the reconstruction results, ensures the accuracy of fringe reconstruction, and shortens the running time.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN115857304B_ABST
    Figure CN115857304B_ABST
Patent Text Reader

Abstract

Embodiments of the present application provide a compressed ultrafast holographic quantitative phase imaging method, system, device and medium; wherein the method obtains an encoded image by encoding processing a plurality of interference images of a sample; obtains a two-dimensional compressed hologram of the sample by compressing the encoded image; obtains an undecoded interference image by inverse modeling of pre-initialized parameters from the two-dimensional compressed hologram; obtains a first denoised image by iterative multiple total variation image denoising processing of the undecoded interference image; reconstructs a hologram sequence frame by depth denoising processing of the first denoised image; obtains a phase image of the sample by phase reconstruction of the hologram sequence frame; and inserts the trained depth denoiser into the image reconstruction framework to speed up the image reconstruction process by depth denoising and achieve good image reconstruction effect.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The embodiments of this application relate to, but are not limited to, the field of image processing technology, and particularly to compressed ultrafast holographic quantitative phase imaging methods, systems, devices, and media. Background Technology

[0002] Holographic imaging is a technique that uses the principles of interference and diffraction to record and reproduce a true three-dimensional image of an object. Most existing compressed ultrafast imaging methods use a two-step iterative shrinkage / thresholding (TwIST) algorithm to obtain image sequences from images captured by a streak camera. The TV regularization term is used as a denoising step in TwIST within compressed ultrafast imaging. However, due to the inherent characteristics of the TV regularization term, the reconstruction results lack robustness as the number of reconstructed frames increases, and the sequence reconstruction takes a long time. While augmented Lagrangian function and alternating minimization (TVAL3) methods outperform TwIST in terms of image reconstruction quality and sequence reconstruction time, when reconstructing holographic sequences, the complex structure of the hologram leads to unclear outlines in the reconstructed stripes, making it impossible to distinguish the boundaries between stripes. Summary of the Invention

[0003] The following is an overview of the subject matter described in detail herein. This overview is not intended to limit the scope of the claims.

[0004] The embodiments of this application aim to at least solve one of the technical problems existing in the prior art. The embodiments of this application provide a compressed ultrafast holographic quantitative phase imaging method, system, device and medium, which accelerates the image reconstruction process through deep denoising.

[0005] An embodiment of the first aspect of this application provides a compressed ultrafast holographic quantitative phase imaging method, comprising:

[0006] Encoded images are obtained by encoding multiple interference images of the sample;

[0007] The encoded image is compressed to obtain a two-dimensional compressed hologram of the sample;

[0008] The undecoded interference image is obtained by inverse modeling the two-dimensional compressed hologram using a pre-initialized parameter inverse model;

[0009] The undecoded interference image is subjected to iterative total variation image denoising processing multiple times to obtain the first denoised image;

[0010] The first denoised image is subjected to deep denoising processing to reconstruct a holographic sequence frame;

[0011] Phase reconstruction is performed on the hologram sequence frames to obtain the phase image of the sample.

[0012] In certain embodiments of the first aspect of this application, the encoding process of multiple interferometric images of a sample to obtain an encoded image includes:

[0013] The light generated by the light source is passed through the sample to obtain multiple interference patterns of the sample;

[0014] The multiple interferometric images of the sample are encoded by passing them through a mask loaded with the encoding matrix to obtain the encoded image.

[0015] In certain embodiments of the first aspect of this application, the step of performing phase reconstruction on the holographic sequence frames to obtain a phase image of the sample includes:

[0016] Perform a Fourier transform on the hologram sequence frames to obtain the spectral distribution of the hologram;

[0017] Based on the spectral distribution, the object light is propagated from the hologram plane to the object plane where the sample is located to obtain the spatial distribution of the hologram;

[0018] The spatial distribution is subjected to phase extraction processing to obtain a wrapped phase, and the wrapped phase is subjected to unwrapping processing to obtain an unfolded phase;

[0019] The unfolded phase is subjected to phase distortion removal processing to obtain the phase image of the sample.

[0020] In certain embodiments of the first aspect of this application, the phase extraction process is represented by the following formula: in, For the wrapped phase, I f It is spatially distributed.

[0021] According to a second aspect of this application, a compressed ultrafast holographic quantitative phase imaging system includes a light source, a mask, an image capturing device, and an image processing device, wherein the light generated by the light source first passes through the mask and then enters the image capturing device;

[0022] The mask is loaded with an encoding matrix, and the mask is used to encode multiple interference images of the sample to obtain an encoded image;

[0023] The image capturing device is used to compress the coded image to obtain a compressed hologram of the sample;

[0024] The image processing device is configured to obtain an undecoded interference image from the two-dimensional compressed hologram by inverse modeling with pre-initialized parameters, perform iterative multiple total variation image denoising on the undecoded interference image to obtain a first denoised image, perform depth denoising on the first denoised image to reconstruct a hologram sequence frame, and perform phase reconstruction on the hologram sequence frame to obtain a phase image of the sample.

[0025] In certain embodiments of the second aspect of this application, the encoding process of multiple interference images of a sample to obtain an encoded image specifically involves: passing light generated by a light source through the sample to obtain multiple interference images of the sample; and encoding the multiple interference images of the sample through a mask loaded with the encoding matrix to obtain the encoded image.

[0026] In certain embodiments of the second aspect of this application, the step of performing phase reconstruction on the hologram sequence frames to obtain a phase image of the sample specifically involves: performing a Fourier transform on the hologram sequence frames to obtain the spectral distribution of the hologram; propagating the object light from the hologram plane to the object plane where the sample is located according to the spectral distribution to obtain the spatial distribution of the hologram; performing phase extraction processing on the spatial distribution to obtain a wrapped phase; performing unwrapping processing on the wrapped phase to obtain an unfolded phase; and performing phase distortion removal processing on the unfolded phase to obtain a phase image of the sample.

[0027] In certain embodiments of the second aspect of this application, the phase extraction process is represented by the following formula: in, For the wrapped phase, I f It is spatially distributed.

[0028] According to a third aspect of this application, an electronic device includes: a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor executes the computer program to implement the compressed ultrafast holographic quantitative phase imaging method as described above.

[0029] According to a fourth aspect of this application, a computer-readable storage medium stores computer-executable instructions for performing the compressed ultrafast holographic quantitative phase imaging method as described above.

[0030] The embodiments of this application obtain encoded images by encoding multiple interference images of the sample; compress the encoded images to obtain a two-dimensional compressed hologram of the sample; obtain an undecoded interference image by inverse modeling the two-dimensional compressed hologram using a pre-initialized parameter inverse model; perform iterative multiple total variation image denoising on the undecoded interference image to obtain a first denoised image; perform deep denoising on the first denoised image to reconstruct a hologram sequence frame; perform phase reconstruction on the hologram sequence frame to obtain a phase image of the sample; and utilize a trained deep denoiser and insert it into the image reconstruction framework to accelerate the image reconstruction process and achieve excellent image reconstruction results. Attached Figure Description

[0031] The accompanying drawings are used to provide a further understanding of the technical solutions of this application and constitute a part of the specification. They are used together with the embodiments of this application to explain the technical solutions of this application and do not constitute a limitation on the technical solutions of this application.

[0032] Figure 1 This is a flowchart illustrating the steps of the compressed ultrafast holographic quantitative phase imaging method provided in the embodiments of this application;

[0033] Figure 2 This is a sub-step diagram of step S600;

[0034] Figure 3 This is a structural diagram of the compressed ultrafast holographic quantitative phase imaging system provided in the embodiments of this application;

[0035] Figure 4 This is a schematic diagram of the interference pattern of the sample;

[0036] Figure 5 This is a schematic diagram of a holographic sequence frame;

[0037] Figure 6 This is a schematic diagram of the phase image of the sample. Detailed Implementation

[0038] To make the objectives, technical solutions, and advantages of this application clearer, the following detailed description is provided in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative and not intended to limit the scope of this application.

[0039] It should be noted that although functional modules are divided in the device schematic diagram and a logical order is shown in the flowchart, in some cases, the steps shown or described may be performed in a different order than the module division in the device or the order in the flowchart. The terms "first," "second," etc., in the specification, claims, or the aforementioned drawings are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence.

[0040] The embodiments of this application will be further described below with reference to the accompanying drawings.

[0041] Holographic technology is a technique that uses the principles of interference and diffraction to record and reproduce a true three-dimensional image of an object. Holographic imaging technology is also known as virtual imaging technology or holographic imaging. Its imaging principle is to record the phase and amplitude of the light waves of an object by means of light wave interference, and at the same time, to display the light wave information of the object by means of diffraction, thereby achieving the effect of imaging.

[0042] This application provides a compressed ultrafast holographic quantitative phase imaging system. (Refer to...) Figure 3 The compressed ultrafast holographic quantitative phase imaging system includes a light source 100, a mask 300, an image capturing device 400, and an image processing device 500.

[0043] The light source 100 comprises a femtosecond laser, an attenuator, and multiple reflectors. The femtosecond laser generates a laser with a power of 1300mW and a wavelength of 800nm. The attenuator has a 0.05% output port. In this embodiment, the laser is reflected by three reflectors; however, in other embodiments, other numbers of reflectors can be used to reflect the laser to adjust the optical path, depending on actual needs.

[0044] The laser light generated by the femtosecond laser enters the dark chamber. Inside the dark chamber, the light path passes through a beam expander and a collimator, then is split into two paths by a first beam splitter 200. One path passes through the sample as the object light and then strikes the second beam splitter 200; the other path serves as the reference light and strikes the second beam splitter 200 directly. The object light and reference light pass through a 75mm lens and enter the first 4f optical system. After leaving the first 4f optical system, they pass through a 100mm lens, then through a mask 300 loaded with an encoding matrix for encoding. After passing through another 100mm lens, they enter the second 4f optical system, and after leaving the second 4f optical system, they pass through a 150mm lens. The object light and reference light then enter the image capturing device 400.

[0045] The image capturing device 400 includes a fringe camera and a CCD device. The slit of the fringe camera is fully open, and the fringe camera cuts out a dynamic scene. The CCD device captures the cut-out dynamic scene to obtain a compressed hologram of the sample. Two beams of light interfere with each other when superimposed on a photosensitive element such as the CCD device. The degree of light sensitivity at each point on the photosensitive element varies not only with intensity but also with the phase relationship between the two beams. The sample forms a diffuse object beam under partial laser irradiation; another portion of the laser beam, as a reference beam, strikes the photosensitive element and interferes with the object beam, converting the phase and amplitude of each point on the object beam into spatially varying intensity. Thus, the contrast and spacing between the interference fringes are used to record all the information of the object beam. After development, fixing, and other processing procedures, the photosensitive element recording the interference fringes forms a hologram.

[0046] The image processing device 500 is configured to obtain an undecoded interference image from the two-dimensional compressed hologram by inverse modeling with pre-initialized parameters, perform iterative multiple total variation image denoising on the undecoded interference image to obtain a first denoised image, perform depth denoising on the first denoised image to reconstruct a hologram sequence frame, and perform phase reconstruction on the hologram sequence frame to obtain a phase image of the sample.

[0047] It is understandable that a hologram sequence frame is a series of holograms reconstructed from a single compressed hologram.

[0048] That is, for the compressed ultrafast holographic quantitative phase imaging system, the following compressed ultrafast holographic quantitative phase imaging method is adopted. (Refer to...) Figure 1 The compressed ultrafast holographic quantitative phase imaging method includes, but is not limited to, the following steps:

[0049] Step S100: Encode multiple interference images of the sample to obtain encoded images;

[0050] Step S200: Compress the coded image to obtain a two-dimensional compressed hologram of the sample;

[0051] Step S300: Obtain the undecoded interference image by inverse modeling the two-dimensional compressed hologram using the pre-initialized parameters;

[0052] Step S400: Perform iterative total variation image denoising on the undecoded interference image to obtain the first denoised image;

[0053] Step S500: Perform depth denoising processing on the first denoised image to reconstruct a hologram sequence frame;

[0054] Step S600: Phase reconstruction is performed on the hologram sequence frames to obtain the phase image of the sample.

[0055] In step S100, the laser beam generated by the femtosecond laser is split into two optical paths by the beam splitter 200. One optical path passes through the sample as the object beam, and the other optical path serves as the reference beam. The object beam contains information from multiple images of the sample, i.e., multiple interference patterns of the sample. Figure 4 This is a schematic diagram of the interference images of the sample. Multiple images of the sample change over time, forming a dynamic scene. The object beam passes through a mask 300 loaded with an encoding matrix, thereby encoding multiple images of the sample to obtain an encoded image.

[0056] The object light and the reference light undergo optical processing through two different 4f optical systems before entering the mask 300 and after leaving the mask 300.

[0057] In step S200, the fringe camera cropped the coded image, and the CCD device captured and compressed the cropped dynamic scene to obtain a compressed hologram of the sample. In this process, the reference light and object light are superimposed to generate interference, converting the phase and amplitude of each point on the object light into spatially varying intensities. Thus, the contrast and spacing between the interference fringes are used to record all the information of the object light, resulting in the compressed hologram.

[0058] For steps S300 to S500, a method for solving the inverse problem is used to obtain the holographic sequence frames from the two-dimensional compressed holograms of the samples. The basic idea of ​​this method is to use a pre-trained denoiser as prior knowledge for the desired signal; it is based on an optimization-based recovery method, which transforms the entire inverse problem into several easier-to-solve subproblems by separately processing the forward model (data fidelity) term and the prior term and iteratively solving the solutions to the subproblems.

[0059] Recovering a 3D hologram from a 2D compressed image is an ill-posed linear inverse problem. Sub-Nyquist sampling and reliable recovery can be achieved through constraints on the sampling / sensing matrix and appropriate prior knowledge of the signal.

[0060] In this system, considering that multiple interferometric images X of the sample are modulated and compressed by the encoding matrix C, the measurement Y can be expressed as... The measurement Y is the observed image recorded by the streak camera. Here, B is the number of encoding matrices, b∈B, and Z is noise. Mathematically, the measurement can be expressed as y=Hx+z, y=Vec(Y), z=Vec(Z), x=Vec(X)=[Vec(X1)] T ,...,Vec(X b ) T ] T .

[0061] For the inversion problem of the system, maximum a posteriori probability (MAP) estimation is used, given the measurement y and the forward model (likelihood function p). y|xIf we use this to estimate the unknown signal x, it can be modeled as follows:

[0062] Assuming the measured additive white Gaussian noise (AWGN) is, then the above formula can be written as:

[0063]

[0064] By replacing the unknown noise variance σ with a noise balance factor λ and a negative logarithmic prior function P x If we define a function (x) and constrain the optimization problem with a regularization term R(x), then the above expression can be written as:

[0065] In the system, A = TSC; T represents the time-space integration operator over the exposure time of the external CCD of the streak camera, S represents the time shearing operator in the vertical direction, and C is the encoding operator from the mask. Based on the given operator TSC and the sparsity of the dynamic scene, image reconstruction can be achieved by solving the optimization problem of the above formula.

[0066] The undecoded interference image is subjected to iterative total variation image denoising processing multiple times to obtain the first denoised image.

[0067]

[0068]

[0069] Solving the above formula, we get: u k+1 =u k +(x k+1 -z k+1 ).

[0070] Where u is the residual variable, ρ is the penalty factor, and k is the number of iterations.

[0071] The solution is as follows: is the estimated noise standard deviation of the k-th iteration, and D is the denoiser; the noise penalty factor is adjusted to match the Gaussian noise during measurement.

[0072] The first denoised image is subjected to depth denoising processing to reconstruct a holographic sequence frame; (Refer to...) Figure 5 , Figure 5 This is a schematic diagram of a holographic sequence frame. The key to using a deep learning denoiser as a prior lies in the flexibility regarding data size and input noise level. According to... The denoiser should be adaptable to different input noise levels. A pre-trained deep learning denoiser is used to reconstruct the holographic sequence frames. The deep learning denoiser can denoise the image frame by frame, accelerating the image reconstruction process.

[0073] Reference Figure 2 For step S600, phase reconstruction is performed on the hologram to obtain the phase image of the sample, including but not limited to the following steps:

[0074] Step S610: Perform Fourier transform on the hologram sequence frames to obtain the spectral distribution of the hologram;

[0075] Step S620: Based on the spectral distribution, propagate the object light from the hologram plane to the object plane where the sample is located to obtain the spatial distribution of the hologram;

[0076] Step S630: Perform phase extraction processing on the spatial distribution to obtain the wrapped phase, and perform unwrapping processing on the wrapped phase to obtain the unfolded phase;

[0077] Step S640: Perform phase distortion removal processing on the unfolded phase to obtain the phase image of the sample.

[0078] For step S620, information from the +1 level image is extracted from the spectral distribution using a filter, and the +1 level image is moved to the origin of the spectrum using the spectral center method. Then, an inverse Fourier transform is performed to convert it into the spatial domain, obtaining the spatial distribution of the hologram. A numerical propagation algorithm is needed to propagate the object light from the hologram plane back to the object plane where the object itself is located; the numerical propagation algorithm typically uses the angular spectrum method.

[0079] For step S630, phase extraction processing is performed on the spatial distribution to obtain a wrapped phase, and the wrapped phase is unwrapped to obtain a continuous phase distribution, i.e., an expanded phase. The phase extraction processing is represented by the following formula: in, For the wrapping phase, I f It is spatially distributed.

[0080] For step S640, phase distortion correction is performed on the spatial distribution. Phase distortion correction typically employs off-axis tilt distortion to obtain the accurate original phase distribution of the sample, i.e., the phase image of the sample. (Refer to...) Figure 6 , Figure 6 This is a schematic diagram of the phase image of the sample.

[0081] Embodiments of this application also provide an electronic device. The electronic device includes a memory, a processor, a program stored in the memory and executable on the processor, and a data bus for enabling communication between the processor and the memory. When the program is executed by the processor, it implements the compressed ultrafast holographic quantitative phase imaging method described above.

[0082] This electronic device can be any smart terminal, including tablet computers, in-vehicle computers, etc.

[0083] In general, for the hardware structure of electronic devices, the processor can be implemented using a general-purpose CPU (Central Processing Unit), microprocessor, application-specific integrated circuit (ASIC), or one or more integrated circuits, to execute relevant programs and implement the technical solutions provided in the embodiments of this application.

[0084] The memory can be implemented in the form of read-only memory (ROM), static storage device, dynamic storage device, or random access memory (RAM). The memory can store the operating system and other applications. When the technical solutions provided in the embodiments of this specification are implemented through software or firmware, the relevant program code is stored in the memory and is called and executed by the processor to execute the compressed ultrafast holographic quantitative phase imaging method of the embodiments of this application.

[0085] Input / output interfaces are used to implement information input and output.

[0086] The communication interface is used to enable communication and interaction between this device and other devices. Communication can be achieved through wired means (such as USB, Ethernet cable, etc.) or wireless means (such as mobile network, WIFI, Bluetooth, etc.).

[0087] The bus transmits information between various components of a device, such as the processor, memory, input / output interfaces, and communication interfaces. The processor, memory, input / output interfaces, and communication interfaces communicate with each other within the device via the bus.

[0088] Embodiments of this application provide a computer-readable storage medium. The computer-readable storage medium stores computer-executable instructions for causing a computer to perform the compressed ultrafast holographic quantitative phase imaging method as described above.

[0089] It will be understood by those skilled in the art that all or some of the steps and systems in the methods disclosed above can be implemented as software, firmware, hardware, and suitable combinations thereof. Some or all of the physical components can be implemented as software executed by a processor, such as a central processing unit, digital signal processor, or microprocessor, or as hardware, or as an integrated circuit, such as an application-specific integrated circuit. Such software can be distributed on a computer-readable medium, which can include computer storage media (or non-transitory media) and communication media (or transient media). As is known to those skilled in the art, the term computer storage media includes volatile and non-volatile, removable and non-removable media implemented in any method or technology for storing information (such as computer-readable instructions, data structures, program modules, or other data). Computer storage media includes, but is not limited to, RAM, ROM, EEPROM, flash memory or other memory technologies, CD-ROM, digital versatile disc (DVD) or other optical disc storage, magnetic cartridges, magnetic tape, disk storage or other magnetic storage devices, or any other medium that can be used to store desired information and is accessible to a computer. Furthermore, it is well known to those skilled in the art that communication media typically contain computer-readable instructions, data structures, program modules, or other data in modulated data signals such as carrier waves or other transmission mechanisms, and may include any information delivery medium. In the foregoing description of this specification, references to terms such as "one embodiment," "another embodiment," or "some embodiments" indicate that a specific feature, structure, material, or characteristic described in connection with an embodiment or example is included in at least one embodiment or example of this application. In this specification, illustrative expressions of the above terms do not necessarily refer to the same embodiment or example. Moreover, the specific features, structures, materials, or characteristics described may be combined in any suitable manner in one or more embodiments or examples.

[0090] Those skilled in the art will understand that all or some of the steps in the methods disclosed above, as well as the functional modules / units in the systems and devices, can be implemented as software, firmware, hardware, or suitable combinations thereof.

[0091] The units described above as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the units can be selected to achieve the purpose of this embodiment according to actual needs.

[0092] Furthermore, the functional units in the various embodiments of this application can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The integrated unit can be implemented in hardware or as a software functional unit.

[0093] If the integrated unit is implemented as a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, or all or part of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes multiple instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute all or part of the steps of the methods of the various embodiments of this application. The aforementioned storage medium includes various media capable of storing programs, such as USB flash drives, portable hard drives, read-only memory (ROM), random access memory (RAM), magnetic disks, or optical disks.

[0094] In the several embodiments provided in this application, it should be understood that the disclosed apparatus and methods can be implemented in other ways. For example, the apparatus embodiments described above are merely illustrative; for instance, the division of the units described above is only a logical functional division, and in actual implementation, there may be other division methods. For example, multiple units or components may be combined or integrated into another system, or some features may be ignored or not executed. Furthermore, the coupling or direct coupling or communication connection shown or discussed may be through some interfaces; the indirect coupling or communication connection between apparatuses or units may be electrical, mechanical, or other forms.

[0095] Although embodiments of this application have been shown and described, those skilled in the art will understand that various changes, modifications, substitutions and variations can be made to these embodiments without departing from the principles and spirit of this application, the scope of which is defined by the embodiments and their equivalents.

[0096] The above is a detailed description of the preferred embodiments of this application, but this application is not limited to the embodiments. Those skilled in the art can make various equivalent modifications or substitutions without departing from the spirit of this application, and these equivalent modifications or substitutions are all included within the scope defined in this embodiment.

Claims

1. A compressed ultrafast holographic quantitative phase imaging method, comprising: encoding a plurality of interference images of a sample to obtain an encoded image, the plurality of interference images of the sample forming a dynamic scene over time; compressing the encoded image to obtain a two-dimensional compressed hologram of the sample; back-solving the two-dimensional compressed hologram to obtain an undecoded interference image by using a reverse model of pre-initialized parameters; iteratively performing a plurality of total variation image denoising processes on the undecoded interference image to obtain a first denoised image; performing a deep denoising process on the first denoised image to reconstruct a hologram sequence frame; reconstructing a phase image of the sample by performing a phase reconstruction on the hologram sequence frame.

2. The compressive ultrafast holographic quantitative phase imaging method of claim 1, wherein, The encoding of the plurality of interference images of the sample to obtain the encoded image comprises: passing light generated by a light source through the sample to obtain the plurality of interference images of the sample; encoding the plurality of interference images of the sample by passing the plurality of interference images through a mask plate loaded with an encoding matrix to obtain the encoded image.

3. The compressive ultrafast holographic quantitative phase imaging method of claim 1, wherein, The phase reconstruction of the hologram sequence frame to obtain the phase image of the sample comprises: performing a Fourier transform on the hologram sequence frame to obtain a frequency spectrum distribution of the hologram; propagating an object light from a hologram plane to an object plane where the sample is located according to the frequency spectrum distribution to obtain a spatial distribution of the hologram; performing a phase extraction process on the spatial distribution to obtain a wrapped phase, and performing an unwrapping process on the wrapped phase to obtain an unwrapped phase; performing a de-phase distortion process on the unwrapped phase to obtain the phase image of the sample.

4. The compressive ultrafast holographic quantitative phase imaging method of claim 3, wherein, The phase extraction process is represented by the following equation: wherein, is the wrapped phase, is the spatial distribution.

5. A compressive ultrafast holographic quantitative phase imaging system, comprising: The apparatus comprises a light source, a mask plate, an image capturing device, and an image processing device; the light generated by the light source first passes through the mask plate and then enters the image capturing device; The mask plate is loaded with an encoding matrix, and the mask plate is used to encode a plurality of interference images of a sample to obtain an encoded image, the plurality of interference images of the sample forming a dynamic scene over time; The image capturing device is used to compress the encoded image to obtain a compressed hologram of the sample; The image processing device is configured to back-solve a two-dimensional compressed hologram to obtain an undecoded interference image by using a reverse model of pre-initialized parameters, iteratively perform a plurality of total variation image denoising processes on the undecoded interference image to obtain a first denoised image, perform a deep denoising process on the first denoised image to reconstruct a hologram sequence frame, and reconstruct a phase image of the sample by performing a phase reconstruction on the hologram sequence frame.

6. The compressive ultrafast holographic quantitative phase imaging system of claim 5, wherein, The encoding of the plurality of interference images of the sample to obtain the encoded image specifically comprises: passing light generated by a light source through the sample to obtain the plurality of interference images of the sample; and encoding the plurality of interference images of the sample by passing the plurality of interference images through a mask plate loaded with the encoding matrix to obtain the encoded image.

7. The compressive ultrafast holographic quantitative phase imaging system of claim 5, wherein, The phase reconstruction is performed on the hologram sequence frames to obtain a phase image of the sample, specifically, Fourier transform is performed on the hologram sequence frames to obtain a frequency spectrum distribution of the hologram; according to the frequency spectrum distribution, the object light is propagated from a hologram plane to an object plane where the sample is located to obtain a spatial distribution of the hologram; phase extraction processing is performed on the spatial distribution to obtain a wrapped phase, unwrapping processing is performed on the wrapped phase to obtain an unwrapped phase; and de-phase distortion processing is performed on the unwrapped phase to obtain the phase image of the sample.

8. The compressive ultrafast holographic quantitative phase imaging system of claim 7, wherein, The phase extraction process is represented by the following equation: wherein, is the wrapped phase, is the spatial distribution.

9. An electronic device comprising: The memory, the processor and the computer program stored in the memory and executable on the processor, wherein the processor executes the computer program to implement the compressed ultrafast holographic quantitative phase imaging method according to any one of claims 1 to 4.

10. A computer-readable storage medium, characterized in that, Computer executable instructions are stored, and the computer executable instructions are used to execute the compressed ultrafast holographic quantitative phase imaging method according to any one of claims 1 to 4.

Citation Information

Patent Citations

  • Quantitative phase imaging method based on Hilbert transform phase demodulation and BM3D denoising

    CN114359097A

  • Ultrafast holographic imaging method and system, electronic equipment and storage medium

    CN115348434A