Photoacoustic microscopy imaging device and method
By using an optical phase-shaping element in a photoacoustic microscopy device to convert the detection beam into a target phase delay mode, the problem of low axial resolution in photoacoustic microscopy is solved, achieving higher axial resolution and 3D image quality.
Patent Information
- Application Number
- CN202411056910.1
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2024-08-02
- Publication Date
- 2024-11-19
- Estimated Expiration
- 2044-08-02
AI Technical Summary
The low axial resolution in photoacoustic microscopy limits the effectiveness of three-dimensional imaging.
By deploying optical phase shaping elements, the detection beam is converted into a target phase delay mode, so that the cross-correlation coefficient of the point spread function at adjacent axial positions is lower than a preset threshold, and a three-dimensional image is generated using a multi-period point spread function.
It improves the axial resolution of photoacoustic microscopy, enhances the spatial resolution and contrast of three-dimensional images, and maintains the signal-to-noise ratio.
Smart Images

Figure CN118583782B_ABST
Abstract
Description
Technical Field
[0001] The present disclosure relates to the field of microscopic imaging technology, and in particular to a photoacoustic microscopic imaging device and method. Background Art
[0002] Photoacoustic microscopy is a high-resolution microscopic imaging technology that combines optical imaging and acoustic imaging. It has a wide range of applications in the biomedical field, especially in the imaging of living tissues, such as the structural and functional imaging of biological microcirculatory networks. It uses laser pulses to excite samples to generate sound waves, and then uses detectors to capture the information of these sound waves. By measuring the propagation time and amplitude of the sound waves, the three-dimensional structural distribution of biological tissues can be reconstructed.
[0003] In order to obtain microvascular network information, a sufficiently high resolution is required. However, the three-dimensional spatial resolution of traditional photoacoustic microscopy is uneven. Photoacoustic microscopy has high performance in lateral resolution, but the axial resolution is limited by the detection bandwidth of the ultrasonic transducer, the imaging tailing effect, and other issues, and is usually 1 to 2 orders of magnitude lower than the lateral resolution. Summary of the invention
[0004] The embodiments of the present disclosure at least provide a photoacoustic microscopy imaging device and method for solving the problem of low axial resolution in photoacoustic microscopy imaging.
[0005] In a first aspect, an embodiment of the present disclosure provides a photoacoustic microscopic imaging device, the device comprising a light beam emitting component, an optical phase shaping element, an acoustic wave receiving component, and an imaging component;
[0006] The light beam emitting assembly is used to emit a detection light beam for the object to be imaged;
[0007] The optical phase shaping element is used to convert the detection light beam into a target phase delay mode; the point spread function corresponding to the detection light beam in the target phase delay mode has a plurality of periods; each point spread function slice under the period is used to distinguish the axial position of the detection light beam; the mutual correlation coefficient of the point spread function at adjacent axial positions is lower than a preset threshold;
[0008] The acoustic wave receiving component is used to receive the acoustic wave signal generated by the object to be imaged being affected by the detection light beam in the target phase delay mode;
[0009] The imaging component is used to convert the acoustic wave signal into a three-dimensional image corresponding to the object to be imaged based on the point spread function.
[0010] In an optional implementation, the optical phase shaping element includes a phase mask or a spatial light modulator.
[0011] In an optional implementation, the point spread function corresponding to the detection light beam in the target phase delay mode is a multi-period spiral structure.
[0012] In an optional embodiment, the texture of the optical phase shaping element includes a plurality of Laguerre-Gaussian rings.
[0013] In an optional implementation manner, the phase distribution corresponding to the optical phase shaping element is determined by the following steps:
[0014] Optimizing the average Cramer-Rao lower bound CRLB of the axial position along the detection beam within a preset depth of field and the sum of normalized cross-correlation coefficients between adjacent slices to obtain proportional coefficient values of Laguerre-Gaussian polynomials of each order of the CRLB after optimization;
[0015] Based on the proportional coefficient value, a phase distribution corresponding to the optical phase shaping element is determined.
[0016] In an optional implementation manner, the imaging component is specifically used for:
[0017] Determining coordinates of a plurality of imaging points in the object to be imaged based on the point spread function and the acoustic wave signal;
[0018] Based on the coordinates of each of the imaging points, a three-dimensional image corresponding to the object to be imaged is determined.
[0019] In an optional embodiment, the coordinates of the plurality of imaging points in the object to be imaged are and the acoustic signal Satisfies the following formula:
[0020] ;
[0021] Wherein, x represents the coordinate of the acoustic wave signal on the horizontal axis of the preset coordinate system, y represents the coordinate of the acoustic wave signal on the vertical axis of the preset coordinate system, t represents the time when the acoustic wave signal is received, c represents the propagation speed of the acoustic wave signal in the imaging medium, and z represents the axial coordinate of the acoustic wave signal in the preset coordinate system. represents the time series of the impulse response of the sound wave receiving component, represents the focused spot stack set of the detection beam in the target phase delay mode, n represents noise, represents the temporal convolution on (x,y), represents a two-dimensional convolution at a certain depth on (x,y); where z = t·c.
[0022] In an optional implementation manner, the noise is determined by the following steps:
[0023] Generate an image to be denoised based on the sound wave signal, and determine a plurality of noise level images corresponding to the image to be denoised;
[0024] The image to be denoised and the noise level image are input into a pre-trained neural network model to obtain the noise corresponding to the sound wave signal.
[0025] In an optional implementation manner, the imaging component is specifically used for:
[0026] Deconvolution calculation is performed based on the improved fast iterative shrinkage threshold algorithm FISTA and the formula to determine the coordinates of multiple imaging points in the object to be imaged.
[0027] In an optional implementation manner, the imaging component is specifically used for:
[0028] Based on the neural network regularization factor and the point spread function, the acoustic wave signal is converted into a three-dimensional image corresponding to the object to be imaged.
[0029] In a second aspect, the present disclosure also provides a photoacoustic microscopy method, which is applied to the photoacoustic microscopy device in the first aspect or any one of the embodiments of the first aspect, the method comprising:
[0030] emitting a detection beam directed to an object to be imaged;
[0031] The detection beam is converted into a target phase delay mode; the point spread function corresponding to the detection beam in the target phase delay mode has a plurality of periods; each point spread function slice in the period is used to distinguish the axial position of the detection beam;
[0032] receiving an acoustic wave signal generated by the object to be imaged being affected by the detection light beam in a target phase delay mode;
[0033] Based on the point spread function, the acoustic wave signal is converted into a three-dimensional image corresponding to the object to be imaged.
[0034] In a third aspect, an embodiment of the present disclosure further provides an electronic device, comprising: a processor, a memory and a bus, wherein the memory stores machine-readable instructions executable by the processor, and when the electronic device is running, the processor and the memory communicate via the bus, and when the machine-readable instructions are executed by the processor, the steps in the above-mentioned second aspect are performed.
[0035] In a fourth aspect, an embodiment of the present disclosure further provides a computer-readable storage medium, on which a computer program is stored, and when the computer program is executed by a processor, the steps in the above-mentioned second aspect are executed.
[0036] The photoacoustic microscopy imaging device and method provided by the embodiments of the present disclosure convert a detection light beam into a target phase delay pattern by deploying an optical phase shaping element, so that the point spread function corresponding to the detection light beam has multiple periods, and the cross-correlation coefficient of the point spread function at adjacent axial positions is lower than a preset threshold, so that the detection light beam has obvious differences in axial position, and then generates a three-dimensional image based on the point spread function and the acoustic wave signal converted from the detection light beam, thereby improving the axial resolution of the three-dimensional image.
[0037] In order to make the above-mentioned objectives, features and advantages of the present disclosure more obvious and easy to understand, preferred embodiments are specifically cited below and described in detail with reference to the attached drawings. BRIEF DESCRIPTION OF THE DRAWINGS
[0038] In order to more clearly illustrate the technical solutions of the embodiments of the present disclosure, the following is a brief introduction to the drawings required for use in the embodiments. The drawings herein are incorporated into the specification and constitute a part of the specification. These drawings illustrate embodiments consistent with the present disclosure and are used together with the specification to illustrate the technical solutions of the present disclosure. It should be understood that the following drawings only illustrate certain embodiments of the present disclosure and should not be regarded as limiting the scope. For ordinary technicians in this field, other relevant drawings can also be obtained based on these drawings without creative work.
[0039] Figure 1 A schematic diagram of a photoacoustic microscopy imaging device provided by an embodiment of the present disclosure is shown;
[0040] Figure 2 A schematic diagram showing the phase distribution of the optical phase shaping element provided by an embodiment of the present disclosure;
[0041] Figure 3 The discrete processing texture layout of the mask provided by the embodiment of the present disclosure is shown;
[0042] Figure 4 A physical diagram of mask processing provided by an embodiment of the present disclosure is shown;
[0043] Figure 5 A flow chart of a photoacoustic microscopy method provided by an embodiment of the present disclosure is shown;
[0044] Figure 6 A schematic diagram of an electronic device provided by an embodiment of the present disclosure is shown. DETAILED DESCRIPTION
[0045] In order to make the purpose, technical scheme and advantages of the embodiments of the present disclosure clearer, the technical scheme in the embodiments of the present disclosure will be clearly and completely described below in conjunction with the drawings in the embodiments of the present disclosure. Obviously, the described embodiments are only part of the embodiments of the present disclosure, rather than all of the embodiments. The components of the embodiments of the present disclosure generally described and shown in the drawings here can be arranged and designed in various different configurations. Therefore, the following detailed description of the embodiments of the present disclosure provided in the drawings is not intended to limit the scope of the present disclosure for protection, but merely represents the selected embodiments of the present disclosure. Based on the embodiments of the present disclosure, all other embodiments obtained by those skilled in the art without making creative work belong to the scope of protection of the present disclosure.
[0046] It should be noted that similar reference numerals and letters denote similar items in the following drawings, and therefore, once an item is defined in one drawing, further definition and explanation thereof is not required in subsequent drawings.
[0047] The term "and / or" herein only describes an association relationship, indicating that three relationships may exist. For example, A and / or B may represent the following three situations: A exists alone, A and B exist at the same time, and B exists alone. In addition, the term "at least one" herein represents any combination of at least two of any one or more of a plurality of. For example, including at least one of A, B, and C may represent including any one or more elements selected from the set consisting of A, B, and C.
[0048] To facilitate understanding of the disclosed embodiments, the photoacoustic microscopy technique is first explained. Photoacoustic microscopy is a high-resolution microscopy technique that combines optical imaging and acoustic imaging. It uses laser pulses to excite samples to generate sound waves, and then uses detectors to capture the information of these sound waves. By measuring the propagation time and amplitude of the sound waves, high-resolution images can be generated.
[0049] This technology has a wide range of applications in the biomedical field, especially in the imaging of living tissues. Since sound waves are almost unaffected by scattering when propagating in biological tissues, photoacoustic microscopy has a high penetration depth and good resolution, making it a powerful tool for observing the structure and function of biological tissues.
[0050] Photoacoustic microscopy can be used in biomedical research to diagnose tumors, observe vascular networks, study neural activity, etc. At the same time, due to its non-invasiveness and high-resolution imaging capabilities of living tissues, it is also widely used in clinical diagnosis and treatment monitoring.
[0051] The pulse excitation used in the photoacoustic microscopy system can provide axial resolution: since the speed of ultrasonic propagation is much slower than the speed of light, the distance at which the photoacoustic signal is generated can be inferred based on the measured ultrasonic flight arrival time, thereby providing axial stratification capabilities. This gives photoacoustic microscopy the ability to resolve axial information and achieve three-dimensional volume imaging through two-dimensional point scanning. Compared to pure optical three-dimensional imaging technology that needs to be combined with three-dimensional mechanical scanning, photoacoustic microscopy has a faster three-dimensional imaging speed and has strong advantages in imaging signal-to-noise ratio and sample bleaching damage.
[0052] Although the lateral resolution of photoacoustic microscopy reaches the optical diffraction limit, the axial resolution of photoacoustic microscopy is limited by the acoustic detection bandwidth, usually in the range of 25-50MHz, resulting in an axial resolution of tens of microns, which is much worse than its lateral resolution. Although the morphology and interactions of tissues and cells in vivo in photoacoustic microscopy are essentially in three-dimensional space, the presentation of microscopic imaging is still limited to a two-dimensional plane because the three-dimensional imaging results usually have a very serious tailing effect. How to improve the axial resolution of photoacoustic microscopy while maintaining the working depth (such as 1mm) and lateral resolution (such as 3μm) of photoacoustic microscopy is an important issue faced in the basic research field and application of photoacoustic microscopy.
[0053] To this end, the embodiments of the present disclosure propose a photoacoustic microscopy imaging device and method, which can convert a detection light beam into a target phase delay pattern by deploying an optical phase shaping element, so that the point spread function corresponding to the detection light beam has multiple periods, and the cross-correlation coefficient of the point spread function at adjacent axial positions is lower than a preset threshold, so that the detection light beam has obvious differences in axial position, and then generate a three-dimensional image based on the point spread function and the acoustic wave signal converted from the detection light beam, thereby improving the axial resolution of the three-dimensional image.
[0054] See also Figure 1 , which is a schematic diagram of a photoacoustic microscopy imaging device provided in an embodiment of the present disclosure, the device includes a light beam emitting component 110, an optical phase shaping element 120, an acoustic wave receiving component 130 and an imaging component 140; wherein,
[0055] The light beam emitting assembly 110 is used to emit a detection light beam for the object to be imaged;
[0056] The optical phase shaping element 120 is used to convert the detection beam into a target phase delay mode; the point spread function corresponding to the detection beam in the target phase delay mode has multiple periods; each point spread function slice under the period is used to distinguish the axial position of the detection beam; the cross-correlation coefficient of the point spread function at adjacent axial positions is lower than a preset threshold;
[0057] The acoustic wave receiving component 130 is used to receive the acoustic wave signal generated by the object to be imaged being affected by the detection light beam in the target phase delay mode;
[0058] The imaging component 140 is used to convert the acoustic wave signal into a three-dimensional image corresponding to the object to be imaged based on the point spread function.
[0059] The light beam emitting component 110 may be a nanosecond pulse laser source, which is used to excite the object to be imaged (i.e., the sample) to generate sound waves. The laser source can generate short pulses at the nanosecond level, has the characteristics of high energy and high repetition frequency, and is suitable for the needs of photoacoustic microscopy imaging. The nanosecond pulse laser source may generally be a solid laser or a semiconductor laser.
[0060] The above-mentioned sound wave receiving component 130 may include an ultrasonic transducer, which receives the sound wave signal generated by the sample and converts it into an electrical signal. These electrical signals are then processed and used to generate an image. Ultrasonic transducers are usually made of piezoelectric materials, such as piezoelectric ceramics. When sound waves act on piezoelectric materials, it causes the charge distribution inside the material to change and generates a voltage signal. This voltage signal is associated with the characteristics of the sound wave and can provide information about the propagation of the sound wave. Therefore, the ultrasonic transducer is actually a converter of sound waves to electrical signals.
[0061] In photoacoustic microscopy, an ultrasonic transducer is usually installed as a detector or sensor around the sample or near the sample surface. When a laser pulse irradiates the sample and generates sound waves, the ultrasonic transducer can receive these sound waves and convert them into electrical signals. These electrical signals are then amplified and processed and ultimately used to generate photoacoustic images.
[0062] In a possible implementation, the photoacoustic microscopy imaging device may also include a low-noise preamplifier and a data acquisition device. The low-noise preamplifier is used to amplify the weak sound wave signal received by the ultrasonic transducer, while minimizing the noise in the signal to improve the signal-to-noise ratio and sensitivity of the imaging system. The data acquisition device is used to convert the electrical signal into a digital signal for use by the imaging component 140.
[0063] The imaging component 140 may be a computer device with certain computing capabilities, and may post-process the digital signal generated by the sound wave receiving component 130 to form and display a three-dimensional image.
[0064] In order to improve the axial resolution of the photoacoustic microscopy imaging device, the embodiment of the present disclosure further provides an optical phase shaping element 120 in the photoacoustic microscopy imaging device. The optical phase shaping element 120 is an optical device for regulating the phase of a light wave, and is generally used to modulate or change the phase distribution of a light wave to achieve control and regulation of an optical signal.
[0065] The optical phase shaping element 120 can be arranged in the pupil plane of the photoacoustic microscopy imaging device (or the Fourier plane in the filtering system). The pupil plane determines the angle and spatial frequency distribution of the incident light beam, and plays an important role in the quality and performance of imaging.
[0066] In photoacoustic microscopy, the pupil plane is usually the plane formed by the photoacoustic laser beam after passing through an optical lens or optical element. On this plane, the angle and wavefront shape of the incident beam can be adjusted to produce the desired photoacoustic excitation on the sample, or the focusing properties of the beam can be adjusted to obtain the desired photoacoustic signal.
[0067] In the disclosed embodiment, the optical phase shaping element 120 can adjust the detection light beam, perform phase encoding, control the point spread function of the detection light beam, and convert the detection light beam into a target phase delay pattern.
[0068] Point Spread Function (PSF) is an important indicator used to describe the imaging performance of an optical system. It represents the intensity distribution of the image formed by a single point source in the optical system on the focal plane. PSF can be regarded as the response function of the optical system to the point source signal, which determines the resolution and imaging quality of the imaging system.
[0069] The shape and size of the PSF depend on various factors of the optical system, including the aperture shape and size of the optical lens, the wavelength of the incident light wave, the non-ideality of the optical system, etc. In general, the PSF of an ideal optical system presents a symmetrical Gaussian distribution, that is, a point source forms a point approximating a Gaussian distribution after imaging.
[0070] In the target phase delay mode, the cross-correlation coefficient of the point spread function at adjacent axial positions is lower than the preset threshold, that is, the shape of the point spread function at adjacent axial positions is more obviously different, so that the depth information of the imaging can be judged according to the shape or blur degree of the point spread function at the axial position. In addition, imaging using the point spread function can also improve the imaging quality of the spatial resolution, enhance the contrast and maintain the signal-to-noise ratio.
[0071] At the same time, since the point spread function corresponding to the detection beam in the target phase delay mode has multiple periods, the period corresponding to the acoustic signal (that is, the corresponding axial depth position) can be determined according to the timestamp when the acoustic signal is received, thereby increasing the depth that can be identified by the axial resolution.
[0072] When designing the optical phase shaping element 120, the average Cramer-Rao lower bound (CRLB) of the axial position along the detection beam within a preset depth of field and the sum of the normalized cross-correlation coefficients between adjacent slices can be optimized to minimize the objective function (i.e., minimizing the average CRLB of the axial position within the preset depth of field and the normalized cross-correlation coefficient between slices).
[0073] The Cramer-Rao lower bound is used to describe the best possible accuracy limit for parameter estimates.
[0074] Among them, the objective function can be expressed as follows:
[0075]
[0076] in, represents the average value of the ensemble at the axial resolution z; represents the unit vector matrix; stands for Cramer-Rao lower bound, which measures the positioning accuracy. As the performance limit of the point spread function, this lower bound quantifies the change in sensitivity used to encode axial position information, which can be specifically calculated by calculating the Fisher information matrix. The reciprocal of is obtained, that is, the theoretically optimal z accuracy that can be obtained. Among them, As shown in the following formula,
[0077]
[0078]
[0079]
[0080] in, Represents a set of parameters, including axial position , signal strength Photons and Background ; is the first slice of the point spread function The expected number of photons per pixel is Represents the weight factor for adjusting the two evaluation indicators; Represents the normalized cross-correlation coefficient between adjacent slices.
[0081] In one possible implementation, the optical phase shaping element 120 can be physically implemented by placing it in the Fourier plane of the optical filtering system (at half the distance between the two lenses). and deflection angle As the spatial coordinates at the detector plane of the photoacoustic microscopy imaging device, the imaging process of the photoacoustic microscopy imaging device is simulated according to the Fresnel approximation. The point spread function intensity is as follows:
[0082]
[0083]
[0084]
[0085] in, represents the two-dimensional Fourier transform; represents the normalized polar coordinates within the focal depth range, represents the length of the wave direction, represents the polar angle of the wave direction; the phase mask can be modeled as being located within the pupil of a microscope objective, represents the phase distribution of the mask, Indicates the difference in phase distribution caused by the movement of light propagation position, generally , , They represent the distance from the focus axis position to the second layer of medium and the defocus amount, respectively. . is the numerical aperture; is the wavelength of light; , and They are the refractive index of water, which can be 1.33, the refractive index of ultrasound coupling gel, which can be 1.485, and the refractive index of the sample medium, such as the refractive index of biological tissue, which is generally 1.34~1.62. In addition, the refractive index of plastic film can also be considered, which is generally 1.535. represents the limiting aperture angle; The polar angle that represents the direction of the wave.
[0086] In this way, by minimizing the objective function, the proportional coefficient values of each order of the optimized Laguerre-Gaussian polynomials of CRLB can be obtained. Then, based on the proportional coefficient values of each order of the optimized Laguerre-Gaussian polynomials, the phase distribution corresponding to the optical phase shaping element 120 can be determined.
[0087] The optical phase shaping element 120 may include a phase mask or a spatial light modulator. The phase mask is used to adjust the phase distribution of light waves in an optical system. It is usually composed of a transparent silicon dioxide substrate and a phase mask formed on its surface. The phase mask can be designed according to a specific phase pattern to modulate the phase of the light wave, thereby achieving control and regulation of the optical signal. The spatial light modulator is used to control the amplitude, phase or polarization state of the light wave, thereby achieving precise control and regulation of the optical signal.
[0088] In a specific implementation process, the optical phase shaping element 120 may be provided with a pattern matching the above phase distribution, and the pattern may be a Laguerre-Gaussian ring, a Zernike pattern, etc. The optical phase shaping element 120 with a Zernike pattern corresponds to a quadruped point spread function, and the optical phase shaping element with a Laguerre-Gaussian ring corresponds to a multi-period spiral point spread function.
[0089] See also Figure 2 As shown, Figure 2 A schematic diagram of the phase distribution of the optical phase shaping element provided in an embodiment of the present disclosure, Figure 2 The optical phase shaping element in the figure may be a mask, which may be provided with a plurality of Laguerre-Gaussian ring patterns. The coefficients of the Laguerre-Gaussian rings may be determined according to actual conditions to achieve a multi-period spiral PSF mask phase distribution as shown in the figure.
[0090] See also Figure 3 As shown, Figure 3 The mask plate discrete processing texture layout provided by the embodiment of the present disclosure. In the figure, the optical phase shaping element can be a mask plate, and one side of the mask plate can be discretized into multiple units, and the mask plate is processed according to the discrete processing texture layout, so that the mask plate has the above Figure 2 The phase distribution in .
[0091] See also Figure 4 As shown in FIG. 1 , it is a physical picture of the mask plate processing provided by the embodiment of the present disclosure. The appearance of the mask plate is as follows Figure 4 As shown, it has special texture.
[0092] The imaging component 140 can use the acoustic wave signal converted into a digital signal and the point spread function to determine the coordinates of multiple imaging points in the object to be imaged, and then determine the three-dimensional image corresponding to the object to be generated according to the coordinates of each imaging point. and the acoustic signal Satisfies the following formula:
[0093]
[0094] Wherein, x represents the coordinate of the acoustic wave signal on the horizontal axis of the preset coordinate system, y represents the coordinate of the acoustic wave signal on the vertical axis of the preset coordinate system, t represents the time when the acoustic wave signal is received, c represents the propagation speed of the acoustic wave signal in the imaging medium, and z represents the axial coordinate of the acoustic wave signal in the preset coordinate system. represents the time series of the impulse response of the sound wave receiving component, represents the focused spot stack set of the detection beam in the target phase delay mode, n represents noise, represents the temporal convolution on (x,y), represents a two-dimensional convolution at a certain depth on (x,y); where z = t·c.
[0095] In a specific implementation, the imaging component 140 can deconvolve the above formula to obtain the coordinates of the imaging point: In the process of deconvolution, non-blind deconvolution can be performed, assuming that the point spread function of the detection beam is known and unchanged over the entire large field of view, thereby achieving the determination of the coordinates of the imaging point.
[0096] In order to reduce the amount of deconvolution calculation, deconvolution calculation can be performed based on an improved Fast Iterative Shrinkage-Thresholding Algorithm (FISTA) and the above formula to determine the coordinates of multiple imaging points in the object to be imaged.
[0097] Among them, the fast iterative shrinkage threshold algorithm is an optimization algorithm for solving sparse representation problems, especially in the fields of compressed sensing and image restoration. FISTA is an improved iterative soft threshold algorithm, which improves convergence performance by accelerating convergence speed and stability.
[0098] When performing deconvolution calculations, noise is required, and the noise can be determined by a neural network model. Specifically, an image to be denoised can be generated based on the sound wave signal, and multiple noise level images corresponding to the image to be denoised can be determined; then, the image to be denoised and the noise level image are input into a pre-trained neural network model to obtain the noise corresponding to the sound wave signal.
[0099] Among them, noise level images are used to visualize the chart or image of the noise level in the data. In the fields of signal processing, image processing and data analysis, noise level graphs are often used to evaluate the quality and noise level of data for subsequent processing or analysis. Noise level graphs are usually based on the spatial or frequency domain of the data to show the distribution of noise levels in the data.
[0100] Optionally, in order to avoid excessive light excitation energy, the intensity of the detection light beam can be controlled within a certain level according to the excitation ratio relationship of the photoacoustic signal.
[0101] In order to avoid the situation where the denominator is zero during the deconvolution process, the neural network regularization factor can be used to regularize the terms in the formula to avoid being unable to solve. Through the neural network regularization factor and the point spread function, the digital signal of the sound wave can be converted into a three-dimensional image corresponding to the object to be imaged.
[0102] Based on the same inventive concept, a photoacoustic microscopy method corresponding to the photoacoustic microscopy device is also provided in the embodiments of the present disclosure. Since the principle of solving the problem by the method in the embodiments of the present disclosure is similar to that of the photoacoustic microscopy device mentioned above in the embodiments of the present disclosure, the implementation of the method can refer to the implementation of the device, and the repeated parts will not be repeated.
[0103] Reference Figure 5 FIG. 1 is a flow chart of a photoacoustic microscopy method provided in an embodiment of the present disclosure. The method is applied to a photoacoustic microscopy device in any of the above embodiments. The method includes:
[0104] S501 , emitting a detection light beam for an object to be imaged.
[0105] S502, converting the detection beam into a target phase delay mode; the point spread function corresponding to the detection beam in the target phase delay mode has multiple periods; each point spread function slice in the period is used to distinguish the axial position of the detection beam;
[0106] S503, receiving an acoustic wave signal generated by the object to be imaged being affected by the detection light beam in a target phase delay mode;
[0107] S504: Based on the point spread function, convert the acoustic wave signal into a three-dimensional image corresponding to the object to be imaged.
[0108] For the description of each step in the method, reference may be made to the relevant description in the above-mentioned device embodiment, which will not be described in detail here.
[0109] Corresponds to Figure 5 The photoacoustic microscopy imaging method in the present disclosure also provides an electronic device 600, such as Figure 6 FIG. 6 is a schematic diagram of the structure of an electronic device 600 provided in an embodiment of the present disclosure, including:
[0110] Processor 61, memory 62, and bus 63; memory 62 is used to store execution instructions, including internal memory 621 and external memory 622; the internal memory 621 is also called internal memory, which is used to temporarily store the operation data in the processor 61 and the data exchanged with the external memory 622 such as a hard disk. The processor 61 exchanges data with the external memory 622 through the internal memory 621. When the electronic device 600 is running, the processor 61 communicates with the memory 62 through the bus 63, so that the processor 61 executes the following instructions:
[0111] emitting a detection beam directed to an object to be imaged;
[0112] The detection beam is converted into a target phase delay mode; the point spread function corresponding to the detection beam in the target phase delay mode has a plurality of periods; each point spread function slice in the period is used to distinguish the axial position of the detection beam;
[0113] receiving an acoustic wave signal generated by the object to be imaged being affected by the detection light beam in a target phase delay mode;
[0114] Based on the point spread function, the acoustic wave signal is converted into a three-dimensional image corresponding to the object to be imaged.
[0115] The present disclosure also provides a computer-readable storage medium on which a computer program is stored. When the computer program is executed by a processor, the steps of the photoacoustic microscopy imaging method described in the above method embodiment are executed. The storage medium may be a volatile or non-volatile computer-readable storage medium.
[0116] The embodiments of the present disclosure also provide a computer program product, which carries a program code. The instructions included in the program code can be used to execute the steps of the photoacoustic microscopy imaging method described in the above method embodiment. For details, please refer to the above method embodiment, which will not be repeated here.
[0117] The computer program product may be implemented in hardware, software or a combination thereof. In one optional embodiment, the computer program product is implemented as a computer storage medium. In another optional embodiment, the computer program product is implemented as a software product, such as a software development kit (SDK).
[0118] Those skilled in the art can clearly understand that, for the convenience and simplicity of description, the specific working process of the system and device described above can refer to the corresponding process in the aforementioned method embodiment, and will not be repeated here. In the several embodiments provided in the present disclosure, it should be understood that the disclosed system, device and method can be implemented in other ways. The device embodiments described above are merely schematic. For example, the division of the units is only a logical function division. There may be other division methods in actual implementation. For example, multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some communication interfaces, and the indirect coupling or communication connection of the device or unit can be electrical, mechanical or other forms.
[0119] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.
[0120] In addition, each functional unit in each embodiment of the present disclosure may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.
[0121] If the functions are implemented in the form of software functional units and sold or used as independent products, they can be stored in a non-volatile computer-readable storage medium that is executable by a processor. Based on this understanding, the technical solution of the present disclosure, or the part that contributes to the prior art or the part of the technical solution, can be embodied in the form of a software product, which is stored in a storage medium and includes several instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the method described in each embodiment of the present disclosure. The aforementioned storage medium includes: various media that can store program codes, such as a USB flash drive, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk.
[0122] Finally, it should be noted that the above-described embodiments are only specific implementation methods of the present disclosure, which are used to illustrate the technical solutions of the present disclosure, rather than to limit them. The protection scope of the present disclosure is not limited thereto. Although the present disclosure is described in detail with reference to the above-described embodiments, ordinary technicians in the field should understand that any technician familiar with the technical field can still modify the technical solutions recorded in the above-described embodiments within the technical scope disclosed in the present disclosure, or can easily think of changes, or make equivalent replacements for some of the technical features therein; and these modifications, changes or replacements do not make the essence of the corresponding technical solutions deviate from the spirit and scope of the technical solutions of the embodiments of the present disclosure, and should be included in the protection scope of the present disclosure. Therefore, the protection scope of the present disclosure should be based on the protection scope of the claims.
Claims
1. A photoacoustic microscopy imaging device, characterized in that: The device includes a light beam emitting component, an optical phase shaping element, an acoustic wave receiving component, and an imaging component; The light beam emitting assembly is used to emit a detection light beam for the object to be imaged; The optical phase shaping element is used to convert the detection beam into a target phase delay mode; the point spread function corresponding to the detection beam in the target phase delay mode has multiple periods; each point spread function slice under the period is used to distinguish the axial position of the detection beam; The cross-correlation coefficient of the point spread function at adjacent axial positions is lower than a preset threshold; The acoustic wave receiving component is used to receive the acoustic wave signal generated by the object to be imaged being affected by the detection light beam in the target phase delay mode; The imaging component is used to convert the acoustic wave signal into a three-dimensional image corresponding to the object to be imaged based on the point spread function; The imaging component is specifically used for: Determining coordinates of a plurality of imaging points in the object to be imaged based on the point spread function and the acoustic wave signal; Determine a three-dimensional image corresponding to the object to be imaged based on the coordinates of each of the imaging points; The coordinates of multiple imaging points in the object to be imaged and the acoustic signal Satisfies the following formula: ; Wherein, x represents the coordinate of the acoustic wave signal on the horizontal axis of the preset coordinate system, y represents the coordinate of the acoustic wave signal on the vertical axis of the preset coordinate system, t represents the time when the acoustic wave signal is received, c represents the propagation speed of the acoustic wave signal in the imaging medium, and z represents the axial coordinate of the acoustic wave signal in the preset coordinate system. represents the time series of the impulse response of the sound wave receiving component, represents the focused spot stack set of the detection beam in the target phase delay mode, n represents noise, represents the temporal convolution on (x,y), represents a two-dimensional convolution at a certain depth on (x, y); where z=t·c; The point spread function corresponding to the detection light beam in the target phase delay mode is a multi-period spiral structure; the texture of the optical phase shaping element includes a plurality of Laguerre-Gaussian rings.
2. The device according to claim 1, characterized in that The optical phase shaping element includes a phase mask or a spatial light modulator.
3. The device according to claim 1, characterized in that The noise is determined by the following steps: Generate an image to be denoised based on the sound wave signal, and determine a plurality of noise level images corresponding to the image to be denoised; The image to be denoised and the noise level image are input into a pre-trained neural network model to obtain the noise corresponding to the sound wave signal.
4. The device according to claim 1, characterized in that The imaging component is specifically used for: Based on the neural network regularization factor and the point spread function, the acoustic wave signal is converted into a three-dimensional image corresponding to the object to be imaged.
5. A photoacoustic microscopy method, characterized in that: Applicable to the photoacoustic microscopy imaging device as claimed in any one of claims 1 to 4; The method comprises: emitting a detection beam directed to an object to be imaged; The detection beam is converted into a target phase delay mode; the point spread function corresponding to the detection beam in the target phase delay mode has a plurality of periods; each point spread function slice in the period is used to distinguish the axial position of the detection beam; receiving an acoustic wave signal generated by the object to be imaged being affected by the detection light beam in a target phase delay mode; Based on the point spread function, the acoustic wave signal is converted into a three-dimensional image corresponding to the object to be imaged.
