A method for optimizing multimodal imaging based on photoacoustic signal-assisted adaptive optics.

Abstract

This invention relates to a method for optimizing multimodal imaging based on photoacoustic signal-assisted adaptive optics. By collecting imaging results from photoacoustic imaging modes and calculating the phase change of the photoacoustic signal using machine learning algorithms, this change is fed back to the photoacoustic adaptive optics module in the system to adjust the imaging phase of the optical system, thereby improving the resolution of photoacoustic imaging. Because the photoacoustic microscope imaging mode shares a common optical path with the multiphoton microscopy imaging mode, multiple harmonic microscopy imaging mode, and optical coherence imaging mode, it can simultaneously improve the penetration depth and imaging resolution of the multiphoton microscopy and multiple harmonic microscopy imaging modes while simultaneously improving the resolution of photoacoustic microscopy imaging. This method utilizes the deep penetration capability and rapid imaging advantage of the photoacoustic microscope, possessing full-field-of-view and high-speed control capabilities, which can significantly improve the effect of multimodal imaging and promote the application of multimodal systems in disease detection and scientific research.

Description

TECHNICAL FIELD

[0001] The present application relates to the field of microscopic imaging technology, and in particular to a method for multi-modal imaging based on photoacoustic signal assisted adaptive optical optimization. BACKGROUND

[0002] Existing microscopic imaging techniques often involve multiple different imaging modes, such as three-photon microscopy, third-harmonic microscopy, optical coherence tomography microscopy, and photoacoustic microscopy, etc. Each imaging mode has different imaging characteristics and advantages, but also has certain limitations, especially in terms of image resolution and penetration depth. In order to solve these problems, in recent years, adaptive optics (AO) technology has been widely applied in microscopic imaging systems to dynamically adjust the imaging performance of the optical system.

[0003] However, traditional adaptive optical control methods usually only optimize the imaging effect of a single mode, ignoring the mutual influence and collaborative optimization between multi-modal systems. Therefore, how to improve the overall performance of multi-modal microscopic imaging systems through intelligent means is still a problem to be solved.

[0004] The present application relates to the field of microscopic imaging technology, and in particular to a method for multi-modal imaging based on photoacoustic signal assisted adaptive optical optimization. SUMMARY

[0005] The purpose of this invention is to address the problems existing in the prior art by proposing a method for optimizing a multimodal imaging system based on photoacoustic signal-assisted adaptive optics. This method simultaneously integrates multi-photon microscopy (MPM), multi-harmonic microscopy (MHM), photoacoustic microscopy or photoacoustic computational tomography (PCT) modes [including photoacoustic microscopy (PAM) or photoacoustic computational tomography (PACT)], and optical coherence imaging modes [including optical coherence microscopy (OCM) or optical coherence tomography]. The system utilizes photoacoustic microscopy (OCT) and combines it with corresponding optical and ultrasonic detectors to effectively detect imaging signals of various modes. Furthermore, by collecting the imaging results of the photoacoustic imaging modes and calculating the phase change of the photoacoustic signal using machine learning algorithms, it feeds this back to the photoacoustic adaptive optics module in the system to adjust the imaging phase of the optical system, thereby improving the resolution of photoacoustic imaging. Because the photoacoustic microscope imaging mode shares a common optical path with the multiphoton microscopy imaging mode, multiple harmonic microscopy imaging mode, and optical coherence imaging mode, it can simultaneously improve the penetration depth and imaging resolution of the multiphoton microscopy imaging mode and the multiple harmonic microscopy imaging mode while improving the resolution of photoacoustic microscopy imaging. This allows for the simultaneous output of optical coherence imaging images, as well as optimized photoacoustic microscopic images, optimized fluorescence images, and optimized harmonic images.

[0006] The method for optimizing a multimodal imaging system based on photoacoustic signal-assisted adaptive optics provided in this invention utilizes the deep penetration function and rapid imaging advantage of photoacoustic microscopes, and has full field of view and high-speed control capabilities. It can significantly improve the effect of multimodal imaging and promote the application of multimodal systems in disease detection and scientific research.

[0007] To achieve the above objectives, in a first aspect, embodiments of the present invention provide a method for optimizing multimodal imaging based on photoacoustic signal-assisted adaptive optics. A system for executing the method includes: a laser module, a laser stretching module, an optical coherence imaging module, a first optical path transmission module, a photoacoustic adaptive optics module, a second optical path transmission module, a beam scanning module, a third optical path transmission module, a sample excitation module, a photoacoustic signal acquisition module, a photoacoustic image calculation module, and a detection module; the photoacoustic adaptive optics module includes a spatial light modulator.

[0008] The method includes:

[0009] Step S1: Start the system. The laser module emits a first laser beam and a second laser beam. The laser broadening module converts the first laser beam into a broadened optical signal. The optical coherence imaging module splits the second laser beam into a compensation optical signal and a test optical signal. The compensation optical signal undergoes multiple reflections to form a reference arm signal. The broadened optical signal and the test optical signal sequentially pass through the first optical path transmission module, the photoacoustic adaptive optics module, the second optical path transmission module, the beam scanning module, and the third optical path transmission module before entering the sample excitation module to excite the sample under test, generating photoacoustic signals, optical coherence imaging signals, multiphoton signals, and multiple harmonic signals. The optical coherence imaging signal is used to form an optical coherence imaging image. The detection module detects the multiphoton signal and multiple harmonic signals and outputs them as fluorescence images and harmonic images, respectively.

[0010] Step S2: The photoacoustic signal acquisition module acquires the photoacoustic electrical signal and converts the photoacoustic electrical signal into a photoacoustic microscopic imaging electrical signal, which is then sent to the photoacoustic image calculation module.

[0011] Step S3: The photoacoustic image calculation module collects the photoacoustic microscopic imaging electrical signal, preprocesses it to generate an optimized photoacoustic microscopic image, and uses a machine learning algorithm to perform phase inversion calculation on the optimized photoacoustic microscopic image to generate a photoacoustic phase adjustment signal to adjust the spatial light modulator.

[0012] Step S4: The adjusted spatial light modulator performs phase adjustment on the broadened light signal and the test light signal that re-enter the photoacoustic adaptive optics module.

[0013] In step S5, the phase-adjusted broadened optical signal and the test optical signal sequentially pass through the second optical path transmission module, the beam scanning module, and the third optical path transmission module into the sample excitation module, which excites the sample to be tested again, generating optimized multiphoton signals, multiple harmonic signals, and photoacoustic signals, respectively, and then outputting optimized fluorescence images and optimized harmonic images.

[0014] Preferably, step S1 specifically includes:

[0015] When the system is activated, the laser module emits a first laser beam and a second laser beam.

[0016] The laser stretching module acquires the first laser beam, performs stretching processing, and forms a stretched optical signal;

[0017] The optical coherent imaging module acquires the second laser beam, performs beam splitting processing to generate a compensation light signal and a test light signal, and further reflects the compensation light multiple times to form a reference arm signal.

[0018] The broadened optical signal and the test optical signal pass sequentially through the first optical path transmission module, the photoacoustic adaptive optics module, the second optical path transmission module, the beam scanning module, and the third optical path transmission module to form the outgoing broadened optical signal and the outgoing test optical signal, respectively, and then enter the sample excitation module;

[0019] The emitted broadened light signal excites the sample to be tested in the sample excitation module to generate a photoacoustic signal, and converts the photoacoustic signal into a photoacoustic electrical signal for acquisition by the photoacoustic signal acquisition module.

[0020] The emitted test light signal excites the sample under test to generate an excitation light signal;

[0021] The excitation light signal is separated to generate a sample excitation light signal and an optical coherence imaging signal;

[0022] The optical coherent imaging signal sequentially passes through the third optical path transmission module, the beam scanning module, the second optical path transmission module, the photoacoustic adaptive optics module, and the first optical path transmission module before returning to the optical coherent imaging module. There, it undergoes beam combining interference processing with the reference arm signal to form an interference light signal. The interference light signal is then converted into an optical coherent imaging electrical signal to output an optical coherent imaging image.

[0023] The detection module acquires the sample excitation light signal, and after focusing and beam splitting, forms a multiphoton signal and multiple harmonic signals. The multiphoton signal and multiple harmonic signals are then converted into multiphoton electrical signals and multiple harmonic imaging electrical signals, respectively, to output fluorescence images and harmonic images.

[0024] More preferably, the laser source module includes: a chirped amplified laser, a first half-wave plate, a first polarizing beam splitter, a first reflecting mirror, and an optical parametric amplified laser;

[0025] The laser module outputs a first laser and a second laser, specifically comprising: the laser emitted by the chirped amplified laser sequentially undergoes phase processing by the first half-wave plate and beam splitting processing by the first polarizing beam splitter to generate a first laser and a laser signal to be amplified; the first laser is reflected by the first reflector and enters the laser broadening module; the optical parametric amplified laser acquires the laser signal to be amplified, undergoes chirped amplification processing to generate a second laser, and sends it to the optical coherent imaging module;

[0026] The broadening process includes: grating dispersion pulse broadening or material dispersion pulse broadening; wherein, when using the grating dispersion pulse broadening, the laser broadening module includes: any one of Martinez broadener, Overler broadener, Trisch broadener, or Martinez broadener based on a 4F system; when using material dispersion pulse broadening, the broadening medium of the laser broadening module includes: quartz material or zinc selenide material.

[0027] More preferably, the optical coherence imaging module includes: a first beam splitter prism, an optical path compensation component, a second half-wave plate, a second polarization beam splitter prism, a quarter-wave plate, a silicon window, a beam combiner prism, and an imaging component; wherein, the optical path compensation component includes: a retroreflection prism and multiple plane mirrors; the retroreflection prism moves according to the position of the sample to be tested; the imaging component includes: a first lens, an optical fiber, and a spectrometer; one end of the optical fiber is connected to the first lens, and the other end of the optical fiber is connected to the spectrometer;

[0028] The first beam splitter acquires the second laser beam, performs beam splitting processing, and forms a compensation optical signal and a test optical signal; wherein, the beam energy ratio of the compensation optical signal to the test optical signal is 1:99;

[0029] The plurality of planar mirrors acquire the compensation light signal, and after multiple reflections, form a first reflected light signal; the retroreflection prism acquires the first reflected light signal, and after reflection, forms a reference arm signal.

[0030] The test optical signal passes sequentially through the second half-wave plate, the second polarizing beam splitter, and the quarter-wave plate, and is then reflected by the silicon window before entering the first optical path transmission module; the silicon window is placed at Brewster's angle to compensate for the dispersion of the second amplified optical signal.

[0031] The beam combining prism performs beam combining and interference processing on the reference arm signal and the optical coherent imaging signal to form an interference light signal;

[0032] The first lens acquires the interference light signal, and after focusing processing, forms a focused imaging light signal;

[0033] The spectrometer acquires the focused imaging light signal through the optical fiber, analyzes and processes it to generate an optical coherent imaging electrical signal, which is then processed by an external display device to output an optical coherent imaging image.

[0034] More preferably, the first optical path transmission module includes: a first dichroic mirror;

[0035] The photoacoustic adaptive optics module further includes: a second lens, a right-angle mirror, an achromatic focusing mirror, and a third lens; the spatial light modulator includes: any one of a deformable mirror, a digital micromirror array, or a liquid crystal spatial light modulator.

[0036] The second optical path transmission module includes: a second reflector;

[0037] The broadened optical signal and the test optical signal sequentially pass through the first optical path transmission module, the photoacoustic adaptive optics module, and the second optical path transmission module before entering the beam scanning module, specifically including:

[0038] The broadened light signal is reflected sequentially by the first dichroic mirror, focused by the second lens, reflected for the first time by the right-angle mirror, transmitted for the first time by the achromatic focusing mirror, and reflected by the spatial light modulator to generate first parallel light. The first parallel light is transmitted sequentially by the achromatic focusing mirror for the second time, reflected for the second time by the right-angle mirror, focused by the third lens, and reflected by the second mirror to form an incident broadened light signal that enters the beam scanning module.

[0039] The test light signal is transmitted sequentially through the first dichroic mirror, focused by the second lens, reflected for the first time by the right-angle mirror, transmitted for the first time by the achromatic focusing mirror, and reflected by the spatial light modulator to generate a second parallel light; the second parallel light is transmitted sequentially through the achromatic focusing mirror, reflected for the second time by the right-angle mirror, focused by the third lens, and reflected by the second mirror to form an incident test light signal that enters the beam scanning module.

[0040] In step S4, phase adjustment is performed on the broadened optical signal and the test optical signal that re-enter the photoacoustic adaptive optics module, specifically including:

[0041] The broadened light signal that re-enters the photoacoustic adaptive optics module is sequentially focused by the second lens, reflected for the first time by the right-angle mirror, transmitted for the first time by the achromatic focusing mirror, and phase-adjusted by the spatial light modulator to generate a phase-adjusted broadened light signal. The phase-adjusted broadened light signal is then sequentially transmitted for the second time by the achromatic focusing mirror, reflected for the second time by the right-angle mirror, focused by the third lens, and reflected by the second mirror to form an optimized incident broadened light signal.

[0042] The test light signal entering the photoacoustic adaptive optics module again is sequentially focused by the second lens, reflected for the first time by the right-angle mirror, transmitted for the first time by the achromatic focusing mirror, and phase-adjusted by the spatial light modulator to generate a phase-adjusted test light signal; the phase-adjusted test light signal is sequentially transmitted for the second time by the achromatic focusing mirror, reflected for the second time by the right-angle mirror, focused by the third lens, and reflected by the second mirror to generate an optimized incident test light signal.

[0043] More preferably, the beam scanning module includes: a third reflecting mirror, a scanning device, and a galvanometer;

[0044] The third optical path transmission module includes: a fourth lens, a fourth reflector, a fifth lens, and a fifth reflector;

[0045] The third reflector adjusts the incident angle of the incident broadened light signal and the incident test light signal, or adjusts the incident angle of the optimized incident broadened light signal and the optimized incident test light signal.

[0046] The scanning device scans the incident broadened light signal and the incident test light signal, or the optimized incident broadened light signal and the optimized incident test light signal, in the X-axis direction; the galvanometer scans the incident broadened light signal and the incident test light signal, or the optimized incident broadened light signal and the optimized incident test light signal, in the Y-axis direction to generate an outgoing broadened light signal and an outgoing test light signal, or to generate an optimized outgoing broadened light signal and an optimized outgoing test light signal; the X-axis is perpendicular to the Y-axis;

[0047] The emitted broadened light signal and the emitted test light signal, or the optimized emitted broadened light signal and the optimized emitted test light signal, enter the sample excitation module after being transmitted through the fourth lens, reflected by the third mirror, transmitted through the fifth lens, and reflected by the fourth mirror.

[0048] More preferably, the sample excitation module includes: a second dichroic mirror, an objective lens, an ultrasonic transducer, and a water tank; wherein, the second dichroic mirror is positioned above the objective lens; the ultrasonic transducer and the water tank are integrated on the objective lens; the ultrasonic transducer is annular and is positioned on the lower surface of the objective lens or surrounds the side surface of the objective lens; the lower surface or side surface of the objective lens, together with the ultrasonic transducer, is immersed in the upper part of the water tank; the sample to be tested is placed in the lower part of the water tank;

[0049] The emitted broadened light signal and the emitted test light signal pass through the second dichroic mirror and enter the objective lens, and then act on the sample to be tested.

[0050] The emitted broadened light signal excites the sample under test to generate a photoacoustic signal, and the photoacoustic signal is converted into a photoacoustic electrical signal by the ultrasonic transducer and sent to the photoacoustic signal acquisition module; the photoacoustic signal acquisition module acquires the photoacoustic electrical signal, analyzes and processes it to generate a photoacoustic microscopic imaging electrical signal, and sends the photoacoustic microscopic imaging electrical signal to the photoacoustic image calculation module.

[0051] The emitted test light signal excites the sample under test to generate an excitation light signal. The second dichroic mirror separates the excitation light signal to form a sample excitation light signal and an optical coherent imaging signal. The sample excitation light signal is reflected into the detection module, and the optical coherent imaging signal is transmitted into the third optical path transmission module.

[0052] More preferably, the detection module includes: a sixth lens, a third dichroic mirror, a fluorescence detection device, and a harmonic detection device; wherein the fluorescence detection device includes a first photomultiplier tube; and the harmonic detection device includes a second photomultiplier tube.

[0053] In step S1, the sample excitation light signal is separated to generate multiphoton signals and multiple harmonic signals, specifically including: the sample excitation light signal is sequentially focused by the sixth lens and split by the third dichroic mirror to form multiphoton signals and multiple harmonic signals;

[0054] The first photomultiplier tube detects and analyzes the multiphoton signal, generates a multiphoton electrical signal, and sends the multiphoton electrical signal to an external display device connected to the first photomultiplier tube, so that the external display device can process the multiphoton electrical signal and output a fluorescence image;

[0055] The second photomultiplier tube detects and analyzes the multiple harmonic signals, generates multiple harmonic imaging electrical signals, and sends the multiple harmonic imaging electrical signals to an external display device connected to the second photomultiplier tube. The external display device processes the multiple harmonic imaging electrical signals and outputs a harmonic image.

[0056] Preferably, the photoacoustic image calculation module includes: a photoacoustic image calculation unit and an adaptive signal processing unit;

[0057] Step S3 specifically includes: the photoacoustic image calculation unit collects the photoacoustic microscopic imaging electrical signal, preprocesses the photoacoustic microscopic imaging electrical signal to generate an optimized photoacoustic microscopic image, and sends the optimized photoacoustic microscopic image to the adaptive signal processing unit; the adaptive signal processing unit uses a machine learning algorithm to perform phase inversion calculation on the photoacoustic microscopic image, identifies and analyzes low-resolution regions in the optimized photoacoustic microscopic image, generates a photoacoustic phase adjustment signal, and sends the photoacoustic phase adjustment signal to the photoacoustic adaptive optics module;

[0058] The preprocessing includes: the photoacoustic image calculation unit performing one or more of the following processes on the photoacoustic signal: signal denoising, dynamic range adjustment, and spectral filtering;

[0059] The machine learning algorithm includes: a deep neural network;

[0060] In step S5, the optimized fluorescence image and harmonic image are output, specifically including:

[0061] The detection module acquires the optimized multiphoton signal, detects it, and converts the optimized multiphoton signal into a multiphoton electrical signal, which is then processed by an external display device to output the optimized fluorescence image.

[0062] The detection module acquires the optimized multiple harmonic signals, and after detection, converts the optimized multiple harmonic signals into multiple harmonic imaging electrical signals, which are then processed by an external display device to output the optimized harmonic image.

[0063] In a second aspect, embodiments of the present invention provide a system for performing the method for optimizing multimodal imaging based on photoacoustic signal-assisted adaptive optics as described in the first aspect. The system includes: a laser module, a laser stretching module, an optical coherence imaging module, a first optical path transmission module, a photoacoustic adaptive optics module, a second optical path transmission module, a beam scanning module, a third optical path transmission module, a sample excitation module, a photoacoustic signal acquisition module, a photoacoustic image calculation module, and a detection module; the photoacoustic adaptive optics module includes a spatial light modulator.

[0064] The laser module emits a first laser beam and a second laser beam;

[0065] The laser stretching module stretches the first laser beam to form a stretched optical signal.

[0066] The optical coherent imaging module splits the second laser beam to generate a compensation light signal and a test light signal, and further reflects the compensation light multiple times to form a reference arm signal.

[0067] The broadened optical signal and the test optical signal pass sequentially through the first optical path transmission module, the photoacoustic adaptive optics module, the second optical path transmission module, the beam scanning module, and the third optical path transmission module to generate an outgoing broadened optical signal and an outgoing test optical signal, respectively, which then enter the sample excitation module.

[0068] The emitted test light signal excites the sample under test to generate an excitation light signal; the sample excitation module separates the excitation light signal to generate a sample excitation light signal and an optical coherence imaging signal;

[0069] The detection module separates the sample excitation light signal to form a multiphoton signal and multiple harmonic signals, detects the fluorescence signal to generate a multiphoton imaging electrical signal, and then sends the multiphoton imaging electrical signal to an external display device connected to the detection module. It also detects the harmonic signal to generate multiple harmonic imaging electrical signals and sends the multiple harmonic imaging electrical signals to an external display device connected to the detection module.

[0070] The optical coherent imaging module performs beam combining interference processing on the optical coherent imaging signal and the reference arm signal to generate an interference light signal, then performs photoelectric conversion processing on the interference light signal to generate an optical coherent imaging electrical signal, and sends the optical coherent imaging electrical signal to an external display device connected to the optical coherent imaging module.

[0071] The emitted broadened light signal excites the sample to be tested in the sample excitation module to generate a photoacoustic signal; the photoacoustic signal acquisition module acquires the photoacoustic signal and converts it into a photoacoustic electrical signal, which is then sent to the photoacoustic image calculation module.

[0072] The photoacoustic image calculation module preprocesses the photoacoustic electrical signal to generate a photoacoustic microscopic image. After phase inversion calculation, it generates a photoacoustic phase adjustment signal and sends the photoacoustic phase adjustment signal to the photoacoustic adaptive optics module to adjust the spatial light modulator and perform phase adjustment on the broadened light signal and the test light signal that re-enter the photoacoustic adaptive optics module.

[0073] The method for optimizing multimodal imaging based on photoacoustic signal-assisted adaptive optics provided in this invention integrates multiphoton microscopy, multiple harmonic microscopy, photoacoustic microscopy or photoacoustic computational tomography, and optical coherence imaging modes, and combines them with corresponding optical components and ultrasonic transducers to achieve effective detection of imaging signals from each mode. Furthermore, the multimodal imaging system provided in this invention employs a photoacoustic image calculation module and a photoacoustic adaptive optics module. By combining machine learning algorithms and adaptive optics control technology, the imaging resolution is improved. Specifically, machine learning algorithms identify and analyze low-resolution regions in the photoacoustic microscopy image, and the photoacoustic adaptive optics module adjusts the phase of the optical system in real time, significantly improving the imaging resolution of photoacoustic microscopy.

[0074] The method for optimizing multimodal imaging based on photoacoustic signal-assisted adaptive optics provided in this invention can effectively reduce image blur and distortion, providing clearer and more detailed imaging results. Furthermore, it enhances the penetration depth of other modalities while increasing resolution. Since the photoacoustic microscopy imaging mode shares the same optical path with the other three modes—multiphoton microscopy, multiple harmonic microscopy, and optical coherence imaging—and because they pass through the same sample obstructions (such as skull or skin), optimizing and compensating for the optical phase can simultaneously improve the aberrations caused by phase misalignment after all excitation light penetrates the sample obstruction.

[0075] The method for optimizing multimodal imaging based on photoacoustic signal-assisted adaptive optics provided in this invention can simultaneously improve the penetration depth of multiphoton microscopy and multiple harmonic microscopy modes.

[0076] The system provided in this embodiment of the invention for executing a method for optimizing multimodal imaging based on photoacoustic signal-assisted adaptive optics includes a photoacoustic adaptive optics module and a photoacoustic image calculation module. This system enables an automated workflow for adjusting the phase of the laser signal. By using machine learning algorithms, it automatically identifies low-resolution regions in the photoacoustic image, automatically derives an optimized optical phase adjustment scheme, and feeds it back to the adaptive optics module for multiple iterations of optimization. The entire process requires no manual intervention, thus achieving automated optimization of the imaging system.

[0077] Furthermore, compared to other adaptive optics modes, such as optical coherence tomography scanning mode phase calculation, this invention uses photoacoustic signal-assisted adaptive optics technology to acquire photoacoustic images, which has the advantage of high speed. It can achieve simultaneous scanning and reconstruction during the photoacoustic image scanning process in the photoacoustic image calculation module, and transmit the phase adjustment signal to the photoacoustic adaptive optics module during the reconstruction process, reducing the transmission waiting time and improving efficiency and speed. Attached Figure Description

[0078] Figure 1 This is a structural block diagram of a system 1 provided in an embodiment of the present invention for performing a method for optimizing multimodal imaging based on photoacoustic signals-assisted adaptive optics.

[0079] Figure 2 A flowchart illustrating a method for optimizing multimodal imaging based on photoacoustic signal-assisted adaptive optics, provided in an embodiment of the present invention.

[0080] Figure 3 This is a schematic diagram of the structure of system 2 provided in Embodiment 1 of the present invention for performing a method of optimizing multimodal imaging based on photoacoustic signal-assisted adaptive optics. Detailed Implementation

[0081] To make the objectives, technical solutions, and advantages of this invention clearer, the invention will be further described in detail below with reference to the accompanying drawings. Obviously, the described embodiments are only a part of the embodiments of this invention, and not all of them. Based on the embodiments of this invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this invention.

[0082] The technical solution of the present invention will be further described in detail below with reference to the accompanying drawings and embodiments.

[0083] This invention provides a method for optimizing multimodal imaging based on photoacoustic signal-assisted adaptive optics. For ease of understanding, the modules of the system used to execute this method will be introduced first.

[0084] Figure 1 The diagram shows the structure of a system 1 for performing the above-described method based on photoacoustic signal-assisted adaptive optics optimization multimodal imaging, provided in an embodiment of the present invention.

[0085] like Figure 1 As shown, the photoacoustic signal-assisted adaptive optics optimized multimodal imaging system 1 includes:

[0086] The system includes a laser module 11, a laser broadening module 12, an optical coherence imaging module 13, a first optical path transmission module 14, a photoacoustic adaptive optics module 15, a second optical path transmission module 16, a beam scanning module 17, a third optical path transmission module 18, a sample excitation module 19, a photoacoustic signal acquisition module 20, a photoacoustic image calculation module 21, and a detection module 22.

[0087] The laser module 11 includes: a chirped amplified laser (CPA), an optical parametric amplified laser (OPA), a first half-wave plate (not shown in the figure), a first polarizing beam splitter (not shown in the figure), and a first reflecting mirror (not shown in the figure). The laser emitted from the chirped amplified laser (CPA) undergoes phase processing by the first half-wave plate and beam splitting by the first polarizing beam splitter to generate a first laser path and a laser signal to be amplified. The first laser path is reflected by the first reflecting mirror and enters the laser broadening module. The optical parametric amplified laser acquires the laser signal to be amplified, undergoes chirped amplification, generates a second laser path, and sends it to the optical coherence imaging module. The wavelength of the first laser path is 800nm–1064nm; the wavelength of the second laser path is 1300nm–1700nm, which is a picosecond laser.

[0088] In this invention, the parameters of the chirped amplified laser (CPA) are not fixed and can be changed according to different experimental requirements and imaging effect requirements. For example, the output parameters of the CPA can be set as: a laser with a center wavelength of 1030nm, a full width at half maximum (FWHM) of 70nm, and a pulse width of 200fs; and then the laser emitted by the CPA can be broadened into a picosecond pulse light source with a center wavelength of 1030nm and a pulse width of 20ps through the photoacoustic light source broadening module.

[0089] The laser stretching module 12 stretches the first laser beam to form a stretched optical signal. Preferably, the stretched optical signal is a nanosecond laser. The stretching process of the laser stretching module 12 extends the time width of the laser pulse through different optical techniques, thereby making its spectral distribution wider. The stretching processing methods of this invention include: grating dispersion pulse stretching or material dispersion pulse stretching. When grating dispersion pulse stretching is used, the laser stretching module 12 includes, but is not limited to: Martinez stretcher, Overler stretcher, etc. The stretching medium of the laser stretching module 12 is any one of the following: a stretcher, a Treacy stretcher, or a Martinez stretcher based on a 4F system; when material dispersion pulse stretching is used, the stretching medium is including, but is not limited to: quartz material or zinc selenide material.

[0090] The optical coherence imaging module 13 includes: a first beam-splitting prism (not shown in the figure), an optical path compensation component 131, a second half-wave plate (not shown in the figure), a second polarization beam-splitting prism (not shown in the figure), a quarter-wave plate (not shown in the figure), a silicon window (not shown in the figure), a beam-combining prism (not shown in the figure), and an imaging component 132; wherein, the optical path compensation component 131 includes: a retroreflection prism and multiple plane mirrors; the retroreflection prism moves according to the position of the sample to be measured; the imaging component 132 includes: a first lens (not shown in the figure), an optical fiber (not shown in the figure), and a spectrometer (not shown in the figure); one end of the optical fiber is connected to the first lens, and the other end of the optical fiber is connected to the spectrometer. The spectrometer includes, but is not limited to, a CCD spectrometer.

[0091] The first optical path transmission module 14 includes: a first dichroic mirror (not shown in the figure); optionally, optical devices such as lenses and reflectors can be added to the first optical path transmission module 14 according to the needs of laser transmission.

[0092] The photoacoustic adaptive optics module 15 includes: a second lens (not shown in the figure), a right-angle mirror (not shown in the figure), an achromatic focusing mirror (not shown in the figure), a spatial light modulator (not shown in the figure), and a third lens (not shown in the figure). The spatial light modulator includes, but is not limited to, any one of a deformable mirror, a liquid crystal spatial light modulator, and a digital micromirror array.

[0093] The second optical path transmission module 16 includes a second reflector (not shown in the figure); optionally, optical devices such as lenses and reflectors can be added to the second optical path transmission module 16 according to the needs of laser transmission.

[0094] The beam scanning module 17 includes a third reflecting mirror, a scanning device 171, and a galvanometer 172; the scanning device 161 includes one or more of a polygonal scanning mirror, a MEMS scanning mirror, and an AOM scanning mirror.

[0095] The third optical path transmission module 18 includes: a fourth lens (not shown in the figure), a fourth reflector (not shown in the figure), a fifth lens (not shown in the figure), and a fifth reflector (not shown in the figure). Optionally, optical devices such as lenses and reflectors can be added to the third optical path transmission module 18 according to the needs of laser transmission.

[0096] The sample excitation module 19 includes: a second dichroic mirror (not shown in the figure), an objective lens (not shown in the figure), an ultrasonic transducer (not shown in the figure), and a water tank (not shown in the figure); the second dichroic mirror is positioned above the objective lens; the ultrasonic transducer and the water tank are integrated on the objective lens; the ultrasonic transducer is annular and is positioned on the lower surface of the objective lens or surrounds the side surface of the objective lens; the lower surface or side surface of the objective lens and the ultrasonic transducer are immersed together in the upper part of the water tank; the sample to be tested is placed in the lower part of the water tank; wherein, the medium contained in the water tank can be water or a coupling agent for ultrasonic detection; the ultrasonic transducer includes, but is not limited to, any one of a 64-array piezoelectric transducer, a 128-array piezoelectric transducer, and a 256-array piezoelectric transducer, preferably a 256-array piezoelectric transducer.

[0097] The photoacoustic signal acquisition module 20 is used to acquire the photoacoustic signal generated by the excitation of the sample in the sample excitation module 19, and convert the photoacoustic signal into a photoacoustic electrical signal and send it to the photoacoustic image calculation module 21.

[0098] The photoacoustic image calculation module 21 includes a photoacoustic image calculation unit 211 and an adaptive signal processing unit 212.

[0099] The detection module 22 includes: a sixth lens (not shown in the figure), a third dichroic mirror (not shown in the figure), a fluorescence detection device 221, and a harmonic detection device 222; wherein, the fluorescence detection device includes a first photomultiplier tube (not shown in the figure); and the harmonic detection device includes a second photomultiplier tube (not shown in the figure). In an optional embodiment, the fluorescence detection device 221 further includes a first bandpass filter (not shown in the figure), which is disposed between the third dichroic mirror and the first photomultiplier tube; the harmonic detection device 222 includes a second bandpass filter (not shown in the figure), which is disposed between the third dichroic mirror and the second photomultiplier tube.

[0100] In an optional embodiment, the aforementioned photoacoustic signal-assisted adaptive optics optimized multimodal imaging system 1 further includes a main frame (not shown in the figure); wherein the laser module 11, laser broadening module 12, optical coherence imaging module 13, first optical path transmission module 14, photoacoustic adaptive optics module 15, second optical path transmission module 16, beam scanning module 17, third optical path transmission module 18, sample excitation module 19, photoacoustic signal acquisition module 20, photoacoustic image calculation module 21, and detection module 22 are disposed within the main frame; the exterior of the main frame has openings for transmitting signal lines and power supply lines to the outside.

[0101] This invention provides a method for optimizing multimodal imaging based on photoacoustic signal-assisted adaptive optics, such as... Figure 2 As shown, combined with Figure 1System 1 describes the method, which specifically includes the following steps: The method for optimizing multimodal imaging based on photoacoustic signal-assisted adaptive optics includes the following steps:

[0102] Step 210: Start system 1. The emitted laser excites the sample under test, generating interference light signals, photoacoustic signals, optical coherence imaging signals, multiphoton signals, and multiple harmonic signals.

[0103] Specifically, it includes:

[0104] (1) Laser module 11 emits a first laser and a second laser, specifically including: the laser emitted by the chirped amplified laser (CPA) is sequentially processed by the phase of the first half-wave plate and the beam splitting by the first polarizing beam splitter to generate a first laser and a laser signal to be amplified; the first laser is reflected by the first mirror and enters the laser broadening module 12; the optical parametric amplified laser (OPA) acquires the laser signal to be amplified, performs chirped amplification processing to generate a second laser, and sends it to the optical coherent imaging module 13. The wavelength of the first laser is 800nm ​​to 1064nm; the wavelength of the second laser signal is 1300nm to 1700nm.

[0105] (2) The laser stretching module 12 acquires the first laser beam, performs stretching processing, and forms a stretched optical signal; wherein, the stretching processing method includes: grating dispersion pulse stretching or material dispersion pulse stretching; when grating dispersion pulse stretching is used, the laser stretching module 12 includes, but is not limited to: Martinez stretcher, Overler stretcher, etc. The stretching medium of the laser stretching module 12 is any one of the following: a stretcher, a Treacy stretcher, or a Martinez stretcher based on a 4F system; when material dispersion pulse stretching is used, the stretching medium is including, but is not limited to: quartz material or zinc selenide material.

[0106] (3) The optical coherent imaging module 13 acquires the second laser beam, performs beam splitting processing to generate a compensation light signal and a test light signal, and further performs multiple reflections on the compensation light to form a reference arm signal. Specifically, the first beam splitter acquires the second laser beam, performs beam splitting processing to form a compensation light signal and a test light signal; multiple plane mirrors in the optical path compensation component 131 acquire the compensation light signal, perform multiple reflection processing to form a first reflected light signal; the retroreflection prism acquires the first reflected light signal, performs reflection processing to form a reference arm signal; wherein, the beam energy ratio of the compensation light signal to the test light signal is 1:99.

[0107] (4) The broadened optical signal and the test optical signal pass sequentially through the first optical path transmission module 14, the photoacoustic adaptive optics module 15, and the second optical path transmission module 16 before entering the beam scanning module 17, specifically including:

[0108] The broadened light signal is reflected sequentially by the first dichroic mirror, focused by the second lens, reflected for the first time by the right-angle mirror, transmitted for the first time by the achromatic focusing mirror, and reflected by the spatial light modulator to generate the first parallel light. The first parallel light is transmitted sequentially by the achromatic focusing mirror for the second time, reflected for the second time by the right-angle mirror, focused by the third lens, and reflected by the second mirror to form an incident broadened light signal that enters the beam scanning module 17.

[0109] The test light signal passes through the transmission of the first dichroic mirror, the focusing of the second lens, the first reflection of the right-angle mirror, the first transmission of the achromatic focusing mirror, and the reflection of the spatial light modulator in sequence to generate the second parallel light. The second parallel light passes through the second transmission of the achromatic focusing mirror, the second reflection of the right-angle mirror, the focusing of the third lens, and the reflection of the second mirror in sequence to form the incident test light signal that enters the beam scanning module 17.

[0110] (5) The third reflector of the beam scanning module 17 adjusts the incident angle of the incident broadened light signal and the incident test light signal. The scanning device 171 scans the incident broadened light signal and the incident test light signal in the X-axis direction. The galvanometer 172 scans the incident broadened light signal and the incident test light signal in the Y-axis direction to generate the outgoing broadened light signal and the outgoing test light signal. The X-axis is perpendicular to the Y-axis.

[0111] The emitted broadened light signal and the emitted test light signal enter the sample excitation module through the third optical path transmission module 18. Specifically, the emitted broadened light signal and the emitted test light signal pass through the transmission of the fourth lens, the reflection of the fourth mirror, the transmission of the fifth lens, and the reflection of the fifth mirror in sequence before entering the sample excitation module 19.

[0112] (6) The sample excitation module 19 acquires the emitted broadened light signal and the emitted test light signal. After the emitted broadened light signal and the emitted test light signal pass through the second dichroic mirror and enter the objective lens, they act on the sample to be tested.

[0113] The emitted broadened light signal excites the sample to generate a photoacoustic signal, which is then converted into a photoacoustic electrical signal by an ultrasonic transducer and sent to the photoacoustic signal acquisition module 20. The photoacoustic signal acquisition module 20 collects the photoacoustic signal, analyzes and processes it to generate a photoacoustic microscopic imaging electrical signal, and sends the photoacoustic microscopic imaging electrical signal to the photoacoustic image calculation module 21.

[0114] The emitted test light signal excites the sample under test to generate an excitation light signal. The second dichroic mirror separates the excitation light signal, forming a sample excitation light signal and an optical coherent imaging signal. The sample excitation light signal is reflected by the second dichroic mirror and enters the detection module 22. The optical coherent imaging signal is transmitted through the second dichroic mirror and enters the third optical path transmission module 18. After the sixth lens of the detection module 22 focuses the excitation light signal, it is then processed by the third dichroic mirror to separate the excitation light signal into a multiphoton signal and multiple harmonic signals.

[0115] The optical coherent imaging signal sequentially passes through the third optical path transmission module 18, the beam scanning module 17, the second optical path transmission module 16, the photoacoustic adaptive optics module 15, and the first optical path transmission module 14 before returning to the optical coherent imaging module 13. The beam combining prism in the optical coherent imaging module 13 performs beam combining interference processing on the reference arm signal and the optical coherent imaging signal to form an interference light signal. The first lens acquires the interference light signal, and after focusing processing, forms a focused imaging light signal. The spectrometer of the imaging component 132 acquires the focused imaging light signal through an optical fiber, analyzes and processes it to generate an optical coherent imaging electrical signal, which is then processed by an external display device (not shown in the figure) to output an optical coherent imaging image.

[0116] The first photomultiplier tube of the detection module 22 detects and analyzes the multiphoton signal, generates a multiphoton electrical signal, and sends the multiphoton electrical signal to an external display device (not shown in the figure) connected to the first photomultiplier tube. The external display device processes the multiphoton electrical signal and outputs a fluorescence image.

[0117] The second photomultiplier tube of the detection module 22 detects and analyzes the multiple harmonic signals, generates multiple harmonic imaging electrical signals, and sends the multiple harmonic imaging electrical signals to an external display device (not shown in the figure) connected to the second photomultiplier tube. The external display device processes the multiple harmonic imaging electrical signals and outputs a harmonic image.

[0118] Step 220: The photoacoustic signal acquisition module 20 acquires the photoacoustic electrical signal and converts the photoacoustic signal into a photoacoustic microscopic imaging electrical signal, which is then sent to the photoacoustic image calculation module 21.

[0119] Step 230: The photoacoustic image calculation module 21 collects the photoacoustic microscopic imaging electrical signal, preprocesses it to generate an optimized photoacoustic microscopic image, uses a machine learning algorithm to perform phase inversion calculation on the optimized photoacoustic microscopic image to generate a photoacoustic phase adjustment signal, and sends the photoacoustic phase adjustment signal to the photoacoustic adaptive optics module 15 to adjust the spatial light modulator.

[0120] Specifically, the photoacoustic image computing unit 211 collects photoacoustic microscopic imaging electrical signals, preprocesses the photoacoustic microscopic imaging electrical signals to obtain an optimized photoacoustic microscopic image, and sends the optimized photoacoustic microscopic image to the adaptive signal processing unit 212; the adaptive signal processing unit 212 uses machine learning algorithms to perform phase inversion calculations on the optimized photoacoustic microscopic image, identifies and analyzes low-resolution regions in the optimized photoacoustic microscopic image, generates a photoacoustic phase adjustment signal, and sends the photoacoustic phase adjustment signal to the photoacoustic adaptive optics module 15 to adjust the spatial light modulator;

[0121] The preprocessing includes: the photoacoustic image calculation unit 211 performs one or more of the following processes on the photoacoustic electrical signal: signal denoising, dynamic range adjustment, and spectral filtering;

[0122] The machine learning algorithm includes a deep neural network. This algorithm analyzes the acquired photoacoustic microscope images to identify low-resolution regions. These low-resolution regions are typically associated with loss of image detail or insufficient imaging depth. The machine learning algorithm's model can infer the required optical phase change for optimization based on image features and prior learning experience. Based on the machine learning inference, the required photoacoustic phase adjustment signal is fed back to the adaptive optics module 15 in the system.

[0123] Step 240: The adjusted spatial light modulator performs phase adjustment on the broadened light signal and the test light signal that re-enter the photoacoustic adaptive optics module 15.

[0124] The optical adaptive optics module 15 adjusts the shape of the spatial light modulator (including but not limited to deformable mirrors, liquid crystal spatial light modulators, and digital micromirror arrays) in real time according to the adjustment information of the input photoacoustic phase adjustment signal, thereby precisely adjusting the optical performance of the multimodal imaging system and improving the resolution of photoacoustic microscopy.

[0125] This method achieves dynamic adjustment and optimization of the adaptive optics system through a multi-iterative feedback mechanism. After each optimization, the system re-acquires imaging data and further adjusts the optical settings using machine learning algorithms until the desired imaging effect is achieved.

[0126] Specifically, the broadened light signal that re-enters the photoacoustic adaptive optics module 15 is reflected by the first dichroic mirror, focused by the second lens, reflected for the first time by the right-angle mirror, transmitted for the first time by the achromatic focusing mirror, and phase-adjusted by the spatial light modulator to generate a phase-adjusted broadened light signal.

[0127] The test light signal that re-enters the photoacoustic adaptive optics module 15 passes through the transmission of the first dichroic mirror, the focusing of the second lens, the first reflection of the right-angle mirror, the first transmission of the achromatic focusing mirror, and the phase adjustment of the spatial light modulator to generate a phase-adjusted test light signal.

[0128] The phase-adjusted broadened light signal and the phase-adjusted test light signal are sequentially transmitted through the achromatic focusing mirror for the second time, reflected by the right-angle mirror for the second time, focused by the third lens, and reflected by the second mirror, to form the optimized incident broadened light signal and the optimized incident test light signal, respectively.

[0129] Step 250: The phase-adjusted broadened optical signal and the test optical signal pass through the second optical path transmission module 16, the beam scanning module 17, and the third optical path transmission module 18 in sequence and enter the sample excitation module 19 to excite the sample to be tested again, generating optimized multiphoton signals, multiple harmonic signals and photoacoustic signals respectively.

[0130] Specifically, in this step, the phase-adjusted broadened light signal and test light signal in the photoacoustic adaptive optics module 15, namely the optimized incident broadened light signal and the optimized incident test light signal, repeat the process of steps (4) to (6) of S1. The phase-adjusted broadened light signal and test light signal pass through the second optical path transmission module 16, the beam scanning module 17, and the third optical path transmission module 18 in sequence and enter the sample excitation module 19 to excite the sample to be tested again, thereby generating the optimized multiphoton signal, multiple harmonic signal and photoacoustic signal respectively.

[0131] The photoacoustic signal acquisition module 20 continues to acquire the optimized photoacoustic signal and converts it into an optimized photoacoustic electrical signal, which is then sent to the photoacoustic image calculation module 21. The photoacoustic image calculation unit 211 further preprocesses the optimized photoacoustic electrical signal to form a new optimized photoacoustic microscopic image. The adaptive signal processing unit 212 then performs phase inversion calculation on the new optimized photoacoustic microscopic image to generate a photoacoustic phase adjustment signal, which is then sent to the photoacoustic adaptive optics module 15. This process is repeated iteratively to optimize the signal.

[0132] Step 260: Output the optimized fluorescence image and harmonic image;

[0133] Specifically: the detection module 19 acquires the optimized multiphoton signal, and after detection, converts the optimized multiphoton signal into a multiphoton electrical signal, which is then processed by an external display device to output an optimized fluorescence image;

[0134] The detection module 19 acquires the optimized multiple harmonic signals, and after detection, converts the optimized multiple harmonic signals into multiple harmonic imaging electrical signals, which are then processed by an external display device (not shown in the figure) to output an optimized harmonic image.

[0135] The photoacoustic signal acquisition module 20 collects optimized photoacoustic signals and sends them to the photoacoustic image calculation module 21. The optimized photoacoustic image formed by the preprocessing of the photoacoustic signals can be stored and backed up in the photoacoustic image calculation module as a signal source for phase inversion technology, thereby enabling adaptive control. When the image result of this photoacoustic mode needs to be called, the photoacoustic image information can be extracted from the photoacoustic image calculation module 21 and transmitted to an external display device (not shown in the figure) to output an optimized photoacoustic microscopic image.

[0136] In this invention, the photoacoustic image calculation module 21 consists of a photoacoustic image calculation unit 211 and an adaptive signal processing unit 212. The photoacoustic image calculation unit acquires photoacoustic signals from the photoacoustic signal acquisition module 20 in the multimodal imaging system, converts them into image data, and performs certain preprocessing. The preprocessing includes signal denoising, dynamic range adjustment, and spectral filtering to ensure signal quality and processing accuracy. This process effectively removes background noise and instrument errors, improving the reliability of subsequent calculations. The photoacoustic image acquisition module obtains photoacoustic signals from samples using a photoacoustic microscope. The photoacoustic image calculation unit processes these signals to generate corresponding photoacoustic images (ultrasound images). These images are then input into a machine learning algorithm for further analysis. Specifically, the machine learning model used may include a deep convolutional neural network (CNN) or other image processing and recognition algorithms. The model learns from a large amount of labeled data through training, extracting feature information from the image. The algorithm analyzes the spatial distribution and signal intensity of the image, identifies low-resolution regions, infers the optical phase changes that need adjustment, and transmits this information to the adaptive signal processing unit.

[0137] The effects of the adaptive optics technology used in this invention on three photons and the third harmonic are as follows:

[0138] The resolution of three-photon imaging signals and third harmonic imaging signals is positively correlated with the number of photons emitted by the sample. Without photobleaching, the number of photons emitted by the sample is proportional to the number of photons absorbed. Where N abs σ is the number of photons absorbed by the sample, C is the sample concentration, σ is the sample absorption cross section, I is the laser intensity, and the last term, S integral, is the three-dimensional intensity spatial distribution at the laser focal point.

[0139] The adaptive optics used in this invention influences the S-integral term. By adjusting the laser wavefront phase through adaptive optics, the scattering caused by the system is reduced, thereby improving the system's point spread function (PSF), focusing more laser energy at the intersection point, increasing the S-integral, and thus improving signal quality.

[0140] To better understand the technical solution provided by the present invention, the following specific examples illustrate the system for implementing the method of photoacoustic signal-assisted adaptive optics optimization of multimodal imaging.

[0141] Example 1

[0142] This invention provides a system 2 for performing a method for optimizing multimodal imaging based on photoacoustic signal-assisted adaptive optics, such as... Figure 3 The diagram shows the structure. The modules and components of System 2 are described below.

[0143] System 2 includes: laser module A, laser broadening module B, optical coherence imaging module C, first optical path transmission module D, photoacoustic adaptive optics module E, second optical path transmission module F, beam scanning module G, third optical path transmission module H, sample excitation module M, photoacoustic signal acquisition module N, photoacoustic image calculation module S, and detection module T.

[0144] The laser module A includes a chirped amplified laser assembly (not shown in the figure) and an optical parametric amplified laser (OPA). The chirped amplified laser assembly includes a chirped amplified laser (CPA), a first half-wave plate 30, a first polarizing beam splitter 31, and a first reflector 32. The wavelength of the first laser signal is 800 nm to 1064 nm; the wavelength of the second chirped amplified laser signal is 1300 nm to 1700 nm.

[0145] The laser stretching module B stretches the laser pulse by extending its duration using various optical techniques, thereby broadening its spectral distribution. The stretching methods of this invention include: grating dispersion pulse stretching or material dispersion pulse stretching; when using grating dispersion pulse stretching, the laser stretching module B includes, but is not limited to: Martinez stretchers, Overler stretchers, etc. The stretching medium of the laser stretching module 12 may be any one of the following: a stretcher, a Treacy stretcher, or a Martinez stretcher based on a 4F system; when material dispersion pulse stretching is used, the stretching medium may be a quartz material or a zinc selenide material.

[0146] The optical coherent imaging module C includes: a first beam splitter 33, multiple plane mirrors 34, a retroreflection prism 35, a second half-wave plate 36, a second polarizing beam splitter 37, a quarter-wave plate 38, a silicon window 39, a beam combiner prism 40, a first lens 41, an optical fiber 42, and a CCD spectrometer 43; one end of the optical fiber 42 is connected to the first lens 41, and the other end of the optical fiber 42 is connected to the CCD spectrometer 43.

[0147] The first optical path transmission module D includes: a first dichroic mirror 44.

[0148] The photoacoustic adaptive optics module E includes: a second lens 45, a right-angle mirror 46, an achromatic focusing mirror 47, a deformable mirror 48, and a third lens 49.

[0149] The second optical path transmission module F includes: a second reflector 50.

[0150] The beam scanning module G includes: a third reflecting mirror 51, a scanning device 52, and a galvanometer 53; wherein, the scanning device 52 is a polygonal scanning mirror.

[0151] The third optical path transmission module H includes: a fourth lens 54, a fourth reflector 55, a fifth lens 56, and a fifth reflector 57.

[0152] The sample excitation module M includes: a second dichroic mirror 58, an objective lens 59, an ultrasonic transducer 60, and a water tank 61; the second dichroic mirror 58 is positioned above the objective lens 59; the ultrasonic transducer 60 and the water tank 61 are integrated on the objective lens; the ultrasonic transducer 60 is annular and surrounds the side surface of the objective lens 59; the lower surface of the objective lens 59 is immersed in the upper part of the water tank 61; the sample to be tested is placed in the lower part of the water tank 61. In this embodiment, the ultrasonic transducer 59 is a 256-array piezoelectric transducer; the medium carried in the water tank 61 is water.

[0153] The detection module T includes: a sixth lens 62, a third dichroic mirror 63, a first photomultiplier tube 64, and a second photomultiplier tube 65.

[0154] The photoacoustic image calculation module S includes: a photoacoustic image calculation unit 66 and an adaptive signal processing unit 67.

[0155] This invention provides an application system 2 for performing a method of photoacoustic signal-assisted adaptive optics-optimized multimodal imaging, combined with... Figure 3 The specific steps of this method are as follows.

[0156] Step 310: Start system 2. The emitted laser excites the sample under test, generating interference light signals, photoacoustic signals, optical coherence imaging signals, multiphoton signals, and multiple harmonic signals.

[0157] Specifically, it includes:

[0158] (1) Laser module A outputs a first laser and a second laser, specifically including: the laser emitted by the chirped amplified laser (CPA) is sequentially processed by the phase of the first half-wave plate 30 and the beam splitting by the first polarizing beam splitter 31 to generate a first laser and a laser signal to be amplified; the first laser is reflected by the first reflector 32 and enters the laser broadening module B; the optical parametric amplified laser (OPA) acquires the laser signal to be amplified, performs chirped amplification processing to generate a second laser, and sends it to the optical coherent imaging module C. In this embodiment, the parameters of the CPA output laser are: a center wavelength of 1030nm, a full width at half maximum (FWHM) of 70nm, and a pulse width of 200fs; then the laser emitted by the CPA is broadened by the laser broadening module B into a picosecond pulse laser with a center wavelength of 1030nm and a pulse width of 20ps.

[0159] (2) The laser broadening module B acquires the first laser beam, performs broadening processing, and forms a broadened optical signal; wherein, in this embodiment, the broadening processing method uses a material dispersion pulse broadener, and quartz is selected as the broadening material, such as... Figure 3 The laser broadening module B shown uses multiple sets of mirrors to allow the incident first laser to pass back and forth through the quartz material multiple times, thereby achieving the effect of broadening the material's dispersion.

[0160] (3) The optical coherent imaging module C acquires the second laser beam, performs beam splitting processing to generate a compensation light signal and a test light signal, and further reflects the compensation light multiple times to form a reference arm signal. Specifically, the first beam splitter prism 33 acquires the second laser beam, performs beam splitting processing to form a compensation light signal and a test light signal; multiple plane mirrors 34 acquire the compensation light signal, and perform multiple reflection processing to form a first reflected light signal; the retroreflection prism 35 acquires the first reflected light signal, and performs reflection processing to form a reference arm signal; wherein, the beam energy ratio of the compensation light signal to the test light signal is 1:99.

[0161] (4) The broadened optical signal and the test optical signal pass sequentially through the first optical path transmission module D, the photoacoustic adaptive optics module E, and the second optical path transmission module F before entering the beam scanning module G. Specifically, this includes:

[0162] The broadened light signal is reflected sequentially by the first dichroic mirror 44, focused by the second lens 45, reflected for the first time by the right-angle mirror 46, transmitted for the first time by the achromatic focusing mirror 47, and reflected by the deformable mirror 48 to generate the first parallel light. The first parallel light is transmitted for the second time by the achromatic focusing mirror 47, reflected for the second time by the right-angle mirror 46, focused by the third lens 49, and reflected by the second mirror 50 to form an incident broadened light signal that enters the beam scanning module G.

[0163] The test light signal is transmitted sequentially through the first dichroic mirror 44, focused by the second lens 45, reflected for the first time by the right-angle mirror 46, transmitted for the first time by the achromatic focusing mirror 47, and reflected by the deformable mirror 48 to generate a second parallel light. The second parallel light is transmitted sequentially through the achromatic focusing mirror 47, reflected for the second time by the right-angle mirror 46, focused by the third lens 49, and reflected by the second mirror 50 to form an incident test light signal that enters the beam scanning module G.

[0164] The incident broadened light signal and the incident test light signal share the same optical path and are almost physically identical.

[0165] (5) The third reflection mirror 51 of the beam scanning module G adjusts the incident angle of the incident broadened light signal and the incident test light signal. The scanning device 52 scans the incident broadened light signal and the incident test light signal in the X-axis direction. The galvanometer 53 scans the incident broadened light signal and the incident test light signal in the Y-axis direction to generate the outgoing broadened light signal and the outgoing test light signal. The X-axis is perpendicular to the Y-axis.

[0166] The emitted broadened light signal and the emitted test light signal pass through the third optical path transmission module H and enter the sample excitation module M. Specifically, the emitted broadened light signal and the emitted test light signal pass through the transmission of the fourth lens 54, the reflection of the fourth mirror 55, the transmission of the fifth lens 56, and the reflection of the fifth mirror 57 in sequence before entering the sample excitation module M.

[0167] (6) The sample excitation module M acquires the emitted broadened light signal and the emitted test light signal. The emitted broadened light signal and the emitted test light signal pass through the second dichroic mirror 58 and enter the objective lens 59, and then act on the sample to be tested.

[0168] The emitted broadened light signal excites the sample under test to generate a photoacoustic signal, which is then converted into a photoacoustic electrical signal by the ultrasonic transducer 60 and sent to the photoacoustic signal acquisition module N. The photoacoustic signal acquisition module N collects the photoacoustic electrical signal, analyzes and processes it to generate a photoacoustic microscopic imaging electrical signal, and sends the photoacoustic microscopic imaging electrical signal to the photoacoustic image calculation module S.

[0169] The emitted test light signal excites the sample under test to generate an excitation light signal. The second dichroic mirror 58 separates the excitation light signal, forming a sample excitation light signal and an optical coherent imaging signal. The sample excitation light signal is reflected by the second dichroic mirror 58 and enters the detection module T. The optical coherent imaging signal is transmitted through the second dichroic mirror 58 and enters the third optical path transmission module H. The sixth lens 62 of the detection module T focuses the sample excitation light signal and then separates it through the third dichroic mirror 63, forming a multiphoton signal and multiple harmonic signals.

[0170] The optical coherent imaging signal sequentially passes through the third optical path transmission module H, the beam scanning module G, the second optical path transmission module F, the photoacoustic adaptive optics module E, and the first optical path transmission module D before returning to the optical coherent imaging module C. The beam combining prism 40 in the optical coherent imaging module C performs beam combining interference processing on the reference arm signal and the optical coherent imaging signal to form an interference light signal. The first lens 41 acquires the interference light signal, and after focusing processing, forms a focused imaging light signal. The CCD spectrometer 43 acquires the focused imaging light signal through the optical fiber 42, analyzes and processes it to generate an optical coherent imaging electrical signal, which is then used by an external display device (not shown in the figure) to process the optical coherent imaging electrical signal and output an optical coherent imaging image.

[0171] The first photomultiplier tube 64 of the detection module T detects and analyzes the multiphoton signal, generates a multiphoton electrical signal, and sends the multiphoton electrical signal to an external display device (not shown in the figure) connected to the first photomultiplier tube 64. The external display device processes the multiphoton electrical signal and outputs a fluorescence image.

[0172] The second photomultiplier tube 65 of the detection module T detects and analyzes the multiple harmonic signals, generates multiple harmonic imaging electrical signals, and sends the multiple harmonic imaging electrical signals to an external display device (not shown in the figure) connected to the second photomultiplier tube 65. The external display device processes the multiple harmonic imaging electrical signals and outputs a harmonic image.

[0173] Step 320: The photoacoustic signal acquisition module 20 acquires the photoacoustic electrical signal and converts the photoacoustic signal into a photoacoustic microscopic imaging electrical signal, which is then sent to the photoacoustic image calculation module S.

[0174] Step 330: The photoacoustic image calculation unit 66 of the photoacoustic image calculation module S collects the photoacoustic microscopic imaging electrical signal and performs preprocessing such as signal denoising, dynamic range adjustment, and spectral filtering on the photoacoustic microscopic imaging electrical signal to obtain an optimized photoacoustic microscopic image. The optimized photoacoustic microscopic image is then sent to the adaptive signal processing unit 67. The adaptive signal processing unit 67 uses a deep neural network to perform phase inversion calculation on the optimized photoacoustic microscopic image, identifies and analyzes the low-resolution region in the photoacoustic microscopic image, generates a photoacoustic phase adjustment signal, and sends the photoacoustic phase adjustment signal to the photoacoustic adaptive optics module E to adjust the deformable mirror 48.

[0175] Step 340: The deformable mirror 48, after adjustment, performs phase adjustment on the broadened optical signal and the test optical signal that re-enter the photoacoustic adaptive optics module E;

[0176] Specifically, the broadened light signal and the test light signal that re-enter the photoacoustic adaptive optics module E are focused by the second lens 45, reflected for the first time by the right-angle mirror 46, transmitted for the first time by the achromatic focusing mirror 47, and phase-adjusted by the deformable mirror 48, respectively generating the phase-adjusted broadened light signal and the phase-adjusted test light signal.

[0177] The phase-adjusted broadened light signal and the phase-adjusted test light signal are sequentially transmitted through the achromatic focusing mirror 47 for the second time, reflected by the right-angle mirror 46 for the second time, focused by the third lens 49, and reflected by the second mirror 60, to form the optimized incident broadened light signal and the optimized incident test light signal, respectively.

[0178] In this step, the photoacoustic adaptive optics module E can iteratively feedback multiple times based on the adjustment information of the input photoacoustic phase adjustment signal, and change the shape of the deformable mirror 48 in real time, thereby dynamically and precisely adjusting the optical performance of the system and improving the resolution of photoacoustic microscopy imaging.

[0179] Step 350: In the photoacoustic adaptive optics module E, the phase-adjusted broadened light signal and the test light signal, i.e. the optimized incident broadened light signal and the optimized incident test light signal, repeat the process of (4) to (6) of step S1. The phase-adjusted broadened light signal and the test light signal pass through the second optical path transmission module F, the beam scanning module G, and the third optical path transmission module H in sequence and enter the sample excitation module M, to excite the sample to be tested again, and generate the optimized multiphoton signal, multiple harmonic signal and photoacoustic signal respectively.

[0180] Step 360: Output optimized fluorescence and harmonic images;

[0181] Specifically: The process of generating optimized fluorescence and harmonic images based on optimized multiphoton and multiple harmonic signals in this step is the same as the imaging operation process in step 310(6), and will not be repeated here; the optimized photoacoustic image can be extracted by the photoacoustic image calculation module S and transmitted to an external display device (not shown in the figure) to output the optimized photoacoustic image.

[0182] Those skilled in the art will further recognize that the units and algorithm steps of the various examples described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, computer software, or a combination of both. To clearly illustrate the interchangeability of hardware and software, the components and steps of the various examples have been generally described in terms of functionality in the foregoing description. Whether these functions are implemented in hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementations should not be considered beyond the scope of this invention.

[0183] The steps of the methods or algorithms described in conjunction with the embodiments disclosed herein can be implemented in hardware, a software module executed by a processor, or a combination of both. The software module can be located in random access memory (RAM), main memory, read-only memory (ROM), electrically programmable ROM, electrically erasable programmable ROM, registers, hard disk, removable disk, CD-ROM, or any other form of storage medium known in the art.

[0184] The specific embodiments described above further illustrate the purpose, technical solution, and beneficial effects of the present invention. It should be understood that the above description is only a specific embodiment of the present invention and is not intended to limit the scope of protection of the present invention. Any modifications, equivalent substitutions, improvements, etc., made within the spirit and principles of the present invention should be included within the scope of protection of the present invention.

Claims

1. A method for adaptive optical optimization of multimodal imaging assisted by photoacoustic signals, characterized in that, The system for executing the method comprises a laser module, a laser broadening module, an optical coherence imaging module, a first light path transmission module, an optoacoustic adaptive optical module, a second light path transmission module, a light beam scanning module, a third light path transmission module, a sample excitation module, an optoacoustic signal acquisition module, an optoacoustic image calculation module and a detection module; the optoacoustic adaptive optical module comprises a spatial light modulator; The method comprises: Step S1, starting the system, the laser module emits first and second lasers, the laser broadening module converts the first laser into a broadened optical signal; the optical coherence imaging module splits the second laser into a compensation optical signal and a test optical signal, the compensation optical signal forms a reference arm signal after multiple reflections; the broadened optical signal and the test optical signal successively pass through the first light path transmission module, the optoacoustic adaptive optical module, the second light path transmission module, the light beam scanning module, the third light path transmission module and enter the sample excitation module, excite the sample to be tested, generate an optoacoustic signal, an optical coherence imaging signal, a multi-photon signal and a multiple harmonic signal; the optical coherence imaging signal is used to form an optical coherence imaging image; after the multi-photon signal and the multiple harmonic signal are detected by the detection module, they are respectively output as a fluorescence image and a harmonic image; Step S2, the optoacoustic signal acquisition module acquires the optoacoustic signal converted into an optoacoustic electrical signal and converts the optoacoustic electrical signal into an optoacoustic microscopic imaging electrical signal and sends the optoacoustic microscopic imaging electrical signal to the optoacoustic image calculation module; Step S3, the optoacoustic image calculation module collects the optoacoustic microscopic imaging electrical signal, generates an optimized optoacoustic microscopic image after preprocessing, uses a machine learning algorithm to calculate the phase inversion of the optimized optoacoustic microscopic image, generates an optoacoustic phase adjustment signal and uses the optoacoustic phase adjustment signal to adjust the spatial light modulator; Step S4, the spatial light modulator after adjustment adjusts the phase of the broadened optical signal and the test optical signal entering the optoacoustic adaptive optical module again; Step S5, the broadened optical signal and the test optical signal after phase adjustment successively pass through the second light path transmission module, the light beam scanning module and the third light path transmission module, enter the sample excitation module, excite the sample to be tested again, generate an optimized multi-photon signal, a multiple harmonic signal and an optoacoustic signal respectively and further output an optimized fluorescence image and an optimized harmonic image.

2. The method of claim 1, wherein, The step S1 specifically comprises: Starting the system, the laser module emits first and second lasers; The laser broadening module acquires the first laser, performs broadening processing and forms a broadened optical signal; The optical coherence imaging module acquires the second laser, performs splitting processing, generates a compensation optical signal and a test optical signal and further performs multiple reflections on the compensation optical signal to form a reference arm signal; The broadened optical signal and the test optical signal successively pass through the first light path transmission module, the optoacoustic adaptive optical module, the second light path transmission module, the light beam scanning module and the third light path transmission module to form an emitted broadened optical signal and an emitted test optical signal respectively and enter the sample excitation module; The exit test light signal excites the sample to be tested to generate an excitation light signal; The excitation light signal is separated to generate a sample excitation light signal and an optical coherence imaging signal; The optical coherence imaging signal sequentially passes through the third light path transmission module, the light beam scanning module, the second light path transmission module, the optical coherence adaptive optical module, the first light path transmission module, and returns to the optical coherence imaging module, and is subjected to beam combination interference processing with the reference arm signal to form an interference light signal, which is converted into an optical coherence imaging electrical signal for outputting an optical coherence imaging image; The detection module acquires the sample excitation light signal, performs focusing and beam splitting processing to form a multiphoton signal and a multiple harmonic signal, and converts the multiphoton signal and the multiple harmonic signal into a multiphoton electrical signal and a multiple harmonic imaging electrical signal, respectively, for outputting a fluorescence image and a harmonic image. The laser light source module comprises a chirped amplification laser, a first half-wave plate, a first polarization beam splitter prism, a first mirror and an optical parametric amplification laser; 3. The method of claim 2, wherein, The laser module emits first and second lasers, specifically, the laser emitted by the chirped amplification laser passes through phase processing of the first half-wave plate and beam splitting processing of the first polarization beam splitter prism in sequence to generate a first laser and a laser signal to be amplified; the first laser enters the laser broadening module through reflection of the first mirror; the optical parametric amplification laser acquires the laser signal to be amplified and generates a second laser through chirped amplification processing, and sends the second laser to the optical coherence imaging module; The broadening processing comprises grating dispersion pulse broadening processing or material dispersion pulse broadening processing; when the grating dispersion pulse broadening processing is adopted, the laser broadening module comprises any one of a Martinez stretcher, an O'Friel stretcher, a Treacy stretcher and a Martinez stretcher based on a 4F system; when the material dispersion pulse broadening is adopted, the broadening medium of the laser broadening module comprises quartz material or zinc selenide material. The optical coherence imaging module comprises a first beam splitter prism, an optical path compensation assembly, a second half-wave plate, a second polarization beam splitter prism, a quarter-wave plate, a silicon window piece, a beam combination prism and an imaging assembly; the optical path compensation assembly comprises a retroreflective prism and a plurality of plane mirrors; the retroreflective prism moves according to the position of the sample to be tested; the imaging assembly comprises a first lens, an optical fiber and a spectrometer; one end of the optical fiber is connected to the first lens, and the other end of the optical fiber is connected to the spectrometer; 4. The method of claim 2, wherein, The first beam splitter prism acquires the second laser, performs beam splitting processing to form a compensation light signal and a test light signal; the beam energy ratio of the compensation light signal to the test light signal is 1:

99. ​ The multiple plane mirrors acquire the compensation light signal, and form a first reflected light signal through multiple reflection processes; the retroreflective prism acquires the first reflected light signal, and forms a reference arm signal through reflection processes; The test light signal sequentially passes through the second half-wave plate, the second polarization beam splitter prism, the quarter-wave plate, and is reflected by the silicon window piece, and then enters the first optical path conduction module; the silicon window piece is placed according to the Brewster angle, and performs dispersion compensation on the test light signal; The beam combining prism performs beam combining interference processing on the reference arm signal and the optical coherence imaging signal, and forms an interference light signal; The first lens acquires the interference light signal, and forms a focused imaging light signal through focusing processing; The spectrometer acquires the focused imaging light signal through the optical fiber, performs analysis processing, generates an optical coherence imaging electrical signal, processes the optical coherence imaging electrical signal by an external display device, and outputs an optical coherence imaging image.

5. The method according to claim 1 or 2, characterized in that, The first optical path conduction module comprises a first dichroic mirror; The photoacoustic adaptive optical module further comprises a second lens, a right-angle mirror, an achromatic focusing lens, and a third lens; the spatial light modulator comprises any one of a deformable mirror, a digital micromirror array, or a liquid crystal spatial light modulator; The second optical path conduction module comprises a second mirror; The expanded light signal and the test light signal sequentially pass through the first optical path conduction module, the photoacoustic adaptive optical module, and the second optical path conduction module to enter the beam scanning module, and specifically include: The expanded light signal sequentially passes through reflection of the first dichroic mirror, focusing of the second lens, first reflection of the right-angle mirror, first transmission of the achromatic focusing lens, and reflection of the spatial light modulator to generate a first parallel light; the first parallel light sequentially passes through second transmission of the achromatic focusing lens, second reflection of the right-angle mirror, focusing of the third lens, and reflection of the second mirror to form an incident expanded light signal entering the beam scanning module; The test light signal sequentially passes through transmission of the first dichroic mirror, focusing of the second lens, first reflection of the right-angle mirror, first transmission of the achromatic focusing lens, and reflection of the spatial light modulator to generate a second parallel light; the second parallel light sequentially passes through second transmission of the achromatic focusing lens, second reflection of the right-angle mirror, focusing of the third lens, and reflection of the second mirror to form an incident test light signal entering the beam scanning module; In the step S4, the expanded light signal and the test light signal re-entering the photoacoustic adaptive optical module are phase adjusted, and specifically include: The stretched optical signal entering the photoacoustic adaptive optical module again is sequentially subjected to focusing of the second lens, first reflection of the right-angle mirror, first transmission of the achromatic focusing mirror, phase adjustment of the spatial light modulator, to generate a phase-adjusted stretched optical signal; the phase-adjusted stretched optical signal is sequentially subjected to second transmission of the achromatic focusing mirror, second reflection of the right-angle mirror, focusing of the third lens, and reflection of the second mirror, to form an optimized incident stretched optical signal; The test optical signal entering the photoacoustic adaptive optical module again is sequentially subjected to focusing of the second lens, first reflection of the right-angle mirror, first transmission of the achromatic focusing mirror, phase adjustment of the spatial light modulator, to generate a phase-adjusted test optical signal; the phase-adjusted test optical signal is sequentially subjected to second transmission of the achromatic focusing mirror, second reflection of the right-angle mirror, focusing of the third lens, and reflection of the second mirror, to generate an optimized incident test optical signal.

6. The method of claim 5, wherein, The light beam scanning module comprises a third mirror, a scanning device, and a galvanometer; The third optical path conducting module comprises a fourth lens, a fourth mirror, a fifth lens, and a fifth mirror; The third mirror adjusts the incident angle of the incident stretched optical signal and the incident test optical signal, or adjusts the incident angle of the optimized incident stretched optical signal and the optimized incident test optical signal; The scanning device performs scanning processing on the incident stretched optical signal and the incident test optical signal, or on the optimized incident stretched optical signal and the optimized incident test optical signal in the X-axis direction, and the galvanometer performs scanning processing on the incident stretched optical signal and the incident test optical signal, or on the optimized incident stretched optical signal and the optimized incident test optical signal in the Y-axis direction, to generate an outgoing stretched optical signal and an outgoing test optical signal, or to generate an optimized outgoing stretched optical signal and an optimized outgoing test optical signal; the X-axis is perpendicular to the Y-axis; The outgoing stretched optical signal and the outgoing test optical signal, or the optimized outgoing stretched optical signal and the optimized outgoing test optical signal, enter the sample excitation module through transmission of the fourth lens, reflection of the third mirror, transmission of the fifth lens, and reflection of the fourth mirror.

7. The method of claim 2, wherein, The sample excitation module comprises a second dichroic mirror, an objective lens, an ultrasonic transducer, and a water tank; the second dichroic mirror is arranged above the objective lens; the ultrasonic transducer and the water tank are integrated on the objective lens; the ultrasonic transducer is annular and arranged on the lower surface of the objective lens or around the side surface of the objective lens; the lower surface or the side surface of the objective lens is immersed in the upper part of the water tank together with the ultrasonic transducer; and the sample to be measured is arranged in the lower part of the water tank; After the outgoing stretched optical signal and the outgoing test optical signal pass through the second dichroic mirror and enter the objective lens, they act on the sample to be measured. The outgoing broadened light signal excites the sample to be tested to generate a photoacoustic signal, and the photoacoustic signal is converted into a photoacoustic electrical signal by the ultrasonic transducer and sent to the photoacoustic signal acquisition module; the photoacoustic signal acquisition module collects the photoacoustic electrical signal, analyzes and processes to generate a photoacoustic microscopic imaging electrical signal, and sends the photoacoustic microscopic imaging electrical signal to the photoacoustic image calculation module; The outgoing test light signal excites the sample to be tested to generate an excitation light signal, the second dichroic mirror separates the excitation light signal to form a sample excitation light signal and an optical coherence imaging signal, so that the sample excitation light signal is reflected into the detection module, and the optical coherence imaging signal is transmitted into the third light path conduction module.

8. The method of claim 2, wherein, The detection module comprises a sixth lens, a third dichroic mirror, a fluorescence detection device and a harmonic detection device; wherein the fluorescence detection device comprises a first photomultiplier tube; the harmonic detection device comprises a second photomultiplier tube; In step S1, the sample excitation light signal is separated to generate a multiphoton signal and a harmonic signal, specifically including: the sample excitation light signal is sequentially subjected to focusing treatment of the sixth lens and beam splitting treatment of the third dichroic mirror to form a multiphoton signal and a harmonic signal; The first photomultiplier tube detects and analyzes the multiphoton signal to generate a multiphoton electrical signal, and sends the multiphoton electrical signal to an external display device connected to the first photomultiplier tube, so that the multiphoton electrical signal is processed by the external display device to output a fluorescence image; The second photomultiplier tube detects and analyzes the harmonic signal to generate a harmonic imaging electrical signal, and sends the harmonic imaging electrical signal to an external display device connected to the second photomultiplier tube, so that the harmonic imaging electrical signal is processed by the external display device to output a harmonic image.

9. The method of claim 1, wherein, The photoacoustic image calculation module comprises a photoacoustic image calculation unit and an adaptive signal processing unit; Step S3 specifically comprises: the photoacoustic image calculation unit collects the photoacoustic microscopic imaging electrical signal, pre-processes the photoacoustic microscopic imaging electrical signal to generate an optimized photoacoustic microscopic image, and sends the optimized photoacoustic microscopic image to the adaptive signal processing unit; the adaptive signal processing unit uses a machine learning algorithm to calculate the phase inversion of the photoacoustic microscopic image, identifies and analyzes the low-resolution area in the optimized photoacoustic microscopic image, generates a photoacoustic phase adjustment signal, and sends the photoacoustic phase adjustment signal to the photoacoustic adaptive optical module; The preprocessing includes one or more of signal denoising, dynamic range adjustment and spectral filtering of the photoacoustic electrical signal by the photoacoustic image calculation unit; The machine learning algorithm comprises a deep neural network; In step S5, the optimized fluorescence image and harmonic image are outputted, specifically including: The detection module acquires the optimized multi-photon signal, detects the same, converts the same into a multi-photon electrical signal, processes the multi-photon electrical signal by using an external display device, and outputs the optimized fluorescence image. The detection module acquires the optimized multi-harmonic signal, detects the same, converts the same into a multi-harmonic imaging electrical signal, processes the multi-harmonic imaging electrical signal by using an external display device, and outputs the optimized harmonic image.

10. A system for performing the method of adaptive optical optimization of multimodal imaging assisted by optoacoustic signals according to any of the preceding claims 1-9, characterized in that, The system comprises a laser module, a laser broadening module, an optical coherence imaging module, a first light path transmission module, an optical sound self-adaptive optical module, a second light path transmission module, a light beam scanning module, a third light path transmission module, a sample excitation module, an optical sound signal acquisition module, an optical sound image calculation module, and a detection module; the optical sound self-adaptive optical module comprises a spatial light modulator. The laser module emits first and second lasers. The laser broadening module performs broadening processing on the first laser to form a broadened light signal. The optical coherence imaging module performs beam splitting processing on the second laser to generate a compensation light signal and a test light signal, and further performs multiple reflections on the compensation light to form a reference arm signal. The broadened light signal and the test light signal sequentially pass through the first light path transmission module, the optical sound self-adaptive optical module, the second light path transmission module, the light beam scanning module, and the third light path transmission module to respectively generate an emitted broadened light signal and an emitted test light signal into the sample excitation module. The emitted test light signal excites the sample under test to generate an excitation light signal; the sample excitation module separates the excitation light signal to generate a sample excitation light signal and an optical coherence imaging signal. The detection module separates the sample excitation light signal to form a multi-photon signal and a multi-harmonic signal, detects the multi-photon signal to generate a multi-photon electrical signal, sends the multi-photon electrical signal to an external display device connected to the detection module, detects the harmonic signal to generate a multi-harmonic imaging electrical signal, and sends the multi-harmonic imaging electrical signal to the external display device connected to the detection module. The optical coherence imaging module performs beam combination interference processing on the optical coherence imaging signal and the reference arm signal to generate an interference light signal, performs photoelectric conversion processing on the interference light signal to generate an optical coherence imaging electrical signal, and sends the optical coherence imaging electrical signal to an external display device connected to the optical coherence imaging module. The emitted broadened light signal excites the sample under test in the sample excitation module to generate an optical sound signal. The optical sound signal acquisition module acquires the optical sound signal, converts the optical sound signal into an optical sound electrical signal, and sends the optical sound electrical signal to the optical sound image calculation module. The photoacoustic image calculation module pre-processes the photoacoustic electrical signal, generates a photoacoustic microscopic image, generates a photoacoustic phase adjustment signal through phase inversion calculation, and sends the photoacoustic phase adjustment signal to the photoacoustic adaptive optical module to adjust the spatial light modulator and phase-adjust the stretched light signal and the test light signal again entering the photoacoustic adaptive optical module.

Images