Self-adaptive endoscope system and method based on photoacoustic image structure feature recognition

Abstract

The invention discloses a self-adaptive endoscope system and method based on photoacoustic image structure feature recognition, and relates to the technical field of photoacoustic endoscopic imaging, the system comprises a control system, a light source system, an endoscope probe, a feedback system, a signal processing system and a computing terminal; the control system synchronously triggers the light source system and the signal processing system, the light source system comprises a white light source and a laser, laser exciting light enters the endoscope probe through a single-mode optical fiber, scanning is controlled by a micro-electro-mechanical system (micro-electro-mechanical system scanning micro-mirror) scanning micro-mirror in the probe, scanning light enters the focusing lens group through the relay lens, and the focusing lens group is connected with the signal processing system through the relay lens. A to-be-imaged tissue surface is irradiated by the liquid lens, echo signals are acquired and processed by the signal processing system, photoacoustic image reconstruction is completed, the feedback system is connected with the liquid lens in the probe, and optical signals of optical images are acquired and reconstructed by an eyepiece at the top of the endoscope and a matched CMOS (complementary metal oxide semiconductor).

Description

Technical Field

[0001] The present invention relates to the technical field of photoacoustic endoscopic imaging, and more specifically, to an adaptive endoscope system and method based on photoacoustic image structural feature recognition. Background Art

[0002] A medical endoscope is an endoscopic tool used for minimally invasive medical treatment of the human body. It enters the human body through natural cavities or small incisions during surgery. The endoscope is guided into the tissues and organs to be examined to obtain high-resolution optical images, which can effectively diagnose and treat the patient's internal organs. Different types of endoscopic probes are suitable for different clinical application scenarios, expanding the application field of optical imaging. The provision of tissue structure information has brought convenience to doctors' diagnosis and treatment.

[0003] Photoacoustic imaging is an emerging medical imaging technology that combines the advantages of high resolution of optical imaging and high penetration depth of ultrasonic imaging. When a pulsed laser is irradiated into biological tissue, the light absorbing medium in the biological tissue absorbs the laser energy and is stimulated to generate an ultrasonic signal. The photoacoustic signal generated by the rapid heating and expansion of the medium carries the light absorption characteristic information of the tissue. The corresponding light absorption distribution image in the tissue can be reconstructed by receiving the photoacoustic signal through an ultrasonic transducer. Photoacoustic imaging reflects the light absorption difference of the biological tissue absorber without the need for exogenous probes.

[0004] In recent years, many teams at home and abroad have proposed many photoacoustic endoscope solutions. Patent No. 201210186582.8 proposed a forward-looking photoacoustic endoscope for intracavitary tissue imaging. The probe scanning structure is a piezoelectric scanning structure, which limits the probe size and cannot penetrate into the narrow cavity of the human body. At the same time, multiple scans are required for reconstruction; Application No. 201710845921.1 proposed a photoacoustic endoscope based on adaptive focusing of a light-transmitting and sound-transmitting water bag and an implementation method. The overall structure of the endoscope is a soft mirror, which requires a motor to control the scanning area and angle. It is not suitable for open intracavitary environments such as the abdominal cavity. At the same time, the patent realizes adaptive focusing based on the boundary of the water bag, does not perform quantitative analysis of the photoacoustic image characteristics, and cannot achieve real-time zoom positioning during surgery. Summary of the invention

[0005] In view of the deficiencies in the prior art, the present invention aims to provide an adaptive endoscope system and method based on photoacoustic image structural feature recognition.

[0006] To achieve the above object, the present invention provides the following technical solutions: An adaptive endoscope system based on photoacoustic image structural feature recognition includes a control system, a light source system, an endoscope probe, a feedback system, a signal processing system, and a computing terminal. The endoscope probe is connected to the light source system, the control system, the feedback system, and the signal processing system. The feedback system, the signal processing system, and the control system are respectively connected to the computing terminal. The control system generates a pulse sequence according to the signal timing, controls the light emission of the first pulse laser and the second pulse laser, triggers the signal acquisition card, and moves the MEMS scanning micromirror; The light source system includes a first pulse laser, a second pulse laser, and a white light source. The first pulse laser, the second pulse laser, and the white light source control end are all connected to the FPGA development board. The outputs of the first pulse laser and the second pulse laser are connected to the optical fiber through a fiber coupler and connected to the endoscope probe. The endoscope probe comprises an ultrasonic transducer, a CMOS, an eyepiece, a spectroscope, a MEMS scanning micromirror, a first collimator, a second collimator, a reflector, a focusing lens, a dichroic mirror, a second optical fiber bundle, a relay lens, a focusing lens group, a liquid lens, and a light-transmitting reflector; the output light of the first pulse laser and the second pulse laser enters the endoscope probe via the first collimator and the second collimator, is focused by the focusing lens and then incident on the reflector, is reflected and then incident on the surface of the MEMS scanning micromirror, the scanning light is reflected by the spectroscope and then incident on the relay lens, the output light of the relay lens passes through the focusing lens group, is incident on the light-transmitting reflector by the liquid lens, and then incident on the surface of the tissue to be imaged; The feedback system is composed of a zoom lens driving device. The feedback system receives a feedback signal from a computing terminal. The feedback signal is obtained by the computing terminal identifying the vascular structure through a feature recognition algorithm, extracting the vascular features for analysis, and adjusting the voltage of the zoom lens driving device to change the curvature of the liquid inside the liquid lens, thereby realizing adaptive adjustment of the focal length. The signal processing system includes a signal amplifier and a signal acquisition card. When a pulse laser is incident on the tissue surface, the surface is stimulated to generate ultrasonic waves which are received by the ultrasonic transducer on the side wall of the endoscope probe. The transducer converts the ultrasonic signal into an electrical signal. The electrical signal is amplified by the signal amplifier with noise reduction and enters the signal acquisition card. The signal acquisition card performs analog-to-digital conversion on the photoacoustic signal and sends the original data to the computing terminal.

[0007] Furthermore, the adaptive endoscopy method based on photoacoustic image structural feature recognition includes the following steps: Photoacoustic imaging: The control system generates a timing signal to control the first pulse laser and the second pulse laser to generate lasers. The output light of the first pulse laser and the second pulse laser enters the endoscope probe through the first collimator and the second collimator, and is focused by the focusing lens and then incident on the reflector. After reflection, it is incident on the surface of the MEMS scanning micromirror. The scanning light is reflected by the beam splitter and then incident on the relay lens. The output light of the relay lens passes through the focusing lens group and is incident on the light-transmitting reflector by the liquid lens, and then incident on the surface of the tissue to be imaged. The photoacoustic signal obtains a photoacoustic vascular image through the signal processing system. The feature recognition network extracts the vascular network skeleton through the image segmentation algorithm, identifies the vascular structure, and calculates the structural information and functional information. The abnormal tissue area is identified by comparing the difference in photoacoustic images in different areas, and the zoom lens is adjusted for continuous zooming. The continuous zooming refers to the zooming of the light focus within the range of 1 to 2 mm from the probe surface with an accuracy of 0.02 mm, and the zooming is used to enlarge or reduce the scanning area. White light imaging: The control system generates a timing signal to control the white light source. The light outlet is connected to the light cone part of the endoscope probe through the first optical fiber bundle. The light cone emits light through the second optical fiber bundle on the side wall and irradiates the tissue surface. The reflected light on the tissue surface is collected by the focusing lens group, relayed to the eyepiece through the relay lens, and then enters the CMOS. The CMOS converts the incident light signal into a charge output and inputs the electrical signal into the computing terminal through the data line. Vascular feature recognition based on photoacoustic images: The vascular diameter, curvature, and number of blood vessels are identified through photoacoustic images, the blood flow velocity is calculated through the correlation between adjacent frames, and the blood oxygen saturation is obtained through the imaging intensity analysis algorithm.

[0008] Furthermore, structural information includes blood vessel diameter, tortuosity, and number of blood vessels, and functional information includes blood flow rate and blood oxygen saturation.

[0009] Furthermore, the blood vessel diameter is calculated as follows: the photoacoustic image is binarized, the edge of the grayscale image corresponds to the blood vessel skeleton, and the value of the center line of the blood vessel skeleton is assigned a high value to distinguish the skeleton from the blood vessel center line, and the slope of the skeleton and the vertical line at each position are calculated, and the blood vessel diameter is calculated by taking the slope of the two adjacent points.

[0010] Furthermore, the calculation method of the blood vessel tortuosity is as follows: binarize the photoacoustic image, mark the connected blood vessel area, find the first element of the connected area, find the area where the connected area is smaller than two points, refine the center line of the connected area, find the endpoints of the connected area, calculate the linear distance length between the two ends of the blood vessel and the actual length of the blood vessel, traverse each connected area, and store the sequential tortuosity of each connected area.

[0011] Furthermore, the number of blood vessels is calculated as follows: the photoacoustic image is binarized, the grayscale image area is the area occupied by the blood vessels, the number of pixels inside the area is calculated, and the number is divided by the entire imaging area to obtain the blood vessel area ratio.

[0012] Furthermore, the blood flow velocity is calculated as follows: by performing multiple B scans on the same section, different pixels in multiple images are retained, and pixels without difference are removed, and the correlation is calculated.

[0013] Furthermore, the calculation method of blood oxygen saturation is as follows: the imaging intensity is proportional to the product of the absorption coefficient of the substance to light and the substance concentration. 532 nm and 558 nm correspond to the absorption peaks of oxygenated hemoglobin and deoxygenated hemoglobin, respectively. The corresponding absorption intensity is the sum of the products of the absorption coefficients of different substances and the substance concentration. Solving the absorption intensity equation can obtain the blood oxygen saturation.

[0014] Furthermore, the feature recognition network extracts the vascular network skeleton through an image segmentation algorithm, identifies the vascular structure, calculates the vascular diameter, tortuosity, number of blood vessels, blood flow rate, and blood oxygen saturation, and establishes a difference database between normal tissue and abnormal areas through feature recognition. During the photoacoustic imaging process, the image feature differences are compared, and after identifying the abnormal tissue, the scanning area is enlarged by driving the zoom lens to obtain a photoacoustic image with more feature points.

[0015] Compared with the prior art, the present invention has the following beneficial effects: 1. The present invention realizes the integration of adaptive photoacoustic and optical imaging methods, and can perform real-time high-resolution confocal imaging. The photoacoustic imaging technology combines the characteristics of high resolution of optical imaging and deep depth of acoustic imaging, and can image the tumor microvascular network, determine the depth of tumor infiltration, and provide an important reference for determining tumor staging. It can also be used for postoperative screening, imaging the microstructure morphology of the marginal area, and determining whether there is residue at the resection margin. Compared with traditional white light endoscopes, the present invention has the characteristics of information integration, tomographic imaging, high resolution, and deep imaging depth. It is suitable for in vivo diagnosis of various malignant tumors, and can combine the advantages of various imaging devices to obtain medical images of tissues and organs, providing a multi-dimensional data detection device and method for the field of medical imaging.

[0016] 2. The combination of the light-transmitting reflective mirror and the rod lens inside the endoscope probe of the present invention can realize optical beam combining and optical path multiplexing, realize real-time high-resolution confocal imaging of the target tissue area, and simultaneously obtain photoacoustic images and white light images. The photoacoustic excitation light is focused by the rod lens and incident on the tissue to be imaged. The existence of the rod lens can extend the working distance of the endoscope. The photoacoustic excitation light is incident on the biological tissue, and the echo signal is reflected by the light-transmitting reflective mirror and received by the lateral transducer.

[0017] 3. The endoscope probe of the present invention realizes dual-wavelength confocal by using an adjustable focus collimator. The different wavelengths of the photoacoustic excitation light cause dispersion when passing through the same lens, reducing the image resolution. By using an adjustable focus collimator, the position of the incident light spot on the tissue is changed, and the photoacoustic image confocal at different wavelengths is realized, thereby improving the image resolution.

[0018] 4. The internal scanning structure of the multimodal endoscope probe of the present invention adopts a micro-electromechanical system (MEMS) scanning micro-mirror. Compared with galvanometer scanning, the micro-electromechanical system (MEMS) scanning micro-mirror can reduce the size of the endoscope, reduce the weight of the endoscope, and at the same time has a high reflectivity to the incident light.

[0019] 5. The internal lens structure of the multimodal endoscopic probe of the present invention can change the focal position of the photoacoustic system and extend the working distance of the multimodal imaging system. The endoscopic probe can penetrate into narrow cavity organs for in vivo detection. The working distance of the system can be changed by adjusting the number of lens groups, thereby achieving high-resolution confocal endoscopic imaging of cavity organ tissues at different depths. BRIEF DESCRIPTION OF THE DRAWINGS

[0020] Figure 1 It is a system module diagram of an adaptive endoscope system based on photoacoustic image structural feature recognition; Figure 2 It is a schematic diagram of the structure of an endoscope based on photoacoustic image structural feature recognition; Figure 3 Schematic diagram of the structure of the endoscope probe.

[0021] Explanation of the accompanying drawings: 1. first pulse laser; 2. first fiber coupler; 3. second pulse laser; 4. second fiber coupler; 5. endoscope probe; 6. ultrasonic transducer; 7. signal acquisition card; 8. white light source; 9. first fiber bundle; 10. zoom lens drive device; 11. FPGA development board; 12. computing terminal; 13. CMOS; 14. eyepiece; 15. spectroscope; 16. MEMS scanning micromirror; 17. first collimator; 18. second collimator; 19. reflector; 20. focusing lens; 21. dichroic mirror; 22. second fiber bundle; 23. relay lens; 24. focusing lens group; 25. liquid lens; 26. light-transmitting reflector. DETAILED DESCRIPTION

[0022] Reference Figure 1-Figure 3 As shown, this embodiment discloses an adaptive endoscope system based on photoacoustic image structure feature recognition of the present invention, including a control system, a light source system, an endoscope probe 5, a feedback system, a signal processing system, and a computing terminal 12.

[0023] Among them, the control system uses an FPGA development board 11 as a control module, generates a pulse sequence according to the signal timing to control the first pulse laser 1, the second pulse laser 3, the signal acquisition card 7, and the MEMS scanning micromirror 16; the light source system includes the first pulse laser 1, the second pulse laser 3, and the white light source 8; the endoscope probe 5 is composed of an integrated endoscope, including a CMOS 13, an eyepiece 14, a spectroscope 15, a first collimator 17, a second collimator 18, a reflector 19, a focusing lens 20, a MEMS scanning micromirror 16, a dichroic mirror 21, a first optical fiber bundle 9, a relay lens 23, a focusing lens group 24, a liquid lens 25, a light-transmitting reflector 26, an ultrasonic transducer 6, and an endoscope housing; the data acquisition and reconstruction system includes a signal amplifier, a signal acquisition card 7, and a computing terminal 12; and the feedback system is composed of a zoom lens driving device 10.

[0024] The control system uses an FPGA development board 11 as a control module, generates a pulse sequence according to a signal timing to control a first pulse laser 1, and the laser output light is coupled into a single-mode optical fiber via a first optical fiber coupler 2, and the single-mode optical fiber is connected to a first collimator 17 in an endoscopic probe 5; generates a pulse sequence to control a second pulse laser 3, and the laser output light is coupled into a single-mode optical fiber via a second optical fiber coupler 4, and the single-mode optical fiber is connected to a second collimator 18 in an endoscopic probe 5; generates a pulse sequence to control a scanning trajectory of a MEMS scanning micromirror 16; and generates a pulse sequence to control the acquisition of a control signal acquisition card 7.

[0025] In the endoscopic probe 5, the light emitted from the first collimator 17 is reflected by the dichroic mirror 21 and combined with the incident light from the second collimator 18. The combined light is focused by the focusing lens 20 and then enters the reflector 19, changing the direction of the light to enter the MEMS scanning micromirror 16. The MEMS scanning micromirror 16 controls the trajectory of the scanning light and reflects it through the beam splitter 15 to enter the relay lens 23. The light emitted from the lens passes through the focusing lens group 24 and is incident on the light-transmitting reflector 26 by the liquid lens 25 to reach the surface of the tissue to be imaged. The ultrasonic signal generated on the surface of the tissue is received by the ultrasonic transducer 6 on the side wall of the endoscope, and enters the computing terminal 12 after passing through the signal acquisition card 7 to complete the reconstruction of the photoacoustic image.

[0026] The addition of the dichroic mirror 21 allows the photoacoustic excitation lights of different wavelengths to share the same optical path. The short-wave pulse light is incident vertically on the dichroic mirror 21, and the long-wave pulse light is incident horizontally on the dichroic mirror 21, thereby achieving excitation photosynthesis.

[0027] The addition of the first collimator 17 and the second collimator 18 can achieve the confocal point of the dual-wavelength photoacoustic image. When lasers of different wavelengths pass through the same lens, dispersion will occur. By adjusting the adjustable focus collimator, the imaging confocal point can be achieved, and clear images can be obtained at the same position under different imaging modes.

[0028] The addition of the first pulse laser 1 and the second pulse laser 3 can realize photoacoustic blood oxygen functional imaging. Lasers of different wavelengths correspond to the absorption difference between hemoglobin and deoxyhemoglobin. By calculating the changes in the intensity of the photoacoustic image at different wavelengths, the blood oxygen saturation in the imaging area can be calculated.

[0029] In this embodiment, the optical fiber on the side wall of the endoscopic probe 5 is used to transmit the illuminating white light, and the light reflected from the tissue surface passes through the beam splitter 15 via the relay lens 23 .

[0030] In this embodiment, the laser focusing light path is focused and reflected by the reflector to the surface of the MEMS scanning micromirror 16. The control system controls the MEMS scanning micromirror 16 to deflect and adjust the scanning range. Compared with the galvanometer scanning, the MEMS scanning micromirror 16 can reduce the size of the endoscope, reduce the quality of the endoscope, and at the same time has a high reflectivity to the incident light.

[0031] The pulsed laser inside the endoscopic probe 5 is focused through the laser focusing optical path and then reflected by the reflector 19 to the surface of the MEMS scanning micromirror 16. The control system controls the deflection of the MEMS scanning micromirror 16 to adjust the scanning range. Compared with the galvanometer scanning, the MEMS scanning micromirror 16 reduces the volume of the endoscope and reduces the weight of the endoscope. At the same time, the surface of the reflector 19 is coated with an aluminum film, which has a high reflectivity to the incident light.

[0032] The dichroic mirror 21 is a long-wave pass dichroic mirror with a cut-off wavelength of 535-555 nm.

[0033] The driving process of the zoom lens driving device 10 is as follows: the zoom lens inside the endoscopic probe 5 is connected to the zoom lens driving device 10 through a control line, and the zoom lens driving device 10 realizes continuous zooming of the zoom lens by continuously changing the voltage according to the signal feedback from the computing terminal 12. According to the corresponding relationship between the driving voltage and the focal length of the zoom lens, the voltage range in which the focus is 1 to 2 mm away from the probe surface is selected as a continuous zoom range, wherein the zoom accuracy is 0.02 mm.

[0034] In this embodiment, white light guides the probe to the tissue area to be imaged for scanning, and the endoscope probe adopts a forward scanning mode. The use of a rod lens can extend the working distance, and the addition of a light-transmitting reflector 26 at the front end of the probe can reflect the photoacoustic echo signal, which is received by the side wall high-frequency ultrasonic transducer 6, and the main frequency of the high-frequency ultrasonic transducer 6 is 40M and the bandwidth is 80%.

[0035] In this embodiment, the signal amplifier has an amplification gain of 60 dB.

[0036] In this embodiment, the endoscope housing is a metal housing with biocompatibility, the working distance is 20 cm, and the endoscope diameter is 10 mm.

[0037] The present invention utilizes an adaptive endoscope method based on photoacoustic image structural feature recognition, comprising the following steps: Photoacoustic imaging: The control system generates a timing signal to control the pulsed laser to generate laser light. The pulsed laser relays the optical path through the rod lens inside the endoscope. The emitted focused light is focused again through the focusing lens group 24. The focused light enters the liquid lens 25 to reach the surface of the tissue to be imaged. The photoacoustic signal obtains the photoacoustic vascular image through the signal processing system. The feature recognition network extracts the vascular network skeleton through the image segmentation algorithm, identifies the vascular structure, calculates the structural information such as vascular diameter, curvature, density, and functional information such as blood flow rate and blood oxygen saturation, identifies the abnormal tissue area by comparing the photoacoustic image differences in different areas, and adjusts the zoom lens for continuous zooming. The continuous zooming refers to the zooming of the light focus within the range of 1 to 2 mm from the probe surface with an accuracy of 0.02 mm, and the zooming is used to enlarge or reduce the scanning area.

[0038] White light imaging: The control system generates a timing signal to control the white light source 8. The light outlet is connected to the light cone part of the endoscope through the first optical fiber bundle 9. The light emitted from the light cone is irradiated to the tissue surface through the first optical fiber bundle 9 on the side wall. The reflected light on the tissue surface is collected by the lens group, relayed to the eyepiece 14 through the relay lens 23 and enters the CMOS13. The CMOS13 can convert the incident light signal into an electric charge output and enter the electrical signal into the computer through the data line. Vascular feature recognition based on photoacoustic images: Identify information such as vascular diameter, curvature, density, etc. through photoacoustic images, calculate blood flow velocity through the correlation between adjacent frames, and obtain blood oxygen saturation through imaging intensity analysis algorithm. Calculate vascular diameter: Binarize the photoacoustic image. The edge of the grayscale image corresponds to the vascular skeleton. The value of the center line of the vascular skeleton is assigned a high value to distinguish the skeleton from the vascular center line. The slope of the skeleton and the vertical line at each position are calculated. The diameter of the vascular is calculated by taking the slope of the two adjacent points. Vascular curvature: Binarize the photoacoustic image, mark the connected area (vascular area), find the first element of the connected area, find the area where the connected area is less than two points, refine the center line of the connected area, find the endpoints of the connected area, calculate the linear distance between the two ends of the blood vessel and the actual length of the blood vessel, traverse each connected area, and store the sequential curvature of each connected area. Number of blood vessels: Binarize the photoacoustic image. The grayscale image area is the area occupied by the blood vessel. Calculate the number of pixels inside the area and divide it by the entire imaging area to get the proportion of the blood vessel area. Calculate blood flow velocity: Through multiple B scans of the same section, retain the pixels (blood flow) with differences in multiple images, remove the pixels (tissue) with no differences, and calculate the correlation. Blood oxygen saturation: Imaging intensity is proportional to the product of the absorption coefficient of the substance to light and the concentration of the substance. 532nm and 558nm correspond to the absorption peaks of oxygenated hemoglobin and deoxygenated hemoglobin, respectively. The corresponding absorption intensity is the sum of the products of the absorption coefficients of different substances and the concentration of the substance. Solving the absorption intensity equation can obtain blood oxygen saturation.

[0039] It should be understood that the various parts of the present application can be implemented by hardware, software, firmware or a combination thereof. In the above-mentioned embodiments, multiple steps or methods can be implemented by software or firmware stored in a memory and executed by a suitable instruction execution system. For example, if implemented by hardware, as in another embodiment, it can be implemented by any one of the following technologies known in the art or their combination: a discrete logic circuit having a logic gate circuit for implementing a logic function for a data signal, a dedicated integrated circuit having a suitable combination of logic gate circuits, a programmable gate array (PGA), a field programmable gate array (FPGA), etc.

[0040] The above embodiments are preferred implementation modes of the present invention, but the implementation modes of the present invention are not limited to the above embodiments. Any other changes, modifications, substitutions, combinations, and simplifications that do not deviate from the spirit and principles of the present invention should be equivalent replacement methods and are included in the protection scope of the present invention.

Claims

1. An adaptive endoscope system based on photoacoustic image structural feature recognition, characterized in that: It comprises a control system, a light source system, an endoscope probe (5), a feedback system, a signal processing system, and a computing terminal (12), wherein the endoscope probe (5) is connected to the light source system, the control system, the feedback system, and the signal processing system, and the feedback system, the signal processing system, and the control system are respectively connected to the computing terminal (12); The control system generates a pulse sequence according to the signal timing, controls the light emission of the first pulse laser (1), the second pulse laser (3), the triggering of the signal acquisition card (7), and the movement of the MEMS scanning micromirror (16); The light source system comprises a first pulse laser (1), a second pulse laser (3), and a white light source (8); the control ends of the first pulse laser (1), the second pulse laser (3), and the white light source (8) are all connected to an FPGA development board (11); the outputs of the first pulse laser (1) and the second pulse laser (3) are connected to an optical fiber via an optical fiber coupler and connected to an endoscope probe (5); The endoscope probe (5) comprises an ultrasonic transducer (6), a CMOS (13), an eyepiece (14), a spectroscope (15), a MEMS scanning micromirror (16), a first collimator (17), a second collimator (18), a reflector (19), a focusing lens (20), a dichroic mirror (21), a second optical fiber bundle (22), a relay lens (23), a focusing lens group (24), a liquid lens (25), and a light-transmitting reflector (26); a first pulse laser (1) and a second pulse laser (1) are connected to each other. The output light of the laser (3) enters the endoscope probe (5) via the first collimator (17) and the second collimator (18), is focused by the focusing lens (20), and then enters the reflective mirror (19), and then enters the surface of the MEMS scanning micromirror (16), the scanning light is reflected by the beam splitter (15), and then enters the relay lens (23), the output light of the relay lens (23) passes through the focusing lens group (24), and enters the light-transmitting reflective mirror (26) via the liquid lens (25), and then enters the surface of the tissue to be imaged; The feedback system is composed of a zoom lens driving device (10), and the feedback system receives a feedback signal from a computing terminal (12), wherein the feedback signal is obtained by the computing terminal (12) identifying the blood vessel structure through a feature recognition algorithm, extracting blood vessel features for analysis, and adjusting the voltage of the zoom lens driving device (10) to change the curvature of the liquid inside the liquid lens (25), thereby realizing adaptive adjustment of the focal length; The signal processing system comprises a signal amplifier and a signal acquisition card (7). When a pulsed laser is incident on a tissue surface, the surface is stimulated to generate ultrasonic waves which are received by an ultrasonic transducer (6) on the side wall of an endoscope probe (5). The transducer converts the ultrasonic signal into an electrical signal. The electrical signal is amplified by the signal amplifier after noise reduction and enters the signal acquisition card (7). The signal acquisition card (7) performs analog-to-digital conversion on the photoacoustic signal and sends the original data to a computing terminal (12).

2. An adaptive endoscopy method based on photoacoustic image structural feature recognition, characterized in that: The adaptive endoscope system based on photoacoustic image structural feature recognition as described in claim 1 is characterized by comprising the following steps: Photoacoustic imaging: The control system generates a timing signal to control the first pulse laser (1) and the second pulse laser (3) to generate laser light. The output light of the first pulse laser (1) and the second pulse laser (3) enters the endoscope probe (5) through the first collimator (17) and the second collimator (18). After being focused by the focusing lens (20), the light enters the reflection mirror (19). After being reflected, the light enters the surface of the MEMS scanning micromirror (16). The scanning light is reflected by the beam splitter (15) and enters the relay lens (23). The output light of the relay lens (23) passes through the focusing lens group (2 4) The liquid lens (25) is incident on the light-transmitting reflector (26), and then on the surface of the tissue to be imaged. The photoacoustic signal is processed by the signal processing system to obtain a photoacoustic vascular image. The feature recognition network extracts the skeleton of the vascular network through an image segmentation algorithm, identifies the vascular structure, and calculates the structural information and functional information. The abnormal tissue area is identified by comparing the difference in the photoacoustic images in different areas, and the zoom lens is adjusted to continuously zoom. The continuous zoom refers to the light focus being zoomed with an accuracy of 0.02 mm within a range of 1 to 2 mm from the probe surface, and the scanning area is enlarged or reduced by zooming; White light imaging: the control system generates a timing signal to control the white light source (8), the light outlet is connected to the light cone part of the endoscope probe (5) through the first optical fiber bundle (9), the light cone output light is irradiated to the tissue surface through the second optical fiber bundle (22) on the side wall, the light reflected from the tissue surface is collected by the focusing lens group (24), relayed to the eyepiece (14) through the relay lens (23), and then enters the CMOS (13), the CMOS (13) converts the incident light signal into an electric charge output, and inputs the electric signal into the computing terminal (12) through the data line; Vascular feature recognition based on photoacoustic images: The vascular diameter, curvature, and number of blood vessels are identified through photoacoustic images, the blood flow velocity is calculated through the correlation between adjacent frames, and the blood oxygen saturation is obtained through the imaging intensity analysis algorithm.

3. The adaptive endoscopy method based on photoacoustic image structural feature recognition according to claim 2, characterized in that: Structural information includes blood vessel diameter, tortuosity, and number of blood vessels, while functional information includes blood flow rate and blood oxygen saturation.

4. The adaptive endoscopy method based on photoacoustic image structural feature recognition according to claim 2, characterized in that: The blood vessel diameter is calculated as follows: the photoacoustic image is binarized, the edge of the grayscale image corresponds to the blood vessel skeleton, and the value of the center line of the blood vessel skeleton is assigned a high value to distinguish the skeleton from the blood vessel center line. The slope of the skeleton and the perpendicular line at each position are calculated, and the blood vessel diameter is calculated by taking the slope of the two adjacent points.

5. The adaptive endoscopy method based on photoacoustic image structural feature recognition according to claim 2, characterized in that: The calculation method of blood vessel tortuosity is as follows: binarize the photoacoustic image, mark the connected blood vessel area, find the first element of the connected area, find the area where the connected area is smaller than two points, refine the center line of the connected area, find the endpoints of the connected area, calculate the linear distance between the two ends of the blood vessel and the actual length of the blood vessel, traverse each connected area, and store the sequential tortuosity of each connected area.

6. The adaptive endoscopy method based on photoacoustic image structural feature recognition according to claim 2, characterized in that: The number of blood vessels is calculated as follows: binarize the photoacoustic image, the grayscale image area is the area occupied by the blood vessels, the number of pixels inside the area is calculated, and then divided by the entire imaging area to obtain the blood vessel area ratio.

7. The adaptive endoscopy method based on photoacoustic image structural feature recognition according to claim 2, characterized in that: The blood flow velocity is calculated as follows: through multiple B-scans of the same section, the pixels with differences in multiple images are retained, and the pixels with no differences are removed, and the correlation is calculated.

8. The adaptive endoscopy method based on photoacoustic image structural feature recognition according to claim 2, characterized in that: The calculation method of blood oxygen saturation is as follows: the imaging intensity is proportional to the product of the absorption coefficient of the substance to light and the substance concentration. 532nm and 558nm correspond to the absorption peaks of oxygenated hemoglobin and deoxygenated hemoglobin, respectively. The corresponding absorption intensity is the sum of the products of the absorption coefficients of different substances and the substance concentration. Solving the absorption intensity equation can obtain the blood oxygen saturation.

9. The adaptive endoscopy method based on photoacoustic image structural feature recognition according to claim 2, characterized in that: The feature recognition network extracts the vascular network skeleton through the image segmentation algorithm, identifies the vascular structure, calculates the vascular diameter, tortuosity, number of blood vessels, blood flow rate, and blood oxygen saturation. Through feature recognition, a database of differences between normal tissue and abnormal areas is established. During the photoacoustic imaging process, the image feature differences are compared. After identifying the abnormal tissue, the scanning area is enlarged by driving the zoom lens to obtain a photoacoustic image with more feature points.

Images