Ultrasonic / photoacoustic imaging diagnosis and treatment integrated uterine cavity endoscope based on micro array probe and working method of ultrasonic / photoacoustic imaging diagnosis and treatment integrated uterine cavity endoscope

By combining ultrasound and photoacoustic imaging technologies, hysteroscopy has solved the problem of inaccurate sampling in the early diagnosis of endometrial cancer, achieving high-resolution endometrial imaging and improving diagnostic accuracy and visualization.

CN118986257APending Publication Date: 2024-11-22NORTHERN JIANGSU PEOPLES HOSPITAL

Patent Information

Application Number
CN202411014420.5
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-07-26
Publication Date
2024-11-22

Smart Images

  • Figure CN118986257A_ABST
    Figure CN118986257A_ABST
Patent Text Reader

Abstract

The invention provides an ultrasonic / photoacoustic imaging diagnosis and treatment integrated uterine cavity endoscope based on a micro array probe and a working method of the ultrasonic / photoacoustic imaging diagnosis and treatment integrated uterine cavity endoscope. The ultrasonic / photoacoustic imaging diagnosis and treatment integrated uterine cavity endoscope comprises a photoacoustic imaging probe unit, a laser generator, a signal generator, an ultrasonic pulse exciter / receiver and an imaging platform. The signal generator is used for controlling a controller for ultrasonic imaging or photoacoustic imaging and triggering different signals to excite different imaging modes; the laser generator is a multi-mode laser generator and is used for exciting ultrasonic pulses, receiving ultrasonic echo signals and carrying out data and signal processing. Development and clinical application of an EC efficient diagnosis and treatment mode are promoted through interdisciplinary cross research, a brand new strategy is expected to be provided for EC prevention and treatment, research in the field in China can be ranked in the international prostate, and the method can also be used for early physical examination screening of potential patients in the future. More importantly, an experimental basis is provided for subsequent research and development of other endoscopes, and a design thought and technical support are provided for development of a diagnosis and treatment integrated mode.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention belongs to the cross-fields of clinical pathology, clinical gynecology, clinical imaging, etc. Specifically, it relates to an ultrasonic / photoacoustic imaging diagnosis and treatment integrated hysteroscope based on a micro-array probe and a working method thereof. Background Art

[0002] EC (endometrial cancer) originates from the endometrial epithelium and is one of the three major malignant tumors of the female reproductive tract, accounting for about 7% of the total number of female cancers and 20%-30% of female reproductive tract malignant tumors. Its incidence has a clear upward trend, and the age of onset is gradually getting younger. The proportion of patients under 40 years old has increased from 1%-8% in the past to 13.3%. At present, EC diagnostic schemes generally use ultrasound as the preferred early screening tool for EC, and the diagnosis is based on ex vivo endometrial pathological histological examination. Therefore, the accuracy of the second step of endometrial lesion sampling is crucial for diagnosis. In recent years, early diagnosis and sampling of endometrial lesions under direct hysteroscopy have replaced diagnostic curettage (blind curettage) and increased the positive rate of sampling, but the existing endometrial cancer diagnosis and treatment technologies are still insufficient. Summary of the invention

[0003] The embodiment of the present application provides an integrated ultrasound / photoacoustic imaging diagnosis and treatment hysteroscopic endoscope based on a micro-array probe and its working method, and studies the clinical application value of the US / PA-BI hysteroscopic endoscope. It aims to promote the development and clinical application of efficient EC diagnosis and treatment models through interdisciplinary research, and is expected to provide a new strategy for EC prevention and treatment, so that my country's research in this field can be among the world's top, and it can also be used for early physical examination screening of potential patients in the future. More importantly, it provides an experimental basis for the subsequent development of other endoscopes, and provides design ideas and technical support for the development of integrated diagnosis and treatment models.

[0004] In the first aspect, an embodiment of the present application provides an integrated hysteroscopic endoscope for ultrasound / photoacoustic imaging diagnosis and treatment based on a micro-array probe, comprising: a photoacoustic imaging probe unit, a laser generator, a signal generator, an ultrasonic pulse excitation / receiver, and a data post-processing and imaging platform; the signal generator is respectively connected to the laser generator and the ultrasonic pulse excitation / receiver, and is used to control a controller for ultrasound imaging or photoacoustic imaging, triggering different signals to excite different imaging modes; the laser generator is a multimodal laser generator, which is used to excite ultrasonic pulses, receive ultrasonic echo signals, and perform data and signal processing; the ultrasonic pulse excitation / receiver is connected to the data post-processing and imaging platform, and the laser generator and ultrasonic pulse excitation / receiver are both connected to the photoacoustic imaging probe unit.

[0005] Among them, the photoacoustic imaging probe unit includes: a water inlet, a water inlet channel, a transmission shaft, a coupling, a stepper motor and an imaging probe; the water inlet is reinforced by bolts, and adopts rust-proof material and a closed design; water is injected into the water inlet through a syringe, and pure water flows to the probe side through the water inlet channel, which is convenient for the acoustic coupling of the signal and the sample; the stepper motor is connected with the coupling and the transmission shaft in sequence, and the transmission shaft is located in the water inlet channel; the stepper motor is integrated with the handle, and the imaging probe is rotated by the transmission shaft in the water channel to achieve 360-degree ultrasonic imaging in the uterine cavity; the transmission shaft and the stepper motor are hollow, allowing optical fiber and ultrasonic transducer wires to pass through; the imaging probe is wrapped with a latex balloon, and when in use, the imaging probe is covered by the latex balloon and filled with water through the water inlet channel. When filled with deionized water, the liquid can make US waves and PA waves propagate from the imaging head to the surrounding uterine cavity wall.

[0006] Among them, the imaging probe is a phased array probe with an aperture of 5 mm, a width of 3 mm, a center frequency of 12 MHz, and a bandwidth range of 10 MHz to 15 MHz; the imaging probe is made of piezoelectric film material; the ultrasonic probe receives the signal, which is amplified and sampled by the excitation / receiver, and the sampled signal is stored in the computer for later image reconstruction.

[0007] Among them, the photoacoustic imaging probe unit also includes: a transducer, a reflector, a polyethylene film sleeve, an SMA connecting line, and a tubular rotating shaft; the transducer and the 45° reflector are assembled as a whole, and the reflector will not change the propagation path of the sound signal emitted by the sample; the transducer is a miniature array transducer, which has multiple ultrasonic transducers or a combination, and can collect 64 or more signals for the same target point; the polyethylene film sleeve is at the opening of the reflector; the SMA connecting line is directly connected to the internal circuit of the probe and extends to the AD port of the acquisition system; the tubular rotating shaft is a clamp for the optical fiber, which fixes the multimode optical fiber in the center of the tube and prevents the optical fiber from being entangled and knotted during rotation; the multimode optical fiber is connected to the laser, and the optical power and wavelength are adjusted through the external optical path; the motor can provide rotation and translation functions.

[0008] The ultrasonic pulse excitation / receiver is used to complete the two imaging processes of ultrasonic imaging and photoacoustic imaging. The data collected by the receiver is transmitted to the computer via the USB3.0 interface, and the computer's CPU and GPU are used for real-time calculation to obtain photoacoustic and ultrasonic images of the tissue.

[0009] Among them, the array transducer uses the DAS delay-sum algorithm, which is divided into two steps: calculating delay and data summation;

[0010] Step (1): Calculate the delay time by calculating the distance from the target point P to the sensor receiving unit, and then according to the speed of the transmission medium and the acquisition frequency of the ultrasonic sensor array, find the time required for the photoacoustic signal to be received from the target point, thereby locating the position of the collected data point in the sensor receiving data set, and finding the receiving signal of the target point at the time corresponding to a certain sensor unit;

[0011] According to the distance formula between two points, the center of the upper part of the image and the center of the array probe are taken as the origin, and the target point position P(x i ,y i ) to the (N,0)th array element can be expressed as:

[0012]

[0013] Where N is the number of array elements, the target point is located at the (i, j)th position of the image pixel, dx and dy represent the image pixel size, X and Y represent the image length and width, (Channel i ,0) is the position of the i-th array element, and the distance between each array element is d;

[0014] The propagation time of the photoacoustic signal is the speed of sound propagation processed by the calculated distance. The calculation formula is as follows:

[0015]

[0016] Where fs is the sampling frequency of the probe, which indicates the number of data points generated per second, and Vs is the speed of sound;

[0017] Step (2): Data summation: after determining the receiving time and signal strength corresponding to each unit in the transducer array, the corresponding data are summed to obtain the signal strength of the target point;

[0018] Signal(i,j)=Signal(i,j)+Transducer_data(Channel i ,time);

[0019] In the formula, Signal represents the signal value of the target point, and Transducer_data represents the signal strength obtained by the transducer unit at the corresponding time;

[0020] According to steps (1) and (2), the sum of all array signals corresponding to each pixel in the image can be calculated, thereby obtaining the intensity information of the entire image area.

[0021] In a second aspect, the present application provides a working method of a hysteroscopic endoscope, wherein the hysteroscopic endoscope is an integrated hysteroscopic endoscope for ultrasound / photoacoustic imaging diagnosis and treatment based on a micro-array probe as described in any one of the above items, comprising:

[0022] Step (1): a pulsed laser emits a laser pulse, which is coupled into an optical fiber after passing through a beam splitter. The optical fiber guides the laser energy into a photoacoustic imaging head and irradiates the sample.

[0023] Step (2): The photoacoustic signal generated by the photoacoustic effect is received by the ultrasound probe, amplified and sampled by the data acquisition card, and the sampled signal is stored in the computer for later image reconstruction;

[0024] Step (3): another part of the laser beam through the beam splitter is irradiated on the photodetector, and the data acquisition card collects the signal generated by the photodetector, thereby ensuring the synchronization of the excitation and acquisition of the photoacoustic signal. At the same time, the signal of the photodetector can also be used to monitor the size of the laser pulse energy;

[0025] Step (4): Under computer control, the electrically controlled translation stage drives the array probe to scan the sample point by point to obtain a two-dimensional or three-dimensional optical resolution photoacoustic image of the sample.

[0026] This also includes: achieving photoacoustic imaging of different wavelengths by replacing different laser light sources to meet different functional imaging needs.

[0027] These include: using 266nm ultraviolet laser as the excitation light source to obtain the distribution image of nuclear material; using 532nm excitation light source to monitor the functional changes of endometrial cell composition and local hemoglobin concentration, blood oxygen saturation and oxygen metabolism; using near-infrared laser excitation to ensure the imaging of endometrium and subendometrial blood vessels at a depth of 10-15mm.

[0028] The ultrasonic / photoacoustic imaging diagnosis and treatment integrated hysteroscopic endoscope based on the microarray probe and the working method thereof in the embodiment of the present application have the following beneficial effects:

[0029] (1) The US / PA-BI hysteroscopic endoscope of this application can provide high-resolution structural and functional information of the entire endometrium, visualize the endometrial margins involved by EC cells, assist in early diagnosis of EC, and is easy to carry and expand in later functions.

[0030] (2) The high-frequency ultrasound probe part of this system is small in size, high in center frequency, and wide in bandwidth. It can penetrate the uterine cavity to a depth of 6 cm. It has a high theoretical axial resolution that can reach the sub-millimeter level and has good imaging effects.

[0031] (3) The acquisition system in this application uses 64 parallel physical channels, including a 64-channel pulse generator, a 64-channel AD conversion, an AD bit width of 14 bits, a high sampling frequency, and a supporting auxiliary circuit system. It can complete two imaging processes, ultrasound imaging and photoacoustic imaging. The computer data transmission rate can reach gigabits, and the CPU and GPU can be used for real-time computing to quickly obtain photoacoustic and ultrasound images of tissues. BRIEF DESCRIPTION OF THE DRAWINGS

[0032] Figure 1a A schematic diagram of the high-frequency uterine ultrasound system of the US / PA-BI hysteroscopic endoscope of this application;

[0033] Figure 1b This is a schematic diagram of the high-frequency intrauterine ultrasound transmission system of the US / PA-BI hysteroscopic endoscope of this application;

[0034] Figure 1c A cross section of the US / PA imaging head of the US / PA-BI hysteroendoscope of the present application;

[0035] Figure 1d This is a schematic diagram of the high-frequency uterine ultrasound water-filling device of the US / PA-BI hysteroscopic endoscope of the present application;

[0036] Figure 2a This is an overall schematic diagram of the front and rear end components of the probe of the photoacoustic hysteroscopic system of the present application;

[0037] Figure 2b The probe performance curve of the photoacoustic hysteroscopic system of this application;

[0038] Figure 2c This is a schematic diagram of the motor drive system and data acquisition of the photoacoustic hysteroscopic system of the present application;

[0039] Figure 2d The sample placement and experimental system schematic diagram of the photoacoustic hysteroscopic system of this application;

[0040] Figure 3 This is a schematic diagram of the overall system of US / PA-BI hysteroscopic endoscope;

[0041] Figure 4 This is a cross-sectional view of the US / PA-BI annular array ultrasound transducer and a schematic diagram of the DAS imaging algorithm;

[0042] Figure 5 The overall, horizontal and vertical images of the black tape sample taken by US / PA-BI hysteroscopic endoscope;

[0043] Figure 6 These are the overall, transverse and longitudinal images of the carbon fiber sample taken by the US / PA-BI hysteroscopic endoscope. DETAILED DESCRIPTION

[0044] The present application is further described below in conjunction with the accompanying drawings and embodiments.

[0045] In the following introduction, the terms "first" and "second" are used for descriptive purposes only and should not be understood as indicating or implying relative importance. The following introduction provides multiple embodiments of the present invention, and different embodiments can be replaced or combined, so this application can also be considered to include all possible combinations of the same and / or different embodiments recorded. Therefore, if one embodiment includes features A, B, and C, and another embodiment includes features B and D, then this application should also be considered to include embodiments containing one or more of all other possible combinations of features A, B, C, and D, even though the embodiment may not be clearly recorded in the following text.

[0046] Embodiment 1

[0047] With the development of medical imaging technology, a number of new technologies have emerged that can be used to detect and evaluate the tissue structure and intrinsic function of lesions. Photoacoustic imaging is a new composite imaging technology based on the photoacoustic effect that emerged in the early 21st century. The photoacoustic imaging system uses pulsed lasers to irradiate the organism, which converts the absorbed light energy into heat energy, which then expands and contracts to cause stress changes and radiates sound waves. The photoacoustic signal is collected using an ultrasonic transducer array arranged on the periphery of the organism. The imaging mechanism based on the photoacoustic effect gives photoacoustic imaging many unique advantages. The photoacoustic imaging system has a similar ultrasonic signal detection system and post-data processing system as the ultrasonic imaging system. Therefore, photoacoustic imaging and conventional ultrasonic imaging systems are highly compatible and can be integrated to achieve ultrasound / photoacoustic dual-modality imaging (US / PA-BI), while providing structural and functional imaging information of biological tissues.

[0048] The integrated ultrasound / photoacoustic imaging diagnosis and treatment hysteroscope based on the microarray probe in this application can provide high-resolution structural and functional information of the entire layer of the endometrium, visualize the endometrial margin involved by EC cells, and assist in the early diagnosis of EC.

[0049] like Figure 1a-Figure 3As shown, the present application of the integrated hysteroscopic endoscope of ultrasound / photoacoustic imaging diagnosis and treatment based on a micro-array probe includes: a photoacoustic imaging probe unit 14, a laser generator 11, a signal generator 10, an ultrasonic pulse excitation / receiver 12, and a data post-processing and imaging platform 13; the signal generator 10 is connected to the laser generator 11 and the ultrasonic pulse excitation / receiver 12 respectively, and is used to control the controller of ultrasonic imaging or photoacoustic imaging, triggering different signals to excite different imaging modes; the laser generator 11 is a multi-modal laser generator, which is used to excite ultrasonic pulses, receive ultrasonic echo signals and perform data and signal processing; the ultrasonic pulse excitation / receiver 12 is connected to the data post-processing and imaging platform 13, and the laser generator 11 and the ultrasonic pulse excitation / receiver 12 are both connected to the photoacoustic imaging probe unit 14. The present application can be used for single hysteroscopic optical (BI) imaging, high-frequency US single imaging, or laser system fusion for US / PA fusion imaging, or US / PA / BI three-modal fusion imaging.

[0050] Figure 1a-1d It is the hardware structure part of US / PA-BI hysteroscopic system, such as Figure 1a-1d As shown, the photoacoustic imaging probe unit 14 includes: a water inlet 15, a water inlet channel 16, a transmission shaft 18, a coupling 19, a stepper motor 20 and an imaging probe 17. Figure 1a As shown, the water inlet 15 is reinforced by a small bolt. The rust-proof material ensures continuous use, and the good airtightness ensures that no bubbles are generated during the experimental stage. Water is slowly injected into the water inlet 15 through a syringe, and the pure water flows to the probe side through the water inlet channel 16, which facilitates the acoustic coupling of the signal with the sample. The transmission shaft 18 and the stepper motor 20 are hollow, allowing the optical fiber and ultrasonic transducer wire to pass from the back of the probe to the imaging probe. At the same time, the water channel can also be used as a treatment channel during the treatment stage, and can pass through the laser treatment catheter to achieve mediated photothermal therapy of early EC and precancerous lesions.

[0051] like Figure 1b As shown, the stepper motor 20 is integrated with the handle, and the imaging probe 17 is rotated by the transmission shaft 18 in the water channel to achieve 360-degree ultrasound imaging in the uterine cavity. Figure 1d As shown, the imaging probe is wrapped in a latex balloon. The cross-section of the US / PA probe is shown in Figure 1c As shown, it includes an ultrasonic transducer 21, a pulse exciter 22, a prism 23, and an optical fiber / transducer sleeve 24. When in use, the probe is covered with a latex balloon and filled with water through a water channel near the probe handle. When filled with deionized water, the liquid can cause ultrasound (US) waves and photoacoustic (PA) waves to propagate from the imaging head to the surrounding uterine cavity wall.

[0052] The micro-array high-frequency ultrasound probe part of the US / PA-BI hysteroscopic system is as follows Figure 2a-2dAs shown, the probe is a phased array probe with a 5 mm aperture, a 3 mm width, a center frequency of 12 MHz, and a bandwidth range of 10 MHz to 15 MHz. The probe performance is as follows Figure 2b As shown, the probe center frequency is 12MHz, and the relative bandwidth is 25.02% at -6dB. The spatial resolution of the system is quantified to be approximately 19.1μm. It can penetrate the uterine cavity to a depth of 6 cm, and the theoretical axial resolution can reach submillimeter level. The probe is made of piezoelectric film (PVDF) material. Compared with traditional piezoelectric ceramic transducers, the acoustic impedance of piezoelectric film is closer to the acoustic impedance of soft tissue, so it has higher receiving sensitivity; moreover, piezoelectric film has flexible characteristics and is easy to be processed into a self-focusing intrauterine microprobe. The piezoelectric film is attached to the side of the front end of the probe. The ultrasound probe receives, and after amplification, it is excited / receiver sampled, and the sampled signal is stored in the computer for later image reconstruction. The imaging probe is an ultrasonic phased array probe.

[0053] The micro-array transducer has multiple ultrasonic transducers or combinations, and can collect 64 or even more signals for the same target point, which is convenient for the implementation of multiple algorithms during the imaging process. At the same time, it supports the operation of holding the handle instead of rotating the motor, which is convenient for medical staff to use.

[0054] The transducer 35 and the 45° reflector 33 are assembled as a whole, and the reflector 33 will not change the propagation path of the sound signal emitted by the sample; the polyethylene film 34 is sleeved on the opening of the reflector 33, and the thickness is negligible to prevent the internal structure of the endoscope from being corroded by the living tissue fluid, and the material will not change the propagation path of the sound signal and the light signal; the SMA (SubMiniature versionA) connecting line 31 is directly connected to the internal circuit of the probe and extends to the analog-to-digital conversion (AD) port of the acquisition system; the tubular shaft 36 is used to replace the support and cooperate as a clamp for the optical fiber, fix the multimode optical fiber 38 in the center of the tube, and prevent the optical fiber from being entangled and knotted during rotation; the multimode optical fiber 38 is connected to the laser, and the optical power and wavelength are adjusted through the external optical path; the function of the catheter 39 and the package 40 is to provide external protection for the endoscope, and they are coaxial and codiametric with the step support 37; the motor system 32 can provide rotation and translation functions, and a handheld measurement mode can be selected.

[0055] In response to the needs of US / PA-BI hysteroscopic imaging in this project, a host circuit system (excitation / receiver) was designed. Through the iteration of the host prototype in the previous work, the current host system has 64 parallel physical channels, including 64-channel pulse generators, 64-channel AD conversion, AD bit width 14 bits, sampling frequency 50MHz, and supporting 64-channel low-noise amplifiers, digital switches and other auxiliary circuit systems. The excitation / receiver host circuit can complete the two imaging processes of ultrasound imaging and photoacoustic imaging. The data collected by the receiver is transmitted to the computer via the USB3.0 interface, and further uses the CPU and GPU for real-time calculation to obtain the photoacoustic and ultrasound images of the tissue.

[0056] like Figure 2c As shown, the motor drive system and data acquisition are collected by the AD chip to obtain the original photoacoustic signal, which is then transmitted to the FPGA acquisition system through the signal amplifier. The original signal or the FPGA post-processing signal can be selected and sent to the PC through the network cable. At the same time, the PC reads the position frame signal in the signal and feeds it back to the FPGA to indicate the next position of the motor.

[0057] like Figure 2d As shown in the sample placement and experimental system, the sample 41 is placed in a cylindrical container, and the endoscope probe end rotates 360 degrees in the container and moves vertically up and down to collect the complete wall photoacoustic data. Alternatively, when the probe is held horizontally, it can be rotated and moved horizontally according to the cervical position.

[0058] The physical principle of the US / PA-BI hysteroscopic system of this application includes the following steps:

[0059] Step 1: The pulsed laser generated by the laser is introduced into the lumen of the ultrasound / photoacoustic endoscope through the optical fiber. The laser emitted from the optical fiber is collimated and focused by the microlens, passes through the central hole of the micro-ultrasonic transducer, and irradiates the reflecting mirror surface inclined at 45°. After 90° reflection, it passes through the special transparent material at the opening of the tube wall and irradiates vertically on the uterine wall of the uterine cavity, thereby stimulating the photoacoustic signal;

[0060] Step 2: Photoacoustic imaging of different wavelengths can be achieved by replacing different laser light sources to meet different functional imaging requirements. For example, using 266nm ultraviolet laser as the excitation light source can obtain the distribution image of nuclear matter.

[0061] Step 3: Use 532nm to monitor the functional changes of endometrial cell composition and local hemoglobin concentration, blood oxygen saturation and oxygen metabolism;

[0062] Step 4: Using near-infrared laser excitation can ensure the imaging of the endometrium and subendometrial blood vessels at a depth of 10-15mm. At the same time, the technical parameters of the endoscope are continuously optimized, and the imaging performance of the imaging system, such as resolution, specificity, and sensitivity, is improved by optimizing the laser wavelength, ultrasonic transducer working wavelength and bandwidth, and the scanning head optical-acoustic beam structure.

[0063] The working method of the US / PA-BI hysteroscopic system of the present application comprises the following steps:

[0064] Step 1: The pulsed laser emits a laser pulse, and most of the energy is coupled into the optical fiber after passing through the beam splitter. The optical fiber guides the laser energy into the photoacoustic imaging head and irradiates the sample;

[0065] Step 2: The photoacoustic signal generated by the photoacoustic effect is received by the ultrasound probe, amplified and sampled by the data acquisition card, and the sampled signal is stored in the computer for later image reconstruction;

[0066] Step 3: Another part of the laser beam through the beam splitter is irradiated on the photodetector. The data acquisition card collects the signal generated by the photodetector to ensure the synchronization of the excitation and acquisition of the photoacoustic signal. At the same time, the signal of the photodetector can also be used to monitor the size of the laser pulse energy and eliminate the interference of the laser energy fluctuation on the photoacoustic image;

[0067] Step 4: Under computer control, the electrically controlled translation stage drives the array probe to scan the sample point by point, thereby obtaining a two-dimensional or three-dimensional optical resolution photoacoustic image of the sample.

[0068] The array transducer uses the DAS delay-and-sum algorithm, which is divided into two steps: calculating the delay and summing the data.

[0069] Step 1: Calculate the delay time. By calculating the distance from the target point P to the sensor receiving unit, and then according to the speed of the transmission medium and the acquisition frequency of the ultrasonic sensor array, the time required for the photoacoustic signal to be received from the target point is calculated, thereby locating the position of the collected data point in the sensor receiving data set, and finding the receiving signal of the target point at the time corresponding to a certain sensor unit.

[0070] According to the distance formula between two points, with the center of the upper part of the image and the center of the array probe as the origin, the distance between the target point position P(xi,yi) and the (N,0)th array element can be expressed as:

[0071]

[0072] Where N is the number of array elements, the target point is located at the (i, j)th position of the image pixel, dx and dy represent the image pixel size, X and Y represent the length and width of the image, (Channeli, 0) is the position of the i-th array element, and the distance between each array element is d.

[0073] The propagation time of the photoacoustic signal is the speed of sound propagation processed by the calculated distance. The calculation formula is as follows:

[0074]

[0075] Where fs is the sampling frequency of the probe, which represents the number of data points generated per second, and Vs is the speed of sound.

[0076] Step 2: Data summation: After determining the receiving time and signal strength corresponding to each unit in the transducer array, the corresponding data are summed to obtain the signal strength of the target point.

[0077] Signal(i,j)=Signal(i,j)+Transducer_data(Channel i ,time);

[0078] Where Signal represents the signal value of the target point, and Transducer_data represents the signal strength obtained by the transducer unit at the corresponding time.

[0079] According to this method, the sum of all array signals corresponding to each pixel in the image can be calculated, thereby obtaining the intensity information of the entire image area.

[0080] The application scenarios of the US / PA-BI hysteroscopic system of this application are as follows:

[0081] Application 1: Endoscopic imaging of the pig uterine cavity: After anesthetizing an adult pig, place it on the imaging platform. First, use a transvaginal probe to scan the uterus to obtain a macroscopic image from the endometrium to the myometrium. Then, insert the US / PA-BI hysteroscopic endoscope into the pig uterine cavity along the cervix to perform endometrial imaging. At the same time, high-resolution images of endometrial structure and vascular blood flow are collected and compared with the transvaginal ultrasound macroscopic images.

[0082] Application 2: Endoscopic imaging of human EC ex vivo uterus: 50 patients with suspected EC and precancerous lesions who were scheduled to undergo hysterectomy in the hospital were collected. The study was approved by the ethics committee. The conditions are as follows: ① Age ≥ 18 years old; ② Based on clinical history, two or more imaging diagnoses of endometrial thickening, and clear preoperative imaging images; ③ Patients diagnosed with EC and precancerous lesions by rapid freezing during surgery; ④ Patients have no history of intrauterine surgery. After intraoperative hysterectomy, the US / PA-BI hysteroscopic endoscope was immediately inserted into the excised uterine cavity along the cervix for imaging, and the ultrasound image was saved. The image acquisition method was to simultaneously acquire dynamic images and static images, of which the static image was intended to acquire the largest cross-sectional image of the tumor, the largest longitudinal image, and the image of the local blood vessels of the endometrium, and was compared with the preoperative transvaginal ultrasound macroscopic image and the postoperative pathological results.

[0083] The present application organically integrates a high-frequency ultrasonic hysteroendoscopic (HFUIE) ultrasound probe and a miniature optical path system to develop a miniaturized US / PA-BI hysteroendoscopic imaging for clinical EC specialist diagnosis. The device can obtain a high resolution of several microns to meet the observation of fine structures at the cellular level, and non-invasively visualize the edge of the endometrium (cut edge) involved by EC cells in vivo. It is also possible to obtain US / PA dual-modal high-resolution microstructure images of the entire endometrium with a spatial resolution of tens of microns and hundreds of microns, visualizing the range and depth of EC cell involvement. Since various molecular chemical components in tissues have specific optical absorption coefficients for lasers of different wavelengths, photoacoustic imaging is essentially a measurement technology that can reflect the biochemical molecular components of tissues. The contrast of photoacoustic images reveals functional information of the endometrium, such as blood oxygen distribution and changes, blood perfusion, etc.

[0084] This application builds a HFUIE and US / PA dual-modality imaging device suitable for uterine endoscopic imaging and treatment guidance, completes the organic integration of the HFUIE ultrasound probe and the micro-optical path, and develops a miniaturized US / PA uterine endoscopic imaging head, as well as corresponding hardware and software equipment. The specific technical indicators of the system are as follows: imaging resolution: axial resolution 150 microns, lateral resolution 200 microns; optical wavelength: covers visible light band, near-infrared band, etc.; imaging depth: 1mm~10mm, meeting the needs of imaging of early endometrial lesions.

[0085] The purpose of this application is to develop a US / PA-BI hysteroscopic endoscope and perform high-resolution structural and functional imaging of the endometrium and endometrial lesions in the live pig uterine cavity, the ex vivo human EC uterine cavity, and the nude mouse Ishikawa EC transplant tumor. The US / PA-BI hysteroscopic endoscope developed in the project has high clinical application value and involves cross-disciplinary fields such as clinical pathology, clinical gynecology, and clinical imaging. It aims to promote the development and preclinical application of efficient EC diagnosis and treatment models through cross-disciplinary research, and is expected to provide a new strategy for the prevention and treatment of EC, so that my country's research in this field can be among the world's top, and it can also be used for early physical examination screening of potential patients in the future. More importantly, it provides an experimental basis for the subsequent development of other endoscopes and provides design ideas and technical support for the development of integrated diagnosis and treatment models.

[0086] Embodiment 2

[0087] This embodiment takes carbon fiber and black tape phantom US / PA-BI endoscope imaging as an example for explanation:

[0088] like Figure 1a-1d The figure shows a dual-channel acquisition system for photoacoustic signals. Taking carbon fiber imaging under low laser radiation power as an example, a cluster of carbon fibers with a diameter of 7 is placed on a glass slide, and the carbon fiber / black tape is dispersed with tweezers. Cover the carbon fiber with transparent tape. Place the glass slide in a water tank container. Collect US / PA dual-modality photoacoustic image data (thanks to the high resolution of tens of microns, photoacoustic intensity, shape, area and other information can be obtained) and photoacoustic data. When collecting photoacoustic data, it will first be judged from the photoacoustic image, and the most appropriate section will be selected. The section will be scanned and imaged in B-mode with multiple wavelengths, so that the entire photoacoustic data of the B-mode can be obtained; then, the most meaningful photoacoustic data (from the center position of the phantom) will be selected as the data used by the subsequent reconstruction algorithm. Finally, all phantoms are scanned and archived panoramically.

[0089] The probe center frequency in the experiment was 12MHz, and the relative bandwidth was 25.02% at -6dB. The spatial resolution of the system was quantified to be approximately 15.1μm and 13.7μm, respectively, saving US / PA dual-modality images, black tape and carbon fiber images, respectively. Figure 5 , Figure 6 As shown. The image acquisition method is to collect dynamic images and static images at the same time, among which the static images are intended to collect the largest cross-sectional image of the phantom, the largest longitudinal image, the reconstructed three-dimensional image, and the local image of the carbon fiber / black tape phantom, and compare them with the high-resolution photoacoustic microscopy results. Therefore, this part of the experiment shows that the US / PA-BI micro-endoscopic probe will obtain the US / PA dual-modality images and photoacoustic data of the experimental phantom.

[0090] The above description is only a preferred embodiment of the present invention and is not intended to limit the present invention. For those skilled in the art, the present invention may have various modifications and variations. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present invention shall be included in the protection scope of the present invention.

Claims

1. A hysteroscopic endoscope with integrated ultrasound / photoacoustic imaging diagnosis and treatment based on a microarray probe, characterized in that: include: A photoacoustic imaging probe unit, a laser generator, a signal generator, an ultrasonic pulse excitation / receiver, and a data post-processing and imaging platform; the signal generator is respectively connected to the laser generator and the ultrasonic pulse excitation / receiver, and is used to control a controller of ultrasonic imaging or photoacoustic imaging, and trigger different signals to excite different imaging modes; the laser generator is a multimodal laser generator, and is used to excite ultrasonic pulses, receive ultrasonic echo signals, and perform data and signal processing; the ultrasonic pulse excitation / receiver is connected to the data post-processing and imaging platform, and the laser generator and the ultrasonic pulse excitation / receiver are both connected to the photoacoustic imaging probe unit.

2. The integrated ultrasound / photoacoustic imaging diagnosis and treatment hysteroendoscope based on a microarray probe according to claim 1, characterized in that: The photoacoustic imaging probe unit includes: a water inlet, a water inlet channel, a transmission shaft, a coupling, a stepper motor and an imaging probe; the water inlet is reinforced by bolts, and adopts rust-proof material and a closed design; water is injected into the water inlet through a syringe, and pure water flows to the probe side through the water inlet channel, which is convenient for the acoustic coupling of the signal and the sample; the stepper motor is connected with the coupling and the transmission shaft in sequence, and the transmission shaft is located in the water inlet channel; the stepper motor is integrated with the handle, and the imaging probe is rotated by the transmission shaft in the water channel to achieve 360-degree ultrasonic imaging in the uterine cavity; the transmission shaft and the stepper motor are hollow, allowing the optical fiber and ultrasonic transducer wire to pass through; the imaging probe is wrapped by a latex balloon, and when in use, the imaging probe is covered by the latex balloon and filled with water through the water inlet channel. When filled with deionized water, the liquid can make US waves and PA waves propagate from the imaging head to the surrounding uterine cavity wall.

3. The integrated ultrasound / photoacoustic imaging diagnosis and treatment hysteroendoscope based on a microarray probe according to claim 1 or 2, characterized in that: The imaging probe is a phased array probe with an aperture of 5 mm, a width of 3 mm, a center frequency of 12 MHz, and a bandwidth range of 10 MHz to 15 MHz; the imaging probe is made of piezoelectric film material; the ultrasonic probe receives the signal, which is sampled by the excitation / receiver after amplification, and the sampled signal is stored in a computer for later image reconstruction.

4. The integrated ultrasound / photoacoustic imaging diagnosis and treatment hysteroendoscope based on a microarray probe according to claim 1 or 2, characterized in that: The photoacoustic imaging probe unit also includes: a transducer, a reflector, a polyethylene film sleeve, an SMA connecting line, and a tubular rotating shaft; the transducer and the 45° reflector are assembled as a whole, and the reflector will not change the propagation path of the sound signal emitted by the sample; the transducer is a miniature array transducer, which has multiple ultrasonic transducers or a combination, and can collect 64 or more signals for the same target point; the polyethylene film sleeve is at the opening of the reflector; the SMA connecting line is directly connected to the internal circuit of the probe and extends to the AD port of the acquisition system; the tubular rotating shaft is a clamp for the optical fiber, which fixes the multi-mode optical fiber at the center of the tube and prevents the optical fiber from being entangled and knotted during rotation; the multi-mode optical fiber is connected to the laser, and the optical power and wavelength are adjusted through the external optical path; the motor can provide rotation and translation functions.

5. The integrated ultrasound / photoacoustic imaging diagnosis and treatment hysteroendoscope based on a microarray probe according to claim 1 or 2, characterized in that: The ultrasonic pulse excitation / receiver is used to complete the two imaging processes of ultrasonic imaging and photoacoustic imaging. The data collected by the receiver is transmitted to the computer via the USB3.0 interface, and the CPU and GPU of the computer are used for real-time calculation to obtain the photoacoustic and ultrasonic images of the tissue.

6. The integrated ultrasound / photoacoustic imaging diagnosis and treatment hysteroendoscope based on a microarray probe according to claim 4, characterized in that: The array transducer uses the DAS delay-sum algorithm, which is divided into two steps: calculating the delay and summing the data; Step (1): Calculate the delay time by calculating the distance from the target point P to the sensor receiving unit, and then according to the speed of the transmission medium and the acquisition frequency of the ultrasonic sensor array, find the time required for the photoacoustic signal to be received from the target point, thereby locating the position of the collected data point in the sensor receiving data set, and finding the receiving signal of the target point at the time corresponding to a certain sensor unit; According to the distance formula between two points, the center of the upper part of the image and the center of the array probe are taken as the origin, and the target point position P(x i ,y i ) to the (N,0)th array element can be expressed as: Where N is the number of array elements, the target point is located at the (i, j)th position of the image pixel, dx and dy represent the image pixel size, X and Y represent the image length and width, (Channel i ,0) is the position of the i-th array element, and the distance between each array element is d; The propagation time of the photoacoustic signal is the speed of sound propagation processed by the calculated distance. The calculation formula is as follows: Where fs is the sampling frequency of the probe, which indicates the number of data points generated per second, and Vs is the speed of sound; Step (2): Data summation: after determining the receiving time and signal strength corresponding to each unit in the transducer array, the corresponding data are summed to obtain the signal strength of the target point; Signal(i,j)=Signal(i,j)+Transducer_data(Channel i ,time); In the formula, Signal represents the signal value of the target point, and Transducer_data represents the signal strength obtained by the transducer unit at the corresponding time; According to steps (1) and (2), the sum of all array signals corresponding to each pixel in the image can be calculated, thereby obtaining the intensity information of the entire image area.

7. A method for operating a hysteroscopic endoscope, characterized in that: The hysteroscopic endoscope is an integrated ultrasound / photoacoustic imaging diagnosis and treatment hysteroscopic endoscope based on a microarray probe as described in any one of claims 1 to 6, comprising: Step (1): a pulsed laser emits a laser pulse, which is coupled into an optical fiber after passing through a beam splitter. The optical fiber guides the laser energy into a photoacoustic imaging head and irradiates the sample. Step (2): The photoacoustic signal generated by the photoacoustic effect is received by the ultrasound probe, amplified and sampled by the data acquisition card, and the sampled signal is stored in the computer for later image reconstruction; Step (3): another part of the laser beam through the beam splitter is irradiated on the photodetector, and the data acquisition card collects the signal generated by the photodetector, thereby ensuring the synchronization of the excitation and acquisition of the photoacoustic signal. At the same time, the signal of the photodetector can also be used to monitor the size of the laser pulse energy; Step (4): Under computer control, the electrically controlled translation stage drives the array probe to scan the sample point by point to obtain a two-dimensional or three-dimensional optical resolution photoacoustic image of the sample.

8. The method for operating a hysteroscopic endoscope according to claim 7, characterized in that: Also includes: By replacing different laser light sources, photoacoustic imaging of different wavelengths can be achieved to meet different functional imaging needs.

9. The method for operating a hysteroscopic endoscope according to claim 8, characterized in that: include: Using 266nm ultraviolet laser as the excitation light source can obtain the distribution image of nuclear material; using 532nm excitation light source can monitor the functional changes of endometrial cell composition and local hemoglobin concentration, blood oxygen saturation and oxygen metabolism; using near-infrared laser excitation can ensure the imaging of endometrium and subendometrial blood vessels at a depth of 10-15mm.

Citation Information

Patent Citations

  • Intravascular photoacoustic and ultrasonic double-mode imaging endoscope device and imaging method thereof

    CN101912250A

  • Optoacoustic / ultrasonic dual mode endoscope based on miniature piezoelectric ultrasonic transducer arrays

    CN105147332A

  • Photoacoustic endoscope for high-precision three-dimensional scanning of front micro motor and imaging method

    CN109044243A

  • Bimodal imaging system and method based on array type optical fiber ultrasonic probe

    CN113749689A

  • Photoacoustic / ultrasonic endoscopic probe based on fixed-focus sound field and dynamic focusing reconstruction algorithm

    CN113842158A

Cited By

  • Photoacoustic imaging system, imaging method, imaging device and computer program product

    CN122893899A