Esophageal endoscopy diagnosis and treatment system and storage medium

Abstract

The present application relates to an esophageal endoscopic diagnosis and treatment system and a storage medium, wherein the esophageal endoscopic diagnosis and treatment system comprises: a multimodal optical endoscopic device, comprising a multimodal endoscopic light source, a first image processing module and an endoscopic probe; the multimodal endoscopic light source is used to emit a multimodal optical signal, and the multimodal optical signal is transmitted through the endoscopic probe; a conformal optical platform construction device, comprising a catheter adapted to the endoscopic probe; wherein the endoscopic probe enters the human esophagus through the catheter; the first image processing module is used to receive optical imaging data of the human esophagus returned by the endoscopic probe based on the multimodal optical signal, and generate a first imaging image based on the optical imaging data; a photodynamic therapy device, connected to the endoscopic probe, for emitting a therapeutic optical signal to the endoscopic probe. Through this application, the problem of low accuracy of the esophageal endoscopic diagnosis and treatment system is solved, and an in vivo super-resolution diagnosis and treatment integrated system for early esophageal cancer is realized.

Description

Technical Field

[0001] The present application relates to the field of endoscopy technology, and in particular to an esophageal endoscopy diagnosis and treatment system and a storage medium. Background Art

[0002] Early esophageal cancer and early invasive cancer are high-incidence and high-risk digestive tract tumors in my country, accounting for 50% of the worldwide morbidity and mortality. Early clinical detection and treatment boundary identification are the core and focus of tumor diagnosis, while tumor removal and reduction of normal structural and functional damage are the key and goal of treatment. At present, local treatment of digestive tract tumors is mainly resection. Photodynamic therapy, as a new and more accurate targeted selective treatment, has been clinically used in the treatment of malignant tumors and precancerous lesions. In related technologies, there are also cases of detection using the fusion of multiple optical imaging modalities, but none of them considers the impact of esophageal motility on imaging accuracy, and imaging and photodynamic therapy cannot be synchronized, resulting in poor accuracy of diagnosis and treatment.

[0003] Currently, no effective solution has been proposed for the problem of low accuracy of esophageal endoscopic diagnosis and treatment systems in related technologies. Summary of the invention

[0004] The embodiments of the present application provide an esophageal endoscopic diagnosis and treatment system and a storage medium to at least solve the problem of low accuracy of esophageal endoscopic diagnosis and treatment in the related art.

[0005] In a first aspect, an embodiment of the present application provides an esophageal endoscopic diagnosis and treatment system, the system comprising:

[0006] A multimodal optical endoscopy device, comprising a multimodal endoscopy light source, a first image processing module and an endoscopy probe; the multimodal endoscopy light source is used to emit a multimodal optical signal, and the multimodal optical signal is transmitted through the endoscopy probe;

[0007] A conformal optical platform construction device, comprising a catheter adapted to the endoscopic probe; wherein the endoscopic probe enters the human esophagus through the catheter; the first image processing module is used to receive optical imaging data of the human esophagus returned by the endoscopic probe based on the multimodal optical signal, and generate a first imaging image according to the optical imaging data;

[0008] A photodynamic therapy device is connected to the endoscopic probe and is used to transmit a therapeutic light signal to the endoscopic probe.

[0009] In some embodiments, the system further comprises:

[0010] An electronic endoscope device comprises an electronic endoscope light source, a second image processing module and an electronic endoscope body equipped with the conformal optical platform building device; wherein the catheter enters the human esophagus through the electronic endoscope body;

[0011] The electronic endoscope light source is used to emit a first light signal during the diagnosis process; the first light signal is transmitted through the electronic endoscope body;

[0012] The second image processing module is used to receive the first imaging data of the human esophagus returned by the first optical signal, and generate a second imaging image according to the first imaging data;

[0013] The multimodal endoscopic light source is further used to transmit the multimodal light signal to the human esophagus based on the second imaging image.

[0014] In some embodiments, the electronic endoscope light source is further used to emit a second light signal during photodynamic therapy; the second light signal is conducted through the electronic endoscope body;

[0015] The second image processing module is further used to receive second imaging data of the human esophagus returned by the second optical signal, and generate a third imaging image according to the second imaging data;

[0016] The photodynamic therapy device is further configured to transmit the therapeutic light signal to the endoscopic probe based on the third imaging image.

[0017] In some embodiments, a large clamp channel is integrated on the electronic endoscope body; the large clamp channel is a clamp channel with an inner diameter greater than a preset inner diameter threshold;

[0018] Wherein, the conformal optical platform construction equipment is mounted on the large clamp channel, and the catheter passes through the large clamp channel.

[0019] In some of the embodiments, a notch filter is integrated at one end of the electronic endoscope body;

[0020] The notch filter is used to filter out therapeutic light signals within a preset wavelength range.

[0021] In some of the embodiments, the conformal optical platform construction device is further provided with a transparent support pipe and a liquid filling mechanism;

[0022] The transparent support tube and the catheter are both hollow structures; wherein a first liquid medium flows inside the transparent support tube and the catheter; and the first liquid medium constitutes the liquid filling mechanism.

[0023] In some of the embodiments, the transparent support tube is provided with scale marks for registration of the first imaging image.

[0024] In some embodiments, the endoscopic probe comprises a reflecting prism, an ultrasonic transducer, a focusing lens, an inner sheath of the lens, and a multi-clad optical fiber;

[0025] The ultrasonic transducer is annular; wherein the ultrasonic transducer is connected to the reflective prism and the focusing lens respectively;

[0026] The focusing lens is in a convex step structure, and the outer diameter of the first step of the convex step structure is adapted to the inner hole of the ultrasonic transducer;

[0027] The inner lens sheath covers the ultrasonic transducer and the focusing lens; wherein the ultrasonic transducer is arranged along the strip-shaped hole opened on the inner lens sheath;

[0028] The multi-clad optical fiber is connected to the focusing lens and is used to transmit the multi-modal optical signal.

[0029] In some of these embodiments, the endoscopic probe further comprises a transparent outer sheath;

[0030] When the transparent outer sheath is wrapped around one end of the endoscopic probe, the gap between the reflecting prism and the ultrasonic transducer is pre-filled with a second liquid medium.

[0031] In some of the embodiments, the multimodal optical endoscopy device further comprises an optoelectronic connector, an optical fiber coupler, and a wavelength division multiplexer;

[0032] The photoelectric connector is connected to the optical fiber coupler and the multi-clad optical fiber respectively, and is used to drive the endoscope probe to perform rotation and / or translation movement;

[0033] The wavelength division multiplexer is connected to the multi-modal endoscopic light source and the optical fiber coupler respectively;

[0034] The optical fiber coupler is also connected to the first image processing module and is used to couple the multi-mode signal and the single-mode signal transmitted in the multi-clad optical fiber.

[0035] In some of the embodiments, the multi-modal endoscopic light source includes an optical coherence tomography (OCT) light source, a photoacoustic light source, a fluorescent light source and / or a multi-mode fiber optic light source.

[0036] In a second aspect, an embodiment of the present application provides a storage medium, in which a computer program is stored, wherein the computer program is configured to execute the operation of the esophageal endoscopic diagnosis and treatment system described in the first aspect when running.

[0037] Compared with the related art, the embodiment of the present application provides an esophageal endoscopic diagnosis and treatment system and storage medium, wherein the system includes: a multimodal optical endoscopy device, including a multimodal endoscopy light source, a first image processing module and an endoscopy probe; the multimodal endoscopy light source is used to emit a multimodal optical signal, and the multimodal optical signal is transmitted through the endoscopy probe; a conformal optical platform construction device, including a catheter adapted to the endoscopy probe; wherein the endoscopy probe enters the human esophagus through the catheter; the first image processing module is used to receive the optical imaging data of the human esophagus returned by the endoscopy probe based on the multimodal optical signal, and generate a first imaging image based on the optical imaging data; a photodynamic therapy device, connected to the endoscopy probe, is used to transmit a therapeutic optical signal to the endoscopy probe. Based on this, through a multimodal optical endoscopy device of different modes, the imaging features of each mode can be integrated to obtain comprehensive imaging data for the human esophagus, which is conducive to obtaining multi-level and multi-dimensional information such as tissue morphology, tissue stratification, tissue composition, and cell morphology of the lesion area, thereby realizing super-resolution and accurate diagnosis of early esophageal cancer. By building a conformal optical platform, a stable conformal optical platform is established in vivo, avoiding environmental interference caused by factors such as irregular contraction and peristalsis of the esophagus and organ pulsation, and building a stable environment for in vivo optical diagnosis and treatment. In addition, by integrating multimodal imaging with photodynamic therapy, an in vivo super-resolution diagnosis and treatment integrated system for early esophageal cancer is realized.

[0038] Details of one or more embodiments of the present application are set forth in the following drawings and description to make other features, objects, and advantages of the present application more readily apparent. BRIEF DESCRIPTION OF THE DRAWINGS

[0039] The drawings described herein are used to provide a further understanding of the present application and constitute a part of the present application. The illustrative embodiments of the present application and their descriptions are used to explain the present application and do not constitute an improper limitation on the present application. In the drawings:

[0040] Figure 1 is a structural block diagram of an esophageal endoscopy diagnosis and treatment system according to an embodiment of the present application;

[0041] Figure 2 is a structural block diagram of another esophageal endoscopy diagnosis and treatment system according to an embodiment of the present application;

[0042] Figure 3 is a structural schematic diagram of an esophageal endoscopic diagnosis and treatment system according to an embodiment of the present application;

[0043] Figure 4 This is a schematic diagram of the appearance structure of a transparent support pipe according to an embodiment of the present application;

[0044] Figure 5 is a schematic structural diagram of a multimodal optical endoscopy device according to an embodiment of the present application;

[0045] Figure 6 is a schematic structural diagram of a lens inner sheath according to an embodiment of the present application;

[0046] Figure 7 is a schematic structural diagram of an endoscope probe according to an embodiment of the present application;

[0047] Figure 8 is a schematic structural diagram of another endoscope probe according to an embodiment of the present application;

[0048] Fig. 9 This is a structural block diagram of another esophageal endoscopic diagnosis and treatment system according to an embodiment of the present application.

[0049] Description of reference numerals:

[0050] 11. Multimodal optical endoscopy device; 111. Multimodal endoscopy light source; 112. First image processing module; 113. Endoscopy probe; 12. Conformal optical platform construction equipment; 121. Catheter; 13. Photodynamic therapy device; 21. Electronic endoscopy device; 211. Electronic endoscopy light source; 212. Second image processing module; 213. Electronic endoscope body; 31. Large forceps channel; 32. Liquid filling mechanism; 33. Transparent support pipe; 34. First liquid medium; 35. Notch filter; 501. Reflection prism; 502. Ultrasonic transducer; 503. Focusing lens mirror; 504, lens inner sheath; 505, multi-clad optical fiber; 506, torque spring; 507, metal sheath; 508, optoelectronic connector; 509, fiber coupler; 510, wavelength division multiplexer; 511, OCT light source; 512, photoacoustic light source; 513, fluorescent light source; 514, multimode fiber light source; 515, photodynamic therapy light source; 516, first display; 61, strip hole; 62, first step; 63, second step; 81, transparent outer sheath; 82, second liquid medium; 91, second display; 92, human body; 921, esophagus. DETAILED DESCRIPTION

[0051] In order to make the purpose, technical solutions and advantages of the present application clearer, the present application is described and illustrated below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application and are not intended to limit the present application. Based on the embodiments provided in the present application, all other embodiments obtained by ordinary technicians in this field without making creative work are within the scope of protection of the present application. In addition, it can also be understood that although the efforts made in this development process may be complex and lengthy, for ordinary technicians in the field related to the contents disclosed in the present application, some changes such as design, manufacturing or production based on the technical contents disclosed in the present application are only conventional technical means, and should not be understood as insufficient contents disclosed in the present application.

[0052] Reference to "embodiments" in this application means that a particular feature, structure, or characteristic described in conjunction with the embodiments may be included in at least one embodiment of the present application. The appearance of the phrase in various locations in the specification does not necessarily refer to the same embodiment, nor is it an independent or alternative embodiment that is mutually exclusive with other embodiments. It is explicitly and implicitly understood by those of ordinary skill in the art that the embodiments described in this application may be combined with other embodiments without conflict.

[0053] Unless otherwise defined, the technical terms or scientific terms involved in this application should be understood by people with ordinary skills in the technical field to which this application belongs. The words "one", "a", "a", "the" and the like involved in this application do not indicate a quantity limitation, and may indicate the singular or plural. The terms "include", "comprise", "have" and any of their variations involved in this application are intended to cover non-exclusive inclusions; for example, a process, method, system, product or device that includes a series of steps or modules (units) is not limited to the listed steps or units, but may also include steps or units that are not listed, or may also include other steps or units inherent to these processes, methods, products or devices. The words "connect", "connected", "coupled" and the like involved in this application are not limited to physical or mechanical connections, but may include electrical connections, whether direct or indirect. The "multiple" involved in this application means greater than or equal to two. "And / or" describes the association relationship of associated objects, indicating that there can be three relationships. For example, "A and / or B" can mean: A exists alone, A and B exist at the same time, and B exists alone. The terms "first", "second", "third" and the like involved in the present application are merely used to distinguish similar objects and do not represent a specific ordering of the objects.

[0054] This embodiment provides an esophageal endoscopic diagnosis and treatment system. Figure 1 is a structural block diagram of an esophageal endoscopic diagnosis and treatment system according to an embodiment of the present application, such as Figure 1 As shown, the system includes: a multimodal optical endoscopy device 11, a conformal optical platform construction device 12 and a photodynamic therapy device 13.

[0055] The multimodal optical endoscopy device 11 includes a multimodal endoscopy light source 111, a first image processing module 112 and an endoscopy probe 113; the multimodal endoscopy light source 111 is used to emit a multimodal optical signal, and the multimodal optical signal is transmitted through the endoscopy probe 113. The above-mentioned multimodal optical endoscopy device 11 refers to a plurality of optical endoscopy devices that detect and image a target object through optical signals of different modes. That is, the multimodal endoscopy light source 111 in the multimodal optical endoscopy device 11 may include but is not limited to at least one of various OCT light sources, photoacoustic light sources, fluorescent light sources or multimode optical fiber light sources. It should be noted that in this embodiment, the multimodal endoscopy light source 111 such as the OCT light source, photoacoustic light source, fluorescent light source, multimode optical fiber light source, etc. are integrated into the same endoscopy probe, and the optical signals of each mode are transmitted to the target position through the endoscopy probe.

[0056] The above-mentioned first image processing module 112 may also be correspondingly provided with multiple ones, each first image processing module 112 corresponding to a multimodal endoscopic light source 111, for processing the imaging data returned by the light signal emitted by the multimodal endoscopic light source 111, and performing image registration and fusion; or, if permitted by the embodiment, multiple multimodal endoscopic light sources 111 may also share the same first image processing module 112, that is, the first image processing module 112 is used to realize centralized processing of multimodal light signals and generate tissue images, so as to improve the efficiency of data processing and further simplify the structure of the diagnosis and treatment system.

[0057] Among them, OCT imaging obtains images of tissue reflectivity and can image tissues at a depth of 1mm. Its axial resolution can reach 8μm and its lateral resolution is 20μm, which can observe lesions below the mucosal surface, but it does not have molecular specificity. Photoacoustic imaging uses the absorption characteristics of tissues to light signals. Detecting photoacoustic signals can reconstruct the light absorption distribution image in the tissue, avoiding the influence of light scattering, and can image esophageal tissues of 1-4mm. Fluorescence imaging has high molecular specificity and high sensitivity, but its imaging requires corresponding fluorescent agent labeling. Multimode fiber imaging uses multimode optical fiber to transmit and modulate illumination light, which can provide high resolution while maintaining an extremely fine probe diameter. Its resolution can reach submicron level, and can achieve in vivo label-free super-resolution imaging, which is different from fluorescence imaging that requires labeling. By acquiring multimodal image data such as OCT, photoacoustic, fluorescence, and multimode optical fiber, and performing image registration and fusion, biological information such as tissue morphology, vascular distribution, tissue structure, and cell morphology can be accurately characterized, and in vivo super-resolution and accurate diagnosis of early cancer can be achieved.

[0058] The conformal optical platform building device 12 includes a catheter 121 adapted for the endoscopic probe 113; wherein the endoscopic probe 113 enters the human esophagus through the catheter 121; the first image processing module 112 is used to receive optical imaging data of the human esophagus returned by the endoscopic probe 113 based on the multimodal optical signal, and generate a first imaging image according to the optical imaging data.

[0059] The esophagus is part of the human digestive tract, connected to the pharynx, descending along the vertebral body of the spine, and passing through the esophageal hiatus of the diaphragm into the stomach. Endoscopic diagnosis of early esophageal cancer is crucial. However, due to objective factors such as irregular contraction and peristalsis of the human esophagus and organ pulsation that easily cause environmental interference, it is difficult to provide a stable environment for endoscopic diagnosis and treatment, which easily affects the accuracy of esophageal endoscopic diagnosis and treatment. Therefore, in order to improve the above problems, in this embodiment, a conformal optical platform construction device 12 is provided, which includes at least a catheter 121. The catheter 121 is a hollow structure in the axial direction, and an endoscopic probe 113 adapted thereto is carried inside. During the diagnosis and treatment process, the catheter 121 can be coupled into the human esophagus to establish a conformal optical platform in the body. More specifically, after a stable conformal optical platform construction device is built by the above structure, during the endoscopic diagnosis process, the first image processing module 112 receives the optical imaging data of the human esophagus returned by the endoscopic probe 113, and performs image processing on it to obtain an imaging image of the human esophagus. It should be understood that the above-mentioned first imaging image can be displayed to the operator in real time through the first display in the multimodal optical endoscopy device 11.

[0060] The photodynamic therapy device 13 is connected to the endoscopic probe 113 and is used to transmit a therapeutic light signal to the endoscopic probe 113. It should be supplemented that in the related art, independent imaging probes and therapeutic probes are usually placed in the endoscopic diagnosis and treatment channel; however, this approach relies on manual operation to perform laser ablation and other treatments on the lesions, and due to the asynchronous movement of the imaging and treatment probes, it is easy to cause poor matching of the diagnosis and treatment processes, and there are large monitoring errors, which affect the treatment effect. Based on this, in this embodiment, the photodynamic therapy device 13 and the multimodal optical endoscope device 11 share an endoscope probe 113, and in the integrated diagnosis and treatment process, a variety of multimodal imaging light signals can be transmitted through the endoscope probe 113, and the therapeutic light signal can be transmitted through the endoscope probe 113 at the same time. It can be seen that, through the above-mentioned system structure that shares the same endoscopic probe 113, after accurate diagnosis is performed using the multimodal optical endoscope device 11, the switching between diagnosis and treatment can be completed by switching the multimodal endoscope light source and the photodynamic therapy light source, without pulling out the multimodal endoscope probe 113, and the integrated diagnosis and treatment system design that can simultaneously transmit multimodal imaging light signals and treatment light signals can be realized, and the detection during the treatment process and the evaluation after the treatment can be carried out at the same time. Through the above-mentioned method, the phenomenon of low accuracy of the optical endoscope diagnosis and treatment system caused by the misalignment between the diagnosed lesion position and the optical treatment position is avoided, the monitoring error is reduced, and the multimodal imaging and photodynamic therapy that can be accurately diagnosed in vivo with super-resolution are integrated, and the diagnosis and efficacy monitoring system, as well as the treatment system share an endoscope probe, which effectively improves the integrated diagnosis and treatment accuracy and efficiency of the esophageal endoscope diagnosis and treatment system, thereby improving the diagnosis rate, cure rate and patient adaptability for patients with early esophageal cancer.

[0061] Through the above embodiments, an esophageal endoscopic diagnosis and treatment system including at least a multimodal optical endoscope device 11, a conformal optical platform construction device 12 and a photodynamic therapy device 13 is provided; through the multimodal optical endoscope device 11 of different modes, the imaging characteristics of each mode can be integrated to obtain comprehensive imaging data for the human esophagus, which is conducive to obtaining multi-level and multi-dimensional information such as tissue morphology, tissue stratification, tissue composition, and cell morphology in the lesion area, thereby realizing super-resolution and accurate diagnosis of early esophageal cancer. By establishing a stable conformal optical platform in vivo through the conformal optical platform construction device 12, environmental interference caused by factors such as irregular contraction and peristalsis of the esophagus and organ pulsation is avoided, and a stable environment for in vivo optical diagnosis and treatment is constructed. In addition, by integrating multimodal imaging with photodynamic therapy, an in vivo super-resolution diagnosis and treatment integrated system for early esophageal cancer is realized.

[0062] In some embodiments, an esophageal endoscopic diagnosis and treatment system is also provided, see Figure 2 The system also includes an electronic endoscopy device 21.

[0063] The electronic endoscope device 21 includes an electronic endoscope light source 211, a second image processing module 212, and an electronic endoscope body 213 equipped with a conformal optical platform building device 12; wherein the catheter 121 enters the human esophagus through the electronic endoscope body 213. In other words, the electronic endoscope body 213 of the electronic endoscope device 21 can penetrate into the human esophagus, and the second image processing module 212 can obtain optical information of the tumor at different scales through high-resolution imaging technology.

[0064] The following is a brief description of the workflow of each component in the electronic endoscope device 21 during the diagnosis process: the electronic endoscope light source 211 emits a first light signal during the diagnosis process; the first light signal is transmitted through the electronic endoscope body 213; the electronic endoscope light source 211 may include a xenon light source or an LED light source, etc., to ensure that stable and high-quality lighting can be provided during the endoscopic examination. In this process, the electronic endoscope body is responsible for transmitting the light emitted by the electronic endoscope light source, that is, the first light signal, to the human esophageal part to be observed, and capturing the reflected image signal. The second image processing module 212 receives the first imaging data of the human esophagus returned by the electronic endoscope body 213 through the first light signal, and generates a second imaging image based on the first imaging data. It should be understood that the second imaging image can be displayed on the second display of the electronic endoscope device 21 for real-time observation and analysis by the operator. Then the multimodal endoscope light source 111 can also emit a multimodal light signal to the human esophagus based on the second imaging image. More specifically, the multimodal optical endoscopy device 11 can adjust the multimodal light signal emitted by the multimodal endoscopy light source 111 during the diagnosis process in real time according to the cross-scale optical information of the esophageal lesion tissue obtained by the electronic endoscopy device 21 during the initial inspection, thereby achieving more accurate esophageal endoscopy diagnosis.

[0065] In another embodiment, the workflow of each component in the electronic endoscope device 21 during the treatment process is briefly described: the above-mentioned electronic endoscope light source 211 emits a second light signal during the photodynamic therapy process; the second light signal is transmitted through the electronic endoscope body; the second image processing module 212 receives the second imaging data of the human esophagus returned by the second light signal, and generates a third imaging image based on the second imaging data. Similar to the above-mentioned diagnosis process, the second image processing module 212 receives the second imaging data returned by the electronic endoscope body 213, performs image processing on it and generates a third imaging image, which can be displayed on the second display to achieve real-time monitoring during the treatment process. Then the above-mentioned photodynamic therapy device 13 can also emit a therapeutic light signal to the endoscope probe based on the third imaging image. Specifically, the photodynamic therapy device 13 can be adjusted in time based on the third imaging image displayed in real time by the electronic endoscope device 21 during the treatment process, including adjusting parameters such as photosensitizer concentration and light dose, and emitting a corresponding therapeutic light signal for treatment, which is conducive to improving the accuracy of photodynamic therapy.

[0066] Through the above-mentioned embodiment, the cross-scale optical information and photodynamic efficiency information of the human esophageal tumor tissue are obtained through the electronic endoscope device 21, thereby realizing the full-process visual monitoring function, and further effectively improving the accuracy of in vivo diagnosis and treatment of the human esophagus.

[0067] In some of the embodiments, a large clamp channel is integrated on the electronic endoscope body 213; the large clamp channel is a clamp channel with an inner diameter greater than a preset inner diameter threshold. Among them, the large clamp channel refers to the ratio of the clamp channel diameter of the front end part of the scope body to the diameter of the front end of the entire scope body, that is, the clamp diameter ratio is greater than a certain threshold. The larger the clamp channel, the smaller the diameter of the head end, the larger the clamp diameter ratio, and the more convenient it is for the endoscope system to pass through narrow and tortuous channels and try to penetrate into areas such as the human esophagus to achieve more accurate observation and treatment. In particular, in this embodiment, the inner diameter of the large clamp channel is ≥3.2 mm.

[0068] The conformal optical platform construction device is mounted on the large clamp channel, and the catheter of the conformal optical platform construction device is coupled into the human esophagus through the large clamp channel. As an example, please refer to Figure 3 , the figure shows the coupling assembly method between the various devices in the esophageal endoscope diagnosis and treatment system. Among them, the electronic endoscope body 213 is integrated with a large clamp channel 31; the catheter 121 of the conformal optical platform construction device passes through the large clamp channel 31 and enters the human esophagus, and the catheter 121 is equipped with the above-mentioned endoscope probe 113.

[0069] In some embodiments, a notch filter is integrated at one end of the electronic endoscope body; the notch filter is used to filter out the therapeutic light signal within a preset wavelength range while retaining other unaffected wavelengths of therapeutic laser. It should be understood that the preset wavelength range that can be filtered out is related to the material selected for the notch filter; in this embodiment, the filtering range of the notch filter can be a 630 nm wavelength range. Please refer to Figure 3 , the figure shows a way to install a notch filter; wherein, the notch filter 35 is arranged at the imaging channel position at the front end of the electronic endoscope body, and can filter out the 630nm wavelength laser (actual transmittance <1%) emitted by the photodynamic therapy device 13. Through this ingenious and simple design structure, the blindness problem caused by strong photodynamic light illumination is effectively solved, and photodynamic visualization is achieved, thereby being able to display the spot boundary, tumor boundary and treatment effect in real time.

[0070] In some embodiments, the conformal optical platform construction device is further provided with a transparent support pipe and a liquid filling mechanism; the transparent support pipe and the catheter are both hollow structures, and the transparent support pipe is equipped with a catheter; the liquid filling mechanism is used to flow a first liquid medium into the transparent support pipe and the catheter. In this embodiment, the first liquid medium can be a contrast agent iodine solution or heavy water, which is used to establish a photoacoustic signal path in the system.

[0071] See also Figure 3, the filling mechanism 32 is arranged on the conformal optical platform construction device located on the side of the large clamp channel, and the mechanism does not need to enter the esophagus. In the actual application process, under the action of the filling mechanism 32, a path is arranged along the catheter 121, and a certain flow of the first liquid medium is injected into the transparent support pipe 33 and the catheter 121 at the front end. The first liquid medium 34 flows into the transparent support pipe 33 and the catheter through the filling mechanism 32, so that the shape of the transparent support pipe 33 can be changed after the first liquid medium 34 is filled, so that it can better fit the target part, such as the esophagus. The injection of the first liquid medium 34 is controlled by the filling mechanism 32, which can have a higher injection control accuracy to ensure that the first liquid medium 34 can be accurately injected into the specified position, and the injection can be stopped when necessary, which helps to avoid waste and potential risks caused by excessive injection. When the transparent support pipe 33 and the catheter 121 are filled with the first liquid medium 34, the transparent support pipe 33 can be close to the esophagus in the first liquid medium 34 to achieve the work of opening the human esophagus during application, thereby providing stable support and positioning for the catheter, which is convenient for building a stable in-body conformal optical platform. Moreover, in this state, the concentricity between the catheter 121 and the transparent support tube 33 should be less than the preset concentricity threshold to ensure good system accuracy; the concentricity threshold can be set according to actual conditions, for example, it can be set to 200μm. It should be noted that when the transparent support tube 33 and the catheter 121 are not filled with liquid, the transparent support tube 33 will automatically shrink and fold and cling to the outer wall of the catheter 121. When the first liquid medium flows inside the transparent support tube 33, its outer diameter is 20 mm, and its outer diameter is less than 2.9 mm in the contracted state when not filled with liquid. Among them, the transparent support tube 33 can be made of deformable and highly transparent polymer materials such as PET or PA12, and the catheter 121 can be made of highly transparent pebax polymer materials. It should be ensured that the light transmittance is greater than 95% to withstand the in vivo environment and maintain excellent optical properties.

[0072] Through the above embodiment, by filling the first liquid medium into the transparent support tube 33 and the catheter 121, the entire transparent support tube 33 can be filled, so that it can be close to the human esophagus in actual application, which is convenient for establishing a photoacoustic imaging circuit, and provides reliable protection for high-precision operations such as photoacoustic imaging, which not only ensures the stability during imaging or treatment, but also helps to improve imaging quality or treatment effect.

[0073] In some embodiments, the transparent support tube is provided with scale marks for first imaging image registration. Figure 4In order to better enter the esophagus and adapt to the morphology of the esophagus, and to facilitate the construction of a conformal optical platform in vivo, the transparent support tube is designed to have a structure in which the diameters at both ends are smaller than a certain proportion of the middle diameter. At the same time, scale marks are printed on the transparent support tube, which can be used for the registration between axial and circumferential multimodal image data. Among them, the scale marks allow the operator to accurately locate the position of the transparent support tube in the body during the operation. In addition, through the scale marks, a unified coordinate system can be established to map image data of different modalities to this coordinate system. In this way, even if the image data comes from light sources of different modalities or different imaging technologies, they can be compared and analyzed in this unified coordinate system.

[0074] It can be seen that the design of printing scale marks on the transparent support pipe of the conformal optical platform building device 12 plays an important role in the multimodal image data registration; such scale marks not only provide an intuitive reference basis for operators, but also greatly improve the accuracy and efficiency of image registration. In addition, the traditional image registration process may require complex algorithms and a large amount of computing resources. With the assistance of scale marks, operators can complete the preliminary registration work through simple observation and operation, thereby simplifying the entire operation process.

[0075] In some embodiments, the endoscopic probe includes a reflective prism, an ultrasonic transducer, a focusing lens, a lens inner sheath, and a multi-clad optical fiber. Figure 5 and Figure 6 The structure of the endoscope probe according to the embodiment of the present application is described.

[0076] The ultrasonic transducer is annular in shape, wherein the ultrasonic transducer is connected to a reflective prism and a focusing lens respectively. Figure 5The reflecting prism 501 is a prism with a triangular cross section. In the endoscope probe 113, the reflecting prism 501 can receive light from the light source and reflect it to the imaging area according to a predetermined path, thereby ensuring that the light can be efficiently transmitted to the target position. At the same time, the reflecting prism 501 can reduce the interference of reflections: since the working environment of the endoscope probe 113 is often more complicated, light interference is a common problem; the reflecting prism 501 can reduce the reflection and scattering of light inside the probe through its special optical design, thereby reducing the interference of reflections and improving the imaging quality. The reflecting prism 501 is coupled and assembled with the ultrasonic transducer 502. The ultrasonic transducer 502 is a device that converts electromagnetic energy into mechanical energy (acoustic energy); through the ultrasonic waves emitted by the ultrasonic transducer 502 in the endoscope probe 113, the operator can clearly observe the internal structure and pathological conditions of the human body, providing an important basis for the diagnosis and treatment of early esophageal cancer. In this embodiment, in order to facilitate the fitting and assembly of various components, the ultrasonic transducer 502 is designed as a structure with a ring-shaped cross section, and its surface size is set to 1.8 mm×0.9 mm (outer diameter×inner diameter).

[0077] The focusing lens 503 is used to focus the light source beam on a point or a specific focal plane, thereby improving the clarity of endoscopic imaging. Figure 5 For example, the cross section of the focusing lens 503 is a convex step structure, and the outer diameter of the first step of the convex step structure is adapted to the inner hole of the ultrasonic transducer 502, so that one end of the focusing lens 503 can just be inserted into the ultrasonic transducer 502 and assembled together into the lens inner sheath 504. The lens inner sheath 504 covers the surface of the ultrasonic transducer 502 and the focusing lens 503. Figure 6 , the figure shows the surface structure of the inner sheath of the lens, and the internal cross-sectional structure of the lens equipped with an ultrasonic transducer and a focusing lens. The ultrasonic transducer 502 is arranged along the strip hole 61 opened on the inner sheath 504 of the lens. The focusing lens 503 includes at least a first step 62 and a second step 63, wherein the first step 62 is adapted to the structure of the ultrasonic transducer 502.

[0078] The multi-clad optical fiber 505 is connected to the focusing lens 503 and is used to transmit multi-mode optical signals. The multi-clad optical fiber 505 includes a core and at least two cladding structures surrounding the core. The imaging optical signal and the therapeutic optical signal can be transmitted simultaneously through the multi-clad optical fiber 505, and the imaging optical signal and the therapeutic optical signal do not interfere with each other during the transmission process. In this embodiment, the multi-clad optical fiber 505 can adopt a double-clad optical fiber; wherein the double-clad optical fiber includes a core, an inner cladding and an outer cladding sheath. Its core diameter is 9μm, which is used to transmit a single-mode optical signal of 1310nm; of course, if a single-mode optical signal of 840nm needs to be transmitted, its core diameter can be adjusted accordingly. Its inner cladding diameter is 105μm, which is used to transmit multi-mode optical signals of different wavelengths such as 405nm, 488nm, 532nm, and 630nm.

[0079] More specifically, when the endoscopic probe 113 further includes a torque spring 506 and a metal sheath 507, the multi-clad optical fiber 505 can be connected to the focusing lens 503 through the torque spring 506. The torque spring 506 is a stainless steel coil spring with an outer diameter of 1.8 mm, which is bonded to the metal sheath 507 with a direction-finding hole, and is used to transmit torque from the optoelectronic connector, thereby avoiding loss of the internal multi-clad optical fiber 505 due to force.

[0080] In another embodiment, the above-mentioned endoscopic probe may further include a transparent outer sheath; when the transparent outer sheath is coated on one end of the endoscopic probe, the gap between the reflective prism and the ultrasonic transducer is pre-filled with a second liquid medium. The second liquid medium may be an oily liquid medium; the selection of the second liquid medium should take into account factors such as its attenuation of ultrasonic signals, acoustic impedance, and compatibility with the internal materials of the probe. It should be noted that in the embodiment of the present application, it is possible to choose whether to adapt a transparent protective cover to the endoscopic probe according to the actual application. If the transparent outer sheath is configured, the transparent outer sheath can be wrapped around the assembled ultrasonic transducer and the reflective prism surface to protect them. At the same time, an appropriate amount of the second liquid medium can be pre-filled into the transparent outer sheath, and at this time the second liquid medium will not leak out, but will fill the gap between the ultrasonic transducer and the reflective prism.

[0081] As an example, see Figure 7 and Figure 8 .in, Figure 7 This is a schematic diagram of the structure of an endoscopic probe without a transparent outer sheath. At this time, the ultrasonic transducer is connected to the reflective prism, and there is no liquid between the two. Figure 8 It is a schematic diagram of the structure of an endoscopic probe provided with a transparent outer sheath 81. For the endoscopic probe, the gap between the reflective prism 501 and the ultrasonic transducer 502 can be pre-filled with a second liquid medium 82 for transmitting acoustic signals.

[0082] Through the above embodiments, a variety of endoscopic probe design solutions with different structures are provided, so that the above esophageal endoscopic diagnosis and treatment system can be suitable for different application scenarios, effectively improving the flexibility of system application.

[0083] In some of these examples, see Figure 5 The above-mentioned multimodal optical endoscopy device also includes a photoelectric connector 508, a fiber optic coupler 509 and a wavelength division multiplexer 510.

[0084] The wavelength division multiplexer 510 is connected to the multi-mode endoscopic light source, the photodynamic therapy device and the optical fiber coupler 509 respectively. The wavelength division multiplexer 510 is used for coupling and separation between multi-mode signals of different wavelengths. Optionally, the wavelength division multiplexer 510 can be in the form of 1-to-4, or 1-to-2 and then 1-to-2. Figure 5 For example, at this time, the multi-modal endoscopic light source includes an OCT light source 511, a photoacoustic light source 512, a fluorescent light source 513, and a multimode fiber light source 514, and each modal light source corresponds to a first image processing module. Specifically, one end of the wavelength division multiplexer 510 is respectively connected to the light sources of each modality and the photodynamic therapy light source in the photodynamic therapy device, and the other end is connected to the fiber coupler, wherein the imaging light signals and the therapeutic light signals emitted by the OCT light source 511, the photoacoustic light source 512, the fluorescent light source 513, the multimode fiber light source 514, and the photodynamic therapy light source 515 are multiplexed and demultiplexed through the wavelength division multiplexer 510, and transmitted to the fiber coupler 509, so that each light source can share part of the optical path, simplifying the complexity of the system.

[0085] The optical fiber coupler 509 is used to couple the multi-mode signal and the single-mode signal transmitted in the multi-clad optical fiber 505 .

[0086] The photoelectric connector 508 is connected to the fiber coupler 509 and the multi-clad optical fiber 505, respectively, and is used to drive the endoscope probe 113 to perform rotation and / or translation movement. In this embodiment, the photoelectric connector 508 is not only responsible for transmitting optical signals and electrical signals, but also can support the mechanical movement of the endoscope probe 113, such as rotation and translation, under a specific design. Specifically, the photoelectric connector 508 can be connected to an external motor and driven by the external motor. In actual application, the photoelectric connector 508 drives the endoscope probe 113 to rotate or translate to a specified posture under the drive of the external motor, so that the endoscope probe 113 can work in the adjusted specified posture. Based on this, the endoscope probe 113 can perform spiral rotation and pullback operations inside the human esophagus, so that the imaging field of view of the endoscope probe 113 is large and can perform large-scale screening of the lesion area in the body, which is conducive to expanding the working space of the endoscope probe 113 and further improving the flexibility of the system.

[0087] In addition, the first image processing modules corresponding to the above-mentioned light sources are also connected to the first display 516 ; the first imaging image generated by the above-mentioned method can be displayed in real time on the first display 516 .

[0088] The following describes the invention in conjunction with specific embodiments. Fig. 9 is a structural block diagram of another esophageal endoscopic diagnosis and treatment system according to an embodiment of the present application, such as Fig. 9 As shown, the system includes: an electronic endoscopy device 21, a multimodal optical endoscopy device 11, a conformal optical platform construction device 12 and a photodynamic therapy device 13.

[0089] The electronic endoscope device 21 includes an electronic endoscope light source 211, an electronic endoscope body 213, a second image processing module 212, and a second display 91. The electronic endoscope body 213 is integrated with a large clamp channel 31 with an inner diameter ≥ 3.2 mm, which is used to carry a conformal optical platform system. At the same time, a notch filter is arranged in the front imaging channel of the electronic endoscope body 213 to filter out the 630nm wavelength laser emitted by the photodynamic therapy light source 515. The electronic endoscope device 21 is used to obtain the cross-scale optical information and photodynamic force efficiency relationship of the tumor, and realize the full-process visual monitoring function. Among them, the imaging data generated by the electronic endoscope device can be displayed in real time through the second display 91.

[0090] The conformal optical platform construction device 12 comprises a transparent support pipe 33, a catheter 121 adapted to the multimodal endoscopic probe 113, and an auxiliary liquid filling mechanism 32. The transparent support pipe 33 and the catheter 121 enter the target part of the esophagus 921 of the human body 92 through the large forceps integrated on the electronic endoscope body 213 to achieve the establishment of a conformal optical platform in the body; the conformal optical platform construction device 12 is mainly used to solve the environmental disturbance caused by irregular contraction and peristalsis of the esophagus and pulsation of other organs, and provide a stable environment for precise optical diagnosis and treatment.

[0091] The multimodal optical endoscopy device 11 includes a multimodal endoscopy light source 111, a first image processing module 112, a first display 516, and a multimodal endoscopy probe 113 that integrates OCT, photoacoustic, fluorescence, and multimode fiber super-resolution imaging modes. The endoscopy probe 113 enters the esophagus 921 of the human body 92 through the catheter 121 of the conformal optical platform construction device 12 to acquire and fuse in vivo multimodal super-resolution data. Among them, the multimodal endoscopy light source 111 includes: an OCT light source, which uses an 840nm / 1310nm near-infrared light source; a photoacoustic light source, which uses a 532nm laser light source; a fluorescence light source, which uses a 405nm wavelength light source, and a multimode fiber light source, which uses a 488nm laser light source.

[0092] The photodynamic therapy device 13 includes a photodynamic therapy light source 515 for emitting a therapeutic light signal, and the photodynamic therapy light source 515 is connected to the endoscope probe 113. The photodynamic therapy device 13 is used for targeted treatment of tumors, and uses a wavelength division multiplexer, and then couples into the core of the double-clad optical fiber inside the multimodal endoscope probe 113 through an optical fiber coupler. After accurate diagnosis is performed using the multimodal optical endoscope device 11, the switching between diagnosis and treatment can be completed by switching the diagnostic light source and the photodynamic light source, without pulling out the multimodal endoscope probe 113, and the electronic endoscope device 21 is used to monitor the treatment process in real time. Among them, the photodynamic therapy light source 515 uses a 630nm laser light source.

[0093] Through the above embodiments, a system for in vivo super-resolution and precise diagnosis and treatment of early esophageal cancer is provided, which includes an electronic endoscope device 21 integrated with a large channel, a conformal optical platform construction device 12, a multi-modal optical endoscope device 11, and a photodynamic therapy device 13; wherein the electronic endoscope device 21 is used to obtain the cross-scale optical information and photodynamic force efficiency relationship of the tumor to realize the full-process visual monitoring function; the conformal optical platform construction device 12 includes a transparent support pipe 33 and a catheter 121 adapted to the multi-modal endoscope probe 113, which is used to solve the environmental interference caused by the irregular contraction and peristalsis of the esophagus 921 and the pulsation of the organs, and provide a stable environment for optical diagnosis and treatment; the multi-modal optical endoscope device 11 integrates OCT, photoacoustic, fluorescence, and multi-mode optical fiber super-resolution imaging, which is used to obtain multi-level and multi-dimensional information such as tissue morphology, tissue stratification, tissue composition, and cell morphology of the lesion area, thereby realizing super-resolution and precise diagnosis of early cancer; the photodynamic therapy device 13 is used for targeted treatment of tumors. And the components are precisely assembled and the design is ingenious. Through this application, in vivo super-resolution precise diagnosis, treatment and monitoring of early esophageal cancer are effectively achieved.

[0094] This embodiment also provides an electronic device, including a memory and a processor, wherein the memory stores a computer program, and the processor is configured to run the computer program to perform the work of any of the above-mentioned esophageal endoscopic diagnosis and treatment systems.

[0095] Optionally, the electronic device may further include a transmission device and an input / output device, wherein the transmission device is connected to the processor, and the input / output device is connected to the processor.

[0096] It should be noted that the specific examples in this embodiment can refer to the examples described in the above embodiments and optional implementation modes, and this embodiment will not be described in detail here.

[0097] In addition, in combination with the esophageal endoscope diagnosis and treatment system in the above embodiments, the present application embodiment can provide a storage medium for implementation. The storage medium stores a computer program; when the computer program is executed by a processor, the operation of any one of the esophageal endoscope diagnosis and treatment systems in the above embodiments is implemented.

[0098] Those skilled in the art should understand that the technical features of the above-described embodiments may be arbitrarily combined. To make the description concise, not all possible combinations of the technical features in the above-described embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.

[0099] The above-mentioned embodiments only express several implementation methods of the present application, and the descriptions thereof are relatively specific and detailed, but they cannot be understood as limiting the scope of the invention patent. It should be pointed out that, for a person of ordinary skill in the art, several variations and improvements can be made without departing from the concept of the present application, and these all belong to the protection scope of the present application. Therefore, the protection scope of the patent of the present application shall be subject to the attached claims.

Claims

1. An esophageal endoscopic diagnosis and treatment system, characterized in that: The system comprises: A multimodal optical endoscopy device, comprising a multimodal endoscopy light source, a first image processing module and an endoscopy probe; the multimodal endoscopy light source is used to emit a multimodal optical signal, and the multimodal optical signal is transmitted through the endoscopy probe; A conformal optical platform construction device, comprising a catheter adapted to the endoscopic probe; wherein the endoscopic probe enters the human esophagus through the catheter; the first image processing module is used to receive optical imaging data of the human esophagus returned by the endoscopic probe based on the multimodal optical signal, and generate a first imaging image according to the optical imaging data; An electronic endoscope device comprises an electronic endoscope light source, a second image processing module and an electronic endoscope body equipped with the conformal optical platform building device; wherein the catheter enters the human esophagus through the electronic endoscope body; The electronic endoscope light source is used to emit a first light signal during the diagnosis process; the first light signal is transmitted through the electronic endoscope body; The second image processing module is used to receive the first imaging data of the human esophagus returned by the first optical signal, and generate a second imaging image according to the first imaging data; The multimodal endoscopic light source is further used to transmit the multimodal light signal to the human esophagus based on the second imaging image; The electronic endoscope light source is also used to emit a second light signal during the photodynamic therapy process; the second light signal is transmitted through the electronic endoscope body; The second image processing module is further used to receive second imaging data of the human esophagus returned by the second optical signal, and generate a third imaging image according to the second imaging data; A photodynamic therapy device is connected to the endoscopic probe and is used to transmit a therapeutic light signal to the endoscopic probe based on the third imaging image.

2. The esophageal endoscopic diagnosis and treatment system according to claim 1, characterized in that: The electronic endoscope body is integrated with a large clamp channel; the large clamp channel is a clamp channel with an inner diameter greater than a preset inner diameter threshold; Wherein, the conformal optical platform construction equipment is mounted on the large clamp channel, and the catheter passes through the large clamp channel.

3. The esophageal endoscopic diagnosis and treatment system according to claim 2, characterized in that: A notch filter is integrated at one end of the electronic endoscope body; The notch filter is used to filter out therapeutic light signals within a preset wavelength range.

4. The esophageal endoscopic diagnosis and treatment system according to claim 1, characterized in that: The conformal optical platform construction device is also provided with a transparent support pipe and a liquid filling mechanism; The transparent support pipe and the catheter are both hollow structures, and the catheter is mounted inside the transparent support pipe; The liquid filling mechanism is used to flow a first liquid medium into the transparent supporting tube and the catheter.

5. The esophageal endoscopic diagnosis and treatment system according to claim 4, characterized in that: The transparent support tube is provided with scale marks for first imaging image registration.

6. The esophageal endoscopic diagnosis and treatment system according to claim 1, characterized in that: The endoscope probe comprises a reflecting prism, an ultrasonic transducer, a focusing lens, an inner lens sheath and a multi-clad optical fiber; The ultrasonic transducer is annular; wherein the ultrasonic transducer is connected to the reflective prism and the focusing lens respectively; The focusing lens is in a convex step structure, and the outer diameter of the first step of the convex step structure is adapted to the inner hole of the ultrasonic transducer; The inner lens sheath covers the ultrasonic transducer and the focusing lens; wherein the ultrasonic transducer is arranged along the strip-shaped hole opened on the inner lens sheath; The multi-clad optical fiber is connected to the focusing lens and is used to transmit the multi-modal optical signal.

7. The esophageal endoscopic diagnosis and treatment system according to claim 6, characterized in that: The endoscope probe further comprises a transparent outer sheath; When the transparent outer sheath is wrapped around one end of the endoscopic probe, the gap between the reflecting prism and the ultrasonic transducer is pre-filled with a second liquid medium.

8. The esophageal endoscopic diagnosis and treatment system according to claim 6, characterized in that: The multimodal optical endoscopy device further comprises a wavelength division multiplexer, an optical fiber coupler and an optoelectronic connector; The wavelength division multiplexer is connected to the multi-modal endoscopic light source, the photodynamic therapy device and the optical fiber coupler respectively; The optical fiber coupler is used to couple the multi-mode signal and the single-mode signal transmitted in the multi-clad optical fiber; The photoelectric connector is respectively connected to the optical fiber coupler and the multi-clad optical fiber, and is used to drive the endoscopic probe to perform rotation and / or translation movement.

9. The esophageal endoscopic diagnosis and treatment system according to any one of claims 1 to 8, characterized in that: The multi-modal endoscopic light source includes an optical coherence tomography (OCT) light source, a photoacoustic light source, a fluorescent light source and / or a multi-mode optical fiber light source.

10. A storage medium, characterized in that: The storage medium stores a computer program, wherein the computer program is configured to execute the operation of the esophageal endoscopic diagnosis and treatment system according to any one of claims 1 to 9 when the computer program is run.

Images