A fluorescence microendoscopy system and method capable of adjusting the liquid inflow amount and concentration in real time

Abstract

The application provides a fluorescence microscopic endoscopy system and method capable of adjusting liquid inflow and concentration in real time, and belongs to the field of microscopic imaging. The system comprises an integrated image transmission fiber probe (integrated liquid inflow channel and image transmission fiber bundle), a double-channel electric infusion unit (stain pump and diluent pump), an optical path control module (switchable filter and wide spectrum light source), and an image feedback module. A high-sensitivity camera is used to collect fluorescence images, and a main control board dynamically adjusts the concentration (mixed stain and diluent ratio) and spraying amount of the stain based on image brightness / contrast features, thereby solving the problems of traditional split-type operation complexity, uncontrollable stain amount, and poor imaging quality. Advantages include: single insertion for spraying and imaging, shortening detection time; image feedback closed-loop control improves staining accuracy; and expandable multi-spectral imaging. The application is suitable for early cancer screening of the digestive tract and significantly improves lesion recognition rate.

Description

TECHNICAL FIELD

[0001] The present application relates to the field of microscopic imaging, in particular to a fluorescence microscopic endoscopy system and method capable of real-time adjustment of liquid volume and concentration. BACKGROUND

[0002] Gastrointestinal malignant tumors rank among the top in global tumor incidence. Improving the early detection rate of cancer is of great significance for improving patient prognosis and reducing medical expenses. Existing international research has confirmed that endoscopic technology is the most reliable diagnostic method for screening gastrointestinal tumors, and its early detection and timely intervention can significantly improve treatment outcomes.

[0003] In modern endoscopy, high-resolution microscopic imaging technology is increasingly popular. This advanced equipment can provide clear images of the microscopic structure of tissues in real time, partially replacing traditional pathological biopsy, helping doctors to assess the microscopic features of lesions during endoscopy, and thus more accurately formulate diagnosis and subsequent treatment plans.

[0004] High-resolution microscopic imaging equipment usually uses a thin flexible image transmission fiber bundle for image transmission. This fiber bundle is composed of densely arranged cores, with small diameter and good flexibility, facilitating its use in endoscopy. During examination, the doctor needs to first spray a dyeing agent on the surface of the tissue to be observed, and the dyeing agent is introduced into the body through a thin catheter via the endoscopic instrument channel. The catheter is connected to a syringe at one end, and the dyeing agent is uniformly sprayed on the target area by pushing the syringe. Subsequently, the doctor withdraws the catheter and inserts the image transmission fiber into the instrument channel, with the tip of the fiber closely adhering to the tissue surface, and high-resolution microscopic images can be obtained to assist accurate diagnosis.

[0005] The above detection process has the following problems: 1. The catheter is first inserted to spray the dyeing agent, then withdrawn, and then the image transmission fiber is inserted for imaging, which is a relatively cumbersome process; 2. The amount of dyeing agent sprayed is manually controlled by a syringe, and the amount of spraying is difficult to control, resulting in poor imaging effect with too little dose, and harm to the patient with too much dose; 3. The spraying position relies on the lesion image obtained by the conventional endoscope, which cannot guarantee that the spraying position is very accurate; 4. The concentration of the sprayed solution is also prepared in advance, and it is difficult to adjust the concentration of the sprayed solution in real time according to the lesion condition, resulting in over-bright or over-dark fluorescent microscopic images, which affects the identification of the lesion. SUMMARY

[0006] The present application proposes a fluorescence microscopic endoscopy system and method capable of real-time adjustment of liquid volume and concentration. By improving the structure of the image transmission fiber, it can simultaneously spray the dyeing agent and real-time imaging. The system adds an image feedback mechanism, which can adjust the concentration and dose of the sprayed dyeing agent in real time according to the characteristics of the collected images, accurately spray the dyeing agent on the surface of the tissue to be detected, and control the dose, thereby reducing the harm to the patient, shortening the detection period, and improving the quality of the microscopic images.

[0007] The technical solution of the present application is as follows

[0008] A fluorescence microendoscopy system capable of adjusting the liquid inflow and concentration in real time, comprising:

[0009] Integrated probe: image transmission fiber handle integrating liquid inflow channel and image transmission fiber bundle;

[0010] Double-channel infusion unit: dye pump and diluent pump, respectively connected to the dye input channel and the diluent input channel;

[0011] Image feedback module: high-sensitivity camera captures fluorescence images, and the main control board dynamically adjusts the dye concentration and flow rate based on image brightness / contrast;

[0012] Optical path control module: excitation light filter, dichroic mirror, emission light filter, and wide-spectrum light source.

[0013] In the above technical solution, the liquid inflow channel includes independent and parallel dye input channel and diluent input channel, which are fused into a single outlet channel at the front end of the probe.

[0014] In the above technical solution, the main control board performs the following operations:

[0015] Step 1: When the over-bright area with local pixel value > 200 accounts for > 30%, reduce the dye concentration and flow rate;

[0016] Step 2: If step 1 is not triggered, and the average brightness of the image is < the set threshold, increase the dye flow rate and concentration.

[0017] In the above technical solution, in the optical path control module, the excitation light filter and the emission light filter are switchable, suitable for multi-spectral fluorescence probes.

[0018] In the above technical solution, the flow rate range of the electric infusion device is 0.1-2 mL / min, and the single spraying duration is ≤5 seconds.

[0019] In the above technical solution, the image transmission fiber bundle is composed of ≥10,000 cores with a diameter ≤2 mm.

[0020] A fluorescence microendoscopy operation method based on the above system, comprising the following steps:

[0021] (1) Insert the integrated probe into the target tissue through the endoscope channel;

[0022] (2) Dynamically adjust the dye concentration and spraying amount through image feedback;

[0023] (3) Real-time acquisition and display of optimized fluorescence microimages.

[0024] In the above technical solution, the adjustment strategy in step (2) includes: initial spraying flow rate 0.5 mL / min, dyeing agent:diluent=1:1; according to the image brightness deviation value Adjust the mixing ratio: if , increase the dyeing agent ratio to ; if , reduce the dyeing agent ratio to .

[0025] A fluorescent dye concentration real-time regulation device, comprising:

[0026] An image analysis unit: extracting the brightness distribution characteristics of the fluorescent image;

[0027] A decision unit: generating flow control instructions for the dyeing agent pump and the diluent pump;

[0028] A mixed execution unit: outputting a mixed solution to the probe channel according to the instructions.

[0029] In the above technical solution, the decision unit adopts a PID algorithm to control the flow in a closed loop with a target brightness value of 120±20.

[0030] Advantages:

[0031] 1) The present application proposes a fluorescent microscopic endoscope system that can adjust the liquid inflow and concentration in real time. The dyeing agent injection catheter and the image transmission fiber are designed as an integrated type, which is more simple and convenient than the previous split type design, can shorten the detection time, and reduce the harm to the patient.

[0032] 2) The dose of dyeing agent spraying is controlled by an electric pump, which can reduce the harm to the patient.

[0033] 3) An image feedback mechanism is added. By preprocessing the collected image quality, the dyeing agent concentration and dose of spraying can be adjusted in real time according to the overall light and dark effect of the image, improving the quality of the collected image and the accuracy of diagnosis.

[0034] 4) By replacing different emission light filters and excitation light filters, as well as the corresponding dyeing agents, microscopic images under other fluorescent signals can be easily obtained, and the device has expandability. BRIEF DESCRIPTION OF DRAWINGS

[0035] Figure 1 It is a structure diagram of a fluorescent microscopic endoscope system that can adjust the liquid inflow and concentration in real time.

[0036] Figure 2 It is a structure diagram of the image transmission fiber handle.

[0037] Figure 3This is a cross-sectional view of the head end of the image transmission fiber.

[0038] Wherein: 1 is the light source, 2 is the focusing lens, 3 is the excitation light filter, 4 is the beam splitter, 5 is the objective lens, 6 is the fiber optic probe at the objective lens end, 7 is the image transmission fiber, 8 is the fiber optic probe at the detection end, 9 is the object to be detected, 10 is the emission light filter, 11 is the focusing lens, 12 is the high-sensitivity camera, 13 is the dye pump, 14 is the diluent pump, 15 is the main control board, 16 is the acquisition card, and 17 is the display.

[0039] 101 is the image transmission fiber handle, 102 is the dye input channel, 103 is the diluent input channel, 104 is the image transmission fiber, and 105 is the fusion channel.

[0040] 201 is the cross-section of the infusion channel at the head end of the image transmission fiber, 202 is the cross-section of the filling part at the head end of the image transmission fiber, and 203 is the cross-section of the image transmission fiber. Detailed Implementation

[0041] The present invention will now be described in detail with reference to the accompanying drawings and specific embodiments. However, the following embodiments are only for explaining the present invention, and the scope of protection of the present invention should include all the contents of the claims. Moreover, through the description of the following embodiments, those skilled in the art can fully implement all the contents of the claims of the present invention.

[0042] Example 1: A fluorescence endoscope system with real-time adjustable liquid volume and concentration

[0043] This embodiment describes the structure of a fluorescence endoscope system with adjustable liquid inflow and concentration in real time, such as... Figure 1 As shown, this system includes a light source 1, a focusing lens 2, an excitation light filter 3, a beam splitter 4, an objective lens 5, an objective lens end fiber optic probe 6, an image transmission fiber optic cable 7, a detection end fiber optic probe 8, an object to be detected 9, an emission light filter 10, a focusing lens 11, a high-sensitivity camera 12, a dye pump 13, a diluent pump 14, a main control board 15, a data acquisition card 16, and a display 17.

[0044] 1. Light source excitation module:

[0045] Light source 1 (xenon lamp or LED) emits light, which is collimated by focusing lens 2 and passes through switchable excitation light filter 3 (such as a 490nm bandpass filter) to select the target excitation band; the excitation light is reflected by beam splitter 4 (the beam splitter is coated with high reflectivity excitation light / high transmittance fluorescence) and focused by objective lens 5 to fiber optic probe 6 at the objective lens end.

[0046] 2. Probe conduction and staining agent control:

[0047] The objective lens fiber optic probe 6 is flexibly connected to the detection fiber optic probe 8 via the image transmission fiber 7, and the probe is in close contact with the surface of the object to be detected 9.

[0048] The dye pump 13 stores the fluorescent dye, and the diluent pump 14 stores the diluent (such as normal saline), which are respectively connected to the dye input channel and the diluent input channel in the probe through independent pipelines (see Figure 2 ), and the mixed solution is sprayed after fusion at the front end of the probe.

[0049] 3. Fluorescent signal collection:

[0050] The fluorescent signal generated by the stimulated tissue is transmitted to the detection end through the image transmission optical fiber 7 in reverse;

[0051] The fluorescent light passes through the light splitter 4 (transmits the fluorescent light band), and the stray light is filtered out through the emission light filter 10 (such as a 525 nm filter), and is converged to the high-sensitivity camera 12 (such as an sCMOS camera) through the focusing lens 11.

[0052] 4. Intelligent feedback control:

[0053] The high-sensitivity camera 12 transmits the image data to the acquisition card 16, and converts it into a digital signal input to the main control board 15;

[0054] The main control board 15 performs image analysis (such as calculating the average brightness), and generates control instructions:

[0055] If the brightness is insufficient, increase the flow of the dye pump 13 and reduce the proportion of the diluent pump 14;

[0056] If it is overexposed, reduce the dye concentration and total flow;

[0057] The adjustment instructions are transmitted to the dye pump 13 and the diluent pump 14 through electrical signals.

[0058] 5. Result display:

[0059] The optimized image is output to the display 17 after being processed by the main control board 15 for real-time diagnosis by the doctor.

[0060] As a further illustration of the above embodiment, the light source 1 is used to provide illumination for the device, which can be a xenon lamp light source or a wide-band LED light source.

[0061] As a further illustration of the above embodiment, the excitation light filter 3 can screen specific waveband light into the subsequent optical system.

[0062] As a further illustration of the above embodiment, the light splitter 4 can selectively reflect light of a specific waveband and transmit light of other wavebands.

[0063] As a further illustration of the above embodiment, the objective end optical fiber probe 6 has optical fibers and liquid inlet channels inside for light transmission and image transmission.

[0064] As a further illustration of the above embodiments, the images obtained by the high-sensitivity camera 12 are analyzed by the control system.

[0065] As shown in Figure 2 the image fiber handle structure includes an image fiber handle 101, a dye input channel 102, a diluent input channel 103, an image fiber 104, and a fusion channel 105;

[0066] Probe handle structure:

[0067] The image fiber handle 101 is a cylindrical shell (diameter ≤ 5 mm), with the following internal parallel arrangements:

[0068] The dye input channel 102 and the diluent input channel 103 (independent double channels, diameter 0.3-0.5 mm) are connected to the external dye pump 13 and the diluent pump 14, respectively;

[0069] The image fiber bundle 104 is centrally arranged and consists of ≥10,000 cores, covered with a protective layer;

[0070] The double input channels merge into the fusion channel 105 (diameter expanded to 0.8 mm) at a distance of 2-3 mm from the probe front end, achieving pre-mixing of the dye and the diluent.

[0071] As shown in Figure 3 the image fiber head end cross-sectional structure includes an image fiber head end infusion channel cross-section 201, an image fiber head end filling part cross-section 202, and an image fiber cross-section 203,

[0072] Head end cross-sectional structure:

[0073] The outer ring of the image fiber head end infusion channel cross-section (201) (diameter 0.3 mm) is connected to the fusion channel 105, used for uniformly spraying the mixed solution to the tissue surface;

[0074] The central region is the image fiber cross-section 203 (diameter 1.2 mm), with closely arranged cores for transmitting excitation light and fluorescence signals;

[0075] The image fiber head end filling part cross-section 202 (such as an epoxy resin curing layer) between the image fiber head end infusion channel cross-section 201 and the image fiber cross-section 203 achieves mechanical support and optical isolation.

[0076] The above structure can bring the following technical effects: 1. Cross-contamination prevention: the double channels are independent throughout the handle and only mix at the end of the fusion channel, avoiding premature reaction of the dye and the diluent. 2. Uniformity of spraying: the ring-distributed infusion holes make the mixed solution cover the tissue, eliminating the imaging blind area. 3. Mechanical stability: the epoxy resin filling layer solidifies the fiber and the infusion holes into a whole, bearing the shear stress when the endoscope is bent.

[0077] Example 2: A method for using a fluorescence endomicroscopy system capable of real-time adjustment of liquid flow rate and concentration based on the above system

[0078] 1. Device initialization and preparation

[0079] Insert the assembled integrated delivery fiber probe (integrated with delivery channel and delivery fiber) into the patient's body through the endoscope instrument channel, and navigate to the target lesion area.

[0080] Select the excitation light filter matched with the fluorescent probe (such as 490 nm band for FITC probe), and initialize the electric infusion device (stain pump and physiological saline pump) through the main control board.

[0081] 2. Pre-imaging and real-time feedback adjustment

[0082] Turn on the wide-spectrum LED light source, and the light passes through the focusing lens, excitation light filter, and beam splitter, and then is irradiated to the target tissue through the objective lens.

[0083] The high-sensitivity CMOS camera collects the initial fluorescence image, and the main control board evaluates the image quality through image analysis algorithm:

[0084] If the overall image is too dark (average pixel value < 50), increase the stain pump flow rate (such as from 0.5 mL / min to 1 mL / min) and reduce the physiological saline mixing ratio (from 1:1 to 2:1), and the general single spraying time is 2s.

[0085] If the local is too bright (the area with pixel value > 200 accounts for more than 30%), reduce the stain concentration (adjust the mixing ratio to 1:2) and reduce the total spraying amount.

[0086] As a further supplement to the above examples, the strategy of real-time feedback adjustment includes: initial spraying flow rate 0.5 mL / min, stain:diluent = 1:1; according to the image brightness deviation value Adjust the mixing ratio: if , increase the stain ratio to ; if , reduce the stain ratio to .

[0087] 3. Dynamic imaging and precise control

[0088] The main control board sends instructions to the electric pump, mixes the stain and physiological saline according to the optimized ratio, and sprays them uniformly to the lesion surface at a flow rate of 0.8 mL / min through the liquid delivery channel, and the general single spraying time is 2s.

[0089] The real-time collected fluorescence signal is filtered by the emission filter (e.g. 525 nm band-pass filter) to remove stray light, then converted into digital image by the camera and displayed on the monitor for the doctor to diagnose.

[0090] The system continuously monitors the image quality, and if it finds that the fluorescence is attenuated (e.g. the signal intensity is decreased by 20%), it automatically triggers a supplementary spray (the single spray time is generally 2 s).

[0091] 4. Multi-modal imaging extension

[0092] Replace the excitation filter and the matched emission filter, and the corresponding dye solution, repeat the above process to obtain multi-spectral fluorescence images of the same lesion.

[0093] The main control board automatically aligns the images of different spectral bands to generate a fusion image to enhance the contrast of the lesion features.

[0094] The above description is merely a specific implementation of the present application, which enables those skilled in the art to understand or implement the present application. Various modifications to these embodiments will be apparent to those skilled in the art, and the general principles defined herein can be implemented in other embodiments without departing from the spirit or scope of the present application. Therefore, the present application will not be limited to these embodiments shown herein, but will conform to the widest scope consistent with the principles and novel features disclosed herein.

Claims

1. A fluorescence endomicroscopy system capable of adjusting the amount and concentration of liquid in real time, characterized in that, The application relates to a fluorescence imaging system, comprising: an integrated probe, which is composed of an image transmission fiber handle and a fusion channel, the image transmission fiber handle is integrated with an image transmission fiber bundle, an independent dye input channel and a diluent input channel, and the fusion channel mixes the dye and the diluent and then outputs the mixture; a double-channel infusion unit, which comprises a dye pump and a diluent pump and is connected with the dye input channel and the diluent input channel respectively; an image feedback module, which comprises a high-sensitivity camera and a main control board, the high-sensitivity camera collects a fluorescence image, and the main control board dynamically generates a flow control instruction of the dye pump and the diluent pump based on image brightness distribution characteristics; an optical path control module, which comprises a wide-spectrum light source, switchable excitation light filters, a dichroic mirror and emission light filters, excitation light is sequentially reflected by the excitation light filters and the dichroic mirror and then irradiates tissues through the image transmission fiber bundle, and fluorescence signals are transmitted through the dichroic mirror and filtered by the emission light filters and then input into the high-sensitivity camera.

2. The system of claim 1, wherein: The main control board performs the following operations: Step 1: when the proportion of over-bright regions with local pixel values greater than 200 is greater than 30%, the dye concentration is reduced and the flow is reduced; Step 2: if step 1 is not triggered and the average brightness of the image is less than a set threshold, the dye flow and concentration are increased.

3. The system of claim 1, wherein: In the optical path control module, the excitation light filters and the emission light filters are switchable.

4. The system of claim 1, wherein: The flow rate of the dye pump and the diluent pump ranges from 0.1 mL / min to 2 mL / min, and the single spraying time is less than or equal to 5 seconds.

5. The system of claim 1, wherein: The image transmission fiber bundle is composed of more than or equal to 10,000 fiber cores and has a diameter of less than or equal to 2 mm.

Images