FLUORESCENCE ENDOSCOPYRIGHT:

The fluorescence endoscope system addresses the limitations of existing systems by seamlessly switching between white light and fluorescence modes, improving lesion detection and surgical safety through dual illumination and advanced image processing.

JP2024540754AActive Publication Date: 2024-11-01SCIVITA MEDICAL TECHNOLOGY CO LTD
View PDF 4 Cites 0 Cited by

Patent Information

Application Number
JP2024529445
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Priority Date
2022-01-27
Filing Date
2022-11-04
Publication Date
2024-11-01
Estimated Expiration
2042-11-04

AI Technical Summary

Technical Problem

Existing fluorescence endoscope systems lack the ability to efficiently switch between white light and fluorescence modes, limiting their effectiveness in visualizing and accurately identifying difficult-to-see or early-stage lesions during medical procedures.

Method used

A fluorescence endoscope system with a light source module capable of emitting both broad spectrum white visible light and narrowband IR excitation light, a camera module with an optical adapter and spectroscopic prism to process reflected beams, and an operating section with buttons to control the illumination mode, allowing seamless switching between white light and fluorescence modes.

Benefits of technology

Enables accurate visualization of lesions by providing both white light and fluorescence images, enhancing surgical safety and efficacy in lesion detection.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2024540754000001_ABST
    Figure 2024540754000001_ABST
Patent Text Reader

Abstract

The present invention relates to a fluorescence endoscope system, including a light source module, a camera module, a main control module, and a display module. The light source module is configured to emit an illumination beam, the camera module includes an endoscope configured to propagate the illumination beam and its reflected beam, and an operation unit configured to collect the reflected beam and convert the collected reflected beam into video data therefrom. The main control module includes a control unit configured to drive the light source module to emit a first illumination beam or a second illumination beam, and an image processing unit configured to process the video data frame by frame. The display module is configured to play the video data. The present invention can provide at least two operation modes including a white light mode and a fluorescence mode, and a first button of the operation unit can switch between the white light mode and the fluorescence mode, and has the advantage that the fluorescence imaging can provide a fluorescence image of tissue below the tissue surface, and can visualize and accurately identify lesions that are difficult to observe or early lesions, thereby improving the safety of surgery.
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to the technical field of fluorescence endoscopy, and more particularly to a fluorescence endoscopy system and a control method thereof. [Background technology]

[0002] An endoscope system based on the inherent spectral characteristics of human tissue is a novel medical device that can enter the body for diagnosis and treatment, and can identify benign and malignant lesions in the examined tissue with high sensitivity and specificity, and can identify abnormal tissue that cannot be seen by X-rays, which is advantageous for improving the diagnosis rate of early cancer. Since fluorescence imaging has the advantage of being able to visualize and accurately identify lesions that are difficult to observe or early-stage lesions, there is a strong demand for a fluorescence endoscope system and its control method to ensure the safety of surgery. Summary of the Invention

[0003] The technical problem that the present invention aims to solve is to overcome the problems existing in the existing technology and to provide a fluorescence endoscope system and a control method thereof.

[0004] In order to solve the above technical problems, the present invention provides a fluorescence endoscope system, comprising: a light source module including a first light guide beam configured to guide an illumination beam emitted by a light source module, the illumination beam comprising a first illumination beam and a second illumination beam corresponding to a white light mode and a fluorescence mode, respectively; a camera module including a connected endoscope and an operating unit, the endoscope configured to propagate the illumination beam guided by the first light guide beam and a reflected beam formed after the illumination beam maps an object, the operating unit configured to collect the reflected beam and convert the collected reflected beam therefrom into video data; and a camera module including a connected endoscope and an operating unit configured to drive the light source module to guide the first illumination beam or the second illumination beam. and a display module configured to play the video data after being processed by the image processing unit, wherein the operation unit includes a handheld body and a first button installed on the handheld body, and the operation unit is configured to generate a first control signal and send the first control signal to the image processing unit based on the triggered first button, and can drive the light source module to emit the first illumination beam or the second illumination beam and switch between the white light mode and the fluorescent mode based on the first control signal.

[0005] In one embodiment of the fluorescence endoscope system according to the present invention, the first illumination beam is configured as an illumination beam including only broad-spectrum white visible light having a wavelength of 400 nm to 730 nm, and the second illumination beam is configured to mix white visible light with an illumination beam of narrowband IR excitation light having a wavelength of 750 nm to 810 nm.

[0006] In one embodiment of the fluorescence endoscope system according to the present invention, the camera module includes an optical adapter, the endoscope is connected to the operation unit via the optical adapter, and the optical adapter is configured to focus the reflected beam.

[0007] In one embodiment of the fluorescence endoscope system, the endoscope includes an objective lens, a light-guiding structure, an eyepiece lens, a light source interface, and a second light guide beam arranged along the axial direction of the endoscope, the first light guide beam is connected to the second light guide beam via the light source interface, the second light guide beam guides the illumination beam to map to an object, and after the illumination beam encounters an object, it changes its propagation direction to form a reflected beam, and the reflected beam passes through the objective lens, the light-guiding structure, and the eyepiece lens and enters the optical adapter.

[0008] In one embodiment of the fluorescence endoscope system according to the present invention, the handheld body is molded with a front end face and a cavity, an optical filter is installed on the front end face, a spectroscopic prism and an image sensor are installed inside the cavity, the optical adapter focuses the reflected beam onto the optical filter, the optical filter is configured to cut the reflected beam with a wavelength of 750 nm or more and 810 nm or less, the spectroscopic prism is configured to decompose the reflected beam transmitted through the optical filter, and the image sensor is configured to collect the reflected beam decomposed by the spectroscopic prism and convert the collected reflected beam therefrom into video data.

[0009] In one embodiment of the fluorescence endoscope system according to the present invention, the operation unit is configured to preset a first mapping relationship between the first button and the first control signal, so that when the first button is triggered, the operation unit matches and generates the first control signal based on the first mapping relationship, the first mapping relationship including a first mapping relationship a and a first mapping relationship b corresponding to a white light mode and a fluorescence mode, respectively, and causes the image processing unit to execute a corresponding operation.

[0010] In one embodiment of the fluorescence endoscope system according to the present invention, the main control module includes a panel assembly and a second button installed on the panel assembly, and the panel assembly is configured to generate a second control signal based on the triggered second button and transmit the second control signal to the control unit, and based on the second control signal, drive the light source module to emit the first illumination beam or the second illumination beam and switch between the white light mode and the fluorescence mode.

[0011] In one embodiment of the fluorescence endoscope system according to the present invention, the panel assembly presets a combination arrangement rule by which the second button is triggered and a third mapping relationship between the combination arrangement rule and the second control signal, and when the second button is triggered according to the combination arrangement rule, matches and generates the second control signal according to the third mapping relationship, and drives the image processing unit to load a first GUI on top of the video data.

[0012] Thus, the present invention provides a control method for the fluorescence endoscope system, comprising: triggering the first button, driving the light source module to emit the first illumination beam or the second illumination beam, and switching between the white light mode and the fluorescence mode; and / or triggering the second button, driving the light source module to emit the first illumination beam or the second illumination beam, and switching between the white light mode and the fluorescence mode.

[0013] A control method according to an embodiment of the present invention includes the step of triggering the second button according to the combination arrangement rule to drive the image processing unit to load a first GUI on top of video data.

[0014] Compared with the prior art, the above technical solution of the present invention has the advantages that it can provide at least two operating modes including a white light mode and a fluorescence mode, and the mode can be switched between the white light mode and the fluorescence mode by a first button of the operation unit, and the fluorescence imaging can provide a fluorescence image of tissue below the tissue surface, so as to visualize and accurately identify lesions that are difficult to observe or early lesions, and improve the safety of surgery. [Brief description of the drawings]

[0015] In order to facilitate a clear understanding of the present invention, the present invention will be described in more detail below based on specific embodiments of the present invention with reference to the accompanying drawings. [Figure 1] FIG. 2 is a structural schematic diagram of the present invention. [Diagram 2] FIG. 2 is a structural schematic diagram of a camera module of the present invention; [Diagram 3] FIG. 2 is a structural schematic diagram of an operating unit of the present invention. [Figure 4] FIG. 2 is a structural schematic diagram of the panel assembly of the present invention. [Diagram 5] FIG. 2 is an exemplary structural schematic diagram of an embodiment of the present invention; DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0016] The present invention will now be further described with reference to the accompanying drawings and specific embodiments so that those skilled in the art can better understand and practice the present invention, but the illustrated embodiments are not intended to limit the present invention. EXAMPLES

[0017] As shown in FIG. 1 to FIG. 4, the first embodiment of the present invention provides a fluorescence endoscope system including a light source module 100, a camera module 200, a main control module 300, and a display module 400. The light source module 100 includes a first light guide beam (not shown). The first light guide beam is configured to guide an illumination beam emitted by the light source module 100. The illumination beam includes a first illumination beam and a second illumination beam corresponding to a white light mode and a fluorescence mode, respectively. The camera module 200 includes a connected endoscope 210 and an operation unit 220. The endoscope 210 is configured to propagate the illumination beam and a reflected beam formed after the illumination beam maps an object. The operation unit 220 is configured to collect the reflected beam and convert the collected reflected beam therefrom into video data. The main control module 300 includes a control unit 310 and an image processing unit 320. The control unit 310 is configured to drive the light source module 100 to emit the first illumination beam or the second illumination beam. The image processing unit 320 is configured to process the video data frame by frame. The display module 400 is configured to play the video data after being processed by the image processing unit 320.

[0018] The first illumination beam is configured as an illumination beam including only broad spectrum white visible light having a wavelength between 400 nm and 730 nm.

[0019] The second illumination beam is configured to mix white visible light with an illumination beam of narrowband IR excitation light having a wavelength between 750 nm and 810 nm, and can interact with fluorescent material contained in the object to form a reflected beam with a wavelength of 820 nm or more and 860 nm or less.

[0020] Preferably, the camera module 200 includes an optical adapter 230. The endoscope 210 is connected to the operation unit 220 via the optical adapter 230. The optical adapter 230 is configured to focus the reflected beam.

[0021] The optical adapter 230 is molded with a cavity 231. At least one pair of lenses 232 are installed inside the cavity 231. The optical adapter 230 is configured to rotate about its axis and reciprocate the lenses 232 within the cavity 231, thereby adjusting the focal length of the fluorescence endoscope system and ensuring the clarity of its image.

[0022] The endoscope 210 includes an objective lens 211, a light-guiding structure 212, an eyepiece lens 213, a light source interface 214, and a second light guide beam 215 disposed along the axial direction of the endoscope 210. The first light guide beam of the light source module 100 is connected to the second light guide beam 215 via the light source interface 214. The second light guide beam 215 guides the illumination beam to map to the object. After the illumination beam encounters the object, it changes its propagation direction to form a reflected beam, which passes through the objective lens 211, the light-guiding structure 212, and the eyepiece lens 213 and enters the optical adapter 230.

[0023] As shown in FIG. 2, the operation unit 220 includes a handheld body 221. The handheld body 221 is molded with a front end face and a cavity, and an optical filter 222 is installed on the front end face. A light splitting prism 223 and an image sensor 224 are installed inside the cavity. The optical adapter 230 focuses the reflected beam onto the optical filter 222. The optical filter 222 is configured to cut the reflected beam within a certain wavelength range. The light splitting prism 223 is configured to split the reflected beam transmitted through the optical filter 222. The image sensor 224 is configured to collect the reflected beam split by the light splitting prism 223 and convert the collected reflected beam therefrom into video data.

[0024] In the white light mode, the light source module 100 emits a first illumination beam through the first light guide beam. The first illumination beam forms a first reflected beam after mapping the object. The optical adapter 230 focuses the first reflected beam on the optical filter 222. The optical filter 222 cuts the first reflected beam in a specific wavelength range. The spectroscopic prism 223 decomposes the first reflected beam transmitted through the optical filter 222 into R / G / B band reflected beams. The wavelength of the R / G / B band reflected beam is 400 nm to 730 nm. Then, the image sensor 224 collects the R / G / B band reflected beams decomposed by the spectroscopic prism 223, and converts the collected R / G / B band reflected beams into R / G / B channel video data correspondingly. After that, the image processing unit 320 performs noise removal, correction, and gain processing on the R / G / B channel video data for each frame to generate white light image video data. Finally, the display module 400 reproduces the white light image video data generated by the image processing unit 320 .

[0025] In the fluorescence mode, the light source module 100 emits a second illumination beam through the first light guide beam. The second illumination beam forms a second reflected beam after mapping the object. The optical adapter 230 focuses the second reflected beam onto the optical filter 222. The optical filter 222 cuts the second reflected beam within a certain wavelength range. The light splitting prism 223 separates the second reflected beam transmitted through the optical filter 222 into an R / G / B band reflected beam and an IR band reflected beam. The wavelength of the R / G / B band reflected beam is 400nm to 730nm. The wavelength of the IR band reflected beam is 820nm to 860nm. Then, the image sensor 224 collects the R / G / B band reflected beam and the IR band reflected beam separated by the light splitting prism 223, and converts the collected R / G / B band reflected beam and the IR band reflected beam into R / G / B channel video data and IR channel video data. Then, the image processing unit 320 performs noise removal, correction, and gain processing on the R / G / B channel video data and the IR channel video data frame by frame to generate white light image video data and fluorescent image video data, and then overlays and mixes the white light image video data and the fluorescent image video data frame by frame to generate white light and fluorescent fusion image video data. Here, the image processing unit 320 needs to combine the white light image video data, the fluorescent image video data, and the white light and fluorescent fusion image video data frame by frame to generate multi-screen image video data including the above three kinds of images. Finally, the display module 400 plays the white light image video data, the fluorescent image video data, the white light and fluorescent fusion image video data, and the multi-screen image video data generated by the image processing unit 320.

[0026] Preferably, a portion of the narrowband IR excitation light of the second illumination beam can change its propagation direction to form a second reflected beam after mapping the object before interacting with the fluorescent material contained in the object. Therefore, in order to prevent such a second reflected beam from entering the optical adapter 230, the optical filter 222 is configured to cut the reflected beam having a wavelength of 750 nm or more and 810 nm or less, so as to enhance the fluorescence imaging effect.

[0027] 3, the operation unit 220 further includes a first button 225 disposed on the handheld body 221. The operation unit 220 is configured to generate a first control signal based on the triggered first button 225, and send the first control signal to the image processing unit 320. Based on the first control signal, the operation unit 220 can drive the light source module 100 to emit the first illumination beam or the second illumination beam, and switch between a white light mode and a fluorescent mode.

[0028] Preferably, the operation unit 220 is configured to preset a first mapping relationship between the first button 225 and the first control signal, and match and generate the first control signal based on the first mapping relationship when the first button 225 is triggered. The first mapping relationship includes a first mapping relationship a and a first mapping relationship b corresponding to a white light mode and a fluorescent mode, respectively, and causes the image processing unit 320 to perform a corresponding operation.

[0029] Preferably, to extend the first button 225, the operation unit 220 is configured to preset a first virtual key value table for the first button 225, and when the first button 225 is triggered, match and generate a first virtual key value based on the first virtual key value table, and further match and generate a first control signal by matching the first mapping relationship based on the first virtual key value.

[0030] Specifically, the first button 225 includes a first physical button 1, a first physical button 2, a first physical button 3, and a first physical button 4.

[0031] In the white light mode, the first virtual key value includes a first virtual key value a1 of the first physical button 1, a first virtual key value a2 of the first physical button 2, a first virtual key value a3 of the first physical button 3, and a first virtual key value a4 of the first physical button 4, and the first control signals include a first control signal a1, a first control signal a2, a first control signal a3, a first control signal a4, a first control signal a5, and a first control signal a6. After the first physical button 1, the first physical button 2, the first physical button 3, and the first physical button 4 are respectively triggered, firstly generate a first virtual key value a1, a first virtual key value a2, a first virtual key value a3, and a first virtual key value a4 accordingly based on the first virtual key value table, then match with the first mapping relationship a based on the first virtual key value a1, the first virtual key value a2, the first virtual key value a3, and the first virtual key value a4, generate a first control signal a1, the first control signal a2 or the first control signal a4, the first control signal a3 or the first control signal a5, and the first control signal a6, and send the first control signal a1, the first control signal a2 or the first control signal a4, the first control signal a3 or the first control signal a5, and the first control signal a6 to the image processing unit 320, so as to cause the image processing unit 320 to perform a corresponding operation.

[0032] Among them, after the first physical button 1 is triggered, the first control signal a1 generated accordingly is used to drive the image processing unit 320 to stepwise enlarge the white light image video data within a certain magnification range. After the first physical button 2 or the first physical button 3 is triggered an odd number of times, the first control signal a2 or the first control signal a3 generated accordingly is used to drive the image processing unit 320 to start retouching the white light image video data by a certain technical means. After the first physical button 2 or the first physical button 3 is triggered an even number of times, the first control signal a4 or the first control signal a5 generated accordingly is used to drive the image processing unit 320 to stop retouching the white light image video data. After the first physical button 4 is triggered, the first control signal a6 generated accordingly is transferred to the control unit 310 via the image processing unit 320 and used to switch the white light mode to the fluorescent mode.

[0033] In the white light mode, the image processing unit 320 is configured to stepwise enlarge the video data of the white light image by a magnification of 0.5 times within a magnification range of 1 times to 5 times. When the magnification is 5 times, the operation unit 220 again sends the first control signal a1 to drive the image processing unit 320 to reduce the video data of the white light image to a size of 1 times. The above-mentioned specific technical means are wide dynamics, shadow compensation, exposure compensation, vascular enhancement, or smoke removal. The first physical button 2 and the first physical button 3 correspondingly trigger different specific technical means.

[0034] In the fluorescent mode, the first virtual key value includes a first virtual key value b1 of the first physical button 1, a first virtual key value b2 of the first physical button 2, a first virtual key value b3 of the first physical button 3, and a first virtual key value b4 of the first physical button 4. The first control signal includes a first control signal b1, a first control signal b2, a first control signal b3, and a first control signal b4, and after the first physical button 1, the first physical button 2, the first physical button 3, and the first physical button 4 are triggered respectively, firstly generate the first virtual key value b1, the first virtual key value b2, the first virtual key value b3, and the first virtual key value b4 accordingly based on the first virtual key value table, and then generate the first virtual key value b1, the first virtual key value b2, the first virtual key value b3, and the first virtual key value b4 according to the first virtual key value table. Based on the virtual key value b1, the first virtual key value b2, the first virtual key value b3, and the first virtual key value b4, match with the first mapping relationship b, generate a first control signal b1, a first control signal b2, a first control signal b3, and a first control signal b4, and send the first control signal b1, the first control signal b2, the first control signal b3, and the first control signal b4 to the image processing unit 320, so as to cause the image processing unit 320 to perform corresponding operations.

[0035] Among them, after the first physical button 1 is triggered, the first control signal b1 generated accordingly is used to drive the image processing unit 320 to transmit the white light image video data, the fluorescent image video data, the white light and fluorescent fusion image video data, or the multi-screen image video data to the display module 400 in a sequential and cyclic manner. After the first physical button 2 or the first physical button 3 is triggered, the first control signal b2 or the first control signal b3 generated accordingly is transferred to the control unit 310 via the image processing unit 320, thereby used to drive the light source module 100 to adjust its own power supply current within a certain range and enhance or weaken the brightness of the narrowband IR excitation light in the second illumination beam. After the first physical button 4 is triggered, the first control signal b4 generated accordingly is transferred to the control unit 310 via the image processing unit 320, and used to switch the fluorescent mode to the white light mode.

[0036] In the fluorescent mode, the light source module 100 is configured to regulate its power supply current within the range of 0.5A to 18A.

[0037] 4, the main control module 300 includes a panel assembly 360 and a second button 361 disposed on the panel assembly 360. The panel assembly 360 is configured to generate a second control signal based on the triggered second button 361, and send the second control signal to the control unit 310. Based on the second control signal, the light source module 100 can be driven to emit a first illumination beam or a second illumination beam, and switch between a white light mode and a fluorescent mode.

[0038] Preferably, the panel assembly 360 is configured to preset a second mapping relationship between the second button 361 and the second control signal, and when the second button 361 is triggered, matches and generates the second control signal based on the second mapping relationship, and causes the image processing unit 320 to perform a corresponding operation.

[0039] Specifically, the second button 361 includes a second physical button 1, a second physical button 2, a second physical button 3, a second physical button 4, a second physical button 5, a second physical button 6, and a second physical button 7. The second control signals include a second control signal 1, a second control signal 2, a second control signal 3, a second control signal 4, a second control signal 5, a second control signal 6, a second control signal 7, a second control signal 8, a second control signal 9, a second control signal 10, a second control signal 11, and a second control signal 12. After the second physical button 1, the second physical button 2, the second physical button 3, the second physical button 4, the second physical button 5, the second physical button 6 and the second physical button 7 are respectively triggered, accordingly generate a second control signal 1 or the second control signal 2, the second control signal 3 or the second control signal 4, the second control signal 5 or the second control signal 6, the second control signal 7, the second control signal 8, the second control signal 9 or the second control signal 10, the second control signal 11 or the second control signal 12 based on the second mapping relationship, and send the second control signal 1 or the second control signal 2, the second control signal 3 or the second control signal 4, the second control signal 5 or the second control signal 6, the second control signal 7, the second control signal 8, the second control signal 9 or the second control signal 10, the second control signal 11 or the second control signal 12 to the control unit 310.

[0040] In order to debug the fluorescence endoscope system in the absence of an external device, the image processing unit 320 is configured to load a first GUI for setting parameters of the main control module 300. The first GUI is displayed on top of the video data played by the display module 400. In the white light mode or the fluorescence mode, after the second physical button 1 is triggered an odd number of times, the panel assembly 360 accordingly generates a second control signal 1 and sends the second control signal 1 to the control unit 310. The control unit 310 then transfers the second control signal 1 to the image processing unit 320, driving the image processing unit 320 to load the first GUI. After the second button 1 is triggered an even number of times, the panel assembly 360 accordingly generates a second control signal 2 and sends the second control signal 2 to the control unit 310. Furthermore, the control unit 310 transfers the second control signal 2 to the image processing unit 320 to drive the image processing unit 320 to remove the first GUI.

[0041] The image processing unit 320 is configured to load a second GUI for brightening or darkening the white light image video data, the fluorescent image video data, the white light and fluorescent fusion image video data, or the multi-screen image video data. The second GUI is displayed on top of the video data played by the display module 400. After the second physical button 2 is triggered an odd number of times in the white light mode or the fluorescent mode, the panel assembly 360 accordingly generates a second control signal 3 and sends the second control signal 3 to the control unit 310, which then forwards the second control signal 3 to the image processing unit 320, causing the image processing unit 320 to load the second GUI. After the second physical button 2 is triggered an even number of times, the panel assembly 360 accordingly generates a second control signal 4 and sends the second control signal 4 to the control unit 310, which further forwards the second control signal 4 to the image processing unit 320, causing the image processing unit 320 to remove the second GUI.

[0042] In the white light mode, when the second GUI is displayed on top of the video data played by the display module 400, each time the second physical button 4 or the second physical button 5 is triggered once, the panel assembly 360 accordingly generates one second control signal 7 or second control signal 8, and sends the second control signal 7 or second control signal 8 to the control unit 310, which forwards the second control signal 7 or second control signal 8 to the image processing unit 320 to drive the image processing unit 320 to brighten or darken the white light image video data.

[0043] In the fluorescent mode, when the second GUI is displayed on top of the video data played by the display module 400, each time the second physical button 4 or the second physical button 5 is triggered, the panel assembly 360 accordingly generates one second control signal 7 or second control signal 8, and sends the second control signal 7 or second control signal 8 to the control unit 310, which drives the image processing unit 320 to transfer the second control signal 7 or second control signal 8 to the image processing unit 320 to brighten or darken the white light image video data, the fluorescent image video data, the white light and fluorescent fusion image video data, or the multi-screen image video data.

[0044] The image processing unit 320 is configured to load a third GUI for stepwise scaling the white light image video data, the fluorescent image video data, the white light and fluorescent fusion image video data, or the multi-screen image video data within a certain magnification range, and the third GUI is superimposed and displayed on top of the video data played by the display module 400; in the white light mode or the fluorescent mode, after the second physical button 3 is triggered an odd number of times, the panel assembly 360 accordingly generates a second control signal 5, and sends the control unit 360 a second control signal 5 to the control unit 360. After the second physical button 3 is triggered an even number of times, the panel assembly 360 accordingly generates a second control signal 6, and sends the second control signal 6 to the control unit 310, and further forwards the second control signal 5 to the image processing unit 320 by the control unit 310, causing the image processing unit 320 to load the third GUI; after the second physical button 3 is triggered an even number of times, the panel assembly 360 accordingly generates a second control signal 6, and sends the second control signal 6 to the control unit 310, and further forwards the second control signal 6 to the image processing unit 320 by the control unit 310, causing the image processing unit 320 to remove the third GUI.

[0045] The third GUI is configured to scale the white light image video data, the fluorescent image video data, the fused white light and fluorescent image video data, or the multi-screen image video data by a factor of 0.5x within a range of a factor of 1x to 5x.

[0046] In the white light mode, when the third GUI is displayed on top of the video data played by the display module 400, each time the second physical button 4 or the second physical button 5 is triggered once, the panel assembly 360 accordingly generates one second control signal 7 or second control signal 8, and sends the second control signal 7 or second control signal 8 to the control unit 310, which forwards the second control signal 7 or second control signal 8 to the image processing unit 320 for driving the image processing unit 320 to shrink or enlarge the white light image video data.

[0047] In the fluorescence mode, when the third GUI is displayed on top of the video data played by the display module 400, each time the second physical button 4 or the second physical button 5 is triggered, the panel assembly 360 accordingly generates one second control signal 7 or second control signal 8, and sends the second control signal 7 or second control signal 8 to the control unit 310, which drives the image processing unit 320 to transfer the second control signal 7 or second control signal 8 to the image processing unit 320 to reduce or enlarge the white light image video data, the fluorescence image video data, the white light and fluorescence fusion image video data, or the multi-screen image video data.

[0048] In the white light mode, after the second physical button 6 is triggered an odd number of times, the panel assembly 360 accordingly generates a second control signal 9 and sends the second control signal 9 to the control unit 310, and further forwards the second control signal 9 to the image processing unit 320 by the control unit 310, to drive the image processing unit 320 to start retouching the white light image video data with a specific technical means; after the second button 6 is triggered an even number of times, the panel assembly 360 accordingly generates a second control signal 10 and sends the second control signal 10 to the control unit 310, and further forwards the second control signal 10 to the image processing unit 320 by the control unit 310, to drive the image processing unit 320 to stop retouching the white light image video data.

[0049] In the fluorescence mode, after the second physical button 6 is triggered an odd number of times, the panel assembly 360 accordingly generates a second control signal 9, and sends the second control signal 9 to the control unit 310, and further forwards the second control signal 9 to the image processing unit 320 by the control unit 310, to drive the image processing unit 320 to start retouching the white light image video data, the fluorescence image video data, the white light and fluorescence fusion image video data, or the multi-screen image video data by a certain technical means; after the second physical button 6 is triggered an even number of times, the panel assembly 360 accordingly generates a second control signal 10, and sends the second control signal 10 to the control unit 310, and further forwards the second control signal 10 to the image processing unit 320 by the control unit 310, to drive the image processing unit 320 to stop retouching the white light image video data, the fluorescence image video data, the white light and fluorescence fusion image video data, or the multi-screen image video data.

[0050] The above specific technical means are wide dynamics, shadow compensation, exposure compensation, vessel enhancement, or smoke removal, and the second physical button 6 correspondingly triggers different specific technical means.

[0051] In the white light mode, after the second physical button 7 is triggered, the panel assembly 360 accordingly generates a second control signal 11 and sends the second control signal 11 to the control unit 310, which drives the light source module 100 to emit a second illumination beam to switch to the fluorescent mode; in the fluorescent mode, after the second physical button 7 is triggered, the panel assembly 360 accordingly generates a second control signal 12 and sends the second control signal 12 to the control unit 310, which drives the light source module 100 to emit a first illumination beam to switch to the white light mode. Unlike the operation unit 220 which transfers the first control signal a6 or the first control signal b4 to the control unit 310 via the image processing unit 320, the panel assembly 360 directly transmits the second control signal 11 or the second control signal 12 to the control unit 310. Therefore, when the first physical button 4 and the second physical button 7 are triggered simultaneously, the second control signal 11 or the second control signal 12 reaches the control unit 310 before the first control signal a6 or the first control signal b4. This makes it possible to avoid signal collisions affecting the imaging of the fluorescence endoscope system, which is further advantageous in improving the safety of surgery.

[0052] Preferably, in order to prevent tampering with parameters of the main control module 300, the panel assembly 360 presets a combination arrangement rule for triggering the second button 361 and a third mapping relationship between the combination arrangement rule and the second control signal, and when the second button 361 is triggered according to the combination arrangement rule, matches and generates the second control signal based on the third mapping relationship, and drives the image processing unit 320 to load the first GUI on top of the video data.

[0053] Specifically, the second control signal includes the second control signal 13, in the white light mode or the fluorescent mode, the second physical button 2 and the second physical button 3 are simultaneously triggered once, and the second physical button 1 is further triggered once, and based on the preset combination arrangement rule and the third mapping relationship, the panel assembly 360 accordingly generates the second control signal 13, and sends the second control signal 13 to the control unit 310. The control unit 310 transfers the second control signal 13 to the image processing unit 320, and drives the image processing unit 320 to load the first GUI.

[0054] As an alternative embodiment, in the white light mode or the fluorescent mode, the second physical button 6 is triggered several times and the second physical button 1 is triggered one more time, and the panel assembly 360 accordingly generates a second control signal 13 and sends the second control signal 13 to the control unit 310. The control unit 310 forwards the second control signal 13 to the image processing unit 320, which drives the image processing unit 320 to load the first GUI.

[0055] 5, the main control module 300 further includes an image cache unit 330 and an external storage interface 340. The image cache unit 330 is configured to record the video data processed by the image processing unit 320. The image cache unit 330 is connected to a storage device outside the main control module 300 through the external storage interface 340.

[0056] The present invention can provide at least two operating modes including a white light mode and a fluorescence mode, and the first button 225 on the operation unit 220 can switch between the white light mode and the fluorescence mode, and the fluorescence imaging can provide a fluorescence image of the tissue below the tissue surface, visualize and accurately identify lesions that are difficult to observe or early lesions, and improve the safety of surgery. EXAMPLES

[0057] The present invention further provides a method for controlling a fluorescence endoscope system, including the steps of triggering a first button 225, driving the light source module 100 to emit a first illumination beam or a second illumination beam, and switching between a white light mode and a fluorescence mode, and / or triggering a second button 361, driving the light source module 100 to emit a first illumination beam or a second illumination beam, and switching between a white light mode and a fluorescence mode.

[0058] Preferably, the control method of the present invention further includes the step of triggering the second button 361 according to the combination arrangement rule to drive the image processing unit 320 to load the first GUI on top of the video data.

[0059] Preferably, the control method of the present invention further includes the step of rotating the optical adapter 230 and reciprocating the lens 232 within the cavity 231 to adjust the focal length of the fluorescence endoscope system and ensure the clarity of its image.

[0060] The specific contents above have been described in detail in the first embodiment, so a detailed description of the present invention will be omitted here.

[0061] Obviously, the above examples are merely examples for clear explanation, and are not intended to limit the embodiments. Those skilled in the art can make other changes or modifications based on the above description. It is not necessary or possible to cover all the embodiments in this specification. Any obvious changes or modifications derived therefrom still fall within the protection scope of the present invention. [Explanation of symbols]

[0062] 100 Light Source Module 200 Camera Module 210 Endoscope 211 Objective Lens 212 Light guiding structure 213 Eyepiece 214 Light Source Interface 215 Light Guide Beam 220 Operation section 221 Handheld unit 222 Optical Filter 223 Spectroscopic Prism 224 Image Sensor 225 First Button 230 Optical adapter 231 Cavity 232 Lens 300 Main Control Module 310 Control Unit 320 Image Processing Unit 330 Image Cache Unit 340 External Memory Interface 360 Panel Assembly 361 Second Button 400 Display Module

Claims

1. A fluorescence endoscope system, comprising: a light source module including a first light guide beam configured to guide an illumination beam emitted by the light source module, the illumination beam comprising a first illumination beam and a second illumination beam corresponding to a white light mode and a fluorescent mode, respectively; a camera module including a connected endoscope and a control unit, the endoscope configured to propagate an illumination beam guided by a first light guide beam and a reflected beam formed after the illumination beam maps an object, the control unit configured to collect the reflected beam and convert the collected reflected beam therefrom into video data; a main control module including a control unit configured to drive the light source module to emit the first illumination beam or the second illumination beam, and an image processing unit configured to process the video data frame by frame; a display module configured to play the video data after it has been processed by the image processing unit; Wherein, the operation unit includes a handheld body and a first button installed on the handheld body, the operation unit is configured to generate a first control signal according to the triggered first button, and send the first control signal to the image processing unit, and drive the light source module to emit the first illumination beam or the second illumination beam according to the first control signal, and can switch between the white light mode and the fluorescent mode. A fluorescence endoscope system comprising:

2. the first illumination beam is configured as an illumination beam including only broad spectrum white visible light having a wavelength between 400 nm and 730 nm; the second illumination beam is configured to mix white visible light with an illumination beam of narrowband IR excitation light having a wavelength between 750 nm and 810 nm; 2. The fluorescence endoscope system according to claim 1 .

3. The camera module includes an optical adapter, the endoscope is connected to the operation unit via the optical adapter, and the optical adapter is configured to focus the reflected beam.

2. The fluorescence endoscope system according to claim 1 .

4. The endoscope includes an objective lens, a light-guiding structure, an eyepiece lens, a light source interface, and a second light guide beam arranged along the axial direction of the endoscope, the first light guide beam is connected to the second light guide beam through the light source interface, the second light guide beam guides the illumination beam to map to an object, and after the illumination beam encounters the object, it changes its propagation direction to form a reflected beam, and the reflected beam passes through the objective lens, the light-guiding structure, and the eyepiece lens and enters the optical adapter; 4. The fluorescence endoscope system according to claim 3.

5. the handheld body is molded with a front end face and a cavity, an optical filter is disposed on the front end face, and a spectroscopic prism and an image sensor are disposed inside the cavity, the optical adapter focuses the reflected beam onto the optical filter, the optical filter is configured to cut the reflected beam having a wavelength of 750 nm or more and 810 nm or less, the spectroscopic prism is configured to decompose the reflected beam transmitted through the optical filter, and the image sensor is configured to collect the reflected beam decomposed by the spectroscopic prism and convert the collected reflected beam therefrom into video data.

4. The fluorescence endoscope system according to claim 3.

6. the operation unit is configured to preset a first mapping relationship between the first button and the first control signal, and then match and generate the first control signal based on the first mapping relationship when the first button is triggered, the first mapping relationship including a first mapping relationship a and a first mapping relationship b corresponding to a white light mode and a fluorescent light mode, respectively, and cause the image processing unit to perform a corresponding operation; 2. The fluorescence endoscope system according to claim 1 .

7. the main control module includes a panel assembly and a second button disposed on the panel assembly, the panel assembly being configured to generate a second control signal based on the triggered second button, and to transmit the second control signal to the control unit, and based on the second control signal, drive the light source module to emit the first illumination beam or the second illumination beam and switch between the white light mode and the fluorescent mode.

2. The fluorescence endoscope system according to claim 1 .

8. the panel assembly presets a combination arrangement rule by which the second button is triggered and a third mapping relationship between the combination arrangement rule and the second control signal, and when the second button is triggered according to the combination arrangement rule, matches and generates the second control signal according to the third mapping relationship, and drives the image processing unit to load a first GUI on top of video data; 8. The fluorescence endoscope system according to claim 7.

9. A method for controlling a fluorescence endoscope system according to claim 8, comprising the steps of: Triggering the first button to drive the light source module to emit the first illumination beam or the second illumination beam and switch between the white light mode and the fluorescent mode; and / or triggering the second button to drive the light source module to emit the first illumination beam or the second illumination beam and switch between the white light mode and the fluorescent mode. A control method comprising:

10. triggering the second button according to the combination arrangement rule to drive the image processing unit to load a first GUI on top of video data; 10. The control method according to claim 9.

Citation Information

Patent Citations

  • Endoscope imaging system

    JP2002102158A

  • Electronic endoscope system

    JP2012065898A

  • Endoscope device, and method for operating endoscope device

    JP2015226713A

  • Systems and methods for medical imaging using a rolling shutter imager

    WO2020150494A1