Fluorescence endoscope system and control method thereof

The fluorescence endoscope system addresses the challenge of mode transitions by integrating white light and fluorescence modes, enhancing lesion visibility and surgical safety through advanced imaging capabilities.

JP7808370B2Active Publication Date: 2026-01-29SCIVITA MEDICAL TECHNOLOGY CO LTD
View PDF 4 Cites 0 Cited by

Patent Information

Application Number
JP2024529445
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Priority Date
2022-01-27
Filing Date
2022-11-04
Publication Date
2026-01-29
Estimated Expiration
2042-11-04

AI Technical Summary

Technical Problem

Existing fluorescence endoscopy systems lack the ability to efficiently switch between white light and fluorescence modes, hindering the visualization and accurate identification of difficult-to-observe lesions, thereby compromising surgical safety.

Method used

A fluorescence endoscope system with a light source module emitting both broad-spectrum white visible light and narrow-band IR excitation light, a camera module with an optical adapter and image processing unit, and a control unit to switch between white light and fluorescence modes using buttons on the operation unit, allowing for seamless mode transitions and enhanced imaging capabilities.

Benefits of technology

Enables visualization and accurate identification of lesions through fluorescence imaging, improving surgical safety by providing clear and detailed images of tissue surfaces.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007808370000001
    Figure 0007808370000001
  • Figure 0007808370000002
    Figure 0007808370000002
  • Figure 0007808370000003
    Figure 0007808370000003
Patent Text Reader

Abstract

The present invention relates to a fluorescence endoscope system, including a light source module, a camera module, a main control module, and a display module. The light source module is configured to emit an illumination beam, the camera module includes an endoscope configured to propagate the illumination beam and its reflected beam, and an operation unit configured to collect the reflected beam and convert the collected reflected beam into video data therefrom. The main control module includes a control unit configured to drive the light source module to emit a first illumination beam or a second illumination beam, and an image processing unit configured to process the video data frame by frame. The display module is configured to play the video data. The present invention can provide at least two operation modes including a white light mode and a fluorescence mode, and a first button of the operation unit can switch between the white light mode and the fluorescence mode, and has the advantage that the fluorescence imaging can provide a fluorescence image of tissue below the tissue surface, and can visualize and accurately identify lesions that are difficult to observe or early lesions, thereby improving the safety of surgery.
Need to check novelty before this filing date? Find Prior Art

Description

[Technical Field]

[0001] The present invention relates to the technical field of fluorescence endoscopy, and more particularly to a fluorescence endoscopy system and a control method thereof. [Background technology]

[0002] Endoscopy systems based on the inherent spectral characteristics of human tissue are novel medical devices that can be inserted into the body for diagnosis and treatment. They can identify benign and malignant lesions in the tissue under examination with high sensitivity and specificity, and can identify abnormal tissue that is invisible to X-rays, which is beneficial for improving the rate of early cancer diagnosis. Because fluorescence imaging has the advantage of being able to visualize and accurately identify lesions that are difficult to observe or early-stage lesions, there is a strong demand for fluorescence endoscopy systems and their control methods to ensure the safety of surgery. Summary of the Invention

[0003] The technical problem that the present invention aims to solve is to overcome the problems that exist in the existing technology and to provide a fluorescence endoscope system and a control method thereof.

[0004] In order to solve the above technical problems, the present invention provides a fluorescence endoscope system, comprising: a light source module including a first light guide beam configured to guide an illumination beam emitted by a light source module, the illumination beam comprising a first illumination beam and a second illumination beam corresponding to a white light mode and a fluorescence mode, respectively; a camera module including an endoscope connected thereto and a control unit, the endoscope configured to propagate the illumination beam guided by the first light guide beam and a reflected beam formed after the illumination beam maps an object, the control unit configured to collect the reflected beam and convert the collected reflected beam therefrom into video data; and a camera module including a control unit configured to drive the light source module to guide the first illumination beam or the second illumination beam. and an image processing unit configured to process the video data frame by frame; and a display module configured to play the video data after being processed by the image processing unit, wherein the operation unit includes a handheld body and a first button located on the handheld body, and the operation unit is configured to generate a first control signal and send the first control signal to the image processing unit based on the triggered first button, and to drive the light source module to emit the first illumination beam or the second illumination beam and switch between the white light mode and the fluorescent mode based on the first control signal.

[0005] In a fluorescence endoscope system according to one embodiment of the present invention, the first illumination beam is configured as an illumination beam containing only broad-spectrum white visible light having a wavelength of 400 nm to 730 nm, and the second illumination beam is configured to mix white visible light with an illumination beam of narrow-band IR excitation light having a wavelength of 750 nm to 810 nm.

[0006] In a fluorescence endoscope system according to one embodiment of the present invention, the camera module includes an optical adapter, the endoscope is connected to the operation unit via the optical adapter, and the optical adapter is configured to focus the reflected beam.

[0007] In one embodiment of the fluorescence endoscope system, the endoscope includes an objective lens, a light-guiding structure, an eyepiece lens, a light source interface, and a second light guide beam arranged along the axial direction of the endoscope, the first light guide beam is connected to the second light guide beam via the light source interface, and the second light guide beam guides the illumination beam to map onto an object. After encountering the object, the illumination beam changes its propagation direction to form a reflected beam, which passes through the objective lens, the light-guiding structure, and the eyepiece lens and enters the optical adapter.

[0008] In one embodiment of the fluorescence endoscope system, the handheld body is molded with a front end face and a cavity, an optical filter is installed on the front end face, a spectroscopic prism and an image sensor are installed inside the cavity, the optical adapter focuses the reflected beam onto the optical filter, the optical filter is configured to cut the reflected beam with a wavelength of 750 nm or more and 810 nm or less, the spectroscopic prism is configured to decompose the reflected beam that has passed through the optical filter, and the image sensor is configured to collect the reflected beam decomposed by the spectroscopic prism and convert the collected reflected beam into video data.

[0009] In one embodiment of the fluorescence endoscope system, the operation unit is configured to preset a first mapping relationship between the first button and the first control signal, and thereby, when the first button is triggered, match and generate the first control signal based on the first mapping relationship, the first mapping relationship including a first mapping relationship a and a first mapping relationship b corresponding to a white light mode and a fluorescence mode, respectively, and cause the image processing unit to perform a corresponding operation.

[0010] In one embodiment of the fluorescence endoscope system, the main control module includes a panel assembly and a second button installed on the panel assembly, and the panel assembly is configured to generate a second control signal based on the triggering of the second button and send the second control signal to the control unit, and based on the second control signal, drive the light source module to emit the first illumination beam or the second illumination beam and switch between the white light mode and the fluorescence mode.

[0011] In one embodiment of the fluorescence endoscope system according to the present invention, the panel assembly presets a combination arrangement rule for triggering the second button and a third mapping relationship between the combination arrangement rule and the second control signal, and when the second button is triggered according to the combination arrangement rule, matches and generates the second control signal according to the third mapping relationship, and drives the image processing unit to load a first GUI on top of the video data.

[0012] Thus, the present invention provides a control method for the above-mentioned fluorescence endoscope system, including the steps of triggering the first button, driving the light source module to emit the first illumination beam or the second illumination beam, and switching between the white light mode and the fluorescence mode, and / or triggering the second button, driving the light source module to emit the first illumination beam or the second illumination beam, and switching between the white light mode and the fluorescence mode.

[0013] A control method according to an embodiment of the present invention includes the step of triggering the second button according to the combination arrangement rule to drive the image processing unit to load a first GUI on top of video data.

[0014] Compared with the prior art, the above technical solution of the present invention has the advantages of providing at least two operating modes including a white light mode and a fluorescence mode, allowing the mode to be switched between the white light mode and the fluorescence mode by a first button on the operating unit, providing a fluorescence image of tissue below the tissue surface through fluorescence imaging, visualizing and accurately identifying lesions that are difficult to observe or early lesions, and improving surgical safety. [Brief explanation of the drawings]

[0015] In order to make the contents of the present invention clear and easy to understand, the present invention will be described in more detail below based on specific embodiments of the present invention with reference to the accompanying drawings. [Figure 1] 1 is a structural schematic diagram of the present invention; [Figure 2] 1 is a structural schematic diagram of a camera module of the present invention; [Figure 3] 2 is a structural schematic diagram of the operating unit of the present invention; FIG. [Figure 4] 1 is a structural schematic diagram of a panel assembly of the present invention; [Figure 5] 1 is an exemplary structural schematic diagram of an embodiment of the present invention; DETAILED DESCRIPTION OF THE INVENTION

[0016] The present invention will now be further described with reference to the accompanying drawings and specific examples so that those skilled in the art can better understand and practice the present invention, but the illustrated examples are not intended to limit the present invention. [Example]

[0017] As shown in FIGS. 1 to 4 , a first embodiment of the present invention provides a fluorescence endoscope system including a light source module 100, a camera module 200, a main control module 300, and a display module 400. The light source module 100 includes a first light guide beam (not shown). The first light guide beam is configured to guide an illumination beam emitted by the light source module 100. The illumination beam includes a first illumination beam and a second illumination beam corresponding to a white light mode and a fluorescence mode, respectively. The camera module 200 includes a connected endoscope 210 and an operation unit 220. The endoscope 210 is configured to propagate the illumination beam and a reflected beam formed after the illumination beam maps an object. The operation unit 220 is configured to collect the reflected beam and convert the collected reflected beam into video data. The main control module 300 includes a control unit 310 and an image processing unit 320. The control unit 310 is configured to drive the light source module 100 to emit the first illumination beam or the second illumination beam. The image processing unit 320 is configured to process the video data frame by frame. The display module 400 is configured to play the video data after being processed by the image processing unit 320.

[0018] The first illumination beam is configured as an illumination beam that includes only broad-spectrum white visible light having a wavelength between 400 nm and 730 nm.

[0019] The second illumination beam is configured to mix white visible light with an illumination beam of narrowband IR excitation light having a wavelength of 750 nm to 810 nm, and can interact with fluorescent materials contained in the object to form a reflected beam with a wavelength of 820 nm or more and 860 nm or less.

[0020] Preferably, the camera module 200 includes an optical adapter 230. The endoscope 210 is connected to the operation unit 220 via the optical adapter 230. The optical adapter 230 is configured to focus the reflected beam.

[0021] The optical adapter 230 has a cavity 231 molded therein. At least one pair of lenses 232 is installed inside the cavity 231. The optical adapter 230 is configured to rotate around its own axis and move the lenses 232 back and forth within the cavity 231, thereby adjusting the focal length of the fluorescence endoscope system and ensuring the clarity of its image.

[0022] The endoscope 210 includes an objective lens 211, a light-guiding structure 212, an eyepiece lens 213, a light source interface 214, and a second light-guiding beam 215 disposed along the axial direction of the endoscope 210. The first light-guiding beam of the light source module 100 is connected to the second light-guiding beam 215 via the light source interface 214. The second light-guiding beam 215 guides the illumination beam to map onto an object. After encountering the object, the illumination beam changes its propagation direction to form a reflected beam, which passes through the objective lens 211, the light-guiding structure 212, and the eyepiece lens 213 and enters the optical adapter 230.

[0023] As shown in FIG. 2 , the operation unit 220 includes a handheld body 221. The handheld body 221 is molded with a front end face and a cavity, and an optical filter 222 is installed on the front end face. A light-splitting prism 223 and an image sensor 224 are installed inside the cavity. An optical adapter 230 focuses the reflected beam onto the optical filter 222. The optical filter 222 is configured to cut the reflected beam within a specific wavelength range. The light-splitting prism 223 is configured to decompose the reflected beam that has passed through the optical filter 222. The image sensor 224 is configured to collect the reflected beam decomposed by the light-splitting prism 223 and convert the collected reflected beam into video data.

[0024] In the white light mode, the light source module 100 emits a first illumination beam through a first light guide beam. The first illumination beam forms a first reflected beam after mapping an object. The optical adapter 230 focuses the first reflected beam onto the optical filter 222. The optical filter 222 cuts off the first reflected beam within a specific wavelength range. The spectroscopic prism 223 splits the first reflected beam into R, G, and B band reflected beams. The wavelengths of the R, G, and B band reflected beams are between 400 nm and 730 nm. The image sensor 224 then collects the R, G, and B band reflected beams split by the spectroscopic prism 223 and converts the collected R, G, and B band reflected beams into corresponding R, G, and B channel video data. The image processing unit 320 then performs noise reduction, correction, and gain processing on the R, G, and B channel video data for each frame to generate white light image video data. Finally, the display module 400 reproduces the white light image video data generated by the image processing unit 320 .

[0025] In the fluorescence mode, the light source module 100 emits a second illumination beam through the first light guide beam. After mapping the object, the second illumination beam forms a second reflected beam. The optical adapter 230 focuses the second reflected beam onto the optical filter 222. The optical filter 222 filters out the second reflected beam within a specific wavelength range. The light splitting prism 223 splits the second reflected beam into R / G / B band reflected beams and IR band reflected beams. The R / G / B band reflected beams have wavelengths ranging from 400 nm to 730 nm. The IR band reflected beam has a wavelength ranging from 820 nm to 860 nm. The image sensor 224 collects the R / G / B band reflected beams and the IR band reflected beams split by the light splitting prism 223 and converts the collected R / G / B band reflected beams and IR band reflected beams into corresponding R / G / B channel video data and IR channel video data. The image processing unit 320 then performs noise reduction, correction, and gain processing on the R / G / B channel video data and the IR channel video data for each frame to generate white-light image video data and fluorescent image video data, and then overlays and mixes the white-light image video data and the fluorescent image video data for each frame to generate fusion image video data of white light and fluorescent light. Here, the image processing unit 320 needs to combine the white-light image video data, fluorescent image video data, and fusion image video data of white light and fluorescent light for each frame to generate multi-frame image video data containing the above three types of images. Finally, the display module 400 plays the white-light image video data, fluorescent image video data, fusion image video data of white light and fluorescent light, and multi-frame image video data generated by the image processing unit 320.

[0026] Preferably, a portion of the narrowband IR excitation light in the second illumination beam can change its propagation direction to form a second reflected beam after mapping the object before interacting with the fluorescent material contained in the object. Therefore, to prevent such a second reflected beam from entering the optical adapter 230, the optical filter 222 is configured to cut reflected beams having wavelengths greater than or equal to 750 nm and less than or equal to 810 nm, thereby enhancing the fluorescence imaging effect.

[0027] 3, the operation unit 220 further includes a first button 225 disposed on the handheld body 221. The operation unit 220 is configured to generate a first control signal based on the triggered first button 225, and send the first control signal to the image processing unit 320. Based on the first control signal, the operation unit 220 can drive the light source module 100 to emit the first illumination beam or the second illumination beam, and switch between a white light mode and a fluorescent mode.

[0028] Preferably, the operation unit 220 is configured to preset a first mapping relationship between the first button 225 and the first control signal, and to match and generate the first control signal based on the first mapping relationship when the first button 225 is triggered. The first mapping relationship includes a first mapping relationship a and a first mapping relationship b corresponding to the white light mode and the fluorescence mode, respectively, and causes the image processing unit 320 to perform corresponding operations.

[0029] Preferably, to extend the first button 225, the operation unit 220 is configured to preset a first virtual key value table for the first button 225, and when the first button 225 is triggered, match and generate a first virtual key value based on the first virtual key value table, and further match and generate a first control signal based on the first virtual key value by checking against a first mapping relationship.

[0030] Specifically, the first buttons 225 include a first physical button 1, a first physical button 2, a first physical button 3, and a first physical button 4.

[0031] In the white light mode, the first virtual key values ​​include a first virtual key value a1 of the first physical button 1, a first virtual key value a2 of the first physical button 2, a first virtual key value a3 of the first physical button 3, and a first virtual key value a4 of the first physical button 4, and the first control signals include a first control signal a1, a first control signal a2, a first control signal a3, a first control signal a4, a first control signal a5, and a first control signal a6. After the first physical button 1, the first physical button 2, the first physical button 3, and the first physical button 4 are triggered respectively, firstly generate a first virtual key value a1, a first virtual key value a2, a first virtual key value a3, and a first virtual key value a4 accordingly based on the first virtual key value table, then match the first mapping relationship a based on the first virtual key value a1, a first virtual key value a2, a first virtual key value a3, and a first virtual key value a4, generate a first control signal a1, a first control signal a2 or a first control signal a4, a first control signal a3 or a first control signal a5, and a6, and send the first control signal a1, a first control signal a2 or a first control signal a4, a first control signal a3 or a first control signal a5, and a6 to the image processing unit 320, so as to cause the image processing unit 320 to perform corresponding operations.

[0032] After the first physical button 1 is triggered, the correspondingly generated first control signal a1 is used to drive the image processing unit 320 to gradually enlarge the white light image video data within a certain magnification range. After the first physical button 2 or the first physical button 3 is triggered an odd number of times, the correspondingly generated first control signal a2 or a3 is used to drive the image processing unit 320 to start retouching the white light image video data by a certain technical means. After the first physical button 2 or the first physical button 3 is triggered an even number of times, the correspondingly generated first control signal a4 or a5 is used to drive the image processing unit 320 to stop retouching the white light image video data. After the first physical button 4 is triggered, the correspondingly generated first control signal a6 is transmitted to the control unit 310 via the image processing unit 320 and used to switch from the white light mode to the fluorescent mode.

[0033] In the white light mode, the image processing unit 320 is configured to magnify the white light image video data in increments of 0.5x within a magnification range of 1x to 5x. When the magnification is 5x, the operation unit 220 again sends the first control signal a1 to drive the image processing unit 320 to reduce the white light image video data to 1x. The specific technical means include wide dynamics, shadow compensation, exposure compensation, vein enhancement, and smoke removal. The first physical button 2 and the first physical button 3 trigger different specific technical means correspondingly.

[0034] In the fluorescent mode, the first virtual key value includes a first virtual key value b1 of the first physical button 1, a first virtual key value b2 of the first physical button 2, a first virtual key value b3 of the first physical button 3, and a first virtual key value b4 of the first physical button 4. The first control signal includes a first control signal b1, a first control signal b2, a first control signal b3, and a first control signal b4, and after the first physical button 1, the first physical button 2, the first physical button 3, and the first physical button 4 are triggered respectively, firstly generate the first virtual key value b1, the first virtual key value b2, the first virtual key value b3, and the first virtual key value b4 accordingly based on the first virtual key value table; Based on the virtual key value b1, the first virtual key value b2, the first virtual key value b3, and the first virtual key value b4, match with the first mapping relationship b, generate the first control signal b1, the first control signal b2, the first control signal b3, and the first control signal b4, and send the first control signal b1, the first control signal b2, the first control signal b3, and the first control signal b4 to the image processing unit 320, so as to cause the image processing unit 320 to perform corresponding operations.

[0035] The first control signal b1 generated when the first physical button 1 is triggered drives the image processing unit 320 to sequentially and cyclically transmit white light image video data, fluorescence image video data, white light and fluorescence fusion image video data, or multi-screen image video data to the display module 400. The first control signal b2 or b3 generated when the first physical button 2 or 3 is triggered is transmitted to the control unit 310 via the image processing unit 320 to drive the light source module 100 to adjust its power supply current within a certain range and increase or decrease the brightness of the narrowband IR excitation light in the second illumination beam. The first control signal b4 generated when the first physical button 4 is triggered is transmitted to the control unit 310 via the image processing unit 320 to switch from the fluorescence mode to the white light mode.

[0036] In the fluorescent mode, the light source module 100 is configured to adjust its power supply current within the range of 0.5A to 18A.

[0037] 4 , the main control module 300 includes a panel assembly 360 and a second button 361 disposed on the panel assembly 360. The panel assembly 360 is configured to generate a second control signal based on the triggered second button 361, and send the second control signal to the control unit 310. Based on the second control signal, the light source module 100 can be driven to emit the first illumination beam or the second illumination beam, and can switch between a white light mode and a fluorescent mode.

[0038] Preferably, the panel assembly 360 is configured to preset a second mapping relationship between the second button 361 and the second control signal, and when the second button 361 is triggered, it matches and generates the second control signal based on the second mapping relationship, and causes the image processing unit 320 to perform a corresponding operation.

[0039] Specifically, the second buttons 361 include a second physical button 1, a second physical button 2, a second physical button 3, a second physical button 4, a second physical button 5, a second physical button 6, and a second physical button 7. The second control signals include a second control signal 1, a second control signal 2, a second control signal 3, a second control signal 4, a second control signal 5, a second control signal 6, a second control signal 7, a second control signal 8, a second control signal 9, a second control signal 10, a second control signal 11, and a second control signal 12. After second physical button 1, second physical button 2, second physical button 3, second physical button 4, second physical button 5, second physical button 6 and second physical button 7 are respectively triggered, the control unit 310 accordingly generates a second control signal 1 or a second control signal 2, a second control signal 3 or a second control signal 4, a second control signal 5 or a second control signal 6, a second control signal 7, a second control signal 8, a second control signal 9 or a second control signal 10, a second control signal 11 or a second control signal 12 based on the second mapping relationship, and sends the second control signal 1 or a second control signal 2, a second control signal 3 or a second control signal 4, a second control signal 5 or a second control signal 6, a second control signal 7, a second control signal 8, a second control signal 9 or a second control signal 10, a second control signal 11 or a second control signal 12 to the control unit 310.

[0040] To debug the fluorescence endoscope system in the absence of an external device, the image processing unit 320 is configured to load a first GUI for setting parameters of the main control module 300. The first GUI is displayed overlaid on top of the video data played by the display module 400. In the white light mode or the fluorescence mode, after the second physical button 1 is triggered an odd number of times, the panel assembly 360 accordingly generates a second control signal 1 and sends the second control signal 1 to the control unit 310. The control unit 310 then forwards the second control signal 1 to the image processing unit 320, driving the image processing unit 320 to load the first GUI. After the second button 1 is triggered an even number of times, the panel assembly 360 accordingly generates a second control signal 2 and sends the second control signal 2 to the control unit 310. Furthermore, the control unit 310 transfers the second control signal 2 to the image processing unit 320 to drive the image processing unit 320 to remove the first GUI.

[0041] The image processing unit 320 is configured to load a second GUI for brightening or darkening the white-light image video data, the fluorescent image video data, the white-light and fluorescent fusion image video data, or the multi-screen image video data. The second GUI is displayed overlaid on top of the video data played by the display module 400. In the white-light mode or the fluorescent mode, after the second physical button 2 is triggered an odd number of times, the panel assembly 360 accordingly generates a second control signal 3 and sends the second control signal 3 to the control unit 310, which then forwards the second control signal 3 to the image processing unit 320, causing the image processing unit 320 to load the second GUI. After the second physical button 2 is triggered an even number of times, the panel assembly 360 accordingly generates a second control signal 4 and sends the second control signal 4 to the control unit 310, which then forwards the second control signal 4 to the image processing unit 320, causing the image processing unit 320 to remove the second GUI.

[0042] In the white light mode, when the second GUI is displayed on top of the video data played by the display module 400, each time the second physical button 4 or the second physical button 5 is triggered, the panel assembly 360 accordingly generates one second control signal 7 or 8, and sends the second control signal 7 or 8 to the control unit 310, which then forwards the second control signal 7 or 8 to the image processing unit 320 to drive the image processing unit 320 to brighten or darken the white light image video data.

[0043] In the fluorescent mode, when the second GUI is displayed on top of the video data played by the display module 400, each time the second physical button 4 or the second physical button 5 is triggered, the panel assembly 360 accordingly generates one second control signal 7 or 8 and sends the second control signal 7 or 8 to the control unit 310, which then drives the image processing unit 320 to transfer the second control signal 7 or 8 to the image processing unit 320 to brighten or darken the white light image video data, the fluorescent image video data, the white light and fluorescent fusion image video data, or the multi-screen image video data.

[0044] The image processing unit 320 is configured to load a third GUI for gradually scaling the white light image video data, the fluorescent image video data, the white light and fluorescent fusion image video data, or the multi-screen image video data within a specific magnification range, and the third GUI is displayed on top of the video data played by the display module 400. After the second physical button 3 is triggered an odd number of times in the white light mode or the fluorescent mode, the panel assembly 360 accordingly generates a second control signal 5, and the control unit After the second physical button 3 is triggered an even number of times, the panel assembly 360 accordingly generates a second control signal 6, and sends the second control signal 6 to the control unit 310, and further forwards the second control signal 6 to the image processing unit 320 by the control unit 310, causing the image processing unit 320 to remove the third GUI.

[0045] The third GUI is configured to scale the white light image video data, the fluorescence image video data, the fused white light and fluorescence image video data, or the multi-screen image video data by a factor of 0.5x within a range of a factor of 1x to 5x.

[0046] In the white light mode, when the third GUI is displayed on top of the video data played by the display module 400, each time the second physical button 4 or the second physical button 5 is triggered, the panel assembly 360 generates one second control signal 7 or 8 accordingly, and sends the second control signal 7 or 8 to the control unit 310, which then transfers the second control signal 7 or 8 to the image processing unit 320 to drive the image processing unit 320 to reduce or enlarge the white light image video data.

[0047] In the fluorescence mode, when the third GUI is displayed on top of the video data played by the display module 400, each time the second physical button 4 or the second physical button 5 is triggered, the panel assembly 360 accordingly generates one second control signal 7 or 8, and sends the second control signal 7 or 8 to the control unit 310, which drives the image processing unit 320 to transfer the second control signal 7 or 8 to the image processing unit 320 to reduce or enlarge the white light image video data, the fluorescence image video data, the white light and fluorescence fusion image video data, or the multi-screen image video data.

[0048] In the white light mode, after the second physical button 6 is triggered an odd number of times, the panel assembly 360 accordingly generates a second control signal 9 and sends the second control signal 9 to the control unit 310, which then forwards the second control signal 9 to the image processing unit 320 to drive the image processing unit 320 to start retouching the white light image video data by specific technical means; after the second button 6 is triggered an even number of times, the panel assembly 360 accordingly generates a second control signal 10 and sends the second control signal 10 to the control unit 310, which then forwards the second control signal 10 to the image processing unit 320 to drive the image processing unit 320 to stop retouching the white light image video data.

[0049] In the fluorescence mode, after the second physical button 6 is triggered an odd number of times, the panel assembly 360 accordingly generates a second control signal 9 and sends it to the control unit 310, which then forwards it to the image processing unit 320 to drive the image processing unit 320 to start retouching the white light image video data, the fluorescence image video data, the white light and fluorescence fusion image video data, or the multi-screen image video data by certain technical means; after the second physical button 6 is triggered an even number of times, the panel assembly 360 accordingly generates a second control signal 10 and sends it to the control unit 310, which then forwards it to the image processing unit 320 to drive the image processing unit 320 to stop retouching the white light image video data, the fluorescence image video data, the white light and fluorescence fusion image video data, or the multi-screen image video data.

[0050] The specific technical means are wide dynamics, shadow correction, exposure correction, vascular enhancement, or smoke removal, and the second physical button 6 triggers different specific technical means correspondingly.

[0051] In the white light mode, after the second physical button 7 is triggered, the panel assembly 360 accordingly generates a second control signal 11 and sends the second control signal 11 to the control unit 310, which drives the light source module 100 to emit a second illumination beam to switch to the fluorescent mode; in the fluorescent mode, after the second physical button 7 is triggered, the panel assembly 360 accordingly generates a second control signal 12 and sends the second control signal 12 to the control unit 310, which drives the light source module 100 to emit a first illumination beam to switch to the white light mode. Unlike the operation unit 220 which transfers the first control signal a6 or the first control signal b4 to the control unit 310 via the image processing unit 320, the panel assembly 360 directly transmits the second control signal 11 or the second control signal 12 to the control unit 310. Therefore, when the first physical button 4 and the second physical button 7 are triggered simultaneously, the second control signal 11 or the second control signal 12 reaches the control unit 310 before the first control signal a6 or the first control signal b4. This prevents signal collisions from affecting the imaging of the fluorescence endoscope system, which is further advantageous in improving surgical safety.

[0052] Preferably, in order to prevent tampering with the parameters of the main control module 300, the panel assembly 360 presets a combination arrangement rule for triggering the second button 361 and a third mapping relationship between the combination arrangement rule and the second control signal, and when the second button 361 is triggered according to the combination arrangement rule, it matches and generates the second control signal based on the third mapping relationship, and drives the image processing unit 320 to load the first GUI on top of the video data.

[0053] Specifically, the second control signal includes a second control signal 13, in which, in the white light mode or the fluorescent mode, the second physical button 2 and the second physical button 3 are simultaneously triggered once, and the second physical button 1 is further triggered once, and based on the preset combination arrangement rule and the third mapping relationship, the panel assembly 360 accordingly generates the second control signal 13 and sends the second control signal 13 to the control unit 310. The control unit 310 transfers the second control signal 13 to the image processing unit 320, and drives the image processing unit 320 to load the first GUI.

[0054] In an alternative embodiment, in the white light mode or the fluorescent mode, the second physical button 6 is triggered several times and the second physical button 1 is triggered once more, and the panel assembly 360 accordingly generates a second control signal 13 and sends the second control signal 13 to the control unit 310. The control unit 310 forwards the second control signal 13 to the image processing unit 320, which drives the image processing unit 320 to load the first GUI.

[0055] 5, the main control module 300 preferably further includes an image cache unit 330 and an external storage interface 340. The image cache unit 330 is configured to record the video data processed by the image processing unit 320. The image cache unit 330 is connected to a storage device external to the main control module 300 via the external storage interface 340.

[0056] The present invention can provide at least two operating modes, including a white light mode and a fluorescence mode, and the first button 225 on the operating unit 220 can be used to switch between the white light mode and the fluorescence mode, and the fluorescence imaging can provide a fluorescence image of the tissue below the tissue surface, allowing difficult-to-observe lesions or early lesions to be visualized and accurately identified, thereby improving surgical safety. [Example]

[0057] The present invention further provides a method for controlling a fluorescence endoscope system, including the steps of triggering a first button 225 to drive the light source module 100 to emit a first illumination beam or a second illumination beam and switching between a white light mode and a fluorescence mode, and / or triggering a second button 361 to drive the light source module 100 to emit a first illumination beam or a second illumination beam and switching between a white light mode and a fluorescence mode.

[0058] Preferably, the control method of the present invention further includes the step of triggering the second button 361 according to the combination arrangement rule to drive the image processing unit 320 to load the first GUI on top of the video data.

[0059] Preferably, the control method of the present invention further includes the step of rotating the optical adapter 230 and reciprocating the lens 232 within the cavity 231 to adjust the focal length of the fluorescence endoscope system and ensure the clarity of its image.

[0060] The specific contents of the above have been explained in detail in the first embodiment, so a detailed explanation of the present invention will be omitted here.

[0061] Obviously, the above examples are merely examples for clear explanation and are not intended to limit the embodiments. Those skilled in the art can make other changes or modifications based on the above descriptions. It is not necessary or possible to cover all the embodiments in this specification. Any obvious changes or modifications derived therefrom still fall within the protection scope of the present invention. [Explanation of symbols]

[0062] 100 Light Source Module 200 Camera Module 210 Endoscope 211 Objective Lens 212 Light guiding structure 213 Eyepiece 214 Light Source Interface 215 Light Guide Beam 220 Operation section 221 Handheld unit 222 Optical Filter 223 Spectroscopic Prism 224 Image Sensor 225 First Button 230 Optical Adapter 231 Cavity 232 Lens 300 Main Control Module 310 Control Unit 320 Image Processing Unit 330 Image Cache Unit 340 External Memory Interface 360 Panel Assembly 361 Second Button 400 Display Module

Claims

1. A fluorescence endoscope system, comprising: a light source module including a first light guide beam configured to guide an illumination beam emitted by the light source module, the illumination beam comprising a first illumination beam and a second illumination beam corresponding to a white light mode and a fluorescent mode, respectively; a camera module including a connected endoscope and a control unit, the endoscope configured to propagate an illumination beam guided by a first light guide beam and a reflected beam formed after the illumination beam maps an object, the control unit configured to collect the reflected beam and convert the collected reflected beam therefrom into video data; a main control module including a control unit configured to drive the light source module to emit the first illumination beam or the second illumination beam, and an image processing unit configured to process the video data frame by frame; a display module configured to play the video data after it has been processed by the image processing unit; wherein the operating unit includes a handheld body and a first button located on the handheld body, the operating unit is configured to generate a first control signal according to the triggering of the first button, and send the first control signal to the image processing unit, and drive the light source module to emit the first illumination beam or the second illumination beam according to the first control signal, and switch between the white light mode and the fluorescent light mode; the operating unit is configured to preset a first mapping relationship between the first button and the first control signal, and to match and generate the first control signal based on the first mapping relationship when the first button is triggered, the first mapping relationship including a first mapping relationship a and a first mapping relationship b corresponding to a white light mode and a fluorescent light mode, respectively; and cause the image processing unit to perform a corresponding operation; The operation unit is configured to preset a first virtual key value table for a first button, and when the first button is triggered, match and generate a first virtual key value according to the first virtual key value table, and further match and generate a first control signal according to the first virtual key value by checking against a first mapping relationship; the main control module includes a panel assembly and a second button mounted on the panel assembly, the panel assembly being configured to generate a second control signal based on the second button being triggered and send the second control signal to the control unit, and based on the second control signal, drive the light source module to emit the first illumination beam or the second illumination beam and switch between the white light mode and the fluorescent mode; the second buttons include a second physical button 1, a second physical button 2, a second physical button 3, a second physical button 4, a second physical button 5, a second physical button 6, and a second physical button 7; the panel assembly presets a combination arrangement rule for triggering the second physical buttons based on an operation procedure in which two or more predetermined buttons among the second physical buttons are operated in a predetermined order or simultaneously, and a third mapping relationship between the combination arrangement rule and the second control signal; and when the second button is triggered according to the combination arrangement rule, matches and generates the second control signal according to the third mapping relationship, and drives the image processing unit to load a first GUI on top of video data; A fluorescence endoscope system characterized by:

2. the first illumination beam is configured as an illumination beam including only broad-spectrum white visible light having a wavelength between 400 nm and 730 nm; the second illumination beam is configured to mix white visible light with an illumination beam of narrowband IR excitation light having a wavelength between 750 nm and 810 nm; 2. The fluorescence endoscope system according to claim 1.

3. the camera module includes an optical adapter, the endoscope is connected to the operation unit via the optical adapter, and the optical adapter is configured to focus the reflected beam.

2. The fluorescence endoscope system according to claim 1.

4. The endoscope includes an objective lens, a light-guiding structure, an eyepiece lens, a light source interface, and a second light-guiding beam arranged along the axial direction of the endoscope, wherein the first light-guiding beam is connected to the second light-guiding beam through the light source interface, and the second light-guiding beam guides the illumination beam to map onto an object, and after encountering the object, the illumination beam changes its propagation direction to form a reflected beam, which passes through the objective lens, the light-guiding structure, and the eyepiece lens and enters the optical adapter; 4. The fluorescence endoscope system according to claim 3.

5. the handheld body is molded with a front end face and a cavity, an optical filter is disposed on the front end face, a spectroscopic prism and an image sensor are disposed within the cavity, the optical adapter focuses the reflected beam onto the optical filter, the optical filter is configured to cut the reflected beam having a wavelength of 750 nm or more and 810 nm or less, the spectroscopic prism is configured to decompose the reflected beam transmitted through the optical filter, and the image sensor is configured to collect the reflected beam decomposed by the spectroscopic prism and convert the collected reflected beam into video data.

4. The fluorescence endoscope system according to claim 3.

Citation Information

Patent Citations

  • Endoscope imaging system

    JP2002102158A

  • Electronic endoscope system

    JP2012065898A

  • Endoscope device, and method for operating endoscope device

    JP2015226713A

  • Systems and methods for medical imaging using a rolling shutter imager

    WO2020150494A1