Electronic soft mirror with fluorescence and narrow-band spectral imaging technology and implementation method thereof

Abstract

The invention discloses an electronic soft mirror with fluorescence and narrow-band spectrum imaging technology and an implementation method thereof. The electronic soft mirror comprises a light source module for emitting white light, near-infrared excitation light, blue light and green light. The collected white light image and near-infrared fluorescence image, blue light signal and green light signal are processed respectively to obtain a fluorescence imaging image or a narrow-band spectrum imaging image and output it. By simultaneously realizing near-infrared fluorescence imaging and narrow-band spectrum imaging on the electronic soft mirror, not only can the problem of being unable to accurately locate according to the image when the narrow-band spectrum imaging technology is used alone be solved, but also by adopting the narrow-band spectrum imaging technology, a target area in the image will have a strong contrast with an ordinary area to be highlighted, and a shallow blue light signal and a deep green light signal can be processed separately to highlight the morphology of target areas at different depths.

Description

Technical Field

[0001] The present invention relates to the field of imaging technology, and in particular to an electronic soft mirror with fluorescence and narrow-band spectrum imaging technology and a realization method thereof. Background Art

[0002] The incidence of diseases such as esophagitis, gastritis, colitis, and rectal cancer is on the rise. Electronic soft endoscopes can generally enter the human body through natural channels such as the mouth and anus, and can be used to detect early lesions and make diagnoses. Electronic soft endoscopes are recognized as the most reliable method for diagnosing diseases such as the esophagus, stomach, duodenum, and large intestine. The World Health Organization regards electronic gastroscopy as the gold standard for diagnosing digestive tract diseases.

[0003] Electronic soft lenses are a field with extremely high barriers. Due to the technical accumulation and leading level of Japanese companies in the field of optics, the global market is basically divided up by Japanese companies such as Olympus, Pentax, and Fuji, which together account for more than 90% of the market share. Among them, Olympus occupies 65% of the market share with its excellent product performance and strong innovation genes, and Fuji and Pentax occupy 14% of the market share respectively. Some domestic companies mainly focus on low-end standard-definition products in the field of soft lenses. The high-end is a market that domestic companies have not been able to enter in the past. It will be a trend to create the current domestic leading and high-quality electronic soft lenses.

[0004] From the production trend of global flexible electronic endoscopes, it can be seen that the development trend of electronic soft endoscopes is three aspects: ① High-definition resolution: Image quality directly affects the application of electronic soft endoscopes, so high resolution is still the research focus of endoscopes; ② Miniaturization: The size of the probe at the insertion end directly affects the severity of the trauma. Miniaturization of the probe can reduce the pain and discomfort of patients, thereby accelerating postoperative recovery. ③ Expanding new functions: In terms of expanding new functions, narrow-band spectral imaging technology is currently more commonly used, such as Olympus, Fuji, Aohua, Kaili and other domestic and foreign companies. Narrow-band spectral imaging technology uses long waves (green light) and short waves (blue light) to obtain vascular information at different depths, and then performs image algorithm highlighting and enhancement processing, which can clearly observe the vascular morphology of suspected lesions and help doctors make diagnoses. However, there is no mature imaging atlas in the industry. When doctors use narrow-band spectral imaging technology, they can generally only make judgments based on experience, and cannot accurately locate the lesions. It is difficult to promote and popularize, and the role of auxiliary diagnosis is also relatively limited.

[0005] Fluorescence imaging technology injects ICG (indocyanine green) reagent into the patient's body, and after a period of time, uses near-infrared excitation light and white light to irradiate the part to be tested. Abnormal tissue molecules combined with ICG will emit near-infrared fluorescence under the irradiation of near-infrared excitation light. After being processed by the electronic soft mirror imaging system, the lesion of the corresponding tissue can be displayed. The cancerous part is clearly revealed, the lesion can be accurately located, and it is helpful for the diagnosis of early cancer screening.

[0006] Therefore, it is urgent to solve how to apply fluorescence imaging technology to flexible electronic endoscopes to solve the problems that arise when using narrow-band spectral imaging technology.

[0007] Therefore, the prior art still needs to be improved and developed. Summary of the invention

[0008] The purpose of the present invention is to provide an electronic soft endoscope with fluorescence and narrow-band spectral imaging technology and a method for realizing the same, and to solve the problem that accurate positioning cannot be performed based on the image when using narrow-band spectral imaging technology by applying fluorescence imaging technology to a flexible electronic endoscope.

[0009] The technical solution of the present invention is as follows: an electronic soft mirror with fluorescence and narrow-band spectrum imaging technology, which includes:

[0010] The light source module emits white light and near-infrared excitation light to illuminate the target area, and the target area reflects the white light and part of the near-infrared excitation light and excites near-infrared fluorescence;

[0011] The camera module collects the focused reflected white light and part of the near-infrared excitation light, as well as the excited near-infrared fluorescence, reflects all the near-infrared excitation light, transmits the white light and near-infrared fluorescence and forms white light images and near-infrared fluorescence images respectively, synthesizes the white light image and the near-infrared fluorescence image, obtains the fluorescence imaging image and outputs it.

[0012] The electronic soft mirror with fluorescence and narrow-band spectral imaging technology, wherein the light source module can also emit blue light and green light to illuminate the target area, the target area absorbs part of the blue light and green light and reflects the rest of the blue light and green light, the camera module collects the focused reflected blue light and green light and forms an image, and processes the blue light signal and the green light signal respectively to obtain a narrow-band spectral imaging image and output it.

[0013] The electronic soft mirror with fluorescence and narrow-band spectrum imaging technology, wherein the light source module comprises:

[0014] White light and narrow-band spectrum modules for emitting white, blue and green light;

[0015] A near-infrared excitation light module emits near-infrared excitation light;

[0016] A near-infrared collimating lens is used to collimate the near-infrared excitation light emitted by the near-infrared excitation light module;

[0017] Short-wave pass filter, reflecting the collimated near-infrared excitation light and transmitting white light, blue light and green light;

[0018] A condenser lens focuses near-infrared excitation light, white light, blue light and green light;

[0019] Light guide, output focused near-infrared excitation light, white light, blue light and green light.

[0020] The electronic soft mirror with fluorescence and narrow-band spectrum imaging technology, wherein the white light and narrow-band spectrum module includes: a white light LED for emitting white light; a green light LED for emitting green light; a blue light LED for emitting blue light; a white light LED collimating lens for collimating white light; a green light LED collimating lens for collimating green light; a blue light LED collimating lens for collimating blue light; a long-wave pass filter for reflecting blue light and transmitting green light; and an electrically controlled reflector for reflecting green light and blue light.

[0021] The electronic soft mirror with fluorescence and narrow-band spectrum imaging technology, wherein the white light and narrow-band spectrum module includes: a red light LED, used to emit red light; a green light LED, used to emit green light; a blue light LED, used to emit blue light; a red light LED collimating lens, used to collimate the red light; a green light LED collimating lens, used to collimate the green light; a blue light LED collimating lens, used to collimate the blue light; an X-cube light-combining prism, used to combine red light, green light and blue light into white light, or to transmit green light and reflect blue light.

[0022] The electronic soft mirror with fluorescence and narrow-band spectral imaging technology, wherein the camera module includes: a lens for collecting and focusing white light, near-infrared excitation light, near-infrared fluorescence, blue light, and green light; a narrow-band filter for reflecting the near-infrared excitation light and transmitting white light, near-infrared fluorescence, blue light, and green light; a spectroscope for splitting white light and near-infrared fluorescence; a white light camera for imaging white light; a near-infrared camera for imaging near-infrared fluorescence; an image processing module for processing and synthesizing white light images and near-infrared fluorescence images and outputting them, or processing and synthesizing blue light images and green light images and outputting them.

[0023] The electronic soft mirror with fluorescence and narrow-band spectrum imaging technology, wherein the camera module includes: a lens for collecting focused white light, near-infrared excitation light, near-infrared fluorescence, blue light, and green light; a narrow-band filter for reflecting near-infrared excitation light and transmitting white light, near-infrared fluorescence, blue light, and green light; a four-color camera for imaging white light, near-infrared fluorescence, blue light, and green light; an image processing module for processing and synthesizing white light images and near-infrared fluorescence images and outputting them, or processing and synthesizing blue light images and green light images and outputting them.

[0024] The electronic soft mirror with fluorescence and narrow-band spectrum imaging technology, wherein the camera module includes: a lens for collecting focused white light, near-infrared excitation light, near-infrared fluorescence, blue light, and green light; a narrow-band filter for reflecting near-infrared excitation light and transmitting white light, near-infrared fluorescence, blue light, and green light; a strobe camera for imaging white light, near-infrared fluorescence, blue light, and green light; an image processing module for processing and synthesizing white light images and near-infrared fluorescence images and outputting them, or processing and synthesizing blue light images and green light images and outputting them.

[0025] A method for realizing an electronic soft mirror with fluorescence and narrow-band spectral imaging technology as described above, wherein the method specifically comprises the following steps:

[0026] After the white light and near-infrared excitation light emitted by the light source module reach the target area, the white light and part of the near-infrared excitation light are reflected by the target area, and part of the near-infrared excitation light is absorbed by the abnormal target area combined with ICG, stimulating near-infrared fluorescence;

[0027] White light, near-infrared excitation light, and near-infrared fluorescence are collected and focused by the lens, and then pass through a narrow-band filter. The narrow-band filter reflects the near-infrared excitation light and transmits white light and near-infrared fluorescence.

[0028] White light and near-infrared fluorescence are imaged separately when they reach the camera, and then synthesized into fluorescent images through the image processing module and output;

[0029] After the blue light and green light emitted by the light source module reach the target area, the blue light has weaker penetration and is absorbed by the shallow target area, while the green light has stronger penetration and is absorbed by the deep target area;

[0030] The reflected blue-green light is collected and focused by the lens, then transmitted through a narrow-band filter to reach the camera, and processed and synthesized by the image processing module to obtain a narrow-band spectral imaging image and output it.

[0031] Beneficial effects of the present invention: The present invention provides an electronic soft mirror with fluorescence and narrow-band spectral imaging technology and an implementation method thereof. The electronic soft mirror includes a light source module for emitting white light, near-infrared excitation light, blue light and green light. The collected white light image and near-infrared fluorescence image, blue light signal and green light signal are processed respectively to obtain a fluorescence imaging image or a narrow-band spectral imaging image and output it. By simultaneously realizing near-infrared fluorescence imaging and narrow-band spectral imaging on the electronic soft mirror, not only can the problem of being unable to accurately locate according to the image when the narrow-band spectral imaging technology is used alone be solved, but also by adopting the narrow-band spectral imaging technology, the target area in the image will have a strong contrast with the ordinary area to be highlighted, and the shallow blue light signal and the deep green light signal can be processed separately to highlight the morphology of the target area at different depths. BRIEF DESCRIPTION OF THE DRAWINGS

[0032] Figure 1 It is a structural schematic diagram of the light source module in the present invention.

[0033] Figure 2 It is a structural schematic diagram of the camera module in the present invention.

[0034] Figure 3 It is a flowchart of the steps of the implementation method of the electronic soft mirror with fluorescence and narrow-band spectral imaging technology in the present invention. DETAILED DESCRIPTION

[0035] The embodiments of the present invention are described in detail below, examples of which are shown in the accompanying drawings, wherein the same or similar reference numerals throughout represent the same or similar elements or elements having the same or similar functions. The embodiments described below with reference to the accompanying drawings are exemplary and are only used to explain the present invention, and cannot be understood as limiting the present invention.

[0036] In the description of the present invention, it should be understood that the terms "center", "longitudinal", "lateral", "length", "width", "thickness", "up", "down", "front", "back", "left", "right", "vertical", "horizontal", "top", "bottom", "inside", "outside", "clockwise", "counterclockwise" and the like indicate positions or positional relationships based on the positions or positional relationships shown in the accompanying drawings, and are only for the convenience of describing the present invention and simplifying the description, rather than indicating or implying that the device or element referred to must have a specific orientation, be constructed and operated in a specific orientation, and therefore cannot be understood as limiting the present invention. In addition, the terms "first" and "second" are only used for descriptive purposes, and cannot be understood as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Therefore, the features defined as "first" and "second" may explicitly or implicitly include one or more of the features. In the description of the present invention, the meaning of "multiple" is two or more, unless otherwise clearly and specifically defined.

[0037] In the description of the present invention, it should be noted that, unless otherwise clearly specified and limited, the terms "installed", "connected", and "connected" should be understood in a broad sense, for example, it can be a fixed connection, a detachable connection, or an integral connection; it can be a mechanical connection, an electrical connection, or mutual communication; it can be a direct connection, or an indirect connection through an intermediate medium, it can be the internal connection of two elements or the interaction relationship between two elements. For ordinary technicians in this field, the specific meanings of the above terms in the present invention can be understood according to specific circumstances.

[0038] In the present invention, unless otherwise clearly specified and limited, a first feature being "above" or "below" a second feature may include that the first and second features are in direct contact, or may include that the first and second features are not in direct contact but are in contact through another feature between them. Moreover, a first feature being "above", "above" and "above" a second feature includes that the first feature is directly above and obliquely above the second feature, or simply indicates that the first feature is higher in level than the second feature. A first feature being "below", "below" and "below" a second feature includes that the first feature is directly below and obliquely below the second feature, or simply indicates that the first feature is lower in level than the second feature.

[0039] The disclosure below provides many different embodiments or examples to realize different structures of the present invention. In order to simplify the disclosure of the present invention, the parts and settings of specific examples are described below. Of course, they are only examples, and the purpose is not to limit the present invention. In addition, the present invention can repeat reference numbers and / or reference letters in different examples, and this repetition is for the purpose of simplicity and clarity, which itself does not indicate the relationship between the various embodiments and / or settings discussed. In addition, the present invention provides various specific examples of processes and materials, but those of ordinary skill in the art can be aware of the application of other processes and / or the use of other materials.

[0040] like Figure 1 As shown, an electronic soft mirror with fluorescence and narrow-band spectral imaging technology includes:

[0041] The light source module emits white light and near-infrared excitation light to illuminate the target area, and the target area reflects the white light and part of the near-infrared excitation light and excites near-infrared fluorescence;

[0042] The camera module collects the focused reflected white light and part of the near-infrared excitation light, as well as the excited near-infrared fluorescence, reflects all the near-infrared excitation light, transmits the white light and near-infrared fluorescence and forms white light images and near-infrared fluorescence images respectively, synthesizes the white light image and the near-infrared fluorescence image, obtains the fluorescence imaging image and outputs it.

[0043] This technical solution solves the problem that accurate positioning cannot be performed based on images when using narrow-band spectral imaging technology by arranging a fluorescent imaging mechanism on the electronic soft mirror and using near-infrared fluorescent imaging technology in combination with corresponding dyes.

[0044] In some specific embodiments, the light source module can also emit blue light and green light to illuminate the target area. The target area absorbs part of the blue light and green light and reflects the remaining blue light and green light. The camera module collects the focused reflected blue light and green light and forms an image. The blue light signal and the green light signal are processed separately to obtain a narrow-band spectral imaging image and output it.

[0045] This technical solution integrates narrow-band spectral imaging on the basis of near-infrared fluorescence imaging. It can not only solve the problem that accurate positioning cannot be performed based on the image when narrow-band spectral imaging technology is used alone, but also can highlight the target area in the image with a strong contrast from the ordinary area by adopting narrow-band spectral imaging technology, and the shallow blue light signal and the deep green light signal can be processed separately to highlight the morphology of target areas at different depths.

[0046] In some specific embodiments, the light source module includes:

[0047] White light and narrow-band spectrum modules for emitting white, blue and green light;

[0048] A near-infrared excitation light module 104 emits near-infrared excitation light;

[0049] A near-infrared collimating lens 204 is used to collimate the near-infrared excitation light emitted by the near-infrared excitation light module 104;

[0050] A short-wave filter 302 reflects the collimated near-infrared excitation light and transmits white light, blue light and green light;

[0051] A condenser lens 205 focuses the near-infrared excitation light, white light, blue light and green light;

[0052] The light guide 401 (integrated in the cable of the camera module) outputs focused near-infrared excitation light, white light, blue light and green light.

[0053] In some specific embodiments, the white light and narrowband spectrum module can be configured as follows:

[0054] (1) The white light and narrowband spectrum module comprises: a white light LED for emitting white light; a green light LED for emitting green light; a blue light LED for emitting blue light; a white light LED collimating lens for collimating white light; a green light LED collimating lens for collimating green light; a blue light LED collimating lens for collimating blue light; a long-wave pass filter for reflecting blue light and transmitting green light; and an electrically controlled reflector for reflecting green light and blue light.

[0055] In this embodiment, when the electronic soft mirror is in the fluorescence imaging mode, the near-infrared excitation light emitted by the near-infrared excitation light module is collimated by the near-infrared collimating lens, reflected by the short-wave pass filter, and then focused by the condensing lens to the guide light beam to output the near-infrared excitation light; at the same time, the white light emitted by the white light LED is collimated by the white light LED collimating lens, transmitted by the short-wave pass filter, and then focused by the condensing lens to the guide light beam to output.

[0056] In this embodiment, when the electronic soft mirror is in the narrow-band spectrum imaging mode, the blue light emitted by the blue LED is collimated by the blue light LED collimating lens, reflected by the long-wave pass filter, then reflected by the electrically controlled reflector, transmitted by the short-wave pass filter, and then focused by the condenser lens to the light guide output; the green light emitted by the green LED is collimated by the green light LED collimating lens, transmitted by the long-wave pass filter, then reflected by the electrically controlled reflector, transmitted by the short-wave pass filter, and then focused by the condenser lens to the light guide output.

[0057] (2) If Figure 1 As shown, the white light and narrow-band spectrum module includes: a red light LED 101, used to emit red light; a green light LED 102, used to emit green light; a blue light LED 103, used to emit blue light; a red light LED collimating lens 201, used to collimate the red light; a green light LED collimating lens 202, used to collimate the green light; a blue light LED collimating lens 203, used to collimate the blue light; an X-cube light-combining prism 301, used to combine red light, green light and blue light into white light, or to transmit green light and reflect blue light.

[0058] In this embodiment, when the electronic soft mirror is in the fluorescence imaging mode, the near-infrared excitation light emitted by the near-infrared excitation light module 104 is collimated by the near-infrared collimating lens 204, reflected by the short-wave filter 302, and then focused by the condensing lens 205 to the light guide 401 to output the near-infrared excitation light; at the same time, the red light emitted by the red light LED 101 is collimated by the red light LED collimating lens, the green light emitted by the green light LED 102 is collimated by the green light LED collimating lens, and the blue light emitted by the blue light LED 103 is collimated by the blue light LED collimating lens. The red light, green light and blue light are synthesized into white light by the X-cube light combining prism 301, transmitted by the short-wave filter 302, and then focused by the condensing lens 205 to the light guide 401 for output.

[0059] In this embodiment, when the electronic soft mirror is in the narrow-band spectrum imaging mode, the green light emitted by the green LED 102 is collimated by the green LED collimating lens, and the blue light emitted by the blue LED 103 is collimated by the blue LED collimating lens. The green light and the blue light pass through the X-cube light-combining prism 301. The X-cube light-combining prism 301 transmits the green light and reflects the blue light. The blue light and the green light are transmitted through the short-wave filter 302 and then focused by the condenser lens 205 to the light guide 401 to output the blue light and the green light.

[0060] In some specific embodiments, the camera module may be configured as follows:

[0061] (1) The camera module includes: a lens for collecting and focusing white light, near-infrared excitation light, near-infrared fluorescence, blue light, and green light; a narrow-band filter for reflecting near-infrared excitation light and transmitting white light, near-infrared fluorescence, blue light, and green light; a spectroscope for splitting white light and near-infrared fluorescence; a white light camera for imaging white light; a near-infrared camera for imaging near-infrared fluorescence; and an image processing module for processing and synthesizing white light images and near-infrared fluorescence images and outputting them, or processing and synthesizing blue light images and green light images and outputting them.

[0062] In this embodiment, when the electronic soft mirror is in the fluorescence imaging mode, the white light and near-infrared excitation light output by the light source module are irradiated to the target area, and the target area reflects the white light and part of the near-infrared excitation light, and excites near-infrared fluorescence, and the narrow-band filter reflects the near-infrared excitation light; the white light and near-infrared fluorescence are split by the spectroscope and reach the white light camera and near-infrared camera for imaging respectively, and finally the image processing module processes the white light image and the near-infrared fluorescence image to synthesize the fluorescence imaging image and output it.

[0063] In this embodiment, when the electronic soft mirror is in the narrow-band spectral imaging mode, the blue light and green light emitted by the light source module are irradiated to the target area, the target area absorbs part of the blue light and green light, and the reflected blue light and green light are transmitted through the narrow-band filter to reach the white light camera, and are processed and synthesized by the image processing module to obtain a narrow-band spectral imaging image and output it.

[0064] (2) The camera module includes: a lens for collecting and focusing white light, near-infrared excitation light, near-infrared fluorescence, blue light, and green light; a narrow-band filter for reflecting the near-infrared excitation light and transmitting white light, near-infrared fluorescence, blue light, and green light; a four-color camera for imaging white light, near-infrared fluorescence, blue light, and green light; and an image processing module for processing and outputting a synthesized white light image and a near-infrared fluorescence image, or processing and outputting a synthesized blue light image and a green light image.

[0065] In this embodiment, when the electronic soft mirror is in the fluorescence imaging mode, the white light and near-infrared excitation light output by the light source module are irradiated to the target area, and the white light and near-infrared excitation light are emitted to irradiate the target area. The target area reflects the white light and part of the near-infrared excitation light, and excites near-infrared fluorescence. The narrow-band filter reflects the near-infrared excitation light; the white light and near-infrared fluorescence reach the four-color camera, where the RGB channels synthesize the white light signal, and the IR channel extracts the near-infrared fluorescence signal. Finally, the image processing module processes the white light image and the near-infrared fluorescence image to synthesize the fluorescence imaging image and outputs it.

[0066] In this embodiment, when the electronic soft mirror is in the narrow-band spectral imaging mode, the blue light and green light emitted by the light source module are irradiated to the target area, the target area absorbs part of the blue light and green light, and the reflected blue light and green light are transmitted through the narrow-band filter to reach the four-color camera, and are processed and synthesized by the image processing module to obtain a narrow-band spectral imaging image and output it.

[0067] (3) If Figure 2 As shown, the camera module includes: a lens 501, which is used to collect and focus white light, near-infrared excitation light, near-infrared fluorescence, blue light, and green light; a narrow-band filter 601, which is used to reflect the near-infrared excitation light and transmit white light, near-infrared fluorescence, blue light, and green light; a strobe camera 701, which images white light, near-infrared fluorescence, blue light, and green light; an image processing module 801, which processes and synthesizes white light images and near-infrared fluorescence images and outputs them, or processes and synthesizes blue light images and green light images and outputs them.

[0068] In this embodiment, when the electronic soft mirror is in the fluorescence imaging mode, the white light and near-infrared excitation light output by the light source module are irradiated to the target area, the target area reflects the white light and part of the near-infrared excitation light, and excites the near-infrared fluorescence, and the narrow-band filter 601 reflects the near-infrared excitation light; the stroboscopic camera 701 communicates with the light source module to control the white light and near-infrared excitation light to perform time-sharing stroboscopic emission, and the corresponding white light and near-infrared fluorescence reach the stroboscopic camera 701 in a time-sharing manner to form a white light image and a near-infrared fluorescence image respectively, and finally the image processing module 801 processes the white light image and the near-infrared fluorescence image, and each frame of the image only has a white light signal or a near-infrared fluorescence signal, and then the image processing module 801 synthesizes the fluorescence imaging image and outputs it.

[0069] In this embodiment, when the electronic soft mirror is in the narrow-band spectrum imaging mode, the blue light and green light emitted by the light source module are irradiated to the target area, and the target area absorbs part of the blue light and green light. The reflected blue light and green light are transmitted through the narrow-band filter 601 to reach the stroboscopic camera 701, and are processed and synthesized by the image processing module 801 to obtain a narrow-band spectrum imaging image and output it.

[0070] like Figure 3 As shown, a method for realizing the electronic soft mirror with fluorescence and narrow-band spectral imaging technology as described above specifically comprises the following steps:

[0071] Step S1: After the white light and near-infrared excitation light emitted by the light source module reach the target area, the white light and part of the near-infrared excitation light are reflected by the target area, and part of the near-infrared excitation light is absorbed by the abnormal target area combined with ICG, thereby stimulating near-infrared fluorescence;

[0072] Step S2: white light, near-infrared excitation light, and near-infrared fluorescence are collected and focused by the lens 501, and then pass through the narrow-band filter 601, which reflects the near-infrared excitation light and transmits the white light and near-infrared fluorescence;

[0073] Step S3: white light and near-infrared fluorescence are imaged at the camera respectively, and the image processing module 801 synthesizes the fluorescence imaging image and outputs it;

[0074] Step S4: After the blue light and green light emitted by the light source module reach the target area, the blue light has a weaker penetrating power and is absorbed by the shallow target area, while the green light has a stronger penetrating power and is absorbed by the deep target area;

[0075] Step S5: The reflected blue-green light is collected and focused by the lens 501, and then transmitted through the narrow-band filter 601 to reach the camera, and processed and synthesized by the image processing module 801 to obtain a narrow-band spectrum imaging image and output it.

[0076] In this technical solution, the camera module structure (2) is combined with the camera module structure (3) to form an electronic soft mirror with fluorescence and narrow-band spectrum imaging technology. The implementation process is as follows:

[0077] When the electronic soft microscope with fluorescence and narrow-band spectral imaging technology is in fluorescence imaging mode:

[0078] The light emitted by the near-infrared excitation light module 104 is collimated by the near-infrared collimating lens 204, reflected by the short-wave filter 302, and then focused by the condenser lens 205 to the light guide 401 to output the near-infrared excitation light. At the same time, the red light emitted by the red LED 101 is collimated by the red LED collimating lens, the green light emitted by the green LED 102 is collimated by the green LED collimating lens, and the blue light emitted by the blue LED 103 is collimated by the blue LED collimating lens. The red light, green light and blue light are synthesized into white light by the X-cube light combining prism 301, transmitted by the short-wave filter 302, and then focused by the condenser lens 205 to the light guide 401 for output.

[0079] After the white light and near-infrared excitation light reach the target area, the white light and part of the near-infrared excitation light are reflected by the target area, and part of the near-infrared excitation light is absorbed by the abnormal target area combined with ICG, stimulating near-infrared fluorescence. The white light, near-infrared excitation light, and near-infrared fluorescence are collected and focused by the lens 501, and then reflected by the narrow-band filter 601. The near-infrared excitation light transmits the white light and near-infrared fluorescence to reach the stroboscopic camera 701, and is processed by the image processing module 801.

[0080] Specifically, the stroboscopic camera 701 communicates with the light source module to control the output of white light and near-infrared excitation light to be performed alternately according to the frame rate of the stroboscopic camera 701. The returned white light and near-infrared fluorescence arrive at the stroboscopic camera 701 in a time-sharing manner. Finally, the image processing module 801 processes the white light image and the near-infrared fluorescence image. Each frame of the image contains only white light signals or near-infrared fluorescence signals. The image processing module 801 then synthesizes the fluorescence imaging image and outputs it.

[0081] When the electronic soft mirror with fluorescence and narrow-band spectral imaging technology is in narrow-band spectral imaging mode:

[0082] The green light emitted by the green LED 102 is collimated by the green LED collimating lens, and the blue light emitted by the blue LED 103 is collimated by the blue LED collimating lens. The green light and the blue light pass through the X-cube light-combining prism 301. The X-cube light-combining prism 301 transmits the green light and reflects the blue light. The blue light and the green light are transmitted through the short-wave pass filter 302 and then focused by the condensing lens 205 to the light guide 401 to output the blue light and the green light.

[0083] After the blue light and the green light reach the target area, the blue light has weaker penetration and is absorbed by the shallow target area, while the green light has stronger penetration and is absorbed by the deep target area; the reflected blue light and green light are collected and focused by the lens 501, and then transmitted through the narrow-band filter 601 to reach the stroboscopic camera 701; finally, the image processing module 801 processes and synthesizes them to obtain a narrow-band spectral imaging image and outputs it.

[0084] This technical solution realizes near-infrared fluorescence imaging and narrow-band spectral imaging on the electronic soft mirror at the same time, which not only solves the problem that accurate positioning cannot be performed based on the image when the narrow-band spectral imaging technology is used alone, but also can produce a strong contrast between the target area and the ordinary area in the image by adopting the narrow-band spectral imaging technology, and the shallow blue light signal and the deep green light signal can be processed separately to highlight the morphology of the target area at different depths.

[0085] In the description of this specification, the description with reference to the terms "one embodiment", "certain embodiments", "illustrative embodiments", "examples", "specific examples", or "some examples" means that the specific features, structures, materials, or characteristics described in conjunction with the embodiment or example are included in at least one embodiment or example of the present invention. In this specification, the schematic representation of the above terms does not necessarily refer to the same embodiment or example. Moreover, the specific features, structures, materials, or characteristics described may be combined in any one or more embodiments or examples in a suitable manner.

[0086] It should be understood that the application of the present invention is not limited to the above examples. For ordinary technicians in this field, improvements or changes can be made based on the above description. All these improvements and changes should fall within the scope of protection of the claims attached to the present invention.

Claims

1. A method for realizing an electronic soft mirror with fluorescence and narrow-band spectral imaging technology, characterized in that: The method comprises the steps of: After the white light and near-infrared excitation light emitted by the light source module reach the target area, the white light and part of the near-infrared excitation light are reflected by the target area, and part of the near-infrared excitation light is absorbed by the abnormal target area combined with ICG, stimulating near-infrared fluorescence; White light, near-infrared excitation light, and near-infrared fluorescence are collected and focused by the lens, and then pass through a narrow-band filter. The narrow-band filter reflects the near-infrared excitation light and transmits white light and near-infrared fluorescence. White light and near-infrared fluorescence are imaged separately when they reach the camera, and then synthesized into fluorescent images through the image processing module and output; After the blue light and green light emitted by the light source module reach the target area, the blue light has weaker penetration and is absorbed by the shallow target area, while the green light has stronger penetration and is absorbed by the deep target area; The reflected blue-green light is collected and focused by the lens, and then transmitted through a narrow-band filter to the camera, where it is processed and synthesized by the image processing module to obtain a narrow-band spectral imaging image and output; Electronic soft mirror includes: The light source module emits white light and near-infrared excitation light to illuminate the target area, and the target area reflects the white light and part of the near-infrared excitation light and excites near-infrared fluorescence; The camera module collects the focused reflected white light and part of the near-infrared excitation light, as well as the excited near-infrared fluorescence, reflects all the near-infrared excitation light, transmits the white light and near-infrared fluorescence, and forms a white light image and a near-infrared fluorescence image respectively, synthesizes the white light image and the near-infrared fluorescence image, obtains a fluorescence imaging image, and outputs it; The light source module can also emit blue light and green light to illuminate the target area. The target area absorbs part of the blue light and green light and reflects the rest of the blue light and green light. The camera module collects the focused reflected blue light and green light and forms an image. The blue light signal and the green light signal are processed separately to obtain a narrow-band spectrum imaging image and output it.

2. The method for realizing the electronic soft mirror with fluorescence and narrow-band spectral imaging technology according to claim 1, characterized in that: The light source module comprises: White light and narrow-band spectrum modules for emitting white, blue and green light; A near-infrared excitation light module emits near-infrared excitation light; A near-infrared collimating lens is used to collimate the near-infrared excitation light emitted by the near-infrared excitation light module; Short-wave pass filter, reflecting the collimated near-infrared excitation light and transmitting white light, blue light and green light; A condenser lens focuses near-infrared excitation light, white light, blue light and green light; Light guide, outputs focused near-infrared excitation light, white light, blue light and green light.

3. The method for realizing the electronic soft mirror with fluorescence and narrow-band spectral imaging technology according to claim 2, characterized in that: The white light and narrowband spectrum module includes: a white light LED for emitting white light; a green light LED for emitting green light; a blue light LED for emitting blue light; a white light LED collimating lens for collimating white light; a green light LED collimating lens for collimating green light; a blue light LED collimating lens for collimating blue light; a long-wave pass filter for reflecting blue light and transmitting green light; and an electrically controlled reflector for reflecting green light and blue light.

4. The method for realizing the electronic soft mirror with fluorescence and narrow-band spectral imaging technology according to claim 2, characterized in that: The white light and narrow-band spectrum module includes: a red light LED for emitting red light; a green light LED for emitting green light; a blue light LED for emitting blue light; a red light LED collimating lens for collimating red light; a green light LED collimating lens for collimating green light; a blue light LED collimating lens for collimating blue light; and an X-cube light-combining prism for combining red light, green light and blue light into white light, or transmitting green light and reflecting blue light.

5. The method for realizing the electronic soft mirror with fluorescence and narrow-band spectral imaging technology according to claim 1, characterized in that: The camera module includes: a lens for collecting and focusing white light, near-infrared excitation light, near-infrared fluorescence, blue light, and green light; a narrow-band filter for reflecting near-infrared excitation light and transmitting white light, near-infrared fluorescence, blue light, and green light; a spectroscope for splitting white light and near-infrared fluorescence; a white light camera for imaging white light; a near-infrared camera for imaging near-infrared fluorescence; and an image processing module for processing and synthesizing white light images and near-infrared fluorescence images and outputting them, or processing and synthesizing blue light images and green light images and outputting them.

6. The method for realizing the electronic soft mirror with fluorescence and narrow-band spectral imaging technology according to claim 1, characterized in that: The camera module includes: a lens for collecting focused white light, near-infrared excitation light, near-infrared fluorescence, blue light, and green light; a narrow-band filter for reflecting near-infrared excitation light and transmitting white light, near-infrared fluorescence, blue light, and green light; a four-color camera for imaging white light, near-infrared fluorescence, blue light, and green light; and an image processing module for processing and synthesizing white light images and near-infrared fluorescence images and outputting them, or processing and synthesizing blue light images and green light images and outputting them.

7. The method for realizing the electronic soft mirror with fluorescence and narrow-band spectral imaging technology according to claim 1, characterized in that: The camera module includes: a lens for collecting focused white light, near-infrared excitation light, near-infrared fluorescence, blue light, and green light; a narrow-band filter for reflecting near-infrared excitation light and transmitting white light, near-infrared fluorescence, blue light, and green light; a strobe camera for imaging white light, near-infrared fluorescence, blue light, and green light; and an image processing module for processing and outputting synthesized white light images and near-infrared fluorescence images, or processing and outputting synthesized blue light images and green light images.

Images