Medical dual fluorescence imaging method and device fusing white light background image

Abstract

The application provides a medical dual-fluorescence imaging method and device for fusing a white light background image, comprising: setting light emission logic of a fusion light source and irradiating an imaging area according to the light emission logic, collecting and splitting white light and first long-wavelength fluorescence, short-wavelength fluorescence and second long-wavelength fluorescence in time, collecting the white light and the short-wavelength fluorescence in time by using a first camera, collecting the first long-wavelength fluorescence and the second long-wavelength fluorescence in time by using a second camera, performing image fusion processing on white light image data, first long-wavelength fluorescence image data, short-wavelength fluorescence image data and second long-wavelength fluorescence image data, and obtaining a fused image. The application outputs the short-wavelength fluorescence and the white light in the same path and outputs the long-wavelength fluorescence separately by designing a time-sharing light emission mode combined with a prism splitting mode, achieves the effect of fusing the white light background image when dual-fluorescence simultaneous development imaging, the prism structure is relatively simple, the fluorescence signal cross-talk can be avoided, and the overall fused image is bright and clear in color.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of medical imaging, in particular to a medical dual-fluorescence imaging method and device fusing a white light background image. BACKGROUND

[0002] With the development of modern medicine, fluorescence technology is increasingly widely used in the medical field and plays an increasingly important role. Through fluorescence technology, DNA sequencing, lymph and tumor tracing, drug metabolism and pesticide residue detection can be achieved. Fluorescence technology mainly involves fluorescence imaging by collecting fluorescence, so as to trace drugs and tumors. However, since fluorescence imaging can only display the fluorescence region, the other tissue regions and the position of the instrument cannot be imaged. Therefore, most of the current fluorescence surgery navigation imaging devices provide fused images of white light and fluorescence, so as to facilitate doctors to identify the fluorescence imaging area, the instrument and other tissues. There are currently three ways to realize single-fluorescence imaging fusing white light. The first way is to use a beam splitter prism, such as a double prism, to split the fluorescence image and the white light image into two paths, corresponding to fluorescence and white light respectively, and then use two cameras to collect the fluorescence signal and the white light signal respectively, and display the image after image fusion. The second way is to collect white light and fluorescence images by time division, fuse the two images into one frame of image, and then display the image. The third way is to use a Bayer camera (a kind of color camera) to collect the mixed signal of white light and fluorescence, and then perform color gamut conversion. Specifically, the fluorescence is identified by the corresponding color in the color gamut space, and the image is fused and displayed.

[0003] However, due to the different characteristics of fluorescence drugs, some surgeries require the use of two kinds of fluorescence drugs in cooperation. The existing dual-fluorescence imaging scheme is improved based on the above-mentioned single-fluorescence imaging fusing white light. The difference is that the white light is replaced by another fluorescence. Obviously, such a dual-fluorescence imaging scheme cannot simultaneously meet the needs of imaging the fluorescence imaging area, the instrument and other tissues. However, if the above-mentioned single-fluorescence imaging fusing white light is still used to fuse the dual-fluorescence and white light images, the following problems will occur. Based on the first way described above, at least three prisms or even five prisms need to be added to the double prism, which makes the design and production of the beam splitter prism very complex. Based on the second way described above, when one kind of fluorescence drug is excited, the spectrum with a relative excitation peak blue shift (deviation towards blue light) will also excite fluorescence. Even if the white light is not fused, there will be interference between the two fluorescences, which will interfere with the identification of fluorescence. Based on the third way described above, since the fluorescence signal is very weak and can be easily "overwhelmed" in the white light signal, the identification of the two fluorescences will be affected. At this time, the brightness of the white light is adjusted to identify the fluorescence. However, the fused image obtained in this way will be dark overall and not bright enough. Even some details of the white light image are unclear, resulting in poor picture quality and poor detail clarity.

[0004] Therefore, a medical dual-fluorescence imaging method and device capable of fusing a white light background image, avoiding fluorescence signal interference, and making the overall fused image bright and clear are needed. SUMMARY

[0005] The medical dual-fluorescence imaging method and device for fusing a white light background image provided by the application mainly solve the problems of the prior art, such as the inability to fuse a white light background image, the complexity of prism design and production based on a traditional white light fusion scheme, the existence of fluorescence signal interference, and poor fused image quality, thereby achieving the effects of fusing a white light background image while effectively performing dual-fluorescence simultaneous imaging, a relatively simple prism structure, the avoidance of fluorescence signal interference, and bright and clear overall fused image color.

[0006] The application achieves the above-mentioned purpose by the following technical solutions:

[0007] The medical dual-fluorescence imaging method for fusing a white light background image comprises the following steps:

[0008] S1: setting an out-light logic of a fusion light source and irradiating an imaging area according to the out-light logic, wherein the out-light logic is that white light and long-wavelength excitation light are emitted at the same time, and short-wavelength excitation light is emitted at different times.

[0009] S2: simultaneously collecting reflected white light and first long-wavelength fluorescence excited by the long-wavelength excitation light, and splitting the white light and the first long-wavelength fluorescence by using a light-splitting prism.

[0010] S3: simultaneously collecting short-wavelength fluorescence and second long-wavelength fluorescence excited by the short-wavelength excitation light, and splitting the short-wavelength fluorescence and the second long-wavelength fluorescence by using the light-splitting prism.

[0011] Steps S2 and S3 are performed at different times according to the current irradiation light received by the imaging area.

[0012] S4: collecting the white light and the first long-wavelength fluorescence by using a first camera and a second camera, respectively, and obtaining white light image data and first long-wavelength fluorescence image data, respectively.

[0013] S5: collecting the short-wavelength fluorescence and the second long-wavelength fluorescence by using the first camera and the second camera, respectively, and obtaining short-wavelength fluorescence image data and second long-wavelength fluorescence image data, respectively.

[0014] Steps S4 and S5 are performed at different times according to the current light-splitting condition of the light-splitting prism.

[0015] S6: image fusion processing is performed on the white light image data, the first long-wavelength fluorescent image data, the short-wavelength fluorescent image data, and the second long-wavelength fluorescent image data to obtain a fusion image.

[0016] Further, the setting of the light emission logic in step S1 includes the following steps:

[0017] S11: the fusion light source emits the white light and the long-wavelength excitation light, and then turns off.

[0018] S12: then emits the short-wavelength excitation light, and then turns off.

[0019] S13: steps S11-S12 are repeated to perform alternating light emission.

[0020] Further, the light collection in step S2 includes the following steps:

[0021] S21: the white light and the long-wavelength excitation light are transmitted to the vicinity of the lens through a light guide beam, the long-wavelength excitation light irradiates the imaging area and excites the first long-wavelength fluorescent light, and the white light is reflected.

[0022] S22: the lens collects the white light and the first long-wavelength fluorescent light and projects them to the light splitting prism.

[0023] S23: the light splitting prism projects the white light to the first camera through a first light path and projects the first long-wavelength fluorescent light to the second camera through a second light path.

[0024] Further, the light collection in step S3 includes the following steps:

[0025] S31: the short-wavelength excitation light is transmitted to the vicinity of the lens through a light guide beam, the short-wavelength excitation light irradiates the imaging area and excites the short-wavelength fluorescent light and the second long-wavelength fluorescent light.

[0026] S32: the lens collects the short-wavelength fluorescent light and the second long-wavelength fluorescent light and projects them to the light splitting prism.

[0027] S33: the light splitting prism projects the short-wavelength fluorescent light to the first camera through a first light path and projects the second long-wavelength fluorescent light to the second camera through a second light path.

[0028] Further, an optical filter arranged at the front end of the lens transmits the white light and the first long-wavelength fluorescent light, or the short-wavelength fluorescent light and the second long-wavelength fluorescent light, and cuts off the long-wavelength excitation light or the short-wavelength excitation light.

[0029] Further, the time-sharing light acquisition of the first camera and the second camera in steps S4 and S5 further comprises the following steps:

[0030] The light acquisition logic of the first camera and the second camera is set respectively, and the light acquisition is performed according to the light acquisition logic, that is, the first camera acquires the white light and the short-wavelength fluorescence in time-sharing mode, and the second camera acquires the first long-wavelength fluorescence and the second long-wavelength fluorescence in time-sharing mode.

[0031] Further, the image data processing in step S6 comprises:

[0032] S61: performing image addition processing on the first long-wavelength fluorescence image data and the second long-wavelength fluorescence image data to obtain long-wavelength fluorescence image data.

[0033] S62: performing image enhancement on the white light image data, the short-wavelength fluorescence image data, and the long-wavelength fluorescence image data respectively, and performing image registration and image fusion to obtain the fusion image.

[0034] Further, the imaging region is a near-infrared spectral region, and the first fluorescent drug and the second fluorescent drug are mixed in the imaging region, and the excitation peak of the first fluorescent drug is greater than the excitation peak of the second fluorescent drug.

[0035] The first long-wavelength fluorescence and the second long-wavelength fluorescence are both the fluorescence generated after the first fluorescent drug is excited, and the second long-wavelength fluorescence is weaker than the first long-wavelength fluorescence.

[0036] The wavelength of the long-wavelength excitation light is near the excitation peak of the first fluorescent drug, and the wavelength of the short-wavelength excitation light is near the excitation peak of the second fluorescent drug.

[0037] A medical dual-fluorescence imaging device for fusing a white light background image, which applies the medical dual-fluorescence imaging method for fusing a white light background image, comprising:

[0038] The master control module, the fusion light source module, the first camera, the second camera, the lens and the light splitting prism, the master control module is communicated with the fusion light source module and is communicated with the first camera and the second camera respectively, the master control module outputs the light emitting instruction to the fusion light source module and sends the collection instruction to the first camera and the second camera respectively; the fusion light source module is pre-set with the light emitting logic, and white light and long-wavelength excitation light or single short-wavelength excitation light are emitted to the imaging area according to the light emitting instruction and the light emitting logic; the lens is placed above the imaging area and is used for collecting and outputting the reflection of the white light and the excited first long-wavelength fluorescence, short-wavelength fluorescence and second long-wavelength fluorescence in time; the light splitting prism is placed in the light emitting direction of the lens and is provided with a first light path and a second light path, and is used for receiving the white light and the first long-wavelength fluorescence, the short-wavelength fluorescence and the second long-wavelength fluorescence in time and projecting the white light and the short-wavelength fluorescence to the first camera through the first light path and projecting the first long-wavelength fluorescence and the second long-wavelength fluorescence to the second camera through the second light path; the first camera is used for converting and processing the white light and the short-wavelength fluorescence in time and outputting white light image data and short-wavelength fluorescence data to the master control module; the second camera is used for converting and processing the first long-wavelength fluorescence and the second long-wavelength fluorescence in time and outputting first long-wavelength fluorescence data and second long-wavelength fluorescence data to the master control module; and the master control module is used for processing the white light image data, the short-wavelength fluorescence data, the first long-wavelength fluorescence data and the second long-wavelength fluorescence data and outputting a fusion image.

[0039] Further, the scheme further includes an optical filter, which is placed in front of the lens, is used for increasing the transmittance of the white light and the first long-wavelength fluorescence or the short-wavelength fluorescence and the second long-wavelength fluorescence, and has a transmittance of more than 85%; and is used for cutting off the long-wavelength excitation light or the short-wavelength excitation light and has a cutoff degree of more than OD4.

[0040] Therefore, the present application has the following beneficial effects:

[0041] 1. The application is to emit white light together with long-wavelength fluorescent excitation light according to a pre-set light-emitting sequence, emit short-wavelength excitation light alternately and time-sharingly, and carry out time-sharing light splitting and collection, specifically, the white light and long-wavelength fluorescence are split by a light splitting prism and then collected by two cameras respectively, then the short-wavelength fluorescence and weak long-wavelength fluorescence excited by the separate short-wavelength excitation light are split and also collected by the two cameras respectively, so that the white light and short-wavelength fluorescence are collected by the same camera to generate corresponding image data, and the two long-wavelength fluorescences collected in sequence are collected by the same camera to generate corresponding image data, so that the white light background image is fused when the double fluorescences are simultaneously developed and imaged, the needs of developing the fluorescence development area, instruments and other tissues are met, and doctors can identify the fluorescence development area, instruments and other tissues, which is convenient for operation.

[0042] 2. The application only needs to design a double prism with two light paths to realize light splitting, and can be implemented based on the current common double prism, four-prism single-fluorescence surgical navigation imaging equipment, and the structure and production are relatively simple compared with the existing prism design scheme.

[0043] 3. The application can maximize the avoidance of interference between fluorescence signals by splitting the short-wavelength fluorescence and weak long-wavelength fluorescence excited by the short-wavelength excitation light and collecting them by two cameras respectively.

[0044] 4. The application splits light by a light splitting prism and collects short-wave and long-wave light signals by two cameras according to the collection sequence, avoids the problem that the existing color camera causes the image to be dark and the definition to be poor by adjusting the white light brightness, and can maintain the brightness of the fused image consistent with the current common double prism, four-prism single-fluorescence surgical navigation imaging equipment.

[0045] The application will be further described in detail in combination with the drawings and specific embodiments. BRIEF DESCRIPTION OF DRAWINGS

[0046] Figure 1 It is a medical double-fluorescence imaging method process diagram of the application fusing white light background image.

[0047] Figure 2 It is a process diagram of the application fusing light source time-sharing light emission and camera time-sharing collection.

[0048] Figure 3 It is a light splitting diagram of the light splitting prism of the application.

[0049] Figure 4 It is a filter anti-reflection and cut-off spectrum diagram of the application.

[0050] Figure 5 It is a medical double-fluorescence imaging device diagram of the application fusing white light background image. Detailed Implementation

[0051] To make the objectives, technical solutions, and advantages of the embodiments of the present invention clearer, the technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some, not all, of the embodiments of the present invention. All other embodiments obtained by those skilled in the art based on the described embodiments of the present invention without creative effort are within the scope of protection of the present invention.

[0052] An embodiment of a medical dual-fluorescence imaging method and device for fusing white background images

[0053] See Figure 1 The present invention relates to a medical dual-fluorescence imaging method that fuses white light background images, comprising:

[0054] S1: Set the light output logic of the fusion light source and illuminate the imaging area according to the light output logic. The light output logic is: white light and long-wavelength excitation light are emitted simultaneously and are emitted at different times than short-wavelength excitation light.

[0055] S2: Simultaneously collect the reflected white light and the first long-wavelength fluorescence excited by the long-wavelength excitation light, and use a beam splitter to separate the white light and the first long-wavelength fluorescence.

[0056] S3: Simultaneously collect the short-wavelength fluorescence and the second long-wavelength fluorescence excited by the short-wavelength excitation light, and use the beam splitter to split the short-wavelength fluorescence and the second long-wavelength fluorescence.

[0057] Steps S2 and S3 are performed in time-division according to the current illumination light received by the imaging area.

[0058] S4: Use the first camera and the second camera to collect the white light and the first long-wavelength fluorescence respectively, and obtain white light image data and first long-wavelength fluorescence image data respectively.

[0059] S5: Use the first camera and the second camera to collect the short-wavelength fluorescence and the second long-wavelength fluorescence respectively, and obtain short-wavelength fluorescence image data and second long-wavelength fluorescence image data respectively.

[0060] Steps S4 and S5 are performed in time-division manner according to the current beam splitting situation of the beam splitter.

[0061] S6: Perform image fusion processing on the white light image data, the first long-wavelength fluorescence image data, the short-wavelength fluorescence image data, and the second long-wavelength fluorescence image data to obtain a fused image.

[0062] Specifically, the embodiment takes the scene of using indocyanine green and methylene blue as an example:

[0063] The excitation peak of the indocyanine green (ICG) is about 780 nm, and the emission peak is about 830 nm, that is, the fluorescence generated by the indocyanine green is long-wavelength fluorescence; the excitation peak of the methylene blue (MB) is about 665 nm, and the emission peak is about 688 nm, that is, the fluorescence generated by the methylene blue is short-wavelength fluorescence; both of the two fluorescent drugs are in the near-infrared spectrum band.

[0064] Among them, indocyanine green is commonly used for blood vessel, lymph, tumor tracing, observation of anastomotic fistula during surgery, and is injected through veins, lymphatic vessels and tumors, metabolized through the liver and intestinal tract, and finally excreted out of the body in the form of feces, so it has disadvantages in ureter imaging; while methylene blue is mostly metabolized by the kidney after intravenous injection, and finally excreted out of the body in the form of urine, and can be used for ureter imaging. Therefore, in some urological surgery, it is necessary to inject indocyanine green and methylene blue at the same time, and use the two drugs in combination to perform double-fluorescence imaging.

[0065] In the embodiment, the setting of the light emission logic in step S1 includes the following steps:

[0066] S11: The fusion light source emits the white light and the long-wavelength excitation light, and turns off after emitting.

[0067] S12: Then emit the short-wavelength excitation light, and turn off after emitting.

[0068] S13: Repeat steps S11-S12 to perform alternating light emission.

[0069] Referring to Figure 2 Specifically, in the embodiment, the light emission logic of the fusion light source corresponds to a group of light emission sequences, and the light collection logics of the first camera and the second camera correspond to a group of light collection sequences, respectively. The light emission sequence and the light collection sequence correspond to each other in the time sequence of acquiring corresponding image data.

[0070] For example, in the acquisition of the first frame of the fusion image, the light source emits white light and the excitation light of indocyanine green according to the light emission sequence of the fusion light source. The excitation light of indocyanine green is the long-wavelength excitation light mentioned above. At this time, the white light is reflected, and the indocyanine green is excited by the long-wavelength excitation light to emit indocyanine green fluorescence, which is the first long-wavelength fluorescence mentioned above. Correspondingly, at this time, the first camera collects the white light after being split according to the light collection sequence of the first camera, and the second camera collects the first long-wavelength fluorescence after being split according to the light collection sequence of the second camera, and white light image data and first long-wavelength fluorescence image data are generated after data processing; then, after the white light and the long-wavelength excitation light are turned off, the fusion light source emits the excitation light of methylene blue alone, which is the short-wavelength excitation light mentioned above. At this time, the methylene blue and the indocyanine green are excited by the short-wavelength excitation light to emit short-wavelength fluorescence and second long-wavelength fluorescence, respectively. Correspondingly, at this time, the first camera collects the short-wavelength fluorescence after being split according to the light collection sequence of the first camera, and the second camera collects the second long-wavelength fluorescence after being split according to the light collection sequence of the second camera, and short-wavelength fluorescence image data and second long-wavelength fluorescence image data are generated after data processing. The white light image data, the first long-wavelength fluorescence image data, the short-wavelength fluorescence image data, and the second long-wavelength fluorescence image data are processed by image fusion to obtain the fusion image of this frame. Thereafter, each frame of the fusion image is acquired according to the above-mentioned sequence.

[0071] In the present embodiment, the light collection in step S2 includes the following steps:

[0072] S21: The white light and the long-wavelength excitation light are transmitted to the vicinity of the lens through the light guide beam, the long-wavelength excitation light irradiates the imaging area and excites the first long-wavelength fluorescence, and the white light is reflected.

[0073] S22: The lens collects the white light and the first long-wavelength fluorescence and projects them to the light splitting prism.

[0074] S23: The light splitting prism projects the white light to the first camera through the first light path and projects the first long-wavelength fluorescence to the second camera through the second light path.

[0075] Referring to Figure 3 Specifically, the light splitting prism in the present embodiment adopts a double prism, the first light path is used for transmitting light with a wavelength of 420-720 nm, the second light path is used for reflecting light with a wavelength of 800-900 nm, and the light emission interval of the first light path and the second light path is about 80 nm.

[0076] Specifically, the fusion light source in this embodiment uses LED white light and excitation light with a wavelength of 785 nm, and the wavelength of the LED white light is 450-460 nm. The spectrum of the excitation light is close to the excitation peak (about 780 nm) of indocyanine green. Under the excitation of light at this wavelength, indocyanine green can absorb the maximum amount of light energy and reach the highest excited state, thereby exciting higher emission light intensity with the lowest excitation light power. At this time, the excitation efficiency of the excitation light is the highest.

[0077] Then, after the imaging area is irradiated by the LED white light and the excitation light with a wavelength of 785 nm, the LED white light is reflected, and the indocyanine green emits strong fluorescence with a wavelength of about 840 nm, i.e., the first long-wavelength fluorescence, after being excited near its excitation peak. The LED white light and the first long-wavelength fluorescence are collected by the lens and projected to the double prism. The double prism separates the light spectrum by using the refraction characteristics of light waves. Specifically, the LED white light is transmitted through the first light path, and the first long-wavelength fluorescence is reflected through the second light path.

[0078] In this embodiment, the collection of light in step S3 includes the following steps:

[0079] S31: The short-wavelength excitation light is transmitted to the vicinity of the lens by a light guide beam. The short-wavelength excitation light irradiates the imaging area and excites the short-wavelength fluorescence and the second long-wavelength fluorescence.

[0080] S32: The lens collects the short-wavelength fluorescence and the second long-wavelength fluorescence and projects them to the light-splitting prism.

[0081] S33: The light-splitting prism projects the short-wavelength fluorescence to the first camera through the first light path and projects the second long-wavelength fluorescence to the second camera through the second light path.

[0082] Specifically, the fusion light source in this embodiment uses 660 nm excitation light. The spectrum of the excitation light is close to the excitation peak (about 665 nm) of methylene blue. Under the excitation of light at this wavelength, methylene blue can absorb the maximum amount of light energy and reach the highest excited state, thereby exciting higher emission light intensity with the lowest excitation light power. At this time, the excitation efficiency of the excitation light is the highest.

[0083] Then, after the imaging area is irradiated by excitation light of 660 nm, methylene blue is excited to emit fluorescence of about 694 nm, i.e. the short-wavelength fluorescence, and indocyanine green is also excited to emit weak fluorescence of about 840 nm, i.e. the second long-wavelength fluorescence. The short-wavelength fluorescence and the second long-wavelength fluorescence are collected by the lens and projected to the double prism. The double prism separates the light waves according to the refraction characteristics, and the short-wavelength fluorescence is transmitted through the first light path, and the second long-wavelength fluorescence is reflected by the second light path.

[0084] In this embodiment, the filter arranged at the front end of the lens transmits the white light and the first long-wavelength fluorescence or the short-wavelength fluorescence and the second long-wavelength fluorescence, and cuts off the long-wavelength excitation light or the short-wavelength excitation light.

[0085] Referring to Figure 4 Specifically, the filter of this embodiment selectively transmits or reflects light of different wavelengths. The transmittance of the filter in the cut-off band of the excitation light of 660 nm and 785 nm is less than 0.01%, i.e. the corresponding cut-off effect reaches OD4 or more, and the transmittance of the filter for the LED white light, the long-wavelength fluorescence and the short-wavelength fluorescence is more than 85%, which can effectively transmit the white light and the fluorescence and filter out the interference of the excitation light.

[0086] In this embodiment, the time-sharing light collection of the first camera and the second camera in steps S4 and S5 further includes the following steps:

[0087] The light collection logic of the first camera and the second camera is respectively arranged and the light collection is performed according to the light collection logic. The light collection logic is that the first camera time-sharing collects the white light and the short-wavelength fluorescence, and the second camera time-sharing collects the first long-wavelength fluorescence and the second long-wavelength fluorescence.

[0088] In this embodiment, the image data processing in step S6 includes:

[0089] S61: performing image addition processing on the first long-wavelength fluorescence image data and the second long-wavelength fluorescence image data to obtain long-wavelength fluorescence image data.

[0090] S62: performing image enhancement on the white light image data, the short-wavelength fluorescence image data and the long-wavelength fluorescence image data respectively, and performing image registration and image fusion to obtain the fusion image.

[0091] In this embodiment, the imaging area is a near-infrared spectral region, and the first fluorescent drug and the second fluorescent drug are mixed in the imaging area. The excitation peak of the first fluorescent drug is greater than the excitation peak of the second fluorescent drug.

[0092] The first long-wavelength fluorescence and the second long-wavelength fluorescence are both fluorescences generated after the first fluorescent drug is excited, and the second long-wavelength fluorescence is weaker than the first long-wavelength fluorescence.

[0093] The wavelength of the long-wavelength excitation light is near the excitation peak of the first fluorescent drug, and the wavelength of the short-wavelength excitation light is near the excitation peak of the second fluorescent drug.

[0094] Specifically, the first fluorescent drug in the embodiment is indocyanine green, and the excitation peak thereof is about 780 nm. The second fluorescent drug is methylene blue, and the excitation peak thereof is about 665 nm. The first long-wavelength fluorescence is relatively strong fluorescence excited by 785 nm excitation light irradiating indocyanine green, and the second long-wavelength fluorescence is relatively weak fluorescence excited by 660 nm excitation light irradiating indocyanine green. The wavelength of the long-wavelength excitation light is 785 nm, which is near the excitation peak 780 nm of indocyanine green. The wavelength of the short-wavelength excitation light is 660 nm, which is near the excitation peak 665 nm of methylene blue.

[0095] Specifically, the above-mentioned embodiment about the use of indocyanine green and methylene blue is only exemplary, and is not the only way. Different fluorescent drugs can be selected according to the application scenario, and excitation light near the excitation peak of each fluorescent drug is selected to excite fluorescence. According to the principle of spectral separation of light wave by combining the refraction characteristics of the prism, the prism can be designed to better achieve spectral separation.

[0096] A medical dual-fluorescence imaging device for fusing a white light background image

[0097] Referring to Figure 5 A medical dual-fluorescence imaging device for fusing a white light background image, applying the medical dual-fluorescence imaging method for fusing a white light background image, comprising:

[0098] The master module 10, the fusion light source module 20, the first camera 30, the second camera 40, the lens 50 and the light splitting prism 60, the master module 10 is in communication connection with the fusion light source module 20, and is in data communication connection with the first camera 30 and the second camera 40 respectively, the master module 10 outputs a light-emitting instruction to the fusion light source module 20, and respectively sends a collection instruction to the first camera 30 and the second camera 40; the fusion light source module 20 is pre-set with light-emitting logic, for emitting white light and long-wavelength excitation light or separate short-wavelength excitation light to the imaging area 200 according to the light-emitting instruction and the light-emitting logic; the lens 50 is placed above the imaging area 200, for collecting and outputting the reflected light of the white light and the excited first long-wavelength fluorescence, the excited short-wavelength fluorescence and the second long-wavelength fluorescence in time sharing; the light splitting prism 60 is placed in the light-emitting direction of the lens 50, and is provided with a first light path and a second light path, for receiving the white light and the first long-wavelength fluorescence, the short-wavelength fluorescence and the second long-wavelength fluorescence in time sharing, and projecting the white light, the short-wavelength fluorescence to the first camera 30 through the first light path, and projecting the first long-wavelength fluorescence, the second long-wavelength fluorescence to the second camera 40 through the second light path in time sharing; the first camera 30 is used for signal conversion and processing of the white light and the short-wavelength fluorescence in time sharing, and outputs white light image data and short-wavelength fluorescence data to the master module 10; the second camera 40 is used for signal conversion and processing of the first long-wavelength fluorescence and the second long-wavelength fluorescence in time sharing, and outputs first long-wavelength fluorescence data and second long-wavelength fluorescence data to the master module 10; the master module 10 is used for image processing of the white light image data, the short-wavelength fluorescence data, the first long-wavelength fluorescence data and the second long-wavelength fluorescence data, and outputs a fusion image.

[0099] Specifically, the master module 10 of the embodiment at least includes an interface module, a communication module, an image processor GPU, a central processor CPU and a peripheral circuit, the interface module is in data communication connection with the first camera 30 and the second camera 40, for image data receiving and communication; the communication module is in RS232 serial communication with the fusion light source module 20; the image processor GPU is used for image data calculation and image display output, and the central processor CPU is used for logical control.

[0100] Specifically, the fusion light source module 20 in the embodiment includes a light source generating module, a plurality of control switches, a light combining module, and a light output module. The light source generating module is configured to emit an excitation light source. The excitation light source can be a laser light source, a monochromatic LED light source, or the like, so as to meet the requirements of excitation spectral range, excitation light intensity, and light emission timing control. The plurality of control switches are respectively configured to control the emission or shutdown of white light and long-wavelength excitation light, and the emission or shutdown of short-wavelength excitation light. The light combining module is configured to combine the light paths of the white light, the long-wavelength excitation light, and the short-wavelength excitation light into one light path and output through the light path. The light output module includes a light output interface, a light guide beam, and a beam expander. The light output interface adopts an SMA905 interface to output light so as to ensure the effective transmission of optical signals. The light guide beam is configured to efficiently transmit the white light and the long-wavelength excitation light or the short-wavelength excitation light alone to the vicinity of the lens 50. The beam expander is arranged on the light output port and is configured to expand the diameter of the laser beam and reduce the divergence angle of the laser beam, so that the laser can be transmitted to the imaging area 200 in a more concentrated manner.

[0101] Specifically, the master control module 10 and the fusion light source module 20 in the embodiment can be independent devices that communicate through an external interface, or can be integrated into the same device and communicate through an internal interface. For example, the master control module 10 can be integrated into a computer host, and the fusion module can be integrated into a separate device. The computer host can be based on a Windows, Linux, or the like operating system, and the data processing and calculation can be based on a CPU, GPU, or FPGA. An independent graphics card is provided, and the first camera 30 and the second camera 40 are connected through a USB interface of the computer host to receive image data and communicate. The fusion light source module 20 is connected through an RS232 serial communication interface to establish serial communication. The display device 300 is connected through an HDMI interface to display the fusion image.

[0102] Specifically, the first camera 30 and the second camera 40 in the embodiment adopt the same type of CMOS Mono camera, which has a low cost and a higher quantum efficiency than a Bayer camera. The camera is integrated with a USB interface, a BNC interface, and other rich peripheral interfaces. The camera is connected with the host through the USB interface for data transmission and communication, and is controlled through the BNC interface. The camera frame rate is greater than 120 fps to meet the video output of 60 fps of the entire device. The minimum exposure time is 10 us, which is convenient for overexposure adjustment.

[0103] Specifically, the lens 50 in the embodiment adopts an infrared anti-reflection 8mm fixed-focus C port lens, which can effectively collect near-infrared fluorescence while meeting the requirements of a certain field of view.

[0104] Specifically, the light splitting prism 60 of the embodiment adopts a double prism, the first light path is used for transmitting light with a wavelength of 420nm-720nm, the second light path is used for reflecting light with a wavelength of 800nm-900nm, and the light interval between the first light path and the second light path is about 80nm, so that better interference between the two light paths can be avoided.

[0105] Specifically, the double prism adopted in the embodiment is only exemplary and is not the only way. For example, the light splitting prism 60 can adopt a 4-prism. When the white light and the first long-wavelength fluorescent light are incident, the white light is split into R, G, and B (red, green, and blue) three primary color light outputs, and the first long-wavelength fluorescent light is output in one way. When the short-wavelength fluorescent light is incident, the short-wavelength fluorescent light is output in the same light path as the R light, and the second long-wavelength fluorescent light is output in the same light path as the first long-wavelength fluorescent light.

[0106] In the embodiment, the filter 70 is further included, which is arranged at the front end of the lens 50 and is used for increasing the transmittance of the white light and the first long-wavelength fluorescent light or the short-wavelength fluorescent light and the second long-wavelength fluorescent light, the transmittance being greater than 85%; and is used for cutting off the long-wavelength excitation light or the short-wavelength excitation light, the cut-off degree being greater than OD4.

[0107] Specifically, the filter 70 of the embodiment can be arranged in front of the lens 50, or can be simplified and divided into two or four pieces and arranged between the light splitting prism 60 and the first camera 30 and between the light splitting prism 60 and the second camera 40.

[0108] The above-described embodiments are only preferred embodiments of the present application, and cannot be used to limit the scope of protection of the present application. Any non-essential changes and replacements made by those skilled in the art on the basis of the present application are within the scope of protection of the present application.

Claims

1. A medical dual-fluorescence imaging method of fusing a white light background image, characterized by, Comprising: S1: set the light-emitting logic of the fusion light source and irradiate the imaging area according to the light-emitting logic, the light-emitting logic is that the white light and the long-wavelength excitation light are emitted at the same time, and the short-wavelength excitation light is emitted at different times; Wherein, the imaging area is the near-infrared spectral region; S2: simultaneously collect the reflected white light and the first long-wavelength fluorescence excited by the long-wavelength excitation light, and use a beam splitter to split the white light and the first long-wavelength fluorescence; S3: simultaneously collect the short-wavelength fluorescence and the second long-wavelength fluorescence excited by the short-wavelength excitation light, and use the beam splitter to split the short-wavelength fluorescence and the second long-wavelength fluorescence; Steps S2 and S3 are performed at different times according to the current irradiation light received by the imaging area; S4: use the first camera and the second camera to collect the white light and the first long-wavelength fluorescence respectively, and obtain white light image data and first long-wavelength fluorescence image data respectively; S5: use the first camera and the second camera to collect the short-wavelength fluorescence and the second long-wavelength fluorescence respectively, and obtain short-wavelength fluorescence image data and second long-wavelength fluorescence image data respectively; Steps S4 and S5 are performed at different times according to the current splitting of the beam splitter; S6: image fusion processing is performed on the white light image data, the first long-wavelength fluorescence image data, the short-wavelength fluorescence image data, and the second long-wavelength fluorescence image data to obtain a fusion image.

2. The method of claim 1, wherein the white light background image is fused with the medical dual fluorescence image. The setting of the light-emitting logic in step S1 includes the following steps: S11: the fusion light source emits the white light and the long-wavelength excitation light, and turns off after emitting; S12: then emit the short-wavelength excitation light, and turn off after emitting; S13: repeat steps S11-S12 to perform alternating light emission.

3. The method of claim 1, wherein the white light background image is fused with the medical dual fluorescence image. The light collection in step S2 includes the following steps: S21: the white light and the long-wavelength excitation light are transmitted to the lens through a light guide beam, the long-wavelength excitation light irradiates the imaging area and excites the first long-wavelength fluorescence, and the white light is reflected; S22: the lens collects the white light and the first long-wavelength fluorescence and projects them to the beam splitter; S23: the beam splitter projects the white light to the first camera through a first light path and projects the first long-wavelength fluorescence to the second camera through a second light path.

4. The method of claim 1, wherein the method is a medical dual- fluorescence imaging method of fusing a white light background image, characterized by, The light collection in step S3 includes the following steps: S31: the short-wavelength excitation light is transmitted to the lens through a light guide beam, the short-wavelength excitation light irradiates the imaging area and excites the short-wavelength fluorescence and the second long-wavelength fluorescence; S32: the lens collects the short-wavelength fluorescence and the second long-wavelength fluorescence and projects them to the beam splitter; S33: the beam splitter projects the short-wavelength fluorescence to the first camera through a first light path and projects the second long-wavelength fluorescence to the second camera through a second light path.

5. The medical dual-fluorescence imaging method of fusing white light background images according to any one of claims 3-4, characterized in that: The filter arranged at the front end of the lens transmits the white light and the first long-wavelength fluorescence or the short-wavelength fluorescence and the second long-wavelength fluorescence, and cuts off the long-wavelength excitation light or the short-wavelength excitation light.

6. The method of claim 1, wherein the method is a medical dual- fluorescence imaging method of fusing a white light background image, characterized by, The time-sharing light acquisition of the first camera and the second camera in steps S4 and S5 further includes the following steps: The light acquisition logic of the first camera and the second camera is respectively arranged and the light acquisition is performed according to the light acquisition logic, that is, the first camera acquires the white light and the short-wavelength fluorescence in time-sharing mode, and the second camera acquires the first long-wavelength fluorescence and the second long-wavelength fluorescence in time-sharing mode.

7. The method of claim 1, wherein the method is a medical dual- fluorescence imaging method of fusing a white light background image, characterized by, The image data processing in step S6 includes: S61: performing image addition processing on the first long-wavelength fluorescence image data and the second long-wavelength fluorescence image data to obtain long-wavelength fluorescence image data; S62: performing image enhancement on the white light image data, the short-wavelength fluorescence image data and the long-wavelength fluorescence image data respectively, and performing image registration and image fusion to obtain the fusion image.

8. The medical dual-fluorescence imaging method for fusing a white light background image according to claim 7, characterized in that: The imaging region is a near-infrared spectrum region, and the first fluorescent drug and the second fluorescent drug are mixed in the imaging region, and the excitation peak of the first fluorescent drug is greater than the excitation peak of the second fluorescent drug; The first long-wavelength fluorescence and the second long-wavelength fluorescence are both the fluorescence generated after the first fluorescent drug is excited, and the second long-wavelength fluorescence is weaker than the first long-wavelength fluorescence; The wavelength of the long-wavelength excitation light is near the excitation peak of the first fluorescent drug, and the wavelength of the short-wavelength excitation light is near the excitation peak of the second fluorescent drug.

9. A medical dual-fluorescence imaging apparatus that fuses a white light background image, characterized by The application of the medical dual-fluorescence imaging method for fusing a white light background image according to any one of claims 1-8 includes: The master control module, the fusion light source module, the first camera, the second camera, the lens, and the light splitting prism are in communication connection, and the master control module is in data communication connection with the first camera and the second camera respectively. The master control module outputs light emission instructions to the fusion light source module and sends collection instructions to the first camera and the second camera respectively. The fusion light source module is pre-set with light emission logic for emitting white light and long-wavelength excitation light or separate short-wavelength excitation light to an imaging area according to the light emission instructions and the light emission logic. The lens is placed above the imaging area for collecting and outputting the reflected light of the white light and the excited first long-wavelength fluorescence, short-wavelength fluorescence, and second long-wavelength fluorescence in time. The light splitting prism is placed in the light emission direction of the lens and is provided with a first light path and a second light path for receiving the white light and the first long-wavelength fluorescence, the short-wavelength fluorescence, and the second long-wavelength fluorescence in time and projecting the white light and the short-wavelength fluorescence to the first camera through the first light path and projecting the first long-wavelength fluorescence and the second long-wavelength fluorescence to the second camera through the second light path in time. The first camera is used for signal conversion and processing of the white light and the short-wavelength fluorescence in time and outputs white light image data and short-wavelength fluorescence data to the master control module. The second camera is used for signal conversion and processing of the first long-wavelength fluorescence and the second long-wavelength fluorescence in time and outputs first long-wavelength fluorescence data and second long-wavelength fluorescence data to the master control module. The master control module is used for image processing of the white light image data, the short-wavelength fluorescence data, the first long-wavelength fluorescence data, and the second long-wavelength fluorescence data and outputs a fusion image.

10. The medical dual-fluorescence imaging device for fusing a white light background image according to claim 9, further comprising a filter placed at the front end of the lens for increasing the transmittance of the white light and the first long-wavelength fluorescence or the short-wavelength fluorescence and the second long-wavelength fluorescence, and the transmittance is greater than 85%, and for cutting off the long-wavelength excitation light or the short-wavelength excitation light, and the cut-off degree is greater than OD4. ​

Images