Fluorescence image processing method and fluorescence endoscope system

Abstract

The application relates to a fluorescent image processing method and a fluorescent endoscope system. In a fluorescent mode, a detected object marked by a fluorescent agent is illuminated based on detection light, the detection light comprising white light and excitation light emitted in a set light emission mode; light signals from the detected object are collected based on a collection mode corresponding to the light emission mode, a first image is obtained based on first waveband light signals, and a second image is obtained based on second waveband light signals; the first waveband is set based on a spectral range of fluorescent light excited by the excitation light, and the second waveband is set based on a spectral range of the white light; the first image and the second image are fused to obtain a fluorescent detection image of the detected object, thereby solving the problem of unclear imaging of a fluorescent marking peripheral region and improving overall imaging effect.

Description

Technical Field

[0001] This application relates to the field of fluorescence image processing technology, and in particular to a fluorescence image processing method and a fluorescence endoscope system. Background Technology

[0002] 5-ALA is a fluorescent contrast agent used in clinical surgery and examinations. Its main mechanism is that it is metabolized in the human body to produce PpIX, which has a fluorescent effect. The excitation light is around 405 nm, and the fluorescence is around 600 nm-720 nm. By observing the different metabolic rates of PpIX in different sites, the surgical area can be located.

[0003] Because the fluorescence band emitted by PpIX overlaps with the visible light band, most existing 5-ALA fluorescent labeling scenarios use the native fluorescence image directly as the final display image. Specifically, this is achieved by using excitation light illumination and setting a filter to block most of the excitation light. The object being tested is then illuminated by the weak excitation light passing through the filter. This weak excitation light can excite fluorescence and also illuminate surrounding tissue. The native fluorescence image acquired at this point is then used as the final display image.

[0004] However, the native fluorescence scheme produces poor imaging results around the fluorescent area, making it impossible to observe the tissue around the fluorescent area in detail. Summary of the Invention

[0005] This embodiment provides a fluorescence image processing method and a fluorescence endoscope system to solve the problem of poor imaging effect around the fluorescence region in related technologies.

[0006] In a first aspect, this embodiment provides a fluorescence image processing method, the method comprising:

[0007] In fluorescence mode, the test object labeled with a fluorescent agent is illuminated based on detection light, which includes white light emitted in a set emission mode and excitation light;

[0008] Based on the acquisition method corresponding to the light emission mode, light signals from the object under test are acquired, a first image is obtained based on the light signal of the first band, and a second image is obtained based on the light signal of the second band; the first band is set based on the spectral range of fluorescence excited by the excitation light, and the second band is set based on the spectral range of white light;

[0009] The first image and the second image are fused to obtain a fluorescence detection image of the object being inspected.

[0010] In some embodiments, the emission mode is set according to the fluorescence intensity excited by the excitation light;

[0011] The method of setting the emission mode based on the fluorescence intensity excited by the excitation light includes:

[0012] When the fluorescence intensity excited by the excitation light meets the preset conditions, the emission mode adopts the method of emitting white light and excitation light simultaneously;

[0013] When the fluorescence intensity does not meet the preset conditions, the emission mode adopts the method of alternating emission of white light and excitation light according to the video frame rate.

[0014] In some embodiments, the acquisition method based on the light emission method includes:

[0015] When the light emission method is that the white light and the excitation light are emitted simultaneously, the acquisition method is to acquire the light signal of the first band and the light signal of the second band at the same time.

[0016] In some embodiments, the first image and the second image are fused to obtain a fluorescence detection image of the object being examined, including:

[0017] The first image includes a fluorescence image, and the second image includes a white light image;

[0018] Register the fluorescence image and the white light image;

[0019] After registration, the fluorescent region in the fluorescence image is superimposed with a preset color on the corresponding position in the white light image to obtain the fluorescence detection image of the object under test.

[0020] In some embodiments, the acquisition method based on the light emission method includes:

[0021] When the light emission method is that the white light and the excitation light are emitted alternately according to the video frame rate, the acquisition method is as follows: when the excitation light is irradiated alone, the light signal of the first band and the light signal of the second band are acquired simultaneously; when the white light is irradiated alone, only the light signal of the first band is acquired.

[0022] In some embodiments, the first image and the second image are fused to obtain a fluorescence detection image of the object being examined, including:

[0023] When the spectral range of the fluorescence partially overlaps with the spectral range of the white light, the first image and the second image are simultaneously acquired when the subject is irradiated with the excitation light alone. The first image includes a first frame of fluorescence path image, and the second image includes a first frame of white light path image.

[0024] At the moment when the white light is used to illuminate the object under inspection alone, the second image is acquired, and the second image includes a second frame of white light path image;

[0025] The first frame of the fluorescence path image and the first frame of the white light path image are combined to obtain an enhanced fluorescence image;

[0026] The enhanced fluorescence image and the second frame white light path image are superimposed to obtain the fluorescence detection image of the object under test.

[0027] In some embodiments, the enhanced fluorescence image and the second frame white light path image are superimposed to obtain a fluorescence detection image of the object under test, including:

[0028] The enhanced fluorescence image and the second frame white light path image are registered;

[0029] After registration, the fluorescent region of the enhanced fluorescence image is superimposed with a preset color on the corresponding position of the second frame white light path image to obtain the fluorescence detection image of the object under test.

[0030] Secondly, this embodiment provides a fluorescence endoscope system, the system comprising: a light source module, a camera module, a memory, and a processor;

[0031] The light source module is used to emit detection light;

[0032] The camera module is used to capture the first image and the second image;

[0033] The memory stores a computer program, and the processor executes the computer program to implement the steps of the method described in any one of the first aspects.

[0034] In some embodiments, the camera module further includes an optical unit, a beam splitting unit, a first imaging unit, and a second imaging unit;

[0035] The optical unit is used to collect light from the object being inspected and transmit the light to the beam splitting unit;

[0036] The beam splitting unit is used to split the received light into a first band of light signals and a second band of light signals, transmit the first band of light signals to the first imaging unit, and transmit the second band of light signals to the second imaging unit.

[0037] The first imaging unit is used to generate the first image based on the optical signal of the first wavelength band;

[0038] The second imaging unit is used to generate the second image based on the optical signal of the second band.

[0039] Thirdly, this application also provides a computer-readable storage medium. The computer-readable storage medium stores a computer program thereon, which, when executed by a processor, implements the fluorescence image processing method described in the first aspect.

[0040] Compared with related technologies, the fluorescence image processing method and fluorescence endoscopy system provided in this embodiment, in fluorescence mode, illuminate the subject marked with a fluorescent agent based on detection light, which includes white light emitted in a set emission mode and excitation light; based on the acquisition mode corresponding to the emission mode, light signals from the subject are acquired, a first image is obtained based on the light signal of a first band, and a second image is obtained based on the light signal of a second band; the first band is set based on the spectral range of fluorescence excited by the excitation light, and the second band is set based on the spectral range of white light; the first image and the second image are fused to obtain a fluorescence detection image of the subject, which solves the problem of unclear imaging of the surrounding area of ​​the fluorescent mark, realizes the acquisition of high-quality surrounding area information by illuminating the subject with white light, and can further fuse the fluorescent area with the surrounding area, improving the overall imaging effect, and is applicable to more fluorescence scenarios.

[0041] Details of one or more embodiments of this application are set forth in the following drawings and description to make other features, objects and advantages of this application more readily apparent. Attached Figure Description

[0042] The accompanying drawings, which are included to provide a further understanding of this application and form part of this application, illustrate exemplary embodiments of this application and are used to explain this application, but do not constitute an undue limitation of this application. In the drawings:

[0043] Figure 1 This is a flowchart illustrating a fluorescence image processing method in one embodiment;

[0044] Figure 2 This is a structural block diagram of a fluorescence endoscope system in one embodiment;

[0045] Figure 3 This is a structural block diagram of a fluorescence endoscope system in a preferred embodiment;

[0046] Figure 4 This is a structural block diagram of the camera module in a preferred embodiment;

[0047] Figure 5-A This is a schematic diagram of the fluorescence, white light, and excitation light spectra in one embodiment;

[0048] Figure 5-BThis is a schematic diagram of the transmittance curves of different filters in one embodiment;

[0049] Figure 6 This is a flowchart illustrating a fluorescence image processing method in a preferred embodiment;

[0050] Figure 7 This is a flowchart illustrating the fluorescence image processing method in another preferred embodiment.

[0051] Reference numerals: 310, Light source module; 320, Camera module; 330, Memory; 340, Processor; 410, Endoscope main unit; 411, Light source controller; 412, White light source; 413, Excitation light source; 414, Beam combiner; 415, Main controller; 416, Image processor; 420, Endoscope operating lever; 510, Optical unit; 520, Beam splitting unit; 530, First imaging unit; 531, Fluorescent path filter; 532, Fluorescent path image sensor; 540, Second imaging unit; 541, White light path filter; 542, White light path image sensor. Detailed Implementation

[0052] To better understand the purpose, technical solution, and advantages of this application, the application is described and illustrated below in conjunction with the accompanying drawings and embodiments.

[0053] Unless otherwise defined, the technical or scientific terms used in this application shall have the general meaning as understood by one of ordinary skill in the art to which this application pertains. Words such as “a,” “an,” “an,” “the,” “the,” and “these,” used in this application, do not indicate quantitative limitation and may be singular or plural. The terms “comprising,” “including,” “having,” and any variations thereof used in this application are intended to cover non-exclusive inclusion; for example, a process, method, system, product, or device that comprises a series of steps or modules (units) is not limited to the listed steps or modules (units) but may include steps or modules (units) not listed, or may include other steps or modules (units) inherent to such processes, methods, products, or devices. The terms “connected,” “linked,” and “coupled,” used in this application, are not limited to physical or mechanical connections but may include electrical connections, whether direct or indirect. The term “multiple” used in this application refers to two or more. The "and / or" operator describes the relationship between related objects, indicating that three relationships can exist. For example, "A and / or B" can represent three cases: A alone, A and B simultaneously, and B alone. Typically, the character " / " indicates that the objects before and after it are in an "or" relationship. The terms "first," "second," and "third," etc., used in this application are merely for distinguishing similar objects and do not represent a specific ordering of the objects.

[0054] This embodiment provides a fluorescence image processing method. Figure 1 This is a flowchart of the fluorescence image processing method in this embodiment, as follows: Figure 1 As shown, the process includes the following steps:

[0055] Step S210: In fluorescence mode, the test object labeled with fluorescent agent is illuminated based on detection light, which includes white light emitted in a set emission mode and excitation light.

[0056] Specifically, the set emission methods include emitting white light and excitation light simultaneously, or emitting white light and excitation light alternately.

[0057] Step S220: Based on the acquisition method corresponding to the emission mode, acquire the light signal from the object under test, obtain a first image based on the light signal of the first band, and obtain a second image based on the light signal of the second band; the first band is set based on the spectral range of the fluorescence excited by the excitation light, and the second band is set based on the spectral range of white light.

[0058] Specifically, when white light and excitation light are emitted simultaneously, the first and second images can be acquired at the same time. When white light and excitation light are emitted alternately, images of white light illumination alone and laser illumination alone need to be acquired. The first and second wavelength light signals can be separated using a beam-splitting device such as a beam splitter, and the separated light signals are acquired using an image sensor. When the fluorescence spectrum partially overlaps with the white light spectrum, the first wavelength includes the fluorescence spectrum after subtracting the white light spectrum that overlaps with the fluorescence spectrum. When the fluorescence spectrum does not overlap with the white light spectrum, the first wavelength includes the complete fluorescence spectrum.

[0059] Step S230: The first image and the second image are fused to obtain the fluorescence detection image of the object being inspected.

[0060] Specifically, the first image contains fluorescence information, and the second image contains white light information. By fusing the two, the fluorescently marked area and the surrounding area are clearly displayed in the same image.

[0061] In this embodiment, the method illuminates the fluorescently labeled object in fluorescence mode using detection light, which includes white light emitted in a set emission mode and excitation light. Based on a collection method corresponding to the emission mode, light signals from the object are collected. A first image is obtained based on the light signal in a first band, and a second image is obtained based on the light signal in a second band. The first band is set based on the spectral range of fluorescence excited by the excitation light, and the second band is set based on the spectral range of white light. The first and second images are fused to obtain a fluorescence detection image of the object, solving the problem of unclear imaging around the fluorescent label and improving the overall imaging effect.

[0062] In some embodiments, the method further includes setting the emission mode based on the fluorescence intensity emitted by the excited light.

[0063] The emission mode is set according to the fluorescence intensity excited by the excitation light, including: when the fluorescence intensity excited by the excitation light meets the preset conditions, the emission mode adopts the method of emitting white light and excitation light simultaneously; when the fluorescence intensity does not meet the preset conditions, the emission mode adopts the method of emitting white light and excitation light alternately according to the video frame rate.

[0064] Specifically, fluorescence intensity is determined based on statistical values ​​of fluorescence path brightness. For fluorescence of different intensities, a fixed amount of transmitted excitation light may overwhelm weak fluorescence. Therefore, different emission modes can be selected to obtain more fluorescence information when fluorescence intensities vary.

[0065] In some of these embodiments, based on the acquisition method corresponding to the emission mode, the acquisition method includes: when the emission mode is the simultaneous emission of white light and excitation light, the acquisition method is to acquire the light signal of the first band and the light signal of the second band at the same time.

[0066] Specifically, simultaneously acquiring optical signals from two different wavelengths avoids frame rate loss and helps improve the quality of the final fused image.

[0067] In some embodiments, the first image and the second image are fused to obtain a fluorescence detection image of the object being examined, including:

[0068] Step S310: The first image includes a fluorescence image, and the second image includes a white light image.

[0069] Step S320: Register the fluorescence image and the white light image.

[0070] Step S330: After registration, the fluorescent region in the fluorescence image is superimposed with a preset color on the corresponding position in the white light image to obtain the fluorescence detection image of the object under test.

[0071] Specifically, the fluorescent region in the registered fluorescence image can be extracted, and the fluorescent region can be marked at the corresponding position in the white light image by setting a false color. Alternatively, the registered fluorescence image can be mapped to a preset color according to its brightness, and the false color image can be superimposed on the white light image to finally display and output a fluorescence detection image with white light and fluorescence superposition.

[0072] In some of these embodiments, based on the acquisition method corresponding to the emission mode, the acquisition method includes: when the emission mode is white light and excitation light alternately emitted according to the video frame rate, the acquisition method is: when the excitation light is irradiated alone, the light signal of the first band and the light signal of the second band are acquired simultaneously; when the white light is irradiated alone, only the light signal of the first band is acquired.

[0073] Specifically, the two-source alternating emission method is suitable for situations where the pre-set second band partially overlaps with the fluorescence spectrum used. Therefore, when the excitation light is irradiated alone, a portion of the fluorescence signal can also be collected in the second band.

[0074] At this time, during image acquisition, the first image of the fluorescence path can be acquired every other frame, that is, acquired according to the frequency of excitation light activation, to obtain the first frame of the fluorescence path image. However, the second image of the white light path needs to be acquired frame by frame, that is, two adjacent frames are respectively under excitation light illumination and white light illumination, and one second image is acquired for each of the two adjacent frames, to obtain the first frame of the white light path image and the second frame of the white light path image.

[0075] By using the alternating sampling method described above, richer fluorescence information can be obtained.

[0076] In some embodiments, the first image and the second image are fused to obtain a fluorescence detection image of the object being examined, including:

[0077] Step S410: When the spectral range of fluorescence partially overlaps with the spectral range of white light, at the moment when the object under test is irradiated with excitation light alone, a first image and a second image are acquired simultaneously. The first image includes a first frame of fluorescence path image, and the second image includes a first frame of white light path image.

[0078] Step S420: At the moment when the object under inspection is illuminated with white light alone, a second image is acquired, the second image including a second frame of white light path image.

[0079] Step S430: Combine the first frame fluorescence path image and the first frame white light path image to obtain an enhanced fluorescence image.

[0080] Step S440: The enhanced fluorescence image and the second frame white light path image are superimposed to obtain the fluorescence detection image of the object under test.

[0081] Specifically, when the fluorescence intensity is weak, the first band may only collect a portion of the fluorescence energy, making it difficult to extract the fluorescent region. In this case, a frame alternation approach can be used to enhance the fluorescence signal collected in the first band by utilizing the fluorescence signal collected in the second band. This involves synthesizing the first frame fluorescence path image and the first frame white light path image to obtain an enhanced fluorescence image, thereby improving the imaging effect. The synthesis can employ methods such as weighted fusion, pyramid fusion, and Poisson fusion.

[0082] In some embodiments, the enhanced fluorescence image and the second frame of the white light path image are superimposed to obtain a fluorescence detection image of the object under test, including:

[0083] Step S441 involves registering the enhanced fluorescence image with the second frame of the white light path image.

[0084] Step S442 enhances the fluorescence region of the fluorescence image after registration and displays it in a preset color overlaid on the corresponding position of the second frame white light path image to obtain the fluorescence detection image of the object under test.

[0085] Specifically, the registered enhanced fluorescence image can be mapped to a preset color pseudo-color according to the brightness, and the pseudo-color image is superimposed on the white light image, finally displaying and outputting a fluorescence detection image with white light and fluorescence superposition.

[0086] This embodiment also provides a fluorescence endoscope system, see [link to documentation]. Figure 2 The system includes: a light source module 310, a camera module 320, a memory 330, and a processor 340.

[0087] The light source module 310 is used to emit detection light.

[0088] The camera module 320 is used to capture the first image and the second image.

[0089] The memory 330 stores a computer program, and the processor 340 executes the computer program to implement the steps of the method in any of the above embodiments.

[0090] For details, see Figure 3 The fluorescence endoscope system includes an endoscope main unit 410 and an endoscope operating lever 420. The endoscope main unit 410 houses a light source module 310, a memory 330, and a processor 340. The camera module 320 is located inside the endoscope operating lever 420. The light source module 310 includes a light source controller 411, a white light source 412, an excitation light source 413, and a beam combiner 414. The light source controller 411 controls the white light source 412 and the excitation light source 413 to irradiate the white light and excitation light according to a preset emission pattern. The white light and excitation light are emitted through the beam combiner 414 to irradiate the object being examined.

[0091] The processor 340 includes a main controller 415 and an image processor 416. The first and second images acquired by the camera module 320 are sent to the image processor 416, where fusion processing is performed to obtain a fluorescence detection image. The main controller 415 is used to control the image processing module, the light source control module, and other modules to perform corresponding tasks.

[0092] In some embodiments, the camera module 320 further includes an optical unit 510, a beam splitting unit 520, a first imaging unit 530, and a second imaging unit 540.

[0093] The optical unit 510 is used to collect light from the object being inspected and transmit the light to the beam splitting unit 520.

[0094] The beam splitting unit 520 is used to split the received light into a first band of optical signals and a second band of optical signals, and to transmit the first band of optical signals to the first imaging unit 530 and the second band of optical signals to the second imaging unit 540.

[0095] The first imaging unit 530 is used to generate a first image based on an optical signal of the first wavelength band.

[0096] The second imaging unit 540 is used to generate a second image based on the optical signal of the second band.

[0097] For details, see Figure 4 The beam splitting unit 520 is a beam splitting prism. The beam splitting prism and the preset wavelength serve as the beam splitting boundary. For example, the range greater than the preset wavelength is the first band, and the range less than the preset wavelength is the second band.

[0098] The first imaging unit 530 includes a fluorescence path filter 531 and a fluorescence path image sensor 532; the fluorescence path filter is used to cut off excitation light and white light; the fluorescence path image sensor 532 is used to convert the received optical signal of the first band into an electrical signal.

[0099] The second imaging unit 540 includes a white light path filter 541 and a white light path image sensor 542; the white light path filter 541 is used to cut off the excitation light; the white light path image sensor 542 is used to convert the received optical signal in the white light path band into an electrical signal.

[0100] In this embodiment, the fluorescence endoscope system acquires a first image and a second image containing white light information and fluorescence information, and fuses the first image and the second image to obtain a fluorescence detection image, thereby realizing the display of a fluorescence superimposed image using a two-way beam splitting method and improving the imaging quality of endoscopic detection.

[0101] The present embodiment will now be described and illustrated through preferred implementations.

[0102] 5-ALA is a fluorescent contrast agent used in clinical surgery and examinations. Its main mechanism of action involves metabolism in the body to produce PpIX, which exhibits fluorescence. The excitation wavelength is approximately 405 nm, and the fluorescence wavelength is approximately 600 nm-720 nm. By utilizing the different metabolic rates of PpIX at different sites, the surgical area is located by observing the fluorescence. After marking the subject with 5-ALA fluorescent contrast agent, the procedure is then performed... Figure 3 and Figure 4 The endoscopic system shown acquires fluorescence images of the object being examined. (Example) Figure 5-A As shown, the white light source 412 has a spectrum ranging from 430nm to 650nm and is used to acquire white light images; the excitation light source 413 has the following spectrum, with a center wavelength of approximately 410nm, and is used to excite fluorescence. The two light sources are controlled by a light source controller 411.

[0103] In the camera module 320, after imaging by the optical unit 510, the light signal passes through a beam splitter 520. The beam splitter 520 transmits light with wavelengths before 650nm for white light path imaging and reflects light with wavelengths greater than 650nm for fluorescence path imaging. A white light path image sensor 542 is used to acquire white light images. A white light path filter 541 is placed in front of the white light path image sensor 542, and its transmittance curve is shown below. Figure 5-B As shown, it is used to cut off the excitation light; the fluorescence path image sensor 532 is used to acquire fluorescence images, and a fluorescence path filter 531 is placed in front of the fluorescence path image sensor 532, the transmittance of which is as shown. Figure 5-B As shown, it is used to cut off excitation light and white light.

[0104] The image processing module is used to process the acquired images. The processing flow is as follows: Figure 6 When the fluorescence mode is activated, the white light source 412 and the excitation light source 413 are turned on. The white light path image sensor 542 and the fluorescence path image sensor 532 simultaneously acquire white light images and fluorescence images. The white light images and fluorescence images are registered, and the registered fluorescence image is mapped to a preset color pseudo-color according to its brightness. The pseudo-color image is superimposed on the white light image, and finally the fused image is displayed.

[0105] When the fluorescence intensity is weak, the fluorescence path may only collect fluorescence energy beyond 650nm, making it difficult to extract the fluorescence region and display the fluorescence image. In this case, a frame alternation method can be used to improve the effect, as follows: Figure 7At this time, the light source controller 411 controls the white light source 412 and the excitation light source 413 to alternately illuminate the light source. Meanwhile, the white light path image sensor 542 alternately acquires white light images and fluorescence images in the wavelength range up to 650nm, while the fluorescence path image sensor 532 acquires a fluorescence image in the wavelength range after 650nm every other frame. The fluorescence images acquired by the two image sensors are combined to increase the fluorescence intensity. The combined fluorescence image is then fused with the white light image, and the fused image is finally displayed.

[0106] This preferred embodiment enables the simultaneous acquisition of fluorescence and white light images, avoiding frame rate loss, and has a high tolerance for fluorescence intensity, making it applicable to fluorescence scenes of varying strengths. In weak fluorescence conditions, frame alternation can solve the problem of fluorescence areas being difficult to identify accurately and clearly.

[0107] It should be noted that the steps shown in the above process or in the flowchart of the accompanying figures can be executed in a computer system such as a set of computer-executable instructions, and although a logical order is shown in the flowchart, in some cases the steps shown or described may be executed in a different order than that shown here.

[0108] Furthermore, in conjunction with the fluorescence image processing methods provided in the above embodiments, this embodiment can also provide a storage medium for implementation. The storage medium stores a computer program; when executed by a processor, the computer program implements any of the fluorescence image processing methods described in the above embodiments.

[0109] It should be understood that the specific embodiments described herein are merely illustrative of the application and not intended to limit it. All other embodiments derived by those skilled in the art based on the embodiments provided in this application without inventive effort are within the scope of protection of this application.

[0110] Obviously, the accompanying drawings are merely some examples or embodiments of this application. Those skilled in the art can apply this application to other similar situations based on these drawings without any creative effort. Furthermore, it is understood that although the work done in this development process may be complex and lengthy, for those skilled in the art, certain design, manufacturing, or production modifications made based on the technical content disclosed in this application are merely conventional technical means and should not be considered as insufficient disclosure of this application.

[0111] The term "embodiment" in this application refers to a specific feature, structure, or characteristic described in connection with an embodiment that may be included in at least one embodiment of this application. The appearance of this phrase in various places in the specification does not necessarily imply the same embodiment, nor does it imply that it is mutually exclusive with or independent of other embodiments. It will be clearly or implicitly understood by those skilled in the art that the embodiments described in this application may be combined with other embodiments without conflict.

[0112] The embodiments described above are merely illustrative of several implementation methods of this application, and while the descriptions are relatively specific and detailed, they should not be construed as limiting the scope of patent protection. It should be noted that those skilled in the art can make various modifications and improvements without departing from the concept of this application, and these all fall within the scope of protection of this application. Therefore, the scope of protection of this application should be determined by the appended claims.

Claims

1. A fluorescence image processing method, characterized in that, The method includes: In fluorescence mode, the test object labeled with a fluorescent agent is illuminated based on detection light, which includes white light emitted in a set emission mode and excitation light; Based on the acquisition method corresponding to the light emission mode, light signals from the object under test are acquired, a first image is obtained based on the light signal of the first band, and a second image is obtained based on the light signal of the second band; the first band is set based on the spectral range of fluorescence excited by the excitation light, and the second band is set based on the spectral range of white light; The first image and the second image are fused to obtain a fluorescence detection image of the object being inspected. The acquisition method based on the light emission mode includes: the light emission mode is that the white light and the excitation light are emitted alternately according to the video frame rate; the acquisition method is that when the excitation light is irradiated alone, the light signal of the first band and the light signal of the second band are acquired simultaneously; when the white light is irradiated alone, only the light signal of the second band is acquired; the first band is the fluorescence spectrum remaining after subtracting the white light spectrum that overlaps with the fluorescence spectrum from the fluorescence spectrum; The process involves fusing the first image and the second image to obtain a fluorescence detection image of the object under test, including: When the spectral range of the fluorescence partially overlaps with the spectral range of the white light, the first image and the second image are simultaneously acquired when the subject is irradiated with the excitation light alone. The first image includes a first frame of fluorescence path image, and the second image includes a first frame of white light path image. At the moment when the white light is used to illuminate the object under inspection alone, the second image is acquired, and the second image includes a second frame of white light path image; The first frame of the fluorescence path image and the first frame of the white light path image are combined to obtain an enhanced fluorescence image; The enhanced fluorescence image and the second frame white light path image are superimposed to obtain the fluorescence detection image of the object under test.

2. The fluorescence image processing method according to claim 1, characterized in that, The emission mode is set according to the fluorescence intensity excited by the excitation light; The method of setting the emission mode based on the fluorescence intensity excited by the excitation light includes: When the fluorescence intensity excited by the excitation light meets the preset conditions, the emission mode adopts the method of emitting white light and excitation light simultaneously; When the fluorescence intensity does not meet the preset conditions, the emission mode adopts the method of alternating emission of white light and excitation light according to the video frame rate.

3. The fluorescence image processing method according to claim 2, characterized in that, Based on the acquisition method corresponding to the light emission method, it also includes: When the light emission method is that the white light and the excitation light are emitted simultaneously, the acquisition method is to acquire the light signal of the first band and the light signal of the second band at the same time.

4. The fluorescence image processing method according to claim 3, characterized in that, The process of fusing the first image and the second image to obtain a fluorescence detection image of the object under test further includes: The first image includes a fluorescence image, and the second image includes a white light image; Register the fluorescence image and the white light image; After registration, the fluorescent region in the fluorescence image is superimposed with a preset color on the corresponding position in the white light image to obtain the fluorescence detection image of the object under test.

5. The fluorescence image processing method according to claim 1, characterized in that, The enhanced fluorescence image and the second frame white light path image are superimposed to obtain a fluorescence detection image of the object under test, including: The enhanced fluorescence image and the second frame white light path image are registered; After registration, the fluorescent region of the enhanced fluorescence image is superimposed with a preset color on the corresponding position of the second frame white light path image to obtain the fluorescence detection image of the object under test.

6. A fluorescence endoscope system, characterized in that, The system includes: a light source module, a camera module, a memory, and a processor; The light source module is used to emit detection light; The camera module is used to capture the first image and the second image; The memory stores a computer program, and when the processor executes the computer program, it implements the steps of the method according to any one of claims 1 to 5.

7. The fluorescence endoscope system according to claim 6, characterized in that, The camera module also includes an optical unit, a beam splitting unit, a first imaging unit, and a second imaging unit; The optical unit is used to collect light from the object being inspected and transmit the light to the beam splitting unit; The beam splitting unit is used to split the received light into a first band of light signals and a second band of light signals, transmit the first band of light signals to the first imaging unit, and transmit the second band of light signals to the second imaging unit. The first imaging unit is used to generate the first image based on the optical signal of the first wavelength band; The second imaging unit is used to generate the second image based on the optical signal of the second band.

8. A computer-readable storage medium having a computer program stored thereon, characterized in that, When the computer program is executed by a processor, it implements the steps of the method according to any one of claims 1 to 5.

Images