Fluorescence imaging method and device based on light source proportion adjustment and storage medium

Abstract

The invention provides a fluorescence imaging method and device based on light source proportion adjustment and a storage medium, and the method comprises the steps: in a photodynamic diagnosis PDD fluorescence mode, when a blue light source is turned on, after blue light is reflected by tissues, filtering the spectrum of a green fluorescence wave band generated by excitation of riboflavin through a notch filter, the interference of green fluorescence on PDD fluorescence contrast is reduced; in the photodynamic white light image mode, red light, green light and blue light are controlled to be imaged in a stroboscopic mode through the light compensation module, and the proportion of the light power of the red light, the green light and the blue light is controlled, so that the red light, the green light and the blue light are reflected by observation tissue, penetrate through the notch filter and then are synthesized into white light. By combining the notch filter and the light compensation module, the problem that in the PDD fluorescence imaging process, green fluorescence generated by excitation of riboflavin affects the contrast ratio of PDD fluorescence imaging is solved, and meanwhile color rendition of traditional white light imaging can be guaranteed.

Description

Technical Field

[0001] The present invention relates to the field of photodynamic diagnosis, and in particular to a fluorescence imaging method, device and storage medium based on light source ratio adjustment. Background Art

[0002] Photodynamic diagnosis (PDD) is a new diagnostic technology that allows photosensitizing substances to accumulate in diseased tissues and irradiates them with excitation light to cause them to fluoresce. The presence of disease and the diseased tissues are determined by observing and detecting fluorescence.

[0003] This technology is widely used in the field of medical diagnosis. For example, in the diagnosis of tumors, photosensitizers are selectively enriched in cancer cells; then the cancer tissue is irradiated with excitation light to make the enriched photosensitizers produce fluorescence; by analyzing the intensity and distribution of the fluorescence, the location and condition of the cancer can be determined. For another example, in the process of bladder PDD imaging, blue-violet light is used as the excitation light to irradiate the photosensitizer-aggregated tissue, stimulating red fluorescence and imaging it.

[0004] However, during bladder PDD imaging, the metabolite riboflavin in urine will be excited by the excitation light and emit green fluorescence, thereby interfering with the contrast of PDD fluorescence. The existing method is to change the excitation light band, such as using 500nm as the photosensitizer excitation wavelength to reduce the excitation efficiency of riboflavin. However, changing the excitation wavelength will also cause the fluorescence excitation efficiency of the photosensitizer to decrease, and the fluorescence brightness of PDD imaging will decrease. At the same time, it will cause more loss of visible light imaging band, which is not conducive to traditional white light imaging. Summary of the invention

[0005] The present application provides a fluorescence imaging method, device and storage medium based on light source ratio adjustment. By combining a notch filter and a light compensation module, the problem of the green fluorescence generated by the excitation of riboflavin affecting the contrast of PDD fluorescence imaging during PDD fluorescence imaging is solved, while the color restoration of traditional white light imaging can be ensured.

[0006] In view of this, the present application provides a fluorescence imaging method based on light source ratio adjustment, the method is applied to a fluorescence imaging device based on light source ratio adjustment, the fluorescence imaging device based on light source ratio adjustment includes at least two modes of photodynamic diagnosis PDD fluorescence mode and photodynamic white light imaging mode, the method includes: in the photodynamic diagnosis PDD fluorescence mode, when the blue light source is turned on, after the blue light is reflected by the tissue, the spectrum of the green fluorescence band generated by the excitation of riboflavin is filtered through a notch filter to reduce the interference of green fluorescence on the PDD fluorescence contrast; in the photodynamic white light imaging mode, the red, green and blue three-color lights are controlled by the light compensation module to adopt stroboscopic imaging, and the ratio of the light power of the red, green and blue three-color lights is controlled so that the three-color lights are reflected by the observed tissue and pass through the notch filter to synthesize white light.

[0007] In combination with the first aspect, in a possible implementation, the light compensation module controls the red, green and blue lights to form images in a stroboscopic manner, specifically including: the light compensation module controls the red light, blue light and green light to form staggered images according to a preset frame rate.

[0008] In combination with the first aspect, in a possible implementation manner, the method specifically includes: controlling the lighting time of the blue light and the red light to be synchronous, and the lighting time of the blue light and the green light to be asynchronous.

[0009] In combination with the first aspect, in a possible implementation method, the light compensation module controls the red light, blue light, and green light to perform frame-error imaging according to a preset frame rate, specifically including: in the first frame, the blue light is controlled to be off, the red light is controlled to be off, and the green light is turned on at the same time; in the second frame, the blue light is controlled to be on, the red light is controlled to be on, and the green light is turned off at the same time; the third frame is the same as the first frame, the fourth frame is the same as the second frame...one cycle for every two frames.

[0010] In combination with the first aspect, in a possible implementation method, the controlling the ratio of the optical power of the red, green and blue lights specifically includes: the optical compensation module adjusts the light output ratio of the red, green and blue lights according to a preset optical power ratio, wherein the ratio of the red, green and blue lights in the preset optical power ratio is related to the transmittance of the notch filter.

[0011] In combination with the first aspect, in a possible implementation manner, the ratio of the red, green and blue colors of the preset optical power ratio is related to the transmittance of the notch filter and specifically includes:

[0012] If it is determined that the transmittance ratio of the notch filter for red, green and blue light is a:b:a, the output power of the red light spectrum, the green light spectrum and the blue light spectrum is controlled by the light compensation module to be b:a:b, where a and b are both positive numbers.

[0013] In combination with the first aspect, in a possible implementation, the optical powers of red light, green light, and blue light emitted by the red, green, and blue light sources entering the photosensitive element are respectively:

[0014]

[0015]

[0016] Among them, P r is the light power of red light entering the photosensitive element, P g is the optical power of green light entering the photosensitive element, P b is the optical power of blue light entering the photosensitive element, λ is the wavelength of light, L r (λ) is the output power of the red light spectrum, L g (λ) is the output power of the green light spectrum, L b (λ) is the output power of the blue light spectrum.

[0017] In combination with the first aspect, in a possible implementation, in the photodynamic white light imaging mode, the light compensation module controls the output power of the red, green and blue lights so that the difference percentage between the power of the red, green and blue lights entering the photosensitive element and the average power of the three lights is less than or equal to a preset difference percentage threshold.

[0018] In combination with the first aspect, in a possible implementation, the average power of the red, green and blue lights is for:

[0019]

[0020] The percentage difference between the red light power and the average power of the three-color light is:

[0021]

[0022] The percentage difference between the green light power and the average power of the three-color light is:

[0023]

[0024] The percentage difference between the blue light power and the average power of the three colors of light is:

[0025]

[0026] Among them, P r is the red light power, P g is the green light power, P b is the blue light power, ΔP r is the difference between the red light power and the average power of the three colors of light, ΔP g is the difference between the green light power and the average power of the three colors of light, ΔP bis the difference between the blue light power and the average power of the three-color light, a is the preset difference percentage threshold, 0<a<1.

[0027] The second aspect of the present application provides a fluorescence imaging device based on light source ratio adjustment, the device comprising: a blue light source 1, a green light source 2, a red light source 3, a light compensation module 4, an imaging lens group 5, a notch filter 6, a photosensitive element 7, and an image processor 8. In the photodynamic diagnosis PDD fluorescence mode, when the blue light source 1 is turned on, the green light source 2 and the red light source 3 are turned off, and when the blue light emitted by the blue light source 1 irradiates the observed tissue, the imaging lens group 5 is used to collect the spectrum of the PDD fluorescence excited in the observed tissue and the green fluorescence band generated by riboflavin, and the notch filter 6 is used to filter the riboflavin fluorescence, and the PDD fluorescence passes through the notch filter 6 to reach the photosensitive element Component 7, the photosensitive element 7 is used to convert the optical signal into an electrical signal and transmit it to the image processor 8 for processing to output the PDD fluorescence image; in the photodynamic white light imaging mode, the blue light source 1, the green light source 2, and the red light source 3 are imaged in a stroboscopic manner under the control of the light compensation module 4, and the red, green, and blue light emitted by the blue light source 1, the green light source 2, and the red light source 3 are all adjusted according to the preset optical power by the light compensation module 4, and the emitted light is reflected by the observed tissue and then collected by the imaging lens group 5, and after being filtered by the notch filter 6, enters the photosensitive element 7, and the photosensitive element 7 is used to convert the optical signal into an electrical signal and transmit it to the image processor 8 for processing to output a white light image.

[0028] In combination with the second aspect, in a possible implementation, the light compensation module 4 is used to control the red light, the green light and the blue light to perform staggered imaging according to a preset frame rate.

[0029] In combination with the second aspect, in a possible implementation, the light compensation module 4 is specifically used to control the lighting time of the blue light and the red light to be synchronous, and the lighting time of the blue light and the green light to be asynchronous.

[0030] In combination with the second aspect, in a possible implementation method, the light compensation module 4 is specifically used for: in the first frame, controlling the blue light to be off, the red light to be off, and the green light to be on; in the second frame, controlling the blue light to be on, the red light to be on, and the green light to be off; the third frame is the same as the first frame, the fourth frame is the same as the second frame...one cycle for every two frames.

[0031] In combination with the second aspect, in a possible implementation, the optical compensation module 4 is also used to adjust the light output ratio of red, green and blue light according to a preset optical power ratio, wherein the ratio of red, green and blue in the preset optical power ratio is related to the transmittance of the notch filter.

[0032] In combination with the second aspect, in a possible implementation method, if it is determined that the transmittance ratio of the notch filter for the red, green and blue light is a:b:a, the output power of the red light spectrum, the green light spectrum and the blue light spectrum is controlled by the light compensation module 4 to be b:a:b, where a and b are both positive numbers.

[0033] In combination with the second aspect, in a possible implementation, the optical powers of red light, green light, and blue light emitted by the red, green, and blue light sources entering the photosensitive element 7 are respectively:

[0034]

[0035] Among them, P r is the light power of red light entering the photosensitive element 7, P g is the optical power of green light entering the photosensitive element 7, P b is the optical power of blue light entering the photosensitive element 7, λ is the wavelength of light, L r (λ) is the output power of the red light spectrum, L g (λ) Output power of green light spectrum, L b (λ) Output power of the blue light spectrum.

[0036] In combination with the second aspect, in a possible implementation, in the photodynamic white light imaging mode, the light compensation module 4 is used to control the output power of the red, green and blue lights so that the difference percentage between the power of the red, green and blue lights entering the photosensitive element 7 and the average power of the three colors of light is less than or equal to a preset difference percentage threshold.

[0037] In combination with the second aspect, in a possible implementation, the average power of the red, green and blue lights is for:

[0038]

[0039] The percentage difference between the red light power and the average power of the three-color light is:

[0040]

[0041] The percentage difference between the green light power and the average power of the three-color light is:

[0042]

[0043] The percentage difference between the blue light power and the average power of the three colors of light is:

[0044]

[0045] Among them, P r is the red light power, P g is the green light power, Pb is the blue light power, ΔP r is the difference between the red light power and the average power of the three colors of light, ΔP g is the difference between the green light power and the average power of the three colors of light, ΔP b is the difference between the blue light power and the average power of the three-color light, a is the preset difference percentage threshold, 0<a<1.

[0046] The third aspect of the present application provides a fluorescence imaging device based on light source ratio adjustment, the device comprising: a memory, a processor, and a computer program stored in the memory and executable on the processor, when the processor executes the computer program, the fluorescence imaging method of light source ratio adjustment as described in any possible implementation method of the first aspect to the first aspect is implemented.

[0047] The fourth aspect of the present application provides a computer-readable storage medium, characterized in that the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, it implements the fluorescence imaging method of adjusting the light source ratio as described in any possible implementation method of the first aspect to the first aspect.

[0048] The present application provides a fluorescence imaging method, device and storage medium based on light source ratio adjustment, the method is applied to a fluorescence imaging device based on light source ratio adjustment, the fluorescence imaging device based on light source ratio adjustment includes at least two modes of photodynamic diagnosis PDD fluorescence mode and photodynamic white light imaging mode, the method includes: in the photodynamic diagnosis PDD fluorescence mode, when the blue light source is turned on, after the blue light is reflected by the tissue, the spectrum of the green fluorescence band generated by the excitation of riboflavin is filtered through a notch filter to reduce the interference of green fluorescence on the PDD fluorescence contrast; in the photodynamic white light imaging mode, the red, green and blue three-color light is controlled by a light compensation module to adopt a stroboscopic imaging method, and the ratio of the light power of the red, green and blue three-color light is controlled so that the three-color light is reflected by the observation tissue and synthesized into white light after passing through the notch filter. By combining the notch filter and the light compensation module, the problem of the green fluorescence generated by the excitation of riboflavin affecting the contrast of PDD fluorescence imaging during PDD fluorescence imaging is solved, and the color restoration of traditional white light imaging can be guaranteed at the same time. BRIEF DESCRIPTION OF THE DRAWINGS

[0049] Figure 1 A schematic diagram of a flow chart of a fluorescence imaging method based on light source ratio adjustment in an embodiment of the present application;

[0050] Figure 2 This is a schematic diagram of staggered frame imaging of white light synthesized by red, green and blue light in a photodynamic white light imaging mode in an embodiment of the present application;

[0051] Figure 3 This is a structural schematic diagram of a fluorescent imaging device based on light source ratio adjustment in an embodiment of the present application;

[0052] Figure 4 A schematic diagram of the structure of a fluorescence imaging device based on light source ratio adjustment in an embodiment of the present application. DETAILED DESCRIPTION

[0053] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those skilled in the art without creative work are within the scope of protection of this application.

[0054] The term "and / or" in this application can be a description of the association relationship of associated objects, indicating that there can be three relationships. For example, A and / or B can represent: A exists alone, A and B exist at the same time, and B exists alone. In addition, the character " / " in this application generally indicates that the associated objects before and after are in an "or" relationship.

[0055] The terms "first", "second", etc. in the specification and claims of the present application and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchangeable where appropriate, so that the embodiments described herein can be implemented in an order other than that illustrated or described herein. In addition, the terms "including" and "having" and any of their variations are intended to cover non-exclusive inclusions, for example, a process, method, system, product or device that includes a series of steps or modules is not necessarily limited to those steps or modules that are clearly listed, but may include other steps or modules that are not clearly listed or inherent to these processes, methods, products or devices.

[0056] During bladder PDD imaging, the metabolite riboflavin in urine will be excited by the excitation light and emit green fluorescence, thereby interfering with the contrast of PDD fluorescence. The existing method is to reduce the excitation efficiency of riboflavin by changing the excitation light band, such as using 500nm as the photosensitizer excitation wavelength. However, changing the excitation wavelength will also cause the fluorescence excitation efficiency of the photosensitizer to decrease, and the fluorescence brightness of PDD imaging will decrease. At the same time, it will cause more loss of visible light imaging band, which is not conducive to traditional white light imaging.

[0057] In view of this, see Figure 1 The present application provides a fluorescence imaging method based on light source ratio adjustment, the method comprising:

[0058] 101. Determine the working mode.

[0059] The fluorescence imaging method based on light source ratio adjustment provided in the present application is applied to a fluorescence imaging device based on light source ratio adjustment, and the fluorescence imaging device based on light source ratio adjustment includes two modes: photodynamic diagnosis PDD fluorescence mode and photodynamic white light imaging mode. The device may also add other modes in the future, which are not limited here.

[0060] For details, see Figure 3 The present application also provides a fluorescence imaging device based on light source ratio adjustment, the device comprising: a blue light source 1, a green light source 2, a red light source 3, a light compensation module 4, an imaging lens group 5, a notch filter 6, a photosensitive element 7, and an image processor 8.

[0061] 102. In the PDD fluorescence mode, when the blue light source is turned on, the blue light is reflected by the tissue and then filtered through the notch filter to filter the spectrum of the green fluorescence band produced by the excitation of riboflavin, so as to reduce the interference of green fluorescence on the PDD fluorescence contrast.

[0062] When it is determined that the working mode is the PDD fluorescence mode, when the blue light source 1 is turned on, the green light source 2 and the red light source 3 are turned off, after the blue light emitted by the blue light source 1 irradiates the observed tissue, the imaging lens group 5 is used to collect the spectra of the PDD fluorescence excited in the observed tissue and the green fluorescence band produced by riboflavin, the notch filter 6 is used to filter the riboflavin fluorescence, the PDD fluorescence passes through the notch filter 6 to reach the photosensitive element 7, the photosensitive element 7 is used to convert the optical signal into an electrical signal and transmit it to the image processor 8 for processing to output a PDD fluorescence image.

[0063] In this way, the spectrum of the green fluorescence band generated by the excitation of riboflavin is filtered by the notch filter 6 to reduce the interference of the green fluorescence on the PDD fluorescence contrast.

[0064] 103. In the photodynamic white light imaging mode, the red, green and blue lights are controlled by the light compensation module to form an image in a stroboscopic manner, and the ratio of the light power of the red, green and blue lights is controlled so that the three colors of light are reflected by the observed tissue and synthesized into white light after passing through the notch filter.

[0065] When it is determined that the working mode is the PDD fluorescence mode, the blue light source 1, the green light source 2, and the red light source 3 are imaged in a stroboscopic manner under the control of the light compensation module 4, and the red, green, and blue light emitted by the blue light source 1, the green light source 2, and the red light source 3 are all adjusted according to the preset light power by the light compensation module 4, and the emitted light is reflected by the observed tissue and then collected by the imaging lens group 5, and after being filtered by the notch filter 6, enters the photosensitive element 7, and the photosensitive element 7 is used to convert the optical signal into an electrical signal and transmit it to the image processor 8 for processing, and output a white light image.

[0066] The light compensation module 4 is used to control the red light, green light and blue light to form staggered images according to a preset frame rate. Specifically, the light compensation module 4 is used to control the blue light and red light to be on synchronously, and the blue light and green light to be on asynchronously. Furthermore, the light compensation module 4 is used to: when in the first frame, control the blue light to be off, the red light to be off, and the green light to be on at the same time; in the second frame, control the blue light to be on, the red light to be on, and the green light to be off at the same time; the third frame is the same as the first frame, the fourth frame is the same as the second frame...one cycle for every two frames.

[0067] The optical compensation module 4 is also used to adjust the light output ratio of red, green and blue light according to a preset optical power ratio, wherein the ratio of red, green and blue in the preset optical power ratio is related to the transmittance of the notch filter.

[0068] Specifically, if it is determined that the transmittance ratio of the notch filter for the red, green and blue light is a:b:a, then the output power of the red light spectrum, the green light spectrum and the blue light spectrum controlled by the light compensation module 4 is b:a:b, and a and b are both positive numbers. Exemplarily, if it is determined that the transmittance of the notch filter 6 for the red, green and blue light is 1:0.4:1 respectively. Then it can be determined that the output power of the red light spectrum, the green light spectrum and the blue light spectrum controlled by the light compensation module 4 is 0.4:1:0.4. This is only an example and is not a limitation of the present application.

[0069] It should be noted that the light compensation module 4 controls the red, green and blue lights to be imaged in a stroboscopic manner and controls the ratio of the light power of the red, green and blue lights so that in the white light mode, the image obtained by the photosensitive element 7 can synthesize white light. Figure 2 shown.

[0070] It should be noted that the optical powers of the red light, green light and blue light emitted by the red, green and blue light sources entering the photosensitive element 7 are respectively:

[0071]

[0072] Among them, P r is the light power of red light entering the photosensitive element 7, P g is the optical power of green light entering the photosensitive element 7, P b is the optical power of blue light entering the photosensitive element 7, λ is the wavelength of light, L r (λ) is the output power of the red light spectrum, L g (λ) Output power of green light spectrum, L b (λ) Output power of the blue light spectrum.

[0073] It is understandable that in the photodynamic white light imaging mode, the light compensation module 4 controls the output power of the red, green and blue light so that the difference percentage between the power of the red, green and blue light entering the photosensitive element 7 and the average power of the three-color light is less than or equal to the preset difference percentage threshold. The difference percentage threshold can be set according to actual conditions, and can be set to 10% for example. This is only an example and is not a limitation of the present application.

[0074] Furthermore, the average power of the three colors of red, green and blue for:

[0075]

[0076] The percentage difference between the red light power and the average power of the three-color light is:

[0077]

[0078] The percentage difference between the green light power and the average power of the three-color light is:

[0079]

[0080] The percentage difference between the blue light power and the average power of the three colors of light is:

[0081]

[0082] Among them, P r is the red light power, P g is the green light power, P b is the blue light power, ΔP r is the difference between the red light power and the average power of the three colors of light, ΔP g is the difference between the green light power and the average power of the three colors of light, ΔP b is the difference between the blue light power and the average power of the three-color light, a is the preset difference percentage threshold, 0<a<1.

[0083] This application also provides a fluorescence imaging device based on light source ratio adjustment, see Figure 2 The device includes: a blue light source 1, a green light source 2, a red light source 3, a light compensation module 4, an imaging lens group 5, a notch filter 6, a photosensitive element 7, and an image processor 8.

[0084] In the photodynamic diagnosis PDD fluorescence mode, when the blue light source 1 is turned on, the green light source 2 and the red light source 3 are turned off, after the blue light emitted by the blue light source 1 irradiates the observed tissue, the imaging lens group 5 is used to collect the spectra of the PDD fluorescence excited in the observed tissue and the green fluorescence band produced by riboflavin, the notch filter 6 is used to filter the riboflavin fluorescence, the PDD fluorescence passes through the notch filter 6 to reach the photosensitive element 7, the photosensitive element 7 is used to convert the optical signal into an electrical signal and transmit it to the image processor 8 for processing to output the PDD fluorescence image.

[0085] In the photodynamic white light imaging mode, the blue light source 1, the green light source 2, and the red light source 3 are imaged in a stroboscopic manner under the control of the light compensation module 4, and the red, green, and blue light emitted by the blue light source 1, the green light source 2, and the red light source 3 are all adjusted according to the preset light power by the light compensation module 4. The emitted light is reflected by the observed tissue, and the reflected light is collected by the imaging lens group 5, and after being filtered by the notch filter 6, it enters the photosensitive element 7, and the photosensitive element 7 is used to convert the optical signal into an electrical signal and transmit it to the image processor 8 for processing, and output a white light image.

[0086] It should be noted that the light compensation module 4 is used to control the red light, green light and blue light to be staggered according to a preset frame rate. Specifically, the light compensation module 4 is specifically used to control the blue light and red light lighting time to be synchronous, and the blue light and green light lighting time to be asynchronous.

[0087] Furthermore, the light compensation module 4 is specifically used for: in the first frame, controlling the blue light to be off, the red light to be off, and the green light to be on; in the second frame, controlling the blue light to be on, the red light to be on, and the green light to be off; the third frame is the same as the first frame, the fourth frame is the same as the second frame... one cycle for every two frames.

[0088] The optical compensation module 4 is also used to adjust the light output ratio of the red, green and blue lights according to a preset optical power ratio, wherein the ratio of the red, green and blue lights in the preset optical power ratio is related to the transmittance of the notch filter. Specifically, if it is determined that the transmittance ratio of the notch filter for the red, green and blue lights is a:b:a, the output power of the red light spectrum, the green light spectrum and the blue light spectrum is controlled by the optical compensation module 4 to be b:a:b, where a and b are both positive numbers.

[0089] The optical powers of the red light, green light and blue light emitted by the red, green and blue light sources entering the photosensitive element 7 are respectively:

[0090]

[0091] Among them, P r is the light power of red light entering the photosensitive element 7, P gis the optical power of green light entering the photosensitive element 7, P b is the optical power of blue light entering the photosensitive element 7, λ is the wavelength of light, L r (λ) is the output power of the red light spectrum, L g (λ) is the output power of the green light spectrum, L b (λ) is the output power of the blue light spectrum.

[0092] In the photodynamic white light imaging mode, the light compensation module 4 is used to control the output power of the red, green and blue lights so that the difference percentage between the power of the red, green and blue lights entering the photosensitive element 7 and the average power of the three colors of light is less than or equal to the preset difference percentage threshold.

[0093] The average power of red, green and blue light for:

[0094]

[0095] The percentage difference between the red light power and the average power of the three-color light is:

[0096]

[0097] The percentage difference between the green light power and the average power of the three-color light is:

[0098]

[0099] The percentage difference between the blue light power and the average power of the three colors of light is:

[0100]

[0101] Among them, P r is the red light power, P g is the green light power, P b is the blue light power, ΔP r is the difference between the red light power and the average power of the three colors of light, ΔP g is the difference between the green light power and the average power of the three colors of light, ΔP b is the difference between the blue light power and the average power of the three-color light, a is the preset difference percentage threshold, 0<a<1.

[0102] The present application provides a fluorescence imaging method, device and storage medium based on light source ratio adjustment, the method is applied to a fluorescence imaging device based on light source ratio adjustment, the fluorescence imaging device based on light source ratio adjustment includes at least two modes of photodynamic diagnosis PDD fluorescence mode and photodynamic white light imaging mode, the method includes: in the photodynamic diagnosis PDD fluorescence mode, when the blue light source is turned on, after the blue light is reflected by the tissue, the spectrum of the green fluorescence band generated by the excitation of riboflavin is filtered through a notch filter to reduce the interference of green fluorescence on the PDD fluorescence contrast; in the photodynamic white light imaging mode, the red, green and blue three-color light is controlled by a light compensation module to adopt a stroboscopic imaging method, and the ratio of the light power of the red, green and blue three-color light is controlled so that the three-color light is reflected by the observation tissue and synthesized into white light after passing through the notch filter. By combining the notch filter and the light compensation module, the problem of the green fluorescence generated by the excitation of riboflavin affecting the contrast of PDD fluorescence imaging during PDD fluorescence imaging is solved, and the color restoration of traditional white light imaging can be guaranteed at the same time.

[0103] Figure 4 Schematic diagram of the structure of the fluorescence imaging 20 based on light source ratio adjustment provided in the embodiment of the present application. Figure 4 As shown, the fluorescence imaging 20 based on light source ratio adjustment of this embodiment includes: at least one processor 201 ( Figure 4 Only one processor is shown in the figure), a memory 202, and a computer program 203 stored in the memory 202 and executable on the at least one processor 201, wherein the processor 201 implements any of the steps in the above-mentioned fluorescence imaging method embodiment based on light source ratio adjustment when executing the computer program 203.

[0104] The fluorescence imaging device 20 based on light source ratio adjustment may include, but is not limited to, a processor 201 and a memory 202. Those skilled in the art will understand that Figure 3 It is only an example of the fluorescence imaging device 20 based on the light source ratio adjustment, and does not constitute a limitation on the fluorescence imaging device 20 with source ratio adjustment. It can include more or fewer components than shown in the figure, or combine certain components, or different components, for example, it can also include input and output devices, network access devices, etc.

[0105] The processor 201 may be a central processing unit (CPU), or other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), field-programmable gate arrays (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. A general-purpose processor may be a microprocessor or any conventional processor, etc.

[0106] In some embodiments, the memory 202 may be an internal storage unit of the fluorescence imaging device 20 based on light source ratio adjustment, such as a hard disk or memory of the fluorescence imaging device 20 based on light source ratio adjustment. In other embodiments, the fluorescence imaging device 20 based on light source ratio adjustment may also be an external storage device of the fluorescence imaging device 20 based on light source ratio adjustment, such as a plug-in hard disk, a smart memory card (Smart Media Card, SMC), a secure digital (Secure Digital, SD) card, a flash card (Flash Card), etc. equipped on the fluorescence imaging device 20 based on light source ratio adjustment. Further, the memory 202 may also include both the internal storage unit of the fluorescence imaging device 20 based on light source ratio adjustment and an external storage device. The memory 202 is used to store operating devices, application programs, boot loaders (BootLoader), data and other programs, such as program codes of the computer program, etc. The memory 202 may also be used to temporarily store data that has been output or is to be output.

[0107] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working processes of the systems, devices and units described above can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.

[0108] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application is essentially or the part that contributes to the prior art or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including a number of instructions to enable a computer device (which can be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the method described in each embodiment of the present application. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (ROM), random access memory (RAM), disk or optical disk and other media that can store program code.

[0109] In the embodiments provided in this application, it should be understood that the disclosed methods can be implemented in other ways without exceeding the spirit and scope of this application. The current embodiment is only an illustrative example and should not be used as a limitation. The specific content given should not limit the purpose of this application. For example, some features can be ignored or not executed.

[0110] The technical means disclosed in the present application are not limited to the technical means disclosed in the above-mentioned implementation methods, but also include technical solutions composed of any combination of the above technical features. It should be pointed out that for ordinary technicians in this technical field, several improvements and modifications can be made without departing from the principles of this application, and these improvements and modifications are also regarded as the protection scope of this application.

[0111] The above is a detailed introduction to a fluorescence imaging method, device and storage medium based on light source ratio adjustment provided in the embodiments of the present application. Specific examples are used in this article to illustrate the principles and implementation methods of the present application. The description of the above embodiments is only used to help understand the method of the present application and its core idea; at the same time, for those of ordinary skill in the art, according to the idea of ​​the present application, there will be changes in the specific implementation methods and application scope. In summary, the content of this specification should not be understood as a limitation on the present application. Although the present application has been described in detail with reference to the aforementioned embodiments, those of ordinary skill in the art should understand that they can still modify the technical solutions recorded in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein; and these modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present application.

Claims

1. A fluorescence imaging method based on light source ratio adjustment, characterized in that: The method is applied to a fluorescence imaging device based on light source ratio adjustment, the fluorescence imaging device based on light source ratio adjustment includes two modes: a photodynamic diagnosis PDD fluorescence mode and a photodynamic white light imaging mode, and the method includes: In the PDD fluorescence mode of photodynamic diagnosis, when the blue light source is turned on, the blue light is reflected by the tissue and then filtered by the notch filter to filter the spectrum of the green fluorescence band generated by the excitation of riboflavin, so as to reduce the interference of green fluorescence on the PDD fluorescence contrast; In the photodynamic white light imaging mode, the red, green and blue lights are controlled by the light compensation module to form images in a stroboscopic manner, and the ratio of the light power of the red, green and blue lights is controlled so that the red, green and blue lights are reflected by the observed tissue and synthesized into white light after passing through the notch filter.

2. The fluorescence imaging method based on light source ratio adjustment according to claim 1, characterized in that: The light compensation module controls the red, green and blue lights to form images in a stroboscopic manner, specifically including: The light compensation module controls the red light, the blue light and the green light to perform staggered imaging according to a preset frame rate.

3. The fluorescence imaging method based on light source ratio adjustment according to claim 2, characterized in that: The method specifically comprises: The lighting time of the blue light and the red light is controlled to be synchronous, and the lighting time of the blue light and the green light is controlled to be asynchronous.

4. The fluorescence imaging method based on light source ratio adjustment according to claim 3, characterized in that: The light compensation module controls the red light, the blue light, and the green light to perform frame-by-frame imaging according to a preset frame rate, specifically including: When in the first frame, control the blue light to turn off, the red light to turn off, and the green light to turn on; in the second frame, control the blue light to turn on, the red light to turn on, and the green light to turn off; the third frame is the same as the first frame, the fourth frame is the same as the second frame... One cycle for every two frames.

5. The fluorescence imaging method based on light source ratio adjustment according to claim 1, characterized in that: The controlling of the ratio of the optical power of the red, green and blue light specifically includes: The optical compensation module adjusts the light output ratio of red, green and blue light according to a preset optical power ratio, wherein the ratio of red, green and blue light in the preset optical power ratio is related to the transmittance of the notch filter.

6. The fluorescence imaging method based on light source ratio adjustment according to claim 5, characterized in that: The ratio of the red, green and blue colors of the preset optical power ratio is related to the transmittance of the notch filter and specifically includes: If it is determined that the transmittance ratio of the notch filter for red, green and blue light is a:b:a, the output power of the red light spectrum, the green light spectrum and the blue light spectrum is controlled by the light compensation module to be b:a:b, where a and b are both positive numbers.

7. The fluorescence imaging method based on light source ratio adjustment according to claim 6, characterized in that: The optical powers of red light, green light, and blue light emitted by the red, green, and blue light sources entering the photosensitive element are: Among them, P r is the light power of red light entering the photosensitive element, P g is the optical power of green light entering the photosensitive element, P b is the optical power of blue light entering the photosensitive element, λ is the wavelength of light, L r (λ) is the output power of the red light spectrum, L g (λ) is the output power of the green light spectrum, L b (λ) is the output power of the blue light spectrum.

8. The fluorescence imaging method based on light source ratio adjustment according to claim 7, characterized in that: In the photodynamic white light imaging mode, the light compensation module controls the output power of the red, green and blue lights so that the difference percentage between the power of the red, green and blue lights entering the photosensitive element and the average power of the three colors of light is less than or equal to the preset difference percentage threshold.

9. The fluorescence imaging method based on light source ratio adjustment according to claim 8, characterized in that: The average power of red, green and blue light for: The percentage difference between the red light power and the average power of the three-color light is: The percentage difference between the green light power and the average power of the three-color light is: The percentage difference between the blue light power and the average power of the three colors of light is: Among them, P r is the red light power, P g is the green light power, P b is the blue light power, ΔP r is the difference between the red light power and the average power of the three colors of light, ΔP g is the difference between the green light power and the average power of the three colors of light, ΔP b is the difference between the blue light power and the average power of the three-color light, a is the preset difference percentage threshold, 0<a<1.

10. A fluorescence imaging device based on light source ratio adjustment, characterized in that: The device comprises: a blue light source (1), a green light source (2), a red light source (3), a light compensation module (4), an imaging lens group (5), a notch filter (6), a photosensitive element (7), and an image processor (8). In the photodynamic diagnosis PDD fluorescence mode, when the blue light source (1) is turned on, the green light source (2) and the red light source (3) are turned off, and after the blue light emitted by the blue light source (1) irradiates the observed tissue, the imaging lens group (5) is used to collect the spectrum of the PDD fluorescence excited in the observed tissue and the green fluorescence band generated by riboflavin, and the notch filter (6) is used to filter the riboflavin fluorescence. The PDD fluorescence passes through the notch filter (6) to reach the photosensitive element (7), and the photosensitive element (7) is used to convert the optical signal into an electrical signal and transmit it to the image processor (8) for processing, so as to output a PDD fluorescence image; In the photodynamic white light imaging mode, the blue light source (1), the green light source (2), and the red light source (3) are imaged in a stroboscopic manner under the control of the light compensation module (4), and the red, green, and blue light emitted by the blue light source (1), the green light source (2), and the red light source (3) are all adjusted according to a preset light power by the light compensation module (4). The emitted light is reflected by the observed tissue, and the reflected light is collected by the imaging lens group (5). After being filtered by the notch filter (6), the reflected light enters the photosensitive element (7). The photosensitive element (7) is used to convert the optical signal into an electrical signal and transmit it to the image processor (8) for processing, thereby outputting a white light image.

11. The fluorescence imaging device based on light source ratio adjustment according to claim 10, characterized in that: The light compensation module (4) is used to control the red light, green light and blue light to perform staggered imaging according to a preset frame rate.

12. The fluorescence imaging device based on light source ratio adjustment according to claim 11, characterized in that: The light compensation module (4) is specifically used to control the blue light and the red light to be on synchronously, and the blue light and the green light to be on asynchronously.

13. The fluorescence imaging device based on light source ratio adjustment according to claim 12, characterized in that: The light compensation module (4) is specifically used for: When in the first frame, control the blue light to turn off, the red light to turn off, and the green light to turn on; in the second frame, control the blue light to turn on, the red light to turn on, and the green light to turn off; the third frame is the same as the first frame, the fourth frame is the same as the second frame... One cycle for every two frames.

14. The fluorescence imaging device based on light source ratio adjustment according to claim 10, characterized in that: The optical compensation module (4) is also used to adjust the light output ratio of red, green and blue light according to a preset optical power ratio, wherein the ratio of red, green and blue light in the preset optical power ratio is related to the transmittance of the notch filter.

15. The fluorescence imaging device based on light source ratio adjustment according to claim 14, characterized in that: If it is determined that the transmittance ratio of the notch filter for the red, green and blue light is a:b:a, the output power of the red light spectrum, the green light spectrum and the blue light spectrum is controlled by the light compensation module (4) to be b:a:b, where a and b are both positive numbers.

16. The fluorescence imaging device based on light source ratio adjustment according to claim 15, characterized in that: The optical powers of the red light, green light and blue light emitted by the red, green and blue light sources entering the photosensitive element (7) are respectively: Among them, P r is the light power of red light entering the photosensitive element (7), P g is the optical power of green light entering the photosensitive element (7), P b is the optical power of blue light entering the photosensitive element (7), λ is the wavelength of light, L r (λ) is the output power of the red light spectrum, L g (λ) is the output power of the green light spectrum, L b (λ) is the output power of the blue light spectrum.

17. The fluorescence imaging device based on light source ratio adjustment according to claim 16, characterized in that: In the photodynamic white light imaging mode, the light compensation module (4) is used to control the output power of the red, green and blue lights so that the difference percentage between the power of the red, green and blue lights entering the photosensitive element (7) and the average power of the three-color lights is less than or equal to a preset difference percentage threshold.

18. The fluorescence imaging device based on light source ratio adjustment according to claim 17, characterized in that: The average power of red, green and blue light for: The percentage difference between the red light power and the average power of the three-color light is: The percentage difference between the green light power and the average power of the three-color light is: The percentage difference between the blue light power and the average power of the three colors of light is: Among them, P r is the red light power, P g is the green light power, P b is the blue light power, ΔP r is the difference between the red light power and the average power of the three colors of light, ΔP g is the difference between the green light power and the average power of the three colors of light, ΔP b is the difference between the blue light power and the average power of the three-color light, a is the preset difference percentage threshold, 0<a<1.

19. A fluorescence imaging device based on light source ratio adjustment, characterized in that: The device comprises: a memory, a processor, and a computer program stored in the memory and executable on the processor. When the processor executes the computer program, the fluorescence imaging method for adjusting the light source ratio as described in any one of claims 1 to 9 is implemented.

20. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the fluorescence imaging method for adjusting the light source ratio as claimed in any one of claims 1 to 9 is implemented.

Images