A fluorescence imaging method and device based on light source proportion adjustment and a storage medium

Abstract

The application provides a fluorescence imaging method and device based on light source proportion adjustment and a storage medium. In a photodynamic diagnosis (PDD) fluorescence mode, when a blue light source is turned on, after the blue light is reflected by tissues, a notch filter is used to filter the spectrum of green fluorescence bands generated by the excitation of the luciferin, so as to reduce the interference of green fluorescence on the contrast of PDD fluorescence. In a photodynamic white light image mode, a light compensation module is used to control the imaging of red, green and blue light in a stroboscopic mode, and the proportion of the light power of the red, green and blue light is controlled, so that the three-color light is reflected by the observed tissues and then synthesizes white light after passing through the notch filter. Through the combination of the notch filter and the light compensation module, the problem that the green fluorescence generated by the excitation of the luciferin affects the contrast of PDD fluorescence imaging in the PDD fluorescence imaging process is solved, and the color restoration of traditional white light imaging is also ensured.

Description

TECHNICAL FIELD

[0001] The present application relates to the field of photodynamic diagnosis, and in particular to a fluorescence imaging method and device based on light source proportion adjustment and a storage medium. BACKGROUND

[0002] Photo dynamic diagnosis (PDD) is a new type of diagnosis technology, which allows photosensitizer to accumulate in the diseased tissue and emit fluorescence when excited by excitation light, so as to determine the presence or absence of disease and the diseased tissue by observing and detecting the fluorescence.

[0003] This technology is widely used in the field of medical diagnosis. For example, in the diagnosis of tumors, photosensitive drugs are selectively enriched at cancer cells; then excitation light is used to irradiate the cancer tissue, so that the enriched photosensitive drugs produce fluorescence; by analyzing the intensity and distribution of the fluorescence, the position and condition of the cancer can be determined. For another example, in the process of bladder PDD imaging, blue-violet light is used as excitation light to irradiate the photosensitizer accumulation tissue, exciting red fluorescence and imaging it.

[0004] However, in the process of bladder PDD imaging, the metabolite of urine, riboflavin, will be excited by excitation light to emit green fluorescence, thereby interfering with the contrast of PDD fluorescence. The existing method is to change the excitation light wavelength, such as using 500nm as the photosensitizer excitation wavelength, to reduce the excitation efficiency of riboflavin. However, changing the excitation wavelength will also cause the fluorescence excitation efficiency of the photosensitizer to decrease, and the fluorescence brightness of PDD imaging to decrease. At the same time, it causes more loss of visible light imaging wavelength, which is not conducive to traditional white light imaging. SUMMARY

[0005] The present application provides a fluorescence imaging method and device based on light source proportion adjustment and a storage medium, which combines a trap wave filter and a light compensation module to solve the problem that the green fluorescence produced by riboflavin excited in the process of PDD fluorescence imaging affects the contrast of PDD fluorescence imaging, while also ensuring the color restoration of traditional white light imaging.

[0006] Therefore, the application provides a fluorescence imaging method based on light source proportion adjustment, which is applied to a fluorescence imaging device based on light source proportion adjustment, and the fluorescence imaging device based on light source proportion adjustment comprises at least two modes of a photodynamic diagnosis (PDD) fluorescence mode and a photodynamic white light image mode. The method comprises the following steps: in the PDD fluorescence mode, when the blue light source is turned on, the spectrum of green fluorescence generated by the excitation of the photosensitizer is filtered through the trap filter after the blue light is reflected by the tissue, so as to reduce the interference of the green fluorescence on the PDD fluorescence contrast; in the photodynamic white light image mode, the red, green and blue three-color light is controlled to be imaged in a stroboscopic mode by the light compensation module, and the proportion of the light powers of the red, green and blue three-color light is controlled, so that the three-color light is reflected by the observed tissue and synthesized into white light after penetrating the trap filter.

[0007] With reference to the first aspect, in a possible implementation manner, the light compensation module controls the red, green and blue three-color light to be imaged in a stroboscopic mode, specifically comprising: the light compensation module controls the red light, the blue light and the green light to be imaged in a frame error mode according to a preset frame rate.

[0008] With reference to the first aspect, in a possible implementation manner, the method specifically comprises: the blue light and the red light are controlled to be turned on synchronously, and the blue light and the green light are controlled to be turned on asynchronously.

[0009] With reference to the first aspect, in a possible implementation manner, the light compensation module controls the red, green and blue three-color light to be imaged in a stroboscopic mode, specifically comprising: when in the first frame, the blue light is controlled to be turned off, the red light is controlled to be turned off, and the green light is controlled to be turned on; when in the second frame, the blue light is controlled to be turned on, the red light is controlled to be turned on, and the green light is controlled to be turned off; the third frame is the same as the first frame, and the fourth frame is the same as the second frame.

[0010] With reference to the first aspect, in a possible implementation manner, the control of the proportion of the light powers of the red, green and blue three-color light specifically comprises: the light compensation module adjusts the light output proportions of the red, green and blue three-color light according to a preset light power proportion, and the preset light power proportion of the red, green and blue three-color light is related to the transmittance of the trap filter.

[0011] With reference to the first aspect, in a possible implementation manner, the preset light power proportion of the red, green and blue three-color light is related to the transmittance of the trap filter, specifically comprising:

[0012] If it is determined that the transmittance proportion of the trap filter for the red, green and blue three-color light is a:b:a, then the output powers of the red light spectrum, the green light spectrum and the blue light spectrum are controlled to be b:a:b by the light compensation module, and a and b are positive numbers.

[0013] In combination with the first aspect, in a possible implementation manner, the light powers of the red light, the green light and the blue light emitted by the red light source, the green light source and the blue light source and entering the photosensitive element are respectively:

[0014]

[0015]

[0016] wherein, P r is the light power of the red light entering the photosensitive element, P g is the light power of the green light entering the photosensitive element, and P b is the light power of the blue light entering the photosensitive element, λ is the wavelength of the light, L r (λ) is the output power of the red light spectrum, L g (λ) is the output power of the green light spectrum, and L b (λ) is the output power of the blue light spectrum.

[0017] In combination with the first aspect, in a possible implementation manner, when the light power compensation module controls the output powers of the red light, the green light and the blue light in the photodynamic white light image mode, the difference percentage of the powers of the red light, the green light and the blue light entering the photosensitive element and the average power of the three colors of light is less than or equal to a preset difference percentage threshold.

[0018] In combination with the first aspect, in a possible implementation manner, the average power of the red light, the green light and the blue light is:

[0019]

[0020] The difference percentage of the red light power and the average power of the three colors of light is:

[0021]

[0022] The difference percentage of the green light power and the average power of the three colors of light is:

[0023]

[0024] The difference percentage of the blue light power and the average power of the three colors of light is:

[0025]

[0026] wherein, P r is the red light power, P g is the green light power, and P b is the blue light power, ΔP r is the difference of the red light power and the average power of the three colors of light, ΔP g is the difference of the green light power and the average power of the three colors of light, and ΔP b ​is the difference between the blue light power and the average power of the three colors of light, a is a preset difference percentage threshold, 0 < a < 1.

[0027] The second aspect of the present application provides a fluorescence imaging device based on light source proportion adjustment, which comprises a blue light source 1, a green light source 2, a red light source 3, a light compensation module 4, an imaging lens group 5, a trap wave filter 6, a photosensitive element 7, and an image processor 8. In a photodynamic diagnosis PDD fluorescence mode, when the blue light source 1 is turned on and the green light source 2 and the red light source 3 are turned off, after the blue light emitted by the blue light source 1 irradiates the observed tissue, the imaging lens group 5 is used to collect the spectrum of the PDD fluorescence generated by the excitation in the observed tissue and the green fluorescence waveband generated by the riboflavin, the trap wave filter 6 is used to filter the riboflavin fluorescence, the PDD fluorescence transmits through the trap wave filter 6 to the photosensitive element 7, the photosensitive element 7 is used to convert the optical signal into an electrical signal and transmit it to the image processor 8 for processing, so as to output a PDD fluorescence image; in a photodynamic white light image mode, the blue light source 1, the green light source 2 and the red light source 3 are controlled by the light compensation module 4 to adopt a stroboscopic imaging mode, and the red, green and blue light emitted by the blue light source 1, the green light source 2 and the red light source 3 is adjusted by the light compensation module 4 according to a preset light power, the reflected light after the emitted light is reflected by the observed tissue is collected by the imaging lens group 5, and then enters the photosensitive element 7 after being filtered by the trap wave filter 6, the photosensitive element 7 is used to convert the optical signal into an electrical signal and transmit it to the image processor 8 for processing, so as to output a white light image.

[0028] In combination with the second aspect, in a possible implementation manner, the light compensation module 4 is configured to control the red light, the green light and the blue light to be imaged in a frame error mode according to a preset frame rate.

[0029] In combination with the second aspect, in a possible implementation manner, the light compensation module 4 is specifically configured to control the blue light and the red light to be turned on at the same time, and the blue light and the green light to be turned on at different times.

[0030] In combination with the second aspect, in a possible implementation manner, the light compensation module 4 is specifically configured to: when in the first frame, control the blue light to be turned off, the red light to be turned off, and the green light to be turned on; when in the second frame, control the blue light to be turned on, the red light to be turned on, and the green light to be turned off; when in the third frame, control the blue light to be turned off, the red light to be turned off, and the green light to be turned on; and when in the fourth frame, control the blue light to be turned on, the red light to be turned on, and the green light to be turned off, and so on.

[0031] In combination with the second aspect, in a possible implementation manner, the light compensation module 4 is further configured to adjust the light output proportion of the red, green and blue light according to a preset light power proportion, and the proportion of the red, green and blue light of the preset light power proportion is related to the transmittance of the trap wave filter.

[0032] With reference to the second aspect, in a possible implementation manner, if it is determined that the transmittance ratio of the notch filter to red, green and blue light is a:b:a, the light compensation module 4 is configured to control the output power of red, green and blue light to be b:a:b, and a and b are positive numbers.

[0033] With reference to the second aspect, in a possible implementation manner, the light power of red, green and blue light emitted by the red, green and blue light sources and entering the photosensitive element 7 is respectively:

[0034]

[0035] wherein, P r is the light power of red light entering the photosensitive element 7, P g is the light power of green light entering the photosensitive element 7, and P b is the light power of blue light entering the photosensitive element 7, λ is the wavelength of light, L r (λ) is the output power of red light spectrum, L g (λ) is the output power of green light spectrum, and L b (λ) is the output power of blue light spectrum.

[0036] With reference to the second aspect, in a possible implementation manner, in the case of the photodynamic white light image mode, the light compensation module 4 is configured to control the output power of red, green and blue light, so that the difference percentage of the power of red, green and blue light entering the photosensitive element 7 and the average power of the three colors of light is less than or equal to a preset difference percentage threshold.

[0037] With reference to the second aspect, in a possible implementation manner, the average power of red, green and blue light is:

[0038]

[0039] The difference percentage of the red light power and the average power of the three colors of light is:

[0040]

[0041] The difference percentage of the green light power and the average power of the three colors of light is:

[0042]

[0043] The difference percentage of the blue light power and the average power of the three colors of light is:

[0044]

[0045] wherein, P r is the red light power, P g is the green light power, and P​b is the difference between the red light power and the average power of the three colors of light, ΔP r is the difference between the red light power and the average power of the three colors of light, ΔP g is the difference between the green light power and the average power of the three colors of light, ΔP b is the difference between the blue light power and the average power of the three colors of light, a is a preset difference percentage threshold, 0 < a < 1.

[0046] The third aspect of the present application provides a fluorescence imaging device based on light source proportion adjustment, which comprises a memory, a processor, and a computer program stored in the memory and executable on the processor, and the processor implements the fluorescence imaging method based on light source proportion adjustment as described in any one of the possible implementation manners of the first aspect to the first aspect.

[0047] The fourth aspect of the present application provides a computer readable storage medium, characterized in that the computer readable storage medium stores a computer program, and the computer program is executed by a processor to implement the fluorescence imaging method based on light source proportion adjustment as described in any one of the possible implementation manners of the first aspect to the first aspect.

[0048] The present application provides a fluorescence imaging method, device and storage medium based on light source proportion adjustment. The method is applied to a fluorescence imaging device based on light source proportion adjustment, which comprises at least two modes of a photodynamic diagnosis (PDD) fluorescence mode and a photodynamic white light image mode. The method comprises: in the PDD fluorescence mode, when the blue light source is turned on, the spectrum of the green fluorescence band excited by the luciferin is filtered through a trap filter after the blue light is reflected by the tissue, so as to reduce the interference of the green fluorescence on the contrast of the PDD fluorescence; in the photodynamic white light image mode, the red, green and blue three-color light is controlled to image in a stroboscopic mode through a light compensation module, and the proportion of the light power of the red, green and blue three-color light is controlled, so that the three-color light is reflected by the observed tissue and passes through the trap filter to synthesize white light. By combining the trap filter and the light compensation module, the problem that the green fluorescence excited by the luciferin affects the contrast of the PDD fluorescence imaging in the PDD fluorescence imaging process is solved, and the color restoration of the traditional white light imaging is also ensured. BRIEF DESCRIPTION OF DRAWINGS

[0049] Figure 1 FIG. 1 is a flowchart of a fluorescence imaging method based on light source proportion adjustment in an embodiment of the present application;

[0050] Figure 2 FIG. 2 is a stroboscopic imaging schematic diagram of the red, green and blue three-color light synthesizing white light in a photodynamic white light image mode in an embodiment of the present application;

[0051] Figure 3 Fig. 1 is a structural schematic diagram of a fluorescence imaging device based on light source proportion adjustment according to an embodiment of the present application;

[0052] Figure 4 Fig. 1 is a structural schematic diagram of a fluorescence imaging device based on light source proportion adjustment according to an embodiment of the present application. DETAILED DESCRIPTION

[0053] The technical solutions in the embodiments of the present application will be clearly and completely described in combination with the drawings in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, rather than all the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those skilled in the art without creative work fall within the scope of protection of the present application.

[0054] The term "and / or" appearing in the present application can be a description of the association relationship of the associated objects, which means that there can be three relationships, for example, A and / or B can mean that there are three cases of A alone, A and B together, and B alone. In addition, the character " / " in the present application generally represents an "or" relationship between the front and rear associated objects.

[0055] The terms "first", "second", and the like in the specification and claims of the present application and the above drawings are used to distinguish similar objects, and do not necessarily have to describe a specific order or sequence. It should be understood that the data thus used can be interchanged under appropriate circumstances, so that the embodiments described herein can be implemented in an order other than that illustrated or described herein. In addition, the terms "include" and "have" and any variations thereof are intended to cover non-exclusive inclusion, for example, a process, method, system, product or device that includes a series of steps or modules does not have to be limited to only those steps or modules clearly listed, but can include other steps or modules that are not clearly listed or inherent to these processes, methods, products or devices.

[0056] During the process of performing bladder PDD imaging, the metabolite riboflavin of urine will be excited by excitation light, and green fluorescence will be emitted, thereby interfering with the contrast of PDD fluorescence. The existing method is to change the excitation light wavelength, such as using 500 nm as the photosensitizer excitation wavelength, to reduce the excitation efficiency of riboflavin. However, changing the excitation wavelength will also cause the fluorescence excitation efficiency of the photosensitizer to decrease, and the fluorescence brightness of PDD imaging to decrease. At the same time, it will cause more loss of visible light imaging wavelength, which is not conducive to traditional white light imaging.

[0057] In view of this, referring to Figure 1 The present application provides a fluorescence imaging method based on light source proportion adjustment, which comprises:

[0058] 101, determining a working mode.

[0059] The light source ratio adjustment-based fluorescence imaging method provided in the application is applied to a light source ratio adjustment-based fluorescence imaging device, which includes two modes of a photodynamic diagnosis (PDD) fluorescence mode and a photodynamic white light imaging mode. The device can also be subsequently increased with other modes, which are not limited herein.

[0060] Specifically, referring to Figure 3 The application also provides a light source ratio adjustment-based fluorescence imaging device, which includes a blue light source 1, a green light source 2, a red light source 3, a light compensation module 4, an imaging lens group 5, a trap wave filter 6, a photosensitive element 7, and an image processor 8.

[0061] 102. In the PDD fluorescence mode, when the blue light source is turned on, the blue light is reflected by the tissue, and the green fluorescence band spectrum generated by the excitation of the riboflavin is filtered by the trap wave filter to reduce the interference of the green fluorescence on the PDD fluorescence contrast.

[0062] When it is determined that the working mode is the PDD fluorescence mode, the blue light source 1 is turned on, the green light source 2 and the red light source 3 are turned off, the blue light emitted by the blue light source 1 is irradiated to the observed tissue, the imaging lens group 5 is used to collect the PDD fluorescence generated by the excitation in the observed tissue and the green fluorescence band spectrum generated by the riboflavin, the trap wave filter 6 is used to filter the riboflavin fluorescence, the PDD fluorescence transmits through the trap wave filter 6 to the photosensitive element 7, the photosensitive element 7 is used to convert the optical signal into an electrical signal and transmit the electrical signal to the image processor 8 for processing, and a PDD fluorescence image is output.

[0063] In this way, the green fluorescence band spectrum generated by the excitation of the riboflavin is filtered by the trap wave filter 6 to reduce the interference of the green fluorescence on the PDD fluorescence contrast.

[0064] 103. In the photodynamic white light imaging mode, the red, green and blue light is controlled by the light compensation module to be imaged in a stroboscopic manner, and the proportion of the light power of the red, green and blue light is controlled so that the three colors of light are reflected by the observed tissue and then synthesize white light after transmitting through the trap wave filter.

[0065] When it is determined that the working mode is the PDD fluorescence mode, the blue light source 1, the green light source 2 and the red light source 3 are controlled by the light compensation module 4 to be imaged in a stroboscopic manner, the red, green and blue light emitted by the blue light source 1, the green light source 2 and the red light source 3 is adjusted by the light compensation module 4 according to the pre-set light power, the reflected light after the emitted light is reflected by the observed tissue is collected by the imaging lens group 5, and then enters the photosensitive element 7 after being filtered by the trap wave filter 6, the photosensitive element 7 is used to convert the optical signal into an electrical signal and transmit the electrical signal to the image processor 8 for processing, and a white light image is output.

[0066] The light compensation module 4 is configured to control the red light, green light and blue light to be imaged in a staggered manner according to a preset frame rate. Specifically, the light compensation module 4 is configured to control the blue light and the red light to be turned on at the same time, and the blue light and the green light to be turned on at different times. Further, the light compensation module 4 is configured to control the blue light to be turned off, the red light to be turned off, and the green light to be turned on at the first frame; control the blue light to be turned on, the red light to be turned on, and the green light to be turned off at the second frame; control the blue light and the red light to be turned off, and the green light to be turned on at the third frame; and control the blue light and the red light to be turned on, and the green light to be turned off at the fourth frame, and so on.

[0067] The light compensation module 4 is also configured to adjust the light output ratio of the red, green and blue light according to a preset light power ratio, wherein the preset light power ratio of the red, green and blue light is related to the transmittance of the notch filter.

[0068] Specifically, if the transmittance ratio of the red, green and blue light of the notch filter is determined to be a:b:a, the light compensation module 4 is configured to control the output power of the red light spectrum, the green light spectrum and the blue light spectrum to be b:a:b, and a and b are positive numbers. For example, if the transmittance of the red, green and blue light of the notch filter 6 is determined to be 1:0.4:1, the light compensation module 4 is configured to control the output power of the red light spectrum, the green light spectrum and the blue light spectrum to be 0.4:1:0.4. This is only an example and does not limit the present application.

[0069] It should be noted that the red, green and blue light is imaged in a stroboscopic manner by the light compensation module 4, and the ratio of the light power of the red, green and blue light is controlled, so that in the white light mode, the image obtained by the photosensitive element 7 can be synthesized into white light, as shown in Figure 2 .

[0070] It should be noted that the light power of the red, green and blue light emitted by the red, green and blue light source entering the photosensitive element 7 is respectively:

[0071]

[0072] wherein P r is the light power of the red light entering the photosensitive element 7, P g is the light power of the green light entering the photosensitive element 7, and P b is the light power of the blue light entering the photosensitive element 7, λ is the wavelength of the light, L r (λ) is the output power of the red light spectrum, L g (λ) is the output power of the green light spectrum, and L b (λ) is the output power of the blue light spectrum.

[0073] It can be understood that, in the photodynamic white light image mode, the light compensation module 4 controls the output power of the red, green and blue light, so that the difference percentage of the power of the red, green and blue light entering the photosensitive element 7 and the average power of the three colors is less than or equal to the preset difference percentage threshold. The difference percentage threshold can be set according to the actual situation, and for example, it can be set to 10%. Herein, only as an example, not as a limitation of the present application.

[0074] Further, the average power of the red, green and blue light is:

[0075]

[0076] The difference percentage of the red light power and the average power of the three colors is:

[0077]

[0078] The difference percentage of the green light power and the average power of the three colors is:

[0079]

[0080] The difference percentage of the blue light power and the average power of the three colors is:

[0081]

[0082] Wherein, P r is the red light power, P g is the green light power, P b is the blue light power, ΔP r is the difference between the red light power and the average power of the three colors, ΔP g is the difference between the green light power and the average power of the three colors, and ΔP b is the difference between the blue light power and the average power of the three colors, and a is the preset difference percentage threshold, 0

[0083] The present application also provides a fluorescence imaging device based on light source proportion adjustment, please refer to Figure 2 , the device comprises: a blue light source 1, a green light source 2, a red light source 3, a light compensation module 4, an imaging lens group 5, a wave trap filter 6, a photosensitive element 7, an image processor 8.

[0084] In the PDD fluorescence mode of photodynamic diagnosis, when the blue light source 1 is turned on and the green light source 2 and the red light source 3 are turned off, the blue light emitted by the blue light source 1 irradiates the observed tissue, the imaging lens group 5 is used to collect the PDD fluorescence generated by the excited light and the green fluorescence band generated by the luciferin in the observed tissue, the notch filter 6 is used to filter the luciferin fluorescence, the PDD fluorescence transmits through the notch filter 6 to the photosensitive element 7, the photosensitive element 7 is used to convert the optical signal into an electrical signal and transmit it to the image processor 8 for processing to output a PDD fluorescence image.

[0085] In the photodynamic white light image mode, the blue light source 1, the green light source 2 and the red light source 3 are controlled by the light compensation module 4 to perform imaging in the stroboscopic mode, and the red, green and blue light emitted by the blue light source 1, the green light source 2 and the red light source 3 is adjusted by the light compensation module 4 according to the pre-set light power, the reflected light after the emitted light is reflected by the observed tissue is collected by the imaging lens group 5, and then enters the photosensitive element 7 after being filtered by the notch filter 6, the photosensitive element 7 is used to convert the optical signal into an electrical signal and transmit it to the image processor 8 for processing to output a white light image.

[0086] It should be noted that the light compensation module 4 is used to control the red light, the green light and the blue light to be imaged in the frame error mode according to the pre-set frame rate. Specifically, the light compensation module 4 is specifically used to control the blue light and the red light to be turned on at the same time, and the blue light and the green light to be turned on at different times.

[0087] Further, the light compensation module 4 is specifically used to: when in the first frame, control the blue light to be turned off, the red light to be turned off, and the green light to be turned on; in the second frame, control the blue light to be turned on, the red light to be turned on, and the green light to be turned off; the third frame is the same as the first frame, and the fourth frame is the same as the second frame, and so on.

[0088] The light compensation module 4 is also used to adjust the light output ratio of the red, green and blue light according to the pre-set light power ratio, wherein the ratio of the red, green and blue light of the pre-set light power ratio is related to the transmittance of the notch filter. Specifically, if it is determined that the transmittance ratio of the red, green and blue light of the notch filter is a:b:a, then the output power of the red light spectrum, the green light spectrum and the blue light spectrum is controlled by the light compensation module 4 to be b:a:b, and a and b are positive numbers.

[0089] Wherein, the light power of the red light, the green light and the blue light emitted by the red, green and blue light sources entering the photosensitive element 7 is respectively:

[0090]

[0091] Wherein, P r is the light power of the red light entering the photosensitive element 7, P gP represents the light power of green light entering the photosensitive element 7. b λ represents the optical power of blue light entering the photosensitive element 7, and L represents the wavelength of the light. r (λ) represents the output power of the red light spectrum, L g (λ) represents the output power of the green light spectrum, L b (λ) represents the output power of the blue light spectrum.

[0092] In photodynamic white light imaging mode, the light compensation module 4 is used to control the output power of red, green and blue light so that the percentage difference between the power of the red, green and blue light entering the photosensitive element 7 and the average power of the three colors is less than or equal to a preset percentage difference threshold.

[0093] The average power of red, green and blue light for:

[0094]

[0095] The percentage difference between the red light power and the average power of the three colors is:

[0096]

[0097] The percentage difference between the green light power and the average power of the three colors is:

[0098]

[0099] The percentage difference between the blue light power and the average power of the three colors is:

[0100]

[0101] Among them, P r For red light power, P g For green light power, P b For blue light power, ΔP r It is the difference between the red light power and the average power of the three colors of light, ΔP. g It is the difference between the green light power and the average power of the three colors of light, ΔP b It is the difference between the blue light power and the average power of the three colors of light, where 'a' is a preset percentage threshold for the difference, and 0 < a < 1.

[0102] This application provides a fluorescence imaging method, apparatus, and storage medium based on light source ratio adjustment. The method is applied to a fluorescence imaging apparatus based on light source ratio adjustment, which includes at least two modes: a photodynamic diagnostic PDD fluorescence mode and a photodynamic white light imaging mode. The method includes: in the photodynamic diagnostic PDD fluorescence mode, when a blue light source is turned on, the blue light, after being reflected by tissue, is filtered through a notch filter to reduce the interference of green fluorescence on the PDD fluorescence contrast; in the photodynamic white light imaging mode, a light compensation module controls red, green, and blue light to use a stroboscopic imaging method and controls the ratio of the light power of the three colors so that the three colors of light, after being reflected by the observed tissue and passing through the notch filter, are synthesized into white light. By combining a notch filter and a light compensation module, the problem of green fluorescence generated by riboflavin excitation affecting the contrast of PDD fluorescence imaging is solved, while ensuring the color reproduction of traditional white light imaging.

[0103] Figure 4 This is a schematic diagram of the structure of a fluorescence imaging system 20 based on light source ratio adjustment, provided in an embodiment of this application. Figure 4 As shown, the fluorescence imaging 20 based on light source ratio adjustment in this embodiment includes: at least one processor 201 ( Figure 4 The diagram shows only one processor, a memory 202, and a computer program 203 stored in the memory 202 and executable on the at least one processor 201. When the processor 201 executes the computer program 203, it implements the steps in any of the above embodiments of the fluorescence imaging method based on light source ratio adjustment.

[0104] The fluorescence imaging device 20 based on light source ratio adjustment may include, but is not limited to, a processor 201 and a memory 202. Those skilled in the art will understand that... Figure 3 This is merely an example of a fluorescence imaging device 20 based on the adjustment of the light source ratio, and does not constitute a limitation on the fluorescence imaging device 20 based on the adjustment of the light source ratio. It may include more or fewer components than shown, or combine certain components, or different components, such as input / output devices, network access devices, etc.

[0105] The processor 201 can be a central processing unit (CPU), and can also be other general-purpose processors, a digital signal processor (DSP), an application specific integrated circuit (ASIC), a field-programmable gate array (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. The general-purpose processor can be a microprocessor or the processor can also be any conventional processor.

[0106] The memory 202 can be an internal storage unit of the light source ratio adjustment based fluorescence imaging device 20 in some embodiments, for example, a hard disk or a memory of the light source ratio adjustment based fluorescence imaging device 20. The light source ratio adjustment based fluorescence imaging device 20 can also be an external storage device of the light source ratio adjustment based fluorescence imaging device 20 in other embodiments, for example, a plug-in hard disk, a smart media card (SMC), a secure digital (SD) card, a flash card, etc. equipped on the light source ratio adjustment based fluorescence imaging device 20. Further, the memory 202 can include both the internal storage unit and the external storage device of the light source ratio adjustment based fluorescence imaging device 20. The memory 202 is used to store operating devices, application programs, a boot loader, data, and other programs, for example, program codes of the computer programs, etc. The memory 202 can also be used to temporarily store data that has been output or will be output.

[0107] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working processes of the above-described system, device and unit can refer to the corresponding processes in the foregoing method embodiments, which will not be described herein.

[0108] The integrated unit, if implemented in the form of a software function unit and sold or used as an independent product, can be stored in a computer readable storage medium. Based on such understanding, the technical solutions of the present application essentially or say the part that contributes to the prior art or the whole or part of the technical solutions can be embodied in the form of a software product. The computer software product is stored in a storage medium and includes a number of instructions for causing a computer device (which can be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of the present application. The aforementioned storage medium includes: a U disk, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk, and various media that can store program codes.

[0109] In the embodiments provided by the present application, it should be understood that the disclosed method can be implemented in other ways without exceeding the spirit and scope of the application. The present embodiments are only exemplary and should not be used to limit the application. The specific contents given should not limit the purpose of the application. For example, some features can be omitted or not implemented.

[0110] The technical means disclosed in the present application scheme is not limited to the technical means disclosed in the above embodiments, but also includes the technical solutions composed of any combination of the above technical features. It should be noted that, for those skilled in the art, without departing from the principles of the present application, some improvements and refinements can also be made, which are also considered within the protection scope of the present application.

[0111] The above provides a kind of fluorescent imaging method based on light source proportion adjustment, device and storage medium provided by the embodiment of the present application in detail, the principle and implementation mode of the present application are described in this paper, the above embodiment is only used to help understanding the method and core idea of the present application;At the same time, for those skilled in the art, according to the idea of the present application, there will be changes in specific implementation mode and application range, and the above description should not be understood as the limitation of the present application. Although the present application is described in detail with reference to the foregoing embodiments, those skilled in the art should understand that: it can still modify the technical solutions recorded in the foregoing embodiments, or make equivalent replacement to part of technical features;And these modifications or replacements do not make the essence of the corresponding technical solutions deviate from the spirit and scope of the technical solutions of the embodiments of the present application.

Claims

1. A method for fluorescence imaging based on light source proportion adjustment, characterized in that, The method is applied to a light source proportion adjustment-based fluorescence imaging device including two modes of a photodynamic diagnosis (PDD) fluorescence mode and a photodynamic white light imaging mode, and the method comprises the following steps: In the PDD fluorescence mode, when the blue light source is turned on, the spectrum of green fluorescence generated by the excitation of the blue light after being reflected by the tissue is filtered through the trap filter to reduce the interference of the green fluorescence on the PDD fluorescence contrast; In the photodynamic white light imaging mode, the red, green and blue light is controlled to be imaged in a stroboscopic manner by the light compensation module, and the proportion of the light powers of the red, green and blue light is controlled to make the red, green and blue light reflected by the observed tissue and then synthesized into white light after passing through the trap filter; In the photodynamic white light imaging mode, the light compensation module controls the output powers of the red, green and blue light to make the power difference percentage of the red, green and blue light entering the photosensitive element and the average power of the three colors of light both less than or equal to a preset power difference percentage threshold.

2. The method of claim 1, wherein the light source ratio adjustment is based on a ratio of a first light source to a second light source. The light compensation module controls the red, green and blue light to be imaged in a stroboscopic manner, specifically comprising the following steps: The light compensation module controls the red, green and blue light to be imaged in a stroboscopic manner, specifically comprising the following steps:

3. The method of claim 2, wherein the light source ratio adjustment is based on a ratio of a first light source to a second light source. The method specifically comprises the following steps: The blue light and the red light are controlled to be turned on at the same time.

4. The method of claim 3, wherein the light source ratio adjustment is based on a ratio of a first light source to a second light source. The light compensation module controls the red, green and blue light to be imaged in a stroboscopic manner, specifically comprising the following steps: In the first frame, the blue light is controlled to be turned off, the red light is controlled to be turned off, and the green light is controlled to be turned on; in the second frame, the blue light is controlled to be turned on, the red light is controlled to be turned on, and the green light is controlled to be turned off; the third frame is the same as the first frame, and the fourth frame is the same as the second frame.

5. The method of claim 1, wherein, The control of the proportion of the light powers of the red, green and blue light specifically comprises the following steps: The light compensation module adjusts the light output proportion of the red, green and blue light according to a preset light power proportion, wherein the proportion of the red, green and blue light of the preset light power proportion is related to the transmittance of the trap filter.

6. The method of claim 5, wherein the light source ratio adjustment is based on a ratio of a first light source to a second light source. The proportion of the red, green and blue light of the preset light power proportion is related to the transmittance of the trap filter, specifically comprising the following steps: If it is determined that the transmittance proportion of the trap filter for the red, green and blue light is a:b:a, then the output powers of the red, green and blue light are controlled by the light compensation module to be b:a:b, and a and b are positive numbers.

7. The light source proportion adjustment-based fluorescence imaging method according to claim 6, wherein Average power of red, green, blue light Is: ； The difference value percentage of the red light power and the average power of the three colors of light is: ； The difference value percentage of the green light power and the average power of the three colors of light is: ； The difference value percentage of the blue light power and the average power of the three colors of light is: ； wherein, is a light power of red light entering the photosensitive element, is a light power of green light entering the photosensitive element, is a light power of blue light entering the photosensitive element, is a difference between the red light power and an average power of the three colors of light, is a difference between the green light power and the average power of the three colors of light, is a difference between the blue light power and the average power of the three colors of light, and m is a preset difference percentage threshold, .

8. A fluorescence imaging apparatus based on light source proportion adjustment, characterized by, The device comprises a blue light source (1), a green light source (2), a red light source (3), a light compensation module (4), an imaging lens group (5), a trap filter (6), a photosensitive element (7), an image processor (8), In the photodynamic diagnosis PDD fluorescence mode, when the blue light source (1) is turned on and the green light source (2) and the red light source (3) are turned off, after the blue light emitted by the blue light source (1) irradiates the observed tissue, the imaging lens group (5) is used to collect the spectrum of the PDD fluorescence generated by the excited observation tissue and the green fluorescence generated by the riboflavin, the notch filter (6) is used to filter the riboflavin fluorescence, the PDD fluorescence transmits through the notch filter (6) to the photosensitive element (7), and the photosensitive element (7) is used to convert the optical signal into an electrical signal and transmit it to the image processor (8) for processing to output a PDD fluorescence image. In the photodynamic white light imaging mode, the blue light source (1), the green light source (2), and the red light source (3) are controlled by the light compensation module (4) to perform imaging in a stroboscopic manner, and the red, green, and blue light emitted by the blue light source (1), the green light source (2), and the red light source (3) is adjusted by the light compensation module (4) according to the pre-set light power, the reflected light after the emitted light is reflected by the observed tissue is collected by the imaging lens group (5), and then enters the photosensitive element (7) after being filtered by the notch filter (6), the photosensitive element (7) is used to convert the optical signal into an electrical signal and transmit it to the image processor (8) for processing to output a white light image. In the photodynamic white light imaging mode, the light compensation module (4) is used to control the output power of the red, green, and blue light so that the difference percentage of the power of the red, green, and blue light entering the photosensitive element (7) and the average power of the three colors of light is less than or equal to a pre-set difference percentage threshold.

9. The fluorescence imaging device based on light source ratio adjustment according to claim 8, wherein the light compensation module (4) is configured to control the red, green, and blue light to be imaged in a frame error mode according to a pre-set frame rate.

10. The fluorescence imaging device based on light source ratio adjustment according to claim 9, wherein the light compensation module (4) is specifically configured to control the blue light and the red light to be turned on at the same time, and the blue light and the green light to be turned on at different times. The light compensation module (4) is specifically configured to: when in the first frame, control the blue light to be turned off, the red light to be turned off, and the green light to be turned on; in the second frame, control the blue light to be turned on, the red light to be turned on, and the green light to be turned off; in the third frame, control the blue light to be turned off, the red light to be turned off, and the green light to be turned on; in the fourth frame, control the blue light to be turned on, the red light to be turned on, and the green light to be turned off; and so on.

11. The light source proportionally adjusted fluorescence imaging apparatus according to claim 10, wherein 12. The fluorescence imaging device based on light source ratio adjustment according to claim 11, wherein the light compensation module (4) is further configured to adjust the light output ratio of the red, green, and blue light according to a pre-set light power ratio, and the pre-set light power ratio of the red, green, and blue light is related to the transmittance of the notch filter.

13. The fluorescence imaging device based on light source ratio adjustment according to claim 12, wherein if it is determined that the transmittance ratio of the red, green, and blue light of the notch filter is a:b:a, the light compensation module (4) is configured to control the output power of the red, green, and blue light spectrum to be b:a:b, and a and b are positive numbers. ​ ​ ​ ​ 14. The light source ratio adjustment based fluorescence imaging apparatus according to claim 13, characterized in that, Average power of red, green, blue light Is: ； a difference percentage of red light power and average power of the three colors is: ； a difference percentage of green light power and average power of the three colors is: ； a difference percentage of blue light power and average power of the three colors is: ； wherein, is the light power of red light entering the light sensing element (7), is the light power of green light entering the light sensing element (7), is the light power of blue light entering the light sensing element (7), is the difference between the red light power and the average power of the three colors of light, is the difference between the green light power and the average power of the three colors of light, is the difference between the blue light power and the average power of the three colors of light, and m is a preset difference percentage threshold value, .

15. A fluorescence imaging device based on light source proportion adjustment, characterized in that, The apparatus comprises a memory, a processor, and a computer program stored in the memory and executable on the processor, and the processor implements the light source ratio adjustment based fluorescence imaging method according to any one of claims 1 to 7 when executing the computer program.

16. A computer-readable storage medium, characterized in that, The computer readable storage medium stores a computer program, and the computer program is executed by the processor to implement the light source ratio adjustment based fluorescence imaging method according to any one of claims 1 to 7.

Images