Fluorescence imaging method and apparatus based on light source proportion adjustment, and storage medium

Abstract

A fluorescence imaging method and apparatus based on light source proportion adjustment, and a storage medium. The method comprises: in a photodynamic diagnosis (PDD) fluorescence mode, when a blue light source is turned on, blue light is reflected by tissue, and then passes through a notch filter to filter out a spectrum of a green fluorescence band generated by riboflavin excitation, so as to reduce the interference of green fluorescence on PDD fluorescence contrast; and in a photodynamic white light imaging mode, a light compensation module controls red light, green light, and blue light to perform imaging in a stroboscopic manner, and controls a proportion of the optical powers of the red light, the green light, and the blue light, so that the red light, the green light, and the blue light, after being reflected by observed tissue and passing through the notch filter, are synthesized into white light. By combining the notch filter and the light compensation module, the problem that during PDD fluorescence imaging, green fluorescence generated by riboflavin excitation affects the contrast of PDD fluorescence imaging is solved, and the color reproduction of traditional white light imaging can also be ensured.

Description

A fluorescence imaging method, device, and storage medium based on light source ratio adjustment

[0001] This application claims priority to Chinese patent application CN202411835834.4, filed on December 13, 2024. The entire contents of the aforementioned Chinese patent application are incorporated herein by reference. Technical Field

[0002] This application relates to the field of photodynamic diagnostics, and in particular to a fluorescence imaging method, device, and storage medium based on light source ratio adjustment. Background Technology

[0003] Photodynamic diagnosis (PDD) is a novel diagnostic technique that involves accumulating photosensitizing substances in diseased tissue and then exciting it with light to make it fluoresce. The presence or absence of disease and the location of the diseased tissue are determined by observing and detecting the fluorescence.

[0004] This technology has wide applications in medical diagnostics. For example, in tumor diagnosis, photosensitizing drugs are selectively concentrated at cancer cells; then, the cancerous tissue is irradiated with excitation light, causing the concentrated photosensitizing drugs to fluoresce; by analyzing the distribution of fluorescence intensity, the location and condition of the cancer can be determined. As another example, in bladder photodiagnosis (PDD) imaging, blue-violet light is used as excitation light to irradiate the tissue where photosensitizers have accumulated, exciting red fluorescence, which is then imaged.

[0005] However, during bladder photodiode (PDD) imaging, riboflavin, a metabolite in urine, is excited by excitation light and emits green fluorescence, thus interfering with the contrast of PDD fluorescence. Current methods aim to reduce the excitation efficiency of riboflavin by altering the excitation wavelength, for example, by using 500 nm as the photosensitizer excitation wavelength. However, changing the excitation wavelength also leads to a decrease in the fluorescence excitation efficiency of the photosensitizer, resulting in a decrease in the fluorescence brightness of the PDD image. Simultaneously, it causes greater loss in the visible light imaging band, which is detrimental to traditional white light imaging. Summary of the Invention

[0006] This application provides a fluorescence imaging method, device, and storage medium based on light source ratio adjustment. By combining a notch filter and a light compensation module, it solves the problem that the green fluorescence generated by the excitation of riboflavin affects the contrast of PDD fluorescence imaging during the PDD fluorescence imaging process, while also ensuring the color reproduction of traditional white light imaging.

[0007] In view of this, this application provides a fluorescence imaging method based on light source ratio adjustment. This method is applied to a fluorescence imaging device based on light source ratio adjustment, which includes at least two modes: a photodynamic diagnostic PDD fluorescence mode and a photodynamic white light imaging mode. The method includes: in the photodynamic diagnostic PDD fluorescence mode, when the blue light source is turned on, the blue light, after being reflected by the tissue, is filtered through a notch filter to reduce the interference of green fluorescence on the PDD fluorescence contrast; in the photodynamic white light imaging mode, a light compensation module controls the red, green, and blue light to use a stroboscopic imaging method, and controls the ratio of the light power of the red, green, and blue light so that the three colors of light, after being reflected by the observed tissue and passing through the notch filter, are synthesized into white light.

[0008] In conjunction with the first aspect, in one possible implementation, the optical compensation module controls the red, green, and blue light to form an image using a stroboscopic method, specifically including: the optical compensation module controls the red, blue, and green light to form an image in staggered frames according to a preset frame rate.

[0009] In conjunction with the first aspect, in one possible implementation, the method specifically includes: controlling the blue light and red light to illuminate synchronously, and the blue light and green light to illuminate asynchronously.

[0010] In conjunction with the first aspect, in one possible implementation, the light compensation module controls the red, blue, and green light to perform frame-shifting imaging according to a preset frame rate, specifically including: when in the first frame, controlling the blue light to turn off and the red light to turn off, while the green light turns on; when in the second frame, controlling the blue light to turn on and the red light to turn on, while the green light turns off; the third frame is the same as the first frame, the fourth frame is the same as the second frame, and so on, with each two frames forming a cycle.

[0011] In conjunction with the first aspect, in one possible implementation, controlling the ratio of the optical power of the red, green, and blue light specifically includes: the optical compensation module adjusting the output ratio of the red, green, and blue light according to a preset optical power ratio, wherein the preset optical power ratio of the red, green, and blue light is related to the transmittance of the notch filter.

[0012] In conjunction with the first aspect, in one possible implementation, the ratio of the red, green, and blue colors with the pre-set optical power ratio is related to the transmittance of the notch filter, specifically including:

[0013] If the transmittance ratio of the notch filter for red, green and blue light is determined to be a:b:a, then the output power of the red light spectrum, green light spectrum and blue light spectrum is controlled by the light compensation module to be b:a:b, where a and b are both positive numbers.

[0014] In conjunction with the first aspect, in one possible implementation, the optical powers of the red, green, and blue light emitted by the red, green, and blue light sources entering the photosensitive element are respectively:

[0015] Among them, P r P represents the light power of red light entering the photosensitive element. g P represents the light power of green light entering the photosensitive element. b L represents the optical power of blue light entering the photosensitive element, λ represents the wavelength of the light, and L represents the wavelength of the light. r (λ) represents the output power of the red light spectrum, L g (λ) represents the output power of the green light spectrum, L b (λ) represents the output power of the blue light spectrum.

[0016] In conjunction with the first aspect, in one possible implementation, in photodynamic white light imaging mode, the light compensation module controls the output power of red, green and blue light so that the percentage difference between the power of the red, green and blue light entering the photosensitive element and the average power of the three colors is less than or equal to a preset percentage difference threshold.

[0017] In conjunction with the first aspect, in one possible implementation, the average power of the red, green, and blue light... for:

[0018] The percentage difference between the red light power and the average power of the three colors is:

[0019] The percentage difference between the green light power and the average power of the three colors is:

[0020] The percentage difference between the blue light power and the average power of the three colors is:

[0021] Among them, P r For red light power, P g For green light power, P b For blue light power, ΔP r It is the difference between the red light power and the average power of the three colors of light, ΔP. g It is the difference between the green light power and the average power of the three colors of light, ΔP b It is the difference between the blue light power and the average power of the three-color light, where 'a' is a preset percentage threshold for the difference, 0. <a<1。

[0022] A second aspect of this application provides a fluorescence imaging device based on light source ratio adjustment. The device includes: a blue light source 1, a green light source 2, a red light source 3, a light compensation module 4, an imaging lens group 5, a notch filter 6, a photosensitive element 7, and an image processor 8. In photodynamic diagnostic PDD fluorescence mode, when the blue light source 1 is turned on, the green light source 2 and the red light source 3 are turned off. After the blue light emitted by the blue light source 1 illuminates the observed tissue, the imaging lens group 5 is used to collect the spectrum of the PDD fluorescence excited within the observed tissue and the green fluorescence band generated by riboflavin. The notch filter 6 is used to filter the riboflavin fluorescence, and the PDD fluorescence passes through the notch filter 6 to reach the photosensitive element. The photosensitive element 7 is used to convert light signals into electrical signals and transmit them to the image processor 8 for processing to output a PDD fluorescence image. In the photodynamic white light imaging mode, the blue light source 1, green light source 2, and red light source 3 are used for imaging in a stroboscopic manner under the control of the light compensation module 4. The red, green, and blue light emitted by the blue light source 1, green light source 2, and red light source 3 are all adjusted by the light compensation module 4 according to a preset light power. After being reflected by the observed tissue, the reflected light is collected by the imaging lens group 5 and filtered by the notch filter 6 before entering the photosensitive element 7. The photosensitive element 7 is used to convert light signals into electrical signals and transmit them to the image processor 8 for processing to output a white light image.

[0023] In conjunction with the second aspect, in one possible implementation, the light compensation module 4 is used to control red light, green light and blue light to perform frame-shifting imaging according to a preset frame rate.

[0024] In conjunction with the second aspect, in one possible implementation, the light compensation module 4 is specifically used to control the blue light and red light illumination times to be synchronized, while the blue light and green light illumination times are asynchronous.

[0025] In conjunction with the second aspect, in one possible implementation, the light compensation module 4 is specifically used to: control the blue light to turn off and the red light to turn off in the first frame, while the green light turns on; control the blue light to turn on and the red light to turn on in the second frame, while the green light turns off; the third frame is the same as the first frame, the fourth frame is the same as the second frame, and so on, with a cycle of every two frames.

[0026] In conjunction with the second aspect, in one possible implementation, the light compensation module 4 is further configured to adjust the output ratio of red, green, and blue light according to a preset light power ratio, wherein the preset light power ratio of red, green, and blue light is related to the transmittance of the notch filter.

[0027] In conjunction with the second aspect, in one possible implementation, if the transmittance ratio of the notch filter for red, green, and blue light is determined to be a:b:a, then the output power of the red, green, and blue light spectra is controlled by the light compensation module 4 to be b:a:b, where a and b are both positive numbers.

[0028] In conjunction with the second aspect, in one possible implementation, the optical powers of the red, green, and blue light emitted by the red, green, and blue light sources entering the photosensitive element 7 are respectively:

[0029] Among them, P r P represents the light power of red light entering the photosensitive element 7. g P represents the light power of green light entering the photosensitive element 7. b λ represents the optical power of blue light entering the photosensitive element 7, and L represents the wavelength of the light. r (λ) represents the output power of the red light spectrum, L g (λ) Output power of the green light spectrum, L b (λ) Output power of the blue light spectrum.

[0030] In conjunction with the second aspect, in one possible implementation, in the photodynamic white light imaging mode, the light compensation module 4 is used to control the output power of red, green and blue light so that the percentage difference between the power of the red, green and blue light entering the photosensitive element 7 and the average power of the three colors is less than or equal to a preset percentage difference threshold.

[0031] In conjunction with the second aspect, in one possible implementation, the average power of the red, green, and blue light... for:

[0032] The percentage difference between the red light power and the average power of the three colors is:

[0033] The percentage difference between the green light power and the average power of the three colors is:

[0034] The percentage difference between the blue light power and the average power of the three colors is:

[0035] Among them, P r For red light power, P g For green light power, P b For blue light power, ΔP r It is the difference between the red light power and the average power of the three colors of light, ΔP. g It is the difference between the green light power and the average power of the three colors of light, ΔP bIt is the difference between the blue light power and the average power of the three-color light, where 'a' is a preset percentage threshold for the difference, 0. <a<1。

[0036] A third aspect of this application provides a fluorescence imaging device based on light source ratio adjustment. The device includes: a memory, a processor, and a computer program stored in the memory and executable on the processor. When the processor executes the computer program, it implements the fluorescence imaging method based on light source ratio adjustment as described in any of the possible implementations of the first aspect.

[0037] The fourth aspect of this application provides a computer-readable storage medium storing a computer program that, when executed by a processor, implements a fluorescence imaging method for adjusting the light source ratio as described in any of the possible implementations of the first aspect.

[0038] This application provides a fluorescence imaging method, apparatus, and storage medium based on light source ratio adjustment. The method is applied to a fluorescence imaging apparatus based on light source ratio adjustment, which includes at least two modes: a photodynamic diagnostic PDD fluorescence mode and a photodynamic white light imaging mode. The method includes: in the photodynamic diagnostic PDD fluorescence mode, when a blue light source is turned on, the blue light, after being reflected by tissue, is filtered through a notch filter to reduce the interference of green fluorescence on the PDD fluorescence contrast; in the photodynamic white light imaging mode, a light compensation module controls red, green, and blue light to use a stroboscopic imaging method and controls the ratio of the light power of the three colors so that the three colors of light, after being reflected by the observed tissue and passing through the notch filter, are synthesized into white light. By combining a notch filter and a light compensation module, the problem of green fluorescence generated by riboflavin excitation affecting the contrast of PDD fluorescence imaging is solved, while ensuring the color reproduction of traditional white light imaging. Attached Figure Description

[0039] Figure 1 is a schematic flowchart of a fluorescence imaging method based on light source ratio adjustment in an embodiment of this application;

[0040] Figure 2 is a schematic diagram of a fluorescence imaging device based on light source ratio adjustment in an embodiment of this application;

[0041] Figure 3 is a schematic diagram of frame-shifting imaging of white light synthesized from red, green and blue light in a photodynamic white light imaging mode according to an embodiment of this application.

[0042] Figure 4 is a schematic diagram of a fluorescence imaging device based on light source ratio adjustment in an embodiment of this application;

[0043] Figure 5 is a schematic diagram of a fluorescence imaging device based on light source ratio adjustment in an embodiment of this application. Detailed Implementation

[0044] The technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this application, and not all embodiments. Based on the embodiments of this application, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this application.

[0045] The term "and / or" appearing in this application can describe the relationship between related objects, indicating that there can be three relationships. For example, A and / or B can represent three cases: A alone, A and B simultaneously, and B alone. Additionally, the character " / " in this application generally indicates that the preceding and following related objects have an "or" relationship.

[0046] The terms "first," "second," etc., used in the specification, claims, and accompanying drawings of this application are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It should be understood that such data can be interchanged where appropriate so that the embodiments described herein can be implemented in a sequence other than that illustrated or described herein. Furthermore, the terms "comprising" and "having," and any variations thereof, are intended to cover a non-exclusive inclusion; for example, a process, method, system, product, or apparatus that comprises a series of steps or modules is not necessarily limited to those steps or modules explicitly listed, but may include other steps or modules not explicitly listed or inherent to such processes, methods, products, or apparatus.

[0047] During bladder photodiode (PDD) imaging, riboflavin, a urinary metabolite, is excited by excitation light, emitting green fluorescence and interfering with the contrast of PDD fluorescence. Current methods aim to reduce riboflavin excitation efficiency by altering the excitation wavelength, for example, by using 500nm as the photosensitizer excitation wavelength. However, changing the excitation wavelength also reduces the photosensitizer's fluorescence excitation efficiency, leading to decreased fluorescence brightness in PDD imaging. Furthermore, it results in greater loss of visible light imaging wavelengths, which is detrimental to traditional white light imaging.

[0048] In view of this, this application provides a fluorescence imaging method, device and storage medium based on light source ratio adjustment. By combining a filtering module and a light compensation module, it solves the problem that the green fluorescence generated by the excitation of riboflavin affects the contrast of PDD fluorescence imaging during the PDD fluorescence imaging process, while also ensuring the color reproduction of traditional white light imaging.

[0049] In some examples, the filtering module is a notch filter, which reduces the interference of green fluorescence on the PDD fluorescence contrast by filtering the spectrum in the green fluorescence band. In other examples, the filtering module uses image processing algorithms to identify and suppress the signal components in the image data corresponding to green fluorescence, thereby reducing the interference of green fluorescence on the PDD fluorescence contrast. In some examples, the filtering module is integrated into the image processor of a fluorescence imaging device based on light source ratio adjustment.

[0050] Please refer to Figure 1. This application provides a fluorescence imaging method based on light source ratio adjustment, the method comprising:

[0051] 101. Determine the working mode.

[0052] The fluorescence imaging method based on light source ratio adjustment provided in this application is applied to a fluorescence imaging device based on light source ratio adjustment. This device includes two modes: photodynamic diagnostic PDD fluorescence mode and photodynamic white light imaging mode. In practical applications, these two modes can coexist, or only one mode can be switched to. Other modes may be added to the device in the future; this is not limited here.

[0053] In some examples, the fluorescence imaging device based on light source ratio adjustment is a cystoscope. In other examples, the fluorescence imaging device based on light source ratio adjustment includes a blue light source and a white light source; for example, white or blue LED beads can be mounted on the handle of the cystoscope, and light is guided from the handle to the tip of the cystoscope via an internal illumination fiber. In still other examples, the fluorescence imaging device based on light source ratio adjustment is externally connected to both a blue light source and a white light source.

[0054] The white light source can be achieved by combining red, green, and blue light sources, or by using a single white light source. The blue light source can be achieved by using a single blue light source, or by using a single white light source and a bandpass filter that works in conjunction with the white light source. Specifically, the bandpass filter filters out the blue light band from the white light to serve as the blue light source.

[0055] Specifically, please refer to Figure 2. This application also provides a fluorescence imaging device based on light source ratio adjustment. The device includes: a blue light source 1, a green light source 2, a red light source 3, a light compensation module 4, an imaging lens group 5, a notch filter 6, a photosensitive element 7, and an image processor 8.

[0056] 102. In PDD fluorescence mode, when the blue light source is turned on, the blue light is reflected by the tissue and then filtered through a notch filter to reduce the interference of green fluorescence on the PDD fluorescence contrast.

[0057] When the working mode is determined to be PDD fluorescence mode, with blue light source 1 turned on and green light source 2 and red light source 3 turned off, after the blue light emitted by blue light source 1 illuminates the observed tissue, the imaging lens group 5 is used to collect the spectrum of PDD fluorescence and green fluorescence generated by riboflavin that are excited in the observed tissue. The notch filter 6 is used to filter the riboflavin fluorescence. The PDD fluorescence passes through the notch filter 6 and reaches the photosensitive element 7. The photosensitive element 7 is used to convert the light signal into an electrical signal and transmit it to the image processor 8 for processing to output a PDD fluorescence image.

[0058] In this way, the spectrum of the green fluorescence band generated by riboflavin is filtered by notch filter 6 to reduce the interference of green fluorescence on the fluorescence contrast of PDD.

[0059] 103. In the photodynamic white light imaging mode, the red, green and blue light are controlled by the light compensation module to form an image using a stroboscopic method, and the ratio of the light power of the red, green and blue light is controlled so that the three colors of light are reflected by the observed tissue and then synthesized into white light after passing through the notch filter.

[0060] When the working mode is determined to be PDD fluorescence mode, the blue light source 1, green light source 2, and red light source 3 use strobe mode for imaging under the control of the light compensation module 4. The red, green, and blue light emitted by the blue light source 1, green light source 2, and red light source 3 are all adjusted by the light compensation module 4 according to the preset light power. After being reflected by the observed tissue, the reflected light is collected by the imaging lens group 5 and filtered by the notch filter 6 before entering the photosensitive element 7. The photosensitive element 7 is used to convert the light signal into an electrical signal and transmit it to the image processor 8 for processing, outputting a white light image.

[0061] The light compensation module 4 is used to control the red, green, and blue light to form staggered frames according to a preset frame rate. Specifically, the light compensation module 4 is used to control the blue and red light to illuminate synchronously, and the blue and green light to illuminate asynchronously. Furthermore, the light compensation module 4 is specifically used to: in the first frame, control the blue light to turn off and the red light to turn off, while the green light turns on; in the second frame, control the blue light to turn on and the red light to turn on, while the green light turns off; the third frame is the same as the first frame, the fourth frame is the same as the second frame, and so on, with each two frames forming a cycle.

[0062] The optical compensation module 4 is also used to adjust the output ratio of red, green and blue light according to a preset optical power ratio, wherein the ratio of red, green and blue light in the preset optical power ratio is related to the transmittance of the notch filter.

[0063] Specifically, if the transmittance ratio of the notch filter for red, green, and blue light is determined to be a:b:a, then the output power of the red, green, and blue light spectra controlled by the optical compensation module 4 is b:a:b, where a and b are both positive numbers. For example, if the transmittance of the notch filter 6 for red, green, and blue light is determined to be 1:0.4:1, then the output power of the red, green, and blue light spectra controlled by the optical compensation module 4 can be determined to be 0.4:1:0.4. This is merely an example and is not intended to limit the scope of this application.

[0064] It should be noted that the light compensation module 4 controls the red, green and blue light to form an image using a strobe method and controls the ratio of the light power of the three colors of light so that the image obtained by the photosensitive element 7 can be synthesized into white light in white light mode, as shown in Figure 3.

[0065] It should be noted that the light powers of the red, green, and blue light emitted by the red, green, and blue light sources entering the photosensitive element 7 are respectively:

[0066] Among them, P r P represents the light power of red light entering the photosensitive element 7. g P represents the light power of green light entering the photosensitive element 7. b λ represents the optical power of blue light entering the photosensitive element 7, and L represents the wavelength of the light. r (λ) represents the output power of the red light spectrum, L g (λ) Output power of the green light spectrum, L b (λ) Output power of the blue light spectrum.

[0067] Understandably, in photodynamic white light imaging mode, the light compensation module 4 controls the output power of red, green, and blue light so that the percentage difference between the power of the red, green, and blue light entering the photosensitive element 7 and the average power of the three colors is less than or equal to a preset percentage difference threshold. This percentage difference threshold can be set according to actual conditions; for example, it can be set to 10%. This is merely an example and is not intended to limit the scope of this application.

[0068] Furthermore, the average power of red, green, and blue light for:

[0069] The percentage difference between the red light power and the average power of the three colors is:

[0070] The percentage difference between the green light power and the average power of the three colors is:

[0071] The percentage difference between the blue light power and the average power of the three colors is:

[0072] Among them, P r For red light power, P g For green light power, P b For blue light power, ΔP r It is the difference between the red light power and the average power of the three colors of light, ΔP. g It is the difference between the green light power and the average power of the three colors of light, ΔP b It is the difference between the blue light power and the average power of the three-color light, where 'a' is a preset percentage threshold for the difference, 0. <a<1。

[0073] This application also provides a fluorescence imaging device based on light source ratio adjustment, as shown in Figure 2. The device includes: a blue light source 1, a green light source 2, a red light source 3, a light compensation module 4, an imaging lens group 5, a notch filter 6, a photosensitive element 7, and an image processor 8.

[0074] In the photodynamic diagnostic PDD fluorescence mode, when the blue light source 1 is turned on and the green light source 2 and red light source 3 are turned off, after the blue light emitted by the blue light source 1 illuminates the observed tissue, the imaging lens group 5 is used to collect the spectrum of the PDD fluorescence and the green fluorescence band generated by riboflavin that are excited in the observed tissue. The notch filter 6 is used to filter the riboflavin fluorescence. The PDD fluorescence passes through the notch filter 6 to reach the photosensitive element 7. The photosensitive element 7 is used to convert the light signal into an electrical signal and transmit it to the image processor 8 for processing to output the PDD fluorescence image.

[0075] In the photodynamic white light imaging mode, the blue light source 1, green light source 2, and red light source 3 are used for imaging in a stroboscopic manner under the control of the light compensation module 4. The red, green, and blue light emitted by the blue light source 1, green light source 2, and red light source 3 are all adjusted by the light compensation module 4 according to the preset light power. After being reflected by the observed tissue, the reflected light is collected by the imaging lens group 5 and filtered by the notch filter 6 before entering the photosensitive element 7. The photosensitive element 7 is used to convert the light signal into an electrical signal and transmit it to the image processor 8 for processing to output a white light image.

[0076] It should be noted that the light compensation module 4 is used to control the red, green, and blue light to form frames at a preset frame rate. Specifically, the light compensation module 4 is used to control the blue and red light to illuminate synchronously, while the blue and green light to illuminate asynchronously.

[0077] Furthermore, the light compensation module 4 is specifically used to: in the first frame, control the blue light to turn off, the red light to turn off, and the green light to turn on at the same time; in the second frame, control the blue light to turn on, the red light to turn on, and the green light to turn off at the same time; the third frame is the same as the first frame, the fourth frame is the same as the second frame... and so on, with each two frames forming a cycle.

[0078] The optical compensation module 4 is further used to adjust the output ratio of red, green, and blue light according to a preset optical power ratio, wherein the preset optical power ratio of red, green, and blue light is related to the transmittance of the notch filter. Specifically, if the transmittance ratio of the notch filter for red, green, and blue light is determined to be a:b:a, then the optical compensation module 4 controls the output power of the red, green, and blue light spectra to be b:a:b, where a and b are both positive numbers.

[0079] The light powers of the red, green, and blue light emitted by the red, green, and blue light sources entering the photosensitive element 7 are respectively:

[0080] Among them, P r P represents the light power of red light entering the photosensitive element 7. g P represents the light power of green light entering the photosensitive element 7. b λ represents the optical power of blue light entering the photosensitive element 7, and L represents the wavelength of the light. r (λ) represents the output power of the red light spectrum, L g (λ) represents the output power of the green light spectrum, L b (λ) represents the output power of the blue light spectrum.

[0081] In the photodynamic white light imaging mode, the light compensation module 4 is used to control the output power of red, green and blue light so that the percentage difference between the power of the red, green and blue light entering the photosensitive element 7 and the average power of the three colors is less than or equal to a preset percentage difference threshold.

[0082] The average power of red, green and blue light for:

[0083] The percentage difference between the red light power and the average power of the three colors is:

[0084] The percentage difference between the green light power and the average power of the three colors is:

[0085] The percentage difference between the blue light power and the average power of the three colors is:

[0086] Among them, P r For red light power, P g For green light power, P b For blue light power, ΔP r It is the difference between the red light power and the average power of the three colors of light, ΔP. g It is the difference between the green light power and the average power of the three colors of light, ΔP bIt is the difference between the blue light power and the average power of the three-color light, where 'a' is a preset percentage threshold for the difference, 0. <a<1。

[0087] In some examples, the light compensation module 4 dynamically adjusts parameters such as the output power, light emission ratio, flicker mode, and illumination time of the blue light source 1, green light source 2, and red light source 3 based on the PDD fluorescence image or white light image. In other examples, the light compensation module 4 utilizes a pre-trained neural network model to dynamically adjust the light source parameters. The PDD fluorescence image or white light image is input into the neural network model, which outputs instructions for adjusting the parameters of each light source. In one specific example, the PDD fluorescence image is input into the neural network model, which outputs instructions to suppress the green light output power, thereby optimizing the filtering effect of the notch filter to suppress the green fluorescence background generated by riboflavin in the PDD fluorescence image and reduce the interference of green fluorescence on the PDD fluorescence contrast. In another specific example, the white light image is input into the neural network model, which outputs instructions to adjust the light emission ratio of the red, blue, and green light sources to compensate for the spectral absorption of the green fluorescence band caused by the notch filter, thus achieving white light color restoration.

[0088] In some examples, the neural network model described above is a Convolutional Neural Network (CNN) model or a Vision Transformer (ViT) model. In some examples, the training data for the neural network model includes PDD fluorescence images labeled with green fluorescence interference and color-distorted white light images acquired under different bladder tissue conditions. The neural network model is trained to learn the mapping relationship between the parameters of each light source and the image quality. The parameters of each light source include at least one of the following: output power, light emission ratio, flicker mode, and illumination time. Image quality includes fluorescence contrast in PDD fluorescence mode and color balance in photodynamic white light imaging mode. In some examples, the neural network model supports online learning, allowing for incremental updates based on newly acquired images to adapt to different clinical scenarios and individual patient differences.

[0089] This application also provides a fluorescence imaging device based on light source ratio adjustment, as shown in Figure 4. The device includes: a white light source 11, a blue light source 1, an imaging lens group 5, a filter 16, a photosensitive element 7, and an image processor 8.

[0090] In the photodynamic white light imaging mode, the white light source 11 emits white light, which is reflected to the imaging lens group 5 after reaching the tissue being observed. The imaging lens group 5 is used to collect the white light reflected by the tissue being observed, and after passing through the filter 16, it is focused onto the photosensitive chip 7. The photosensitive element 7 converts the light signal into an electrical signal and transmits it to the image processor 8 for processing, thereby outputting a white light image.

[0091] In some examples, filter 16 is a double notch filter used to filter most of the blue light and visible red light and transmit it to the photosensitive element 7. The photosensitive element 7 converts the light signal into an electrical signal and transmits it to the image processor 8 for processing. The image processor 8 is used to compensate for the blue light and red light, that is, to compensate for the signal light of the B channel and R channel, thereby ensuring the color reproduction of the white light image.

[0092] In some examples, filter 16 is a notch filter used to filter the spectrum of the green fluorescence band, and image processor 8 is used to compensate for the spectrum of the green fluorescence band, that is, to compensate for the signal light of the G channel, so as to ensure color reproduction of white light imaging.

[0093] In PDD fluorescence mode, blue light source 1 is turned on. Blue light excites the photosensitizer in the observed tissue to produce PDD fluorescence (red fluorescence), and excites riboflavin in the observed tissue to produce green fluorescence. The excitation light (blue light), red fluorescence, and green fluorescence are simultaneously collected and focused by imaging lens group 5.

[0094] In some examples, when filter 16 is a double notch filter, it is used to filter most of the blue light and visible red light green fluorescence spectrum and transmit it to the photosensitive element 7. The photosensitive element 7 converts the light signal into an electrical signal and transmits it to the image processor 8 for processing. The image processor 8 integrates a filtering module. The filtering module identifies and suppresses the signal component corresponding to green fluorescence in the image data through image processing algorithms, so as to reduce the interference of green fluorescence on the PDD fluorescence contrast, thereby outputting the PDD fluorescence image.

[0095] In some examples, when filter 16 is a notch filter, it is used to filter the spectrum of the green fluorescence band and transmit it to the photosensitive element 7. The photosensitive element 7 converts the light signal into an electrical signal and transmits it to the image processor 8 for processing, thereby outputting a PDD fluorescence image. Understandably, the notch filter in this example corresponds to the filtering module described above. In some examples, even after filtering with the notch filter, a small amount of residual green noise may still remain. To improve the quality of the PDD fluorescence image, the image processor 8 can also use methods such as desaturation via Hue / Saturation / Lightness (HSV) or targeted color correction matrix (CCM) for suppression.

[0096] In some examples, the PDD fluorescence mode and photodynamic white light imaging mode are switched via a button. In other examples, the PDD fluorescence mode and photodynamic white light imaging mode are switched via a mode switching function provided by the image processor.

[0097] This application provides a fluorescence imaging method, apparatus, and storage medium based on light source ratio adjustment. The method is applied to a fluorescence imaging apparatus based on light source ratio adjustment, which includes at least two modes: a photodynamic diagnostic PDD fluorescence mode and a photodynamic white light imaging mode. The method includes: in the photodynamic diagnostic PDD fluorescence mode, when a blue light source is turned on, the blue light, after being reflected by tissue, is filtered through a notch filter to reduce the interference of green fluorescence on the PDD fluorescence contrast; in the photodynamic white light imaging mode, a light compensation module controls red, green, and blue light to use a stroboscopic imaging method and controls the ratio of the light power of the three colors so that the three colors of light, after being reflected by the observed tissue and passing through the notch filter, are synthesized into white light. By combining a notch filter and a light compensation module, the problem of green fluorescence generated by riboflavin excitation affecting the contrast of PDD fluorescence imaging is solved, while ensuring the color reproduction of traditional white light imaging.

[0098] Figure 5 is a schematic diagram of the structure of a fluorescence imaging method 20 based on light source ratio adjustment provided in an embodiment of this application. As shown in Figure 5, the fluorescence imaging method 20 based on light source ratio adjustment in this embodiment includes: at least one processor 201 (only one processor is shown in Figure 5), a memory 202, and a computer program 203 stored in the memory 202 and executable on the at least one processor 201. When the processor 201 executes the computer program 203, it implements the steps in any of the above-described fluorescence imaging method embodiments based on light source ratio adjustment.

[0099] The fluorescence imaging device 20 based on light source ratio adjustment may include, but is not limited to, a processor 201 and a memory 202. Those skilled in the art will understand that Figure 5 is merely an example of the fluorescence imaging device 20 based on light source ratio adjustment and does not constitute a limitation on the fluorescence imaging device 20 based on light source ratio adjustment. It may include more or fewer components than illustrated, or combine certain components, or different components, such as input / output devices, network access devices, etc.

[0100] The processor 201 can be a Central Processing Unit (CPU), but it can also be other general-purpose processors, digital signal processors (DSPs), application-specific integrated circuits (ASICs), field-programmable gate arrays (FPGAs), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. The general-purpose processor can be a microprocessor or any conventional processor.

[0101] In some embodiments, the memory 202 can be an internal storage unit of the fluorescence imaging device 20 that adjusts based on the light source ratio, such as a hard disk or memory of the fluorescence imaging device 20. In other embodiments, the fluorescence imaging device 20 that adjusts based on the light source ratio can also be an external storage device, such as a plug-in hard disk, smart media card (SMC), secure digital (SD) card, flash card, etc., equipped on the fluorescence imaging device 20. Furthermore, the memory 202 can include both the internal storage unit of the fluorescence imaging device 20 and an external storage device. The memory 202 is used to store operating devices, application programs, bootloaders, data, and other programs, such as the program code of the computer program. The memory 202 can also be used to temporarily store data that has been output or will be output.

[0102] Those skilled in the art will clearly understand that, for the sake of convenience and brevity, the specific working processes of the systems, devices, and units described above can be referred to the corresponding processes in the foregoing method embodiments, and will not be repeated here.

[0103] If the integrated unit is implemented as a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, or all or part of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of this application. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, portable hard drives, read-only memory (ROM), random access memory (RAM), magnetic disks, or optical disks.

[0104] In the embodiments provided in this application, it should be understood that the disclosed methods can be implemented in other ways without exceeding the concept and scope of this application. The current embodiments are merely exemplary examples and should not be considered limiting, nor should the specific content given limit the purpose of this application. For example, some features may be omitted or not implemented.

[0105] The technical means disclosed in this application are not limited to those disclosed in the above embodiments, but also include technical solutions composed of any combination of the above technical features. It should be noted that those skilled in the art can make several improvements and modifications without departing from the principles of this application, and these improvements and modifications are also considered to be within the scope of protection of this application.

[0106] The foregoing has provided a detailed description of a fluorescence imaging method, apparatus, and storage medium based on light source ratio adjustment provided in the embodiments of this application. Specific examples have been used to illustrate the principles and implementation methods of this application. The descriptions of the embodiments above are merely for the purpose of helping to understand the method and its core ideas. Furthermore, those skilled in the art will recognize that, based on the ideas of this application, there will be changes in the specific implementation methods and application scope. Therefore, the content of this specification should not be construed as a limitation of this application. Although this application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some of the technical features; and these modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the concept and scope of the technical solutions of the embodiments of this application.

Claims

1. A fluorescence imaging method based on light source ratio adjustment, characterized in that, The method is applied to a fluorescence imaging device based on light source ratio adjustment, wherein the fluorescence imaging device based on light source ratio adjustment includes two modes: photodynamic diagnostic PDD fluorescence mode and photodynamic white light imaging mode. The method includes: In the photodynamic diagnostic PDD fluorescence mode, when the blue light source is turned on, the blue light excites the photosensitizer in the observed tissue to produce PDD fluorescence and excites the riboflavin in the observed tissue to produce green fluorescence. After the green fluorescence is reduced by the filtering module to reduce the interference of the green fluorescence on the PDD fluorescence contrast, the PDD fluorescence image is output. In photodynamic white light imaging mode, when the white light source is turned on, the white light image is output after color restoration of the image formed by the reflection of light through the observed tissue.

2. The fluorescence imaging method based on light source ratio adjustment according to claim 1, characterized in that, The white light source is achieved by combining red, green, and blue light sources; In the photodynamic white light imaging mode, the red, green and blue light are controlled by the light compensation module to form an image using a stroboscopic method, and the ratio of the light power of the red, green and blue light is controlled so that the red, green and blue light are reflected by the observed tissue and then synthesized into white light after passing through the filtering module.

3. The fluorescence imaging method based on light source ratio adjustment according to claim 2, characterized in that, The filtering module is a notch filter, used to filter the spectrum of the green fluorescence band.

4. The fluorescence imaging method based on light source ratio adjustment according to claim 2, characterized in that, The optical compensation module controls red, green, and blue light to form an image using a strobe method, specifically including: The light compensation module controls red, blue, and green light to perform frame-by-frame imaging according to a preset frame rate.

5. The fluorescence imaging method based on light source ratio adjustment according to claim 4, characterized in that, The method specifically includes: The blue and red lights are controlled to illuminate synchronously, while the blue and green lights are controlled to illuminate asynchronously.

6. The fluorescence imaging method based on light source ratio adjustment according to claim 5, characterized in that, The light compensation module controls red, blue, and green light to perform frame-shifting imaging according to a preset frame rate, specifically including: In frame 1, control the blue light to turn off and the red light to turn off, while the green light turns on; in frame 2, control the blue light to turn on and the red light to turn on, while the green light turns off; frame 3 is the same as frame 1, frame 4 is the same as frame 2... every two frames form a cycle.

7. The fluorescence imaging method based on light source ratio adjustment according to claim 3, characterized in that, The specific proportions of controlling the optical power of the red, green, and blue light include: The optical compensation module adjusts the output ratio of red, green, and blue light according to a preset optical power ratio, wherein the preset optical power ratio of red, green, and blue light is related to the transmittance of the notch filter.

8. The fluorescence imaging method based on light source ratio adjustment according to claim 7, characterized in that, The pre-set ratio of red, green, and blue light power is related to the transmittance of the notch filter, specifically including: If the transmittance ratio of the notch filter for red, green and blue light is determined to be a:b:a, then the output power of the red light spectrum, green light spectrum and blue light spectrum is controlled by the light compensation module to be b:a:b, where a and b are both positive numbers.

9. The fluorescence imaging method based on light source ratio adjustment according to claim 8, characterized in that, In photodynamic white light imaging mode, the light compensation module controls the output power of red, green and blue light so that the percentage difference between the power of the red, green and blue light entering the photosensitive element and the average power of the three colors is less than or equal to a preset percentage difference threshold.

10. A fluorescence imaging device based on light source ratio adjustment, characterized in that, The device includes: a blue light source (1), an imaging lens group (5), a filtering module, a photosensitive element (7), and an image processor (8). In the photodynamic diagnostic PDD fluorescence mode, when the blue light source (1) is turned on, the blue light emitted by the blue light source (1) excites the photosensitizer in the observed tissue to produce PDD fluorescence and excites the riboflavin in the observed tissue to produce green fluorescence. The imaging lens group (5) is used to collect the spectrum of the PDD fluorescence and the green fluorescence produced by the riboflavin in the observed tissue. The filtering module is used to reduce the interference of green fluorescence on the contrast of PDD fluorescence. The PDD fluorescence passes through the filtering module to reach the photosensitive element (7). The photosensitive element (7) is used to convert the light signal into an electrical signal and transmit it to the image processor (8) for processing to output a PDD fluorescence image.

11. The fluorescence imaging device based on light source ratio adjustment according to claim 10, characterized in that, The device also includes: a green light source (2), a red light source (3), and a light compensation module (4); In the photodynamic white light imaging mode, the blue light source (1), green light source (2), and red light source (3) are used for imaging in a stroboscopic manner under the control of the light compensation module (4). The red, green, and blue light emitted by the blue light source (1), green light source (2), and red light source (3) are all adjusted by the light compensation module (4) according to the preset light power. After the emitted light is reflected by the observed tissue, the reflected light is collected by the imaging lens group (5) and enters the photosensitive element (7) after passing through the filtering module. The photosensitive element (7) is used to convert the light signal into an electrical signal and transmit it to the image processor (8) for processing to output a white light image.

12. The fluorescence imaging device based on light source ratio adjustment according to claim 11, characterized in that, The filtering module is a notch filter (6) used to filter the spectrum of the green fluorescence band.

13. The fluorescence imaging device based on light source ratio adjustment according to claim 11, characterized in that, The light compensation module (4) is used to control red light, green light and blue light to form frames according to a preset frame rate.

14. The fluorescence imaging device based on light source ratio adjustment according to claim 13, characterized in that, The light compensation module (4) is specifically used to control the blue light and red light to be on synchronously, and the blue light and green light to be on asynchronously.

15. The fluorescence imaging device based on light source ratio adjustment according to claim 14, characterized in that, The optical compensation module (4) is specifically used for: In frame 1, control the blue light to turn off and the red light to turn off, while the green light turns on; in frame 2, control the blue light to turn on and the red light to turn on, while the green light turns off; frame 3 is the same as frame 1, frame 4 is the same as frame 2... every two frames form a cycle.

16. The fluorescence imaging device based on light source ratio adjustment according to claim 12, characterized in that, The light compensation module (4) is also used to adjust the output ratio of red, green and blue light according to a preset light power ratio, wherein the ratio of red, green and blue light in the preset light power ratio is related to the transmittance of the notch filter (6).

17. The fluorescence imaging device based on light source ratio adjustment according to claim 16, characterized in that, If the transmittance ratio of the notch filter (6) for red, green and blue light is determined to be a:b:a, then the output power of the red light spectrum, green light spectrum and blue light spectrum is controlled by the light compensation module (4) to be b:a:b, where a and b are both positive numbers.

18. The fluorescence imaging device based on light source ratio adjustment according to claim 17, characterized in that, In the photodynamic white light imaging mode, the light compensation module (4) is used to control the output power of red, green and blue light so that the percentage difference between the power of the red, green and blue light entering the photosensitive element (7) and the average power of the three colors of light is less than or equal to a preset percentage difference threshold.

19. A fluorescence imaging device based on light source ratio adjustment, characterized in that, The device includes: a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein when the processor executes the computer program, it implements the fluorescence imaging method for adjusting the light source ratio as described in any one of claims 1 to 9.

20. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores a computer program that, when executed by a processor, implements the fluorescence imaging method for adjusting the light source ratio as described in any one of claims 1 to 9.

Images