Fluorescence imaging method and apparatus based on light source intensity adjustment, and storage medium

Abstract

A fluorescence imaging method and apparatus based on light source intensity adjustment, and a storage medium. The method comprises: in a PDD fluorescence mode, when a blue light source is turned on, reflecting blue light by observed tissue, and then filtering, by means of a notch filter, a spectrum of a green fluorescence band generated by excitation of riboflavin; and in a photo dynamic white light imaging mode, by means of a light compensation module and on the basis of preset optical power, adjusting each of red, green and blue light emitted by red, green and blue light sources, such that the light is reflected by the observed tissue, and then the light turns into white light after passing through the notch filter, wherein the light compensation module controls the output optical power of red light and the output optical power of blue light to be consistent, and controls the output power of green light to be higher than the optical power of red or blue light. By combining the notch filter and the light compensation module, the problem that green fluorescence generated by the excitation of riboflavin during PDD fluorescence imaging affects the contrast of PDD fluorescence imaging is solved, and color reproduction of conventional white light imaging can also be ensured.

Description

A fluorescence imaging method, device, and storage medium based on light source intensity adjustment

[0001] This application claims priority to Chinese patent application CN202411836014.7, filed on December 13, 2024. The entire contents of the aforementioned Chinese patent application are incorporated herein by reference. Technical Field

[0002] This application relates to the field of photodynamic diagnostics, and in particular to a fluorescence imaging method, device, and storage medium based on light source intensity adjustment. Background Technology

[0003] Photodynamic diagnosis (PDD) is a novel diagnostic technique that involves accumulating photosensitizing substances in diseased tissue and then exciting it with light to make it fluoresce. The presence or absence of disease and the location of the diseased tissue are determined by observing and detecting the fluorescence.

[0004] This technology has wide applications in medical diagnostics. For example, in tumor diagnosis, photosensitizing drugs are selectively concentrated at cancer cells; then, the cancerous tissue is irradiated with excitation light, causing the concentrated photosensitizing drugs to fluoresce; by analyzing the distribution of fluorescence intensity, the location and condition of the cancer can be determined. As another example, in bladder photodiagnosis (PDD) imaging, blue-violet light is used as excitation light to irradiate the tissue where photosensitizers have accumulated, exciting red fluorescence, which is then imaged.

[0005] However, during bladder photodiode (PDD) imaging, riboflavin, a metabolite in urine, is excited by excitation light and emits green fluorescence, thus interfering with the contrast of PDD fluorescence. Current methods aim to reduce the excitation efficiency of riboflavin by altering the excitation wavelength, for example, by using 500 nm as the photosensitizer excitation wavelength. However, changing the excitation wavelength also leads to a decrease in the fluorescence excitation efficiency of the photosensitizer, resulting in a decrease in the fluorescence brightness of the PDD image. Simultaneously, it causes greater loss in the visible light imaging band, which is detrimental to traditional white light imaging. Summary of the Invention

[0006] This application provides a fluorescence imaging method based on light source intensity adjustment. By combining a notch filter and a light compensation module, it solves the problem that the green fluorescence generated by the excitation of riboflavin affects the contrast of PDD fluorescence imaging during the PDD fluorescence imaging process, while also ensuring the color reproduction of traditional white light imaging.

[0007] In view of this, this application provides a fluorescence imaging method based on light source intensity adjustment. The method is applied to a fluorescence imaging device with light intensity adjustment, which includes two modes: photodynamic diagnostic PDD fluorescence mode and photodynamic white light imaging mode. The method includes: in PDD fluorescence mode, when the blue light source is turned on, the blue light, after being reflected by the observed tissue, is filtered through a notch filter to reduce the interference of green fluorescence on the PDD fluorescence contrast; in photodynamic white light imaging mode, red, green, and blue light sources are turned on simultaneously, wherein the red, green, and blue light emitted by the red, green, and blue light sources are all adjusted by a light compensation module according to a preset light power so that the light after being reflected by the observed tissue and then passing through the notch filter is white light. The light compensation module controls the output light power of the red and blue light to be consistent, and the output power of the green light is higher than that of the red or blue light.

[0008] In conjunction with the first aspect, in one possible implementation, the red, green, and blue light emitted by the red, green, and blue light sources are all adjusted by the light compensation module according to a preset light power. Specifically, the light compensation module adjusts the output ratio of the red, green, and blue light according to a preset light power ratio, wherein the ratio of the red, green, and blue light in the preset light power ratio is related to the transmittance of the notch filter.

[0009] In conjunction with the first aspect, in one possible implementation, the ratio of red, green, and blue light to the pre-set optical power ratio is related to the transmittance of the notch filter. Specifically, if the transmittance ratio of the notch filter for red, green, and blue light is determined to be a:b:a, then the output power of the red, green, and blue light spectra is controlled by the optical compensation module to be b:a:b, where a and b are both positive numbers.

[0010] In conjunction with the first aspect, in one possible implementation, the optical powers of the red, green, and blue light emitted by the red, green, and blue light sources entering the photosensitive element are respectively:

[0011] Among them, P r P represents the light power of red light entering the photosensitive element. g P represents the light power of green light entering the photosensitive element. b L represents the optical power of blue light entering the photosensitive element, λ represents the wavelength of the light, and L represents the wavelength of the light. r (λ) represents the output power of the red light spectrum, L g (λ) Output power of the green light spectrum, L b (λ) Output power of the blue light spectrum.

[0012] In conjunction with the first aspect, in one possible implementation, in photodynamic white light imaging mode, the light compensation module controls the output power of red, green and blue light so that the percentage difference between the power of the red, green and blue light entering the photosensitive element and the average power of the three colors is less than or equal to a preset percentage difference threshold.

[0013] In one possible implementation, the average power of the red, green, and blue light... for:

[0014] The percentage difference between the red light power and the average power of the three colors is:

[0015] The percentage difference between the green light power and the average power of the three colors is:

[0016] The percentage difference between the blue light power and the average power of the three colors is:

[0017] Among them, P r For red light power, P g For green light power, P b For blue light power, ΔP r It is the difference between the red light power and the average power of the three colors of light, ΔP. g It is the difference between the green light power and the average power of the three colors of light, ΔP b It is the difference between the blue light power and the average power of the three colors of light, where 'a' is a preset percentage threshold for the difference, and 0 < a < 1.

[0018] A second aspect of this application provides a fluorescence imaging device based on light source intensity adjustment. The device includes: a blue light source 1, a green light source 2, a red light source 3, a light compensation module 4, an imaging lens group 5, a notch filter 6, a photosensitive element 7, and an image processor 8. In photodynamic diagnostic PDD fluorescence mode, when the blue light source 1 is turned on, the green light source 2 and the red light source 3 are turned off. After the blue light emitted by the blue light source 1 illuminates the observed tissue, the imaging lens group 5 is used to collect the spectrum of the PDD fluorescence excited within the observed tissue and the green fluorescence generated by riboflavin. The notch filter 6 is used to filter the riboflavin fluorescence. The PDD fluorescence passes through the notch filter 6 and reaches the photosensitive element 7. The photosensitive element 7 is used to convert the optical signal into an electrical signal and transmit it to the image processor. The image is processed by the device 8 to output a PDD fluorescence image. In the photodynamic white light imaging mode, the blue light source 1, green light source 2, and red light source 3 are all turned on under the control of the light compensation module 4. The red, green, and blue light emitted by the blue light source 1, green light source 2, and red light source 3 are all adjusted by the light compensation module 4 according to the preset light power. After the three colors of light are reflected by the observed tissue, the reflected light is collected by the imaging lens group 5 and filtered by the notch filter 6 before entering the photosensitive element 7. The photosensitive element 7 is used to convert the light signal into an electrical signal and transmit it to the image processor 8 for processing to output a white light image. The light compensation module 4 controls the light power output by the blue light source 1 and the red light source 3 to be consistent, and the output power of the green light source 2 is higher than that of the blue light source 1 or the red light source 3.

[0019] In conjunction with the second aspect, in one possible implementation, the optical compensation module 4 adjusts the output of red, green, and blue light according to a preset optical power ratio, wherein the preset optical power ratio of red, green, and blue light is related to the transmittance of the notch filter 6.

[0020] In conjunction with the second aspect, in one possible implementation, if the transmittance ratio of the notch filter 6 for red, green, and blue light is determined to be a:b:a, then the output power of the red, green, and blue light spectra is controlled by the light compensation module 4 to be b:a:b, where a and b are both positive numbers.

[0021] In conjunction with the second aspect, in one possible implementation,

[0022] The light powers of the red, green, and blue light emitted by the red, green, and blue light sources entering the photosensitive element 7 are respectively:

[0023] Among them, P r P represents the light power of red light entering the photosensitive element 7. g P represents the light power of green light entering the photosensitive element 7. bλ represents the optical power of blue light entering the photosensitive element 7, and L represents the wavelength of the light. r (λ) represents the output power of the red light spectrum, L g (λ) Output power of the green light spectrum, L b (λ) Output power of the blue light spectrum.

[0024] In conjunction with the second aspect, in one possible implementation, in the photodynamic white light imaging mode, the light compensation module 4 controls the output power of the red, green and blue light so that the percentage difference between the power of the red, green and blue light entering the photosensitive element 7 and the average power of the three light colors is less than or equal to a preset percentage difference threshold.

[0025] In conjunction with the second aspect, in one possible implementation, the average power of the red, green, and blue light... for:

[0026] The percentage difference between the red light power and the average power of the three colors is:

[0027] The percentage difference between the green light power and the average power of the three colors is:

[0028] The percentage difference between the blue light power and the average power of the three colors is:

[0029] Among them, P r For red light power, P g For green light power, P b For blue light power, ΔP r It is the difference between the red light power and the average power of the three colors of light, ΔP. g It is the difference between the green light power and the average power of the three colors of light, ΔP b It is the difference between the blue light power and the average power of the three colors of light, where 'a' is a preset percentage threshold for the difference, and 0 < a < 1.

[0030] A third aspect of this application provides a fluorescence imaging device based on light source intensity adjustment. The device includes a memory, a processor, and a computer program stored in the memory and executable on the processor. When the processor executes the computer program, it implements the fluorescence imaging method based on light source intensity adjustment as described in any possible implementation of the first aspect to the first aspect of this application.

[0031] The fourth aspect of this application provides a computer-readable storage medium storing a computer program that, when executed by a processor, implements the fluorescence imaging method based on light source intensity adjustment as described in any possible implementation of the first aspect to the first aspect of this application.

[0032] This application provides a fluorescence imaging method based on light source intensity adjustment. The method is applied to a fluorescence imaging device with light intensity adjustment, which includes two modes: photodynamic diagnostic PDD fluorescence mode and photodynamic white light imaging mode. The method includes: in PDD fluorescence mode, when the blue light source is turned on, the blue light, after being reflected by the observed tissue, is filtered through a notch filter to reduce the interference of green fluorescence on the PDD fluorescence contrast; in photodynamic white light imaging mode, red, green, and blue light sources are turned on simultaneously. The red, green, and blue light emitted by the red, green, and blue light sources are all adjusted by a light compensation module according to a preset light power so that the light after being reflected by the observed tissue and then passing through the notch filter is white light. The light compensation module controls the output light power of the red and blue light to be consistent, and the output power of the green light is higher than that of the red or blue light. By combining a notch filter and an optical compensation module, the problem of green fluorescence generated by riboflavin excitation affecting the contrast of PDD fluorescence imaging is solved, while ensuring color reproduction of traditional white light imaging. Attached Figure Description

[0033] Figure 1 is a schematic flowchart of a fluorescence imaging method based on light source intensity adjustment in an embodiment of this application;

[0034] Figure 2 is a schematic diagram of a fluorescence imaging device based on light source intensity adjustment in an embodiment of this application;

[0035] Figure 3 is a schematic diagram of a fluorescence imaging device based on light source intensity adjustment in an embodiment of this application;

[0036] Figure 4 is a schematic diagram of a fluorescence imaging device based on light source intensity adjustment in an embodiment of this application. Detailed Implementation

[0037] The technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this application, and not all embodiments. Based on the embodiments of this application, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this application.

[0038] The term "and / or" appearing in this application can describe the relationship between related objects, indicating that there can be three relationships. For example, A and / or B can represent three cases: A alone, A and B simultaneously, and B alone. Additionally, the character " / " in this application generally indicates that the preceding and following related objects have an "or" relationship.

[0039] The terms "first," "second," etc., used in the specification, claims, and accompanying drawings of this application are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It should be understood that such data can be interchanged where appropriate so that the embodiments described herein can be implemented in a sequence other than that illustrated or described herein. Furthermore, the terms "comprising" and "having," and any variations thereof, are intended to cover a non-exclusive inclusion; for example, a process, method, system, product, or apparatus that comprises a series of steps or modules is not necessarily limited to those steps or modules explicitly listed, but may include other steps or modules not explicitly listed or inherent to such processes, methods, products, or apparatus.

[0040] During bladder photodiode (PDD) imaging, riboflavin, a urinary metabolite, is excited by excitation light, emitting green fluorescence and interfering with the contrast of PDD fluorescence. Current methods aim to reduce riboflavin excitation efficiency by altering the excitation wavelength, for example, by using 500nm as the photosensitizer excitation wavelength. However, changing the excitation wavelength also reduces the photosensitizer's fluorescence excitation efficiency, leading to decreased fluorescence brightness in PDD imaging. Furthermore, it results in greater loss of visible light imaging wavelengths, which is detrimental to traditional white light imaging.

[0041] In view of this, this application provides a fluorescence imaging method, device and storage medium based on light source intensity adjustment. By combining a filtering module and a light compensation module, it solves the problem that the green fluorescence generated by the excitation of riboflavin affects the contrast of PDD fluorescence imaging during the PDD fluorescence imaging process, while also ensuring the color reproduction of traditional white light imaging.

[0042] In some examples, the filtering module is a notch filter, which reduces the interference of green fluorescence on the PDD fluorescence contrast by filtering the spectrum in the green fluorescence band. In other examples, the filtering module uses image processing algorithms to identify and suppress the signal components in the image data corresponding to green fluorescence, thereby reducing the interference of green fluorescence on the PDD fluorescence contrast. In some examples, the filtering module is integrated into the image processor of a fluorescence imaging device based on light source intensity adjustment.

[0043] Please refer to Figure 1. This application provides a fluorescence imaging method based on light source intensity adjustment, the method comprising:

[0044] 101. Determine the working mode.

[0045] The fluorescence imaging method based on light source intensity adjustment provided in this application is applied to a fluorescence imaging device based on light source intensity adjustment, which is equipped with a notch filter and a light compensation module.

[0046] In some examples, the fluorescence imaging device based on light source intensity adjustment is a cystoscope. In some examples, the fluorescence imaging device based on light source intensity adjustment includes a blue light source and a white light source; for example, white or blue LED beads can be mounted on the handle of the cystoscope, and light is guided from the handle to the tip of the cystoscope via an internal illumination fiber. In other examples, the fluorescence imaging device based on light source intensity adjustment is externally connected to both a blue light source and a white light source.

[0047] The white light source can be achieved by combining red, green, and blue light sources, or by using a single white light source. The blue light source can be achieved by using a single blue light source, or by using a single white light source and a bandpass filter that works in conjunction with the white light source. Specifically, the bandpass filter filters out the blue light band from the white light to serve as the blue light source.

[0048] Specifically, please refer to Figure 2. This application also provides a fluorescence imaging device based on light source intensity adjustment. The device includes: a blue light source 1, a green light source 2, a red light source 3, a light compensation module 4, an imaging lens group 5, a notch filter 6, a photosensitive element 7, and an image processor 8.

[0049] The device features two modes: PDD fluorescence mode and photodynamic white light imaging mode. In practical applications, these two modes can coexist, or only one mode can be switched on. Further modes may be added to the device in the future; no restrictions are specified here.

[0050] 102. In PDD fluorescence mode, when the blue light source is turned on, the blue light is reflected by the observed tissue and then filtered through a notch filter to reduce the interference of green fluorescence on the PDD fluorescence contrast.

[0051] When the working mode is determined to be PDD fluorescence mode, with blue light source 1 turned on and green light source 2 and red light source 3 turned off, after the blue light emitted by blue light source 1 illuminates the observed tissue, the imaging lens group 5 is used to collect the spectrum of PDD fluorescence and green fluorescence generated by riboflavin that are excited in the observed tissue. The notch filter 6 is used to filter the riboflavin fluorescence. The PDD fluorescence passes through the notch filter 6 and reaches the photosensitive element 7. The photosensitive element 7 is used to convert the light signal into an electrical signal and transmit it to the image processor 8 for processing to output a PDD fluorescence image.

[0052] In this way, the spectrum of the green fluorescence band generated by riboflavin is filtered by notch filter 6 to reduce the interference of green fluorescence on the fluorescence contrast of PDD.

[0053] 103. In the photodynamic white light imaging mode, red, green and blue light sources are turned on simultaneously. The red, green and blue light emitted by the red, green and blue light sources are all adjusted by the light compensation module according to the preset light power so that the light is reflected by the observed tissue and then passes through the notch filter to produce white light. The light compensation module controls the output light power of red light and blue light to be consistent, and the output power of green light is higher than that of red light or blue light.

[0054] In photodynamic white light imaging mode, blue light source 1, green light source 2, and red light source 3 are all turned on under the control of light compensation module 4. The red, green, and blue light emitted by blue light source 1, green light source 2, and red light source 3 are all adjusted by light compensation module 4 according to the preset light power. After the three colors of light are reflected by the observed tissue, the reflected light is collected by imaging lens group 5, filtered by notch filter 6, and then enters photosensitive element 7. Photosensitive element 7 is used to convert light signals into electrical signals and transmit them to image processor 8 for processing, outputting a white light image.

[0055] The light compensation module 4 controls the output light power of blue light source 1 and red light source 3 to be consistent, and the output power of green light source 2 is higher than that of blue light source 1 or red light source 3.

[0056] It should be noted that the light compensation module 4 adjusts the output ratio of red, green and blue light according to the preset light power ratio. The ratio of red, green and blue light in the preset light power ratio is related to the transmittance of the notch filter 6.

[0057] Furthermore, if the transmittance ratio of the notch filter 6 for red, green, and blue light is determined to be a:b:a, then the output power ratio of the red, green, and blue light spectra controlled by the optical compensation module 4 is b:a:b, where a and b are both positive numbers. For example, if the transmittance ratio of the notch filter 6 for red, green, and blue light is determined to be 1:0.4:1, then the output power ratio of the red, green, and blue light spectra controlled by the optical compensation module 4 can be determined to be 0.4:1:0.4. This is merely an example and is not intended to limit the scope of this application.

[0058] It should be noted that the light powers of the red, green, and blue light emitted by the red, green, and blue light sources entering the photosensitive element 7 are respectively:

[0059] Among them, P r P represents the light power of red light entering the photosensitive element 7. g P represents the light power of green light entering the photosensitive element 7. b λ represents the optical power of blue light entering the photosensitive element 7, and L represents the wavelength of the light. r (λ) represents the output power of the red light spectrum, L g(λ) represents the output power of the green light spectrum, L b (λ) represents the output power of the blue light spectrum.

[0060] It is understood that in photodynamic white light imaging mode, the light compensation module 4 controls the output power of red, green, and blue light so that the percentage difference between the power of the red, green, and blue light entering the photosensitive element 7 and the average power of the three colors is less than or equal to a preset percentage difference threshold. This preset percentage difference threshold can be set according to actual conditions; for example, it can be set to 10%. This is merely an example and is not intended to limit the scope of this application.

[0061] Furthermore, the average power of red, green, and blue light for:

[0062] The percentage difference between the red light power and the average power of the three colors is:

[0063] The percentage difference between the green light power and the average power of the three colors is:

[0064] The percentage difference between the blue light power and the average power of the three colors is:

[0065] Among them, P r For red light power, P g For green light power, P b For blue light power, ΔP r It is the difference between the red light power and the average power of the three colors of light, ΔP. g It is the difference between the green light power and the average power of the three colors of light, ΔP b It is the difference between the blue light power and the average power of the three colors of light, where 'a' is a preset percentage threshold for the difference, and 0 < a < 1.

[0066] This application also provides a fluorescence imaging device based on light source intensity adjustment, as shown in Figure 2. The device includes: a blue light source 1, a green light source 2, a red light source 3, a light compensation module 4, an imaging lens group 5, a notch filter 6, a photosensitive element 7, and an image processor 8.

[0067] In the photodynamic diagnostic PDD fluorescence mode, when the blue light source 1 is turned on and the green light source 2 and red light source 3 are turned off, after the blue light emitted by the blue light source 1 illuminates the observed tissue, the imaging lens group 5 is used to collect the spectrum of the PDD fluorescence and the green fluorescence band generated by riboflavin that are excited in the observed tissue. The notch filter 6 is used to filter the riboflavin fluorescence. The PDD fluorescence passes through the notch filter 6 to reach the photosensitive element 7. The photosensitive element 7 is used to convert the light signal into an electrical signal and transmit it to the image processor 8 for processing to output the PDD fluorescence image.

[0068] In photodynamic white light imaging mode, blue light source 1, green light source 2, and red light source 3 are all turned on under the control of light compensation module 4. The red, green, and blue light emitted by blue light source 1, green light source 2, and red light source 3 are all adjusted by light compensation module 4 according to the preset light power. After the three colors of light are reflected by the observed tissue, the reflected light is collected by imaging lens group 5 and filtered by notch filter 6 before entering photosensitive element 7. Photosensitive element 7 is used to convert the light signal into an electrical signal and transmit it to image processor 8 for processing to output a white light image. Light compensation module 4 controls the light power output by blue light source 1 and red light source 3 to be consistent, and the output power of green light source 2 is higher than that of blue light source 1 or red light source 3.

[0069] It should be noted that the optical compensation module 4 adjusts the output of red, green and blue light according to the preset optical power ratio. The preset optical power ratio of red, green and blue light is related to the transmittance of the notch filter 6.

[0070] Furthermore, if the transmittance ratio of the notch filter 6 for red, green and blue light is determined to be a:b:a, then the output power of the red light spectrum, green light spectrum and blue light spectrum is controlled by the light compensation module 4 to be b:a:b, where a and b are both positive numbers.

[0071] The light powers of the red, green, and blue light emitted by the red, green, and blue light sources entering the photosensitive element 7 are respectively:

[0072] Among them, P r P represents the light power of red light entering the photosensitive element 7. g P represents the light power of green light entering the photosensitive element 7. b λ represents the optical power of blue light entering the photosensitive element 7, and L represents the wavelength of the light. r (λ) represents the output power of the red light spectrum, L g (λ) represents the output power of the green light spectrum, L b (λ) represents the output power of the blue light spectrum.

[0073] It should be noted that in the photodynamic white light imaging mode, the light compensation module 4 controls the output power of the red, green and blue light so that the percentage difference between the power of the red, green and blue light entering the photosensitive element 7 and the average power of the three light colors is less than or equal to a preset percentage difference threshold.

[0074] The average power of red, green and blue light for:

[0075] The percentage difference between the red light power and the average power of the three colors is:

[0076] The percentage difference between the green light power and the average power of the three colors is:

[0077] The percentage difference between the blue light power and the average power of the three colors is:

[0078] Among them, P r For red light power, P g For green light power, P b For blue light power, ΔP r It is the difference between the red light power and the average power of the three colors of light, ΔP. g It is the difference between the green light power and the average power of the three colors of light, ΔP b It is the difference between the blue light power and the average power of the three colors of light, where 'a' is a preset percentage threshold for the power difference, and 0 < a < 1.

[0079] In some examples, the light compensation module 4 dynamically adjusts the output power of the blue light source 1, green light source 2, and red light source 3 based on the PDD fluorescence image or white light image. In other examples, the light compensation module 4 utilizes a pre-trained neural network model to dynamically adjust the output power of the light sources. The PDD fluorescence image or white light image is input into the neural network model, which outputs instructions for adjusting the output power of each light source. In one specific example, the PDD fluorescence image is input into the neural network model, which outputs instructions to reduce the output power of the green light source, thereby optimizing the filtering effect of the notch filter to suppress the green fluorescence background generated by riboflavin in the PDD fluorescence image and reduce the interference of green fluorescence on the PDD fluorescence contrast. In another specific example, the white light image is input into the neural network model, which outputs instructions to increase the output power of the green light source to compensate for the spectral absorption of the green fluorescence band caused by the notch filter, thus achieving white light color restoration.

[0080] In some examples, the neural network model described above is a Convolutional Neural Network (CNN) model or a Vision Transformer (ViT) model. In some examples, the training data for the neural network model includes PDD fluorescence images labeled with green fluorescence interference and color-distorted white light images acquired under different bladder tissue conditions. The neural network model is trained to learn the mapping relationship between the output power of each light source and image quality, including fluorescence contrast in PDD fluorescence mode and color balance in photodynamic white light imaging mode. In some examples, the neural network model supports online learning capabilities, allowing for incremental updates based on newly acquired images to adapt to different clinical scenarios and individual patient differences.

[0081] This application also provides a fluorescence imaging device based on light source intensity adjustment, as shown in Figure 3. The device includes: a white light source 11, a blue light source 1, an imaging lens group 5, a filter 16, a photosensitive element 7, and an image processor 8.

[0082] In the photodynamic white light imaging mode, the white light source 11 emits white light, which is reflected to the imaging lens group 5 after reaching the tissue being observed. The imaging lens group 5 is used to collect the white light reflected by the tissue being observed, and after passing through the filter 16, it is focused onto the photosensitive chip 7. The photosensitive element 7 converts the light signal into an electrical signal and transmits it to the image processor 8 for processing, thereby outputting a white light image.

[0083] In some examples, filter 16 is a double notch filter used to filter most of the blue light and visible red light and transmit it to the photosensitive element 7. The photosensitive element 7 converts the light signal into an electrical signal and transmits it to the image processor 8 for processing. The image processor 8 is used to compensate for the blue light and red light, that is, to compensate for the signal light of the B channel and R channel, thereby ensuring the color reproduction of the white light image.

[0084] In some examples, filter 16 is a notch filter used to filter the spectrum of the green fluorescence band, and image processor 8 is used to compensate for the spectrum of the green fluorescence band, that is, to compensate for the signal light of the G channel, so as to ensure color reproduction of white light imaging.

[0085] In PDD fluorescence mode, blue light source 1 is turned on. Blue light excites the photosensitizer in the observed tissue to produce PDD fluorescence (red fluorescence), and excites riboflavin in the observed tissue to produce green fluorescence. The excitation light (blue light), red fluorescence, and green fluorescence are simultaneously collected and focused by imaging lens group 5.

[0086] In some examples, when filter 16 is a double notch filter, it is used to filter most of the blue light and visible red light green fluorescence spectrum and transmit it to the photosensitive element 7. The photosensitive element 7 converts the light signal into an electrical signal and transmits it to the image processor 8 for processing. The image processor 8 integrates a filtering module. The filtering module identifies and suppresses the signal component corresponding to green fluorescence in the image data through image processing algorithms, so as to reduce the interference of green fluorescence on the PDD fluorescence contrast, thereby outputting the PDD fluorescence image.

[0087] In some examples, when filter 16 is a notch filter, it is used to filter the spectrum of the green fluorescence band and transmit it to the photosensitive element 7. The photosensitive element 7 converts the light signal into an electrical signal and transmits it to the image processor 8 for processing, thereby outputting a PDD fluorescence image. Understandably, the notch filter in this example corresponds to the filtering module described above. In some examples, even after filtering with the notch filter, a small amount of residual green noise may still remain. To improve the quality of the PDD fluorescence image, the image processor 8 can also use methods such as desaturation via Hue / Saturation / Lightness (HSV) or targeted color correction matrix (CCM) for suppression.

[0088] In some examples, the PDD fluorescence mode and photodynamic white light imaging mode are switched via a button. In other examples, the PDD fluorescence mode and photodynamic white light imaging mode are switched via a mode switching function provided by the image processor.

[0089] This application provides a fluorescence imaging method, device, and storage medium based on light source intensity adjustment. The method is applied to a fluorescence imaging device based on light intensity adjustment, which includes two modes: photodynamic diagnostic PDD fluorescence mode and photodynamic white light imaging mode. The method includes: in PDD fluorescence mode, when the blue light source is turned on, the blue light, after being reflected by the observed tissue, is filtered through a notch filter to reduce the interference of green fluorescence on the PDD fluorescence contrast; in photodynamic white light imaging mode, red, green, and blue light sources are turned on simultaneously, wherein the red, green, and blue light emitted by the red, green, and blue light sources are all adjusted by a light compensation module according to a preset light power so that the light after being reflected by the observed tissue and then passing through the notch filter is white light. The light compensation module controls the output light power of the red and blue light to be consistent, and the output power of the green light is higher than that of the red or blue light. By combining a notch filter and an optical compensation module, the problem of green fluorescence generated by riboflavin excitation affecting the contrast of PDD fluorescence imaging is solved, while ensuring color reproduction of traditional white light imaging.

[0090] Figure 4 is a schematic diagram of the structure of the fluorescence imaging device 20 based on light source intensity adjustment provided in an embodiment of this application. As shown in Figure 4, the fluorescence imaging device 20 based on light source intensity adjustment in this embodiment includes: at least one processor 201 (only one processor is shown in Figure 4), a memory 202, and a computer program 203 stored in the memory 202 and executable on the at least one processor 201. When the processor 201 executes the computer program 203, it implements the steps in any of the above-described embodiments of the fluorescence imaging method based on light source intensity adjustment.

[0091] The fluorescence imaging device 20 based on light source intensity adjustment may include, but is not limited to, a processor 201 and a memory 202. Those skilled in the art will understand that Figure 4 is merely an example of the fluorescence imaging device 20 based on light source intensity adjustment and does not constitute a limitation on the device. It may include more or fewer components than illustrated, or combine certain components, or different components, such as input / output devices, network access devices, etc.

[0092] The processor 201 can be a Central Processing Unit (CPU), but it can also be other general-purpose processors, digital signal processors (DSPs), application-specific integrated circuits (ASICs), field-programmable gate arrays (FPGAs), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. The general-purpose processor can be a microprocessor or any conventional processor.

[0093] In some embodiments, the memory 202 can be an internal storage unit of the fluorescence imaging device 20 that adjusts based on light intensity, such as a hard disk or memory of the fluorescence imaging device 20. In other embodiments, the fluorescence imaging device 20 that adjusts based on light intensity can also be an external storage device, such as a plug-in hard disk, smart media card (SMC), secure digital (SD) card, flash card, etc., equipped on the fluorescence imaging device 20. Furthermore, the memory 202 can include both the internal storage unit of the fluorescence imaging device 20 and an external storage device. The memory 202 is used to store operating devices, applications, bootloaders, data, and other programs, such as the program code of the computer program. The memory 202 can also be used to temporarily store data that has been output or will be output.

[0094] Those skilled in the art will clearly understand that, for the sake of convenience and brevity, the specific working processes of the systems, devices, and units described above can be referred to the corresponding processes in the foregoing method embodiments, and will not be repeated here.

[0095] If the integrated unit is implemented as a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, or all or part of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of this application. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, portable hard drives, read-only memory (ROM), random access memory (RAM), magnetic disks, or optical disks.

[0096] In the embodiments provided in this application, it should be understood that the disclosed methods can be implemented in other ways without exceeding the concept and scope of this application. The current embodiments are merely exemplary examples and should not be considered limiting, nor should the specific content given limit the purpose of this application. For example, some features may be omitted or not implemented.

[0097] The technical means disclosed in this application are not limited to those disclosed in the above embodiments, but also include technical solutions composed of any combination of the above technical features. It should be noted that those skilled in the art can make several improvements and modifications without departing from the principles of this application, and these improvements and modifications are also considered to be within the scope of protection of this application.

[0098] The foregoing has provided a detailed description of a fluorescence imaging method, apparatus, and storage medium based on light source intensity adjustment provided in the embodiments of this application. Specific examples have been used to illustrate the principles and implementation methods of this application. The descriptions of the embodiments above are merely for the purpose of helping to understand the method and its core ideas. Furthermore, those skilled in the art will recognize that, based on the ideas of this application, there will be changes in the specific implementation methods and application scope. Therefore, the content of this specification should not be construed as a limitation of this application. Although this application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some of the technical features; and these modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the concept and scope of the technical solutions of the embodiments of this application.

Claims

1. A fluorescence imaging method based on light source intensity adjustment, characterized in that, The method is applied to a fluorescence imaging device based on light source intensity adjustment. The fluorescence imaging device includes two modes: photodynamic diagnostic PDD fluorescence mode and photodynamic white light imaging mode. The method includes: In PDD fluorescence mode, when the blue light source is turned on, the blue light excites the photosensitizer in the observed tissue to produce PDD fluorescence and excites the riboflavin in the observed tissue to produce green fluorescence. After the green fluorescence is reduced by the filtering module to reduce the interference of the green fluorescence on the PDD fluorescence contrast, the PDD fluorescence image is output. In photodynamic white light imaging mode, when the white light source is turned on, the white light image is output after color restoration of the image formed by the reflection of light through the observed tissue.

2. The fluorescence imaging method based on light source intensity adjustment according to claim 1, characterized in that, The white light source is achieved by combining red, green, and blue light sources; In photodynamic white light imaging mode, red, green, and blue light sources are turned on simultaneously. The red, green, and blue light emitted by these light sources are all adjusted by the light compensation module according to a preset light power so that the light is reflected by the observed tissue and then filtered to produce white light. The light compensation module controls the output light power of the red and blue light to be consistent, while the output power of the green light is higher than that of the red or blue light.

3. The fluorescence imaging method based on light source intensity adjustment according to claim 2, characterized in that, The filtering module is a notch filter, used to filter the spectrum of the green fluorescence band.

4. The fluorescence imaging method based on light source intensity adjustment according to claim 3, characterized in that, The red, green, and blue light emitted by the red, green, and blue light sources are all adjusted according to a preset light power by the light compensation module, specifically including: The optical compensation module adjusts the output ratio of red, green, and blue light according to a preset optical power ratio, wherein the preset optical power ratio of red, green, and blue light is related to the transmittance of the notch filter.

5. The fluorescence imaging method based on light source intensity adjustment according to claim 4, characterized in that, The pre-set ratio of red, green, and blue light power is related to the transmittance of the notch filter, specifically including: If the transmittance ratio of the notch filter for red, green and blue light is determined to be a:b:a, then the output power ratio of the red light spectrum, green light spectrum and blue light spectrum is controlled by the light compensation module to be b:a:b, where a and b are both positive numbers.

6. The fluorescence imaging method based on light source intensity adjustment according to claim 5, characterized in that, In photodynamic white light imaging mode, the light compensation module controls the output power of red, green and blue light so that the percentage difference between the power of the red, green and blue light entering the photosensitive element and the average power of the three colors is less than or equal to a preset percentage difference threshold.

7. The fluorescence imaging method based on light source intensity adjustment according to claim 6, characterized in that, The average power of red, green and blue light for: The percentage difference between the red light power and the average power of the three colors is: The percentage difference between the green light power and the average power of the three colors is: The percentage difference between the blue light power and the average power of the three colors is: Among them, P r For red light power, P g For green light power, P b For blue light power, ΔP r It is the difference between the red light power and the average power of the three colors of light, ΔP g It is the difference between the power of green light and the average power of the three colors of light, ΔP b It is the difference between the blue light power and the average power of the three-color light, where 'a' is a preset percentage threshold for the difference, 0. <a<1。 8. A fluorescence imaging device based on light source intensity adjustment, characterized in that, The device includes: a blue light source (1), an imaging lens group (5), a filtering module, a photosensitive element (7), and an image processor (8). In the photodynamic diagnostic PDD fluorescence mode, when the blue light source (1) is turned on, after the blue light emitted by the blue light source (1) illuminates the observed tissue, the imaging lens group (5) is used to collect the spectrum of the PDD fluorescence generated by the excited tissue and the green fluorescence generated by riboflavin. The filtering module is used to reduce the interference of green fluorescence on the PDD fluorescence contrast and transmit it to the photosensitive element (7). The photosensitive element (7) is used to convert the light signal into an electrical signal and transmit it to the image processor (8) for processing to output the PDD fluorescence image.

9. The fluorescence imaging device based on light source intensity adjustment according to claim 8, characterized in that, The device also includes: a green light source (2), a red light source (3), and a light compensation module (4); In the photodynamic white light imaging mode, the blue light source (1), green light source (2), and red light source (3) are all turned on under the control of the light compensation module (4). The red, green, and blue light emitted by the blue light source (1), green light source (2), and red light source (3) are all adjusted by the light compensation module (4) according to the preset light power. After the three colors of light are reflected by the observed tissue, the reflected light is collected by the imaging lens group (5) and enters the photosensitive element (7) after passing through the filtering module. The photosensitive element (7) is used to convert the light signal into an electrical signal and transmit it to the image processor (8) for processing and outputting a white light image. The light compensation module (4) controls the light power output of the blue light source (1) and the red light source (3) to be consistent. The output power of the green light source (2) is higher than that of the blue light source (1) or the red light source (3).

10. The fluorescence imaging device based on light source intensity adjustment according to claim 9, characterized in that, The filtering module is a notch filter (6) used to filter the spectrum of the green fluorescence band.

11. The fluorescence imaging device based on light source intensity adjustment according to claim 10, characterized in that, The optical compensation module (4) adjusts the output of red, green and blue light according to a preset optical power ratio, wherein the ratio of red, green and blue light in the preset optical power ratio is related to the transmittance of the notch filter (6).

12. The fluorescence imaging device based on light source intensity adjustment according to claim 11, characterized in that, If the transmittance ratio of the notch filter (6) for red, green and blue light is determined to be a:b:a, then the output power of the red light spectrum, green light spectrum and blue light spectrum is controlled by the light compensation module (4) to be b:a:b, where a and b are both positive numbers.

13. The fluorescence imaging device based on light source intensity adjustment according to claim 12, characterized in that, In the photodynamic white light imaging mode, the light compensation module (4) controls the output power of red, green and blue light so that the percentage difference between the power of red, green and blue light entering the photosensitive element (7) and the average power of the three colors of light is less than or equal to a preset percentage difference threshold.

14. The fluorescence imaging device based on light source intensity adjustment according to claim 13, characterized in that, The average power of red, green and blue light for: The percentage difference between the red light power and the average power of the three colors is: The percentage difference between the green light power and the average power of the three colors is: The percentage difference between the blue light power and the average power of the three colors is: Among them, P r For red light power, P g For green light power, P b For blue light power, ΔP r It is the difference between the red light power and the average power of the three colors of light, ΔP g It is the difference between the power of green light and the average power of the three colors of light, ΔP b It is the difference between the blue light power and the average power of the three-color light, where 'a' is a preset percentage threshold for the difference, 0. <a<1。 15. A fluorescence imaging device based on light source intensity adjustment, characterized in that, The device includes: a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein when the processor executes the computer program, it implements the fluorescence imaging method based on light source intensity adjustment as described in any one of claims 1 to 7.

16. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores a computer program that, when executed by a processor, implements the fluorescence imaging method based on light source intensity adjustment as described in any one of claims 1 to 7.

Images