Image acquisition system, method and device for fluorescence imaging

Abstract

The present invention discloses an image acquisition system, method and device for fluorescence imaging. The image processing method comprises the following steps: at a first moment, a first image is captured by obtaining a reference light when irradiating an object to be photographed, and the first image can display the entire clear image and the approximate position and boundary of a tumor in the entire clear image. At a second moment, a second image is captured by obtaining an excitation light when irradiating the object to be photographed so that the object to be photographed produces fluorescence, and the second image can display the precise position and boundary of the tumor in the entire blurred image. Finally, the fluorescent parts in the first image and the second image are synthesized to generate a first synthesized image. The first synthesized image can display the entire clear image and the precise position and boundary of the tumor in the entire clear image, so as to ensure that the tumor can be completely removed, thereby avoiding the problem of local recurrence of the tumor.

Description

Technical Field

[0001] The present invention relates to the technical field of image processing, and in particular to an image acquisition system, method and device for fluorescence imaging. Background Art

[0002] Medical imaging has greatly improved the accuracy of surgeons’ understanding of the cause, location, stage of disease progression, and surgical treatment methods of lesions. Existing imaging technologies include X-ray imaging, magnetic resonance imaging, nuclear medicine imaging, and ultrasound imaging. During surgery, surgeons mainly use existing imaging technologies to visually determine the location and boundaries of tumors. For tumors that are the same color, texture, and hardness as cell tissues, existing imaging technologies can only show the approximate location and boundaries of the tumor in the entire image, resulting in the inability to completely remove the tumor, which can easily lead to local recurrence of the tumor. Summary of the invention

[0003] The main purpose of the present invention is to provide an image acquisition system, method and device for fluorescence imaging, aiming to solve the technical problem that the imaging technology in the prior art can only display the approximate location and boundary of the tumor in the entire picture, resulting in the inability to completely remove the tumor, which easily leads to local recurrence of the tumor.

[0004] In a first aspect, the present application provides an acquisition system for fluorescence imaging, comprising:

[0005] A light source assembly, the light source assembly comprising a first light source and a second light source, the first light source emitting a reference light, and the second light source emitting an excitation light;

[0006] A camera device, comprising a camera body and a filter movably arranged on the camera body, wherein at a first moment, the filter is in a retracted state, so that the visible light emitted by the first light source and the second light source is irradiated on an object to be photographed, and the camera body is used to photograph the object to be photographed under the action of the visible light to obtain a first image; at a second moment, the filter is in a use state, so that the narrow-band light that meets the conditions emitted by the first light source and the second light source is irradiated on the object to be photographed, so that the object to be photographed generates fluorescence, and the camera body is used to photograph the object to be photographed under the action of the narrow-band light to obtain a second image; and

[0007] A processor is used to synthesize the first image and the fluorescent part in the second image to generate a first synthesized image.

[0008] In a second aspect, the present application provides an acquisition system for fluorescence imaging, comprising:

[0009] A light source assembly, the light source assembly comprising a first light source and a plurality of second light sources, the first light source emitting reference light, and the plurality of second light sources emitting excitation light of different wavelengths;

[0010] A camera device, comprising a camera body and a filter movably arranged on the camera body, wherein at a first moment, the filter is in a retracted state, so that the visible light emitted by the first light source and the second light source respectively illuminates the object to be photographed, and the camera body is used to photograph the object to be photographed under the action of the visible light to obtain a first image; at a second moment, the filter is in a use state, so that narrow-band light of different wavelengths satisfying conditions emitted alternately by a plurality of second light sources illuminates the object to be photographed, so that the object to be photographed produces fluorescence of different colors, and the camera body is used to photograph the object to be photographed under the action of narrow-band light of different wavelengths to obtain a plurality of second images, wherein the fluorescent parts in the plurality of second images are of different colors; and

[0011] A processor is used to synthesize the first image and fluorescent parts of different colors in a plurality of the second images to generate a first synthesized image.

[0012] In a third aspect, the present application provides an image processing method for fluorescence imaging, comprising:

[0013] At a first moment, acquiring a first image captured when the reference light is irradiated on the object to be photographed;

[0014] At a second moment, an excitation light is obtained to illuminate the object to be photographed, so as to capture a second image when the object to be photographed generates fluorescence;

[0015] The first image and the fluorescent part in the second image are synthesized to generate a first synthesized image.

[0016] Preferably, the image processing method further includes:

[0017] At a third moment, acquiring a third image captured when the reference light is irradiated on the object to be photographed;

[0018] At a fourth moment, an excitation light is obtained to illuminate the object to be photographed, so that a fourth image is captured when the object to be photographed generates fluorescence;

[0019] synthesizing the third image and the fluorescent part in the fourth image to generate a second synthesized image;

[0020] And so on;

[0021] At the N-1th moment, obtaining the N-1th image taken when the reference light is irradiated on the object to be photographed;

[0022] At the Nth moment, an excitation light is obtained to illuminate the object to be photographed, so that the object to be photographed generates fluorescence, and an Nth image is taken;

[0023] The N-1th image and the fluorescent part in the Nth image are synthesized to generate an N / 2th synthesized image; wherein N is an even number ≥2.

[0024] Preferably, the second image is processed to obtain a processed second image.

[0025] Preferably, processing the second image includes:

[0026] The parameters of the fluorescent portion in the second image are adjusted so that the fluorescent portion in the second image meets the requirements.

[0027] Preferably, the contrast and brightness of the fluorescent part in the second image are adjusted so that the contrast and brightness of the fluorescent part in the second image meet requirements.

[0028] Preferably, the reference light is white light, and the excitation light is narrow-band light.

[0029] In a fourth aspect, the present application provides an image processing method for fluorescence imaging, comprising:

[0030] At a first moment, acquiring a first image captured when the reference light is irradiated on the object to be photographed;

[0031] At a second moment, a plurality of second images are captured by alternately irradiating the object to be photographed with a plurality of excitation lights of different wavelengths so as to make the object to be photographed produce fluorescence of different colors, wherein the fluorescent parts in the plurality of second images are of different colors;

[0032] The first image and fluorescent parts of different colors in a plurality of the second images are synthesized to generate a first synthesized image.

[0033] In a fifth aspect, the present application provides an image processing device for fluorescence imaging, comprising:

[0034] A first image acquisition module, used for acquiring, at a first moment, a first image captured when the reference light is irradiated on the object to be photographed;

[0035] A second image acquisition module, used for acquiring, at a second moment, a second image captured when the object to be photographed is irradiated with excitation light to cause the object to be photographed to generate fluorescence;

[0036] The first synthetic image module is used to synthesize the first image and the fluorescent part in the second image to generate a first synthetic image.

[0037] Compared with the prior art, the present invention has the following beneficial effects:

[0038] At the first moment, by acquiring a first image captured when the reference light is used to illuminate the object to be photographed, the first image can display the entire clear image and the approximate position and boundary of the tumor in the entire clear image. At the second moment, by acquiring a second image captured when the object to be photographed is irradiated with excitation light so that the object to be photographed produces fluorescence, the second image can display the precise position and boundary of the tumor in the entire blurred image. Finally, the fluorescent parts in the first image and the second image are synthesized to generate a first synthesized image. The first synthesized image can display the entire clear image and the precise position and boundary of the tumor in the entire clear image to ensure that the tumor can be completely removed, thereby avoiding the problem of local recurrence of the tumor. BRIEF DESCRIPTION OF THE DRAWINGS

[0039] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on the structures shown in these drawings without paying creative work.

[0040] Figure 1 is a structural block diagram of an acquisition system for fluorescence imaging according to an embodiment of the present invention;

[0041] Figure 2 is a schematic diagram of a collection device for fluorescence imaging according to an embodiment of the present invention;

[0042] Figure 3 is a flow chart of an image processing method for fluorescence imaging according to one embodiment of the present invention;

[0043] Figure 4 is a structural block diagram of an image processing device for fluorescence imaging according to an embodiment of the present invention. DETAILED DESCRIPTION

[0044] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0045] It should be noted that all directional indications in the embodiments of the present invention (such as up, down, left, right, front, back, etc.) are only used to explain the relative position relationship, movement status, etc. between the components under a certain specific posture (as shown in the accompanying drawings). If the specific posture changes, the directional indication will also change accordingly.

[0046] In addition, the descriptions of "first", "second", etc. in the present invention are only used for descriptive purposes and cannot be understood as indicating or implying their relative importance or implicitly indicating the number of the indicated technical features. Therefore, the features defined as "first" and "second" may explicitly or implicitly include at least one of the features. In addition, "and / or" in the full text includes three solutions. Taking A and / or B as an example, it includes technical solution A, technical solution B, and technical solution that satisfies both A and B. In addition, the technical solutions between the various embodiments can be combined with each other, but it must be based on the ability of ordinary technicians in this field to implement. When the combination of technical solutions is contradictory or cannot be implemented, it should be deemed that such combination of technical solutions does not exist and is not within the scope of protection required by the present invention.

[0047] This application uses fluorescent imaging technology to mark tumors with fluorescent reagents, allowing the surgeon to accurately locate the position and boundaries of the tumor during surgery, thereby completely removing the tumor and reducing secondary damage to the patient.

[0048] like Figure 1-2 As shown, in one embodiment, a collection system for fluorescence imaging is provided, the collection system comprising a light source assembly 1, a camera device 2 and a processor 3, the light source assembly 1 comprising a first light source 11 and a second light source 12, the first light source 11 emitting reference light, and the second light source 12 emitting excitation light; the camera device 2 comprises a camera body 21 and a filter 22 movably arranged on the camera body 21, at a first moment, the filter 22 is in a retracted state, so that the visible light emitted by the first light source 11 and the second light source 12 respectively irradiates the object to be photographed, the camera body 21 is used to photograph the object to be photographed under the action of the visible light to obtain a first image; at a second moment, the filter 22 is in a use state, so that the narrow-band light that meets the conditions emitted by the first light source 11 and the second light source 12 respectively irradiates the object to be photographed, so that the object to be photographed generates fluorescence, the camera body 21 is used to photograph the object to be photographed under the action of the narrow-band light to obtain a second image; the processor 3 is used to synthesize the fluorescent parts in the first image and the second image to generate a first synthesized image.

[0049] At the first moment, the filter 22 is retracted so that the visible light emitted by the first light source 11 and the second light source 12 is respectively irradiated on the object to be photographed, so that the camera subject 21 can photograph the object to be photographed under the action of the visible light, and obtain a first image, which can display the entire clear image and the approximate position and boundary of the tumor in the entire clear image. At the second moment, the filter 22 is used so that the narrow-band light that meets the conditions emitted by the first light source 11 and the second light source 12 is respectively irradiated on the object to be photographed, so that the object to be photographed produces fluorescence, so that the camera subject 21 can photograph the object to be photographed under the action of the narrow-band light, and obtain a second image, which can display the precise position and boundary of the tumor in the entire blurred image, and finally the fluorescent parts in the first image and the second image are synthesized to generate a first synthesized image, which can display the entire clear image and the precise position and boundary of the tumor in the entire clear image, so as to ensure that the tumor can be completely removed, thereby avoiding the problem of local recurrence of the tumor.

[0050] The camera body 21 of this embodiment adopts a single CMOS to collect images. Compared with dual CMOS image collection, the single CMOS has the advantages of higher accuracy, smaller size, and less heat generation.

[0051] The camera device 2 of this embodiment can be used for non-fluorescent surgery. When performing non-fluorescent surgery, it is only necessary to put away the filter 22 without replacing the camera device 2, thereby improving the versatility of the camera device 2.

[0052] In this embodiment, the first light source 11 and the second light source 12 illuminate the object to be photographed simultaneously. It can be understood that in an optional embodiment, the first light source 11 and the second light source 12 illuminate the object to be photographed at different times.

[0053] In one embodiment, a collection system for fluorescence imaging is provided, the collection system comprising a light source assembly 1, a camera device 2 and a processor 3, the light source assembly 1 comprising a first light source 11 and a plurality of second light sources 12, the first light source 11 emitting reference light, and the plurality of second light sources 12 emitting excitation light of different wavelengths; the camera device 2 comprising a camera body 21 and a filter 22 movably arranged on the camera body 21, at a first moment, the filter 22 is in a retracted state so that the visible light emitted by the first light source 11 and the second light source 12 respectively irradiates the object to be photographed, and the camera body 21 is used to capture the visible light in the visible light. The object to be photographed is photographed under the action of light to obtain a first image; at a second moment, the filter 22 is in use, so that the narrow-band light of different wavelengths that meets the conditions is alternately emitted by the plurality of second light sources 12 to irradiate the object to be photographed, so that the object to be photographed produces fluorescence of different colors, and the camera body 21 is used to photograph the object to be photographed under the action of narrow-band light of different wavelengths to obtain a plurality of second images, wherein the fluorescent parts in the plurality of second images are of different colors; and the processor 3 is used to synthesize the first image and the fluorescent parts of different colors in the plurality of second images to generate a first synthesized image.

[0054] For example, if the first light source 11 emits white light, and the number of the second light sources 12 is three, wherein the first second light source 12 emits excitation light with a wavelength of 525nm, the second second light source 12 emits excitation light with a wavelength of 575nm, and the third second light source 12 emits excitation light with a wavelength of 610nm, at the first moment, the optical filter 22 is in a retracted state, so that the visible light emitted by the first light source 11 and the second light source 12 respectively illuminates the object to be photographed, and the camera body 21 is used to photograph the object to be photographed under the action of the visible light to obtain a first image. At the second moment, the optical filter 22 is in a use state, first, the first second light source 12 emits a narrow-band light of 525nm to illuminate the object to be photographed, so that the object to be photographed produces green fluorescence, and the camera body 21 is used to photograph the object to be photographed under the action of the narrow-band light of 525nm to obtain a first second image, wherein the fluorescent part in the first second image is green. Then, the first second light source 12 is turned off, and the second second light source 12 emits a narrow-band light of 575 nm to illuminate the object to be photographed, so that the object to be photographed produces orange fluorescence, and the camera body 21 is used to photograph the object to be photographed under the action of the narrow-band light of 575 nm to obtain a second second image, wherein the fluorescent part in the second second image is orange. Finally, the second second light source 12 is turned off, and the third second light source 12 emits a narrow-band light of 610 nm to illuminate the object to be photographed, so that the object to be photographed produces red fluorescence, and the camera body 21 is used to photograph the object to be photographed under the action of the narrow-band light of 610 nm to obtain a corresponding third second image, wherein the fluorescent part in the third second image is red. The duration of the second moment is three times that of the first moment, and the processor 3 is used to synthesize the first image, the green fluorescent part in the first second image, the orange fluorescent part in the second second image, and the red fluorescent part in the third second image to generate a first synthetic image. And so on, multiple synthetic images are obtained.

[0055] like Figure 3 As shown, in one embodiment, an image processing method for fluorescence imaging is provided, the image processing method comprising the following steps:

[0056] S100 , at a first moment, obtaining a first image captured when a reference light is irradiated on an object to be photographed.

[0057] The reference light is white light emitted by the first light source, and the first image is taken by the camera device.

[0058] S200 , at a second moment, obtaining excitation light to illuminate the object to be photographed, so as to capture a second image when the object to be photographed generates fluorescence.

[0059] The excitation light is narrow-band light emitted by the second light source, and the second image is taken by the camera device.

[0060] In one embodiment, the second image is processed to obtain a processed second image.

[0061] Specifically, the parameters of the fluorescent part in the second image are adjusted so that the fluorescent part in the second image meets the requirements.

[0062] Furthermore, the contrast and brightness of the fluorescent part in the second image are adjusted so that the contrast and brightness of the fluorescent part in the second image meet the requirements.

[0063] S300, synthesizing the first image and the fluorescent part in the second image to generate a first synthesized image.

[0064] At the first moment, by acquiring a first image captured when the reference light is used to illuminate the object to be photographed, the first image can display the entire clear image and the approximate position and boundary of the tumor in the entire clear image. At the second moment, by acquiring a second image captured when the object to be photographed is irradiated with excitation light so that the object to be photographed produces fluorescence, the second image can display the precise position and boundary of the tumor in the entire blurred image. Finally, the fluorescent parts in the first image and the second image are synthesized to generate a first synthesized image. The first synthesized image can display the entire clear image and the precise position and boundary of the tumor in the entire clear image to ensure that the tumor can be completely removed, thereby avoiding the problem of local recurrence of the tumor.

[0065] In one embodiment, the image processing method further comprises the following steps:

[0066] At a third moment, acquiring a third image captured when the reference light is irradiated on the object to be photographed;

[0067] At a fourth moment, an excitation light is obtained to illuminate the object to be photographed, so that a fourth image is captured when the object to be photographed generates fluorescence;

[0068] synthesizing the third image and the fluorescent part in the fourth image to generate a second synthesized image;

[0069] And so on;

[0070] At the N-1th moment, obtaining the N-1th image taken when the reference light is irradiated on the object to be photographed;

[0071] At the Nth moment, an excitation light is obtained to illuminate the object to be photographed, so that the object to be photographed generates fluorescence, and an Nth image is taken;

[0072] The N-1th image and the fluorescent part in the Nth image are synthesized to generate an N / 2th synthesized image; wherein N is an even number ≥2.

[0073] like Figure 4 As shown, in one embodiment, an image processing method for fluorescence imaging is provided, the image processing method comprising the following steps:

[0074] S10, at a first moment, obtaining a first image captured when a reference light is irradiated on an object to be photographed;

[0075] S20, at a second moment, acquiring a plurality of second images captured when the object to be photographed is alternately irradiated with a plurality of excitation lights of different wavelengths so as to cause the object to be photographed to generate fluorescence of different colors, wherein the fluorescent parts in the plurality of second images are of different colors;

[0076] S30, synthesizing the first image and fluorescent parts of different colors in a plurality of the second images to generate a first synthesized image.

[0077] like Figure 5 As shown, in one embodiment, an image processing device 10 for fluorescence imaging is provided. The image processing device 10 includes a first image acquisition module 01 , a second image acquisition module 02 and a first synthetic image module 03 .

[0078] The first image acquisition module 01 is used to acquire, at a first moment, a first image captured when a reference light is irradiated on an object to be photographed.

[0079] The second image acquisition module 02 is used to acquire, at a second moment, a second image captured when the object to be photographed is irradiated with excitation light to cause the object to be photographed to generate fluorescence.

[0080] The first composite image module 03 is used to composite the first image with the fluorescent part in the second image to generate a first composite image.

[0081] It should be noted that the specific implementation process of the image processing device of the embodiment of the present invention is the same as that of the image processing method. For details, please refer to the method embodiment, which will not be repeated here.

[0082] In one embodiment, a computer-readable storage medium is provided, comprising a program code. When the program product is run on an electronic device, the program code is used to enable the electronic device to execute the image processing method in any of the above embodiments.

[0083] In one embodiment, an electronic device is provided, including a processor and a memory, wherein the memory stores program code, and when the program code is executed by the processor, the processor executes the image processing method in any one of the above embodiments.

[0084] If the integrated module is implemented in the form of a software function module and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present invention, in essence, or the part that contributes to the prior art, or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including a number of instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the methods of each embodiment of the present invention. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), disk or optical disk and other media that can store program codes.

[0085] The above description is only a preferred embodiment of the present invention, and does not limit the patent scope of the present invention. All equivalent structural changes made by using the contents of the present invention specification and drawings under the inventive concept of the present invention, or directly / indirectly applied in other related technical fields are included in the patent protection scope of the present invention.

Claims

1. An image processing method for fluorescence imaging, characterized in that: include: At a first moment, acquiring a first image captured when the reference light is irradiated on the object to be photographed; At a second moment, an excitation light is obtained to illuminate the object to be photographed, so as to capture a second image when the object to be photographed generates fluorescence; synthesizing the first image and the fluorescent part in the second image to generate a first synthesized image; The image processing method further comprises: At a third moment, acquiring a third image captured when the reference light is irradiated on the object to be photographed; At a fourth moment, an excitation light is obtained to illuminate the object to be photographed, so that a fourth image is captured when the object to be photographed generates fluorescence; synthesizing the third image and the fluorescent part in the fourth image to generate a second synthesized image; And so on; At the N-1th moment, obtaining the N-1th image taken when the reference light is irradiated on the object to be photographed; At the Nth moment, an excitation light is obtained to illuminate the object to be photographed, so that the object to be photographed generates fluorescence, and an Nth image is taken; synthesizing the N-1th image and the fluorescent part in the Nth image to generate an N / 2th synthesized image; Wherein, N is an even number ≥ 2; wherein the second image is processed to obtain a processed second image; Wherein, processing the second image includes: adjusting the parameters of the fluorescent portion in the second image so that the fluorescent portion in the second image meets the requirements; wherein the contrast and brightness of the fluorescent part in the second image are adjusted so that the contrast and brightness of the fluorescent part in the second image meet the requirements; Wherein, the reference light is white light, and the excitation light is narrow-band light; Also included is an image acquisition system for fluorescence imaging, the system is used to perform the image processing method for fluorescence imaging, including: A light source assembly, the light source assembly comprising a first light source and a second light source, the first light source emitting a reference light, and the second light source emitting an excitation light; A camera device, comprising a camera body and a filter movably arranged on the camera body, wherein at a first moment, the filter is in a retracted state, so that the visible light emitted by the first light source and the second light source is irradiated on an object to be photographed, and the camera body is used to photograph the object to be photographed under the action of the visible light to obtain a first image; at a second moment, the filter is in a use state, so that the narrow-band light that meets the conditions emitted by the first light source and the second light source is irradiated on the object to be photographed, so that the object to be photographed generates fluorescence, and the camera body is used to photograph the object to be photographed under the action of the narrow-band light to obtain a second image; and A processor is used to synthesize the first image and the fluorescent part in the second image to generate a first synthesized image.

2. The image processing method for fluorescence imaging according to claim 1, characterized in that: include: At the Nth moment, multiple excitation lights of different wavelengths are obtained to alternately illuminate the object to be photographed, so as to make the object to be photographed produce fluorescence of different colors and take multiple Nth images, wherein the fluorescent parts in the multiple Nth images are different colors.

3. An image processing device for fluorescence imaging, characterized in that: The device is used to perform the image processing method for fluorescence imaging according to claim 1 or 2, comprising: A first image acquisition module, used for acquiring, at a first moment, a first image captured when the reference light is irradiated on the object to be photographed; A second image acquisition module, used for acquiring, at a second moment, a second image captured when the object to be photographed is irradiated with excitation light to cause the object to be photographed to generate fluorescence; The first synthetic image module is used to synthesize the first image and the fluorescent part in the second image to generate a first synthetic image.

Images