Fluorescent endoscopic apparatus

Abstract

A processor 9 constituting a fluorescent endoscopic apparatus 1 controls the operation of first and second excitation light sources 32, 33 and modulates the intensity of one of first and second excitation lights without modulating the intensity of the other excitation light. In addition, the processor 9 detects differences in brightness level between pixels of a first captured image obtained by capturing first and second fluorescent lights with an imaging element 523 when the intensity of the one excitation light is higher and the corresponding pixels of a second captured image obtained by capturing the first and second fluorescent lights with the imaging element 523 when the intensity of the one excitation light is lower, and determines that a region having differences in brightness level is a region where one of the first and second fluorescent lights has been emitted in response to the one excitation light.

Description

Fluorescence endoscope device

[0001] The present invention relates to a fluorescence endoscope apparatus.

[0002] Conventionally, there has been known a fluorescence endoscope device that irradiates an observation target (a subject such as a human) with visible light such as excitation light or white light emitted from a light source device, and observes the fluorescence emitted from a fluorescent reagent contained in the observation target by the irradiation of the excitation light (see, for example, Patent Document 1).

[0003] The fluorescence endoscope device described in Patent Document 1 is capable of observing first and second fluorescence of two different wavelength bands corresponding to two types of first and second fluorescent reagents. Specifically, the fluorescence endoscope device includes a first light source that emits visible light (hereinafter referred to as white light), a second light source that emits first excitation light corresponding to the first fluorescent reagent, and a third light source that emits second excitation light corresponding to the second fluorescent reagent. The fluorescence endoscope device also includes first and second image capture elements. The first image capture element is irradiated with light from an observation target and captures images of the white light reflected by the observation target. The second image capture element captures both the first fluorescence emitted from the first fluorescent reagent contained in the observation target when irradiated with the first excitation light and the second fluorescence emitted from the second fluorescent reagent contained in the observation target when irradiated with the second excitation light.

[0004] International Publication No. 2017 / 047140

[0005] A known first fluorescent reagent is one that emits a first fluorescence having a peak wavelength near 700 nm when irradiated with a first excitation light. A known second fluorescent reagent is one that emits a second fluorescence having a peak wavelength near 800 nm when irradiated with a second excitation light. The first fluorescent reagent is also sensitive to the second excitation light, and may emit the first fluorescence even when irradiated with the second excitation light. The second fluorescent reagent is also sensitive to the first excitation light, and may emit the second fluorescence even when irradiated with the first excitation light. The use of such first and second fluorescent reagents in the fluorescence endoscope device described in Patent Document 1 presents the following problem. Specifically, the first and second fluorescence are imaged by the same first imaging element. Therefore, when attempting to observe the first and second fluorescence simultaneously, it is difficult to determine whether a high-brightness area in the image obtained by imaging with the first imaging element is due to the first fluorescence or the second fluorescence.

[0006] Here, in order to distinguish between the first and second fluorescence, a configuration using the following optical system and three image sensors is conceivable. The optical system is an optical system such as a dichroic prism that separates the reflected white light reflected by the object of observation, the first fluorescence, and the second fluorescence. The three image sensors are image sensors that capture the reflected white light, and the first and second fluorescence separated by the optical system. However, a configuration using the above-described optical system and three image sensors results in an increase in size of the optical system.

[0007] Therefore, there is a demand for a technique that can avoid an increase in the size of the optical system and easily distinguish between the first and second fluorescent lights.

[0008] The present invention has been made in view of the above, and an object of the present invention is to provide a fluorescence endoscope apparatus that can avoid an increase in the size of the optical system and can easily distinguish between the first and second fluorescence.

[0009] In order to solve the above-mentioned problems and achieve the object, a fluorescence endoscope device according to the present invention comprises a first excitation light source that emits first excitation light for exciting a first fluorescent reagent having a fluorescent emission peak wavelength in the vicinity of 700 nm, a second excitation light source that emits second excitation light for exciting a second fluorescent reagent having a fluorescent emission peak wavelength in the vicinity of 800 nm, an image sensor that captures first fluorescence emitted from the first fluorescent reagent contained in an observation object when irradiated with the first excitation light, and second fluorescence emitted from the second fluorescent reagent contained in the observation object when irradiated with the second excitation light, and a processor that controls operations of the first excitation light source, the second excitation light source, and the image sensor, The image sensor controls the operations of the first excitation light source and the second excitation light source, respectively, and modulates the intensity of one of the first excitation light and the second excitation light without modulating the intensity of the other excitation light. The image sensor calculates a difference in brightness level between corresponding pixels of a first captured image obtained by capturing the first fluorescence and the second fluorescence with the image sensor at a timing when the intensity of the other excitation light is high, and a second captured image obtained by capturing the first fluorescence and the second fluorescence with the image sensor at a timing when the intensity of the other excitation light is low, and determines that a region where the brightness levels are different is a region of the first fluorescence or the second fluorescence emitted in response to the other excitation light.

[0010] According to the fluorescence endoscope apparatus of the present invention, it is possible to avoid an increase in the size of the optical system and to easily distinguish between the first and second fluorescence.

[0011] Fig. 1 is a diagram showing the configuration of a fluorescence endoscope apparatus according to an embodiment. Fig. 2 is a diagram showing the absorption spectrum and emission spectrum of a first fluorescent reagent. Fig. 3 is a diagram showing the absorption spectrum and emission spectrum of a second fluorescent reagent. Fig. 4 is a block diagram showing the configuration of a camera head and a control device. Fig. 5 is a diagram showing the configuration of an imaging unit. Fig. 6 is a diagram explaining the operation of a fluorescence endoscope apparatus. Fig. 7 is a diagram explaining the operation of a fluorescence endoscope apparatus. Fig. 8 is a diagram explaining a modified example of the embodiment.

[0012] Hereinafter, a mode for carrying out the present invention (hereinafter referred to as an embodiment) will be described with reference to the drawings. Note that the present invention is not limited to the embodiment described below. Furthermore, in the description of the drawings, the same parts are given the same reference numerals.

[0013] [Configuration of Fluorescence Endoscope Apparatus] Fig. 1 is a diagram showing the configuration of a fluorescence endoscope apparatus 1 according to an embodiment. The fluorescence endoscope apparatus 1 is an endoscope apparatus that uses an endoscope to perform fluorescence observation of an observation target (inside a living organism). As shown in Fig. 1, this fluorescence endoscope apparatus 1 includes an insertion section 2, a light source device 3, a light guide 4, a camera head 5, a first transmission cable 6, a display device 7, a second transmission cable 8, a control device 9, and a third transmission cable 10.

[0014] In this embodiment, the insertion section 2 is a rigid endoscope. That is, the insertion section 2 has an elongated shape that is entirely rigid or partially flexible and partially rigid, and is inserted into an observation object. The insertion section 2 includes an optical system (not shown) that includes one or more lenses and focuses the normal light and first and second excitation lights reflected by the observation object, as well as the first and second fluorescence emitted from the first and second fluorescent reagents contained in the observation object. Hereinafter, for convenience of explanation, the normal light and first and second excitation lights reflected by the observation object, as well as the first and second fluorescence emitted from the first and second fluorescent reagents contained in the observation object, will be referred to as a subject image.

[0015] An excitation light cut filter 22 (FIG. 1) that removes the first and second excitation lights contained in the focused subject image is disposed at the proximal end (eyepiece 21) of the insertion portion 2. The excitation light cut filter 22 is not limited to being disposed in the insertion portion 2, and may be disposed in the camera head 5.

[0016] One end of the light guide 4 is connected to the light source device 3. As shown in FIG. 1 , the light source device 3 includes first to third light sources 31 to 33. The first light source 31 supplies normal light (hereinafter referred to as white light) including a wavelength band of visible light to one end of the light guide 4 under the control of the control device 9. The second light source 32 corresponds to the first excitation light source according to the present invention. The second light source 32 supplies first excitation light to one end of the light guide 4 for exciting a first fluorescent reagent contained in the observation object. The third light source 33 corresponds to the second excitation light source according to the present invention. The third light source 33 supplies second excitation light to one end of the light guide 4 for exciting a second fluorescent reagent contained in the observation object.

[0017] The first to third light sources 31 to 33 may be configured by LEDs (Light Emitting Diodes) or semiconductor lasers.

[0018] Here, the first fluorescent reagent has the following characteristics. Fig. 2 is a diagram showing the absorption spectrum and emission spectrum of the first fluorescent reagent. In Fig. 2, the horizontal axis represents wavelength [nm], and the vertical axis represents absorbance of the absorption spectrum and fluorescence emission of the emission spectrum. In Fig. 2, the absorption spectrum is shown by a dashed line, and the emission spectrum is shown by a solid line.

[0019] The peak wavelength of the absorption spectrum of the first fluorescent reagent is near 680 nm, as shown in Figure 2. Therefore, in order to increase the intensity of the first fluorescence emitted from the first fluorescent reagent, it is preferable to use excitation light in a wavelength band including a wavelength near 680 nm as the first excitation light. Also, the peak wavelength of the emission spectrum of the first fluorescent reagent is near 700 nm, as shown in Figure 2.

[0020] The second fluorescent reagent has the following characteristics. Fig. 3 is a diagram showing the absorption spectrum and emission spectrum of the second fluorescent reagent. In Fig. 3, the horizontal axis represents wavelength [nm], and the vertical axis represents the intensity of the absorption spectrum and emission spectrum. In Fig. 3, the absorption spectrum is shown by a dashed line, and the emission spectrum is shown by a solid line.

[0021] The peak wavelength of the absorption spectrum of the second fluorescent reagent is near 780 nm, as shown in Figure 3. Therefore, in order to increase the intensity of the second fluorescence emitted from the second fluorescent reagent, it is preferable to use excitation light in a wavelength band including a wavelength near 780 nm as the second excitation light. Also, the peak wavelength of the emission spectrum of the second fluorescent reagent is near 800 nm, as shown in Figure 3.

[0022] 3, the second fluorescent reagent is also sensitive to excitation light having a wavelength near 700 nm, i.e., the first excitation light, and emits the second fluorescence even when irradiated with the first excitation light. Therefore, when observing the first and second fluorescence simultaneously, it is difficult to distinguish between the first and second fluorescence.

[0023] In this embodiment, the light source device 3 is configured as a separate entity from the control device 9, but this is not limited to this, and a configuration in which the light source device 3 and the control device 9 are provided in the same housing may also be adopted.

[0024] One end of the light guide 4 is detachably connected to the light source device 3. The other end of the light guide 4 is detachably connected to the insertion section 2. The light guide 4 propagates the white light and the first and second excitation light supplied from the light source device 3 (first to third light sources 31 to 33) from one end to the other end, and supplies them to the insertion section 2. The white light and the first and second excitation light supplied to the insertion section 2 are emitted from the tip of the insertion section 2 and irradiated onto the observation object. The white light and the first and second excitation light irradiated onto the observation object and reflected by the observation object, as well as the first and second fluorescence (subject image) emitted from the first and second fluorescent reagents contained in the observation object, are each collected by an optical system within the insertion section 2.

[0025] The camera head 5 is detachably connected to the proximal end (eyepiece 21 ( FIG. 1 )) of the insertion section 2. The camera head 5 captures an image of a subject after light is collected by the insertion section 2 and the first and second excitation lights have been removed by the excitation light cut filter 22. For ease of explanation, the image signal obtained by imaging with the camera head 5 will hereinafter be collectively referred to as a captured image. Furthermore, the subject image after the first and second excitation lights have been removed by the excitation light cut filter 22 will be referred to as an excitation light-removed subject image. The detailed configuration of the camera head 5 will be described later in the section "Configuration of the Camera Head."

[0026] One end of the first transmission cable 6 is detachably connected to the control device 9. The other end of the first transmission cable 6 is detachably connected to the camera head 5. The first transmission cable 6 transmits the captured image output from the camera head 5 to the control device 9, and also transmits the control signal, synchronization signal, clock, power, and the like sent from the control device 9 to the camera head 5.

[0027] The captured images and the like transmitted from the camera head 5 to the control device 9 via the first transmission cable 6 may be transmitted as optical signals or as electrical signals. The same applies to the transmission of control signals, synchronization signals, and clocks from the control device 9 to the camera head 5 via the first transmission cable 6.

[0028] The display device 7 is configured with a display using a liquid crystal or organic EL (Electro Luminescence) display, etc., and displays an image based on a video signal from the control device 9 under the control of the control device 9 .

[0029] One end of the second transmission cable 8 is detachably connected to the display device 7. The other end of the second transmission cable 8 is detachably connected to the control device 9. The second transmission cable 8 transmits the video signal processed by the control device 9 to the display device 7.

[0030] The control device 9 includes controllers such as a CPU (Central Processing Unit) and an MPU (Micro Processing Unit), and comprehensively controls the operations of the light source device 3, the camera head 5, and the display device 7. The control device 9 is not limited to a CPU or an MPU, and may include an ASIC (Application Specific Integrated Circuit), an FPGA (Field-Programmable Gate Array), a GPU (Graphics Processing Unit), or the like. The detailed configuration of the control device 9 will be described later in the section "Configuration of the Control Device."

[0031] One end of the third transmission cable 10 is detachably connected to the light source device 3. The other end of the third transmission cable 10 is detachably connected to the control device 9. The third transmission cable 10 transmits a control signal from the control device 9 to the light source device 3.

[0032] [Configuration of Camera Head] Next, a description will be given of the configuration of the camera head 5. Fig. 4 is a block diagram showing the configuration of the camera head 5 and the control device 9. As shown in Fig. 4, the camera head 5 includes a lens unit 51, an imaging unit 52, and a communication unit 53.

[0033] The lens unit 51 is configured using one or more lenses, and forms an image of the subject from which excitation light has been removed on the imaging surfaces of the first and second image sensors 522 and 523, respectively.

[0034] 5 is a diagram showing the configuration of the imaging unit 52. The imaging unit 52 is a part that generates a captured image by capturing an image of a subject from which excitation light has been removed. As shown in FIGS. 4 and 5 , the imaging unit 52 includes a prism 521, first and second image sensors 522 and 523, and a signal processing unit 524.

[0035] The prism 521 has a substantially cubic shape formed by combining two triangular prism-shaped light-transmitting members 521a (FIG. 5). A dichroic filter 521b is provided at the interface between the two light-transmitting members 521a.

[0036] The dichroic filter 521b has the property of transmitting light in wavelength bands near 700 [nm] and 800 [nm] and reflecting light in other wavelength bands. Therefore, of the subject image from which excitation light has been removed that has entered the prism 521, most of the reflected white light WL ( FIG. 5 ) from which the first and second excitation lights have been removed by the excitation light cut filter 22 is reflected by the dichroic filter 521b. Then, as shown in FIG. 5 , the reflected white light WL travels toward the first image sensor 522. Meanwhile, of the subject image from which excitation light has been removed that has entered the prism 521, most of the first and second fluorescence light FL1, FL2 ( FIG. 5 ) from which the first and second excitation lights have been removed by the excitation light cut filter 22 is transmitted through the dichroic filter 521b (prism 521). The first and second fluorescence FL1 and FL2 then travel toward the second image sensor 523.

[0037] The first and second image sensors 522 and 523 receive incident light and convert it into an electrical signal (analog signal). Examples of the first and second image sensors 522 and 523 include a CMOS (Complementary Metal Oxide Semiconductor) which is a rolling shutter type image sensor in which multiple pixels are arranged two-dimensionally in horizontal line units, and a CCD (Charge Coupled Device) which is a global shutter type image sensor.

[0038] Then, the first image sensor 522 captures an image of the light reflected by the dichroic filter 521b under the control of the control device 9. For ease of explanation, the captured image generated by the first image sensor 522 will be referred to as a white image below.

[0039] Here, a color filter 522a is provided on the light receiving surface of the first image sensor 522, as shown in FIGS.

[0040] The color filter 522a is a color filter in which three filter groups are grouped according to the wavelength bands of light (red, green, blue) to be transmitted, and are arranged in a specific format (for example, a Bayer array). Specifically, the color filter 522a has an R filter group that mainly transmits light in the red wavelength band, a B filter group that mainly transmits light in the blue wavelength band, and a G filter group that mainly transmits light in the green wavelength band.

[0041] The second imaging element 523 corresponds to the imaging element according to the present invention. Under the control of the control device 9, the second imaging element 523 captures an image of light transmitted through the prism 521. For ease of explanation, the image captured by the second imaging element 523 will be referred to as a fluorescent image below. Note that the light receiving surface of the second imaging element 523 does not have a color filter 522a like the first imaging element 522. In other words, the second imaging element 523 is a so-called monochrome image sensor.

[0042] The number of pixels in the white image and the number of pixels in the fluorescent image may be different or the same.

[0043] The signal processing unit 524 outputs a captured image (digital signal) by performing signal processing on the captured image (analog signal) generated by the first and second imaging elements 522 and 523 under the control of the control device 9. For example, the signal processing unit 524 performs signal processing on the captured image (analog signal) generated by the first and second imaging elements 522 and 523, such as processing to remove reset noise, processing to multiply the analog signal by an analog gain that amplifies the analog signal (hereinafter referred to as analog gain adjustment), and A / D conversion.

[0044] The communication unit 53 functions as a transmitter that transmits the captured images sequentially output from the imaging unit 52 to the control device 9 via the first transmission cable 6 .

[0045] The communication unit 53 may transmit the white image and the fluorescent image to the control device 9 in that order, or may transmit the white image and the fluorescent image simultaneously.

[0046] [Configuration of Control Device] Next, the configuration of the control device 9 will be described with reference to Fig. 4. The control device 9 corresponds to a processor according to the present invention. As shown in Fig. 4, the control device 9 includes a communication unit 91, a processing module 92, a control unit 93, an input unit 94, an output unit 95, and a storage unit 96.

[0047] The communication unit 91 functions as a receiver that receives the captured images sequentially transmitted from the camera head 5 (communication unit 53 ) via the first transmission cable 6 .

[0048] Under the control of the control unit 93, the processing module 92 processes the captured images sequentially transmitted from the camera head 5 (communication unit 53) and received by the communication unit 91. As shown in FIG. 4 , the processing module 92 includes an image processing unit 921 and a display control unit 922.

[0049] The image processing unit 921 performs image processing on the input captured image (the captured image received by the communication unit 91). Examples of the image processing include optical black subtraction processing (clamp processing), white balance adjustment processing, demosaic processing, color correction matrix processing, gamma correction processing, YC processing for converting RGB signals into luminance color difference signals (Y, Cb / Cr signals), digital gain adjustment for multiplying by a digital gain, noise removal, and filtering for enhancing structure.

[0050] The image processing performed on the white image and the image processing performed on the fluorescent image may be different from each other, or may be the same.

[0051] Under the control of the control unit 93, the display control unit 922 generates a video signal for displaying the captured image after image processing has been performed by the image processing unit 921. Then, the display control unit 922 outputs the video signal to the display device 7 via the second transmission cable 8.

[0052] The control unit 93 is realized by a controller such as a CPU or an MPU executing various programs stored in the storage unit 96, and controls the operations of the light source device 3, the camera head 5, and the display device 7, as well as the operation of the entire control device 9. Note that the control unit 93 is not limited to a CPU or an MPU, and may include an ASIC, an FPGA, a GPU, or the like.

[0053] The input unit 94 is configured using operation devices such as a mouse, a keyboard, and a touch panel, and receives user operations from a user such as a surgeon. The input unit 94 then outputs an operation signal corresponding to the user operation to the control unit 93.

[0054] The output unit 95 is configured using a speaker, a printer, etc., and outputs various information.

[0055] The storage unit 96 stores programs executed by the control unit 93, information necessary for the processing of the control unit 93, and the like.

[0056] [Operation of Fluorescence Endoscope Apparatus] Next, the operation of the above-described fluorescence endoscope apparatus 1 will be described. FIGS. 6 and 7 are diagrams illustrating the operation of the fluorescence endoscope apparatus 1. Specifically, FIG. 6(a) is a time chart showing the operating state of the first light source 31. FIG. 6(b) is a time chart showing the operating state of the second light source 32. FIG. 6(c) is a time chart showing the operating state of the third light source 33. FIG. 7(a) is a diagram showing a white image F1. Note that FIG. 7(a) shows only two white images as the white image F1: a white image F1a captured in the first frame period T1 and a white image F1b captured in the second frame period T2 of the first and second frame periods T1 and T2 arranged in chronological order. The first and second frame periods T1 and T2 are the same period and alternately repeat. FIG. 7(b) is a diagram showing a fluorescent image F2. Note that Fig. 7(b) shows only two fluorescence images F2: a fluorescence image F2a captured in the first frame period T1 and a fluorescence image F2b captured in the second frame period T2 of the first and second frame periods T1 and T2 arranged in chronological order. The region Ar1 indicated by a solid line in Fig. 7(a) and the region Ar2 indicated by a dashed line in Fig. 7(b) represent the same subject. The region Ar3 indicated by a solid line in Fig. 7(b) is a region where the intensity of one of the first and second fluorescence FL1 and FL2 is high. The region Ar4 indicated by a solid line in Fig. 7(b) is a region where the intensity of one of the first and second fluorescence FL1 and FL2 is high. Fig. 7(c) shows a difference image F2' indicating the difference in brightness levels between corresponding pixels in the two fluorescence images F2a and F2b. FIG. 7D shows the superimposed image F3 displayed on the display device 7.

[0057] The control unit 93 controls the operations of the light source device 3 and the first and second image pickup elements 522 and 523 as described below.

[0058] As shown in Fig. 6A, the control unit 93 continuously lights up the first light source 31 during the alternating first and second frame periods T1 and T2, causing the first light source 31 to constantly emit white light. Note that Fig. 6A shows a period shorter than the cycle in which dimming control is performed, and therefore the white light is emitted at a constant intensity.

[0059] 6B, the control unit 93 continuously lights up the second light source 32 during the alternating first and second frame periods T1 and T2, causing the second light source 32 to constantly emit the first excitation light. That is, the first excitation light corresponds to one of the excitation lights according to the present invention. Note that, since FIG. 6B shows a period shorter than the cycle in which dimming control is performed, the first excitation light is emitted at a constant intensity without being modulated.

[0060] Furthermore, as shown in FIG. 6C , the control unit 93 modulates the intensity of the second excitation light emitted from the third light source 33 during the alternating first and second frame periods T1 and T2. In other words, the second excitation light corresponds to the other excitation light according to the present invention. Specifically, the control unit 93 sets the intensity of the second excitation light to a first intensity I1 during the first frame period T1 and to a second intensity I2, lower than the first intensity I1, during the second frame period T2. The difference ΔI between the first and second intensities I1 and I2 is set to a level that is inconspicuous in the fluorescence image F2 but still allows a difference in signal value to be detected from the fluorescence image F2. For example, the difference ΔI is set to an intensity difference of approximately 5% between the first intensity I1 and the second intensity I2. Note that (c) of Figure 6 shows a period shorter than the cycle in which dimming control is performed, so the second excitation light is emitted at a constant first intensity I1 in each first frame period T1 and at a constant second intensity I2 in each second frame period T2.

[0061] The control unit 93 then causes the first and second image pickup elements 522 and 523 to perform image pickup operations during the first and second frame periods T1 and T2 that are alternately repeated.

[0062] Specifically, the first image sensor 522 sequentially captures reflected white light WL during the first and second frame periods T1 and T2, and sequentially generates white images F1a and F1b (FIG. 7(a)).

[0063] Furthermore, the second image sensor 523 captures the first and second fluorescence FL1, FL2 during the first frame period T1 (the period during which the intensity of the second excitation light is the first intensity I1) and generates a fluorescence image F2a ((b) in FIG. 7). This fluorescence image F2a corresponds to the first captured image according to the present invention. Furthermore, the second image sensor 523 captures the first and second fluorescence FL1, FL2 during the second frame period T2 (the period during which the intensity of the second excitation light is the second intensity I2) and generates a fluorescence image F2b ((b) in FIG. 7). This fluorescence image F2b corresponds to the second captured image according to the present invention.

[0064] Under the control of the control unit 93, the image processing unit 921 performs image processing on the white image F1 and the fluorescent image F2 received by the communication unit 91. Furthermore, under the control of the control unit 93, the image processing unit 921 calculates the difference in brightness levels between corresponding pixels in two chronologically arranged fluorescent images F2a and F2b, as shown in FIGS. 7B and 7C, to generate a difference image F2'. Here, the brightness level can be, for example, a brightness value or a pixel value. The image processing unit 921 then determines, as a region from which the second fluorescent light FL2 is emitted, an area Ar4 (FIG. 7C) in the fluorescent images F2a and F2b where the brightness level is equal to or higher than a certain level and which is recognized as having a different brightness level in the difference image F2'. Meanwhile, the image processing unit 921 determines that an area Ar3 ( FIG. 7( b) ) in the fluorescence images F2a and F2b has a brightness level equal to or higher than a certain level and is recognized as having an equivalent brightness level in the difference image F2', as an area from which the first fluorescence FL1 is emitted. The image processing unit 921 then superimposes the white image F1 and the fluorescence image F2 using a known alpha blending process or additive blending process to generate a superimposed image F3 ( FIG. 7( d) ) in which the determined areas Ar3 and Ar4 are distinguished from each other by specific colors or the like. The display control unit 922 then generates a video signal corresponding to the superimposed image F3 and outputs it to the display device 7. As a result, the superimposed image F3 is displayed on the display device 7.

[0065] The above-described embodiment provides the following advantages. In the fluorescence endoscope device 1 according to this embodiment, the control device 9 controls the operation of the second and third light sources 32 and 33, respectively, to modulate the intensity of the second excitation light without modulating the intensity of the first excitation light. The control device 9 then calculates the difference in brightness levels between corresponding pixels in a fluorescence image F2a obtained by causing the second image sensor 523 to capture the first and second fluorescence FL1 and FL2 when the intensity of the second excitation light is high (first frame period T1), and a fluorescence image F2b obtained by causing the second image sensor 523 to capture the first and second fluorescence FL1 and FL2 when the intensity of the second excitation light is low (second frame period T2). The control device 9 then determines that an area Ar4 with different brightness levels is the area from which the second fluorescence of the first and second fluorescence FL1 and FL2 is emitted. This facilitates distinguishing between the first and second fluorescence FL1 and FL2. Furthermore, the optical system (the prism 521 including the dichroic filter 521b) that separates the reflected white light WL from the first and second fluorescence lights FL1, FL2 can also be compact. As described above, the fluorescence endoscope device 1 according to this embodiment can easily distinguish between the first and second fluorescence lights FL1, FL2 while achieving a compact optical system.

[0066] In particular, the control device 9 controls the operation of the second and third light sources 32, 33, respectively, to continuously emit the second excitation light while modulating the intensity thereof without modulating the intensity of the first excitation light. Therefore, compared to a configuration in which the third light source 33 is turned on intermittently during the first and second frame periods T1, T2, the second excitation light can be made sufficiently intense, and the intensity of the emitted second fluorescence FL2 can be made sufficiently high. In other words, it is easier to distinguish between the first and second fluorescence FL1, FL2.

[0067] Other Embodiments Up to this point, embodiments for carrying out the present invention have been described, but the present invention should not be limited to the above-described embodiments. FIG. 8 is a diagram illustrating a modified example of the embodiment. Specifically, FIG. 8 is a diagram corresponding to FIG. 6. In the above-described embodiment, one excitation light according to the present invention is designated as the first excitation light and the other excitation light according to the present invention is designated as the second excitation light. However, this is not limiting. One excitation light according to the present invention may be designated as the second excitation light and the other excitation light according to the present invention may be designated as the first excitation light. That is, as shown in FIG. 8(b), the first excitation light is emitted at a first intensity I1 during the first frame period T1 and at a second intensity I2 during the second frame period T2. On the other hand, as shown in FIG. 8(c), the second excitation light is emitted at a constant intensity during the first and second frame periods T1 and T2. In this configuration, a region recognized as having different brightness levels in the differential image is determined to be a region from which the first fluorescence FL1 is emitted. Furthermore, an area that is recognized as having the same brightness level based on the difference image is determined as an area from which the second fluorescence FL2 is emitted.

[0068] REFERENCE SIGNS LIST 1 Fluorescence endoscope device 2 Insertion section 3 Light source device 4 Light guide 5 Camera head 6 First transmission cable 7 Display device 8 Second transmission cable 9 Control device 10 Third transmission cable 21 Eyepiece section 22 Excitation light cut filter 31 First light source 32 Second light source 33 Third light source 51 Lens unit 52 Imaging section 53 Communication section 91 Communication section 92 Processing module 93 Control section 94 Input section 95 Output section 96 Storage section 521 Prism 521a Light-transmitting member 521b Dichroic filter 522 First imaging element 522a Color filter 523 Second imaging element 524 Signal processing section 921 Image processing section 922 Display control section Ar1 to Ar4 Regions F1, F1a, F1b White image F2, F2a, F2b: Fluorescence images F2': Difference image F3: Superimposed image FL1: First fluorescence FL2: Second fluorescence I1: First intensity I2: Second intensity T1: First frame period T2: Second frame period WL: Reflected light of white light

Claims

1. A system comprising: a first excitation light source that emits first excitation light for exciting a first fluorescent reagent having a peak fluorescence emission wavelength in the vicinity of 700 nm; a second excitation light source that emits second excitation light for exciting a second fluorescent reagent having a peak fluorescence emission wavelength in the vicinity of 800 nm; an image capture element that captures first fluorescence emitted from the first fluorescent reagent contained in an observation object when irradiated with the first excitation light, and second fluorescence emitted from the second fluorescent reagent contained in the observation object when irradiated with the second excitation light; and a processor that controls the operation of the first excitation light source, the second excitation light source, and the image capture element, wherein the processor controls the operation of the first excitation light source and the second excitation light source, and modulates the intensity of one of the first excitation light and the second excitation light without modulating the intensity of the other excitation light, a fluorescence endoscope device that calculates a difference in brightness levels between corresponding pixels of a first captured image obtained by causing the image sensor to capture the first fluorescence and the second fluorescence at a timing when the intensity of the other excitation light is high, and a second captured image obtained by causing the image sensor to capture the first fluorescence and the second fluorescence at a timing when the intensity of the other excitation light is low, and determines that an area where the brightness levels differ is an area of ​​the first fluorescence or the second fluorescence emitted in response to the other excitation light.

2. The fluorescence endoscope device according to claim 1, wherein the processor controls the operation of the first excitation light source and the second excitation light source, respectively, and emits one excitation light without modulating the intensity of the other excitation light while modulating the intensity of the other excitation light.

3. The fluorescence endoscope device according to claim 1, wherein the processor controls the operation of the first excitation light source and the second excitation light source, respectively, and modulates the intensity of the second excitation light without modulating the intensity of the first excitation light.

4. The fluorescence endoscope device according to claim 1, wherein the processor controls the operation of the first excitation light source and the second excitation light source, respectively, and modulates the intensity of the first excitation light without modulating the intensity of the second excitation light.

Images