Medical device and method of operation thereof

By designing a medical device that can emit multi-band illumination light and acquire fluorescence and oxygen saturation images through multi-channel sensors, the problem of difficulty in obtaining multiple images at the same time in the prior art is solved, and efficient and low-cost multiple image acquisition is achieved, and the efficiency of medical diagnosis is improved.

JP7663604B2Active Publication Date: 2025-04-16FUJIFILM CORP
View PDF 7 Cites 0 Cited by

Patent Information

Application Number
JP2022565088
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Priority Date
2020-11-24
Filing Date
2021-09-24
Publication Date
2025-04-16
Estimated Expiration
2041-09-24

AI Technical Summary

Technical Problem

In the medical field, it is difficult to obtain fluorescence images and oxygen saturation images at the same time in the prior art, and the equipment costs are high and there are many components, making it difficult to meet diagnostic needs.

Method used

A medical device is designed to emit illumination light including the first and second bands through a light source, and to sense light in different bands using different channels of the light sensor. Combined with an image processor, multiple acquisitions of fluorescence images and oxygen saturation images are achieved.

Benefits of technology

The acquisition of multiple inspection images is realized, which reduces equipment costs and components and improves diagnostic efficiency.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007663604000001
    Figure 0007663604000001
  • Figure 0007663604000002
    Figure 0007663604000002
  • Figure 0007663604000003
    Figure 0007663604000003
Patent Text Reader

Abstract

The present invention provides a medical device with which a plurality of inspection images can be acquired, and the greatest possible cost reduction and the greatest possible suppression of the number of components are achieved, and a method for operating the same. This medical device illuminates a subject, and captures an image of reflected light from the subject. The medical device comprises: a light source (20) that emits illumination light including a first wavelength band; a light receiving part (15) that has a first channel for sensing a first sensing band; and an image control processor. The first sensing band is a wavelength band that does not overlap with the first wavelength band or overlaps up to a half-value wavelength, and the image control processor acquires at least one inspection image on the basis of light included in the first sensing band sensed by the first channel.
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to a medical device for acquiring multiple types of images and a method of operating the same. [Background technology]

[0002] In the medical field, medical devices including a light source device, an endoscope, and a processor device are widely used. In the medical device, particularly in the field of endoscopes, an object is illuminated and an image of the reflected light from the object is captured. In an endoscope system, an object is illuminated with white light including red, green, and blue light to obtain an image for visually observing the object.

[0003] In addition, endoscopes have been developed that can visualize blood vessels and lymphatic vessels by administering a fluorescent substance such as indocyanine green, which is a fluorescent substance that binds to lipoproteins in the blood or lymph, into blood vessels or lymph nodes, illuminating a subject with the excitation light from the fluorescent substance, and capturing an image of the fluorescence emitted by the fluorescent substance, thereby obtaining fluorescent images that can be used to observe the extent of cancer infiltration and blood flow deficiency.

[0004] Furthermore, by utilizing the property that the absorption coefficients of oxygenated hemoglobin and reduced hemoglobin in blood differ depending on the wavelength band of the illumination light, an image showing the oxygen saturation of the subject can be obtained by illuminating the subject with near-ultraviolet light and capturing an image. Also, endoscopes have been developed that can obtain an image showing the oxygen saturation of the subject (red oxygen saturation image) by illuminating the subject with near-infrared light and capturing an image.

[0005] Patent Document 1 describes an endoscope system that is provided with semiconductor lasers that respectively emit visible light, 700 nm laser light, and 980 nm laser light, and irradiates the subject with these as a single irradiation light in order to obtain both an observation image and a red oxygen saturation image. It also describes a configuration in which reflected light from the subject is separated (dispersed) into light in a band for obtaining an observation image and light in a band for obtaining a red oxygen saturation image (illumination light for oxygen saturation), and each light is made incident on a different imaging element to obtain an image. [Prior art documents] [Patent documents]

[0006] [Patent Document 1] JP 2010-268838 A Summary of the Invention [Problem to be solved by the invention]

[0007] In the medical field, as described above, there is a demand for acquiring both a fluorescence image based on the fluorescence emitted from a fluorescent substance by excitation light and an oxygen saturation image (see Patent Document 1) based on illumination light for oxygen saturation, and using these images to diagnose lesions, etc. There has been a demand for a medical device that can acquire multiple examination images such as these fluorescence images and oxygen saturation images, while reducing costs and the number of parts as much as possible.

[0008] An object of the present invention is to provide a medical device and an operating method thereof that are capable of acquiring a plurality of examination images while realizing as low a cost and as few parts as possible. [Means for solving the problem]

[0009] The medical device of the present invention is a medical device that illuminates a subject and captures an image of reflected light from the subject, and includes a light source that emits illumination light including a first wavelength band, a light receiving unit having a first channel that detects a first sensing band, and an image control processor, the first sensing band being a wavelength band that does not overlap with the first wavelength band or that overlaps with the first wavelength band up to a half-value wavelength, and the image control processor acquires at least one examination image based on the light included in the first sensing band. the reflected light includes a first wavelength band and a second wavelength band different from the first wavelength band, the light receiving unit includes a second channel for sensing the second sensing band different from the first sensing band, the second sensing band being a wavelength band that does not overlap with the second wavelength band or overlaps with the second wavelength band up to a half-maximum wavelength, the first wavelength band is a wavelength band that excites the fluorescent material and is necessary for calculating oxygen saturation based on a difference in responsiveness to illumination light between oxygenated hemoglobin and reduced hemoglobin, and the second wavelength band is a wavelength band of fluorescence emitted by the fluorescent material receiving light including the first wavelength band, the first sensing band includes the wavelength band of fluorescence, and the second sensing band includes the wavelength band required for calculating oxygen saturation. . The medical device of the present invention is a medical device that illuminates a subject and captures an image of reflected light from the subject, and includes a light source that emits illumination light including a first wavelength band, a light receiving unit having a first channel that senses a first sensing band, and an image control processor, the first sensing band being a wavelength band that does not overlap with the first wavelength band or that overlaps up to a half-value wavelength, the image control processor acquiring at least one or more examination images based on light included in the first sensing band, the reflected light including the first wavelength band and a second wavelength band that is a wavelength band different from the first wavelength band, and the light receiving unit and a second channel for sensing a second sensing band which is a wavelength band different from the first sensing band, the second sensing band being a wavelength band which does not overlap with the second wavelength band or overlaps with the second wavelength band up to a half-value wavelength. The light receiving unit has a first dispersing element for dispersing reflected light into the first spectral band and a second spectral band different from the first spectral band, a first imaging element having a first transmission band, and a second imaging element having a second transmission band different from the first transmission band, the first sensing band being a band based on the first spectral band and the first transmission band, and the second sensing band being a band based on the second spectral band and the second transmission band. .

[0010] The reflected light includes a first wavelength band and a second wavelength band that is different from the first wavelength band, and the light receiving unit has a second channel that senses the second sensing band that is different from the first sensing band, and it is preferable that the second sensing band is a wavelength band that does not overlap with the second wavelength band or overlaps up to the half-value wavelength.

[0011] The light receiving unit has a first dispersing element for dispersing the reflected light into a first dispersing band and a second dispersing band different from the first dispersing band, a first imaging element having a first transmission band, and a second imaging element having a second transmission band different from the first transmission band, and it is preferable that the first sensing band is a band based on the first dispersing band and the first transmission band, and the second sensing band is a band based on the second dispersing band and the second transmission band. It is preferable that the second transmission band includes a second A transmission band, a second B transmission band, and a second C transmission band that are different from each other.

[0012] The first wavelength band is a wavelength band that excites the fluorescent substance and is necessary for calculating oxygen saturation based on the difference in responsiveness to illumination light between oxyhemoglobin and deoxyhemoglobin, and it is preferable that the first sensing band is a wavelength band that includes the wavelength band of fluorescence emitted from the fluorescent substance, and the second sensing band is a wavelength band that includes the wavelength band necessary for calculating oxygen saturation.

[0013] It is preferable that the fluorescent material receives light including a first wavelength band and emits fluorescence which is light of a second wavelength band, the first channel detects the fluorescence, and the image control processor obtains a fluorescent blood vessel image based on the fluorescence and a fluorescent lymphatic vessel image based on the fluorescence as test images, and obtains blood vessel distribution information from the fluorescent blood vessel image and lymphatic vessel distribution information from the fluorescent lymphatic vessel image. It is preferable that the image control processor obtains a hemoglobin image based on light of a wavelength band required for calculating oxygen saturation as the test image, calculates oxygen saturation from the hemoglobin image, and calculates StO2 distribution information from the oxygen saturation.

[0014] It is preferable that the light source emits normal light, the light receiving unit detects reflected light obtained by irradiating the subject with the normal light, and the image control processor acquires a normal light image based on the normal light, and generates at least one of a blood vessel superimposition image in which blood vessel distribution information is superimposed on the normal light image, a lymphatic vessel superimposition image in which lymphatic vessel distribution information is superimposed on the normal light image, and a vascular superimposition image in which blood vessel distribution information and lymphatic vessel distribution information are superimposed on the normal light image.

[0015] It is preferable that the light receiving unit senses a wavelength band required for calculating oxygen saturation and a wavelength band of fluorescence, the image control processor acquires a hemoglobin image based on light of the wavelength band required for calculating oxygen saturation and a fluorescent blood vessel image based on fluorescence as test images, calculates oxygen saturation from the hemoglobin image, acquires StO2 distribution information from the oxygen saturation, acquires blood vessel distribution information from the fluorescent blood vessel image, and acquires blood vessel visualization StO2 information from the blood vessel distribution information and the StO2 distribution information. It is preferable that the light source emits normal light, the light receiving unit senses reflected light obtained by irradiating the subject with the normal light, and the image control processor acquires a normal light image based on the normal light and superimposes the blood vessel visualization StO2 information on the normal light image to generate a blood vessel visualization StO2 image.

[0016] It is preferable that the light source excites the fluorescent substance and emits light in a wavelength band required for calculating oxygen saturation and normal light, and the image control processor acquires a fluorescent blood vessel image based on fluorescence, a fluorescent lymphatic vessel image based on fluorescence, a hemoglobin image based on light in the wavelength band required for calculating oxygen saturation, and a normal light image based on normal light as test images, calculates oxygen saturation from the hemoglobin image, acquires StO2 distribution information from the oxygen saturation, acquires blood vessel distribution information from the fluorescent blood vessel image and lymphatic vessel distribution information from the fluorescent lymphatic vessel image, acquires blood vessel visualization StO2 information from the blood vessel distribution information and oxygen saturation, and superimposes the blood vessel visualization StO2 information and lymphatic vessel distribution information on the normal light image to generate a vascular visualization StO2 image.

[0017] The light receiving unit has a second dispersing element that disperses the reflected light into at least two or more lights having the same wavelength band, a first optical element that cuts off a first cut wavelength contained in the light dispersed by the second dispersing element to form a first dispersion band, a first imaging element having a first transmission band, a second optical element that cuts off a second cut wavelength, which is a wavelength band different from the first cut wavelength contained in the light dispersed by the second dispersing element, to form a second dispersion band different from the first dispersion band, and a second imaging element having a second transmission band, and the first sensing band is preferably a band based on the first dispersion band and the first transmission band, and the second sensing band is preferably a band based on the second dispersion band and the second transmission band. The light receiving unit preferably includes one sensor provided with a first filter corresponding to the first channel and a second filter corresponding to the second channel.

[0018] The operating method of the medical device of the present invention is a method for operating a medical device that illuminates a subject and captures an image of reflected light from the subject, in which a light source emits illumination light including a first wavelength band, a light receiving unit has a first channel that detects a first sensing band, and an image control processor acquires at least one inspection image based on light included in the first sensing band detected by the first channel, and the first sensing band is a wavelength band that does not overlap with the first wavelength band or overlaps with the first wavelength band up to a half-value wavelength. the reflected light includes a first wavelength band and a second wavelength band different from the first wavelength band, the light receiving unit includes a second channel for sensing the second sensing band different from the first sensing band, the second sensing band being a wavelength band that does not overlap with the second wavelength band or overlaps with the second wavelength band up to a half-maximum wavelength, the first wavelength band is a wavelength band that excites the fluorescent material and is necessary for calculating oxygen saturation based on a difference in responsiveness to illumination light between oxygenated hemoglobin and reduced hemoglobin, and the second wavelength band is a wavelength band of fluorescence emitted by the fluorescent material receiving light including the first wavelength band, the first sensing band includes the wavelength band of fluorescence, and the second sensing band includes the wavelength band required for calculating oxygen saturation. . The operating method of the medical device of the present invention is a method for operating a medical device that illuminates a subject and captures an image of reflected light from the subject, the light source emits illumination light including a first wavelength band, the light receiving unit has a first channel that detects a first sensing band, the image control processor acquires at least one examination image based on light included in the first sensing band detected by the first channel, the first sensing band being a wavelength band that does not overlap with the first wavelength band or that overlaps with the first wavelength band up to a half-value wavelength, the reflected light includes the first wavelength band and a second wavelength band that is a wavelength band different from the first wavelength band, and the receiving The optical unit includes a second channel for sensing a second sensing band which is a wavelength band different from the first sensing band, and the second sensing band is a wavelength band which does not overlap with the second wavelength band or overlaps with it up to the half-value wavelength. The light receiving unit includes a first dispersing element for dispersing the reflected light into the first spectral band and a second spectral band different from the first spectral band, a first imaging element having a first transmission band, and a second imaging element having a second transmission band different from the first transmission band. The first sensing band is a band based on the first spectral band and the first transmission band, and the second sensing band is a band based on the second spectral band and the second transmission band. Effect of the Invention

[0019] According to the medical device and the operating method thereof of the present invention, it is possible to provide a medical device that is capable of acquiring a plurality of examination images and that realizes as low a cost and as few parts as possible. [Brief description of the drawings]

[0020] [Figure 1] FIG. 1 is a configuration diagram of an endoscope system. [Diagram 2] 4 is a graph showing a spectrum of a first wavelength band. [Diagram 3] 1 is a graph showing the excitation light and fluorescence spectra of ICG. [Figure 4] 13 is a graph showing the spectrum of a second wavelength band. [Diagram 5] 1 is a graph showing the extinction coefficient of hemoglobin. [Figure 6] FIG. 2 is a configuration diagram of a light receiving section in the first embodiment. [Figure 7] 4 is a graph showing characteristics of a first light separating element. [Figure 8] 4 is a graph showing characteristics of a first light separating element. [Figure 9] 1 is a graph showing an example of a first spectral band. [Figure 10] 13 is a graph showing an example of a second spectral band. [Figure 11] 4 is a graph showing a first transmission band. [Figure 12] 13 is a graph showing a 2A transmission band, a 2B transmission band, and a 2C transmission band. [Figure 13] 1 is a graph showing a first sensing band. [Figure 14] 11 is a graph showing a second sensing band. [Figure 15] FIG. 2 is a block diagram showing functions of an image processing unit. [Figure 16] Fluorescent blood vessel images are shown. [Figure 17] Fluorescent lymphatic vessel images are shown. [Figure 18] FIG. 2 is a block diagram showing an oxygen saturation acquiring unit and a StO2 distribution information acquiring unit. [Figure 19] 13 is a graph for calculating oxygen saturation. [Figure 20] FIG. 1 is an image diagram showing a StO2 distribution image. [Figure 21] 1 is an explanatory diagram showing the relationship between a hemoglobin image, oxygen saturation, StO2 distribution information, and a StO2 distribution image. [Figure 22] FIG. 13 is an image diagram showing a blood vessel superimposed image. [Figure 23] 10 is an explanatory diagram showing the relationship between a fluorescent blood vessel image, blood vessel distribution information, and a blood vessel superimposition image. FIG. [Figure 24] FIG. 13 is an image diagram showing a lymphatic vessel superimposed image. [Diagram 25] 10 is an explanatory diagram showing the relationship between a fluorescent lymphatic vessel image, lymphatic vessel distribution information, and a lymphatic vessel superimposed image. FIG. [Figure 26] FIG. 13 is an image diagram showing a vascular superimposed image. [Figure 27] 11 is an explanatory diagram showing the relationship between blood vessel distribution information, lymphatic vessel distribution information, and a blood vessel superimposed image. FIG. [Figure 28] FIG. 13 is an image diagram showing a blood vessel visualization StO2 image. [Figure 29] 10 is an explanatory diagram showing the relationship between blood vessel distribution information, StO2 distribution information, blood vessel visualization StO2 information, and a blood vessel visualization StO2 image. FIG. [Diagram 30] FIG. 13 is an image diagram showing a vascular visualization StO2 image. [Diagram 31] 11 is an explanatory diagram showing the relationship between blood vessel distribution information, StO2 distribution information, blood vessel visualization StO2 information, lymphatic vessel distribution information, and a blood vessel visualization StO2 image. FIG. [Diagram 32] FIG. 11 is a configuration diagram of a light receiving section in a second embodiment. [Diagram 33] 11 is a graph showing a first dispersion band. [Diagram 34] 13 is a graph showing a second dispersion band. [Diagram 35] FIG. 11 is a configuration diagram of a light receiving section in a third embodiment. [Diagram 36] FIG. 11 is a configuration diagram of a sensor according to a third embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0021] [First embodiment] As shown in FIG. 1, an endoscope system 10 includes an endoscope 12, a light source device 14, a light receiving unit 15, a processor device 16, a display 18, and a console 19.

[0022] The endoscope 12 is inserted into the subject. An optical system for forming an image of the subject and an optical system for irradiating the subject with illumination light are provided inside the endoscope 12. The light source device 14 generates illumination light. The light receiving unit 15 captures an image of the subject. The processor device 16 performs system control and image processing of the endoscope system 10. The display 18 is a display unit that displays an image captured by the endoscope 12. The console 19 is an input device for inputting settings to the processor device 16, etc.

[0023] The light source device 14 includes a light source section 20 that emits illumination light, and a light source control section 22 that controls the operation of the light source section 20 .

[0024] The light source unit 20 emits illumination light for illuminating a subject, or excitation light used to emit illumination light. The light source unit 20 includes a light source such as a laser diode, an LED (Light Emitting Diode), a xenon lamp, or a halogen lamp, and emits at least white illumination light (normal light), light in a first wavelength band, or light in a second wavelength band. The white light includes so-called pseudo-white light that is substantially equivalent to white light in imaging of a subject using the endoscope 12.

[0025] Furthermore, the light source unit 20 includes an optical filter or the like that adjusts the wavelength band, spectrum, or light amount of the illumination light or excitation light, as necessary.

[0026] In this embodiment, the light source unit 20 emits illumination light including a first wavelength band. Light For example, the first wavelength band is near-infrared light having a central wavelength of about 780 nm as shown in Fig. 2. The first wavelength band is a wavelength band of excitation light that excites a fluorescent substance.

[0027] A fluorescent substance emits fluorescence when it receives excitation light, as shown in Fig. 3. An example of a fluorescent substance is indocyanine green. When indocyanine green receives excitation light, which is light in a first wavelength band, it emits fluorescence, which is light including wavelengths in a second wavelength band whose central wavelength is different from that of the first wavelength band, as shown in Fig. 4.

[0028] Furthermore, the first wavelength band is also the wavelength of light required to generate an image (hemoglobin image) showing the distribution of hemoglobin contained in the subject. As shown in FIG. 5, the central wavelength of about 780 nm is a wavelength at which oxygenated hemoglobin and reduced hemoglobin have different absorption coefficients. The subject is imaged by irradiating it with illumination light including light with the central wavelength of about 780 nm, and tissue oxygen saturation (StO2) is calculated based on the difference in absorption coefficient between oxygenated hemoglobin and reduced hemoglobin contained in the subject. Hereinafter, tissue oxygen saturation will be referred to as "StO2" or simply as "oxygen saturation."

[0029] That is, in the present invention, the illumination including a certain wavelength band (first wavelength band) is Akira The light functions as excitation light for the fluorescent substance and also as light for measuring oxygen saturation.

[0030] The light source control unit 22 controls the on / off and light emission amount of each light source constituting the light source unit 20. The illumination light emitted by the light source unit 20 enters the endoscope 12 via a light guide 24, is guided to the tip of the endoscope 12 via an optical system (an optical system for irradiating an object with illumination light) built into the endoscope 12, and is emitted toward the object from the tip of the endoscope 12. Thereafter, the illumination light is irradiated onto the object, and reflected light from the object is guided to the light receiving unit 15 via an optical system (an optical system for forming an image of the object) built into the endoscope 12.

[0031] The light reflected from the subject includes at least light in a first wavelength band and light in a second wavelength band that is a different wavelength band from the first wavelength band.

[0032] 6, the light receiving unit 15, which receives reflected light from a subject and transmits an image signal, includes a first spectroscopic element 31, a first imaging element 41, and a second imaging element 42. Based on image signals detected by the first imaging element 41 and the second imaging element 42, inspection images such as a fluorescent blood vessel image 80, a fluorescent lymphatic vessel image 82, and a hemoglobin image, which will be described later, are generated.

[0033] The first spectroscopic element 31 is a spectroscopic element that reflects light having a wavelength band equal to or greater than a certain wavelength band and transmits light having a wavelength band smaller than the certain wavelength band, such as a dichroic filter, a dichroic mirror, a beam splitter, a half mirror, etc. The first imaging element and the second imaging element are a CMOS (Complementary Metal Oxide Semiconductor) sensor, a CCD (Charge-Coupled Device) sensor, etc.

[0034] Here, the first light-splitting element 31 and the first image sensor 41 A combination of the first light-splitting element 31 and the second image capturing element 42 is referred to as a first channel, and a combination of the first light-splitting element 31 and the second image capturing element 42 is referred to as a second channel.

[0035] The first channel has a first sensing band, which is a wavelength band that does not overlap with the first wavelength band or that overlaps with the first wavelength band up to the half-wavelength. The second channel has a second sensing band, which is a wavelength band that does not overlap with the second wavelength band or that overlaps with the second wavelength band up to the half-wavelength. The half-wavelength refers to the wavelength at which the sensitivity of the sensor is half its peak value.

[0036] The first dispersing element 31 disperses light reflected from a subject into light having a specific wavelength in a first spectral band and light having a specific wavelength in a second spectral band. The light in the first spectral band is reflected by the first dispersing element 31, and the light in the second spectral band is transmitted.

[0037] Specifically, as shown in Fig. 7, the reflectance of the first spectroscopic element 31 increases at wavelengths of (λ-X) nm or more and is maximum at (λ+Y) nm. On the other hand, as shown in Fig. 8, the transmittance of the first spectroscopic element 31 decreases at wavelengths of (λ-X) nm or more and is minimum at (λ+Y) nm. That is, the first spectroscopic element 31 almost completely reflects light with a wavelength longer than (λ+Y) nm and sets light in a wavelength band longer than (λ-X) nm as a first spectroscopic band, and transmits light in a wavelength band shorter than (λ+Y) nm as a second spectroscopic band. The values ​​of λ, X, and Y vary depending on the selected first spectroscopic element.

[0038] To give specific numerical values, light in the second wavelength band (for example, fluorescence with a central wavelength of approximately 820 nm) is reflected by the first dispersive element and becomes light in the first dispersive band, as shown in Fig. 9. As a specific numerical example of the wavelength band, as shown in Fig. 9, the reflectance increases at λ=(780-X) nm, and becomes maximum at λ=(780+Y) nm, becoming light in the first dispersive band. The values ​​of X and Y vary depending on the selected first dispersive element.

[0039] On the other hand, as shown in Fig. 10, light in the first wavelength band (for example, excitation light with a central wavelength of about 780 nm, light for measuring oxygen saturation) is transmitted through the first spectroscopic element and becomes light in the second spectroscopic band. As a specific numerical example of the wavelength band, as shown in Fig. 10, the transmittance decreases at λ = (780 - X) nm and becomes a minimum at λ = (780 + X) nm, becoming light in the second spectroscopic band. The values ​​of X and Y vary depending on the first spectroscopic element selected.

[0040] The light in the first spectral band reflected by the first dispersive element 31 is incident on the first imaging element 41. The light in the first spectral band is imaged on the imaging surface of the first imaging element 41. On the other hand, the light in the second spectral band transmitted by the first dispersive element 31 is incident on the second imaging element 42. The light in the second spectral band is imaged on the imaging surface of the second imaging element 42.

[0041] The first imaging element 41 has a first transmission band. Specifically, the first imaging element 41 is a monochrome imaging sensor that is not provided with a color filter (such as a Bayer filter), and can recognize light in the wavelength band shown in FIG.

[0042] The second imaging element 42 has a second transmission band. Specifically, the second imaging element 42 is a color imaging sensor provided with a color filter (such as a Bayer filter). The second transmission band is divided into a 2A transmission band, a 2B transmission band, and a 2C transmission band that are different from each other, as shown in Fig. 12. For example, the 2A transmission band corresponds to a blue wavelength band, the 2B transmission band corresponds to a green wavelength band, and the 2C transmission band corresponds to a red wavelength band.

[0043] The first sensing band of the first channel is a wavelength band where the first spectral band and the first transmission band overlap, and in Fig. 13, the solid line portion where the first spectral band shown by the dotted line and the first transmission band shown by the dashed line overlap corresponds to the first sensing band. The first imaging element 41 converts the sensed light into a monochrome image signal.

[0044] The second sensing band of the second channel is a wavelength band where the second spectral band and the second transmission band overlap, and in Fig. 14, the second spectral band shown by the dotted line and the solid line portion where the 2A transmission band, the 2B transmission band, and the 2C transmission band overlap corresponds to the second sensing band. The second imaging element 42 converts the sensed light into a color image signal. Note that the color sensor used as the second imaging element 42 may convert the sensed light into a CMY signal instead of an RBG signal.

[0045] In this embodiment, light having a central wavelength of about 780 nm, which is the wavelength band of excitation light for fluorescent substances and the wavelength band of light required to obtain a hemoglobin image, is used as the first wavelength band light as the irradiating light. In this case, the reflected light includes light having a central wavelength of about 780 nm, which is reflected light from a living body, and light having a central wavelength of about 820 nm, which is fluorescence from fluorescent substances, which is the first wavelength band light.

[0046] With the above configuration, by having the first imaging element sense light in the first spectral band and the second imaging element sense light in the second spectral band, it is possible to obtain a fluorescence image and a hemoglobin image in one stop using light in a specific wavelength band without using special excitation light illumination or illumination for oxygen saturation measurement.

[0047] The image signals transmitted from the first imaging element 41 and the second imaging element 42 are transmitted to an image processing unit 61 of the processor device 16. The processor device 16 is made up of a control unit 59, an image processing unit 61, and a display control unit 66. In the processor device 16, the functions of the image processing unit 61 and the display control unit 66 are realized by the control unit 59, which is made up of an image control processor, running a program in a program memory. The functions of the image processing unit 61 and the display control unit 66 will be described later.

[0048] Hereinafter, the function of the image processing unit 61 will be described with reference to FIG.

[0049] The signal converted from the light in the first sensing band by the first imaging element 41 to an image signal is transmitted to a blood vessel distribution information acquisition section 102 and / or a lymphatic vessel distribution information acquisition section 104 in the image processing section 61. The blood vessel distribution information acquisition section 102 generates a fluorescent blood vessel image 80 as shown in FIG. 16 based on the image signal received from the first imaging element 41. In the fluorescent blood vessel image 80, the localization of indocyanine green is visualized as relatively thin blood vessels 111 such as arterioles, venules, and capillaries, and relatively thick blood vessels 112. The blood vessel distribution information acquisition section 102 obtains blood vessel distribution information from the generated fluorescent blood vessel image 80.

[0050] The lymphatic vessel distribution information acquisition unit 104 generates a fluorescent lymphatic vessel image 82 as shown in Fig. 17 based on the image signal received from the first imaging element 41. In the fluorescent lymphatic vessel image 82, the localization of indocyanine green is visualized as a relatively thin lymphatic vessel 113 and a relatively thick lymphatic vessel 114. The lymphatic vessel distribution information acquisition unit 104 obtains lymphatic vessel distribution information from the generated fluorescent lymphatic vessel image 82. Note that Figs. 16 and 17 show examples of images captured by enlarging a portion of the stomach 100, which is the subject.

[0051] Whether to generate either the fluorescent blood vessel image 80 or the fluorescent lymphatic vessel image 82, or both of these images, is set by the user before or during the examination. 、This is because a user such as a doctor decides whether to perform lymphatic angiography or blood vessel angiography. When a user performs fluorescence angiography using a fluorescent substance, the fluorescent substance is administered to a vein or lymph node. When a fluorescent substance is administered into a vein of a subject, fluorescence angiography of blood vessels is performed. On the other hand, when a fluorescent substance is administered into a lymph node of a subject, fluorescence angiography of lymph vessels is performed. Note that, without setting whether to send the image signal converted by the first image sensor 41 to the blood vessel distribution information acquisition unit 102 and / or the lymph vessel distribution information acquisition unit 104, the image processing unit 61 may automatically determine whether the image signal is a blood vessel or a lymph vessel from the distribution of the fluorescent substance obtained from the fluorescent blood vessel image 80 or the fluorescent lymph vessel image 82.

[0052] The vascular distribution information is a feature of blood vessels obtained from the fluorescent blood vessel image 80. The feature of the fluorescent blood vessel image 80 is preferably classified according to whether the observation target is located in at least one of the superficial layer, the middle layer, and the deep layer. The feature is preferably a value obtained from the shape or pixel density of the observation target. Examples of feature items include blood vessel density, blood vessel shape, the number of blood vessel branches, blood vessel thickness, blood vessel length, blood vessel tortuosity, blood vessel depth, and blood vessel irregularity. The feature is preferably at least one of these, or a value combining two or more of these. Note that the feature items are not limited to these, and may be added as appropriate depending on the usage situation.

[0053] The lymphatic vessel distribution information is a feature of the lymphatic vessel obtained from the fluorescent lymphatic vessel image 82. The feature is preferably a value obtained from the shape of the observation object, pixel density, and the like. Examples of feature items include lymphatic vessel density, lymphatic vessel shape, number of lymphatic vessel branches, lymphatic vessel thickness, lymphatic vessel length, lymphatic vessel tortuosity, lymphatic vessel depth, and lymphatic vessel irregularity. The feature is preferably at least one of these, or a combination of two or more of these. Note that the feature items are not limited to these, and may be added as appropriate depending on the usage situation.

[0054] With the above configuration, it is possible to visualize, from blood vessel distribution information and / or lymphatic vessel distribution information, the locations where blood flow insufficiency is occurring, the blood flow concentration, and the characteristics (thickness, depth) of the blood vessels and / or lymphatic vessels and how they are distributed (normally, irregularly).

[0055] The fluorescent blood vessel image 80 acquired by the blood vessel distribution information acquisition unit 102 may be transmitted to the display control unit 66. It may also be transmitted to a superimposed image generation unit 110, which will be described later. It may also be transmitted to a blood vessel visualization StO2 information acquisition unit 108, which will be described later.

[0056] The fluorescent lymphatic vessel image 82 acquired by the lymphatic vessel distribution information acquisition unit 104 may be transmitted to the display control unit 66. It may also be transmitted to the superimposed image generation unit 110, which will be described later. In addition, lymphatic vessel distribution information may be transmitted to the superimposed image generation unit 110 together with the fluorescent lymphatic vessel image 82.

[0057] The oxygen saturation level acquiring section 90 will now be described.

[0058] The signal converted from the light in the second sensing band by the second imaging element 42 into an image signal is transmitted to an oxygen saturation acquisition unit 90 in the image processing unit 61. A hemoglobin image generation unit 91 provided in the oxygen saturation acquisition unit 90 shown in Fig. 18 generates a hemoglobin image based on the image signal received from the second imaging element 42, and transmits the image information to a signal ratio calculation unit 92. The result calculated in the signal ratio calculation unit 92 and information on an oxygen saturation calculation table 93 are transmitted to an oxygen saturation calculation unit 94, and the oxygen saturation is obtained.

[0059] The image processing for oxygen saturation measurement performed by the oxygen saturation acquisition unit 90 is a process applied to an image signal obtained by emitting light including a wavelength band of the first wavelength band. The image signal received from the second imaging element may include a B image signal, a G image signal, and an R image signal based on light of the 2A transmission band, the 2B transmission band, and the 2C transmission band. The signal ratio calculation unit 92 performs the signal ratio calculation process by, for example, calculating a first signal ratio (B / G) representing the ratio between the B image signal and the G image signal, and a second signal ratio (R / G) representing the ratio between the R image signal and the G image signal, and transmits the signal ratio calculation process result to the oxygen saturation calculation unit 94. The oxygen saturation calculation unit 94 calculates the oxygen saturation corresponding to the first signal ratio and the second signal ratio by referring to the signal ratio calculation process result and the oxygen saturation calculation table 93.

[0060] The oxygen saturation calculation table 93 stores the correlation between the oxygen saturation and the first and second signal ratios. Specifically, as illustrated in FIG. 19, the table is configured as a two-dimensional table that defines oxygen saturation contour lines ELx, EL1, EL2, EL3, ELy, etc. in a two-dimensional space with the first signal ratio (B / G) and the second signal ratio (R / G) as axes. The contour line ELx represents oxygen saturation of "0%", the contour line EL1 represents oxygen saturation of "30%", the contour line EL2 represents oxygen saturation of "50%", and the contour line EL3 represents oxygen saturation of "80%". The positions and shapes of the contour lines for the first signal ratio (B / G) and the second signal ratio (R / G) are obtained in advance by a physical simulation of light scattering. In addition, it is preferable that the first signal ratio (B / G) and the second signal ratio (R / G) are in a log scale. The oxygen saturation level is transmitted to the StO2 distribution information acquisition unit 106.

[0061] The StO2 distribution information acquisition unit 106 acquires StO2 distribution information from the oxygen saturation calculated by the oxygen saturation acquisition unit 90. The oxygen saturation is numerical information based on the distribution of oxygenated hemoglobin and reduced hemoglobin, and this is applied to the hemoglobin image, which parts of the hemoglobin image are two-dimensionally mapped to show which parts are hypoxic, and the approximate positions of blood vessels are visualized to provide StO2 distribution information. The StO2 distribution information is transmitted to the blood vessel visualization StO2 information acquisition unit 108. In addition, a StO2 distribution image 123 as shown in FIG. 20 may be generated by superimposing the StO2 distribution information on the hemoglobin image, and transmitted to the display control unit 66.

[0062] In the StO2 distribution image 123 shown in Fig. 20, a normal value region 120 where the oxygen saturation is normal, a hyperoxic region 121 where the oxygen saturation is high, and a hypoxic region 122 where the oxygen saturation is low are visualized in different colors. The display of the StO2 distribution information is not limited to this, and the oxygen saturation may be displayed as a numerical value or the like. Note that Fig. 20 illustrates an example of an image obtained by enlarging and capturing a part of the stomach 100, which is the subject.

[0063] The functions of the oxygen saturation acquiring unit 90 and the StO2 distribution information acquiring unit 106 are summarized in Fig. 21. When the oxygen saturation acquiring unit 90 receives an image signal, it generates a hemoglobin image, acquires oxygen saturation, and transmits it to the StO2 distribution information acquiring unit 106. The StO2 distribution information acquiring unit 106 acquires StO2 distribution information. The StO2 distribution information acquiring unit 106 may generate a StO2 distribution image 123 shown in Fig. 20. In addition, the StO2 distribution information may be transmitted to the blood vessel visualization StO2 information acquiring unit 108 described later.

[0064] The superimposed image generating unit 110 will now be described.

[0065] A normal light image 130 based on reflected light obtained by irradiating a subject with normal light is transmitted to the superimposed image generating section 110. The superimposed image generating section 110 generates an image as shown in Figs. 22, 24, 26, 28, and 30 by superimposing information described later on the normal light image 130.

[0066] The superimposed image generating unit 110 generates a blood vessel superimposed image 131 as shown in FIG. 22 by superimposing blood vessel distribution information on the normal light image 130. In the blood vessel superimposed image 131, the shape, position, size, range, etc. of blood vessels are visualized on the normal light image 130. For simplicity, FIG. 22 shows only a thick blood vessel 112. As for the flow of images and information, as shown in FIG. 23, when the blood vessel distribution information acquiring unit 102 receives an image signal, a fluorescent blood vessel image 80 (see FIG. 16) is generated and blood vessel distribution information is acquired and transmitted to the display control unit 66 or the superimposed image generating unit 110. The blood vessel distribution information is superimposed on the normal light image 130 to generate the blood vessel superimposed image 131 shown in FIG. 22.

[0067] Furthermore, the superimposed image generating unit 110 generates a lymphatic vessel superimposed image 132 as shown in FIG. 24 by superimposing lymphatic vessel distribution information on the normal light image 130. In the lymphatic vessel superimposed image 132, the shape, position, size, range, etc. of the lymphatic vessel are visualized on the normal light image 130. For simplicity, FIG. 24 shows only a thick lymphatic vessel 114. As for the flow of images and information, as shown in FIG. 25, when the lymphatic vessel distribution information acquiring unit 104 receives an image signal, a fluorescent lymphatic vessel image 82 (see FIG. 17) is generated and lymphatic vessel distribution information is acquired and transmitted to the display control unit 66 or the superimposed image generating unit 110. The lymphatic vessel distribution information is superimposed on the normal light image 130 to generate the lymphatic vessel superimposed image 132 shown in FIG. 24.

[0068] Moreover, the superimposed image generating unit 110 may receive blood vessel distribution information and lymphatic vessel distribution information and generate a blood vessel superimposed image 133 shown in Fig. 26. The flow of images and information is as shown in Fig. 27. The blood vessel is a general term that includes blood vessels and lymphatic vessels.

[0069] Furthermore, the superimposed image generating unit 110 superimposes blood vessel visualization StO2 information obtained by combining the blood vessel distribution information and the StO2 distribution information acquired by the blood vessel visualization StO2 information acquiring unit 108 onto the normal light image 130, thereby generating a blood vessel visualization StO2 image 134 as shown in FIG. 28.

[0070] The blood vessel visualization StO2 information acquisition unit 108 receives the StO2 distribution information from the StO2 distribution information acquisition unit 106 and the blood vessel distribution information from the blood vessel distribution information acquisition unit 102, and acquires the blood vessel visualization StO2 information. The blood vessel visualization StO2 information is information that combines information that visualizes the oxygen saturation obtained from the StO2 distribution information and the blood vessel property and three-dimensional distribution information obtained from the blood vessel distribution information, and can improve the accuracy of information required to determine the position, malignancy, invasion range, etc. of a tumor. The blood vessel visualization StO2 information is transmitted to the superimposed image generation unit 110.

[0071] In the blood vessel visualized StO2 image 134 generated by the superimposed image generating unit 110, the blood vessel visualized StO2 information is visualized on the normal light image 130. For example, as illustrated in FIG. 28, StO2 distribution information and thick blood vessels 112 are displayed, but the display method is not limited to this. For example, the predicted position, malignancy, infiltration range, etc. of the tumor may be displayed. As a flow of the image and information, as illustrated in FIG. 29, the blood vessel visualized StO2 information acquiring unit 108 receives the blood vessel distribution information and the StO2 distribution information and acquires the blood vessel visualized StO2 information. The blood vessel visualized StO2 information is transmitted to the superimposed image generating unit 110, and a process of generating the blood vessel visualized StO2 image 134 shown in FIG. 28 is performed.

[0072] The superimposed image generating unit 110 generates a vessel-visualized StO2 image 135 as shown in FIG. 30, in which the vessel-visualized StO2 information and lymphatic distribution information are superimposed on the normal light image 130. In the vessel-visualized StO2 image 135, information obtained by combining the vessel-visualized StO2 information and lymphatic distribution information on the normal light image 130 is visualized. For example, as illustrated in FIG. 30, the vessel-visualized StO2 information, a thick vessel 112, and a thick lymphatic vessel 114 are displayed, but the display method is not limited thereto. Thin vessels and thin lymphatic vessels may also be displayed, and the thickness of the vessels to be displayed can be set appropriately. The flow of images and information for generating the vessel-visualized StO2 image 135 is as shown in FIG. 31.

[0073] The blood vessel superimposed image 131, lymphatic vessel superimposed image 132, blood vessel superimposed image 133, blood vessel visualized StO2 image 134, and blood vessel visualized StO2 image 135 generated by the superimposed image generation unit 110 are transmitted to the display control unit 66 and output and displayed on the display 18.

[0074] [Second embodiment] In the above-described first embodiment, an embodiment has been described in which the light receiving unit 15 has the first dispersing element 31, the first imaging element 41, and the second imaging element 42. In contrast, in the second embodiment, the light receiving unit 15 has the second dispersing element 201, the first optical element 202, the second optical element 203, the first imaging element 41, and the second imaging element 42 (see FIG. 32).

[0075] In this embodiment, the combination of the first optical element 202 and the first imaging element 41 is called a first channel, and the combination of the second optical element 203 and the second imaging element 42 is called a second channel.

[0076] The second spectroscopic element 201 is a spectroscopic element that splits one light having the same wavelength band into at least two or more lights having the same wavelength band. Examples of the second spectroscopic element 201 include a plate-type beam splitter and a cube-type beam splitter.

[0077] The first optical element 202 is an optical element that reflects or absorbs light in a wavelength band of a first cutoff wavelength contained in the light dispersed by the second dispersing element 201, and transmits light in a first dispersion band. The first cutoff wavelength preferably includes the entire wavelength band of the first wavelength band or up to a half-value wavelength. Examples of the first optical element 202 include a long-pass filter, a band-pass filter, and the like. The first optical element 202 may also be a combination of these.

[0078] Specifically, the first optical element 202 reflects or absorbs light less than λ=(780-X) nm, which is the first cutoff wavelength, as shown in FIG. 33, for example. The transmittance of the first optical element 202 increases in a wavelength band equal to or greater than λ=(780-X) nm, and is maximum at λ=(780+Y) nm. In other words, the first dispersion band is a wavelength band equal to or greater than λ=(780-X) nm, from which light less than λ=(780-X) nm is excluded. The wavelength band that is the first cutoff wavelength can be determined arbitrarily, and the values ​​of X and Y depend on the first cutoff wavelength to be selected. 2 It varies depending on the spectroscopic element.

[0079] The first imaging element 41 is a monochrome imaging sensor having a first transmission band shown in FIG. 11, as in the first embodiment. Light in a first dispersion band is incident on the first imaging element 41. A first sensing band, which is a wavelength band of light sensed by the first imaging element 41, is a wavelength band in which the first dispersion band and the first transmission band overlap. Specifically, the first sensing band is the same as in the first embodiment, and is the band shown by the solid line in FIG. 13. In this embodiment, the dashed line in FIG. 13 corresponds to the first transmission band, and the dotted line corresponds to the first dispersion band.

[0080] The second optical element 203 is an optical element that reflects or absorbs light in a wavelength band of a second cutoff wavelength contained in the light dispersed by the second spectroscopic element 203, and transmits light in a second dispersion band. The second cutoff wavelength preferably includes the entire wavelength band of the second wavelength band or up to a half-value wavelength. Examples of the second optical element 203 include a short-pass filter, a band-pass filter, and the like. The second optical element 203 may also be a combination of these.

[0081] Specifically, the second optical element 203 reflects or absorbs light of the second cut wavelength, λ=(780+Y) nm or more, as shown in FIG. 34, for example. The transmittance of the second optical element 203 decreases at λ=(780-X) nm or more and is minimum at λ=(780+Y) nm. This light is in the second dispersion band. In other words, the second dispersion band is a wavelength band less than λ=(780-X) nm, from which light of λ=(780+Y) nm or more is excluded. The wavelength band that is the second cut wavelength can be determined arbitrarily, and the values ​​of X and Y are determined according to the first cut wavelength to be selected.2 It varies depending on the spectroscopic element.

[0082] The second imaging element 42 is a color imaging sensor having a second transmission band, as in the first embodiment. The light that is dispersed by the second dispersing element 201 and transmitted through the second optical element 203 to become the second dispersion band is incident on the second imaging element 42. The second sensing band, which is the wavelength band of light sensed by the second imaging element 42, is a wavelength band in the range where the second dispersion band and the second transmission band overlap. Specifically, the second sensing band is the same as in the first embodiment, and is the band indicated by the solid line in FIG. 14. In this embodiment, the dotted line in FIG. 14 is the second dispersion band.

[0083] The first imaging element 41 and the second imaging element 42 transmit image signals based on the detected light to an image processing unit 61. Note that the functions of the processor device 16 and the image processing unit 61 are the same as those in the first embodiment, and therefore description thereof will be omitted.

[0084] [Third embodiment] In the second embodiment, the first 2 The embodiment having the spectroscopic element, the first optical element, the second optical element, the first imaging element, and the second imaging element has been described. In contrast, in the third embodiment, as shown in Fig. 36, a first filter corresponding to the first channel and a second filter corresponding to the second channel are provided in one sensor in the light receiving unit 15.

[0085] In the first and second embodiments, the filters provided in the first and second channels are both common or ready-made products. The light receiving unit 15 in the third embodiment includes a special sensor 300 in which a first filter 301 corresponding to the first channel and a second filter 302 corresponding to the second channel are alternately combined and arranged, as shown in FIG.

[0086] The first channel is shown in Figure 1. 3 The first sensing band is shown by the solid line in FIG. 4The second sensing band is indicated by a solid line in FIG. 1. The first and second channels transmit image signals from the sensed light to an image processing unit 61. Note that the functions of the processor device 16 and the image processing unit 61 are the same as those of the first embodiment, and therefore will be omitted.

[0087] In the first, second and third embodiments, the image processing unit 61 and the control unit 59 are connected to the endoscope 12. However, the image processing unit 61 and the control unit 59 are provided in the endoscope system 10. However, the present invention is not limited to this, and other medical devices may be used. A rigid or flexible endoscope may be used as the endoscope 12. In addition, the image processing unit 61 and / or the control unit 59 of the endoscope system 10 may be provided in part or in whole in a medical image processing device that communicates with the processor device 16 and cooperates with the endoscope system 10. For example, the image processing unit 61 and / or the control unit 59 of the endoscope system 10 may be provided in a diagnosis support device that acquires an image captured by the endoscope 12 directly from the endoscope system 10 or indirectly from a PACS (Picture Archiving and Communication Systems). In addition, the image processing unit 61 and / or the control unit 59 of the endoscope system 10 may be provided in part or in whole in a medical work support device that is connected to various inspection devices such as a first inspection device, a second inspection device, ..., an Nth inspection device, including the endoscope system 10, via a network.

[0088] In the first, second and third embodiments, the hardware structure of the processing units that execute various processes, such as the control unit 59, the image processing unit 61 and the display control unit 66, is various processors as shown below. The various processors include a CPU (Central Processing Unit), which is a general-purpose processor that executes software (programs) and functions as various processing units, a programmable logic device (PLD), which is a processor whose circuit configuration can be changed after manufacture, such as an FPGA (Field Programmable Gate Array), and a dedicated electric circuit, which is a processor having a circuit configuration designed exclusively for executing various processes.

[0089] One processing unit may be configured with one of these various processors, or may be configured with a combination of two or more processors of the same type or different types (for example, multiple FPGAs, or a combination of a CPU and an FPGA). Also, multiple processing units may be configured with one processor. As an example of configuring multiple processing units with one processor, first, as represented by a computer such as a client or server, one processor is configured with a combination of one or more CPUs and software, and this processor functions as multiple processing units. Second, as represented by a system on chip (SoC), there is a form using a processor that realizes the functions of the entire system including multiple processing units with one IC (Integrated Circuit) chip. In this way, the various processing units are configured using one or more of the above various processors as a hardware structure.

[0090] Furthermore, the hardware structure of these various processors is, more specifically, an electric circuit (circuitry) in the form of a combination of circuit elements such as semiconductor elements, etc. Also, the hardware structure of the memory unit is a storage device such as a hard disk drive (HDD) or a solid state drive (SSD). [Explanation of symbols]

[0091] 10 Medical Devices 12 Endoscopy 14 Light source device 15 Light receiving part 16 Processor Unit 18 Display 19 Console 20 Light source section 22 Light source control unit 24 rai to guide 31 First spectroscopic element 41 First image sensor 42 Second image sensor 59 Control section 61 Image processing section 66 Display control unit 90 Oxygen saturation acquisition unit 80 Fluorescent Blood Vessel Images 82 Fluorescent Lymphatic Vessel Images 91 Hemoglobin Imaging Unit 92 Signal ratio calculation section 93 Oxygen Saturation Calculation Table 94 Oxygen saturation calculation unit 100 stomach 102 Blood vessel distribution information acquisition unit 104 Lymphatic vessel distribution information acquisition unit 106 StO2 distribution information acquisition section 108 Blood vessel visualization StO2 information acquisition unit 110 Superimposed image generation unit 111 Small Blood Vessels 112 Thick Blood Vessels 113 Thin Lymphatic Vessels 114 Large Lymphatic Vessel 120 Normal range 121 Hyperoxic region 122 Hypoxic Region 123 StO2 distribution image 130 normal light images 131 Blood vessel superimposition image 132 Lymphatic vessel superimposed image 133 Vascular Overlay Image 134 Blood vessel visualization StO2 image 135 Vascular visualization StO2 image 201 Second spectroscopic element 202 First optical element 203 Second Optical Element 300 Sensors 301 First Filter 302 Second Filter

Claims

1. A medical device that illuminates a subject and captures an image of reflected light from the subject, a light source that emits illumination light including a first wavelength band; a light receiving unit having a first channel for sensing a first sensing band; An image control processor; Equipped with The first sensing band is a wavelength band that does not overlap the first wavelength band or overlaps with the first wavelength band up to a half-wavelength; The image control processor acquires at least one inspection image based on light included in the first sensing band; the reflected light includes the first wavelength band and a second wavelength band that is a wavelength band different from the first wavelength band, the light receiving unit includes a second channel for detecting a second sensing band, the second sensing band being a wavelength band different from the first sensing band; The second sensing band is a wavelength band that does not overlap with the second wavelength band or overlaps with the second wavelength band up to a half-wavelength, the first wavelength band is a wavelength band that excites a fluorescent substance and is necessary for calculating an oxygen saturation level based on a difference in responsiveness between oxyhemoglobin and deoxyhemoglobin to the illumination light, the second wavelength band is a wavelength band of fluorescence emitted by the fluorescent material upon receiving light including the first wavelength band, A medical device, wherein the first sensing band includes a wavelength band of the fluorescence, and the second sensing band includes a wavelength band required for calculating the oxygen saturation level.

2. A medical device that illuminates a subject and captures an image of reflected light from the subject, a light source that emits illumination light including a first wavelength band; a light receiving unit having a first channel for sensing a first sensing band; An image control processor; Equipped with The first sensing band is a wavelength band that does not overlap the first wavelength band or overlaps with the first wavelength band up to a half-wavelength; The image control processor acquires at least one inspection image based on light included in the first sensing band; the reflected light includes the first wavelength band and a second wavelength band that is a wavelength band different from the first wavelength band, the light receiving unit includes a second channel for detecting a second sensing band, the second sensing band being a wavelength band different from the first sensing band; The second sensing band is a wavelength band that does not overlap with the second wavelength band or overlaps with the second wavelength band up to a half-wavelength, the light receiving unit includes a first dispersing element that disperses the reflected light into a first dispersing band and a second dispersing band different from the first dispersing band, a first imaging element having a first transmission band, and a second imaging element having a second transmission band different from the first transmission band; the first sensing band is a band based on the first spectral band and the first transmission band, The medical device, wherein the second sensing band is a band based on the second spectral band and the second transmission band.

3. 3. The medical device of claim 2, wherein the second transmission bands include a second A transmission band, a second B transmission band, and a second C transmission band that are distinct from one another.

4. the first wavelength band is a wavelength band that excites a fluorescent substance and is necessary for calculating an oxygen saturation level based on a difference in responsiveness between oxyhemoglobin and deoxyhemoglobin to the illumination light, the first sensing band is a wavelength band including a wavelength band of fluorescence emitted from the fluorescent material, The medical device according to claim 2 , wherein the second sensing band is a wavelength band that includes a wavelength band necessary for calculating the oxygen saturation level.

5. The first channel detects fluorescence, which is light of the second wavelength band, emitted by the fluorescent material in response to light including the first wavelength band; the image control processor acquires, as the inspection images, a fluorescent blood vessel image based on the fluorescence and a fluorescent lymphatic vessel image based on the fluorescence; The medical device according to claim 1 or 4, further comprising: a fluorescent blood vessel image that obtains blood vessel distribution information; and a fluorescent lymphatic vessel image that obtains lymphatic vessel distribution information.

6. the image control processor acquires, as the test image, a hemoglobin image based on light in a wavelength band required for calculating the oxygen saturation level; Calculating the oxygen saturation from the hemoglobin image; The medical device according to claim 1 or 4, wherein StO2 distribution information is calculated from the oxygen saturation.

7. The light source emits normal light, The light receiving unit detects the reflected light obtained by irradiating the subject with the normal light, the image control processor acquires a normal light image based on the normal light; The medical device according to claim 5, which generates at least one of a blood vessel superimposition image in which the blood vessel distribution information is superimposed on the normal light image, a lymphatic vessel superimposition image in which the lymphatic vessel distribution information is superimposed on the normal light image, and a blood vessel superimposition image in which the blood vessel distribution information and the lymphatic vessel distribution information are superimposed on the normal light image.

8. The light receiving unit detects a wavelength band necessary for calculating the oxygen saturation level and a wavelength band of the fluorescence, the image control processor acquires, as the inspection image, a hemoglobin image based on light in a wavelength band required for calculating the oxygen saturation level and a fluorescent blood vessel image based on the fluorescent light; Calculating the oxygen saturation from the hemoglobin image; Acquire StO2 distribution information from the oxygen saturation; acquiring vascularity information from the fluorescent vascular image; The medical device according to claim 1 , wherein blood vessel visualization StO2 information is obtained from the blood vessel distribution information and the StO2 distribution information.

9. The light source emits normal light, The light receiving unit detects the reflected light obtained by irradiating the subject with the normal light, the image control processor acquires a normal light image based on the normal light; The medical device according to claim 8 , wherein the blood vessel-visualizing StO2 information is superimposed on the normal light image to generate a blood vessel-visualizing StO2 image.

10. the light source excites the fluorescent substance and emits light in a wavelength band necessary for calculating the oxygen saturation level and normal light; the image control processor acquires, as the inspection images, a fluorescent blood vessel image based on the fluorescence, a fluorescent lymphatic vessel image based on the fluorescence, a hemoglobin image based on light in a wavelength band required for calculating the oxygen saturation level, and a normal light image based on the normal light; Calculating the oxygen saturation from the hemoglobin image; Acquire StO2 distribution information from the oxygen saturation; acquiring blood vessel distribution information from the fluorescent blood vessel image and lymphatic vessel distribution information from the fluorescent lymphatic vessel image; Acquiring blood vessel visualization StO2 information from the blood vessel distribution information and the oxygen saturation level; The medical device according to claim 1 , wherein the blood vessel visualization StO2 information and the lymphatic vessel distribution information are superimposed on the normal light image to generate a blood vessel visualization StO2 image.

11. the light receiving unit has a second dispersing element that disperses the reflected light into at least two or more lights having the same wavelength band, a first optical element that cuts off a first cut wavelength included in the light dispersed by the second dispersing element to form a first dispersion band, a first imaging element having a first transmission band, a second optical element that cuts off a second cut wavelength, which is a wavelength band different from the first cut wavelength included in the light dispersed by the second dispersing element, to form a second dispersion band different from the first dispersion band, and a second imaging element having a second transmission band, the first sensing band is a band based on the first dispersion band and the first transmission band; The medical device according to claim 1 , wherein the second sensing band is a band based on the second dispersion band and the second transmission band.

12. The medical device according to claim 1 , wherein the light receiving unit includes a sensor provided with a first filter corresponding to the first channel and a second filter corresponding to the second channel.

13. 1. A method for operating a medical device that illuminates a subject and captures an image of reflected light from the subject, comprising: The light source emits illumination light including a first wavelength band; the light receiving unit has a first channel for sensing a first sensing band; The image control processor acquires at least one inspection image based on light included in a first sensing band sensed by the first channel; The first sensing band is a wavelength band that does not overlap with the first wavelength band or overlaps with the first wavelength band up to a half-wavelength, the reflected light includes the first wavelength band and a second wavelength band that is a wavelength band different from the first wavelength band, the light receiving unit includes a second channel for detecting a second sensing band, the second sensing band being a wavelength band different from the first sensing band; The second sensing band is a wavelength band that does not overlap with the second wavelength band or overlaps with the second wavelength band up to a half-wavelength, the first wavelength band is a wavelength band that excites a fluorescent substance and is necessary for calculating an oxygen saturation level based on a difference in responsiveness between oxyhemoglobin and deoxyhemoglobin to the illumination light, the second wavelength band is a wavelength band of fluorescence emitted by the fluorescent material upon receiving light including the first wavelength band, A method for operating a medical device, wherein the first sensing band includes a wavelength band of the fluorescence, and the second sensing band includes a wavelength band required for calculating the oxygen saturation.

14. A method for operating a medical device that illuminates a subject and captures an image of reflected light from the subject, comprising: The light source emits illumination light including a first wavelength band; the light receiving unit has a first channel for sensing a first sensing band; The image control processor acquires at least one inspection image based on light included in a first sensing band sensed by the first channel; The first sensing band is a wavelength band that does not overlap with the first wavelength band or overlaps with the first wavelength band up to a half-wavelength, the reflected light includes the first wavelength band and a second wavelength band that is a wavelength band different from the first wavelength band, the light receiving unit includes a second channel for detecting a second sensing band, the second sensing band being a wavelength band different from the first sensing band; The second sensing band is a wavelength band that does not overlap with the second wavelength band or overlaps with the second wavelength band up to a half-wavelength, the light receiving unit includes a first dispersing element that disperses the reflected light into a first dispersing band and a second dispersing band different from the first dispersing band, a first imaging element having a first transmission band, and a second imaging element having a second transmission band different from the first transmission band; the first sensing band is a band based on the first spectral band and the first transmission band, The method of operating a medical device, wherein the second sensing band is a band based on the second spectral band and the second transmission band.

Citation Information

Patent Citations

  • Observation system for medical use

    JP2010268838A

  • Medical system, processing unit therefor, and method of generating image

    JP2012152460A

  • Optical imaging system and method

    JP2018514748A

  • Medical Imaging Systems

    US20070203413A1

  • Cameras for fluorescence and reflectance imaging

    US20080177140A1