Medical image processing device and medical observation system

Abstract

In the first observation mode, the memory controller (931) writes the first captured image to the first storage area of the memory (92); reads the first divided image to the fourth divided image respectively obtained by dividing the first captured image from the first divided area to the fourth divided area of the first storage area, and outputs the images to the image processing units (932)-(935) respectively. In the second observation mode, the memory controller (931) writes the first captured image and the second captured image to the second storage area and the third storage area respectively, each of the second storage area and the third storage area has the same storage capacity as the divided area of the memory (92), reads the first captured image and the second captured image from the second storage area and the third storage area respectively, and outputs the images to the two image processing units (932), (933) respectively.

Description

Technical Field

[0001] The present disclosure relates to a medical image processing device and a medical observation system. Background Art

[0002] For example, conventionally, a medical image processing device is known that rapidly processes captured images having a relatively large amount of data (e.g., a pixel number of 4K or more) (see, for example, Patent Document 1).

[0003] In the medical image processing device described in Patent Document 1, the captured image is written into a specific storage area in a memory. Thereafter, in the medical image processing device, a plurality of divided images obtained by dividing the captured image are respectively read from a plurality of divided areas in the above storage area where the plurality of divided images are written. Then, the medical image processing device performs image processing on the plurality of read divided images in parallel using the same number of image processing units as the number of divided images.

[0004] Furthermore, conventionally, a medical image processing device is known that respectively acquires a first captured image and a second captured image and generates a superimposed image by superimposing the first captured image and the second captured image of corresponding pixels (see, for example, Patent Document 2).

[0005] Here, the first captured image is an image of irradiating an observation target with light in a first wavelength band and capturing the light reflected by the observation target by an image sensor. In addition, the second captured image is an image of irradiating the observation target with excitation light in a second wavelength band different from the first wavelength band and capturing fluorescence from the observation target excited by the excitation light by the image sensor.

[0006] Prior Art Documents

[0007] Patent Documents

[0008] Patent Document 1: JP 2018-79249 A

[0009] Patent Document 2: US 2014 / 276008 A Summary of the Invention

[0010] Technical Problem to be Solved by the Invention

[0011] Incidentally, in the medical image processing device described in Patent Document 2, for example, it is assumed that a first observation mode of observing an observation target with the first captured image and a second observation mode of observing the observation target with the superimposed image are provided. In this case, the following configuration can be imagined as a configuration for rapidly processing the first captured image in the first observation mode and rapidly processing the first captured image and the second captured image in the second observation mode.

[0012] That is to say, in order to process the first captured image, in the medical image processing apparatus described in the above Patent Document 1, the above-described memory (hereinafter, described as the first memory) and the above-described plurality of image processing units (hereinafter, described as the plurality of first image processing units) are provided. Then, for the first captured image, the first memory and the plurality of first image processing units are used to divide the first captured image into a plurality of divided images and perform image processing in parallel. In addition, in order to process the second captured image, a second memory different from the first memory and a plurality of second image processing units different from the plurality of first image processing units are provided. Then, for the second captured image, the second memory and the plurality of second image processing units are used to divide the second captured image into a plurality of divided images and perform image processing in parallel.

[0013] However, in the case where, in addition to the first memory and the plurality of first image processing units, a second memory and a plurality of second image processing units are also provided, there is a problem of an increase in circuit scale.

[0014] Therefore, there is a need for an image generation technique that can generate an image suitable for observation without increasing the circuit scale.

[0015] In view of the above, the present disclosure is constituted, and an object thereof is to provide a medical image processing apparatus and a medical observation system that can generate an image suitable for observation without increasing the circuit scale.

[0016] Solution to the problem

[0017] To solve the above problems and achieve this object, a medical image processing apparatus according to the present disclosure includes: a first captured image acquisition unit that acquires a first captured image obtained by capturing light from an observation target that emits fluorescence when irradiated with excitation light in a second wavelength band different from a first wavelength band and is irradiated with light in the first wavelength band; a second captured image acquisition unit that acquires a second captured image obtained by capturing fluorescence from the observation target irradiated with the excitation light; a mode switching unit that switches between a first observation mode and a second observation mode; a memory that temporarily stores images; a memory controller that controls writing of images to the memory and reading of images from the memory; and a plurality of image processing units that perform image processing on each input image in parallel, wherein the memory controller: in the first observation mode, writes the first captured image to a first storage area in the memory; reads a plurality of divided images from a plurality of divided areas in the first storage area, the plurality of divided images being obtained by dividing the first captured image into a number corresponding to the number of the image processing units, writes the plurality of divided images to the plurality of divided areas respectively; and outputs the plurality of divided images to the plurality of image processing units respectively; and, in the second observation mode, writes the first captured image and the second captured image to a second storage area and a third storage area respectively, each storage area having the same storage capacity as each divided area in the memory, reads the first captured image and the second captured image from the second storage area and the third storage area respectively, and outputs the first captured image and the second captured image to two of the plurality of image processing units respectively.

[0018] In addition, a medical observation system according to the present disclosure includes: a light source device that emits light in a first wavelength band and excitation light in a second wavelength band different from the first wavelength band; an imaging device that generates a first captured image by capturing light from an observation target that emits fluorescence when irradiated with the excitation light and is irradiated with light in the first wavelength band, and generates a second captured image by capturing fluorescence from the observation target irradiated with the excitation light; and a medical image processing apparatus that processes the first captured image and the second captured image.

[0019] Advantageous Effects of the Invention

[0020] According to the medical image processing apparatus and the medical observation system of the present disclosure, an image suitable for observation can be generated without increasing the circuit scale. Description of the Drawings

[0021] Figure 1 is a diagram showing the configuration of a medical observation system according to an embodiment;

[0022] Figure 2 is a block diagram showing the configuration of a camera and a control device;

[0023] Figure 3 is a diagram for explaining a captured image output from an imaging unit;

[0024] Figure 4 is a block diagram showing the configuration of a first image processing unit;

[0025] Figure 5 is a flowchart showing the operation of a control device;

[0026] Figure 6 is a diagram for explaining the operation of a memory controller in a normal observation mode;

[0027] Figure 7 is a diagram for explaining the operation of a memory controller in a normal observation mode;

[0028] Figure 8 is a diagram for explaining the operation of a memory controller in a fluorescence observation mode;

[0029] Figure 9 is a diagram for explaining the operation of a memory controller in a fluorescence observation mode. Detailed Description of the Invention

[0030] Hereinafter, embodiments for carrying out the present disclosure (hereinafter referred to as embodiments) will be described with reference to the accompanying drawings. Note that the present disclosure is not limited to the embodiments described below. In addition, in the description of the drawings, the same parts are denoted by the same reference numerals.

[0031] [Schematic Configuration Diagram of a Medical Observation System]

[0032] Figure 1 is a diagram showing the configuration of a medical observation system 1 according to the present embodiment.

[0033] The medical observation system 1 is a system for use in the medical field and for capturing (observing) an image inside a living body (observation target) as a subject. As Figure 1 shown, the medical observation system 1 includes an insertion unit 2, a light source device 3, an optical fiber 4, a camera 5, a first transmission cable 6, a display device 7, a second transmission cable 8, a control device 9, and a third transmission cable 10.

[0034] In the present embodiment, the insertion unit 2 is constituted by a rigid endoscope. That is, the insertion unit 2 has an elongated shape that is either completely rigid or partially flexible and partially rigid, and is inserted into a living body. An optical system composed of one or more lenses and converging light from the subject is provided in the insertion unit 2.

[0035] The light source device 3 is connected to one end of the optical fiber 4 and supplies light to this end of the optical fiber 4 under the control of the control device 9 to irradiate the inside of the living body. AsFigure 1 As shown, the light source device 3 includes a first light source 31 and a second light source 32.

[0036] The first light source 31 emits light in a first wavelength band. In the present embodiment, the first light source 31 is constituted by a light-emitting diode (LED) that emits white light (light in the first wavelength band).

[0037] The second light source 32 emits excitation light in a second wavelength band different from the first wavelength band. In the present embodiment, the second light source 32 is constituted by a semiconductor laser that emits near-infrared excitation light (excitation light in the second wavelength band) in the near-infrared wavelength band.

[0038] The near-infrared excitation light emitted by the second light source 32 is excitation light that excites a fluorescent substance (e.g., indocyanine green). When excited by the near-infrared excitation light, the fluorescent substance (e.g., indocyanine green) emits fluorescence whose center wavelength is on the long-wavelength side of the center wavelength of the wavelength band of the near-infrared excitation light. Note that the wavelength band of the near-infrared excitation light and the wavelength band of the fluorescence may be set to partially overlap each other, or may be set to not overlap each other at all.

[0039] In the light source device 3 according to the present embodiment, the first light source 31 is driven in a normal observation mode under the control of the control device 9. That is, in the normal observation mode, the light source device 3 emits normal light (white light). The normal observation mode corresponds to the first observation mode according to the present disclosure. On the other hand, in the light source device 3, under the control of the control device 9, in the fluorescence observation mode, in a first period and a second period that are alternately repeated, the first light source 31 is driven in the first period, and the second light source 32 is driven in the second period. That is, in the fluorescence observation mode, the light source device 3 emits normal light (white light) in the first period, and emits near-infrared excitation light in the second period. The fluorescence observation mode corresponds to the second observation mode according to the present disclosure.

[0040] Note that in the present embodiment, the light source device 3 is separately arranged from the control device 9, but the present disclosure is not limited thereto, and a configuration in which the light source device 3 is provided inside the control device 9 may be adopted.

[0041] One end of the light guide 4 is detachably connected to the light source device 3, and the other end is detachably connected to the insertion unit 2. The light guide 4 transmits the light (normal light and near-infrared excitation light) provided from the light source device 3 from one end to the other end, and supplies the light to the insertion unit 2. When the inside of the living body is irradiated with normal light (white light), the normal light reflected in the living body is converged by the optical system in the insertion unit 2. Note that hereinafter, for convenience of description, the normal light converged by the optical system in the insertion unit 2 is described as the first subject image. In addition, in the case where the inside of the living body is irradiated with near-infrared excitation light, the near-infrared excitation light reflected in the living body and the fluorescence emitted from the fluorescent substance (e.g., indocyanine green) after accumulating in the damaged part of the excited living body are converged by the optical system in the insertion unit 2. Note that hereinafter, for convenience of description, the near-infrared excitation light and the fluorescence converged by the optical system in the insertion unit 2 are described as the second subject image.

[0042] The camera 5 corresponds to the imaging device according to the present disclosure. The camera 5 is detachably connected to the proximal end of the insertion unit 2 (the eyepiece unit 21( Figure 1 ))). Under the control of the control device 9, the camera 5 captures the first subject image (normal light) and the second subject image (near-infrared excitation light and fluorescence) converged by the insertion unit 2, and outputs an image signal (RAW signal) obtained by capturing each image.

[0043] Note that the detailed configuration of the camera 5 will be described later.

[0044] One end of the first transmission cable 6 is detachably connected to the control device 9 via the connector CN1( Figure 1 )), and the other end is detachably connected to the camera 5 via the connector CN2( Figure 1 )). The first transmission cable 6 transmits the image signal etc. output from the camera 5 to the control device 9, and transmits the control signal, synchronization signal, clock, power, etc. output from the control device 9 to the camera 5.

[0045] Note that when transmitting the image signal etc. from the camera 5 to the control device 9 via the first transmission cable 6, the image signal etc. may be transmitted as an optical signal, or may be transmitted as an electrical signal. The same applies to the control signal, synchronization signal, and clock transmitted from the control device 9 to the camera 5 via the first transmission cable 6.

[0046] The display device 7 is composed of a display using liquid crystal, organic electroluminescence (EL), etc., and displays an image based on the video signal from the control device 9 under the control of the control device 9.

[0047] One end of the second transmission cable 8 is detachably connected to the display device 7, and the other end is detachably connected to the control device 9. The second transmission cable 8 transmits the video signal processed by the control device 9 to the display device 7.

[0048] The control device 9 corresponds to the medical image processing device according to the present disclosure. The control device 9 is composed of a central processing unit (CPU), a field programmable gate array (FPGA), etc., and overall controls the operations of the light source device 3, the camera 5, and the display device 7.

[0049] Note that the detailed configuration of the control device 9 will be described later.

[0050] One end of the third transmission cable 10 is detachably connected to the light source device 3, and the other end is detachably connected to the control device 9. The third transmission cable 10 transmits the control signal from the control device 9 to the light source device 3.

[0051] [Configuration of the Camera]

[0052] Next, the configuration of the camera 5 will be described.

[0053] Figure 2 is a block diagram showing the configurations of the camera 5 and the control device 9.

[0054] Note that in Figure 2 , for ease of description, the connectors CN1 and CN2 between the control device 9 and the camera 5, the first transmission cable 6, the connector between the control device 9 and the display device 7, the second transmission cable 8, the connector between the control device 9 and the light source device 3, and the third transmission cable 10 are omitted.

[0055] As Figure 2 shown, the camera 5 includes a lens unit 51, an imaging unit 52, and a communication unit 53.

[0056] The lens unit 51 includes one or more lenses and forms a first subject image (normal light) and a second subject image (near-infrared excitation light and fluorescence) converged by the insertion unit 2 on the imaging surface of the imaging unit 52 (image sensor 522).

[0057] The imaging unit 52 captures an image inside the living body under the control of the control device 9. As Figure 2 shown, the imaging unit 52 includes an excitation light cut-off filter 521, an image sensor 522, and a signal processing unit 523.

[0058] The excitation light cut-off filter 521 is disposed between the lens unit 51 and the image sensor 522, and is constituted by a band-stop filter that removes a specific wavelength band. Note that hereinafter, for the sake of convenience of description, the wavelength band cut off (removed) by the excitation light cut-off filter 521 is described as the cut-off band, the wavelength band located on the short wavelength side of the cut-off band and passing through the excitation light cut-off filter 521 is described as the short wavelength side transmission band, and the wavelength band located on the long wavelength side of the cut-off band and passing through the excitation light cut-off filter 521 is described as the long wavelength side transmission band.

[0059] Here, the cut-off band includes at least a part of the wavelength band of the near-infrared excitation light. In the present embodiment, the cut-off band includes a part of the wavelength band of the near-infrared excitation light. Further, the long wavelength side transmission band includes the wavelength band of the near-infrared excitation light and a part of the wavelength band of the fluorescence. Further, the short wavelength side transmission band includes the wavelength band of the normal light (white light) (first wavelength band).

[0060] That is, the excitation light cut-off filter 521 transmits the first subject image (normal light (white light)) guided from the lens unit 51 to the image sensor 522. On the other hand, the excitation light cut-off filter 521 transmits a part of the near-infrared excitation light and the fluorescence (near-infrared excitation light and fluorescence) of the second subject image guided from the lens unit 51 to the image sensor 522.

[0061] The image sensor 522 is constituted by a charge coupled device (CCD), a complementary metal oxide semiconductor (CMOS), etc., and receives the light that has passed through the excitation light cut-off filter 521 and converts the light into an electric signal (analog signal).

[0062] Here, a color filter 522a ( Figure 2 ) is provided on the imaging surface (light receiving surface) of the image sensor 522, in which three filter groups grouped according to the wavelength band of the light to be transmitted (red (R), green (G), and blue (B)) are arranged in a predetermined format (e.g., Bayer array).

[0063] Specifically, the color filter 522a includes an R filter group that mainly transmits light in the R wavelength band, a B filter group that mainly transmits light in the B wavelength band, and a G filter group that mainly transmits light in the G wavelength band.

[0064] Note that the R, G, and B filter groups also transmit the near-infrared excitation light and the fluorescence. Further, the image sensor 522 is sensitive not only to light in the R, G, and B wavelength bands, but also to light in the near-infrared excitation light and fluorescence wavelength bands.

[0065] Under the control of the control device 9, the image sensor 522 captures a first subject image (normal light) at a predetermined frame rate in the normal observation mode. In addition, under the control of the control device 9, the image sensor 522 captures images at every first period and second period, and the first period and the second period are alternately repeated synchronously with the light emission times of the light source device 3 in the fluorescence observation mode.

[0066] Hereinafter, for convenience of description, the image generated by capturing the first subject image (normal light) by the image sensor 522 is described as a normal light image (corresponding to the first captured image according to the present disclosure). In addition, the image generated by capturing the second subject image (near-infrared excitation light and fluorescence) by the image sensor 522 is described as a fluorescence image (corresponding to the second captured image according to the present disclosure). In addition, the normal light image and the fluorescence image are collectively described as captured images.

[0067] Under the control of the control device 9, the signal processing unit 523 performs signal processing on the captured image (analog signal) generated by the image sensor 522, and outputs a captured image (RAW signal (digital signal)).

[0068] Here, examples of the signal processing performed by the signal processing unit 523 include A / D conversion and thinning processing.

[0069] The thinning processing is a process for setting the total number of pixels of the captured image to a second number of pixels when the total number of pixels of the captured image generated by the image sensor 522 is set to a first number of pixels, and the second number of pixels is equal to or less than 1 / N of the first number of pixels (equal to or less than 2 / N in each of the vertical and horizontal directions), and N is the number of image processing units. That is, for example, through the thinning processing, a captured image having 4K pixels is converted into a captured image having full high definition (HD) or fewer pixels. Note that in the thinning processing, the total number of pixels of the captured image can be set to the second number of pixels by deleting the pixels of the captured image having the first number of pixels at a constant period, or the total number of pixels of the captured image can be set to the second number of pixels by adding adjacent pixels in the captured image having the first number of pixels.

[0070] Figure 3 is a diagram for explaining the captured image output from the imaging unit 52. Specifically, Figure 3 is a diagram schematically showing the physical arrangement of the pixels 522b in the image sensor 522.

[0071] Note that in Figure 3 only some of the pixels 522b among all the pixels in the image sensor 522 are shown for convenience of description.

[0072] The imaging unit 52 outputs the captured images sequentially in units of raster. Specifically, in the image sensor 522, each pixel 522b is arranged in a matrix. As Figure 3 indicated by the arrows and dashed lines in Figure 3 , in each pixel 522b in the first row, the imaging unit 52 sequentially outputs from each pixel 522b an image of one row from the pixel 522b arranged in the first column to the pixel 522b arranged in the last column. Note that

[0073] one arrow shown in Figure 3 indicates an image of one row. Subsequently, in each pixel 522b in the second row, the imaging unit 52 sequentially outputs from each pixel 522b an image of one row from the pixel 522b arranged in the first column to the pixel 522b arranged in the last column. Then, the imaging unit 52 outputs the captured image of one frame by continuing the above processing until the last row. When outputting the captured image of the next frame, the imaging unit 52 returns to each pixel 522b in the first row and performs the same processing as above.

[0074] Note that in the above description, the raster output of the captured image without performing the above refinement processing has been described. However, even when the above refinement processing is performed, the captured image after the refinement processing is sequentially output in units of raster in the order indicated by the arrows and dashed lines in

[0075] [Configuration of the control device]

[0076] Next, the configuration of the control device 9 will be described with reference to Figure 2 .

[0077] As Figure 2 shown, the control device 9 includes a communication unit 91, a memory 92, an observation image generation unit 93, a control unit 94, an input unit 95, an output unit 96, and a storage unit 97.

[0078] The communication unit 91 serves as a receiver, which receives the captured images sequentially in units of raster output from the camera 5 (communication unit 53) via the first transmission cable 6. The communication unit 91 is constituted by, for example, a high-speed serial interface, which communicates the captured images with the communication unit 53 at a transmission rate of 1 Gbps or higher. That is, the communication unit 91 corresponds to the first captured image acquisition unit and the second captured image acquisition unit according to the present disclosure.

[0079] The memory 92 is constituted by, for example, a dynamic random access memory (DRAM) or the like. The memory 92 temporarily stores, in units of raster, the captured images of a plurality of frames sequentially output from the camera 5 (communication unit 53).

[0080] The observation image generation unit 93 processes, in units of raster, the captured images sequentially output from the camera 5 (communication unit 53) and received by the communication unit 91 under the control of the control unit 94. As Figure 2 shown, the observation image generation unit 93 includes a memory controller 931 and first to fourth image processing units 932 to 935.

[0081] The memory controller 931 controls writing an image into the memory 92 and reading an image from the memory 92 under the control of the control unit 94. Note that details of the function of the memory controller 931 will be described in the "operation of the control device" which will be described later.

[0082] The first to fourth image processing units 932 to 935 perform image processing in parallel on each input image under the control of the control unit 94.

[0083] Figure 4 is a block diagram showing the configuration of the first image processing unit 932.

[0084] Note that the configurations of the first to fourth image processing units 932 to 935 are the same. Therefore, only the configuration of the first image processing unit 932 will be described below.

[0085] As Figure 4 shown, the first image processing unit 932 includes a clamping processing unit 932A, a WB processing unit 932B, a digital gain processing unit 932C, a demosaicing processing unit 932D, a color matrix processing unit 932E, a gamma processing unit 932F, a YC processing unit 932G, a first amplification processing unit 932H, an image enhancement processing unit 932I, a second amplification processing unit 932J, and a serial digital interface (SDI) converter 932K.

[0086] Here, the images input to the first to fourth image processing units 932 to 935 (the images corresponding to the captured images (RAW data) output from the camera 5) include, for each pixel, component information (pixel data) of any one of R, G, and B corresponding to the filter groups of R, G, and B that constitute the color filter 522a. Hereinafter, for the sake of convenience of description, the component information of R will be described as an R value, the component information of G will be described as a G value, and the component information of B will be described as a B value.

[0087] The clamping processing unit 932A performs clamping processing for fixing the black level to the input image.

[0088] The WB processing unit 932B performs white balance adjustment processing (WB processing) to multiply each of the r value, g value, and b value in the image after clamping processing by a specific gain.

[0089] The digital gain processing unit 932C performs digital gain processing to multiply the r value, g value, and b value in the image after WB processing by a digital gain to amplify the r value, g value, and b value.

[0090] The demosaicing processing unit 932D performs demosaicing processing to provide pixel values (R (r value), G (g value), B (b value)) of the r value, g value, and b value to the image after digital gain processing by interpolation for each pixel.

[0091] The color matrix processing unit 932E performs color matrix processing for correcting the pixel value (R, G, and B) of each pixel to a pixel value (Rm, Gm, and Bm) by using a color correction matrix on the image after demosaicing processing.

[0092] The gamma processing unit 932F performs gamma processing (γ correction) on the image after color matrix processing.

[0093] The YC processing unit 932G performs YC conversion for converting the image after gamma processing into a luminance signal and a chrominance signal (Y, C B / C R signal).

[0094] The first amplification processing unit 932H performs first amplification processing (electronic zoom) on the image after YC conversion.

[0095] The image enhancement processing unit 932I performs image enhancement processing on the image after the first amplification processing (electronic zoom).

[0096] The second amplification processing unit 932J performs second amplification processing (electronic zoom) on the image after image enhancement processing.

[0097] The SDI converter 932K performs SDI conversion on the image after the second amplification processing (electronic zoom).

[0098] Then, the images from each SDI converter 932K of the first image processing unit 932 to the fourth image processing unit 935 are output to the display device 7 via the second transmission cable 8 as a first video signal or a second video signal described later.

[0099] The control unit 94 is composed of, for example, a CPU, an FPGA, etc., and outputs control signals via the first to third transmission cables 6, 8, and 10, thereby controlling the operations of the light source device 3, the camera 5, and the display device 7, and controlling the overall operation of the control device 9. As Figure 2 shown, the control unit 94 includes a light source control unit 941, an imaging control unit 942, and a mode switching unit 943. Note that the functions of the light source control unit 941, the imaging control unit 942, and the mode switching unit 943 will be described in the "Operation of the Control Device" which will be described later.

[0100] The input unit 95 is composed of an operation device such as a mouse, a keyboard, and a touch panel, and receives a user operation from a user (e.g., a doctor). Then, the input unit 95 outputs an operation signal corresponding to the user operation to the control unit 94.

[0101] The output unit 96 is composed of a speaker, a printer, etc., and outputs various types of information.

[0102] The storage unit 97 stores programs executed by the control unit 94, information required for the processing of the control unit 94, etc.

[0103] [Operation of the Control Device]

[0104] Next, the operation of the above-described control device 9 will be described.

[0105] Figure 5 is a flowchart showing the operation of the control device 9.

[0106] Note that in the following description, it is assumed that the image sensor 522 is an image sensor that generates a captured image having 4K pixel count. In addition, it is assumed that the maximum data amount that the first image processing unit 932 can process is the data amount of an image having HD pixel count. The same applies to the second to fourth image processing units 933 to 935.

[0107] First, the control unit 94 determines whether the current mode of the control device 9 is the normal observation mode (step S1).

[0108] Note that the mode of the control device 9 is switched by the mode switching unit 943. Specifically, the mode switching unit 943 switches the mode of the control device 9 to the normal observation mode or the fluorescence observation mode in response to a user operation by a user (e.g., a doctor) on the input unit 95.

[0109] When it is determined that the mode is the normal observation mode (step S1: YES), the light source control unit 941 drives the first light source 31 (step S2). That is, the inside of the living body is irradiated with normal light (white light).

[0110] After step S2, the imaging control unit 942 causes the image sensor 522 to capture a first subject image (normal light) at a predetermined frame rate (step S3). Then, the imaging unit 52 sequentially outputs normal light images having 4K pixel numbers in units of raster.

[0111] After step S3, the memory controller 931 controls to write an image into the memory 92 and read an image from the memory 92 (step S4).

[0112] Figure 6 and Figure 7 are diagrams for explaining the operation of the memory controller 931 in the normal observation mode. Specifically, Figure 6 is a diagram for explaining writing a normal light image into the memory 92. Figure 7 is a diagram for explaining reading a normal light image from the memory 92. Note that Figure 6 and Figure 7 schematically show a specific bank 921 among a plurality of banks in the memory 92. The bank 921 corresponds to a first storage area according to the present disclosure and has a storage capacity corresponding to the data amount of an image having 4K pixel numbers in the present embodiment. In addition, in Figure 7 , the entire area of the bank 921 is equally divided into four areas in a square grid shape, that is, a first divided area Ar1 to a fourth divided area Ar4. That is, in the present embodiment, the storage capacities of the first divided area Ar1 to the fourth divided area Ar4 all correspond to the data amount of an image having HD pixel numbers.

[0113] Specifically, as shown by the arrows and dotted lines in Figure 6 , the memory controller 931 sequentially writes the normal light images (pixel number: 4K) in units of raster, which are sequentially output from the imaging unit 52 and received row by row by the communication unit 91, into the bank 921. Note that Figure 6 one arrow shown in

[0114] indicates an image of one row in the normal light image (pixel number: 4K). Figure 7 ). In addition, the memory controller 931 reads the images written into each of the first divided area Ar1 to the fourth divided area Ar4 row by row from the first storage position P1 to the fourth storage position P4 substantially at the moment of writing a frame of normal light image (pixel number: 4K) into the fourth storage position P4 ( Figure 7 ), as shown by the arrows and dotted lines in

[0115] Note that the image written to the first divided area Ar1 (hereinafter described as the first divided image) is an image of a rectangular area including the upper left corner position in the normal light image. The pixel data stored in the first storage position P1 is the pixel data of the pixel at the upper left corner position in the first divided image. In addition, the image written to the second divided area Ar2 (hereinafter described as the second divided image) is an image of a rectangular area including the upper right corner position in the normal light image. The pixel data stored in the second storage position P2 is the pixel data of the pixel at the upper left corner position in the second divided image. Furthermore, the image written to the third divided area Ar3 (hereinafter described as the third divided image) is an image of a rectangular area including the lower left corner position in the normal light image. The pixel data stored in the third storage position P3 is the pixel data of the pixel at the upper left corner position in the third divided image. Moreover, the image written to the fourth divided area Ar4 (hereinafter described as the fourth divided image) is an image of a rectangular area including the lower right corner position in the normal light image. The pixel data stored in the fourth storage position P4 is the pixel data of the pixel at the upper left corner position in the fourth divided image.

[0116] Since the above-described first divided image to fourth divided images are images obtained by equally dividing a normal light image having 4K pixel count into four, the first divided image to fourth divided images are images having HD pixel count.

[0117] Then, the read first divided image to fourth divided images (pixel count: HD) are sequentially input row by row to the first image processing unit 932 to the fourth image processing unit 935, respectively. Note that Figure 7 one arrow shown in

[0118] indicates an image of one row in the first divided image to the fourth divided images (pixel count: HD). After step S4, the first image processing unit 932 to the fourth image processing unit 935 perform image processing (step S5) on the input first divided image to fourth divided images (pixel count: HD) in parallel. Here, the first image processing unit 932 to the fourth image processing unit 935 perform first image processing. Note that the first image processing will be described in "First Image Processing and Second Image Processing" which will be described later.

[0119] After step S5, the observation image generation unit 93 outputs a first video signal for displaying a normal light image (pixel count: 4K) to the display device 7 via the second transmission cable 8. The normal light image is obtained by combining the first divided image to the fourth divided images after performing the first image processing (step S6). Therefore, the display device 7 displays the normal light image (pixel count: 4K) based on the first video signal.

[0120] Return to step S1. When it is determined that the current mode is the fluorescence observation mode (step S1: No), the light source control unit 941 performs time-division driving of the first light source 31 and the second light source 32 (step S7). Specifically, in step S7, the light source control unit 941 causes the first light source 31 to emit light in the first period and the second light source 32 to emit light in the second period of the alternately repeated first and second periods based on the synchronization signal.

[0121] After step S7, the imaging control unit 942 causes the imaging unit 52 to capture a first subject image and a second subject image in the first period and the second period, respectively, in synchronization with the light emission timings of the first light source 31 and the second light source 32 based on the synchronization signal (steps S8 to S11). That is, in the case of the first period (step S8: Yes), in other words, when the inside of the living body is irradiated with normal light (white light), the image sensor 522 captures the first subject image (normal light) to generate a normal light image (step S9). On the other hand, in the case of the second period (step S8: No), in other words, when the inside of the living body is irradiated with near-infrared excitation light, the image sensor 522 captures the second subject image (near-infrared excitation light and fluorescence) to generate a fluorescence image (step S10). In addition, the signal processing unit 523 performs thinning processing (step S11). Through the thinning processing, the normal light image and the fluorescence image having 4K pixel numbers are respectively set to the normal light image and the fluorescence image having HD pixel numbers.

[0122] Then, the imaging unit 52 sequentially outputs the normal light image having HD pixel numbers in units of raster, which is obtained by capturing the first subject image in the first period, and sequentially outputs the fluorescence image having HD pixel numbers in units of raster, which is obtained by capturing the second subject image in the second period.

[0123] After step S11, the memory controller 931 controls writing an image to the memory 92 and reading an image from the memory 92 (step S12).

[0124] Figure 8 and Figure 9 are diagrams for explaining the operation of the memory controller 931 in the fluorescence observation mode. Specifically, Figure 8 (a) of is a diagram for explaining writing the normal light image to the memory 92. Figure 8 (b) of is a diagram for explaining writing the fluorescence image to the memory 92. Figure 9 (a) of is a diagram for explaining reading the normal light image from the memory 92. Figure 9 (b) of is a diagram for explaining reading the fluorescence image from the memory 92. Note that Figure 8 and Figure 9Schematically shows specific memory banks 922 and 923 among a plurality of memory banks in memory 92. Memory banks 922 and 923 both have the same storage capacity as memory bank 921 (in this embodiment, the storage capacity corresponds to the data volume of an image having 4K pixel count). In addition, in Figure 8 and Figure 9 , the entire area of memory bank 922 is equally divided into four areas in a square grid shape, namely the fifth divided area Ar5 to the eighth divided area Ar8, and the entire area of memory bank 923 is equally divided into four areas in a square grid shape, namely the ninth divided area Ar9 to the twelfth divided area Ar12. That is, each of the fifth divided area Ar5 to the twelfth divided area Ar12 has the same storage capacity as each of the first divided area Ar1 to the fourth divided area Ar4 (in this embodiment, the storage capacity corresponding to the data volume of an image having HD pixel count). Note that according to the present disclosure, the fifth divided area Ar5 in memory bank 922 corresponds to the second storage area. In addition, according to the present disclosure, the ninth divided area Ar9 in memory bank 923 corresponds to the third storage area.

[0125] Specifically, as shown by the arrows and dashed lines in Figure 8 (a), the memory controller 931 sequentially writes the normal light image (pixel count: HD) in raster units, which is sequentially output from the imaging unit 52 and received row by row by the communication unit 91, into the fifth divided area Ar5 in memory bank 922. Note that Figure 8 one arrow shown in (a) of Figure 8 indicates an image of one row in the normal light image (pixel count: HD). Additionally, as shown by the arrows and dashed lines in Figure 8 (b), after writing a frame of the normal light image (pixel count: HD) into memory bank 922, the memory controller 931 sequentially writes the fluorescence image (pixel count: HD) in raster units, which is sequentially output from the imaging unit 52 and received row by row by the communication unit 91, into the ninth divided area Ar9 in memory bank 923. Note that Figure 8 one arrow shown in (b) of

[0126] indicates an image of one row in the fluorescence image (pixel count: HD).

[0126] In addition, the memory controller 931 sequentially reads row by row the normal light image (pixel count: HD) and the fluorescence image (pixel count: HD) written into the fifth divided area Ar5 and the ninth divided area Ar9 respectively from the fifth storage position P5 and the sixth storage position P6, as shown by the arrows and dashed lines in Figure 9 , substantially simultaneously with the moment of starting to write the fluorescence image (pixel count: HD) from the sixth storage position P6. Note that Figure 9One of the arrows shown in the figure indicates an image of a line in the normal light image (number of pixels: HD) and the fluorescence image (number of pixels: HD). In addition, in Figure 8 and Figure 9 , the arrows at the same time in terms of time have the same thickness. That is, Figure 8 in (b) of Figure 9 in (a) of Figure 9 and (b) of Figure 8 shown have the same thickness, and have a thickness different from that of the arrow shown in (a) of Figure 8 . Here, the pixel data stored in the fifth storage position P5 is the pixel data of the pixel at the upper left corner position in the normal light image (number of pixels: HD). In addition, the pixel data stored in the sixth storage position P6 is the pixel data of the pixel at the upper left corner position in the fluorescence image (number of pixels: HD).

[0127] The read normal light image (number of pixels: HD) and fluorescence image (number of pixels: HD) are sequentially input to the first image processing unit 932 and the second image processing unit 933 line by line, respectively. Note that the third image processing unit 934 and the fourth image processing unit 935 do not perform any processing in the fluorescence observation mode.

[0128] After step S12, the first image processing unit 932 and the second image processing unit 933 perform image processing on the input normal light image (number of pixels: HD) and fluorescence image (number of pixels: HD) in parallel (step S13). Here, the first image processing unit 932 performs first image processing on the input normal light image (number of pixels: HD). On the other hand, the second image processing unit 933 performs second image processing on the input fluorescence image (number of pixels: HD). Note that the first image processing and the second image processing will be described in "First Image Processing and Second Image Processing" to be described later.

[0129] After step S13, the observation image generation unit 93 outputs a second video signal to the display device 7 via the second transmission cable 8 for displaying at least one of the normal light image after performing the first image processing, the fluorescence image after performing the second image processing, and the superimposed image obtained by superimposing the normal light image and the fluorescence image according to the corresponding pixels (step S14). Therefore, the display device 7 displays an image (number of pixels: 4K) based on the second video signal.

[0130] [First Image Processing and Second Image Processing]

[0131] In the first image processing and the second image processing, under the control of the control unit 94, for example, the following operations are performed: clamping processing, WB processing, digital gain processing, demosaicing processing, color matrix processing, gamma processing, YC processing, first amplification processing, and image enhancement processing.

[0132] (1) Clamping processing

[0133] In the first image processing and the second image processing, the same clamping processing is performed.

[0134] (2) WB processing

[0135] In the first image processing and the second image processing, different gains are used in the WB processing.

[0136] Specifically, in the first image processing, in the WB processing, the r value, g value, and b value in any one of the first divided image to the fourth divided image (number of pixels: HD) or the normal light image (number of pixels: HD) after the clamping processing are respectively multiplied by three first gains. The three first gains are the gains for the r value, g value, and b value in the wavelength band of normal white light (white light) for white balance.

[0137] On the other hand, in the second image processing, in the WB processing, the r value, g value, and b value in the fluorescent image (number of pixels: HD) after the clamping processing are respectively multiplied by three second gains. Here, since the sensitivity to fluorescence in the image sensor 522 is substantially the same for R, G, and B, the three second gains have substantially the same value.

[0138] (3) Digital gain processing

[0139] In the first image processing and the second image processing, different digital gains are used in the digital gain processing. That is, in the first image processing, in the digital gain processing, the first digital gain is used. On the other hand, in the second image processing, in the digital gain processing, the second digital gain different from the first digital gain is used.

[0140] Specifically, in the second image processing, in the digital gain processing, since the brightness of the fluorescent image is low, the r value, g value, and b value in the fluorescent image (number of pixels: HD) after the WB processing are multiplied by the digital gain common to all pixels, so that the fluorescent image has the same brightness as the normal light image.

[0141] (4) Demosaicing processing

[0142] In the second image processing, it is not necessary to perform demosaicing processing.

[0143] (5) Color matrix processing

[0144] In the first image processing, color matrix processing is performed.

[0145] On the other hand, in the second image processing, since the fluorescence image has no color, color matrix processing is not performed. Alternatively, in the second image processing, color matrix processing is performed using a color correction matrix that does not correct colors.

[0146] (6) Gamma processing

[0147] In the second image processing, γ correction with a higher contrast than the first image processing is performed.

[0148] (7) YC conversion

[0149] In the second image processing, the chrominance values (Cb value and Cr value) of the luminance signal and chrominance signal after YC conversion are set to 0 (black and white image). Alternatively, in the second image processing, coloring can be performed by adding small chrominance values.

[0150] (8) First magnification processing

[0151] In the first image processing and the second image processing, in the first magnification processing, the same electronic zoom magnification can be used, or different electronic zoom magnifications can be used.

[0152] (9) Image enhancement processing

[0153] In the first image processing and the second image processing, in the image enhancement processing, the intensity of enhancing the image is different. That is, in the first image processing, the first intensity is set as the intensity. On the other hand, in the second image processing, the second intensity different from the first intensity is set as the intensity.

[0154] Here, in the second image processing, since the fluorescence image is dark and contains noise, the intensity of image enhancement (second intensity) may be lower than the intensity of image enhancement in the first image processing (first intensity). In addition, in the second image processing, noise reduction processing can be additionally performed.

[0155] According to the above embodiments, the following effects are obtained.

[0156] In the normal observation mode, the control device 9 according to the present embodiment uses the memory 92 and the first image processing unit 932 to the fourth image processing unit 935 to divide the normal light image (number of pixels: 4K) into the first divided image to the fourth divided image, and performs image processing in parallel. On the other hand, in the fluorescence observation mode, the control device 9 uses the memory 92 and the first image processing unit 932 and the second image processing unit 933 to perform image processing on the normal light image (number of pixels: HD) and the fluorescence image (number of pixels: HD) in parallel.

[0157] That is, there is no need to separately provide a memory and a plurality of image processing units corresponding to the normal light image and the fluorescence image, and the normal observation mode and the fluorescence observation mode can be executed by providing only a single memory 92 and four image processing units 932 to 935.

[0158] Therefore, an image suitable for observation can be generated without increasing the circuit scale.

[0159] (Other embodiments)

[0160] Although the embodiments for implementing the present disclosure have been described so far, the present disclosure should not be limited only by the above embodiments.

[0161] In the above embodiment, the number of image processing units according to the present disclosure is four, but the present disclosure is not limited thereto, and other numbers of image processing units can be provided. For example, in the case of processing a normal light image with a pixel number of 8K in the normal observation mode, if an image processing unit whose maximum processable data amount is the data amount of an HD image is used similarly to the above embodiment, 16 image processing units need to be provided.

[0162] In the above embodiment, in the case where the image sensor 522 is an image sensor that generates an HD captured image, the processing can be performed as follows.

[0163] For example, in the normal observation mode, after step S3, the signal processing unit 523 magnifies the pixel number (pixel number: HD) of the normal light image to 4K under the control of the imaging control unit 942. Then, the memory controller 931 stores the normal light image (pixel number: 4K) in the bank 921. Thereafter, the control device 9 performs processing similar to that in the above embodiment (steps S4 to S6). On the other hand, in the fluorescence observation mode, the control device 9 does not only execute step S11 in steps S7 to S14 described in the above embodiment.

[0164] In the above embodiment, in the fluorescence observation mode, the light in the first wavelength band and the excitation light in the second wavelength band are emitted in a time-division manner, but the present disclosure is not limited thereto. For example, the light in the first wavelength band and the excitation light in the second wavelength band can be emitted simultaneously, the light in the first wavelength band, the excitation light in the second wavelength band, and the fluorescence can be separated by a filter on one side of the captured image, and can be captured by two image sensors respectively.

[0165] In the above-described embodiment, the light in the first wavelength band is white light, and the excitation light in the second wavelength band is near-infrared excitation light. However, the present disclosure is not limited thereto. As the first and second light sources 31 and 32 having the first and second wavelength bands different from each other, other configurations may be adopted as long as the first light source 31 emits light in the first wavelength band and the second light source 32 emits light in the second wavelength band different from the first wavelength band. At this time, the first and second wavelength bands may be partially overlapping or completely non-overlapping wavelength bands. In addition, the first light source 31 may emit narrow-band light.

[0166] Incidentally, photodynamic diagnosis (PDD), which is one of the cancer diagnosis methods for detecting cancer cells, is conventionally known.

[0167] In photodynamic diagnosis, for example, a photosensitizing substance (e.g., 5-aminolevulinic acid) (hereinafter, described as 5-ALA) is used. 5-ALA is a natural amino acid originally contained in the living bodies of animals and plants. After administration in the body, 5-ALA is absorbed into cells and biosynthesized into protoporphyrin in mitochondria. In cancer cells, protoporphyrin accumulates excessively. In addition, the protoporphyrin that accumulates excessively in cancer cells is photoactive. Therefore, when the protoporphyrin is excited by excitation light (e.g., blue visible light in the wavelength band of 375 nm to 445 nm), the protoporphyrin emits fluorescence (e.g., red fluorescence in the wavelength band of 600 nm to 740 nm). As described above, the cancer diagnosis method using a photosensitizing substance to make cancer cells emit fluorescence is called photodynamic diagnosis.

[0168] In the above-described embodiment, the first light source 31 may be composed of an LED that emits white light, and the second light source 32 may be composed of a semiconductor laser that emits excitation light (e.g., blue visible light in the wavelength band of 375 nm to 445 nm) that excites protoporphyrin. Even in such a configuration, the same effects as those of the above-described embodiment can be obtained.

[0169] In the above-described embodiment, the first period and the second period are set to be alternately repeated in the fluorescence observation mode. However, the present disclosure is not limited thereto, and at least one of the first period and the second period may be continuous, and the frequency ratio of the first period and the second period may be a ratio other than 1:1.

[0170] In the above-described embodiment, the medical image processing apparatus according to the present disclosure is installed on the medical observation system 1, where the insertion unit 2 is constituted by a rigid endoscope, but the present disclosure is not limited thereto. For example, the medical image processing apparatus according to the present disclosure may be installed on a medical observation system, where the insertion unit 2 is constituted by a flexible endoscope. Further, the medical image processing apparatus according to the present disclosure may be installed on a medical observation system, such as, for example, a surgical microscope (see, for example, JP 2016-42981A), which magnifies and observes a predetermined field of view in a subject (living body) or on the surface of the subject (living body surface).

[0171] In the above-described embodiment, a part of the configuration of the camera 5 or a part of the configuration of the control device 9 may be provided, for example, in the connector CN1 or the connector CN2.

[0172] List of Reference Numerals

[0173] 1 Medical observation system

[0174] 2 Insertion unit

[0175] 3 Light source device

[0176] 4 Light guide

[0177] 5 Camera

[0178] 6 First transmission cable

[0179] 7 Display device

[0180] 8 Second transmission cable

[0181] 9 Control device

[0182] 10 Third transmission cable

[0183] 21 Eyepiece unit

[0184] 31 First light source

[0185] 32 Second light source

[0186] 51 Lens unit

[0187] 52 Imaging unit

[0188] 53 Communication unit

[0189] 91 Communication unit

[0190] 92 Memory

[0191] 93 Observation image generation unit

[0192] 94 Control unit

[0193] 95 Input Unit

[0194] 96 Output Unit

[0195] 97 Storage Unit

[0196] 521 Excitation Light Cutoff Filter

[0197] 522 Image Sensor

[0198] 522a Color Filter

[0199] 523 Signal Processing Unit

[0200] 921 to 923 Memory Banks

[0201] 931 Memory Controller

[0202] 932 First Image Processing Unit

[0203] 932A Clamping Processing Unit

[0204] 932B WB Processing Unit

[0205] 932C Digital Gain Processing Unit

[0206] 932D Demosaicing Processing Device

[0207] 932E Color Matrix Processing Unit

[0208] 932F Gamma Processing Unit

[0209] 932G YC Processing Unit

[0210] 932H First Amplification Processing Unit

[0211] 932I Image Enhancement Processing Unit

[0212] 932J Second Amplification Processing Unit

[0213] 932K SDI Converter

[0214] 933 Second Image Processing Unit

[0215] 934 Third Image Processing Unit

[0216] 935 Fourth Image Processing Unit

[0217] 941 Light Source Control Unit

[0218] 942 Imaging Control Unit

[0219] 943 Mode Switching Unit

[0220] Ar1 First divided area

[0221] Ar2 Second divided area

[0222] Ar3 Third divided area

[0223] Ar4 Fourth divided area

[0224] Ar5 Fifth divided area

[0225] Ar6 Sixth divided area

[0226] Ar7 Seventh divided area

[0227] Ar8 Eighth divided area

[0228] Ar9 Ninth divided area

[0229] Ar10 Tenth divided area

[0230] Ar11 Eleventh divided area

[0231] Ar12 Twelfth divided area

[0232] CN1, CN2 Connectors

[0233] P1 First storage location

[0234] P2 Second storage location

[0235] P3 Third storage location

[0236] P4 Fourth storage location

[0237] P5 Fifth storage location

[0238] P6 Sixth storage location.

Claims

1. A medical image processing device, comprising: a first captured image acquisition unit that acquires a first captured image obtained by capturing light from an observation target that emits fluorescence when irradiated with excitation light in a second wavelength band different from a first wavelength band, and the observation target is irradiated with light in the first wavelength band; a second captured image acquisition unit that acquires a second captured image obtained by capturing fluorescence from the observation target irradiated with the excitation light; a mode switching unit that switches between a first observation mode and a second observation mode; a memory that temporarily stores images; a memory controller that controls writing the images to the memory and reading the images from the memory; and a plurality of image processing units that perform image processing in parallel on each input image, wherein the memory controller: in the first observation mode, writes the first captured image to a first storage area in the memory; reads a plurality of divided images respectively from a plurality of divided areas in the first storage area, the plurality of divided images being obtained by dividing the first captured image into a number corresponding to the number of the image processing units, writes the plurality of divided images respectively in the plurality of divided areas; and outputs the plurality of divided images respectively to the plurality of image processing units, and in the second observation mode, writes a predetermined captured image to a second storage area and writes the second captured image to a third storage area, the predetermined captured image being obtained by subjecting the first captured image to a thinning process of reducing the number of pixels, and the storage capacity of each of the second storage area and the third storage area is the same as the storage capacity of each of the divided areas in the memory; reads the predetermined captured image from the second storage area and reads the second captured image from the third storage area, and outputs the predetermined captured image and the second captured image respectively to two of the plurality of image processing units.

2. The medical image processing device according to claim 1, wherein the image processing unit performs first image processing when the divided image or the first captured image or the predetermined captured image is input, and performs second image processing different from the first image processing when the second captured image is input.

3. The medical image processing device according to claim 2, wherein the first image processing includes digital gain processing for multiplying a pixel value in the divided image or the first captured image or the predetermined captured image by a first digital gain to amplify the pixel value, and the second image processing includes digital gain processing for multiplying a pixel value in the second captured image by a second digital gain different from the first digital gain to amplify the pixel value.

4. The medical image processing device according to claim 2, wherein the first image processing includes image enhancement processing for enhancing an image with a first intensity for the divided image or the first captured image or the predetermined captured image, and The second image processing includes an image enhancement process for enhancing an image of the second captured image with a second intensity different from the first intensity.

5. The medical image processing apparatus according to claim 4, wherein, the second intensity is lower than the first intensity.

6. The medical image processing apparatus according to claim 1, wherein, in the memory, in the first observation mode, the first captured image having a total number of pixels equal to a first number of pixels is written to the first storage area, and in the second observation mode, when the number of the image processing units is N, the predetermined captured image is written to the second storage area and the refined second captured image is written to the third storage area. In the refinement process, the total number of pixels is set to a second number of pixels equal to or less than 1 / N of the first number of pixels.

7. The medical image processing apparatus according to claim 1, wherein, in the second observation mode, the first captured image acquisition unit and the second captured image acquisition unit alternately acquire the predetermined captured image and the second captured image in a time-division manner, and in the second observation mode, the memory controller alternately writes the predetermined captured image to the second storage area and writes the second captured image to the third storage area in the time-division manner, and at the moment of starting to write one of the predetermined captured image and the second captured image, another image that has been written and the image that has just been written are simultaneously read from the second storage area and the third storage area.

8. A medical observation system, comprising: a light source device that emits light in a first wavelength band and excitation light in a second wavelength band different from the first wavelength band; an imaging device that generates a first captured image and a predetermined captured image by capturing light from an observation target. The predetermined captured image is obtained by subjecting the first captured image to a refinement process of reducing the number of pixels. The observation target emits fluorescence when irradiated with the excitation light and is irradiated with light in the first wavelength band, and generates a second captured image by capturing the fluorescence from the observation target irradiated with the excitation light; and the medical image processing apparatus according to claim 1, which processes the first captured image, the predetermined captured image, and the second captured image.

9. A medical observation system, comprising: a light source device that emits light in a first wavelength band and excitation light in a second wavelength band different from the first wavelength band; an imaging device that generates a first captured image and a predetermined captured image by capturing light from an observation target. The predetermined captured image is obtained by subjecting the first captured image to a refinement process of reducing the number of pixels. The observation target emits fluorescence when irradiated with the excitation light and the observation target is irradiated with light in the first wavelength band, and generates the second captured image by capturing the fluorescence from the observation target irradiated with the excitation light; and The medical image processing apparatus according to claim 2, wherein the medical image processing apparatus processes the first captured image, the predetermined captured image, and the second captured image.

Images