Medical imaging device, medical observation system, and medical image processing device

Abstract

A medical imaging device 5 comprises: a first imaging unit 53a that generates a first captured image by capturing an image of first return light from an observation object; and a second imaging unit 53b that generates a second captured image by capturing an image of second return light from the observation object. When a first mode is set, the first imaging unit 53a transmits the first captured image to a medical image processing device 9 at a specific frame rate via a transmission path. When a second mode is set, the first and second imaging units 53a and 53b reduce the number of pixels of at least one of the first and second captured images so that the combined data amount of the first and second captured images is equal to or less than the transmission capacity of the transmission path, and transmit the first and second captured images to the medical image processing device 9 via the transmission path at a specific frame rate while including the first and second captured images in the same frame.

Description

Medical imaging device, medical observation system, and medical image processing device

[0001] The present disclosure relates to a medical imaging device, a medical observation system, and a medical image processing device.

[0002] Conventionally, a medical observation system that irradiates an observation target (a subject such as a person) with light from a light source device and observes the return light from the observation target is known (see, for example, Patent Document 1). In the medical observation system described in Patent Document 1, visible light such as white light and excitation light, which is narrow-band light, are irradiated from the light source device toward the observation target. That is, in this medical observation system, observation of visible light reflected from the observation target by irradiation of the visible light (hereinafter referred to as normal light observation), and observation of fluorescence emitted from substances contained in the observation target by irradiation of the excitation light (hereinafter referred to as observation target fluorescence) (hereinafter referred to as fluorescence observation) are each possible. According to such fluorescence observation, it is possible to grasp a tissue state that is difficult to recognize through the observation target fluorescence. Therefore, fluorescence observation can be used for various purposes and applications such as identification of a lesion part.

[0003] And, in the medical observation system described in Patent Document 1, it is disclosed that two image sensors are used: an image sensor for imaging visible light and an image sensor for imaging observation target fluorescence

[0004] International Publication No. WO 2021 / 039869

[0005] By the way, in order to reduce the scale of the medical observation system, it is desirable to reduce the amount of data and the transmission path transmitted from the imaging unit (two image sensors) side to the image processing unit side that performs processing at a stage subsequent to the imaging unit side. In the medical observation system described in Patent Document 1, the thinning process reduces the total number of pixels of the captured image generated by the image sensor and reduces the amount of data transmitted from the imaging unit side to the image processing unit side. However, in order to realize high-frame-rate image transmission, the transmission capacity of the transmission path also becomes a constraint, so it is necessary to perform control based on the transmission capacity of the transmission path. Therefore, there is a demand for a technology that can realize high-frame-rate image transmission in a configuration using a plurality of image sensors.

[0006] This disclosure is made in view of the above, and aims to provide a medical imaging device, a medical observation system, and a medical image processing device that can achieve high frame rate image transmission.

[0007] To solve the above-mentioned problems and achieve the objective, the medical imaging device according to this disclosure comprises a first imaging unit that generates a first image by imaging a first return light from an object to be observed based on a first light emitted from a light source device, and a second imaging unit that generates a second image by imaging a second return light having a different wavelength band from the first return light from the object to be observed based on a second light emitted from the light source device, and when set to the first mode, the first imaging unit transmits the first image to an external medical device at a specific frame rate via a transmission path. When the image is transmitted to the medical image processing device and set to the second mode, at least one of the first imaging unit and the second imaging unit reduces the number of pixels in at least one of the first imaging image and the second imaging image so that the total amount of data of the first imaging image and the second imaging image is less than or equal to the transmission capacity of the transmission path, and the first imaging unit and the second imaging unit transmit the first imaging image and the second imaging image together in the same frame at the specified frame rate via the transmission path.

[0008] Furthermore, the medical observation system according to this disclosure comprises a light source device that emits a first light and a second light, respectively; a medical imaging device that images a first reflected light from an observation target based on the first light and a second reflected light from the observation target based on the second light having a different wavelength band than the first reflected light; a medical image device that processes the captured image captured by the medical imaging device; and a transmission path for transmitting the captured image from the medical imaging device to the medical image processing device, wherein the medical imaging device comprises a first imaging unit that captures the first reflected light and generates a first captured image, and a second imaging unit that captures the second reflected light and generates a second captured image, and in a first mode If set to mode A, the first imaging unit transmits the first captured image to the medical image processing device via the transmission path at a specific frame rate. If set to mode B, at least one of the first imaging unit and the second imaging unit reduces the number of pixels in at least one of the first and second captured images so that the combined data amount of the first and second captured images is less than or equal to the transmission capacity of the transmission path, and transmits the first and second captured images together in the same frame to the medical image processing device via the transmission path at the specific frame rate.

[0009] Furthermore, the medical image processing apparatus according to this disclosure is a medical image processing apparatus for processing an image generated by a medical imaging apparatus, wherein the medical imaging apparatus comprises a first imaging unit that generates a first image by imaging a first return light from an object of observation based on a first light emitted from a light source device, and a second imaging unit that generates a second image by imaging a second return light having a different wavelength band from the first return light from the object of observation based on a second light emitted from the light source device, and when set to a first mode, the first imaging unit transmits the first image via a transmission path When the system is set to a second mode, the system transmits the images to the medical image processing device at a specific frame rate, and at least one of the first imaging unit and the second imaging unit reduces the number of pixels in at least one of the first and second imaging images so that the combined data amount of the first and second imaging images is less than or equal to the transmission capacity of the transmission path, and the first and second imaging units transmit the first and second imaging images together in the same frame at the specific frame rate via the transmission path to the medical image processing device.

[0010] The medical imaging device, medical observation system, and medical image processing device described herein enable high-frame-rate image transmission.

[0011] Figure 1 is a diagram illustrating the configuration of a medical observation system according to an embodiment. Figure 2 is a block diagram illustrating the configuration of a camera head and a control device. Figure 3 is a diagram illustrating the first mode. Figure 4 is a diagram illustrating the first mode. Figure 5 is a diagram illustrating the second mode. Figure 6 is a diagram illustrating the second mode. Figure 7 is a diagram illustrating the third mode. Figure 8 is a diagram illustrating the third mode. Figure 9 is a diagram illustrating the fourth mode. Figure 10 is a diagram illustrating the fourth mode. Figure 11 is a diagram illustrating modification 1 of the embodiment. Figure 12 is a diagram illustrating modification 2 of the embodiment. Figure 13 is a diagram illustrating modification 3 of the embodiment. Figure 14 is a diagram illustrating modification 3 of the embodiment.

[0012] The embodiments for implementing this disclosure (hereinafter referred to as "embodiments") will be described below with reference to the drawings. However, the embodiments described below do not limit this disclosure. Furthermore, the same parts are denoted by the same reference numerals in the drawings.

[0013] [Configuration of the Medical Observation System] Figure 1 shows the configuration of the medical observation system 1 according to this embodiment. In this embodiment, the medical observation system 1 is a medical endoscope system that uses an endoscope to observe an object (inside the body). As shown in Figure 1, the medical observation system 1 comprises an insertion unit 2, a light source device 3, a light guide 4, a camera head 5, a first transmission cable 6, a display device 7, a second transmission cable 8, a control device 9, and a third transmission cable 10.

[0014] In this embodiment, the insertion section 2 is made up of a rigid endoscope. That is, the insertion section 2 has an elongated shape that is either entirely rigid or partially flexible with other parts rigid, and is inserted into the object to be observed. Inside the insertion section 2, there is an optical system made up of one or more lenses that collects the reflected light (image of the subject) from the object to be observed.

[0015] Furthermore, an excitation light cut filter 22 (Figure 1) is provided at the base end (eyepiece 21) of the insertion section 2 to partially, substantially, or completely suppress the excitation light (subject image) contained in the reflected light (subject image) from the focused observation target, as described later. Note that the excitation light cut filter 22 is not limited to the insertion section 2, but may also be provided inside the camera head 5.

[0016] One end of the light guide 4 is connected to the light source device 3. The light source device 3 then supplies light to the one end of the light guide 4 under the control of the control device 9. As shown in Figure 1, the light source device 3 comprises a first light source 31, a second light source 32, and a third light source 33.

[0017] The first light source 31 emits first light (broadband light such as white light, or narrowband light such as red light, green light, or blue light) that includes at least a portion of the visible light wavelength band. Examples of the configuration of the first light source 31 include a configuration including a white LED (Light Emitting Diode), or a configuration including three light sources that emit red light, green light, and blue light respectively, and an optical element that combines the red light, green light, and blue light. The first light source 31 may be made of an LED or a semiconductor laser. The number of first light sources 31 may be one or more.

[0018] The second light source 32 emits excitation light that excites the substance contained in the object to be observed. This excitation light corresponds to the second light according to this disclosure. The second light source 32 may be composed of an LED or a semiconductor laser. There may be one or more second light sources 32. Furthermore, the second light source 32 may emit, for example, infrared light or ultraviolet light.

[0019] The third light source 33 emits excitation light that excites the substance contained in the object to be observed. This excitation light corresponds to the third light according to this disclosure. The wavelength bands of the excitation light emitted from the second and third light sources 32 are different from each other. The third light source 33 may be composed of an LED or a semiconductor laser. There may be one or more third light sources 33. Furthermore, the third light source 33 may emit, for example, infrared light or ultraviolet light.

[0020] Examples of substances contained in the object being observed that are excited by the excitation light include drugs or fluorescent dyes applied to the object, or fluorescent substances originating from the object itself.

[0021] Examples of the above-mentioned drugs applied to the subjects of observation include "5-ALA (PP-IX)", "ADS780WS", "ADS830WS", "aggregation-induced emission dots allophycocyanin (APC)", "boron-dipyrromethane (BODIPY)", "CLR 1502", "Flavins", "fluorescamine", "Fluorescein", "fluoro-gold", "green fluorescence protein", "ICG (indocyanine green)", "IRDye 78", "IR-PEG nanoparticles", "Isothiocyanate", "rose bengal", "SGM-101", and "trypan blue".

[0022] Furthermore, the fluorescent dyes mentioned above that can be applied to the object of observation include: "coumarine", "Cy3", "DyLight547", "GE3126", "metal nanoclusters", "oxacarbocyanine", "Rhodamine", "Riboflavin", "fluorescein", "AlexaFluor660", "AlexaFluor680", "AlexaFluor700", "Cy5", "Cy5.5", "Dy677", "Dy682", "Dy752", "DyLight647", "HiLyte Fluor 647", "HiLyte Fluor 680", "IRDye 700DX", "methylene blue", "Porphyrins", "Porphysomes", "VivoTag-680", "VivoTag-S680", "AlexaFluor750", "AlexaFluor790", "carbocyanine", "conjugated copolymers", "CW800-CA", "Cy7", "Cy7.5", "cyanine dyes", "Dy780", and "HiLyte Fluor Examples include "750", "Indocarbocyanine", "IR-786", "IRDye 800CW", "IRDye 800RS", "IRDye 800BK", "Nervelight", "OTL-38 (Pafolacianine)", "Polymethine", "VivoTag-S750", "Xanthene", and "LUM-015".

[0023] Furthermore, examples of fluorescent substances derived from the observed object that constitute the observed object itself include "collagen," "elastin," and "NADH."

[0024] In this embodiment, the light source device 3 is configured separately from the control device 9, but it is not limited to this configuration, and it may also be configured to be housed in the same enclosure as the control device 9.

[0025] One end of the light guide 4 is detachably connected to the light source device 3. The other end of the light guide 4 is detachably connected to the insertion section 2. The light guide 4 transmits light (first light and excitation light) supplied from the light source device 3 from one end to the other and supplies it to the insertion section 2. The light (first light and excitation light) supplied to the insertion section 2 is emitted from the tip of the insertion section 2 and irradiates the object to be observed. When the object to be observed is irradiated with the first light, the first reflected light (reflected light of the first light) from the object to be observed is focused by the optical system in the insertion section 2. When the object to be observed is irradiated with excitation light from the second and third light sources 32 and 33, the second and third reflected light from the excitation light from the object to be observed is focused by the optical system in the insertion section 2. The second reflected light is the reflected light based on the excitation light from the second light source 32. The third reflected light is the reflected light based on the excitation light from the third light source 33. The second and third reflected lights each include not only the excitation light reflected from the object being observed, but also fluorescence emitted from a substance contained in the object when the excitation light irradiates the object and the substance is excited (hereinafter, fluorescence based on the excitation light from the second light source 32 will be referred to as the second object fluorescence, and fluorescence based on the excitation light from the third light source 33 will be referred to as the third object fluorescence). For the sake of explanation, the first to third reflected lights from the object being observed described above may be referred to as reflected light below. The first to third reflected lights each have different wavelength bands. Also, the first and third reflected lights have a portion of their wavelength bands overlapping.

[0026] The camera head 5 corresponds to the medical imaging device according to this disclosure. This camera head 5 is detachably connected to the eyepiece 21 of the insertion section 2. The camera head 5 then generates a pixel signal by imaging the reflected light focused by the insertion section 2 under the control of the control device 9. For the sake of explanation, this pixel signal may be referred to as the captured image below. The detailed configuration of the camera head 5 will be described in "Camera Head Configuration" below.

[0027] The first transmission cable 6 corresponds to the transmission path described herein. One end of the first transmission cable 6 is detachably connected to the control device 9 via connector CN1 (Figure 1). The other end of the first transmission cable 6 is detachably connected to the camera head 5 via connector CN2 (Figure 1). The first transmission cable 6 transmits captured images and the like output from the camera head 5 to the control device 9, and also transmits control signals, synchronization signals, clock signals, and power signals output from the control device 9 to the camera head 5, respectively.

[0028] Furthermore, the captured images and other data transmitted from the camera head 5 to the control device 9 via the first transmission cable 6 may be transmitted as optical signals or as electrical signals. The same applies to the transmission of control signals, synchronization signals, and clock signals from the control device 9 to the camera head 5 via the first transmission cable 6.

[0029] The display device 7 is composed of a display using liquid crystal or organic EL (Electro Luminescence), and under the control of the control device 9, it displays an image based on a video signal from the control device 9.

[0030] One end of the second transmission cable 8 is detachably connected to the display device 7. The other end of the second transmission cable 8 is detachably connected to the control device 9. The second transmission cable 8 transmits the video signal processed by the control device 9 to the display device 7.

[0031] The control device 9 corresponds to the medical image processing device described herein. This control device 9 is composed of a CPU (Central Processing Unit), FPGA (Field-Programmable Gate Array), or GPU (Graphics Processing Unit), and comprehensively controls the operation of the light source device 3, camera head 5, and display device 7. The detailed configuration of the control device 9 will be described later in "Configuration of the Control Device".

[0032] One end of the third transmission cable 10 is detachably connected to the light source device 3. The other end of the third transmission cable 10 is detachably connected to the control device 9. The third transmission cable 10 transmits control signals from the control device 9 to the light source device 3.

[0033] [Camera Head Configuration] Next, the configuration of the camera head 5 will be described. Figure 2 is a block diagram showing the configuration of the camera head 5 and the control device 9. As shown in Figure 2, the camera head 5 comprises a lens unit 51, a prism 52, and an imaging unit 53.

[0034] The lens unit 51 is composed of one or more lenses. The lens unit 51 focuses light at the insertion section 2, and the reflected light (subject image) via the excitation light cut filter 22 is imaged onto the imaging surfaces of the first and second image sensors 531 and 532, respectively.

[0035] The prism 52 separates the reflected light (subject image) via the excitation light cut filter 22 and the lens unit 51 into light of two different wavelength bands: first and second. The light of the first wavelength band is light of a wavelength band excluding at least a portion of the wavelength band of the second target fluorescence, and includes at least a portion of the visible light wavelength band and a portion of the wavelength band of the third target fluorescence. The light of the second wavelength band is light of a wavelength band excluding at least a portion of the visible light wavelength band, and includes at least a portion of the wavelength band of the second target fluorescence. In other words, the prism 52 separates the light containing the first reflected light via the excitation light cut filter 22 (hereinafter referred to as the first subject image), the light containing the third reflected light (third target fluorescence) via the excitation light cut filter 22 (hereinafter referred to as the third subject image), and the light containing the second reflected light (second target fluorescence) via the excitation light cut filter 22 (hereinafter referred to as the second subject image). The prism 52 then moves the first and third subject images toward the first image sensor 531. The prism 52 also moves the second subject image toward the second image sensor 532.

[0036] The imaging unit 53 captures an image of the object under the control of the control device 9. As shown in Figure 2, the imaging unit 53 includes a first image sensor 531, a second image sensor 532, and a transmission and communication unit 533. In this embodiment, two image sensors, the first and second image sensors 531 and 532, are used, but the number of image sensors is not limited to two; it may be three or more.

[0037] The first and second image sensors 531 and 532 receive the subject image and convert it into an electrical signal (analog signal). In this embodiment, the first and second image sensors 531 and 532 are each composed of CMOS (Complementary Metal Oxide Semiconductor) rolling shutter image sensors in which multiple pixels are arranged in a two-dimensional manner in units of horizontal lines. Note that the first and second image sensors 531 and 532 are not limited to CMOS, but may also be composed of CCD (Charge Coupled Device) sensors.

[0038] Here, the first image sensor 531, although not shown in detail in the illustration, is composed of an invalid region where the output signal is not used to generate the captured image, an optical black region (OB region), and an effective pixel region where the first and third subject images formed by the lens unit 51 are converted into pixel signals and output. Similarly, the second image sensor 532 is composed of an invalid region, an optical black region (OB region), and an effective pixel region.

[0039] The first image sensor 531 then captures the first and third subject images via the prism 52 under the control of the control device 9. That is, the first image sensor 531 captures light that includes at least a portion of the visible light wavelength band and light that includes at least a portion of the wavelength band of the third observed fluorescence. For the sake of explanation, the image generated by capturing the first subject image with the first image sensor 531 will be referred to as the normal light image. The image generated by capturing the third subject image with the first image sensor 531 will be referred to as the third fluorescence image. The normal light image corresponds to the first image according to this disclosure. The third fluorescence image corresponds to the third image according to this disclosure.

[0040] Furthermore, the second image sensor 532, under the control of the control device 9, captures a second subject image via the prism 52. That is, the second image sensor 532 captures light that includes at least a portion of the wavelength band of the second fluorescence to be observed. For the sake of explanation, the image generated by capturing the second subject image with the second image sensor 532 will be referred to as the second fluorescence image. This second fluorescence image corresponds to the second image image according to this disclosure.

[0041] In this embodiment, the maximum number of pixels in the captured image that can be generated by the first image sensor 531 and the second image sensor 532 are different. Specifically, the first image sensor 531 is capable of generating captured images (normal light images and third fluorescence images) with a maximum of UHD (Ultra-High Definition) pixels. The second image sensor 532 is capable of generating captured images (second fluorescence images) with a maximum of Full HD (High Definition) pixels.

[0042] Furthermore, the first and second image sensors 531 and 532 perform pixel addition processing to reduce the number of pixels in the generated image under the control of the control device 9. In this embodiment, the first image sensor 531 is capable of performing pixel addition processing as shown below, for example. For example, the first image sensor 531 performs pixel addition processing to change the total number of pixels in an image to the number of pixels of Full HD by adding adjacent pixels in an image where the total number of pixels is UHD. Alternatively, for example, the first image sensor 531 performs pixel addition processing to change only the number of pixels in the vertical direction of an image to half the number of pixels by adding adjacent pixels in an image where the total number of pixels is UHD.

[0043] The transmission and communication unit 533 performs signal processing on the captured images (analog signals) generated by the first and second image capture elements 531 and 532 under the control of the control device 9, and outputs the captured images (digital signals). Examples of the signal processing performed by the transmission and communication unit 533 include the following signal processing. For example, the transmission and communication unit 533 performs processing to remove reset noise, multiplies the analog gain for amplifying the analog signal, and performs signal processing such as A / D conversion on the captured images (analog signals) generated by the first and second image capture elements 531 and 532

[0044] Further, the transmission and communication unit 533 can execute a decimation process of reducing the total number of pixels of the captured image by deleting the pixels of the captured images generated by the first and second image capture elements 531 and 532 at a constant period

[0045] Then, the transmission and communication unit 533 functions as a transmitter that transmits the captured image on which the above-described signal processing has been performed to the control device 9 via the first transmission cable 6. This transmission and communication unit 533 is configured, for example, by a high-speed serial interface that communicates the captured image at a transmission rate of 1 Gbps or more with the control device 9 via the first transmission cable

[0046] The first image capture element 531 and the transmission and communication unit 533 described above correspond to the first image capture unit 53a (FIG. See also the second image capture element 532 and the transmission and communication unit 533, which correspond to the second image capture unit 53b (FIG

[0047] [Configuration of Control Device] Next, the configuration of the control device 9 will be described with reference to FIG. As shown in FIG. 2, the control device 9 includes a communication unit 91, an image memory 92, a processing module 93, a control unit 94, an input unit 95, an output unit 96, and a storage unit 97

[0048] The communication unit 91 functions as a receiver that sequentially receives the captured images transmitted from the camera head As shown in FIG. 2, the control device 9 includes a communication unit 91, an image memory 92, a processing module 93, a control unit 94, an input unit 95, an output unit 96, and a storage unit 97. This communication unit 91 is configured, for example, by a high-speed serial interface that communicates the captured image at a transmission rate of more than 1 Gbps with the transmission and communication unit 533

[0049] The image memory 92 is composed of, for example, a DRAM (Dynamic Random Access Memory) or the like. This image memory 92 can temporarily store a plurality of frames of captured images sequentially output from the camera head 5 (transmission communication unit 533).

[0050] The processing module 93 corresponds to the medical image processing apparatus according to the present disclosure. This processing module 93 processes the captured images sequentially transmitted from the camera head 5 (transmission communication unit 533) and received by the communication unit 91 under the control of the control unit 94. As shown in FIG. 2, this processing module 93 includes a memory controller 931, an image processing unit 932, and a display control unit 933.

[0051] The memory controller 931 controls the writing of the captured image into the image memory 92 and the reading of the captured image from the image memory 92. The captured image read by the memory controller 931 is input to the image processing unit 932.

[0052] The image processing unit 932 executes image processing on the input captured image. Examples of such image processing include optical black subtraction processing (clamp processing), white balance adjustment processing, demosaic processing, color correction matrix processing, gamma correction processing, YC processing for converting RGB signals into luminance chrominance signals (Y, Cb / Cr signals), digital gain adjustment by multiplying digital gain, noise removal, filter processing for enhancing structure, and the like.

[0053] Note that the image processing performed on the normal light image and the image processing performed on the second and third fluorescence images may be different from each other, or may be the same image processing. Also, in the present embodiment, although specific illustration is omitted, the image processing unit 932 divides the captured image stored in the image memory 92 into four regions: the upper left region, the upper right region, the lower left region, and the lower right region, and includes four image processing units that perform image processing on the divided images for each region.

[0054] The display control unit 933 generates a video signal for displaying the captured image after image processing has been performed by the image processing unit 932, under the control of the control unit 94. The display control unit 933 then outputs the video signal to the display device 7 via the second transmission cable 8.

[0055] The control unit 94 is implemented by a controller such as a CPU or MPU (Micro Processing Unit) executing various programs stored in the memory unit 97. It controls the operation of the light source device 3, the camera head 5, and the display device 7, as well as the operation of the entire control device 9. The control unit 94 is not limited to a CPU or MPU; it may also be composed of integrated circuits such as an ASIC (Application Specific Integrated Circuit) or FPGA. The functions of the control unit 94 will be explained later in the section "Operation of the Medical Observation System".

[0056] The input unit 95 is configured using operating devices such as a mouse, keyboard, and touch panel, and accepts user operations from a user such as a surgeon. The input unit 95 then outputs an operation signal corresponding to the user operation to the control unit 94.

[0057] The output unit 96 is configured using a speaker, printer, etc., and outputs various types of information.

[0058] The memory unit 97 stores programs executed by the control unit 94, information necessary for processing by the control unit 94, and so on.

[0059] [Operation of the Medical Observation System] Next, the operation of the medical observation system 1 described above will be explained. The medical observation system 1 is set to one of four modes, for example, in response to user operations on the input unit 95 by the user. The medical observation system 1 then performs different operations according to the first to fourth modes. The fourth mode, like the second mode, corresponds to the second mode in this disclosure. The operations corresponding to the first to fourth modes will be explained in order below.

[0060] [Operation according to the first mode] Figures 3 and 4 illustrate the first mode. Specifically, Figure 3 illustrates the operation of the first image sensor 531 in the first mode. Figure 3(b) shows the period of the frame (field) of the generated image. Figure 3(c) shows the horizontal line of the first image sensor 531 on the vertical axis (the top row shows the uppermost horizontal line (the first horizontal line), and the bottom row shows the lowermost horizontal line (the final line)), and time on the horizontal axis. The parallelogram region is the region that contributes to the generation of the normal light image F1a in one field. Figure 3(a) shows the normal light image F1a generated by the first image sensor 531. Figure 4 also illustrates the operation of the transmission communication unit 533 in the first mode. Figure 4(b) shows the period of the frame (field), similar to Figure 3(b). Figure 4(a) shows a normal optical image F1a transmitted from the transmission communication unit 533 to the communication unit 91 via the first transmission cable 6.

[0061] When set to the first mode, the control unit 94 does not operate the second image sensor 532. Meanwhile, the first image sensor 531, under the control of the control unit 94, captures a first subject image based on the first light emitted from the first light source 31, and generates one normal light image F1a for each frame (field), as shown in Figure 3. Here, the first image sensor 531 does not perform pixel addition processing. Therefore, the first image sensor 531 generates a normal light image F1a with the number of UHD pixels (Figure 3(a)). In Figure 3(a), for the sake of explanation, the word "UHD" is added to the normal light image F1a with the number of UHD pixels. The same applies to Figure 4(a).

[0062] Furthermore, when set to the first mode, the transmission communication unit 533, under the control of the control unit 94, sequentially transmits one normal optical image F1a, which is the number of pixels in the UHD, to the communication unit 91 via the first transmission cable 6, as shown in Figure 4, for each frame (field). The transmission capacity (maximum amount of data that can be transmitted) of the first transmission cable 6 is approximately the same as the amount of data of the captured image, which is the number of pixels in the UHD.

[0063] [Operation according to the second mode] Figures 5 and 6 illustrate the second mode. Specifically, Figures 5 and 6 illustrate the operation of the imaging unit 53 in the second mode. Figure 5(c) corresponds to Figure 3(b). Figure 5(d) corresponds to Figure 3(c). Figure 5(a) corresponds to Figure 3(a). Figure 5(e), similar to Figure 5(d), shows the horizontal line of the second image sensor 532 on the vertical axis (the top row shows the uppermost horizontal line (the first horizontal line), and the bottom row shows the lowermost horizontal line (the final line)), and time on the horizontal axis. The parallelogram region is the region that contributes to the generation of the second fluorescence image F2 in one field. Figure 5(b) shows the second fluorescence image F2 generated by the second image sensor 532. Figure 6 also illustrates the operation of the transmission communication unit 533 in the second mode. Figure 6(b) corresponds to Figure 4(b). Figure 6(a) corresponds to Figure 4(a) and shows the normal optical image F1a and the second fluorescence image F2 transmitted from the transmission communication unit 533 to the communication unit 91 via the first transmission cable 6.

[0064] When set to the second mode, the first image sensor 531, under the control of the control unit 94, captures a first subject image based on the first light emitted from the first light source 31, and generates one normal light image F1a for each frame (field), as shown in Figure 5. Here, the first image sensor 531 performs pixel addition processing and adds adjacent pixels in the normal light image F1a, which has a total number of UHD pixels, thereby reducing the number of pixels in both the vertical and horizontal directions and changing the total number of pixels in the normal light image F1a to the number of Full HD pixels. For this reason, the first image sensor 531 generates a normal light image F1a with a Full HD number of pixels (Figure 5(a)). Note that in Figure 5(a), for the sake of explanation, the letters "HD" are added to the normal light image F1a with a Full HD number of pixels. The same applies to Figure 6(a).

[0065] Furthermore, when set to the second mode, the second image sensor 532 captures a second subject image based on the excitation light emitted from the second light source 32, and under the control of the control unit 94, generates one second fluorescence image F2 for each frame (field), as shown in Figure 5. Here, the second image sensor 532 does not perform pixel addition processing. For this reason, the second image sensor 532 generates a second fluorescence image F2 with the number of pixels of Full HD (Figure 5(b)). Note that in Figure 5(b), for the sake of explanation, the word "HD" is added to the second fluorescence image F2 with the number of pixels of Full HD. The same applies to Figure 6(a).

[0066] In Figure 5, the exposure timing (readout timing) of each frame (field) in the first and second image sensors 531 and 532 are staggered, but this is not limited to this; they may be the same. Also, in Figure 5, the readout speeds of the first and second image sensors 531 and 532 are the same, but they may be different.

[0067] Furthermore, when set to the second mode, the transmission communication unit 533, under the control of the control unit 94, transmits to the communication unit 91 sequentially, frame by frame (field by field), via the first transmission cable 6, as shown in Figure 6, one normal light image F1a with the pixel count of Full HD and one second fluorescence image F2 with the pixel count of Full HD, in the same frame. In Figure 6, when one frame is divided into four regions: the upper left region, the upper right region, the lower left region, and the lower right region, the normal light image F1a is placed in the upper left region and the second fluorescence image F2 is placed in the upper right region. As mentioned above, the transmission capacity of the first transmission cable 6 is the data amount of the captured image with the pixel count of UHD, which is greater than the sum of the data amount of one normal light image F1a with the pixel count of Full HD and one second fluorescence image F2 with the pixel count of Full HD.

[0068] [Operation according to the third mode] Figures 7 and 8 are diagrams illustrating the third mode. Specifically, Figures 7(a) to 7(c) correspond to Figures 3(a) to 3(c), respectively. Figures 8(a) and 8(b) correspond to Figures 4(a) and 4(b), respectively.

[0069] When set to the third mode, the control unit 94 does not operate the second image sensor 532. Meanwhile, the first image sensor 531, under the control of the control unit 94, alternately captures a first subject image based on the first light emitted alternately by the time-division driving of the first and third light sources 31 and 33, and a third subject image based on the excitation light, in a time-division manner. As a result, the first image sensor 531 alternately generates one normal light image F1a and one third fluorescence image F1b for each frame (field), as shown in Figure 7. Here, the first image sensor 531 performs pixel addition processing and adds adjacent pixels in the normal light image F1a, which has a total number of pixels equal to UHD pixels, thereby reducing the number of pixels in both the vertical and horizontal directions and changing the total number of pixels in the normal light image F1a to the number of pixels equal to Full HD pixels. Similarly, the first image sensor 531 performs pixel addition processing and adds adjacent pixels in the third fluorescence image F1b, which has a total number of UHD pixels, thereby reducing the number of pixels in both the vertical and horizontal directions and changing the total number of pixels in the third fluorescence image F1b to a full HD number of pixels. For this reason, the first image sensor 531 generates a normal light image F1a with a full HD number of pixels and a third fluorescence image F1b with a full HD number of pixels (Figure 7(a)). In Figure 7(a), for the sake of explanation, the letters "HD" are added to the normal light image F1a and the third fluorescence image F1b, which have a full HD number of pixels. The same applies to Figure 8(a).

[0070] Furthermore, when set to the third mode, the transmission communication unit 533, under the control of the control unit 94, alternately transmits to the communication unit 91, via the first transmission cable 6, one normal light image F1a with the number of pixels of full HD and a third fluorescence image F1b with the number of pixels of full HD, for each frame (field), as shown in Figure 8.

[0071] In the above example, the first image sensor 531 performed pixel addition processing when set to the third mode, but this is not limited to this. The first image sensor 531 does not have to perform pixel addition processing. In this case, the transmission communication unit 533 alternately transmits to the communication unit 91, via the first transmission cable 6, one normal light image F1a with the number of UHD pixels and a third fluorescence image F1b with the number of UHD pixels, for each frame (field).

[0072] [Operation according to the fourth mode] Figures 9 and 10 are diagrams illustrating the fourth mode. Specifically, they correspond to Figures 9(a) to 9(e) and Figures 5(a) to 5(e), respectively. Figures 10(a) and 10(b) correspond to Figures 6(a) and 6(b), respectively.

[0073] When set to the fourth mode, the first image sensor 531, under the control of the control unit 94, captures a first subject image based on the first light emitted from the first light source 31, and generates one normal light image F1a for each frame (field), as shown in Figure 9. Here, the first image sensor 531 performs a pixel addition process and adds adjacent pixels in the normal light image F1a, where the total number of pixels is the number of UHD pixels, thereby changing only the number of pixels in the vertical direction of the normal light image F1a to half the number of pixels. For this reason, the first image sensor 531 generates a normal light image F1a in which only the number of pixels in the vertical direction has been changed to half the number of UHD pixels (Figure 9(a)). Hereafter, for the sake of explanation, the number of pixels in which only the number of pixels in the vertical direction has been changed to half the number of UHD pixels will be referred to as the number of "H-UHD" pixels. In Figure 9(a), for the sake of explanation, the words "H-UHD" are added to the normal light image F1a, which has the number of pixels of H-UHD. The same applies to Figure 10(a).

[0074] Furthermore, when set to the fourth mode, the second image sensor 532 captures a second subject image based on the excitation light emitted from the second light source 32, and under the control of the control unit 94, generates one second fluorescence image F2 for each frame (field), as shown in Figure 9. Here, the second image sensor 532 does not perform pixel addition processing. For this reason, the second image sensor 532 generates a second fluorescence image F2 with the number of pixels of Full HD (Figure 9(b)). Note that in Figure 9(b), for the sake of explanation, the word "HD" is added to the second fluorescence image F2 with the number of pixels of Full HD. The same applies to Figure 10(a).

[0075] Furthermore, when set to the fourth mode, the transmission communication unit 533, under the control of the control unit 94, transmits to the communication unit 91 sequentially, frame by frame (field by field), via the first transmission cable 6, as shown in Figure 10, one normal light image F1a with the pixel count of H-UHD and one second fluorescence image F2 with the pixel count of Full HD, in the same frame. In Figure 10, when one frame is divided into four regions: the upper left region, the upper right region, the lower left region, and the lower right region, the normal light image F1a is placed across the upper left region and the upper right region, and the second fluorescence image F2 is placed in the lower right region. As mentioned above, the transmission capacity of the first transmission cable 6 is the data amount of the captured image with the pixel count of UHD, which is greater than the sum of the data amount of one normal light image F1a with the pixel count of H-UHD and one second fluorescence image F2 with the pixel count of Full HD.

[0076] As described above, in this embodiment, when set to the first mode, the first imaging unit 53a transmits the normal light image F1a to the control device 9 at a specific frame rate via the first transmission cable 6. On the other hand, when set to the second or fourth mode, the first imaging unit 53a reduces the number of pixels in the normal light image F1a so that the combined data amount of the normal light image F1a and the second fluorescence image F2 is less than or equal to the transmission capacity of the first transmission cable 6, and transmits the normal light image F1a and the second fluorescence image F2 in the same frame to the control device 9 at a specific frame rate via the first transmission cable 6.

[0077] In this embodiment, when set to the second mode, the first imaging unit 53a of the first and second imaging units 53a and 53b reduced the number of pixels in the normal light image F1a by pixel addition processing, but this is not limited to this. At least one of the first and second imaging units 53a and 53b may reduce the number of pixels in at least one of the captured images, the normal light image F1a and the second fluorescence image F2, by pixel addition processing. Furthermore, the number of pixels in at least one of the captured images, the normal light image F1a and the second fluorescence image F2, may be reduced not only by pixel addition processing but also by decimation processing by the transmission and communication unit 533.

[0078] Furthermore, in this embodiment, the medical observation system 1 was configured to be configurable to first to fourth modes, but it is not limited to this, and it is sufficient if it is configured to be configurable to at least first and second modes. For example, the third mode may be omitted. In this case, it is not necessary to provide the third light source 33.

[0079] The embodiment described above provides the following effects. In the camera head 5 according to this embodiment, when set to the second or fourth mode, the first imaging unit 53a reduces the number of pixels in the normal light image F1a so that the combined data amount of the normal light image F1a and the second fluorescence image F2 is less than or equal to the transmission capacity of the first transmission cable 6, and transmits the normal light image F1a and the second fluorescence image F2 in the same frame to the control device 9 via the first transmission cable 6 at a specific frame rate. Therefore, with the camera head 5 according to this embodiment, by performing control based on the transmission capacity of the first transmission cable 6, it is possible to achieve high frame rate image transmission in a configuration using multiple image sensors such as the first and second image sensors 531 and 532.

[0080] Furthermore, when the first imaging unit 53a is set to the second mode, it reduces the number of pixels in both the vertical and horizontal directions of the normal light image F1a. This effectively reduces the amount of data in the normal light image F1a.

[0081] Furthermore, when the first imaging unit 53a is set to the fourth mode, it reduces only the number of pixels in the vertical direction in the normal light image F1a. This makes it possible to reduce the amount of data while maintaining the high resolution of the normal light image F1a as much as possible.

[0082] Furthermore, when the first imaging unit 53a is set to the third mode, it alternately generates and transmits one normal light image F1a and one third fluorescence image F1b for each frame (field). Therefore, fluorescence observation can be performed using only the first imaging unit 53a, depending on the wavelength band of the third reflected light.

[0083] (Other Embodiments) Up to this point, we have described embodiments for implementing this disclosure, but this disclosure should not be limited to the embodiments described above. In the embodiments described above, the following modifications 1 to 3 may also be adopted.

[0084] (Modification 1) The medical observation system according to Modification 1 is a medical observation system that uses a so-called videoscope (flexible endoscope) having an imaging unit on the tip side of the insertion part. For the sake of explanation, the medical observation system 1 according to Modification 1 will be referred to as medical observation system 1B below.

[0085] Figure 11 shows a modified example of the embodiment. As shown in Figure 11, the medical observation system 1B includes an endoscope 300B that captures images of the internal organs of an observation site by inserting an insertion part 2B into the body and outputs the captured images, a light source device 3 that emits first light and excitation light from the tip of the endoscope 300B, a control device 9 that processes the captured images output from the endoscope 300B, and a display device 7 that is connected to the control device 9 via a second transmission cable 8 and displays an image based on the video signal processed by the control device 9.

[0086] As shown in Figure 11, the endoscope 300B comprises an insertion section 2B having a flexible, elongated shape, an operating section 301 connected to the base end of the insertion section 2B and receiving various operations, and a universal cord 302 extending from the operating section 301 in a direction different from the direction in which the insertion section 2B extends, and containing various cables connected to the light source device 3 and the control device 9. As shown in Figure 12, the insertion section 2B comprises a tip section 24, a flexible bending section 25 connected to the base end of the tip section 24 and composed of a plurality of bending pieces, and a flexible, elongated flexible tube section 26 connected to the base end of the bending section 25.

[0087] The tip section 24 incorporates a configuration substantially similar to that of the camera head 5 described in the above-described embodiment, although a specific illustration is omitted. The captured image captured by the tip section 24 is output to the control device 9 via the operation unit 301 and the universal code 302.

[0088] Even when adopting the configuration of the modified example 1 described above, the same effects as those of the embodiment described above are achieved.

[0089] (Modification 2) The medical observation system according to Modification 2 is a medical observation system that uses a surgical microscope to magnify and image a predetermined field of view of the inside (in vivo) or surface (biological surface) of the subject being observed. For the sake of explanation, the medical observation system 1 according to Modification 3 will be referred to as medical observation system 1C below.

[0090] Figure 12 shows a modified example of the embodiment. As shown in Figure 12, the medical observation system 1C includes a surgical microscope 12 that captures images for observing a subject and outputs the captured images, a control device 9 that processes the captured images output from the surgical microscope 12, and a display device 7 that is connected to the control device 9 via a second transmission cable 8 and displays an image based on the video signal processed by the control device 9.

[0091] As shown in Figure 12, the surgical microscope 12 comprises a microscope unit 121 that magnifies and images minute parts of a subject and outputs the captured image, a support unit 122 connected to the base end of the microscope unit 121 and including an arm that rotatably supports the microscope unit 121, and a base unit 123 that rotatably holds the base end of the support unit 122 and is movable on the floor. The control device 9 is installed on the base unit 123 as shown in Figure 12. Although not specifically shown in the illustration, a light source device 3 that emits first light and excitation light from the surgical microscope 12 to the object being observed is also installed on the base unit 123. Note that the base unit 123 may be fixed to the ceiling or wall to support the support unit 122, rather than being movably installed on the floor.

[0092] The microscope unit 121 incorporates a configuration substantially similar to that of the camera head 5 described in the above-described embodiment, although specific illustrations are omitted. The image captured by the microscope unit 121 is output to the control device 9 via the first transmission cable 6, which is routed along the support unit 122.

[0093] Even when adopting the configuration of the modified example 2 described above, the same effects as those of the embodiment described above are achieved.

[0094] (Modification 3) Figures 13 and 14 illustrate modification 3 of the embodiment. Specifically, Figure 13 is a side view of the ring light 15. Figure 14 is a front view of the ring light 15 (left side in Figure 13). In this modification 3, in addition to the insertion part 2 described in the above embodiment, the ring light 15 shown in Figures 13 and 14 is detachably connected to the camera head 5. That is, depending on the user's usage, the camera head 5 may be connected to either the insertion part 2 or the ring light 15, as shown in Figure 13.

[0095] Unlike the insertion unit 2, the ring light 15 is not inserted into the object being observed. Instead, it supplies first light and excitation light to the surgical unit and captures second light (subject image), which is the reflected light of the first light and excitation light from the surgical unit. As shown in Figures 13 and 14, the ring light 15 comprises an illumination unit 151 and a subject image capture unit 152 for capturing the subject image.

[0096] As shown in Figures 13 and 14, the illumination unit 151 comprises a housing 1511 and a plurality of illumination lenses 1512. The housing 1511 has an annular shape centered on the optical axis Ax. The other end of the light guide 4 is detachably connected to the housing 1511.

[0097] As shown in Figure 14, the multiple illumination lenses 1512 are arranged at predetermined intervals along the circumferential direction centered on the optical axis Ax on the front end face of the housing 1511. The multiple illumination lenses 1512 each irradiate the surgical area with the first light supplied from the light source device 3 and introduced into the housing 1511 via the light guide 4.

[0098] The subject image acquisition section 152 extends along the optical axis Ax. Within the subject image acquisition section 152, there is an optical system composed of one or more lenses that focuses the second light (subject image) illuminated from multiple illumination lenses 1512 and transmitted through the surgical section. Furthermore, a connection section 1521 is provided at the base end (right side in Figure 13) of the subject image acquisition section 152. This connection section 1521 is designed (shaped) to be compatible with the eyepiece section 21 in the insertion section 2 and is detachably connected to the camera head 5.

[0099] Even when adopting the configuration of the modified example 3 described above, the same effects as those of the embodiment described above are achieved.

[0100] Furthermore, the following configurations also fall within the technical scope of this disclosure. (1) A medical control device comprising: a first imaging unit that generates a first image by imaging a first reflected light from an object to be observed based on a first light emitted from a light source device; and a second imaging unit that generates a second image by imaging a second reflected light having a different wavelength band from the first reflected light from the object to be observed based on a second light emitted from the light source device, wherein when set to a first mode, the first imaging unit transmits the first image to an external medical image processing device at a specific frame rate via a transmission path; and when set to a second mode, at least one of the first imaging unit and the second imaging unit reduces the number of pixels in at least one of the first image and the second image so that the combined data amount of the first image and the second image is less than or equal to the transmission capacity of the transmission path, and the first imaging unit and the second imaging unit transmit the first image and the second image in the same frame to the medical image processing device at the specific frame rate via the transmission path. (2) The medical imaging apparatus according to (1), wherein at least one of the first imaging unit and the second imaging unit reduces both the number of pixels in the vertical direction and the number of pixels in the horizontal direction of at least one of the first imaging image and the second imaging image when the total amount of data of the first imaging image and the second imaging image is reduced to be less than or equal to the transmission capacity of the transmission path. (3) The medical imaging apparatus according to (1), wherein at least one of the first imaging unit and the second imaging unit reduces only the number of pixels in the vertical direction of at least one of the imaging image of the first imaging image and the second imaging image when the total amount of data of the first imaging image and the second imaging image is reduced to be less than or equal to the transmission capacity of the transmission path. (4) When set to a third mode, the first imaging unit time-divisionally images the first reflected light and a third reflected light from the object being observed that has a different wavelength band than the first reflected light and the second reflected light, based on a third light emitted from the light source device, the medical imaging device according to any one of (1) to (3).(5) The medical imaging apparatus according to (4), wherein, when set to the third mode, the first imaging unit reduces the number of pixels in at least one of the imaging images, which is the first imaging image and the third imaging image generated by imaging the third reflected light. (6) The medical imaging apparatus according to any one of (1) to (5), wherein the first reflected light is light including the visible wavelength band, and the second reflected light is fluorescence emitted from the object of observation by the second light, which is excitation light emitted from the light source device and excites a substance contained in the object of observation. (7) The medical imaging apparatus according to (4), wherein the third reflected light overlaps with the wavelength band of the first reflected light in part. (8) A medical imaging device comprising: a light source device that emits a first light and a second light, respectively; a medical imaging device that images a first reflected light from an object to be observed based on the first light and a second reflected light from the object to be observed based on the second light having a different wavelength band than the first reflected light; a medical imaging device that processes the image captured by the medical imaging device; and a transmission path for transmitting the image captured from the medical imaging device to the medical image processing device, wherein the medical imaging device comprises a first imaging unit that images the first reflected light to generate a first image, and a second imaging unit that images the second reflected light to generate a second image, and when set to the first mode, A medical observation system comprising: a first imaging unit that transmits the first captured image to the medical image processing device at a specific frame rate via the transmission path; when set to a second mode, at least one of the first imaging unit and the second imaging unit reduces the number of pixels in at least one of the first and second captured images so that the combined data amount of the first and second captured images is less than or equal to the transmission capacity of the transmission path; and the first and second imaging units transmit the first and second captured images together in the same frame at the specific frame rate via the transmission path to the medical image processing device.(9) A medical image processing device for processing an image generated by a medical imaging device, wherein the medical imaging device comprises a first imaging unit that generates a first image by imaging a first return light from an object to be observed based on a first light emitted from a light source device, and a second imaging unit that generates a second image by imaging a second return light having a different wavelength band from the first return light from the object to be observed based on a second light emitted from the light source device, and when set to a first mode, the first imaging unit transmits the first image at a specific frame rate via a transmission path. A medical image processing device that transmits to a medical image processing device and, when set to a second mode, at least one of the first imaging unit and the second imaging unit reduces the number of pixels in at least one of the first imaging image and the second imaging image so that the combined data amount of the first imaging image and the second imaging image is less than or equal to the transmission capacity of the transmission path, and the first imaging unit and the second imaging unit transmit the first imaging image and the second imaging image together in the same frame at the specified frame rate via the transmission path.

[0101] 1, 1B, 1C Medical observation system 2, 2B Insertion section 3 Light source device 4 Light guide 5 Camera head 6 First transmission cable 7 Display device 8 Second transmission cable 9 Control device 10 Third transmission cable 12 Surgical microscope 15 Ring light 21 Eyepiece section 22 Excitation light cut filter 24 Tip section 25 Bending section 26 Flexible tube section 31 First light source 32 Second light source 33 Third light source 51 Lens unit 52 Prism 53 Imaging section 53a First imaging section 53b Second imaging section 91 Communication section 92 Image memory 93 Processing module 94 Control section 95 Input section 96 Output section 97 Storage section 121 Microscope section 122 Support section 123 Base section 151 Illumination section 152 Subject image acquisition unit 300B Endoscope 301 Operation unit 302 Universal code 531 First image sensor 532 Second image sensor 533 Transmission and communication unit 931 Memory controller 932 Image processing unit 933 Display control unit 1511 Housing 1512 Illumination lens 1521 Connection unit Ax Optical axis CN1, CN2 Connector F1a Normal light image F1b Third fluorescence image F2 Second fluorescence image

Claims

1. A medical imaging device comprising: a first imaging unit that generates a first image by imaging a first reflected light from an object to be observed based on a first light emitted from a light source device; and a second imaging unit that generates a second image by imaging a second reflected light having a different wavelength band from the first reflected light from the object to be observed based on a second light emitted from the light source device, wherein when set to a first mode, the first imaging unit transmits the first image to an external medical image processing device at a specific frame rate via a transmission path; and when set to a second mode, at least one of the first imaging unit and the second imaging unit reduces the number of pixels in at least one of the first image and the second image so that the combined data amount of the first image and the second image is less than or equal to the transmission capacity of the transmission path; and the first imaging unit and the second imaging unit transmit the first image and the second image in the same frame to the medical image processing device at the specific frame rate via the transmission path.

2. The medical imaging device according to claim 1, wherein at least one of the first imaging unit and the second imaging unit reduces both the number of pixels in the vertical direction and the number of pixels in the horizontal direction of at least one of the first imaging image and the second imaging image when the total amount of data of the first imaging image and the second imaging image is reduced to be less than or equal to the transmission capacity of the transmission path.

3. The medical imaging device according to claim 1, wherein at least one of the first imaging unit and the second imaging unit reduces only the number of pixels in the vertical direction of at least one of the first imaging image and the second imaging image when the combined data amount of the first imaging image and the second imaging image is kept below the transmission capacity of the transmission path.

4. When set to a third mode, the medical imaging apparatus according to claim 1, wherein the first imaging unit time-divisionally images the first reflected light and the third reflected light from the object being observed, which has a different wavelength band from the first reflected light and the second reflected light, based on the third light emitted from the light source device.

5. When set to the third mode, the medical imaging device according to claim 4, wherein the first imaging unit reduces the number of pixels in at least one of the first imaging image and the third imaging image generated by imaging the third reflected light.

6. The medical imaging apparatus according to claim 1, wherein the first reflected light is light including the visible wavelength band, and the second reflected light is fluorescence emitted from the object of observation by the second light, which is excitation light emitted from the light source device and excites a substance contained in the object of observation.

7. The medical imaging apparatus according to claim 4, wherein the third reflected light overlaps with the wavelength band of the first reflected light in part.

8. A medical imaging device comprising: a light source device that emits a first light and a second light, respectively; a medical imaging device that images a first return light from an object of observation based on the first light and a second return light from the object of observation based on the second light having a different wavelength band than the first return light; a medical image processing device that processes the image captured by the medical imaging device; and a transmission path for transmitting the image captured from the medical imaging device to the medical image processing device, wherein the medical imaging device comprises: a first imaging unit that images the first return light to generate a first image; and a second imaging unit that images the second return light to generate a second image; when set to a first mode, the first imaging unit transmits the first image captured to the medical image processing device via the transmission path at a specific frame rate; when set to a second mode, A medical observation system in which at least one of the first imaging unit and the second imaging unit reduces the number of pixels in at least one of the first imaging image and the second imaging image so that the combined data amount of the first imaging image and the second imaging image is less than or equal to the transmission capacity of the transmission path, and the first imaging unit and the second imaging unit transmit the first imaging image and the second imaging image together in the same frame at a specific frame rate via the transmission path.

9. A medical image processing device for processing an image generated by a medical imaging device, wherein the medical imaging device comprises: a first imaging unit that generates a first image by imaging a first return light from an object of observation based on a first light emitted from a light source device; and a second imaging unit that generates a second image by imaging a second return light having a different wavelength band from the first return light from the object of observation based on a second light emitted from the light source device, wherein when set to a first mode, the first imaging unit transmits the first image to the medical image processing device at a specific frame rate via a transmission path; and when set to a second mode, at least one of the first imaging unit and the second imaging unit reduces the number of pixels in at least one of the first image and the second image so that the combined data amount of the first image and the second image is less than or equal to the transmission capacity of the transmission path. A medical image processing device comprising the first imaging unit and the second imaging unit, which transmits the first image and the second image together in the same frame at a specific frame rate via the transmission path to the medical image processing device.

Images