Medical control device and medical observation system
The medical control device and system address fogging in endoscope optical members by adjusting dimming control to prioritize shutter closure over light reduction based on brightness, enhancing visibility and temperature management for different endoscope uses.
Patent Information
- Application Number
- JP2021006010
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2021-01-18
- Publication Date
- 2024-11-21
- Estimated Expiration
- 2041-01-18
AI Technical Summary
Conventional medical observation systems face issues with fogging of optical members at the distal end of endoscopes due to high temperature and humidity when used in environments like the abdominal cavity, as they reduce both illumination light and electronic shutter simultaneously, leading to condensation.
A medical control device and system that adjusts dimming control by first reducing the electronic shutter and then the illumination light based on brightness levels, prioritizing shutter closure over light reduction as brightness increases, specifically for endoscopes used in abdominal and otologic applications.
Effectively suppresses fogging at the endoscope tip by maintaining higher light levels during stable dimming for abdominal cavity use and lower light levels for otologic use, improving visibility and reducing temperature-related issues.
Smart Images

Figure 0007587991000001 
Figure 0007587991000002 
Figure 0007587991000003
Abstract
Description
[Technical field]
[0001] The present disclosure relates to a medical control device and a medical observation system. [Background technology]
[0002] Conventionally, there has been known a medical observation system that uses a light source device to irradiate light onto a subject such as the inside of a living body, and uses an imaging element to capture light from the subject (subject image), thereby observing the subject (see, for example, Patent Document 1). In the medical observation system described in Patent Document 1, dimming control is performed to control the amount of illumination light from the light source device to the subject and the electronic shutter in the image sensor, based on the luminance level of the subject image contained in the captured image generated by the image sensor. [Prior art documents] [Patent documents]
[0003] [Patent Document 1] JP 2012-85790 A Summary of the Invention [Problem to be solved by the invention]
[0004] FIG. 7 is a diagram for explaining the conventional problem. Specifically, FIG. 7(a) shows the luminance level of a subject image included in a captured image. In FIG. 7, the luminance level increases toward the right side, and decreases toward the left side. FIG. 7(b) is a diagram showing the control of an electronic shutter in an image sensor in the conventional light control. FIG. 7(c) is a diagram showing the control of the amount of illumination light to a subject in a light source device in the conventional light control. In FIG. 7, position P1 shown by a solid line indicates a position where the control of the electronic shutter and the control of the amount of light are stable when the subject is a specific recommended subject (hereinafter, referred to as light control stable position P1). Incidentally, in conventional light adjustment control, as shown in FIG. 7, it is common to reduce the amount of light from the light source device and at the same time reduce the electronic shutter in the image sensor as the luminance level of the subject image included in the captured image increases. Furthermore, with conventional dimming control, when the endoscope is an endoscope for use in the abdominal cavity, the temperature and humidity are high inside the abdominal cavity, so when the endoscope, which is outside the abdominal cavity, is inserted into the abdominal cavity, there is a problem in that optical components such as lenses that are attached to the tip of the endoscope and exposed to the outside of the endoscope become clouded.
[0005] The present disclosure has been made in consideration of the above, and aims to provide a medical control device and a medical observation system that can effectively suppress fogging of optical components provided at the tip of an endoscope. [Means for solving the problem]
[0006] In order to solve the above-mentioned problems and achieve the objective, the medical control device of the present disclosure includes an image acquisition unit that acquires an image generated by an imaging element that captures an image of a subject captured by an endoscope, a brightness calculation unit that calculates a brightness level of the subject image included in the image, and a dimming control unit that controls the amount of light irradiated to the subject and an electronic shutter of the imaging element based on the brightness level, and the dimming control unit executes a first dimming control that narrows the electronic shutter before narrowing the amount of light as the brightness level becomes higher.
[0007] In addition, the medical control device according to the present disclosure includes an image acquisition unit that acquires an image generated by an imaging element that captures an image of a subject captured by an endoscope, a brightness calculation unit that calculates a brightness level of the subject image included in the image, and a dimming control unit that controls the amount of light irradiated to the subject and an electronic shutter of the imaging element based on the brightness level, and the dimming control unit executes a second dimming control that reduces the amount of light before closing the electronic shutter as the brightness level becomes higher.
[0008] Furthermore, a medical observation system according to the present disclosure includes an image sensor that captures an image of a subject captured by an endoscope, a light source device that supplies light to be irradiated to the subject, and a medical control device that controls the operation of the image sensor and the light source device, and the medical control device includes an image acquisition unit that acquires an image generated by the image sensor, a brightness calculation unit that calculates a brightness level of the subject image included in the captured image, and a light adjustment control unit that controls the amount of light irradiated to the subject and an electronic shutter of the image sensor based on the brightness level, and the light adjustment control unit executes a first light adjustment control that reduces the electronic shutter before reducing the amount of light as the brightness level increases.
[0009] Furthermore, a medical observation system according to the present disclosure includes an image sensor that captures an image of a subject captured by an endoscope, a light source device that supplies light to be irradiated to the subject, and a medical control device that controls the operation of the image sensor and the light source device, the medical control device including an image acquisition unit that acquires an image generated by the image sensor, a brightness calculation unit that calculates a brightness level of the subject image included in the captured image, and a light adjustment control unit that controls the amount of light to be irradiated to the subject and an electronic shutter of the image sensor based on the brightness level, and the light adjustment control unit executes a second light adjustment control that reduces the amount of light before closing the electronic shutter as the brightness level becomes higher. Effect of the Invention
[0010] According to the medical control device and medical observation system according to the present disclosure, fogging of optical members provided at the tip portion of an endoscope can be effectively suppressed. [Brief description of the drawings]
[0011] [Figure 1] FIG. 1 is a diagram showing the configuration of a medical observation system according to the first embodiment. [Diagram 2] FIG. 2 is a block diagram showing the configuration of the camera head and the control device. [Diagram 3] FIG. 3 is a diagram for explaining the function of the control unit as a type determination unit. [Figure 4] FIG. 4 is a diagram illustrating the first dimming control. [Diagram 5] FIG. 5 is a diagram illustrating the second dimming control. [Figure 6] FIG. 6 is a diagram showing the configuration of a medical observation system according to the second embodiment. [Figure 7] FIG. 7 is a diagram illustrating the problems associated with the conventional technology. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0012] Hereinafter, a mode for carrying out the present disclosure (hereinafter, referred to as an embodiment) will be described with reference to the drawings. Note that the present disclosure is not limited to the embodiment described below. Furthermore, in the description of the drawings, the same parts are given the same reference numerals.
[0013] (Embodiment 1) [Overview of medical observation system] FIG. 1 is a diagram showing the configuration of a medical observation system 1 according to the first embodiment. The medical observation system 1 is a system used in the medical field for capturing (observing) images of the inside of a living body as a subject. As shown in Fig. 1, the medical observation system 1 includes an insertion section 2, a light source device 3, a light guide 4, a camera head 5, a first transmission cable 6, a display device 7, a second transmission cable 8, a control device 9, and a third transmission cable 10.
[0014] The insertion section 2 corresponds to an endoscope according to the present disclosure. In the first embodiment, the insertion section 2 is configured as a rigid endoscope. That is, the insertion section 2 has an elongated shape in which the entirety is rigid, or a part is flexible and the other part is rigid, and is inserted into a living body. Inside the insertion section 2, an optical system 21 (FIG. 1) is provided, which is configured using one or more lenses and collects light from a subject. For convenience of explanation, FIG. 1 illustrates only an optical member 211 of the optical system 21 that is located at the tip of the insertion section 2 and exposed to the outside of the insertion section 2. In this embodiment 1, the insertion portion 2 is one of two types of insertion portions (endoscopes): a large-diameter insertion portion (endoscope) for use in the abdominal cavity (for laparoscopic surgery) and a small-diameter insertion portion (endoscope) for use in otology.
[0015] The light source device 3 is connected to one end of a light guide 4, and under the control of a control device 9, supplies light to the one end of the light guide 4 to irradiate the inside of a living body. In the first embodiment, the light source device 3 is configured as a separate entity from the control device 9, but the present invention is not limited to this, and a configuration in which the light source device 3 is provided inside the control device 9 may be adopted. One end of the light guide 4 is detachably connected to the light source device 3, and the other end is detachably connected to the insertion portion 2. The light guide 4 transmits light supplied from the light source device 3 from one end to the other end, and supplies it to the insertion portion 2. The light irradiated into the living body and reflected within the living body is collected by the optical system 21 in the insertion portion 2.
[0016] The camera head 5 is detachably connected to the base end (eyepiece 22 (FIG. 1)) of the insertion portion 2. The camera head 5 is detachably connected to the base end of each of the two types of insertion portions 2 (for abdominal cavity and for otologic use) described above. Under the control of the control device 9, the camera head 5 captures light collected by the insertion portion 2 to generate a captured image. The detailed configuration of the camera head 5 will be described later in the section "Configuration of the Camera Head."
[0017] One end of the first transmission cable 6 is detachably connected to the control device 9 via a connector CN1 (FIG. 1), and the other end is detachably connected to the camera head 5 via a connector CN2 (FIG. 1). The first transmission cable 6 transmits captured images and the like output from the camera head 5 to the control device 9, and also transmits control signals, synchronization signals, clocks, power, and the like output from the control device 9 to the camera head 5. In addition, when transmitting captured images and the like from the camera head 5 to the control device 9 via the first transmission cable 6, the captured images and the like may be transmitted as optical signals or may be transmitted as electrical signals. The same applies to the transmission of control signals, synchronization signals, and clocks from the control device 9 to the camera head 5 via the first transmission cable 6.
[0018] The display device 7 is configured with a display using liquid crystal or organic EL (Electro Luminescence) or the like, and displays an image based on a video signal from the control device 9 under the control of the control device 9. One end of the second transmission cable 8 is detachably connected to the display device 7, and the other end is detachably connected to the control device 9. The second transmission cable 8 transmits the video signal processed by the control device 9 to the display device 7.
[0019] The control device 9 corresponds to a medical control device according to the present disclosure. The control device 9 is composed of a CPU (Central Processing Unit), an FPGA (Field-Programmable Gate Array), etc., and controls the overall operations of the light source device 3, the camera head 5, and the display device 7. The detailed configuration of the control device 9 will be described later in the section "Configuration of the Control Device." One end of the third transmission cable 10 is detachably connected to the light source device 3, and the other end is detachably connected to the control device 9. The third transmission cable 10 transmits a control signal from the control device 9 to the light source device 3.
[0020] [Camera head configuration] Next, the configuration of the camera head 5 will be described. FIG. 2 is a block diagram showing the configuration of the camera head 5 and the control device 9. As shown in FIG. As shown in FIG. 2, the camera head 5 includes a lens unit 51, an imaging unit 52, and a communication unit 53. The lens unit 51 is configured using one or more lenses, and forms an image on an imaging surface of the imaging section 52 (imaging element 521) from light collected by the insertion section 2. For ease of explanation, hereinafter, the light traveling from the lens unit 51 toward the imaging element 521 will be referred to as a subject image.
[0021] The imaging unit 52 captures images of the inside of a living body under the control of the control device 9. The imaging unit 52 includes an imaging element 521 and a signal processing unit 522, as shown in FIG. The image sensor 521 is configured with a charge coupled device (CCD) or a complementary metal oxide semiconductor (CMOS) that receives a subject image and converts it into an electrical signal (analog signal), etc. The image sensor 521 captures the subject image to generate a captured image.
[0022] Under the control of the control device 9, the signal processing unit 522 performs signal processing on the captured image (analog signal) generated by the image sensor 521, and outputs the captured image (RAW signal (digital signal)). For example, the signal processing unit 522 performs signal processing such as a process of removing reset noise from the captured image (analog signal) generated by the imaging element 521, a process of multiplying the analog signal by an analog gain that amplifies the analog signal, and A / D conversion.
[0023] The communication unit 53 functions as a transmitter that transmits the captured image (RAW signal (digital signal)) output from the imaging unit 52 to the control device 9 via the first transmission cable 6. The communication unit 53 is configured, for example, with a high-speed serial interface that communicates the captured image with the control device 9 via the first transmission cable 6 at a transmission rate of 1 Gbps or more.
[0024] [Configuration of the control device] Next, the configuration of the control device 9 will be described with reference to FIG. As shown in FIG. 2, the control device 9 includes a communication unit 91, a memory 92, an observation image generating unit 93, a control unit 94, an input unit 95, an output unit 96, and a storage unit 97. The communication unit 91 functions as a receiver that receives a captured image (RAW signal (digital signal)) output from the camera head 5 (communication unit 53) via the first transmission cable 6. This communication unit 91 is configured, for example, with a high-speed serial interface that communicates captured images with the communication unit 53 at a transmission rate of 1 Gbps or more. In other words, the communication unit 91 corresponds to a captured image acquisition unit according to the present disclosure. The memory 92 is configured, for example, with a dynamic random access memory (DRAM) etc. This memory 92 is capable of temporarily storing multiple frames of captured images sequentially output from the camera head 5 (communication unit 53).
[0025] Under the control of the control unit 94, the observational image generating unit 93 processes captured images that are sequentially output from the camera head 5 (communication unit 53) and received by the communication unit 91. As shown in FIG. 2, the observational image generating unit 93 includes a memory controller 931, an image processing unit 932, and a display control unit 933.
[0026] The memory controller 931 controls writing and reading of captured images to and from the memory 92. More specifically, the memory controller 931 sequentially writes captured images that are sequentially output from the camera head 5 (communication unit 53) and received by the communication unit 91 to the memory 92. The memory controller 931 also reads captured images from the memory 92 at specific timing, and inputs the read captured images to the image processing unit 932.
[0027] The image processing unit 932 executes image processing on the input captured image (RAW signal (digital signal)). Examples of such image processing include optical black subtraction processing, white balance adjustment processing, digital gain processing (processing of multiplying a digital signal by a digital gain that amplifies the digital signal), demosaic processing, color correction matrix processing, gamma correction processing, and YC processing that converts an RGB signal (captured image) into a luminance color difference signal (Y, Cb / Cr signal).
[0028] The display control unit 933, under the control of the control unit 94, generates a video signal for displaying the captured image after image processing is performed by the image processing unit 932. Then, the display control unit 933 outputs the video signal to the display device 7 via the second transmission cable 8.
[0029] The control unit 94 is configured using, for example, a CPU, an FPGA, etc., and controls the operations of the light source device 3, the camera head 5, and the display device 7 as well as the operation of the entire control device 9 by outputting control signals via the first to third transmission cables 6, 8, and 10. This control unit 94 has functions as a type discrimination unit, a brightness calculation unit, and a dimming control unit according to the present disclosure. The functions of the type discrimination unit, the brightness calculation unit, and the dimming control unit will be described later in "Operation of the control device."
[0030] The input unit 95 is configured using operation devices such as a mouse, a keyboard, and a touch panel, and receives user operations by a user such as a doctor. Then, the input unit 95 outputs an operation signal to the control unit 94 in response to the user operation. The output unit 96 is configured using a speaker, a printer, etc., and outputs various information. The storage unit 97 stores the programs executed by the control unit 94, information necessary for the processing of the control unit 94, and the like.
[0031] [Control device operation] Next, the operation of the above-mentioned control device 9 will be described. For convenience of explanation, the following mainly describes the function of the control unit 94 as a type determination unit, the function of the control unit 94 as a luminance calculation unit, and the function of the control unit 94 as a light adjustment control unit.
[0032] [Function as type discrimination unit] First, the function of the control unit 94 as a type determining unit will be described. Fig. 3 is a diagram for explaining the function of the control unit 94 as a type discrimination unit. Specifically, Fig. 3(a) is a diagram showing an example of a captured image CI captured by the image sensor 521. Fig. 3(b) is a diagram showing the distribution of luminance values on a horizontal line L5 in the captured image CI of Fig. 3(a). Here, the light (subject image) reflected inside the living body and collected inside the insertion portion 2 has a substantially circular cross section. Therefore, the subject image SI in the captured image CI is substantially circular, as shown in Fig. 3(a). That is, the captured image CI includes the area of the subject image SI and a mask area MA (the black portion in Fig. 3(a)) other than the subject image SI.
[0033] The control unit 94 acquires a luminance signal (Y signal) from the luminance and color difference signals (Y, Cb / Cr signals) of the captured image CI after YC processing has been performed by the image processing unit 932. Then, based on the luminance signal (Y signal), the control unit 94 detects the distribution of luminance values on each of a plurality of horizontal lines L1 to L14 (14 in the example of FIG. 3(a)) in the captured image CI. Here, in the captured image CI, the area of the subject image SI has a higher luminance value than the mask area MA. That is, for example, in the luminance distribution on the horizontal line L5, as shown in FIG. 3(b), the luminance value is high between two boundary points BP between the subject image SI and the mask area MA, and the luminance value is low in other parts. For this reason, the control unit 94 compares the luminance value with a first luminance threshold SB1 (FIG. 3(b)), and recognizes an area in which pixels having a luminance value higher than the first luminance threshold SB1 are consecutively arranged as an area of the subject image SI. The control unit 94 also compares the luminance value with a second luminance threshold SB2 (FIG. 3(b)), which is lower than the first luminance threshold SB1, and recognizes an area in which pixels having a luminance value lower than the second luminance threshold SB2 are consecutively arranged as a mask area MA. By performing the above process for all horizontal lines L1 to L14, the control unit 94 recognizes the entire area of the subject image SI and the entire mask area MA in the captured image SI.
[0034] Then, the control unit 94 compares the size of the area of the subject image SI with a specific size threshold, and if the size of the area of the subject image SI is equal to or greater than the size threshold, determines the type of the insertion portion 2 connected to the camera head 5 to be an insertion portion for the abdominal cavity (endoscope). On the other hand, when the size of the area of the subject image SI is smaller than the size threshold, the control unit 94 determines the type of the insertion portion 2 connected to the camera head 5 as an otological insertion portion (endoscope).
[0035] [Luminance calculation function] Next, the function of the control unit 94 as a luminance calculation unit will be described. The control unit 94 calculates the brightness level (average brightness value) within the detection region, which is at least a portion of the entire image region of the captured image CI, based on the brightness signal (Y signal) within the detection region, which is at least a portion of the entire image region of the captured image CI, out of the brightness and color difference signals (Y, Cb / Cr signals) of the captured image CI after YC processing has been performed by the image processing unit 932.
[0036] [Function as dimming control unit] Next, the function of the control unit 94 as a light adjustment control unit will be described. The control unit 94 executes dimming control to adjust the captured image CI to a reference brightness based on the luminance level (average luminance value) in the detection region in the captured image CI calculated as described above. Here, when the control unit 94 determines that the type of the insertion portion 2 connected to the camera head 5 is an insertion portion for abdominal cavity, it executes a first dimming control as the dimming control. That is, the first type according to the present disclosure is an insertion portion for abdominal cavity (endoscope). On the other hand, when the control unit 94 determines that the type of the insertion portion 2 connected to the camera head 5 is an insertion portion for otology, it executes a second dimming control as the dimming control. That is, the second type according to the present disclosure is an insertion portion for otology (endoscope). The first and second dimming controls will be described below in order.
[0037] [First dimming control] First, the first dimming control will be described. FIG. 4 is a diagram for explaining the first light control. Specifically, FIG. 4(a) is a diagram corresponding to FIG. 7(a), and shows the luminance level in the detection region in the captured image CI (the luminance level of the subject image SI included in the captured image CI) calculated as described above. In FIG. 4, the luminance level increases toward the right in the figure, and decreases toward the left in the figure, as in FIG. 7. FIG. 4(b) is a diagram showing the control of the digital gain multiplied in the image processing (digital gain processing) by the image processing unit 932. FIG. 4(c) is a diagram showing the control of the analog gain multiplied by the signal processing unit 522. FIG. 4(d) is a diagram showing the control of the electronic shutter in the image sensor 521. FIG. 4(e) is a diagram showing the control of the amount of illumination light into the living body in the light source device 3. In FIG. 4, the position P1 indicated by the dashed line indicates the stable light control position in the conventional light control shown in FIG. 7. In addition, in FIG. 4, position P1' indicated by a solid line indicates a stable light adjustment position where light adjustment control becomes stable by the first light adjustment control when the subject is a specific recommended subject.
[0038] In the first light adjustment control, as the luminance level of the subject image SI increases, the control unit 94 first sequentially decreases the digital gain from the maximum value to the minimum value, as shown in Fig. 4(b). In the example of Fig. 4(b), the maximum value of the digital gain is 8 times, and the minimum value of the digital gain is 1 time. Furthermore, in the process of lowering the digital gain from the maximum value to the minimum value, the control unit 94 does not change the analog gain to the maximum value, as shown in Fig. 4(c). In the example of Fig. 4(c), the maximum value of the analog gain is 8 times. Then, as the luminance level of the subject image SI becomes higher, the control unit 94 sequentially lowers the analog gain from the maximum value to the minimum value at the same time that the digital gain is set to the minimum value. In the example of Fig. 4(c), the minimum value of the analog gain is 1 time.
[0039] In addition, in the process of decreasing the digital gain from the maximum value to the minimum value and in the process of decreasing the analog gain from the maximum value to the minimum value, the control unit 94 does not change the electronic shutter of the image sensor 521 to the minimum aperture as shown in FIG. 4(d). In the example of FIG. 4(d), the minimum aperture of the electronic shutter of the image sensor 521 is 1 / 60 [hour]. Then, as the luminance level of the subject image SI becomes higher, the control unit 94 sequentially changes the electronic shutter of the image sensor 521 from the minimum aperture to the maximum aperture at the same time that the analog gain is set to the minimum value. In the example of FIG. 4(d), the electronic shutter time is increased from 1 / 60 [hour].
[0040] Also, when the electronic shutter in the image sensor 521 is kept at the minimum aperture, the control unit 94 does not change the amount of light in the light source device 3 to the maximum amount of light as shown in FIG. 4(e). In the first light adjustment control, the maximum amount of light is, for example, the amount of light that can be emitted to the maximum extent in the light source device 3 (hereinafter, referred to as full emission). Then, as the luminance level of the subject image SI becomes higher, the control unit 94 sequentially reduces the amount of light in the light source device 3 from the maximum amount of light to the minimum amount of light after the timing of changing the electronic shutter in the image sensor 521 from the minimum aperture to the maximum aperture. In the first light adjustment control, the minimum amount of light is, for example, a light amount higher than the amount of light that can be emitted to the minimum extent in the light source device 3. For example, the characteristic of the light source device 3 is that the amount of light can be reduced to 1 / 4000 of full emission, but the minimum amount of light is set to 1 / 1000 of full emission.
[0041] As described above, in the first light adjustment control, as the luminance level of the subject image SI increases, the electronic shutter in the image sensor 521 is closed before the amount of light in the light source device 3 is reduced. Also, in the first light adjustment control, as the luminance level of the subject image SI increases, both the digital gain and the analog gain are lowered before the electronic shutter in the image sensor 521 is closed. In the first light adjustment control, as shown in FIG. 4, the light adjustment stable position P1' moves toward the side where the luminance level of the subject image SI is higher (to the right in FIG. 4) with respect to the light adjustment stable position P1 in the conventional light adjustment control.
[0042] [Second dimming control] Next, the second dimming control will be described. Fig. 5 is a diagram for explaining the second dimming control. Specifically, Fig. 5(a) to Fig. 5(e) are diagrams corresponding to Fig. 4(a) to Fig. 4(e), respectively. In Fig. 5, position P1 indicated by a dashed line indicates a stable dimming position in the conventional dimming control shown in Fig. 7. In Fig. 5, position P1'' indicated by a solid line indicates a stable dimming position where dimming control is stabilized by the second dimming control when the subject is a specific recommended subject.
[0043] In the second dimming control, as the brightness level of the subject image SI increases, the control unit 94 performs digital gain control, analog gain control, and electronic shutter control in the image sensor 521 in the same manner as in the first dimming control, as shown in Figures 5(b) to 5(d).
[0044] Also, during a period in which the electronic shutter of the image sensor 521 is left at the minimum aperture and is not changed (before the timing of changing the electronic shutter of the image sensor 521 from the minimum aperture to the maximum aperture), as the luminance level of the subject image SI increases, the control unit 94 sequentially reduces the amount of light in the light source device 3 from the maximum amount of light to the minimum amount of light, as shown in FIG. 5(e). Note that in the second dimming control, the maximum amount of light in the light source device 3 is, for example, 1 / 4 of the amount of light in the full emission of the light source device 3. That is, the maximum value of the amount of light in the first dimming control is greater than the maximum value of the amount of light in the second dimming control. In addition, in the second dimming control, the minimum amount of light in the light source device 3 is, for example, the amount of light that can be emitted minimally in the light source device 3 (1 / 4000 of the amount of light in the full emission). That is, the minimum value of the amount of light in the first dimming control is greater than the minimum value of the amount of light in the second dimming control. Then, after the timing at which the electronic shutter in the image sensor 521 is changed from the minimum aperture to the maximum aperture, the control unit 94 reduces the amount of light in the light source device 3 to the minimum amount of light, and does not change the amount of light to the minimum amount of light even if the brightness level of the subject image SI increases.
[0045] As described above, in the second light adjustment control, as the luminance level of the subject image SI increases, the amount of light in the light source device 3 is reduced before the electronic shutter in the image sensor 521 is closed. Also, in the second light adjustment control, as the luminance level of the subject image SI increases, both the digital gain and the analog gain are reduced before the electronic shutter in the image sensor 521 is closed. In the second light adjustment control, as shown in FIG. 5, the stable light adjustment position P1'' moves to the side where the luminance level of the subject image SI is low (left side in FIG. 5) with respect to the stable light adjustment position P1 in the conventional light adjustment control.
[0046] According to the above-described first embodiment, the following effects are achieved. In the control device 9 according to the first embodiment, when the type of the insertion section 2 connected to the camera head 5 is an insertion section for abdominal cavity, a first light adjustment control is executed to reduce the electronic shutter before reducing the amount of light as the luminance level of the subject image SI included in the captured image CI increases. This makes it possible to make the amount of light at the light adjustment stable position P1' higher than the amount of light at the light adjustment stable position P1 in the conventional light adjustment control. Therefore, the temperature of the tip portion of the insertion portion 2 can be increased, and fogging of the optical member 211 can be effectively suppressed (hereinafter, referred to as a first effect).
[0047] Incidentally, when the insertion portion 2 is an otological insertion portion, it is necessary to perform observation with the tip portion positioned away from the subject to be observed in order to prevent the tip portion of the insertion portion 2, which has become hot, from coming into contact with parts that are sensitive to heat, such as the eardrum. In the control device 9 according to the first embodiment, when the type of the insertion section 2 connected to the camera head 5 is an otological insertion section, as the luminance level of the subject image SI included in the captured image CI increases, a second light adjustment control is executed to reduce the amount of light before closing the electronic shutter. This makes it possible to make the amount of light at the stable light adjustment position P1' lower than the amount of light at the stable light adjustment position P1 in the conventional light adjustment control. Therefore, the temperature of the tip portion of the insertion portion 2 can be lowered, and observation can be performed with the tip portion positioned in the vicinity of the observation target (hereinafter, referred to as the second effect).
[0048] In particular, the maximum light amount in the first dimming control is greater than the maximum light amount in the second dimming control. Also, the minimum light amount in the first dimming control is greater than the minimum light amount in the second dimming control. Therefore, the first and second effects described above can be preferably achieved.
[0049] Furthermore, the control device 9 according to the first embodiment determines the type of the insertion portion 2 based on the area of the subject image SI included in the captured image CI. Therefore, a user such as a doctor does not need to input the type of the insertion portion 2 using the input unit 95 or the like. In other words, convenience can be improved.
[0050] (Embodiment 2) Next, a second embodiment will be described. In the following description, the same components as those in the above-described first embodiment are given the same reference numerals, and detailed description thereof will be omitted or simplified. FIG. 6 is a diagram showing the configuration of a medical observation system 1A according to the second embodiment. As shown in FIG. 6, a medical observation system 1A according to the second embodiment employs a scope 100 instead of the insertion section 2, the camera head 5, and the first transmission cable 6 of the medical observation system 1 described in the first embodiment.
[0051] The scope 100 corresponds to an endoscope according to the present disclosure. In the second embodiment, the scope 100 is one of two types of scopes (endoscopes): a scope (endoscope) for the abdominal cavity (for laparoscopic surgery) and a scope (endoscope) for otology. A portion of the scope 100 is inserted into a living body, captures an image of a subject reflected within the living body, and outputs a captured image generated by the capture. As shown in FIG. 6, the scope 100 includes an insertion section 2A, an operation section 110, a universal cord 120, and a connector section 130. The insertion section 2A is a section that is at least partially flexible and is inserted into a living body. A light guide (not shown), an illumination lens (not shown), an objective lens (not shown), and an imaging section 52A (FIG. 6) are provided in the insertion section 2A.
[0052] The light guide described above is routed from the insertion section 2A through the operation section 110 and the universal cord 120 to the connector section 130. One end of the light guide is located at the tip portion inside the insertion section 2A. When the scope 100 (connector section 130) is connected to the light source device 3, the other end of the light guide is located inside the light source device 3. Note that, for convenience of explanation, FIG. 6 illustrates a state in which the scope 100 and the light source device 3 are separated, but the scope 100 is connected to the light source device 3 in addition to the control device 9. The light guide transmits light supplied from the light source device 3 from the other end to one end. The illumination lens described above faces one end of the light guide described above in the insertion portion 2 A. The illumination lens irradiates the light transmitted by the light guide into the living body.
[0053] The above-mentioned objective lens is provided at the tip portion inside the insertion portion 2A. The objective lens forms an image of the light (subject image) that is irradiated from the above-mentioned illumination lens to the inside of the living body and reflected inside the living body on the imaging element 521A. 6, the imaging unit 52A has a configuration similar to that of the imaging unit 52 described in the above-mentioned embodiment 1. That is, the imaging unit 52A includes an imaging element 521A and a signal processing unit 522A similar to the imaging element 521 and the signal processing unit 522 constituting the imaging unit 52, respectively. Here, a signal line (not shown) is routed from the insertion section 2A through the operation section 110 and the universal cord 120 to the connector section 130. One end of the signal line is connected to the imaging section 52A (signal processing section 52A). In addition, when the scope 100 is connected to the control device 9, the other end of the signal line is connected to the control device 9. The signal line transmits the captured image (RAW signal (digital signal) generated by the imaging section 52A, and the control signal output from the control device 9, between the scope 100 and the control device 9.
[0054] The operation section 110 is connected to a base end portion of the insertion section 2 A. The operation section 110 receives various operations on the scope 100. The universal cord 120 extends from the operation section 110 in a direction different from the direction in which the insertion section 110 extends, and is a cord on which the above-mentioned light guide, the above-mentioned signal line, and the like are disposed.
[0055] The connector unit 130 is provided at an end of the universal cord 120, and is detachably connected to the control device 9 and the light source device 3. The connector unit 130 is provided with a storage unit 131, as shown in FIG. The storage unit 131 stores a scope ID indicating the type (peritoneal scope or otological scope) of the scope 100. The scope ID corresponds to type information according to the present disclosure.
[0056] In the medical observation system 1A according to the second embodiment, the function of the control unit 94 as a type discrimination unit is different from that of the first embodiment. That is, the control unit 94 determines the type of the scope 100 connected to the control device 9 based on the scope ID stored in the storage unit 131. Note that the function of the control unit 94 as a luminance calculation unit and the function of the control unit 94 as a dimming control unit are similar to those in the first embodiment described above.
[0057] Even in the case of a configuration in which the type of the scope 100 is determined based on the scope ID as in the present embodiment described above, the same effects as those of the first embodiment described above can be achieved.
[0058] (Other embodiments) Although the embodiments for carrying out the present disclosure have been described above, the present disclosure should not be limited to only the above-described first and second embodiments. In the above-described first and second embodiments, both analog gain control and digital gain control are executed as the first and second dimming controls, but this is not limiting, and a configuration in which only one of them is executed may also be used. In the above-mentioned embodiments 1 and 2, the method of distinguishing the type of the insertion unit 2 and the type of the scope 100 is not limited to the distinguishing method described in the above-mentioned embodiments 1 and 2. For example, a configuration may be adopted in which a user such as a doctor inputs the type of the insertion unit 2 and the type of the scope 100 using the input unit 95 or the like, and the control unit 94 distinguishes the type.
[0059] Note that the following configurations also fall within the technical scope of the present disclosure. (1) A medical control device comprising: an image acquisition unit that acquires an image generated by an imaging element that captures an image of a subject captured by an endoscope; a brightness calculation unit that calculates a brightness level of the subject image contained in the image; and a dimming control unit that controls the amount of light irradiated to the subject and an electronic shutter of the imaging element based on the brightness level, wherein the dimming control unit executes a first dimming control that reduces the electronic shutter before reducing the amount of light as the brightness level increases. (2) The medical control device described in (1) further includes a type discrimination unit that discriminates the type of the endoscope, and the dimming control unit executes the first dimming control when the type of the endoscope is a first type, and executes a second dimming control different from the first dimming control when the type of the endoscope is a second type different from the first type, and the second dimming control is a control that reduces the amount of light before closing the electronic shutter as the brightness level becomes higher. (3) The medical control device according to (2), wherein the first type is an endoscope for abdominal cavity, and the second type is an endoscope for otology. (4) The medical control device described in (2) or (3), wherein the type discrimination unit discriminates the type of the endoscope based on at least one of the areas of the subject image included in the captured image and a mask area other than the subject image included in the captured image. (5) The medical control device described in (2) or (3), wherein the type discrimination unit is stored in a memory unit provided in the endoscope and discriminates the type of the endoscope based on type information indicating the type of the endoscope. (6) The medical control device according to any one of (2) to (5), wherein the maximum light amount in the first dimming control is greater than the maximum light amount in the second dimming control. (7) The medical control device according to any one of (2) to (6), wherein the minimum light amount in the first dimming control is greater than the minimum light amount in the second dimming control. (8) A medical control device described in any one of (1) to (7), wherein the dimming control unit reduces at least one of the analog gain by which an analog signal corresponding to the captured image is multiplied and the digital gain by which a digital signal corresponding to the captured image is multiplied before closing the electronic shutter as the brightness level increases. (9) A medical control device comprising: an image acquisition unit that acquires an image generated by an imaging element that captures an image of a subject captured by an endoscope; a brightness calculation unit that calculates a brightness level of the subject image contained in the image; and a dimming control unit that controls the amount of light irradiated to the subject and an electronic shutter of the imaging element based on the brightness level, wherein the dimming control unit executes a second dimming control that reduces the amount of light before closing the electronic shutter as the brightness level becomes higher. (10) A medical observation system comprising an image sensor for capturing an image of a subject captured by an endoscope, a light source device for supplying light to the subject, and a medical control device for controlling the operation of the image sensor and the light source device, wherein the medical control device comprises an image acquisition unit for acquiring an image generated by the image sensor, a brightness calculation unit for calculating a brightness level of the subject image included in the captured image, and a dimming control unit for controlling the amount of light to be irradiated to the subject and an electronic shutter of the image sensor based on the brightness level, wherein the dimming control unit executes a first dimming control for reducing the electronic shutter before reducing the amount of light as the brightness level increases. (11) A medical observation system comprising an image sensor which captures an image of a subject captured by an endoscope, a light source device which supplies light to be irradiated onto the subject, and a medical control device which controls the operation of the image sensor and the light source device, wherein the medical control device comprises an image acquisition unit which acquires an image generated by the image sensor, a brightness calculation unit which calculates a brightness level of the subject image contained in the image sensor, and a dimming control unit which controls the amount of light irradiated onto the subject and an electronic shutter of the image sensor based on the brightness level, wherein the dimming control unit executes a second dimming control which reduces the amount of light before closing the electronic shutter as the brightness level becomes higher. [Explanation of symbols]
[0060] 1,1A Medical Observation System 2,2A Insertion section 3 Light source device 4 Light Guide 5 Camera Head 6 First Transmission Cable 7 Display device 8 Second Transmission Cable 9. Control Device 10. Third Transmission Cable 21 Optical system 22 Eyepiece 51 Lens unit 52, 52A Imaging section 53 Communications Department 91 Communications Department 92 Memory 93 Observation image generation unit 94 Control Unit 95 Input section 96 Output section 97 Memory section 100 Scope 110 Operation section 120 Universal Code 130 Connector part 131 Storage section 211 Optical components 521,521A Image sensor 522,522A Signal Processing Unit 931 Memory Controller 932 Image Processing Unit 933 Display control section BP boundary point CI image capture CN1,CN2 connector L1~L14 Horizontal lines MA Mask Area SB1 First luminance threshold SB2 Second Luminance Threshold SI subject image P1,P1´,P1´´ Stable dimming position
Claims
1. an image acquisition unit that acquires an image generated by an image sensor that captures an image of a subject captured by an endoscope; a luminance calculation unit that calculates a luminance level of the subject image included in the captured image; a light control unit that controls an amount of light emitted from a light source device to a subject and an electronic shutter of the image sensor based on the luminance level; a type discrimination unit that discriminates the type of the endoscope, The light control unit is When the type of the endoscope is a first type, a first light adjustment control is executed; When the type of the endoscope is a second type different from the first type, a second light adjustment control different from the first light adjustment control is executed; The first dimming control includes: a control for closing the electronic shutter before reducing the amount of light of the illumination light irradiated from the light source device to the subject as the luminance level becomes higher; The second dimming control includes: A medical control device that performs control to reduce the amount of light irradiated from the light source device to the subject before closing the electronic shutter as the luminance level becomes higher.
2. The first type is: An endoscope for the abdominal cavity, The second type is:
2. The medical control device according to claim 1, which is an otological endoscope.
3. The type determination unit is The medical control device according to claim 1 , wherein the type of the endoscope is determined based on at least one of a region of the subject image included in the captured image and a mask region other than the subject image included in the captured image.
4. The type determination unit is The medical control device according to claim 1 , wherein the type of the endoscope is determined based on type information that is stored in a storage unit provided in the endoscope and indicates the type of the endoscope.
5. The maximum light amount of the light irradiated from the light source device to the subject in the first light adjustment control is The medical control device according to claim 1 , wherein the amount of light emitted from the light source device to the subject is greater than a maximum value in the second light adjustment control.
6. The minimum value of the amount of light of the light irradiated from the light source device to the subject in the first light adjustment control is The medical control device according to claim 1 , wherein the amount of light emitted from the light source device to the subject is greater than a minimum value of the amount of light in the second light adjustment control.
7. The light control unit is The medical control device of claim 1, wherein as the brightness level increases, at least one of the analog gain multiplied by the analog signal corresponding to the captured image and the digital gain multiplied by the digital signal corresponding to the captured image is lowered before the electronic shutter is closed.
8. an image acquisition unit that acquires an image generated by an image sensor that captures an image of a subject captured by an endoscope; a luminance calculation unit that calculates a luminance level of the subject image included in the captured image; a light control unit that controls an amount of light irradiated from a light source device to an object and an electronic shutter of the image sensor based on the luminance level, The light control unit is The medical control device executes a second light adjustment control to reduce the amount of the light irradiated from the light source device to the subject before closing the electronic shutter as the luminance level becomes higher.
9. an imaging element for capturing an image of a subject captured by an endoscope; A light source device that supplies light to an object; a medical control device for controlling operations of the imaging element and the light source device, The medical control device includes: an image acquisition unit that acquires an image generated by the imaging element; a luminance calculation unit that calculates a luminance level of the subject image included in the captured image; a light control unit that controls an amount of light emitted from the light source device to a subject and an electronic shutter of the image sensor based on the luminance level; a type discrimination unit that discriminates the type of the endoscope, The light control unit is When the type of the endoscope is a first type, a first light adjustment control is executed; When the type of the endoscope is a second type different from the first type, a second light adjustment control different from the first light adjustment control is executed; The first dimming control includes: a control for closing the electronic shutter before reducing the amount of light of the illumination light irradiated from the light source device to the subject as the luminance level becomes higher; The second dimming control includes: A medical observation system in which the amount of light irradiated from the light source device to the subject before the electronic shutter is closed is reduced as the luminance level becomes higher.
10. an imaging element for capturing an image of a subject captured by an endoscope; A light source device that supplies light to an object; a medical control device for controlling operations of the imaging element and the light source device, The medical control device includes: an image acquisition unit that acquires an image generated by the imaging element; a luminance calculation unit that calculates a luminance level of the subject image included in the captured image; a light control unit that controls an amount of light emitted from the light source device to a subject and an electronic shutter of the image sensor based on the luminance level, The light control unit is The medical observation system executes a second light adjustment control to reduce the amount of the light irradiated from the light source device to the subject before closing the electronic shutter as the luminance level becomes higher.
Citation Information
Patent Citations
Endoscope unit
JP1998192232A
Imaging system
JP2002112958A
Still image recordable electronic endoscope device
JP2003305007A
Endoscope system
JP2007037565A
Endoscopic system
JP2012085790A
