Medical control devices and medical observation devices

By using the brightness control unit in the endoscope system to adjust the brightness of the imaging signal according to the dynamic range of the display device, the problems of compact cameras and blurred images in the endoscope system are solved, the effect of reducing halos is achieved, and the observation goal is improved visibility of the region.

CN112566539BActive Publication Date: 2024-11-01SONY OLYMPUS MEDICAL SOLUTIONS +1
View PDF 6 Cites 0 Cited by

Patent Information

Application Number
CN201980053855.1
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Priority Date
2018-08-21
Filing Date
2019-06-14
Publication Date
2024-11-01
Estimated Expiration
2039-06-14

AI Technical Summary

Technical Problem

In an endoscope system, due to the compact camera requirements, it is difficult to use large image sensors, and when synthesizing long-exposure and short-exposure images to generate HDR images, the movement of objects or devices leads to blurring the image, which cannot effectively reduce halos.

Method used

In the medical control device, the brightness control unit is used to adjust the brightness of the imaging signal according to the dynamic range of the display device, and reduce the halo, so that the brightness control of the image captured in the mobile imaging device is realized, and the appearance of the halo is reduced.

Benefits of technology

It effectively reduces the appearance of halos in medical images, improves the visibility of observing target area information and color in the endoscopic system, and avoids image blurring.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN112566539B_ABST
    Figure CN112566539B_ABST
Patent Text Reader

Abstract

A medical control device includes: a display control unit that causes a display device for displaying an image to display a medical image generated from an imaging signal generated by an imaging device for receiving light from an observation target; and a brightness control unit that controls the brightness of the imaging signal in such a manner that the display control unit displays the medical image with a predetermined brightness. The brightness control unit performs control when a dynamic range of the display device is set to a second value greater than a first value to reduce the brightness of the imaging signal compared to the brightness of the imaging signal that displays the medical image with the predetermined brightness when the dynamic range is set to the first value.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present disclosure relates to a medical control device and a medical observation device. Background Art

[0002] In a medical environment, when an imaging device captures an image of an observation target (such as inside a patient's body), there may be a situation where an object other than the observation target (such as forceps or gauze) is captured as part of the photographic subject. In this case, the brightness of the captured image displayed in the display device matches the brightness of the forceps or gauze, resulting in an increase in the overall brightness of the image displayed in the display device. This sometimes causes halos in the displayed image, resulting in loss of information and color in the area that the operator wishes to observe.

[0003] Generally, in order to reduce halo, it is effective to expand the dynamic range of the image sensor. For example, by using a large image sensor with a large cell size, the dynamic range of the image sensor can be expanded. As a result, it is possible to capture an image corresponding to a wide dynamic range, thereby reducing halo that occurs when the image is displayed in a display device. Alternatively, in order to reduce halo, it is also effective to perform HDR (High Dynamic Range) imaging, in which multiple brightness images captured at different timings are synthesized by changing the shutter speed for imaging. As a result, an image corresponding to a wide dynamic range can be generated, thereby reducing halo that occurs when the image is displayed.

[0004] For reference, in Patent Document 1 mentioned below, a technique is disclosed in which, when converting a wide dynamic range image into a narrow dynamic range image, luminance at an arbitrary position in an image is optimized based on a user operation.

[0005] Reference List

[0006] Patent Literature

[0007] Patent Document 1: Japanese Patent Application Publication No. 2002-135589 Summary of the invention

[0008] Technical issues

[0009] However, in an endoscope system, it is difficult to use a large image sensor because a compact camera is required. In addition, in a shooting method that synthesizes a long exposure image and a short exposure image to generate an HDR image, any movement of the subject or the imaging device causes image blur. Therefore, it is not desirable to use this shooting method in an endoscope system for observing the internal conditions of a body while moving the imaging device. In this regard, with respect to an endoscope system, it is necessary to reduce halo without using a large image sensor and without using the above-mentioned shooting method.

[0010] In this regard, in the present disclosure, a novel and improved form of a medical control device and a medical observation device is proposed, which can achieve a reduction in halos that appear in images taken for medical purposes.

[0011] Solution to the problem

[0012] According to the present disclosure, a medical control device is provided, comprising: a display control unit configured to display, in a display device configured to display an image, a medical image generated from an imaging signal generated by an imaging device configured to receive light from an observation target; and a brightness control unit configured to control the brightness of the imaging signal in such a manner that the display control unit displays the medical image with a predetermined brightness, wherein, when a dynamic range of the display device is set to a second value greater than a first value, the brightness control unit is configured to perform control to reduce the brightness of the imaging signal compared to the brightness of the imaging signal that displays the medical image with the predetermined brightness when the dynamic range is set to the first value.

[0013] In addition, according to the present disclosure, a medical observation device is provided, which includes: a light source configured to emit light; an imaging device configured to capture an image of an observation target; a display control unit configured to display a medical image generated from an imaging signal generated by an imaging device configured to receive light from the observation target in a display device configured to display the image; and a brightness control unit configured to control the brightness of the imaging signal in such a manner that the display control unit displays the medical image with a predetermined brightness, wherein, when a dynamic range of the display device is set to a second value greater than a first value, the brightness control unit is configured to perform control to reduce the brightness of the imaging signal compared to the brightness of the imaging signal that displays the medical image with the predetermined brightness when the dynamic range is set to the first value.

[0014] Advantageous Effects of the Invention

[0015] As described above, according to the present disclosure, halos occurring in images taken for medical purposes can be reduced. Meanwhile, the above-mentioned effects are not necessarily limited in scope, and any other effects indicated in this written description or any other effects that may arise from this written description may be achieved instead of or in addition to the above-mentioned effects. BRIEF DESCRIPTION OF THE DRAWINGS

[0016] Figure 1 It is an explanatory diagram for explaining the outline of an embodiment of the present disclosure.

[0017] Figure 2 is an explanatory diagram showing an exemplary configuration of the medical observation system according to the first embodiment.

[0018] Figure 3is a block diagram illustrating an exemplary functional configuration of the medical observation apparatus according to the first embodiment.

[0019] Figure 4 1 is an explanatory diagram showing an input-output relationship in the medical observation apparatus according to the first embodiment.

[0020] Figure 5 : is an explanatory diagram showing an example of an input-output relationship in the display device according to the first embodiment.

[0021] Figure 6 is an explanatory diagram showing an exemplary display of a medical image according to the first embodiment.

[0022] Figure 7 is a sequence diagram for explaining the flow of operations performed in the medical observation system according to the first embodiment.

[0023] Figure 8 is a flowchart for explaining the flow of operations performed in the determination operation according to the first embodiment.

[0024] Fig. 9 is a flowchart for explaining the flow of operations performed in the correction operation according to the first embodiment.

[0025] Fig.10 is a flowchart for explaining the flow of operations performed in the display operation according to the first embodiment.

[0026] Fig.11 is an explanatory diagram showing an exemplary configuration of a medical observation system according to the second embodiment.

[0027] Fig.12 : is an explanatory diagram showing an example of gamma correction intended for a plurality of display devices according to the second embodiment.

[0028] Fig.13 is a sequence diagram for explaining the flow of operations performed in the medical observation system according to the second embodiment.

[0029] Fig.14 is a flowchart for explaining the flow of operations performed in the correction operation according to the second embodiment.

[0030] Fig.15 is an explanatory diagram for explaining a determination operation according to the second modification example. DETAILED DESCRIPTION

[0031] The preferred embodiments of the present disclosure are described in detail below with reference to the accompanying drawings. In the present specification and the accompanying drawings, constituent elements having substantially the same functional configuration are denoted by the same reference numerals, and their descriptions are not repeated.

[0032] The instructions are given in the following order.

[0033] 1. Overview

[0034] 2. First embodiment

[0035] 2.1. Example System Configuration

[0036] 2.2. Example functional configuration

[0037] 2.3. Operation examples

[0038] 3. Second embodiment

[0039] 3.1. Example System Configuration

[0040] 3.2. Example functional configuration

[0041] 3.3. Operation examples

[0042] 4. Modify the example

[0043] 5. Summary

[0044] <<1. Overview>>

[0045] Reference below Figure 1 What is described is an overview of embodiments of the present disclosure. Figure 1 1 is an explanatory diagram for explaining an overview of an embodiment of the present disclosure. The following description is made with reference to an example in which a medical control device according to an embodiment of the present disclosure is implemented in an endoscope system used in a medical environment. However, the target system in which the medical control device can be implemented is not limited to the endoscope system. Alternatively, for example, the medical control device can also be implemented in a medical observation system in which an image of an observation target such as a patient is captured using an imaging device.

[0046] In an endoscope system, when an imaging device captures an image of an observation target (such as inside a patient's body), there may be a situation where an object other than the observation target (such as forceps or gauze) is captured as part of the photographic subject. In this case, the brightness of the captured image displayed in the display device matches the brightness of the forceps or gauze, resulting in an increase in the overall brightness of the image displayed in the display device. This sometimes causes a halo in the displayed image, resulting in a loss of information and color in the area that the operator wishes to observe.

[0047] Generally, in order to reduce halo, it is effective to expand the dynamic range of the image sensor. For example, by using a large image sensor with a large cell size, the dynamic range of the image sensor can be expanded. As a result, it is possible to capture an image corresponding to a wide dynamic range, thereby reducing halo that occurs when the image is displayed in a display device. Alternatively, in order to reduce halo, it is also effective to perform HDR (High Dynamic Range) imaging, in which multiple brightness images captured at different timings are synthesized by changing the shutter speed for imaging. As a result, an image corresponding to a wide dynamic range can be generated, thereby reducing halo that occurs when the image is displayed.

[0048] However, in an endoscope system, it is difficult to use a large image sensor because a compact camera is required. In addition, in a shooting method that synthesizes a long exposure image and a short exposure image to generate an HDR image, any movement of the subject or the imaging device causes image blur. Therefore, it is not desirable to use this shooting method in an endoscope system for observing the internal conditions of a body while moving the imaging device. In this regard, with respect to an endoscope system, it is necessary to reduce halo without using a large image sensor and without using the above-mentioned shooting method.

[0049] The embodiments of the present disclosure are conceived by focusing on the above-mentioned problems, and propose a technology that can achieve reduction of halation that appears in images captured for medical purposes. For example, a medical control device is proposed, in which the brightness of an imaging signal generated by an imaging device that receives light from an observation target is controlled; and a medical image generated from the imaging signal is displayed in a display device for displaying images.

[0050] More specifically, in the medical control device, the brightness of the imaging signal is controlled in such a manner that the higher the dynamic range of the display device 20, the lower the brightness of the imaging signal. This is because the higher the dynamic range of the display device, the more likely the display device is to display a medical image with high brightness; and the higher the brightness, the more likely the displayed medical image will have a halo. Therefore, in the medical control device, according to the brightness of the medical image to be displayed in the display device, the image of the observation target is captured by lowering the brightness, so that it is possible to achieve reduction of the halo that occurs when the medical image is displayed in the display device by increasing the brightness.

[0051] In an embodiment according to the present disclosure, a display device indicating a high level of dynamic range is a display device with a high dynamic range (HDR). Here, an HDR display device is a display device having a maximum brightness of more than 1000 nits for a displayable image. On the other hand, a display device indicating a low level of dynamic range is a display device with a standard dynamic range (SDR). Here, an SDR display device is a display device having a maximum brightness of less than 1000 nits for a displayable image. At the same time, the type of display device based on the dynamic range is not limited to an HDR display device and an SDR display device, and there may be a display device based on some other dynamic range. The following description is given for an example in which a display device for displaying a medical image is an HDR display device or an SDR display device.

[0052] exist Figure 1 In FIG. 1 , the dashed line graph represents the input-output relationship in the SDR display device; the double dashed line graph represents the input-output relationship in the HDR display device. Figure 1 As shown, the imaging signal according to the embodiment of the present disclosure is subjected to gamma correction and inverse gamma correction before being finally output as an imaging signal.

[0053] For example, when a medical image is displayed using an HDR display device, the observation target is photographed by reducing the brightness. Therefore, as shown in the graph of the imaging signal when imaging is performed, the output of the HDR display device is smaller than the output of the SDR display device. However, since gamma correction and inverse gamma correction are performed on the imaging signal obtained when the HDR display device is used, the HDR display device can perform an output larger than the output of the SDR display device, as shown in FIG. Figure 1 The curve diagram of the corrected imaging signal is shown in FIG.

[0054] Until now, reference Figure 1 , a description is given about the overview of the embodiments according to the present disclosure. Given below is a description of the first embodiment.

[0055] <<2. First embodiment>>

[0056] Reference below Figures 2 to 10 The first embodiment is described.

[0057] <2.1. Example system configuration>

[0058] Reference below Figure 2 An exemplary configuration of a medical observation system according to a first embodiment of the present disclosure is described. Figure 2 is an explanatory diagram showing an exemplary configuration of the medical observation system 1 according to the first embodiment.

[0059] like Figure 2As shown, the medical observation system 1 according to the first embodiment includes, for example, a medical observation device 10 and a display device 20. For example, when using during surgery Figure 2 When the medical observation device 10 is shown, the operator observes the surgical field while referring to the medical image displayed in the display screen of the display device 20, and performs various surgical procedures according to surgical techniques. In addition, in the same manner, the operator's assistant refers to the medical image displayed in the display screen of the display device 20, and assists the operator in performing various procedures. In the following description, the personnel participating in the surgery, such as the operator and the assistant, are collectively referred to as users.

[0060] Meanwhile, the medical observation system 1 according to the first embodiment is not limited to Figure 2 For example, the medical observation system 1 according to the first embodiment may further include a medical control device (not shown) that controls various operations performed in the medical observation device 10. Figure 2 In the illustrated medical observation system 1 , as will be described later, since a control unit (described later) is included therein, the medical observation device 10 also functions as a medical control device (not shown).

[0061] Examples of the medical control device (not shown) include a “medical controller” and a “computer such as a server.” Meanwhile, the medical control device (not shown) is alternatively an IC (Integrated Circuit) that may be embedded in the above-mentioned device.

[0062] The medical observation system 1 according to the first embodiment may be configured to include one or more medical observation devices 10 and one or more display devices 20. If a plurality of medical observation devices 10 are included, a display control operation (described later) is performed in each medical observation device 10. In addition, when the medical observation system 1 according to the first embodiment is configured to include a plurality of medical observation devices 10 and a plurality of display devices 20, the medical observation devices 10 or the display devices 20 may have a one-to-one correspondence, or a plurality of medical observation devices 10 may be associated with a single display device 20. If a plurality of medical observation devices 10 are associated with a single display device 20; for example, a switching operation may be performed in the display device 20 for switching the medical observation device 10 in which the medical image will be displayed in the display screen.

[0063] The following is a diagram showing a structure according to the first embodiment. Figure 2 A description of each device of the medical observation system 1 is shown.

[0064] (1) Medical observation device 10

[0065] Figure 2 The illustrated medical observation apparatus 10 includes, for example, an insertion member 130 , a light source unit 132 , a light guide 134 , a camera 136 , a cable 138 , and a control unit 140 .

[0066] At the same time, although not Figure 2 , but the medical observation device 10 may also include one or more processors (not shown) configured with an operation circuit such as an MPU (microprocessing unit); ROM (read only memory, not shown); RAM (random access memory, not shown); a recording medium (not shown); and a communication device (not shown). The medical observation device 10 operates, for example, on power supplied from an internal light source (such as a battery installed therein) or power supplied from an external power source connected thereto.

[0067] The processor (not shown) serves as a control unit (not shown) of the medical observation apparatus 10. The ROM (not shown) is used to store programs to be used by the processor (not shown) and to store control data such as operating parameters. The RAM (not shown) is used to temporarily store programs executed by the processor (not shown).

[0068] The recording medium (not shown) is used as a storage unit (not shown) of the medical observation device 10. In the recording medium (not shown), for example, data related to the display control method according to the first embodiment is stored, and various data such as various applications are stored. Examples of the recording medium (not shown) include a magnetic recording medium such as a hard disk; and a non-volatile memory such as a flash memory. Meanwhile, alternatively, the recording medium (not shown) is detachably attached to the medical observation device 10.

[0069] The communication device (not shown) is a communication unit of the medical observation device 10, and plays a role of performing wired communication or wireless communication with an external device such as the display device 20. Examples of the communication device (not shown) include an IEEE 802.15.1 port and a transmission-reception circuit (wireless communication); an IEEE 802.11 port and a transmission-reception circuit (wireless communication); a communication antenna and an RF circuit (wireless communication); and a LAN terminal and a transmission-reception circuit (wired communication).

[0070] (1-1) Insertion member 130

[0071] The insertion member 130 is an elongated member including an optical system for collecting incident light. The front end of the insertion member 130 is inserted into, for example, a body cavity of a patient. The rear end of the insertion member 130 is detachably connected to the front end of the camera 136. In addition, the insertion member 130 is connected to the light source unit 132 via the light guide 134 and receives light supply from the light source unit 132.

[0072] The insertion member 130 may be made of, for example, a non-flexible material or a flexible material. Depending on the material used to manufacture the insertion member 130, the medical observation device 10 may be referred to as a rigid endoscope or a flexible endoscope.

[0073] (1-2) Light source unit 132

[0074] The light source unit 132 is connected to the insertion member 130 via the light guide 134. The light source unit 132 supplies light to the insertion member 130 via the light guide 134.

[0075] The light source unit 132 includes, for example, a plurality of light sources that emit light of different wavelengths. Examples of the plurality of light sources of the light source unit 132 include a light source that emits red light, a light source that emits green light, and a light source that emits blue light. Examples of light sources that emit red light include one or more red light emitting diodes. Examples of light sources that emit green light include one or more green light emitting diodes. Examples of light sources that emit blue light include one or more blue light emitting diodes. Meanwhile, it goes without saying that the plurality of light sources of the light source unit 132 are not limited to the examples given above. In addition, for example, in the light source unit 132, the plurality of light sources are mounted on a single chip or on a plurality of chips.

[0076] The light source unit 132 is connected to the control unit 140 in a wired or wireless manner, and emission of light from the light source unit 132 is controlled by the control unit 140 .

[0077] The light supplied to the insertion member 130 is emitted from the front end of the insertion member 130, and then an observation target such as a patient's body tissue is illuminated with the light. Subsequently, reflected light from the observation target is collected by an optical system installed in the insertion member 130.

[0078] (1-3) Camera 136

[0079] The camera 136 has a function of capturing an image of an observation target. The camera 136 is connected to the control unit 140 via a cable 138 representing a signal transmission member.

[0080] The camera 136 includes an image sensor; captures an image of the observation target by photoelectrically converting the reflected light reflected from the observation target and collected by the insertion member 130; and generates an imaging signal (a signal representing a medical image). The camera 136 then outputs the generated imaging signal to the control unit 140 via the cable 138. Examples of the image sensor installed in the camera 136 include an image sensor using a plurality of imaging elements such as a CMOS (Complementary Metal Oxide Semiconductor) or a CCD (Charge Coupled Device).

[0081] In the medical observation device 10 serving as an endoscope device; for example, the insertion member 130, the light source unit 132, and the camera 136 function as an "imaging device that is inserted into a body cavity of a patient and captures an image of the body cavity."

[0082] Meanwhile, the medical observation device 10 used as an endoscope device may be configured to include, for example, a plurality of imaging devices used as so-called stereo cameras. In the configuration including the imaging device used as a stereo camera, the optical system may be a Galilean optical system or a Greenough-type optical system in the same manner as the medical observation device 10 constituting the medical observation system according to the first embodiment.

[0083] (1-4) Control Unit 140

[0084] The control unit 140 controls the imaging device, and more specifically, controls the light source unit 132 and the camera 136 .

[0085] In addition, the control unit 140 includes a communication device (not shown) for transmitting the imaging signal output from the camera 136 to the display device 20 using any wireless communication or any wired communication. Here, the control unit 140 may transmit the imaging signal and the display control signal to the display device 20.

[0086] Examples of the communication device (not shown) included in the control unit 140 include an IEEE 802.15.1 port and a transmission-reception circuit (wireless communication); an IEEE 802.11 port and a transmission-reception circuit (wireless communication); a communication antenna and an RF circuit (wireless communication); an optical communication device (wired communication or wireless communication); and a LAN terminal and a transmission-reception circuit (wired communication). Meanwhile, the communication device (not shown) may be configured to be able to perform communication with one or more external devices using a variety of communication methods.

[0087] In addition, the control unit 140 may perform predetermined processing on the imaging signal output from the camera 136, and may transmit the processed imaging signal to the display device 20. Examples of the predetermined processing on the imaging signal include white balance adjustment, image enlargement / reduction according to an electronic zoom function, and inter-pixel correction.

[0088] The control unit 140 may also store a medical image based on the imaging signal. Examples of the control unit 140 include a CCU (Camera Control Unit).

[0089] Therefore, the medical observation device 10 used as an endoscope device has the following features: Figure 2 In the medical observation apparatus 10 used as an endoscope apparatus, for example, the insertion member 130 , the light source unit 132 , and the camera 136 function as an imaging apparatus; and imaging performed in the imaging apparatus is controlled by the control unit 140 .

[0090] (2) Display device 20

[0091] The display device 20 is a display unit in the medical observation system 1 according to the first embodiment, and is equivalent to an external display device from the perspective of the medical observation device 10. The display device 20 displays various images such as medical images captured in the medical observation device 10 and images related to a UI (User Interface) on a display screen. More specifically, the display device 20 generates a medical image based on an imaging signal transmitted from the control unit 140, and displays the generated medical image on a display screen.

[0092] In addition, the display device 20 may also include a configuration capable of performing 3D display according to an arbitrary method. The display performed in the display device 20 is controlled by, for example, the medical observation device 10 or a medical control device (not shown).

[0093] In the medical observation system 1 , the display device 20 is installed at any position of an operating room used for surgical operations, such as a wall, a ceiling, or a floor, which is visible to a user in the surgical room.

[0094] Examples of the display device 20 include a liquid crystal display, an organic EL (Electro Luminescence) display, and a CRT (Cathode Ray Tube) display.

[0095] However, the display device 20 is not limited to the examples given above. Alternatively, for example, the display device 20 may be any wearable device that a user can wear, such as a head-mounted display or a glasses-type device.

[0096] The display device 20 operates, for example, based on power supplied from an internal light source such as a battery installed therein or power supplied from an external power source connected thereto.

[0097] <2.2. Exemplary Functional Configuration>

[0098] Reference below Figures 3 to 7 An exemplary functional configuration of the medical observation system 1 is described.

[0099] <2.2.1. Exemplary Functional Configuration of Medical Observation Apparatus 10>

[0100] Reference below Figure 3 and Figure 4 An exemplary functional configuration of the medical observation apparatus 10 according to the first embodiment is described. Figure 3 1 is a block diagram showing an exemplary functional configuration of the medical observation apparatus 10 according to the first embodiment. Figure 3 As shown, the medical observation apparatus 10 according to the first embodiment includes, for example, an imaging unit 100 , a control unit 110 , and a communication unit 120 .

[0101] (1) Imaging unit 100

[0102] The imaging unit 100 captures an image of an observation target. The imaging unit 100 is configured with, for example, Figure 2 Shown are an insertion member 130, a light source unit 132, and a camera 136. The imaging performed by the imaging unit 100 is controlled by the control unit 110, for example.

[0103] (2) Control unit 110

[0104] The control unit 110 is configured with, for example, a processor (not shown) as described above, and plays a role in overall control of the medical observation apparatus 10. In addition, the control unit 110 plays a leading role in performing an imaging control operation (described later) and a display control operation (described later). The imaging control operation and the display control operation performed by the control unit 110 may be performed on a plurality of processing circuits (e.g., a plurality of processors) in a decentralized manner.

[0105] More specifically, if Figure 3 As shown, the control unit 110 includes a brightness control unit 112 and a display control unit 114 .

[0106] (2-1) Brightness Control Unit 112

[0107] The brightness control unit 112 controls the imaging device constituting the imaging unit 100. For example, when the imaging device captures an image of an observation target, the brightness control unit 112 performs an imaging control operation for controlling the brightness. More specifically, the brightness control unit 112 identifies the dynamic range of the display device 20 based on the determination information capable of determining the display device 20. Then, the brightness control unit 112 decides a brightness target value corresponding to the identified dynamic range of the display device 20. More specifically, the imaging control operation includes a determination information acquisition operation, a determination operation, and a brightness target value decision operation described below.

[0108] (Confirm information acquisition operation)

[0109] The brightness control unit 112 first obtains determination information that enables determination of the display device 20 connected to the medical observation device 10. The determination information may include operation information and dynamic range information.

[0110] The operation information indicates information related to an operation input by the user by performing a predetermined operation. For example, the user performs a selection operation for selecting the display device 20 in which the medical image is to be displayed. The brightness control unit 112 obtains information related to the display device 20 selected by the user as the operation information (determination information).

[0111] The dynamic range information refers to information indicating the dynamic range of the display device 20. For example, the brightness control unit 112 obtains the dynamic range information from the display device 20 connected to the medical observation device 10. Alternatively, the brightness control unit 112 may obtain identification information from the display device 20 connected to the medical observation device 10; and then may obtain the dynamic range information of the display device 20 based on the identification information. For example, based on the obtained identification information, the brightness control unit 112 refers to the dynamic range information of the display device 20 pre-registered in the storage unit of the medical observation device 10, and obtains the dynamic range information of the display device 20.

[0112] Meanwhile, if the medical observation device 10 and the display device 20 are connected to each other via a cable that allows only one-way communication, dynamic range information or identification information cannot be obtained from the display device 20. Then, the brightness control unit 112 obtains the previously described operation information. On the other hand, if the medical observation device 10 and the display device 20 are connected to each other via a cable that enables two-way communication, the brightness control unit 112 obtains dynamic range information or identification information from the display device 20. Examples of cables that support only one-way communication include SDI (serial digital interface) cables. Examples of cables that support two-way communication include HDMI (high-definition multimedia interface) cables and display port cables. When the medical observation device 10 and the display device 20 are connected using an SDI cable, the medical observation device 10 sends a user ID to the display device 20; and the display device 20 can perform inverse gamma correction and brightness adjustment based on the user ID. In that case, it is assumed that the user ID is associated with the display device 20 used by the user.

[0113] (Confirm operation)

[0114] The brightness control unit 112 identifies the dynamic range of the display device 20 based on the obtained determination information. For example, the brightness control unit 112 identifies the dynamic range of the display device 20 based on a predetermined selection operation. More specifically, the brightness control unit 112 refers to the operation information obtained as the determination information, and confirms the display device 20 selected according to the selection operation performed by the user. Then, the brightness control unit 112 identifies the dynamic range of the display device 20 selected by the user as the dynamic range of the display device 20 connected to the medical observation device 10. Alternatively, the brightness control unit 112 identifies the dynamic range of the display device 20 based on the dynamic range information obtained as the determination information. More specifically, as the dynamic range of the display device 20 connected to the medical observation device 10, the brightness control unit 112 identifies the dynamic range indicated by the dynamic range information obtained as the determination information.

[0115] The brightness control unit 112 determines a method for causing the imaging unit 100 to capture an image of the observation target based on the dynamic range of the display device 20 identified in the determination operation. For example, when the dynamic range of the display device 20 is HDR, the display device 20 displays the medical image by increasing the brightness. For this reason, the brightness control unit 112 determines to cause the imaging unit 100 to capture an image of the observation target by reducing the brightness. On the other hand, when the dynamic range of the display device 20 is SDR, the display device 20 displays the medical image without increasing the brightness. For this reason, the brightness control unit 112 determines to cause the imaging unit 100 to capture an image of the observation target without reducing the brightness.

[0116] (Brightness target value determines operation)

[0117] According to the result of the determination, the brightness control unit 112 determines a brightness target value when capturing an image of the observation target. For example, when it is decided to make the imaging unit 100 capture an image of the observation target by reducing the brightness, the brightness control unit 112 compares the dynamic range of the display device 20 with the predetermined dynamic range, and determines the brightness target value based on the comparison result. More specifically, the brightness control unit 112 extracts the difference between the maximum value of the dynamic range of the display device 20 and the maximum value of the predetermined dynamic range; and determines the brightness target value based on the difference.

[0118] For example, if the maximum value of the dynamic range of the display device 20 is equal to n times (where n is a real number) the maximum value of the predetermined dynamic range, the brightness control unit 112 sets the brightness target value in the display device 20 to 1 / n of the brightness target value corresponding to the predetermined dynamic range. More specifically, it is assumed that the dynamic range of the display device 20 connected to the medical observation device 10 is HDR, and it is assumed that the maximum value of the dynamic range of the HDR display device 20 is twice the maximum value of the dynamic range of the SDR display device 20. In that case, the brightness control unit 112 sets the brightness target value in the HDR display device 20 to half of the brightness target value in the SDR display device 20.

[0119] At the same time, the brightness target value can be determined in such a way that the brightness increases when the imaging device captures an image of the observation target. In addition, when calculating the brightness target value in the display device 20, the scale factor to be multiplied by the target value corresponding to the predetermined dynamic range is not limited to 1 / n, and can be set to an arbitrary scale factor.

[0120] (Brightness control operation)

[0121] For example, the brightness control unit 112 controls the amount of light emitted by the light source unit 132, and adjusts the brightness when the imaging unit 100 captures an image of the observation target. More specifically, if the brightness during imaging is to be increased, the brightness control unit 112 increases the amount of light emitted by the light source unit 132. This results in an increase in the amount of light projected onto the observation target. Therefore, the brightness during imaging is increased, and the brightness of the imaging signal is also increased. On the other hand, if the brightness during imaging is to be reduced, the brightness control unit 112 reduces the amount of light emitted by the light source unit 132. This results in a decrease in the amount of light projected onto the observation target. Therefore, the brightness during imaging is reduced, and the brightness of the imaging signal is also reduced.

[0122] (Other control operations)

[0123] For example, the brightness control unit 112 may also control one or more functions provided in a common microscope of the electronic imaging type, such as controlling an AF function including a zoom function (an optical zoom function and an electronic zoom function).

[0124] (2-2) Display Control Unit 114

[0125] The display control unit 114 controls display of the medical image in the display device 20. Regarding control of display of the medical image, for example, the display control unit 114 performs a display control operation and controls brightness when the medical image is displayed in the display device 20.

[0126] Reference below Figure 4 This describes the gamma correction. Figure 4 1 is an explanatory diagram showing an input-output relationship in the medical observation apparatus 10 according to the first embodiment. Figure 4 In the graph shown, the longitudinal axis represents data input to the medical observation apparatus 10 , and the transverse axis represents data output from the medical observation apparatus 10 .

[0127] Typically, in the display device 20, ideally, an image corresponding to the input imaging signal is output without modification. In order to ensure such an ideal output of the image, it is necessary to set the gamma value indicating the input-output relationship in the display device 20 to 1.0. However, typically, the gamma value in the display device 20 is set to 2.2 instead of 1.0; and an operation called inverse gamma correction is performed, in which the RGB value of the input imaging signal is reduced so as to reduce the brightness of the medical image corresponding to the imaging signal. For this reason, if the imaging signal is input to the display device 20 without modification from the state obtained at the time of imaging, the medical image is displayed at a lower brightness due to the inverse gamma correction performed in the display device 20. Therefore, before the imaging signal is input to the display device, if the RGB value is increased in advance, the medical image can be prevented from being displayed at a lower brightness in the display device 20. The operation of increasing the RGB value in advance is called gamma correction.

[0128] When the gamma value is set to 1.0, the input-output relationship becomes Figure 4 When the gamma line is set to 2.2, the input-output relationship becomes as follows Figure 4 , and is equivalent to the input-output relationship in the SDR display device 20. On the other hand, the input-output relationship in the HDR display device 20 becomes as follows Figure 4 The double-dotted line in . The double-dotted line represents the input-output relationship based on the HLG (Hybrid Log Gamma) method. Alternatively, the input-output relationship in the HDR display device 20 may be based on the PQ (Perceptual Quantization) method.

[0129] In the medical observation apparatus 10 according to the first embodiment, the display control unit 114 performs gamma correction on the imaging signal based on the gamma value of the display device 20, and displays the medical image generated from the gamma-corrected imaging signal in the display device 20. For example, the display control unit 114 performs gamma correction on the imaging signal in such a manner that the intermediate brightness values ​​of the medical image displayed in the relevant display device 20 and the display device 20 having a predetermined gamma value are the same. More specifically, when the medical image is to be displayed in the HDR display device 20, the display control unit 114 performs gamma correction in such a manner that the intermediate brightness values ​​of the medical image displayed in the HDR display device 20 and the SDR display device 20 having a gamma value of 2.2 are the same. As a result, the medical image can be displayed in each type of display device 20 in such a manner that the medical image has the same visibility in the HDR display device 20 and the SDR display device 20.

[0130] (3) Communication unit 120

[0131] The communication unit 120 is a communication unit installed in the medical observation device 10, and realizes the role of wireless communication or wired communication with an external device such as the display device 20. The communication unit 120 is configured with, for example, the above-mentioned communication device (not shown). The communication performed by the communication unit 120 is controlled by, for example, the control unit 110.

[0132] <2.2.2. Example Functional Configuration of Display Device 20>

[0133] Reference below Figure 5 and Figure 6 An exemplary functional configuration of the display device 20 according to the first embodiment is described. Figure 5 1 is an explanatory diagram showing an example of an input-output relationship in the display device 20 according to the first embodiment. Figure 5 In the graph shown, the horizontal axis represents data input to the display device 20 , and the vertical axis represents data output from the display device 20 .

[0134] The display device 20 includes at least a control unit (not shown). The control unit performs inverse gamma correction on the imaging signal that has increased RGB values ​​due to gamma correction. Thus, the control unit reduces the RGB values ​​of the imaging signal and makes them closer to those obtained by Figure 5 The dotted line in FIG. 2 indicates an ideal input-output relationship, and then the imaging signal is displayed as a medical image in the display device 20 .

[0135] When a medical image is to be displayed in the SDR display device 20, the control unit is based on Figure 5 The input-output relationship indicated by the dashed line shown in is used to perform inverse gamma correction. The input-output relationship indicated by the dashed line represents the input-output relationship when the gamma value is set to 2.2. When a medical image is to be displayed in the HDR display device 20, the control unit performs inverse gamma correction based on the input-output relationship indicated by the dashed line shown in . Figure 5 The input-output relationship indicated by the double-dashed line shown in the figure is used to perform inverse gamma correction. The input-output relationship indicated by the double-dashed line represents an input-output relationship based on the HLG (Hybrid Log-Gamma) method. Alternatively, in the HDR display device 20, the input-output relationship may be based on the PQ (Perceptual Quantization) method.

[0136] Reference below Figure 6 The medical image displayed on the display device 20 is described. Figure 6 FIG. 1 is an explanatory diagram showing an exemplary display of a medical image according to the first embodiment. Figure 6 In the upper part of FIG. , a medical image displayed in the SDR display device 20 is shown. Figure 6 The lower part of FIG. 1 shows a medical image displayed in the HDR display device 20. Figure 6The left part of shows the medical image obtained during imaging. Figure 6 The right part of , shows the corrected medical image.

[0137] The upper left medical image is intended to be displayed in an SDR display device. Therefore, the medical image has been captured at normal brightness without reducing the brightness, and a halo appears in the observation target 50. In the upper right medical image obtained by correcting the upper left medical image, the brightness is increased due to the correction compared to the upper left medical image, but the halo in the observation target 50 still exists.

[0138] The lower left medical image is intended to be displayed in an HDR display device. Therefore, the medical image has been captured at a lower brightness than that of the upper left medical image, and there is no halo in the observation target 50. In the lower right medical image obtained by correcting the lower left medical image, there is no halo in the observation target 50 even if the correction has resulted in a higher brightness compared to the brightness of the lower left medical image.

[0139] <2.3. Operation examples>

[0140] Reference below Figures 7 to 10 An example of operations performed in the medical observation system 1 according to the first embodiment is described.

[0141] (1) Operation example of the entire medical observation system 1

[0142] First, a description is given about the sequence of operations performed in the medical observation system 1 for displaying a medical image in the display device 20 . Figure 7 1 is a sequence diagram for explaining the flow of operations performed in the medical observation system 1 according to the first embodiment.

[0143] like Figure 7 As shown, first, the control unit 110 obtains determination information (step S1000). Then, based on the determination information, the control unit 110 performs a determination operation for determining the dynamic range of the display device 20 connected to the medical observation device 10 (step S1002). Details of the determination operation will be described later. Subsequently, based on the result of the determination operation, the control unit 110 determines a brightness target value (step S1004). Then, the control unit 110 outputs an imaging instruction to the imaging unit 100 for capturing a medical image having a brightness equal to the determined brightness target value (step S1006).

[0144] When receiving input of an imaging instruction from the control unit 110 , the imaging unit 100 captures an image of the observation target according to the imaging instruction (step S1008 ), and outputs an imaging signal obtained as a result of performing imaging to the control unit 110 (step S1010 ).

[0145] When the imaging signal is received from the imaging unit 100, the control unit 110 performs a correction operation on the imaging signal according to the display device 20 to which the imaging signal is to be transmitted (step S1012). Details of the correction operation will be described later. After performing the correction operation, the control unit 110 transmits the corrected imaging signal to the display device 20 via the communication unit 120 (step S1014).

[0146] When the imaging signal is received, the display device 20 performs a display operation for displaying the imaging signal as a medical image (step S1016). Details of the display operation will be described later. As a result of performing the display operation, the medical image is displayed in the display device 20; and the medical observation system 1 ends the operation.

[0147] (2) Confirm the operation

[0148] A detailed description is given below of the determination operation performed by the control unit 110 according to the first embodiment. Figure 8 is a flowchart for explaining the flow of operations performed in the determination operation according to the first embodiment.

[0149] like Figure 8 As shown, first, the control unit 110 refers to the obtained determination information and identifies the dynamic range of the display device 20 connected to the medical observation device 10 (step S1200). Then, the control unit 110 confirms whether the identified dynamic range is HDR (step S1202). If the identified dynamic range is HDR (step S1202 is "yes"), the control unit 110 decides to make the imaging unit 100 take an image of the observation target by reducing the brightness (step S1204). On the other hand, if the identified dynamic range is not HDR (step S1202 is "no"), the control unit 110 decides to make the imaging unit 100 take an image of the observation target without reducing the brightness (step S1206). Then, the control unit 110 ends the determination operation.

[0150] (3) Correction operation

[0151] A detailed description is given below of the correction operation performed by the control unit 110 according to the first embodiment. Fig. 9 is a flowchart for explaining the flow of operations performed in the correction operation according to the first embodiment.

[0152] like Fig. 9As shown, first, the control unit 110 adjusts the white balance of the input imaging signal (step S1400). Then, the control unit 110 performs gamma correction according to the dynamic range of the display device 20 (step S1402). For example, when the dynamic range is HDR; the control unit 110 performs gamma correction on the imaging signal using the gamma value corresponding to HDR. Similarly, when the dynamic range is SDR; the control unit 110 performs gamma correction on the imaging signal using the gamma value corresponding to SDR. Then, the control unit 110 converts the gamma-corrected imaging signal from RGB to YCbCr (step S1404), and ends the correction operation.

[0153] (4) Display operation

[0154] Given below is a detailed description of a display operation performed in the display device 20 according to the first embodiment. Fig.10 is a flowchart for explaining the flow of operations performed in the display operation according to the first embodiment.

[0155] like Fig.10 As shown, first, the display device 20 converts the received imaging signal from YCbCr to RGB (step S1600). Then, the display device 20 performs inverse gamma correction on the converted imaging signal according to the dynamic range of the display device 20 (step S1602). For example, when the dynamic range is HDR, the display device 20 performs inverse gamma correction on the imaging signal using a gamma value corresponding to HDR. Similarly, when the dynamic range is SDR, the display device 20 performs inverse gamma correction on the imaging signal using a gamma value corresponding to SDR. Then, the display device 20 generates a medical image corresponding to the corrected imaging signal and displays the medical image (step S1604); then the display operation ends.

[0156] So far, reference Figures 2 to 10 The first embodiment has been described. Next, a description is given of the second embodiment.

[0157] <<3. Second embodiment>>

[0158] Reference below Figures 11 to 14 Description of the second embodiment. In the above-mentioned first embodiment, description is given about an example in which a single display device 20 is connected to the medical observation device 10. In the second embodiment, description is given about an example in which a plurality of display devices 20 are connected to the medical observation device 10. Meanwhile, only the differences from the first embodiment are described below, and the same points as the first embodiment are not described again.

[0159] <3.1. Example system configuration>

[0160] Reference below Fig.11An exemplary configuration of a medical observation system 2 according to the second embodiment is described. Fig.11 2 is an explanatory diagram showing an exemplary configuration of a medical observation system 2 according to the second embodiment. Fig.11 As shown, the medical observation system 2 according to the second embodiment includes, for example, a medical observation apparatus 10 , a display apparatus 20A, and a display apparatus 20B.

[0161] The system configuration of the medical observation system 2 according to the second embodiment is the same as that of the medical observation system 1 according to the first embodiment, except for the fact that a plurality of display devices 20 are connected to the medical observation device 10. Therefore, in this section, a detailed description of the system configuration of the medical observation system 2 is not given.

[0162] <3.2. Exemplary Functional Configuration>

[0163] A description is given below of an exemplary functional configuration of the medical observation apparatus 10 according to the second embodiment. Although the functional configuration of the medical observation apparatus 10 according to the second embodiment is the same as that of the medical observation apparatus 10 according to the first embodiment, there are some differences in the operations performed by the control unit 110. Therefore, in this section, a description is given only about those different operations performed by the control unit 110.

[0164] (1) Control unit 110

[0165] The functional configuration of the medical observation apparatus 10 according to the second embodiment is the same as that of the medical observation apparatus 10 according to the first embodiment. However, there are some differences in the operation of each constituent element.

[0166] (1-1) Brightness Control Unit 112

[0167] The brightness control unit 112 according to the second embodiment is different from the brightness control unit 112 according to the first embodiment in that, when deciding the brightness target value, a reference display device 20 is selected from a plurality of display devices 20. When there are a plurality of display devices 20, the brightness control unit 112 controls imaging performed in the imaging device in such a manner that an imaging signal corresponds to the dynamic range of the display device 20 selected from the plurality of display devices 20.

[0168] The display device 20 selected from the plurality of display devices 20 represents, for example, a display device 20 associated with a predetermined user. More specifically, as the display device 20 associated with the predetermined user, a display device 20 associated with the main operator may be selected. Alternatively, as the display device 20 associated with the predetermined user, a display device 20 associated with the assistant of the main operator may be selected. Meanwhile, the display device 20 selected from the plurality of display devices 20 may be, for example, a display device 20 having the highest dynamic range among the plurality of display devices 20. More specifically, as the display device 20 having the highest dynamic range, an HDR display device 20 may be selected. Once a specific display device 20 is selected from the plurality of display devices 20, the brightness control unit 112 decides a brightness target value in the same manner as in the first embodiment.

[0169] (1-2) Display Control Unit 114

[0170] The display control unit 114 according to the second embodiment is different from the display control unit 114 according to the first embodiment in that a plurality of imaging signals matching the characteristics of the display devices 20 are generated for the purpose of displaying medical images in the plurality of display devices 20 .

[0171] When there are a plurality of display devices 20, the display control unit 114 displays, in each display device 20, a medical image generated from an imaging signal that has been gamma-corrected based on a gamma value set in the relevant display device 20. Fig.12 An example of gamma correction according to the second embodiment is described. Fig.12 2 is an explanatory diagram showing an example of gamma correction intended for a plurality of display devices 20 according to the second embodiment. Fig.12 On the left side of FIG. , an example of gamma correction intended for use with the HDR display device 20 is shown. Fig.12 To the right of , an example of gamma correction intended for use with an SDR display device 20 is shown.

[0172] For example, the display control unit 114 performs Fig.12 , and generates imaging signals for the HDR display device 20 from the plurality of display devices 20. Similarly, the display control unit 114 performs gamma correction with respect to the imaging signal. Fig.12 The gamma correction shown in the right graph of is performed, and an imaging signal for the SDR display device 20 is generated from the plurality of display devices 20. Fig.12 In the gamma correction shown in the left graph of , the gamma correction is performed using the entire input imaging signal. Fig.12In the gamma correction shown in the right graph of , gamma correction is performed using only the low level portion of the input imaging signal. As a result, the display control unit 114 becomes able to saturate the high brightness portion of the medical image to be displayed in the SDR display device 20.

[0173] Meanwhile, if a medical image having a brightness corresponding to the brightness target value of the HDR display device 20 determined by the brightness control unit 112 is to be displayed in the SDR display device 20, the display control unit 114 may multiply the gain by the entire captured image. More specifically, a coefficient based on the ratio between the brightness target value of the HDR display device 20 determined by the brightness control unit 112 and the brightness target value of the SDR display device 20 may be multiplied as the gain for the medical image. As a result, when a medical image having a brightness corresponding to the HDR display device 20 is to be displayed in the SDR display device 20, the captured image may also be displayed with excellent brightness in the SDR display device 20.

[0174] <3.3. Operation examples>

[0175] Reference below Fig.13 and Fig.14 An example of operations performed in the medical observation system 2 according to the second embodiment is described.

[0176] (1) Operation example of the entire medical observation system 2

[0177] First, a description is given about the sequence of operations performed in the medical observation system 2 for displaying medical images in the plurality of display devices 20 . Fig.13 is a sequence diagram for explaining the flow of operations performed in the medical observation system 2 according to the second embodiment.

[0178] like Fig.13 As shown, first, the control unit 110 obtains determination information (step S2000). Then, based on the determination information, the control unit 110 performs a determination operation for determining the dynamic range of the display devices 20A and 20B connected to the medical observation device 10 (step S2002). Here, the details of the determination operation are the same as the determination operation described in the first embodiment. Therefore, this section will not be repeated. Subsequently, based on the result of the determination operation, the control unit 110 determines the brightness target value (step S2004). Then, the control unit 110 outputs an imaging instruction to the imaging unit 100 for capturing a medical image having a brightness equal to the determined brightness target value (step S2006).

[0179] When receiving input of an imaging instruction from the control unit 110 , the imaging unit 100 captures an image of the observation target according to the imaging instruction (step S2008 ), and outputs an imaging signal obtained as a result of performing imaging to the control unit 110 (step S2010 ).

[0180] When the imaging signal is received from the imaging unit 100, the control unit 110 performs a correction operation on the imaging signal according to each of the display devices 20A and 20B to which the imaging signal is to be transmitted (step S2012). The details of the correction operation will be described later. After performing the correction operation, the control unit 110 transmits the corrected imaging signal to the display devices 20A and 20B via the communication unit 120 (steps S2014 and S2016).

[0181] When the imaging signal is received, the display devices 20A and 20B perform a display operation for displaying the imaging signal as a medical image (steps S2018 and S2020). The details of the display operation are the same as the display operation described in the first embodiment. Therefore, this section will not repeat them. As a result of performing the display operation, the medical image is displayed in the display devices 20A and 20B; and the medical observation system 2 ends the operation.

[0182] (2) Calibration operation

[0183] A detailed description is given below of the correction operation performed in the control unit 110 according to the second embodiment. Fig.14 is a flowchart for explaining the flow of operations performed in the correction operation according to the second embodiment.

[0184] like Fig.14 As shown, first, the control unit 110 adjusts the white balance of the input imaging signal (step S2200). Then, the control unit 110 performs gamma correction according to the dynamic range of each of the multiple display devices 20, and generates multiple imaging signals (step S2202). For example, if the dynamic range of the display device 20A is HDR, the control unit 110 performs gamma correction on the imaging signal using the gamma value corresponding to HDR, and generates an imaging signal to be sent to the display device 20A. Similarly, if the dynamic range of the display device 20B is SDR, the control unit 110 performs gamma correction on the imaging signal using the gamma value corresponding to SDR, and generates an imaging signal to be sent to the display device 20B. Then, the control unit 110 converts the gamma-corrected imaging signal from RGB to YCbCr (step S2204), and ends the correction operation.

[0185] So far, reference Figures 11 to 14 The second embodiment is described. Next, a description is given of modified examples of the embodiment according to the present disclosure.

[0186] <<4. Modification Example>>

[0187] Given below is a description of a modified example of an embodiment of the present disclosure. The modified example may be applied to the embodiment of the present disclosure individually or in combination. In addition, the modified example may be applied to replace the configuration described in the embodiment of the present disclosure, or may be applied to supplement the configuration described in the embodiment of the present disclosure.

[0188] <4.1. First Modification Example>

[0189] A description is given below of a first modified example of the embodiment according to the present disclosure.

[0190] In the above embodiment, a description is given of an example in which the control unit 110 decides the luminance target value based on the dynamic range. In the first modified example, a description is given of an example in which the control unit 110 further determines the luminance target value based on the display mode of the display device 20.

[0191] Examples of display modes include a 3D mode for displaying a medical image in a 3D view, and a 2D mode for displaying a medical image in a 2D view. Typically, in a display device 20 (e.g., 3D glasses) capable of displaying a medical image in a 3D mode, display is performed at a lower brightness than in a display device 20 for displaying a medical image in a 2D mode. Therefore, in the case of a 3D mode, the control unit 110 determines a brightness target value by taking into account the fact that the medical image is displayed at a lower brightness than in a 2D mode. For example, the control unit 110 determines the brightness target value by taking into account the fact that the imaging device captures an image of the observation target by increasing the brightness, and the 3D glasses representing the display device 20 display the medical image by reducing the brightness. In the case of a 2D mode, the control unit 110 may determine the brightness target value in the same manner as in the above-described embodiment.

[0192] As described above, as a result of determining the brightness target value by also considering the display mode of the display device 20, a medical image with more appropriate brightness can be displayed in the display device 20, thereby enabling enhanced visibility for the user when viewing the medical image.

[0193] <4.2. Second Modification Example>

[0194] Reference below Fig.15 A second modified example of the embodiment according to the present disclosure is described. Fig.15 is an explanatory diagram for explaining a determination operation according to the second modification example.

[0195] In the first modified example of the above-described embodiment, descriptions are given about an example in which the control unit 110 determines the luminance target value based on the dynamic range and an example in which the control unit 110 decides the luminance target value based on the display mode of the display device 20. In the second modified example, descriptions are given about an example in which the control unit 110 further decides the luminance target value based on the type of the imaging device.

[0196] In the above-described embodiment, an explanation is given of an example in which an imaging device emits visible light (e.g., white light) toward an observation target when capturing an image of the observation target. Alternatively, for example, an imaging device that emits special light toward an observation target when capturing an image of the observation target may be used. A medical image captured using special light has no halo. Therefore, if the imaging device captures an image of the observation target using special light, the control unit 110 determines the brightness target value by taking into account the fact that the imaging device captures the image of the observation target without reducing the brightness and the display device 20 displays the medical image without increasing the brightness.

[0197] At the same time, an imaging device that captures images by switching between visible light and special light at regular intervals may also be used. Here, a plurality of medical images captured by switching between visible light and special light at regular intervals are superimposed, and the superimposed medical images are displayed in the display device 20. As described above, the medical images captured using visible light are ensured to have a lower brightness. Therefore, when displaying the superimposed medical image, if the display device 20 does not perform any specific processing on the superimposed medical image, the superimposed medical image is displayed with a lower brightness. To this end, when the imaging device captures an image by switching between visible light and special light, the control unit 110 determines the brightness target value by taking into account the fact that the display device 20 displays the superimposed medical image by increasing the brightness.

[0198] Meanwhile, when the imaging device uses visible light to capture an image of the observation target, the control unit 110 causes the imaging device to capture the image of the observation target with reduced brightness. On the other hand, when the imaging device uses special light to capture an image of the observation target, the control unit 110 causes the imaging device to capture the image of the observation target without reducing brightness.

[0199] When the imaging device captures an image of an observation target by switching between visible light and special light at regular intervals, the flow of the determination operation is different from the description given previously in the embodiment. Fig.15 Instructions to confirm the operation. Fig.15As shown, first, the control unit 110 confirms the type of light emitted by the imaging device onto the observation target (step S3200). Then, the control unit 110 confirms whether the light emitted onto the observation target is visible light (step S3202). If the light emitted onto the observation target is visible light (step S3202 is "yes"), the control unit 110 decides to make the imaging unit 100 take an image of the observation target by reducing the brightness (step S3204). On the other hand, if the light emitted onto the observation target is not visible light (step S3202 is "no"), the control unit 110 decides to make the imaging unit 100 take an image of the observation target without reducing the brightness (step S3206). Then, the control unit 110 ends the determination operation.

[0200] As described above, the control unit 110 also determines the brightness target value by considering the type of the imaging device. Therefore, a medical image with more appropriate brightness can be displayed in the display device 20, thereby enabling enhanced visibility for the user when viewing the medical image.

[0201] <4.3. Third Modification Example>

[0202] A description is given below of a third modified example of the embodiment according to the present disclosure.

[0203] The display control unit 114 adjusts the brightness of the characters displayed in the display device 20 according to the brightness of the medical image displayed in the display device 20. For example, according to the brightness of the medical image displayed in the display device 20, the display control unit 114 may reduce the brightness of information displayed using OSD (On Screen Display) (hereinafter, also referred to as OSD information). When the dynamic range of the display device 20 is HDR, the display control unit 114 increases the brightness of the display device 20 when displaying a medical image captured at a lower brightness. Therefore, the OSD information is also displayed in a bright manner, and this may cause the visibility of the OSD information to decrease. In this regard, when displaying the OSD information, the display control unit 114 reduces the brightness at the same rate as the rate at which the brightness of the imaging device is reduced when capturing an image of an observation target; and then displays the OSD information in the display device 20. As a result, the display control unit 114 becomes able to display the OSD information at a lower brightness than the medical image in the display device 20.

[0204] As described above, the display control unit 114 may display the OSD information in the display device 20 by reducing the brightness of the OSD information to be lower than the brightness of the medical image, and thus may enhance the visibility of the user when viewing the OSD information.

[0205] <4.4. Fourth Modification Example>

[0206] Given below is a description of a fourth modified example of the embodiment according to the present disclosure.

[0207] When the dynamic range of the display device 20 is HDR, the imaging device according to the above embodiment captures the image of the observation target by reducing the brightness, so the digital gain increases the amount of brightening during imaging. Due to the increase in digital gain, the SN ratio (signal-to-noise ratio) deteriorates, and the noise in the medical image increases. In this regard, when the dynamic range of the display device 20 is HDR, the control unit 110 may also perform noise reduction on the imaging signal. For example, the control unit 110 performs noise reduction during the correction operation. In addition, even when the dynamic range of the display device 20 is SDR, the control unit 110 may perform noise reduction. At the same time, when the dynamic range of the display device 20 is HDR, there is more noise in the medical image compared to the case where the dynamic range of the display device 20 is SDR. Therefore, when the dynamic range of the display device 20 is HDR, it is expected that the control unit 110 performs noise reduction with a higher intensity than the noise reduction performed when the dynamic range of the display device 20 is SDR.

[0208] As described above, the display control unit 114 may perform noise reduction on the imaging signal so as to reduce noise included in the imaging signal, and thus may enhance visibility for the user when viewing the medical image.

[0209] <4.5. Fifth modified example>

[0210] A description is given below of a fifth modified example of the embodiment according to the present disclosure.

[0211] In the above-described embodiment, the control unit 110 controls the amount of light projected from the light source unit 132 and adjusts the brightness during imaging. Alternatively, the brightness during imaging may be adjusted by controlling the aperture of the image sensor of the camera 136. For example, in the embodiment described below, the control unit 110 reduces the amount of light projected from the light source unit 132 and reduces the brightness during imaging. Alternatively, the control unit 110 may reduce the aperture of the image sensor so as to reduce the amount of light passing through the lens, and may reduce the brightness during imaging.

[0212] As the aperture of the image sensor decreases, the depth of field increases. This results in an increase in the range in which the observation target remains in focus even after moving closer or farther away from the imaging device, making it easier for the user to observe the observation target.

[0213] <<5. Conclusion>>

[0214] As described above, the medical control device according to the embodiment of the present disclosure controls the brightness of the imaging signal generated by the imaging device that receives the light from the observation target. In addition, the medical control device displays the medical image generated from the imaging signal in the display device 20 that displays the image. The medical control device controls the brightness of the imaging signal in such a manner that the higher the dynamic range of the display device 20, the lower the brightness of the imaging signal. As a result, the medical control device becomes able to restore and display in the HDR display device 20 a saturated portion in the medical image displayed in the SDR display device 20.

[0215] As a result, it is possible to provide a medical control apparatus and a medical observation apparatus in a new and improved form which can achieve reduction of halation occurring in medical images.

[0216] Although the present disclosure is described in detail above in the form of preferred embodiments with reference to the accompanying drawings; the technical scope of the present disclosure is not limited to the above embodiments. That is, the present disclosure will be described as embodying all modifications that may be thought of by those skilled in the art that fall completely within the basic teachings set forth herein, such as other embodiments, additions, alternative constructions, and deletions. In any form thereof, as long as the functions / effects of the present disclosure are achieved, these modifications are included within the scope of the present disclosure.

[0217] For example, each device described in this written description may be implemented as a separate device, or these devices may be implemented as separate devices in part or in whole. For example, the medical observation device 10, the display device 20, and the medical control device may be implemented as separate devices. Alternatively, the medical observation device 10, the display device 20, and the medical control device may be implemented as a server device connected via a network.

[0218] In addition, the medical observation device 10 described in this specification may be configured as a system in which the constituent elements are partially or entirely implemented as separate devices. For example, there may be a system in which the medical observation device 10 includes a light source and an imaging device, and a control unit is implemented using an external device.

[0219] Meanwhile, the sequence of operations performed by each device described in this written description may be implemented using software or using hardware or using a combination of software and hardware. The program constituting the software is pre-stored in a recording medium (non-transitory medium) installed inside or outside each device. Then, for example, each program is read into a RAM when executed by a computer and executed by a processor such as a CPU.

[0220] Meanwhile, the operations described with reference to the flowcharts and sequence diagrams in this written description do not necessarily have to be performed in the order shown in the drawings. That is, some operation steps may be performed in parallel. Moreover, additional operation steps may be included, and some operation steps may be omitted.

[0221] The effects described in this written description are merely illustrative and exemplary and are not limited in scope. That is, in addition to or in place of the above effects, the technology disclosed in this disclosure enables other effects that may be conceived by those skilled in the art.

[0222] Meanwhile, the configurations described below also fall within the technical scope of the present disclosure. (1)

[0224] A medical control device, comprising:

[0225] a brightness control unit that controls the brightness of an imaging signal generated by an imaging device that receives light from an observation target; and

[0226] A display control unit displays a medical image generated from an imaging signal in a display device for displaying an image, wherein

[0227] The brightness control unit controls the brightness of the imaging signal so that the brightness decreases in inverse proportion to the dynamic range of the display device. (2)

[0229] The medical control device according to (1), wherein the brightness control unit identifies a dynamic range of the display device and determines a brightness target value corresponding to the identified dynamic range of the display device. (3)

[0231] The medical control device according to (2), wherein the brightness control unit identifies the dynamic range of the display device based on a predetermined selection operation. (4)

[0233] The medical control device according to (2), wherein the brightness control unit identifies the dynamic range of the display device based on dynamic range information indicating the dynamic range of the display device. (5)

[0235] The medical control device according to (4), wherein the dynamic range information is obtained from a display device. (6)

[0237] The medical control device according to (4), wherein the dynamic information is obtained based on the identification information obtained from the display device. (7)

[0239] The medical control device according to any one of (2) to (6), wherein the brightness control unit compares the dynamic range of the display device with a predetermined dynamic range, and decides the brightness target value based on the comparison result. (8)

[0241] The medical control device according to (7), wherein the brightness control unit decides the brightness target value based on a difference between a maximum value of a dynamic range of the display device and a maximum value of a predetermined dynamic range. (9)

[0243] A medical control device according to (8), wherein, when the maximum value of the dynamic range of the display device is n times (where n is a real number) the maximum value of the predetermined dynamic range, the brightness control unit sets the brightness target value in the display device to 1 / n of the brightness target value corresponding to the predetermined dynamic range. (10)

[0245] A medical control device according to (1) to (9), wherein, when there are a plurality of display devices, the brightness control unit controls imaging by the imaging device in such a manner that an imaging signal has a brightness corresponding to a dynamic range of a display device selected from the plurality of display devices. (11)

[0247] The medical control device according to (10), wherein the display device selected from the plurality of display devices is a display device associated with a predetermined user. (12)

[0249] The medical control device according to (10) or (11), wherein the display device selected from the plurality of display devices is a display device having a highest dynamic range among the plurality of display devices. (13)

[0251] The medical control device according to any one of (1) to (12), wherein the display control unit performs gamma correction on the imaging signal based on the gamma value of the display device, and displays the medical image generated from the gamma-corrected imaging signal in the display device. (14)

[0253] A medical control device according to (13), wherein the display control unit performs gamma correction on the imaging signal in such a manner that the intermediate brightness value of the medical image displayed in the display device is equal to the intermediate brightness value of the medical image displayed in the display device having a predetermined gamma value. (15)

[0255] A medical control device according to (13) or (14), wherein, when there are multiple display devices, the display control unit displays a medical image generated from an imaging signal that has been gamma-corrected based on a gamma value of a corresponding display device in each of the multiple display devices. (16)

[0257] The medical control device according to (2), wherein the brightness control unit determines the brightness target value further based on a display mode of the display device. (17)

[0259] The medical control device according to (2) or (16), wherein the brightness control unit determines the brightness target value further based on the type of the imaging device. (18)

[0261] The medical control device according to any one of (1) to (17), wherein when the medical image is displayed in the display device, the display control unit adjusts the brightness of the characters displayed in the display device according to the brightness of the medical image. (19)

[0263] A medical observation device, comprising:

[0264] Light source, emitting light;

[0265] an imaging device that captures an image of an observation target; and

[0266] Control unit,

[0267] controlling the brightness of an imaging signal generated by an imaging device that receives reflected light from an observation target illuminated with light, and

[0268] A medical image generated from the imaging signal is displayed in a display device, wherein

[0269] The control unit controls the brightness of the imaging signal so that the brightness decreases in inverse proportion to the dynamic range of the display device.

[0270] Reference Symbols List

[0271] 1.2 Medical observation system

[0272] 10 Medical observation device

[0273] 20 Display device

[0274] 100 Imaging Units

[0275] 110 Control unit

[0276] 112 Brightness Control Unit

[0277] 114 Display control unit

[0278] 120 Communication Unit

[0279] 130 Insert component

[0280] 132 Light source unit

[0281] 134 Light Guide

[0282] 136 Camera

[0283] 138 Cable

[0284] 140 control unit.

Claims

1. A medical control device, comprising: a display control unit configured to display a medical image in a display device for displaying an image, the medical image being generated from an imaging signal generated by an imaging device configured to receive light from an observation target; as well as a brightness control unit configured to control the brightness of the imaging signal by controlling the amount of light falling on the imaging device or controlling the amount of light emitted to the observation target, wherein when the dynamic range of the display device is set to a second value greater than the first value, the brightness control unit is configured to perform control to reduce the brightness of the imaging signal by reducing the amount of light falling on the imaging device or reducing the amount of light emitted to the observation target, compared to the brightness of the imaging signal that displays the medical image at a predetermined brightness when the dynamic range is set to the first value; wherein the imaging device captures a plurality of medical images by switching between visible light and special light at regular intervals, and the plurality of medical images are superimposed and displayed in the display device, wherein when the imaging device uses the visible light to capture the medical image, the brightness control unit enables the imaging device to capture the medical image of the observation target with reduced brightness; and when the imaging device uses the special light to capture the medical image, the brightness control unit enables the imaging device to capture the medical image of the observation target without reducing brightness.

2. The medical control device according to claim 1, wherein: The brightness control unit is configured to identify the dynamic range of the display device and determine a brightness target value of the imaging signal in a manner corresponding to the identified dynamic range of the display device.

3. The medical control device according to claim 1, wherein: When the medical image is to be displayed in a first display device in which the dynamic range is set to the first value, the brightness control unit is configured to perform control to set the brightness of the imaging signal to a first brightness for displaying the medical image at the predetermined brightness, and When the medical image is to be displayed in a second display device in which the dynamic range is set to the second value, the brightness control unit is configured to perform control to set the brightness of the imaging signal to a second brightness lower than the first brightness.

4. The medical control device according to claim 2, wherein: The brightness control unit is configured to identify the dynamic range of the display device based on dynamic range information indicating the dynamic range of the display device.

5. The medical control device according to claim 4, wherein: The dynamic range information is obtained from the display device.

6. The medical control device according to claim 4, wherein: The dynamic range information is obtained based on identification information obtained from the display device.

7. The medical control device according to claim 2, wherein: The brightness control unit is configured to compare the dynamic range of the display device with a predetermined dynamic range and decide the brightness target value based on a comparison result.

8. The medical control device according to claim 7, wherein: The brightness control unit is configured to determine the brightness target value based on a difference between a maximum value of the dynamic range of the display device and a maximum value of the predetermined dynamic range.

9. The medical control device according to claim 8, wherein: When the maximum value of the dynamic range of the display device is n times the maximum value of the predetermined dynamic range, where n is a real number, the brightness control unit is configured to set the brightness target value in the display device to 1 / n of the brightness target value corresponding to the predetermined dynamic range.

10. The medical control device according to claim 1, wherein: When there are a plurality of the display devices, the brightness control unit is configured to control imaging by the imaging device in such a manner that the imaging signal has brightness corresponding to the dynamic range of the display device selected from the plurality of the display devices.

11. The medical control device according to claim 10, wherein: The display device selected from the plurality of display devices is the display device associated with a predetermined user.

12. The medical control device according to claim 10, wherein: The display device selected from the plurality of display devices is the display device having the highest dynamic range among the plurality of display devices.

13. The medical control device according to claim 1, wherein: The display control unit is configured to perform gamma correction on the imaging signal based on a gamma value of the display device, and display the medical image generated from the imaging signal that has been subjected to the gamma correction in the display device.

14. The medical control device according to claim 13, wherein: The display control unit is configured to perform the gamma correction on the imaging signal in such a manner that a mid-glow value of the medical image displayed in the display device is equal to a mid-glow value of the medical image displayed in the display device having a predetermined gamma value.

15. The medical control device according to claim 13, wherein: When there are a plurality of the display devices, the display control unit displays, in each of the plurality of the display devices, the medical image generated from the imaging signal that has been gamma-corrected based on the gamma value of the corresponding display device.

16. The medical control device according to claim 2, wherein: The brightness control unit is configured to determine the brightness target value further based on a display mode of the display device.

17. The medical control device according to claim 1, wherein: The display control unit is configured to adjust brightness of characters displayed in the display device according to brightness of the medical image when the medical image is displayed in the display device.

18. A medical observation device, comprising: a light source configured to emit light; an imaging device configured to capture an image of an observation target; a display control unit configured to display a medical image in a display device for displaying an image, the medical image being generated from an imaging signal generated by the imaging device configured to receive light from the observation target; as well as a brightness control unit configured to control the brightness of the imaging signal by controlling the amount of light falling on the imaging device or controlling the amount of light emitted to the observation target, wherein when the dynamic range of the display device is set to a second value greater than the first value, the brightness control unit is configured to perform control to reduce the brightness of the imaging signal by reducing the amount of light falling on the imaging device or reducing the amount of light emitted to the observation target, compared to the brightness of the imaging signal that displays the medical image at a predetermined brightness when the dynamic range is set to the first value; wherein the imaging device captures a plurality of medical images by switching between visible light and special light at regular intervals, and the plurality of medical images are superimposed and displayed in the display device, wherein when the imaging device uses the visible light to capture the medical image, the brightness control unit enables the imaging device to capture the medical image of the observation target with reduced brightness; and when the imaging device uses the special light to capture the medical image, the brightness control unit enables the imaging device to capture the medical image of the observation target without reducing brightness.

Citation Information

Patent Citations

  • Image processing apparatus and method, and recording medium

    JP2002135589A

  • Image processing apparatus, image processing method, and storage medium

    CN107979718A

  • Signal processor for electronic endoscope system

    JP2003339634A

  • Fluorescence image display apparatus

    US20020177780A1

  • Image area specification device and method, and x-ray image processing device and method

    US20160171691A1