Display device and display control method

Abstract

The present technology pertains to a display device and a display control method capable of suppressing variations in image quality. A display device according to one aspect of the present technology: communicates information including adjustment information, which is information related to image quality adjustment, with another display device; and synchronizes the image quality on the basis of the adjustment information. For example, the luminance of a screen displayed by a display unit is adjusted according to the detected brightness, and adjustment information indicating the adjustment content of the luminance is transmitted to the other display device. The present technology can be applied to medical monitors.

Description

Display device and display control method

[0001] The present technology relates to a display device and a display control method, and more particularly to a display device and a display control method that are capable of suppressing variations in image quality.

[0002] Medical displays installed in operating rooms and other facilities are required to display images of the surgical field that are easy for surgeons to see. Various displays equipped with ambient light sensors and a function to automatically adjust the brightness of images are available on the market.

[0003] Japanese Patent Laid-Open No. 05-006159 Japanese Patent Laid-Open No. 2008-051848

[0004] Typically, multiple displays are installed in operating rooms, etc. If the brightness of each display is adjusted automatically, the brightness of each display may vary.

[0005] The present technology has been made in view of such circumstances, and is intended to make it possible to suppress variations in image quality.

[0006] A display device according to one aspect of the present technology includes a display unit that displays a screen including externally input images including surgical images, a communication unit that communicates information including adjustment information that is information related to adjusting image quality between other display devices that include other display units, and an information processing unit that synchronizes the image quality of the screen displayed by the display unit with the image quality of the screen displayed by the other display unit based on the adjustment information.

[0007] In one aspect of the present technology, communication of information including adjustment information relating to adjustment of image quality is performed between display devices, and image quality is synchronized based on the adjustment information.

[0008] 10 is a diagram illustrating an example configuration of a monitor system according to an embodiment of the present technology; FIG. 11 is a diagram illustrating an example connection of medical monitors; FIG. 12 is a block diagram illustrating an example configuration of a medical monitor; FIG. 13 is a flowchart illustrating a first example of a luminance synchronization method; FIG. 14 is a flowchart illustrating a second example of a luminance synchronization method; FIG. 15 is a flowchart illustrating a luminance synchronization method for transmitting and receiving ambient light sensor values ​​and luminance adjustment related parameters; FIG. 16 is a diagram illustrating a schematic configuration of an endoscope system; FIG. 17 is a block diagram illustrating an example of the functional configuration of a camera and a CCU illustrated in FIG. 9; FIG. 18 is a diagram illustrating an example of a schematic configuration of a microsurgical system;

[0009] Hereinafter, embodiments of the present technology will be described in the following order: 1. Configuration of monitor system 2. Operation of monitor system 3. Modification 4. Application example

[0010] <<Configuration of Monitor System>> FIG. 1 is a diagram showing an example of the configuration of a monitor system according to an embodiment of the present technology.

[0011] The monitor system 1 shown in Fig. 1 is a medical display system installed in a room of a medical facility, such as an operating room or examination room. Doctors and medical staff are users of the monitor system 1. In the example of Fig. 1, three medical monitors, 11A, 11B, and 11C, are shown as the multiple display devices that make up the monitor system 1. Hereinafter, when it is not necessary to distinguish between the medical monitors 11A, 11B, and 11C, they will be collectively referred to as medical monitor 11. The monitor system 1 may be configured with two medical monitors, or may be configured with three or more medical monitors.

[0012] The signal of the image captured by the camera is input to the medical monitor 11, and the input image is displayed. The input images displayed include surgical images such as an operative field image captured by an endoscopic camera, an operative field image captured by an operative field camera installed above the operating table, and an operative field image captured by a camera installed in the operating room. In addition to moving images, still images of the surgical images are also displayed on the medical monitor 11 as appropriate.

[0013] As will be described in detail later, the medical monitor 11 has a function for automatically adjusting the image quality of the screen in accordance with the ambient brightness, etc. The image quality adjusted by the medical monitor 11 includes brightness. For example, brightness is adjusted by adjusting the brightness of the backlight provided on the display of the medical monitor 11.

[0014] Furthermore, the medical monitors 11 are provided with a communication function. As indicated by the bidirectional arrows, each medical monitor 11 can transmit and receive information to and from the other medical monitors 11. The transmission and reception of information between the medical monitors 11 is performed, for example, via wired communication.

[0015] FIG. 2 is a diagram showing an example of connections of the medical monitor 11. As shown in FIG.

[0016] 2A shows an example in which medical monitors 11A and 11B are connected by cables, and medical monitors 11B and 11C are connected by cables. Communication can also be performed between medical monitors 11A and 11C via medical monitor 11B.

[0017] FIG. 2B shows an example in which the medical monitors 11A and 11B, the medical monitors 11B and 11C, and the medical monitors 11C and 11A are connected by cables.

[0018] 2C, medical monitors 11A, 11B, and 11C are connected to one hub, and communication between the medical monitors 11 is performed via the hub.

[0019] 2 can be used as a method for connecting the medical monitors 11 in the monitor system 1. The medical monitors 11 may be connected via wireless communication such as wireless LAN or Bluetooth (registered trademark).

[0020] In the monitor system 1 shown in Fig. 1, brightness adjustments made by the automatic adjustment function are synchronized to reduce variations. By reducing variations in brightness, it is possible to improve visibility for users. It is also possible to eliminate the effort required to manually adjust brightness variations.

[0021] FIG. 3 is a block diagram showing an example of the configuration of the medical monitor 11. As shown in FIG.

[0022] The medical monitor 11A includes a display unit 21A, a control unit 22A, an ambient light sensor 23A, an information processing unit 24A, a storage unit 25A, and a communication IF 26A.

[0023] The display unit 21A is configured with a display device such as an LCD. The display unit 21A displays various screens, including a screen containing a surgical video. The display unit 21A may be configured with an organic EL display.

[0024] The control unit 22A is configured with a drive circuit that controls the driving of the backlight of the display unit 21A, a drive circuit that controls the driving of the liquid crystal panel of the display unit 21A, etc. The control unit 22A adjusts the brightness of the backlight of the display unit 21A under the control of the information processing unit 24A. The control unit 22A also drives the liquid crystal panel of the display unit 21A based on the video signal supplied from the information processing unit 24A, and controls the screen display of the display unit 21A.

[0025] The ambient light sensor 23A is a sensor device that functions as a detector for detecting the brightness of the surroundings of the medical monitor 11. The ambient light sensor 23A is provided at a predetermined position, such as the top of the housing of the medical monitor 11A. The ambient light sensor 23A is configured, for example, by an illuminance sensor. The ambient light sensor value indicating the brightness of the surroundings is output to the information processing unit 24A as the detection result of the ambient light sensor 23A.

[0026] The information processing unit 24A is configured with a microprocessor. The information processing unit 24A executes a predetermined program and controls the overall operation of the medical monitor 11A. For example, the information processing unit 24A synchronizes the image quality of the screen displayed by the display unit 21A with the image quality of the screens displayed by the medical monitors 11B and 11C.

[0027] The storage unit 25A is a memory configured by a flash memory, etc. The storage unit 25A stores various information such as programs executed by the information processing unit 24A.

[0028] The communication IF 26A communicates with the medical monitors 11B and 11C. For example, communication of adjustment information, which is information related to image quality adjustment, is performed between the medical monitors 11B and 11C. The communication IF 26A transmits information supplied from the information processing unit 24A to the medical monitors 11B and 11C. The communication IF 26A also receives information transmitted from the medical monitors 11B and 11C and outputs the information to the information processing unit 24A.

[0029] 3, the medical monitors 11B and 11C each have the same configuration as the medical monitor 11A. The display unit 21B, control unit 22B, ambient light sensor 23B, information processing unit 24B, storage unit 25B, and communication IF 26B of the medical monitor 11B have the same functions as the display unit 21A, control unit 22A, ambient light sensor 23A, information processing unit 24A, storage unit 25A, and communication IF 26A of the medical monitor 11A, respectively. The display unit 21C, control unit 22C, ambient light sensor 23C, information processing unit 24C, storage unit 25C, and communication IF 26C of the medical monitor 11C have the same functions as the display unit 21A, control unit 22A, ambient light sensor 23A, information processing unit 24A, storage unit 25A, and communication IF 26A of the medical monitor 11A, respectively.

[0030] Taking medical monitor 11A as the reference, for example, display unit 21B of medical monitor 11B and display unit 21C of medical monitor 11C, which are other display devices, are other display units. Also, ambient light sensor 23B of medical monitor 11B and ambient light sensor 23C of medical monitor 11C are other detection units. Communication IF 26B of medical monitor 11B and communication IF 26C of medical monitor 11C are other communication units.

[0031] <<Operation of Monitor System>> <First Example of Luminance Synchronization Method> FIG. 4 is a flowchart showing a first example of a luminance synchronization method.

[0032] In the synchronization method shown in Fig. 4, a specific medical monitor 11 acts as a master and adjusts the brightness, and other slave medical monitors 11 synchronize their brightness to match the brightness of the master. In the example of Fig. 4, medical monitor 11A functions as the master. Of medical monitors 11A, 11B, and 11C, for example, the medical monitor 11 frequently used by the main surgeon is set as the master, and the medical monitor 11 used by the assistant doctor is set as the slave. The process shown in Fig. 4 is started, for example, when each medical monitor 11 is turned on.

[0033] Processing of Medical Monitor 11A In step S1, the ambient light sensor 23A of the medical monitor 11A acquires an ambient light sensor value.

[0034] In step S2, the information processing unit 24A calculates a target brightness based on the ambient light sensor value. Here, the target brightness is calculated as the screen brightness corresponding to the ambient brightness of the medical monitor 11A represented by the ambient light sensor value. Basically, the target brightness is calculated so that the brightness is lowered when the ambient environment is dark and raised when the ambient environment is bright.

[0035] In step S3, the information processing unit 24A determines whether the synchronization function is ON.

[0036] If it is determined in step S3 that the synchronization function is ON, in step S4, the information processing unit 24A controls the communication IF 26A to transmit information about the target brightness as an adjustment result. The target brightness information is transmitted to the medical monitors 11B and 11C as indicated by dashed arrows #1 and #2. The transmitted target brightness information serves as adjustment information indicating the brightness adjustment content.

[0037] On the other hand, if it is determined in step S3 that the synchronization function is OFF, the process of step S4 is skipped.

[0038] In step S5, the information processing unit 24A controls the control unit 22A to adjust the luminance of the display unit 21A so that the luminance becomes the same as the target luminance.

[0039] Processing of Medical Monitors 11B and 11C In step S11, the information processing unit 24B of the medical monitor 11B determines whether the synchronization function is ON.

[0040] If it is determined in step S11 that the synchronization function is ON, in step S12, the information processing unit 24B controls the communication IF 26B to receive the target brightness information transmitted from the medical monitor 11A.

[0041] In step S13, the information processing unit 24B controls the control unit 22B based on the information transmitted from the medical monitor 11A, and adjusts the brightness of the display unit 21B to the same brightness as the target brightness of the medical monitor 11A.

[0042] If it is determined in step S11 that the synchronization function is OFF, the ambient light sensor 23B of the medical monitor 11B acquires an ambient light sensor value in step S14.

[0043] In step S15, the information processing unit 24B calculates the target luminance based on the ambient light sensor value. Then, the process proceeds to step S13, where the luminance of the display unit 21B is adjusted to be the same as the target luminance calculated by the information processing unit 24B.

[0044] The same processing as that of medical monitor 11B is performed in medical monitor 11C. Steps S21 to S25 of medical monitor 11C are the same as steps S11 to S15 of medical monitor 11B, respectively. When the brightness synchronization function is ON, the brightness of display unit 21C in medical monitor 11C is also adjusted so that the brightness is the same as the target brightness of medical monitor 11A.

[0045] The process of FIG. 4 makes it possible to synchronize the luminance of the medical monitors 11B and 11C with the luminance of the medical monitor 11A.

[0046] <Second Example of Luminance Synchronization Method> Fig. 5 is a flowchart showing a second example of a luminance synchronization method. Descriptions that overlap with the above description will be omitted as appropriate. The same applies to the processes shown in Fig. 5 and subsequent figures.

[0047] The synchronization method shown in Fig. 5 is a method of calculating a target brightness in each medical monitor 11 and synchronizing the brightness of each medical monitor 11 so that each medical monitor 11 matches the average of the calculated target brightness. Information on the target brightness calculated in each medical monitor 11 is transmitted and received, and the target brightness is averaged in each medical monitor 11. The process shown in Fig. 5 is also started, for example, when each medical monitor 11 is turned on.

[0048] Processing of Medical Monitor 11A In step S51, the ambient light sensor 23A of the medical monitor 11A acquires an ambient light sensor value.

[0049] In step S52, the information processing unit 24A calculates a target brightness based on the ambient light sensor value.

[0050] In step S53, the information processing unit 24A determines whether the synchronization function is ON.

[0051] If it is determined in step S53 that the synchronization function is ON, in step S54, the information processing unit 24A controls the communication IF 26A to transmit and receive target brightness information. As indicated by dashed arrows #11 and #12, target brightness information calculated by the medical monitor 11A is transmitted to the medical monitors 11B and 11C. Furthermore, target brightness information calculated by the medical monitor 11B and target brightness information calculated by the medical monitor 11C are received. The target brightness information transmitted from the medical monitor 11A to the medical monitors 11B and 11C serves as adjustment information indicating a first brightness value as a brightness adjustment content. Furthermore, the target brightness information transmitted from the medical monitors 11B and 11C to the medical monitor 11A serves as adjustment information indicating a second brightness value as a brightness adjustment content.

[0052] In step S55, the information processing unit 24A averages the target luminance calculated in step S52 and the target luminance acquired from the medical monitors 11B and 11C.

[0053] In step S56, the information processing unit 24A controls the control unit 22A to adjust the luminance of the display unit 21A so that the luminance becomes the same as the target luminance averaged over the medical monitors 11A to 11C.

[0054] On the other hand, if it is determined in step S53 that the synchronization function is OFF, the processes of steps S54 and S55 are skipped. In step S56, the luminance of display unit 21A is adjusted so that it becomes the same as the target luminance calculated by information processing unit 24A.

[0055] Processing of Medical Monitors 11B and 11C In step S61, the ambient light sensor 23B of the medical monitor 11B acquires an ambient light sensor value.

[0056] In step S62, the information processing unit 24B calculates a target brightness based on the ambient light sensor value.

[0057] In step S63, the information processing unit 24B determines whether the synchronization function is ON.

[0058] If it is determined in step S63 that the synchronization function is ON, in step S64, the information processing unit 24B controls the communication IF 26B to transmit and receive information about the target brightness. As indicated by dashed arrows #11 and #12, information about the target brightness calculated in the medical monitor 11B is transmitted to the medical monitors 11A and 11C. In addition, information about the target brightness calculated in the medical monitor 11A and information about the target brightness calculated in the medical monitor 11C are received.

[0059] In step S65, the information processing unit 24B averages the target luminance calculated in step S62 and the target luminance acquired from the medical monitor 11A and the medical monitor 11C.

[0060] In step S66, the information processing unit 24B controls the control unit 22B to adjust the luminance of the display unit 21B so that the luminance becomes the same as the target luminance averaged over the medical monitors 11A to 11C.

[0061] On the other hand, if it is determined in step S63 that the synchronization function is OFF, the processes of steps S64 and S65 are skipped. In step S66, the luminance of display unit 21B is adjusted so that it becomes the same as the target luminance calculated by information processing unit 24B.

[0062] The same processing as that of medical monitor 11B is performed in medical monitor 11C. Steps S71 to S76 of medical monitor 11C are the same as steps S61 to S66 of medical monitor 11B. When the brightness synchronization function is ON, the brightness of display unit 21C in medical monitor 11C is also adjusted so that the brightness becomes the same as the target brightness averaged between medical monitors 11A to 11C.

[0063] The above processing makes it possible to synchronize the luminance of medical monitors 11A, 11B, and 11C. For example, in the synchronization method described with reference to Fig. 4, if only the master medical monitor 11 is installed in a bright location, the luminance of the slave medical monitor 11 is adjusted to match the luminance of the medical monitor 11 installed in the bright location. Such a problem can be prevented by averaging the target luminance calculated for each medical monitor 11, as shown in Fig. 5.

[0064] <<Modifications>> <Example of transmitting and receiving information other than brightness adjustment values> Information other than brightness adjustment values ​​may be transmitted and received between medical monitors 11. For example, ambient light sensor values ​​detected in each medical monitor 11 and brightness adjustment-related parameters of each medical monitor 11 are transmitted and received. The brightness adjustment-related parameters include the following information indicating the characteristics of the display unit: Panel information Backlight illumination time

[0065] The panel information is information about the specifications of the display unit of the medical monitor 11. The panel information includes information such as the maximum and minimum brightness of the backlight. The backlight illumination time is the cumulative illumination time of the backlight of the medical monitor 11.

[0066] By using the brightness adjustment related parameters, it is possible to synchronize brightness with higher accuracy based on differences in brightness due to changes over time or panel characteristics. Even if brightness is adjusted to match the same target brightness, variations in brightness after adjustment may occur due to changes over time or differences in panel characteristics. Brightness adjustment using the brightness adjustment related parameters is performed to cancel out such differences in brightness due to changes over time or panel characteristics.

[0067] FIG. 6 is a flowchart showing a method for synchronizing brightness when transmitting and receiving ambient light sensor values ​​and brightness adjustment related parameters.

[0068] Processing of Medical Monitor 11A In step S101, the ambient light sensor 23A of the medical monitor 11A acquires an ambient light sensor value.

[0069] In step S102, the information processing unit 24A determines whether the synchronization function is ON.

[0070] In step S103, the information processing unit 24A controls the communication IF 26A to transmit and receive panel information. As indicated by dashed arrows #21 and #22, the panel information of the medical monitor 11A is transmitted to the medical monitors 11B and 11C. The panel information of the medical monitors 11B and 11C is also received.

[0071] In step S104, the information processing unit 24A calculates the difference between the characteristics of the medical monitor 11A and the panel information acquired from the medical monitors 11B and 11C.

[0072] In step S105, the information processing unit 24A controls the communication IF 26A to transmit and receive information about the backlight illumination time. As indicated by dashed arrows #31 and #32, information indicating the backlight illumination time of the medical monitor 11A is transmitted to the medical monitors 11B and 11C. Information indicating the backlight illumination time of the medical monitor 11B and information indicating the backlight illumination time of the medical monitor 11C are also received.

[0073] In step S106, the information processing unit 24A calculates the difference between the lighting time of the medical monitor 11A and the lighting times acquired from the medical monitors 11B and 11C.

[0074] In step S107, the information processing unit 24A controls the communication IF 26A to transmit and receive ambient light sensor values. As indicated by dashed arrows #41 and #42, the ambient light sensor values ​​acquired by the medical monitor 11A are transmitted to the medical monitors 11B and 11C, and the ambient light sensor values ​​acquired by the medical monitors 11B and 11C are received.

[0075] In step S108, the information processing unit 24A calculates the difference between the ambient light sensor value of the medical monitor 11A and the ambient light sensor values ​​acquired from the medical monitors 11B and 11C.

[0076] In step S109, the information processing unit 24A controls the control unit 22A to adjust the luminance of the display unit 21A based on the difference in the ambient light sensor value. Here, the luminance adjustment is performed taking into account the difference in the panel characteristics and the difference in the lighting time of the backlight, which are parameters related to luminance adjustment.

[0077] For example, when the target brightness is calculated based on the ambient light sensor values, if the panel characteristics of medical monitor 11A are worse than those of medical monitors 11B and 11C, the target brightness is corrected by adding a brightness corresponding to the amount of deterioration, and the brightness is adjusted to match the corrected target brightness. Also, when the target brightness is calculated based on the ambient light sensor values, if the lighting time of the backlight of medical monitor 11A is longer than the lighting time of the backlight of medical monitor 11B and medical monitor 11C, the target brightness is corrected by adding a brightness corresponding to the difference in lighting time, and the brightness is adjusted to match the corrected target brightness.

[0078] On the other hand, if it is determined in step S102 that the synchronization function is OFF, in step S110, the information processing unit 24A calculates the target luminance based on the ambient light sensor value, and then proceeds to step S109, where the luminance of the display unit 21A is adjusted to be the same as the target luminance.

[0079] Processing of medical monitors 11B and 11C Processing similar to that of medical monitor 11A described above is performed on medical monitor 11B and medical monitor 11C. The processing of steps S111 to S120 on medical monitor 11B is similar to the processing of steps S101 to S110 on medical monitor 11A. The processing of steps S121 to S130 on medical monitor 11C is similar to the processing of steps S101 to S110 on medical monitor 11A. When the brightness synchronization function is ON, brightness adjustment is performed on medical monitors 11B and 11C as well, taking into account brightness adjustment-related parameters.

[0080] The process of FIG. 6 allows for more accurate synchronization of brightness, taking into consideration brightness differences due to changes over time and panel characteristics.

[0081] The timing of executing the automatic brightness adjustment may be synchronized using a communication IF. In this case, an automatic brightness adjustment trigger indicating the execution timing of the automatic brightness adjustment is transmitted from one medical monitor 11, such as the master medical monitor 11, to the other medical monitors 11. The medical monitor 11 that receives the automatic brightness adjustment trigger performs the automatic brightness adjustment at the timing indicated by the automatic brightness adjustment trigger.

[0082] Image quality adjustment parameters used to adjust image quality may be transmitted and received, and image quality other than brightness may be synchronized among the medical monitors 11. For example, image quality parameters other than brightness may include at least one of the following information: Color temperature Gamma Sharpness Contrast

[0083] <Others> Fig. 7 is a diagram showing a typical operating room for laparoscopic surgery. The monitor system 1 is used as an operating room monitor for laparoscopic surgery, for example.

[0084] In the example of Figure 7, doctors D1 to D3 are standing on either side of patient P, who is lying on a bed. For example, doctor D1 is the surgeon, and doctors D2 and D3 are assistants. The surgery is performed while watching laparoscopic images displayed on medical monitors 11A and 11B installed near the bed. The two monitors, medical monitor 11A and medical monitor 11B, are positioned at an appropriate angle so that the images can be viewed from either the left or right side of patient P. The two monitors, medical monitor 11A and medical monitor 11B, are the main monitors.

[0085] A sub-monitor is also provided for visitors. In the example of Fig. 7, the sub-monitor is configured by a medical monitor 11C. The same laparoscopic image is displayed on the medical monitors 11A, 11B, and 11C.

[0086] In the case of Figure 7, it is desirable that the brightness of the two main monitors be the same. Therefore, processing is performed to synchronize the brightness between medical monitors 11A and 11B, which are the main monitors. On the other hand, since medical monitor 11C is not the monitor used by the surgeon, it is undesirable for the results of automatic brightness adjustment on medical monitor 11C to affect the brightness adjustment of the main monitor. The results of brightness adjustment between the main monitors are sent to medical monitor 11C, and the brightness of medical monitor 11C is adjusted to match the brightness of the main monitor.

[0087] FIG. 8 is a flowchart showing a synchronization method for synchronizing the brightness between the main monitors and adjusting the brightness of the sub-monitor based on the results of the synchronization.

[0088] Processing of Medical Monitor 11A In step S151, the ambient light sensor 23A of the medical monitor 11A acquires an ambient light sensor value.

[0089] In step S152, the information processing unit 24A calculates a target brightness based on the ambient light sensor value.

[0090] In step S153, the information processing unit 24A determines whether the synchronization function is ON.

[0091] If it is determined in step S153 that the synchronization function is ON, in step S154, the information processing unit 24A controls the communication IF 26A to transmit and receive information on the target brightness, which is the calculation result. As indicated by dashed arrow #51, the information on the target brightness calculated by the medical monitor 11A is transmitted to the medical monitor 11B. The information on the target brightness calculated by the medical monitor 11B is also received.

[0092] In step S155, the information processing unit 24A averages the target luminance calculated in step S152 and the target luminance acquired from the medical monitor 11B.

[0093] In step S156, the information processing unit 24A controls the control unit 22A to adjust the luminance of the display unit 21A so that the luminance becomes the same as the target luminance averaged between the medical monitors 11A and 11B.

[0094] On the other hand, if it is determined in step S153 that the synchronization function is OFF, the processes of steps S154 and S155 are skipped. In step S156, the luminance of the display unit 21A is adjusted so that the luminance is the same as the target luminance calculated by the information processing unit 24A.

[0095] Processing of Medical Monitor 11B In step S161, the ambient light sensor 23B of the medical monitor 11B acquires an ambient light sensor value.

[0096] In step S162, the information processing unit 24B calculates a target brightness based on the ambient light sensor value.

[0097] In step S163, the information processing unit 24B determines whether the synchronization function is ON.

[0098] If it is determined in step S163 that the synchronization function is ON, in step S164, the information processing unit 24B controls the communication IF 26B to transmit and receive the target brightness, which is the calculation result. As indicated by dashed arrow #51, the target brightness information calculated by the medical monitor 11B is transmitted to the medical monitor 11A. The target brightness information calculated by the medical monitor 11A is also received.

[0099] In step S165, the information processing unit 24B averages the target luminance calculated in step S162 and the target luminance acquired from the medical monitor 11A.

[0100] In step S166, the information processing unit 24B controls the communication IF 26B to transmit the target brightness averaged between the medical monitor 11A and the medical monitor 11C to the medical monitor 11C. As indicated by the dashed arrow #61, information on the target brightness averaged between the medical monitor 11A and the medical monitor 11B is transmitted.

[0101] In step S167, the information processing unit 24B controls the control unit 22B to adjust the luminance of the display unit 21B so that the luminance becomes the same as the target luminance averaged between the medical monitors 11A and 11B.

[0102] On the other hand, if it is determined in step S163 that the synchronization function is OFF, the processes of steps S164 to S166 are skipped. In step S167, the luminance of display unit 21B is adjusted so that it becomes the same as the target luminance calculated by information processing unit 24B.

[0103] Processing of Medical Monitor 11C In step S171, the information processing unit 24C of the medical monitor 11C determines whether the synchronization function is ON.

[0104] If it is determined in step S171 that the synchronization function is ON, in step S172, the information processing unit 24C controls the communication IF 26C to receive the target brightness information transmitted from the medical monitor 11B.

[0105] In step S173, the information processing unit 24C controls the control unit 22C to adjust the luminance of the display unit 21C so that the luminance becomes the same as the target luminance averaged between the medical monitor 11A and the medical monitor 11B.

[0106] On the other hand, if it is determined in step S171 that the synchronization function is OFF, the ambient light sensor 23C acquires an ambient light sensor value in step S174.

[0107] In step S175, the information processing unit 24C calculates the target luminance based on the ambient light sensor value. Then, in step S173, the luminance of the display unit 21C is adjusted to be the same as the target luminance calculated by the information processing unit 24C.

[0108] 8, brightness synchronization is performed between medical monitors 11A and 11B, which display the main monitor screens, by averaging the brightness of the screens of medical monitors 11A and 11B. Furthermore, brightness synchronization is performed between medical monitors 11A and 11B and medical monitor 11C, which displays the sub-monitor screens, by matching the brightness of the screens of medical monitors 11A and 11B. The synchronization method is switched between medical monitors 11A, 11B, and 11C depending on the content of the screens displayed by each of them. This allows the brightness of all medical monitors 11 to be synchronized without the results of automatic brightness adjustment on the sub-monitors affecting the brightness adjustment on the main monitor.

[0109] <<4. Application Examples>> The technology according to the present disclosure can be applied to a medical imaging system. A medical imaging system is a medical system that uses imaging technology, such as an endoscope system or a microscope system.

[0110] [Endoscopic System] An example of an endoscope system will be described with reference to FIGS. 9 and 10 . FIG. 9 is a diagram illustrating an example of the schematic configuration of an endoscope system 5000 to which the technology according to the present disclosure can be applied. FIG. 10 is a diagram illustrating an example of the configuration of an endoscope 5001 and a CCU (Camera Control Unit) 5039. FIG. 9 illustrates a state in which an operator (e.g., a doctor) 5067, who is a surgical participant, is performing surgery on a patient 5071 on a patient bed 5069 using the endoscope system 5000. As shown in FIG. 9 , the endoscope system 5000 includes an endoscope 5001, which is a medical imaging device, a CCU 5039, a light source device 5043, a recording device 5053, an output device 5055, and a support device 5027 that supports the endoscope 5001.

[0111] In endoscopic surgery, an insertion aid called a trocar 5025 is inserted into a patient 5071. Then, a scope 5003 and surgical tools 5021 connected to an endoscope 5001 are inserted into the body of the patient 5071 via the trocar 5025. The surgical tools 5021 are, for example, energy devices such as an electric scalpel, forceps, etc.

[0112] A surgical image, which is a medical image showing the inside of the body of a patient 5071 photographed by an endoscope 5001, is displayed on a display device 5041. An operator 5067 performs a procedure on the surgical target using a surgical tool 5021 while viewing the surgical image displayed on the display device 5041. Note that the medical image is not limited to a surgical image, and may be a diagnostic image photographed during a diagnosis.

[0113] [Endoscope] The endoscope 5001 is an imaging unit that captures images of the inside of the patient's 5071. For example, as shown in FIG. 10 , the endoscope 5001 is a camera 5005 that includes a focusing optical system 50051 that focuses incident light, a zoom optical system 50052 that changes the focal length of the imaging unit to enable optical zoom, a focus optical system 50053 that changes the focal length of the imaging unit to enable focus adjustment, and a light-receiving element 50054. The endoscope 5001 generates pixel signals by focusing light onto the light-receiving element 50054 via a connected scope 5003, and outputs the pixel signals to the CCU 5039 via a transmission system. The scope 5003 has an objective lens at its tip and is an insertion section that guides light from a connected light source device 5043 into the inside of the patient's 5071. The scope 5003 is, for example, a rigid scope if it is a rigid endoscope or a flexible scope if it is a flexible endoscope. The scope 5003 may be a direct-view endoscope or an oblique-view endoscope. Furthermore, the pixel signal may be a signal based on a signal output from a pixel, such as a RAW signal or an image signal. Furthermore, a configuration may be adopted in which a memory is installed in the transmission system connecting the endoscope 5001 and the CCU 5039, and parameters related to the endoscope 5001 and the CCU 5039 are stored in the memory. The memory may be located, for example, in a connection portion of the transmission system or on a cable. For example, parameters at the time of shipment of the endoscope 5001 and parameters that change when power is applied may be stored in the memory of the transmission system, and the operation of the endoscope may be changed based on parameters read from the memory. Furthermore, the endoscope and the transmission system may be collectively referred to as an endoscope. The light-receiving element 50054 is a sensor that converts received light into a pixel signal, and is, for example, a CMOS (Complementary Metal Oxide Semiconductor) type image sensor. It is preferable that the light-receiving element 50054 be an image sensor capable of color imaging with a Bayer array. Furthermore, the light receiving element 50054 is preferably an imaging element having a number of pixels corresponding to a resolution of, for example, 4K (3840 horizontal pixels × 2160 vertical pixels), 8K (7680 horizontal pixels × 4320 vertical pixels), or square 4K (3840 or more horizontal pixels × 3840 or more vertical pixels). The light receiving element 50054 may be a single sensor chip or multiple sensor chips.For example, a prism may be provided to separate incident light into predetermined wavelength bands, and each wavelength band may be imaged by a different light-receiving element. Alternatively, multiple light-receiving elements may be provided for stereoscopic vision. The light-receiving element 50054 may be a sensor including an image processing circuit within its chip structure, or a Time of Flight (ToF) sensor. The transmission system may be, for example, an optical fiber cable or wireless transmission. Wireless transmission may be performed via any means capable of transmitting pixel signals generated by the endoscope 5001. For example, the endoscope 5001 and the CCU 5039 may be connected wirelessly, or the endoscope 5001 and the CCU 5039 may be connected via a base station in the operating room. In this case, the endoscope 5001 may simultaneously transmit not only pixel signals but also information related to the pixel signals (e.g., pixel signal processing priority, synchronization signal, etc.). The endoscope may be configured such that the scope and camera are integrated, or a light-receiving element is provided at the tip of the scope.

[0114] [CCU (Camera Control Unit)] The CCU 5039 is a control device that comprehensively controls the connected endoscope 5001 and light source device 5043. For example, as shown in FIG. 10 , the CCU 5039 is an information processing device having an FPGA 50391, a CPU 50392, a RAM 50393, a ROM 50394, a GPU 50395, and an I / F 50396. The CCU 5039 may also comprehensively control the connected display device 5041, recording device 5053, and output device 5055. For example, the CCU 5039 controls the irradiation timing, irradiation intensity, and type of irradiation light source of the light source device 5043. The CCU 5039 also performs image processing such as development processing (e.g., demosaic processing) and correction processing on pixel signals output from the endoscope 5001, and outputs the processed pixel signals (e.g., an image) to an external device such as the display device 5041. Furthermore, the CCU 5039 transmits a control signal to the endoscope 5001 to control the driving of the endoscope 5001. The control signal is, for example, information regarding imaging conditions such as the magnification and focal length of the imaging unit. The CCU 5039 may have an image down-conversion function and be configured to be able to simultaneously output a high-resolution (e.g., 4K) image to the display device 5041 and a low-resolution (e.g., HD) image to the recording device 5053.

[0115] The CCU 5039 may also be connected to external devices (e.g., recording devices, display devices, output devices, and support devices) via an IP converter that converts signals into a predetermined communication protocol (e.g., IP (Internet Protocol)). The connection between the IP converter and the external devices may be configured as a wired network, or a partial or entire network may be configured as a wireless network. For example, the IP converter on the CCU 5039 side may have a wireless communication function and transmit the received video to an IP switcher or an output-side IP converter via a wireless communication network such as a fifth-generation mobile communication system (5G) or a sixth-generation mobile communication system (6G).

[0116] [Light Source Device] The light source device 5043 is a device capable of emitting light in a predetermined wavelength band and includes, for example, multiple light sources and a light source optical system that guides the light from the multiple light sources. The light sources are, for example, a xenon lamp, an LED light source, or an LD light source. The light source device 5043 has, for example, LED light sources corresponding to the three primary colors R, G, and B, and emits white light by controlling the output intensity and output timing of each light source. Furthermore, the light source device 5043 may include a light source that can emit special light used for special light observation, in addition to a light source that emits normal light used for normal light observation. The special light is light in a predetermined wavelength band different from the normal light used for normal light observation, such as near-infrared light (light with a wavelength of 760 nm or more), infrared light, blue light, or ultraviolet light. The normal light is, for example, white light or green light. Narrowband light observation, a type of special light observation, alternately emits blue light and green light to utilize the wavelength-dependence of light absorption in body tissue, enabling high-contrast imaging of specific tissue, such as blood vessels on the surface of the mucous membrane. Furthermore, in fluorescence observation, a type of special light observation, excitation light is applied to excite a drug injected into the body tissue, and fluorescence emitted by the drug as a marker is received to obtain a fluorescence image, thereby making it easier for the surgeon to visualize body tissues that are difficult for the surgeon to see under normal light. For example, in fluorescence observation using infrared light, infrared light having an excitation wavelength band is applied to a drug such as indocyanine green (ICG) injected into the body tissue, and the fluorescence of the drug is received, making it easier to visualize the structure of the body tissue and affected areas. Furthermore, in fluorescence observation, a drug (e.g., 5-ALA) that is excited by special light in the blue wavelength band and emits fluorescence in the red wavelength band may be used. The type of light irradiated by the light source device 5043 is set under the control of the CCU 5039. The CCU 5039 may have a mode in which normal light observation and special light observation are alternately performed by controlling the light source device 5043 and the endoscope 5001. In this case, it is preferable to superimpose information based on pixel signals obtained by special light observation on pixel signals obtained by normal light observation. The special light observation may be infrared light observation, which irradiates infrared light to view areas deeper than the surface of an organ, or multispectral observation using hyperspectral spectroscopy. Furthermore, photodynamic therapy may be combined.

[0117] [Recording Device] The recording device 5053 is a device, such as a recorder, that records pixel signals (e.g., images) acquired from the CCU 5039. The recording device 5053 records images acquired from the CCU 5039 on a HDD, SSD, or optical disk. The recording device 5053 may be connected to a network within the hospital so as to be accessible from devices outside the operating room. The recording device 5053 may also have an image down-conversion or up-conversion function.

[0118] [Display Device] The display device 5041 is a device capable of displaying an image, such as a display monitor. The display device 5041 displays an image based on pixel signals acquired from the CCU 5039. The display device 5041 may also function as an input device that enables gaze recognition, voice recognition, and instruction input using gestures by including a camera and a microphone.

[0119] [Output Device] The output device 5055 is a device, such as a printer, that outputs information acquired from the CCU 5039. The output device 5055 prints, for example, a print image based on pixel signals acquired from the CCU 5039 onto paper.

[0120] [Support Device] The support device 5027 is an articulated arm including a base 5029 having an arm control device 5045, an arm 5031 extending from the base 5029, and a holder 5032 attached to the tip of the arm 5031. The arm control device 5045 is configured with a processor such as a CPU and controls the drive of the arm 5031 by operating according to a predetermined program. The support device 5027 controls the position and posture of the endoscope 5001 held by the holder 5032, for example, by controlling parameters such as the length of each link 5035 constituting the arm 5031 and the rotation angle and torque of each joint 5033 using the arm control device 5045. This allows the endoscope 5001 to be changed to a desired position or posture, allowing the scope 5003 to be inserted into the patient 5071 and the observation area within the body to be changed. The support device 5027 functions as an endoscope support arm that supports the endoscope 5001 during surgery. This allows the support device 5027 to take the place of an assistant scopist who holds the endoscope 5001. The support device 5027 may also be a device that supports a microscope device 5301 (described later) and may also be called a medical support arm. The support device 5027 may be controlled autonomously by the arm control device 5045, or may be controlled by the arm control device 5045 based on user input. For example, the control method may be a master-slave method in which the support device 5027, which serves as a slave device (replica device) serving as a patient cart, is controlled based on the movement of a master device (primary device) that serves as an operator console near the user. The support device 5027 may also be remotely controlled from outside the operating room.

[0121] The above describes an example of an endoscope system 5000 to which the technology according to the present disclosure can be applied. For example, the technology according to the present disclosure may be applied to a microscope system.

[0122] 11 is a diagram showing an example of the schematic configuration of a microsurgical system to which the technology according to the present disclosure can be applied. In the following description, components similar to those in the endoscope system 5000 are designated by the same reference numerals, and redundant description thereof will be omitted.

[0123] 11 shows a schematic diagram of an operator 5067 performing surgery on a patient 5071 on a patient bed 5069 using a microsurgical system 5300. For simplicity, the illustration of the cart 5037 of the microsurgical system 5300 is omitted, and the illustration of the microscope device 5301 that replaces the endoscope 5001 is simplified. However, the microscope device 5301 in this description may refer to the microscope unit 5303 provided at the tip of the link 5035, or may refer to the entire configuration including the microscope unit 5303 and the support device 5027.

[0124] 11 , during surgery, a microsurgical system 5300 is used to display an enlarged image of the surgical site captured by a microscope device 5301 on a display device 5041 installed in an operating room. The display device 5041 is installed in a position facing the surgeon 5067, who performs various procedures on the surgical site, such as resecting the affected area, while observing the state of the surgical site using the image displayed on the display device 5041. Microsurgical systems are used, for example, in ophthalmic surgery and brain surgery.

[0125] The above describes examples of an endoscopic system 5000 and a microsurgery system 5300 to which the technology of the present disclosure can be applied. Note that the systems to which the technology of the present disclosure can be applied are not limited to these examples. For example, the support device 5027 may support another observation device or another surgical tool at its tip instead of the endoscope 5001 or the microscope unit 5303. Examples of such other observation devices include forceps, a surgeon, an insufflation tube for insufflation, or an energy treatment tool for incising tissue or sealing blood vessels by cauterization. Supporting these observation devices and surgical tools with a support device allows them to be more stably fixed in position than when medical staff support them manually, and also reduces the burden on medical staff. The technology of the present disclosure may be applied to support devices that support components other than the microscope unit.

[0126] Of the configurations described above, the technology according to the present disclosure can be suitably applied to image quality adjustment in multiple medical monitors including the display device 5041. By applying the technology according to the present disclosure to image quality adjustment in the display device 5041, it becomes possible to display surgical images with consistent image quality.

[0127] <Examples of Combinations of Configurations> The present technology can also have the following configurations.

[0128] (1) A display device comprising: a display unit that displays a screen including externally input video including surgical video; a communication unit that communicates information including adjustment information that is information related to image quality adjustment with another display device that includes another display unit; and an information processing unit that synchronizes the image quality of the screen displayed by the display unit with the image quality of the screen displayed by the other display unit based on the adjustment information. (2) The display device according to (1), further comprising a detection unit that detects ambient brightness. (3) The display device according to (2), wherein the information processing unit adjusts the luminance of the screen displayed by the display unit according to the brightness detected by the detection unit, and the communication unit transmits the adjustment information indicating the luminance adjustment content to the other display device. (4) The display device according to (2), wherein the communication unit receives the adjustment information indicating the luminance adjustment content of the screen displayed by the other display unit, transmitted from the other display device that further comprises a detection unit that detects ambient brightness, and the information processing unit adjusts the luminance of the screen displayed by the display unit based on the adjustment information. (5) The display device according to (2), wherein the information processing unit calculates a first luminance value of a screen displayed by the display unit in accordance with the brightness detected by the detection unit, and the communication unit transmits the adjustment information including the first luminance value to the other display device further including an other detection unit that detects ambient brightness. (6) The display device according to (5), wherein the communication unit receives the adjustment information including a second luminance value of a screen displayed by the other display unit, calculated in the other display device in accordance with the brightness detected by the other detection unit, and the information processing unit adjusts the luminance of the screen displayed by the display unit based on the first luminance value and the second luminance value. (7) The display device according to any of (2) to (6), wherein the communication unit transmits information indicating characteristics of the display unit to the other display device and receives information indicating the characteristics of the other display unit transmitted from the other display device, and the information processing unit adjusts the luminance of the screen displayed by the display unit based on a difference between the characteristics of the display unit and the characteristics of the other display unit.(8) The display device according to any one of (1) to (7), wherein the communication unit communicates the adjustment information relating to adjustment of at least one of color temperature, gamma, sharpness, and contrast, as well as luminance. (9) The display device according to any one of (1) to (8), wherein the information processing unit switches a manner of synchronization between the image quality of the screen displayed by the display unit and the image quality of the screen displayed by the other display unit, depending on the content of the screen displayed by the display unit. (10) A display control method, wherein a display device includes: a display unit that displays a screen including externally input video including a surgical video, and a communication unit that communicates information including adjustment information that is information relating to image quality adjustment, with another display device that includes another display unit, and synchronizes the image quality of the screen displayed by the display unit and the image quality of the screen displayed by the other display unit based on the adjustment information.

[0129] REFERENCE SIGNS LIST 1 monitor system, 11A, 11B, 11C medical monitor, 21A, 21B, 21C display unit, 22A, 22B, 22C control unit, 23A, 23B, 23C ambient light sensor, 24A, 24B, 24C information processing unit, 25A, 25B, 25C storage unit, 26A, 26B, 26C communication IF

Claims

1. A display device comprising: a display unit that displays a screen containing externally input images including surgical images; a communication unit that communicates information including adjustment information relating to image quality adjustment between other display devices that have other display units; and an information processing unit that synchronizes the image quality of the screen displayed by the display unit with the image quality of the screen displayed by the other display units based on the adjustment information.

2. The display device according to claim 1, further comprising a detection unit that detects the ambient brightness.

3. The display device according to claim 2, wherein the information processing unit adjusts the brightness of the screen displayed by the display unit according to the brightness detected by the detection unit, and the communication unit transmits the adjustment information indicating the brightness adjustment content to the other display device.

4. The display device according to claim 2, wherein the communication unit receives the adjustment information indicating the adjustment details of the brightness of the screen displayed by the other display unit, the adjustment information being transmitted from the other display device further comprising another detection unit that detects the ambient brightness, and the information processing unit adjusts the brightness of the screen displayed by the display unit based on the adjustment information.

5. The display device according to claim 2, wherein the information processing unit calculates a first brightness value of the screen displayed by the display unit according to the brightness detected by the detection unit, and the communication unit transmits the adjustment information including the first brightness value to the other display device further comprising another detection unit that detects the ambient brightness.

6. The display device described in claim 5, wherein the communication unit receives the adjustment information including a second brightness value of the screen displayed by the other display unit, calculated in the other display device according to the brightness detected by the other detection unit, and the information processing unit adjusts the brightness of the screen displayed by the display unit based on the first brightness value and the second brightness value.

7. The display device according to claim 2, wherein the communication unit transmits information indicating the characteristics of the display unit to the other display device and receives information indicating the characteristics of the other display unit transmitted from the other display device, and the information processing unit adjusts the brightness of the screen displayed by the display unit based on the difference between the characteristics of the display unit and the characteristics of the other display unit.

8. The display device according to claim 1, wherein the communication unit communicates the adjustment information relating to adjustment of at least one of color temperature, gamma, sharpness, and contrast, in addition to luminance.

9. The display device according to claim 1, wherein the information processing unit switches how the image quality of the screen displayed by the display unit is synchronized with the image quality of the screen displayed by the other display unit, depending on the content of the screen displayed by the display unit.

10. A display control method in which a display device includes a display unit that displays a screen containing externally input images including surgical images, and a communication unit that communicates information including adjustment information, which is information related to adjusting image quality, with another display device that includes another display unit, and synchronizes the image quality of the screen displayed by the display unit with the image quality of the screen displayed by the other display unit based on the adjustment information.

Images