Display device and display control method

Abstract

The present technology relates to a display device and a display control method that make it possible to display an image having suitable image quality corresponding to an application in a medical facility. A display device according to one aspect of the present technology comprises a display unit that displays a screen image including input video from the outside including surgical video, and a detection unit that detects ambient brightness. In the display device, a display mode corresponding to at least one of a medical department and an operation formula using the display device is set, and the image quality of the screen image displayed by the display unit is adjusted in accordance with the display mode and the ambient brightness. The present technology can be applied to medical monitors.

Description

Display device and display control method

[0001] The present technology relates to a display device and a display control method, and more particularly to a display device and a display control method that are capable of displaying images with image quality appropriate for the purpose in a medical facility.

[0002] Medical displays installed in operating rooms and other facilities are required to display images of the surgical field that are easy for surgeons to see. Various displays equipped with ambient light sensors and a function to automatically adjust the brightness of images are available on the market.

[0003] JP-A-5-165450 JP-A-6-348245

[0004] The required image characteristics vary depending on the medical department and surgical procedure, and images adjusted in the same way using the detection results of an ambient light sensor cannot meet each of these requirements.

[0005] The present technology has been developed in light of these circumstances, and makes it possible to display images with image quality appropriate for the purpose in medical facilities.

[0006] A display device according to one aspect of the present technology includes a display unit that displays a screen containing externally input images including surgical images, a detection unit that detects the brightness of the surrounding area, and an information processing unit that sets a display mode according to at least one of the medical department and surgical procedure that will use the display device, and adjusts the image quality of the screen displayed by the display unit according to the display mode and the brightness of the surrounding area.

[0007] In one aspect of the present technology, a display mode is set according to at least one of the medical department and surgical procedure using the display device, and the image quality of the screen displayed by the display unit is adjusted according to the display mode and the ambient brightness.

[0008] Fig. 5 is a block diagram showing an example configuration of a medical monitor according to an embodiment of the present technology; Fig. 6 is a flowchart illustrating a brightness and color tone adjustment process; Fig. 7 is a diagram showing an example display of a department selection screen; Fig. 8 is a diagram showing an example of a schematic configuration of an endoscope system; Fig. 9 is a block diagram showing an example of a functional configuration of a camera and a CCU shown in Fig. 4; Fig. 10 is a diagram showing an example of a schematic configuration of a microsurgery system;

[0009] Hereinafter, embodiments of the present technology will be described in the following order: 1. Configuration example of medical monitor 2. Operation of medical monitor 3. Modification 4. Application example

[0010] <<Configuration Example of Medical Monitor>> FIG. 1 is a block diagram showing a configuration example of a medical monitor according to an embodiment of the present technology.

[0011] The medical monitor 1 is a medical display device installed in a room of a medical facility, such as an operating room or examination room. Doctors and medical staff are users of the medical monitor 1. A signal of an image captured by a camera is input to the medical monitor 1, and the input image is displayed. As input images, surgical images such as an operative field image captured by an endoscopic camera, an operative field image captured by an operative field camera installed above the operating table, and an operating room image captured by a camera installed in the operating room are displayed. In addition to moving images, still images of surgical images are also displayed on the medical monitor 1 as appropriate.

[0012] As will be described in detail later, the medical monitor 1 is provided with a function for automatically adjusting the image quality of the screen in accordance with factors such as the ambient brightness. The image quality adjusted by the medical monitor 1 includes brightness and color tone. For example, brightness is adjusted by adjusting the brightness of the backlight provided on the display of the medical monitor 1. Color tone is adjusted by signal processing using a look-up table (LUT) or the like. The automatic adjustment of brightness and color tone is also performed in accordance with the clinical department and surgical procedure in which the medical monitor 1 is used.

[0013] The medical monitor 1 is composed of a display unit 11 , a control unit 12 , an optical input unit 13 , an information processing unit 14 , an external input unit 15 , an operation input unit 16 , and a storage unit 17 .

[0014] The display unit 11 is configured with a display device such as an LCD. The display unit 11 displays various screens, such as a screen containing a surgical video. The display unit 11 may be configured with an organic EL display.

[0015] The control unit 12 is composed of a drive circuit that controls the driving of the backlight of the display unit 11, a drive circuit that controls the driving of the liquid crystal panel of the display unit 11, etc. The control unit 12 adjusts the brightness of the backlight of the display unit 11 according to the control of the information processing unit 14. The control unit 12 also drives the liquid crystal panel of the display unit 11 based on the video signal supplied from the information processing unit 14, and controls the screen display of the display unit 11.

[0016] The optical input unit 13 is a sensor device that functions as a detector that detects the brightness around the medical monitor 1. The optical input unit 13 is provided at a predetermined position, such as on the top of the housing of the medical monitor 1. The optical input unit 13 is provided with an ambient light sensor unit 13A and a filter unit 13B.

[0017] The ambient light sensor unit 13A is configured with, for example, a plurality of illuminance sensors with different characteristics. By switching the illuminance sensor used to detect brightness, the range (wavelength band) of ambient light to be detected can be switched. In addition to sensors corresponding to a normal range, for example, dark-specialized sensors with improved detection accuracy in dark ranges can be realized.

[0018] The filter unit 13B is a filter that adjusts the range of ambient light incident on the ambient light sensor unit 13A. By switching the filter, the range of ambient light incident on the ambient light sensor unit 13A is adjusted. The filter unit 13B can widen the range of ambient light incident on the ambient light sensor unit 13A or narrow it to a dark range.

[0019] In this way, the optical input unit 13 is an ambient light sensor that can change the range of ambient light that it detects. The characteristics of the optical input unit 13 are controlled by the information processing unit 14. The ambient light sensor value indicating the ambient brightness is output to the information processing unit 14 as the detection result of the optical input unit 13.

[0020] The information processing unit 14 is configured by a microprocessor. The information processing unit 14 executes a predetermined program and controls the overall operation of the medical monitor 1. In the information processing unit 14, a mode setting unit 14A, a sensor adjustment unit 14B, and a brightness / color adjustment unit 14C are realized by executing the predetermined program.

[0021] The mode setting unit 14A controls the control unit 12 to display a selection screen for a medical department and surgical procedure on the display unit 11. The selection of a medical department and surgical procedure is performed at a predetermined timing, such as before the start of surgery. The mode setting unit 14A sets a display mode according to the medical department and surgical procedure selected by the user. As the display mode for images on the medical monitor 1, multiple display modes are prepared according to combinations of medical departments and surgical procedures.

[0022] The mode setting unit 14A reads and acquires mode information, which is information relating to the set display mode, from the storage unit 17. The mode information indicates the adjustment contents of the optical input unit 13 and the adjustment contents of the brightness and color tone of the screen.

[0023] The sensor adjustment unit 14B refers to the mode information and adjusts the detection characteristics of the optical input unit 13 in accordance with the display mode.

[0024] The brightness and color tone adjustment unit 14C refers to the mode information and adjusts the brightness and color tone of the screen according to the display mode and the ambient brightness. That is, the brightness and color tone adjustment unit 14C controls the control unit 12 to adjust the brightness of the backlight of the display unit 11. The brightness and color tone adjustment unit 14C also adjusts the content of signal processing for adjusting the color tone. The color tone adjustment includes adjustment of at least one of hue, lightness, saturation, and edge emphasis.

[0025] For example, the brightness and color tone adjustment unit 14C sets the brightness and color tone adjustment contents according to the display mode. After setting the adjustment contents, the brightness and color tone adjustment unit 14C adjusts the brightness and color tone of the screen according to the ambient brightness represented by the ambient light sensor value. Ambient light is detected at a predetermined timing, for example, after the start of surgery, and the ambient light sensor value is supplied from the optical input unit 13. Basically, the brightness and color tone are adjusted by lowering the brightness when the ambient light becomes dark and adjusting the color tone accordingly. Furthermore, the brightness and color tone are adjusted by raising the brightness when the ambient light becomes brighter and adjusting the color tone accordingly.

[0026] Furthermore, the brightness and color tone adjustment unit 14C adjusts the brightness and color tone according to the display mode, and then adjusts the brightness and color tone of the screen according to the input video information. The input video information is information indicating the type of video to be displayed. The input video information, together with the video signal of the surgical video to be displayed on the display unit 11, is transmitted from an external device as a source and received by the external input unit 15. The input video information received by the external input unit 15 is supplied to the information processing unit 14 and acquired.

[0027] In this way, the ambient light sensor value and input video information are used as control parameters for brightness and color tone. The ambient light sensor value, which is repeatedly acquired during surgery, becomes a control parameter that indicates changes in the surrounding brightness and darkness during surgery. Furthermore, the input video information, which is repeatedly acquired during surgery, becomes a control parameter that indicates changes in the image during surgery.

[0028] The external input unit 15 receives a video signal input from an external device and outputs it to the information processing unit 14. The external input unit 15 receives signals of videos captured by various cameras such as an endoscopic camera and an operating field camera.

[0029] The operation input unit 16 is composed of buttons provided on the housing of the medical monitor 1 and a touch panel provided over the display unit 11. The operation input unit 16 detects user operations and outputs information indicating the content of the operation to the information processing unit 14. The medical monitor 1 may be operated using a remote controller or a device capable of communicating with the medical monitor 1.

[0030] The storage unit 17 is a memory configured by a flash memory, etc. The storage unit 17 stores various information such as programs executed by the information processing unit 14 and mode information.

[0031] <<Operation of Medical Monitor>> The brightness and color tone adjustment process of the medical monitor 1 will be described with reference to the flowchart of Fig. 2. The process of Fig. 2 is started, for example, before the start of surgery.

[0032] In step S1, the mode setting unit 14A of the information processing unit 14 causes the display unit 11 to display a selection screen for a medical department.

[0033] FIG. 3 is a diagram showing an example of a display of a department selection screen.

[0034] In the example of Figure 3, a message prompting the user to select a medical specialty is displayed, and below the message are displayed buttons to select general surgery, neurosurgery, ophthalmology, internal medicine, dentistry, and others. The user operates one of the buttons to select the desired medical specialty.

[0035] After the medical department is selected, in step S2 of Fig. 2, the mode setting unit 14A displays a selection screen for a surgical procedure on the display unit 11. Here, for example, a different selection screen is displayed for each selected medical department. In this example, selectable surgical procedures are prepared for each medical department.

[0036] In step S3, the mode setting unit 14A sets a display mode according to the combination of the medical department and surgical procedure selected by the user. For example, the following modes are prepared as the display modes:

[0037] General incision surgery mode General incision surgery mode is set when general incision surgery is selected as the surgical procedure. The general incision surgery procedure can be selected regardless of the medical department selected. General incision surgery mode is a display mode that adjusts brightness and color tone according to the ambient brightness represented by the ambient light sensor value, and does not adjust brightness and color tone according to the input video information.

[0038] Brain surgery mode The brain surgery mode is set when brain surgery is selected as the surgical procedure. Brain surgery includes cerebral vascular resection, brain tumor removal, cerebral aneurysm resection, etc. Brain surgery procedures can be selected when brain surgery is selected.

[0039] In the brain surgery mode, the characteristics of the optical input unit 13 are adjusted to narrow the detection range to a dark range by using a dark-specializing sensor and a dark filter. The adjustment of brightness and color tone according to the ambient brightness represented by the ambient light sensor value and the adjustment of brightness and color tone according to the input video information are performed so that the contrast between red and gray-white is clear and whiteout is not generated.

[0040] Ophthalmic Surgery Mode The ophthalmic surgery mode is set when ophthalmic surgery is selected as the surgical procedure. Ophthalmic surgery includes surgeries such as cataracts, glaucoma, and retinal detachment. Ophthalmic surgery procedures can be selected when ophthalmology is selected.

[0041] In the ophthalmic surgery mode, the characteristics of the optical input unit 13 are adjusted to narrow the detection range to a dark range by using a dark-specializing sensor and a dark filter. The adjustment of brightness and color tone according to the ambient brightness represented by the ambient light sensor value and the adjustment of brightness and color tone according to the input video information are performed so that the contrast between black and white is clear and whiteout is not generated.

[0042] Rigid endoscopic surgery mode The rigid endoscopic surgery mode is set when rigid endoscopic surgery is selected as the surgical procedure. Rigid endoscopic surgery includes laparoscopic surgery. The rigid endoscopic surgery procedure can be selected when general surgery or internal medicine is selected.

[0043] In the rigid endoscopic surgery mode, the characteristics of the optical input unit 13 are adjusted to widen the detection range. The brightness and color tone are adjusted in accordance with the ambient brightness represented by the ambient light sensor value by lowering the brightness as the ambient light becomes darker and emphasizing the color of the fluorescent material. The brightness and color tone are adjusted in accordance with the input video information by making red more vivid as the ambient light becomes brighter and emphasizing the color of the fluorescent material as the ambient light becomes darker.

[0044] - Flexible endoscopic resection mode, flexible endoscopic observation mode Flexible endoscopic resection mode is set when flexible endoscopic resection is selected as the surgical procedure. Flexible endoscopic resection includes polypectomy and mucosal resection. Furthermore, flexible endoscopic observation mode is set when flexible endoscopic observation is selected as the surgical procedure. Flexible endoscopic observation includes observation using a gastroscope, colonoscope, and small intestine camera. Flexible endoscopic resection and flexible endoscopic observation can be selected when internal medicine is selected.

[0045] The flexible endoscopic resection mode and flexible endoscopic observation mode are display modes that do not adjust the brightness and color tone according to the ambient brightness represented by the ambient light sensor value. The brightness and color tone adjustment according to the input video information is performed so as to emphasize the fluorescent color of the target tissue when using special light.

[0046] Dental surgery mode, dental observation mode Dental surgery mode is set when dental surgery is selected as the procedure. Dental surgery includes tooth extraction and implant surgery. Dental observation mode is set when dental observation is selected as the procedure. Dental surgery and dental observation can be selected when dentistry is selected.

[0047] The dental surgery mode and dental observation mode are display modes that do not adjust brightness and color tone according to the ambient brightness indicated by the ambient light sensor value. Brightness and color tone adjustment according to the input video information is performed by emphasizing red and white.

[0048] 2, in step S4, the sensor adjustment unit 14B adjusts the detection characteristics (sensor characteristics) of the optical input unit 13 in accordance with the display mode. As described above, depending on the display mode, the adjustment of the sensor characteristics and the adjustment of the screen brightness and color tone may not be performed.

[0049] In step S5, the brightness and color tone adjuster 14C sets the brightness and color tone adjustment contents according to the display mode. For example, after the adjustment contents according to the display mode are set, surgery is started.

[0050] In step S6, the ambient light sensor unit 13A detects the ambient brightness.

[0051] In step S7, the external input unit 15 receives input video information.

[0052] In step S8, the brightness and color tone adjustment unit 14C adjusts the brightness and color tone of the screen as appropriate based on the display mode, the ambient light sensor value, and the input video information.

[0053] In step S9, the information processing unit 14 determines whether the surgery has ended. If it is determined in step S9 that the surgery has not ended, the process returns to step S6, and the subsequent processes are repeated. The brightness and color tone are repeatedly adjusted based on the ambient brightness detected at predetermined times during the surgery.

[0054] If it is determined in step S9 that the surgery is complete, the brightness and color tone adjustment process in FIG. 2 ends.

[0055] As described above, the medical monitor 1 is provided with display modes that correspond to a variety of uses in medical facilities. By providing display modes according to the medical department and surgical procedure, it is possible to adjust the brightness and color tone to suit the surgical environment. For example, ophthalmic surgery is performed in a dark operating room. By using a dark-specific sensor or dark-specific filter to increase the resolution in a dark environment, the surgeon can perform surgery in a more suitable environment.

[0056] Furthermore, by adjusting brightness and color tones in response to changes in brightness during surgery, surgeons can always operate in an environment that is optimal for them. This reduces eye strain, improves visibility of displayed content, and enables displays that do not interfere with surgery.

[0057] <<Variations>> <Automatic setting of display mode> The display mode is set based on the department and surgical procedure selected by the user, but the display mode may be set automatically without user operation.

[0058] Example of setting by a central control system If the environment in which the medical monitor 1 is installed is an environment in which each device is set by a central control system, the display mode is automatically set according to the control of the central control system. In this case, the information processing unit 14 receives information on the setting contents of the display mode transmitted from the central control system, and sets the display mode based on the received information.

[0059] Example of setting using patient information or surgery information When patient information or surgery information is input from an external device, the display mode is automatically set based on the patient information or surgery information. In this case, the information processing unit 14 receives at least one of the patient information and surgery information transmitted from the external device and sets the display mode based on the received information. The patient information includes information about symptoms. The surgery information includes information about the details of the surgery.

[0060] Example of setting using location information When location information indicating the location (room) where the medical monitor 1 is installed is input from an external device, the display mode is automatically set based on the location information. In this case, the information processing unit 14 receives the location information transmitted from the external device and sets the display mode based on the received information.

[0061] Example of setting using input video information: The display mode is automatically set based on the input video information input from the device that is the source of the surgical video. In this case, the information processing unit 14 receives the input video information transmitted from the device that is the source of the surgical field video, and sets the display mode based on the received information.

[0062] By automatically setting the display mode, it is possible to eliminate the need to select a medical department or surgical procedure.

[0063] <Others> Although the display mode is set according to the combination of the medical department and the surgical procedure, it is also possible to have only the medical department selected and the display mode set according to the selected medical department. Alternatively, it is also possible to have only the surgical procedure selected and the display mode set according to the selected surgical procedure. It is possible to have the display mode set based on at least one of the medical department and the surgical procedure. In this case, a selection screen for at least one of the medical department and the surgical procedure is displayed.

[0064] Although the case where brightness and color tone are adjusted as the image quality of the screen has been described, various adjustments regarding image quality other than brightness and color tone may also be made. Image quality adjustment parameters include, for example, the following: Color temperature Gamma Sharpness Contrast

[0065] The embodiments of the present technology are not limited to the above-described embodiments, and various modifications are possible without departing from the spirit of the present technology.

[0066] <<Application Example>> The technology according to the present disclosure can be applied to a medical imaging system. A medical imaging system is a medical system that uses imaging technology, such as an endoscope system or a microscope system.

[0067] [Endoscopic System] An example of an endoscopic system will be described with reference to FIGS. 4 and 5. FIG. 4 is a diagram illustrating an example of the schematic configuration of an endoscopic system 5000 to which the technology according to the present disclosure can be applied. FIG. 5 is a diagram illustrating an example of the configuration of an endoscope 5001 and a CCU (Camera Control Unit) 5039. FIG. 4 illustrates a state in which an operator (e.g., a doctor) 5067, who is a surgical participant, is performing surgery on a patient 5071 on a patient bed 5069 using the endoscopic system 5000. As shown in FIG. 4, the endoscopic system 5000 includes an endoscope 5001, which is a medical imaging device, a CCU 5039, a light source device 5043, a recording device 5053, an output device 5055, and a support device 5027 that supports the endoscope 5001.

[0068] In endoscopic surgery, an insertion aid called a trocar 5025 is inserted into a patient 5071. Then, a scope 5003 and surgical tools 5021 connected to an endoscope 5001 are inserted into the body of the patient 5071 via the trocar 5025. The surgical tools 5021 are, for example, energy devices such as an electric scalpel, forceps, etc.

[0069] A surgical image, which is a medical image showing the inside of the body of a patient 5071 photographed by an endoscope 5001, is displayed on a display device 5041. An operator 5067 performs a procedure on the surgical target using a surgical tool 5021 while viewing the surgical image displayed on the display device 5041. Note that the medical image is not limited to a surgical image, and may be a diagnostic image photographed during a diagnosis.

[0070] [Endoscope] The endoscope 5001 is an imaging unit that captures images of the inside of the patient's 5071. For example, as shown in FIG. 5 , the endoscope 5001 is a camera 5005 that includes a focusing optical system 50051 that focuses incident light, a zoom optical system 50052 that changes the focal length of the imaging unit to enable optical zoom, a focus optical system 50053 that changes the focal length of the imaging unit to enable focus adjustment, and a light-receiving element 50054. The endoscope 5001 generates pixel signals by focusing light onto the light-receiving element 50054 via a connected scope 5003, and outputs the pixel signals to the CCU 5039 via a transmission system. The scope 5003 has an objective lens at its tip and is an insertion section that guides light from a connected light source device 5043 into the inside of the patient's 5071. The scope 5003 is, for example, a rigid scope if it is a rigid endoscope or a flexible scope if it is a flexible endoscope. The scope 5003 may be a direct-view endoscope or an oblique-view endoscope. Furthermore, the pixel signal may be a signal based on a signal output from a pixel, such as a RAW signal or an image signal. Furthermore, a configuration may be adopted in which a memory is installed in the transmission system connecting the endoscope 5001 and the CCU 5039, and parameters related to the endoscope 5001 and the CCU 5039 are stored in the memory. The memory may be located, for example, in a connection portion of the transmission system or on a cable. For example, parameters at the time of shipment of the endoscope 5001 and parameters that change when power is applied may be stored in the memory of the transmission system, and the operation of the endoscope may be changed based on parameters read from the memory. Furthermore, the endoscope and the transmission system may be collectively referred to as an endoscope. The light-receiving element 50054 is a sensor that converts received light into a pixel signal, and is, for example, a CMOS (Complementary Metal Oxide Semiconductor) type image sensor. It is preferable that the light-receiving element 50054 be an image sensor capable of color imaging with a Bayer array. Furthermore, the light receiving element 50054 is preferably an imaging element having a number of pixels corresponding to a resolution of, for example, 4K (3840 horizontal pixels × 2160 vertical pixels), 8K (7680 horizontal pixels × 4320 vertical pixels), or square 4K (3840 or more horizontal pixels × 3840 or more vertical pixels). The light receiving element 50054 may be a single sensor chip or multiple sensor chips.For example, a prism may be provided to separate incident light into predetermined wavelength bands, and each wavelength band may be imaged by a different light-receiving element. Alternatively, multiple light-receiving elements may be provided for stereoscopic vision. The light-receiving element 50054 may be a sensor including an image processing circuit within its chip structure, or a Time of Flight (ToF) sensor. The transmission system may be, for example, an optical fiber cable or wireless transmission. Wireless transmission may be performed via any means capable of transmitting pixel signals generated by the endoscope 5001. For example, the endoscope 5001 and the CCU 5039 may be connected wirelessly, or the endoscope 5001 and the CCU 5039 may be connected via a base station in the operating room. In this case, the endoscope 5001 may simultaneously transmit not only pixel signals but also information related to the pixel signals (e.g., pixel signal processing priority, synchronization signal, etc.). The endoscope may be configured such that the scope and camera are integrated, or a light-receiving element is provided at the tip of the scope.

[0071] [CCU (Camera Control Unit)] The CCU 5039 is a control device that comprehensively controls the connected endoscope 5001 and light source device 5043. For example, as shown in FIG. 5 , the CCU 5039 is an information processing device having an FPGA 50391, a CPU 50392, a RAM 50393, a ROM 50394, a GPU 50395, and an I / F 50396. The CCU 5039 may also comprehensively control the connected display device 5041, recording device 5053, and output device 5055. For example, the CCU 5039 controls the irradiation timing, irradiation intensity, and type of irradiation light source of the light source device 5043. The CCU 5039 also performs image processing such as development processing (e.g., demosaic processing) and correction processing on pixel signals output from the endoscope 5001, and outputs the processed pixel signals (e.g., an image) to an external device such as the display device 5041. Furthermore, the CCU 5039 transmits a control signal to the endoscope 5001 to control the driving of the endoscope 5001. The control signal is, for example, information regarding imaging conditions such as the magnification and focal length of the imaging unit. The CCU 5039 may have an image down-conversion function and be configured to be able to simultaneously output a high-resolution (e.g., 4K) image to the display device 5041 and a low-resolution (e.g., HD) image to the recording device 5053.

[0072] The CCU 5039 may also be connected to external devices (e.g., recording devices, display devices, output devices, and support devices) via an IP converter that converts signals into a predetermined communication protocol (e.g., IP (Internet Protocol)). The connection between the IP converter and the external devices may be configured as a wired network, or a partial or entire network may be configured as a wireless network. For example, the IP converter on the CCU 5039 side may have a wireless communication function and transmit the received video to an IP switcher or an output-side IP converter via a wireless communication network such as a fifth-generation mobile communication system (5G) or a sixth-generation mobile communication system (6G).

[0073] [Light Source Device] The light source device 5043 is a device capable of emitting light in a predetermined wavelength band and includes, for example, multiple light sources and a light source optical system that guides the light from the multiple light sources. The light sources are, for example, a xenon lamp, an LED light source, or an LD light source. The light source device 5043 has, for example, LED light sources corresponding to the three primary colors R, G, and B, and emits white light by controlling the output intensity and output timing of each light source. Furthermore, the light source device 5043 may include a light source that can emit special light used for special light observation, in addition to a light source that emits normal light used for normal light observation. The special light is light in a predetermined wavelength band different from the normal light used for normal light observation, such as near-infrared light (light with a wavelength of 760 nm or more), infrared light, blue light, or ultraviolet light. The normal light is, for example, white light or green light. Narrowband light observation, a type of special light observation, alternately emits blue light and green light to utilize the wavelength-dependence of light absorption in body tissue, enabling high-contrast imaging of specific tissue, such as blood vessels on the surface of the mucous membrane. Furthermore, in fluorescence observation, a type of special light observation, excitation light is applied to excite a drug injected into the body tissue, and fluorescence emitted by the drug as a marker is received to obtain a fluorescence image, thereby making it easier for the surgeon to visualize body tissues that are difficult for the surgeon to see under normal light. For example, in fluorescence observation using infrared light, infrared light having an excitation wavelength band is applied to a drug such as indocyanine green (ICG) injected into the body tissue, and the fluorescence of the drug is received, making it easier to visualize the structure of the body tissue and affected areas. Furthermore, in fluorescence observation, a drug (e.g., 5-ALA) that is excited by special light in the blue wavelength band and emits fluorescence in the red wavelength band may be used. The type of light irradiated by the light source device 5043 is set under the control of the CCU 5039. The CCU 5039 may have a mode in which normal light observation and special light observation are alternately performed by controlling the light source device 5043 and the endoscope 5001. In this case, it is preferable to superimpose information based on pixel signals obtained by special light observation on pixel signals obtained by normal light observation. The special light observation may be infrared light observation, which irradiates infrared light to view areas deeper than the surface of an organ, or multispectral observation using hyperspectral spectroscopy. Furthermore, photodynamic therapy may be combined.

[0074] [Recording Device] The recording device 5053 is a device, such as a recorder, that records pixel signals (e.g., images) acquired from the CCU 5039. The recording device 5053 records images acquired from the CCU 5039 on a HDD, SSD, or optical disk. The recording device 5053 may be connected to a network within the hospital so as to be accessible from devices outside the operating room. The recording device 5053 may also have an image down-conversion or up-conversion function.

[0075] [Display Device] The display device 5041 is a device capable of displaying an image, such as a display monitor. The display device 5041 displays an image based on pixel signals acquired from the CCU 5039. The display device 5041 may also function as an input device that enables gaze recognition, voice recognition, and instruction input using gestures by including a camera and a microphone.

[0076] [Output Device] The output device 5055 is a device, such as a printer, that outputs information acquired from the CCU 5039. The output device 5055 prints, for example, a print image based on pixel signals acquired from the CCU 5039 onto paper.

[0077] [Support Device] The support device 5027 is an articulated arm including a base 5029 having an arm control device 5045, an arm 5031 extending from the base 5029, and a holder 5032 attached to the tip of the arm 5031. The arm control device 5045 is configured with a processor such as a CPU and controls the drive of the arm 5031 by operating according to a predetermined program. The support device 5027 controls the position and posture of the endoscope 5001 held by the holder 5032, for example, by controlling parameters such as the length of each link 5035 constituting the arm 5031 and the rotation angle and torque of each joint 5033 using the arm control device 5045. This allows the endoscope 5001 to be changed to a desired position or posture, allowing the scope 5003 to be inserted into the patient 5071 and the observation area within the body to be changed. The support device 5027 functions as an endoscope support arm that supports the endoscope 5001 during surgery. This allows the support device 5027 to take the place of an assistant scopist who holds the endoscope 5001. The support device 5027 may also be a device that supports a microscope device 5301 (described later) and may also be called a medical support arm. The support device 5027 may be controlled autonomously by the arm control device 5045, or may be controlled by the arm control device 5045 based on user input. For example, the control method may be a master-slave method in which the support device 5027, which serves as a slave device (replica device) serving as a patient cart, is controlled based on the movement of a master device (primary device) that serves as an operator console near the user. The support device 5027 may also be remotely controlled from outside the operating room.

[0078] The above describes an example of an endoscope system 5000 to which the technology according to the present disclosure can be applied. For example, the technology according to the present disclosure may be applied to a microscope system.

[0079] 6 is a diagram showing an example of the schematic configuration of a microsurgical system to which the technology according to the present disclosure can be applied. In the following description, components similar to those in the endoscope system 5000 are designated by the same reference numerals, and redundant description thereof will be omitted.

[0080] 6 shows a schematic diagram of an operator 5067 performing surgery on a patient 5071 on a patient bed 5069 using a microsurgical system 5300. For simplicity, the illustration of the cart 5037 of the microsurgical system 5300 is omitted, and a microscope device 5301 that replaces the endoscope 5001 is simplified. However, the microscope device 5301 in this description may refer to the microscope unit 5303 provided at the tip of the link 5035, or may refer to the entire configuration including the microscope unit 5303 and the support device 5027.

[0081] As shown in Figure 6, during surgery, a microsurgical system 5300 is used to display an enlarged image of the surgical site captured by a microscope device 5301 on a display device 5041 installed in an operating room. The display device 5041 is installed in a position facing the surgeon 5067, who performs various procedures on the surgical site, such as resecting the affected area, while observing the state of the surgical site using the image displayed on the display device 5041. Microsurgical systems are used, for example, in ophthalmic surgery and brain surgery.

[0082] The above describes examples of an endoscopic system 5000 and a microsurgery system 5300 to which the technology of the present disclosure can be applied. Note that the systems to which the technology of the present disclosure can be applied are not limited to these examples. For example, the support device 5027 may support another observation device or another surgical tool at its tip instead of the endoscope 5001 or the microscope unit 5303. Examples of such other observation devices include forceps, a surgeon, an insufflation tube for insufflation, or an energy treatment tool for incising tissue or sealing blood vessels by cauterization. Supporting these observation devices and surgical tools with a support device allows them to be more stably fixed in position than when medical staff support them manually, and also reduces the burden on medical staff. The technology of the present disclosure may be applied to support devices that support components other than the microscope unit.

[0083] Of the configurations described above, the technology according to the present disclosure can be suitably applied to image quality adjustment in the display device 5041. By applying the technology according to the present disclosure to image quality adjustment in the display device 5041, it becomes possible to display clearer surgical images.

[0084] <Examples of Combinations of Configurations> The present technology can also have the following configurations.

[0085] (1) A display device comprising: a display unit that displays a screen including externally input video including surgical video; a detection unit that detects ambient brightness; and an information processing unit that sets a display mode according to at least one of a medical department and a surgical procedure using the display device, and adjusts the image quality of the screen displayed by the display unit according to the display mode and the ambient brightness. (2) The display device described in (1), in which the information processing unit adjusts the brightness and color tone of the screen displayed by the display unit according to the ambient brightness detected at a predetermined timing during surgery. (3) The display device described in (1) or (2), in which the information processing unit sets the adjustment contents of the brightness and color tone of the screen displayed by the display unit according to the display mode. (4) The display device described in any of (1) to (3), in which the information processing unit displays a selection screen for at least one of a medical department and a surgical procedure on the display unit, and sets the display mode according to the selection contents made by the user. (5) The display device described in (4), in which, when both a medical department and a surgical procedure are selected, selectable surgical procedures are provided for each medical department. (6) The display device according to any one of (1) to (5), wherein the information processing unit adjusts brightness detection characteristics of the detection unit according to the display mode. (7) The display device according to (6), wherein the detection unit has a plurality of sensors that detect ambient light in different wavelength bands, and the information processing unit adjusts the detection characteristics by switching the sensor used to detect brightness. (8) The display device according to (6) or (7), wherein the detection unit has a sensor that detects ambient light and a filter that adjusts the wavelength band of ambient light incident on the sensor, and the information processing unit adjusts the detection characteristics by switching the filter. (9) The display device according to any one of (1) to (8), wherein the information processing unit acquires input video information indicating a type of the input video transmitted from a device that is an input source of the input video, and adjusts the brightness and color tone of the screen displayed by the display unit according to the type of the input video.(10) A display control method in which a display device having a display unit that displays a screen including externally input images including surgical images and a detection unit that detects the brightness of the surroundings sets a display mode according to at least one of the medical department and surgical procedure that uses the display device, and adjusts the image quality of the screen displayed by the display unit according to the display mode and the brightness of the surroundings.

[0086] REFERENCE SIGNS LIST 1 medical monitor, 11 display unit, 12 control unit, 13 optical input unit, 14 information processing unit, 15 external input unit, 16 operation input unit, 17 storage unit

Claims

1. A display device comprising: a display unit that displays a screen containing externally input images including surgical images; a detection unit that detects the brightness of the surroundings; and an information processing unit that sets a display mode according to at least one of the medical department and surgical procedure that uses the display device, and adjusts the image quality of the screen displayed by the display unit according to the display mode and the brightness of the surroundings.

2. The display device according to claim 1, wherein the information processing unit adjusts the brightness and color tone of the screen displayed by the display unit according to the ambient brightness detected at a predetermined timing during surgery.

3. The display device according to claim 1, wherein the information processing section sets adjustment contents for brightness and color tone of the screen displayed by the display section according to the display mode.

4. The display device according to claim 1, wherein the information processing unit displays a selection screen for at least one of a medical department and a surgical procedure on the display unit, and sets the display mode according to the selection made by the user.

5. The display device according to claim 4, wherein when both a medical department and a surgical procedure are selected, selectable surgical procedures are provided for each medical department.

6. The display device according to claim 1, wherein the information processing section adjusts the brightness detection characteristics of the detection section in accordance with the display mode.

7. The display device according to claim 6, wherein the detection unit has a plurality of sensors that detect ambient light in different wavelength bands, and the information processing unit adjusts the detection characteristics by switching the sensor used to detect brightness.

8. The display device according to claim 6, wherein the detection unit has a sensor that detects ambient light and a filter that adjusts the wavelength band of the ambient light incident on the sensor, and the information processing unit adjusts the detection characteristics by switching the filter.

9. The display device according to claim 1, wherein the information processing unit acquires input video information indicating the type of input video transmitted from a device that is the input source of the input video, and adjusts the brightness and color tone of the screen displayed by the display unit according to the type of input video.

10. A display control method in which a display device having a display unit that displays a screen containing externally input images including surgical images and a detection unit that detects the brightness of the surroundings sets a display mode according to at least one of the medical department and surgical procedure that uses the display device, and adjusts the image quality of the screen displayed by the display unit according to the display mode and the brightness of the surroundings.

Images