Medical control device, medical control system, medical control method, and medical control program

Abstract

A medical control device 5 comprises: a storage unit 53 that stores first related information for deriving an operation image that can be operated through a touch panel 552 provided on a display screen of a display unit 551 from scene information on an observation scene of a subject by a medical observation device 2 and user information for identifying a user using the medical observation device 2; a scene determination unit 52 that determines the observation scene and calculates the scene information; a user information acquisition unit 52 that acquires user information; and a display control unit 52 that derives the operation image from the scene information calculated by the scene determination unit 52 and the user information acquired by the user information acquisition unit 52 on the basis of the first related information, and causes the operation image to be displayed on the display screen.

Description

Medical control device, medical control system, and medical control method

[0001] The present invention relates to a medical control device, a medical control system, and a medical control method.

[0002] Conventionally, medical control systems have been known that include a medical observation device such as an endoscope and a medical control device that controls the operation of the medical observation device (see, for example, Patent Documents 1 and 2). In the medical control devices described in Patent Documents 1 and 2, a touch panel that accepts user operations is provided on a front panel or the like. This touch panel is provided on the display screen of the display unit. The user then operates (touches) an operation image displayed on the display screen via the touch panel to cause the medical control device to execute a specific function.

[0003] JP 2009-201593 A JP 2021-151277 A

[0004] However, the functions that users want the medical control device to execute vary depending on the observation scene of a subject using the medical observation device and on the user. The medical control devices described in Patent Documents 1 and 2 do not change the operation images displayed on the display screen for each observation scene and each user. Therefore, for some users, operation images that are rarely used may be displayed on the display screen, resulting in poor operability. Therefore, there is a demand for technology that can display operation images on the display screen that correspond to the functions that users want the medical control device to execute, thereby improving operability.

[0005] The present invention has been made in view of the above, and has an object to provide a medical control device, a medical control system, and a medical control method that can improve operability.

[0006] In order to solve the above-mentioned problems and achieve the object, the medical control device according to the present invention comprises: a storage unit that stores first related information for deriving an operation image that can be operated by a touch panel provided on a display screen of a display unit, from scene information about an observation scene of a subject observed by a medical observation device and user information that identifies a user who uses the medical observation device; a scene determination unit that determines the observation scene and calculates the scene information; a user information acquisition unit that acquires the user information; and a display control unit that derives the operation image from the scene information calculated by the scene determination unit and the user information acquired by the user information acquisition unit, based on the first related information, and displays the operation image on the display screen.

[0007] A medical control system according to the present invention comprises a medical observation device for observing a subject, and a medical control device for controlling the operation of the medical observation device. The medical control device comprises: a storage unit for storing first related information for deriving an operation image that can be operated by a touch panel provided on a display screen of a display unit, from scene information about an observation scene of a subject observed by the medical observation device and user information that identifies a user who uses the medical observation device; a scene determination unit for determining the observation scene and calculating the scene information; a user information acquisition unit for acquiring the user information; and a display control unit for deriving the operation image from the scene information calculated by the scene determination unit and the user information acquired by the user information acquisition unit, based on the first related information, and displaying the operation image on the display screen.

[0008] A medical control method according to the present invention is a medical control method executed by a medical control device, and comprises: a scene determination step of determining an observation scene of a subject observed by a medical observation device and calculating scene information related to the observation scene; a user information acquisition step of acquiring user information identifying a user who uses the medical observation device; and a display control step of deriving an operation image that can be operated by a touch panel provided on a display screen of a display device from the scene information calculated by the scene determination step and the user information acquired by the user information acquisition step, based on first related information stored in a storage unit, and displaying the operation image on the display screen.

[0009] According to the medical control device, medical control system, and medical control method of the present invention, operability can be improved.

[0010] FIG. 1 is a diagram illustrating a configuration of an endoscope system according to an embodiment. FIG. 2 is a block diagram illustrating a configuration of a control device. FIG. 3 is a diagram illustrating an example of a medical control method. FIG. 4 is a diagram illustrating an example of a medical control method. FIG. 5 is a diagram illustrating an example of a medical control method. FIG. 6 is a diagram illustrating an example of a medical control method. FIG. 7 is a diagram illustrating an example of a medical control method. FIG. 8 is a diagram illustrating a first modification of the embodiment. FIG. 9 is a diagram illustrating a second modification of the embodiment. FIG. 10 is a diagram illustrating a second modification of the embodiment. FIG. 11 is a diagram illustrating a third modification of the embodiment. FIG. 12 is a diagram illustrating a fourth modification of the embodiment.

[0011] Hereinafter, a mode for carrying out the present invention (hereinafter referred to as an embodiment) will be described with reference to the drawings. Note that the present invention is not limited to the embodiment described below. Furthermore, in the description of the drawings, the same parts are given the same reference numerals.

[0012] [Schematic Configuration of Endoscope System] Fig. 1 is a diagram showing the configuration of an endoscope system 1 according to an embodiment. The endoscope system 1 corresponds to a medical control system according to the present invention. This endoscope system 1 is used in the medical field and is a system for observing the inside of a living body. As shown in Fig. 1, the endoscope system 1 includes an endoscope 2, a light source device 3, a display device 4, and a control device 5.

[0013] The endoscope 2 corresponds to a medical observation device according to the present invention. In this embodiment, the endoscope 2 is a so-called flexible endoscope. A portion of the endoscope 2 is inserted into a living body, images the inside of the living body, and output image signals obtained by the images. As shown in FIG. 1 , the endoscope 2 includes an insertion section 21, an operation section 22, a universal cord 23, and a connector section 24.

[0014] The insertion section 21 has at least a portion that is flexible and is inserted into a living body. The insertion section 21 includes a tip unit 211, a bending section 212, and a flexible tube 213, as shown in FIG.

[0015] The tip unit 211 is provided at the tip of the insertion section 21. Although not specifically shown in the drawings, the tip unit 211 is provided with an illumination optical system, an imaging optical system, and an imaging unit.

[0016] The illumination optical system faces one end of a light guide (not shown) routed within the insertion portion 21 , and irradiates the observation light transmitted by the light guide from the tip of the insertion portion 21 into the living body.

[0017] The imaging optical system receives observation light (subject image) that is irradiated from the illumination optical system onto the inside of the living body and returns from the living body, and forms an image on the imaging surface of an imaging element that constitutes the imaging unit.

[0018] The imaging unit includes an imaging element such as a charge coupled device (CCD) or a complementary metal-oxide semiconductor (CMOS), captures an image of a subject formed by an imaging optical system, and outputs an image signal generated by the image capture. Hereinafter, the image signal will be referred to as imaging data.

[0019] The bending portion 212 is connected to the base end side (the operation portion 22 side) of the tip unit 211. Although not specifically shown in the drawings, the bending portion 212 has a configuration in which a plurality of bending pieces are connected to each other, and is capable of bending.

[0020] The flexible tube 213 is connected to the base end side (operation section 22 side) of the bending section 212 and is formed in a flexible, long shape.

[0021] The operation unit 22 is connected to the base end portion of the insertion unit 21. As shown in FIG. 1 , the operation unit 22 is provided with a plurality of operation buttons 221 to 223 (three in this embodiment) that accept various operations on the endoscope 2.

[0022] The universal cord 23 extends from the operating section 22 in a direction different from the direction in which the insertion section 21 extends, and is a cord on which the above-mentioned light guide and the above-mentioned signal line for transmitting the imaging data are arranged.

[0023] The connector portion 24 is provided at the end of the universal cord 23 and is detachably connected to the light source device 3 and the control device 5 .

[0024] In this embodiment, various endoscopes 2 of different release generations are connectable to the light source device 3 and the control device 5. These various endoscopes 2 of different release generations differ in the type of image sensor (CCD, CMOS), the number of pixels of the image sensor, the sensitivity of the image sensor, the characteristics of the illumination optical system and the image sensor, etc.

[0025] The light source device 3 supplies observation light to the other end of the light guide under the control of the control device 5. The observation light then passes through the light guide and the illumination optical system, and is then irradiated into the living body from the tip of the insertion section 21. Examples of the observation light include broadband white light (normal light), narrowband excitation light that excites a fluorescent agent such as indocyanine green, and narrowband light used in Narrow Band Imaging (NBI).

[0026] The display device 4 is an LCD (Liquid Crystal Display), an organic EL (Electro Luminescence) display, or the like, and displays a display image (endoscopic image) according to a video signal output from the control device 5 under the control of the control device 5.

[0027] The control device 5 corresponds to a medical control device according to the present invention. The control device 5 includes controllers such as a CPU (Central Processing Unit) and an MPU (Micro Processing Unit), and comprehensively controls the operations of the endoscope 2 (the imaging unit described above, etc.) and the light source device 3. The control device 5 is not limited to a CPU or an MPU, and may include an ASIC (Application Specific Integrated Circuit), an FPGA (Field-Programmable Gate Array), a GPU (Graphics Processing Unit), etc. The detailed configuration of the control device 5 will be described later in the section "Configuration of the Control Device."

[0028] [Configuration of Control Device] Next, a description will be given of the configuration of the control device 5. Fig. 2 is a block diagram showing the configuration of the control device 5. As shown in Fig. 2, the control device 5 includes an image processing unit 51, a control unit 52, a storage unit 53, an operation input unit 54, and a touch panel display 55.

[0029] The image processing unit 51 performs image processing on the imaging data (RAW data) obtained by imaging using the endoscope 2 , and generates a video signal corresponding to the display image to be displayed on the display device 4 .

[0030] The image processing performed by the image processing unit 51 includes noise removal, brightness correction (gain correction), and structure enhancement. Furthermore, the image processing performed by the image processing unit 51 may include image processing according to the observation light (white light, excitation light, narrowband light) irradiated into the living body. Examples of image processing according to the observation light irradiated into the living body include optical black subtraction (clamping), white balance adjustment, demosaic processing, color correction matrix processing, gamma correction, and YC processing for converting RGB signals into luminance and color difference signals (Y, Cb / Cr signals).

[0031] The control unit 52 is realized by a controller such as a CPU or an MPU executing various programs stored in the storage unit 53, and controls the operation of the endoscope 2 (the imaging unit described above, etc.) and the light source device 3, as well as the operation of the entire control device 5. The control unit 52 is not limited to a CPU or an MPU, and may be configured using an ASIC, an FPGA, etc. The control unit 52 has functions as a scene determination unit, a user information acquisition unit, and a display control unit according to the present invention. The functions of the control unit 52 as a scene determination unit, a user information acquisition unit, and a display control unit will be described in the section "Operation of the Endoscope System" below.

[0032] The storage unit 53 stores programs executed by the control unit 52, information necessary for processing by the control unit 52, etc. Details of the information stored in the storage unit 53 will be described later in the section "Operation of the Endoscope System."

[0033] The operation input unit 54 is configured using operation devices such as a mouse and a keyboard, and receives user operations. The operation input unit 54 then outputs an operation signal to the control unit 52 in response to the user operations.

[0034] The touch panel display 55 is provided on the front panel 5A (see FIGS. 5 to 7) of the control device 5. The touch panel display 55 includes a display unit 551 and a touch panel 552, as shown in FIG.

[0035] The display unit 551 is an LCD or an organic EL display, and displays operation images that can be operated by the touch panel 552 under the control of the control unit 52 .

[0036] The touch panel 552 is provided on the display screen of the display unit 551 and accepts user operations (touches) on operation images displayed on the display screen. The touch panel 552 then outputs an operation signal corresponding to the user operation (touch) to the control unit 52.

[0037] [Operation of Endoscope System] Next, the operation of the endoscope system 1 will be described. The operation of the endoscope system 1 described below includes a medical control method according to the present invention. Figures 3 to 7 are diagrams illustrating an example of the medical control method. Specifically, Figure 3 is a diagram showing first related information stored in the storage unit 53. Figure 4 is a diagram showing an example of a process by which the first related information is generated. Figures 5 to 7 are diagrams corresponding to Figure 3 and show operation images displayed on the touch panel display 55.

[0038] Here, the storage unit 53 stores first related information for deriving an operation image from user information and scene information. In this embodiment, the first related information is information for deriving an operation image from user information, scene information, scope information, and peripheral device information. The user information is information for identifying the user who uses the endoscope 2. The scene information is information about an observation scene of a subject using the endoscope 2. The scope information is a scope ID (identifier) ​​of the endoscope 2 and is stored in a memory (not shown) provided in the endoscope 2. The peripheral device information is information specific to peripheral devices such as the display device 4, image recording device, and air / water supply unit connected to the control device 5, and is stored in a memory (not shown) provided in the peripheral devices. The scope information and peripheral device information correspond to connected device information according to the present invention. In the example of Figure 3, one of the first related information is information that associates user information "user a," scope information "scope α," peripheral device information "peripheral device 1," scene information "esophageal observation," operation contents "light intensity control, observation mode change, and focus control," and operation images "light intensity control button, observation mode change button, focus control button."

[0039] For example, when a user, such as a surgeon or an examiner, has previously performed a specific procedure using a specific endoscope 2, and has performed operations for light intensity control, observation mode change, and focus control from the insertion to removal of the endoscope 2, as shown in FIG. 4, user information identifying the user, scope information of the endoscope 2, scene information relating to the observation scene of the subject using the endoscope 2 at that time (e.g., esophageal observation), and operation images corresponding to the operations (light intensity control button, observation mode change button, focus control button) are associated with each other and stored in the memory unit 53 as first associated information.

[0040] First, the control unit 52 (scene determination unit) determines an observation scene of the subject by the endoscope 2, and calculates scene information related to the observation scene (scene determination step). Here, the following calculation method can be exemplified as a method for calculating the scene information.

[0041] For example, the control unit 52 (scene determination unit) recognizes the observation target of the subject in the imaging data by image recognition using a trained model for scene determination (image recognition using AI (Artificial Intelligence)), and calculates scene information related to the observation target. The trained model for scene determination is a trained model obtained by machine learning based on training data, using training data of various observation targets such as the esophagus and stomach.

[0042] Furthermore, for example, the control unit 52 (scene determination unit) estimates the tip position of the insertion unit 21 inside the subject by using the following technology. This technology receives, outside the subject, a magnetic field generated by a magnetic coil provided in the insertion unit 21, and detects the shape of the insertion unit 21 based on the received magnetic field. Then, the control unit 52 recognizes the subject's observation target from the tip position and calculates scene information related to the observation target.

[0043] Furthermore, for example, the control unit 52 (scene determination unit) calculates the distance from the tip position of the insertion unit 21 to the observation target inside the subject. Then, the control unit 52 recognizes the observation target inside the subject based on the distance and calculates scene information related to the observation target. For example, if the imaging unit of the endoscope 2 is configured with a stereo camera, the control unit 52 calculates the distance based on the principle of triangulation by using the relative shift amount between images of the same subject captured simultaneously from different viewpoints by the stereo camera. For example, if the imaging element constituting the imaging unit of the endoscope 2 is configured with an imaging element including phase difference pixels, the control unit 52 calculates the distance based on pixel information corresponding to the phase difference pixels.

[0044] Furthermore, for example, the control unit 52 (scene determination unit) recognizes the observation target of the subject based on the observation state currently being performed by the endoscope 2 (for example, magnification observation, screening observation), and calculates scene information related to the observation target.

[0045] The control unit 52 (user information acquisition unit) also acquires user information input by user operation to the operation input unit 54 (user information acquisition step). Furthermore, the control unit 52 acquires a scope ID (scope information) from a memory (not shown) of the endoscope 2 connected to the control device 5. The control unit 52 also acquires peripheral device information from a memory (not shown) of a peripheral device connected to the control device 5.

[0046] Next, the control unit 52 (display control unit) refers to the first related information stored in the storage unit 53, and recognizes an operation image associated with the scene information calculated as described above and the user information, scope information, and peripheral device information acquired as described above. Then, the control unit 52 (display control unit) displays the operation image on the display screen of the display unit 551 (display control step).

[0047] In the example of Fig. 5, the control unit 52 acquires "User a," "Scope α," and "Peripheral device 1" as the user information, scope information, and peripheral device information, respectively, and calculates "Esophageal observation" as the scene information. The control unit 52 then references the first related information and recognizes "Light intensity control button, Observation mode change button, and Focus control button (Fig. 3)" as operation images associated with "User a," "Scope α," "Peripheral device 1," and "Esophageal observation." The control unit 52 then displays the recognized operation images FA, namely, the Light intensity control button FA1, the Observation mode change button FA2, and the Focus control button FA3, on the display screen of the display unit 551 (Fig. 5).

[0048] Here, the light intensity control button FA1 is an operation image for causing the control unit 52 to change the intensity of the observation light supplied from the light source device 3. Specifically, when the user operates (touches) the light intensity control button FA1, the control unit 52 displays operation images, a + button FA11 and a − button FA12, on the display screen of the display unit 551, as shown in FIG. 6 . When the user operates (touches) the + button FA11, the control unit 52 controls the operation of the light source device 3 to increase the intensity of the observation light supplied from the light source device 3. On the other hand, when the user operates (touches) the − button FA12, the control unit 52 controls the operation of the light source device 3 to decrease the intensity of the observation light supplied from the light source device 3.

[0049] The observation mode change button FA2 is an operation image for causing the control unit 52 to change the observation mode. Specifically, when the user operates (touches) the observation mode change button FA2, the control unit 52 displays operation images, a normal observation mode button FA21 and an NBI observation mode button FA22, on the display screen of the display unit 551, as shown in FIG. 7 . When the user operates (touches) the normal observation mode button FA21, the control unit 52 changes the observation mode to the normal observation mode. The normal observation mode is a mode in which an object is observed using white light as the observation light. On the other hand, when the user operates (touches) the NBI observation mode button FA22, the control unit 52 changes the observation mode to the NBI observation mode. The NBI observation mode is a mode in which an object is observed using narrowband light as the observation light.

[0050] The focus control button FA3 is an image for operation to cause the control unit 52 to adjust the focus of the image based on the imaging data.

[0051] The present embodiment described above provides the following advantages. The control device 5 according to this embodiment determines an observation scene of a subject observed by the endoscope 2, calculates scene information related to the observation scene, and acquires user information identifying a user using the endoscope 2. The control device 5 then derives operation images from the calculated scene information and the acquired user information based on the first related information stored in the storage unit 53, and displays the operation images on the display screen of the display unit 551. In other words, the display screen of the display unit 551 does not display operation images that are rarely used by the user. Therefore, the control device 5 according to this embodiment can display operation images corresponding to functions that the user wants the control device 5 to execute on the display screen of the display unit 551, thereby improving operability.

[0052] In particular, the first related information is information for deriving operation images from connected device information (scope information and peripheral device information) in addition to scene information and user information. Therefore, when a user is currently using a connected device (the endoscope 2 and peripheral devices), operation images operated by the user when the user previously used the connected device (the endoscope 2 and peripheral devices) can be displayed on the display screen of the display unit 551. Therefore, operation images corresponding to functions that the user wants the control device 5 to execute can be displayed on the display screen of the display unit 551, further improving operability.

[0053] Other Embodiments Although the embodiments for carrying out the present invention have been described above, the present invention should not be limited to the above-described embodiments. The configurations of the following modified examples 1 to 5 may also be adopted.

[0054] (Variation 1) Fig. 8 is a diagram illustrating Variation 1 of the embodiment. Specifically, Fig. 8 is a diagram showing operation images FA, FB, FC, and FD displayed on touch panel display 55 according to Variation 1. In the above-described embodiment, control unit 52 (mode switching unit) may be configured to be able to switch the display mode of the display screen of display unit 551. In Variation 1, control unit 52 (mode switching unit) is able to switch between a first customized display mode ((a) in Fig. 8), a second customized display mode ((b) in Fig. 8), and an initial display mode ((c) in Fig. 8).

[0055] The first customized display mode corresponds to the first display mode according to the present invention. In this first customized display mode, the control unit 52 (display control unit) refers to the first related information stored in the storage unit 53, as in the above-described embodiment, and displays an operation image associated with the calculated scene information and the acquired user information, scope information, and peripheral device information on the display screen of the display unit 551 ((a) in FIG. 8 ).

[0056] The second customized display mode corresponds to a third display mode according to the present invention. Here, the storage unit 53 stores the following trained models. The trained models are trained models generated by machine learning based on training data including scene information and operation images operated by users via the touch panel 552 in observed scenes based on the scene information. More specifically, the training data is data including scene information related to observed scenes in which various users performed specific procedures and operation images operated by the users via the touch panel 552 in the observed scenes. The trained models are trained models obtained by repeatedly executing a training process on the training model using multiple training data. The training model used in the training process is, for example, a convolutional neural network (CNN).

[0057] The neural network used in the learning process for generating a trained model is not limited to a CNN, and other neural networks may be used. Furthermore, various well-known learning algorithms may be used as machine learning algorithms in neural networks. For example, a supervised learning algorithm using backpropagation may be used.

[0058] In the second customized display mode, the control unit 52 (display control unit) calculates scene information in the same manner as in the above-described embodiment, and then estimates operation images from the scene information using the trained model stored in the storage unit 53, and displays the operation images on the display screen of the display unit 551. In the example of (b) in Fig. 8, four operation images FC estimated using the trained model are displayed on the display screen of the display unit 551. When the user operates (touches) the operation images FC, the control unit 52 executes a function corresponding to the operation images FC.

[0059] In addition, the first related information may be configured using a trained model generated by machine learning, similar to the trained model used in the second customized display mode.

[0060] The initial display mode corresponds to a second display mode according to the present invention. In the initial display mode, the control unit 52 (display control unit) displays preset operation images on the display screen of the display unit 551. In the example of FIG. 8(c), 15 operation images FD are displayed on the display screen of the display unit 551. When the user operates (touches) an operation image FD, the control unit 52 executes a function corresponding to the operation image FD.

[0061] Any of the operation images on the operation image FD is an operation image for troubleshooting when an error or malfunction occurs, such as "air cannot be supplied," "image cannot be recorded," "image is not displayed on the display device 4," or "image displayed on the display device 4 is distorted."

[0062] 8, in any of the first and second customized display modes and the initial display mode, the control unit 52 (display control unit) displays, on the display screen of the display unit 551, the above-described operation images FA to FD as well as an operation image FB for switching the display mode. When the user operates (touches) the operation image FB, the control unit 52 switches the display mode from the current display mode to another display mode.

[0063] The first modification described above provides the same effects as the above-described embodiment, as well as the following effects. The control device 5 according to the first modification can switch the display mode between the first and second customized display modes and the initial display mode. Therefore, by switching to the second customized display mode, operation images operated by various users when performing a specific procedure can be displayed on the display screen of the display unit 551. Therefore, the user can understand the operations required to perform a specific procedure from the display screen. In other words, convenience can be improved. Furthermore, by switching to the initial display mode, troubleshooting can be performed, thereby improving convenience.

[0064] 9 and 10 are diagrams illustrating a second modification of the embodiment. Specifically, FIG. 9 is a block diagram showing the configuration of the control device 5 according to the second modification. FIG. 10 is a diagram showing an operation image FE displayed on the touch panel display 55 according to the second modification. In the above-described embodiment, an operation image corresponding to a voice uttered by the user may be displayed on the display screen.

[0065] 9, the control device 5 according to the second modification adds an audio input unit 56 to the control device 5 described in the above embodiment. The audio input unit 56 includes a microphone (not shown) that receives audio uttered by the user and converts it into an electrical signal, and generates audio information by performing A / D (Analog / Digital) conversion or the like on the electrical signal.

[0066] Furthermore, the control unit 52 according to this second modification has the functions of a voice information acquisition unit and a voice analysis unit according to the present invention, in contrast to the control unit 52 described in the above-described embodiment. The control unit 52 (voice information acquisition unit) acquires voice information generated by the voice input unit 56. Furthermore, the control unit 52 (voice information analysis unit) analyzes the acquired voice information to extract keywords included in the voice uttered by the user.

[0067] Furthermore, the storage unit 53 according to the present modification 2 stores second related information for deriving an image for operation from a keyword extracted by the control unit 52 (sound analysis unit). In the present modification 2, the second related information is information in which a keyword and an image for operation are associated with each other. Note that the second related information may be configured by a trained model generated by machine learning, similar to the trained model used in the second customized display mode in the above-described modification 1.

[0068] Then, the control unit 52 (display control unit) recognizes an operation image associated with the extracted keyword based on the second related information stored in the storage unit 53, and displays the operation image on the display screen of the display unit 551. In the example of Fig. 10, three operation images FE are displayed on the display screen of the display unit 551.

[0069] Here, the control unit 52 (display control unit) displays a character image of "SW1" indicating the operation button 221 of the endoscope 2 around (below in FIG. 10 ) the operation image FE1 of the three operation images FE on the display screen of the display unit 551. Then, when the operation image FE1 is operated (touched) by the user or the operation button 221 is pressed, the control unit 52 executes a function corresponding to the operation image FE1.

[0070] Furthermore, the control unit 52 (display control unit) displays a character image of "SW2" indicating the operation button 222 of the endoscope 2 around (below in Fig. 10) the operation image FE2 on the display screen of the display unit 551. Then, when the user operates (touches) the operation image FE2 or presses the operation button 222, the control unit 52 executes a function corresponding to the operation image FE2.

[0071] Furthermore, the control unit 52 (display control unit) displays a character image of "SW2" indicating the operation button 223 of the endoscope 2 around (below in Fig. 10) the operation image FE3 on the display screen. When the user operates (touches) the operation image FE3 or presses the operation button 223, the control unit 52 executes a function corresponding to the operation image FE3.

[0072] The second modification described above provides the same effects as the above-described embodiment, as well as the following effects. The control device 5 according to the second modification displays an operation image on the display screen of the display unit 551 in response to a voice uttered by the user. Therefore, if the operation image desired by the user is not displayed on the display screen of the display unit 551, the user can have the desired operation image displayed on the display screen of the display unit 551 simply by uttering a voice. In other words, convenience can be improved.

[0073] Furthermore, since the functions corresponding to the operation images FE1 to FE3 can also be executed using the operation buttons 221 to 223 of the endoscope 2, the functions can be executed even when the user is holding the insertion portion 21 in his / her hand and cannot let go, thereby further improving convenience.

[0074] (Variation 3) Fig. 11 is a diagram illustrating Variation 3 of the embodiment. Specifically, Fig. 11 is a diagram showing operation images FF1 to FF6 displayed on touch panel display 55 according to Variation 3. In the above-described embodiment, control unit 52 (display control unit) may update the operation images displayed on the display screen of display unit 551 every time the observation scene changes.

[0075] For example, when the observed scene is a first observed scene, the control unit 52 (display control unit) refers to the first related information stored in the storage unit 53, and recognizes operation images FF1 and FF2 associated with scene information related to the first observed scene and the acquired user information, scope information, and peripheral device information. Then, the control unit 52 (display control unit) displays the operation images FF1 and FF2 on the display screen of the display unit 551 ((a) of FIG. 11 ).

[0076] Furthermore, when the observation scene switches from the first observation scene to the second observation scene, the control unit 52 (display control unit) refers to the first related information stored in the storage unit 53 and recognizes a set of operation images FF2 and FF3 and a set of operation images FF2 and FF4 associated with the scene information related to the second observation scene and the acquired user information, scope information, and peripheral device information. Note that the first related information stored in the storage unit 53 according to the present modification example 3 is information in which multiple sets of operation images are associated with sets of scene information, user information, scope information, and peripheral device information. Then, the control unit 52 (display control unit) displays the operation images FF2 to FF4 in a state where the operation image FF2 branches into two, operation images FF3 and FF4, on the display screen of the display unit 551, so that the multiple sets of operation images can be distinguished ((b) of FIG. 11 ).

[0077] Furthermore, when the observation scene switches from the second observation scene to the third observation scene, the control unit 52 (display control unit) refers to the first related information stored in the storage unit 53, and recognizes the set of operation images FF3 and FF5 and the set of operation images FF3 and FF6 that are associated with the scene information related to the third observation scene and the acquired user information, scope information, and peripheral device information. Then, the control unit 52 (display control unit) displays these operation images FF3, FF5, and FF6 on the display screen of the display unit 551 in a state where the operation image FF3 branches into two operation images FF5 and FF6, as described above ((c) of FIG. 11 ).

[0078] When the user operates (touches) any of the operation images FF1 to FF6, the control unit 52 executes the function corresponding to the operation images FF1 to FF6. Note that, as an operation for executing the function corresponding to the operation images FF1 to FF6, in addition to operating (touching) the operation images FF1 to FF6, the operation buttons 221 to 223 of the endoscope 2 or the operation input unit 54 may be used.

[0079] The third modification described above provides the same effects as the above-described embodiment, as well as the following effects: The control device 5 according to the third modification updates the operation images displayed on the display screen of the display unit 551 every time the observation scene changes. This allows the operation images to be arranged on the display screen of the display unit 551 in a manner that is easy for the user to see, thereby improving convenience.

[0080] (Modification 4) Fig. 12 is a diagram illustrating Modification 4 of the embodiment. Specifically, Fig. 12 is a diagram corresponding to Figs. 3 to 5, and shows an operation image FA displayed on the touch panel display 55 according to Modification 4. In the above-described embodiment, the control unit 52 (display control unit) may be configured to display on the display screen of the display unit 551 only operation images for executing functions different from the functions executed by the operation buttons 221 to 223 of the endoscope 2.

[0081] 12, the function corresponding to the focus control button FA3 is assigned to the operation button 221. Therefore, even if the control unit 52 (display control unit) acquires "user a," "scope α," and "peripheral device 1" as the user information, scope information, and peripheral device information, respectively, calculates "esophageal observation" as the scene information, and recognizes the "light intensity control button, observation mode change button, and focus control button ( FIG. 3 )" as operation images associated with "user a," "scope α," "peripheral device 1," and "esophageal observation" from the first related information, it displays only the light intensity control button FA1 and the observation mode change button FA2, excluding the focus control button FA3, from the recognized operation image FA on the display screen of the display unit 551.

[0082] According to the fourth modification described above, in addition to the same effects as those of the above-described embodiment, the following effects are achieved: The control device 5 according to the fourth modification displays, on the display screen of the display unit 551, only operation images for executing functions different from the functions executed by the operation buttons 221 to 223 of the endoscope 2. As a result, only the minimum number of operation images necessary are displayed on the display screen of the display unit 551, and the operation images can be arranged on the display screen in a state that is easy for the user to see, thereby improving convenience.

[0083] (Variation 5) In the above-described embodiment and variations 1 to 4, the medical image processing device according to the present invention is mounted in an endoscopic system 1 in which the endoscope 2 is configured as a flexible endoscope, but this is not limited to this. For example, the medical control device according to the present invention may be mounted in an endoscopic system in which the endoscope 2 is configured as a rigid endoscope. Furthermore, the medical control device according to the present invention may be mounted in a medical observation system including a surgical microscope (see, for example, JP 2016-42981 A) that magnifies and observes a predetermined field of view inside a subject (inside a living body) or on the surface of a subject (surface of a living body). In this case, the surgical microscope corresponds to the medical observation device according to the present invention.

[0084] REFERENCE SIGNS LIST 1 Endoscope system 2 Endoscope 3 Light source device 4 Display device 5 Control device 21 Insertion section 22 Operation section 23 Universal cord 24 Connector section 51 Image processing section 52 Control section 53 Storage section 54 Operation input section 55 Touch panel display 56 Voice input section 211 Tip unit 212 Bending section 213 Flexible tube 221 to 223 Operation buttons 551 Display section 552 Touch panel FA, FB, FC, FD, FE, FE1 to FE3, FF1 to FF6 Operation images FA1 Light intensity control button FA11 + button FA12 - button FA2 Observation mode change button FA21 Normal observation mode button FA22 NBI observation mode button FA3 Focus control button

Claims

1. A medical control device that generates an operation image for a user to operate, a storage unit that stores scene information relating to an observation scene in which a medical observation device is used, user information relating to a user who uses the medical observation device, and first association information indicating an association between the operation image; a processor configured by hardware, which acquires the scene information, acquires the user information, generates the operation image based on the first related information, the scene information, and the user information, and outputs the operation image to a display unit; The processor: The display device is configured to be switchable between a first display mode and a second display mode, When the display mode is the first mode, the operation image is generated based on the first related information, the scene information, and the user information; a medical control device that generates a preset operation image when in the second display mode;

2. The first related information is 2. The medical control device according to claim 1, wherein the scene information is information relating to an observation scene of a subject observed by the medical observation device and the user information is information for identifying a user who uses the medical observation device, and the operation image is information for enabling operation by a touch panel provided on a display screen of the display unit.

3. The processor, The medical control device according to claim 1 , wherein the scene information is acquired by determining the observed scene and calculating the scene information.

4. The user information is The medical control device according to claim 1 , wherein the information is information for identifying a user who uses the medical observation device.

5. The processor, The medical control device according to claim 1 , wherein the operation image is derived from the scene information and the user information based on the first related information, and the operation image is displayed on the display screen of the display unit.

6. The first related information is 2. The medical control device according to claim 1, wherein the information is for deriving the operation image from the scene information, the user information, and connected device information specific to a connected device connected to the medical control device.

7. The memory unit Further storing a trained model generated by machine learning based on training data including the scene information and the operation image operated by the user using a touch panel provided on the display screen of the display unit in the observed scene based on the scene information; The processor: The display device is configured to be switchable between the first display mode and the third display mode, When the display mode is the first mode, the image for operation is derived from the scene information and the user information based on the first related information, and the image for operation is displayed on the display screen of the display unit; The medical control device according to claim 1, wherein, in the third display mode, the learned model is used to estimate the operation image from the scene information, and the operation image is displayed on the display screen.

8. The processor: Acquire voice information relating to a voice uttered by the user; extracting keywords contained in the voice by analyzing the voice information; The storage unit further storing second related information for deriving the operation image from the keyword; The processor: The medical control device according to claim 1 , wherein the operation image is derived from the extracted keyword based on the second related information, and the operation image is displayed on the display screen of the display unit.

9. The processor: The medical control device according to claim 1 , wherein the operation image displayed on the display screen of the display unit is updated every time the observation scene based on the scene information is changed.

10. The medical observation device includes: an operation button for accepting an operation by the user is provided; The processor: The medical control device according to claim 1 , wherein only the operation images for executing functions different from the functions executed by the operation buttons are displayed on the display screen of the display unit.

11. a medical observation device for observing a subject; A medical control system comprising the medical control device according to claim 1.

12. A medical control method executed by a processor of a medical control device, comprising: The processor: Acquire scene information regarding an observation scene using a medical observation device; acquiring user information about a user who uses the medical observation device; generating an image for operation based on the first related information, the scene information, and the user information stored in a storage unit; outputting the operation image to a display unit; When generating the operation image, When the display mode is a first display mode, the operation image is generated based on the first related information, the scene information, and the user information; A medical control method for generating a preset operation image when in the second display mode.

13. A medical control program to be executed by a processor of a medical control device, comprising: The medical control program causes the processor to: Acquire scene information regarding an observation scene using a medical observation device; acquiring user information about a user who uses the medical observation device; generating an image for operation based on the first related information, the scene information, and the user information stored in a storage unit; outputting the operation image to a display unit; When generating the operation image, When the display mode is a first display mode, the operation image is generated based on the first related information, the scene information, and the user information; a medical control program that generates the preset operation image when in the second display mode;