Medical image processing device, medical image processing system, server, medical image processing method, and medical image processing program

Abstract

A medical image processing device 5 is provided with: an information acquisition unit 52 which acquires, from an external server, at least one processing module corresponding to connected instrument information and manipulation information related to a manipulation, the connected instrument information identifying a connected medical observation device 2 and being specific to the medical observation device 2; an image processing unit 51 which performs image processing on captured data obtained by imaging performed by the medical observation device 2; and a processing control unit 52 which controls the operation of the image processing unit 51. The processing control unit 52 controls the operation of the image processing unit 51, and causes image processing to be performed with respect to the captured data using an image processing algorithm corresponding to the at least one processing module acquired by the information acquisition unit 52.

Description

Medical image processing device, medical image processing system, server, and medical image processing method

[0001] The present invention relates to a medical image processing device, a medical image processing system, a server, and a medical image processing method.

[0002] Conventionally, there is known a technique for having a server execute image processing of imaging data obtained by imaging using a medical observation device such as an endoscope (see, for example, Patent Document 1). In the technique described in Patent Document 1, the medical observation device is communicably connected to the server and transmits the imaging data obtained by imaging to the server. The server then executes image processing on the received imaging data and displays a display image corresponding to the processed imaging data on a monitor.

[0003] Japanese Patent Application Laid-Open No. 2022-42011

[0004] However, the technology described in Patent Document 1 has a problem in that if an error occurs in the communication between the medical observation device and the server, such as an error in the transmission path between the medical observation device and the server, while the surgeon or examiner is performing a procedure, the image cannot be displayed on the monitor (hereinafter referred to as image loss). Therefore, there is a demand for technology that can prevent image loss and improve convenience.

[0005] The present invention has been made in view of the above, and aims to provide a medical image processing device, a medical image processing system, a server, and a medical image processing method that can improve convenience.

[0006] In order to solve the above-mentioned problems and achieve the object, the medical image processing apparatus according to the present invention comprises an information acquisition unit that acquires, from an external server, connection device information specific to the connected medical observation device that identifies the medical observation device and at least one processing module corresponding to procedure information related to the procedure; an image processing unit that performs image processing on imaging data obtained by imaging with the medical observation device; and a processing control unit that controls the operation of the image processing unit, and causes the image processing unit to perform image processing on the imaging data using an image processing algorithm corresponding to the at least one processing module acquired by the information acquisition unit.

[0007] A medical image processing system according to the present invention comprises a server and a medical image processing device communicatively connected to the server, wherein the medical image processing device comprises an information acquisition unit that acquires, from the server, connected device information specific to the medical observation device that identifies the connected medical observation device and at least one processing module corresponding to procedure information related to the procedure, an image processing unit that performs image processing on imaging data obtained by imaging with the medical observation device, and a processing control unit that controls the operation of the image processing unit, and causes the imaging data to undergo image processing using an image processing algorithm corresponding to the at least one processing module acquired by the information acquisition unit.

[0008] The server according to the present invention comprises a communication unit communicatively connected to an external medical image processing device, a control unit controlling the operation of the communication unit, and a storage unit storing connected device information specific to the medical observation device that identifies the medical observation device, procedure information related to a procedure, and at least one processing module in association with each other, and the control unit reads out from the storage unit the connected device information and the at least one processing module associated with the procedure information acquired from the medical image processing device via the communication unit, and transmits the at least one processing module to the medical image processing device via the communication unit.

[0009] A medical image processing method according to the present invention is a medical image processing method executed by a medical image processing device, and includes an information acquisition step of acquiring, from an external server, connection device information specific to the medical observation device that identifies the medical observation device connected to the medical image processing device and at least one processing module corresponding to procedure information related to the procedure, and an image processing step of performing image processing on imaging data obtained by imaging with the medical observation device using an image processing algorithm corresponding to the at least one processing module acquired in the information acquisition step.

[0010] The medical image processing device, medical image processing system, server, and medical image processing method according to the present invention can improve convenience.

[0011] FIG. 1 is a diagram illustrating a configuration of an endoscope system according to an embodiment. FIG. 2 is a block diagram illustrating a configuration of a control device. FIG. 3 is a block diagram illustrating a configuration of a server. FIG. 4 is a diagram illustrating an example of a medical image processing method. FIG. 5 is a diagram illustrating an example of a medical image processing method. FIG. 6 is a diagram illustrating a first modification of the embodiment. FIG. 7 is a diagram illustrating the first modification of the embodiment. FIG. 8 is a diagram illustrating a second modification of the embodiment. FIG. 9 is a diagram illustrating the second modification of the embodiment. FIG. 10 is a diagram illustrating a third modification of the embodiment. FIG. 11 is a diagram illustrating the third modification of the embodiment. FIG. 12 is a diagram illustrating a fourth modification of the embodiment. FIG. 13 is a diagram illustrating the fourth modification of the embodiment. FIG. 14 is a diagram illustrating a fifth modification of the embodiment.

[0012] Hereinafter, a mode for carrying out the present invention (hereinafter referred to as an embodiment) will be described with reference to the drawings. Note that the present invention is not limited to the embodiment described below. Furthermore, in the description of the drawings, the same parts are given the same reference numerals.

[0013] [Schematic Configuration of Endoscope System] Fig. 1 is a diagram showing the configuration of an endoscope system 1 according to an embodiment. The endoscope system 1 corresponds to a medical image processing system according to the present invention. This endoscope system 1 is used in the medical field and is a system for observing the inside of a living body. As shown in Fig. 1, the endoscope system 1 includes an endoscope 2, a light source device 3, a display device 4, a control device 5, and a server 6.

[0014] The endoscope 2 corresponds to a medical observation device according to the present invention. In this embodiment, the endoscope 2 is a so-called flexible endoscope. A portion of the endoscope 2 is inserted into a living body, images the inside of the living body, and output image signals obtained by the images. As shown in FIG. 1 , the endoscope 2 includes an insertion section 21, an operation section 22, a universal cord 23, and a connector section 24.

[0015] The insertion section 21 has at least a portion that is flexible and is inserted into a living body. The insertion section 21 includes a tip unit 211, a bending section 212, and a flexible tube 213, as shown in FIG.

[0016] The tip unit 211 is provided at the tip of the insertion section 21. Although not specifically shown in the drawings, the tip unit 211 is provided with an illumination optical system, an imaging optical system, and an imaging unit.

[0017] The illumination optical system faces one end of a light guide (not shown) routed within the insertion portion 21 , and irradiates the observation light transmitted by the light guide from the tip of the insertion portion 21 into the living body.

[0018] The imaging optical system receives observation light (subject image) that is irradiated from the illumination optical system onto the inside of the living body and returns from the living body, and forms an image on the imaging surface of an imaging element that constitutes the imaging unit.

[0019] The imaging unit includes an imaging element such as a charge coupled device (CCD) or a complementary metal-oxide semiconductor (CMOS), captures an image of a subject formed by an imaging optical system, and outputs an image signal generated by the image capture. Hereinafter, the image signal will be referred to as imaging data.

[0020] The bending portion 212 is connected to the base end side (the operation portion 22 side) of the tip unit 211. Although not specifically shown in the drawings, the bending portion 212 has a configuration in which a plurality of bending pieces are connected to each other, and is capable of bending.

[0021] The flexible tube 213 is connected to the base end side (operation section 22 side) of the bending section 212 and is formed in a flexible, long shape.

[0022] The operation unit 22 is connected to the base end portion of the insertion unit 21. The operation unit 22 accepts various operations on the endoscope 2. The universal cord 23 extends from the operation unit 22 in a direction different from the extension direction of the insertion unit 21, and is a cord on which the above-mentioned light guide, the above-mentioned signal line for transmitting imaging data, etc. are disposed.

[0023] The connector portion 24 is provided at the end of the universal cord 23 and is detachably connected to the light source device 3 and the control device 5 .

[0024] In this embodiment, various endoscopes 2 of different release generations are connectable to the light source device 3 and the control device 5. These various endoscopes 2 of different release generations differ in the type of image sensor (CCD, CMOS), the number of pixels of the image sensor, the sensitivity of the image sensor, the characteristics of the illumination optical system and the image sensor, etc.

[0025] The light source device 3 supplies observation light to the other end of the light guide under the control of the control device 5. The observation light then passes through the light guide and the illumination optical system, and is then irradiated into the living body from the tip of the insertion section 21. Examples of the observation light include broadband white light (normal light), narrowband excitation light that excites a fluorescent agent such as indocyanine green, and narrowband light used in Narrow Band Imaging (NBI).

[0026] The display device 4 is an LCD (Liquid Crystal Display), an organic EL (Electro Luminescence) display, or the like, and displays a display image (endoscopic image) according to a video signal output from the control device 5 under the control of the control device 5.

[0027] The control device 5 corresponds to the medical image processing device according to the present invention. The control device 5 includes controllers such as a CPU (Central Processing Unit) and an MPU (Micro Processing Unit), and comprehensively controls the operations of the endoscope 2 (the imaging unit described above, etc.) and the light source device 3. The control device 5 is not limited to a CPU or an MPU, and may include an ASIC (Application Specific Integrated Circuit), an FPGA (Field-Programmable Gate Array), a GPU (Graphics Processing Unit), etc. The detailed configuration of the control device 5 will be described later in the section "Configuration of the Control Device."

[0028] The server 6 communicates with the control device 5 via a network NE (FIG. 1). Although the server 6 is realized by a single server in FIG. 1, this is not limiting and the server 6 may be realized by a cloud system in which multiple servers operate in cooperation with each other. The detailed configuration of the server 6 will be described later in the section "Server Configuration."

[0029] [Configuration of Control Device] Next, a description will be given of the configuration of the control device 5. Fig. 2 is a block diagram showing the configuration of the control device 5. As shown in Fig. 2, the control device 5 includes an image processing unit 51, a control unit 52, a storage unit 53, an input unit 54, and a communication unit 55.

[0030] The image processing unit 51 is configured with at least one processing module received via the communication unit 55. The image processing unit 51 then performs image processing on the imaging data (RAW data) obtained by imaging using the endoscope 2 using an image processing algorithm corresponding to the at least one processing module, and generates a video signal corresponding to the display image to be displayed on the display device 4.

[0031] Here, the processing module is the smallest unit of each function constituting the image processing algorithm, and is also called a microservice (hereinafter referred to as MS). Note that the processing module according to the present invention is not limited to an MS, and may be configured by combining multiple smallest units of each function constituting the image processing algorithm.

[0032] The image processing performed by this processing module includes noise removal, brightness correction (gain correction), and structure enhancement. Furthermore, the image processing performed by the processing module may include image processing according to the observation light (white light, excitation light, narrowband light) irradiated into the living body. Examples of image processing according to the observation light irradiated into the living body include optical black subtraction (clamping), white balance adjustment, demosaic processing, color correction matrix processing, gamma correction, and YC processing for converting RGB signals into luminance and color difference signals (Y, Cb / Cr signals).

[0033] The control unit 52 is realized by a controller such as a CPU or an MPU executing various programs stored in the storage unit 53, and controls the operation of the endoscope 2 (the imaging unit described above, etc.) and the light source device 3, as well as the operation of the entire control device 5. The control unit 52 is not limited to a CPU or an MPU, and may be configured using an ASIC, an FPGA, etc. The control unit 52 functions as an information acquisition unit and a processing control unit according to the present invention. The functions of the control unit 52 as an information acquisition unit and a processing control unit will be described in the section "Operation of the Endoscope System" below.

[0034] The storage unit 53 stores programs executed by the control unit 52, information necessary for the processing of the control unit 52, and the like.

[0035] The input unit 54 is configured using operation devices such as a mouse, a keyboard, and a touch panel, and receives user operations. The input unit 54 then outputs an operation signal to the control unit 52 in response to the user operations.

[0036] The communication unit 55 communicates with the server 6 via the network NE under the control of the control unit 52 .

[0037] [Configuration of Server] Next, a description will be given of the configuration of the server 6. Fig. 3 is a block diagram showing the configuration of the server 6. As shown in Fig. 3, the server 6 includes a communication unit 61, a control unit 62, and a storage unit 63.

[0038] The communication unit 61 communicates with the control device 5 (communication unit 55) via the network NE under the control of the control unit 62.

[0039] The control unit 62 is realized by a controller such as a CPU or an MPU executing various programs recorded in the storage unit 63, and controls the operation of the entire server 6. The control unit 62 is not limited to a CPU or an MPU, and may be configured by an integrated circuit such as an ASIC or an FPGA. The functions of the control unit 62 will be described later in "Operation of the Endoscope System."

[0040] The storage unit 63 stores various programs executed by the control unit 62, data necessary for the control unit 62 to perform processing, etc. Details of the information stored in the storage unit 63 will be described later in the section "Operation of the Endoscope System."

[0041] [Operation of Endoscope System] Next, the operation of the endoscope system 1 will be described. The operation of the endoscope system 1 described below includes a medical image processing method according to the present invention. FIGS. 4 and 5 are diagrams illustrating an example of the medical image processing method. Specifically, FIG. 4 is a diagram illustrating information stored in the storage unit 63. FIG. 5 is a diagram corresponding to FIG. 4 and illustrates information transmitted and received through communication between the control device 5 and the server 6. For ease of explanation, FIG. 5 illustrates only the image processing unit 51 as part of the configuration of the control device 5, and only the storage unit 63 as part of the configuration of the server 6.

[0042] As shown in Fig. 4, the storage unit 63 stores connected device information specific to the endoscope 2 that identifies the endoscope 2 and procedure information related to the procedure, in association with at least one MS. In the example of Fig. 4, connected device information "scope α" and procedure information "procedure A" are associated with three MSs "MS1, MS2, MS3" and stored in the storage unit 63. The connected device information is the scope ID (identifier) ​​of the endoscope 2, and is stored in a memory (not shown) provided in the endoscope 2.

[0043] For example, based on the log information stored when a surgeon or examiner previously performed a specific procedure using a specific endoscope 2 and used a specific MS for image processing, the MS is associated with connection device information specific to the endoscope 2 and procedure information related to the procedure and stored in the memory unit 63.

[0044] First, the control device 5 (controller 52) reads the scope ID (connected device information) from the memory (not shown) of the endoscope 2 connected to the control device 5. The controller 52 also acquires procedure information related to the procedure input by a user operation to the input unit 54.

[0045] Next, the control unit 52 transmits the scope ID (connected device information) read from the memory (not shown) of the endoscope 2 and the procedure information input by user operation to the input unit 54 to the server 6 via the communication unit 55.

[0046] Next, the server 6 (controller 62) refers to the information stored in the memory 63 and recognizes the MS associated with the scope ID (connected device information) and procedure information received from the control device 5. Then, the controller 62 transmits the recognized MS to the control device 5 via the communication unit 61.

[0047] Next, the control device 5 (control unit 52 (information acquisition unit)) receives the MS from the server 6 (information acquisition step). Then, the control unit 52 (processing control unit) causes the image processing unit 51 to perform image processing on the imaging data obtained by imaging using the endoscope 2 using an image processing algorithm corresponding to the MS received from the server 6 (image processing step).

[0048] 5 , the control device 5 transmits "scope α" as the connected device information and "procedure A" as the procedure information to the server 6. As a result, the server 6 transmits "MS1, MS2, MS3 ( FIG. 4 )" as MSs corresponding to the "scope α" and the "procedure A" to the control device 5. The control device 5 then performs image processing on the imaging data obtained by imaging with the endoscope 2 in the order of "MS1," "MS2," and "MS3," and a display image corresponding to the imaging data after the image processing is displayed on the display device 4.

[0049] The present embodiment described above provides the following advantages. The control device 5 according to this embodiment acquires at least one MS corresponding to the connected device information and the procedure information from the server 6, and performs image processing on imaging data obtained by imaging with the endoscope 2 using an image processing algorithm corresponding to the at least one MS. This allows appropriate image processing corresponding to the endoscope 2 connected to the control device 5 and the procedure to be performed on the imaging data obtained by imaging with the endoscope 2, and allows a display image suitable for observation to be displayed on the display device 4. Furthermore, because the corresponding MS is acquired from the server 6 before performing the procedure, the display image on the display device 4 can continue to be displayed even if an abnormality occurs in communication between the control device 5 and the server 6 during the procedure. Therefore, the control device 5 according to this embodiment can prevent image loss and improve convenience.

[0050] Other Embodiments Although the embodiments for carrying out the present invention have been described above, the present invention should not be limited to the above-described embodiments. The configurations of the following modified examples 1 to 6 may also be adopted.

[0051] (Variation 1) Figures 6 and 7 are diagrams illustrating Variation 1 of the embodiment. Specifically, Figure 6 is a diagram showing information stored in the storage unit 63. Figure 7 is a diagram corresponding to Figure 6 and shows information transmitted and received through communication between the control device 5 and the server 6. For ease of explanation, Figure 7 shows only the image processing unit 51 as part of the configuration of the control device 5, and only the storage unit 63 as part of the configuration of the server 6.

[0052] In the above-described embodiment, the control device 5 (control unit 52 (information acquisition unit)) may acquire from the server 6 at least one MS corresponding to connected device information, procedure information, and user information identifying the user using the endoscope 2.

[0053] Here, the storage unit 63 stores connected device information, procedure information, and user information in association with at least one MS, as shown in Fig. 6. In the example of Fig. 6, "scope α" which is connected device information, "procedure A" which is procedure information, and "user a" which is user information are stored in association with three MSs, "MS1, MS2, MS3," in the storage unit 63.

[0054] For example, based on log information stored when a surgeon or examiner previously performed a specific procedure using a specific endoscope 2 and used a specific MS for image processing, the MS is associated with connection device information specific to the endoscope 2, procedure information related to the procedure, and user information identifying the surgeon or examiner, and stored in the memory unit 63.

[0055] In the example of FIG. 7 , the control device 5 transmits to the server 6 "scope α" as connected device information, "procedure A" as procedure information, and "user a" as user information. Here, the user information is information input by a user operation to the input unit 54. That is, the control device 5 acquires the user information input by a user operation to the input unit 54. As a result, the server 6 transmits "MS1 ( FIG. 6 )" to the control device 5 as an MS corresponding to the "scope α," the "procedure A," and the "user a." Then, in the control device 5, image processing is performed by "MS1" on the imaging data obtained by imaging using the endoscope 2, and a display image corresponding to the imaging data after the image processing is displayed on the display device 4.

[0056] The first modification described above provides the same effects as the above-described embodiment, as well as the following effects. The control device 5 according to the first modification acquires from the server 6 at least one MS corresponding to user information, in addition to connected device information and procedure information, and performs image processing on imaging data obtained by imaging with the endoscope 2 using an image processing algorithm corresponding to the at least one MS. This makes it possible to perform image processing similar to that previously used by the surgeon or examiner on imaging data obtained by imaging with the endoscope 2, and to display on the display device 4 an image that looks the same as a previously observed display image. This further improves convenience.

[0057] (Variation 2) Figures 8 and 9 are diagrams illustrating Variation 2 of the embodiment. Specifically, Figure 8 is a diagram showing information stored in the storage unit 63. Figure 9 is a diagram corresponding to Figure 8 and shows information transmitted and received through communication between the control device 5 and the server 6. For ease of explanation, Figure 9 illustrates only the image processing unit 51 as part of the configuration of the control device 5, and only the storage unit 63 as part of the configuration of the server 6.

[0058] In the above-described first modification, a plurality of different MSs may be associated with each set of connected device information, procedure information, and user information and stored in the storage unit 63. In the example of Fig. 8, examination scenarios A to C are associated with each set of connected device information "scope α," procedure information "procedure A," and user information "user a" and stored as MSs in the storage unit 63.

[0059] Inspection scenario A is composed of three MSs, "MS1, MS2, MS3." Inspection scenario B is composed of three MSs, "MS4, MS5, MS6." Inspection scenario C is composed of two MSs, "MS1, MS2." Since inspection scenarios A to C use different MSs, the appearance of the displayed image after image processing using the MSs will differ.

[0060] For example, based on log information stored when a specific MS was used for image processing when an operator or examiner previously performed a specific procedure using a specific endoscope 2, connected device information specific to the endoscope 2, procedure information related to the procedure, and user information identifying the operator or examiner are associated with the MS and stored in the storage unit 63. Furthermore, if the same set of connected device information, procedure information, and user information as the set stored in the storage unit 63 is already stored in the storage unit 63, for example, the MS associated with the already stored set is stored as examination scenario A, and the MS associated with the set to be stored is stored in the storage unit 63 as examination scenario B.

[0061] In the example of FIG. 9 , the control device 5 transmits to the server 6 "scope α" as the connected device information, "procedure A" as the procedure information, and "user a" as the user information. Here, as shown in FIG. 8 , examination scenarios A to C are associated with each set of "scope α," "procedure A," and "user a," and stored in the storage unit 63. Therefore, the server 6 transmits to the control device 5 information prompting the control device 5 to select one of the examination scenarios A to C corresponding to the "scope α," the "procedure A," and the "user a." In response to this, when examination scenario A is selected by a user operation on the input unit 54, the control device 5 transmits to the server 6 information indicating that the examination scenario A has been selected. As a result, the server 6 transmits to the control device 5 "MS1, MS2, MS3 ( FIG. 8 )" as MSs corresponding to the examination scenario A. The control device 5 then performs image processing on the imaging data obtained by imaging with the endoscope 2 in the order of "MS1," "MS2," and "MS3," and a display image corresponding to the imaging data after the image processing is displayed on the display device 4.

[0062] The above-described Modification 2 achieves the same effects as those of the above-described embodiment and Modification 1, as well as the following effects. The control device 5 according to Modification 2 acquires from the server 6 at least one MS corresponding to an examination scenario selected by the surgeon or examiner from among a plurality of different examination scenarios associated with a set of connected device information, procedure information, and user information. The control device 5 then performs image processing on imaging data obtained by imaging with the endoscope 2 using an image processing algorithm corresponding to the at least one MS. This allows the surgeon or examiner to select one of a plurality of examination scenarios that provide different appearances of the displayed image and observe the display image with the desired appearance on the display device 4. This further improves convenience.

[0063] In the second modification, a plurality of different examination scenarios are associated with a set of connected device information, procedure information, and user information and stored in the storage unit 63. However, this is not limiting. User information is not essential, and a plurality of different examination scenarios may be associated with a set of only connected device information and procedure information and stored in the storage unit 63.

[0064] (Variation 3) Figures 10 and 11 are diagrams illustrating Variation 3 of the embodiment. Specifically, Figure 10 is a diagram showing information stored in the storage unit 63. Figure 11 is a diagram corresponding to Figure 10 and shows information transmitted and received through communication between the control device 5 and the server 6. For ease of explanation, Figure 10 illustrates only the image processing unit 51 as part of the configuration of the control device 5, and only the storage unit 63 as part of the configuration of the server 6.

[0065] In the above-described embodiment, for example, a specific procedure is planned to be performed before the examination and an MS corresponding to the specific procedure is obtained from the server 6. However, if it becomes necessary to change to a procedure different from the specific procedure during the examination, the configuration may be such that an MS corresponding to the changed procedure can be obtained from the server 6.

[0066] In the example of FIG. 11 , the control device 5 first transmits "scope α" as connected device information, "procedure A" as procedure information, and "user a" as user information to the server 6. As a result, the server 6 transmits "MS1, MS2, MS3 ( FIG. 10 )" as MSs corresponding to the "scope α," the "procedure A," and the "user a" to the control device 5. The control device 5 then performs image processing on the imaging data obtained by imaging with the endoscope 2 in the order of "MS1," "MS2," and "MS3," and displays a display image corresponding to the imaging data after the image processing on the display device 4. If the procedure information is changed from "procedure A" to "procedure B" during the examination, the server 6 transmits "MS4, MS5, MS6 ( FIG. 10 )" as MSs corresponding to the "scope α," the "procedure B," and the "user a." The control unit 52 (information acquisition unit) then acquires "MS4, MS5, MS6." Then, the control unit 52 (processing control unit) executes image processing in the order of "MS4," "MS5," and "MS6" on the imaging data obtained by imaging using the endoscope 2. As a result, a display image corresponding to the imaging data after the image processing is displayed on the display device 4.

[0067] The third modification described above provides the same effects as the above-described embodiment, as well as the following effects. When a procedure is changed to a different procedure from a specific procedure during an examination, the control device 5 according to the third modification acquires at least one MS corresponding to the changed procedure from the server 6. The control device 5 then performs image processing on the imaging data obtained by imaging with the endoscope 2 using an image processing algorithm corresponding to the at least one MS. In other words, because image processing corresponding to the changed procedure is performed on the imaging data obtained by imaging with the endoscope 2, a display image suitable for observation can be displayed on the display device 4. This further improves convenience.

[0068] (Modification 4) Figures 12 and 13 are diagrams illustrating Modification 4 of the embodiment. Specifically, Figure 12 is a diagram showing information stored in the storage unit 63. Figure 13 is a diagram corresponding to Figure 12 and shows information transmitted and received through communication between the control device 5 and the server 6. For ease of explanation, Figure 13 shows only the image processing unit 51 as part of the configuration of the control device 5, and only the storage unit 63 as part of the configuration of the server 6.

[0069] In the above-described embodiment, a modular structure may be configured by combining a plurality of MSs, and image processing may be performed on imaging data using an image processing algorithm corresponding to the modular structure.

[0070] Here, as shown in Fig. 12, the storage unit 63 stores connected device information, procedure information, and user information in association with a plurality of MSs and modular structure information. The modular structure information is information for combining the plurality of MSs to configure a modular structure. In the example of Fig. 12, the connected device information "scope α," procedure information "procedure A," and user information "user a" are stored in association with three MSs "MS1, MS2, MS3," and modular structure information "modular structure A."

[0071] For example, based on log information stored when a surgeon or examiner previously performed a specific procedure using a specific endoscope 2 and used a specific modular structure for image processing, connection device information specific to the endoscope 2, procedure information related to the procedure, and user information identifying the surgeon or examiner are associated with multiple MSs that make up the modular structure and modular structure information for combining the multiple MSs to form the modular structure and stored in the memory unit 63.

[0072] In the example of FIG. 13 , the control device 5 transmits to the server 6 "scope α" as connected device information, "procedure A" as procedure information, and "user a" as user information. The server 6 then transmits to the control device 5 "MS1, MS2, MS3 ( FIG. 12 )" and "modular structure A ( FIG. 12 )" as MS and modular structure information corresponding to the "scope α," the "procedure A," and the "user a." The control unit 52 (information acquisition unit) then acquires the "MS1, MS2, MS3" and the "modular structure A." The control unit 52 (processing control unit) then combines the "MS1, MS2, MS3" and the "modular structure A" to form a modular structure ( FIG. 13 ) based on the "modular structure A." The control unit 52 (processing control unit) then performs image processing on the imaging data obtained by the endoscope 2 using an image processing algorithm corresponding to the modular structure. A display image corresponding to the imaging data after the image processing is then displayed on the display device 4.

[0073] The fourth modification described above provides the same effects as the above-described embodiment, as well as the following effects. The control device 5 according to the fourth modification acquires, from the server 6, multiple MSs and modular structure information for combining the multiple MSs to configure a modular structure. The control device 5 then configures a modular structure based on the multiple MSs and the modular structure information, and performs image processing on imaging data obtained by imaging using the endoscope 2 using an image processing algorithm corresponding to the modular structure. This makes it possible to configure modular structures with various patterns. Furthermore, the amount of data transmitted from the server 6 to the control device 5 can be reduced.

[0074] In the fourth modification, the modular structure is configured on the control device 5 side, but this is not limiting, and the modular structure may be configured on the server 6 side.

[0075] (Variation 5) Fig. 14 is a diagram illustrating Variation 5 of the embodiment. Specifically, Fig. 14 corresponds to Fig. 4 and shows information transmitted and received through communication between the control device 5 and the server 6. For ease of explanation, Fig. 14 illustrates only the image processing unit 51 as part of the configuration of the control device 5, and only the storage unit 63 as part of the configuration of the server 6.

[0076] In the above-described embodiment, the image processing unit 51 may always include a minimum required MS. An example of the minimum required MS is image processing according to white light irradiated into the living body.

[0077] 14 , the image processing unit 51 always includes "MS1" as the minimum required MS. In the example of FIG. 14 , "scope α" is transmitted as connected device information and "procedure A" is transmitted as procedure information from the control device 5 to the server 6. As a result, the server 6 transmits to the control device 5 "MS2 and MS3" other than "MS1" provided in the image processing unit 51, among "MS1, MS2, MS3 ( FIG. 4 )," which are MSs corresponding to the "scope α" and the "procedure A." The control device 5 then performs image processing on the imaging data obtained by imaging with the endoscope 2 in the order of "MS1," "MS2," and "MS3," and a display image corresponding to the imaging data after the image processing is displayed on the display device 4.

[0078] The fifth modification described above provides the same effects as the above-described embodiment, as well as the following effects. In the fifth modification, the image processing unit 51 always includes the minimum required MS. Therefore, for example, when performing image processing in accordance with white light irradiated inside a living body, the control device 5 does not need to acquire the minimum required MS from the server 6 via communication. Furthermore, because the control device 5 always includes the minimum required MS, the amount of data transmitted from the server 6 to the control device 5 can be reduced when performing image processing that includes the minimum required MS and other MSs.

[0079] (Variation 6) In the above-described embodiment and variations 1 to 5, the medical image processing device according to the present invention is mounted in an endoscopic system 1 in which the endoscope 2 is configured as a flexible endoscope, but this is not limiting. For example, the medical image processing device according to the present invention may be mounted in an endoscopic system in which the endoscope 2 is configured as a rigid endoscope. Furthermore, the medical image processing device according to the present invention may be mounted in a medical observation system including a surgical microscope (see, for example, JP 2016-42981 A) that magnifies and observes a predetermined field of view inside a subject (inside a living body) or on the surface of a subject (surface of a living body). In this case, the surgical microscope corresponds to the medical observation device according to the present invention.

[0080] REFERENCE SIGNS LIST 1 Endoscope system 2 Endoscope 3 Light source device 4 Display device 5 Control device 6 Server 21 Insertion section 22 Operation section 23 Universal cord 24 Connector section 51 Image processing section 52 Control section 53 Storage section 54 Input section 55 Communication section 61 Communication section 62 Control section 63 Storage section 211 Tip unit 212 Bending section 213 Flexible tube NE Network

Claims

1. A medical image processing device, comprising: an image processing unit that performs image processing on imaging data obtained by imaging using the connected medical observation device; a processor configured by hardware, The processor: acquiring, from an external server, connection device information specific to the medical observation device that identifies the medical observation device and at least one processing module corresponding to procedure information related to the procedure; a medical image processing apparatus that controls the operation of the image processing unit and executes image processing on the imaging data using an image processing algorithm corresponding to the at least one processing module;

2. The processor: The medical image processing apparatus according to claim 1 , wherein the at least one processing module corresponding to the connected device information, the procedure information, and user information identifying a user who uses the medical observation apparatus is acquired from the server.

3. The processor: additionally acquiring from the server at least one processing module corresponding to the connection device information and the changed procedure information; The medical image processing apparatus according to claim 1 , further comprising: a processor for controlling an operation of the image processing unit; and a processor for executing image processing on the imaging data using an image processing algorithm corresponding to the at least one additionally acquired processing module.

4. The processor: acquiring, from the server, a plurality of the processing modules and modular structure information for combining the plurality of the processing modules to form a modular structure; 2. The medical image processing device according to claim 1, wherein the plurality of processing modules are combined to form a modular structure based on the modular structure information, the operation of the image processing unit is controlled, and image processing is performed on the imaging data using an image processing algorithm corresponding to the modular structure.

5. The image processing unit The medical image processing apparatus according to claim 1 , wherein the minimum number of processing modules is always provided.

6. The processing module includes:

2. The medical image processing apparatus according to claim 1, wherein the image processing algorithm is implemented as a processing module, which is a minimum unit of each function constituting the image processing algorithm.

7. A server; A medical image processing system comprising the medical image processing apparatus according to claim 1 , which is communicably connected to the server.

8. a communication unit that is communicably connected to an external medical image processing device; a control unit that controls the operation of the communication unit; a storage unit that stores connected device information specific to the medical observation device, which identifies the medical observation device, and procedure information related to the procedure, in association with at least one processing module; The control unit A server that reads out from the memory unit the at least one processing module associated with the connected device information and the procedure information obtained from the medical image processing device via the communication unit, and transmits the at least one processing module to the medical image processing device via the communication unit.

9. A medical image processing method executed by a processor of a medical image processing device, comprising: The processor: acquiring, from an external server, connected device information specific to the medical observation device that identifies the medical observation device connected to the medical image processing device, and at least one processing module corresponding to procedure information related to the procedure; A medical image processing method for controlling the operation of an image processing unit, and executing image processing on imaging data obtained by imaging using the medical observation device using an image processing algorithm corresponding to the at least one processing module.

10. A medical image processing program to be executed by a processor of a medical image processing device, comprising: The medical image processing program causes the processor to: acquiring, from an external server, connected device information specific to the medical observation device that identifies the medical observation device connected to the medical image processing device, and at least one processing module corresponding to procedure information related to the procedure; a medical image processing program that controls the operation of an image processing unit and executes image processing on imaging data obtained by imaging using the medical observation device using an image processing algorithm corresponding to the at least one processing module;