Medical image processing device and medical observation system

Abstract

To improve convenience.SOLUTION: A medical image processing device 5 includes: an image acquisition unit 51 for acquiring image information obtained by the imaging executed by a medical observation device 2; and a superimposition image generation unit 52 for generating a superimposition image that superimposes a pattern image in which first images of a specific shape are arranged in parallel by a specific pattern and a captured image based on the image information.SELECTED DRAWING: Figure 2

Description

[Technical Field]

[0001] The present disclosure relates to a medical image processing device and a medical observation system. [Background technology]

[0002] BACKGROUND ART Conventionally, medical observation systems used in eye surgeries such as cataract surgeries are known (see, for example, Patent Document 1). In the medical observation system described in Patent Document 1, an image of an eye to be examined is captured by an imaging device and displayed on a display device. Then, an operator performs surgery while checking the captured image displayed on the display device. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] International Publication No. 2017 / 065018 Summary of the Invention [Problem to be solved by the invention]

[0004] However, since the affected area is biological tissue, there are few landmarks to refer to during surgery. Therefore, even if the surgeon checks the captured image displayed on the display device during surgery, it is difficult to determine how much the surgical tool will move in the captured image if the surgeon moves the hand holding the surgical tool. Therefore, there is a demand for a technology that can easily compare the amount of movement of the hand holding the surgical tool with the amount of movement of the surgical tool in the captured image, thereby improving convenience.

[0005] The present disclosure has been made in view of the above, and has an object to provide a medical image processing device and a medical observation system that can improve convenience. [Means for solving the problem]

[0006] In order to solve the above-mentioned problems and achieve the objectives, the medical image processing device according to the present disclosure includes an image acquisition unit that acquires image information obtained by imaging using a medical observation device, and a superimposed image generation unit that generates a superimposed image by superimposing a pattern image in which a first image of a specific shape is arranged in a specific pattern on an imaged image based on the image information.

[0007] Furthermore, a medical observation system according to the present disclosure includes a medical observation device that images a subject, and a medical image processing device that processes image information obtained by imaging with the medical observation device, and the medical image processing device includes an image acquisition unit that acquires the image information, and a superimposed image generation unit that generates a superimposed image by superimposing a pattern image in which first images of a specific shape are arranged in a specific pattern on an imaged image based on the image information. [Effects of the Invention]

[0008] The medical image processing device and medical observation system according to the present disclosure can improve convenience. [Brief explanation of the drawings]

[0009] [Figure 1] FIG. 1 is a diagram illustrating the configuration of a medical observation system according to the first embodiment. [Figure 2] FIG. 2 is a diagram illustrating the configuration of the medical observation system according to the first embodiment. [Figure 3] FIG. 3 is a diagram showing a captured image. [Figure 4] FIG. 4 is a diagram showing a pattern image. [Figure 5] FIG. 5 is a diagram showing the superimposed image. [Figure 6] FIG. 6 is a diagram showing the superimposed image. [Figure 7] FIG. 7 is a diagram showing a superimposed image. [Figure 8] FIG. 8 is a diagram showing a superimposed image according to the second embodiment. [Figure 9] FIG. 9 is a diagram showing a superimposed image according to the third embodiment. [Figure 10] FIG. 10 is a diagram showing a superimposed image according to the fourth embodiment. [Figure 11] FIG. 11 is a diagram showing a superimposed image according to the fifth embodiment. [Figure 12] FIG. 12 is a diagram showing a superimposed image according to the fifth embodiment. [Figure 13] FIG. 13 is a diagram showing a superimposed image according to the sixth embodiment. [Figure 14] FIG. 14 is a diagram showing a superimposed image according to the seventh embodiment. [Figure 15] FIG. 15 is a diagram showing a display format of a superimposed image according to the eighth embodiment. [Figure 16] FIG. 16 is a diagram showing a display format of a superimposed image according to the ninth embodiment. [Figure 17] FIG. 17 is a diagram showing a first superimposed image according to the tenth embodiment. [Figure 18] FIG. 18 is a diagram showing a second superimposed image according to the tenth embodiment. [Figure 19] FIG. 19 is a diagram showing a display format of the first and second superimposed images according to the tenth embodiment. [Figure 20] FIG. 20 is a diagram showing a modification of the first to sixth and eighth to tenth embodiments. [Figure 21] FIG. 21 is a diagram showing a modification of the first to tenth embodiments. DETAILED DESCRIPTION OF THE INVENTION

[0010] Hereinafter, modes for carrying out the present disclosure (hereinafter, referred to as embodiments) will be described with reference to the drawings. Note that the present disclosure is not limited to the embodiments described below. Furthermore, in the drawings, the same parts are denoted by the same reference numerals.

[0011] (Embodiment 1) [General configuration of medical observation system] 1 and 2 are diagrams for explaining the configuration of a medical observation system 1 according to embodiment 1. Specifically, Fig. 1 is a diagram showing the external configuration of the medical observation system 1. Fig. 2 is a block diagram showing the configuration of the medical observation system 1. The medical observation system 1 is a system used for surgery on the eye of a patient (hereinafter referred to as the subject's eye) lying on a patient bed BD (Fig. 1). As shown in Fig. 1 or 2, this medical observation system 1 comprises a surgical microscope 2, a display device 3, an input device 4, and a control device 5.

[0012] The surgical microscope 2 corresponds to the medical observation device according to the present disclosure. It captures an image of the subject's eye under the control of a control device 5. As shown in FIG. 1 or 2, the surgical microscope 2 includes a light source device 21 (FIG. 2), a microscope unit 22, a base unit 23 (FIG. 1), a support unit 24 (FIG. 1), and a drive unit 25 (FIG. 2). The light source device 21, under the control of the control device 5, supplies illumination light that illuminates the eye to be examined. As shown in FIG. 1 or 2, the microscope section 22 includes an observation optical system 221 (FIG. 2), an eyepiece 222, and an imaging section 223 (FIG. 2).

[0013] The observation optical system 221 includes an objective lens 2211 (FIGS. 1 and 2), a lens unit 2212 (FIG. 2), and a half mirror 2213 (FIG. 2), and guides light reflected from the subject's eye to the eyepiece 222 and the image capturing unit 223, respectively. That is, the light reflected from the subject's eye is incident on the half mirror 2213 via the objective lens 2211 and the lens unit 2212. Approximately half of the light incident on the half mirror 2213 is transmitted through the half mirror 2213 and enters the eyepiece 222. On the other hand, the remaining light incident on the half mirror 2213 is reflected by the half mirror 2213 and enters the image capturing unit 223.

[0014] Here, the lens unit 2212 includes a zoom lens 2214 and a focus lens 2215, as shown in FIG. The zoom lens 2214 is configured using one or more lenses and adjusts the angle of view by moving along the optical axis Ax (FIG. 2). The optical axis Ax extends vertically in FIG. 1 and is the axis extending from the microscope unit 22 toward the eye to be examined. The focus lens 2215 is configured using one or more lenses, and adjusts the focus by moving along the optical axis Ax. The lens unit 2212 is also provided with an optical zoom mechanism (not shown) that moves the zoom lens 2214 along the optical axis Ax, and a focus mechanism (not shown) that moves the focus lens 2215 along the optical axis Ax.

[0015] The eyepiece 222 focuses light incident from the observation optical system 221 to form an optical image of the subject's eye. This allows the surgeon looking through the eyepiece 222 to observe the optical image of the subject's eye. The imaging unit 223 includes an imaging element such as a CCD (Charge Coupled Device) or a CMOS (Complementary Metal Oxide Semiconductor) that receives light incident from the observation optical system 221 and converts it into an electrical signal. Then, under the control of the control device 5, the imaging unit 223 outputs pixel signals (for example, RAW signals or image signals) obtained by imaging to the control device 5. The pixel signals correspond to image information according to the present disclosure.

[0016] The base 23 is a base for the surgical microscope 2, and is configured to be movable on the floor via casters 231 (FIG. 1). The support unit 24 extends from the base unit 23 and supports the microscope unit 22 at its tip (the end spaced apart from the base unit 23). As shown in FIG. 1, the support unit 24 includes an XY stage 241, an XY moving unit 242, and a Z moving unit 243.

[0017] The XY stage 241 supports the XY moving part 242 so that it can move along the X and Y directions. Here, the X and Y directions are directions along planes perpendicular to the optical axis Ax and are perpendicular to each other. The XY moving section 242 is a section that is movable along the X and Y directions relative to the XY stage 241. The XY moving section 242 also supports the Z moving section 243 so that it can move along the Z axis. Here, the Z direction is the direction along the optical axis Ax (the up and down direction in FIG. 1), and is perpendicular to the X and Y directions. The Z movement unit 243 is a part that is movable along the Z direction relative to the XY movement unit 242. The Z movement unit 243 supports the microscope unit 22. That is, by operating the XY moving unit 242, the microscope unit 22 can be moved in the X direction and the Y direction, respectively. Also, by operating the Z moving unit 243, the microscope unit 22 can be moved in the Z direction.

[0018] As shown in FIG. 2, the driving unit 25 includes an XY driving unit 251, a Z driving unit 252, and a lens driving unit 253. The XY driving unit 251 is an actuator such as a motor, and under the control of the control device 5, operates the XY moving unit 242 to move the microscope unit 22 in the X and Y directions. The Z drive unit 252 is an actuator such as a motor, and under the control of the control device 5, operates the Z movement unit 243 to move the microscope unit 22 in the Z direction. The lens driving unit 253 is an actuator such as a motor, and under the control of the control device 5, operates the optical zoom mechanism (not shown) and focus mechanism (not shown) described above to adjust the angle of view and focus.

[0019] The display device 3 is configured with a display using liquid crystal or organic EL (Electro Luminescence) or the like, and displays an image based on a video signal from the control device 5 under the control of the control device 5. The input device 4 is configured using operation devices such as a mouse, a keyboard, and a touch panel, and receives user operations by a user such as a surgeon. The input device 4 then outputs an operation signal to the control device 5 in response to the user operation.

[0020] The control device 5 corresponds to the medical image processing device according to the present disclosure. This control device 5 comprehensively controls the operations of the surgical microscope 2 and the display device 3. As shown in FIG. 2 , this control device 5 includes a communication unit 51, an image processing unit 52, a control unit 53, and a storage unit 54.

[0021] The communication unit 51 is an interface for communicating with the surgical microscope 2, and receives pixel signals from the imaging unit 223 and transmits control signals from the control unit 53. In other words, the communication unit 51 corresponds to the image acquisition unit according to the present disclosure. The image processing unit 52 performs image processing on the pixel signal received by the communication unit 51 to generate a captured image based on the pixel signal, and also generates a display video signal for displaying an image corresponding to the captured image on the display device 3, and outputs the video signal to the display device 3. Examples of the image processing include digital gain processing, which multiplies the pixel signal (digital signal) received by the communication unit 51 by a digital gain that amplifies the digital signal, optical black subtraction processing, white balance (WB) adjustment processing, demosaic processing, color matrix calculation processing, gamma correction processing, YC conversion processing, which generates a luminance signal and color difference signals (Y, Cb / Cr signals), and enlargement processing (electronic zoom). The image processing unit 52 has functions as a pattern image generating unit, a superimposed image generating unit, and a display control unit according to the present disclosure. The functions of the pattern image generating unit, the superimposed image generating unit, and the display control unit will be described later in the section "Operation of the control device."

[0022] The control unit 53 is configured, for example, with a CPU (Central Processing Unit) or FPGA (Field-Programmable Gate Array), and controls the operation of the surgical microscope 2 and the display device 3, as well as the operation of the entire control device 5. This control unit 53 functions as a pattern image control unit according to the present disclosure. The function of the pattern image control unit will be described later in the section "Operation of the Control Device." The control unit 53 may also be configured, for example, as an IP converter with an image processing function. In this case, the control unit 53 functions as a video source-side IP converter that IP-converts the video output from the surgical microscope 2 (video source) and transmits it over the network. The display device 3 is provided with a video output-side IP converter that converts the video transmitted via the network into a format specific to the display device 3 and outputs it. The video source-side IP converter functions as an encoder, and the video output-side IP converter functions as a decoder. The storage unit 54 stores the programs executed by the control unit 53, information necessary for the processing of the control unit 53, and the like.

[0023] [About cataract surgery] Before describing the operation of the control device 5, a brief description of cataract surgery will be given. In cataract surgery, the surgeon performs the steps of creating a port, incising the anterior capsule, hydrodissection, processing the lens nucleus, and inserting an intraocular lens in that order.

[0024] In the port creation step, the surgeon makes an incision in the cornea of ​​the subject's eye with a knife to create a port (incision).

[0025] The anterior capsulotomy step is a step called CCC (Continuous Curvilinear Capsulorrhexis). In this anterior capsulotomy step, the surgeon inserts a sharp-tipped forceps through the port created in the port creation step and makes a circular incision in the anterior part of the lens, i.e., the anterior capsule.

[0026] In the hydrodissection step, the surgeon inserts the tip of a cannula between the lens capsule (the skin surrounding the lens) and the lens cortex through the port created in the port creation step. Then, the surgeon flows irrigation fluid through the cannula, which separates the lens capsule from the lens cortex.

[0027] In the lens nucleus processing step, the surgeon inserts an aspiration tube through the port created in the port creation step. Then, through the aspiration tube, the surgeon performs a process called nucleus processing, which involves emulsifying (pulverizing) and aspirating the lens nucleus using ultrasonic vibrations, and also aspirating the cortex.

[0028] In the intraocular lens insertion step, the surgeon places the intraocular lens in a cartridge, then inserts the cartridge through the port created in the port creation step, and pushes the intraocular lens out of the cartridge and inserts it into the subject's eye.

[0029] [Control device operation] Next, we will explain the operation of the above-mentioned control device 5. Below, we will mainly explain the functions of the image processing unit 52 as a pattern image generating unit, a superimposed image generating unit, and a display control unit, and the function of the control unit 53 as a pattern image control unit, using cataract surgery as an example. FIG. 3 is a diagram showing a captured image C1. FIG. 4 is a diagram showing a pattern image C2. FIG. 5 and FIG. 6 are diagrams showing a superimposed image C3. In FIG. 3, FIG. 5, and FIG. 6, the reference numeral "100" indicates the eye to be examined. The reference numeral "110" indicates the cornea. The reference numeral "120" indicates the pupil. The reference numeral "130" indicates the blood vessels of the sclera. The reference numeral "140" indicates the eyelashes.

[0030] The image processing unit 52 (pattern image generating unit) generates a pattern image C2 (FIG. 4) under the control of the control unit 53 (pattern image control unit). Here, the pattern image C2 is an image in which first images 200 of a specific shape are arranged in a specific pattern. In the first embodiment, the first images 200 are circular dots, as shown in Fig. 4. The pattern image C2 is an image in which a plurality of first images 200 are arranged in a row at specific intervals in the vertical and horizontal directions.

[0031] In addition, the image processing unit 52 (superimposed image generation unit) generates a superimposed image C3 (Figure 5) by superimposing the pattern image C2 generated as described above and the captured image C1 (Figure 3) generated based on the pixel signal generated by the imaging unit 223 and acquired via the communication unit 51. Furthermore, the image processing unit 52 (display control unit) uses the superimposed image C3 generated as described above as an image for display. Then, the image processing unit 52 (display control unit) generates a video signal for displaying the image for display (superimposed image C3) on the display device 3, and outputs the video signal to the display device 3.

[0032] The control unit 53 (pattern image control unit) controls the operation of the image processing unit 52 (pattern image generating unit) as described below, and generates a pattern image C2 (FIG. 6). As shown in FIG. 6, the control unit 53 (pattern image control unit) generates a pattern image C2 that makes some first images 210 of all first images 200 in the pattern image C2 distinguishable from other first images 220. In the first embodiment, the control unit 53 (pattern image control unit) generates a pattern image C2 that makes some first images 210 distinguishable from other first images 220 by changing the overall appearance of the some first images 210 without changing the shape (circular shape) of each of all first images 200. Specifically, the control unit 53 (pattern image control unit) generates a pattern image C2 that makes some first images 210 distinguishable from other first images 220 by changing at least one of the brightness, color, and transmittance of the some first images 210 relative to the captured image C1. Note that in FIG. 6, for ease of explanation, some first images 210 are represented by dots filled in black, and other first images 220 are represented by dots filled in gray.

[0033] Here, the control unit 53 (pattern image control unit) selects some first images 210 from all the first images 200 in the pattern image C2 as follows. A patient undergoing cataract surgery undergoes a preoperative examination before the surgery. During the preoperative examination, the patient's eye is imaged, and an image similar to image C1 (hereinafter referred to as a preoperative image) is generated. Then, the surgeon performing the cataract surgery, while checking the preoperative image displayed on a display device, specifies an area on the preoperative image that will serve as a specific indicator for performing the cataract surgery. Examples of the specific indicator area include an area indicating the position of a port to be incised in a port creation process, a circular area indicating the anterior capsule to be incised in an anterior capsule incision process, an area indicating the position of an astigmatic axis used in an intraocular lens insertion process, or an area indicating the center of the eye to be examined.

[0034] The control unit 53 (pattern image control unit) determines the positional relationship between corresponding pixels in the preoperative image and the captured image C1 based on at least one of structural features of the subject's eye 100 contained in the preoperative image and the captured image C1, such as the outline of the pupil 120, the outline of the cornea 110 (the outline of the iris), the pattern of the iris, and the shape of the scleral blood vessels 130. The control unit 53 (pattern image control unit) also extracts a region in the captured image C1 that corresponds to a region (a region that serves as a specific index) designated on the preoperative image as described above (i.e., extracts a region having a specific feature from the captured image C1). The control unit 53 (pattern image control unit) then selects a first image 200 located at a position in the pattern image C2 that corresponds to the extracted region (e.g., within the extracted region) as a part of the first image 210. Note that FIG. 6 illustrates an example in which the region that serves as a specific index is a region indicating the position of a port to be incised in the port creation process.

[0035] As described above, some of the first images 210 are selected. Therefore, even if the center position of the subject's eye 100 (the center position of the pupil 120) moves, for example, as shown in Figures 6 and 7, the first image 210 at a position that follows the movement of the subject's eye 100 will be selected from all of the first images 200.

[0036] According to the first embodiment described above, the following effects are achieved. The control device 5 according to the first embodiment generates a superimposed image C3 by superimposing the above-described pattern image C2 and the captured image C1 generated by the surgical microscope 2. Therefore, during surgery, the surgeon can easily determine, from the position of each first image 200 in the pattern image C2 included in the superimposed image C3 displayed on the display device 3, how much the surgeon should move his or her hand holding the surgical tool to move the surgical tool in the superimposed image C3. Therefore, according to the control device 5 of this embodiment 1, it is possible to easily compare the amount of movement of the hand holding the surgical tool with the amount of movement of the surgical tool in the superimposed image C3, thereby improving convenience.

[0037] In particular, the control device 5 according to the first embodiment extracts an area having specific characteristics from the captured image C1, and generates a pattern image C2 that makes it possible to distinguish the first image 210 from the other first images 220 by using the first image 200 located at a position corresponding to the area in the pattern image C2 as a part of the first image 210. Therefore, the surgeon can recognize an area that serves as a specific indicator for performing cataract surgery (for example, an area indicating the position of a port to be incised in the port creation step) from the position of the part of the first image 210 displayed on the display device 3. Therefore, convenience can be further improved.

[0038] In addition, the control device 5 according to the first embodiment generates a pattern image C2 that enables a portion of the first image 210 to be distinguished from other first images 220 by changing at least one of the brightness, color, and transmittance of the portion of the first image 210 relative to the captured image C1. Therefore, the pattern image C2 that allows the surgeon to easily recognize the part of the first image 210 can be generated by simple processing.

[0039] (Embodiment 2) Next, a second embodiment will be described. In the following description, the same components as those in the first embodiment are denoted by the same reference numerals, and detailed description thereof will be omitted or simplified. 8 is a diagram showing a superimposed image C3 according to Embodiment 2. For convenience of explanation, FIG. 8 corresponds to FIG. In the second embodiment, the pattern image C2 is different from that in the first embodiment, as shown in Fig. 8. For ease of explanation, the pattern image C2 according to the second embodiment will be referred to as a pattern image C2' below.

[0040] The first image 200 constituting the pattern image C2' is made up of two types of images: a second image 201 and a third image 202, as shown in FIG. The second image 201 is the same image as the first image 200 described in the first embodiment above, and is made up of circular dots. The third image 202 is an image different from the second image 201. In the second embodiment, the dots are square-shaped, as shown in FIG. The pattern image C2' is an image in which the first image 200 located at a specific position in the above-described pattern image C2 is replaced with a third image 202. More specifically, the multiple third images 202 are regularly aligned vertically and horizontally so as to sandwich four second images 201 therebetween. Note that the number of second images 201 sandwiched between the third images 202 is not limited to four and may be any other number.

[0041] According to the second embodiment described above, in addition to the same effects as those of the first embodiment, the following effects are achieved. In the second embodiment, the first image 200 constituting the pattern image C2' is made up of two types of images, second and third images 201 and 202. Therefore, the surgeon can compare in more detail the amount of movement of the hand holding the surgical tool with the amount of movement of the surgical tool in the superimposed image C3 from the position of the closely spaced second image 201 and the position of the widely spaced third image 202 in the first image 200 displayed on the display device 3. In other words, convenience can be further improved.

[0042] (Embodiment 3) Next, a third embodiment will be described. In the following description, the same components as those in the first embodiment are denoted by the same reference numerals, and detailed description thereof will be omitted or simplified. Fig. 9 is a diagram showing a superimposed image C3 according to embodiment 3. For ease of explanation, Fig. 9 corresponds to Fig. 6. In Fig. 9, the area indicated by the reference numeral "150" (the shaded area) indicates blood that has bled from the subject's eye 100. The control unit 53 (pattern image control unit) according to the third embodiment selects some first images 210 from all the first images 200 in the pattern image C2 in the same manner as in the first embodiment described above, and also selects the images shown below as some first images 210. For ease of explanation, hereinafter, some first images 210 selected by the method described in the first embodiment above will be referred to as some first images 211 (FIG. 9), and some first images 210 selected by the method of the third embodiment will be referred to as some first images 212 (FIG. 9).

[0043] The control unit 53 (pattern image control unit) extracts an area having a specific characteristic (for example, an area where blood 150 or a stain or fluorescent agent used in surgery is present) from the captured image C1 using a known method such as image recognition using AI (Artificial Intelligence). Then, the control unit 53 (pattern image control unit) sets the first image 200 located at a position in the pattern image C2 corresponding to the extracted area (for example, a position surrounding the extracted area) as a part of the first image 212. Note that in FIG. 9, the part of the first image 211 and the part of the first image 212 appear similarly, but this is not limiting and they may appear differently.

[0044] According to the third embodiment explained above, in addition to the same effects as those of the first embodiment, the following effects are achieved. The control device 5 according to the third embodiment selects the first images 212 as the first images 210 from among all the first images 200 in the pattern image C2, as described above. Therefore, the surgeon can recognize the area of ​​the bleeding blood 150 and the area where the dye or fluorescent agent used in the surgery is present from the position of the part of the first image 212 displayed on the display device 3. In other words, convenience can be further improved.

[0045] (Fourth embodiment) Next, a fourth embodiment will be described. In the following description, the same components as those in the third embodiment are denoted by the same reference numerals, and detailed description thereof will be omitted or simplified. 10 is a diagram showing a superimposed image C3 according to Embodiment 4. For convenience of explanation, FIG. 10 corresponds to FIG. The control unit 53 (pattern image control unit) according to the fourth embodiment selects some first images 210 from all the first images 200 in the pattern image C2 in the same manner as in the third embodiment described above, and also selects the images shown below as some of the first images 210. For ease of explanation, the some of the first images 210 selected by the method of the fourth embodiment will be referred to as some of the first images 213 (FIG. 10).

[0046] The control unit 53 (pattern image control unit) sets the first images 200 located at positions (for example, within the area Ar1) corresponding to a predetermined area Ar1 (four corner areas in the example of FIG. 10 ) in the pattern image C2 as some of the first images 213. Then, the control unit 53 (pattern image control unit) generates a pattern image C2 in which the overall appearance of some of the first images 213 is made less visible relative to the other first images 200, without changing the shape (circular shape) of each of all of the first images 200. Here, examples of methods for making some of the first images 213 less visible include making the brightness of the some of the first images 213 the same as the brightness or color of the captured image C1 located at pixel positions around the first images 213, or making the transmittance of the first images 213 very high relative to the captured image C1.

[0047] According to the fourth embodiment described above, in addition to the same effects as those of the third embodiment, the following effects are achieved. The control device 5 according to the fourth embodiment selects some of the first images 213 as some of the first images 210 from among all of the first images 200 in the pattern image C2, as described above. Then, the control device 5 generates a pattern image C2 in which the overall visibility of some of the first images 213 is made less visible than the other first images 200, without changing the shape (circular shape) of each of all of the first images 200. As a result, some of the first image 213 located in unnecessary areas Ar1 such as the corner areas is difficult to see, resulting in a pattern image C2 in which the first image 210 is visible only in the necessary areas, making the superimposed image C3 displayed on the display device 3 an easy-to-see image.

[0048] (Embodiment 5) Next, a fifth embodiment will be described. In the following description, the same components as those in the first embodiment are denoted by the same reference numerals, and detailed description thereof will be omitted or simplified. 11 and 12 are diagrams showing a superimposed image C3 according to embodiment 5. For convenience of explanation, FIGS. 11 and 12 correspond to FIG. The control unit 53 (pattern image control unit) according to the fifth embodiment has the following functions in addition to the functions explained in the first embodiment.

[0049] The control unit 53 (pattern image control unit) controls the operation of the image processing unit 52 (pattern image generation unit) to change the specific interval between the first images 200 in the pattern image C2. In the fifth embodiment, the control unit 53 (pattern image control unit) changes the specific interval based on the state of the surgical microscope 2. Specifically, for example, when the zoom magnification (the zoom magnification of the zoom lens 2214 or the zoom magnification in the enlargement process (electronic zoom) of the image processing unit 52) ​​is lower than a specific magnification threshold, or when the subject distance is longer than a specific distance threshold, the control unit 53 (pattern image control unit) sets the specific interval to a first interval D1 as shown in FIG. 11 . On the other hand, when the zoom magnification is higher than a specific magnification threshold, or when the subject distance is shorter than a specific distance threshold, the control unit 53 (pattern image control unit) sets the specific interval to a second interval D2 larger than the first interval D1 as shown in FIG. 12 . Here, the subject distance means the distance from the objective lens 2211 to the eye to be examined, and is estimated from the position (focus position) of the focus lens 2215 on the optical axis Ax, for example. According to the method for selecting some of the first images 210 described in the first embodiment above, even if the zoom magnification or subject distance changes, as shown in Figures 11 and 12, a first image 211 at a position that follows the change is selected from all of the first images 200.

[0050] According to the fifth embodiment described above, in addition to the same effects as those of the first embodiment, the following effects are achieved. The control device 5 according to the fifth embodiment changes the specific intervals between the first images 200 in the pattern image C2 based on the state of the surgical microscope 2. Therefore, even if the zoom magnification or subject distance changes, the surgeon can easily compare the amount of movement of the hand holding the surgical tool with the amount of movement of the surgical tool in the superimposed image C3 from the position of the first image 200 displayed on the display device 3.

[0051] (Embodiment 6) Next, a sixth embodiment will be described. In the following description, the same components as those in the first embodiment are denoted by the same reference numerals, and detailed description thereof will be omitted or simplified. 13 is a diagram showing a superimposed image C3 according to Embodiment 6. For convenience of explanation, FIG. 13 corresponds to FIG. The control unit 53 (pattern image control unit) according to the sixth embodiment has the following functions in addition to the functions explained in the first embodiment.

[0052] The control unit 53 (pattern image control unit) controls the operation of the image processing unit 52 (pattern image generation unit) to change a specific interval between the first images 200 in the pattern image C2. In the sixth embodiment, as shown in FIG. 13, the control unit 53 (pattern image control unit) makes the interval between the first images 200 located in a first region Ar2 (in the example of FIG. 13, the four corner regions) in the pattern image C2 different from the interval between the first images 200 located in a second region Ar3 other than the first region Ar2 in the pattern image C2. Specifically, the control unit 53 makes the interval between the first images 200 located in the first region Ar2 coarser and makes the interval between the first images 200 located in the second region Ar3 denser.

[0053] According to the sixth embodiment described above, in addition to the same effects as those of the first embodiment, the following effects are achieved. The control device 5 according to this embodiment 6 makes the spacing between the first images 200 located in the first area Ar2 in the pattern image C2 different from the spacing between the first images 200 located in the second area Ar3 in the pattern image C2. As a result, the first image 200 located in unnecessary areas (first area Ar2) such as the corner areas is difficult to see, and the pattern image C2 is such that the first image 200 is visible only in the necessary area (second area Ar3), making the superimposed image C3 displayed on the display device 3 an easy-to-see image.

[0054] (Embodiment 7) Next, a seventh embodiment will be described. In the following description, the same components as those in the first embodiment are denoted by the same reference numerals, and detailed description thereof will be omitted or simplified. 14 is a diagram showing a superimposed image C3 according to Embodiment 7. For convenience of explanation, FIG. 14 corresponds to FIG. In the seventh embodiment, as shown in FIG. 14, the pattern image C2 is different from that in the first embodiment described above. For ease of explanation, the pattern image C2 according to the seventh embodiment will be referred to as pattern image C2" below. Furthermore, the first image 200 according to the seventh embodiment will be referred to as first image 200". Furthermore, the first images 210 and 211 according to the seventh embodiment will be referred to as first images 210" and 211". Furthermore, the other first images 220 according to the seventh embodiment will be referred to as other first images 220".

[0055] The first image 200" has a square frame shape as shown in Fig. 14. The pattern image C2" is a mesh-like (grid-like) image in which a plurality of first images 200" are arranged in a specific pattern (in the example of Fig. 14, the first images 200" are arranged in a row and in contact with each other vertically and horizontally).

[0056] The control unit 53 (pattern image control unit) according to the seventh embodiment generates a pattern image C2'' that enables the first images 210'' and 211'' to be distinguished from the other first image 220'' by changing the appearance of a part (only two adjacent sides of the frame shape in the example of FIG. 14) of the first images 210'' and 211'' as a whole without changing the shape (frame shape) of each of all of the first images 200''. The method for changing the appearance is the same as the method described in the first embodiment above (the method of changing at least one of brightness, color, and transmittance with respect to the captured image C1). Note that in FIG. 14, for convenience of explanation, the changed parts are represented by thick black lines, and other parts are represented by thin black lines.

[0057] Even when the pattern image C2'' as in the seventh embodiment described above is employed, the same effects as those in the first embodiment described above can be achieved.

[0058] (Embodiment 8) Next, an eighth embodiment will be described. In the following description, the same components as those in the first embodiment are denoted by the same reference numerals, and detailed description thereof will be omitted or simplified. Fig. 15 is a diagram showing a display format of a superimposed image C3 according to embodiment 8. In Fig. 15, the captured image C1 is the same as the captured image C1 shown in Fig. 3, and the superimposed image C3 is the same as the superimposed image C3 shown in Fig. 6. The image processing unit 52 (display control unit) according to the above-described first embodiment uses the superimposed image C3 as an image for display, and causes the display device 3 to display only the superimposed image C3. In contrast, the image processing unit 52 (display control unit) according to the eighth embodiment uses the captured image C1 and the superimposed image C3 as images for display. Then, the image processing unit 52 (display control unit) generates a display video signal for displaying the display images (captured image C1 and superimposed image C3) on the display device 3, and outputs the video signal to the display device 3. In the eighth embodiment, the image processing unit 52 (display control unit) generates a display video signal for displaying the captured image C1 as a parent image and the superimposed image C3 as a child image in picture-in-picture (PinP) format, and outputs the video signal to the display device 3. As a result, the captured image C1 (parent image) and the superimposed image C3 (child image) are displayed on the display device 3 in picture-in-picture (PinP) format, as shown in FIG. 15 .

[0059] According to the eighth embodiment described above, in addition to the same effects as those of the first embodiment, the following effects are achieved. The control device 5 according to the eighth embodiment uses the captured image C1 and the superimposed image C3 as images to be displayed. Therefore, the surgeon can view the captured image C1 and the superimposed image C3 separately from the display device 3, which allows the surgery to be carried out more smoothly.

[0060] (Embodiment 9) Next, a ninth embodiment will be described. In the following description, the same components as those in the first embodiment are denoted by the same reference numerals, and detailed description thereof will be omitted or simplified. Fig. 16 is a diagram showing a display format of a superimposed image C3 according to embodiment 9. In Fig. 16, the captured image C1 is the same as the captured image C1 shown in Fig. 3, and the superimposed image C3 is the same as the superimposed image C3 shown in Fig. 6. The image processing unit 52 (display control unit) according to the above-described first embodiment uses the superimposed image C3 as an image for display, and causes the display device 3 to display only the superimposed image C3. In contrast, the image processing unit 52 (display control unit) according to the ninth embodiment uses the captured image C1 and the superimposed image C3 as images for display. Then, the image processing unit 52 (display control unit) generates a display video signal for displaying the display images (captured image C1 and superimposed image C3) on the display device 3, and outputs the video signal to the display device 3. In the ninth embodiment, the image processing unit 52 (display control unit) generates a display video signal for displaying the captured image C1 and the superimposed image C3 in picture-out-picture (PoP) format, and outputs the video signal to the display device 3. As a result, the captured image C1 and the superimposed image C3 are displayed side by side in picture-out-picture format on the display device 3, as shown in FIG. 16 .

[0061] Even when the display format as in the ninth embodiment described above is adopted, the same effects as those in the first and eighth embodiments described above can be achieved.

[0062] (Embodiment 10) Next, a tenth embodiment will be described. In the following description, the same components as those in the first embodiment are denoted by the same reference numerals, and detailed description thereof will be omitted or simplified. Fig. 17 is a diagram showing a first superimposed image C31 according to embodiment 10. Fig. 18 is a diagram showing a second superimposed image C32 according to embodiment 10. Fig. 19 is a diagram showing the display formats of the first and second superimposed images C31 and C32 according to embodiment 10. For ease of explanation, Figs. 17 and 18 correspond to Fig. 6. In Fig. 19, the first superimposed image C31 is the same as the first superimposed image C31 shown in Fig. 17, and the second superimposed image C32 is the same as the second superimposed image C32 shown in Fig. 18. The image processing unit 52 (display control unit) according to the above-described first embodiment uses the superimposed image C3 as an image for display, and causes the display device 3 to display only the superimposed image C3. In contrast to this, in the tenth embodiment, the display format of the image on the display device 3 by the control device 5 is different.

[0063] In the control device 5 according to the tenth embodiment, the image processing unit 52 (pattern image generating unit) generates two pattern images C2 under the control of the control unit 53 (pattern image control unit). For ease of explanation, one of the two pattern images C2 will be referred to as a first pattern image C21 (FIG. 17), and the other pattern image will be referred to as a second pattern image C22 (FIG. 18). The first pattern image C21 is the same as the pattern image C2 shown in FIG. 6. That is, as described in the first embodiment, the control unit 53 (pattern image control unit) finds the positional relationship between corresponding pixels in the preoperative image and the captured image C1 based on at least one of structural features of the eye 100 to be examined contained in the preoperative image and the captured image C1, such as the outline of the pupil 120, the outline of the cornea 110 (the outline of the iris), the pattern of the iris, and the shape of the blood vessels 130 in the sclera. The control unit 53 (pattern image control unit) also extracts a region in the captured image C1 that corresponds to a region designated on the preoperative image (a region that serves as a specific index) (i.e., extracts a region having a first feature from the captured image C1). Then, the control unit 53 (pattern image control unit) generates a first pattern image C21 (FIG. 17) in which a portion of the first image 211 is a first image 200 located at a position in the pattern image C2 that corresponds to the extracted region (e.g., within the extracted region). Then, the image processing unit 52 (superimposed image generation unit) generates a first superimposed image C31 (Figure 17) by superimposing the first pattern image C21 generated as described above and the captured image C1 (Figure 3) generated by the imaging unit 223 and acquired via the communication unit 51.

[0064] The second pattern image C22 is an image generated as shown below. That is, the control unit 53 (pattern image control unit) extracts a region having a second characteristic (e.g., a region where blood 150 or a stain or fluorescent agent used in surgery is present) from the captured image C1 using a known method such as image recognition using AI (Artificial Intelligence), as described in the above-mentioned third embodiment. Then, the control unit 53 (pattern image control unit) generates a second pattern image C22 (FIG. 18) in which a portion of the first image 212 is taken as the first image 200 located at a position in the pattern image C2 corresponding to the extracted region (e.g., a position surrounding the extracted region). Then, the image processing unit 52 (superimposed image generation unit) generates a second superimposed image C32 (Figure 18) by superimposing the second pattern image C22 generated as described above with the captured image C1 (Figure 3) generated by the imaging unit 223 and acquired via the communication unit 51.

[0065] After the above, the image processing unit 52 (display control unit) sets the first superimposed image C31 and the second superimposed image C32 as images for display. Then, the image processing unit 52 (display control unit) generates a video signal for displaying the images for display (first and second superimposed images C31 and C32) on the display device 3, and outputs the video signal to the display device 3. This embodiment 10 In this example, the image processing unit 52 (display control unit) generates a display video signal for displaying the second superimposed image C32 as a parent image and the first superimposed image C31 as a child image in picture-in-picture format, and outputs the video signal to the display device 3. As a result, the first superimposed image C31 (child image) and the second superimposed image C32 (parent image) are displayed in picture-in-picture format on the display device 3, as shown in FIG. 19. Note that the first superimposed image C31 may be the parent image and the second superimposed image C32 may be the child image. Alternatively, the first and second superimposed images C31 and C32 may be configured to be displayed in picture-out-picture format, as in the ninth embodiment.

[0066] According to the tenth embodiment described above, in addition to the same effects as those of the first embodiment, the following effects are achieved. The control device 5 according to the tenth embodiment uses the above-described first and second superimposed images C31 and C32 as images for display. Therefore, the surgeon can view the first and second superimposed images C31, C32 separately from the display device 3, which allows the surgeon to carry out surgery more smoothly.

[0067] (Other embodiments) Although the embodiments for carrying out the present disclosure have been described above, the present disclosure should not be limited to only the above-described first to tenth embodiments. FIG. 20 is a diagram showing a modification of the first to sixth and eighth to tenth embodiments. In the above-described first to sixth and eighth to tenth embodiments, the overall appearance of some of the first images 210 is changed without changing the shape (circular shape) of all of the first images 200, but this is not limiting. For example, as shown in (a) to (f) of FIG. 20, the overall appearance of some of the first images 210 may be changed. In (a) to (f) of FIG. 20, the parts whose appearance has been changed are represented in black. Note that the method for changing the appearance is the same as the method described in the above-described first embodiment (a method for changing at least one of brightness, color, and transmittance with respect to the captured image C1).

[0068] FIG. 21 is a diagram showing a modification of the first to tenth embodiments. In the first to tenth embodiments described above, the shape of the first image 200 is not limited to the shapes described in the first to tenth embodiments, and other shapes may be adopted. For example, the first image 200 may have a shape of "*" with three lines intersecting at the center, as shown in (a) to (k) of FIG. 21. Furthermore, when such a shape is adopted, the overall appearance of a portion of the first image 210 may be changed as shown in (a) of FIG. 21, or the appearance of a portion of the entire portion of the first image 210 may be changed as shown in (b) to (k) of FIG. 21. In (a) to (k) of FIG. 21, the portion whose appearance has been changed is represented in black, and the other portion is represented by dots. Note that the method of changing the appearance is the same as the method described in the first embodiment (a method of changing at least one of brightness, color, and transmittance with respect to the captured image C1). Furthermore, the shape of the first image 200 may be a circle, a rectangle, an asterisk (*), a triangle, another polygonal shape, a plus (+) shape, or the like.

[0069] In the above-described first to tenth embodiments, the pattern image C2 (C2', C21, C21) may be an image rotated by a specific angle (for example, 45 degrees).

[0070] In the above-described fifth embodiment, the control unit 53 (pattern image control unit) changes the specific interval between the first images 200 in the pattern image C2 based on the state of the surgical microscope 2, but this is not limiting. For example, the control unit 53 (pattern image control unit) may change the specific interval between the first images 200 in the pattern image C2 based on a specific feature of the subject's eye (subject) included in the captured image C1. Here, an example of the specific feature is the pupil 120. In other words, the control unit 53 (pattern image control unit) may control the specific interval to be 1 / n of the diameter of the pupil 120. With this configuration, even if the size of the eye to be examined displayed on the display device 3 changes, the surgeon can easily compare the amount of movement of the hand holding the surgical tool with the amount of movement of the surgical tool in the superimposed image C3 from the position of the first image 200 displayed on the display device 3. In other words, convenience can be further improved. In this case, the display range of the pattern image C2 may be configured to indicate the range in which the specific feature can be detected, allowing the surgeon to detect the specific feature by operating the surgical microscope 2 so that the specific feature is within the display range of the pattern image C2.

[0071] In the above-described first to tenth embodiments, when changing the appearance of a part of the first image 210, the change may be associated with the brightness or color of the captured image C1 at the pixel positions around the part of the first image 210. For example, the appearance of a portion of the first image 210 may be changed to a color opposite to the color of the captured image C1 at pixel positions around the portion of the first image 210. Also, for example, the appearance of a portion of the first image 210 may be changed so that the brightness of the captured image C1 at the pixel positions around the portion of the first image 210 is lowered by a specific percentage (for example, 20%).

[0072] In the above-described first to tenth embodiments, the size of the gap between the first images 200 in the pattern image C2 may be displayed on the display device 3. This size can be calculated, for example, from the shooting conditions (focus position, zoom magnification, subject distance, etc.).

[0073] In the above-described first to tenth embodiments, the medical observation system 1 may be configured as a system that displays images in 3D. That is, the display device 3 may be configured as an active or passive 3D display, and the microscope unit 22 may have a function as a stereo camera. In this case, the pattern image C2 (C2', C21, C21) may be displayed in 3D or 2D. When the pattern image C2 (C2', C21, C21) is to be displayed in 2D, the pattern image C2 (C2', C21, C21) is included in only one of the images for the left eye and the right eye, or the same pattern image C2 (C2', C21, C21) is included in both images. Furthermore, when the pattern image C2 (C2', C21, C21) is displayed in 3D, the interval between the first images 200 may be changed like a bird's-eye view if the observation direction through the surgical microscope 2 becomes oblique. In this case, a 3D space detection function (3D measurement, arm angle detection, position detection by an external sensor, etc.) may be used to create the pattern image C2 (C2', C21, C21).

[0074] In the above-described first to tenth embodiments, cataract surgery has been exemplified as an example of ophthalmic surgery, but the medical observation system 1 according to the present disclosure can of course also be applied to other surgeries and the like.

[0075] In the above-described first to tenth embodiments, a surgical microscope 2 having an eyepiece 222 has been exemplified as a medical observation device according to the present disclosure, but this is not limiting, and a surgical microscope dedicated to HUS (Heads Up Surgery) that does not have the eyepiece 222 may also be employed. In the above-described first to tenth embodiments, a variable-focus surgical microscope 2 having a focus lens 2215 has been exemplified as a medical observation device according to the present disclosure, but this is not limiting, and a fixed-focus surgical microscope may also be used. In particular, if the microscope unit 22 is movable in the Z direction, such a fixed-focus surgical microscope may also be used. In the above-described first to tenth embodiments, a surgical microscope 2 in which the microscope unit 22 can be moved in the X, Y, and Z directions has been exemplified as a medical observation device according to the present disclosure, but the present disclosure is not limited to this. For example, a surgical microscope that allows XY tilt, in which the microscope unit 22 is rotated around an axis along the X direction and rotated around an axis along the Y direction, may also be used as a medical observation device according to the present disclosure.

[0076] The following configurations also fall within the technical scope of the present disclosure. (1) A medical image processing device comprising: an image acquisition unit that acquires image information obtained by imaging using a medical observation device; and a superimposed image generation unit that generates a superimposed image by superimposing a pattern image in which a first image of a specific shape is arranged in a specific pattern on an image captured based on the image information. (2) The medical image processing device described in (1) further comprises a pattern image generation unit that generates the pattern image, and a pattern image control unit that controls the operation of the pattern image generation unit and generates the pattern image in such a way that some of the first images among all of the first images in the pattern image can be distinguished from other first images. (3) The pattern image control unit generates the pattern image that makes it possible to distinguish between the partial first image and the other first image by changing the overall appearance of the partial first image without changing the respective shapes of the partial first image and the other first image. (4) The pattern image control unit generates the pattern image that makes it possible to distinguish between the partial first image and the other first image by changing the appearance of a part of the partial first image as a whole without changing the respective shapes of the partial first image and the other first image. (5) A medical image processing device described in any one of (2) to (4), wherein the pattern image control unit generates the pattern image that makes it possible to distinguish the part of the first images from the other first images by changing at least one of the brightness, color, and transmittance of the part of the first images relative to the captured image. (6) The pattern image control unit extracts an area having a specific feature from the captured image, and sets the first image located at a position corresponding to the area in the pattern image as the first image of the part, in the medical image processing device described in any one of (2) to (5). (7) The medical image processing device described in any one of (2) to (6), wherein the pattern image control unit selects the first image located at a position corresponding to a predetermined area of ​​the pattern image as the first image of the portion. (8) The medical image processing device described in (7) above, wherein the pattern image control unit generates the pattern image that makes it possible to distinguish between the partial first image and the other first images by making the overall appearance of the partial first image less visible compared to the other first images without changing the respective shapes of the partial first image and the other first images. (9) The pattern image is a medical image processing device described in any one of (1) to (8), in which a plurality of the first images are arranged in a regular array at specific intervals, and the medical image processing device further comprises a pattern image generation unit that generates the pattern image, and a pattern image control unit that controls the operation of the pattern image generation unit and changes the specific intervals between the first images in the pattern image. (10) The medical image processing device according to (9), wherein the pattern image control unit changes the specific interval between the first images in the pattern image based on a state of the medical observation device. (11) The medical image processing device described in (9) above, wherein the pattern image control unit makes the spacing between the first images located in a first region of the pattern image different from the spacing between the first images located in a second region of the pattern image that is different from the first region. (12) The medical image processing device described in (9), wherein the pattern image control unit changes the specific spacing between the first images in the pattern image based on a specific feature of the subject included in the captured image. (13) A medical image processing device described in any one of (1) to (12), further comprising a display control unit that outputs a video signal corresponding to an image for display to a display device that displays an image, wherein the display control unit outputs the video signal corresponding to the image for display, which includes the captured image and the superimposed image, to the display device. (14) The image capturing device further includes a display control unit that outputs a video signal corresponding to an image to be displayed on a display device that displays an image, a pattern image generation unit that generates a first pattern image that is the pattern image and a second pattern image that is the pattern image, and a pattern image control unit that controls the operation of the pattern image generation unit, wherein the pattern image control unit extracts a first range having a specific first feature from the captured image, generates the first pattern image that makes the first image located at a position corresponding to the first range in the first pattern image distinguishable from other first images, and generates the first pattern image that makes the first image located at a position corresponding to the first range distinguishable from other first images. and generates the second pattern image that makes the first image located at a position in the second pattern image that corresponds to the second range distinguishable from other first images, the superimposed image generation unit generates a first superimposed image that is the superimposed image obtained by superimposing the first pattern image and the captured image, and generates a second superimposed image that is the superimposed image obtained by superimposing the second pattern image and the captured image, and the display control unit outputs the video signal corresponding to the image for display that includes the first superimposed image and the second superimposed image to the display device. (15) The medical image processing device according to any one of (1) to (14), wherein the first image is composed of at least two types of images: a second image and a third image different from the second image. (16) The medical image processing device according to any one of (1) to (15), wherein the first image is a dot image. (17) A medical image processing device according to any one of (1) to (15), wherein the first image has a frame shape and the pattern image is a mesh-like image in which the first images are arranged in a specific pattern. (18) A medical observation system comprising: a medical observation device that images a subject; and a medical image processing device that processes image information obtained by imaging with the medical observation device, wherein the medical image processing device comprises an image acquisition unit that acquires the image information; and a superimposed image generation unit that generates a superimposed image by superimposing a pattern image in which first images of a specific shape are arranged in a specific pattern on an imaged image based on the image information. [Explanation of symbols]

[0077] 1 Medical observation system 2. Surgical microscope 3 Display device 4 Input Devices 5. Control device 21 Light source device 22 Microscope Section 23 Base 24 Support part 25 Drive unit 51 Communications Department 52 Image processing section 53 Control Unit 54 Memory section 100 Examined eye 110 Cornea 120 Pupil 130 Blood vessels 140 eyelashes 150 blood 200,200´´ 1st image 201 Second Image 202 Third Image 210~213,210´´,211´´ Part 1 image 220,220´´ Other first image 221 Observation Optical System 222 eyepiece 223 Imaging unit 231 Caster 241 XY stage 242 XY moving part 243 Z moving part 251 XY drive unit 252 Z drive unit 253 Lens drive unit 2211 Objective Lens 2212 Lens unit 2213 Half Mirror 2214 Zoom Lens 2215 Focus Lens Ar1 area Ar2 First Region Ar3 Second Region Ax optical axis BD Patient Bed C1 Captured image C2,C2´,C2´´ pattern image C21 First pattern image C22 Second pattern image C3 Superimposed image C31 First superimposed image C32 Second superimposed image D1 First interval D2 Second interval

Claims

1. an image acquisition unit that acquires image information obtained by imaging using a medical observation device; a superimposed image generating unit that generates a superimposed image by superimposing a pattern image in which first images having a specific shape are arranged in a specific pattern and a captured image based on the image information; a pattern image generating unit for generating the pattern image; a pattern image control unit that controls an operation of the pattern image generation unit and generates the pattern image in which some of the first images among all the first images in the pattern image can be distinguished from other first images, The pattern image control unit A medical image processing apparatus that sets the first image located at a position corresponding to a predetermined region of the pattern image as the part of the first image.

2. The pattern image control unit The medical image processing device according to claim 1, wherein the pattern image is generated by changing at least one of the brightness, color, and transmittance of the portion of the first image relative to the captured image, thereby making it possible to distinguish the portion of the first image from the other first images.

3. The pattern image control unit 3. The medical image processing device according to claim 1, wherein an area having a specific characteristic is extracted from the captured image, and the first image located at a position in the pattern image corresponding to the area is set as the first image of the part.

4. The pattern image is A plurality of the first images are regularly arranged at specific intervals, The pattern image control unit 4. The medical image processing apparatus according to claim 1, further comprising: controlling an operation of said pattern image generating section to change said specific interval between said first images in said pattern image.

5. The pattern image control unit The medical image processing apparatus according to claim 4 , wherein the specific interval between the first images in the pattern image is changed based on a state of a medical observation apparatus.

6. The pattern image control unit The medical image processing device according to claim 4 , wherein the interval between the first images located in a first region of the pattern image is different from the interval between the first images located in a second region of the pattern image that is different from the first region.

7. The pattern image control unit The medical image processing apparatus according to claim 4 , wherein the specific interval between the first images in the pattern image is changed based on a specific feature portion of a subject included in the captured image.

8. a display control unit that outputs a video signal corresponding to the image to be displayed to a display device that displays the image; The display control unit is 8. The medical image processing apparatus according to claim 1, further comprising: a display unit configured to display a display image including the captured image and the superimposed image, the display unit being configured to display the image based on the captured image and the superimposed image.

9. a display control unit that outputs a video signal corresponding to an image to be displayed to a display device that displays an image; a pattern image generating unit that generates a first pattern image that is the pattern image and a second pattern image that is the pattern image; A pattern image control unit that controls an operation of the pattern image generation unit, The pattern image control unit extracting a first range having a specific first feature from the captured image, and generating a first pattern image that allows the first image located at a position in the first pattern image corresponding to the first range to be distinguished from other first images; and extracting a second range having a specific second feature from the captured image, and generating a second pattern image that allows the first image located at a position in the second pattern image corresponding to the second range to be distinguished from other first images; The superimposed image generating unit generating a first superimposed image obtained by superimposing the first pattern image and the captured image, and generating a second superimposed image obtained by superimposing the second pattern image and the captured image; The display control unit is 8. The medical image processing apparatus according to claim 1, further comprising: a display unit configured to display a display image including the first superimposed image and the second superimposed image, the display unit being configured to display the image based on the first superimposed image and the second superimposed image.

10. The first image is 10. The medical image processing apparatus according to claim 1, wherein the image is composed of at least two types of images: a second image and a third image different from the second image.

11. The first image is 11. The medical image processing device according to claim 1, wherein the image is a dot.

12. The first image is It has a frame shape, The pattern image is 11. The medical image processing apparatus according to claim 1, wherein the first image is a mesh-like image in which images are arranged in a specific pattern.

13. An image acquisition unit that acquires image information obtained by imaging using a medical observation device; a superimposed image generating unit that generates a superimposed image by superimposing a pattern image in which first images having a specific shape are arranged regularly at specific intervals in a specific pattern and a captured image based on the image information; a pattern image generating unit for generating the pattern image; a pattern image control unit that controls an operation of the pattern image generation unit and changes the specific interval between the first images in the pattern image, The pattern image control unit A medical image processing apparatus that varies the specific interval between the first images in the pattern image based on a state of a medical observation apparatus.

14. A medical observation device that images a subject; a medical image processing device for processing image information obtained by imaging using the medical observation device, The medical image processing device includes: an image acquisition unit for acquiring the image information; a superimposed image generating unit that generates a superimposed image by superimposing a pattern image in which first images having a specific shape are arranged in a specific pattern and a captured image based on the image information; a pattern image generating unit for generating the pattern image; a pattern image control unit that controls an operation of the pattern image generation unit and generates the pattern image in which some of the first images among all the first images in the pattern image can be distinguished from other first images, The pattern image control unit the first image located at a position corresponding to a predetermined region of the pattern image is set as the first image of the portion.

15. A medical observation device for imaging a subject; a medical image processing device for processing image information obtained by imaging using the medical observation device, The medical image processing device includes: an image acquisition unit for acquiring the image information; a superimposed image generating unit that generates a superimposed image by superimposing a pattern image in which first images having a specific shape are arranged regularly at specific intervals in a specific pattern and a captured image based on the image information; a pattern image generating unit for generating the pattern image; a pattern image control unit that controls an operation of the pattern image generation unit and changes the specific interval between the first images in the pattern image; The pattern image control unit A medical observation system that varies the specific interval between the first images in the pattern image based on a state of a medical observation device.

Images