Medical control device and medical observation system

Abstract

To improve the convenience.SOLUTION: A control device 5 for medical treatment comprises: a determination unit 53 which determines whether or not a specific surgical tool is included in a photographed image based on an image signal generated by an imaging device 22 that images a subject eye; an image generation unit 52 which generates an image for display on the basis of the image signal; and a state control unit 53 which controls the operation of the image generation unit 52 or the imaging visual field by the imaging device 22 so as to maintain the state of the subject eye in the image for display when the determination unit 53 determines that the specific surgical tool is not included in the photographed image.SELECTED DRAWING: Figure 2

Description

[Technical field]

[0001] The present disclosure relates to a medical control device and a medical observation system. [Background technology]

[0002] 2. Description of the Related Art Conventionally, medical observation systems used in eye surgeries such as cataract surgeries are known (see, for example, Patent Document 1). In the medical observation system described in Patent Document 1, an image of a subject's eye is captured by an imaging device and the captured image is displayed on a display device. A doctor performs surgery while checking the captured image displayed on the display device. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] International Publication No. 2017 / 065018 Summary of the Invention [Problem to be solved by the invention]

[0004] By the way, possible situations in which the center position of the test eye moves within the screen of the display device include, for example, the first case in which pressure is applied to the test eye by a specific procedure by a doctor, and the second case in which the patient changes their posture or moves their line of sight. Here, in the above-mentioned first case, when the specific procedure is completed, the pressure applied to the subject's eye is removed and the center position of the subject's eye on the screen returns to its original position. Therefore, in the above-mentioned first case, the doctor does not need to change the center position of the subject's eye on the screen by operating the medical observation system to change the imaging field of view. On the other hand, in the above-mentioned second case, the doctor needs to carry out the cumbersome work of changing the center position of the subject's eye on the screen to an appropriate position by operating the medical observation system to change the imaging field of view. Therefore, there is a demand for a technique that can eliminate the above-mentioned troublesome operations and improve convenience.

[0005] The present disclosure has been made in consideration of the above, and has an object to provide a medical control device and a medical observation system that can improve convenience. [Means for solving the problem]

[0006] In order to solve the above-mentioned problems and achieve the objective, the medical control device of the present disclosure includes a judgment unit that judges whether or not a specific surgical tool is included in an captured image based on an image signal generated by an imaging device that images a test eye, an image generation unit that generates an image for display based on the image signal, and a state control unit that controls the operation of the image generation unit or the imaging field of view of the imaging device so as to maintain the state of the test eye in the image for display when the judgment unit judges that the specific surgical tool is not included in the captured image.

[0007] In addition, the medical observation system according to the present disclosure includes an imaging device that images a test eye, and a medical control device that processes an image signal generated by the imaging device, and the medical control device includes a determination unit that determines whether a specific surgical tool is included in an image based on the image signal, an image generation unit that generates an image for display based on the image signal, and a state control unit that controls the operation of the image generation unit or the imaging field of view of the imaging device so as to maintain the state of the test eye in the image for display when the determination unit determines that the specific surgical tool is not included in the image for display. Effect of the Invention

[0008] According to the medical control device and medical observation system according to the present disclosure, convenience can be improved. [Brief description of the drawings]

[0009] [Figure 1] FIG. 1 is a diagram illustrating the configuration of a medical observation system according to an embodiment. [Diagram 2] FIG. 2 is a diagram illustrating the configuration of a medical observation system according to an embodiment. [Figure 3A] FIG. 3A is a diagram illustrating surgical tools used in cataract surgery. [Figure 3B] FIG. 3B is a diagram illustrating surgical tools used in cataract surgery. [Figure 3C] FIG. 3C is a diagram illustrating surgical tools used in cataract surgery. [Figure 3D] FIG. 3D is a diagram illustrating surgical tools used in cataract surgery. [Figure 3E] FIG. 3E is a diagram illustrating surgical tools used in cataract surgery. [Figure 4] FIG. 4 is a flowchart showing the operation of the control device. [Diagram 5] FIG. 5 is a diagram for explaining a change in the imaging field of view when a specific surgical tool is included in a captured image. [Figure 6] FIG. 6 is a diagram for explaining a change in the imaging field of view when a specific surgical tool is not included in a captured image. [Figure 7] FIG. 7 is a diagram illustrating step S4. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0010] Hereinafter, a mode for carrying out the present disclosure (hereinafter, referred to as an embodiment) will be described with reference to the drawings. Note that the present disclosure is not limited to the embodiment described below. Furthermore, in the description of the drawings, the same parts are given the same reference numerals.

[0011] [Overview of medical observation system] 1 and 2 are diagrams for explaining the configuration of a medical observation system 1 according to an embodiment. Specifically, Fig. 1 is a diagram showing the external configuration of the medical observation system 1. Fig. 2 is a block diagram showing the configuration of the medical observation system 1. The medical observation system 1 is a system used for surgery on the eye of a patient (hereinafter referred to as the subject's eye) lying on a patient bed BD (Fig. 1). As shown in Fig. 1 or 2, this medical observation system 1 includes a surgical microscope 2, a display device 3, an input device 4, and a control device 5.

[0012] The surgical microscope 2 captures an image of the examinee's eye under the control of the control device 5. As shown in Fig. 1 or 2, the surgical microscope 2 includes a light source device 21 (Fig. 2), a microscope unit 22, a base unit 23 (Fig. 1), a support unit 24 (Fig. 1), and a drive unit 25 (Fig. 2). The light source device 21, under the control of the control device 5, supplies illumination light that illuminates the subject's eye. The microscope unit 22 corresponds to an imaging device according to the present disclosure. As shown in Fig. 1 or 2, the microscope unit 22 includes an observation optical system 221 (Fig. 2), an eyepiece 222, and an imaging unit 223 (Fig. 2).

[0013] The observation optical system 221 includes an objective lens 2211 (FIGS. 1 and 2), a lens unit 2212 (FIG. 2), and a half mirror 2213 (FIG. 2), and guides light reflected from the subject's eye to the eyepiece 222 and the imaging unit 223, respectively. That is, the light reflected from the subject's eye is incident on the half mirror 2213 via the objective lens 2211 and the lens unit 2212. Approximately half of the light incident on the half mirror 2213 passes through the half mirror 2213 and is incident on the eyepiece 222. On the other hand, the remaining light incident on the half mirror 2213 is reflected by the half mirror 2213 and is incident on the imaging unit 223.

[0014] Here, the lens unit 2212 includes a zoom lens 2214 (FIG. 2). The zoom lens 2214 is configured using one or more lenses, and adjusts the angle of view by moving along an optical axis Ax (FIG. 2). The optical axis Ax is an axis extending in the vertical direction in FIG. 1. That is, the optical axis Ax is an axis directed from the microscope unit 22 toward the subject's eye, and corresponds to the observation optical axis according to the present disclosure. In addition, the lens unit 2212 is provided with an optical zoom mechanism (not shown) that moves the zoom lens 2214 along the optical axis Ax.

[0015] The eyepiece 222 collects the light incident from the observation optical system 221 to form an optical image of the subject's eye. This allows an operator looking through the eyepiece 222 to observe the optical image of the subject's eye. The imaging unit 223 includes an imaging element such as a CCD (Charge Coupled Device) or a CMOS (Complementary Metal Oxide Semiconductor) that receives light incident from the observation optical system 221 and converts it into an electric signal. The imaging unit 223 captures an image under the control of the control device 5 to generate an image signal including the subject's eye.

[0016] The base portion 23 is a base for the surgical microscope 2, and is configured to be movable on the floor surface via casters 231 (FIG. 1). The support unit 24 extends from the base unit 23, and supports the microscope unit 22 at its tip (the end portion separated from the base unit 23). The support unit 24 includes an XY stage 241, an XY moving unit 242, and a Z moving unit 243, as shown in FIG.

[0017] The XY stage 241 supports the XY moving part 242 so as to be movable along the X direction and the Y direction, respectively. Here, the X direction and the Y direction are directions along a plane perpendicular to the optical axis Ax, and are perpendicular to each other. The XY moving section 242 is a section that allows movement along the X and Y directions relative to the XY stage 241. Furthermore, the XY moving section 242 supports the Z moving section 243 so that it can move along the Z axis. Here, the Z direction is the direction along the optical axis Ax (the up and down direction in FIG. 1) and is perpendicular to the X and Y directions. The Z movement section 243 is a section that is movable along the Z direction relative to the XY movement section 242. The Z movement section 243 supports the microscope section 22. That is, the microscope unit 22 can be moved in the X direction and the Y direction by operating the XY moving unit 242. Also, the microscope unit 22 can be moved in the Z direction by operating the Z moving unit 243.

[0018] As shown in FIG. 2, the driving section 25 includes an XY driving section 251, a Z driving section 252, and a lens driving section 253. The XY drive unit 251 is an actuator such as a motor, and under the control of the control device 5, operates the XY movement unit 242 to move the microscope unit 22 in the X and Y directions. The Z drive unit 252 is an actuator such as a motor, and under the control of the control device 5, operates the Z movement unit 243 to move the microscope unit 22 in the Z direction. The lens driving unit 253 is an actuator such as a motor, and under the control of the control device 5, operates the optical zoom mechanism (not shown) described above to adjust the angle of view.

[0019] The display device 3 is configured with a display using liquid crystal or organic EL (Electro Luminescence) or the like, and displays an image based on a video signal from the control device 5 under the control of the control device 5. The input device 4 is configured using operation devices such as a mouse, a keyboard, and a touch panel, and receives user operations by a user such as a surgeon. The input device 4 then outputs an operation signal to the control device 5 in response to the user operation.

[0020] The control device 5 corresponds to a medical control device according to the present disclosure. The control device 5 comprehensively controls the operations of the surgical microscope 2 and the display device 3. As shown in FIG. 2, the control device 5 includes a communication unit 51, an image processing unit 52, a control unit 53, and a storage unit 54.

[0021] The communication unit 51 is an interface for communicating with the surgical microscope 2 , and receives image signals generated by the imaging unit 223 and transmits control signals from the control unit 53 . The image processing unit 52 corresponds to an image generating unit according to the present disclosure. The image processing unit 52 performs image processing on the image signal received by the communication unit 51, generates a display video signal for displaying an image for display corresponding to a captured image based on the image signal on the display device 3, and outputs the video signal to the display device 3. Examples of the image processing include digital gain processing, which multiplies the image signal (digital signal) received by the communication unit 51 by a digital gain that amplifies the digital signal, optical black subtraction processing, white balance (WB) adjustment processing, demosaic processing, color matrix calculation processing, gamma correction processing, YC conversion processing, which generates a luminance signal and a color difference signal (Y, Cb / Cr signal), and enlargement processing (electronic zoom).

[0022] The control unit 53 is composed of, for example, a CPU (Central Processing Unit) or an FPGA (Field-Programmable Gate Array), and controls the operation of the surgical microscope 2 and the display device 3, as well as the operation of the entire control device 5. The control unit 53 has functions as a determination unit and a state control unit according to the present disclosure. The functions of the determination unit and the state control unit will be described in "Operation of the Control Device" below. The control unit 53 may also be configured as, for example, an IP converter having an image processing function. In this case, the control unit 53 functions as an IP converter on the image source side that performs IP conversion on the image output from the surgical microscope 2 (image source) and transmits it onto the network. The display device 3 is provided with an IP converter on the image output side, which converts the image transmitted via the network into a format specific to the display device 3 and outputs it. The IP converter on the image source side functions as an encoder, and the IP converter on the image output side functions as a decoder. The storage unit 54 stores the programs executed by the control unit 53, information necessary for the processing of the control unit 53, and the like.

[0023] [About cataract surgery] Before describing the operation of the control device 5, a brief description of cataract surgery will be given. Figures 3A to 3E are diagrams for explaining surgical tools used in cataract surgery. In Figures 3A to 3E, reference numeral "100" indicates the subject's eye. Reference numeral "110" indicates the cornea. Reference numeral "120" indicates the pupil. In cataract surgery, the surgeon performs the steps of creating a port, incising the anterior capsule, hydrodissection, processing the lens nucleus, and inserting an intraocular lens in that order. In the port creating step, a knife T1 shown in Fig. 3A is used. The knife T1 corresponds to a first surgical tool according to the present disclosure. In the port creating step, the surgeon incises the cornea 110 of the subject's eye 100 (Fig. 3A) with the knife T1 to create a port (wound).

[0024] The anterior capsule incision step is a step called CCC (Continuous Curvilinear Capsulorrhexis). In this anterior capsule incision step, a sharp-tipped pin T2 shown in FIG. 3B is used. The pin T2 corresponds to a second surgical tool according to the present disclosure. In the anterior capsule incision step, the surgeon inserts the pin T2 through the port created in the port creation step, and makes a circular incision in the anterior portion of the crystalline lens, i.e., the anterior capsule portion.

[0025] In the hydrodissection step, a cannula T3 shown in Fig. 3C is used. The cannula T3 corresponds to a third surgical tool according to the present disclosure. In the hydrodissection step, the surgeon inserts the tip of the cannula T3 between the lens capsule (the skin that encases the lens) and the lens cortex through the port created in the port creation step, and flows an irrigation fluid. This separates the lens capsule from the lens cortex.

[0026] In the lens nucleus processing step, an aspiration tube T4 shown in Fig. 3D is used. The aspiration tube T4 corresponds to a fourth surgical tool according to the present disclosure. In the lens nucleus processing step, the surgeon inserts the aspiration tube T4 through the port created in the port creation step. In addition, the surgeon performs emulsification (crushing) and aspirating of the lens nucleus by ultrasonic vibration, which is called nucleus processing, through the aspiration tube T4, and also aspirates the cortex.

[0027] In the intraocular lens insertion step, a cartridge T5 shown in Fig. 3E is used. The cartridge T5 corresponds to a fifth surgical tool according to the present disclosure. In the intraocular lens insertion step, first, the surgeon places an intraocular lens in the cartridge T5. The surgeon also inserts the cartridge T5 through the port created in the port creation step, and pushes out and inserts the intraocular lens from the cartridge T5 into the subject's eye.

[0028] [Control device operation] Next, a description will be given of the operation of the above-mentioned control device 5. The following mainly describes the function of the control unit 53 as a determination unit in the above-mentioned cataract surgery and the function of the control unit 53 as a state control unit. Fig. 4 is a flowchart showing the operation of the control device 5. Figs. 5 to 7 are diagrams for explaining the operation of the control device 5. First, the communication unit 51 acquires an image signal generated by the imaging unit 223 (step S1). Then, the image processing unit 52 executes image processing on the image signal.

[0029] After step S1, the control unit 53 (determination unit) executes a surgical tool detection process to detect the use state of a specific surgical tool T0 (see FIG. 5) among the knife T1, the suction tube T2, the cannula T3, the suction tube T4, and the cartridge T5 (step S2). Note that surgical tools other than those exemplified can also be detected in the surgical tool detection process by registering or learning before surgery. In this embodiment, in step S2, the control unit 53 (determination unit) determines whether or not a specific surgical tool T0 is included in the captured image based on the image signal after image processing by the image processing unit 52, using a known method such as pattern matching or image recognition using AI (Artificial Intelligence). The specific surgical tool T0 is at least one of the knife T1, the suction tube T2, the cannula T3, the suction tube T4, and the cartridge T5, and is set, for example, by a user operation (setting input) to the input device 4 by the user. The setting input may be, for example, selection of one of the above-mentioned steps of the port creation step, the anterior capsule incision step, the hydrodissection step, the lens nucleus processing step, and the intraocular lens insertion step (mode selection), and at least one of the surgical tools corresponding to the step is set as the specific surgical tool T0 by selecting one of the steps.

[0030] Then, when step S2 is executed and it is determined that the specific surgical tool T0 is included in the captured image (step S3: Yes), the control device 5 returns to step S1. Fig. 5 is a diagram for explaining a change in the imaging field of view when a specific surgical tool T0 is included in the captured image C1. Note that Fig. 5 shows a state in which the image processing unit 52 has not performed enlargement processing (zoom magnification is 1x) and the entire image area of ​​the captured image C1 after image processing by the image processing unit 52 is displayed on the screen of the display device 3 as an image for display.

[0031] For example, as shown in Fig. 5, when a specific surgical tool T0 is included in the captured image C1, the control unit 53 does not execute steps S4 and S5 described below. That is, even if the center position P2 of the subject's eye 100 moves from a specific position P1 in the captured image C1 (Fig. 5(b)), the imaging field of view does not change, and the center position P2 remains displaced from the specific position P1 (Fig. 5(c)). Note that, although the specific position P1 is the center position of the captured image C1 (the center of the screen of the display device 3) in Fig. 5, it is not limited to this, and may be another position. The same applies to Figs. 6 and 7.

[0032] On the other hand, when step S2 is executed and it is determined that the specific surgical tool T0 is not included in the captured image (step S3: No), the control unit 53 executes steps S4 and S5 in this order. Fig. 6 is a diagram for explaining a change in the imaging field of view when a specific surgical tool T0 is not included in the captured image C1. Fig. 6 illustrates a case in which all surgical tools, namely, the knife T1, the suction tube T2, the cannula T3, the suction tube T4, and the cartridge T5, are not included in the captured image C1. Fig. 6 also illustrates a state in which, like Fig. 5, the image processing unit 52 has not performed the enlargement process (zoom magnification is 1x), and the entire image area of ​​the captured image C1 after image processing by the image processing unit 52 is displayed on the screen of the display device 3 as an image for display.

[0033] For example, as shown in FIG. 6, when the captured image C1 does not include a specific surgical tool T0, the control unit 53 (state control unit) executes step S4. Fig. 7 is a diagram for explaining step S4. Specifically, Fig. 7 is a diagram corresponding to Fig. 6(b). Specifically, in step S4, the control unit 53 (state control unit) extracts at least one feature point from structural features of the subject's eye 100 included in the captured image C1. For example, the control unit 53 (state control unit) extracts at least one feature point based on at least one of the outline of the pupil 120, the outline of the iris (the outline of the cornea 110), the pattern of the iris, and the shape of blood vessels in the sclera in the subject's eye 100. Then, the control unit 53 (state control unit) recognizes the center position P2 of the subject's eye 100 based on the at least one feature point. In addition, the control unit 53 (state control unit) calculates the amount and direction of movement of the microscope unit 22 in the X and Y directions required to position the center position P2 at the specific position P1 based on the positional relationship (shift amount D1 (FIG. 7) and shift direction D2 (FIG. 7)) between the specific position P1 in the captured image C1 and the center position P2 of the subject's eye 100.

[0034] After step S4, the control unit 53 (state control unit) executes step S5. Specifically, in step S5, the control unit 53 (state control unit) operates the XY movement unit 242 via the XY drive unit 251 to move the microscope unit 22 by the movement amount and in the movement direction calculated in step S4. As a result, when the center position P2 of the test eye 100 moves from a specific position P1 in the captured image C1 (Figure 6(b)), the imaging field of view changes so as to maintain the center position P2 located at the specific position P1 (Figure 6(c)).

[0035] According to the present embodiment described above, the following effects are achieved. The control device 5 according to the present embodiment controls the imaging field of view to maintain the state of the subject's eye 100 in the captured image C1 (image for display) only when it is determined that the captured image C1 does not include the specific surgical tool T0. More specifically, only in this case, the control device 5 controls the imaging field of view by moving the microscope unit 22 in the X direction and the Y direction, thereby maintaining the state in which the center position P2 of the subject's eye 100 is located at the specific position P1 in the captured image C1. Therefore, for example, when the specific surgical tool T0 is a knife T1, the pressure applied from the knife T1 to the subject's eye 100 disappears once the creation of the port is completed, and the center position P2 of the subject's eye 100 in the captured image C1 returns to its original position, even if the control of the imaging field described above is not executed. On the other hand, when the patient changes his / her posture or moves his / her line of sight, the control of the imaging field described above is automatically executed, so that the surgeon does not need to carry out the troublesome task of changing the imaging field by operating the medical observation system 1 (XY movement unit 242). Therefore, according to the control device 5 of this embodiment, the above-described control of the imaging field of view is executed only when necessary, and convenience can be effectively improved.

[0036] Furthermore, the control device 5 according to the present embodiment recognizes the center position of the subject's eye 100 based on at least one of the outline of the pupil 120, the outline of the cornea 110 (outline of the iris), the pattern of the iris, and the shape of blood vessels in the sclera, which are included in the captured image C1. This allows the control of the imaging field of view described above to be executed with high accuracy.

[0037] Moreover, the control device 5 according to the present embodiment executes the above-mentioned control of the imaging field of view based on the positional relationship between a specific position P1 (the center position of the image for display) in the captured image C1 and a center position P2 of the subject's eye 100. Therefore, the above-mentioned control of the imaging field of view can be executed with high accuracy by utilizing a simple calculation.

[0038] (Other embodiments) Although the embodiments for carrying out the present disclosure have been described above, the present disclosure should not be limited to only the above-described embodiments. In the above-described embodiment, the control unit 53 maintained a state in which the center position P2 of the test eye 100 was located at a specific position in the image for display (specific position P1 in the captured image C1) by controlling the imaging field of view, but this is not limited to this. For example, the control unit 53 may control the operation of the image processing unit 52 to maintain the state in which the center position P2 of the subject's eye 100 is located at a specific position in the image for display. Specifically, the enlargement process (electronic zoom) executed by the image processing unit 52 is a process of cutting out a part of a rectangular area (a rectangular area corresponding to a specified zoom magnification) of the entire image area in the captured image C1 from the captured image C1 and enlarging the image of the rectangular area at the zoom magnification. The control unit 53 then controls the operation of the image processing unit 52 to change the cutting position of the part of the area, thereby maintaining the state in which the center position P2 of the subject's eye 100 is located at a specific position in the image for display. Note that, even in this case, the method of recognizing the center position P2 of the subject's eye 100 can adopt the method described in the above-mentioned first embodiment (the method using the outline of the pupil 120, etc.). Also, the control unit 53 changes the cutting position of the part of the area based on the positional relationship (the amount of deviation D1 and the direction of deviation D2) between the center position of the image for display and the center position P2 of the subject's eye 100, as in the above-mentioned first embodiment.

[0039] Also, for example, the control unit 53 may control the imaging field of view to maintain the state in which the size of the test eye 100 in the display image is a specific size. Specifically, the control unit 53 operates the Z movement unit 243 via the Z drive unit 252, or moves the zoom lens 2214 along the optical axis Ax via the lens drive unit 253 to maintain the state in which the size of the test eye 100 in the display image is a specific size. Also, the control unit 53 may control the operation of the image processing unit 52 to maintain the state in which the size of the test eye 100 in the display image is a specific size. For example, in the enlargement process (electronic zoom) performed by the image processing unit 52, the zoom magnification (magnification ratio) is changed to maintain the state in which the size of the test eye 100 in the display image is a specific size. Thereby, for example, even in a situation in which the size of the test eye 100 in the display image changes due to a change in the patient's posture, the size can be always constant. Therefore, the surgeon can smoothly perform cataract surgery, etc. while checking the display image. Furthermore, for example, if the surgical microscope 2 is configured to be able to tilt the optical axis Ax, the central position P2 of the test eye 100 can be maintained at a specific position within the display image by tilting the optical axis Ax (controlling the imaging field of view).

[0040] In the above-described embodiment, cataract surgery has been exemplified, but the medical observation system 1 according to the present disclosure can of course also be applied to other eye surgeries, such as vitreoretinal surgery.

[0041] Note that the following configurations also fall within the technical scope of the present disclosure. (1) A medical control device comprising: a judgment unit that judges whether or not a specific surgical tool is included in an image captured based on an image signal generated by an imaging device that captures an image of a test eye; an image generation unit that generates an image for display based on the image signal; and a state control unit that controls the operation of the image generation unit or the imaging field of view of the imaging device so as to maintain the state of the test eye in the image for display when the judgment unit judges that the specific surgical tool is not included in the captured image. (2) The medical control device according to (1), wherein the state control unit maintains a state in which the center position of the test eye is located at a specific position within the image for display by controlling the imaging field of view. (3) The medical control device according to (2), wherein the state control unit recognizes a center position of the test eye based on structural features of the test eye included in the captured image. (4) The medical control device according to (3), wherein the structural features of the test eye are at least one of the pupil contour, the iris contour, the iris pattern, and the sclera blood vessel shape of the test eye. (5) The medical control device according to any one of (2) to (4), wherein the state control unit controls the imaging field of view based on the positional relationship between the center position of the image for display and the center position of the test eye included in the image for display. (6) The medical control device according to any one of (2) to (5), wherein the state control unit, in controlling the imaging field of view, moves the imaging device within a plane perpendicular to an observation optical axis extending from the imaging device to the subject's eye. (7) The medical control device according to (1), wherein the state of the subject's eye in the image for display is the size of the subject's eye in the image for display. (8) The medical control device described in (7), wherein the state control unit maintains a state in which the size of the test eye in the display image is a specific size by controlling the imaging field of view. (9) The medical control device according to (8), wherein the state control unit, in controlling the imaging field of view, moves the imaging device in a direction along an observation optical axis extending from the imaging device to the subject's eye. (10) The medical control device according to (8), wherein the state control unit changes a magnification factor of a zoom lens included in the imaging device in controlling the imaging field of view. (11) The medical control device described in (7) above, wherein the image generation unit generates the image for display by cutting out and enlarging a portion of the captured image, and the state control unit maintains a state in which the size of the test eye in the image for display is a specific size by controlling the magnification ratio of the portion of the image in the image generation unit. (12) The medical control device described in (1), wherein the state control unit maintains a state in which the center position of the test eye is located at a specific position within the image for display by controlling the operation of the image generation unit. (13) The medical control device according to (12), wherein the state control unit recognizes a center position of the test eye based on structural features of the test eye included in the captured image. (14) The medical control device according to (13), wherein the structural feature of the test eye is at least one of the pupil contour, the iris contour, the iris pattern, and the sclera blood vessel shape of the test eye. (15) A medical control device as described in any one of (12) to (14), wherein the image generation unit cuts out a partial area of ​​the captured image to generate the image for display, and the state control unit changes the cut-out position of the partial area by controlling the operation of the image generation unit. (16) The medical control device described in (15), wherein the state control unit changes the cut-out position of the portion of the area based on the positional relationship between the center position of the image for display and the center position of the test eye contained in the image for display. (17) The medical control device according to any one of (1) to (16), wherein the specific surgical instrument is a surgical instrument used in cataract surgery, and is at least one of a first surgical instrument used for creating a port, a second surgical instrument used for incising the anterior capsule, a third surgical instrument used for hydrodissection, a fourth surgical instrument used for processing the lens nucleus, and a fifth surgical instrument used for inserting an intraocular lens. (18) A medical observation system comprising an imaging device for imaging a test eye, and a medical control device for processing an image signal generated by the imaging device, the medical control device comprising a judgment unit for determining whether a specific surgical tool is included in an image based on the image signal, an image generation unit for generating an image for display based on the image signal, and a state control unit for controlling the operation of the image generation unit or the imaging field of view of the imaging device so as to maintain the state of the test eye in the image for display when the judgment unit determines that the specific surgical tool is not included in the image for display. [Explanation of symbols]

[0042] 1 Medical observation system 2. Surgical microscope 3 Display device 4 Input Devices 5. Control device 21 Light source device 22 Microscope Section 23 Base 24 Support part 25 Drive unit 51 Communications Department 52 Image processing section 53 Control section 54 Storage section 100 Examined Eye 110 Cornea 120 Pupil 221 Observation Optical System 222 Eyepiece 223 Imaging unit 231 Caster 241 XY Stage 242 XY moving part 243 Z moving part 251 XY drive unit 252 Z drive unit 253 Lens drive unit 2211 Objective lens 2212 Lens unit 2213 Half Mirror 2214 Zoom Lens Ax optical axis BD Patient Bed C1 Captured image D1 Displacement D2 Misalignment direction P1 Specific position in the captured image P2 Center position of the test eye T0 Specific surgical tools T1 Knife T2 Setsuko T3 Cannula T4 suction tube T5 Cartridge

Claims

1. a determination unit that determines whether or not a specific surgical tool is included in a captured image based on an image signal generated by an imaging device that images the subject's eye; an image generating unit that generates an image for display based on the image signal; a state control unit that controls the operation of the image generating unit or the imaging field of view of the imaging device so as to maintain the state of the subject's eye in the display image when the determination unit determines that the captured image does not include the specific surgical tool, The state control unit is A medical control device that maintains a state in which the center position of the subject's eye is located at a specific position within the display image by controlling the imaging field of view.

2. The state control unit is The medical control device according to claim 1 , wherein the center position of the subject's eye is recognized based on a structural feature of the subject's eye contained in the captured image.

3. The structural characteristics of the subject's eye include 3. The medical control device according to claim 2, wherein the detected shape is at least one of a pupil outline, an iris outline, an iris pattern, and a blood vessel shape of the sclera of the subject's eye.

4. The state control unit is 4. The medical control device according to claim 1, wherein the imaging field of view is controlled based on a positional relationship between a center position of the image for display and a center position of the subject's eye included in the image for display.

5. The state control unit is 5. The medical control device according to claim 1, wherein the control of the imaging field of view comprises moving the imaging device within a plane perpendicular to an observation optical axis directed from the imaging device to the subject's eye.

6. A determination unit that determines whether or not a specific surgical tool is included in an image captured based on an image signal generated by an imaging device that captures an image of a subject's eye; an image generating unit that generates an image for display based on the image signal; a state control unit that controls the operation of the image generating unit or the imaging field of view of the imaging device so as to maintain the state of the subject's eye in the display image when the determination unit determines that the captured image does not include the specific surgical tool, The state of the subject's eye in the display image is A medical control device that is the size of the subject's eye within the display image.

7. The state control unit is The medical control device according to claim 6 , wherein the imaging field of view is controlled to maintain a state in which the size of the subject's eye in the display image is a specific size.

8. The state control unit is The medical control device according to claim 7 , wherein the control of the imaging field of view comprises moving the imaging device in a direction along an observation optical axis directed from the imaging device to the subject's eye.

9. The state control unit is The medical control device according to claim 7 , wherein the control of the imaging field of view includes changing a magnification factor of a zoom lens included in the imaging device.

10. The image generating unit includes: generating the display image by cropping and enlarging a partial area of ​​the captured image; The state control unit is The medical control device according to claim 6 , wherein the magnification ratio of the partial area in the image generating unit is controlled to maintain a state in which the size of the subject's eye in the display image is a specific size.

11. A determination unit that determines whether or not a specific surgical tool is included in an image captured based on an image signal generated by an imaging device that captures an image of a subject's eye; an image generating unit that generates an image for display based on the image signal; a state control unit that controls the operation of the image generating unit or the imaging field of view of the imaging device so as to maintain the state of the subject's eye in the display image when the determination unit determines that the captured image does not include the specific surgical tool, The state control unit is A medical control device that maintains a state in which the center position of the subject's eye is located at a specific position within the display image by controlling the operation of the image generating unit.

12. The state control unit is The medical control device according to claim 11 , wherein the central position of the subject's eye is recognized based on a structural feature of the subject's eye included in the captured image.

13. The structural characteristics of the subject's eye include The medical control device according to claim 12 , wherein the detected shape is at least one of a pupil outline, an iris outline, an iris pattern, and a blood vessel shape in the sclera of the subject's eye.

14. The image generating unit includes: A part of the captured image is cut out to generate the image for display; The state control unit is The medical control device according to any one of claims 11 to 13, wherein the operation of the image generating unit is controlled to change the cut-out position of the partial area.

15. The state control unit is The medical control device according to claim 14 , wherein a position at which the partial area is cut out is changed based on a positional relationship between a center position of the image for display and a center position of the subject's eye included in the image for display.

16. The specific surgical tool is: A medical control device described in any one of claims 1 to 15, wherein the surgical instrument used in cataract surgery is at least one of a first surgical instrument used to create a port, a second surgical instrument used to incise the anterior capsule, a third surgical instrument used for hydrodissection, a fourth surgical instrument used to process the lens nucleus, and a fifth surgical instrument used to insert an intraocular lens.

17. an imaging device for imaging the subject's eye; a medical control device for processing an image signal generated by the imaging device, The medical control device includes: a determination unit that determines whether a specific surgical tool is included in a captured image based on the image signal; an image generating unit that generates an image for display based on the image signal; a state control unit that controls the operation of the image generating unit or the imaging field of view of the imaging device so as to maintain the state of the subject's eye in the display image when the determination unit determines that the captured image does not include the specific surgical tool, The state control unit is A medical observation system that maintains a state in which the center position of the subject's eye is located at a specific position within the display image by controlling the imaging field of view.

18. An imaging device for imaging a subject's eye; a medical control device for processing an image signal generated by the imaging device, The medical control device includes: a determination unit that determines whether a specific surgical tool is included in a captured image based on the image signal; an image generating unit that generates an image for display based on the image signal; a state control unit that controls the operation of the image generating unit or the imaging field of view of the imaging device so as to maintain the state of the subject's eye in the display image when the determination unit determines that the captured image does not include the specific surgical tool, The state of the subject's eye in the display image is A medical observation system, which is the size of the subject's eye within the display image.

19. An imaging device for imaging a subject's eye; a medical control device for processing an image signal generated by the imaging device, The medical control device includes: a determination unit that determines whether a specific surgical tool is included in a captured image based on the image signal; an image generating unit that generates an image for display based on the image signal; a state control unit that controls the operation of the image generating unit or the imaging field of view of the imaging device so as to maintain the state of the subject's eye in the display image when the determination unit determines that the captured image does not include the specific surgical tool, The state control unit is A medical observation system that maintains a state in which the center position of the subject's eye is located at a specific position within the display image by controlling the operation of the image generating unit.

Images