Ophthalmic observation device, ophthalmic image processing device, ophthalmic image processing method, program, and recording medium

Abstract

To provide a novel technique for facilitating ophthalmological observation.SOLUTION: An ophthalmological observation device (1) according to an exemplary embodiment is used for observing a subject eye. The ophthalmological observation device (1) comprises: a moving image generation unit (operating microscope 10); an image processing unit (data processing unit 210, image processing unit 211); and a display control unit (main control unit 201). The moving image generation unit generates a first moving image by imaging the subject eye. The image processing unit creates a plurality of processed images by applying first image processing using a plurality of values of prescribed different image parameters to a static image included in the first moving image generated by the moving image generation unit. The display control unit causes a first display device (display device 3) to display the plurality of processed images created by the image processing unit.SELECTED DRAWING: Figure 3

Description

[Technical field]

[0001] The present invention relates to an ophthalmic observation apparatus, an ophthalmic image processing apparatus, an ophthalmic image processing method, a program, and a recording medium. [Background technology]

[0002] An ophthalmic observation device is a device for observing a patient's eye (called an examined eye). Ophthalmic observation is performed in order to grasp the condition of the examined eye in various situations such as examination, surgery, and treatment.

[0003] Conventional ophthalmic observation devices provide a user with a magnified image obtained by an objective lens or a variable magnification optical system through an eyepiece, but some recent ophthalmic observation devices are configured to capture the magnified image obtained by the objective lens or the variable magnification optical system with an image sensor and display the captured image (first embodiment of ophthalmic observation device). Examples of such ophthalmic observation devices include slit lamp microscopes, surgical microscopes, and fundus cameras. In addition, various types of ophthalmic examination devices such as refractometers, keratometers, tonometers, specular microscopes, wavefront analyzers, and microperimeters are also provided with the function of the first embodiment of the ophthalmic observation device.

[0004] Furthermore, some recent ophthalmic observation devices use optical scanning (the second aspect of the ophthalmic observation device). Such ophthalmic observation devices include a scanning laser ophthalmoscope (SLO) and an optical coherence tomography (OCT) device.

[0005] In general, an ophthalmic observation device provides a moving image of an eye to a user (for example, a medical professional such as a doctor). The ophthalmic observation device of the first aspect is typically configured to perform moving image capture using infrared light and / or visible light as illumination light, and real-time moving image display of the image obtained thereby. On the other hand, the ophthalmic observation device of the second aspect is typically configured to perform data collection by repeated optical scanning, real-time image reconstruction based on data sets collected sequentially, and real-time moving image display of the sequentially reconstructed images. The real-time moving image provided in this manner is called an observation image.

[0006] In order to provide a good observation image, it is necessary to adjust the image quality, but the desired image quality differs depending on the user and also depending on the type and phase of the examination or surgery. For example, some doctors prefer images with a reddish tint, while other doctors prefer images with a greenish tint. In addition, cataract surgery, one of the most common ophthalmic surgeries, is performed in the steps of alignment, incision preparation, viscoelastic injection, anterior capsulotomy (CCC), phacoemulsification and aspiration, phacocortical aspiration, intraocular lens (IOL) insertion, IOL centering, viscoelastic removal, and wound closure, but the image quality desired by the doctor may differ for each phase. Furthermore, there are cases where the quality of the image of the target area needs to be selectively improved. In addition, the desired image quality may differ depending on the condition of the examined eye.

[0007] As described above, the quality desired for an observation image varies widely, but in a typical conventional ophthalmic observation device, image quality adjustment was performed manually each time, which was very cumbersome and time-consuming, and was one of the factors that led to longer examinations and surgeries. On the other hand, although it is possible to automatically adjust image quality, considering the diversity of desired image quality, manual adjustment is still required after all. [Prior art documents] [Patent documents]

[0008] [Patent Document 1] JP 2003-310556 A [Patent Document 2] JP 2009-118955 A Summary of the Invention [Problem to be solved by the invention]

[0009] One object of the present invention is to provide a new technique for facilitating ophthalmic observation. [Means for solving the problem]

[0010] Some exemplary aspects are an ophthalmic observation device for observing a test eye, including a moving image generation unit that photographs the test eye and generates a first moving image, an image processing unit that applies a first image processing using a plurality of different values ​​of a predetermined image parameter to still images included in the first moving image to create a plurality of processed images, and a display control unit that displays the plurality of processed images on a first display device.

[0011] An ophthalmologic observation device according to some exemplary aspects further includes an instruction receiving unit that receives an instruction to select at least one processed image from the plurality of processed images displayed on the first display device, the image processing unit applies second image processing based on at least one value of the image parameter corresponding to the at least one processed image to a second moving image generated by the moving image generating unit after the at least one processed image is selected using the instruction receiving unit, and the display control unit displays the second moving image to which the second image processing has been applied on the second display device.

[0012] In some exemplary aspects of the ophthalmologic observation device, when one processed image of the plurality of processed images is selected using the instruction receiving unit, the image processing unit applies image processing using one value of the image parameter corresponding to the one processed image to the second moving image as the second image processing.

[0013] In some exemplary aspects of the ophthalmologic observation device, when two or more processed images of the plurality of processed images are selected using the instruction receiving unit, the image processing unit applies image processing using one value of the image parameter corresponding to one of the two or more processed images to the second moving image as the second image processing.

[0014] In some exemplary aspects of the ophthalmologic observation device, when two or more processed images among the plurality of processed images are selected using the instruction receiving unit, the image processing unit determines one value based on two or more values ​​of the image parameters corresponding to the two or more processed images, respectively, and applies image processing using the one value to the second moving image as the second image processing.

[0015] The ophthalmic observation device according to some exemplary embodiments further includes a recording unit that records the value of the one of the image parameters used in the second image processing.

[0016] An ophthalmic observation device according to some exemplary embodiments further includes an identifier receiving unit that receives a user's identifier, and the recording unit records the one value of the image parameter in association with the identifier received by the identifier receiving unit.

[0017] An ophthalmologic observation device according to some exemplary aspects further includes an attribute information acquisition unit that acquires attribute information indicating attributes of a medical procedure on the subject's eye, and the recording unit records the one value of the image parameter in association with the attribute information acquired by the attribute information acquisition unit.

[0018] In some exemplary aspects, the ophthalmologic observation device further includes a selection unit that selects at least one value from among the values ​​of the image parameters previously recorded by the recording unit, and the image processing unit applies image processing based on the at least one value selected by the selection unit to a third moving image generated by the moving image generation unit.

[0019] In some exemplary aspects of the ophthalmic observation device, the recording unit records the shooting conditions when the second moving image was generated in association with the one value of the image parameter, the selection unit further selects a shooting condition associated with the at least one value selected by the selection unit, the ophthalmic observation device further includes a determination unit that determines a value of the image parameter based on the at least one value and the shooting condition selected by the selection unit, and the image processing unit applies image processing to the third moving image using the value of the image parameter determined by the determination unit.

[0020] In some exemplary aspects of the ophthalmologic observation device, the image processing unit applies the first image processing to a partial image that is a part of the still image included in the first moving image to create a plurality of processed partial images as the plurality of processed images, and the display control unit displays a plurality of images each including the plurality of processed partial images on the first display device.

[0021] In some exemplary aspects of an ophthalmic observation device, the image processing unit includes a first partial image identification unit that applies segmentation to the still image included in the first moving image to identify an image of a specific part of the test eye, thereby identifying the partial image.

[0022] In some exemplary aspects of the ophthalmologic observation device, the first partial image identification unit applies the segmentation to the second moving image to sequentially identify partial images of still images included in the second moving image, and the image processing unit sequentially applies the second image processing to the partial images identified from the still images included in the second moving image.

[0023] In some exemplary aspects of the ophthalmic observation device, the display control unit displays the first moving image or a still image included in the first moving image on the first display device or the second display device, the ophthalmic observation device further includes a graphical user interface for specifying a partial area in the displayed first moving image or the still image included in the first moving image, and the image processing unit sets the partial image based on the partial area specified using the user interface.

[0024] In some exemplary aspects of the ophthalmic observation device, the image processing unit includes a second partial image identification unit that sequentially identifies partial images corresponding to the partial region in a still image included in the second moving image, and the image processing unit sequentially applies the second image processing to the partial images identified from the still image included in the second moving image.

[0025] In the ophthalmologic observation device according to some exemplary aspects, the display control unit causes the first display device to display two or more processed images among the plurality of processed images or thumbnails of the two or more processed images side by side.

[0026] In the ophthalmologic observation device according to some exemplary aspects, the display control unit sequentially displays two or more processed images of the plurality of processed images or thumbnails of the two or more processed images on the first display device.

[0027] An ophthalmologic observation device according to some exemplary aspects further includes a monitoring unit that monitors the movement of the subject's eye, and the display control unit changes the display state of the plurality of processed images based on an output from the monitoring unit.

[0028] The ophthalmologic observation device according to some exemplary aspects further includes an abnormality detection unit that detects an abnormality in the subject's eye, and the display control unit changes the display state of the plurality of processed images based on an output from the abnormality detection unit.

[0029] In some exemplary aspects of the ophthalmic observation device, the image parameters include one or more of a hue parameter, a brightness parameter, a contrast parameter, a gain parameter, a gamma parameter, a color temperature parameter, a white balance parameter, an RGB balance parameter, a gray balance parameter, an edge enhancement parameter, a shadow enhancement parameter, a sharpening parameter, and a high dynamic range parameter.

[0030] Some exemplary aspects are an ophthalmologic image processing device that processes images of a test eye, and includes a moving image receiving unit that receives a first moving image of the test eye, an image processing unit that creates a plurality of processed images by applying a first image processing using a plurality of different values ​​of a predetermined image parameter to still images included in the first moving image, and a display control unit that displays the plurality of processed images on a first display device.

[0031] An ophthalmic image processing device according to some exemplary embodiments further includes an instruction receiving unit that receives an instruction to select at least one processed image from the plurality of processed images displayed on the first display device, and the image processing unit applies second image processing based on at least one value of the image parameters corresponding to the at least one processed image to a second moving image of the test eye received by the moving image receiving unit after the at least one processed image is selected based on the instruction, and the display control unit displays the second moving image to which the second image processing has been applied on the second display device.

[0032] Some exemplary aspects are an ophthalmologic image processing method for processing images of a test eye, which includes receiving a first moving image of the test eye, applying a first image process using a plurality of different values ​​of a predetermined image parameter to each of still images included in the first moving image to create a plurality of processed images, displaying the plurality of processed images, receiving an instruction to select at least one processed image from the plurality of displayed processed images, and after the at least one processed image is selected based on the instruction, receiving a second moving image of the test eye, applying a second image process to the second moving image based on at least one value of the image parameter corresponding to the at least one processed image, and displaying the second moving image with the second image process applied.

[0033] Some exemplary aspects are programs for causing a computer to execute an ophthalmologic image processing method according to the exemplary aspects.

[0034] Some exemplary aspects are a computer-readable non-transitory recording medium having a program according to the exemplary aspects recorded thereon. Effect of the Invention

[0035] According to an exemplary embodiment, it is possible to provide a new technique for facilitating ophthalmic observation. [Brief description of the drawings]

[0036] [Figure 1] 1 is a schematic diagram showing an example of the configuration of an ophthalmic observation device (ophthalmic surgical microscope) according to an exemplary embodiment. [Diagram 2] FIG. 1 is a schematic diagram showing an example of the configuration of an ophthalmologic observation apparatus according to an exemplary embodiment. [Diagram 3] FIG. 1 is a schematic diagram showing an example of the configuration of an ophthalmologic observation apparatus according to an exemplary embodiment. [Figure 4] FIG. 1 is a schematic diagram showing an example of the configuration of an ophthalmologic observation apparatus according to an exemplary embodiment. [Diagram 5] FIG. 1 is a schematic diagram showing an example of the configuration of an ophthalmologic observation apparatus according to an exemplary embodiment. [Figure 6] FIG. 1 is a schematic diagram showing an example of the configuration of an ophthalmologic observation apparatus according to an exemplary embodiment. [Figure 7] FIG. 1 is a schematic diagram showing an example of the configuration of an ophthalmologic observation apparatus according to an exemplary embodiment. [Figure 8] FIG. 1 is a schematic diagram showing an example of the configuration of an ophthalmologic observation apparatus according to an exemplary embodiment. [Figure 9] FIG. 1 is a schematic diagram showing an example of the configuration of an ophthalmologic observation apparatus according to an exemplary embodiment. [Figure 10] FIG. 1 is a schematic diagram showing an example of the configuration of an ophthalmologic observation apparatus according to an exemplary embodiment. [Figure 11] 11 is a flowchart illustrating an example of processing executed by an ophthalmologic observation apparatus according to an exemplary embodiment. [Figure 12A] 1 is a schematic diagram for explaining an example of processing executed by an ophthalmologic observation apparatus according to an exemplary embodiment; [Figure 12B] 1 is a schematic diagram for explaining an example of processing executed by an ophthalmologic observation apparatus according to an exemplary embodiment; [Figure 12C] 1 is a schematic diagram for explaining an example of processing executed by an ophthalmologic observation apparatus according to an exemplary embodiment; [Figure 12D] 1 is a schematic diagram for explaining an example of processing executed by an ophthalmologic observation apparatus according to an exemplary embodiment; [Figure 12E] 1 is a schematic diagram for explaining an example of processing executed by an ophthalmologic observation apparatus according to an exemplary embodiment; [Figure 13] 11 is a flowchart illustrating an example of processing executed by an ophthalmologic observation apparatus according to an exemplary embodiment. [Figure 14A] 1 is a schematic diagram for explaining an example of processing executed by an ophthalmologic observation apparatus according to an exemplary embodiment; [Figure 14B] 1 is a schematic diagram for explaining an example of processing executed by an ophthalmologic observation apparatus according to an exemplary embodiment; [Figure 14C] 1 is a schematic diagram for explaining an example of processing executed by an ophthalmologic observation apparatus according to an exemplary embodiment; [Figure 14D]1 is a schematic diagram for explaining an example of processing executed by an ophthalmologic observation apparatus according to an exemplary embodiment; [Figure 14E] 1 is a schematic diagram for explaining an example of processing executed by an ophthalmologic observation apparatus according to an exemplary embodiment; [Figure 14F] 1 is a schematic diagram for explaining an example of processing executed by an ophthalmologic observation apparatus according to an exemplary embodiment; [Figure 14G] 1 is a schematic diagram for explaining an example of processing executed by an ophthalmologic observation apparatus according to an exemplary embodiment; [Figure 15] FIG. 1 is a schematic diagram showing an example of the configuration of an ophthalmologic observation apparatus according to an exemplary embodiment. [Figure 16] FIG. 1 is a schematic diagram showing an example of the configuration of an ophthalmologic observation apparatus according to an exemplary embodiment. [Figure 17] FIG. 1 is a schematic diagram illustrating an example of a configuration of an ophthalmologic image processing apparatus according to an exemplary embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0037] Some exemplary aspects of an ophthalmic observation device, an ophthalmic image processing device, an ophthalmic image processing method, a program, and a recording medium according to the embodiments will be described in detail with reference to the drawings. Note that it is possible to combine the matters described in the documents cited in this specification and any publicly known technology with the exemplary aspects.

[0038] The ophthalmic observation device according to the exemplary embodiment is used to grasp the condition of a subject's eye in medical procedures such as examination, surgery, and treatment of the subject's eye. The ophthalmic observation device according to the exemplary embodiment described below is a surgical microscope system, but the ophthalmic observation device is not limited to a surgical microscope system. For example, the ophthalmic observation device may be any of a slit lamp microscope, a fundus camera, a refractometer, a keratometer, a tonometer, a specular microscope, a wavefront analyzer, a microperimeter, an SLO, and an OCT device, or may be a system including any one or more of these. More generally, the ophthalmic observation device may be any ophthalmic device having an observation function.

[0039] The target site of observation using an ophthalmic observation device may be any site of the subject's eye, and may be any site of the anterior eye and / or any site of the posterior eye. Examples of the target sites of observation in the anterior eye include the cornea, iris, anterior chamber, angle, crystalline lens, ciliary body, and Zinn's zonule. Examples of the target sites of observation in the posterior eye include the retina, choroid, sclera, and vitreous body. The target sites of observation are not limited to ocular tissues, and may be any site that is the target of observation in ophthalmology (and / or other departments), such as the eyelids, meibomian glands, and orbit.

[0040] At least a portion of the functionality of the elements disclosed herein is implemented using circuitry or processing circuitry. The circuitry or processing circuitry may be a general purpose processor, a special purpose processor, an integrated circuit, a central processing unit (CPU), a graphics processing unit (GPU), an application specific integrated circuit (ASIC), a programmable logic device (e.g., a simple programmable logic device (SPLD), a complex programmable logic device (CPLD), a field programmable gate array (FPGA), or a combination of a programmable logic device (PLC) and a programmable logic device (PGD)), configured and / or programmed to perform at least a portion of the functionality disclosed. The term "circuitry", "unit", "means" or the like includes any of the above-mentioned circuitry, including a transistor and / or other circuitry, a processor, a processor array, a conventional circuitry, and any combination thereof. A processor is considered to be a processing circuitry or circuitry, including transistors and / or other circuitry. In this disclosure, a circuitry, a unit, a means, or the like is hardware that performs at least some of the disclosed functions or is hardware that is programmed to perform at least some of the disclosed functions. The hardware may be hardware disclosed herein or may be known hardware that is programmed and / or configured to perform at least some of the described functions. In the case where the hardware is a processor that can be considered to be a type of circuitry, a circuitry, a unit, a means, or the like is a combination of hardware and software, and the software is used to configure the hardware and / or the processor.

[0041] <Ophthalmological observation device> The configuration of an exemplary embodiment of an ophthalmic observation device is shown in FIG.

[0042] An ophthalmic observation device 1 (surgical microscope system) according to the embodiment includes an operation device 2, a display device 3, and a surgical microscope 10. In some aspects, the surgical microscope 10 may include at least one of the operation device 2 and the display device 3. In some aspects, the display device 3 may not be included in the ophthalmic observation device 1. In other words, the display device 3 may be a peripheral device of the ophthalmic observation device 1.

[0043] <Control device 2> The operation device 2 includes an operation device and / or an input device. For example, the operation device 2 may include a button, a switch, a mouse, a keyboard, a trackball, an operation panel, a dial, etc. Typically, the operation device 2 includes a foot switch, similar to a general ophthalmic surgical microscope.

[0044] <Display device 3> The display device 3 displays an image of the examinee's eye acquired by the surgical microscope 10. The display device 3 includes a display device such as a flat panel display. The display device 3 may also include various display devices such as a touch panel. A typical display device 3 includes a large-screen display device. The display device 3 includes one or more display devices. When the display device 3 includes two or more display devices, for example, one may be a relatively large-screen display device and the other may be a relatively small-screen display device.

[0045] The operation device 2 and the display device 3 do not need to be separate devices. For example, a device in which an operation function and a display function are integrated, such as a touch panel, may be used as the display device 3. In this case, the operation device 2 includes the touch panel and a computer program. The operation content on the operation device 2 is input to a processor (not shown) as an electric signal. In addition, operations and information input may be performed using a graphical user interface (GUI) displayed on the display device 3 and the operation device 2. In some aspects, the functions of the operation device 2 and the display device 3 may be realized by a touch screen.

[0046] <Surgical microscope 10> The surgical microscope 10 is used to observe the eye (examined eye) of a patient in a supine position. The surgical microscope 10 captures an image of the examined eye to generate digital image data. In particular, the surgical microscope 10 generates a moving image of the examined eye. The moving image (video) generated by the surgical microscope 10 is transmitted to the display device 3 via a wired and / or wireless signal path and displayed. A user (surgeon) can perform surgery while observing the examined eye through the displayed video. Some aspects of the surgical microscope 10 may allow observation through a conventional eyepiece in addition to observation of such a displayed video.

[0047] In some aspects, the surgical microscope 10 includes a communication device for transmitting and receiving an electrical signal to and from the operation device 2. The operation device 2 receives an operation by a user and generates an electrical signal (operation signal) corresponding to the operation. The operation signal is transmitted to the surgical microscope 10 via a wired and / or wireless signal path. The surgical microscope 10 executes a process corresponding to the received operation signal.

[0048] <Optical system of surgical microscope 10> An example of the configuration of the optical system of the surgical microscope 10 will be described below. For convenience of description, the optical axis direction of the objective lens is defined as the z direction (e.g., the vertical direction during surgery, the up-down direction), a predetermined direction perpendicular to the z direction is defined as the x direction (e.g., the horizontal direction during surgery, the left-right direction for the surgeon and patient), and a direction perpendicular to both the z direction and the x direction is defined as the y direction (e.g., the horizontal direction during surgery, the front-back direction for the surgeon, the body axis direction for the patient).

[0049] In the following, the observation optical system will be mainly described as having a pair of left and right optical systems (optical systems capable of binocular observation). However, the observation optical system in other aspects may have an optical system for monocular observation, and those skilled in the art will understand that the configuration described below can be applied to such aspects.

[0050] An example of the configuration of the optical system of the surgical microscope 10 is shown in Fig. 2. Fig. 2 shows a schematic top view of the optical system as seen from above and a schematic side view of the optical system as seen from the side in correspondence with each other. To simplify the illustration, the illumination optical system 30 disposed above the objective lens 20 is omitted from the illustration.

[0051] The surgical microscope 10 includes an objective lens 20, a dichroic mirror DM1, an illumination optical system 30, and an observation optical system 40. The observation optical system 40 includes a zoom expander 50 and an imaging camera 60. In some embodiments, the illumination optical system 30 or the observation optical system 40 includes the dichroic mirror DM1.

[0052] The objective lens 20 is disposed so as to face the eye to be examined. The objective lens 20 is disposed so that its optical axis is along the z direction. The objective lens 20 may include two or more lenses.

[0053] The dichroic mirror DM1 couples the optical path of the illumination optical system 30 and the optical path of the observation optical system 40. The dichroic mirror DM1 is disposed between the illumination optical system 30 and the objective lens 20. The dichroic mirror DM1 transmits illumination light from the illumination optical system 30 and guides it to the subject's eye via the objective lens 20, and also reflects return light from the subject's eye that enters through the objective lens 20 and guides it to the imaging camera 60 of the observation optical system 40.

[0054] The dichroic mirror DM1 coaxially couples the optical path of the illumination optical system 30 and the optical path of the observation optical system 40. That is, the optical axis of the illumination optical system 30 and the optical axis of the observation optical system 40 intersect at the dichroic mirror DM1. When the illumination optical system 30 includes a left-eye illumination optical system (31L) and a right-eye illumination optical system (31R), and the observation optical system 40 includes a left-eye observation optical system 40L and a right-eye observation optical system 40R, the dichroic mirror DM1 coaxially couples the optical path of the left-eye illumination optical system (first illumination optical system 31L) and the optical path of the left-eye observation optical system 40L, and coaxially couples the optical path of the right-eye illumination optical system (first illumination optical system 31R) and the optical path of the right-eye observation optical system 40R.

[0055] The illumination optical system 30 is an optical system for illuminating the subject's eye via the objective lens 20. The illumination optical system 30 may be configured to illuminate the subject's eye with one of two or more illumination lights having different color temperatures. The illumination optical system 30 projects illumination light of a specified color temperature onto the subject's eye under the control of a control unit (200) described later.

[0056] The illumination optical system 30 includes first illumination optical systems 31L and 31R and a second illumination optical system 32.

[0057] The optical axis OL of the first illumination optical system 31L and the optical axis OR of the first illumination optical system 31R are arranged approximately coaxially with the optical axis of the objective lens 20. This makes it possible to realize so-called "0 degree illumination" and obtain a transillumination image using diffuse reflection at the fundus. In this embodiment, the transillumination image of the subject's eye can be observed with binoculars.

[0058] The second illumination optical system 32 is disposed so that its optical axis OS is decentered from the optical axis of the objective lens 20. The first illumination optical systems 31L and 31R and the second illumination optical system 32 are disposed so that the deviation of the optical axis OS from the optical axis of the objective lens 20 is larger than the deviation of the optical axes OL and OR from the optical axis of the objective lens 20. This allows the realization of so-called "angled illumination (oblique illumination)," making it possible to observe the subject's eye with binoculars while preventing the inclusion of ghosts caused by corneal reflection, etc. Furthermore, it also makes it possible to observe the irregularities of the parts and tissues of the subject's eye in detail.

[0059] The first illumination optical system 31L includes a light source 31LA and a condenser lens 31LB. The light source 31LA outputs illumination light with a wavelength in the visible region corresponding to a color temperature of, for example, 3000 K (Kelvin). The illumination light output from the light source 31LA passes through the condenser lens 31LB, transmits through the dichroic mirror DM1, and passes through the objective lens 20 to enter the subject's eye.

[0060] The first illumination optical system 31R includes a light source 31RA and a condenser lens 31RB. The light source 31RA also outputs illumination light with a wavelength in the visible region corresponding to a color temperature of, for example, 3000 K. The illumination light output from the light source 31RA passes through the condenser lens 31RB, transmits through the dichroic mirror DM1, and passes through the objective lens 20 to enter the subject's eye.

[0061] The second illumination optical system 32 includes a light source 32A and a condenser lens 32B. The light source 32A outputs illumination light with a wavelength in the visible region corresponding to a color temperature of, for example, 4000 K to 6000 K. The illumination light output from the light source 32A passes through the condenser lens 32B and passes through the objective lens 20 without passing through the dichroic mirror DM1, and enters the subject's eye.

[0062] That is, the color temperature of the illumination light from the first illumination optical systems 31L and 31R is lower than the color temperature of the illumination light from the second illumination optical system 32. With this configuration, it becomes possible to observe the subject's eye in warm colors using the first illumination optical systems 31L and 31R, and to observe the structure and shape of the subject's eye in detail.

[0063] In some aspects, each of the optical axes OL and OR is movable relative to the optical axis of the objective lens 20. The direction of this relative movement is a direction intersecting the optical axis of the objective lens 20, and this relative movement is expressed by a displacement vector in which at least one of the x component and the y component is not zero. In some aspects, each of the optical axes OL and OR may be movable independently. On the other hand, in some aspects, the optical axes OL and OR may be movable integrally. For example, the surgical microscope 10 includes a moving mechanism (31d) that moves the first illumination optical systems 31L and 31R independently or integrally, and the moving mechanism moves the first illumination optical systems 31L and 31R independently or integrally in a direction intersecting the optical axis of the objective lens 20. This makes it possible to adjust the visibility of the subject's eye. In some aspects, the moving mechanism operates under the control of a control unit (200) described later.

[0064] In some aspects, the optical axis OS is movable relative to the optical axis of the objective lens 20. The direction of this relative movement is a direction intersecting with the optical axis of the objective lens 20, and this relative movement is expressed by a displacement vector in which at least one of the x component and the y component is not zero. For example, the surgical microscope 10 includes a movement mechanism (32d) that moves the second illumination optical system 32, and this movement mechanism moves the second illumination optical system 32 in a direction intersecting with the optical axis of the objective lens 20. This makes it possible to adjust the visibility of unevenness in the part or tissue of the subject's eye. In some aspects, the movement mechanism operates under the control of a control unit (200) described later.

[0065] As described above, in this embodiment, the illumination optical system 30 is disposed directly above the objective lens 20 (in the transmission direction of the dichroic mirror DM1), and the observation optical system 40 is disposed in the reflection direction of the dichroic mirror DM1. For example, the observation optical system 40 may be disposed so that the angle between the optical axis of the observation optical system 40 and the plane (xy plane) perpendicular to the optical axis of the objective lens 20 is ±20 degrees or less.

[0066] According to the configuration of this embodiment, the observation optical system 40, which generally has a longer optical path length than the illumination optical system 30, is arranged approximately parallel to the xy plane, so that the observation optical system is not obstructed from the field of view of the surgeon as in the conventional surgical microscope in which the observation optical system is arranged vertically in front of the surgeon's eyes. Therefore, the surgeon can easily see the screen of the display device 3 installed in front. In other words, the visibility of the displayed information (images and videos of the subject's eye, and various other reference information) during surgery is improved. In addition, since the housing is not arranged in front of the surgeon's eyes, the surgeon does not feel a sense of pressure, and the burden on the surgeon is reduced.

[0067] The observation optical system 40 is an optical system for observing an image formed based on return light of illumination light incident from the subject's eye via the objective lens 20. In this embodiment, the observation optical system 40 provides an image to an imaging element of the imaging camera 60.

[0068] As described above, the observation optical system 40 includes the left-eye observation optical system 40L and the right-eye observation optical system 40R. The configuration of the left-eye observation optical system 40L is similar to the configuration of the right-eye observation optical system 40R. In some aspects, the optical arrangements of the left-eye observation optical system 40L and the right-eye observation optical system 40R may be changeable independently of each other.

[0069] The zoom expander 50 is also called a beam expander, a variable beam expander, etc. The zoom expander 50 includes a left-eye zoom expander 50L and a right-eye zoom expander 50R. The configuration of the left-eye zoom expander 50L is similar to the configuration of the right-eye zoom expander 50R. In some aspects, the left-eye zoom expander 50L and the right-eye zoom expander 50R may be capable of changing the optical arrangements independently of each other.

[0070] The left-eye zoom expander 50L includes a plurality of zoom lenses 51L, 52L, and 53L. At least one of the plurality of zoom lenses 51L, 52L, and 53L is movable in the optical axis direction by a magnification change mechanism (not shown).

[0071] Similarly, the right-eye zoom expander 50R includes a plurality of zoom lenses 51R, 52R, and 53R, and at least one of the plurality of zoom lenses 51R, 52R, and 53R is movable in the optical axis direction by a magnification change mechanism (not shown).

[0072] The magnification change mechanism may be configured to move each zoom lens of the left-eye zoom expander 50L and each zoom lens of the right-eye zoom expander 50R independently or integrally in the optical axis direction. This changes the magnification when photographing the subject's eye. In some aspects, the magnification change mechanism operates under the control of a control unit (200) described later.

[0073] The imaging camera 60 is a device that captures an image formed by the observation optical system 40 to generate digital image data, and is typically a digital camera (digital video camera). The imaging camera 60 includes a left-eye imaging camera 60L and a right-eye imaging camera 60R. The configuration of the left-eye imaging camera 60L is similar to the configuration of the right-eye imaging camera 60R. In some aspects, the optical arrangements of the left-eye imaging camera 60L and the right-eye imaging camera 60R can be changed independently of each other.

[0074] The left-eye imaging camera 60L includes an imaging lens 61L and an imaging element 62L. The imaging lens 61L forms an image based on the return light that has passed through the left-eye zoom expander 50L on the imaging surface of the imaging element 62L. The imaging element 62L is an area sensor, and may typically be a charge-coupled device (CCD) image sensor or a complementary metal-oxide semiconductor (CMOS) image sensor. The imaging element 62L operates under the control of a control unit (200) described below.

[0075] The right-eye imaging camera 60R includes an imaging lens 61R and an imaging element 62R. The imaging lens 61R forms an image based on the return light that has passed through the right-eye zoom expander 50R on the imaging surface of the imaging element 62L. The imaging element 62R is an area sensor, and may typically be a CCD image sensor or a CMOS image sensor. The imaging element 62R operates under the control of a control unit (200) described later.

[0076] <Processing system> The processing system of the ophthalmologic observation device 1 will be described. Several configuration examples of the processing system are shown in Figs. 3 to 10. Any two or more of the configuration examples described below can be at least partially combined. Note that the configuration of the processing system is not limited to these examples.

[0077] The control unit 200 controls each part of the ophthalmic observation device 1. The control unit 200 includes a main control unit 201 and a storage unit 202. The main control unit 201 includes a processor and controls each part of the ophthalmic observation device 1. For example, the processor can read and execute a program stored in the storage unit 202 or another storage device to realize the function according to this embodiment, and can also use (reference, processing, calculation, etc.) data and information stored in the storage unit 202 or another storage device.

[0078] The main control unit 201 can control the light sources 31LA, 31RA, and 32A of the illumination optical system 30, the image pickup elements 62L and 62R of the observation optical system 40, the movement mechanisms 31d and 32d, the magnification change mechanisms 50Ld and 50Rd, the operation device 2, the display device 3, etc.

[0079] The control of the light source 31LA includes turning the light source on and off, adjusting the light amount, adjusting the aperture, etc. The control of the light source 31RA includes turning the light source on and off, adjusting the light amount, adjusting the aperture, etc. The main control unit 201 can control the light sources 31LA and 31RA mutually exclusively. The control of the light source 32A includes turning the light source on and off, adjusting the light amount, adjusting the aperture, etc.

[0080] When the illumination optical system 30 includes a light source capable of changing the color temperature, the main controller 201 can change the color temperature of the output illumination light by controlling this light source.

[0081] The control of the image sensor 62L includes exposure adjustment, gain adjustment, shooting rate adjustment, etc. The control of the image sensor 62R includes exposure adjustment, gain adjustment, shooting rate adjustment, etc. Furthermore, the main control unit 201 can control the image sensors 62L and 62R so that the shooting timings of the image sensors 62L and 62R coincide with each other, or so that the difference between the shooting timings of the two is within a predetermined time. Furthermore, the main control unit 201 can control the reading of the digital data obtained by the image sensors 62L and 62R.

[0082] The moving mechanism 31d moves the light sources 31LA and 31RA independently or integrally in a direction intersecting the optical axis of the objective lens 20. The main controller 201 can move the optical axes OL and OR independently or integrally with respect to the optical axis of the objective lens 20 by controlling the moving mechanism 31d.

[0083] The moving mechanism 32d moves the light source 32A independently or integrally in a direction intersecting the optical axis of the objective lens 20. The main controller 201 can move the optical axis OS relative to the optical axis of the objective lens 20 by controlling the moving mechanism 32d.

[0084] In some aspects, the main controller 201 can coordinately control the moving mechanisms 31d and 32d.

[0085] The magnification change mechanism 50Ld moves at least one of the multiple zoom lenses 51L to 53L of the left-eye zoom expander 50L in the optical axis direction. The main controller 201 can change the magnification of the left-eye observation optical system 40L by controlling the magnification change mechanism 50Ld.

[0086] Similarly, the magnification change mechanism 50Rd moves at least one of the multiple zoom lenses 51R to 53R of the right-eye zoom expander 50R in the optical axis direction. The main controller 201 can change the magnification of the right-eye observation optical system 40R by controlling the magnification change mechanism 50Rd.

[0087] The control over the operation device 2 includes operation permission control, operation prohibition control, and transmission control and / or reception control of an operation signal from the operation device 2. The main control unit 201 receives an operation signal generated by the operation device 2, and executes control corresponding to the received signal.

[0088] The control of the display device 3 includes information display control. As a display control unit, the main control unit 201 can cause the display device 3 to display an image based on the digital image data generated by the imaging elements 62L and 62R. Typically, the main control unit 201 can cause the display device 3 to display a moving image (image) based on the digital image data (video signal) generated by the imaging elements 62L and 62R, and can also cause the display device 3 to display a still image (frame) included in the moving image. Furthermore, the main control unit 201 can cause the display device 3 to display an image (moving image, still image, etc.) obtained by processing the digital image data generated by the imaging elements 62L and 62R. In addition, the main control unit 201 can cause the display device 3 to display any information generated by the ophthalmic observation device 1 or any information acquired by the ophthalmic observation device 1 from the outside.

[0089] Further, the main control unit 201, as a display control unit, can create a left eye image from the digital image data generated by the imaging element 62L and create a right eye image from the digital image data generated by the imaging element 62R, and can display the created left eye image and right eye image on the display device 3 in a manner that allows stereoscopic viewing. For example, the main control unit 201 can create a pair of left and right parallax images from the left eye image and the right eye image, and can display the pair of parallax images on the display device 3. A user (such as a surgeon) can recognize the pair of parallax images as a stereoscopic image by using a known stereoscopic viewing method. Any stereoscopic viewing method can be applied to this embodiment, and can be, for example, a stereoscopic viewing method with the naked eye, a stereoscopic viewing method using an auxiliary device (such as polarized glasses), a stereoscopic viewing method using image processing (such as image synthesis and rendering) on ​​the left eye image and the right eye image, a stereoscopic viewing method that simultaneously displays a pair of parallax images, a stereoscopic viewing method that switches between and displays a pair of parallax images, or a stereoscopic viewing method that combines two or more of these.

[0090] The data processing unit 210 executes various types of data processing. Some examples of the processing that the data processing unit 210 can execute are described below.

[0091] <Details of the processing system> Several examples of processing that can be executed by the data processing unit 210 will be described together with related elements. Each of Figs. 4 to 10 shows a configuration example of the data processing unit 210 (and related elements). Any two or more of the configuration examples shown in Figs. 4 to 10 can be at least partially combined. The data processing unit 210 (each of its elements) includes a processor that operates according to predetermined software (program), and is realized by cooperation between hardware and software.

[0092] The data processing unit 210A shown in Fig. 4 is an example of the data processing unit 210 in Fig. 3. The data processing unit 210A of this example includes an image processing unit 211. The image processing unit 211 applies image processing (first image processing) using multiple different values ​​of predetermined image parameters to still images included in a moving image (first moving image, video) of the subject's eye generated by the surgical microscope 10. This creates multiple processed images based on these still images. The processed image creation process by the image processing unit 211 may be executed in parallel with the moving image capture of the subject's eye by the surgical microscope 10.

[0093] The type of image parameter used in the first image processing may be any type. For example, the image parameter may include one or more of the following types of parameters: color tone parameter (parameter for color tone conversion); brightness parameter (parameter for brightness conversion); contrast parameter (parameter for contrast conversion); gain parameter (parameter for gain change); gamma parameter (parameter for gamma correction (correction of the response characteristic of the gradation of an image)); color temperature parameter (parameter for color temperature conversion); white balance parameter (parameter for white balance conversion); RGB balance parameter (parameter for balance conversion between R value, G value, and B value); gray balance parameter (parameter for gray balance conversion); edge enhancement parameter (parameter for edge enhancement); shadow enhancement parameter (parameter for shadow enhancement); sharpening parameter (parameter for sharpening); high dynamic range parameter (parameter for HDR synthesis). Image parameters applicable to this example are not limited to the types exemplified here, and may more generally be any parameter that can be used to change the appearance of an image (for example, a parameter for display control, a parameter for image representation, a parameter for image correction, a parameter for image adjustment, etc.).

[0094] In the first image processing, the image processing unit 211 can apply each of a plurality of image processes using a plurality of different values ​​of one image parameter to a still image included in the first moving image. For example, the image processing unit 211 can apply each of N image processes (color tone conversion) using N values ​​of a color tone parameter to a still image (N is an integer equal to or greater than 2). This creates N processed images expressed in different color tones. The same applies when an image parameter other than a color tone parameter is used.

[0095] Also, in the first image processing, the image processing unit 211 can apply each of a plurality of image processes using different combinations of a plurality of values of two image parameters to the still images included in the first moving image. For example, the image processing unit 211 can apply each of N×M image processes (color tone conversion and brightness conversion) consisting of combinations of N values of the color tone parameter and M values of the brightness parameter to the still image (each of N and M is an integer of 2 or more). Thereby, N×M processed images expressed by different combinations of color tone and brightness are created. The same applies when using combinations other than the combination of the color tone parameter and the brightness parameter. Also, the number of image parameters to be combined may be any number of 2 or more. Also, it is not necessary to use all of the plurality of values prepared for each image parameter. For example, when N values of the color tone parameter and M values of the brightness parameter are prepared, a combination of N1 values of the color tone parameter and M1 values of the brightness parameter can be considered. Here, N1≦N and M1≦M, and further, N1<N and / or M1<M.

[0096] The plurality of processed images created in this way are displayed on the display device 3 by the main control unit 201. Here, the main control unit 201 may cause the display device 3 to display the plurality of processed images themselves created by the image processing unit 211, or may cause the display device 3 to display thumbnails (reduced images) of these processed images.

[0097] The mode of displaying the plurality of processed images may be arbitrary. In some modes, the main control unit 201 can display two or more of the plurality of processed images (or their thumbnails) side by side. Here, the main control unit 201 may execute a process of displaying in parallel a first group selected from the plurality of processed images and a process of switching from the parallel display of the first group to the parallel display of the second group in response to a predetermined trigger. The trigger for switching the groups to be displayed in parallel is issued manually or automatically.

[0098] In some aspects, the main control unit 201 can sequentially display two or more processed images (or thumbnails thereof) among the multiple processed images. The displayed processed images are switched manually or automatically.

[0099] When a thumbnail is to be displayed, the main control unit 201 (or the image processing unit 211 or the data processing unit 210A) executes a process of creating a thumbnail from the processed image created by the first image processing.

[0100] A user (for example, a surgeon, an assistant under the instructions of the surgeon, etc.) can select a desired one from among a plurality of processed images (or thumbnails thereof) displayed on the display device 3.

[0101] The number of processed images selected may be arbitrary. When one processed image is selected, the processed image is provided for subsequent processing. When two or more processed images are selected, all or some of them are provided for subsequent processing. For example, the image processing unit 211A (or the data processing unit 210A) may be configured to select one of the two or more selected processed images according to a predetermined algorithm.

[0102] The ophthalmic observation device 1 has an element (instruction receiving unit) that receives a user's instruction to select a processed image. The element that functions as the instruction receiving unit may be any element. For example, the user can give instructions using the operation device 2. In some aspects, the instruction receiving unit may include a voice recognition unit that detects and recognizes an instruction by voice, a gaze recognition unit that detects and recognizes an instruction by gaze, an electroencephalogram recognition unit that detects and recognizes an instruction by electroencephalogram, a pointing recognition unit that detects and recognizes an instruction by pointing, a biosignal recognition unit that detects and recognizes an instruction by any biosignal, and the like.

[0103] When the user selects the processed image, the ophthalmologic observation device 1 executes processing based on the selected processed image. Some examples of this processing will be described below.

[0104] An example of the configuration shown in Fig. 5 will be described. An image processing unit 211A shown in Fig. 5 is an example of the image processing unit 211 in Fig. 4. The image processing unit 211A of this example includes a processed image creation unit 2111 and a moving image processing unit 2112.

[0105] The processed image creation unit 2111 executes, for example, at least a part of the above-mentioned processing described with reference to FIG.

[0106] The video processing unit 2112 processes the video based on a processed image selected by the user from among a plurality of processed images displayed on the display device 3. For example, the video processing unit 2112 first acquires image parameters corresponding to the processed image selected by the user. That is, the video processing unit 2112 acquires values ​​of image parameters used in the first image processing for creating the processed image selected by the user. Next, the video processing unit 2112 applies image processing (second image processing) based on the values ​​of the image parameters to the video. The video to which the second image processing is applied is at least a video (called the second video) generated by the surgical microscope 10 after the user selects the processed image. This allows the acquisition of a video to which the same image processing as that of the processed image selected by the user has been applied. Note that, when one or more still images included in the video (first video) acquired before the user selects the processed image are saved, the same image processing can be applied to at least a part of the one or more still images.

[0107] The main control unit 201 causes the display device 3 to display the second moving image to which the second image processing has been applied. Typically, the ophthalmologic observation device 1 can perform real-time application of the second image processing to the moving image (second moving image) acquired by the moving image capture while capturing a moving image of the subject's eye using the surgical microscope 10, and real-time display of the moving image to which the second image processing has been applied. This allows the user to observe in real time the moving image to which image processing using the same image parameter values ​​as those of the processed image selected by the user has been applied.

[0108] As described above, the number of processed images selected by the user may be any number. For example, when the number of processed images selected is one, the video processing unit 2112 can apply image processing using the value (one value) of the image parameter corresponding to the one selected processed image to the second video as the second image processing.

[0109] On the other hand, when the number of selected processed images is two or more, the video processing unit 2112 can select one processed image from the two or more selected processed images, and apply image processing using the value (one value) of the image parameter corresponding to this one processed image to the second video as the second image processing. Alternatively, the video processing unit 2112 can select one value from two or more values ​​of the image parameter corresponding to the two or more selected processed images, and apply image processing using this one value to the second video as the second image processing. These selection processes performed by the video processing unit 2112 are performed according to a predetermined algorithm. For example, the video processing unit 2112 may be configured to analyze two or more processed images selected by the user to calculate a predetermined image quality evaluation value, and select one processed image having an optimal image quality evaluation value. Alternatively, when two or more image parameters are used in the first image processing, the video processing unit 2112 may be configured to select a processed image or select an image parameter value by referring to a priority order between image parameters set in advance. In this case, for example, the video processor 2112 is configured to select an optimal value (eg, the highest contrast value) from among a plurality of values ​​of the image parameter having the highest priority.

[0110] In another aspect in which the number of processed images selected is two or more, the video processing unit 2112 can determine one value based on two or more values ​​of image parameters corresponding to the two or more selected processed images, and apply the image processing using this one value as the second image processing to the second video. The arithmetic processing for determining one value from two or more values ​​may be any type, for example, a statistical calculation. The statistical value obtained by this statistical calculation may be any type of statistical value, such as an average value, a median value, a maximum value, or a minimum value. The arithmetic processing to be applied may be set in advance or may be set for each process. As an example of the latter, the video processing unit 2112 can determine the type of arithmetic processing (statistical calculation) to be applied based on any one or more factors, such as the type of image parameter used in the first image processing, the number of processed images selected by the user, the type of image acquired by the surgical microscope 10, and the phase of the medical procedure (surgery in this example).

[0111] Next, reference will be made to Fig. 6. A data processing unit 210B shown in Fig. 6 is an example of the data processing unit 210 in Fig. 3. The data processing unit 210B of this example includes an image processing unit 211 and a parameter processing unit 212.

[0112] The image processing unit 211 may be configured to execute the same processing as the image processing unit 211 or the image processing unit 211A described above.

[0113] The parameter processing unit 212 executes processing related to image parameters. The image processing unit 211 can execute processing using the output from the parameter processing unit 212. For example, the parameter processing unit 212 is configured to record values ​​of image parameters used in the second image processing by the video processing unit 2112 (recording unit), and the image processing unit 211 is configured to execute new image processing (for example, new first image processing, new second image processing) using the values ​​of the image parameters recorded by the parameter processing unit 212. Note that the parameter processing unit 212 as a recording unit may be configured to record only the values ​​of the image parameters used in the second image processing, or may be configured to record other values ​​as well. As an example of the latter, the parameter processing unit 212 as a recording unit may record values ​​of image parameters corresponding to each processed image selected by the user, may record one or more values ​​of image parameters corresponding to a part of a plurality of processed images selected by the user, or may record values ​​of image parameters manually adjusted.

[0114] Several examples of the configuration of the parameter processing unit 212 and the processes executed using the same will be described below.

[0115] The parameter processing unit 212A shown in Fig. 7 is an example of the parameter processing unit 212 in Fig. 6. The parameter processing unit 212A includes a parameter recording unit 2121 and a parameter selection unit 2122. When the parameter processing unit 212A of this example is adopted, the ophthalmic observation device 1 may have an identifier receiving unit 221 and an attribute information acquiring unit 222. In some aspects, the ophthalmic observation device 1 may have only one of the identifier receiving unit 221 and the attribute information acquiring unit 222.

[0116] The identifier receiving unit 221 receives a user identifier (user ID). This user is typically a surgeon. The user ID may be expressed by, for example, a character string or an image (e.g., a barcode, a two-dimensional barcode, etc.) assigned to a surgeon (doctor) at the medical institution, the surgeon's name, or the surgeon's biometric information (e.g., a face, a fingerprint, a palm print, an iris pattern, a voice, etc.).

[0117] The identifier receiving unit 221 may include any device (hardware, software) for receiving such a user ID, and may include, for example, an operation device 2, a camera, a barcode scanner, a biometric information scanner, a microphone, a processor, and the like.

[0118] The parameter recording unit 2121 functions as the recording unit described above, and records the values ​​of the image parameters in association with the user ID accepted by the identifier accepting unit 221. This makes it possible to identify which user selected which image parameter value. For example, it becomes possible to search for the values ​​of the image parameters using the user ID as a search query.

[0119] The attribute information acquisition unit 222 acquires attribute information indicating attributes of a medical procedure on the subject's eye. That is, the attribute information acquisition unit 222 acquires attribute information indicating various attributes related to a medical procedure (surgery in this example) performed on the subject's eye using the ophthalmic observation device 1.

[0120] Attributes of surgery include types of surgery according to the surgical site (e.g., anterior eye surgery, posterior eye surgery, corneal surgery, angle surgery, ciliary body surgery, retinal surgery, vitreous surgery, etc.), types of surgery according to the disease (e.g., cataract surgery, glaucoma surgery, corneal transplant surgery, retinal cell transplant surgery, retinal detachment surgery, laser photocoagulation, etc.), etc. The same applies to medical procedures other than surgery (e.g., examinations, treatments, screenings, etc.).

[0121] The attributes of a medical procedure are not limited to the type of medical procedure. For example, the attribute information may include information indicating multiple phases of a surgery. For example, the phases of a cataract surgery include alignment, incision creation, ocular viscoelastic injection, CCC, phacoemulsification, phacocortical aspiration, IOL insertion, IOL centering, ocular viscoelastic removal, and wound closure. Such information indicating a surgery phase can be included in the attribute information. The phases included in the attribute information may be set in advance or may be determined by the surgeon. Two or more phases to which the same image parameter value is applied may be grouped together (a phase group).

[0122] The attribute information may be expressed, for example, by a character string or an image (for example, a barcode, a two-dimensional barcode, etc.) assigned to a medical procedure at the medical institution, the name of the medical procedure, or the like.

[0123] The attribute information acquisition unit 222 may include any device (hardware, software) for receiving such attribute information, and may include, for example, an operating device 2, a camera, a barcode scanner, a biometric information scanner, a microphone, a processor, and the like.

[0124] Furthermore, the attribute information acquisition unit 222 may be configured to automatically identify the current phase by analyzing the image (video) generated by the surgical microscope 10, the operation performed using the operation device 2, the image displayed on the display device 3, etc. Furthermore, when the procedure of the surgery is predetermined, the attribute information acquisition unit 222 may be configured to automatically identify the current phase by referring to the steps that have been performed up to the current stage.

[0125] The main control unit 201 can display information indicating the phase automatically identified by the attribute information acquisition unit 222 on the display device 3. The user can determine whether the displayed information is correct or not, and input the result of this determination using the operation device 2 or the like. With this configuration, the phase automatically identified by the attribute information acquisition unit 222 can be confirmed, making it possible to prevent an incorrect phase from being recorded.

[0126] The parameter recording unit 2121 as a recording unit records the values ​​of the image parameters in association with the attribute information acquired by the attribute information acquisition unit 222. This makes it possible to identify which image parameter value the user selected for which medical procedure (type, phase, etc.). For example, it becomes possible to search for the values ​​of the image parameters using the type or phase of surgery as a search query. In addition, the attribute information may include any information such as the progression of the disease, the date the medical procedure was performed, the proficiency of the surgeon, etc.

[0127] When both the identifier receiving unit 221 and the attribute information acquiring unit 222 are provided, the parameter recording unit 2121 as a recording unit can record the values ​​of the image parameters in association with both the user ID received by the identifier receiving unit 221 and the attribute information acquired by the attribute information acquiring unit 222. This makes it possible to identify which user selected which image parameter value for which medical procedure (type, phase, etc.). For example, it becomes possible to search for the values ​​of the image parameters using the user ID and / or the type or phase of surgery as a search query.

[0128] The parameter selection unit 2122 selects at least one value from among the values ​​of the image parameters previously recorded by the parameter recording unit 2121. For example, the parameter selection unit 2122 can select the value of the image parameter by the above-mentioned search query.

[0129] The image processing unit 211 (211A) can apply image processing based on the values ​​of the image parameters selected by the parameter selection unit 2122 to the moving image (third moving image) generated by the surgical microscope 10. The third moving image may be any moving image, and may be, for example, the above-mentioned second moving image, a moving image acquired in another medical procedure on the same subject, a moving image acquired in a medical procedure on another subject, or the like.

[0130] When the image parameter values ​​are selected using the user ID as a search query, image processing can be applied to the third moving image using the image parameter values ​​used in the past by that user (e.g., surgeon), making it possible to easily provide the third moving image in the user's preferred display mode (hue, brightness, contrast, etc.).

[0131] When image parameter values ​​are selected using attribute information of a medical procedure as a search query, image processing can be applied to the third moving image using image parameter values ​​previously used depending on the type and phase of the medical procedure, making it possible to easily provide the third moving image in a display mode (color, brightness, contrast, etc.) that suits the type and phase of the medical procedure.

[0132] The parameter processing unit 212B shown in Fig. 8 is an example of the parameter processing unit 212 in Fig. 6. The parameter processing unit 212B includes a parameter recording unit 2121 and a parameter selection unit 2122, similar to the parameter processing unit 212A in Fig. 7, and further includes an imaging condition recording unit 2123, an imaging condition selection unit 2124, and a parameter determination unit 2125. The configurations and operations of the parameter recording unit 2121 and the parameter selection unit 2122 may be similar to those in Fig. 7, and description thereof will be omitted.

[0133] Even when the parameter processing unit 212B of this example is adopted, the ophthalmic observation device 1 may include the identifier receiving unit 221 and the attribute information acquiring unit 222. In some aspects, the ophthalmic observation device 1 may include only one of the identifier receiving unit 221 and the attribute information acquiring unit 222. The configurations and operations of the identifier receiving unit 221 and the attribute information acquiring unit 222 may be the same as those in FIG. 7, and the description thereof will be omitted.

[0134] The imaging condition recording unit 2123 records the imaging conditions when the second moving image was generated by the surgical microscope 10 in association with the values ​​of the image parameters recorded by the parameter recording unit 2121. In this example, the combination of the parameter recording unit 2121 and the imaging condition recording unit 2123 functions as a recording unit.

[0135] The photographing conditions may include, for example, illumination conditions, observation conditions, environmental conditions, and conditions of the subject's eye. The illumination conditions include conditions related to the elements of the illumination optical system 30, and examples of these include the amount of light (the amount of light output from the light sources 31LA, 31RA, and 32A, and the output intensity), the aperture value of the iris, and the illumination mode (0-degree illumination, angled illumination, etc.). The observation conditions are conditions related to the elements of the observation optical system 40, and examples of these include the aperture value of the iris, the magnification, and the control values ​​(gain, etc.) of the image pickup elements 62L and 62R. The environmental conditions include conditions related to the environment during photographing, and examples of these include the brightness of the room in which the surgical microscope 10 is installed. The conditions of the subject's eye include conditions related to the subject's eye, and examples of these include the presence or absence of a disease, the type and degree of the disease, the pupil diameter, and the degree of opacity of the site (cornea, crystalline lens, vitreous body, etc.).

[0136] In this example, since information is recorded by both the parameter recording unit 2121 and the imaging condition recording unit 2123, imaging conditions can be taken into consideration in addition to the information considered in the example of FIG.

[0137] The photographing condition selection unit 2124 selects the photographing condition associated with the value of the image parameter selected by the parameter selection unit 2122 from among the photographing conditions previously recorded by the photographing condition recording unit 2123. In this way, in addition to the value of the image parameter selected by the parameter selection unit 2122, the photographing condition associated with this image parameter value can also be acquired.

[0138] The parameter determination section 2125 determines the value of the image parameter based on the value of the image parameter selected by the parameter selection section 2122 and the shooting condition selected by the shooting condition selection section 2124 .

[0139] Regarding controllable conditions in the surgical microscope 10, such as the illumination conditions and observation conditions, the main controller 201 can control the surgical microscope 10 (the illumination optical system 30, the observation optical system 40, etc.) based on the selected photographing conditions. For example, the main controller 201 can control the surgical microscope 10 so as to reproduce the selected photographing conditions. This makes it possible to reproduce the display mode of the image when the values ​​of the image parameters selected by the parameter selector 2122 are applied.

[0140] For image capturing conditions (environmental conditions, conditions of the subject's eye, etc.) other than the controllable conditions of the surgical microscope 10, for example, the parameter determination unit 2125 executes processing based on the values ​​of the image parameters and the image capturing conditions selected respectively. This processing may be a calculation processing based on a predetermined algorithm.

[0141] In some aspects, a correspondence relationship (graph, table, etc.) between a change in the photographing condition (environmental condition, subject eye condition, etc.) and the value of the image parameter is prepared in advance. The parameter determination unit 2125 can compare the current photographing condition with the selected photographing condition and determine the value of the image parameter based on the comparison result (change amount of the photographing condition, etc.) and the correspondence relationship.

[0142] In some aspects, instead of preparing the above-mentioned correspondence relationship, a system (artificial intelligence engine) that learns the relationship between the change in the shooting conditions (environmental conditions, test eye conditions, etc.) and the value of the image parameter by machine learning is used. This artificial intelligence engine includes, for example, a neural network constructed by machine learning with the shooting conditions and the value of the image parameter as input and the new value of the image parameter as output. This artificial intelligence engine is trained to output the optimal image parameter value according to the change in the shooting conditions based on the value of the given image parameter. The parameter determination unit 2125 includes such an artificial intelligence engine, and inputs the selected image parameter value and shooting condition to this artificial intelligence engine. The image parameter value output from this artificial intelligence engine is the result obtained by the parameter determination unit 2125.

[0143] The image processing unit 211 (211A) can apply image processing using the values ​​of the image parameters determined by the parameter determination unit 2125 to the moving image (third moving image) generated by the surgical microscope 10. As described above, the third moving image may be any moving image, and may be, for example, the above-mentioned second moving image, a moving image acquired in another medical procedure on the same subject, a moving image acquired in a medical procedure on another subject, etc.

[0144] According to this example, the values ​​of the image parameters can be adjusted (corrected) according to differences in the shooting conditions, so that it is possible to easily provide a third moving image that is expressed in a manner close to the previously achieved good display manner (color tone, brightness, contrast, etc.) regardless of differences in the shooting conditions.

[0145] Next, an example shown in Fig. 9 will be described. In this example, image processing is applied to only some of the still images (frames) included in a moving image, thereby reducing resources and time required for image processing, and optimizing the quality of the image of the site of interest in observing the subject's eye.

[0146] The image processing unit 211B shown in FIG. 9 creates multiple processed partial images by applying the first image processing to a part (partial image) of a still image included in the first moving image generated by the surgical microscope 10. In this example, the multiple processed partial images are treated as multiple processed images. The main control unit 201 causes the display device 3 to display multiple images each including the multiple processed partial images created. Each displayed image may be a corresponding processed partial image, or a wider area image including the corresponding processed partial image. This wider area image may be, for example, an image in which a partial image in the corresponding still image is replaced with the processed partial image. In this way, by displaying multiple processed partial images, the user can select a processed partial image in which the part of interest is best depicted.

[0147] An image processing unit 211B shown in Fig. 9 is an example of the image processing unit 211 in Fig. 4. The image processing unit 211B of this example includes a processed image creation unit 2111 and a video processing unit 2112, similar to the image processing unit 211A in Fig. 5. The processed image creation unit 2111 and the video processing unit 2112 in this example may be similar to the processed image creation unit 2111 and the video processing unit 2112 in the example in Fig. 5, respectively, unless otherwise specified.

[0148] The image processing unit 211B further includes a partial image specifying unit 2113A. The partial image specifying unit 2113A applies segmentation for specifying an image of a predetermined part of the subject's eye to a still image included in the first moving image, thereby specifying a partial image in the still image. In general, segmentation is a process for specifying a partial region in an image. The segmentation may include any known image processing technique, and may include, for example, image processing such as edge detection and / or segmentation using machine learning (for example, deep learning).

[0149] The processed image creation unit 2111 of this example applies the first image processing to the partial image specified by the partial image specification unit 2113A. That is, the application range of the first image processing by the processed image creation unit 2111 of this example is limited to the partial image specified by the partial image specification unit 2113A.

[0150] Furthermore, the partial image specifying unit 2113A can also apply the same segmentation to the second moving image generated by the surgical microscope 10 after the user selects the processed image. More specifically, the partial image specifying unit 2113A first applies segmentation to each still image included in the second moving image (or each still image selected by thinning processing or the like (same below)) to specify an image of the same part of interest.

[0151] In some aspects, segmentation of still images in the second sequence may be performed in the same manner as segmentation of still images in the first sequence, such that images of the same region of interest are identified in each still image in the second sequence.

[0152] In some aspects, the ophthalmologic observation device 1 has a function of monitoring the movement of the subject's eye by analyzing the moving image generated by the surgical microscope 10. The partial image specifying unit 2113A stores the position (referred to as the reference position) of the subject's eye when a still image (segmented and referred to as a reference still image) included in the first moving image is obtained. The partial image specifying unit 2113A also stores information indicating the range (partial image range) of the partial image in the still image included in the first moving image. When the generation of the second moving image starts, each still image (referred to as a target still image) included in the second moving image and the position (referred to as a target position) of the subject's eye when the target still image is obtained are input to the partial image specifying unit 2113A. The partial image specifying unit 2113A determines the deviation of the target position from the reference position, and specifies the range of the partial image in the target still image by moving the partial image range by the deviation. According to this example, even in the case of areas that are difficult to segment (e.g., areas with small differences in brightness or color from the surroundings, etc.), tracking of partial images in the second moving image (from which frames are obtained one after another) can be performed in real time.

[0153] According to this example of performing such processing, the partial image specifying unit 2113A can sequentially specify partial images of still images included in the second video sequence by applying segmentation to the second video sequence. Furthermore, the image processing unit 210B (video processing unit 2112) can sequentially apply the second image processing to the partial images specified from the still images included in the second video sequence. This allows the image parameter values ​​applied to the processed partial images selected by the user to also be applied to the second video sequence, making it possible to observe the second video sequence in which the site of interest is suitably depicted.

[0154] Next, an example shown in Fig. 10 will be described. As in the example of Fig. 9, in this example, image processing is applied to only some of the still images (frames) included in a moving image, thereby reducing resources and time required for image processing, and optimizing the quality of the image of the site of interest in observing the subject's eye.

[0155] The image processing unit 211C shown in FIG. 10 creates a plurality of processed partial images by applying the first image processing to a part (partial image) of a still image included in the first moving image generated by the surgical microscope 10. In this example, the plurality of processed partial images are treated as a plurality of processed images. The main control unit 201 causes the display device 3 to display a plurality of images including the created plurality of processed partial images. Each displayed image may be a corresponding processed partial image, or may be a wider image including the corresponding processed partial image. This wider image may be, for example, an image in which a partial image in the corresponding still image is replaced with the processed partial image. In this way, by displaying a plurality of processed partial images, the user can select a processed partial image in which the site of interest is best depicted. This point is similar to the example of FIG. 9, but this example differs from the example of FIG. 9 in the method of identifying the partial image.

[0156] An image processing unit 211C shown in Fig. 10 is an example of the image processing unit 211 in Fig. 4. The image processing unit 211C of this example includes a processed image creation unit 2111 and a video processing unit 2112, similar to the image processing unit 211A in Fig. 5. The processed image creation unit 2111 and the video processing unit 2112 in this example may be similar to the processed image creation unit 2111 and the video processing unit 2112 in the example in Fig. 5, respectively, unless otherwise specified. The image processing unit 211C further includes a partial image specification unit 2113B.

[0157] 10 is an example of the control unit 200 in FIG. 3. The control unit 200A in this example includes a main control unit 201 and a storage unit 202, similar to the control unit 200 in FIG. 3. The main control unit 201 and the storage unit 202 in this example may be similar to the main control unit 201 and the storage unit 202 in the example in FIG. 3, unless otherwise specified. The control unit 200A further includes a graphical user interface (GUI) control unit 203.

[0158] The main controller 201 causes the display device 3 to display the first moving image (or a still image included in the first moving image (hereinafter the same)) generated by the surgical microscope 10. The GUI controller 203 causes the display device 3 to display a GUI for designating a partial region in the first moving image. The GUI is, for example, an image of a figure having a shape and dimensions similar to the site of interest. As an example, the site of interest is a pupil, and the GUI is a circular or elliptical image. The user can change the position, dimensions, and shape of the GUI, for example, by using the operation device 2. This allows the user to match the GUI to the outer edge of the pupil image in the first moving image. After the GUI is adjusted to the image of the site of interest, the GUI controller 203 can track the GUI in accordance with the movement of the subject's eye in the first moving image. The partial image specification unit 2113B specifies the range specified by the GUI (for example, the range surrounded by the GUI (and a predetermined range around it)) as the partial region.

[0159] The processed image creation unit 2111 of this example applies the first image processing to the partial image specified by the partial image specification unit 2113B. That is, the application range of the first image processing by the processed image creation unit 2111 of this example is limited to the partial image specified by the partial image specification unit 2113B.

[0160] Furthermore, the partial image specifying section 2113B can specify a partial image in the second moving image generated by the surgical microscope 10 after the user has selected the processed image, for example, in the same manner as the above tracking.

[0161] According to this example in which such processing is performed, the partial image specifying unit 2113B can sequentially specify partial images corresponding to the site of interest in still images included in the second video sequence by applying segmentation to the second video sequence. Furthermore, the image processing unit 210C (video processing unit 2112) can sequentially apply the second image processing to the partial images specified from the still images included in the second video sequence. This allows the values ​​of the image parameters applied to the processed partial images selected by the user to be applied to the second video sequence as well, making it possible to observe the second video sequence in which the site of interest is suitably depicted. Furthermore, in this example, the range specified by the user himself is set in the partial images, so that the range according to the user's preference can be expressed in a manner according to the user's preference.

[0162] <Operation / Usage form> Several examples of the operation and usage of the ophthalmologic observation device 1 will be described.

[0163] <First example> A first example of the operation and usage of the ophthalmologic observation device 1 will be described with reference to Fig. 11 to Fig. 12E. Any of the above-mentioned processes, operations, and usage can be combined with this example.

[0164] (S1: Start generating and displaying live images) First, the user performs a predetermined operation using the operation device 2 to start the generation and display of a live image of the subject's eye by the ophthalmic observation device 1. Specifically, the surgical microscope 10 generates digital image data (video) of the subject's eye by the imaging elements 62L and 62R while illuminating the subject's eye by the illumination optical system 30. The generated video (live image 301) is displayed in real time on the display device 3 (see FIG. 12A). That is, the video acquired by the surgical microscope 10 is displayed as a live image on the display device 3. The user can perform surgery while observing this live image. This live image corresponds to the first moving image described above.

[0165] (S2: Switch to image processing mode) Next, the user switches the operation mode of the ophthalmic observation device 1 to an image processing mode by performing a predetermined operation using the operation device 2. The image processing mode is an operation mode for processing a live image displayed by the ophthalmic observation device 1.

[0166] (S3: Capture frame) When the operation mode transitions to the image processing mode, the ophthalmologic observation device 1 captures a frame (still image) of a live image.

[0167] The number of frames to be captured is arbitrary. When one frame is captured, this frame is subjected to the following processing. When two or more frames are captured, the ophthalmic observation device 1 (for example, the data processing unit 210) can select one frame from these frames or generate one still image. For example, the ophthalmic observation device 1 can select one frame by calculating image quality evaluation values ​​of two or more captured frames and comparing them. As another example, the ophthalmic observation device 1 can display two or more captured frames on the display device 3 and select one frame specified by the user using the operation device 2. As yet another example, the ophthalmic observation device 1 can create one frame by synthesizing two or more captured frames with a predetermined image processing.

[0168] (S4: First image processing) The data processing unit 210 (image processing unit 211, processed image creation unit 2111) applies a first image process using a plurality of different values ​​of one or more image parameters to the frame captured in step S3. This creates a plurality of processed images based on the captured frame.

[0169] In the example shown in FIG. 12B, each of K image processes included in the first image process is applied to a frame (still image) 302 captured from a live image 301. I image parameters (I types) are used for the K image processes (I is an integer equal to or greater than 1). J values ​​are prepared for each image parameter (i-th image parameter; i=1, . . . , I) (J is an integer equal to or greater than 2). The number of prepared values ​​J may be equal or different for all image parameters. In the former case, K=I×J. In the latter case, K=Σ[J(i)]. Here, J(i) indicates the number of values ​​in the i-th image parameter, and Σ is the sum with respect to i. The j-th value of the i-th image parameter is indicated by P(i, j). A plurality of processed images 303-k are obtained by such a first image process. Here, k=1, . . . , K, and K is an integer equal to or greater than 2.

[0170] Here, the main control unit 201 or the data processing unit 210 associates each of the multiple processed images with the values ​​(one or more values) of the image parameters used to create the processed image and records them. For example, in the example of Fig. 12B, each processed image 303-k is associated with one or more values ​​P(i, j) of one or more image parameters used to create the processed image 303-k. Such information that associates the processed image with the values ​​of the image parameters is called associated information.

[0171] (S5: Create thumbnails of the processed images) Next, the data processing unit 210 (image processing unit 211) creates thumbnails of each of the multiple processed images created in step S4.

[0172] (S6: Display multiple thumbnails) Next, the main control unit 201 causes the plurality of thumbnails created in step S5 to be displayed on the display device 3. In this example, as shown in Fig. 12C, a plurality of thumbnails (thumbnail group) 303 arranged in a predetermined array are displayed on a live image 301.

[0173] The number of thumbnails displayed at one time is arbitrary; for example, all thumbnails created in step S5 may be presented at one time, or a portion (e.g., a predetermined number) of all thumbnails created in step S5 may be presented at one time. Also, the number of thumbnails presented at one time may be changeable. When only a portion of all thumbnails created in step S5 are presented at one time, an operation can be performed to switch the thumbnails presented. This operation may be, for example, page switching or scrolling.

[0174] (S7: Select thumbnail) The user compares the multiple thumbnails displayed in step S6 and selects the desired thumbnail. This selection operation is performed using the instruction receiving unit (for example, a foot switch included in the operation device 2) described above. In the example shown in Fig. 12D, one thumbnail 304 is selected from the multiple thumbnails 303.

[0175] (S8: Second image processing) The main control unit 201 or the data processing unit 210 refers to the above-mentioned related information to identify the values ​​of the image parameters associated with the processed image corresponding to the thumbnail selected in step S7.

[0176] Furthermore, the data processing unit 210 (image processing unit 211, moving image processing unit 2112) processes the live image generated by the surgical microscope 10 in real time using the identified image parameter values ​​(second image processing). The live image processed in real time is displayed in real time on the display device 3 by the main control unit 201 (end). The live image generated and displayed at this stage corresponds to the second moving image described above (live image 305 in FIG. 12E).

[0177] The user can perform surgery while observing a live image 305 to which the same image processing as the processed image selected by the user has been applied.

[0178] When the parameter processing unit 212 (recording unit) described above is provided, the values ​​of image parameters previously applied can be read out and reapplied. At this time, the values ​​of image parameters previously adopted by the user can be selectively read out and reapplied, or the values ​​of image parameters matching the attributes of the medical procedure currently being performed (e.g., the type of surgery) can be selectively read out and reapplied. In addition, the values ​​of image parameters matching the phase of the medical procedure currently being performed can be selectively read out and reapplied, or multiple values ​​matching multiple phases of the medical procedure can be sequentially reapplied.

[0179] When performing anterior segment surgery, for example, color parameters, brightness parameters, contrast parameters, gain parameters, etc. are used as image parameters. This allows the user to observe parts such as the cornea, iris, pupil, and crystalline lens in a display mode of their choice, for example, in cataract surgery, and also to clearly grasp the incision, side port, anterior capsule incision site in CCC, emulsification and aspiration state of the crystalline lens, position and orientation of the IOL, etc. Furthermore, such a preferred image display mode can be realized simply and quickly.

[0180] When performing vitreous surgery or posterior segment surgery, image parameters such as gamma parameters, gain parameters, color temperature parameters, white balance parameters, RGB balance parameters, etc. are used. This makes it possible to highlight floaters, opacities, proliferative membranes, etc. in the vitreous body, improving the efficiency of surgery and preventing / reducing surgical errors.

[0181] <Second example> A second example of the operation and usage of the ophthalmologic observation device 1 will be described with reference to Fig. 13 to Fig. 14G. Any of the above-mentioned processes, operations, and usage can be combined with this example.

[0182] (S11: Start generating and displaying live images) First, the user performs a predetermined operation using the operation device 2 to start the generation and display of a live image of the subject's eye by the ophthalmic observation device 1. Specifically, the surgical microscope 10 generates digital image data (video) of the subject's eye by the imaging elements 62L and 62R while illuminating the subject's eye by the illumination optical system 30. The generated video (live image 401) is displayed in real time on the display device 3 (see FIG. 14A). That is, the video acquired by the surgical microscope 10 is displayed as a live image on the display device 3. The user can perform surgery while observing this live image. This live image corresponds to the first moving image described above.

[0183] (S12: Switch to image processing mode) Next, the user switches the operation mode of the ophthalmic observation device 1 to an image processing mode by performing a predetermined operation using the operation device 2. The image processing mode is an operation mode for processing a live image displayed by the ophthalmic observation device 1.

[0184] (S13: Capture frame) When the operation mode transitions to the image processing mode, the ophthalmologic observation device 1 captures a frame (still image) of a live image.

[0185] The number of frames to be captured is arbitrary. When one frame is captured, this frame is subjected to the following processing. When two or more frames are captured, the ophthalmic observation device 1 (for example, the data processing unit 210) can select one frame from these frames or generate one still image. For example, the ophthalmic observation device 1 can select one frame by calculating image quality evaluation values ​​of two or more captured frames and comparing them. As another example, the ophthalmic observation device 1 can display two or more captured frames on the display device 3 and select one frame specified by the user using the operation device 2. As yet another example, the ophthalmic observation device 1 can create one frame by synthesizing two or more captured frames with a predetermined image processing.

[0186] (S14: Set partial image) Next, the ophthalmologic observation device 1 (the image processing unit 211, the partial image specifying unit 2113A or 2113B) sets the partial image of the frame captured in step S13.

[0187] The process of this step is performed automatically or manually. In the case of automatic, the partial image specifying unit 2113A in FIG. 9 applies segmentation to the frame captured in step S13 to specify a partial image (image area surrounded by a frame 402 shown in FIG. 14B). In the case of manual, for example, the main control unit 201 causes the display device 3 to display the frame captured in step S13, and the GUI control unit 203 causes a predetermined GUI to be displayed on this frame. The user uses this GUI to specify a partial area of ​​the frame. The partial image specifying unit 2113B specifies the range specified by the GUI (for example, the range surrounded by the GUI (and a predetermined range around it)) as a partial area (image area surrounded by a frame 402 shown in FIG. 14B). As a result, for example, the partial image 403 shown in FIG. 14C is obtained.

[0188] (S15: First image processing) The data processing unit 210 (image processing unit 211, processed image creation unit 2111) applies a first image process using a plurality of different values ​​of one or more image parameters to the partial image obtained in step S14. As a result, a plurality of processed partial images based on this partial image are created.

[0189] In the example shown in FIG. 14D, each of K image processes included in the first image process is applied to the partial image 403. I image parameters (I types) are used for the K image processes (I is an integer equal to or greater than 1). J values ​​are prepared for each image parameter (i-th image parameter; i=1, . . . , I) (J is an integer equal to or greater than 2). The number of prepared values ​​J may be equal or different for all image parameters. In the former case, K=I×J. In the latter case, K=Σ[J(i)]. Here, J(i) indicates the number of values ​​in the i-th image parameter, and Σ is the sum with respect to i. The j-th value of the i-th image parameter is indicated by Q(i, j). A plurality of processed partial images 404-k are obtained by such a first image process. Here, k=1, . . . , K, and K is an integer equal to or greater than 2.

[0190] Here, the main control unit 201 or the data processing unit 210 associates and records the values ​​(one or more values) of the image parameters used to create each of the multiple processed partial images (or multiple processed images). For example, in the example of Fig. 14D, each processed partial image 404-k (or the processed image corresponding thereto) is associated with one or more values ​​Q(i, j) of one or more image parameters used to create this processed partial image 404-k. Such information that associates the processed partial image (or processed image) with the values ​​of the image parameters is called associated information.

[0191] (S16: Create thumbnails of the processed images) Next, the data processing unit 210 (image processing unit 211) creates thumbnails of each of the multiple processed partial images created in step S15.

[0192] (S17: Display multiple thumbnails) Next, the main control unit 201 causes the multiple thumbnails created in step S16 to be displayed on the display device 3. In this example, as shown in Fig. 14E, multiple thumbnails (thumbnail group) 405 arranged in a predetermined array are displayed on a live image 401.

[0193] The number of thumbnails displayed at one time is arbitrary; for example, all thumbnails created in step S16 may be presented at one time, or a portion (e.g., a predetermined number) of all thumbnails created in step S16 may be presented at one time. Also, the number of thumbnails presented at one time may be changeable. When only a portion of all thumbnails created in step S16 are presented at one time, an operation can be performed to switch the thumbnails presented. This operation may be, for example, page switching or scrolling.

[0194] (S18: Select thumbnail) The user compares the multiple thumbnails displayed in step S17 and selects a desired thumbnail. This selection operation is performed using the instruction receiving unit (for example, a foot switch included in the operation device 2) described above. In the example shown in Fig. 14F, one thumbnail 406 is selected from the multiple thumbnails 405.

[0195] (S19: Second image processing) The main control unit 201 or the data processing unit 210 refers to the above-mentioned related information to identify the values ​​of the image parameters associated with the processed partial image corresponding to the thumbnail selected in step S18.

[0196] Furthermore, the data processing unit 210 (image processing unit 211, moving image processing unit 2112) processes the live image generated by the surgical microscope 10 in real time using the specified image parameter values ​​(second image processing). The application range of the second image processing may be only the area of ​​the live image (its frame) corresponding to the frame 402 in FIG. 14B, or may be the entire live image (its frame). In the former case, for example, the area of ​​the live image corresponding to the frame 402 is sequentially specified by the above-mentioned tracking. The live image processed in real time is displayed in real time on the display device 3 by the main control unit 201 (end). Note that the live image generated and displayed at this stage corresponds to the above-mentioned second moving image. The live image 407 in FIG. 12E is an example of a live image displayed in this way. In the live image 407, the second image processing is applied only to the area corresponding to the frame 402 (the area surrounded by the frame 408).

[0197] The user can perform surgery while observing a live image 407 to which the same image processing as the processed image selected by the user has been applied.

[0198] When the parameter processing unit 212 (recording unit) described above is provided, the values ​​of image parameters previously applied can be read out and reapplied. At this time, the values ​​of image parameters previously adopted by the user can be selectively read out and reapplied, or the values ​​of image parameters matching the attributes of the medical procedure currently being performed (e.g., the type of surgery) can be selectively read out and reapplied. In addition, the values ​​of image parameters matching the phase of the medical procedure currently being performed can be selectively read out and reapplied, or multiple values ​​matching multiple phases of the medical procedure can be sequentially reapplied.

[0199] When performing anterior segment surgery, for example, color parameters, brightness parameters, contrast parameters, gain parameters, etc. are used as image parameters. This allows the user to observe parts such as the iris, pupil, and crystalline lens in a display mode of their choice, for example, in cataract surgery, and also allows the user to clearly grasp the incision, side port, anterior capsule incision site in CCC, emulsification and aspiration state of the crystalline lens, position and orientation of the IOL, etc. Furthermore, such a preferred image display mode can be realized simply and quickly.

[0200] When performing vitreous surgery or posterior segment surgery, image parameters such as gamma parameters, gain parameters, color temperature parameters, white balance parameters, RGB balance parameters, etc. are used. This makes it possible to highlight floaters, opacities, proliferative membranes, etc. in the vitreous body, improving the efficiency of surgery and preventing / reducing surgical errors.

[0201] <Modification> Several variations of the exemplary embodiment described above will now be described.

[0202] In the examples shown in Figures 12C, 12D, 14E, and 14F, a part of the image of the subject's eye is hidden by multiple thumbnails (processed image, processed partial image). To resolve this situation, multiple thumbnails can be displayed in the area where the image of the subject's eye is not displayed. Examples of processes that can be adopted for this purpose include reducing the display size of the multiple thumbnails, reducing the display size of each thumbnail, changing the arrangement of the multiple thumbnails, and reducing the number of thumbnails displayed at one time. In addition, the range of the image of the subject's eye can be detected, and multiple thumbnails can be displayed in the other area.

[0203] An example of a configuration that can be adopted to realize such an operation is shown in Fig. 15. A data processing unit 210C in Fig. 15 is an example of the data processing unit 210 in Fig. 3. The data processing unit 210C in this example includes a monitoring processing unit 213 in addition to an image processing unit 211. The image processing unit 211 has the same configuration and executes the same operation as those in the above-mentioned embodiment.

[0204] The monitoring processor 213 executes data processing for monitoring the movement of the subject's eye (monitoring unit). The monitoring processor 213 detects feature points of the subject's eye, for example, by analyzing frames of a moving image generated by the surgical microscope 10. The feature points may be any landmark, for example, the pupil (center, outer edge, etc.), corneal ring (outer edge of the iris), angle, optic disc, macula, blood vessels, etc. The monitoring processor 213 sequentially analyzes frames sequentially generated as a real-time moving image (first moving image) to detect the movement of the feature points in the moving image (change in the position of the feature points over time) in real time.

[0205] The main control unit 201 can change the display state of the multiple processed images (multiple processed partial images, multiple thumbnails) displayed together with the real-time moving image based on the output from the monitoring processing unit 213. This display state change control is performed, for example, so as to display the multiple processed images in an area where the image of the subject's eye is not displayed. For example, the main control unit 201 can execute control to reduce the display size of the multiple processed images, control to reduce the display size of each processed image, control to change the arrangement of the multiple processed images, control to reduce the number of thumbnails displayed at one time, control to stop the display of the multiple processed images (control to not display the multiple processed images), and the like.

[0206] According to such a modified example, the display state of the plurality of processed images can be (dynamically) changed according to the movement of the subject's eye, so that the plurality of processed images do not interfere with the observation of the image of the subject's eye. Note that the configuration (monitoring unit) for detecting the movement of the subject's eye is not limited to the above-mentioned configuration and processing, and may be any configuration or processing.

[0207] Fig. 16 shows another modified example. While the modified example in Fig. 15 focuses on the movement of the subject's eye, this modified example focuses on the occurrence of an abnormality in the subject's eye.

[0208] A data processing unit 210D in Fig. 16 is an example of the data processing unit 210 in Fig. 3. The data processing unit 210D in this example includes an abnormality detection unit 214 in addition to an image processing unit 211. The image processing unit 211 has the same configuration and executes the same operation as those in the above-mentioned embodiment.

[0209] The abnormality detection unit 214 executes data processing to detect an abnormality in the subject's eye. The type of abnormality to be detected may be any type, such as bleeding or a wound. The abnormality detection unit 214 detects an abnormality by, for example, analyzing frames of a moving image generated by the surgical microscope 10. For example, bleeding is detected by a change in color of the image (such as an increase in the red area).

[0210] In some aspects, the anomaly detection unit 214 may include a system (artificial intelligence engine) constructed by machine learning using a training data set including surgical images and the like. The artificial intelligence engine includes, for example, a neural network (typically, a convolutional neural network) constructed by machine learning with a surgical image as an input and a probability of occurrence of a predetermined anomaly as an output. The anomaly detection unit 214 of this example sequentially inputs frames of a real-time moving image (first moving image) generated by the surgical microscope 10 to the artificial intelligence engine. The artificial intelligence engine sequentially outputs an anomaly occurrence probability based on the input frames. The anomaly detection unit 214 performs anomaly detection based on the anomaly occurrence probability sequentially output. For example, the anomaly detection unit 214 determines that an anomaly has been detected when the anomaly occurrence probability sequentially output exceeds a predetermined threshold. As another example, the anomaly detection unit 214 can perform anomaly detection based on a change (for example, a rate of change, an amount of change) in the anomaly occurrence probability sequentially output.

[0211] The main control unit 201 can change the display state of the multiple processed images (multiple processed partial images, multiple thumbnails) displayed together with the real-time moving image based on the output from the abnormality detection unit 214. This display state change control is executed, for example, to display the multiple processed images in an area where the image of the subject's eye is not displayed, or to display the multiple processed images in an area other than the area where the abnormality is detected. For example, the main control unit 201 can execute control to reduce the display size of the multiple processed images, control to reduce the display size of each processed image, control to change the arrangement of the multiple processed images, control to reduce the number of thumbnails displayed at one time, control to stop the display of the multiple processed images (control to not display the multiple processed images), and the like.

[0212] According to such a modified example, the display state of the plurality of processed images can be (dynamically) changed in response to the occurrence of an abnormality in the subject's eye, so that the plurality of processed images do not interfere with the observation of the image of the subject's eye (particularly, the location of the abnormality). Note that the configuration (monitoring unit) for detecting an abnormality in the subject's eye is not limited to the configuration and processing described above, and may be any configuration or processing.

[0213] The ophthalmic observation device 1 of the above embodiment is configured to apply the first image processing to a still image (frame) included in the first moving image to generate and display a plurality of processed images. In contrast, some exemplary aspects may be configured to apply the first image processing sequentially to each still image (each frame) included in the first moving image to generate and display a plurality of processed images (a plurality of processed moving images). In such an aspect, a plurality of processed moving images can be displayed side by side or sequentially. It is also possible to display a still image (processed still image, processed frame) included in at least a portion of the plurality of processed moving images. This aspect is effective in optimizing the display mode of a moving subject's eye or optimizing the display mode of a moving object (floating matter, turbidity, proliferation membrane, liquid flow, blood flow, etc.). On the other hand, in order to perform such processing in real time, a larger amount of resources are required than in the ophthalmic observation device 1 of the above embodiment. Therefore, in order to reduce the processing load when handling processed videos, any method of reducing the processing load may be applied, such as reducing the number of processed videos generated, reducing the number of processed videos (thumbnails) to be processed, reducing the number of processed videos (thumbnails) to be displayed, or performing frame thinning processing.

[0214] <Ophthalmological image processing device> An ophthalmic image processing device according to an exemplary embodiment will be described. The ophthalmic image processing device is configured to process an image of a subject's eye. Any item (function, configuration, processing, operation, usage form, etc.) related to the ophthalmic observation device 1 of the above embodiment can be combined with the following exemplary ophthalmic image processing device.

[0215] An example of the configuration of the ophthalmic image processing device of this example is shown in Fig. 17. Among the components of the ophthalmic image processing device 500 in Fig. 17, the components other than the moving image receiving unit 501 may be configured in the same manner as the corresponding components in the ophthalmic observation device 1 according to the above embodiment, and detailed description thereof will be omitted unless otherwise stated.

[0216] A control unit 502 of the ophthalmic image processing device 500 corresponds to the control unit 200 of the ophthalmic observation device 1 of the above embodiment. An image processing unit 503 of the ophthalmic image processing device 500 corresponds to the data processing unit 210 (image processing unit 211) of the ophthalmic observation device 1 of the above embodiment. A user interface (UI) 504 of the ophthalmic image processing device 500 corresponds to the operation device 2 and the display device 3 of the ophthalmic observation device 1 of the above embodiment.

[0217] The moving image receiving unit 501 receives a moving image of the subject's eye. The moving image receiving unit 501 receives the moving image directly or indirectly from the surgical microscope 10. For example, the moving image receiving unit 501 is connected to the surgical microscope 10 via a communication line or cable. Alternatively, the moving image receiving unit 501 is connected to a device (buffer) in which the moving image generated by the surgical microscope 10 is (temporarily) stored via a communication line or cable.

[0218] The video receiving unit 501 receives the first video of the above embodiment. The control unit 502 sends the first video received by the video receiving unit 501 to the image processing unit 503.

[0219] The image processing unit 503 executes the processing described in the above embodiment to apply a first image processing using multiple different values ​​of predetermined image parameters to still images included in the first moving image, thereby creating multiple processed images.

[0220] The control unit 502 (display control unit) causes a plurality of processed images created by the image processing unit 503 to be displayed on the UI 504 (first display device).

[0221] In addition to such a series of operations, the ophthalmic image processing device 500 can execute the following processes, similar to the ophthalmic observation device 1 of the above embodiment. The user can give an instruction to select at least one processed image from among a plurality of processed images displayed on the UI 504. This instruction can be given in the same manner as in the ophthalmic observation device 1 of the above embodiment, for example, by using the UI 504 (instruction receiving unit).

[0222] The image processing unit 503 applies second image processing based on at least one value of image parameters corresponding to at least one processed image designated by the user to the moving image of the subject's eye (second moving image) accepted by the moving image accepting unit 501 after the selection based on the user's instruction is made. This processing (second image processing) is executed in the same manner as in the case of the ophthalmic observation device 1 of the above embodiment.

[0223] The control unit 502 (display control unit) causes the UI 504 (second display device) to display the second moving image to which the second image processing has been applied.

[0224] According to such an ophthalmic image processing device 500, it is possible to achieve the same actions and effects as those of the ophthalmic observation device 1 of the above embodiment. Moreover, by combining the items (functions, configurations, processing, operations, usage patterns, etc.) related to the ophthalmic observation device 1 of the above embodiment with the ophthalmic image processing device 500, the ophthalmic image processing device 500 obtained as a result thereof can achieve the actions and effects corresponding to the combined items.

[0225] <Ophthalmological image processing method> The exemplary embodiment (for example, the above-mentioned ophthalmic observation device 1 or the ophthalmic image processing device 500) provides a method for processing an ophthalmic image (an image of an eye to be examined). Any feature related to the ophthalmic observation device 1 of the above-mentioned embodiment can be combined with the following exemplary ophthalmic image processing method, and any feature related to the ophthalmic image processing device 500 of the above-mentioned embodiment can be combined with the following exemplary ophthalmic image processing method.

[0226] In the ophthalmologic image processing method of the exemplary embodiment, first, a first moving image of the subject's eye is received. Next, a first image process using a plurality of different values ​​of a predetermined image parameter is applied to each of still images included in the first moving image to create a plurality of processed images. Next, the created plurality of processed images are displayed. Next, an instruction for selecting at least one processed image from the displayed plurality of processed images is received. After the selection of at least one processed image based on the instruction, a second moving image of the subject's eye is received. Next, a second image process based on at least one value of the image parameter corresponding to the selected at least one processed image is applied to the second moving image. Next, the second moving image to which the second image process has been applied is displayed. Such a series of steps are described as the operation and usage form of the ophthalmologic observation device 1 of the above embodiment (FIG. 11, FIG. 12A to FIG. 12E, FIG. 13, FIG. 14A to FIG. 14G, etc.).

[0227] According to such an ophthalmic image processing method, it is possible to achieve the same actions and effects as those of the ophthalmic observation device 1 and the ophthalmic image processing device 500 of the above-mentioned embodiment. Moreover, by combining the matters related to the ophthalmic observation device 1 or the ophthalmic image processing device 500 of the above-mentioned embodiment with the ophthalmic image processing method, the ophthalmic image processing method obtained as a result thereof can achieve the actions and effects corresponding to the combined matters.

[0228] <Program> The exemplary embodiment provides a program for causing a computer to execute the above-mentioned ophthalmic image processing method. It is possible to combine the features related to the ophthalmic observation device 1 or the ophthalmic image processing device 500 of the above-mentioned embodiment with such a program.

[0229] According to such a program, it is possible to achieve the same actions and effects as those of the ophthalmic observation device 1 and the ophthalmic image processing device 500 of the above-mentioned embodiment. Moreover, by combining the items related to the ophthalmic observation device 1 or the ophthalmic image processing device 500 of the above-mentioned embodiment with a program, the resulting program can achieve the actions and effects corresponding to the combined items.

[0230] <Recording Media> The exemplary embodiment provides a computer-readable non-transitory recording medium having the above-mentioned program recorded therein. It is possible to combine the features related to the ophthalmic observation device 1 or the ophthalmic image processing device 500 of the above-mentioned embodiment with such a recording medium. The non-transitory recording medium may be in any form, and examples thereof include a magnetic disk, an optical disk, a magneto-optical disk, and a semiconductor memory.

[0231] Such a recording medium can provide the same actions and effects as those of the ophthalmic observation device 1 and the ophthalmic image processing device 500 of the above-mentioned embodiment. Furthermore, by combining the items related to the ophthalmic observation device 1 or the ophthalmic image processing device 500 of the above-mentioned embodiment with a recording medium, the resulting recording medium can provide the actions and effects corresponding to the combined items.

[0232] The above-described embodiment is merely an example for implementing the present invention. Anyone who wishes to implement the present invention may make any modifications, omissions, additions, substitutions, and the like within the scope of the gist of the present invention. [Explanation of symbols]

[0233] 1 Ophthalmic observation device 2 Control device 3 Display device 10 Surgical microscope 30 Illumination optical system 40 Observation Optical System 60 Imaging camera 200 Control section 201 Main control unit 203 GUI control section 210 Data Processing Unit 211 Image processing section 2111 Processing Image Creation Department 2112 Video processing unit 212 Parameter Processing Section 2121 Parameter memory section 2122 Parameter Selection Section 2123 Shooting condition record section 2124 Shooting condition selection section 2125 Parameter Determination Unit 2113A, 2113B Partial image identification section 221 Identifier Reception Department 222 Attribute information acquisition section

Claims

1. An ophthalmic observation device for observing an eye to be examined, comprising: a moving image generating unit that captures an image of the subject's eye and generates a first moving image; an image processing unit that applies a first image processing to each still image included in the first moving image, the first image processing using a plurality of different values ​​of a predetermined image parameter, to generate a plurality of processed images; a display control unit that causes a first display device to display the plurality of processed images; an instruction receiving unit that receives an instruction to select at least one processed image from the plurality of processed images displayed on the first display device; Including, the image processing unit applies a second image process based on at least one value of the image parameter corresponding to the at least one processed image to a second moving image generated by the moving image generating unit after the at least one processed image is selected using the instruction receiving unit; the display control unit causes a second display device to display the second moving image to which the second image processing has been applied; When two or more processed images among the plurality of processed images are selected using the instruction receiving unit, the image processing unit determines one value based on two or more values ​​of the image parameters corresponding to the two or more processed images, respectively, and applies image processing using the one value to the second moving image as the second image processing. Ophthalmic observation equipment.

2. a recording unit that records the one value of the image parameter used in the second image processing, 2. An ophthalmologic observation device according to claim 1.

3. The device further includes an identifier receiving unit that receives an identifier of a user, the recording unit records the one value of the image parameter in association with the identifier accepted by the identifier accepting unit.

3. An ophthalmologic observation device according to claim 2.

4. Further comprising an attribute information acquisition unit that acquires attribute information indicating attributes of a medical procedure for the subject's eye, the recording unit records the one value of the image parameter in association with the attribute information acquired by the attribute information acquisition unit; 4. An ophthalmologic observation device according to claim 2 or 3.

5. a selection unit that selects at least one value from among the values ​​of the image parameters previously recorded by the recording unit; the image processing unit applies image processing based on the at least one value selected by the selection unit to a third moving image generated by the moving image generation unit. An ophthalmologic observation device according to any one of claims 2 to 4.

6. the recording unit records a shooting condition when the second moving image was generated in association with the one value of the image parameter; The selection unit further selects an imaging condition associated with the at least one value selected by the selection unit; a determination unit that determines a value of the image parameter based on the at least one value selected by the selection unit and the shooting condition, the image processing unit applies image processing to the third moving image using the values ​​of the image parameters determined by the determination unit; the determination unit uses a relationship between a change in a shooting condition and a value of an image parameter, and applies a change from the shooting condition selected by the selection unit to the shooting condition of the third video image to the relationship, thereby adjusting the value of the at least one of the image parameters selected by the selection unit in response to a change from the shooting condition selected by the selection unit to the shooting condition of the third video image.

6. An ophthalmologic observation device according to claim 5.

7. the image processing unit applies the first image processing to a partial image that is a part of the still image included in the first moving image to generate a plurality of processed partial images as the plurality of processed images; The display control unit causes the first display device to display a plurality of images each including the plurality of processed portion images. An ophthalmologic observation device according to any one of claims 1 to 6.

8. The image processing unit includes a first partial image specifying unit that specifies the partial image by applying segmentation for specifying an image of a predetermined part of the subject's eye to the still image included in the first moving image.

8. An ophthalmologic observation device according to claim 7.

9. the first partial image identification unit applies the segmentation to the second video to sequentially identify partial images of still images included in the second video; the image processing unit sequentially applies the second image processing to the partial images identified from the still images included in the second moving image.

9. An ophthalmologic observation device according to claim 8.

10. the display control unit causes the first display device or the second display device to display the first moving image or a still image included in the first moving image; a graphical user interface for designating a partial area in the displayed first moving image or the still image included in the first moving image; the image processing unit sets the partial image based on the partial area specified using the user interface.

8. An ophthalmologic observation device according to claim 7.

11. the image processing unit includes a second partial image specifying unit that sequentially specifies partial images corresponding to the partial regions in still images included in the second moving image, the image processing unit sequentially applies the second image processing to the partial images identified from the still images included in the second moving image.

11. An ophthalmologic observation device according to claim 10.

12. The display control unit causes the first display device to display two or more processed images among the plurality of processed images or thumbnails of the two or more processed images side by side. An ophthalmologic observation device according to any one of claims 1 to 11.

13. The display control unit sequentially displays two or more processed images or thumbnails of the two or more processed images on the first display device. An ophthalmologic observation device according to any one of claims 1 to 11.

14. A monitoring unit for monitoring a movement of the subject's eye is further included, The display control unit changes a display state of the plurality of processed images based on an output from the monitoring unit. An ophthalmologic observation device according to any one of claims 1 to 13.

15. The apparatus further includes an abnormality detection unit that detects an abnormality in the subject's eye, The display control unit changes a display state of the plurality of processed images based on an output from the abnormality detection unit. An ophthalmologic observation device according to any one of claims 1 to 14.

16. The image parameters include one or more of a hue parameter, a brightness parameter, a contrast parameter, a gain parameter, a gamma parameter, a color temperature parameter, a white balance parameter, an RGB balance parameter, a gray balance parameter, an edge enhancement parameter, a shadow enhancement parameter, a sharpening parameter, and a high dynamic range parameter. An ophthalmologic observation device according to any one of claims 1 to 15.

17. An ophthalmologic image processing device that processes an image of a subject's eye, a moving image receiving unit that receives a first moving image of the subject's eye; an image processing unit that applies a first image processing to each still image included in the first moving image, the first image processing using a plurality of different values ​​of a predetermined image parameter, to generate a plurality of processed images; a display control unit that causes a first display device to display the plurality of processed images; an instruction receiving unit that receives an instruction to select at least one processed image from the plurality of processed images displayed on the first display device; Including, the image processing unit applies a second image processing based on at least one value of the image parameter corresponding to the at least one processed image to a second moving image of the subject's eye accepted by the moving image accepting unit after the at least one processed image is selected based on the instruction, the display control unit causes a second display device to display the second moving image to which the second image processing has been applied; When two or more processed images among the plurality of processed images are selected using the instruction receiving unit, the image processing unit determines one value based on two or more values ​​of the image parameters corresponding to the two or more processed images, respectively, and applies image processing using the one value to the second moving image as the second image processing. Ophthalmic imaging device.

18. An ophthalmologic image processing method for processing an image of a subject's eye, comprising: accepting a first moving image of the subject's eye; applying a first image processing to each still image included in the first moving image, the first image processing using a plurality of different values ​​of a predetermined image parameter, to generate a plurality of processed images; Displaying the plurality of processed images; accepting an instruction to select at least one processed image from the displayed plurality of processed images; receiving a second moving image of the subject's eye after the at least one processed image is selected based on the instruction; applying a second image processing to the second video sequence based on at least one value of the image parameter corresponding to the at least one processed image; displaying the second moving image to which the second image processing has been applied; when an instruction to select two or more processed images from the plurality of processed images is received, determining one value based on two or more values ​​of the image parameters corresponding to the two or more processed images, respectively, and applying image processing using the one value to the second moving image as the second image processing; Ophthalmic image processing methods.

19. A program causing a computer to execute the method of claim 18.

20. A non-transitory computer-readable recording medium having the program of claim 19 recorded thereon.

Images