Ophthalmological observation device, ophthalmological image processing device, ophthalmological image processing method, program, and recording medium

Abstract

To provide a novel technique for facilitating ophthalmological observation.SOLUTION: An ophthalmological observation device generates a first moving image by imaging a subject eye, creates a plurality of processed images by respectively applying first image processing using a plurality of values of prescribed different image parameters to a static image included in the first moving image, and displays the plurality of processed images. When selection instruction of a processed image is given, the ophthalmological observation device applies second image processing based on the value of an image parameter corresponding to a selected processed image to a second moving image generated after the selection instruction, and displays it. The ophthalmological observation device receives a user's identifier and records the value of the image parameter used for the second image processing, in association with the identifier.SELECTED DRAWING: Figure 7

Description

Technical Field

[0001] The present invention relates to an ophthalmic observation device, an ophthalmic image processing device, an ophthalmic image processing method, a program, and a recording medium.

Background Art

[0002] An ophthalmic observation device is a device for observing a patient's eye (referred to as the eye to be examined). Ophthalmic observation is performed to grasp the state of the eye to be examined in various scenes such as examinations, surgeries, and treatments.

[0003] Conventional ophthalmic observation devices provided an enlarged image obtained by an objective lens or a zoom optical system to the user via an eyepiece lens. However, in recent ophthalmic observation devices, there are some configured to capture an enlarged image obtained by an objective lens or a zoom optical system with an image sensor and display the obtained captured image (ophthalmic observation device of the first aspect). Examples of such ophthalmic observation devices include a slit lamp microscope, a surgical microscope, and a fundus camera. In addition, various ophthalmic examination devices such as a refractometer, a keratometer, a tonometer, a specular microscope, a wavefront analyzer, and a microperimeter are also provided with the function as an ophthalmic observation device of the first aspect.

[0004] Furthermore, in recent ophthalmic observation devices, there are some that use optical scanning (ophthalmic observation device of the second aspect). Examples of such ophthalmic devices include a scanning laser ophthalmoscope (SLO) and an optical coherence tomography (OCT) device.

[0005] Generally, an ophthalmic observation device provides a moving image of an eye to be examined to a user (e.g., a medical professional such as a doctor). The ophthalmic observation device of the first aspect is typically configured to perform video shooting using infrared light and / or visible light as illumination light, and real-time video display of the image obtained thereby. On the other hand, the ophthalmic observation device of the second aspect is typically configured to perform data collection by iterative light scanning, real-time image reconstruction based on sequentially collected data sets, and real-time video display of the sequentially reconstructed images. The real-time moving image provided in this way is called an observation image.

[0006] In order to provide a good observation image, it is necessary to adjust the image quality. However, the desired image quality varies depending on the user, and also varies depending on the type and phase of the examination or surgery. For example, some doctors prefer images with a reddish tint, while other doctors prefer images with a greenish tint. Also, cataract surgery, which is one of the most common ophthalmic surgeries, is performed in procedures such as alignment, incision creation, viscoelastic injection, capsulotomy (CCC), phacoemulsification aspiration, lens cortex aspiration, intraocular lens (IOL) insertion, IOL centering, viscoelastic removal, and wound closure. However, the image quality desired by the doctor may vary from phase to phase. Furthermore, there may be cases where the quality of the image of the site of interest is selectively enhanced. Also, the desired image quality may vary depending on the state of the eye to be examined.

[0007] As described above, the desired quality of the observation image is diverse. However, in conventional typical ophthalmic observation devices, the image quality adjustment was manually performed each time, which was very complicated and time-consuming, and was also one of the factors causing the lengthening of the examination and surgery time. On the other hand, although it is conceivable to automatically adjust the image quality, considering the diversity of the desired image quality, ultimately, manual adjustment has to be performed.

Prior Art Documents

Patent Documents

[0008]

Patent Document 1

[0009] One object of the present invention is to provide a new technique for facilitating ophthalmic observation. [Means for Solving the Problems]

[0010] Some exemplary embodiments are an ophthalmic observation device for observing an eye to be examined, including a moving image generation unit that captures the eye to be examined and generates a first moving image, an image processing unit that applies first image processing using a plurality of different values of predetermined image parameters to a still image included in the first moving image to create a plurality of processed images, and a display control unit that displays the plurality of processed images on a first display device.

[0011] The ophthalmic observation device according to some exemplary embodiments further includes an instruction reception unit that receives an instruction for selecting at least one processed image from among the plurality of processed images displayed on the first display device. The image processing unit applies second image processing based on at least one value of the image parameters corresponding to the at least one processed image to a second moving image generated by the moving image generation unit after the selection of the at least one processed image is made using the instruction reception unit, and the display control unit displays the second moving image to which the second image processing has been applied on a second display device.

[0012] In the ophthalmic observation device according to some exemplary embodiments, when one processed image among the plurality of processed images is selected using the instruction reception unit, the image processing unit applies image processing using one value of the image parameters corresponding to the one processed image as the second image processing to the second moving image.

[0013] In an ophthalmic observation apparatus according to some exemplary embodiments, when two or more of the plurality of processed images are selected using the instruction reception unit, the image processing unit applies image processing using one value of the image parameters corresponding to one of the two or more processed images as the second image processing to the second moving image.

[0014] In an ophthalmic observation apparatus according to some exemplary embodiments, when two or more of the plurality of processed images are selected using the instruction reception unit, the image processing unit determines one value based on two or more values of the image parameters respectively corresponding to the two or more processed images, and applies image processing using the one value as the second image processing to the second moving image.

[0015] The ophthalmic observation apparatus according to some exemplary embodiments further includes a recording unit that records the one value of the image parameters used for the second image processing.

[0016] The ophthalmic observation apparatus according to some exemplary embodiments further includes an identifier reception unit that receives an identifier of a user, and the recording unit records the one value of the image parameters in association with the identifier received by the identifier reception unit.

[0017] The ophthalmic observation apparatus according to some exemplary embodiments further includes an attribute information acquisition unit that acquires attribute information indicating an attribute of a medical act on the eye to be examined, and the recording unit records the one value of the image parameters in association with the attribute information acquired by the attribute information acquisition unit.

[0018] In an ophthalmic observation apparatus according to some exemplary embodiments, it further includes a selection unit that selects at least one value from among the values of the image parameters recorded by the recording unit in the past, and the image processing unit applies image processing based on the at least one value selected by the selection unit to a third moving image generated by the moving image generation unit.

[0019] In an ophthalmic observation apparatus according to some exemplary embodiments, the recording unit records the imaging conditions when the second moving image is generated in association with the one value of the image parameters, the selection unit further selects the imaging conditions associated with the at least one value selected by the selection unit, the ophthalmic observation apparatus further includes a determination unit that determines the value of the image parameters based on the at least one value and the imaging conditions respectively selected by the selection unit, and the image processing unit applies image processing using the value of the image parameters determined by the determination unit to the third moving image.

[0020] In an ophthalmic observation apparatus according to some exemplary embodiments, the image processing unit applies the first image processing to a partial image that is a part of the still image included in the first moving image to create a plurality of processed partial images as the plurality of processed images, and the display control unit causes the first display device to display a plurality of images each including the plurality of processed partial images.

[0021] In an ophthalmic observation apparatus according to some exemplary embodiments, the image processing unit includes a first partial image specifying unit that applies segmentation for specifying an image of a predetermined part of the eye to be examined to the still image included in the first moving image to specify the partial image.

[0022] In an ophthalmic observation apparatus according to some exemplary embodiments, the first partial image specifying unit sequentially specifies partial images of the still image included in the second moving image by applying the segmentation to the second moving image, and the image processing unit sequentially applies the second image processing to the partial images specified from the still image included in the second moving image.

[0023] In an ophthalmic observation apparatus according to some exemplary embodiments, the display control unit causes the first moving image or a still image included in the first moving image to be displayed on the first display device or the second display device. The ophthalmic observation apparatus further includes a graphical user interface for designating a partial region in the displayed first moving image or the still image included in the first moving image. The image processing unit sets the partial image based on the partial region designated using the user interface.

[0024] In an ophthalmic observation apparatus according to some exemplary embodiments, the image processing unit includes a second partial image specifying unit that sequentially specifies a partial image corresponding to the partial region in a still image included in the second moving image. The image processing unit sequentially applies the second image processing to the partial image specified from the still image included in the second moving image.

[0025] In an ophthalmic observation apparatus according to some exemplary embodiments, the display control unit causes two or more of the plurality of processed images or thumbnails of the two or more processed images to be arranged and displayed on the first display device.

[0026] In an ophthalmic observation apparatus according to some exemplary embodiments, the display control unit causes two or more of the plurality of processed images or thumbnails of the two or more processed images to be sequentially displayed on the first display device.

[0027] An ophthalmic observation apparatus according to some exemplary embodiments further includes a monitoring unit that monitors movement of the eye to be examined. The display control unit changes a display state of the plurality of processed images based on an output from the monitoring unit.

[0028] An ophthalmic observation apparatus according to some exemplary embodiments further includes an abnormality detection unit that detects an abnormality of the eye to be examined. The display control unit changes a display state of the plurality of processed images based on an output from the abnormality detection unit.

[0029] In an ophthalmic observation apparatus according to some exemplary embodiments, the image parameters include one or more of a color tone parameter, a brightness parameter, a contrast parameter, a gain parameter, a gamma parameter, a color temperature parameter, a white balance parameter, an RGB balance parameter, a gray balance parameter, an edge enhancement parameter, a shadow enhancement parameter, a sharpness parameter, and a high dynamic range parameter.

[0030] Some exemplary embodiments are an ophthalmic image processing apparatus that processes an image of an eye to be examined, including a moving image receiving unit that receives a first moving image of the eye to be examined, an image processing unit that applies first image processing using different plural values of predetermined image parameters to a still image included in the first moving image to create plural processed images, and a display control unit that causes the plural processed images to be displayed on a first display device.

[0031] The ophthalmic image processing apparatus according to some exemplary embodiments further includes an instruction receiving unit that receives an instruction for selecting at least one processed image from among the plural processed images displayed on the first display device, the image processing unit applies second image processing based on at least one value of the image parameters corresponding to the at least one processed image to a second moving image of the eye to be examined received by the moving image receiving unit after the selection of the at least one processed image based on the instruction is made, and the display control unit causes the second moving image to which the second image processing has been applied to be displayed on a second display device.

[0032] Some exemplary embodiments are ophthalmic image processing methods for processing an image of an eye to be examined, comprising receiving a first moving image of the eye to be examined, applying first image processing using a plurality of different values of predetermined image parameters to each of the still images included in the first moving image to create a plurality of processed images, displaying the plurality of processed images, receiving an instruction for selecting at least one processed image from among the plurality of displayed processed images, receiving a second moving image of the eye to be examined after the selection of the at least one processed image based on the instruction has been made, applying second image processing based on at least one value of the image parameters corresponding to the at least one processed image to the second moving image, and displaying the second moving image to which the second image processing has been applied.

[0033] Some exemplary embodiments are programs for causing a computer to execute an ophthalmic image processing method according to the exemplary embodiments.

[0034] Some exemplary embodiments are computer-readable non-transitory recording media on which a program according to the exemplary embodiments is recorded.

Advantages of the Invention

[0035] According to the exemplary embodiments, it is possible to provide a new technique for facilitating ophthalmic observation.

Brief Description of the Drawings

[0036]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Figure 11

Figure 12A

Figure 12B

Figure 12C

Figure 12D

Figure 12E

Figure 13

Figure 14A

Figure 14B

Figure 14C

Figure 14D

Figure 14E

Figure 14F

Figure 14G

Figure 15

Figure 16

Figure 17

MODE FOR CARRYING OUT THE INVENTION

[0037] Some exemplary aspects of the ophthalmic observation apparatus, ophthalmic image processing apparatus, ophthalmic image processing method, program, and recording medium according to the embodiment will be described in detail with reference to the drawings. Note that the matters described in the documents cited in this specification and any known techniques can be combined in the exemplary aspects.

[0038] The ophthalmic observation apparatus according to the exemplary aspect is used for grasping the state of the eye to be examined in medical acts such as examination, surgery, and treatment of the eye to be examined. The ophthalmic observation apparatus in the exemplary aspect described below is a surgical microscope system, but the ophthalmic observation apparatus is not limited to the surgical microscope system. For example, the ophthalmic observation apparatus may be any one of a slit lamp microscope, a fundus camera, a refractometer, a keratometer, a tonometer, a specular microscope, a wavefront analyzer, a microperimeter, an SLO, and an OCT apparatus, or may be a system including any one or more of these. More generally, the ophthalmic observation apparatus may be any ophthalmic apparatus having an observation function.

[0039] The observation target site using the ophthalmic observation device may be any site of the eye to be examined, and may be any site of the anterior segment of the eye and / or any site of the posterior segment of the eye. Examples of the observation target site of the anterior segment of the eye include the cornea, iris, anterior chamber, angle, lens, ciliary body, zonular fibers, etc. Examples of the observation target site of the posterior segment of the eye include the retina, choroid, sclera, vitreous body, etc. The observation target site is not limited to eye tissues, and may be any site that is an observation target in ophthalmology (and / or other departments), such as the eyelid, Meibomian gland, eye socket, etc.

[0040] At least a part of the functions of the elements disclosed in this specification is implemented using circuitry or processing circuitry. The circuitry or processing circuitry includes a general-purpose processor, a dedicated processor, an integrated circuit, a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), an ASIC (Application Specific Integrated Circuit), a programmable logic device (e.g., an SPLD (Simple Programmable Logic Device), a CPLD (Complex Programmable Logic Device), an FPGA (Field Programmable Gate Array)), a conventional circuitry, and any combination thereof, which is configured and / or programmed to execute at least a part of the disclosed functions. A processor is regarded as a processing circuitry or circuitry including transistors and / or other circuitry. In the present disclosure, terms such as circuitry, unit, means, or the like refer to hardware that executes at least a part of the disclosed functions, or hardware programmed to execute at least a part of the disclosed functions. The hardware may be the hardware disclosed in this specification, or may be known hardware programmed and / or configured to execute at least a part of the described functions. When the hardware is a processor that can be regarded as a certain type of circuitry, the terms circuitry, unit, means, or the like refer to a combination of hardware and software, and this software is used to configure the hardware and / or the processor.

[0041] <Ophthalmic observation device> The configuration of an ophthalmic observation device according to an exemplary embodiment is shown in FIG. 1.

[0042] The ophthalmic observation device 1 (surgical microscope system) according to the embodiment includes an operation device 2, a display device 3, and a surgical microscope 10. In some aspects, the surgical microscope 10 may include at least one of the operation device 2 and the display device 3. Also, in some aspects, the display device 3 may not be included in the ophthalmic observation device 1. That is, the display device 3 may be a peripheral device of the ophthalmic observation device 1.

[0043] <Operation device 2> The operation device 2 includes an operation device and / or an input device. For example, the operation device 2 may include buttons, switches, a mouse, a keyboard, a trackball, an operation panel, a dial, etc. Typically, the operation device 2 includes a foot switch, similar to a general ophthalmic surgical microscope.

[0044] <Display device 3> The display device 3 displays an image of the eye to be examined acquired by the surgical microscope 10. The display device 3 includes a display device such as a flat panel display. Also, the display device 3 may include various display devices such as a touch panel. A typical display device 3 includes a large-screen display device. The display device 3 includes one or more display devices. When the display device 3 includes two or more display devices, for example, one may be a relatively large-screen display device and the other may be a relatively small-screen display device.

[0045] The operation device 2 and the display device 3 do not necessarily have to be individual devices. For example, a device in which an operation function and a display function are integrated, such as a touch panel, may be used as the display device 3. In that case, the operation device 2 includes this touch panel and a computer program. The operation content for the operation device 2 is input into a processor (not shown) as an electrical signal. Also, operations and information input may be performed using the graphical user interface (GUI) displayed on the display device 3 and the operation device 2. In some aspects, the functions of the operation device 2 and the display device 3 may be realized by a touch screen.

[0046] <Operating Microscope 10> The operating microscope 10 is used to observe the eye (the eye to be examined) of a supine patient. The operating microscope 10 photographs the eye to be examined and generates digital image data. In particular, the operating microscope 10 generates a moving image of the eye to be examined. The moving image (video) generated by the operating microscope 10 is transmitted through a wired and / or wireless signal path to the display device 3 and displayed. The user (surgeon) can perform the operation while observing the eye to be examined based on the displayed video. In some embodiments of the operating microscope 10, in addition to observing such a displayed video, observation through an eyepiece lens as in the past may also be possible.

[0047] In some embodiments, the operating microscope 10 includes a communication device for transmitting and receiving electrical signals to and from the operating device 2. The operating device 2 receives an operation by the user and generates a corresponding electrical signal (operation signal). The operation signal is transmitted to the operating microscope 10 through a wired and / or wireless signal path. The operating microscope 10 executes processing corresponding to the received operation signal.

[0048] <Optical System of the Operating Microscope 10> An example of the configuration of the optical system of the operating microscope 10 will be described. Hereinafter, for convenience of explanation, the optical axis direction of the objective lens is defined as the z direction (for example, the vertical direction, the up-and-down direction during surgery), a predetermined direction orthogonal to the z direction is defined as the x direction (for example, the horizontal direction during surgery, the left-right direction for the surgeon and the patient), and a direction orthogonal to both the z direction and the x direction is defined as the y direction (for example, the horizontal direction during surgery, the front-back direction for the surgeon, the body axis direction for the patient).

[0049] Also, hereinafter, mainly the case where the observation optical system has a pair of left and right optical systems (an optical system capable of binocular observation) will be described. However, it will be understood by those skilled in the art that the observation optical system of other embodiments may have an optical system for monocular observation, and the configurations described below can be applied to such embodiments.

[0050] An example of the configuration of the optical system of the surgical microscope 10 is shown in FIG. 2. FIG. 2 shows a schematic top view of the optical system as seen from above and a schematic side view of the optical system as seen from the side in association with each other. For simplicity of illustration, the illustration of the illumination optical system 30 disposed above the objective lens 20 is omitted.

[0051] The surgical microscope 10 includes an objective lens 20, a dichroic mirror DM1, an illumination optical system 30, and an observation optical system 40. The observation optical system 40 includes a zoom expander 50 and an imaging camera 60. In some aspects, the illumination optical system 30 or the observation optical system 40 includes the dichroic mirror DM1.

[0052] The objective lens 20 is disposed to face the eye to be examined. The objective lens 20 is disposed such that its optical axis is along the z direction. The objective lens 20 may include two or more lenses.

[0053] The dichroic mirror DM1 couples the optical path of the illumination optical system 30 and the optical path of the observation optical system 40. The dichroic mirror DM1 is disposed between the illumination optical system 30 and the objective lens 20. The dichroic mirror DM1 transmits the illumination light from the illumination optical system 30 and guides it to the eye to be examined through the objective lens 20, and reflects the return light from the eye to be examined incident through the objective lens 20 and guides it to the imaging camera 60 of the observation optical system 40.

[0054] The dichroic mirror DM1 coaxially couples the optical path of the illumination optical system 30 and the optical path of the observation optical system 40. That is, the optical axis of the illumination optical system 30 and the optical axis of the observation optical system 40 intersect at the dichroic mirror DM1. When the illumination optical system 30 includes a left-eye illumination optical system (31L) and a right-eye illumination optical system (31R), and the observation optical system 40 includes a left-eye observation optical system 40L and a right-eye observation optical system 40R, the dichroic mirror DM1 coaxially couples the optical path of the left-eye illumination optical system (the first illumination optical system 31L) and the optical path of the left-eye observation optical system 40L, and coaxially couples the optical path of the right-eye illumination optical system (the first illumination optical system 31R) and the optical path of the right-eye observation optical system 40R.

[0055] The illumination optical system 30 is an optical system for illuminating the eye to be examined via the objective lens 20. The illumination optical system 30 may be configured to illuminate the eye to be examined with any one of two or more illumination lights having different color temperatures. The illumination optical system 30 projects illumination light of a specified color temperature onto the eye to be examined under the control of a control unit (200) described later.

[0056] The illumination optical system 30 includes first illumination optical systems 31L and 31R and a second illumination optical system 32.

[0057] Each of the optical axis OL of the first illumination optical system 31L and the optical axis OR of the first illumination optical system 31R is arranged substantially coaxially with the optical axis of the objective lens 20. Thereby, so-called "0-degree illumination" can be realized, and it becomes possible to obtain a fundus illumination image using diffuse reflection at the fundus. In this aspect, it is possible to observe the fundus illumination image of the eye to be examined binocularly.

[0058] The second illumination optical system 32 is arranged such that its optical axis OS is eccentric from the optical axis of the objective lens 20. The first illumination optical systems 31L and 31R and the second illumination optical system 32 are arranged such that the deviation of the optical axis OS with respect to the optical axis of the objective lens 20 is larger than the deviation of the optical axes OL and OR with respect to the optical axis of the objective lens 20. Thereby, so-called "angled illumination (oblique illumination)" can be realized, and it becomes possible to observe the eye to be examined binocularly while preventing the inclusion of ghosts caused by corneal reflection or the like. Furthermore, it becomes possible to observe in detail the unevenness of the parts and tissues of the eye to be examined.

[0059] The first illumination optical system 31L includes a light source 31LA and a condenser lens 31LB. The light source 31LA outputs illumination light having a wavelength in the visible region corresponding to a color temperature of, for example, 3000 K (Kelvin). The illumination light output from the light source 31LA passes through the condenser lens 31LB, passes through the dichroic mirror DM1, passes through the objective lens 20, and is incident on the eye to be examined.

[0060] The first illumination optical system 31R includes a light source 31RA and a condenser lens 31RB. The light source 31RA also outputs illumination light having a wavelength in the visible region corresponding to a color temperature of, for example, 3000K. The illumination light output from the light source 31RA passes through the condenser lens 31RB, passes through the dichroic mirror DM1, and passes through the objective lens 20 and enters the eye to be examined.

[0061] The second illumination optical system 32 includes a light source 32A and a condenser lens 32B. The light source 32A outputs illumination light having a wavelength in the visible region corresponding to a color temperature of, for example, 4000K to 6000K. The illumination light output from the light source 32A passes through the condenser lens 32B, passes through the objective lens 20 without passing through the dichroic mirror DM1, and enters the eye to be examined.

[0062] That is, the color temperature of the illumination light from the first illumination optical systems 31L and 31R is lower than the color temperature of the illumination light from the second illumination optical system 32. With such a configuration, it becomes possible to observe the eye to be examined in warm colors using the first illumination optical systems 31L and 31R, and it becomes possible to observe the structure and form of the eye to be examined in detail.

[0063] In some aspects, each of the optical axes OL and OR is relatively movable with respect to the optical axis of the objective lens 20. The direction of this relative movement is a direction intersecting the optical axis of the objective lens 20, and this relative movement is represented by a displacement vector in which at least one of the x component and the y component is not zero. In some aspects, each of the optical axes OL and OR may be independently movable. On the other hand, in some aspects, the optical axes OL and OR may be integrally movable. For example, the surgical microscope 10 includes a moving mechanism (31d) that moves the first illumination optical systems 31L and 31R independently or integrally, and the moving mechanism moves the first illumination optical systems 31L and 31R independently or integrally in a direction intersecting the optical axis of the objective lens 20. Thereby, it becomes possible to adjust the visibility of the eye to be examined. In some aspects, the moving mechanism operates under the control of a control unit (200) described later.

[0064] In some embodiments, the optical axis OS is movable relative to the optical axis of the objective lens 20. The direction of this relative movement is a direction intersecting the optical axis of the objective lens 20, and this relative movement is represented by a displacement vector in which at least one of the x - component and the y - component is non - zero. For example, the surgical microscope 10 includes a moving mechanism (32d) that moves the second illumination optical system 32, and this moving mechanism moves the second illumination optical system 32 in a direction intersecting the optical axis of the objective lens 20. Thereby, it becomes possible to adjust the visibility of unevenness in the part and tissue of the eye to be examined. In some embodiments, the moving mechanism operates under the control of a control unit (200) described later.

[0065] As described above, in this embodiment, the illumination optical system 30 is disposed at a position directly above the objective lens 20 (the position in the transmission direction of the dichroic mirror DM1), and the observation optical system 40 is disposed at a position in the reflection direction of the dichroic mirror DM1. For example, the observation optical system 40 may be disposed such that the angle formed by the optical axis of the observation optical system 40 and a plane (xy plane) orthogonal to the optical axis of the objective lens 20 is 20 degrees or less in magnitude.

[0066] According to the configuration of this embodiment, since the observation optical system 40, which generally has a longer optical path length than the illumination optical system 30, is disposed substantially parallel to the xy plane, it does not obstruct the surgeon's field of view like a conventional surgical microscope in which the observation optical system is disposed vertically in front of the surgeon's eyes. Therefore, the surgeon can easily view the screen of the display device 3 installed in the front. That is, the visibility of display information (images and videos of the eye to be examined, and other various reference information) during surgery and the like is improved. In addition, since no housing is disposed in front of the surgeon's eyes, there is no sense of pressure on the surgeon, and the burden on the surgeon is reduced.

[0067] The observation optical system 40 is an optical system for observing an image formed based on the return light of the illumination light incident from the eye to be examined through the objective lens 20. In this embodiment, the observation optical system 40 provides an image to the imaging element of the imaging camera 60.

[0068] As described above, the observation optical system 40 includes a left-eye observation optical system 40L and a right-eye observation optical system 40R. The configuration of the left-eye observation optical system 40L is the same as that of the right-eye observation optical system 40R. In some aspects, the left-eye observation optical system 40L and the right-eye observation optical system 40R may be capable of independently changing their optical arrangements.

[0069] The zoom expander 50 is also called a beam expander, a variable beam expander, etc. The zoom expander 50 includes a left-eye zoom expander 50L and a right-eye zoom expander 50R. The configuration of the left-eye zoom expander 50L is the same as that of the right-eye zoom expander 50R. In some aspects, the left-eye zoom expander 50L and the right-eye zoom expander 50R may be capable of independently changing their optical arrangements.

[0070] The left-eye zoom expander 50L includes a plurality of zoom lenses 51L, 52L, and 53L. At least one of the plurality of zoom lenses 51L, 52L, and 53L is movable in the optical axis direction by a zoom mechanism (not shown).

[0071] Similarly, the right-eye zoom expander 50R includes a plurality of zoom lenses 51R, 52R, and 53R, and at least one of the plurality of zoom lenses 51R, 52R, and 53R is movable in the optical axis direction by a zoom mechanism (not shown).

[0072] The zoom mechanism may be configured to move each zoom lens of the left-eye zoom expander 50L and each zoom lens of the right-eye zoom expander 50R independently or integrally in the optical axis direction. Thereby, the magnification when photographing the eye to be examined is changed. In some aspects, the zoom mechanism operates under the control of a control unit (200) described later.

[0073] The imaging camera 60 is a device that captures the image formed by the observation optical system 40 to generate digital image data, and is typically a digital camera (digital video camera). The imaging camera 60 includes a left-eye imaging camera 60L and a right-eye imaging camera 60R. The configuration of the left-eye imaging camera 60L is the same as that of the right-eye imaging camera 60R. In some aspects, the left-eye imaging camera 60L and the right-eye imaging camera 60R can be independently changed in optical arrangement.

[0074] The left-eye imaging camera 60L includes an imaging lens 61L and an image sensor 62L. The imaging lens 61L forms an image based on the return light that has passed through the left-eye zoom expander 50L on the imaging surface of the image sensor 62L. The image sensor 62L is an area sensor and may typically be a charge-coupled device (CCD) image sensor or a complementary metal-oxide semiconductor (CMOS) image sensor. The image sensor 62L operates under the control of a control unit (200) described later.

[0075] The right-eye imaging camera 60R includes an imaging lens 61R and an image sensor 62R. The imaging lens 61R forms an image based on the return light that has passed through the right-eye zoom expander 50R on the imaging surface of the image sensor 62L. The image sensor 62R is an area sensor and may typically be a CCD image sensor or a CMOS image sensor. The image sensor 62R operates under the control of a control unit (200) described later.

[0076] <Processing system> The processing system of the ophthalmic observation device 1 will be described. Some configuration examples of the processing system are shown in FIGS. 3 to 10. Any two or more of the plurality of configuration examples described below can be at least partially combined. Note that the configuration of the processing system is not limited to these examples.

[0077] The control unit 200 controls each part of the ophthalmic observation device 1. The control unit 200 includes a main control unit 201 and a storage unit 202. The main control unit 201 includes a processor and controls each part of the ophthalmic observation device 1. For example, the processor can read and execute a program stored in the storage unit 202 or another storage device to realize the functions according to this aspect, and can also utilize (refer to, process, calculate, etc.) the data and information stored in the storage unit 202 or another storage device.

[0078] The main control unit 201 can control the light sources 31LA, 31RA, and 32A of the illumination optical system 30, the imaging elements 62L and 62R of the observation optical system 40, the moving mechanisms 31d and 32d, the zoom mechanisms 50Ld and 50Rd, the operation device 2, the display device 3, etc.

[0079] The control of the light source 31LA includes turning on and off the light source, adjusting the light amount, adjusting the aperture, etc. The control of the light source 31RA includes turning on and off the light source, adjusting the light amount, adjusting the aperture, etc. The main control unit 201 can control the light sources 31LA and 31RA mutually exclusively. The control of the light source 32A includes turning on and off the light source, adjusting the light amount, adjusting the aperture, etc.

[0080] When the illumination optical system 30 includes a light source whose color temperature can be changed, the main control unit 201 can change the color temperature of the output illumination light by controlling this light source.

[0081] The control of the imaging element 62L includes exposure adjustment, gain adjustment, shooting rate adjustment, etc. The control of the imaging element 62R includes exposure adjustment, gain adjustment, shooting rate adjustment, etc. Also, the main control unit 201 can control the imaging elements 62L and 62R so that the shooting timings of the imaging elements 62L and 62R coincide, or the difference between the shooting timings of both is within a predetermined time. Furthermore, the main control unit 201 can perform read control of the digital data obtained by the imaging elements 62L and 62R.

[0082] The moving mechanism 31d moves the light sources 31LA and 31RA independently or integrally in a direction intersecting the optical axis of the objective lens 20. The main control unit 201 can move the optical axes OL and OR independently or integrally with respect to the optical axis of the objective lens 20 by controlling the moving mechanism 31d.

[0083] The moving mechanism 32d moves the light source 32A independently or integrally in a direction intersecting the optical axis of the objective lens 20. The main control unit 201 can move the optical axis OS with respect to the optical axis of the objective lens 20 by controlling the moving mechanism 32d.

[0084] In some embodiments, the main control unit 201 can control the moving mechanisms 31d and 32d in a coordinated manner.

[0085] The zoom mechanism 50Ld moves at least one of the plurality of zoom lenses 51L to 53L of the left-eye zoom expander 50L in the optical axis direction. The main control unit 201 can change the magnification of the left-eye observation optical system 40L by controlling the zoom mechanism 50Ld.

[0086] Similarly, the zoom mechanism 50Rd moves at least one of the plurality of zoom lenses 51R to 53R of the right-eye zoom expander 50R in the optical axis direction. The main control unit 201 can change the magnification of the right-eye observation optical system 40R by controlling the zoom mechanism 50Rd.

[0087] The control of the operating device 2 includes operation permission control, operation prohibition control, transmission control and / or reception control of operation signals from the operating device 2, etc. The main control unit 201 receives the operation signal generated by the operating device 2 and executes the control corresponding to this received signal.

[0088] The control of the display device 3 includes information display control and the like. As a display control unit, the main control unit 201 can cause the display device 3 to display an image based on the digital image data generated by the imaging elements 62L and 62R. Typically, a moving image (video) based on the digital image data (video signal) generated by the imaging elements 62L and 62R can be displayed on the display device 3, and a still image (frame) included in this moving image can also be displayed on the display device 3. Further, the main control unit 201 can cause the display device 3 to display an image (such as a moving image or a still image) obtained by processing the digital image data generated by the imaging elements 62L and 62R. Also, the main control unit 201 can cause the display device 3 to display any information generated by the ophthalmic observation device 1 or any information acquired by the ophthalmic observation device 1 from the outside.

[0089] Also, as a display control unit, the main control unit 201 creates a left-eye image from the digital image data generated by the imaging element 62L and creates a right-eye image from the digital image data generated by the imaging element 62R, and can cause the display device 3 to display the created left-eye image and right-eye image in a stereoscopic viewable manner. For example, the main control unit 201 can create a pair of left and right parallax images from the left-eye image and the right-eye image, and can cause the display device 3 to display this pair of parallax images. A user (such as an operator) can recognize a pair of parallax images as a stereoscopic image using a known stereoscopic method. The stereoscopic method applicable to this embodiment can be arbitrary. For example, a stereoscopic method with the naked eye, a stereoscopic method using an auxiliary device (such as polarized glasses), a stereoscopic method using image processing (such as image synthesis and rendering) for the left-eye image and the right-eye image, a stereoscopic method for simultaneously displaying a pair of parallax images, a stereoscopic method for switching and displaying a pair of parallax images, and any of a combination of two or more of these stereoscopic methods may be used.

[0090] The data processing unit 210 executes various data processes. Some examples of the processes that the data processing unit 210 can execute will be described below.

[0091] <Detailed Example of the Processing System> Some examples of the processes executable by the data processing unit 210 will be described together with the related elements. Each of FIGS. 4 to 10 shows a configuration example of the data processing unit 210 (and related elements). It is possible to at least partially combine any two or more of the configuration examples shown in FIGS. 4 to 10. The data processing unit 210 (each of its elements) includes a processor that operates according to a predetermined software (program), and is realized by the cooperation of hardware and software.

[0092] The data processing unit 210A shown in FIG. 4 is an example of the data processing unit 210 in FIG. 3. The data processing unit 210A in this example includes an image processing unit 211. The image processing unit 211 applies image processing (first image processing) using a plurality of different values of predetermined image parameters to the still images included in the moving image (first moving image, video) of the eye under examination generated by the surgical microscope 10, respectively. Thereby, a plurality of processed images based on this still image are created. The processed image creation process by the image processing unit 211 may be executed in parallel with the moving image shooting of the eye under examination by the surgical microscope 10.

[0093] The types of image parameters used in the first image processing may be arbitrary. For example, the image parameters may include one or more of the parameters of the types exemplified below: hue parameter (parameter for hue conversion); brightness parameter (parameter for brightness conversion); contrast parameter (parameter for contrast conversion); gain parameter (parameter for gain change); gamma parameter (parameter for gamma correction (correction of the response characteristics of the gradation of an image)); color temperature parameter (parameter for color temperature conversion); white balance parameter (parameter for white balance conversion); RGB balance parameter (parameter for balance conversion between R value, G value, and B value); gray balance parameter (parameter for gray balance conversion); edge enhancement parameter (parameter for edge enhancement); shadow enhancement parameter (parameter for shadow enhancement); sharpness parameter (parameter for sharpness (sharpening)); high dynamic range parameter (parameter for HDR synthesis). The image parameters applicable to this example are not limited to the types exemplified here, and more generally, may be any parameters (e.g., display control parameters, image representation parameters, image correction parameters, image adjustment parameters, etc.) that can be used to change the appearance of an image.

[0094] In the first image processing, the image processing unit 211 can apply each of a plurality of image processings using different values of one image parameter to the still images included in the first moving image. For example, the image processing unit 211 can apply each of N image processings (hue conversion) using N values of the hue parameter to the still image (N is an integer of 2 or more). Thereby, N processed images expressed in different hues are created. The same applies when using image parameters other than the hue parameter.

[0095] Also, in the first image processing, the image processing unit 211 can apply each of a plurality of image processes using different combinations of a plurality of values of two image parameters to the still images included in the first moving image. For example, the image processing unit 211 can apply each of N×M image processes (color tone conversion and brightness conversion) consisting of combinations of N values of the color tone parameter and M values of the brightness parameter to the still image (each of N and M is an integer of 2 or more). Thereby, N×M processed images expressed by different combinations of color tone and brightness are created. The same applies when using combinations other than the combination of the color tone parameter and the brightness parameter. Also, the number of image parameters to be combined may be any number of 2 or more. Also, it is not necessary to use all of the plurality of values prepared for each image parameter. For example, when N values of the color tone parameter and M values of the brightness parameter are prepared, a combination of N1 values of the color tone parameter and M1 values of the brightness parameter can be considered. Here, N1≦N and M1≦M, and further, N1<N and / or M1<M.

[0096] The plurality of processed images created in this way are displayed on the display device 3 by the main control unit 201. Here, the main control unit 201 may cause the display device 3 to display the plurality of processed images themselves created by the image processing unit 211, or may cause the display device 3 to display thumbnails (reduced images) of these processed images.

[0097] The mode of displaying the plurality of processed images may be arbitrary. In some modes, the main control unit 201 can display two or more of the plurality of processed images (or their thumbnails) side by side. Here, the main control unit 201 may execute a process of displaying in parallel a first group selected from the plurality of processed images and a process of switching from the parallel display of the first group to the parallel display of a second group in response to a predetermined trigger. The trigger for switching the groups to be displayed in parallel is issued manually or automatically.

[0098] In some aspects, the main control unit 201 can sequentially display two or more processed images (or their thumbnails) among the plurality of processed images. The switching of the displayed processed images is performed manually or automatically.

[0099] When a thumbnail is displayed, the main control unit 201 (or the image processing unit 211 or the data processing unit 210A) executes a process of creating the thumbnail from the processed image created by the first image processing.

[0100] A user (for example, a surgeon, an assistant receiving instructions from the surgeon, etc.) can select a desired one from among the plurality of processed images (or their thumbnails) displayed on the display device 3.

[0101] The number of selected processed images may be arbitrary. When one processed image is selected, that processed image is used for subsequent processing. When two or more processed images are selected, all or some of them are used for subsequent processing. For example, the image processing unit 211A (or the data processing unit 210A) may be configured to select one from among the two or more selected processed images according to a predetermined algorithm.

[0102] The ophthalmic observation device 1 has an element (instruction reception unit) for receiving a user's instruction for selecting a processed image. The element functioning as the instruction reception unit may be arbitrary. For example, the user can give an instruction using the operation device 2. In some aspects, the instruction reception unit may include a voice recognition unit that detects and recognizes an instruction by voice, a gaze recognition unit that detects and recognizes an instruction by gaze, an electroencephalogram recognition unit that detects and recognizes an instruction by electroencephalogram, a pointing recognition unit that detects and recognizes an instruction by pointing, a biological signal recognition unit that detects and recognizes an instruction by an arbitrary biological signal, and the like.

[0103] When the user selects a processed image, the ophthalmic observation device 1 executes a process based on the selected processed image. Some examples of this process will be described below.

[0104] A configuration example shown in FIG. 5 will be described. The image processing unit 211A shown in FIG. 5 is an example of the image processing unit 211 in FIG. 4. The image processing unit 211A in this example includes a processed image creation unit 2111 and a moving image processing unit 2112.

[0105] The processed image creation unit 2111 executes at least a part of the above-described processing described with reference to FIG. 4, for example.

[0106] The moving image processing unit 2112 processes a moving image based on a processed image selected by a user from among a plurality of processed images displayed on the display device 3. For example, the moving image processing unit 2112 first acquires image parameters corresponding to the processed image selected by the user. That is, the moving image processing unit 2112 acquires the values of the image parameters used for the first image processing for creating the processed image selected by the user. Next, the moving image processing unit 2112 applies image processing (second image processing) based on the values of these image parameters to the moving image. The moving image to which the second image processing is applied is at least a moving image (referred to as a second moving image) generated by the surgical microscope 10 after the user selects a processed image. Thereby, a moving image subjected to the same image processing as the processed image selected by the user is obtained. If one or more still images included in a moving image (first moving image) acquired before the user selects a processed image are stored, the same image processing can be applied to at least a part of the one or more still images.

[0107] The main control unit 201 causes the display device 3 to display the second moving image to which the second image processing has been applied. Typically, the ophthalmic observation device 1 can perform real-time application of the second image processing to a moving image (second moving image) acquired by this video shooting while performing video shooting of the eye to be examined by the surgical microscope 10, and real-time display of the moving image to which the second image processing has been applied. Thereby, the user can observe in real time a moving image to which image processing using the same values of image parameters as the processed image selected by the user has been applied.

[0108] As described above, the number of processed images selected by the user may be arbitrary. For example, when the number of selected processed images is one, the moving image processing unit 2112 can apply image processing using the value (one value) of the image parameter corresponding to the selected one processed image as the second image processing to the second moving image.

[0109] On the other hand, when the number of selected processed images is two or more, the moving image processing unit 2112 can select one processed image from among the two or more selected processed images, and apply image processing using the value (one value) of the image parameter corresponding to this one processed image as the second image processing to the second moving image. Alternatively, the moving image processing unit 2112 can select one value from among two or more values of the image parameters corresponding to the two or more selected processed images, and apply image processing using this one value as the second image processing to the second moving image. These selection processes executed by the moving image processing unit 2112 are executed according to a predetermined algorithm. For example, the moving image processing unit 2112 may be configured to analyze two or more processed images selected by the user to calculate a predetermined image quality evaluation value, and select one processed image having the optimal image quality evaluation value. Alternatively, when two or more image parameters are used in the first image processing, the moving image processing unit 2112 may be configured to select a processed image or select a value of an image parameter with reference to a preset priority order between the image parameters. In this case, for example, the moving image processing unit 2112 is configured to select an optimal value (for example, the highest contrast value) from among a plurality of values of the image parameter with the highest priority.

[0110] In another aspect where the number of selected processed images is two or more, the moving image processing unit 2112 can determine one value based on two or more values of image parameters respectively corresponding to the two or more selected processed images, and apply image processing using this one value as the second image processing to the second moving image. The arithmetic processing for determining one value from two or more values may be arbitrary, for example, it may be a statistical operation. The statistical value obtained by this statistical operation may be any type of statistical value, such as an average value, a median value, a maximum value, a minimum value, etc. Also, the applied arithmetic processing may be set in advance or may be set for each process. As an example of the latter, the moving image processing unit 2112 can determine the type of arithmetic processing (statistical operation) to be applied based on any one or more factors, such as the type of image parameter used in the first image processing, the number of processed images selected by the user, the type of image acquired by the surgical microscope 10, and the phase of the medical procedure (surgery in this example).

[0111] Next, refer to FIG. 6. The data processing unit 210B shown in FIG. 6 is an example of the data processing unit 210 in FIG. 3. The data processing unit 210B in this example includes an image processing unit 211 and a parameter processing unit 212.

[0112] The image processing unit 211 may be configured to execute the same processing as the aforementioned image processing unit 211 or image processing unit 211A.

[0113] The parameter processing unit 212 executes processing related to image parameters. The image processing unit 211 can perform processing using the output from the parameter processing unit 212. For example, the parameter processing unit 212 is configured to record the values of the image parameters used in the second image processing by the moving image processing unit 2112 (recording unit), and the image processing unit 211 is configured to execute new image processing (e.g., new first image processing, new second image processing) using the values of the image parameters recorded by the parameter processing unit 212. Note that the parameter processing unit 212 as the recording unit may be configured to record only the values of the image parameters used in the second image processing, or may be configured to record other values as well. As an example of the latter, the parameter processing unit 212 as the recording unit may record the values of the image parameters corresponding to each processed image selected by the user, or may record one or more values of the image parameters corresponding to a part of the plurality of processed images selected by the user, or may record the values of the image parameters adjusted manually.

[0114] Several examples of the configuration of the parameter processing unit 212 and the processing executed using the same will be described below.

[0115] The parameter processing unit 212A shown in FIG. 7 is an example of the parameter processing unit 212 in FIG. 6. The parameter processing unit 212A includes a parameter recording unit 2121 and a parameter selection unit 2122. When the parameter processing unit 212A of this example is adopted, the ophthalmic observation device 1 may have an identifier reception unit 221 and an attribute information acquisition unit 222. Note that in some aspects, the ophthalmic observation device 1 may be provided with only one of the identifier reception unit 221 and the attribute information acquisition unit 222.

[0116] The identifier reception unit 221 receives the user's identifier (user ID). This user is typically a surgeon. Also, the user ID may be represented, for example, by a character string or an image (e.g., barcode, two-dimensional barcode, etc.) assigned to the surgeon (doctor) in the medical institution, the name of the surgeon, the biometric information of the surgeon (e.g., face, fingerprint, palmprint, iris pattern, voice, etc.).

[0117] The identifier reception unit 221 may include any device (hardware, software) for receiving such a user ID. For example, it may include the operating device 2, a camera, a barcode scanner, a biometric information scanner, a microphone, a processor, etc.

[0118] The parameter recording unit 2121 functions as the aforementioned recording unit and records the values of the image parameters in association with the user ID received by the identifier reception unit 221. This makes it possible to identify which user selected which value of the image parameters. For example, it becomes possible to search for the values of the image parameters using the user ID as a search query.

[0119] The attribute information acquisition unit 222 acquires attribute information indicating the attributes of the medical act on the eye to be examined. That is, the attribute information acquisition unit 222 acquires attribute information indicating various attributes regarding the medical act (surgery in this example) being performed on the eye to be examined using the ophthalmic observation device 1.

[0120] Examples of the attributes of the surgery include the type of surgery according to the surgical site (e.g., anterior segment surgery, posterior segment surgery, corneal surgery, angle surgery, ciliary body surgery, retinal surgery, vitreous surgery, etc.) and the type of surgery according to the disease (e.g., cataract surgery, glaucoma surgery, corneal transplantation surgery, retinal cell transplantation surgery, retinal detachment surgery, laser photocoagulation, etc.). The same applies to medical acts other than surgery (e.g., examination, treatment, screening, etc.).

[0121] The attributes of a medical act are not limited to the type of medical act. For example, the attribute information may include information indicating multiple phases of a surgery. For example, the phases of cataract surgery include alignment, incision creation, viscoelastic injection into the eye, CCC, phacoemulsification and aspiration, cortical aspiration of the lens, IOL insertion, IOL centering, removal of viscoelastic from the eye, wound closure, etc. Information indicating such surgical phases can be included in the attribute information. Note that the phases included in the attribute information may be preset or determined by the surgeon. Also, two or more phases to which the same image parameter value is applied may be grouped together (phase group).

[0122] The attribute information may be expressed, for example, by a character string or an image (e.g., barcode, two-dimensional barcode, etc.) assigned to the medical act in the medical institution, the name of the medical act, etc.

[0123] The attribute information acquisition unit 222 may include any device (hardware, software) for receiving such attribute information, and may include, for example, the operation device 2, a camera, a barcode scanner, a biometric information scanner, a microphone, a processor, etc.

[0124] Also, the attribute information acquisition unit 222 may be configured to automatically identify the current phase by analyzing an image (video) generated by the surgical microscope 10, an operation being performed using the operation device 2, an image displayed on the display device 3, etc. Also, when the surgical procedure is predetermined, the attribute information acquisition unit 222 may be configured to automatically identify the current phase by referring to the steps performed up to the current stage.

[0125] The main control unit 201 can cause the display device 3 to display information indicating the phase automatically identified by the attribute information acquisition unit 222. The user can determine whether the displayed information is correct and input the result of this determination using the operation device 2 or the like. With such a configuration, since the phase automatically identified by the attribute information acquisition unit 222 can be confirmed, it is possible to prevent an incorrect phase from being recorded.

[0126] The parameter recording unit 2121 as a recording unit records the value of the image parameter in association with the attribute information acquired by the attribute information acquisition unit 222. Thereby, it becomes possible to identify which value of the image parameter the user has selected in which medical act (type, phase, etc.). For example, it becomes possible to search for the value of the image parameter using the type or phase of the surgery as a search query. Further, the attribute information may include any information such as the degree of progression of the disease, the date when the medical act was performed, and the proficiency of the surgeon.

[0127] When both the identifier reception unit 221 and the attribute information acquisition unit 222 are provided, the parameter recording unit 2121 as a recording unit can record the value of the image parameter in association with both the user ID received by the identifier reception unit 221 and the attribute information acquired by the attribute information acquisition unit 222. Thereby, it becomes possible to identify which user has selected which value of the image parameter in which medical act (type, phase, etc.). For example, it becomes possible to search for the value of the image parameter using the user ID and / or the type or phase of the surgery as a search query.

[0128] The parameter selection unit 2122 selects at least one value from among the values of the image parameters recorded in the past by the parameter recording unit 2121. For example, the parameter selection unit 2122 can execute the selection of the value of the image parameter according to the search query described above.

[0129] The image processing unit 211 (211A) can apply image processing based on the values of the image parameters selected by the parameter selection unit 2122 to the moving image (third moving image) generated by the surgical microscope 10. The third moving image may be any moving image, for example, the aforementioned second moving image, a moving image acquired during another medical procedure on the same subject, a moving image acquired during a medical procedure on another subject, and so on.

[0130] When the values of the image parameters are selected using the user ID as a search query, image processing using the values of the image parameters previously used by that user (such as a surgeon) can be applied to the third moving image. Therefore, it becomes possible to easily provide a third moving image in the display mode (such as color tone, brightness, contrast, etc.) preferred by that user.

[0131] When the values of the image parameters are selected using the attribute information of the medical procedure as a search query, image processing using the values of the image parameters previously used according to the type and phase of the medical procedure can be applied to the third moving image. Therefore, it becomes possible to easily provide a third moving image in the display mode (such as color tone, brightness, contrast, etc.) suitable for the type and phase of the medical procedure.

[0132] The parameter processing unit 212B shown in FIG. 8 is an example of the parameter processing unit 212 in FIG. 6. The parameter processing unit 212B includes a parameter recording unit 2121 and a parameter selection unit 2122 in the same manner as the parameter processing unit 212A in FIG. 7, and further includes a shooting condition recording unit 2123, a shooting condition selection unit 2124, and a parameter determination unit 2125. The configurations and operations of the parameter recording unit 2121 and the parameter selection unit 2122 may be the same as those in the case of FIG. 7, and the description thereof is omitted.

[0133] Even when the parameter processing unit 212B of this example is adopted, the ophthalmic observation apparatus 1 may include an identifier reception unit 221 and an attribute information acquisition unit 222. In some aspects, the ophthalmic observation apparatus 1 may include only one of the identifier reception unit 221 and the attribute information acquisition unit 222. The configurations and operations of the identifier reception unit 221 and the attribute information acquisition unit 222 may be the same as those in the case of FIG. 7, and the description thereof is omitted.

[0134] The imaging condition recording unit 2123 records the imaging conditions when the second moving image is generated by the surgical microscope 10 in association with the values of the image parameters recorded by the parameter recording unit 2121. In this example, the combination of the parameter recording unit 2121 and the imaging condition recording unit 2123 functions as a recording unit.

[0135] The imaging conditions may include, for example, illumination conditions, observation conditions, environmental conditions, and eye-under-examination conditions. The illumination conditions include conditions related to the elements of the illumination optical system 30. Examples thereof include the amount of light (the output light amounts and output intensities from the light sources 31LA, 31RA, and 32A), the aperture value of the aperture, and the illumination mode (0-degree illumination, angled illumination, etc.). The observation conditions are conditions related to the elements of the observation optical system 40. Examples thereof include the aperture value of the aperture, the magnification, and the control values (such as gain) of the imaging elements 62L and 62R. The environmental conditions include conditions related to the environment during imaging. Examples thereof include the brightness of the room in which the surgical microscope 10 is installed. The eye-under-examination conditions include conditions related to the eye under examination. Examples thereof include the presence or absence of a disease, the type and degree of the disease suffered, the pupil diameter, and the degree of turbidity of the site (cornea, lens, vitreous body, etc.).

[0136] In this example, since information is recorded by both the parameter recording unit 2121 and the imaging condition recording unit 2123, imaging conditions can be considered in addition to the information considered in the example of FIG. 7.

[0137] The shooting condition selection unit 2124 selects shooting conditions associated with the values of the image parameters selected by the parameter selection unit 2122 from among the shooting conditions previously recorded by the shooting condition recording unit 2123. As a result, in addition to the values of the image parameters selected by the parameter selection unit 2122, the shooting conditions associated with the values of these image parameters can also be acquired.

[0138] The parameter determination unit 2125 determines the values of the image parameters based on the values of the image parameters selected by the parameter selection unit 2122 and the shooting conditions selected by the shooting condition selection unit 2124.

[0139] Regarding controllable conditions in the surgical microscope 10, such as lighting conditions and observation conditions, the main control unit 201 can control the surgical microscope 10 (such as the illumination optical system 30 and the observation optical system 40) based on the selected shooting conditions. For example, the main control unit 201 can control the surgical microscope 10 so as to reproduce the selected shooting conditions. As a result, it becomes possible to reproduce the display mode of the image when the values of the image parameters selected by the parameter selection unit 2122 are applied.

[0140] Regarding shooting conditions other than controllable conditions in the surgical microscope 10 (such as environmental conditions and eye conditions of the subject), for example, the parameter determination unit 2125 executes processing based on the values of the respectively selected image parameters and the shooting conditions. This processing may be arithmetic processing based on a predetermined algorithm.

[0141] In some aspects, a correspondence relationship (such as a graph or a table) between changes in shooting conditions (such as environmental conditions and eye conditions of the subject) and the values of the image parameters is prepared in advance. The parameter determination unit 2125 can compare the current shooting conditions with the selected shooting conditions and determine the values of the image parameters based on this comparison result (such as the amount of change in the shooting conditions) and the correspondence relationship.

[0142] In some aspects, instead of preparing the above correspondence relationship, a system (artificial intelligence engine) that has learned the relationship between changes in imaging conditions (environmental conditions, eye-under-examination conditions, etc.) and the values of image parameters using machine learning is used. This artificial intelligence engine includes, for example, a neural network constructed by machine learning that takes the imaging conditions and the values of the image parameters as inputs and outputs new values of the image parameters. This artificial intelligence engine is trained, for example, to output the optimal values of the image parameters according to changes in the imaging conditions based on the given values of the image parameters. The parameter determination unit 2125 includes such an artificial intelligence engine and inputs the values of the respectively selected image parameters and the imaging conditions into this artificial intelligence engine. The values of the image parameters output from this artificial intelligence engine become the results obtained by the parameter determination unit 2125.

[0143] The image processing unit 211(211A) can apply image processing using the values of the image parameters determined by the parameter determination unit 2125 to the moving image (third moving image) generated by the surgical microscope 10. As described above, the third moving image may be an arbitrary moving image, for example, the above-described second moving image, a moving image obtained in another medical procedure for the same subject, a moving image obtained in a medical procedure for another subject, and the like.

[0144] According to this example, since the values of the image parameters can be adjusted (corrected) according to the differences in the imaging conditions, it is possible to easily provide a third moving image expressed in a manner close to the previously achieved good display mode (color tone, brightness, contrast, etc.) regardless of the differences in the imaging conditions.

[0145] Next, the example shown in FIG. 9 will be described. In this example, by applying image processing only to a part of the still images (frames) included in the moving image, reduction of resources and shortening of time required for image processing are achieved, and at the same time, optimization of the quality of the image of the attention site in the observation of the eye-under-examination is achieved.

[0146] The image processing unit 211B shown in FIG. 9 creates a plurality of processed partial images by applying first image processing to a part (partial image) of a still image included in the first moving image generated by the surgical microscope 10. In this example, the plurality of processed partial images are treated as a plurality of processed images. The main control unit 201 causes the display device 3 to display a plurality of images each including the created plurality of processed partial images. Each of the displayed images may be the corresponding processed partial image or a wider-area image including the corresponding processed partial image. This wider-area image may be, for example, an image in which the partial image in the corresponding still image is replaced with the processed partial image. In this way, by displaying the plurality of processed partial images, the user can select the processed partial image in which the target site is depicted best.

[0147] The image processing unit 211B shown in FIG. 9 is an example of the image processing unit 211 in FIG. 4. The image processing unit 211B in this example includes a processed image creation unit 2111 and a moving image processing unit 2112, similar to the image processing unit 211A in FIG. 5. Unless otherwise specified, the processed image creation unit 2111 and the moving image processing unit 2112 in this example may be the same as the processed image creation unit 2111 and the moving image processing unit 2112 in the example of FIG. 5, respectively.

[0148] The image processing unit 211B further includes a partial image identification unit 2113A. The partial image identification unit 2113A identifies a partial image in this still image by applying segmentation for identifying an image of a predetermined site of the eye to be examined to the still image included in the first moving image. Generally, segmentation is a process for identifying partial regions in an image. Segmentation may include any known image processing technique, and may include, for example, image processing such as edge detection and / or segmentation using machine learning (e.g., deep learning).

[0149] The processed image creation unit 2111 in this example applies first image processing to the partial images specified by the partial image specification unit 2113A. That is, the application range of the first image processing by the processed image creation unit 2111 in this example is limited to the partial images specified by the partial image specification unit 2113A.

[0150] Furthermore, the partial image specification unit 2113A can also apply the same segmentation to the second moving image generated by the surgical microscope 10 after the user selects the processed image. More specifically, the partial image specification unit 2113A first applies segmentation for specifying an image of the same region of interest to each still image included in the second moving image (or each of the still images selected by downsampling processing or the like (the same applies hereinafter)).

[0151] In some aspects, the segmentation for the still images included in the second moving image may be performed in the same manner as the segmentation for the still images included in the first moving image. Thereby, an image of the same region of interest is specified from each still image included in the second moving image.

[0152] In some aspects, the ophthalmic observation device 1 has a function of analyzing a moving image generated by the surgical microscope 10 to monitor the movement of the eye to be examined. The partial image specifying unit 2113A stores the position of the eye to be examined (referred to as the reference position) when a still image (to which segmentation is applied and is referred to as the reference still image) included in the first moving image is obtained. Further, the partial image specifying unit 2113A stores information indicating the range of the partial image (partial image range) in the still image included in the first moving image. When the generation of the second moving image starts, each still image (referred to as the target still image) included in the second moving image and the position of the eye to be examined (referred to as the target position) when this target still image is obtained are input to the partial image specifying unit 2113A. The partial image specifying unit 2113A obtains the deviation of the target position with respect to the reference position, and specifies the range of the partial image in the target still image by moving the partial image range by this deviation. According to this example, even in a site where segmentation is difficult (for example, a site where the difference in luminance or color from the surroundings is small, a small site, etc.), the tracking of the partial image in the second moving image (where frames are obtained one after another) can be performed in real time.

[0153] According to this example in which such processing is performed, the partial image specifying unit 2113A can sequentially specify the partial images of the still images included in the second moving image by applying segmentation to the second moving image. Further, the image processing unit 210B (moving image processing unit 2112) can sequentially apply the second image processing to the partial images specified from the still images included in the second moving image. Thereby, the value of the image parameter applied to the processed partial image selected by the user can also be applied to the second moving image, and it becomes possible to observe the second moving image in which the site of interest is preferably depicted.

[0154] Next, the example shown in FIG. 10 will be described. Similar to the example of FIG. 9, in this example, by applying image processing only to a part of the still image (frame) included in the moving image, reduction of resources and shortening of time required for image processing are achieved, and optimization of the quality of the image of the site of interest in the observation of the eye to be examined is achieved.

[0155] The image processing unit 211C shown in FIG. 10 creates a plurality of processed partial images by applying first image processing to a part (partial image) of a still image included in the first moving image generated by the surgical microscope 10. In this example, the plurality of processed partial images are treated as a plurality of processed images. The main control unit 201 causes the display device 3 to display a plurality of images each including the created plurality of processed partial images. Each of the displayed images may be the corresponding processed partial image or a wider area image including the corresponding processed partial image. This wider area image may be, for example, an image in which the partial image in the corresponding still image is replaced with the processed partial image. In this way, by displaying a plurality of processed partial images, the user can select the processed partial image in which the target site is depicted most favorably. This point is the same as the example of FIG. 9, but this example is different from the example of FIG. 9 in the method of specifying the partial image.

[0156] The image processing unit 211C shown in FIG. 10 is an example of the image processing unit 211 in FIG. 4. The image processing unit 211C in this example includes a processed image creation unit 2111 and a moving image processing unit 2112, similarly to the image processing unit 211A in FIG. 5. The processed image creation unit 2111 and the moving image processing unit 2112 in this example may be the same as the processed image creation unit 2111 and the moving image processing unit 2112 in the example of FIG. 5, respectively, unless otherwise specified. The image processing unit 211C further includes a partial image identification unit 2113B.

[0157] Also, the control unit 200A shown in FIG. 10 is an example of the control unit 200 in FIG. 3. The control unit 200A in this example includes a main control unit 201 and a storage unit 202, similarly to the control unit 200 in FIG. 3. The main control unit 201 and the storage unit 202 in this example may be the same as the main control unit 201 and the storage unit 202 in the example of FIG. 3, respectively, unless otherwise specified. The control unit 200A further includes a graphical user interface (GUI) control unit 203.

[0158] The main control unit 201 causes the display device 3 to display the first moving image (or a still image included in this first moving image; the same shall apply hereinafter) generated by the surgical microscope 10. The GUI control unit 203 causes the display device 3 to display a GUI for designating a partial region in this first moving image. This GUI is, for example, an image of a figure having a shape and dimensions similar to those of the target site. As an example thereof, the target site is the pupil, and the GUI is a circular or elliptical image. The user can change the position, dimensions, and shape of the GUI, for example, by using the operating device 2. Thereby, for example, the user can make the GUI coincide with the outer edge of the pupil image in the first moving image. When the GUI is adjusted with respect to the image of the target site, the GUI control unit 203 can perform tracking of the GUI in accordance with the movement of the eye under examination in the first moving image. The partial image specifying unit 2113B specifies, as a partial region, a range specified by the GUI (for example, a range surrounded by the GUI (and a predetermined range in the periphery thereof)).

[0159] The processed image creation unit 2111 in this example applies the first image processing to the partial image specified by the partial image specifying unit 2113B. That is, the application range of the first image processing by the processed image creation unit 2111 in this example is limited to the partial image specified by the partial image specifying unit 2113B.

[0160] Furthermore, the partial image specifying unit 2113B can specify a partial image in the second moving image generated by the surgical microscope 10 after the user selects the processed image, for example, in the same manner as the above-described tracking.

[0161] According to this example where such processing is performed, the partial image identification unit 2113B can sequentially identify partial images corresponding to the target site in the still images included in the second moving image by applying segmentation to the second moving image. Furthermore, the image processing unit 210C (moving image processing unit 2112) can sequentially apply second image processing to the partial images identified from the still images included in the second moving image. Thereby, the value of the image parameter applied to the processed partial image selected by the user can also be applied to the second moving image, and it becomes possible to observe the second moving image in which the target site is preferably depicted. Also, in this example, since the range specified by the user himself / herself is set for the partial image, it is possible to express the range according to the user's preference in a manner according to the user's preference.

[0162] <Operation and Usage Mode> Several examples will be described regarding the operation and usage mode of the ophthalmic observation device 1.

[0163] <The First Example> The first example of the operation and usage mode of the ophthalmic observation device 1 will be described with reference to FIGS. 11 to 12E. Note that any of the above-described processing, operations, and usage modes can be combined in this example.

[0164] (S1: Start Generating and Displaying Live Image) First, the user performs a predetermined operation using the operation device 2 to start generating and displaying a live image of the eye to be examined by the ophthalmic observation device 1. Specifically, the surgical microscope 10 illuminates the eye to be examined by the illumination optical system 30 and generates digital image data (video) of the eye to be examined by the imaging elements 62L and 62R. The generated video (live image 301) is displayed on the display device 3 in real time (see FIG. 12A). That is, the video acquired by the surgical microscope 10 is displayed as a live image on the display device 3. The user can perform the surgery while observing this live image. This live image corresponds to the first moving image described above.

[0165] (S2: Shift to Image Processing Mode) Next, the user switches the operation mode of the ophthalmic observation device 1 to the image processing mode by performing a predetermined operation using the operation device 2. The image processing mode is an operation mode for processing the live image displayed by the ophthalmic observation device 1.

[0166] (S3: Capture frame) When the operation mode shifts to the image processing mode, the ophthalmic observation device 1 captures the frame (still image) of the live image.

[0167] The number of frames to be captured is arbitrary. When one frame is captured, this frame is subjected to the following processing. When two or more frames are captured, the ophthalmic observation device 1 (for example, the data processing unit 210) can select one frame from these frames or generate one still image. For example, the ophthalmic observation device 1 can calculate the image quality evaluation values of two or more captured frames and compare them to select one frame. As another example, the ophthalmic observation device 1 can display two or more captured frames on the display device 3 and the user can select one frame specified using the operation device 2. As yet another example, the ophthalmic observation device 1 can create one frame by synthesizing two or more captured frames with a predetermined image process.

[0168] (S4: First image process) The data processing unit 210 (image processing unit 211, processed image creation unit 2111) applies a first image process using a plurality of different values of one or more image parameters to the frame captured in step S3. Thereby, a plurality of processed images based on the captured frame are created.

[0169] In the example shown in FIG. 12B, for the frame (still image) 302 captured from the live image 301, each of the K image processes included in the first image process is applied. I image parameters (I types) are used for the K image processes (I is an integer of 1 or more). Also, for each image parameter (the i-th image parameter; i = 1, ···, I), J values are prepared (J is an integer of 2 or more). Note that the number J of the prepared values may be the same for all image parameters or may be different. In the former case, K = I × J. In the latter case, K = Σ[J(i)]. Here, J(i) indicates the number of values in the i-th image parameter, and Σ is the sum with respect to i. The j-th value of the i-th image parameter is indicated by P(i, j). By such a first image process, a plurality of processed images 303-k are obtained. Here, k = 1, ···, K, and K is an integer of 2 or more.

[0170] Here, the main control unit 201 or the data processing unit 210 records, in association with each of the plurality of processed images, the value (one or more values) of the image parameter used for creating the processed image. For example, in the example of FIG. 12B, for each processed image 303-k, one or more values P(i, j) of one or more image parameters used for creating this processed image 303-k are associated. The information associating such a processed image and the value of the image parameter with each other is called associated information.

[0171] (S5: Create a thumbnail of the processed image) Next, the data processing unit 210 (image processing unit 211) creates a thumbnail of each of the plurality of processed images created in step S4.

[0172] (S6: Display a plurality of thumbnails) Next, the main control unit 201 causes the display device 3 to display the plurality of thumbnails created in step S5. In this example, as shown in FIG. 12C, a plurality of thumbnails (thumbnail group) 303 arranged in a predetermined array are displayed on the live image 301.

[0173] The number of thumbnails displayed at one time is arbitrary. For example, all the thumbnails created in step S5 may be presented at once, or a part (e.g., a predetermined number) of all the thumbnails created in step S5 may be presented at once. Also, the number of thumbnails presented at one time may be made changeable. When only a part of all the thumbnails created in step S5 is presented at one time, an operation for switching the presented thumbnails can be performed. This operation may be, for example, page switching or scrolling.

[0174] (S7: Select Thumbnail) The user compares the plurality of thumbnails displayed in step S6 and selects a desired thumbnail. This selection operation is performed using the aforementioned instruction reception unit (e.g., the foot switch included in the operation device 2). In the example shown in FIG. 12D, one thumbnail 304 is selected from among the plurality of thumbnails 303.

[0175] (S8: Second Image Processing) The main control unit 201 or the data processing unit 210 identifies the value of the image parameter associated with the processed image corresponding to the thumbnail selected in step S7 by referring to the aforementioned related information.

[0176] Furthermore, the data processing unit 210 (image processing unit 211, moving image processing unit 2112) processes the live image generated by the surgical microscope 10 in real time using the identified value of the image parameter (second image processing). The live image processed in real time is displayed on the display device 3 in real time by the main control unit 201 (end). Note that the live image generated and displayed at this stage corresponds to the aforementioned second moving image (live image 305 in FIG. 12E).

[0177] The user can perform the surgery while observing the live image 305 to which the same image processing as the processed image selected by the user is applied.

[0178] When the above-described parameter processing unit 212 (recording unit) is provided, the values of the image parameters applied in the past can be read out and applied again. At this time, the user can selectively read out and reapply the values of the image parameters adopted in the past, or selectively read out and reapply the values of the image parameters that match the attributes of the current medical procedure (for example, the type of surgery). In addition, the values of the image parameters that match the phase of the current medical procedure can be selectively read out and reapplied, or a plurality of values that match the respective phases of the medical procedure can be sequentially reapplied.

[0179] When performing anterior eye surgery, as image parameters, for example, color tone parameters, brightness parameters, contrast parameters, gain parameters, etc. are used. Thereby, the user can observe parts such as the cornea, iris, pupil, and lens in a preferred display mode during, for example, cataract surgery, and can clearly grasp the incision, side port, anterior capsulotomy location in CCC, the emulsification state and aspiration state of the lens, the position and orientation of the IOL, etc. In addition, such a suitable image display mode can be realized simply and quickly.

[0180] When performing vitreous surgery or posterior eye surgery, as image parameters, for example, gamma parameters, gain parameters, color temperature parameters, white balance parameters, RGB balance parameters, etc. are used. Thereby, floating substances, turbidity, proliferative membranes, etc. in the vitreous body can be highlighted, and it becomes possible to improve the working efficiency of the surgery and avoid and reduce surgical mistakes.

[0181] <Second Example> A second example of the operation and usage form of the ophthalmic observation device 1 will be described with reference to FIGS. 13 to 14G. Note that any of the above-described processes, operations, and usage forms can be combined in this example.

[0182] (S11: Start generating and displaying live images) First, the user performs a predetermined operation using the operation device 2 to start the generation and display of a live image of the eye to be examined by the ophthalmic observation device 1. Specifically, the surgical microscope 10 illuminates the eye to be examined by the illumination optical system 30 and generates digital image data (video) of the eye to be examined by the imaging elements 62L and 62R. The generated video (live image 401) is displayed on the display device 3 in real time (see FIG. 14A). That is, the video acquired by the surgical microscope 10 is displayed as a live image on the display device 3. The user can perform the surgery while observing this live image. This live image corresponds to the first moving image described above.

[0183] (S12: Transition to image processing mode) Next, the user performs a predetermined operation using the operation device 2 to switch the operation mode of the ophthalmic observation device 1 to the image processing mode. The image processing mode is an operation mode for processing the live image displayed by the ophthalmic observation device 1.

[0184] (S13: Capture frame) When the operation mode shifts to the image processing mode, the ophthalmic observation device 1 captures a frame (still image) of the live image.

[0185] The number of frames to be captured is arbitrary. When one frame is captured, this frame is subjected to the following processing. When two or more frames are captured, the ophthalmic observation device 1 (for example, the data processing unit 210) can select one frame from these frames or generate one still image. For example, the ophthalmic observation device 1 can calculate the image quality evaluation values of two or more captured frames and compare them to select one frame. As another example, the ophthalmic observation device 1 can display two or more captured frames on the display device 3 and allow the user to select one frame specified using the operation device 2. As still another example, the ophthalmic observation device 1 can create one frame by synthesizing two or more captured frames by a predetermined image process.

[0186] (S14: Set partial image) Next, the ophthalmic observation apparatus 1 (image processing unit 211, partial image specifying unit 2113A or 2113B) sets a partial image of the frame captured in step S13.

[0187] The process of this step is performed automatically or manually. In the automatic case, the partial image specifying unit 2113A in FIG. 9 applies segmentation to the frame captured in step S13 to specify the partial image (the image area surrounded by the frame 402 shown in FIG. 14B). In the manual case, for example, the main control unit 201 causes the display device 3 to display the frame captured in step S13, and the GUI control unit 203 displays a predetermined GUI on this frame. The user designates a partial area of the frame using this GUI. The partial image specifying unit 2113B specifies the range specified by the GUI (for example, the range surrounded by the GUI (and a predetermined range around it)) as a partial area (the image area surrounded by the frame 402 shown in FIG. 14B). Thereby, for example, the partial image 403 shown in FIG. 14C is obtained.

[0188] (S15: First image processing) The data processing unit 210 (image processing unit 211, processed image creation unit 2111) applies first image processing using a plurality of different values of one or more image parameters to the partial image obtained in step S14. Thereby, a plurality of processed partial images based on this partial image are created.

[0189] In the example shown in FIG. 14D, for the partial image 403, each of the K image processes included in the first image process is applied. I (I types) of image parameters are used for the K image processes (I is an integer of 1 or more). Also, for each image parameter (the i-th image parameter; i = 1, ···, I), J values are prepared (J is an integer of 2 or more). Note that the number J of the prepared values may be the same for all the image parameters, or may be different. In the former case, K = I × J. In the latter case, K = Σ[J(i)]. Here, J(i) indicates the number of values in the i-th image parameter, and Σ is the sum with respect to i. The j-th value of the i-th image parameter is indicated by Q(i, j). By such a first image process, a plurality of processed partial images 404-k are obtained. Here, k = 1, ···, K, and K is an integer of 2 or more.

[0190] Here, the main control unit 201 or the data processing unit 210 records, in association with each of the plurality of processed partial images (or, a plurality of processed images), the value (one or more values) of the image parameter used for creating the processed partial image. For example, in the example of FIG. 14D, for each processed partial image 404-k (or, the processed image corresponding thereto), one or more values Q(i, j) of one or more image parameters used for creating this processed partial image 404-k are associated. The information in which such a processed partial image (or processed image) and the value of the image parameter are associated with each other is called associated information.

[0191] (S16: Create a thumbnail of the processed partial image) Next, the data processing unit 210 (image processing unit 211) creates a thumbnail of each of the plurality of processed partial images created in step S15.

[0192] (S17: Display a plurality of thumbnails) Next, the main control unit 201 causes the display device 3 to display the plurality of thumbnails created in step S16. In this example, as shown in FIG. 14E, a plurality of thumbnails (thumbnail group) 405 arranged in a predetermined array are displayed on the live image 401.

[0193] The number of thumbnails displayed at one time is arbitrary. For example, all the thumbnails created in step S16 may be presented at one time, or a part (e.g., a predetermined number) of all the thumbnails created in step S16 may be presented at one time. Also, the number of thumbnails presented at one time may be made changeable. When only a part of all the thumbnails created in step S16 is presented at one time, an operation for switching the presented thumbnails can be performed. This operation may be, for example, page switching or scrolling.

[0194] (S18: Select Thumbnail) The user compares the plurality of thumbnails displayed in step S17 and selects a desired thumbnail. This selection operation is performed using the aforementioned instruction reception unit (e.g., the foot switch included in the operation device 2). In the example shown in FIG. 14F, one thumbnail 406 is selected from among the plurality of thumbnails 405.

[0195] (S19: Second Image Processing) The main control unit 201 or the data processing unit 210 specifies the value of the image parameter associated with the processed partial image corresponding to the thumbnail selected in step S18 by referring to the aforementioned related information.

[0196] Furthermore, the data processing unit 210 (image processing unit 211, moving image processing unit 2112) processes the live image generated by the surgical microscope 10 in real time using the values of the specified image parameters (second image processing). The application range of the second image processing may be only the area of the live image (its frame) corresponding to the frame 402 in FIG. 14B, or the entire live image (its frame). In the former case, for example, the area of the live image corresponding to the frame 402 is sequentially specified by the above-described tracking. The live image processed in real time is displayed on the display device 3 in real time by the main control unit 201 (END). Note that the live image generated and displayed at this stage corresponds to the second moving image described above. The live image 407 in FIG. 12E is an example of the live image displayed in this way. In the live image 407, the second image processing is applied only to the area corresponding to the frame 402 (the area surrounded by the frame 408).

[0197] The user can perform the surgery while observing the live image 407 to which the same image processing as the processed image selected by the user is applied.

[0198] When the above-described parameter processing unit 212 (recording unit) is provided, the values of the image parameters applied in the past can be read out and applied again. At this time, the user can selectively read out and reapply the values of the image parameters adopted in the past, or selectively read out and reapply the values of the image parameters that match the attributes of the current medical act (for example, the type of surgery). In addition, the values of the image parameters that match the phase of the current medical act can be selectively read out and reapplied, or a plurality of values that match the respective phases of the medical act can be sequentially reapplied.

[0199] When performing anterior eye surgery, as image parameters, for example, color tone parameters, brightness parameters, contrast parameters, gain parameters, etc. are used. Thereby, the user can observe parts such as the iris, pupil, and lens in a preferred display mode during, for example, cataract surgery, and can clearly grasp the incision, side port, anterior capsulotomy location in CCC, the emulsification state and suction state of the lens, the position and orientation of the IOL, etc. Also, such a suitable image display mode can be realized simply and quickly.

[0200] When performing vitreous surgery or posterior eye surgery, as image parameters, for example, gamma parameters, gain parameters, color temperature parameters, white balance parameters, RGB balance parameters, etc. are used. Thereby, floating substances, turbidity, proliferative membranes, etc. in the vitreous body can be highlighted, and it becomes possible to improve the working efficiency of the surgery and avoid and reduce surgical errors.

[0201] <Modification Example> Regarding the exemplary embodiments described above, several modification examples will be described.

[0202] In the examples shown in FIGS. 12C, 12D, 14E, and 14F, a part of the image of the eye to be examined is hidden by a plurality of thumbnails (processed images, processed partial images). In order to eliminate this state, a plurality of thumbnails can be displayed in the area where the image of the eye to be examined is not displayed. Examples of processes that can be adopted for this purpose include reducing the display size of the plurality of thumbnails, reducing the display size of each thumbnail, changing the arrangement of the plurality of thumbnails, reducing the number of thumbnails displayed at one time, etc. Also, the range of the image of the eye to be examined can be detected, and a plurality of thumbnails can be displayed in other areas.

[0203] An example of a configuration that can be adopted to realize such an operation is shown in FIG. 15. The data processing unit 210C in FIG. 15 is an example of the data processing unit 210 in FIG. 3. The data processing unit 210C in this example includes a monitoring processing unit 213 in addition to the image processing unit 211. The image processing unit 211 executes the same configuration and operation as those in the above-described embodiment.

[0204] The monitoring processing unit 213 executes data processing for monitoring the movement of the eye to be examined (monitoring unit). The monitoring processing unit 213 detects feature points of the eye to be examined, for example, by analyzing frames of a moving image generated by the surgical microscope 10. The feature points may be any arbitrary landmarks such as, for example, the pupil (center, outer edge, etc.), the limbus (outer edge of the iris), the corneal angle, the optic disc, the macula, blood vessels, etc. The monitoring processing unit 213 sequentially analyzes the frames sequentially generated as a real-time moving image (first moving image) to detect in real time the movement of the feature points in the moving image (temporal change in the position of the feature points).

[0205] Based on the output from the monitoring processing unit 213, the main control unit 201 can change the display state of a plurality of processed images (a plurality of processed partial images, a plurality of thumbnails) displayed together with the real-time moving image. This display state change control is performed, for example, to display a plurality of processed images in an area where the image of the eye to be examined is not displayed. For example, the main control unit 201 can execute control to reduce the display size of a plurality of processed images, control to reduce the display size of each processed image, control to change the arrangement of a plurality of processed images, control to reduce the number of thumbnails displayed at one time, control to stop the display of a plurality of processed images (control not to display a plurality of processed images), and the like.

[0206] According to such a modification, since the display state of a plurality of processed images can be (dynamically) changed according to the movement of the eye to be examined, the plurality of processed images will not interfere with the observation of the image of the eye to be examined. Note that the configuration (monitoring unit) for detecting the movement of the eye to be examined is not limited to the above-described configuration and processing and may be arbitrary.

[0207] FIG. 16 shows another modification. The modification of FIG. 15 focuses on the movement of the eye to be examined, while this modification focuses on the occurrence of abnormalities in the eye to be examined.

[0208] The data processing unit 210D in FIG. 16 is an example of the data processing unit 210 in FIG. 3. The data processing unit 210D in this example includes an abnormality detection unit 214 in addition to the image processing unit 211. The image processing unit 211 executes the same configuration and operation as that in the above-described embodiment.

[0209] The abnormality detection unit 214 executes data processing for detecting an abnormality in the eye to be examined. The type of abnormality to be detected may be arbitrary, and may be, for example, bleeding, a wound, or the like. The abnormality detection unit 214 detects an abnormality, for example, by analyzing a frame of a moving image generated by the surgical microscope 10. For example, bleeding is detected by a change in the color of the image (such as an increase in the red area).

[0210] In some aspects, the abnormality detection unit 214 may include a system (artificial intelligence engine) constructed by machine learning using a training data set including surgical images and the like. This artificial intelligence engine includes, for example, a neural network (typically, a convolutional neural network) constructed by machine learning that takes a surgical image as an input and outputs the probability of occurrence of a predetermined abnormality. The abnormality detection unit 214 in this example sequentially inputs frames of a real-time moving image (first moving image) generated by the surgical microscope 10 to the artificial intelligence engine. The artificial intelligence engine sequentially outputs the probability of abnormality occurrence based on the input frames. The abnormality detection unit 214 performs abnormality detection based on the sequentially output probabilities of abnormality occurrence. For example, the abnormality detection unit 214 determines that an abnormality has been detected when the sequentially output probability of abnormality occurrence exceeds a predetermined threshold. As another example, the abnormality detection unit 214 can perform abnormality detection based on a change (for example, a change rate, a change amount) in the sequentially output probability of abnormality occurrence.

[0211] Based on the output from the abnormality detection unit 214, the main control unit 201 can change the display state of a plurality of processed images (a plurality of processed partial images, a plurality of thumbnails) displayed together with the real-time moving image. This display state change control is executed, for example, to display a plurality of processed images in an area where the image of the eye to be examined is not displayed, or to display a plurality of processed images in an area other than the area where an abnormality is detected. For example, the main control unit 201 can execute control to reduce the display size of a plurality of processed images, control to reduce the display size of each processed image, control to change the arrangement of a plurality of processed images, control to reduce the number of thumbnails displayed at one time, control to stop the display of a plurality of processed images (control not to display a plurality of processed images), and the like.

[0212] According to such a modification, since the display state of a plurality of processed images can be (dynamically) changed in response to the occurrence of an abnormality in the eye to be examined, the plurality of processed images will not interfere with the observation of the image of the eye to be examined (particularly, the location where the abnormality occurs). Note that the configuration (monitoring unit) for detecting an abnormality in the eye to be examined is not limited to the above-described configuration and processing, and may be arbitrary.

[0213] The ophthalmic observation device 1 of the above-described embodiment is configured to apply first image processing to still images (frames) included in a first moving image to generate and display a plurality of processed images. In contrast, some exemplary aspects may be configured to sequentially apply first image processing to each still image (each frame) included in the first moving image to generate and display a plurality of processed images (a plurality of processed moving images). In such an aspect, the plurality of processed moving images can be displayed side by side or sequentially. Further, for at least a part of the plurality of processed moving images, it is also possible to display the still images (processed still images, processed frames) included in the processed images. According to this aspect, it is effective when it is desired to optimize the display mode of a moving eye under examination or when it is desired to optimize the display mode of an object accompanied by movement (such as floating objects, turbidity, proliferative membranes, fluid flow, blood flow, etc.). On the other hand, in order to perform such processing in real time, a larger amount of resources is required than the ophthalmic observation device 1 of the above-described embodiment. Therefore, in order to reduce the processing load when handling processed moving images, any processing load reduction method such as reducing the number of generated processed moving images, reducing the number of processed moving images (thumbnails) to be processed, reducing the number of processed moving images (thumbnails) to be displayed, and performing decimation processing of frames may be applied.

[0214] <Ophthalmic Image Processing Apparatus> An ophthalmic image processing apparatus according to an exemplary embodiment will be described. The ophthalmic image processing apparatus is configured to process an image of an eye under examination. Any matters (functions, configurations, processes, operations, usage forms, etc.) related to the ophthalmic observation device 1 of the above-described embodiment can be combined with the following exemplary ophthalmic image processing apparatus.

[0215] A configuration example of the ophthalmic image processing apparatus of this example is shown in FIG. 17. Among the elements of the ophthalmic image processing apparatus 500 in FIG. 17, elements other than the moving image reception unit 501 may be configured in the same manner as the corresponding elements in the ophthalmic observation device 1 according to the above-described embodiment, and detailed descriptions thereof will be omitted unless otherwise specified.

[0216] The control unit 502 of the ophthalmic image processing apparatus 500 corresponds to the control unit 200 of the ophthalmic observation apparatus 1 of the above-described embodiment. The image processing unit 503 of the ophthalmic image processing apparatus 500 corresponds to the data processing unit 210 (image processing unit 211) of the ophthalmic observation apparatus 1 of the above-described embodiment. The user interface (UI) 504 of the ophthalmic image processing apparatus 500 corresponds to the operation device 2 and the display device 3 of the ophthalmic observation apparatus 1 of the above-described embodiment.

[0217] The moving image receiving unit 501 receives a moving image of the eye to be examined. The moving image receiving unit 501 receives the moving image directly or indirectly from the surgical microscope 10. For example, the moving image receiving unit 501 is connected to the surgical microscope 10 by a communication line or a cable. Alternatively, the moving image receiving unit 501 is connected to a device (buffer) in which the moving image generated by the surgical microscope 10 is (temporarily) stored by a communication line or a cable.

[0218] The moving image receiving unit 501 receives the first moving image of the above-described embodiment. The control unit 502 sends the first moving image received by the moving image receiving unit 501 to the image processing unit 503.

[0219] By executing the processes described in the above-described embodiment, the image processing unit 503 applies first image processing using a plurality of different values of predetermined image parameters to the still images included in the first moving image, respectively, to create a plurality of processed images.

[0220] The control unit 502 (display control unit) causes the UI 504 (first display device) to display the plurality of processed images created by the image processing unit 503.

[0221] In addition to such a series of operations, the ophthalmic image processing apparatus 500 can execute the following processes in the same manner as the ophthalmic observation apparatus 1 of the above-described embodiment. The user can give an instruction to select at least one of the plurality of processed images displayed on the UI 504. This instruction can be given in the same manner as in the case of the ophthalmic observation apparatus 1 of the above-described embodiment, and is performed, for example, using the UI 504 (instruction receiving unit).

[0222] The image processing unit 503 applies second image processing based on at least one value of the image parameters corresponding to at least one processed image specified by the user to the moving image of the eye to be examined (second moving image) received by the moving image reception unit 501 after selection based on the instruction of this user. This processing (second image processing) is executed in the same manner as in the case of the ophthalmic observation apparatus 1 of the above embodiment.

[0223] The control unit 502 (display control unit) causes the UI 504 (second display device) to display the second moving image to which the second image processing has been applied.

[0224] According to such an ophthalmic image processing apparatus 500, the same operations and effects as those of the ophthalmic observation apparatus 1 of the above embodiment can be achieved. Further, by combining the matters (functions, configurations, processes, operations, usage forms, etc.) related to the ophthalmic observation apparatus 1 of the above embodiment with the ophthalmic image processing apparatus 500, the resulting ophthalmic image processing apparatus 500 can achieve the operations and effects corresponding to the combined matters.

[0225] <Ophthalmic Image Processing Method> Exemplary embodiments (for example, the above-described ophthalmic observation apparatus 1 or ophthalmic image processing apparatus 500) provide a method for processing an ophthalmic image (image of the eye to be examined). It is possible to combine any matters related to the ophthalmic observation apparatus 1 of the above embodiment with the following exemplary ophthalmic image processing method, and it is also possible to combine any matters related to the ophthalmic image processing apparatus 500 of the above embodiment.

[0226] The exemplary ophthalmic image processing method first receives a first moving image of an eye to be examined. Next, first image processing using a plurality of different values of predetermined image parameters is applied to the still images included in this first moving image to create a plurality of processed images. Next, the created plurality of processed images are displayed. Next, an instruction for selecting at least one processed image from among the displayed plurality of processed images is received. After at least one processed image is selected based on this instruction, a second moving image of the eye to be examined is received. Next, second image processing based on at least one value of the image parameter corresponding to the selected at least one processed image is applied to the second moving image. Next, the second moving image to which the second image processing has been applied is displayed. Such a series of steps has been described as the operation and usage mode of the ophthalmic observation device 1 of the above-described embodiment (FIGS. 11, 12A to 12E, 13, 14A to 14G, etc.).

[0227] According to such an ophthalmic image processing method, the same operations and effects as those of the ophthalmic observation device 1 and the ophthalmic image processing device 500 of the above-described embodiment can be achieved. Further, by combining the matters related to the ophthalmic observation device 1 or the ophthalmic image processing device 500 of the above-described embodiment with the ophthalmic image processing method, the resulting ophthalmic image processing method can achieve the operations and effects corresponding to the combined matters.

[0228] <Program> The exemplary embodiment provides a program for causing a computer to execute the above-described ophthalmic image processing method. It is possible to combine the matters related to the ophthalmic observation device 1 or the ophthalmic image processing device 500 of the above-described embodiment with such a program.

[0229] According to such a program, the same operations and effects as those of the ophthalmic observation device 1 and the ophthalmic image processing device 500 of the above-described embodiment can be achieved. Further, by combining the matters related to the ophthalmic observation device 1 or the ophthalmic image processing device 500 of the above-described embodiment with the program, the resulting program can achieve the operations and effects corresponding to the combined matters.

[0230] <Recording medium> Exemplary embodiments provide a computer-readable non-transitory recording medium having recorded thereon a program as described above. With respect to such a recording medium, it is possible to combine matters related to the ophthalmic observation apparatus 1 or the ophthalmic image processing apparatus 500 of the above-described embodiments. The form of the non-transitory recording medium may be arbitrary, and examples thereof include magnetic disks, optical disks, magneto-optical disks, semiconductor memories, and the like.

[0231] According to such a recording medium, it is possible to achieve the same operations and effects as those of the ophthalmic observation apparatus 1 and the ophthalmic image processing apparatus 500 of the above-described embodiments. Further, by combining matters related to the ophthalmic observation apparatus 1 or the ophthalmic image processing apparatus 500 of the above-described embodiments with the recording medium, the resulting recording medium can achieve the operations and effects corresponding to the combined matters.

[0232] The above-described embodiments are merely examples for carrying out the present invention. Those who attempt to carry out the present invention can make arbitrary modifications, omissions, additions, substitutions, and the like within the scope of the gist of the present invention.

Explanation of reference numerals

[0233] 1 Ophthalmic observation apparatus 2 Operating device 3 Display device 10 Surgical microscope 30 Illumination optical system 40 Observation optical system 60 Imaging camera 200 Control unit 201 Main control unit 203 GUI control unit 210 Data processing unit 211 Image processing unit 2111 Processed image creation unit 2112 Moving image processing unit 212 Parameter processing unit 2121 Parameter storage unit 2122 Parameter selection unit 2123 Shooting condition recording section 2124 Shooting condition selection section 2125 Parameter determination section 2113A, 2113B Partial image identification section 221 Identifier reception section 222 Attribute information acquisition section

Claims

1. An ophthalmic observation device for observing an eye to be examined, comprising: a moving image generating unit that captures an image of the subject's eye and generates a first moving image; an image processing unit that applies a first image processing to each still image included in the first moving image, the first image processing using a plurality of different values ​​of a predetermined image parameter, to generate a plurality of processed images; a display control unit that causes a first display device to display the plurality of processed images; an instruction receiving unit that receives an instruction to select at least one processed image from the plurality of processed images displayed on the first display device; Including, the image processing unit applies a second image process based on at least one value of the image parameter corresponding to the at least one processed image to a second moving image generated by the moving image generating unit after the at least one processed image is selected using the instruction receiving unit; the display control unit causes a second display device to display the second moving image to which the second image processing has been applied; an identifier receiving unit that receives a user identifier; a recording unit that records the one value of the image parameter used in the second image processing in association with the identifier accepted by the identifier accepting unit; Further comprising: Ophthalmic observation equipment.

2. An ophthalmic observation device for observing an eye to be examined, comprising: a moving image generating unit that captures an image of the subject's eye and generates a first moving image; an image processing unit that applies a first image processing to each still image included in the first moving image, the first image processing using a plurality of different values ​​of a predetermined image parameter, to generate a plurality of processed images; a display control unit that causes a first display device to display the plurality of processed images; an instruction receiving unit that receives an instruction to select at least one processed image from the plurality of processed images displayed on the first display device; Including, the image processing unit applies a second image process based on at least one value of the image parameter corresponding to the at least one processed image to a second moving image generated by the moving image generating unit after the at least one processed image is selected using the instruction receiving unit; the display control unit causes a second display device to display the second moving image to which the second image processing has been applied; an attribute information acquiring unit that acquires attribute information indicating attributes of a medical procedure for the subject's eye; a recording unit that records the one value of the image parameter used in the second image processing in association with the attribute information acquired by the attribute information acquisition unit; Further comprising: Ophthalmic observation equipment.

3. An ophthalmic observation device for observing an eye to be examined, comprising: a moving image generating unit that captures an image of the subject's eye and generates a first moving image; an image processing unit that applies a first image processing to each still image included in the first moving image, the first image processing using a plurality of different values ​​of a predetermined image parameter, to generate a plurality of processed images; a display control unit that causes a first display device to display the plurality of processed images; an instruction receiving unit that receives an instruction to select at least one processed image from the plurality of processed images displayed on the first display device; Including, the image processing unit applies a second image process based on at least one value of the image parameter corresponding to the at least one processed image to a second moving image generated by the moving image generating unit after the at least one processed image is selected using the instruction receiving unit; the display control unit causes a second display device to display the second moving image to which the second image processing has been applied; an identifier receiving unit that receives a user identifier; an attribute information acquiring unit that acquires attribute information indicating attributes of a medical procedure for the subject's eye; a recording unit that records the one value of the image parameter used in the second image processing in association with the identifier accepted by the identifier accepting unit and the attribute information acquired by the attribute information acquiring unit; Further comprising: Ophthalmic observation equipment.

4. a selection unit that selects at least one value from among the values ​​of the image parameters previously recorded by the recording unit; the image processing unit applies image processing based on the at least one value selected by the selection unit to the third moving image generated by the moving image generation unit. An ophthalmologic observation device according to any one of claims 1 to 3.

5. the recording unit records a shooting condition when the second moving image was generated in association with the one value of the image parameter; The selection unit further selects an imaging condition associated with the at least one value selected by the selection unit; a determination unit that determines a value of the image parameter based on the at least one value selected by the selection unit and the shooting condition, the image processing unit applies image processing to the third moving image using the values ​​of the image parameters determined by the determination unit; the determination unit uses a relationship between a change in a shooting condition and a value of an image parameter, and applies a change from the shooting condition selected by the selection unit to the shooting condition of the third video image to the relationship, thereby adjusting the value of the at least one of the image parameters selected by the selection unit in response to a change from the shooting condition selected by the selection unit to the shooting condition of the third video image.

5. An ophthalmologic observation device according to claim 4.

6. An ophthalmologic image processing device that processes an image of a subject's eye, a moving image receiving unit that receives a first moving image of the subject's eye; an image processing unit that applies a first image processing to each still image included in the first moving image, the first image processing using a plurality of different values ​​of a predetermined image parameter, to generate a plurality of processed images; a display control unit that causes a first display device to display the plurality of processed images; an instruction receiving unit that receives an instruction to select at least one processed image from the plurality of processed images displayed on the first display device; Including, the image processing unit applies a second image processing based on at least one value of the image parameter corresponding to the at least one processed image to a second moving image of the subject's eye accepted by the moving image accepting unit after the at least one processed image is selected based on the instruction, the display control unit causes a second display device to display the second moving image to which the second image processing has been applied; an identifier receiving unit that receives a user identifier; a recording unit that records the one value of the image parameter used in the second image processing in association with the identifier accepted by the identifier accepting unit; Further comprising: Ophthalmic imaging device.

7. An ophthalmologic image processing device that processes an image of a subject's eye, a moving image receiving unit that receives a first moving image of the subject's eye; an image processing unit that applies a first image processing to each still image included in the first moving image, the first image processing using a plurality of different values ​​of a predetermined image parameter, to generate a plurality of processed images; a display control unit that causes a first display device to display the plurality of processed images; an instruction receiving unit that receives an instruction to select at least one processed image from the plurality of processed images displayed on the first display device; Including, the image processing unit applies a second image processing based on at least one value of the image parameter corresponding to the at least one processed image to a second moving image of the subject's eye accepted by the moving image accepting unit after the at least one processed image is selected based on the instruction, the display control unit causes a second display device to display the second moving image to which the second image processing has been applied; an attribute information acquiring unit that acquires attribute information indicating attributes of a medical procedure for the subject's eye; a recording unit that records the one value of the image parameter used in the second image processing in association with the attribute information acquired by the attribute information acquisition unit; Further comprising: Ophthalmic imaging device.

8. An ophthalmologic image processing device that processes an image of a subject's eye, a moving image receiving unit that receives a first moving image of the subject's eye; an image processing unit that applies a first image processing to each still image included in the first moving image, the first image processing using a plurality of different values ​​of a predetermined image parameter, to generate a plurality of processed images; a display control unit that causes a first display device to display the plurality of processed images; an instruction receiving unit that receives an instruction to select at least one processed image from the plurality of processed images displayed on the first display device; Including, the image processing unit applies a second image processing based on at least one value of the image parameter corresponding to the at least one processed image to a second moving image of the subject's eye accepted by the moving image accepting unit after the at least one processed image is selected based on the instruction, the display control unit causes a second display device to display the second moving image to which the second image processing has been applied; an identifier receiving unit that receives a user identifier; an attribute information acquiring unit that acquires attribute information indicating attributes of a medical procedure for the subject's eye; a recording unit that records the one value of the image parameter used in the second image processing in association with the identifier accepted by the identifier accepting unit and the attribute information acquired by the attribute information acquiring unit; Further comprising: Ophthalmic imaging device.

9. An ophthalmologic image processing method for processing an image of a subject's eye, comprising: accepting a first moving image of the subject's eye; applying a first image processing to each still image included in the first moving image, the first image processing using a plurality of different values ​​of a predetermined image parameter, to generate a plurality of processed images; Displaying the plurality of processed images; accepting an instruction to select at least one processed image from the displayed plurality of processed images; receiving a second moving image of the subject's eye after the at least one processed image is selected based on the instruction; applying a second image processing to the second video sequence based on at least one value of the image parameter corresponding to the at least one processed image; displaying the second moving image to which the second image processing has been applied; Accepts the user's identifier, recording the one value of the image parameter used in the second image processing in association with the received identifier; Ophthalmic image processing methods.

10. An ophthalmologic image processing method for processing an image of a subject's eye, comprising: accepting a first moving image of the subject's eye; applying a first image processing to each still image included in the first moving image, the first image processing using a plurality of different values ​​of a predetermined image parameter, to generate a plurality of processed images; Displaying the plurality of processed images; accepting an instruction to select at least one processed image from the displayed plurality of processed images; receiving a second moving image of the subject's eye after the at least one processed image is selected based on the instruction; applying a second image processing to the second video sequence based on at least one value of the image parameter corresponding to the at least one processed image; displaying the second moving image to which the second image processing has been applied; acquiring attribute information indicating attributes of a medical procedure for the subject's eye; the one value of the image parameter used in the second image processing is recorded in association with the acquired attribute information; Ophthalmic image processing methods.

11. An ophthalmologic image processing method for processing an image of a subject's eye, comprising: accepting a first moving image of the subject's eye; applying a first image processing to each still image included in the first moving image, the first image processing using a plurality of different values ​​of a predetermined image parameter, to generate a plurality of processed images; Displaying the plurality of processed images; accepting an instruction to select at least one processed image from the displayed plurality of processed images; receiving a second moving image of the subject's eye after the at least one processed image is selected based on the instruction; applying a second image processing to the second video sequence based on at least one value of the image parameter corresponding to the at least one processed image; displaying the second moving image to which the second image processing has been applied; Accepts the user's identifier, acquiring attribute information indicating attributes of a medical procedure for the subject's eye; the one value of the image parameter used in the second image processing is recorded in association with the accepted identifier and the acquired attribute information; Ophthalmic image processing methods.

12. A program for causing a computer to execute the method according to any one of claims 9 to 11.

13. A non-transitory computer-readable recording medium having the program of claim 12 recorded thereon.

Images