Ophthalmic observation devices, their control methods, procedures, and recording media

Abstract

An ophthalmic observation device (1) according to an exemplary embodiment includes a dynamic image generation unit (30, 40), an analysis unit (211), and a display control unit (200). The dynamic image generation unit captures images of the eye being examined with an artificial object inserted and generates dynamic images. The analysis unit analyzes the still images included in the dynamic images generated by the dynamic image generation unit and determines a first part image corresponding to a predetermined part of the eye being examined and a second part image corresponding to a predetermined part of the artificial object. The display control unit causes the display device (3) to display the dynamic images generated by the dynamic image generation unit, first position information indicating the position of the first part image determined by the analysis unit, and second position information indicating the position of the second part image determined by the analysis unit.

Description

Technical Field

[0001] (Mutual references between related applications)

[0002] This application claims priority to U.S. Provisional Patent Application No. 63 / 106,087, filed October 27, 2020, entitled “APPARATUS AND METHOD FOROPHTHALMIC OBSERVATION”, which is incorporated herein by reference in its entirety.

[0003] This disclosure relates to an ophthalmic observation device, its control method, procedure, and recording medium. Background Technology

[0004] An ophthalmic observation device is used to observe a patient's eye (the eye being examined). Ophthalmic observation is performed in various situations, such as examinations, surgeries, and treatments, to monitor the condition of the eye being examined.

[0005] Traditional ophthalmic observation devices provide the user with a magnified image obtained from an objective lens and a zoom optical system via an eyepiece lens. However, in recent years, ophthalmic observation devices with the following structure have emerged: they use a camera element to capture a magnified image obtained from an objective lens and a zoom optical system, and display the resulting image (called a digital ophthalmic observation device). Types of digital ophthalmic observation devices include surgical microscopes, slit-lamp microscopes, and fundus cameras. Furthermore, various ophthalmic examination devices, such as refractometers, corneal astigmatism meters, tonometers, corneal endothelial microscopes, wavefront aberrometers, and microperimeters, also incorporate functions as digital ophthalmic observation devices.

[0006] Furthermore, in recent years, ophthalmic observation devices have included those utilizing optical scanning (scanning ophthalmic observation devices). Such ophthalmic devices include scanning laser ophthalmoscopes (SLO) and optical coherence tomography (OCT) devices.

[0007] Typically, ophthalmic observation devices provide users (e.g., physicians and other healthcare professionals) with dynamic images of the eye being examined. Digital ophthalmic observation devices are typically configured to perform dynamic image capture using infrared and / or visible light as illumination and real-time dynamic image display of the resulting images. On the other hand, scanning ophthalmic observation devices are typically configured to perform data collection based on repeated light scans, real-time image reconstruction based on the sequentially collected datasets, and real-time dynamic image display of the sequentially reconstructed images. These real-time dynamic images are referred to as observation images or live images.

[0008] Ophthalmic observation devices capable of providing real-time dynamic images are also used in surgery. There are many types of ophthalmic surgery, but typical surgical methods include the retention of artificial objects within the eye. Examples include cataract surgery using an intraocular lens (IOL) to replace the lens, refractive surgery that retains an intraocular contact lens (ICL; also known as a faux IOL) in the anterior chamber, and minimally invasive glaucoma surgery (MIGS) that retains a stent within the fibrous column.

[0009] Patent Document 1: Japanese Patent Application Publication No. 2019-162336 Summary of the Invention

[0010] In surgeries involving the placement of artificial objects within the eye, it is crucial to ensure their correct positioning. For example, in cataract and refractive surgeries, lens centering (aligning the lens center with the eye axis) is essential to prevent postoperative focal deviation. Additionally, in MIGS (Mixed Intracranial Glandular Surgery), aligning the support structure with the fibrous column is necessary to ensure proper aqueous humor drainage. Currently, there are no readily available methods to easily confirm the proper placement of the artificial object, making this process time-consuming and labor-intensive. For instance, there are no readily available reference points for lens centering; therefore, approximate alignment is achieved by referring to the light reflection from the image of the eye provided by the eyepiece lens or a display device.

[0011] One of the purposes of this disclosure is to provide a new technique for making ophthalmic surgery easier.

[0012] Several exemplary embodiments are ophthalmic observation devices for observing an eye under examination, which may include: a dynamic image generation unit for capturing and generating a dynamic image of the eye under examination with an artificial object inserted; an analysis unit for analyzing the still images included in the dynamic image and determining a first part image corresponding to a predetermined part of the eye under examination and a second part image corresponding to a predetermined part of the artificial object; and a display control unit for causing a display device to display the dynamic image, first position information indicating the position of the first part image, and second position information indicating the position of the second part image.

[0013] In several exemplary ophthalmic observation devices, the display control unit may also display information based on the offset between the first part image and the second part image, according to the position of the first part image and the position of the second part image.

[0014] In several exemplary ophthalmic observation devices, the display control unit may include first guidance information indicating the direction of movement of the artificial object.

[0015] In several exemplary ophthalmic observation devices, the display control unit may also include second guidance information indicating the distance the artificial object has moved.

[0016] In several exemplary ophthalmic observation devices, the display control unit may display the first position information and the second position information in different ways.

[0017] In several exemplary ophthalmic observation devices, the analysis unit may sequentially determine the first part image and the second part image from the still images sequentially generated by the dynamic image generation unit, in parallel with the generation of the dynamic image by the dynamic image generation unit. The display control unit may also sequentially update the first position information and the second position information displayed together with the dynamic image, in parallel with the sequential generation of the still images by the dynamic image generation unit and the sequential analysis of the still images by the analysis unit.

[0018] In several exemplary ophthalmic observation devices, the predetermined portion of the artificial object may be at least one of the edge of the intraocular lens, an approximate shape of the edge, the center of the intraocular lens, and the aperture of the intraocular lens.

[0019] In several exemplary ophthalmic observation devices, the predetermined region of the eye being examined may be at least one of the corneal helix, an approximate pattern of the corneal helix, the corneal center, the pupillary edge, an approximate pattern of the pupillary edge, and the pupillary center.

[0020] Several exemplary embodiments are methods for controlling an ophthalmic observation device, the ophthalmic observation device including an optical system for generating a dynamic image of an eye being examined and a processor, wherein the optical system generates a dynamic image of the eye being examined with an artificial object inserted, the processor analyzes still images included in the dynamic image and determines a first part image corresponding to a predetermined part of the eye being examined and a second part image corresponding to a predetermined part of the artificial object, and the processor displays the dynamic image, first position information indicating the position of the first part image, and second position information indicating the position of the second part image on a display device.

[0021] Several exemplary modes are a procedure that enables the calculation of exemplary modes.

[0022] Several exemplary modes are computer-readable, non-transitory recording media that record the programs of the exemplary modes.

[0023] Based on the illustrative approach, ophthalmic surgery can be made easier. Attached Figure Description

[0024] Figure 1 This is a schematic diagram illustrating an example of the structure of an ophthalmic observation device (ophthalmic surgical microscope) according to an exemplary embodiment.

[0025] Figure 2 This is a schematic diagram illustrating an example of the structure of an ophthalmic observation device according to an exemplary embodiment.

[0026] Figure 3 This is a schematic diagram illustrating an example of the structure of an ophthalmic observation device according to an exemplary embodiment.

[0027] Figure 4 This is a schematic diagram illustrating an example of the structure of an ophthalmic observation device according to an exemplary embodiment.

[0028] Figure 5 This is a flowchart illustrating an example of the processing performed by an ophthalmic observation device according to an exemplary embodiment.

[0029] Figure 6A This is a schematic diagram illustrating an example of the processing performed by an ophthalmic observation device according to an exemplary embodiment.

[0030] Figure 6B This is a schematic diagram illustrating an example of the processing performed by an ophthalmic observation device according to an exemplary embodiment.

[0031] Figure 6C This is a schematic diagram illustrating an example of the processing performed by an ophthalmic observation device according to an exemplary embodiment.

[0032] Figure 6D This is a schematic diagram illustrating an example of the processing performed by an ophthalmic observation device according to an exemplary embodiment.

[0033] Figure 6E This is a schematic diagram illustrating an example of the processing performed by an ophthalmic observation device according to an exemplary embodiment.

[0034] Figure 6F This is a schematic diagram illustrating an example of the processing performed by an ophthalmic observation device according to an exemplary embodiment.

[0035] Figure 6G This is a schematic diagram illustrating an example of the processing performed by an ophthalmic observation device according to an exemplary embodiment.

[0036] Figure 6H This is a schematic diagram illustrating an example of the processing performed by an ophthalmic observation device according to an exemplary embodiment.

[0037] Figure 6I This is a schematic diagram illustrating an example of the processing performed by an ophthalmic observation device according to an exemplary embodiment.

[0038] Figure 7A This is a schematic diagram illustrating one example of the processing performed by the modified ophthalmic observation device.

[0039] Figure 7B This is a schematic diagram illustrating one example of the processing performed by the modified ophthalmic observation device. Detailed Implementation

[0040] Referring to the accompanying drawings, several exemplary embodiments of the ophthalmic observation device, the method and procedure for controlling it, and the recording medium are described in detail. Furthermore, matters described in the documents cited in this specification, any known techniques, and exemplary embodiments can be combined.

[0041] The exemplary ophthalmic observation devices are used in medical procedures such as surgery, examination, and treatment to monitor the condition of the examined eye. The exemplary ophthalmic observation devices described below are surgical microscope systems, but are not limited to surgical microscope systems. For example, an ophthalmic observation device can be any of the following: a slit-lamp microscope, fundus camera, refractometer, corneal astigmatism meter, tonometer, corneal endothelial microscope, wavefront aberrometer, microperimeter, SLO, and OCT device, and can also be a system including any and more of these. More commonly, an ophthalmic observation device can be any ophthalmic device with observation capabilities.

[0042] The observation site using ophthalmic observation devices can be any part of the examined eye, including any part of the anterior and / or posterior eye. Examples of anterior eye observation sites include the cornea, iris, anterior chamber, anterior chamber angle, lens, ciliary body, and zonules of Qin. Examples of posterior eye observation sites include the retina, choroid, sclera, and vitreous body. The observation site is not limited to ocular tissues; it can also be any part of the eyelids, meibomian glands, or orbit used in ophthalmology (and / or other specialties) for observation.

[0043] Ophthalmic observation devices are used to observe artificial objects inserted into the eye. For example, artificial objects can be any device remaining in the eye, such as an intraocular lens, an intraocular contact lens, or a MIGS device (stent). Additionally, artificial objects can also be any medical device, such as surgical instruments, examination instruments, or treatment instruments.

[0044] At least a portion of the functionality of the elements disclosed in this specification is implemented using a circuitry or processing circuitry. The circuitry or processing circuitry includes any of the following: a common processor, a special-purpose processor, an integrated circuit, a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), an ASIC (Application Specific Integrated Circuit), a programmable logic device (e.g., a SPLD (Simple Programmable Logic Device), a CPLD (Complex Programmable Logic Device), an FPGA (Field Programmable Gate Array)), conventional circuitry, and any combination thereof. A processor is considered to be a processing circuitry or circuitry including transistors and / or other circuitry. In this disclosure, circuitry, units, components, or similar terms are hardware that performs at least a portion of the disclosed functionality or hardware programmed to perform at least a portion of the disclosed functionality. The hardware may be the hardware disclosed in this specification or known hardware programmed and / or configured to perform at least a portion of the functions described herein. In the case where the hardware is a processor considered as a type of circuit structure, the circuit structure, unit, component, or similar term is a combination of hardware and software used to constitute the hardware and / or processor.

[0045] <Ophthalmic Observation Device>

[0046] Figure 1 The structure of an ophthalmic observation device is shown as an example.

[0047] The ophthalmic observation device 1 (surgical microscope system) of the embodiment includes an operating device 2, a display device 3, and a surgical microscope 10. In several embodiments, the surgical microscope 10 may include at least one of the operating device 2 and the display device 3. Additionally, in several embodiments, the display device 3 may not be included in the ophthalmic observation device 1. That is, the display device 3 may be a peripheral device of the ophthalmic observation device 1.

[0048] <Operating Device 2>

[0049] Operating device 2 includes operating equipment and / or input devices. For example, operating device 2 may also include buttons, switches, mice, keyboards, trackballs, operation panels, dials, etc. Typically, operating device 2 includes a foot switch, similar to that of a general ophthalmic surgical microscope. Alternatively, it may be configured to be operated using voice recognition, gaze input, etc.

[0050] <Display Device 3>

[0051] Display device 3 displays images of the examined eye acquired by surgical microscope 10. Display device 3 includes display devices such as flat panel displays. Alternatively, display device 3 may also include various display devices such as touch panels. A typical display device 3 includes a large-screen display. Display device 3 may include one or more display devices. In cases where display device 3 includes two or more display devices, for example, one may be a larger-screen display device and another a smaller-screen display device. Furthermore, a structure can be adopted where multiple display areas are set on a single display device to display multiple pieces of information.

[0052] The operating device 2 and the display device 3 do not need to be separate devices. For example, a device that integrates operating and display functions, such as a touch panel, can be used as the display device 3. In this case, the operating device 2 includes the touch panel and a computer program. Operations on the operating device 2 are input to a processor (not shown) as electrical signals. Alternatively, operations and information input can be performed using a graphical user interface (GUI) displayed on the display device 3 and the operating device 2. In several ways, the functions of the operating device 2 and the display device 3 can also be implemented using a touch screen.

[0053] <Surgical Microscope 10>

[0054] The surgical microscope 10 is used to observe the eye (examined eye) of a patient in a supine position. The surgical microscope 10 captures images of the examined eye to generate digital image data. In particular, the surgical microscope 10 generates a dynamic image of the examined eye. The dynamic image (image) generated by the surgical microscope 10 is transmitted to and displayed on the display device 3 via wired and / or wireless signal lines. The user (surgical operator) can perform surgery while observing the examined eye through the displayed image. In addition to such image observation, several types of surgical microscopes 10 also allow observation via conventional eyepiece lenses.

[0055] In several embodiments, the surgical microscope 10 includes a communication device for transmitting and receiving electrical signals between itself and the operating device 2. The operating device 2 receives user operations and generates corresponding electrical signals (operation signals). The operation signals are transmitted to the surgical microscope 10 via wired and / or wireless signal lines. The surgical microscope 10 performs processing corresponding to the received operation signals.

[0056] <Optical System of Surgical Microscope 10>

[0057] Hereinafter, for ease of explanation, the optical system structure of the surgical microscope 10 will be described as follows: the direction of the optical axis of the objective lens will be defined as the z-direction (e.g., the vertical direction during surgery, the up-down direction), a predetermined direction orthogonal to the z-direction will be defined as the x-direction (e.g., the horizontal direction during surgery, the left-right direction for the surgeon and the patient), and a direction orthogonal to both the z-direction and the x-direction will be defined as the y-direction (e.g., the horizontal direction during surgery, the front-back direction for the surgeon, the body axis direction for the patient).

[0058] Furthermore, the following description primarily focuses on the case where the observation optical system has a pair of left and right optical systems (optical systems that allow binocular observation). However, other types of observation optical systems can have a monocular observation optical system, and those skilled in the art will recognize that the structure described below can be applied to such systems.

[0059] Figure 2 An example of the structure of the optical system of the surgical microscope 10 is shown. Figure 2 This diagram shows a schematic top view of the optical system viewed from above and a schematic side view of the optical system viewed from the side. For the sake of simplicity, the illumination optical system 30, which is placed above the objective lens 20, is omitted from the top view.

[0060] The surgical microscope 10 includes an objective lens 20, a dichroic mirror DM1, an illumination optics system 30, and an observation optics system 40. The observation optics system 40 includes a zoom extender 50 and a camera 60. In several configurations, either the illumination optics system 30 or the observation optics system 40 includes the dichroic mirror DM1.

[0061] Objective lens 20 is positioned facing the eye being examined. Objective lens 20 is positioned such that its optical axis is along the z-direction. Objective lens 20 may also include two or more lenses.

[0062] The dichroic mirror DM1 couples the optical path of the illumination optical system 30 with the optical path of the observation optical system 40. The dichroic mirror DM1 is placed between the illumination optical system 30 and the objective lens 20. The dichroic mirror DM1 transmits the illumination light from the illumination optical system 30 and guides it through the objective lens 20 to the eye being examined, and reflects and guides the reflected light from the eye being examined through the objective lens 20 to the camera 60 of the observation optical system 40.

[0063] The dichroic mirror DM1 coaxially couples the optical paths of the illumination optical system 30 and the observation optical system 40. That is, the optical axes of the illumination optical system 30 and the observation optical system 40 intersect on the dichroic mirror DM1. When the illumination optical system 30 includes a left-eye illumination optical system (31L) and a right-eye illumination optical system (31R), and the observation optical system 40 includes a left-eye observation optical system 40L and a right-eye observation optical system 40R, the dichroic mirror DM1 coaxially couples the optical paths of the left-eye illumination optical system (first illumination optical system 31L) with those of the left-eye observation optical system 40L, and coaxially couples the optical paths of the right-eye illumination optical system (first illumination optical system 31R) with those of the right-eye observation optical system 40R.

[0064] The illumination optical system 30 is an optical system used to illuminate the eye being examined with the aid of the objective lens 20. The illumination optical system 30 can be configured to illuminate the eye being examined using any one of two or more illumination lights with different color temperatures. Under the control of the control unit (200) described later, the illumination optical system 30 projects illumination light of a specified color temperature onto the eye being examined.

[0065] The illumination optical system 30 includes first illumination optical systems 31L and 31R and a second illumination optical system 32.

[0066] The optical axes OL and OR of the first illumination optical system 31L and 31R are respectively positioned approximately coaxially with the optical axis of the objective lens 20. This enables coaxial illumination and allows the acquisition of a transillumination image utilizing diffuse reflection from the fundus. In this method, the transillumination image of the examined eye can be observed with both eyes.

[0067] The second illumination optical system 32 is positioned such that its optical axis OS is off-center from the optical axis of the objective lens 20. The first illumination optical systems 31L and 31R, as well as the second illumination optical system 32, are positioned such that the offset of the optical axis OS relative to the optical axis of the objective lens 20 is greater than the offset of the optical axes OL and OR relative to the optical axis of the objective lens 20. This enables so-called "angled illumination (oblique illumination)," preventing the intrusion of ghosting caused by corneal reflections, etc., while allowing binocular observation of the examined eye. Furthermore, it allows for detailed observation of the areas and tissues of the examined eye.

[0068] The first illumination optical system 31L includes a light source 31LA and a condenser lens 31LB. The light source 31LA outputs illumination light of a wavelength in the visible region, for example, with a color temperature of 3000K (Kelvin). The illumination light output from the light source 31LA passes through the condenser lens 31LB, is transmitted through the dichroic mirror DM1, and is incident on the eye being examined through the objective lens 20.

[0069] The first illumination optical system 31R includes a light source 31RA and a condenser lens 31RB. The light source 31RA also outputs illumination light of a wavelength in the visible region, for example, with a color temperature of 3000K. The illumination light output from the light source 31RA passes through the condenser lens 31RB, is transmitted through the dichroic mirror DM1, and is incident on the eye being examined through the objective lens 20.

[0070] The second illumination optical system 32 includes a light source 32A and a condenser lens 32B. The light source 32A outputs illumination light with a wavelength in the visible range, for example, a color temperature of 4000K to 6000K. The illumination light output from the light source 32A passes through the condenser lens 32B and, without passing through the dichroic mirror DM1, passes through the objective lens 20 and enters the eye being examined.

[0071] That is, the color temperature of the illumination light from the first illumination optical system 31L and 31R is lower than the color temperature of the illumination light from the second illumination optical system 32. With such a structure, the eye under examination can be observed using the first illumination optical system 31L and 31R with a warm color, and the structure and manner of the eye under examination can be observed in detail.

[0072] In several ways, the optical axes OL and OR can be moved relatively relative to the optical axis of the objective lens 20. This relative movement is in the direction intersecting the optical axis of the objective lens 20, and is represented by a displacement vector in at least one of the x and y components that is not zero. In several ways, the optical axes OL and OR can be moved independently. On the other hand, in several ways, the optical axes OL and OR can be moved as a unit. For example, the surgical microscope 10 includes a moving mechanism (31d) that moves the first illumination optical systems 31L and 31R independently or as a unit, by which the first illumination optical systems 31L and 31R are moved independently or as a unit in a direction intersecting the optical axis of the objective lens 20. This allows adjustment of the visual effect on the examined eye. In several ways, the moving mechanism is operated under the control of a control unit (200) described later.

[0073] In several ways, the optical axis OS can be moved relative to the optical axis of the objective lens 20. This relative movement is in the direction intersecting the optical axis of the objective lens 20, and is expressed as a displacement vector in at least one of the x and y components that is not zero. For example, the surgical microscope 10 includes a moving mechanism (32d) that moves the second illumination optical system 32 in a direction intersecting the optical axis of the objective lens 20. This allows for adjustment of the visual effect of the concavity and convexity of the examined eye area and tissue. In several ways, the moving mechanism is operated under the control of a control unit (200), described later.

[0074] As described above, in this configuration, the illumination optical system 30 is placed directly above the objective lens 20 (at the position of the transmission direction of the dichroic mirror DM1), and the observation optical system 40 is placed at the position of the reflection direction of the dichroic mirror DM1. For example, the observation optical system 40 may be positioned such that the angle formed by the optical axis of the observation optical system 40 and the plane (xy plane) orthogonal to the optical axis of the objective lens 20 is ±20 degrees or less.

[0075] According to the structure of this method, the observation optical system 40, whose optical path length is longer than that of the illumination optical system 30, is typically placed approximately parallel to the xy plane. Therefore, unlike conventional surgical microscopes where the observation optical system is placed vertically in front of the surgeon's eyes, it does not obstruct the surgeon's field of vision. Consequently, the surgeon can easily observe the image displayed on the front-facing display device 3. In other words, the visibility of display information (images, reflections, and other various reference information of the examined eye) during surgery is improved. Furthermore, since no housing is placed in front of the surgeon's eyes, it does not create a feeling of pressure on the surgeon, thus reducing the surgeon's workload.

[0076] The observation optical system 40 is an optical system for observing an image formed based on the reflected light from the illumination light incident from the examined eye via the objective lens 20. In this configuration, the observation optical system 40 provides the image to the imaging element of the camera 60.

[0077] As described above, the observation optical system 40 includes a left-eye observation optical system 40L and a right-eye observation optical system 40R. The structure of the left-eye observation optical system 40L is the same as that of the right-eye observation optical system 40R. In several ways, the optical placement of the left-eye observation optical system 40L and the right-eye observation optical system 40R can also be changed independently of each other.

[0078] The zoom expander 50 is also referred to as a beam expander, variable beam expander, etc. The zoom expander 50 includes a left-eye zoom expander 50L and a right-eye zoom expander 50R. The structure of the left-eye zoom expander 50L is the same as that of the right-eye zoom expander 50R. In several ways, the optical placement of the left-eye zoom expander 50L and the right-eye zoom expander 50R can also be changed independently.

[0079] The zoom extender 50L for the left eye includes multiple zoom lenses 51L, 52L, and 53L. At least one of the multiple zoom lenses 51L, 52L, and 53L is movable in the optical axis direction via a zoom mechanism (not shown).

[0080] Similarly, the zoom extender 50R for the right eye includes multiple zoom lenses 51R, 52R and 53R, at least one of which is movable in the optical axis direction via a zoom mechanism (not shown).

[0081] The zoom mechanism can be configured to move each zoom lens of the left-eye zoom extender 50L and each zoom lens of the right-eye zoom extender 50R independently or as a unit towards the optical axis. This changes the magnification when photographing the eye being examined. In several configurations, the zoom mechanism is operated under the control of the control unit (200), described later.

[0082] The video camera 60 is a device that captures an image formed by the observation optical system 40 and generates digital image data; typically, it is a digital camera (digital video camera). The video camera 60 includes a left-eye video camera 60L and a right-eye video camera 60R. The structure of the left-eye video camera 60L is the same as that of the right-eye video camera 60R. In several ways, the optical placement of the left-eye video camera 60L and the right-eye video camera 60R can be changed independently of each other.

[0083] The left-eye camera 60L includes an imaging lens 61L and an image sensor 62L. The imaging lens 61L forms an image on the imaging surface of the image sensor 62L based on the reflected light from the zoom extender 50L. The image sensor 62L is a region sensor, typically a charge-coupled device (CCD) image sensor or a complementary metal-oxide-semiconductor (CMOS) image sensor. The image sensor 62L operates under the control of a control unit (200) described later.

[0084] The right-eye camera 60R includes an imaging lens 61R and an image sensor 62R. The imaging lens 61R forms an image on the imaging surface of the image sensor 62R based on the reflected light from the right-eye zoom extender 50R. The image sensor 62R is a region sensor, typically a CCD image sensor or a CMOS image sensor. The image sensor 62R operates under the control of a control unit (200) described later.

[0085] <Processing System>

[0086] This describes the processing system of the ophthalmic observation device 1. Figure 3 and Figure 4 Several structural examples of the processing system are shown. Any two or more of the various structural examples described below can be combined, at least partially. Furthermore, the structure of the processing system is not limited to these examples.

[0087] The control unit 200 controls each part of the ophthalmic observation device 1. The control unit 200 includes a main control unit 201 and a storage unit 202. The main control unit 201 includes a processor that controls each part of the ophthalmic observation device 1. For example, in order to realize the functions of this method, the processor can read and execute programs stored in the storage unit 202 or other storage devices, and can utilize (reference, process, calculate, etc.) data and information stored in the storage unit 202 or other storage devices.

[0088] The main control unit 201 is capable of controlling the light sources 31LA, 31RA and 32A of the illumination optical system 30, the imaging elements 62L and 62R of the observation optical system 40, the movement mechanisms 31d and 32d, the zoom mechanisms 50Ld and 50Rd, the operation device 2, and the display device 3.

[0089] The control of light source 31LA includes turning the light source on and off, adjusting the light intensity, and adjusting the aperture. The control of light source 31RA includes turning the light source on and off, adjusting the light intensity, and adjusting the aperture. The main control unit 201 can exclusively control light sources 31LA and 31RA. The control of light source 32A includes turning the light source on and off, adjusting the light intensity, and adjusting the aperture.

[0090] When the lighting optical system 30 includes a light source capable of changing color temperature, the main control unit 201 can change the color temperature of the output lighting light by controlling the light source.

[0091] The control of image sensor 62L includes exposure adjustment, gain adjustment, and imaging rate adjustment. The control of image sensor 62R includes exposure adjustment, gain adjustment, and imaging rate adjustment. Furthermore, the main control unit 201 can control image sensors 62L and 62R so that their imaging timing is synchronized or the difference between their imaging timings is within a predetermined time. Moreover, the main control unit 201 can control the readout of digital data obtained from image sensors 62L and 62R.

[0092] The moving mechanism 31d moves the light sources 31LA and 31RA independently or integrally in a direction intersecting the optical axis of the objective lens 20. The main control unit 201 can move the optical axes OL and OR independently or integrally relative to the optical axis of the objective lens 20 by controlling the moving mechanism 31d.

[0093] The moving mechanism 32d moves the light source 32A in a direction intersecting the optical axis of the objective lens 20. The main control unit 201 can move the optical axis OS relative to the optical axis of the objective lens 20 by controlling the moving mechanism 32d.

[0094] The moving mechanism 70 moves the surgical microscope 10. For example, the moving mechanism 70 is configured to integrate at least a portion of the illumination optics 30 with the observation optics 40. This allows for changing the relative positions of at least a portion of the illumination optics 30 and the observation optics 40 relative to the examined eye while maintaining the relative positional relationship between them. In several configurations, the moving mechanism 70 is configured to move the first illumination optics 31L and 31R integrally with the observation optics 40. This allows for changing the relative positions of the first illumination optics 31L and 31R and the observation optics 40 relative to the examined eye while maintaining coaxial illumination. In several configurations, the moving mechanism 70 is configured to move the second illumination optics 32 integrally with the observation optics 40. This allows for changing the relative positions of the second illumination optics 32 and the observation optics 40 relative to the examined eye while maintaining the oblique illumination angle. In several configurations, the moving mechanism 70 is designed to move the first illumination optical systems 31L and 31R, the second illumination optical system 32, and the observation optical system 40 as a single unit. This allows for changing the relative positions of the illumination optical system 30 and the observation optical system 40 with respect to the eye being examined, while maintaining both coaxial illumination and oblique illumination angles. The moving mechanism 70 operates under the control of the control unit 200.

[0095] In several ways, the main control unit 201 can control at least two of the moving mechanisms 31d, 32d and 70 in conjunction.

[0096] The zoom mechanism 50Ld moves at least one of the multiple zoom lenses 51L to 53L of the left-eye zoom extender 50L in the optical axis direction. The main control unit 201 can change the magnification of the left-eye observation optical system 40L by controlling the zoom mechanism 50Ld.

[0097] Similarly, the zoom mechanism 50Rd moves at least one of the multiple zoom lenses 51R to 53R of the right-eye zoom extender 50R in the optical axis direction. The main control unit 201 can change the magnification of the right-eye observation optical system 40R by controlling the zoom mechanism 50Rd.

[0098] Control of the operating device 2 includes operation permission control, operation prohibition control, transmission control and / or reception control of operation signals from the operating device 2, etc. The main control unit 201 receives the operation signals generated by the operating device 2 and executes the control corresponding to the received signals.

[0099] Control of the display device 3 includes information display control, etc. The main control unit 201, acting as a display control unit, enables the display device 3 to display images based on digital image data generated by the imaging elements 62L and 62R. Typically, the display device 3 can display moving images (images) based on digital image data (image signals) generated by the imaging elements 62L and 62R, and can also display still images (frames) included in the moving images. Furthermore, the main control unit 201 can enable the display device 3 to display images (moving images, still images, etc.) obtained by processing the digital image data generated by the imaging elements 62L and 62R. Additionally, the main control unit 201 can enable the display device 3 to display any information generated by the ophthalmic observation device 1, and any information acquired by the ophthalmic observation device 1 from external sources.

[0100] The main control unit 201, acting as a display control unit, creates a left-eye image based on digital image data generated by the imaging element 62L and a right-eye image based on digital image data generated by the imaging element 62R. The display device 3 can then display the created left-eye and right-eye images in a stereoscopic manner. For example, the main control unit 201 can create a pair of parallax images based on the left-eye and right-eye images, and the display device 3 can then display this pair of parallax images. Users (such as surgical operators) can use known stereoscopic observation methods to recognize the pair of parallax images as stereoscopic images. Any stereoscopic observation method applicable to this method can be used, such as a naked-eye stereoscopic observation method, a stereoscopic observation method using assistive devices (polarized glasses, etc.), a stereoscopic observation method utilizing image processing (image synthesis, rendering, etc.) of the left-eye and right-eye images, a stereoscopic observation method that displays a pair of parallax images simultaneously, a stereoscopic observation method that switches between displaying a pair of parallax images, or a stereoscopic observation method that combines two or more of these methods.

[0101] The data processing unit 210 performs various data processing operations. Several examples of the processing that the data processing unit 210 can perform are described below. The data processing unit 210 (its components) includes a processor that operates according to predetermined software (programs), and is implemented through hardware and software cooperation.

[0102] Several examples of the processing that the data processing unit 210 can perform, together with the associated elements, are explained. Figure 4 The structure of the data processing unit 210 (and related elements) is shown as an example. Figure 4 The data processing unit 210A shown is Figure 3 An example of the data processing unit 210 includes the analysis unit 211.

[0103] The surgical microscope 10 captures images of the examined eye with an inserted artificial object (e.g., an intraocular lens, an intraocular contact lens, a MIGS device, etc.) and generates dynamic images (live images). The control unit 200 captures frames (still images) of the dynamic images and inputs them to the analysis unit 211. For example, the control unit 200 captures frames from the dynamic images in response to manual or automatic triggering.

[0104] The analysis unit 211 analyzes the frames captured from the moving image and determines the image region corresponding to a predetermined part of the eye being examined and the image region corresponding to a predetermined part of the artificial object inserted into the eye being examined. In this disclosure, the image region corresponding to the predetermined part of the eye being examined is referred to as the first part image, and the image region corresponding to the predetermined part of the artificial object is referred to as the second part image.

[0105] The image region corresponding to a predetermined part of the eye being examined can be, for example, an image region that is determined to be the image of that part, or an image region obtained by processing the image of that part (and its vicinity) (e.g., an approximate shape such as an approximate ellipse or an approximate circle). The same applies to the image region corresponding to a predetermined part of a man-made object.

[0106] The predetermined site of the examined eye detected by the analysis unit 211 can be any site. When the object of observation in the ophthalmic observation device 1 is the anterior eye, the analysis unit 211 may be configured to detect, for example, any one of the following: pupil (whole or characteristic sites such as pupil edge, pupil center, pupil centroid, etc.), cornea (whole or characteristic sites such as corneal rim, corneal edge, corneal center, corneal apex, etc.), iris (whole or characteristic sites such as inner iris edge, outer iris edge, iris pattern, etc.), anterior chamber (whole or characteristic sites such as anterior boundary, posterior boundary, etc.), anterior chamber angle (whole or peripheral area, etc.), lens (whole or characteristic sites such as lens capsule, anterior capsule, posterior capsule, lens nucleus, etc.), ciliary body, zona simuli, blood vessels, and lesion sites. When the object of observation in the ophthalmic observation device 1 is the posterior eye, the analysis unit 211 can be configured to detect, for example, any one of the following: optic nerve head, macula, blood vessels, retina (whole, surface, or one or more sub-tissues), choroid (whole, anterior, posterior, or one or more sub-tissues), sclera (whole, anterior, posterior, or one or more sub-tissues), vitreous body (whole, opacity, floaters, detached tissue, etc.), and lesion sites. When the object of observation in the ophthalmic observation device 1 is not the eyeball, the analysis unit 211 can be configured to detect any location (tissue) such as the eyelid, meibomian glands, or eye socket. The location detected by the analysis unit 211 can be determined according to the illumination method, surgical site, surgical method, etc.

[0107] The analysis unit 211 can detect the image of a predetermined region of the eye being examined from a still image using an arbitrary region extraction method. For example, when detecting the image of a region with brightness characteristics, the analysis unit 211 can be configured to use brightness thresholding processing such as binarization to detect the image of the predetermined region of the eye being examined from a still image. When detecting the image of a region with shape characteristics, the analysis unit 211 can be configured to use shape analysis processing such as pattern matching to detect the image of the predetermined region of the eye being examined from a still image. When detecting the image of a region with hue characteristics, the analysis unit 211 can be configured to use color analysis processing such as feature color extraction to detect the image of the predetermined region of the eye being examined from a still image. In addition, the analysis unit 211 can be configured to detect the image of the predetermined region of the eye being examined by applying segmentation used to determine the image of the predetermined region of the eye being examined to a still image. Generally, segmentation is a process of determining local regions in an image. Segmentation can include any known image processing technique, such as segmentation using image processing such as edge detection and / or segmentation using machine learning (e.g., deep learning).

[0108] The predetermined location of the artificial object detected by the analysis unit 211 can be any location of any artificial object, such as an intraocular lens (whole, optical part, support part, or outer edge, center, or aperture of the optical part), an intraocular contact lens (whole, optical part (lens), support part, outer edge, center, or aperture of the optical part, or outer edge or aperture of the support part), a MIGS device (whole or part), etc. Similar to the detection of the image of the predetermined location of the examined eye, the analysis unit 211 can use an arbitrary region extraction method to detect the image of the predetermined location of the artificial object based on a still image.

[0109] While receiving a real-time image of the eye being examined with an artificial object inserted from the surgical microscope 10 and displaying it on the display device 3, the control unit 200 displays first position information indicating the position of the first part image detected by the analysis unit 211 (i.e., the position of the predetermined part of the eye being examined) and second position information indicating the position of the second part image detected by the same analysis unit 211 (i.e., the position of the predetermined part of the artificial object).

[0110] According to the ophthalmic observation device 1 with such a structure, the positions of the predetermined sites of the examined eye and the predetermined sites of the artificial object can be provided together with the live image, so that the user can grasp the positional relationship between the predetermined sites of the examined eye and the predetermined sites of the artificial object in real time. Therefore, for example, in surgery where an artificial object is retained inside the eye, it is easy to place the artificial object in the correct position, and it is easy to confirm whether the artificial object is placed in the appropriate position. Thus, according to the ophthalmic observation device 1, ophthalmic surgery can be made easier.

[0111] The control unit 200 can be configured to display first position information indicating the position of a predetermined part of the eye being examined and second position information indicating the position of a predetermined part of an artificial object in mutually different ways. The display methods of the first position information and the second position information differ, for example, in at least one of color, pattern, shape, and size. Thus, the user can easily grasp the positions of the predetermined parts of the eye being examined and the predetermined parts of the artificial object, and can easily grasp the positional relationship between the predetermined parts of the eye being examined and the predetermined parts of the artificial object.

[0112] The display mode of the first position information and the display mode of the second position information can also be changed automatically or manually. For example, the data processing unit 210A is configured to determine the positional relationship (distance, orientation, etc.) between a predetermined part of the examined eye and a predetermined part of the man-made object based on the first part image and the second part image detected by the analysis unit 211, and the control unit 200 is configured to change the display mode of the first position information and / or the display mode of the second position information based on the positional relationship between the predetermined part of the examined eye and the predetermined part of the man-made object determined by the data processing unit 210A. As a result, the user can easily (intuitively) grasp the positional relationship between the predetermined part of the examined eye and the predetermined part of the man-made object.

[0113] Based on the positions of the first and second part images detected by the analysis unit 211, the control unit 200 can display information based on the offset between the first and second part images, together with the live image generated by the surgical microscope 10. Furthermore, the control unit 200 can display information based on the offset between the first and second part images, together with at least one of the live image, first position information indicating the position of a predetermined part of the examined eye, and second position information indicating the position of a predetermined part of a man-made object.

[0114] Information regarding the offset between the first and second part images can include, for example, information indicating the offset of the artificial object relative to the eye being examined, the offset of the artificial object's actual position relative to the position where the artificial object should be placed, the direction of movement of the artificial object (the direction in which the artificial object is to be moved), the distance the artificial object is to be moved (the distance (amount)) of movement, the direction of rotation of the artificial object (the direction in which the artificial object is to be rotated), and the angle of rotation of the artificial object (the angle (amount) in which the artificial object is to be rotated). Thus, information regarding the offset between the first and second part images can be information indicating the offset, information used to eliminate the offset (user guides, guidance information), or other types of information. The format of information regarding the offset between the first and second part images is arbitrary; for example, it can be an image, a graphic, a string, etc.

[0115] The ophthalmic observation device 1 can update in real time the first position information (information indicating the position of a predetermined part of the examined eye) and the second position information (information indicating the position of a predetermined part of an artificial object) displayed together with the live images generated by the surgical microscope 10. Therefore, the analysis unit 211, in parallel with the generation of dynamic images from the surgical microscope 10, sequentially determines the image (first part image) of the predetermined part of the examined eye and the image (second part image) of the predetermined part of the artificial object based on the frames (still images) sequentially generated by the surgical microscope 10. Furthermore, the control unit 200, in parallel with the sequential generation of still images by the surgical microscope 10 and the sequential analysis of still images by the analysis unit 211, sequentially updates the first and second position information displayed together with the live images. The first position information is updated based on the first part images (time-series images) sequentially obtained from the live images. Similarly, the second position information is updated based on the second part images (time-series images) sequentially obtained from the live images. According to this structure, users can monitor in real time the positional changes of the predetermined part of the eye being examined, the positional changes of the predetermined part of the artificial object, and the relative positional changes of the predetermined part of the eye being examined and the predetermined part of the artificial object.

[0116] <Actions and Usage>

[0117] Explain the operation and usage of ophthalmic observation device 1. Figure 5 An example of the operation and use of the ophthalmic observation device 1 is shown. This example illustrates the application of centering operations (operations to align the center of the intraocular lens with the center of the eye) during intraocular lens implantation surgery. However, even when applied to other surgeries or other artificial objects, the operation and use can be substantially the same as in this example, except for the differences in the applied surgery or artificial object.

[0118] (S1: Start generating and displaying live images)

[0119] First, the user performs a predetermined operation using the operating device 2, and the ophthalmic observation device 1 begins to generate and display a live image of the examined eye (anterior eye). Specifically, the surgical microscope 10 illuminates the examined eye through the illumination optics system 30 while generating digital image data (image) of the examined eye through the imaging elements 62L and 62R. The generated image (live image 301) is displayed in real time on the display device 3 (see reference). Figure 6A In other words, the dynamic images acquired by the surgical microscope 10 are displayed on the display device 3 as live images (observation images). The user can perform surgery while observing these live images.

[0120] (S2: Detect the eye center position based on the live image)

[0121] Next, the analysis unit 211 detects the eye center position based on the live image (its frames) generated at the beginning of step S1. The eye center position is a predefined position that serves as the center position of the eye being examined, typically the corneal center or the pupil center.

[0122] In several methods, to detect the corneal center, the analysis unit 211 first binarizes, performs edge detection and segmentation on the frames of the live image 301, and then detects the corneal helix 302 (see reference). Figure 6B Next, the analysis unit 211 determines the position (pixel) 303 corresponding to the center of the cornea based on the detected corneal helix 302 (refer to...). Figure 6C For example, the analysis unit 211 calculates an approximate ellipse (approximate circle) of the detected corneal helix 302, and determines the center of this approximate ellipse as the corneal center 303. For example, the determination of the center of the approximate ellipse is performed using a known geometric method.

[0123] In several methods, to detect the pupil center, the analysis unit 211 first binarizes, performs edge detection and segmentation to adapt the frame of the live image 301 and detects the pupil edge 304 (refer to...). Figure 6D Next, the analysis unit 211 determines the position (pixel) 305 corresponding to the center of the pupil based on the detected pupil edge 304 (refer to...). Figure 6E For example, the analysis unit 211 calculates an approximate ellipse (approximate circle) of the detected pupil edge 304, and determines the center of this approximate ellipse as the pupil center 305. For example, the determination of the center of the approximate ellipse is performed using a known geometric method.

[0124] The processing of step S2 can be applied to frames acquired sequentially as live images 301. For example, the processing of step S2 can be applied to all frames acquired as live images 301 (time-series images), or the processing of step S2 can be applied to frames selected from all frames acquired as live images 301. The selection of frames can be, for example, a rejection process that selects at predetermined intervals.

[0125] The control unit 200 can overlay and display information indicating the eye center position detected in step S2 (eye center position information) on the live image 301. When the processing of step S2 is applied to the frames acquired sequentially as the live image 301, the control unit 200 can update the display of the eye center position information each time a new eye center position is detected. As a result, the surgeon can grasp the eye center position of the examined eye in real time.

[0126] (S3: The surgeon inserts the IOL into the eye and begins positioning it)

[0127] Next, following the procedure and method of a typical cataract surgery (lens replacement surgery), the surgeon inserts the intraocular lens into the eye being examined and begins the work of determining where to place it (positioning, centering).

[0128] (S4: Detect the eye center position and IOL center position based on the live image)

[0129] After inserting the intraocular lens into the eye being examined in step S3, the analysis unit 211 detects the eye center position and the intraocular lens center position based on the frames of the live image 301. The detection of the eye center position can be the same as the process in step S2. In this example, the corneal rim 302 and the corneal center 303 are detected (see reference). Figure 6F and Figure 6G ).

[0130] The detection of the center position of the intraocular lens can also be done in the same way. For example, the analysis unit 211 first applies binarization, edge detection, and segmentation to the frame of the live image 301, and detects the outer edge 306 (refer to) of the optical part (lens) of the intraocular lens. Figure 6F Next, the analysis unit 211 determines the position (pixel) 307 of the center of the optical part corresponding to the intraocular lens based on the detected outer edge 306 (see reference). Figure 6G For example, the analysis unit 211 calculates an approximate ellipse (approximate circle) of the detected outer edge 306, and determines the center of this approximate ellipse as the center position 307 of the intraocular lens. For example, the determination of the center of the approximate ellipse is performed using known geometric methods.

[0131] Similar to step S2, the processing of step S4 can be applied to the frames acquired sequentially as live images 301. For example, the processing of step S4 can be applied to all frames acquired as live images 301 (time-series images) and the eye center position and intraocular lens center position can be detected, or the processing of step S4 can be applied to frames selected from all frames acquired as live images 301 and the eye center position and intraocular lens center position can be detected. Frame selection can, for example, be a rejection process performed at predetermined intervals.

[0132] (S5: Display eye center position information and IOL center position information on the live image)

[0133] Next, the control unit 200 displays information indicating the eye center position (eye center position information) and information indicating the intraocular lens center position (intraocular lens center position information) overlaid on the live image, based on the eye center position and intraocular lens center position detected in step S4.

[0134] Figure 6HAn example of the display in step S5 is shown. The cornea 308 of the examined eye, the pupil (not shown), and the intraocular lens 309 inserted in step S3 are depicted in the live image 301. On this live image 301, eye center position information 310, indicating the eye center position detected in step S4 based on live image 301, and intraocular lens center position information 311, indicating the intraocular lens center position detected in the same step S4 based on live image 301, are displayed. In this example, eye center position information 310 and intraocular lens center position information 311 are displayed in different ways. This allows the user to easily grasp the eye center position and the intraocular lens center position separately, and to easily grasp the positional relationship (relative position) between the eye center position and the intraocular lens center position. Such a display helps to simplify the intraocular lens positioning operation.

[0135] Figure 6I Other examples of the display of step S5 are shown. In the live image 301 of this example, with Figure 6H Similarly, the cornea 308 of the examined eye, the pupil (not shown), the intraocular lens 309 inserted in step S3, etc., are displayed, and the eye center position information 310 and the intraocular lens center position information 311 are displayed on the live image 301. In addition, in this example, the control unit 200 displays guidance information 312 for eliminating misalignment.

[0136] Guidance information 312 includes arrow images indicating the direction in which the intraocular lens 309 should be moved. In this example, guidance information 312 includes three arrow images pointing to the left. The direction of the arrow images indicates the direction in which the intraocular lens 309 should be moved (the direction of movement of the intraocular lens 309 to eliminate deviation of the intraocular lens 309 relative to the examined eye). Alternatively, guidance information indicating the direction of deviation of the intraocular lens 309 relative to the examined eye may also be displayed. Furthermore, the number of arrow images indicates the distance by which the intraocular lens 309 should be moved (the amount and distance of deviation of the intraocular lens 309 relative to the examined eye). For example, the amount of deviation equivalent to one arrow image can be predetermined.

[0137] Based on the guidance information 312 in this example, the user can understand that the intraocular lens 309 is in a state that deviates to the right relative to the examined eye and that the intraocular lens 309 needs to be moved to the left by a distance equivalent to the distance shown by the three arrows.

[0138] Guidance information 312 is generated based on the eye center position and the intraocular lens center position obtained in step S4. For example, the orientation of the arrow images in guidance information 312 is obtained as the orientation of a vector that starts from the intraocular lens center position and ends at the eye center position, and the number of arrow images is obtained as the magnitude (length) of that vector. Therefore, guidance information 312 indicates the direction and amount of movement of the intraocular lens 309 used to align the intraocular lens center position with the eye center position (i.e., the direction and amount of movement of the intraocular lens 309 used to center the intraocular lens 309).

[0139] When the guidance information 312 is displayed, the user can refer to the information to perform the centering operation of the intraocular lens 309. When the eye center position information 310 and the intraocular lens center position information 311 are displayed, the user can refer to the information to perform the centering operation of the intraocular lens 309.

[0140] (S6: Has IOL's positioning been completed?)

[0141] Steps S4 and S5, along with the user's (surgical operator's) centering operation on the intraocular lens 309 (S6: No), are repeated until the intraocular lens 309 is positioned. Steps S4 and S5 are performed at predetermined time intervals. Thus, the user can perform the positioning operation (centering operation) of the intraocular lens 309 while referring to the eye center position information 310 and the intraocular lens center position information 311, which indicate the positional relationship between the examined eye and the intraocular lens 309 in real time, and to the guidance information 312, which indicates the direction and distance to be moved by the intraocular lens 309.

[0142] If the positioning of the intraocular lens 309 is completed (S6: Yes), the detection of the eye center position and the intraocular lens center position, the display of eye center position information 310 and intraocular lens center position information 311, and the display of guidance information 312 can be completed (end). The user can then proceed to the next step of the cataract surgery.

[0143] <Variation Example>

[0144] In the described embodiment, the case in which the centering of the intraocular lens is assisted by presenting the eye center position information and the intraocular lens center position information on the live image is described in particular detail. However, those skilled in the art will know that the same assistance can be provided in the positioning of any intraocular implantable device such as an intraocular contact lens or a MIGS device.

[0145] Previously, when intraocular contact lenses were implanted, changes in the flow of aqueous humor within the eye caused an increase in intraocular pressure, necessitating iridotomy to lower this pressure. However, in recent years, intraocular contact lenses with a central aperture (ICL) have been developed. In an ICL, the aqueous humor can move through this aperture, eliminating the need for iridotomy. This aperture is very small and does not affect vision. Furthermore, ICLs are not designed for specific refractive errors (such as hyperopia).

[0146] In the case of implantation surgery of such a perforated ICL, the ophthalmic observation device 1 can detect the perforation formed in the center by the analysis unit 211, and the control unit 200 can display information indicating the position of the detected perforation along with the live image. Thus, the same effect as in the described embodiment can be achieved. Furthermore, if the visibility of the perforation of the perforated ICL depicted in the live image is sufficiently high, it is not necessary to detect the perforation and display its position information, and the user can also refer to the image of the perforation depicted in the live image and the position information of the eye center to perform intraocular contact lens positioning (centering).

[0147] In man-made objects with feature points (such as apertures) like ICLs, the positions of these feature points are precisely designed in advance. Therefore, the positional relationship between the feature points and the center of the optical element (lens) is known. Furthermore, the feature points and the center of the optical element sometimes coincide, and sometimes they do not. In this case, the positional information of the feature points of the man-made object is pre-stored in the control unit 200 (storage unit 202), and the position of the center of the optical element (or other parts) of the man-made object is determined by referring to this information. The determined position information can then be displayed along with a live image.

[0148] More commonly, information related to the implanted artificial object can be pre-registered and displayed along with the live image, indicating the center position (or predetermined location) of the optical component. This information related to the artificial object may include, for example, the location information of the artificial object's features (holes, marks, strings, bumps, patterns, etc.), the overall or partial shape information of the artificial object, the overall or partial thickness distribution information of the artificial object, and the overall or partial color information of the artificial object. For instance, if the image of the artificial object is depicted within the pupil area of ​​the live image, the location information of the predetermined location of the artificial object can be displayed accordingly.

[0149] In the described embodiment, the eye center position is determined based on the corneal rim of the examined eye; however, the method for determining the eye center position is not limited to this. Even when the eye center position is determined by other methods, the same guidance information as in the described embodiment can be presented. Examples of other methods for determining the eye center position include methods based on parts other than the corneal rim (e.g., pupil, iris), methods based on projected light, methods based on devices or markers attached to the eye, and methods based on information obtained from other systems (e.g., augmented reality systems, virtual reality systems).

[0150] In the described embodiment, although the positional relationship between the examined eye and the lens is determined based on the positional relationship between the center of the eye and the center of the lens, the method for determining the positional relationship between the examined eye and the lens is not limited to this. For example, the positional relationship between the examined eye and the lens can be determined based on the positional relationship between the corneal rim (or pupillary edge, inner iris edge, outer iris edge) and the lens edge (outer edge). As an example, taking advantage of the fact that both the corneal rim (or pupillary edge, inner iris edge, outer iris edge) and the lens edge (outer edge) are approximately circular or approximately elliptical, the positional relationship between the examined eye and the lens can be determined based on the distance distribution between the corneal rim (or pupillary edge, inner iris edge, outer iris edge) and the lens edge (outer edge), or the positional relationship between the examined eye and the lens can be determined based on the distance distribution between the approximate shape of the corneal rim (or pupillary edge, inner iris edge, outer iris edge) and the approximate shape of the lens edge (outer edge).

[0151] For example Figure 7A As shown, the ophthalmic observation device 1 enables the display device 3 to display a live image 401 of the examined eye, and displays a corneal halo image 402, a pupil edge image 403, and an intraocular lens outer edge image 404 on the live image 401, and displays a vertical linear image 405 and a horizontal linear image 406.

[0152] The vertical linear image 405 and the horizontal linear image 406 are respectively configured, for example, to pass through the center of the circular or elliptical corneal helix image 402. Furthermore, one of the vertical linear image 405 and the horizontal linear image 406 can be displayed, or a linear image placed at an angle can be displayed, or a linear image of a shape other than a straight line (e.g., a curved shape) can be displayed. Additionally, the linear image can be positioned to pass through the center of the pupillary edge image 403, or it can be positioned to pass through the center of the outer edge image 404 of the intraocular lens.

[0153] By referring to such linear images (e.g., vertical linear image 405 and horizontal linear image 406), the positional relationship between the corneal helix image 402 (pupil edge image 403) and the intraocular lens outer edge image 404 can be automatically evaluated, and the user can easily grasp the positional relationship between the corneal helix image 402 (pupil edge image 403) and the intraocular lens outer edge image 404.

[0154] The automatic evaluation of the positional relationship between the corneal helix image 402 (pupil edge image 403) and the intraocular lens outer edge image 404 includes processing for calculating predetermined evaluation parameters and judgment processing based on the calculated evaluation parameters. Evaluation parameters may, for example, be the uniformity of the distribution of the interval (distance) between the corneal helix image 402 (pupil edge image 403) and the intraocular lens outer edge image 404, or the concentricity (eccentricity) between the corneal helix image 402 (pupil edge image 403) and the intraocular lens outer edge image 404.

[0155] The ophthalmic observation device 1, for example, can display guiding information to ensure uniform spacing between the corneal halo image 402 (pupil edge image 403) and the intraocular lens outer edge image 404, or guiding information to improve concentricity. For example, as in the embodiment described above... Figure 6I Similarly, guidance information 407 (arrow image group) indicating the direction and distance of movement of the intraocular lens can be displayed. Furthermore, the guidance information is not limited to this example.

[0156] <Methods for controlling ophthalmic observation devices>

[0157] An exemplary embodiment (such as the ophthalmic observation device 1 described above) provides a method for controlling an ophthalmic observation device. Any aspect related to the ophthalmic observation device 1 of the described embodiment can be combined with the exemplary method described below.

[0158] An ophthalmic observation apparatus controlled by an illustrative method includes an optical system (e.g., an illumination optical system 30 and an observation optical system 40) for generating a dynamic image of the examined eye, and a processor (e.g., a control unit 200 and a data processing unit 210). The illustrative method first causes the optical system to generate a dynamic image of the examined eye with an artificial object inserted. Furthermore, the illustrative method uses the processor to analyze still images included in the generated dynamic image to determine a first part image corresponding to a predetermined part of the examined eye and a second part image corresponding to a predetermined part of the artificial object. Additionally, the illustrative method uses the processor to cause a display device to display the generated dynamic image, first position information indicating the position of the determined first part image, and second position information indicating the position of the determined second part image.

[0159] The method described in this exemplary manner can achieve the same function and effect as the ophthalmic observation device 1 of the embodiment. Furthermore, by combining the aspects related to the ophthalmic observation device 1 of the embodiment with the method of the exemplary manner, the resulting method can achieve the function and effect corresponding to the combined aspects.

[0160] <program>

[0161] An exemplary embodiment provides a program for causing a computer to execute the method of the exemplary mode. Matters related to the ophthalmic observation device 1 of the described embodiment can be combined with such a program.

[0162] According to such a procedure, the same function and effect as the ophthalmic observation device 1 of the described embodiment can be achieved. Furthermore, by combining matters related to the ophthalmic observation device 1 of the described embodiment with the procedure, the resulting procedure can achieve the function and effect corresponding to the combined matters.

[0163] <Recording Medium>

[0164] An exemplary embodiment provides a computer-readable, non-transitory recording medium for recording the program. Matters related to the ophthalmic observation device 1 of the embodiment can be combined with such a recording medium. The non-transitory recording medium can be of any type, including, for example, magnetic disks, optical disks, optical discs, semiconductor memories, etc.

[0165] Based on such a recording medium, it can perform the same function and effect as the ophthalmic observation device 1 of the described embodiment. Furthermore, by combining matters related to the ophthalmic observation device 1 of the described embodiment with the recording medium, the resulting recording medium can perform the function and effect corresponding to the combined matters.

[0166] This disclosure only illustrates the embodiments, and any modifications, omissions, additions, substitutions, etc., can be implemented within the scope of this disclosure and its equivalents.

[0167] (Explanation of reference numerals in the attached diagram)

[0168] 1: Ophthalmic observation device; 2: Operating device; 3: Display device; 10: Surgical microscope; 30: Illumination optical system; 40: Observation optical system; 200: Control unit; 210: Data processing unit; 211: Analysis unit.

Claims

1. An ophthalmic observation device for observing an examined eye, wherein, The ophthalmic observation device includes: The dynamic image generation unit captures and generates a dynamic image of the eye under examination with an intraocular lens inserted. The analysis unit analyzes the still images included in the dynamic image and determines a first region image corresponding to a predetermined region of the examined eye and a second region image corresponding to a predetermined region of the intraocular lens; and The display control unit causes the display device to display the dynamic image, first position information indicating the position of the first part image, and second position information indicating the position of the second part image. The predetermined location of the eye being examined is the center of the eye being examined. The predetermined location of the intraocular lens is the center position of the intraocular lens. The display control unit displays eye center position information, which indicates the center position of the examined eye, as the first position information, and displays intraocular lens center position information, which indicates the center position of the intraocular lens, as the second position information. It also displays guidance information based on the eye center position information and the intraocular lens center position information. The guidance information is a user guide indicating the direction and amount of movement of the intraocular lens to align the center position of the examined eye with the center position of the intraocular lens.

2. The ophthalmic observation device according to claim 1, wherein, The display control unit displays first guidance information indicating the direction of movement of the intraocular lens as the guidance information.

3. The ophthalmic observation device according to claim 2, wherein, The display control unit further displays the second guidance information, which indicates the movement distance of the intraocular lens, as the guidance information.

4. The ophthalmic observation device according to any one of claims 1 to 3, wherein, The display control unit displays the eye center position information and the intraocular lens center position information in different ways.

5. The ophthalmic observation device according to any one of claims 1 to 3, wherein, In parallel with the generation of the dynamic image by the dynamic image generation unit, the analysis unit sequentially determines the first part image and the second part image from the still images sequentially generated by the dynamic image generation unit. In parallel with the sequential generation of still images by the dynamic image generation unit and the sequential analysis of still images by the analysis unit, the display control unit sequentially updates the eye center position information and the intraocular lens center position information displayed together with the dynamic image.

6. The ophthalmic observation device according to any one of claims 1 to 3, wherein, The central location of the eye being examined is the center of the cornea or the center of the pupil.

7. A method for controlling an ophthalmic observation device, the ophthalmic observation device comprising an optical system for generating dynamic images of an examined eye and a processor, wherein, The optical system generates a dynamic image of the examined eye with an intraocular lens inserted. The processor analyzes the still images included in the dynamic image and determines a first image corresponding to a predetermined region of the examined eye and a second image corresponding to a predetermined region of the intraocular lens. The processor causes the display device to display the dynamic image, first position information indicating the position of the first part of the image, and second position information indicating the position of the second part of the image. The predetermined location of the eye being examined is the center of the eye being examined. The predetermined location of the intraocular lens is the center position of the intraocular lens. The processor displays eye center position information, representing the center position of the examined eye, as the first position information, and displays intraocular lens center position information, representing the center position of the intraocular lens, as the second position information. It also displays guidance information based on the eye center position information and the intraocular lens center position information. This guidance information is a user guide indicating the direction and amount of movement of the intraocular lens to align the center position of the examined eye with the center position of the intraocular lens.

8. A computer-readable, non-transitory recording medium containing a program that causes a computer to perform the method of claim 7.

Images