Ophthalmic observation device, its control method, program, and recording medium
The ophthalmological observation device automatically adjusts the optical system based on image parameters to enhance observation quality and surgical efficiency by optimizing the position of the illumination and observation systems.
Patent Information
- Application Number
- JP2022558822
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Priority Date
- 2020-10-27
- Filing Date
- 2020-12-09
- Publication Date
- 2024-12-03
- Estimated Expiration
- 2040-12-09
AI Technical Summary
In coaxial illumination, the range in which fundus reflection of illumination light returns to the optical system is limited, requiring manual adjustment of the optical system position, which is time-consuming and lacks a means to verify the optimal position, affecting surgical success and efficiency.
An ophthalmological observation device with a moving mechanism that adjusts the image generating section based on image parameters, such as brightness, to automatically find and maintain the optimal position for brighter observation, using control units to manage the movement and illumination.
Facilitates ophthalmological observation by automatically optimizing the optical system position, improving surgical success rates, reducing surgery time, and minimizing illumination light exposure.
Smart Images

Figure 0007594022000001 
Figure 0007594022000002 
Figure 0007594022000003
Abstract
Description
[Technical field]
[0001] (CROSS REFERENCE TO RELATED APPLICATIONS) This application claims priority to U.S. Provisional Patent Application No. 63 / 106,087, entitled “APPARATUS AND METHOD FOR OPHTHALMIC OBSERVATION,” filed October 27, 2020, which is incorporated by reference in its entirety.
[0002] The present disclosure relates to an ophthalmic observation device, a control method thereof, a program, and a recording medium. [Background technology]
[0003] An ophthalmic observation device is a device for observing a patient's eye (called an examined eye). Ophthalmic observation is performed in order to grasp the condition of the examined eye in various situations such as examination, surgery, and treatment.
[0004] Conventional ophthalmic observation devices provide users with a magnified image obtained by an objective lens or a variable magnification optical system through an eyepiece, but some recent ophthalmic observation devices are configured to capture the magnified image obtained by the objective lens or the variable magnification optical system with an image sensor and display the captured image (called digital ophthalmic observation devices). Types of digital ophthalmic observation devices include surgical microscopes, slit lamp microscopes, and fundus cameras. In addition, various types of ophthalmic examination devices, such as refractometers, keratometers, tonometers, specular microscopes, wavefront analyzers, and microperimeters, are also provided with the function of a digital ophthalmic observation device.
[0005] Furthermore, some recent ophthalmic observation devices use optical scanning (scanning ophthalmic observation devices). Such ophthalmic devices include scanning laser ophthalmoscopes (SLO) and optical coherence tomography (OCT) devices.
[0006] In general, an ophthalmic observation device provides a moving image of an eye to a user (e.g., a medical professional such as a doctor). A digital ophthalmic observation device is typically configured to perform moving image capture using infrared light and / or visible light as illumination light, and real-time moving image display of the image obtained thereby. On the other hand, a scanning ophthalmic observation device is typically configured to perform data collection by repeated optical scanning, real-time image reconstruction based on data sets collected sequentially, and real-time moving image display of the sequentially reconstructed images. The real-time moving image provided in this manner is called an observation image or a live image.
[0007] There are various methods (called observation modes) for observing an eye to be examined. For example, Patent Document 1 discloses an apparatus capable of selectively applying various observation modes with different conditions such as illumination angle, magnification, and light amount. Patent Document 2 discloses an apparatus capable of linking a change in illumination angle with a change in light amount.
[0008] One of the typical observation modes is coaxial illumination (0 degree illumination). Coaxial illumination is an observation mode in which illumination light is projected onto the subject's eye along the optical axis of the observation optical system (photography optical system) (or along a direction tilted at a small angle to the optical axis), and is used to obtain a transillumination image by diffuse reflection at the fundus. Transillumination images are typically used to observe opacities in the intermediate optic body (crystalline lens, vitreous body, etc.) and the placement of intraocular lenses. [Prior art documents] [Patent documents]
[0009] [Patent Document 1] JP 2003-310556 A [Patent Document 2] JP 2009-118955 A Summary of the Invention [Problem to be solved by the invention]
[0010] In coaxial illumination, the range in which the fundus reflection of illumination light returns to the optical system is limited, so it is necessary to adjust the position of the optical system so that a wider range can be observed more brightly. Conventionally, the position adjustment of the optical system was performed manually, so it took time and effort to search for the optimal position of the optical system. In addition, there was no means to grasp whether the optimal position was actually achieved. For example, even if the optical system was guided to a position that seemed optimal by manual operation, there was a possibility that a more suitable position existed, but there was no way to know this. It is possible to perform surgery if the optical system is placed in a relatively suitable position, but there is room for improvement in terms of improving the success rate of surgery, shortening the surgery time, improving the ease of surgery, reducing the amount of illumination light, etc. It is noted that even when an illumination method other than coaxial illumination is applied, the state of the observation image generally depends on the position of the optical system, so similar issues exist.
[0011] One object of the present disclosure is to provide a new technique for facilitating ophthalmic observation. [Means for solving the problem]
[0012] Some exemplary aspects may be an ophthalmic observation device for observing a test eye, comprising: a moving image generating unit configured to generate a moving image by illuminating and photographing the test eye; a moving mechanism configured to move the moving image generating unit; an analysis unit configured to sequentially analyze a plurality of still images included in the moving image generated by the moving image generating unit moved by the moving mechanism, and sequentially detect images of a predetermined portion of the test eye; and a first control unit configured to control the moving mechanism based on changes in a predetermined image parameter in the image sequentially detected by the analysis unit.
[0013] In some exemplary aspects of the ophthalmic observation device, the first control unit may be configured to control the moving mechanism to stop moving the moving image generating unit when the image parameters in the image successively detected by the analysis unit satisfy a first condition.
[0014] In some exemplary aspects of the ophthalmic observation device, the image parameter may include luminance, and the first condition may include at least one of the luminance being maximum and the luminance being equal to or greater than a first threshold.
[0015] In some exemplary aspects of the ophthalmic observation device, the first control unit may be configured to control the moving mechanism to start moving the moving image generating unit when the image parameters in the image sequentially detected by the analysis unit satisfy a second condition.
[0016] In an ophthalmic observation device according to some exemplary aspects, the image parameter may include luminance, and the second condition may include the luminance being less than a second threshold.
[0017] In some exemplary aspects of the ophthalmologic observation device, the first control unit may be configured to determine a movement direction of the moving image generation unit based on a change in the image parameter, and to control the movement mechanism based on the determined movement direction.
[0018] In some exemplary aspects of the ophthalmologic observation device, the moving image generating unit may be configured to generate a moving image of an anterior segment of the subject's eye, and the predetermined portion may include a pupil.
[0019] In some exemplary aspects of the ophthalmologic observation device, the moving image generating unit may be configured to generate a moving image of a posterior segment of the subject's eye, and the predetermined portion may include an optic disc.
[0020] In the ophthalmologic observation device according to some exemplary aspects, it may be possible to enable and disable control of the movement mechanism based on a change in the image parameter executed by the first control unit.
[0021] An ophthalmic observation device according to some exemplary aspects may further include a notification unit configured to notify when the image parameters in the image sequentially detected by the analysis unit satisfy a third condition.
[0022] The ophthalmic observation device according to some exemplary aspects may further include a response receiving unit that receives a user's response to the alert, and the first control unit may be configured to control the moving mechanism based on the response received by the response receiving unit.
[0023] The ophthalmic observation device according to some exemplary aspects may further include a determination unit configured to determine whether or not to control the moving mechanism based on the change in the image parameter executed by the first control unit.
[0024] In the ophthalmologic observation device according to some exemplary aspects, the determination unit may be configured to make a determination based on the moving image generated by the moving image generation unit.
[0025] In some exemplary aspects of the ophthalmic observation device, the determination unit may be configured to determine whether or not a treatment is being performed on the test eye based on the moving image generated by the moving image generation unit, and when it is determined that the treatment is being performed, to determine not to execute control of the moving mechanism.
[0026] An ophthalmic observation device according to some exemplary aspects may further include a second control unit configured to execute at least one of a notification, an increase in the amount of illumination light by the moving image generating unit, an increase in the gain of the image sensor of the moving image generating unit, and a change in the judgment condition for the image parameter when the optimal value of the image parameter obtained in the control of the moving mechanism based on the change in the image parameter satisfies a fourth condition.
[0027] The ophthalmologic observation device according to some exemplary aspects may further include a third control unit configured to reduce the amount of illumination light by the moving image generating unit, on condition that the image parameter falls within a predetermined range, after controlling the moving mechanism based on the change in the image parameter.
[0028] In an ophthalmic observation device according to some exemplary embodiments, the image parameters may include at least one of brightness, contrast, sharpness, and color tone.
[0029] Some exemplary aspects are a method for controlling an ophthalmic observation device including an optical system for observing a test eye and a processor, which causes movement of the optical system and generation of a moving image of the test eye by the optical system to be performed in parallel, causes the processor to perform sequential analysis of a plurality of still images included in the moving image to sequentially detect images of specific portions of the test eye, and causes the processor to move the optical system based on changes in specific image parameters in the images detected sequentially.
[0030] Some exemplary aspects are programs that cause a computer to execute the methods according to the exemplary aspects.
[0031] Some exemplary aspects are a computer-readable non-transitory recording medium having a program according to the exemplary aspects recorded thereon. Effect of the Invention
[0032] Exemplary aspects may facilitate ophthalmic observations. [Brief description of the drawings]
[0033] [Figure 1] 1 is a schematic diagram showing an example of the configuration of an ophthalmic observation device (ophthalmic surgical microscope) according to an exemplary embodiment. [Diagram 2] FIG. 1 is a schematic diagram showing an example of the configuration of an ophthalmologic observation apparatus according to an exemplary embodiment. [Diagram 3]FIG. 1 is a schematic diagram showing an example of the configuration of an ophthalmologic observation apparatus according to an exemplary embodiment. [Figure 4] FIG. 1 is a schematic diagram showing an example of the configuration of an ophthalmologic observation apparatus according to an exemplary embodiment. [Diagram 5] FIG. 1 is a schematic diagram showing an example of the configuration of an ophthalmologic observation apparatus according to an exemplary embodiment. [Figure 6] 11 is a flowchart illustrating an example of processing executed by an ophthalmologic observation apparatus according to an exemplary embodiment. [Figure 7A] 1 is a schematic diagram for explaining an example of processing executed by an ophthalmologic observation apparatus according to an exemplary embodiment; [Figure 7B] 1 is a schematic diagram for explaining an example of processing executed by an ophthalmologic observation apparatus according to an exemplary embodiment; [Figure 7C] 1 is a schematic diagram for explaining an example of processing executed by an ophthalmologic observation apparatus according to an exemplary embodiment; DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0034] Some exemplary aspects of an ophthalmic observation device according to an embodiment, a method for controlling the same, a program, and a recording medium will be described in detail with reference to the drawings. It should be noted that the matters described in the documents cited in this specification and any publicly known technology can be combined with the exemplary aspects.
[0035] In addition, there are conventional technologies that improve the optical system in order to improve the lighting performance (e.g., the performance of coaxial lighting) of ophthalmic observation devices, but even in products that apply such conventional technologies, it is possible to further improve the lighting performance by combining the technology disclosed herein.
[0036] The ophthalmic observation device according to the exemplary embodiment is used to grasp the condition of a subject's eye in medical procedures such as examination, surgery, and treatment of the subject's eye. The ophthalmic observation device according to the exemplary embodiment described below is a surgical microscope system, but the ophthalmic observation device is not limited to a surgical microscope system. For example, the ophthalmic observation device may be any of a slit lamp microscope, a fundus camera, a refractometer, a keratometer, a tonometer, a specular microscope, a wavefront analyzer, a microperimeter, an SLO, and an OCT device, or may be a system including any one or more of these. More generally, the ophthalmic observation device may be any ophthalmic device having an observation function.
[0037] The target site of observation using an ophthalmic observation device may be any site of the subject's eye, and may be any site of the anterior eye and / or any site of the posterior eye. Examples of the target sites of observation in the anterior eye include the cornea, iris, anterior chamber, angle, crystalline lens, ciliary body, and Zinn's zonule. Examples of the target sites of observation in the posterior eye include the retina, choroid, sclera, and vitreous body. The target sites of observation are not limited to ocular tissues, and may be any site that is the target of observation in ophthalmology (and / or other departments), such as the eyelids, meibomian glands, and orbit.
[0038] At least a portion of the functionality of the elements disclosed herein is implemented using circuitry or processing circuitry. The circuitry or processing circuitry may be a general purpose processor, a special purpose processor, an integrated circuit, a central processing unit (CPU), a graphics processing unit (GPU), an application specific integrated circuit (ASIC), a programmable logic device (e.g., a simple programmable logic device (SPLD), a complex programmable logic device (CPLD), a field programmable gate array (FPGA), or a combination of a programmable logic device (PLC) and a programmable logic device (PGD)), configured and / or programmed to perform at least a portion of the functionality disclosed. The term "circuitry", "unit", "means" or the like includes any of the above-mentioned circuitry, including a transistor and / or other circuitry, a processor, a processor array, a conventional circuitry, and any combination thereof. A processor is considered to be a processing circuitry or circuitry, including transistors and / or other circuitry. In this disclosure, a circuitry, a unit, a means, or the like is hardware that performs at least some of the disclosed functions or is hardware that is programmed to perform at least some of the disclosed functions. The hardware may be hardware disclosed herein or may be known hardware that is programmed and / or configured to perform at least some of the described functions. In the case where the hardware is a processor that can be considered to be a type of circuitry, a circuitry, a unit, a means, or the like is a combination of hardware and software, and the software is used to configure the hardware and / or the processor.
[0039] <Ophthalmological observation device> The configuration of an exemplary embodiment of an ophthalmic observation device is shown in FIG.
[0040] An ophthalmic observation device 1 (surgical microscope system) according to the embodiment includes an operation device 2, a display device 3, and a surgical microscope 10. In some aspects, the surgical microscope 10 may include at least one of the operation device 2 and the display device 3. In some aspects, the display device 3 may not be included in the ophthalmic observation device 1. In other words, the display device 3 may be a peripheral device of the ophthalmic observation device 1.
[0041] <Control device 2> The operation device 2 includes an operation device and / or an input device. For example, the operation device 2 may include a button, a switch, a mouse, a keyboard, a trackball, an operation panel, a dial, and the like. Typically, the operation device 2 includes a foot switch, similar to a general ophthalmic surgical microscope. In addition, the operation device 2 may be configured to perform operations using voice recognition, eye gaze input, and the like.
[0042] <Display device 3> The display device 3 displays an image of the subject's eye acquired by the surgical microscope 10. The display device 3 includes a display device such as a flat panel display. The display device 3 may also include various display devices such as a touch panel. A typical display device 3 includes a large-screen display device. The display device 3 includes one or more display devices. When the display device 3 includes two or more display devices, for example, one may be a relatively large-screen display device and the other may be a relatively small-screen display device. Also, a configuration may be adopted in which one display device is provided with multiple display areas to display multiple pieces of information.
[0043] The operation device 2 and the display device 3 do not need to be separate devices. For example, a device in which an operation function and a display function are integrated, such as a touch panel, may be used as the display device 3. In this case, the operation device 2 includes the touch panel and a computer program. The operation content on the operation device 2 is input to a processor (not shown) as an electric signal. In addition, operations and information input may be performed using a graphical user interface (GUI) displayed on the display device 3 and the operation device 2. In some aspects, the functions of the operation device 2 and the display device 3 may be realized by a touch screen.
[0044] <Surgical microscope 10> The surgical microscope 10 is used to observe the eye (examined eye) of a patient in a supine position. The surgical microscope 10 captures an image of the examined eye to generate digital image data. In particular, the surgical microscope 10 generates a moving image of the examined eye. The moving image (video) generated by the surgical microscope 10 is transmitted to the display device 3 via a wired and / or wireless signal path and displayed. A user (surgeon) can perform surgery while observing the examined eye through the displayed video. Some aspects of the surgical microscope 10 may allow observation through a conventional eyepiece in addition to observation of such a displayed video.
[0045] In some aspects, the surgical microscope 10 includes a communication device for transmitting and receiving an electrical signal to and from the operation device 2. The operation device 2 receives an operation by a user and generates an electrical signal (operation signal) corresponding to the operation. The operation signal is transmitted to the surgical microscope 10 via a wired and / or wireless signal path. The surgical microscope 10 executes a process corresponding to the received operation signal.
[0046] <Optical system of surgical microscope 10> An example of the configuration of the optical system of the surgical microscope 10 will be described below. For convenience of description, the optical axis direction of the objective lens is defined as the z direction (e.g., the vertical direction during surgery, the up-down direction), a predetermined direction perpendicular to the z direction is defined as the x direction (e.g., the horizontal direction during surgery, the left-right direction for the surgeon and patient), and a direction perpendicular to both the z direction and the x direction is defined as the y direction (e.g., the horizontal direction during surgery, the front-back direction for the surgeon, the body axis direction for the patient).
[0047] In the following, the observation optical system will be mainly described as having a pair of left and right optical systems (optical systems capable of binocular observation). However, the observation optical system in other aspects may have an optical system for monocular observation, and those skilled in the art will understand that the configuration described below can be applied to such aspects.
[0048] An example of the configuration of the optical system of the surgical microscope 10 is shown in Fig. 2. Fig. 2 shows a schematic top view of the optical system seen from above and a schematic side view of the optical system seen from the side in association with each other. To simplify the illustration, the illumination optical system 30 disposed above the objective lens 20 is omitted from the top view.
[0049] The surgical microscope 10 includes an objective lens 20, a dichroic mirror DM1, an illumination optical system 30, and an observation optical system 40. The observation optical system 40 includes a zoom expander 50 and an imaging camera 60. In some embodiments, the illumination optical system 30 or the observation optical system 40 includes the dichroic mirror DM1.
[0050] The objective lens 20 is disposed so as to face the eye to be examined. The objective lens 20 is disposed so that its optical axis is along the z direction. The objective lens 20 may include two or more lenses.
[0051] The dichroic mirror DM1 couples the optical path of the illumination optical system 30 and the optical path of the observation optical system 40. The dichroic mirror DM1 is disposed between the illumination optical system 30 and the objective lens 20. The dichroic mirror DM1 transmits illumination light from the illumination optical system 30 and guides it to the subject's eye via the objective lens 20, and also reflects return light from the subject's eye that enters through the objective lens 20 and guides it to the imaging camera 60 of the observation optical system 40.
[0052] The dichroic mirror DM1 coaxially couples the optical path of the illumination optical system 30 and the optical path of the observation optical system 40. That is, the optical axis of the illumination optical system 30 and the optical axis of the observation optical system 40 intersect at the dichroic mirror DM1. When the illumination optical system 30 includes a left-eye illumination optical system (31L) and a right-eye illumination optical system (31R), and the observation optical system 40 includes a left-eye observation optical system 40L and a right-eye observation optical system 40R, the dichroic mirror DM1 coaxially couples the optical path of the left-eye illumination optical system (first illumination optical system 31L) and the optical path of the left-eye observation optical system 40L, and coaxially couples the optical path of the right-eye illumination optical system (first illumination optical system 31R) and the optical path of the right-eye observation optical system 40R.
[0053] The illumination optical system 30 is an optical system for illuminating the subject's eye via the objective lens 20. The illumination optical system 30 may be configured to illuminate the subject's eye with one of two or more illumination lights having different color temperatures. The illumination optical system 30 projects illumination light of a specified color temperature onto the subject's eye under the control of a control unit (200) described later.
[0054] The illumination optical system 30 includes first illumination optical systems 31L and 31R and a second illumination optical system 32.
[0055] The optical axis OL of the first illumination optical system 31L and the optical axis OR of the first illumination optical system 31R are arranged approximately coaxially with the optical axis of the objective lens 20. This makes it possible to realize coaxial illumination and obtain a transillumination image using diffuse reflection at the fundus. In this embodiment, the transillumination image of the subject's eye can be observed with binoculars.
[0056] The second illumination optical system 32 is disposed so that its optical axis OS is decentered from the optical axis of the objective lens 20. The first illumination optical systems 31L and 31R and the second illumination optical system 32 are disposed so that the deviation of the optical axis OS from the optical axis of the objective lens 20 is larger than the deviation of the optical axes OL and OR from the optical axis of the objective lens 20. This allows the realization of so-called "angled illumination (oblique illumination)," making it possible to observe the subject's eye with binoculars while preventing the inclusion of ghosts caused by corneal reflection, etc. Furthermore, it also makes it possible to observe the irregularities of the parts and tissues of the subject's eye in detail.
[0057] The first illumination optical system 31L includes a light source 31LA and a condenser lens 31LB. The light source 31LA outputs illumination light with a wavelength in the visible region corresponding to a color temperature of, for example, 3000 K (Kelvin). The illumination light output from the light source 31LA passes through the condenser lens 31LB, transmits through the dichroic mirror DM1, and passes through the objective lens 20 to enter the subject's eye.
[0058] The first illumination optical system 31R includes a light source 31RA and a condenser lens 31RB. The light source 31RA also outputs illumination light with a wavelength in the visible region corresponding to a color temperature of, for example, 3000 K. The illumination light output from the light source 31RA passes through the condenser lens 31RB, transmits through the dichroic mirror DM1, and passes through the objective lens 20 to enter the subject's eye.
[0059] The second illumination optical system 32 includes a light source 32A and a condenser lens 32B. The light source 32A outputs illumination light with a wavelength in the visible region corresponding to a color temperature of, for example, 4000 K to 6000 K. The illumination light output from the light source 32A passes through the condenser lens 32B and passes through the objective lens 20 without passing through the dichroic mirror DM1, and enters the subject's eye.
[0060] That is, the color temperature of the illumination light from the first illumination optical systems 31L and 31R is lower than the color temperature of the illumination light from the second illumination optical system 32. With this configuration, it becomes possible to observe the subject's eye in warm colors using the first illumination optical systems 31L and 31R, and to observe the structure and shape of the subject's eye in detail.
[0061] In some aspects, each of the optical axes OL and OR is movable relative to the optical axis of the objective lens 20. The direction of this relative movement is a direction intersecting the optical axis of the objective lens 20, and this relative movement is expressed by a displacement vector in which at least one of the x component and the y component is not zero. In some aspects, each of the optical axes OL and OR may be movable independently. On the other hand, in some aspects, the optical axes OL and OR may be movable integrally. For example, the surgical microscope 10 includes a moving mechanism (31d) that moves the first illumination optical systems 31L and 31R independently or integrally, and the moving mechanism moves the first illumination optical systems 31L and 31R independently or integrally in a direction intersecting the optical axis of the objective lens 20. This makes it possible to adjust the visibility of the subject's eye. In some aspects, the moving mechanism operates under the control of a control unit (200) described later.
[0062] In some aspects, the optical axis OS is movable relative to the optical axis of the objective lens 20. The direction of this relative movement is a direction intersecting with the optical axis of the objective lens 20, and this relative movement is expressed by a displacement vector in which at least one of the x component and the y component is not zero. For example, the surgical microscope 10 includes a movement mechanism (32d) that moves the second illumination optical system 32, and this movement mechanism moves the second illumination optical system 32 in a direction intersecting with the optical axis of the objective lens 20. This makes it possible to adjust the visibility of unevenness in the part or tissue of the subject's eye. In some aspects, the movement mechanism operates under the control of a control unit (200) described later.
[0063] As described above, in this embodiment, the illumination optical system 30 is disposed directly above the objective lens 20 (in the transmission direction of the dichroic mirror DM1), and the observation optical system 40 is disposed in the reflection direction of the dichroic mirror DM1. For example, the observation optical system 40 may be disposed so that the angle between the optical axis of the observation optical system 40 and the plane (xy plane) perpendicular to the optical axis of the objective lens 20 is ±20 degrees or less.
[0064] According to the configuration of this embodiment, the observation optical system 40, which generally has a longer optical path length than the illumination optical system 30, is arranged approximately parallel to the xy plane, so that the observation optical system is not obstructed from the field of view of the surgeon as in the conventional surgical microscope in which the observation optical system is arranged vertically in front of the surgeon's eyes. Therefore, the surgeon can easily see the screen of the display device 3 installed in front. In other words, the visibility of the displayed information (images and videos of the subject's eye, and various other reference information) during surgery is improved. In addition, since the housing is not arranged in front of the surgeon's eyes, the surgeon does not feel a sense of pressure, and the burden on the surgeon is reduced.
[0065] The observation optical system 40 is an optical system for observing an image formed based on return light of illumination light incident from the subject's eye via the objective lens 20. In this embodiment, the observation optical system 40 provides an image to an imaging element of the imaging camera 60.
[0066] As described above, the observation optical system 40 includes the left-eye observation optical system 40L and the right-eye observation optical system 40R. The configuration of the left-eye observation optical system 40L is similar to the configuration of the right-eye observation optical system 40R. In some aspects, the optical arrangements of the left-eye observation optical system 40L and the right-eye observation optical system 40R may be changeable independently of each other.
[0067] The zoom expander 50 is also called a beam expander, a variable beam expander, etc. The zoom expander 50 includes a left-eye zoom expander 50L and a right-eye zoom expander 50R. The configuration of the left-eye zoom expander 50L is similar to the configuration of the right-eye zoom expander 50R. In some aspects, the left-eye zoom expander 50L and the right-eye zoom expander 50R may be capable of changing the optical arrangements independently of each other.
[0068] The left-eye zoom expander 50L includes a plurality of zoom lenses 51L, 52L, and 53L. At least one of the plurality of zoom lenses 51L, 52L, and 53L is movable in the optical axis direction by a magnification change mechanism (not shown).
[0069] Similarly, the right-eye zoom expander 50R includes a plurality of zoom lenses 51R, 52R, and 53R, and at least one of the plurality of zoom lenses 51R, 52R, and 53R is movable in the optical axis direction by a magnification change mechanism (not shown).
[0070] The magnification change mechanism may be configured to move each zoom lens of the left-eye zoom expander 50L and each zoom lens of the right-eye zoom expander 50R independently or integrally in the optical axis direction. This changes the magnification when photographing the subject's eye. In some aspects, the magnification change mechanism operates under the control of a control unit (200) described later.
[0071] The imaging camera 60 is a device that captures an image formed by the observation optical system 40 to generate digital image data, and is typically a digital camera (digital video camera). The imaging camera 60 includes a left-eye imaging camera 60L and a right-eye imaging camera 60R. The configuration of the left-eye imaging camera 60L is similar to the configuration of the right-eye imaging camera 60R. In some aspects, the optical arrangements of the left-eye imaging camera 60L and the right-eye imaging camera 60R can be changed independently of each other.
[0072] The left-eye imaging camera 60L includes an imaging lens 61L and an imaging element 62L. The imaging lens 61L forms an image based on the return light that has passed through the left-eye zoom expander 50L on the imaging surface of the imaging element 62L. The imaging element 62L is an area sensor, and may typically be a charge-coupled device (CCD) image sensor or a complementary metal-oxide semiconductor (CMOS) image sensor. The imaging element 62L operates under the control of a control unit (200) described below.
[0073] The right-eye imaging camera 60R includes an imaging lens 61R and an imaging element 62R. The imaging lens 61R forms an image based on the return light that has passed through the right-eye zoom expander 50R on the imaging surface of the imaging element 62L. The imaging element 62R is an area sensor, and may typically be a CCD image sensor or a CMOS image sensor. The imaging element 62R operates under the control of a control unit (200) described later.
[0074] <Processing system> The processing system of the ophthalmologic observation device 1 will be described. Configuration examples of the processing system are shown in Fig. 3 and Fig. 4. Any two or more of the configuration examples described below can be at least partially combined. Note that the configuration of the processing system is not limited to these examples.
[0075] The control unit 200 controls each part of the ophthalmic observation device 1. The control unit 200 includes a main control unit 201 and a storage unit 202. The main control unit 201 includes a processor and controls each part of the ophthalmic observation device 1. For example, the processor can read and execute a program stored in the storage unit 202 or another storage device to realize the function according to this embodiment, and can also use (reference, processing, calculation, etc.) data and information stored in the storage unit 202 or another storage device.
[0076] The main control unit 201 can control the light sources 31LA, 31RA, and 32A of the illumination optical system 30, the image pickup elements 62L and 62R of the observation optical system 40, the movement mechanisms 31d and 32d, the magnification change mechanisms 50Ld and 50Rd, the operation device 2, the display device 3, etc.
[0077] The control of the light source 31LA includes turning the light source on and off, adjusting the light amount, adjusting the aperture, etc. The control of the light source 31RA includes turning the light source on and off, adjusting the light amount, adjusting the aperture, etc. The main control unit 201 can control the light sources 31LA and 31RA mutually exclusively. The control of the light source 32A includes turning the light source on and off, adjusting the light amount, adjusting the aperture, etc.
[0078] When the illumination optical system 30 includes a light source capable of changing the color temperature, the main controller 201 can change the color temperature of the output illumination light by controlling this light source.
[0079] The control of the image sensor 62L includes exposure adjustment, gain adjustment, shooting rate adjustment, etc. The control of the image sensor 62R includes exposure adjustment, gain adjustment, shooting rate adjustment, etc. Furthermore, the main control unit 201 can control the image sensors 62L and 62R so that the shooting timings of the image sensors 62L and 62R coincide with each other, or so that the difference between the shooting timings of the two is within a predetermined time. Furthermore, the main control unit 201 can control the reading of the digital data obtained by the image sensors 62L and 62R.
[0080] The moving mechanism 31d moves the light sources 31LA and 31RA independently or integrally in a direction intersecting the optical axis of the objective lens 20. The main controller 201 can move the optical axes OL and OR independently or integrally with respect to the optical axis of the objective lens 20 by controlling the moving mechanism 31d.
[0081] The moving mechanism 32d moves the light source 32A in a direction intersecting the optical axis of the objective lens 20. The main controller 201 can move the optical axis OS relative to the optical axis of the objective lens 20 by controlling the moving mechanism 32d.
[0082] The moving mechanism 70 moves the surgical microscope 10. For example, the moving mechanism 70 is configured to integrally move at least a part of the illumination optical system 30 and the observation optical system 40. This allows the relative positions of at least a part of the illumination optical system 30 and the observation optical system 40 to be changed with respect to the subject's eye while maintaining the relative positional relationship between at least a part of the illumination optical system 30 and the observation optical system 40. In some aspects, the moving mechanism 70 is configured to integrally move the first illumination optical systems 31L and 31R and the observation optical system 40. This allows the relative positions of the first illumination optical systems 31L and 31R and the observation optical system 40 to be changed with respect to the subject's eye while maintaining the state of coaxial illumination. In some aspects, the moving mechanism 70 is configured to integrally move the second illumination optical system 32 and the observation optical system 40. This allows the relative positions of the second illumination optical system 32 and the observation optical system 40 to be changed with respect to the subject's eye while maintaining the illumination angle of oblique illumination. In some aspects, the movement mechanism 70 is configured to integrally move the first illumination optical systems 31L and 31R and the second illumination optical system 32 and the observation optical system 40. This makes it possible to change the relative positions of the illumination optical system 30 and the observation optical system 40 with respect to the subject's eye while maintaining both the coaxial illumination state and the illumination angle of the oblique illumination. The movement mechanism 70 operates under the control of the control unit 200.
[0083] In some aspects, the main controller 201 can control at least two of the moving mechanisms 31d, 32d, and 70 in a coordinated manner.
[0084] The magnification change mechanism 50Ld moves at least one of the multiple zoom lenses 51L to 53L of the left-eye zoom expander 50L in the optical axis direction. The main controller 201 can change the magnification of the left-eye observation optical system 40L by controlling the magnification change mechanism 50Ld.
[0085] Similarly, the magnification change mechanism 50Rd moves at least one of the multiple zoom lenses 51R to 53R of the right-eye zoom expander 50R in the optical axis direction. The main controller 201 can change the magnification of the right-eye observation optical system 40R by controlling the magnification change mechanism 50Rd.
[0086] The control over the operation device 2 includes operation permission control, operation prohibition control, and transmission control and / or reception control of an operation signal from the operation device 2. The main control unit 201 receives an operation signal generated by the operation device 2, and executes control corresponding to the received signal.
[0087] The control of the display device 3 includes information display control. As a display control unit, the main control unit 201 can cause the display device 3 to display an image based on the digital image data generated by the imaging elements 62L and 62R. Typically, the main control unit 201 can cause the display device 3 to display a moving image (image) based on the digital image data (video signal) generated by the imaging elements 62L and 62R, and can also cause the display device 3 to display a still image (frame) included in the moving image. Furthermore, the main control unit 201 can cause the display device 3 to display an image (moving image, still image, etc.) obtained by processing the digital image data generated by the imaging elements 62L and 62R. In addition, the main control unit 201 can cause the display device 3 to display any information generated by the ophthalmic observation device 1 or any information acquired by the ophthalmic observation device 1 from the outside.
[0088] Further, the main control unit 201, as a display control unit, can create a left eye image from the digital image data generated by the imaging element 62L and create a right eye image from the digital image data generated by the imaging element 62R, and can display the created left eye image and right eye image on the display device 3 in a manner that allows stereoscopic viewing. For example, the main control unit 201 can create a pair of left and right parallax images from the left eye image and the right eye image, and can display the pair of parallax images on the display device 3. A user (such as a surgeon) can recognize the pair of parallax images as a stereoscopic image by using a known stereoscopic viewing method. Any stereoscopic viewing method can be applied to this embodiment, and can be, for example, a stereoscopic viewing method with the naked eye, a stereoscopic viewing method using an auxiliary device (such as polarized glasses), a stereoscopic viewing method using image processing (such as image synthesis and rendering) on the left eye image and the right eye image, a stereoscopic viewing method that simultaneously displays a pair of parallax images, a stereoscopic viewing method that switches between and displays a pair of parallax images, or a stereoscopic viewing method that combines two or more of these.
[0089] The data processing unit 210 executes various types of data processing. Some examples of processing that the data processing unit 210 can execute are described below. The data processing unit 210 (each of its elements) includes a processor that operates according to a specific software (program), and is realized by the cooperation of hardware and software.
[0090] Some examples of processing that can be executed by the data processing unit 210 will be described together with related elements. Fig. 4 shows a configuration example of the data processing unit 210 (and related elements). The data processing unit 210A shown in Fig. 4 is an example of the data processing unit 210 in Fig. 3, and includes an analysis unit 211.
[0091] The control unit 200 of this embodiment can execute, in parallel, control of the moving mechanism 70 (movement control) for integrally moving the illumination optical system 30 and the observation optical system 40, and control of the illumination optical system 30 and the observation optical system 40 for taking video of the subject's eye (illumination and photography) (photography control). The mode of this parallel control may be any, and for example, the movement control and the photography control may be performed simultaneously, the movement control and the photography control may be performed alternately, or simultaneous control and alternating control may be combined.
[0092] At least a part of the moving images (frame group, still image group) acquired by such parallel control is input to the analysis unit 211. Here, all still images acquired by parallel control may be input to the analysis unit 211, or only still images selected by thinning processing or the like may be input to the analysis unit 211. In the latter case, for example, the control unit 200 or the data processing unit 210A executes the still image selection process. In the former case, the analysis unit 211 may execute the still image selection process. In this embodiment, the parallel control and the processing by the analysis unit 211 are executed sequentially and in real time, so that the processing load can be reduced by adding the still image selection process. The processing load reduction method is not limited to the still image selection process. In addition, in cases such as when the ophthalmic observation device 1 has sufficient processing resources, the processing load reduction method does not need to be adopted.
[0093] The analysis unit 211 is configured to sequentially analyze a plurality of still images included in a moving image generated by shooting control executed in parallel with movement control, and sequentially detect images of a specific portion of the subject's eye.
[0094] Any part of the subject's eye may be detected by the analysis unit 211. When the observation target of the ophthalmic observation device 1 is the anterior eye, the analysis unit 211 may be configured to detect, for example, any of the pupil (whole or characteristic parts such as the pupil edge, pupil center, and pupil centroid), the cornea (whole or characteristic parts such as the corneal limbus, corneal limbus, corneal center, and corneal apex), the iris (whole or characteristic parts such as the iris inner edge, iris outer edge, and iris pattern), the anterior chamber (whole or characteristic parts such as the anterior boundary and posterior boundary), the angle (whole or peripheral part), the lens (whole or characteristic parts such as the lens capsule, anterior capsule, posterior capsule, and lens nucleus), the ciliary body, the zonucleus of Zinn, blood vessels, and diseased parts. When the observation target by the ophthalmic observation device 1 is the posterior segment, the analysis unit 211 may be configured to detect, for example, any of the optic disc, macula, blood vessels, retina (whole, surface, or one or more sub-tissues), choroid (whole, anterior surface, posterior surface, or one or more sub-tissues), sclera (whole, anterior surface, posterior surface, or one or more sub-tissues), vitreous body (whole, opacity, floaters, detached tissue, etc.), and a diseased area. When the observation target by the ophthalmic observation device 1 is not an ocular tissue, the analysis unit 211 may be configured to detect any part (tissue) such as the eyelid, meibomian gland, or orbit. The part detected by the analysis unit 211 may be determined according to the illumination method, the surgical site, the surgical method, etc.
[0095] The analysis unit 211 can detect an image of a predetermined part of the test eye from a still image using any region extraction method. For example, when detecting an image of a part having a characteristic brightness, the analysis unit 211 may be configured to detect an image of the predetermined part of the test eye from a still image using a brightness threshold process such as binarization. When detecting an image of a part having a characteristic shape, the analysis unit 211 may be configured to detect an image of the predetermined part of the test eye from a still image using a shape analysis process such as pattern matching. When detecting an image of a part having a characteristic color tone, the analysis unit 211 may be configured to detect an image of the predetermined part of the test eye from a still image using a color analysis process such as feature color extraction. In addition, the analysis unit 211 may be configured to detect an image of the predetermined part of the test eye by applying segmentation for identifying the image of the predetermined part of the test eye to the still image. In general, segmentation is a process for identifying a partial region in an image. Segmentation may include any known image processing technique, for example segmentation using image processing such as edge detection and / or segmentation using machine learning (e.g., deep learning).
[0096] The control unit 200 (and the data processing unit 210A) controls the movement mechanism 70 (first control unit) based on changes in predetermined image parameters in an image of a predetermined part successively detected from a moving image by the analysis unit 211. The movement direction of the illumination optical system 30 and the observation optical system 40 controlled by this movement mechanism 70 may be any direction, and may be one or more of the up-down direction (Z direction), left-right direction (X direction), and front-back direction (Y direction).
[0097] This allows the ophthalmic observation device 1 to adjust the position of the surgical microscope 10 in response to a change in the image parameters in response to a change in the position of the surgical microscope 10 relative to the subject's eye. For example, as described above, in coaxial illumination, the range in which the fundus reflection of illumination light returns to the optical system is limited, so it is necessary to adjust the position of the optical system so that a wider range can be observed more brightly. However, in the past, the position adjustment of the optical system was performed manually, so it took time and effort to search for the optimal position of the optical system. In contrast, according to this aspect, it is possible to automatically search for the optimal position of the optical system while monitoring the image parameters. Also, according to this aspect, it is possible to grasp whether the optimal position has actually been achieved by referring to the image parameters. In this way, according to this aspect, it is possible to facilitate ophthalmic observation, and to improve the success rate of surgery, surgery time, ease of surgery, and the like. The same applies when an illumination method other than coaxial illumination (for example, oblique illumination) is applied.
[0098] The type of image parameter referred to by the control unit 200 (and the data processing unit 210A) may be arbitrary. For example, the image parameter may be at least one of brightness, contrast, sharpness, and color tone.
[0099] The control unit 200 (and the data processing unit 210A) may be configured to control the moving mechanism 70 to stop the movement of the illumination optical system 30 and the observation optical system 40 when the image parameters of the image of the predetermined portion successively detected from the moving image by the analysis unit 211 satisfy a first condition. For example, the control unit 200 (and the data processing unit 210A) may be configured to control the moving mechanism 70 to stop the movement of the illumination optical system 30 and the observation optical system 40 when the luminance (or contrast or sharpness) of the image of the predetermined portion successively detected from the moving image by the analysis unit 211 becomes maximum. Also, the control unit 200 (and the data processing unit 210A) may be configured to control the moving mechanism 70 to stop the movement of the illumination optical system 30 and the observation optical system 40 when the luminance (or contrast or sharpness) of the image of the predetermined portion successively detected from the moving image by the analysis unit 211 becomes equal to or greater than a predetermined threshold. Furthermore, the control unit 200 (and the data processing unit 210A) may be configured to control the movement mechanism 70 to stop the movement of the illumination optical system 30 and the observation optical system 40 when the color tone of the image of a predetermined part successively detected from the moving image by the analysis unit 211 falls within a predetermined allowable range. The threshold value and the range in the first condition may be fixed or variable.
[0100] This makes it possible to automatically guide and position the illumination optical system 30 and the observation optical system 40 to positions where suitable image parameters can be obtained, thus providing the effect of facilitating ophthalmic observation.
[0101] The control unit 200 (and the data processing unit 210A) may be configured to control the moving mechanism 70 to start moving the illumination optical system 30 and the observation optical system 40 when the image parameters of the image of the predetermined part successively detected from the moving image by the analysis unit 211 satisfy the second condition. For example, the control unit 200 (and the data processing unit 210A) may be configured to control the moving mechanism 70 to start moving the illumination optical system 30 and the observation optical system 40 when the luminance (or contrast or sharpness) of the image of the predetermined part successively detected from the moving image by the analysis unit 211 becomes less than a predetermined threshold. Also, the control unit 200 (and the data processing unit 210A) may be configured to control the moving mechanism 70 to start moving the illumination optical system 30 and the observation optical system 40 when the color tone of the image of the predetermined part successively detected from the moving image by the analysis unit 211 falls outside a predetermined allowable range. The threshold value or range in the second condition may be fixed or variable. Furthermore, the second condition may be the same as or different from the first condition.
[0102] As a result, the illumination optical system 30 and the observation optical system 40 can be automatically started to move in response to the deterioration of the image parameters, and the optimum position of the optical system can be searched for, thereby maintaining the quality of the observed image. For example, after the optical system is placed at the optimum position by the automatic search, the positional relationship between the subject's eye and the surgical microscope 10 may change due to eye movement or the like, causing the image parameters to deteriorate. However, according to this embodiment, it is possible to automatically detect the deterioration of the image parameters and resume the search for the optimum position of the optical system, thereby achieving effects such as facilitating ophthalmic observation.
[0103] The control unit 200 (and the data processing unit 210A) can determine the movement direction of the illumination optical system 30 and the observation optical system 40 based on the change in the image parameter. For example, the control unit 200 (and the data processing unit 210A) determines whether or not the change in the image parameter when the illumination optical system 30 and the observation optical system 40 move in a certain direction is a suitable change, and if the change in the image parameter is a suitable change, determines the direction as the movement direction, and if the change in the image parameter is not a suitable change, determines a direction other than the direction (for example, the opposite direction to the direction) as the movement direction. For example, the control unit 200 (and the data processing unit 210A) determines whether or not the change in the image parameter when the illumination optical system 30 and the observation optical system 40 move in a certain direction is a suitable change, and if the change in the image parameter is a suitable change, determines the direction as the movement direction, and if the change in the image parameter is not a suitable change, determines a direction other than the direction (for example, the opposite direction to the direction) as the movement direction. The control unit 200 controls the movement mechanism 70 based on the determined movement direction. As a specific example, the control unit 200 (and the data processing unit 210A) can continue movement in a certain direction when the brightness increases as the illumination optical system 30 and the observation optical system 40 move in that direction, and can switch to movement in the opposite direction when the brightness decreases as the movement moves.
[0104] This allows the moving direction of the surgical microscope 10 to be automatically determined in response to changes in the image parameters, thereby providing the effect of facilitating ophthalmologic observation.
[0105] It may be possible to enable and disable the process (i.e., the control of the moving mechanism 70 based on the change of the image parameter) executed by the control unit 200 (and the data processing unit 210A). That is, the ophthalmic observation device 1 may be configured to be able to turn on / off such a control function. For example, when it is desired to prevent the surgical microscope 10 from moving automatically (i.e., at a timing not intended by the user), the control function can be disabled (off). The switching between enable / disable may be performed, for example, by an operation using the operation device 2 (foot switch). The ophthalmic observation device 1 may also be configured to be able to switch between enable / disable using voice recognition or the like. In order to assist such operations and the processes and tasks associated therewith, the ophthalmic observation device 1 may be provided with a means for notifying the deterioration of the image parameter (for example, a decrease in the luminance of the pupil image), a means for notifying the start of the movement of the surgical microscope 10, a means for requesting the user's permission to move the surgical microscope 10, and the like.
[0106] This allows the automatic movement function of the surgical microscope 10 to be stopped when the user does not want to use it or when the user is performing treatment on the subject's eye. It also makes it possible to notify that a condition such as deterioration of an image parameter has been satisfied. Note that any method of notification may be used, for example, displaying information on the display device 3, outputting audio, turning on the light source, etc. The condition (third condition) that triggers the notification may be any condition, and may be the same as or different from the first condition and / or second condition described above.
[0107] The ophthalmologic observation device 1 can receive a user's response to a notification such as deterioration of an image parameter. The user's response is received by the operation device 2, a voice recognition device, or the like (response receiving unit). The control unit 200 (and the data processing unit 210A) can control the movement mechanism 70 based on the user's response received by the response receiving unit to move the illumination optical system 30 and the observation optical system 40.
[0108] This enables the ophthalmologic observation device 1 to automatically detect that the third condition is satisfied (for example, that an image parameter has deteriorated), notify the user, and accept a response from the user accordingly, thereby enabling the surgical microscope 10 to be moved. Thus, the user recognizes that the third condition is satisfied, and can instruct the start of a search for the optimal positions of the illumination optical system 30 and the observation optical system 40.
[0109] Data processing unit 210B shown in Fig. 5 is an example of data processing unit 210 in Fig. 3, and includes a determination unit 212 in addition to analysis unit 211 of data processing unit 210A in Fig. 4. Unless otherwise specified, data processing unit 21B can execute the same processes as data processing unit 210A.
[0110] The determination unit 212 is configured to determine whether or not to execute the process (i.e., control of the moving mechanism 70 based on the change in the image parameter) executed by the control unit 200 (and the data processing unit 210B). For example, the determination unit 212 is configured to perform the determination based on the moving image generated by the surgical microscope 10. For example, the determination unit 212 may be configured to determine whether or not a treatment is being performed on the subject's eye based on the moving image generated by the surgical microscope 10, and determine not to execute the control of the moving mechanism 70 based on the change in the image parameter when it is determined that the treatment is being performed. Thus, in some aspects, the ophthalmic observation device 1 may include a means for automatically determining whether or not the surgical microscope 10 can be moved by analyzing the observation image obtained by the surgical microscope 10. For example, the movement of the surgical microscope 10 may be prohibited while the user is performing a treatment on the subject's eye. For example, the ophthalmic observation device 1 may be configured to determine by the determination unit 212 whether or not an instrument (such as a surgical instrument) is reflected in the observation image, and to prohibit the movement of the surgical microscope 10 when it is determined that an instrument is reflected in the observation image. In addition, the ophthalmologic observation device 1 may be configured to determine whether an instrument shown in the observation image (moving image) is moving using the determination unit 212, and to prohibit movement of the surgical microscope 10 if it is determined that the instrument shown in the observation image is moving.
[0111] This enables the ophthalmologic observation device 1 to automatically determine whether or not to execute an automatic search for the position of the optical system of the surgical microscope 10. It also makes it possible to prevent the surgical microscope 10 from moving at a timing unintended (unexpected, undesired) by the user, for example, when a treatment is being performed on the subject's eye.
[0112] It is also assumed that an image of good quality cannot be obtained even if the automatic search for the position of the optical system of the surgical microscope 10 is performed. In order to deal with such a case, the ophthalmic observation device 1 may have the following function (second control unit). First, the ophthalmic observation device 1 (for example, the data processing unit 210) can determine the optimal value of the image parameter by controlling the moving mechanism 70 based on the change of the image parameter, for example. Next, the ophthalmic observation device 1 (for example, the data processing unit 210) can judge whether or not this optimal value satisfies the fourth condition. If it is judged that the optimal value of the image parameter satisfies the fourth condition, the ophthalmic observation device 1 (for example, the control unit 200) can execute at least one of the following: notification, increasing the amount of illumination light by the illumination optical system 30, increasing the gain of the image sensor of the observation optical system 40, and changing the judgment condition for the image parameter. A specific example of such a function will be described. First, the ophthalmic observation device 1 performs video shooting while moving the illumination optical system 30 and the observation optical system 40, and sequentially detects the luminance value of the pupil image, thereby obtaining the maximum luminance value. This maximum luminance value is an example of an optimal value of an image parameter, and is the maximum value of luminance obtained in searching for the optimal position of the optical system. Next, the ophthalmic observation device 1 compares this maximum luminance value with the threshold value of the first condition described above, and judges whether the maximum luminance value is less than the threshold value. In this example, the maximum luminance value being less than the threshold value corresponds to satisfying the fourth condition. If it is judged that the maximum luminance value is less than the threshold value, the ophthalmic observation device 1 can execute at least one of increasing the amount of illumination light by the illumination optical system 30, increasing the gain of the image pickup element of the observation optical system 40, and changing the judgment condition regarding the image parameter. The notification informs the user that a pupil image (transillumination image) of sufficient brightness cannot be obtained by the automatic search for the position of the optical system, and the user who recognizes this can take the desired action. Both the increase in the amount of illumination light and the increase in gain contribute to an increase in the luminance of the pupil image (transillumination image). Changing the judgment conditions regarding image parameters, for example, lowering the threshold value of the first condition, can be said to prioritize continuing medical procedures (such as surgery) even if the brightness of the pupil image (transillumination image) is somewhat insufficient.The ophthalmic observation device 1 may select and execute a process from among notification, increasing illumination light, increasing gain, and changing the judgment conditions related to image parameters. Also, any of notification, increasing illumination light, increasing gain, and changing the judgment conditions related to image parameters may be configured to be executed by default. Also, a combination of two or more of notification, increasing illumination light, increasing gain, and changing the judgment conditions related to image parameters may be executed. For example, when the luminance equal to or greater than the threshold value of the first condition is not obtained even after moving the illumination optical system 30 and the observation optical system 40, the ophthalmic observation device 1 can first perform a notification. This allows the user to know that a sufficiently bright transillumination image was not obtained by the automatic search for the position of the optical system. Next, the ophthalmic observation device 1 increases the light amount of the light sources 31LA and 31RA (for example, in response to a user's instruction or automatically). Next, the ophthalmic observation device 1 executes the automatic search for the position of the optical system again. If the luminance of the transillumination image is still insufficient even after this automatic search, the ophthalmic observation device 1 increases the gain of the image pickup elements 62L and 62R of the observation optical system 40. Next, the ophthalmic observation device 1 performs the automatic search for the position of the optical system again. If the brightness of the transillumination image is still insufficient after this automatic search, the ophthalmic observation device 1 lowers the threshold value of the first condition by a predetermined value. Next, the ophthalmic observation device 1 performs the automatic search for the position of the optical system again. If the brightness of the transillumination image is still insufficient after this automatic search, the ophthalmic observation device 1 issues a notification again. This notification informs the user that a transillumination image with sufficient brightness cannot be obtained by a series of automatic searches, and encourages the user to switch to manual operation. The manual operation may include, for example, position adjustment of the illumination optical system 30 and the observation optical system 40, adjustment of the illumination light amount, adjustment of the gain, adjustment of the threshold value of the first condition, and the like.
[0113] This makes it possible to take various suitable measures in cases where an image of good quality cannot be obtained even when automatic search for the position of the optical system of the surgical microscope 10 is performed.
[0114] When an image of good quality is obtained by the automatic search for the position of the optical system of the surgical microscope 10 (when the automatic search is successful), it is also assumed that an image of the minimum necessary brightness is obtained. In such a case, the amount of illumination light can be reduced (third control unit) to reduce the burden on the subject. For example, after the automatic search for the position of the optical system is successful, the control unit 200 of the ophthalmic observation device 1 can reduce the amount of illumination light by the illumination optical system 30 on the condition that the image parameters are included in a predetermined range. This predetermined range is, for example, a range equal to or greater than the threshold value of the first condition.
[0115] This makes it possible to reduce the amount of illumination light and reduce the burden on the subject, provided that an image of good quality is obtained, if the automatic search for the position of the optical system of the surgical microscope 10 is successful.
[0116] When the observation target is the posterior segment, such as when performing posterior segment surgery, the ophthalmic observation device 1 can execute the same processing as in the case of the above-mentioned anterior segment observation. For example, the ophthalmic observation device 1 generates a moving image using the surgical microscope 10 while moving the illumination optical system 30 and the observation optical system 40 using the moving mechanism 70, sequentially analyzes a plurality of still images included in the moving image using the analysis unit 211 to sequentially detect images of a predetermined site (e.g., optic disc) of the posterior segment, and controls the moving mechanism 70 based on changes in a predetermined image parameter (e.g., luminance) in the sequentially detected images. This allows the same actions and effects as in the case of the anterior segment observation to be achieved in the case of the posterior segment observation. Any of the items described for the case of the anterior segment observation can be combined with the case of the posterior segment observation.
[0117] <Operation / Usage form> The operation and usage of the ophthalmic observation device 1 will be described. An example of the operation and usage of the ophthalmic observation device 1 is shown in Fig. 6. In this example, the case of coaxial illumination will be described, but the same operation and usage can be implemented in the case of other illumination methods (e.g., oblique illumination) or in the case of posterior eye observation.
[0118] (S1: Start generating and displaying live images with coaxial lighting) First, the user performs a predetermined operation using the operation device 2 to select coaxial illumination and to start generating and displaying a live image of the subject's eye (anterior eye) by the ophthalmic observation device 1. Specifically, the surgical microscope 10 generates digital image data (video) of the subject's eye by the imaging elements 62L and 62R while illuminating the subject's eye by the illumination optical system 30 (first illumination optical systems 31L and 31R). The generated video (live image 301) is displayed in real time on the display device 3 (see FIG. 7A). That is, a moving image acquired by the surgical microscope 10 is displayed on the display device 3 as a live image (observation image). The user can perform surgery while observing this live image.
[0119] (S2: Detect the pupil center from a live image) Next, the data processing unit 210 (for example, the analysis unit 211) detects the pupil center from the live image (the frame) whose generation has started in step S1. In some aspects, the data processing unit 210 first detects the corneal limbus 302 by applying binarization or segmentation (see FIG. 7B). The data processing unit 210 may detect the pupil margin 303. When detecting the pupil margin 303, for example, a low-luminance area corresponding to the pupil may be searched for, and this low-luminance area may be placed in the center of the frame, and then elliptical approximation may be applied to this low-luminance area. The data processing unit 210 specifies a position (pixel) 304 corresponding to the pupil center based on the detected corneal limbus 302 (see FIG. 7C). For example, the data processing unit 210 obtains an approximation ellipse (approximation circle) of the detected corneal limbus 302, and specifies the center of this approximation ellipse. The specification of the center of the approximation ellipse is performed, for example, by a known geometric method.
[0120] (S3: Align the optical axis of the optical system with the center of the pupil) Next, the ophthalmic observation device 1 aligns the optical axis of the surgical microscope 10 (illumination optical system 30, observation optical system 40) with the pupil center 304 identified in step S2. For example, the ophthalmic observation device 1 executes registration between the newly acquired frame and the frame used for detecting the pupil center 304, identifies a position corresponding to the pupil center in the new frame based on the result of this registration, and moves the illumination optical system 30 and the observation optical system 40 so that the optical axis is located at the position corresponding to the pupil center.
[0121] Alternatively, the user may manually position the optical axis of the surgical microscope 10 at the center of the pupil.
[0122] (S4: Detect pupil image) The ophthalmologic observation device 1 (analysis unit 211) detects the pupil image from the live image after the optical axis of the surgical microscope 10 is moved to the pupil center 304 in step S3.
[0123] (S5: Calculate the brightness of the pupil image) Next, the ophthalmologic observation device 1 calculates the luminance of the pupil image detected in step S4. As a first example of the calculation of the luminance of the pupil image, the data processing unit 210 (for example, the analysis unit 211) executes a process of dividing the pupil image (and its vicinity) into a plurality of partial regions, a process of obtaining a representative value of the luminance of each partial region (for example, an average value, a maximum value, a mode value, a median value, or any other statistical value), and a process of determining the luminance of the pupil image based on the distribution of the representative values of the luminance obtained for the plurality of partial regions. The process of determining the luminance of the pupil image from the distribution may include any statistical process, and may include, for example, calculation of the average, identification of the maximum value, identification of the mode value, identification of the median value, and the like. As a second example of the calculation of the luminance of the pupil image, the data processing unit 210 (for example, the analysis unit 211) can determine the luminance of the pupil image by a predetermined statistical method from the luminance of a plurality of pixels (all pixels or a selected group of pixels) in the pupil image.
[0124] (S6: Is the brightness above the threshold and at maximum?) Next, the ophthalmic observation device 1 (the control unit 200 or the data processing unit 210) judges whether the luminance of the pupil image calculated in step S5 is equal to or greater than a predetermined threshold, and judges whether the luminance of the pupil image is a maximum value (local maximum value). Note that only one of these judgment processes may be executed. The threshold judgment is performed by comparing the luminance of the pupil image with a threshold. This threshold may be, for example, the threshold of the first condition described above. The maximum value judgment is performed by monitoring the change in luminance accompanying the movement of the illumination optical system 30 and the observation optical system 40. For example, by searching for a position where the change in luminance changes from increasing to decreasing, it can be judged whether a certain position of the illumination optical system 30 and the observation optical system 40 is a position where the luminance is maximum (that is, the position of the illumination optical system 30 and the observation optical system 40 where the luminance is maximum can be obtained).
[0125] If it is determined in step S5 that the luminance of the pupil image calculated is equal to or greater than the threshold value and is the maximum value (S6: Yes), the operation proceeds to step S8. If it is determined in step S5 that the luminance of the pupil image calculated is less than the threshold value and / or that the luminance of the pupil image is not the maximum value (S6: No), the operation proceeds to step S7.
[0126] (S7: Move the optical system) If the result of the determination in step S6 is "No", the ophthalmic observation device 1 (control unit 200, movement mechanism 70) moves the illumination optical system 30 and the observation optical system 40. The movement direction may be any direction, and may be one or more of the up-down direction (Z direction), the left-right direction (X direction), and the front-back direction (Y direction). As described above, the movement direction may be determined based on the change in luminance. The movement amount (movement distance) may be set in advance, or may be determined based on the change in luminance.
[0127] (S8: End movement of the optical system) If the result of the determination in step S6 is "Yes," the ophthalmologic observation device 1 (control unit 200) ends (ends) the movement of the illumination optical system 30 and the observation optical system 40. As a result, the illumination optical system 30 and the observation optical system 40 are positioned at a position where the luminance of the pupil image is equal to or greater than the threshold and is at its maximum. In other words, a transillumination image is obtained whose luminance is equal to or greater than the threshold and is at its maximum.
[0128] Any of the above-mentioned items can be combined with the operation and usage of this example. For example, when the luminance of the pupil image falls below a specified value (the threshold of the second condition described above), the illumination optical system 30 and the observation optical system 40 can be moved again to search for a position where the luminance of the pupil image is maximum, and the illumination optical system 30 and the observation optical system 40 can be arranged at that position. In addition, when the luminance of the pupil image is not equal to or greater than the threshold value even after the illumination optical system 30 and the observation optical system 40 are moved, processing such as notification, increasing the amount of illumination light, increasing the gain of the image sensor, and reducing the threshold value can be executed. In addition, after the illumination optical system 30 and the observation optical system 40 are moved to a position where the luminance of the pupil image is equal to or greater than the threshold value and is maximum, the illumination light amount can be reduced in a range where the luminance of the pupil image is equal to or greater than the specified value, thereby reducing the burden on the subject.
[0129] <Method for controlling an ophthalmic observation device> An exemplary embodiment (for example, the above-mentioned ophthalmic observation device 1) provides a method for controlling the ophthalmic observation device. Any feature related to the ophthalmic observation device 1 of the above-mentioned embodiment can be combined with the exemplary method described below.
[0130] The ophthalmic observation device controlled by the method of the exemplary embodiment includes an optical system for observing the subject's eye (e.g., an illumination optical system 30 and an observation optical system 40 moved by a moving mechanism 70) and a processor (e.g., a control unit 200 and a data processing unit 210). The method of the exemplary embodiment first causes the movement of the optical system and the generation of a moving image of the subject's eye by the optical system to be performed in parallel. Furthermore, the method of the exemplary embodiment causes the processor to perform sequential analysis of a plurality of still images included in the moving image to sequentially detect images of a predetermined portion of the subject's eye. In addition, the method of the exemplary embodiment causes the processor to perform movement of the optical system based on changes in predetermined image parameters in the images of the predetermined portion that are sequentially detected.
[0131] According to the method of such an exemplary aspect, it is possible to achieve the same actions and effects as those of the ophthalmic observation device 1 of the above embodiment. Moreover, by combining the matters related to the ophthalmic observation device 1 of the above embodiment with the method of the exemplary aspect, the method obtained as a result can achieve the actions and effects corresponding to the combined matters.
[0132] <Program> The exemplary embodiment provides a program for causing a computer to execute the method of the exemplary aspect described above. It is possible to combine the features related to the ophthalmologic observation device 1 of the above embodiment with such a program.
[0133] According to such a program, it is possible to achieve the same actions and effects as those of the ophthalmic observation device 1 of the above embodiment. Moreover, by combining the items related to the ophthalmic observation device 1 of the above embodiment with a program, the resulting program can achieve the actions and effects corresponding to the combined items.
[0134] <Recording Media> The exemplary embodiment provides a computer-readable non-transitory recording medium having the above-mentioned program recorded therein. It is possible to combine the features related to the ophthalmic observation device 1 of the above-mentioned embodiment with such a recording medium. The non-transitory recording medium may be in any form, and examples thereof include a magnetic disk, an optical disk, a magneto-optical disk, and a semiconductor memory.
[0135] According to such a recording medium, it is possible to achieve the same actions and effects as those of the ophthalmic observation device 1 of the above embodiment. Moreover, by combining the items related to the ophthalmic observation device 1 of the above embodiment with a recording medium, the resulting recording medium can achieve the actions and effects corresponding to the combined items.
[0136] According to the present disclosure, for example, the observation environment can be automatically optimized by automatically determining a position where the return intensity of the fundus reflection of the coaxial illumination is good (above a threshold, maximum) and moving the microscope optical system. In addition, a good observation environment can be maintained by performing the same operation when the subject or the subject's eye moves. In addition, the same operation can be performed with an illumination method other than the coaxial illumination (for example, oblique illumination), but preset information for each user may be prepared in cases where the user's preference is reflected.
[0137] Furthermore, according to the present disclosure, as long as the operation is functioning properly, the user can always observe the eye under optimal lighting conditions, which can improve the success rate of surgery, shorten the surgery time, and reduce the amount of illumination light, thereby reducing the burden on the patient. For example, if the present disclosure is used in cataract surgery, a suitable transillumination image can be obtained in coaxial illumination, making it possible to perform phacoemulsification and posterior capsule polishing appropriately and efficiently.
[0138] The present disclosure is merely an example of an embodiment, and any modifications, omissions, additions, substitutions, and the like can be made within the scope of the present disclosure and its equivalents. [Explanation of symbols]
[0139] 1 Ophthalmic observation device 2 Control device 3 Display device 10 Surgical microscope 30 Illumination optical system 40 Observation Optical System 200 Control section 210 Data Processing Unit 211 Analysis Department 212 Judgment section
Claims
1. An ophthalmic observation device for observing an eye to be examined, comprising: a moving image generating unit that generates a moving image by illuminating and photographing the subject's eye; A moving mechanism that moves the moving image generating unit; an analysis unit that sequentially analyzes a plurality of still images included in the moving image generated by the moving image generation unit moved by the moving mechanism, and sequentially detects an image of a predetermined portion of the subject's eye; a first control unit that controls the moving mechanism based on a change in a predetermined image parameter in the image successively detected by the analysis unit; Including, The control of the moving mechanism based on the change in the image parameter executed by the first control unit can be enabled and disabled. Ophthalmic observation equipment.
2. An ophthalmic observation device for observing an eye to be examined, comprising: a moving image generating unit that generates a moving image by illuminating and photographing the subject's eye; A moving mechanism that moves the moving image generating unit; an analysis unit that sequentially analyzes a plurality of still images included in the moving image generated by the moving image generation unit moved by the moving mechanism, and sequentially detects an image of a predetermined portion of the subject's eye; a first control unit that controls the moving mechanism based on a change in a predetermined image parameter in the image successively detected by the analysis unit; a determination unit that determines whether or not to execute control of the moving mechanism based on the change in the image parameter executed by the first control unit; 1. An ophthalmic observation device comprising:
3. the first control unit controls the movement mechanism to stop the movement of the moving image generating unit when the image parameters in the images successively detected by the analysis unit satisfy a first condition.
3. An ophthalmologic observation device according to claim 1 or 2.
4. The image parameters include brightness; the first condition includes at least one of the luminance being maximum and the luminance being equal to or greater than a first threshold value; 4. An ophthalmologic observation device according to claim 3.
5. the first control unit controls the movement mechanism to start moving the moving image generating unit when the image parameters in the images successively detected by the analysis unit satisfy a second condition. An ophthalmologic observation device according to any one of claims 1 to 4.
6. The image parameters include brightness; the second condition includes the luminance being less than a second threshold.
6. An ophthalmologic observation device according to claim 5.
7. the first control unit determines a movement direction of the moving image generating unit based on the change in the image parameter, and controls the movement mechanism based on the determined movement direction. An ophthalmologic observation device according to any one of claims 1 to 6.
8. the moving image generating unit generates a moving image of an anterior segment of the subject's eye, The predetermined portion includes a pupil. An ophthalmologic observation device according to any one of claims 1 to 7.
9. the moving image generating unit generates a moving image of a posterior segment of the subject's eye, The predetermined site includes the optic disc. An ophthalmologic observation device according to any one of claims 1 to 7.
10. a notification unit that notifies the user when the image parameters in the images sequentially detected by the analysis unit satisfy a third condition. An ophthalmologic observation device according to any one of claims 1 to 9.
11. Further comprising a response receiving unit that receives a response from a user to the notification, The first control unit controls the moving mechanism based on the response received by the response receiving unit.
11. An ophthalmologic observation device according to claim 10.
12. The determination unit performs the determination based on the moving image generated by the moving image generation unit.
3. An ophthalmologic observation device according to claim 2.
13. The determination unit determines whether a treatment is being performed on the subject's eye based on the moving image generated by the moving image generation unit, and determines not to execute control of the movement mechanism when it is determined that the treatment is being performed.
13. An ophthalmologic observation device according to claim 12.
14. a second control unit that, when an optimal value of the image parameter obtained in the control of the moving mechanism based on a change in the image parameter satisfies a fourth condition, executes at least one of a notification, an increase in an amount of illumination light by the moving image generation unit, an increase in a gain of an image sensor of the moving image generation unit, and a change in a judgment condition for the image parameter. An ophthalmologic observation device according to any one of claims 1 to 13.
15. and a third control unit that reduces an amount of illumination light generated by the moving image generating unit on condition that the image parameter falls within a predetermined range after controlling the moving mechanism based on the change in the image parameter. An ophthalmologic observation device according to any one of claims 1 to 14.
16. The image parameters include at least one of brightness, contrast, sharpness, and color tone. An ophthalmologic observation device according to any one of claims 1 to 15.
17. A method for controlling an ophthalmic observation device including an optical system for observing a subject's eye and a processor, comprising: moving the optical system and generating a moving image of the subject's eye by the optical system in parallel; causing the processor to execute sequential analysis of a plurality of still images included in the moving image to sequentially detect images of a predetermined portion of the subject's eye; causing the processor to effect movement of the optical system based on changes in a predetermined image parameter in the successively detected images; causing the processor to enable and disable movement of the optical system based on changes in the image parameters; method.
18. A method for controlling an ophthalmic observation device including an optical system for observing a subject's eye and a processor, comprising: moving the optical system and generating a moving image of the subject's eye by the optical system in parallel; causing the processor to execute sequential analysis of a plurality of still images included in the moving image to sequentially detect images of a predetermined portion of the subject's eye; causing the processor to effect movement of the optical system based on changes in a predetermined image parameter in the successively detected images; causing the processor to determine whether to perform a movement of the optical system based on a change in the image parameter; method.
19. A program causing a computer to execute the method according to claim 17 or 18.
20. A non-transitory computer-readable recording medium having the program of claim 19 recorded thereon.
Citation Information
Patent Citations
Ophthalmologic surgical apparatus
JP2001276111A
Ophthalmologic photographing apparatus
JP2003310556A
Microscope for surgical operation
JP2009118955A
Ophthalmic microscope system
JP2017012430A
Ophthalmologic apparatus, control method thereof, program, and recording medium
JP2020116140A
