Ophthalmic observation device

The ophthalmological observation device addresses brightness discrepancies in digital systems by adjusting sensor gain and processing images to achieve equal brightness and high resolution in both eyes, improving surgical precision and comfort.

JP7594021B2Active Publication Date: 2024-12-03TOPCON CORPORATION
View PDF 7 Cites 0 Cited by

Patent Information

Application Number
JP2022558821
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Priority Date
2020-10-27
Filing Date
2020-12-09
Publication Date
2024-12-03
Estimated Expiration
2040-12-09

AI Technical Summary

Technical Problem

Conventional digital ophthalmological observation devices face challenges in displaying images with significant brightness differences between the left and right optical systems due to differing aperture conditions, leading to suboptimal observation quality.

Method used

The device employs a processor to compensate for differences in imaging parameters, particularly brightness, by adjusting the gain of image sensors and performing image processing to ensure equal brightness and high resolution in both left and right images.

Benefits of technology

This approach allows for simultaneous display of high-resolution images with a deep depth of field and equal brightness, enhancing observation clarity and reducing visual discomfort during procedures like ophthalmic surgery.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007594021000001
    Figure 0007594021000001
  • Figure 0007594021000002
    Figure 0007594021000002
  • Figure 0007594021000003
    Figure 0007594021000003
Patent Text Reader

Abstract

An ophthalmologic observation device (1) according to an exemplary embodiment comprises a microscope (10), processors (203, 211), and a display control unit (201). The microscope includes a pair of imaging systems and a pair of pieces of video data of a to-be-inspected eye. The processor executes first processing so that a predetermined parameter of the pair of pieces of video data satisfies a first condition. The first processing includes at least one among control of the microscope and image processing on at least one of the pair of pieces of video data. The display control unit causes a display device (3) to display a pair of images on the basis of the pair of pieces of video data obtained through the first processing.
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] (CROSS REFERENCE TO RELATED APPLICATIONS) This application claims priority to U.S. Provisional Patent Application No. 63 / 106,087, entitled “APPARATUS AND METHOD FOR OPHTHALMIC OBSERVATION,” filed October 27, 2020, which is incorporated by reference in its entirety.

[0002] The present disclosure relates to an ophthalmic observation device. [Background technology]

[0003] An ophthalmic observation device is a device for observing a patient's eye (called an examined eye). Ophthalmic observation is performed in order to grasp the condition of the examined eye in various situations such as examination, surgery, and treatment.

[0004] Conventional ophthalmic observation devices provide users with a magnified image obtained by an objective lens or a variable magnification optical system through an eyepiece, but some recent ophthalmic observation devices are configured to capture the magnified image obtained by the objective lens or the variable magnification optical system with an image sensor and display the captured image (called digital ophthalmic observation devices). Types of digital ophthalmic observation devices include surgical microscopes, slit lamp microscopes, and fundus cameras. In addition, various types of ophthalmic examination devices, such as refractometers, keratometers, tonometers, specular microscopes, wavefront analyzers, and microperimeters, are also provided with the function of a digital ophthalmic observation device.

[0005] In general, an ophthalmic observation device provides an image of an eye to a user (e.g., a medical professional such as a doctor). A digital ophthalmic observation device is typically configured to perform moving image capture using infrared light and / or visible light as illumination light, and to perform real-time moving image display of the image obtained thereby. The real-time moving image (video) provided in this manner is called an observation image or a live image. [Prior art documents] [Patent documents]

[0006] [Patent Document 1] JP 2019-162336 A Summary of the Invention [Problem to be solved by the invention]

[0007] As a method of using a conventional eyepiece type (non-digital) binocular ophthalmic observation device, there is a method of performing observation by changing the conditions of a pair of optical systems on the left and right. For example, in ophthalmic surgery using an eyepiece type surgical microscope, the aperture of a first optical system is narrowed more than that of a second optical system, so that an image with a relatively deep depth of field (depth of focus) is observed through the first optical system while an image with a relatively high resolution is observed through the second optical system. This allows the surgeon to perform observation with a deep depth of field while ensuring the resolution of the observed image.

[0008] It is possible to apply such observation techniques, which have been used in non-digital ophthalmic observation devices, to digital ophthalmic observation devices. However, when the conditions of the left and right optical systems are different in a binocular digital ophthalmic observation device, there is a problem that the appearance of the left and right captured images obtained by the left and right optical systems is significantly different, so that it is difficult to perform suitable observation even if these captured images are displayed. For example, when the aperture conditions of the left and right optical systems are different, the brightness of the left and right captured images is significantly different, so that the surgeon may observe a bright image with one eye while observing a dark image with the other eye.

[0009] One object of the present disclosure is to provide a new method for using a digital ophthalmic observation device. [Means for solving the problem]

[0010] An ophthalmic observation device according to some exemplary embodiments includes a microscope including a pair of imaging systems and acquiring a pair of image data of a subject's eye, a processor that executes a first process including at least one of control of the microscope and image processing of at least one of the pair of image data so that a predetermined parameter of the pair of image data satisfies a first condition, and a display control unit that causes a display device to display a pair of images based on the pair of image data obtained through the first process.

[0011] In some exemplary aspects of the ophthalmic observation device, the processor may be configured to perform the first processing to compensate for differences in the parameters of the pair of images caused by differences in predetermined shooting conditions between the pair of shooting systems.

[0012] In an ophthalmic observation device according to some exemplary aspects, each of the pair of imaging systems may include an image sensor and an aperture for adjusting the amount of light guided to the image sensor, and the imaging conditions may include conditions for the aperture.

[0013] In some exemplary aspects of the ophthalmic observation device, the processor may be configured to perform the first process to compensate for differences in brightness between the pair of images.

[0014] In an ophthalmic observation device according to some exemplary aspects, the processor may be configured to control a gain of the image sensor of at least one of the pair of imaging systems to compensate for the difference in brightness.

[0015] In the ophthalmic observation device according to some exemplary aspects, the processor may be configured to adjust the brightness of at least one of the pair of image data to compensate for the difference in brightness.

[0016] In some exemplary aspects of the ophthalmic observation device, the processor may be configured to execute a second process including at least one of controlling the microscope and image processing on at least one of the pair of image data so that the brightness of the pair of images further satisfies a second condition.

[0017] In some exemplary aspects of the ophthalmic observation device, the processor may be configured to execute the second processing so that the brightness of both of the pair of images is equal to or greater than a predetermined threshold.

[0018] In some exemplary aspects of the ophthalmic observation device, the processor may be configured to perform the first process to compensate for differences in brightness between the pair of images. Effect of the Invention

[0019] According to an exemplary embodiment, it is possible to provide a new method of using a digital ophthalmic observation device. [Brief description of the drawings]

[0020] [Figure 1] 1 is a schematic diagram showing an example of the configuration of an ophthalmic observation device (ophthalmic surgical microscope) according to an exemplary embodiment. [Diagram 2] FIG. 1 is a schematic diagram showing an example of the configuration of an ophthalmologic observation apparatus according to an exemplary embodiment. [Diagram 3] FIG. 1 is a schematic diagram showing an example of the configuration of an ophthalmologic observation apparatus according to an exemplary embodiment. [Figure 4A] FIG. 1 is a schematic diagram showing an example of the configuration of an ophthalmologic observation apparatus according to an exemplary embodiment. [Figure 4B] FIG. 1 is a schematic diagram showing an example of the configuration of an ophthalmologic observation apparatus according to an exemplary embodiment. [Diagram 5] 11 is a flowchart illustrating an example of processing executed by an ophthalmologic observation apparatus according to an exemplary embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0021] Some exemplary aspects of the ophthalmic observation device according to the embodiment will be described in detail with reference to the drawings. It should be noted that the items described in the documents cited in this specification and any known techniques can be combined with the exemplary aspects.

[0022] An ophthalmic observation device according to an exemplary embodiment is used to grasp the condition of a subject's eye in medical procedures such as surgery, examination, and treatment. Although the ophthalmic observation device according to the exemplary embodiment described below is a surgical microscope system, the ophthalmic observation device is not limited to a surgical microscope system. For example, the ophthalmic observation device may be any of a slit lamp microscope, a fundus camera, a refractometer, a keratometer, a tonometer, a specular microscope, a wavefront analyzer, and a microperimeter, or may be a system including any one or more of these. More generally, the ophthalmic observation device may be any ophthalmic device having an observation function.

[0023] The target site of observation using an ophthalmic observation device may be any site of the subject's eye, and may be any site of the anterior eye and / or any site of the posterior eye. Examples of the target sites of observation in the anterior eye include the cornea, iris, anterior chamber, angle, crystalline lens, ciliary body, and Zinn's zonule. Examples of the target sites of observation in the posterior eye include the retina, choroid, sclera, and vitreous body. The target sites of observation are not limited to ocular tissues, and may be any site that is the target of observation in ophthalmology (and / or other departments), such as the eyelids, meibomian glands, and orbit.

[0024] At least a portion of the functionality of the elements disclosed herein is implemented using circuitry or processing circuitry. The circuitry or processing circuitry may be a general purpose processor, a special purpose processor, an integrated circuit, a central processing unit (CPU), a graphics processing unit (GPU), an application specific integrated circuit (ASIC), a programmable logic device (e.g., a simple programmable logic device (SPLD), a complex programmable logic device (CPLD), a field programmable gate array (FPGA), or a combination of a programmable logic device (PLC) and a programmable logic device (PGD)), configured and / or programmed to perform at least a portion of the functionality disclosed. The term "circuitry", "unit", "means" or the like includes any of the above-mentioned circuitry, including a transistor and / or other circuitry, a processor, a processor array, a conventional circuitry, and any combination thereof. A processor is considered to be a processing circuitry or circuitry, including transistors and / or other circuitry. In this disclosure, a circuitry, a unit, a means, or the like is hardware that performs at least some of the disclosed functions or is hardware that is programmed to perform at least some of the disclosed functions. The hardware may be hardware disclosed herein or may be known hardware that is programmed and / or configured to perform at least some of the described functions. In the case where the hardware is a processor that can be considered to be a type of circuitry, a circuitry, a unit, a means, or the like is a combination of hardware and software, and the software is used to configure the hardware and / or the processor.

[0025] <Ophthalmological observation device> The configuration of an exemplary embodiment of an ophthalmic observation device is shown in FIG.

[0026] An ophthalmic observation device 1 (surgical microscope system) according to the embodiment includes an operation device 2, a display device 3, and a surgical microscope 10. In some aspects, the surgical microscope 10 may include at least one of the operation device 2 and the display device 3. In some aspects, the display device 3 may not be included in the ophthalmic observation device 1. In other words, the display device 3 may be a peripheral device of the ophthalmic observation device 1.

[0027] <Control device 2> The operation device 2 includes an operation device and / or an input device. For example, the operation device 2 may include a button, a switch, a mouse, a keyboard, a trackball, an operation panel, a dial, and the like. Typically, the operation device 2 includes a foot switch, similar to a general ophthalmic surgical microscope. In addition, the operation device 2 may be configured to perform operations using voice recognition, eye gaze input, and the like.

[0028] <Display device 3> The display device 3 displays an image of the subject's eye acquired by the surgical microscope 10. The display device 3 includes a display device such as a flat panel display. The display device 3 may also include various display devices such as a touch panel. A typical display device 3 includes a large-screen display device. The display device 3 includes one or more display devices. When the display device 3 includes two or more display devices, for example, one may be a relatively large-screen display device and the other may be a relatively small-screen display device. Also, a configuration may be adopted in which one display device is provided with multiple display areas to display multiple pieces of information.

[0029] The operation device 2 and the display device 3 do not need to be separate devices. For example, a device in which an operation function and a display function are integrated, such as a touch panel, may be used as the display device 3. In this case, the operation device 2 includes the touch panel and a computer program. The operation content on the operation device 2 is input to a processor (not shown) as an electric signal. In addition, operations and information input may be performed using a graphical user interface (GUI) displayed on the display device 3 and the operation device 2. In some aspects, the functions of the operation device 2 and the display device 3 may be realized by a touch screen.

[0030] <Surgical microscope 10> The surgical microscope 10 is used to observe the eye (examined eye) of a patient in a supine position. The surgical microscope 10 captures an image of the examined eye to generate digital image data (video data). In particular, the surgical microscope 10 generates a moving image (video) of the examined eye. The moving image generated by the surgical microscope 10 is transmitted to the display device 3 via a wired and / or wireless signal path and displayed. A user (surgeon) can perform surgery while observing the examined eye through the displayed video (observation image, live image). Some aspects of the surgical microscope 10 may allow observation through a conventional eyepiece in addition to observing such videos.

[0031] In some aspects, the surgical microscope 10 includes a communication device for transmitting and receiving an electrical signal to and from the operation device 2. The operation device 2 receives an operation by a user and generates an electrical signal (operation signal) corresponding to the operation. The operation signal is transmitted to the surgical microscope 10 via a wired and / or wireless signal path. The surgical microscope 10 executes a process corresponding to the received operation signal.

[0032] <Optical system of surgical microscope 10> An example of the configuration of the optical system of the surgical microscope 10 will be described below. For convenience of description, the optical axis direction of the objective lens is defined as the z direction (e.g., the vertical direction during surgery, the up-down direction), a predetermined direction perpendicular to the z direction is defined as the x direction (e.g., the horizontal direction during surgery, the left-right direction for the surgeon and patient), and a direction perpendicular to both the z direction and the x direction is defined as the y direction (e.g., the horizontal direction during surgery, the front-back direction for the surgeon, the body axis direction for the patient).

[0033] The observation optical system of the surgical microscope 10 has a pair of optical systems. One optical system acquires image data to be presented to the user's left eye, and the other optical system acquires image data to be presented to the user's right eye. This allows the user to observe with both eyes (binocular observation), and in particular, allows stereoscopic vision.

[0034] An example of the configuration of the optical system of the surgical microscope 10 is shown in Fig. 2. Fig. 2 shows a schematic top view of the optical system seen from above and a schematic side view of the optical system seen from the side in association with each other. To simplify the illustration, the illumination optical system 30 disposed above the objective lens 20 is omitted from the top view.

[0035] The surgical microscope 10 includes an objective lens 20, a dichroic mirror DM1, an illumination optical system 30, and an observation optical system 40. The observation optical system 40 includes a zoom expander 50, an aperture 55, and an imaging camera 60. In some embodiments, the illumination optical system 30 or the observation optical system 40 includes the dichroic mirror DM1.

[0036] The objective lens 20 is disposed so as to face the eye to be examined. The objective lens 20 is disposed so that its optical axis is along the z direction. The objective lens 20 may include two or more lenses.

[0037] The dichroic mirror DM1 couples the optical path of the illumination optical system 30 and the optical path of the observation optical system 40. The dichroic mirror DM1 is disposed between the illumination optical system 30 and the objective lens 20. The dichroic mirror DM1 transmits illumination light from the illumination optical system 30 and guides it to the subject's eye via the objective lens 20, and also reflects return light from the subject's eye that enters through the objective lens 20 and guides it to the imaging camera 60 of the observation optical system 40.

[0038] The dichroic mirror DM1 coaxially couples the optical path of the illumination optical system 30 and the optical path of the observation optical system 40. That is, the optical axis of the illumination optical system 30 and the optical axis of the observation optical system 40 intersect at the dichroic mirror DM1. The illumination optical system 30 includes a left-eye illumination optical system (31L) and a right-eye illumination optical system (31R), and the observation optical system 40 includes a left-eye observation optical system 40L and a right-eye observation optical system 40R. The dichroic mirror DM1 coaxially couples the optical path of the left-eye illumination optical system (first illumination optical system 31L) and the optical path of the left-eye observation optical system 40L, and coaxially couples the optical path of the right-eye illumination optical system (first illumination optical system 31R) and the optical path of the right-eye observation optical system 40R.

[0039] The illumination optical system 30 is an optical system for illuminating the subject's eye via the objective lens 20. The illumination optical system 30 may be configured to illuminate the subject's eye with one of two or more illumination lights having different color temperatures. The illumination optical system 30 projects illumination light of a specified color temperature onto the subject's eye under the control of a control unit (200) described later.

[0040] The illumination optical system 30 includes first illumination optical systems 31L and 31R and a second illumination optical system 32.

[0041] The optical axis OL of the first illumination optical system 31L and the optical axis OR of the first illumination optical system 31R are arranged approximately coaxially with the optical axis of the objective lens 20. This makes it possible to realize coaxial illumination and obtain a transillumination image using diffuse reflection at the fundus. In this embodiment, the transillumination image of the subject's eye can be observed with binoculars.

[0042] The second illumination optical system 32 is disposed so that its optical axis OS is decentered from the optical axis of the objective lens 20. The first illumination optical systems 31L and 31R and the second illumination optical system 32 are disposed so that the deviation of the optical axis OS from the optical axis of the objective lens 20 is larger than the deviation of the optical axes OL and OR from the optical axis of the objective lens 20. This allows the realization of so-called "angled illumination (oblique illumination)," making it possible to observe the subject's eye with binoculars while preventing the inclusion of ghosts caused by corneal reflection, etc. Furthermore, it also makes it possible to observe the irregularities of the parts and tissues of the subject's eye in detail.

[0043] The first illumination optical system 31L includes a light source 31LA and a condenser lens 31LB. The light source 31LA outputs illumination light with a wavelength in the visible region corresponding to a color temperature of, for example, 3000 K (Kelvin). The illumination light output from the light source 31LA passes through the condenser lens 31LB, transmits through the dichroic mirror DM1, and passes through the objective lens 20 to enter the subject's eye.

[0044] The first illumination optical system 31R includes a light source 31RA and a condenser lens 31RB. The light source 31RA also outputs illumination light with a wavelength in the visible region corresponding to a color temperature of, for example, 3000 K. The illumination light output from the light source 31RA passes through the condenser lens 31RB, transmits through the dichroic mirror DM1, and passes through the objective lens 20 to enter the subject's eye.

[0045] The second illumination optical system 32 includes a light source 32A and a condenser lens 32B. The light source 32A outputs illumination light with a wavelength in the visible region corresponding to a color temperature of, for example, 4000 K to 6000 K. The illumination light output from the light source 32A passes through the condenser lens 32B and passes through the objective lens 20 without passing through the dichroic mirror DM1, and enters the subject's eye.

[0046] That is, the color temperature of the illumination light from the first illumination optical systems 31L and 31R is lower than the color temperature of the illumination light from the second illumination optical system 32. With this configuration, it becomes possible to observe the subject's eye in warm colors using the first illumination optical systems 31L and 31R, and to observe the structure and shape of the subject's eye in detail.

[0047] In some aspects, each of the optical axes OL and OR is movable relative to the optical axis of the objective lens 20. The direction of this relative movement is a direction intersecting the optical axis of the objective lens 20, and this relative movement is expressed by a displacement vector in which at least one of the x component and the y component is not zero. In some aspects, each of the optical axes OL and OR may be movable independently. On the other hand, in some aspects, the optical axes OL and OR may be movable integrally. For example, the surgical microscope 10 includes a moving mechanism (31d) that moves the first illumination optical systems 31L and 31R independently or integrally, and the moving mechanism moves the first illumination optical systems 31L and 31R independently or integrally in a direction intersecting the optical axis of the objective lens 20. This makes it possible to adjust the visibility of the subject's eye. In some aspects, the moving mechanism operates under the control of a control unit (200) described later.

[0048] In some aspects, the optical axis OS is movable relative to the optical axis of the objective lens 20. The direction of this relative movement is a direction intersecting with the optical axis of the objective lens 20, and this relative movement is expressed by a displacement vector in which at least one of the x component and the y component is not zero. For example, the surgical microscope 10 includes a movement mechanism (32d) that moves the second illumination optical system 32, and this movement mechanism moves the second illumination optical system 32 in a direction intersecting with the optical axis of the objective lens 20. This makes it possible to adjust the visibility of unevenness in the part or tissue of the subject's eye. In some aspects, the movement mechanism operates under the control of a control unit (200) described later.

[0049] As described above, in this embodiment, the illumination optical system 30 is disposed directly above the objective lens 20 (in the transmission direction of the dichroic mirror DM1), and the observation optical system 40 is disposed in the reflection direction of the dichroic mirror DM1. For example, the observation optical system 40 may be disposed so that the angle between the optical axis of the observation optical system 40 and the plane (xy plane) perpendicular to the optical axis of the objective lens 20 is ±20 degrees or less.

[0050] According to the configuration of this embodiment, the observation optical system 40, which generally has a longer optical path length than the illumination optical system 30, is arranged approximately parallel to the xy plane, so that the observation optical system is not obstructed from the field of view of the surgeon as in the conventional surgical microscope in which the observation optical system is arranged vertically in front of the surgeon's eyes. Therefore, the surgeon can easily see the screen of the display device 3 installed in front. In other words, the visibility of the displayed information (images and videos of the subject's eye, and various other reference information) during surgery is improved. In addition, since the housing is not arranged in front of the surgeon's eyes, the surgeon does not feel a sense of pressure, and the burden on the surgeon is reduced.

[0051] The observation optical system 40 is an optical system for observing an image formed based on return light of illumination light incident from the subject's eye via the objective lens 20. In this embodiment, the observation optical system 40 provides an image to an imaging element of the imaging camera 60.

[0052] As described above, the observation optical system 40 includes the left-eye observation optical system 40L and the right-eye observation optical system 40R. The configuration of the left-eye observation optical system 40L is similar to the configuration of the right-eye observation optical system 40R. In some aspects, the optical arrangements of the left-eye observation optical system 40L and the right-eye observation optical system 40R may be changed independently of each other. The left-eye observation optical system 40L and the right-eye observation optical system 40R function as a pair of imaging systems.

[0053] The zoom expander 50 is also called a beam expander, a variable beam expander, etc. The zoom expander 50 includes a left-eye zoom expander 50L and a right-eye zoom expander 50R. The configuration of the left-eye zoom expander 50L is similar to the configuration of the right-eye zoom expander 50R. In some aspects, the left-eye zoom expander 50L and the right-eye zoom expander 50R may be capable of changing the optical arrangements independently of each other.

[0054] The left-eye zoom expander 50L includes a plurality of zoom lenses 51L, 52L, and 53L. At least one of the plurality of zoom lenses 51L, 52L, and 53L is movable in the optical axis direction by a magnification change mechanism (not shown).

[0055] Similarly, the right-eye zoom expander 50R includes a plurality of zoom lenses 51R, 52R, and 53R, and at least one of the plurality of zoom lenses 51R, 52R, and 53R is movable in the optical axis direction by a magnification change mechanism (not shown).

[0056] The magnification change mechanism may be configured to move each zoom lens of the left-eye zoom expander 50L and each zoom lens of the right-eye zoom expander 50R independently or integrally in the optical axis direction. This changes the magnification when photographing the subject's eye. In some aspects, the magnification change mechanism operates under the control of a control unit (200) described later.

[0057] The diaphragm 55 is an optical element for adjusting the amount of light passing through. In other words, the diaphragm 55 is an optical element for adjusting the amount of light guided to the imaging camera 60. The diaphragm 55 includes a left eye diaphragm 55L and a right eye diaphragm 55R. The left eye diaphragm 55L and the right eye diaphragm 55R are controlled independently of each other by a control unit (200) described later.

[0058] The left eye diaphragm 55L in a typical configuration has an opening that passes light and a blocking portion that blocks light. The outer edge of the opening corresponds to the inner edge of the blocking portion. In other words, the opening is defined by the blocking portion. The left eye diaphragm 55L is a variable diaphragm, and the type may be any. For example, the left eye diaphragm 55L may be any of an iris diaphragm, a rotary diaphragm, a watergate diaphragm, and a Waterhouse diaphragm. The right eye diaphragm 55R may have the same configuration as the left eye diaphragm 55L.

[0059] When the condition of the left-eye aperture 55L (the size (diameter) of the opening) is changed, the amount of light guided to the left-eye imaging camera 60L changes. Specifically, when the size of the opening of the left-eye aperture 55L is reduced (i.e., when the left-eye aperture 55L is narrowed), the focal depth (depth of field) of the left-eye observation optical system 40L is expanded and the in-focus range is widened, but the amount of light guided to the left-eye imaging camera 60L is reduced, so the obtained image becomes darker (the brightness is reduced). Conversely, when the size of the opening of the left-eye aperture 55L is increased (i.e., when the left-eye aperture 55L is opened), the amount of light guided to the left-eye imaging camera 60L is increased, so the obtained image becomes brighter (the brightness is increased), but the focal depth (depth of field) of the left-eye observation optical system 40L is reduced and the in-focus range is narrowed.

[0060] Changing the condition of the right-eye aperture 55R (the size (diameter) of the opening) changes the amount of light guided to the right-eye imaging camera 60R. Specifically, reducing the size of the opening of the right-eye aperture 55R increases the focal depth (depth of field) of the right-eye observation optical system 40R and widens the range in focus, but reduces the amount of light guided to the right-eye imaging camera 60R, resulting in a darker image (lower brightness). Conversely, increasing the size of the opening of the right-eye aperture 55R increases the amount of light guided to the right-eye imaging camera 60R, resulting in a brighter image (increased brightness), but reduces the focal depth (depth of field) of the right-eye observation optical system 40R and narrows the range in focus.

[0061] The imaging camera 60 is a device that captures an image formed by the observation optical system 40 to generate digital image data, and is typically a digital camera (digital video camera). The imaging camera 60 includes a left-eye imaging camera 60L and a right-eye imaging camera 60R. The configuration of the left-eye imaging camera 60L is similar to the configuration of the right-eye imaging camera 60R. In some aspects, the optical arrangements of the left-eye imaging camera 60L and the right-eye imaging camera 60R can be changed independently of each other.

[0062] The left-eye imaging camera 60L includes an imaging lens 61L and an imaging element 62L. The imaging lens 61L forms an image based on the return light that has passed through the left-eye aperture 55L on the imaging surface of the imaging element 62L. The imaging element 62L is an area sensor, and may typically be a charge-coupled device (CCD) image sensor or a complementary metal-oxide semiconductor (CMOS) image sensor. The imaging element 62L operates under the control of a control unit (200) described later.

[0063] The right-eye imaging camera 60R includes an imaging lens 61R and an imaging element 62R. The imaging lens 61R forms an image based on the return light that has passed through the right-eye aperture 55R on the imaging surface of the imaging element 62L. The imaging element 62R is an area sensor, and may typically be a CCD image sensor or a CMOS image sensor. The imaging element 62R operates under the control of a control unit (200) described later.

[0064] <Processing system> The processing system of the ophthalmic observation device 1 will be described. Several configuration examples of the processing system are shown in Fig. 3, Fig. 4A, and Fig. 4B. Any two or more of the various configuration examples described below can be at least partially combined. For example, the configuration example of Fig. 3 can be combined with the configuration example of Fig. 4A, the configuration example of Fig. 3 can be combined with the configuration example of Fig. 4B, and the configuration example of Fig. 3 can be combined with the configuration examples of Fig. 4A and Fig. 4B. Note that the configuration of the processing system is not limited to these examples.

[0065] The control unit 200 controls each part of the ophthalmic observation device 1. The control unit 200 includes a main control unit 201 and a storage unit 202. The main control unit 201 includes a processor and controls each part of the ophthalmic observation device 1. For example, the processor can read and execute a program stored in the storage unit 202 or another storage device to realize the function according to this embodiment, and can also use (reference, processing, calculation, etc.) data and information stored in the storage unit 202 or another storage device.

[0066] The main control unit 201 can execute control of each of the light sources 31LA, 31RA, and 32A of the illumination optical system 30, control of each of the apertures 55L and 55R of the observation optical system 40, control of each of the image sensors 62L and 62R of the observation optical system 40, control of each of the movement mechanisms 31d and 32d, control of each of the magnification mechanisms 50Ld and 50Rd, control of the operating device 2, control of the display device 3, etc.

[0067] The control of the light source 31LA includes turning the light source on and off, adjusting the light amount, adjusting the illumination aperture, etc. The control of the light source 31RA includes turning the light source on and off, adjusting the light amount, adjusting the illumination aperture, etc. The main control unit 201 can control the light sources 31LA and 31RA mutually exclusively. The control of the light source 32A includes turning the light source on and off, adjusting the light amount, adjusting the illumination aperture, etc.

[0068] When the illumination optical system 30 includes a light source capable of changing the color temperature, the main controller 201 can change the color temperature of the output illumination light by controlling this light source.

[0069] The control of the imaging element 62L includes exposure adjustment, gain adjustment, shooting rate adjustment, etc. The control of the imaging element 62R includes exposure adjustment, gain adjustment, shooting rate adjustment, etc. Furthermore, the main control unit 201 can control the imaging elements 62L and 62R so that the shooting timings of the imaging elements 62L and 62R coincide with each other, or control the imaging elements 62L and 62R so that the difference in the shooting timings of the imaging elements 62L and 62R is within a predetermined time. Furthermore, the main control unit 201 can control the reading of the digital data obtained by the imaging elements 62L and 62R.

[0070] The moving mechanism 31d moves the light sources 31LA and 31RA independently or integrally in a direction intersecting the optical axis of the objective lens 20. The main controller 201 can move the optical axes OL and OR independently or integrally with respect to the optical axis of the objective lens 20 by controlling the moving mechanism 31d.

[0071] The moving mechanism 32d moves the light source 32A in a direction intersecting the optical axis of the objective lens 20. The main controller 201 can move the optical axis OS relative to the optical axis of the objective lens 20 by controlling the moving mechanism 32d.

[0072] The moving mechanism 70 moves the surgical microscope 10. For example, the moving mechanism 70 is configured to integrally move at least a part of the illumination optical system 30 and the observation optical system 40. This allows the relative positions of at least a part of the illumination optical system 30 and the observation optical system 40 to be changed with respect to the subject's eye while maintaining the relative positional relationship between at least a part of the illumination optical system 30 and the observation optical system 40. In some aspects, the moving mechanism 70 is configured to integrally move the first illumination optical systems 31L and 31R and the observation optical system 40. This allows the relative positions of the first illumination optical systems 31L and 31R and the observation optical system 40 to be changed with respect to the subject's eye while maintaining the state of coaxial illumination. In some aspects, the moving mechanism 70 is configured to integrally move the second illumination optical system 32 and the observation optical system 40. This allows the relative positions of the second illumination optical system 32 and the observation optical system 40 to be changed with respect to the subject's eye while maintaining the illumination angle of oblique illumination. In some aspects, the movement mechanism 70 is configured to integrally move the first illumination optical systems 31L and 31R and the second illumination optical system 32 and the observation optical system 40. This makes it possible to change the relative positions of the illumination optical system 30 and the observation optical system 40 with respect to the subject's eye while maintaining both the coaxial illumination state and the illumination angle of the oblique illumination. The movement mechanism 70 operates under the control of the control unit 200.

[0073] In some aspects, the main controller 201 can control at least two of the moving mechanisms 31d, 32d, and 70 in a coordinated manner.

[0074] The magnification change mechanism 50Ld moves at least one of the multiple zoom lenses 51L to 53L of the left-eye zoom expander 50L in the optical axis direction. The main controller 201 can change the magnification of the left-eye observation optical system 40L by controlling the magnification change mechanism 50Ld.

[0075] Similarly, the magnification change mechanism 50Rd moves at least one of the multiple zoom lenses 51R to 53R of the right-eye zoom expander 50R in the optical axis direction. The main controller 201 can change the magnification of the right-eye observation optical system 40R by controlling the magnification change mechanism 50Rd.

[0076] The control over the operation device 2 includes operation permission control, operation prohibition control, and transmission control and / or reception control of an operation signal from the operation device 2. The main control unit 201 receives an operation signal generated by the operation device 2, and executes control corresponding to the received signal.

[0077] The control of the display device 3 includes information display control. The main control unit 201, as a display control unit, can display an image based on the digital image data generated by the imaging elements 62L and 62R on the display device 3. Typically, based on a pair of video data (video signals) generated in parallel by the imaging elements 62L and 62R, a pair of videos (a pair of moving images) can be displayed in parallel on the display device 3. The main control unit 201 can also display a still image (frame) included in one of the pair of videos on the display device 3. Furthermore, the main control unit 201 can display an image (moving image, still image, etc.) obtained by processing the digital image data generated by the imaging elements 62L and 62R on the display device 3. The main control unit 201 can also display any information generated by the ophthalmic observation device 1 or any information acquired from the outside by the ophthalmic observation device 1 on the display device 3.

[0078] The main control unit 201 functions as a display control unit of this embodiment. As a first example of the case where the main control unit 201 functions as a display control unit, the main control unit 201 can display a left-eye image by sequentially displaying digital image data (frames) sequentially generated as left-eye image data by the imaging element 62L on the display device 3, while displaying a right-eye image by sequentially displaying digital image data (frames) sequentially generated as right-eye image data by the imaging element 62R synchronized with the imaging element 62L on the display device 3. Here, the display of the left-eye image and the display of the right-eye image are synchronized with each other. That is, the main control unit 201 displays the left and right frames obtained substantially simultaneously by the left and right imaging elements 62L and 62R on the display device 3 substantially simultaneously. This first example may be adopted when, for example, the configuration shown in FIG. 4A (details will be described later) is applied.

[0079] In a second example of the case where the data processing unit 210 functions as a display control unit, the image data acquired by the observation optical system 40 is processed by the data processing unit 210 and then displayed on the display device 3 by the main control unit 201. The data processing unit 210 can sequentially apply a predetermined process (image processing) to digital image data (frames) sequentially generated as left-eye image data by the imaging element 62L, while sequentially applying a predetermined process (image processing) to digital image data (frames) sequentially generated as right-eye image data by the imaging element 62R synchronized with the imaging element 62L. Here, the processing of the left-eye image data and the processing of the right-eye image data may be synchronized with each other. That is, the data processing unit 210 can process in parallel the left and right frames obtained substantially simultaneously by the left and right imaging elements 62L and 62R. The left and right frames processed in parallel are sent to the main control unit 201 as a pair of frames (that is, associated with each other), for example. The main controller 201 receives a pair of frames (a left-eye frame and a right-eye frame) sequentially input from the data processor 210, and sequentially displays the sequentially input left-eye frames on the display device 3 to display a left-eye image, while sequentially displaying the sequentially input right-eye frames on the display device 3 to display a right-eye image. Here, the display of the left-eye image and the display of the right-eye image are synchronized with each other. This allows the main controller 201 to display frames obtained substantially simultaneously by the left and right imaging elements 62L and 62R substantially simultaneously on the display device 3. This second example may be employed when, for example, the configuration shown in FIG. 4B (details of which will be described later) is applied.

[0080] The main control unit 201 functioning as a display control unit can display the left-eye image and the right-eye image obtained through at least one of the processing of the first example and the processing of the second example on the display device 3 in a manner that allows stereoscopic viewing. For example, the main control unit 201 can create a pair of left and right parallax images from the left-eye frame and the right-eye frame acquired substantially simultaneously, and display the pair of parallax images on the display device 3. A user (such as a surgeon) can recognize the pair of parallax images as a stereoscopic image by using a known stereoscopic viewing method. Any stereoscopic viewing method can be applied to this embodiment, and can be, for example, a stereoscopic viewing method with the naked eye, a stereoscopic viewing method using an auxiliary device (such as polarized glasses), a stereoscopic viewing method using image processing (such as image synthesis and rendering) on ​​the left-eye frame and the right-eye frame, a stereoscopic viewing method that simultaneously displays a pair of parallax images, a stereoscopic viewing method that switches between and displays a pair of parallax images, or a stereoscopic viewing method that combines two or more of these.

[0081] The data processing unit 210 executes various types of data processing. Some examples of processing that the data processing unit 210 can execute are described below. The data processing unit 210 (each of its elements) includes a processor that operates according to a specific software (program), and is realized by the cooperation of hardware and software.

[0082] The ophthalmologic observation device 1 of this embodiment is configured to acquire left eye image data and right eye image data of the subject eye using a surgical microscope 10 including a left eye observation optical system 40L and a right eye observation optical system 40R, execute a predetermined process (first process) so that predetermined parameters of the image data satisfy a predetermined condition (first condition), and display a left eye image and a right eye image based on the left eye image data and right eye image data acquired through the first process.

[0083] Here, the predetermined parameter of the video data may be any parameter, and may be, for example, the brightness (luminance, luminance) of the frame.

[0084] Furthermore, the first processing may be arbitrary, and may include, for example, control of the surgical microscope 10 and / or image processing of at least one of the left-eye image data and the right-eye image data (i.e., may include at least one of the control and the image processing). The control of the surgical microscope 10 is executed by the control unit 200, and may be executed by, for example, the image sensor control unit 203 shown in Fig. 4A. The image processing of at least one of the left-eye image data and the right-eye image data is executed by the data processing unit 210, and may be executed by, for example, the image processing unit 211 shown in Fig. 4B.

[0085] The first condition may be any, and may be, for example, that a predetermined parameter condition is equivalent between the left eye image data and the right eye image data. This first condition (equalization of parameter condition) may be, for example, that both parameter values ​​are equal, or that the difference between both parameter values ​​is less than a predetermined threshold.

[0086] In some aspects, the ophthalmologic observation device 1 is configured to acquire left eye image data and right eye image data of the test eye using a surgical microscope 10 including a left eye observation optical system 40L and a right eye observation optical system 40R, perform a first process so that corresponding left and right frames in the left eye image data and right eye image data have equal brightness, and display left eye images and right eye images based on the left eye image data and right eye image data obtained through this first process (i.e., left eye image data and right eye image data with the brightness between corresponding frames equalized).

[0087] The following describes configuration examples for realizing such an ophthalmologic observation device 1. Fig. 4A shows a first configuration example, and Fig. 4B shows a second configuration example. Note that the configuration for equalizing the brightness between corresponding frames is not limited to these examples.

[0088] In addition, the purpose of the first process is not limited to equalizing the brightness between corresponding frames, and may be any. For example, the parameters of the video data considered in the first process are not limited to brightness parameters, and may be any parameters, and the number of parameters considered may also be any. For example, examples of the parameters of the video data considered in the first process include a color tone parameter, a contrast parameter, a gamma parameter, a color temperature parameter, a white balance parameter, an RGB balance parameter, a gray balance parameter, an edge enhancement parameter, a shadow enhancement parameter, a sharpening parameter, and a high dynamic range parameter.

[0089] Furthermore, the purpose of the first processing is not limited to making the left and right parameter conditions equal, but may be any purpose, such as making the left and right parameters have a difference of more than a predetermined threshold, making the left and right parameters fall within a predetermined range, or making other parameters obtained from the left and right parameters satisfy predetermined conditions.

[0090] Both the configuration example shown in Fig. 4A and the configuration example shown in Fig. 4B function to compensate for the difference in image parameters caused by the difference in shooting conditions between the left-eye observation optical system 40L and the right-eye observation optical system 40R. More specifically, both the configuration example shown in Fig. 4A and the configuration example shown in Fig. 4B function to cancel (eliminate the difference or make the difference smaller than a threshold value) the difference between the brightness of the left-eye image data and the brightness of the right-eye image data caused by the difference between the condition of the left-eye aperture 55L of the left-eye observation optical system 40L and the condition of the right-eye aperture 55R of the right-eye observation optical system 40R.

[0091] 4A relates to the configuration of the control unit 200. The control unit 200A of this example is an example of the control unit 200, and includes an image sensor control unit 203. The image sensor control unit 203 functions as a processor that executes a first process, and is configured to control at least one of the image sensor 62L of the left-eye observation optical system 40L and the image sensor 62R of the right-eye observation optical system 40R in order to compensate for the difference in brightness between the left-eye image data and the right-eye image data.

[0092] In this example, the image sensor control unit 203 is configured to control at least one of the gain of the image sensor 62L of the left-eye observation optical system 40L and the gain of the image sensor 62R of the right-eye observation optical system 40R.

[0093] Here, the amount of gain adjustment is determined by the image sensor control unit 203 based on, for example, the amount of difference (difference, ratio, etc.) between the conditions (opening dimensions) of the left eye aperture 55L and the conditions (opening dimensions) of the right eye aperture 55R.

[0094] A first example will be described. The image sensor control unit 203 of this example stores in advance a unit gain adjustment amount corresponding to a unit difference amount between the conditions of the left and right apertures. The image sensor control unit 203 of this example receives the conditions of the left eye aperture 55L and the right eye aperture 55R from the main control unit 201, obtains the difference amount between these conditions, divides the obtained difference amount by the unit difference amount, and can determine the gain adjustment amount based on the quotient and the unit gain adjustment amount.

[0095] A second example will be described. The image sensor control unit 203 of this example stores in advance information (correspondence information) that associates the difference between the conditions of the left and right apertures with the gain adjustment amount. The image sensor control unit 203 of this example receives the conditions of the left eye aperture 55L and the right eye aperture 55R from the main control unit 201, finds the difference between these conditions, and can determine the gain adjustment amount corresponding to the found difference amount by referring to the correspondence information. The correspondence information may be, for example, a table or a graph.

[0096] When the size of the opening of the left eye diaphragm 55L is smaller than the size of the opening of the right eye diaphragm 55R, the image sensor control unit 203 can, for example, control to increase the gain of the image sensor 62L of the left eye observation optical system 40L, control to decrease the gain of the image sensor 62R of the right eye observation optical system 40R, or execute both of these controls. This can reduce the difference in brightness between the left and right image data caused by the difference in the aperture conditions between the left and right, and can, for example, make the brightness of the left and right image data equal.

[0097] Conversely, when the size of the opening of the left eye diaphragm 55L is larger than the size of the opening of the right eye diaphragm 55R, the image sensor control unit 203 can, for example, control to increase the gain of the image sensor 62R of the right eye observation optical system 40R, control to decrease the gain of the image sensor 62L of the left eye observation optical system 40L, or execute both of these controls. This can reduce the difference in brightness between the left and right image data caused by the difference in the aperture conditions between the left and right, and can, for example, make the brightness of the left and right image data equal.

[0098] With such a function of the image sensor control unit 203, the ophthalmic observation device 1 can present not only a high-resolution image and an image with a deep depth of field in parallel, but also both images with the same brightness. Therefore, in ophthalmic surgery, the user can observe a first image with a wide range of focus with the left eye (or right eye), while observing an image with the same brightness as the first image and with a high resolution with the right eye (or left eye).

[0099] In some of the above examples, the gain adjustment is performed based on the difference between the conditions of the left and right apertures, but this is not a limitation of the processing that can be executed by the ophthalmic observation device 1. For example, the control unit 200 may be configured to execute, in cooperation with the control of at least one of the left-eye aperture 55L and the right-eye aperture 55R by the main control unit 201 and the control of at least one of the image sensor 62L of the left-eye observation optical system 40L and the image sensor 62R of the right-eye observation optical system 40R by the image sensor control unit 203, by referring to information (correspondence information) that associates the difference between the conditions of the left and right apertures with the gain adjustment amount.

[0100] 4B relates to a configuration of the data processing unit 210. The data processing unit 210A of this example is an example of the data processing unit 210, and includes an image processing unit 211. The image processing unit 211 functions as a processor that executes a first process, and is configured to adjust the brightness of at least one of the left eye video data and the right eye video data in order to compensate for a difference between the brightness of the left eye video data and the brightness of the right eye video data.

[0101] Here, the amount of adjustment of the brightness of the video data is determined by the image processor 211 based on the amount of difference (difference, ratio, etc.) between the condition (dimension of the opening) of the left eye aperture 55L and the condition (dimension of the opening) of the right eye aperture 55R. In addition, the method of calculating the brightness of the video data (its frame) and the method of changing the brightness may be any known method.

[0102] A first example will be described. The image processing unit 211 of this example stores in advance a unit brightness adjustment amount corresponding to a unit difference amount between the conditions of the left and right apertures. The image processing unit 211 of this example receives the conditions of the left eye aperture 55L and the conditions of the right eye aperture 55R from the main control unit 201, obtains the difference amount between these conditions, divides the obtained difference amount by the unit difference amount, and can determine the brightness adjustment amount (a parameter in image processing for brightness adjustment) based on the quotient and the unit brightness adjustment amount.

[0103] A second example will be described. The image processing unit 211 of this example stores in advance information (correspondence information) that associates the difference between the conditions of the left and right apertures with the brightness adjustment amount. The image processing unit 211 of this example receives the conditions of the left eye aperture 55L and the right eye aperture 55R from the main control unit 201, finds the difference between these conditions, and can determine the brightness adjustment amount corresponding to the found difference amount by referring to the correspondence information. The correspondence information may be, for example, a table or a graph.

[0104] When the size of the opening of the left eye diaphragm 55L is smaller than the size of the opening of the right eye diaphragm 55R, the image processor 211 can execute, for example, image processing to increase the brightness of the left eye video data, image processing to decrease the brightness of the right eye video data, or both of these image processes. This can reduce the difference in brightness between the left and right video data caused by the difference in the aperture conditions between the left and right, and can, for example, make the brightness of the left and right video data equal.

[0105] Conversely, when the size of the opening of the left eye diaphragm 55L is larger than the size of the opening of the right eye diaphragm 55R, the image processor 211 can execute, for example, image processing to increase the brightness of the right eye video data, image processing to decrease the brightness of the left eye video data, or both of these image processes. This can reduce the difference in brightness between the left and right video data caused by the difference in the aperture conditions between the left and right, and can, for example, make the brightness of the left and right video data equal.

[0106] With such a function of the image processor 211, the ophthalmic observation device 1 can present not only a high-resolution image and an image with a deep depth of field in parallel, but also both images with the same brightness. Therefore, during ophthalmic surgery, the user can observe a first image with a wide range of focus with the left eye (or right eye), while observing an image with the same brightness as the first image and with a high resolution with the right eye (or left eye).

[0107] In some of the above examples, image processing for brightness adjustment is performed based on the difference between the conditions of the left and right apertures, but the processing executable by the ophthalmic observation device 1 is not limited to this. For example, the control unit 200 and the data processing unit 210 may be configured to execute, in cooperation with each other, the control of at least one of the left eye aperture 55L and the right eye aperture 55R by the main control unit 201 and the image processing of at least one of the left eye video data and the right eye video data by the image processing unit 211, by referring to information (correspondence information) that associates the difference amount between the conditions of the left and right apertures with the brightness adjustment amount (parameter in image processing).

[0108] The ophthalmologic observation device 1 in some aspects may be configured to be able to execute a second process in addition to the first process described above. The second process is a process aimed at satisfying a second condition for the brightness of the left and right image data, and includes at least one of control of the surgical microscope 10 and image processing for at least one of the left and right image data. The processing items executed in the second process may be the same as or different from the processing items in the first process. For example, when the processing item in the first process is gain adjustment, the processing item in the second process may be any of gain adjustment, brightness adjustment (image processing), other processing items, and any combination of these. Also, when the processing item in the first process is brightness adjustment (image processing), the processing item in the second process may be any of brightness adjustment, gain adjustment, other processing items, and any combination of these. Also, when the processing item in the first process is neither gain adjustment nor brightness adjustment (image processing), the processing item in the second process may be any of gain adjustment, brightness adjustment, other processing items, and any combination of these.

[0109] A specific example of the second process will be described. The second process of this example aims to make the brightness of both the left and right image data equal to or greater than a predetermined threshold. The image sensor control unit 203 of this example may be configured to perform at least one of gain adjustment (gain increase) of the image sensor 62L of the left-eye observation optical system 40L and gain adjustment (gain increase) of the image sensor 62R of the right-eye observation optical system 40R so that the brightness of the left-eye image data and the brightness of the right-eye image data are each equal to or greater than a threshold. The image processing unit 211 of this example may be configured to perform at least one of image processing for the left-eye image data and image processing for the right-eye image data so that the brightness of the left-eye image data and the brightness of the right-eye image data are each equal to or greater than a threshold.

[0110] By executing such a second process, it becomes possible to present an image with sufficient brightness (that is, an image with sufficient resolution) to both eyes of the user.

[0111] <Operation / Usage form> A description will now be given of the operation and usage of the ophthalmic observation device 1. An example of the operation and usage of the ophthalmic observation device 1 is shown in FIG.

[0112] In this example, a case will be described in which a difference in a predetermined parameter (brightness) between left and right image data caused by a difference in a predetermined shooting condition (aperture condition (depth of focus, depth of field)) between the left and right shooting systems of a digital binocular surgical microscope is compensated for. However, even in the case of application to an ophthalmic observation device other than a surgical microscope, when a shooting condition other than the aperture condition is considered, when a condition other than the shooting condition is considered, when an image parameter other than brightness is considered, and so on, it is possible to implement substantially the same operation and usage form as this example, except for differences related to the inherent characteristics of the applied ophthalmic observation device and the inherent characteristics of the matters considered.

[0113] (S1: Start generating and displaying live images) First, the user performs a predetermined operation using the operation device 2 to start generating and displaying a live image of the subject's eye (anterior eye) by the ophthalmic observation device 1. Specifically, the surgical microscope 10 generates left-eye image data and right-eye image data by the left-eye observation optical system 40L and the right-eye observation optical system 40R while illuminating the subject's eye with the illumination optical system 30. The main control unit 201 causes the display device 3 to display in real time a left-eye image based on the left-eye image data and a right-eye image based on the right-eye image data. The user can perform surgery while observing the left and right live images.

[0114] (S2: Different aperture conditions for left and right) Next, the user (surgeon, assistant, etc.) operates the operation device 2 to change the conditions (opening dimensions) of the left eye aperture 55L and the conditions (opening dimensions) of the right eye aperture 55R. As a result, left eye image data and right eye image data having different depths of field and brightness are generated by the surgical microscope 10, and the left eye image and right eye image having different depths of field and brightness are displayed on the display device 3.

[0115] (S3: Perform the first process) In response to the operation of step S2, the processor of the ophthalmologic observation device 1 executes a first process to compensate for the difference in brightness between the left-eye image and the right-eye image.

[0116] When the image sensor control unit 203 functions as a processor, the main control unit 201 sends an instruction to the image sensor control unit 203 in response to the operation of step S2. The image sensor control unit 203 that receives the instruction executes at least one of the control of the gain of the image sensor 62L of the left-eye observation optical system 40L and the control of the gain of the image sensor 62R of the right-eye observation optical system 40R in order to compensate for the difference in brightness between the left-eye image and the right-eye image. The gain control (gain adjustment) is executed in the manner described above. When the gain control is executed, the brightness of the left-eye image data output from the image sensor 62L and the brightness of the right-eye image data output from the image sensor 62R become equal. As a result, the left-eye image and the right-eye image that have the same brightness but different in-focus ranges are provided to the user.

[0117] When the image processing unit 211 functions as a processor, the main control unit 201 sends an instruction to the image processing unit 211 in response to the operation of step S2. Upon receiving the instruction, the image processing unit 211 starts at least one of image processing (brightness adjustment) for the left-eye image data obtained by the imaging element 62L of the left-eye observation optical system 40L and image processing (brightness adjustment) for the right-eye image data obtained by the imaging element 62R of the right-eye observation optical system 40R in order to compensate for the difference in brightness between the left-eye image and the right-eye image. As a result, the image processing unit 211 executes at least one of image processing for each of the left-eye frames sequentially output from the imaging element 62L and image processing for each of the right-eye frames sequentially output from the imaging element 62R. The image processing is executed in the manner described above. When the application of the image processing is started, the brightness of each of the left-eye image data and the right-eye image data provided to the display device 3 becomes equal. This allows the user to be provided with left-eye and right-eye images that have the same brightness but different in-focus ranges.

[0118] (S4: Continue generating and displaying live images) The ophthalmic observation device 1 continues to generate left eye image data and right eye image data using the surgical microscope 10, and continues to display the left eye image and right eye image achieved in step S3, i.e., the left eye image and right eye image having the same brightness but different in-focus ranges (end).

[0119] The user can perform fine adjustments of brightness, aperture conditions, and other fine adjustments using the operation device 2. The surgeon can perform surgery while observing the left eye image and the right eye image adjusted in a desired manner.

[0120] According to the operation and usage of this example, when the aperture conditions are different between the left and right in the digital binocular surgical microscope, the gain of one or both of the left and right image pickup elements can be adjusted, and the brightness of one or both of the left and right image data can be adjusted. By such linked operation (linkage between aperture adjustment and gain adjustment, linkage between aperture adjustment and brightness adjustment, linkage between aperture adjustment and gain adjustment and brightness adjustment), for example, when the aperture of one of the left and right shooting systems is contracted, the gain of the image pickup element of the shooting system whose aperture is contracted is increased, or the brightness of the image data is increased, thereby compensating for the decrease in brightness of the image data obtained by this shooting system, and the brightness of the left and right images can be balanced. This makes it possible to present an image with priority given to resolution and an image with priority given to the range in focus in parallel while making the brightness of each image equal. According to this example, the observation method of different conditions of the left and right optical systems, which was performed using a conventional eyepiece type (non-digital) binocular ophthalmic observation device, can also be performed with a digital ophthalmic observation device.

[0121] <Modification> Several variations of the above embodiment will now be described.

[0122] In the above embodiment, the gain adjustment corresponding to the difference between the left and right aperture conditions is performed automatically, but it may be performed manually. For example, the main control unit 201 can display information for prompting the user to perform the gain adjustment, the amount of gain adjustment, etc. on the display device 3 in response to the difference between the left and right aperture conditions.

[0123] Although the above-mentioned embodiment compensates for the difference in brightness between the left and right images caused by the difference in the conditions of the left and right apertures, the cause of the difference in brightness between the left and right images is not limited to the difference in the conditions of the left and right apertures. For example, in the above-mentioned coaxial illumination, it is necessary to precisely position the optical system with respect to the subject's eye, and it is known that even a slight change in the position of the optical system changes the brightness of the image (transillumination image). Therefore, when performing coaxial illumination with a digital binocular ophthalmic observation device, the brightness of the image for the left eye and the brightness of the image for the right eye may differ. Therefore, as in the above-mentioned embodiment, it is possible to make the brightness of the image for the left eye and the brightness of the image for the right eye equal by performing gain adjustment and image processing (brightness adjustment). In addition, the transillumination image is a reddish image, and the color of the image for the left eye and the color of the image for the right eye may differ. Therefore, similar to the case of equalizing brightness, it is possible to equalize the color of the image for the left eye and the color of the image for the right eye by performing processing (such as image processing) to equalize the parameters related to the color of the image (tone parameters, color temperature parameters, RGB balance parameters, etc.).

[0124] The present disclosure is merely an example of an embodiment, and any modifications, omissions, additions, substitutions, and the like can be made within the scope of the present disclosure and its equivalents. [Explanation of symbols]

[0125] 1 Ophthalmic observation device 2 Control device 3 Display device 10 Surgical microscope 30 Illumination optical system 40L Left eye observation optical system 40R Right eye observation optical system 62L, 62R image sensor 200 Control section 201 Main control unit 203 Image sensor control unit 210 Data Processing Unit 211 Image processing section

Claims

1. A microscope including a pair of imaging systems each including an image sensor and an aperture for adjusting the amount of light guided to the image sensor, and acquiring a pair of image data having different brightnesses by photographing a subject's eye under different aperture conditions using the pair of imaging systems; a processor that executes a first process including at least one of controlling the microscope and image processing on at least one of the pair of image data so that the brightness of the pair of image data satisfies a first condition; a display control unit that causes a display device to display a pair of images based on the pair of image data obtained through the first processing; Including, the processor executes the first processing so as to compensate for a difference in brightness between the pair of images caused by a difference in the aperture condition between the pair of shooting systems. Ophthalmic observation equipment.

2. The processor controls a gain of the image sensor of at least one of the pair of imaging systems to compensate for the difference in brightness.

2. An ophthalmologic observation device according to claim 1.

3. the processor adjusts a brightness of at least one of the pair of image data to compensate for the brightness difference.

3. An ophthalmologic observation device according to claim 1 or 2.

4. the processor executes a second process including at least one of controlling the microscope and image processing on at least one of the pair of image data so that the brightness of the pair of images further satisfies a second condition. An ophthalmologic observation device according to any one of claims 1 to 3.

5. the processor executes the second process so that the brightness of both of the pair of images is equal to or greater than a predetermined threshold.

5. An ophthalmologic observation device according to claim 4.

Citation Information

Patent Citations

  • 3D image file, imaging apparatus, image reproducing apparatus, and image processing apparatus

    JP2007028295A

  • Ophthalmic microscope system

    JP2017012430A

  • Ophthalmic operation apparatus and ophthalmic photographic apparatus

    JP2019162336A

  • Control device, ophthalmic microscope system, ophthalmic microscope, and image processing device

    JP2020130607A

  • Ophthalmologic apparatus and method for controlling the same

    US20140146287A1