Slit Lamp Microscope
The slit lamp microscope system addresses the complexity and skill requirements of traditional slit lamp microscopy by using a configuration that satisfies the Scheimpflug condition and includes artifact detection, enabling high-quality remote examinations and reducing the need for specialized personnel.
Patent Information
- Application Number
- JP2024002303
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2024-01-11
- Publication Date
- 2024-12-27
- Estimated Expiration
- 2038-06-13
AI Technical Summary
Existing slit lamp microscopes require complex and skilled operations for obtaining high-quality images, which are difficult to perform remotely, leading to suboptimal examinations and a shortage of qualified personnel for high-quality inspections.
A slit lamp microscope system that includes an illumination system, optical system, imaging system, and movement mechanism, configured to satisfy the Scheimpflug condition, allowing for parallel imaging and artifact detection and removal, and capable of constructing three-dimensional images of the anterior segment of the eye.
Enables high-quality slit lamp microscopy that can be performed remotely with reduced operational complexity, overcoming the need for specialized technicians and providing wide access to accurate eye examinations.
Smart Images

Figure 0007607809000001 
Figure 0007607809000002 
Figure 0007607809000003
Abstract
Description
[Technical field]
[0001] The present invention relates to a slit lamp microscope. [Background technology]
[0002] Diagnostic imaging plays an important role in the field of ophthalmology. Various types of ophthalmic imaging devices are used for diagnostic imaging. Ophthalmic imaging devices include slit lamp microscopes, fundus cameras, scanning laser ophthalmoscopes (SLO), and optical coherence tomography (OCT). In addition, various examination and measurement devices such as refractometers, keratometers, tonometers, specular microscopes, wavefront analyzers, and microperimeters are also equipped with the function of photographing the anterior segment and fundus.
[0003] Among these various ophthalmic devices, one of the most widely and frequently used is the slit lamp microscope, which is an ophthalmic device for illuminating the subject's eye with a slit light and observing and photographing the illuminated cross-section from the side using a microscope (see, for example, Patent Documents 1 and 2).
[0004] Slit lamp microscopes are generally used for observing and diagnosing the anterior eye, such as the cornea and crystalline lens. For example, doctors observe the entire diagnostic area while moving the illumination field and focus position using slit light to determine whether there is an abnormality. Slit lamp microscopes are also used in prescribing vision correction devices, such as checking the fitting status of contact lenses. Furthermore, slit lamp microscopes are also used by people with qualifications other than doctors, such as optometrists, and clerks at eyeglass stores, for the purpose of screening for eye diseases, etc.
[0005] Meanwhile, with the recent progress in information and communication technology, research and development on telemedicine technology is progressing. Telemedicine is the act of providing medical treatment to patients in remote locations using information technology such as the Internet. Patent documents 3 and 4 disclose technologies for operating a slit lamp microscope from a remote location.
[0006] However, to obtain good images using a slit lamp, delicate and complicated operations such as adjusting the illumination angle and the imaging angle are required. In the technologies disclosed in Patent Documents 3 and 4, an examiner in a remote location must perform difficult operations even when observing the eye of a subject who is right in front of him, which results in problems such as a long examination time and failure to obtain good images.
[0007] Furthermore, as mentioned above, slit lamp microscopes are effective for screening and other examinations, but there is a shortage of people with the specialized skills to use the device, meaning that high-quality examinations cannot be provided to many people. [Prior art documents] [Patent documents]
[0008] [Patent Document 1] JP 2016-159073 A [Patent Document 2] JP 2016-179004 A [Patent Document 3] JP 2000-116732 A [Patent Document 4] JP 2008-284273 A Summary of the Invention [Problem to be solved by the invention]
[0009] It is an object of the present invention to make high quality slit lamp microscopy widely available. [Means for solving the problem]
[0010] A first aspect of an exemplary embodiment is a slit lamp microscope including an illumination system that irradiates a slit light onto an anterior segment of a test eye, an imaging system including an optical system that guides light from the anterior segment irradiated by the slit light and an imaging element that receives the light guided by the optical system at an imaging surface, and a moving mechanism that moves the illumination system and the imaging system, wherein an object surface along the optical axis of the illumination system, the optical system, and the imaging surface satisfy the Scheimpflug condition, and the imaging system obtains multiple images of the anterior segment by repeatedly photographing in parallel with the movement of the illumination system and the imaging system by the moving mechanism.
[0011] A second aspect of an exemplary embodiment is a slit lamp microscope of the first aspect, wherein the imaging system includes a first optical system that guides light from the anterior segment of the eye where the slit light is irradiated, and a first imaging element that receives the light guided by the first optical system at a first imaging surface, and obtains a first group of images by repeatedly photographing in parallel with the movement, and a second imaging system that includes a second optical system that guides light from the anterior segment of the eye where the slit light is irradiated, and a second imaging element that receives the light guided by the second optical system at a second imaging surface, and obtains a second group of images by repeatedly photographing in parallel with the movement, wherein the optical axis of the first optical system and the optical axis of the second optical system are arranged in different directions from each other, the object surface, the first optical system, and the first imaging surface satisfy the Scheimpflug condition, and the object surface, the second optical system, and the second imaging surface satisfy the Scheimpflug condition.
[0012] A third aspect of an exemplary embodiment is a slit lamp microscope of the second aspect, characterized in that the optical axis of the first optical system and the optical axis of the second optical system are arranged to be inclined in opposite directions relative to the optical axis of the illumination system, and the microscope further includes an image selection unit that determines whether an artifact is included in either of two images acquired substantially simultaneously by the first imaging system and the second imaging system, and selects the other image when it is determined that an artifact is included in one of the two images.
[0013] A fourth aspect of an exemplary embodiment is a slit lamp microscope of the third aspect, further comprising a three-dimensional image construction unit that constructs a three-dimensional image based on an image group including images selected from the first image group and the second image group by the image selection unit.
[0014] A fifth aspect of an exemplary embodiment is a slit lamp microscope of the second aspect, further comprising an artifact removal unit that determines whether an artifact is included in either of the two images acquired substantially simultaneously by the first imaging system and the second imaging system by comparing the two images, and removes the artifact when it is determined that an artifact is included in either of the two images.
[0015] A sixth aspect of the exemplary embodiment is a slit lamp microscope of the fifth aspect, further comprising a three-dimensional image construction unit that constructs a three-dimensional image based on a group of images including images in which artifacts have been removed by the artifact removal unit.
[0016] A seventh aspect of an exemplary embodiment is a slit lamp microscope of the first aspect, characterized in that it further includes a three-dimensional image construction unit that constructs a three-dimensional image based on the multiple images acquired by the imaging system.
[0017] An eighth aspect of an exemplary embodiment is a slit lamp microscope of any of the fourth, sixth and seventh aspects, characterized in that the moving mechanism includes a rotation mechanism that rotates the illumination system and the imaging system together around the optical axis of the illumination system as a rotation axis, and when the illumination system and the imaging system are positioned at a first rotation position, the imaging system acquires the multiple images, and when the illumination system and the imaging system are positioned at a second rotation position different from the first rotation position, the imaging system acquires an image of the anterior segment where slit light is irradiated by the illumination system, and the three-dimensional image construction unit includes an image position determination unit that determines the relative positions of the multiple images based on the images acquired at the second rotation position.
[0018] A ninth aspect of an exemplary embodiment is a slit lamp microscope of any of the fourth, sixth to eighth aspects, characterized in that the three-dimensional image construction unit includes an image area extraction unit that extracts an image area corresponding to the irradiation area of the slit light from each of the plurality of images, and an image synthesis unit that synthesizes the plurality of image areas extracted from each of the plurality of images by the image area extraction unit to construct a three-dimensional image.
[0019] A tenth aspect of an exemplary embodiment is a slit lamp microscope of the ninth aspect, characterized in that the image area extraction unit extracts an image area corresponding to both the irradiation area of the slit light and a specified portion of the anterior eye from each of the multiple images.
[0020] An eleventh aspect of the exemplary embodiment is the slit lamp microscope of the tenth aspect, characterized in that the predetermined area is an area defined by the anterior surface of the cornea and the posterior surface of the lens.
[0021] A twelfth aspect of an exemplary embodiment is a slit lamp microscope of any of the fourth, sixth to eleventh aspects, characterized in that it further includes a rendering unit that renders the three-dimensional image to construct a rendered image.
[0022] A thirteenth aspect of an exemplary embodiment is a slit lamp microscope of the twelfth aspect, characterized in that when a cross section is specified for the three-dimensional image, the rendering unit cuts the three-dimensional image at the cross section to construct a three-dimensional partial image.
[0023] A fourteenth aspect of an exemplary embodiment is a slit lamp microscope of the twelfth aspect, characterized in that when a cross section is specified for the three-dimensional image, the rendering unit constructs a two-dimensional cross-sectional image representing that cross section.
[0024] A fifteenth aspect of an exemplary embodiment is a slit lamp microscope of the twelfth aspect, characterized in that when a slice is specified for the three-dimensional image, the rendering unit constructs a three-dimensional slice image corresponding to the slice.
[0025] A sixteenth aspect of an exemplary embodiment is a slit lamp microscope of any of the first to fifteenth aspects, characterized in that it further includes a distortion correction unit that applies processing to at least one of the multiple images to correct distortion caused by an optical axis angle, which is the angle between the optical axis of the illumination system and the optical axis of the imaging system.
[0026] A 17th aspect of an exemplary embodiment is a slit lamp microscope of the 16th aspect, characterized in that the optical axis of the optical system included in the imaging system is tilted relative to the optical axis of the illumination system in a third direction perpendicular to both a first direction along the optical axis of the illumination system and a second direction along the longitudinal direction of the slit light, and the distortion correction unit performs processing to correct distortion in a plane including both the first direction and the second direction.
[0027] An 18th aspect of an exemplary embodiment is a slit lamp microscope of the 16th or 17th aspect, characterized in that the distortion correction unit pre-stores a correction coefficient set based on a predetermined reference angle and the optical axis angle, and executes processing to correct the distortion based on the correction coefficient.
[0028] A 19th aspect of an exemplary embodiment is a slit lamp microscope of any of the 1st to 18th aspects, characterized in that it further includes a first measurement unit that determines a predetermined measurement value by analyzing at least one of the multiple images acquired by the imaging system.
[0029] A twentieth aspect of an exemplary embodiment is a slit lamp microscope of any of the fourth, sixth to fifteenth aspects, characterized in that it further includes a second measurement unit that determines a predetermined measurement value by analyzing the three-dimensional image constructed by the three-dimensional image construction unit.
[0030] A twenty-first aspect of an exemplary embodiment is a slit lamp microscope of any of the first to twentieth aspects, characterized in that the illumination system and the imaging system are configured so that the imaging system is focused on at least an area defined by the anterior surface of the cornea and the posterior surface of the lens.
[0031] A 22nd aspect of an exemplary embodiment is a slit lamp microscope of any of the 1st to 21st aspects, characterized in that the illumination system irradiates the anterior segment with slit light whose longitudinal direction is in the body axis direction of the subject, and the moving mechanism moves the illumination system and the imaging system in a direction perpendicular to the body axis direction.
[0032] A 23rd aspect of an exemplary embodiment is a slit lamp microscope of the 22nd aspect, characterized in that the length of the slit light is greater than or equal to the corneal diameter in the body axis direction, and the distance moved by the moving mechanism of the illumination system and the imaging system is greater than or equal to the corneal diameter in a direction perpendicular to the body axis direction.
[0033] A 24th aspect of an exemplary embodiment is a slit lamp microscope of any of the 1st to 23rd aspects, characterized in that the optical system included in the shooting system includes a reflector that reflects light from the anterior segment of the eye irradiated with the slit light, traveling in a direction away from the optical axis of the illumination system, in a direction approaching the optical axis of the illumination system, and one or more lenses that form an image of the light reflected by the reflector on the imaging plane.
[0034] A 25th aspect of an exemplary embodiment is a slit lamp microscope of any of the 1st to 24th aspects, characterized in that it further includes a video capture system that captures video of the anterior segment from a fixed position in parallel with the acquisition of the multiple images by the capture system.
[0035] A 26th aspect of an exemplary embodiment is a slit lamp microscope of the 25th aspect, characterized in that it further includes a motion detection unit that analyzes moving images acquired by the video recording system to detect movement of the test eye.
[0036] A 27th aspect of an exemplary embodiment is a slit lamp microscope of the 26th aspect, characterized in that it further includes a movement control unit that controls the movement mechanism based on an output from the movement detection unit.
[0037] A 28th aspect of an exemplary embodiment is a slit lamp microscope of any of the 1st to 27th aspects, characterized in that it further includes a communication unit that transmits images acquired of the anterior segment to an information processing device.
[0038] A twenty-ninth aspect of the exemplary embodiment is an ophthalmologic system including a slit lamp microscope and an information processing device connected to the slit lamp microscope via a communication line and processing an image of an anterior segment of a subject's eye acquired by the slit lamp microscope. The slit lamp microscope includes an illumination system that irradiates a slit light onto an anterior segment of the subject's eye, an imaging system including an optical system that guides light from the anterior segment irradiated with the slit light and an imaging element that receives the light guided by the optical system at an imaging surface, and a moving mechanism that moves the illumination system and the imaging system. An object surface along the optical axis of the illumination system, the optical system, and the imaging surface satisfy the Scheimpflug condition. The imaging system acquires a plurality of images of the anterior segment by repeatedly photographing in parallel with the movement of the illumination system and the imaging system by the moving mechanism.
[0039] A 30th aspect of an exemplary embodiment is an ophthalmologic system of the 29th aspect, wherein the imaging system of the slit lamp microscope includes a first optical system that guides light from the anterior segment of the eye where the slit light is irradiated, and a first imaging element that receives the light guided by the first optical system at a first imaging surface, and obtains a first group of images by repeatedly capturing images in parallel with the movement, and a second imaging system that includes a second optical system that guides light from the anterior segment of the eye where the slit light is irradiated, and a second imaging element that receives the light guided by the second optical system at a second imaging surface, and obtains a second group of images by repeatedly capturing images in parallel with the movement, wherein the optical axis of the first optical system and the optical axis of the second optical system are arranged in different directions from each other, the object surface, the first optical system, and the first imaging surface satisfy the Scheimpflug condition, and the object surface, the second optical system, and the second imaging surface satisfy the Scheimpflug condition.
[0040] A 31st aspect of an exemplary embodiment is an ophthalmic system of the 30th aspect, wherein the optical axis of the first optical system and the optical axis of the second optical system are arranged at an inclination in opposite directions relative to the optical axis of the illumination system, and the information processing device includes an image selection unit that determines whether either of two images acquired substantially simultaneously by the first imaging system and the second imaging system contains an artifact, and selects the other image when it is determined that one of the two images contains an artifact.
[0041] A 32nd aspect of an exemplary embodiment is an ophthalmologic system of the 31st aspect, characterized in that the information processing device includes a 3D image construction unit that constructs a 3D image based on an image group including images selected from the first image group and the second image group by the image selection unit.
[0042] A 33rd aspect of an exemplary embodiment is an ophthalmologic system of the 30th aspect, characterized in that the information processing device includes an artifact removal unit that determines whether either of the two images contains an artifact by comparing two images acquired substantially simultaneously by the first imaging system and the second imaging system, and removes the artifact when it is determined that either of the two images contains an artifact.
[0043] A 34th aspect of an exemplary embodiment is an ophthalmologic system of the 33rd aspect, characterized in that the information processing device includes a 3D image construction unit that constructs a 3D image based on a group of images including images from which artifacts have been removed by the artifact removal unit.
[0044] A 35th aspect of an exemplary embodiment is an ophthalmologic system of the 29th aspect, characterized in that the information processing device includes a 3D image construction unit that constructs a 3D image based on the multiple images acquired by the shooting system.
[0045] A 36th aspect of an exemplary embodiment is an ophthalmic system of any of the 32nd, 34th and 35th aspects, characterized in that the moving mechanism includes a rotation mechanism that rotates the illumination system and the imaging system together around the optical axis of the illumination system as a rotation axis, and when the illumination system and the imaging system are positioned at a first rotation position, the imaging system acquires the multiple images, and when the illumination system and the imaging system are positioned at a second rotation position different from the first rotation position, the imaging system acquires an image of the anterior segment where slit light is irradiated by the illumination system, and the three-dimensional image construction unit includes an image position determination unit that determines the relative positions of the multiple images based on the images acquired at the second rotation position.
[0046] A 37th aspect of an exemplary embodiment is an ophthalmologic system of any of the 32nd, 34th to 36th aspects, characterized in that the 3D image construction unit includes an image area extraction unit that extracts an image area corresponding to the irradiation area of the slit light from each of the multiple images, and an image synthesis unit that synthesizes the multiple image areas extracted from the multiple images by the image area extraction unit to construct a 3D image.
[0047] A 38th aspect of an exemplary embodiment is an ophthalmic system of the 37th aspect, characterized in that the image area extraction unit extracts an image area corresponding to both the irradiation area of the slit light and a specified portion of the anterior eye from each of the multiple images.
[0048] A thirty-ninth aspect of the exemplary embodiment is the ophthalmic system of the thirty-eighth aspect, characterized in that the predetermined area is an area defined by an anterior surface of the cornea and a posterior surface of the lens.
[0049] A fortieth aspect of an exemplary embodiment is an ophthalmologic system of any of the thirty-second, thirty-fourth to thirty-ninth aspects, characterized in that the information processing device includes a rendering unit that renders the three-dimensional image to construct a rendering image.
[0050] A forty-first aspect of an exemplary embodiment is an ophthalmology system of the fortieth aspect, characterized in that, when a cross section is specified for the three-dimensional image, the rendering unit cuts the three-dimensional image at the cross section to construct a three-dimensional partial image.
[0051] A forty-second aspect of an exemplary embodiment is an ophthalmic system of the fortieth aspect, characterized in that when a cross section is specified for the three-dimensional image, the rendering unit constructs a two-dimensional cross-sectional image representing the cross section.
[0052] A forty-third aspect of an exemplary embodiment is an ophthalmology system of the fortieth aspect, characterized in that when a slice is specified for the three-dimensional image, the rendering unit constructs a three-dimensional slice image corresponding to the slice.
[0053] A 44th aspect of an exemplary embodiment is an ophthalmologic system of any of the 29th to 43rd aspects, characterized in that the information processing device includes a distortion correction unit that applies processing to at least one of the multiple images to correct distortion caused by an optical axis angle, which is the angle between the optical axis of the illumination system and the optical axis of the shooting system.
[0054] A 45th aspect of an exemplary embodiment is an ophthalmic system of the 44th aspect, characterized in that the optical axis of the optical system included in the imaging system is inclined relative to the optical axis of the illumination system in a third direction perpendicular to both a first direction along the optical axis of the illumination system and a second direction along the longitudinal direction of the slit light, and the distortion correction unit performs processing to correct distortion in a plane including both the first direction and the second direction.
[0055] A 46th aspect of an exemplary embodiment is an ophthalmologic system of the 44th or 45th aspect, characterized in that the distortion correction unit pre-stores a correction coefficient set based on a predetermined reference angle and the optical axis angle, and executes processing to correct the distortion based on the correction coefficient.
[0056] A 47th aspect of an exemplary embodiment is an ophthalmologic system of any of the 29th to 46th aspects, characterized in that the information processing device includes a first measurement unit that determines a predetermined measurement value by analyzing at least one of the multiple images acquired by the imaging system.
[0057] A 48th aspect of an exemplary embodiment is an ophthalmologic system of any of aspects 32, 34 to 43, characterized in that the information processing device includes a second measurement unit that determines a predetermined measurement value by analyzing the three-dimensional image constructed by the three-dimensional image construction unit.
[0058] A forty-ninth aspect of an exemplary embodiment is an ophthalmic system of any of the twenty-ninth to forty-eighth aspects, characterized in that the illumination system and the imaging system are configured so that the imaging system is focused on an area defined by at least the anterior surface of the cornea and the posterior surface of the lens.
[0059] A 50th aspect of an exemplary embodiment is an ophthalmic system of any of the 29th to 49th aspects, characterized in that the illumination system irradiates the anterior segment with a slit light whose longitudinal direction is in the body axis direction of the subject, and the moving mechanism moves the illumination system and the imaging system in a direction perpendicular to the body axis direction.
[0060] A 51st aspect of an exemplary embodiment is an ophthalmic system of the 50th aspect, characterized in that the length of the slit light is greater than or equal to the corneal diameter in the body axis direction, and the movement distance of the illumination system and the imaging system by the movement mechanism is greater than or equal to the corneal diameter in a direction perpendicular to the body axis direction.
[0061] A 52nd aspect of an exemplary embodiment is an ophthalmic system of any of the 29th to 51st aspects, characterized in that the optical system included in the imaging system includes a reflector that reflects light from the anterior segment of the eye to which the slit light is irradiated, traveling in a direction away from the optical axis of the illumination system, in a direction approaching the optical axis of the illumination system, and one or more lenses that form an image of the light reflected by the reflector on the imaging surface.
[0062] A 53rd aspect of an exemplary embodiment is an ophthalmic system of any of the 29th to 52nd aspects, characterized in that the slit lamp microscope includes a video capture system that captures video of the anterior segment from a fixed position in parallel with the acquisition of the multiple images by the capture system.
[0063] A 54th aspect of an exemplary embodiment is an ophthalmic system of the 53rd aspect, characterized in that the slit lamp microscope includes a motion detection unit that analyzes moving images acquired by the video recording system to detect movement of the test eye.
[0064] A 55th aspect of an exemplary embodiment is an ophthalmic system of the 54th aspect, characterized in that the slit lamp microscope includes a movement control unit that controls the movement mechanism based on output from the movement detection unit. Effect of the Invention
[0065] Exemplary embodiments facilitate widespread availability of high quality slit lamp microscopy. [Brief description of the drawings]
[0066] [Figure 1] FIG. 1 is a schematic diagram illustrating a configuration of a slit lamp microscope according to an exemplary embodiment. [Figure 2A] FIG. 2 is a schematic diagram for explaining the operation of a slit lamp microscope according to an exemplary embodiment. [Figure 2B] FIG. 2 is a schematic diagram for explaining the operation of a slit lamp microscope according to an exemplary embodiment. [Diagram 3] FIG. 2 is a schematic diagram for explaining the operation of a slit lamp microscope according to an exemplary embodiment. [Figure 4] 1 is a flow chart illustrating use of a slit lamp microscope according to an exemplary embodiment. [Diagram 5] FIG. 1 is a schematic diagram illustrating a configuration of a slit lamp microscope according to an exemplary embodiment. [Figure 6] FIG. 1 is a schematic diagram illustrating a variation of the configuration of a slit lamp microscope according to an exemplary embodiment. [Figure 7] FIG. 1 is a schematic diagram illustrating a configuration of a slit lamp microscope according to an exemplary embodiment. [Figure 8] FIG. 2 is a schematic diagram for explaining the operation of a slit lamp microscope according to an exemplary embodiment. [Figure 9] FIG. 1 is a schematic diagram illustrating a configuration of a slit lamp microscope according to an exemplary embodiment. [Figure 10] FIG. 1 is a schematic diagram illustrating a configuration of a slit lamp microscope according to an exemplary embodiment. [Figure 11] FIG. 1 is a schematic diagram illustrating a configuration of a slit lamp microscope according to an exemplary embodiment. [Figure 12] FIG. 2 is a schematic diagram for explaining the operation of a slit lamp microscope according to an exemplary embodiment. [Figure 13] FIG. 1 is a schematic diagram illustrating a configuration of a slit lamp microscope according to an exemplary embodiment. [Figure 14] FIG. 1 is a schematic diagram illustrating a configuration of a slit lamp microscope according to an exemplary embodiment. [Figure 15] FIG. 1 is a schematic diagram illustrating a configuration of a slit lamp microscope according to an exemplary embodiment. [Figure 16] FIG. 1 is a schematic diagram illustrating a configuration of a slit lamp microscope according to an exemplary embodiment. [Figure 17] FIG. 1 is a schematic diagram illustrating a configuration of a slit lamp microscope according to an exemplary embodiment. [Figure 18] FIG. 1 is a schematic diagram for explaining a mode of use of a slit lamp microscope according to an exemplary embodiment. [Figure 19A] FIG. 1 is a schematic diagram for explaining a mode of use of a slit lamp microscope according to an exemplary embodiment. [Figure 19B] FIG. 1 is a schematic diagram for explaining a mode of use of a slit lamp microscope according to an exemplary embodiment. [Figure 20] FIG. 1 is a diagram for explaining a usage pattern of a slit lamp microscope according to an exemplary embodiment. [Figure 21A] FIG. 1 is a schematic diagram for explaining a mode of use of a slit lamp microscope according to an exemplary embodiment. [Figure 21B] FIG. 1 is a schematic diagram for explaining a mode of use of a slit lamp microscope according to an exemplary embodiment. [Figure 22] FIG. 1 is a schematic diagram for explaining a mode of use of a slit lamp microscope according to an exemplary embodiment. [Diagram 23] FIG. 1 is a schematic diagram for explaining a mode of use of a slit lamp microscope according to an exemplary embodiment. [Figure 24] FIG. 1 is a schematic diagram for explaining a mode of use of a slit lamp microscope according to an exemplary embodiment. [Diagram 25] FIG. 1 is a schematic diagram for explaining a mode of use of a slit lamp microscope according to an exemplary embodiment. [Figure 26] FIG. 1 is a schematic diagram for explaining a mode of use of a slit lamp microscope according to an exemplary embodiment. [Figure 27] FIG. 1 is a schematic diagram for explaining a mode of use of a slit lamp microscope according to an exemplary embodiment. [Figure 28] FIG. 1 is a schematic diagram for explaining a mode of use of a slit lamp microscope according to an exemplary embodiment. [Figure 29] FIG. 1 is a schematic diagram for explaining a mode of use of a slit lamp microscope according to an exemplary embodiment. [Diagram 30] FIG. 1 is a schematic diagram illustrating a configuration of an ophthalmic system according to an exemplary embodiment. [Diagram 31] FIG. 1 is a schematic diagram illustrating a configuration of an ophthalmic system according to an exemplary embodiment. [Diagram 32] FIG. 1 is a schematic diagram illustrating a configuration of an ophthalmic system according to an exemplary embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0067] Exemplary embodiments will now be described in detail with reference to the drawings. Any known technology, such as those disclosed in documents cited in this specification, may be combined with the embodiments.
[0068] The slit lamp microscope according to the embodiment may be installed in, for example, an eyeglass store or a medical facility, or may be portable. The slit lamp microscope according to the embodiment is typically used in a situation or environment where a person with specialized skills related to the device is not nearby. The slit lamp microscope according to the embodiment may be used in a situation or environment where a person with specialized skills is nearby, or in a situation or environment where a person with specialized skills can monitor, give instructions, and operate the microscope from a remote location.
[0069] The ophthalmologic system according to the embodiment includes one or more slit lamp microscopes and one or more information processing devices, and can be used for, for example, remote medical care. The information processing device receives and processes images acquired by the slit lamp microscope. The information processing device may be capable of transmitting data to the slit lamp microscope or another information processing device. The information processing device may be used for, for example, image analysis, image processing, image interpretation, and the like.
[0070] When the ophthalmologic system of the embodiment is used for remote medical care, the image acquired by the slit lamp microscope is interpreted by a person at a remote location away from the facility where the slit lamp microscope is installed. The interpreter is typically a doctor who has specialized skills related to the slit lamp microscope. It is also possible to employ computer-assisted interpretation using information processing technology (e.g., artificial intelligence, image analysis, image processing).
[0071] Examples of facilities where slit lamp microscopes are installed include eyeglass stores, optometrists, medical institutions, health checkup locations, medical examination locations, patients' homes, welfare facilities, public facilities, and medical examination vehicles.
[0072] The slit lamp microscope according to the embodiment is an ophthalmic imaging device having at least a function as a slit lamp microscope, and may further include other imaging functions (modalities). Examples of other modalities include a fundus camera, SLO, and OCT. The slit lamp microscope according to the embodiment may further include a function for measuring characteristics of an eye to be examined. Examples of the measurement function include visual acuity measurement, refraction measurement, intraocular pressure measurement, corneal endothelial cell measurement, aberration measurement, and visual field measurement. The slit lamp microscope according to the embodiment may further include an application for analyzing captured images and measurement data. The slit lamp microscope according to the embodiment may further include a function for treatment or surgery. Examples of such a function include photocoagulation treatment and photodynamic therapy.
[0073] Various exemplary embodiments will be described below. Any two or more of these embodiments can be combined. In addition, any known modification (addition, substitution, etc.) can be applied to each of these embodiments or to a combination of two or more of these embodiments.
[0074] In the embodiments exemplified below, a "processor" refers to a circuit such as a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), an ASIC (Application Specific Integrated Circuit), a programmable logic device (e.g., a SPLD (Simple Programmable Logic Device), a CPLD (Complex Programmable Logic Device), or an FPGA (Field Programmable Gate Array)). The processor realizes the function according to the embodiment by, for example, reading and executing a program or data stored in a memory circuit or a storage device.
[0075] First Embodiment FIG. 1 shows an example of a slit lamp microscope according to the first embodiment.
[0076] The slit lamp microscope 1 is used to photograph the anterior segment of a subject's eye E, and includes an illumination system 2, an imaging system 3, a moving mechanism 6, a control unit 7, a data processing unit 8, and a communication unit 9. Note that the symbol C denotes the cornea, and the symbol CL denotes the crystalline lens.
[0077] The slit lamp microscope 1 may be a single device or a system including two or more devices. As an example of the latter, the slit lamp microscope 1 includes a main body device including an illumination system 2, an imaging system 3, and a moving mechanism 6, a computer including a control unit 7, a data processing unit 8, and a communication unit 9, and a communication device that handles communication between the main body device and the computer. The computer may be installed, for example, together with the main body device or on a network.
[0078] [Lighting system 2] The illumination system 2 irradiates slit light onto the anterior segment of the subject's eye E. Reference symbol 2a indicates the optical axis (illumination optical axis) of the illumination system 2. The illumination system 2 may have a configuration similar to that of an illumination system of a conventional slit lamp microscope. For example, although not shown, the illumination system 2 includes, in order from the side farthest from the subject's eye E, an illumination light source, a positive lens, a slit forming unit, and an objective lens.
[0079] The illumination light source outputs illumination light. The illumination system 2 may include a plurality of illumination light sources. For example, the illumination system 2 may include an illumination light source that outputs continuous light and an illumination light source that outputs flash light. The illumination system 2 may also include an illumination light source for the anterior segment and an illumination light source for the posterior segment. The illumination system 2 may also include two or more illumination light sources with different output wavelengths. A typical illumination system 2 includes a visible light source as an illumination light source. The illumination system 2 may also include an infrared light source. The illumination light output from the illumination light source passes through a positive lens and is projected onto the slit forming portion.
[0080] The slit forming section generates slit light by passing a portion of the illumination light. A typical slit forming section has a pair of slit blades. The width of the area (slit) through which the illumination light passes is changed by changing the interval (slit width) between these slit blades, thereby changing the width of the slit light. The slit forming section may be configured to be able to change the length of the slit light. The length of the slit light is the cross-sectional dimension of the slit light in a direction perpendicular to the cross-sectional width direction of the slit light corresponding to the slit width. The width and length of the slit light are typically expressed as the dimension of a projected image of the slit light onto the anterior segment of the eye.
[0081] The slit light generated by the slit forming unit is refracted by the objective lens and irradiated onto the anterior segment of the subject's eye E.
[0082] The illumination system 2 may further include a focusing mechanism for changing the focus position of the slit light. The focusing mechanism, for example, moves an objective lens along the illumination optical axis 2a. The movement of the objective lens can be performed automatically and / or manually. Note that a focusing lens may be disposed at a position on the illumination optical axis 2a between the objective lens and the slit forming part, and the focus position of the slit light may be changed by moving this focusing lens along the illumination optical axis 2a.
[0083] 1 is a top view, and as shown in the figure, in this embodiment, the direction along the axis of the subject's eye E is the Z direction, the direction perpendicular to the Z direction from left to right with respect to the subject is the X direction, and the direction perpendicular to both the X direction and the Z direction is the Y direction. Typically, the X direction is the arrangement direction of the left eye and the right eye, and the Y direction is the direction along the subject's body axis (body axis direction). In this embodiment, the slit lamp microscope 1 is aligned so that the illumination optical axis 2a coincides with the axis of the subject's eye E, or more broadly, so that the illumination optical axis 2a is arranged parallel to the axis of the subject's eye E. The alignment will be described later.
[0084] [Photography 3] The imaging system 3 images the anterior eye segment illuminated with the slit light from the illumination system 2. Reference numeral 3a denotes an optical axis (imaging optical axis) of the imaging system 3. The imaging system 3 of this embodiment includes an optical system 4 and an image sensor 5.
[0085] The optical system 4 guides light from the anterior segment of the subject's eye E, which is irradiated with the slit light, to the imaging element 5. The imaging element 5 receives the light guided by the optical system 4 on an imaging surface.
[0086] The light guided by the optical system 4 (i.e., light from the anterior segment of the subject's eye E) includes returned light of the slit light irradiated on the anterior segment, and may further include other light. Examples of returned light include reflected light, scattered light, and fluorescence. Examples of other light include light from the installation environment of the slit lamp microscope 1 (room light, sunlight, etc.). When an anterior segment illumination system for illuminating the entire anterior segment is provided separately from the illumination system 2, the returned light of this anterior segment illumination light may be included in the light guided by the optical system 4.
[0087] The imaging element 5 is an area sensor having a two-dimensional imaging area, and may be, for example, a charge-coupled device (CCD) image sensor or a complementary metal-oxide semiconductor (CMOS) image sensor.
[0088] The optical system 4 may have a configuration similar to that of the imaging system of a conventional slit lamp microscope. For example, the optical system 4 includes, in order from the side closer to the subject's eye E, an objective lens, a variable magnification optical system, and an imaging lens. Light from the anterior segment of the subject's eye E irradiated with the slit light passes through the objective lens and the variable magnification optical system, and is imaged on the imaging surface of the image sensor 5 by the imaging lens.
[0089] The imaging system 3 may include, for example, a first imaging system and a second imaging system. Typically, the first imaging system and the second imaging system have the same configuration. The case where the imaging system 3 includes the first imaging system and the second imaging system will be described in another embodiment.
[0090] The imaging system 3 may further include a focusing mechanism for changing the focus position. The focusing mechanism, for example, moves an objective lens along the imaging optical axis 3a. The movement of the objective lens can be performed automatically and / or manually. Note that a focusing lens may be disposed at a position on the imaging optical axis 3a between the objective lens and the imaging lens, and the focus position may be changed by moving this focusing lens along the imaging optical axis 3a.
[0091] The illumination system 2 and the photographing system 3 function as a Scheimpflug camera. That is, the illumination system 2 and the photographing system 3 are configured so that the object plane along the illumination optical axis 2a, the optical system 4, and the imaging plane of the image sensor 5 satisfy the so-called Scheimpflug condition. More specifically, the YZ plane (including the object plane) passing through the illumination optical axis 2a, the principal plane of the optical system 4, and the imaging plane of the image sensor 5 intersect on the same straight line. This allows photographing to be performed by focusing on all positions in the object plane (all positions in the direction along the illumination optical axis 2a).
[0092] In this embodiment, the illumination system 2 and the imaging system 3 are configured so that the imaging system 3 is focused on at least a region defined by the anterior surface of the cornea C and the posterior surface of the crystalline lens CL. In other words, imaging can be performed in a state in which the imaging system 3 is focused on the entire range from the apex (Z=Z1) of the anterior surface of the cornea C to the apex (Z=Z2) of the posterior surface of the crystalline lens CL shown in Fig. 1. Note that Z=Z0 indicates the Z coordinate of the intersection of the illumination optical axis 2a and the imaging optical axis 3a.
[0093] Such conditions are typically realized by the configuration and arrangement of elements included in the illumination system 2, the configuration and arrangement of elements included in the imaging system 3, and the relative positions of the illumination system 2 and the imaging system 3. The parameters indicating the relative positions of the illumination system 2 and the imaging system 3 include, for example, the angle θ between the illumination optical axis 2a and the imaging optical axis 3a. The angle θ is set to, for example, 17.5 degrees, 30 degrees, or 45 degrees. Note that the angle θ may be variable.
[0094] [Moving mechanism 6] The movement mechanism 6 moves the illumination system 2 and the imaging system 3. In this embodiment, the movement mechanism 6 moves the illumination system 2 and the imaging system 3 integrally in the X direction.
[0095] For example, the moving mechanism 6 includes a movable stage on which the illumination system 2 and the imaging system 3 are mounted, an actuator that operates according to a control signal input from the control unit 7, and a mechanism that moves the movable stage based on a driving force generated by the actuator. In another example, the moving mechanism 6 includes a movable stage on which the illumination system 2 and the imaging system 3 are mounted, and a mechanism that moves the movable stage based on a force applied to an operating device (not shown). The operating device is, for example, a lever. The movable stage is movable at least in the X direction, and may further be movable in the Y direction and / or Z direction.
[0096] [Control Unit 7] The control unit 7 controls each part of the slit lamp microscope 1. For example, the control unit 7 controls the elements of the illumination system 2 (illumination light source, slit forming unit, focusing mechanism, etc.), the elements of the imaging system 3 (focusing mechanism, image sensor, etc.), the movement mechanism 6, the data processing unit 8, the communication unit 9, etc. The control unit 7 may also be capable of executing control for changing the relative positions of the illumination system 2 and the imaging system 3.
[0097] The control unit 7 includes a processor, a main storage device, an auxiliary storage device, etc. The auxiliary storage device stores a control program, etc. The control program, etc. may be stored in a computer or storage device accessible to the slit lamp microscope 1. The functions of the control unit 7 are realized by cooperation between software such as the control program and hardware such as a processor.
[0098] In order to scan a three-dimensional area of the anterior segment of the subject's eye E with slit light, the control unit 7 can apply the following controls to the illumination system 2, the imaging system 3, and the moving mechanism 6.
[0099] First, the control unit 7 controls the moving mechanism 6 to place the illumination system 2 and the imaging system 3 at a predetermined scan start position (alignment control). The scan start position is, for example, a position corresponding to an end (first end) of the cornea C in the X direction, or a position further away from the axis of the subject's eye E. The symbol X0 in Fig. 2A indicates the scan start position corresponding to the first end of the cornea C in the X direction. Moreover, the symbol X0' in Fig. 2B indicates a scan start position further away from the axis EA of the subject's eye E than the position corresponding to the first end of the cornea C in the X direction.
[0100] The control unit 7 controls the illumination system 2 to start irradiating the anterior segment of the subject's eye E with slit light (slit light irradiation control). Note that the slit light irradiation control may be performed before or during the execution of the alignment control. The illumination system 2 typically irradiates continuous light as the slit light, but may irradiate intermittent light (pulsed light) as the slit light. Furthermore, the illumination system 2 typically irradiates visible light as the slit light, but may irradiate infrared light as the slit light.
[0101] The control unit 7 controls the imaging system 3 to start imaging of a moving image of the anterior segment of the subject's eye E (imaging control). Incidentally, the imaging control may be performed before or during the execution of the alignment control. Typically, the imaging control is performed simultaneously with or after the slit light irradiation control.
[0102] After performing the alignment control, the slit light irradiation control, and the photographing control, the control unit 7 controls the moving mechanism 6 to start moving the illumination system 2 and the photographing system 3 (movement control). The movement control moves the illumination system 2 and the photographing system 3 together. That is, the illumination system 2 and the photographing system 3 are moved while maintaining the relative position (angle θ, etc.) between the illumination system 2 and the photographing system 3. The illumination system 2 and the photographing system 3 are moved from the above-mentioned scan start position to a predetermined scan end position. The scan end position is, for example, a position corresponding to the end (second end) of the cornea C opposite to the first end in the X direction, similar to the scan start position, or a position further away from the axis of the subject's eye E. In such a case, the range from the scan start position to the scan end position is the scan range.
[0103] Typically, a slit light having the X direction as the width direction and the Y direction as the length direction is irradiated onto the anterior segment, and the illumination system 2 and the imaging system 3 are moved in the X direction, while the imaging system 3 captures a moving image.
[0104] Here, the length of the slit light (i.e., the dimension of the slit light in the Y direction) is set, for example, to be equal to or greater than the diameter of the cornea C on the surface of the subject's eye E. That is, the length of the slit light is set to be equal to or greater than the corneal diameter in the Y direction. Also, as described above, the movement distance of the illumination system 2 and the imaging system 3 by the movement mechanism 6 (i.e., the scanning range) is set to be equal to or greater than the corneal diameter in the X direction. This makes it possible to scan at least the entire cornea C with the slit light.
[0105] By such scanning, multiple anterior eye images with different irradiation positions of the slit light are obtained. In other words, a moving image is obtained that depicts the irradiation position of the slit light moving in the X direction. An example of such multiple anterior eye images (i.e., a group of frames constituting a moving image) is shown in FIG. 3.
[0106] FIG. 3 shows a plurality of anterior eye images (frame group) F1, F2, F3, . . . , FN. The subscript n of these anterior eye images Fn (n=1, 2, . . . , N) represents the time series order. That is, the anterior eye image acquired n-th is represented by the symbol Fn. The anterior eye image Fn includes a slit light irradiation area An. As shown in FIG. 3, the slit light irradiation areas A1, A2, A3, . . . , AN move rightward along the time series. In the example shown in FIG. 3, the scan start position and the scan end position correspond to both ends of the cornea C in the X direction. Note that the scan start position and / or the scan end position are not limited to this example, and may be, for example, a position farther from the axis of the subject's eye E than the edge of the cornea. In addition, the direction and number of scans can also be set arbitrarily.
[0107] [Data Processing Section 8] The data processing unit 8 executes various types of data processing. The data to be processed may be either data acquired by the slit lamp microscope 1 or data input from the outside. For example, the data processing unit 8 may process images acquired by the illumination system 2 and the imaging system 3. The configuration and functions of the data processing unit 8 will be described in other embodiments.
[0108] The data processing unit 8 includes a processor, a main storage device, an auxiliary storage device, etc. The auxiliary storage device stores a data processing program, etc. The data processing program, etc. may be stored in a computer or storage device accessible to the slit lamp microscope 1. The functions of the data processing unit 8 are realized by cooperation between software such as the data processing program and hardware such as a processor.
[0109] [Communications Section 9] The communication unit 9 performs data communication between the slit lamp microscope 1 and other devices. That is, the communication unit 9 transmits data to other devices and receives data transmitted from other devices.
[0110] The communication unit 9 may execute any data communication method. For example, the communication unit 9 includes one or more of various communication interfaces, such as a communication interface conforming to the Internet, a communication interface conforming to a dedicated line, a communication interface conforming to a LAN, a communication interface conforming to short-distance communication, etc. The data communication may be wired communication or wireless communication.
[0111] The data transmitted and received by the communication unit 9 may be encrypted. In that case, for example, the control unit 7 and / or the data processing unit 8 includes at least one of an encryption processing unit that encrypts the data transmitted by the communication unit 9 and a decryption processing unit that decrypts the data received by the communication unit 9.
[0112] [Other Elements] 1, the slit lamp microscope 1 may include a display device and an operating device. Alternatively, the display device and the operating device may be peripheral devices of the slit lamp microscope 1.
[0113] The display device displays various information under the control of the control unit 7. The display device may include a flat panel display such as a liquid crystal display (LCD).
[0114] The operation devices include devices for operating the slit lamp microscope 1 and devices for inputting information. The operation devices include, for example, buttons, switches, levers, dials, handles, knobs, mice, keyboards, trackballs, operation panels, and the like.
[0115] A device in which a display device and an operation device are integrated, such as a touch screen, may be used.
[0116] The subject and the assistant can operate the slit lamp microscope 1 by using the display device and the operation device.
[0117] [Alignment] The following describes the alignment of the slit lamp microscope 1 with respect to the subject's eye E. Generally, alignment is an operation for placing the device optical system in a position suitable for photographing and measuring the subject's eye E. The alignment in this embodiment is an operation for placing the illumination system 2 and the imaging system 3 in a position suitable for acquiring a moving image as shown in FIG.
[0118] There are various methods for aligning an ophthalmic apparatus. Some alignment methods are exemplified below, but the methods applicable to the present embodiment are not limited to these.
[0119] Stereo alignment is an alignment method that can be applied to this embodiment. Stereo alignment can be applied to an ophthalmic device capable of photographing the anterior eye from two or more different directions, and a specific method thereof is disclosed in Japanese Patent Application Laid-Open No. 2013-248376 filed by the present applicant. Stereo alignment includes, for example, the following steps: a step in which two or more anterior eye cameras photograph the anterior eye from different directions to obtain two or more photographed images; a step in which a processor analyzes these photographed images to obtain a three-dimensional position of the subject's eye; and a step in which the processor controls the movement of the optical system based on the obtained three-dimensional position. As a result, the optical system (illumination system 2 and photographing system 3 in this example) is placed at a suitable position relative to the subject's eye. In typical stereo alignment, the position of the pupil (center or center of gravity of the pupil) of the subject's eye is used as a reference.
[0120] In addition to such stereo alignment, any known alignment method can be adopted, such as a method using a Purkinje image obtained by alignment light, a method using an optical lever, etc. In the method using a Purkinje image or the method using an optical lever, the position of the corneal apex of the subject's eye is used as a reference.
[0121] Note that typical conventional alignment methods, including the above examples, are performed with the aim of aligning the axis of the test eye with the optical axis of the optical system, but in this embodiment, alignment can be performed to position the illumination system 2 and the imaging system 3 at a position corresponding to the scan start position.
[0122] As a first example of alignment in this embodiment, after performing alignment based on the pupil or corneal vertex of the subject's eye E by applying any of the above-mentioned alignment methods, the illumination system 2 and the imaging system 3 can be moved (in the X direction) by a distance equivalent to a preset standard value of the corneal radius. Note that instead of using the standard value, a measured value of the corneal radius of the subject's eye E may be used.
[0123] As a second example, after performing alignment based on the pupil or corneal apex of the subject's eye E by applying any of the above-mentioned alignment methods, an image of the anterior segment of the subject's eye E is analyzed to measure the corneal radius, and the illumination system 2 and the imaging system 3 can be moved (in the X direction) by a distance corresponding to this measurement. The image of the anterior segment analyzed in this example is, for example, an anterior segment image obtained by the imaging system 3, or another image. The other image may be any image, such as an image obtained by an anterior segment camera, an image obtained by an anterior segment OCT, or the like.
[0124] As a third example, an image of the anterior segment obtained by an anterior segment camera or imaging system 3 for stereo alignment can be analyzed to determine a first end of the cornea, and stereo alignment can be applied to move the illumination system 2 and imaging system 3 to a position corresponding to this first end.
[0125] It is also possible to apply any of the above-mentioned alignment methods to perform alignment based on the pupil or corneal apex of the subject's eye E, and start scanning the anterior segment with the slit light from the position determined by this. Even in this case, the scan sequence can be set so as to scan the entire cornea C. For example, the scan sequence is set so as to scan to the left from the position determined by the alignment, and then scan to the right.
[0126] [Other matters] The slit lamp microscope 1 may include a fixation system that outputs light (fixation light) for fixating the subject's eye E. The fixation system typically includes at least one visible light source (fixation light source) or a display device that displays an image such as a landscape chart or a fixation target. The fixation system is disposed, for example, coaxially or non-coaxially with the illumination system 2 or the imaging system 3.
[0127] The types of images that can be obtained by the slit lamp microscope 1 are not limited to the above-mentioned moving image of the anterior eye (multiple images of the anterior eye). For example, the slit lamp microscope 1 can obtain a three-dimensional image based on the moving image, a rendering image based on the three-dimensional image, a transillumination image, a moving image showing the movement of a contact lens worn on the subject's eye, and an image showing the gap between the contact lens and the corneal surface by applying a fluorescent agent. The rendering image will be described in another embodiment. The transillumination image is an image obtained by a transillumination method that uses the retinal reflection of illumination light to depict opacities or foreign bodies in the eye. It is to be noted that fundus photography, corneal endothelial cell photography, meibomian gland photography, etc. may also be possible.
[0128] [Usage form] The following describes how the slit lamp microscope 1 (and the system including it) is used. Figure 4 shows an example of how the microscope is used.
[0129] Although not shown in the figure, at any stage, the subject or an assistant inputs subject information to the slit lamp microscope 1. The input subject information is stored in the control unit 7. The subject information typically includes identification information of the subject (subject ID).
[0130] Furthermore, background information can be input. The background information is any information related to the subject, and examples thereof include interview information of the subject, information written by the subject on a prescribed sheet, and information recorded in the subject's electronic medical record. Typically, the background information includes sex, age, height, weight, disease name, candidate disease name, test results (visual acuity value, eye refractive power value, intraocular pressure value, etc.), history of wearing and strength of refractive corrective devices (glasses, contact lenses, etc.), test history, treatment history, etc. These are merely examples, and the background information is not limited to these.
[0131] (S1: Adjust the table, chair, and chin rest) First, the table on which the slit lamp microscope 1 is placed, the chair on which the subject sits, and the chin rest of the slit lamp microscope 1 are adjusted (all not shown). For example, the heights of the table, chair, and chin rest are adjusted. These adjustments are performed, for example, by the subject himself / herself. Alternatively, any of these adjustments may be performed by an assistant. The chin rest is provided with a chin rest and a forehead rest to stably position the subject's face.
[0132] (S2: Instructs to start shooting) After completing the adjustment in step S1, the subject sits on the chair, places his / her chin on the chin rest, and places his / her forehead on the forehead rest. Before or after these actions, the subject or the assistant performs an operation to start photographing the subject's eye. This operation is, for example, pressing a photographing start trigger button (not shown).
[0133] (S3: Alignment) Upon receiving the instruction in step S2, the slit lamp microscope 1 performs alignment with the subject's eye E in the manner described above. After the alignment is completed, focus adjustment may be performed.
[0134] (S4: Scan the anterior segment) In the manner described above, the slit lamp microscope 1 scans the anterior segment of the subject's eye E by combining the irradiation of slit light by the illumination system 2, the capture of moving images by the imaging system 3, and the movement of the illumination system 2 and the imaging system 3 by the movement mechanism 6. This allows for example the acquisition of a number of anterior segment images F1 to FN as shown in FIG.
[0135] The data processing unit 8 can process at least one of the anterior eye images F1 to FN. For example, as described in other embodiments, the data processing unit 8 can construct a three-dimensional image based on the anterior eye images F1 to FN. It is also possible to perform predetermined image processing and predetermined image analysis.
[0136] (S5: Send image) The control unit 7 controls the communication unit 9 to transmit images of the anterior eye acquired by the slit lamp microscope 1 (anterior eye images F1 to FN, parts of the anterior eye images F1 to FN, three-dimensional images based on the anterior eye images F1 to FN, etc.) to other devices.
[0137] Examples of other devices include information processing devices and storage devices. Information processing devices are, for example, servers on a wide area line, servers on a LAN, computer terminals, etc. Storage devices are storage devices provided on a wide area line, storage devices provided on a LAN, etc.
[0138] Background information can be transmitted together with the anterior segment image. Furthermore, identification information of the subject is transmitted together with the anterior segment image. This identification information may be the subject ID (described above) input to the slit lamp microscope 1, or may be identification information generated based on the subject ID. As an example of the latter, the subject ID (internal identification information) used for personal identification within the facility where the slit lamp microscope 1 is installed can be converted into external identification information to be used outside the facility. This makes it possible to improve information security regarding personal information such as the anterior segment image and background information.
[0139] (S6: Observation and diagnosis) The image of the anterior segment of the subject's eye E (as well as the subject's identification information, background information, etc.) transmitted from the slit lamp microscope 1 in step S5 is sent directly or indirectly to an information processing device used, for example, by a doctor (or optometrist).
[0140] A doctor (or optometrist) can observe an image of the anterior segment of the subject's eye E. At this time, for example, it is possible to display a predetermined number of anterior segment images F1 to FN at a time, to display a list of the anterior segment images F1 to FN, to display the anterior segment images F1 to FN as a slideshow, to construct a three-dimensional image from the anterior segment images F1 to FN, or to display a rendering image of the three-dimensional image.
[0141] A doctor (or optometrist) can perform image diagnosis (image interpretation) by observing an image of the anterior segment of the subject's eye E. The doctor (or optometrist) can create a report that records the information obtained from the image interpretation. The report is transmitted, for example, to a facility where the slit lamp microscope 1 is installed. Alternatively, the report may be transmitted to address information (email address, address, etc.) registered by the subject. This concludes the processing of this example.
[0142] [effect] The effects achieved by this embodiment will be described.
[0143] The slit lamp microscope 1 includes an illumination system 2, an imaging system 3, and a movement mechanism 6. The illumination system 2 irradiates slit light onto the anterior segment of the subject's eye E. The imaging system 3 includes an optical system 4 that guides light from the anterior segment irradiated with the slit light, and an image sensor 5 that receives the light guided by the optical system 4 on an imaging surface. The movement mechanism 6 moves the illumination system 2 and the imaging system 3.
[0144] The illumination system 2 and the imaging system 3 are configured so that the object surface along the optical axis (illumination optical axis) 2a of the illumination system 2, the optical system 4, and the imaging surface of the imaging element 5 satisfy the Scheimpflug condition.
[0145] The imaging system 3 repeatedly captures images in parallel with the movement of the illumination system 2 and the imaging system 3 by the moving mechanism 6, thereby acquiring a plurality of images of the anterior segment of the subject's eye E. Typically, this repeated imaging is video imaging, and a video image consisting of a plurality of anterior segment images is acquired.
[0146] According to such a slit lamp microscope 1, a three-dimensional region of the anterior segment of the subject's eye E can be scanned with slit light by moving the illumination system 2 and the imaging system 3, and an image representing the three-dimensional region can be obtained. Therefore, a doctor or optometrist can grasp the condition of a desired part of the anterior segment by observing the image obtained by the slit lamp microscope 1.
[0147] Furthermore, the image acquired by the slit lamp microscope 1 can be provided to a doctor or optometrist in a remote location. Typically, the slit lamp microscope 1 can transmit the image acquired of the anterior segment of the subject's eye E to an information processing device used by the doctor or optometrist via the communication unit 9. Incidentally, providing the communication unit 9 is optional. The method of providing the image acquired by the slit lamp microscope 1 is not limited to such data communication, and may be a method of providing a recording medium or a print medium on which the image is recorded. Recording on the recording medium is performed by a recording device (data writer) conforming to the recording medium, and recording on the print medium is performed by a printing device.
[0148] In addition, the slit lamp microscope 1 is configured so that the object plane along the illumination optical axis 2a, the optical system 4, and the imaging surface of the imaging element 5 satisfy the Scheimpflug condition, and therefore it is possible to focus over a wide range in the depth direction (Z direction). For example, the illumination system 2 and the imaging system 3 are configured so that the imaging system 3 focuses on at least an area defined by the anterior surface of the cornea and the posterior surface of the lens. This makes it possible to image the entire main area of the anterior segment of the eye that is the subject of the slit lamp microscope examination with high resolution. The range in focus is not limited to the area defined by the anterior surface of the cornea and the posterior surface of the lens, and can be set arbitrarily.
[0149] When a configuration that does not satisfy the Scheimpflug condition is applied, in order to photograph a three-dimensional area by focusing over a wide range in the depth direction, it is necessary to move the illumination system and the photographing system along a curved path that corresponds to the shape of the anterior cornea while focusing on each part of the anterior segment. However, such operations and controls are complicated and cannot be said to be practical.
[0150] The illumination system 2 may irradiate the anterior segment with slit light whose longitudinal direction is the subject's body axis direction (Y direction). Furthermore, the moving mechanism 6 may be configured to be able to move the illumination system 2 and the imaging system 3 in a direction (X direction) perpendicular to the subject's body axis direction. Note that the orientation and moving direction of the slit light are not limited to these and can be set arbitrarily, but typically the moving direction is set to the width direction of the slit light.
[0151] When a slit light whose longitudinal direction is the body axis direction is irradiated and the illumination system 2 and the imaging system 3 are moved in a direction perpendicular to the body axis direction, the illumination system 2 can be configured so that the length of the slit light (the dimension of the slit light in the body axis direction) is equal to or greater than the corneal diameter in the body axis direction. In addition, the movement mechanism 6 can be configured so that the movement distance of the illumination system 2 and the imaging system 3 by the movement mechanism 6 is equal to or greater than the corneal diameter in the direction perpendicular to the body axis direction (X direction). This corneal diameter may be the corneal diameter of the subject's eye E or a standard corneal diameter. Note that the length and movement distance of the slit light are not limited to these and can be set arbitrarily.
[0152] This configuration allows an image to be acquired of the entire cornea, and by combining this with a configuration that satisfies the Scheimpflug condition, it becomes possible to acquire an image that represents the entire cornea and a sufficient depth range.
[0153] As described above, the slit lamp microscope 1 can automatically obtain high-quality images that show a wide range (three-dimensional area) of the anterior segment of the eye, without requiring a skilled technician to perform detailed and complicated operations. The image reader can use the images obtained by the slit lamp microscope 1 to perform observation and diagnosis.
[0154] Therefore, the problem of a shortage of specialists can be resolved, and high-quality slit lamp microscope examinations can be widely provided. For example, such a slit lamp microscope 1 can be said to be effective in screening for anterior segment diseases, etc.
[0155] Below, we will explain exemplary functions and exemplary configurations that can be combined with the slit lamp microscope 1. In the following embodiments, elements similar to those in the first embodiment may be indicated with the same reference numerals. Also, in the drawings shown in the following embodiments, elements similar to those in the first embodiment may be omitted.
[0156] Second Embodiment In this embodiment, a configuration of an optical system applicable to the slit lamp microscope 1 of the first embodiment will be described. An example is shown in Fig. 5. In addition to the group of elements shown in Fig. 5, elements shown in other embodiments may be provided. For example, the control unit 7, data processing unit 8, communication unit 9, etc. of the first embodiment may be provided.
[0157] The illumination system 20 shown in FIG. 5 is an example of the illumination system 2 of the first embodiment, and the left photographing system 30L and the right photographing system 30R are examples of the photographing system 3. Reference symbol 20a indicates the optical axis (illumination optical axis) of the illumination system 20, reference symbol 30La indicates the optical axis (left photographing optical axis) of the left photographing system 30L, and reference symbol 30Ra indicates the optical axis (right photographing optical axis) of the right photographing system 30R. The left photographing optical axis 30La and the right photographing optical axis 30Ra are arranged in different directions. The angle between the illumination optical axis 20a and the left photographing optical axis 30La is indicated by θL, and the angle between the illumination optical axis 20a and the right photographing optical axis 30Ra is indicated by θR. The angles θL and θR may be equal to or different from each other. The illumination optical axis 20a, the left photographing optical axis 30La, and the right photographing optical axis 30Ra intersect at one point. As in FIG. 1, the Z coordinate of this intersection is indicated by Z0.
[0158] The moving mechanism 6 can move the illumination system 20, the left imaging system 30L, and the right imaging system 30R in a direction indicated by an arrow 49 (X direction). Typically, the illumination system 20, the left imaging system 30L, and the right imaging system 30R are placed on a stage that is movable at least in the X direction, and the moving mechanism 6 moves this movable stage in accordance with a control signal from the control unit 7.
[0159] The illumination system 20 irradiates slit light onto the anterior segment of the subject's eye E. Similar to the illumination system of a conventional slit lamp microscope, the illumination system 20 includes, in order from the side farthest from the subject's eye E, an illumination light source 21, a positive lens 22, a slit forming unit 23, and objective lens groups 24 and 25.
[0160] Illumination light (typically visible light) output from the illumination light source 21 is refracted by the positive lens 22 and projected onto the slit forming unit 23. A part of the projected illumination light passes through the slit formed by the slit forming unit 23 to become slit light. The generated slit light is refracted by the objective lens groups 24 and 25, and then reflected by the beam splitter 47 to be irradiated onto the anterior segment of the subject's eye E.
[0161] The left imaging system 30L includes a reflector 31L, an imaging lens 32L, and an image sensor 33L. The reflector 31L and the imaging lens 32L guide light from the anterior segment irradiated with slit light by the illumination system 20 (light traveling in the direction of the left imaging system 30L) to the image sensor 33L.
[0162] The light traveling from the anterior eye to the left imaging system 30L is the light from the anterior eye irradiated with the slit light, and travels in a direction away from the illumination optical axis 20a. The reflector 31L reflects the light in a direction approaching the illumination optical axis 20a. The imaging lens 32L refracts the light reflected by the reflector 31L to form an image on the imaging surface 34L of the imaging element 33L. The imaging element 33L receives the light on the imaging surface 34L.
[0163] As in the first embodiment, the left imaging system 30L repeatedly captures images in parallel with the movement of the illumination system 20, the left imaging system 30L, and the right imaging system 30R by the movement mechanism 6. This allows a plurality of anterior eye images to be obtained.
[0164] As in the first embodiment, the object plane along the illumination optical axis 20a, the optical system including the reflector 31L and the imaging lens 32L, and the imaging plane 34L satisfy the Scheimpflug condition. More specifically, when the deflection of the optical path of the imaging system 30L by the reflector 31L is taken into consideration, the YZ plane (including the object plane) passing through the illumination optical axis 20a, the principal plane of the imaging lens 32L, and the imaging plane 34L intersect on the same straight line. This allows the left imaging system 30L to focus on all positions in the object plane (for example, in the range from the anterior surface of the cornea to the posterior surface of the crystalline lens) and perform imaging.
[0165] The right photographing system 30R includes a reflector 31R, an imaging lens 32R, and an image sensor 33R. As with the left photographing system 30L, the right photographing system 30R guides light from the anterior eye, which is irradiated with slit light by the illumination system 20, to an imaging surface 34R of the image sensor 33R by the reflector 31R and the imaging lens 32R. Furthermore, as with the left photographing system 30L, the right photographing system 30R obtains a plurality of anterior eye images by repeatedly photographing in parallel with the movement of the illumination system 20, the left photographing system 30L, and the right photographing system 30R by the moving mechanism 6. As with the left photographing system 30L, the object surface along the illumination optical axis 20a, the optical system including the reflector 31R and the imaging lens 32R, and the imaging surface 34R satisfy the Scheimpflug condition.
[0166] The control unit 7 can synchronize the repeated photographing by the left photographing system 30L and the repeated photographing by the right photographing system 30R. This allows a correspondence relationship to be obtained between a plurality of anterior eye images obtained by the left photographing system 30L and a plurality of anterior eye images obtained by the right photographing system 30R. This correspondence relationship is a temporal correspondence relationship, and more specifically, images acquired substantially simultaneously are paired with each other.
[0167] Alternatively, the control unit 7 or the data processing unit 8 can execute a process for determining a correspondence relationship between a plurality of anterior-segment images obtained by the left photographing system 30L and a plurality of anterior-segment images obtained by the right photographing system 30R. For example, the control unit 7 or the data processing unit 8 can pair the anterior-segment images sequentially input from the left photographing system 30L and the anterior-segment images sequentially input from the right photographing system 30R based on their input timing.
[0168] This embodiment further includes a moving image capturing system 40. The moving image capturing system 40 captures moving images of the anterior segment of the subject's eye E from a fixed position in parallel with the capturing of images by the left capturing system 30L and the right capturing system 30R. "Capturing moving images from a fixed position" means that the moving image capturing system 40 is not moved by the moving mechanism 6, unlike the illumination system 20, the left capturing system 30L, and the right capturing system 30R.
[0169] In this embodiment, the video imaging system 40 is disposed coaxially with the illumination system 20, but the arrangement is not limited thereto. For example, the video imaging system may be disposed non-coaxially with the illumination system 20. Also, an optical system may be provided that illuminates the anterior segment with illumination light in a band to which the video imaging system 40 has sensitivity.
[0170] The light transmitted through the beam splitter 47 is reflected by a reflector 48 and enters the moving image capturing system 40. The light entering the moving image capturing system 40 is refracted by an objective lens 41, and then an image is formed on the imaging surface of an imaging element 43 by an imaging lens 42. The imaging element 43 is an area sensor.
[0171] When the moving image capturing system 40 is provided, it is possible to monitor and track the movement of the subject's eye E. Tracking is a process for making the optical system follow the movement of the subject's eye E. Such a process will be described in another embodiment.
[0172] Depending on the output wavelength of the illumination system 20 and the detection wavelength of the motion picture capturing system 40, the beam splitter 47 is, for example, a dichroic mirror or a half mirror.
[0173] The effects achieved by this embodiment will be described.
[0174] This embodiment is an example of the imaging system 3 of the first embodiment, and includes a left imaging system 30L and a right imaging system 30R. The combination of the left imaging system 30L and the right imaging system 30R is an example of a combination of the first imaging system and the second imaging system.
[0175] The left photographing system 30L includes a reflector 31L and an imaging lens 32L (first optical system) that guide light from the anterior segment of the eye irradiated with the slit light, and an imaging element 33L (first imaging element) that receives the guided light on an imaging surface 34L (first imaging surface). Similarly, the right photographing system 30R includes a reflector 31R and an imaging lens 32R (second optical system) that guide light from the anterior segment of the eye irradiated with the slit light, and an imaging element 33R (second imaging element) that receives the guided light on an imaging surface 34R (second imaging surface).
[0176] The optical axis (left photographing optical axis 30La) of the left photographing system 30L and the optical axis (right photographing optical axis 30Ra) of the right photographing system 30R are arranged in different directions. Furthermore, the object surface along the optical axis (illumination optical axis 20a) of the illumination system 20, the reflector 31L, the imaging lens 32L, and the imaging surface 34L satisfy the Scheimpflug condition. Similarly, the object surface, the reflector 31L, the imaging lens 32L, and the imaging surface 34L satisfy the Scheimpflug condition.
[0177] The left imaging system 30L acquires a first group of images by repeatedly capturing images in parallel with the movement of the illumination system 20, the left imaging system 30L, and the right imaging system 30R by the movement mechanism 6. Similarly, the right imaging system 30R acquires a second group of images by repeatedly capturing images in parallel with the movement of the illumination system 20, the left imaging system 30L, and the right imaging system 30R by the movement mechanism 6.
[0178] According to this configuration, the anterior eye part irradiated with the slit light can be captured in a moving image from different directions. Even if an image acquired by one imaging system includes an artifact, an image acquired by the other imaging system substantially simultaneously with the image may not include the artifact. In addition, even if both of a pair of images acquired substantially simultaneously by both imaging systems include an artifact, and an artifact in one image overlaps a region of interest (e.g., a region irradiated with the slit light), an artifact in the other image may not overlap the region of interest. Therefore, the possibility of acquiring a suitable image is increased. The process of acquiring a suitable image from a pair of images acquired substantially simultaneously will be described later.
[0179] In addition to the first and second imaging systems, the imaging system 3 may include a third, . . . , Kth imaging system (K is an integer of 3 or more) having a similar configuration.
[0180] The left imaging system 30L of this embodiment includes a reflector 31L and an imaging lens 32L. The reflector 31L reflects light from the anterior eye segment irradiated with the slit light, traveling in a direction away from the illumination optical axis 20a, in a direction toward the illumination optical axis 20a. Furthermore, the imaging lens 32L forms an image of the light reflected by the reflector 31L on an imaging surface 34L. Here, the imaging lens 32L includes one or more lenses.
[0181] Similarly, the right imaging system 30R includes a reflector 31R and an imaging lens 32R. The reflector 31R reflects light from the anterior eye segment irradiated with the slit light, traveling in a direction away from the illumination optical axis 20a, toward the illumination optical axis 20a. Furthermore, the imaging lens 32R forms an image of the light reflected by the reflector 31R on an imaging surface 34R. Here, the imaging lens 32R includes one or more lenses.
[0182] According to this configuration, it is possible to miniaturize the device. That is, the image acquired by the image pickup element 33L (33R) is output through a cable extending from the surface opposite to the image pickup surface 34L (34R), but according to this configuration, the cable can be arranged from the back surface of the image pickup element 33L (33R) located relatively close to the illumination optical axis 20a toward the opposite direction to the eye E. Therefore, the cable can be preferably routed, and the device can be miniaturized.
[0183] Moreover, according to this configuration, since the angles θL and θR can be set large, when an image acquired by one imaging system includes an artifact, the possibility that the image acquired by the other imaging system does not include the artifact can be increased. Furthermore, when an artifact is included in both of a pair of images acquired by both imaging systems substantially simultaneously, and an artifact in one image overlaps with a region of interest (e.g., a region irradiated with slit light), the possibility that the artifact in the other image overlaps with the region of interest can be reduced.
[0184] This embodiment includes a video imaging system 40. The left imaging system 30L and the right imaging system 30R repeatedly capture images of the anterior segment in parallel with the movement of the illumination system 20, the left imaging system 30L, and the right imaging system 30R by the moving mechanism 6. In parallel with this repeated imaging, the video imaging system 40 captures video images of the anterior segment from a fixed position.
[0185] According to such a configuration, by capturing a moving image from a fixed position (e.g., the front) in parallel with scanning the anterior eye segment with the slit light, it is possible to grasp the state of the subject's eye E during scanning and to perform control according to the state of the subject's eye E. An example of this will be described in another embodiment.
[0186] An example of an optical system applicable instead of the configuration shown in Fig. 5 is shown in Fig. 6. The reference numerals for each element are omitted. In the left imaging system 30L' of the optical system according to this example, the reflector reflects the light from the anterior eye segment irradiated with the slit light, traveling in a direction away from the illumination optical axis 20a', in a direction further away from the illumination optical axis 20a. Furthermore, the imaging lens forms an image of the light reflected by the reflector on the imaging surface of the imaging element.
[0187] Although it is possible to adopt such a configuration, the cable is arranged from the back surface of the imaging element, which is located relatively far from the illumination optical axis 20a', to the side (or toward the test eye E), which creates the problem that the cable cannot be routed conveniently.
[0188] Third embodiment In this embodiment, the configuration of a processing system applicable to the slit lamp microscope 1 of the first embodiment will be described. In the imaging system 3 of this embodiment, the left imaging optical axis 30La and the right imaging optical axis 30Ra are arranged to be inclined in opposite directions with respect to the illumination optical axis 20a, for example, as shown in FIG. 5 described in the second embodiment. The processing system of this embodiment executes the following processes related to artifacts.
[0189] 7 is an example of the data processing unit 8 in the first embodiment. The data processing unit 8A includes an image selection unit 81.
[0190] The image selection unit 81 determines whether an artifact is included in either of the two images acquired substantially simultaneously by the left imaging system 30L and the right imaging system 30R. The artifact determination includes a predetermined image analysis, and typically includes a threshold process for the luminance information assigned to the pixel.
[0191] In this threshold processing, for example, pixels assigned with a luminance value exceeding a preset threshold are specified. Typically, the threshold is set higher than the luminance value of the slit light irradiation area in the image. In this case, the image selection unit 81 does not determine the slit light irradiation area as an artifact, and determines an image brighter than the slit light irradiation area (for example, a specular reflection image) as an artifact.
[0192] The image selection unit 81 may perform any image analysis other than threshold processing, such as pattern recognition, segmentation, edge detection, etc., for artifact determination. In general, any information processing technique, such as image analysis, image processing, artificial intelligence, cognitive computing, etc., can be applied to artifact determination.
[0193] When it is determined as a result of the artifact determination that one of the two images acquired substantially simultaneously by the left imaging system 30L and the right imaging system 30R contains an artifact, the image selection unit 81 selects the other image. In other words, the image selection unit 81 selects the image that is not determined to contain an artifact, out of these two images.
[0194] When both images contain artifacts, the image selection unit 81 can, for example, evaluate the adverse effect of the artifacts on observation or diagnosis, and select the image with the smaller adverse effect. This evaluation is performed, for example, based on the size and / or position of the artifacts. Typically, an image containing a large artifact is evaluated as having a large adverse effect, and an image in which an artifact is located in or near a region of interest such as a slit light irradiation region is evaluated as having a large adverse effect.
[0195] If both images contain artifacts, the artifact removal described in the fourth embodiment may be applied.
[0196] As described in the second embodiment, the left imaging system 30L acquires a first image group by repeatedly capturing images in parallel with the movement of the illumination system 20, the left imaging system 30L, and the right imaging system 30R by the moving mechanism 6. Similarly, the right imaging system 30R acquires a second image group by repeatedly capturing images in parallel with the movement of the illumination system 20, the left imaging system 30L, and the right imaging system 30R by the moving mechanism 6. The repeated capturing is typically a moving image, and each of the first image group and the second image group is a frame group constituting a moving image. Also, as described above, images of the first image group and the second image group that are acquired substantially simultaneously are paired.
[0197] The image selection unit 81 selects one of the two paired images (a combination of an image from the first image group and an image from the second image group). In this way, for example, one image is selected from each of a plurality of image pairs, and a plurality of images substantially free of artifacts are selected.
[0198] The data processing unit 8A further includes a three-dimensional image construction unit 82. The three-dimensional image construction unit 82 constructs a three-dimensional image based on an image group including images selected from the first image group and the second image group by the image selection unit 81. This image group may include only any of the multiple images selected from the first image group and the second image group by the image selection unit 81, or may further include images other than these.
[0199] A three-dimensional image is an image (image data) in which pixel positions are defined by a three-dimensional coordinate system. Examples of three-dimensional images include stack data and volume data. Stack data is constructed by embedding multiple two-dimensional images into a single three-dimensional coordinate system according to their positional relationships. Volume data is also called voxel data, and is constructed, for example, by applying voxelization to stack data.
[0200] An example of the process of constructing a three-dimensional image will be described. The image group to which the three-dimensional image construction is applied is assumed to be a plurality of anterior eye images (frame group) F1, F2, F3, . . . , FN shown in Fig. 3. The anterior eye image Fn includes a slit light irradiation area An (n = 1, 2, . . . , N).
[0201] The three-dimensional image constructing unit 82 analyzes the anterior-segment image Fn to extract the slit-light irradiation area An. The extraction of the slit-light irradiation area An is performed by referring to the luminance information assigned to the pixels, and typically includes threshold processing. This results in a slit-light irradiation area image Gn (n=1, 2, . . . , N) depicting (only) the slit-light irradiation area An. FIG. 8 shows an example of multiple slit-light irradiation area images G1-GN constructed from multiple anterior-segment images F1-FN.
[0202] If the slit-light irradiation region image Gn contains artifacts, the artifacts can be removed from the slit-light irradiation region image Gn by, for example, known image processing or image processing according to other embodiments. In addition, the distortion correction described in other embodiments can be applied to the anterior-segment image Fn or the slit-light irradiation region image Gn.
[0203] The three-dimensional image constructing section 82 constructs a three-dimensional image based on at least a part of the plurality of slit-beam irradiation area images G1 to GN. The three-dimensional image and the details of the construction thereof will be described in other embodiments.
[0204] The effects achieved by this embodiment will be described.
[0205] In this embodiment, as shown in FIG. 5, for example, the left imaging optical axis 30La and the right imaging optical axis 30Ra are arranged to be inclined in opposite directions with respect to the illumination optical axis 20a. The data processing unit 8A of this embodiment includes an image selection unit 81. The image selection unit 81 determines whether an artifact is included in either of two images acquired substantially simultaneously by the left imaging system 30L and the right imaging system 30R. If it is determined that an artifact is included in one of the two images, the image selection unit 81 selects the other of the two images, that is, the image that does not include the artifact.
[0206] With this configuration, it is possible to select an image that does not include artifacts (specular reflection images, etc.) that interfere with observation and diagnosis.
[0207] Furthermore, the data processing unit 8A of this embodiment includes a three-dimensional image construction unit 82. The three-dimensional image construction unit 82 constructs a three-dimensional image representing the anterior segment of the subject's eye E based on an image group including an image selected by an image selection unit 81 from among a plurality of images acquired by the left imaging system 30L and a plurality of images acquired by the right imaging system 30R.
[0208] With this configuration, it is possible to construct a three-dimensional image of the anterior segment of the eye based on a group of images that do not include artifacts that interfere with observation or diagnosis.
[0209] Fourth embodiment In this embodiment, the configuration of a processing system applicable to the slit lamp microscope 1 of the first embodiment will be described.
[0210] In the imaging system 3 of this embodiment, as shown in FIG. 5 described in the second embodiment, the left imaging optical axis 30La and the right imaging optical axis 30Ra may be arranged to be inclined in opposite directions with respect to the illumination optical axis 20a, or the two imaging optical axes may be arranged in the same direction with respect to the illumination optical axis. In the latter case, the angle between one of the two imaging optical axes and the illumination optical axis is different from the angle between the other imaging optical axis and the illumination optical axis. In either case, the position of one imaging optical axis with respect to the illumination optical axis is different from the position of the other imaging optical axis with respect to the illumination optical axis. The processing system of this embodiment executes the following processing related to artifacts.
[0211] 9 is an example of the data processing unit 8 in the first embodiment. The data processing unit 8B includes an artifact removal unit 83.
[0212] The artifact removal unit 83 compares two images acquired substantially simultaneously by the left imaging system 30L and the right imaging system 30R to determine whether an artifact is included in either of these two images. Here, the two images acquired substantially simultaneously by the left imaging system 30L and the right imaging system 30R are associated with each other by, for example, the above-mentioned image pairing.
[0213] As described above, in this embodiment, the position of one imaging optical axis relative to the illumination optical axis is different from the position of the other imaging optical axis relative to the illumination optical axis. Therefore, the position of an artifact in an image acquired by one imaging system (e.g., the left imaging system 30L) is different from the position of an artifact in an image acquired by the other imaging system (e.g., the right imaging system 30R). Alternatively, only one of the two images to be compared contains an artifact.
[0214] The artifact removal unit 83 analyzes each of these two images to determine whether or not they contain artifacts. The artifact determination is performed in the same manner as that of the image selection unit 81 in the third embodiment, for example.
[0215] If only one of the two images contains an artifact, the artifact removal unit 83 can remove the artifact, or select an image that does not contain the artifact as in the third embodiment. Note that determining that one of the two images contains an artifact and the other does not contain an artifact corresponds to comparing the two images.
[0216] If both of the two images contain artifacts, the artifact remover 83 processes one or both of the two images to remove the artifacts.
[0217] The artifact removal unit 83 can paste a partial region of another image into an image region from which artifacts have been removed. As described above, if the positions of artifacts in the two images being compared are different, or only one of the two images contains artifacts, when an artifact is removed from one image, the corresponding region in the other image is not an artifact. The artifact removal unit 83 extracts this corresponding region from the other image and pastes it into the location from which the artifact has been removed.
[0218] Alternatively, if another imaging system is provided, such as the video imaging system 40 of the second embodiment, it is possible to extract the corresponding area in the image of the anterior eye acquired thereby and paste it into the area where the artifacts have been removed.
[0219] As described in the second embodiment, the left imaging system 30L acquires a first image group by repeatedly capturing images in parallel with the movement of the illumination system 20, the left imaging system 30L, and the right imaging system 30R by the moving mechanism 6. Similarly, the right imaging system 30R acquires a second image group by repeatedly capturing images in parallel with the movement of the illumination system 20, the left imaging system 30L, and the right imaging system 30R by the moving mechanism 6. The repeated capturing is typically a moving image, and each of the first image group and the second image group is a frame group that constitutes a moving image. Also, as described above, images of the first image group and the second image group that are acquired substantially simultaneously are paired. The artifact removal unit 83 applies the above-mentioned alignment removal to each of the multiple image pairs.
[0220] The data processing unit 8B further includes a three-dimensional image construction unit 84. The three-dimensional image construction unit 84 constructs a three-dimensional image based on an image group including images from which artifacts have been removed by the artifact removal unit 83. This image group may include only any of the multiple images processed by the artifact removal unit 83, or may further include images other than these. Details of the three-dimensional image and its construction will be described in other embodiments.
[0221] The effects achieved by this embodiment will be described.
[0222] The data processing unit 8B of this embodiment includes an artifact removal unit 83. The artifact removal unit 83 compares two images acquired substantially simultaneously by the left imaging system 30L and the right imaging system 30R, and determines whether an artifact is included in either of these two images. If it is determined that an artifact is included in either image, the artifact removal unit 83 performs removal of this artifact.
[0223] With this configuration, it is possible to construct an image that does not include artifacts (such as specular reflection images) that interfere with observation and diagnosis.
[0224] Furthermore, the data processing unit 8B of this embodiment includes a three-dimensional image construction unit 84. The three-dimensional image construction unit 84 constructs a three-dimensional image representing the anterior segment of the subject's eye E based on a group of images including images from which artifacts have been removed by the artifact removal unit 83.
[0225] With this configuration, it is possible to construct a three-dimensional image of the anterior segment of the eye based on a group of images that do not include artifacts that interfere with observation or diagnosis.
[0226] Fifth embodiment In this embodiment, a configuration of a processing system applicable to the slit lamp microscope 1 of the first embodiment will be described. In the third and fourth embodiments, typically, artifact-related processing is applied to two images acquired substantially simultaneously by the first and second imaging systems, and a three-dimensional image is constructed based on an image group that does not include artifacts. On the other hand, it is also possible to construct a three-dimensional image without undergoing artifact-related processing. This embodiment is applicable to such cases.
[0227] 10 is an example of the data processing unit 8 in the first embodiment. The data processing unit 8C includes a three-dimensional image constructing unit 85.
[0228] In a first example of this embodiment, as described in the first embodiment, the photographing system 3 repeatedly photographs in parallel with the movement of the illumination system 2 and the photographing system 3 by the moving mechanism 6, thereby acquiring multiple images of the anterior segment of the test eye E.
[0229] The three-dimensional image constructing unit 85 can construct a three-dimensional image based on a plurality of images acquired by the imaging system 3. The image group used for constructing the three-dimensional image may include only any of the plurality of images acquired by the imaging system 3, or may further include images other than these. Details of the three-dimensional image and its construction will be described in other embodiments.
[0230] In the second example of this embodiment, as described in the second embodiment, the left imaging system 30L acquires a first image group by repeatedly capturing images in parallel with the movement of the illumination system 20, the left imaging system 30L, and the right imaging system 30R by the movement mechanism 6. Similarly, the right imaging system 30R acquires a second image group by repeatedly capturing images in parallel with the movement of the illumination system 20, the left imaging system 30L, and the right imaging system 30R by the movement mechanism 6. Images of the first image group and the second image group that are acquired substantially simultaneously are paired.
[0231] The three-dimensional image constructing section 85 can construct a three-dimensional image based on a first image group acquired by the left imaging system 30L. The image group used to construct this three-dimensional image may include only one of the first image group, or may further include images other than these. Similarly, the three-dimensional image constructing section 85 can construct a three-dimensional image based on a second image group acquired by the right imaging system 30R. The image group used to construct this three-dimensional image may include only one of the second image group, or may further include images other than these. Details of the three-dimensional image and its construction will be described in other embodiments.
[0232] The effects achieved by this embodiment will be described.
[0233] The data processing unit 8C of this embodiment includes a three-dimensional image construction unit 85. The three-dimensional image construction unit 85 constructs a three-dimensional image based on a plurality of images acquired by the imaging system 3. The imaging system 3 may include both the left imaging system 30L and the right imaging system 30R, or may include only a single imaging system corresponding to one of them.
[0234] According to such a configuration, it is possible to construct a three-dimensional image that represents a three-dimensional region in the anterior segment of the subject's eye E. The three-dimensional image is useful for observation and diagnosis.
[0235] Sixth embodiment This embodiment is applicable to the case where a three-dimensional image of the anterior eye segment can be constructed like the third to fifth embodiments.
[0236] As described above, a three-dimensional image is constructed from a plurality of images obtained sequentially by scanning with a slit light. In order to construct a three-dimensional image from a plurality of images, it is necessary to arrange the plurality of images. However, since the plurality of images are obtained at different times, it is difficult to arrange the plurality of images with high accuracy and precision. This embodiment has been devised to solve such a problem.
[0237] The control unit 7 shown in Fig. 11 is similar to that in the first embodiment. The moving mechanism 6A is an example of the moving mechanism 6 in the first embodiment, and includes a parallel moving mechanism 61 and a rotation mechanism 62. The data processing unit 8D includes a three-dimensional image construction unit 86. The three-dimensional image construction unit 86 is an example of the three-dimensional image construction unit 82 in the third embodiment, an example of the three-dimensional image construction unit 84 in the fourth embodiment, and an example of the three-dimensional image construction unit 85 in the fifth embodiment. The three-dimensional image construction unit 86 includes an image position determination unit 87.
[0238] When the configuration shown in FIG. 1 of the first embodiment is applied, the parallel movement mechanism 61 moves the illumination system 2 and the imaging system 3 together in the X direction in order to scan the anterior eye segment with slit light.
[0239] When the configuration of the second embodiment shown in FIG. 5 is applied, the parallel movement mechanism 61 moves the illumination system 20, the left imaging system 30L, and the right imaging system 30R integrally in the X direction in order to scan the anterior eye segment with slit light.
[0240] When the configuration shown in FIG. 1 of the first embodiment is applied, the rotation mechanism 62 rotates the illumination system 2 and the imaging system 3 together about the illumination optical axis 2a as the rotation axis.
[0241] When the configuration of the second embodiment shown in FIG. 5 is applied, the rotation mechanism 62 rotates the illumination system 20, the left imaging system 30L, and the right imaging system 30R integrally with the illumination optical axis 20a as the rotation axis.
[0242] This allows the direction of the slit light irradiated onto the anterior segment of the subject's eye E to be rotated, and the photographing direction is also rotated by the same angle as the rotation of the direction of the slit light.
[0243] When the configuration shown in Figure 1 of the first embodiment is applied, an anterior segment scan is performed using slit light when the illumination system 2 and the imaging system 3 are positioned at the first rotation position, and multiple images are acquired by the imaging system 3.
[0244] When the configuration shown in Figure 5 of the second embodiment is applied, an anterior segment scan is performed using slit light when the illumination system 20, the left photographing system 30L and the right photographing system 30R are positioned at a first rotation position, a first group of images is acquired by the left photographing system 30L and a second group of images is acquired by the right photographing system 30R.
[0245] The first rotational position is, for example, a rotational position where the longitudinal direction of the slit light projected onto the anterior segment coincides with the body axis direction (Y direction) of the subject.
[0246] When the configuration shown in Figure 1 of the first embodiment is applied, when the illumination system 2 and the photographing system 3 are positioned at a second rotation position different from the first rotation position, the photographing system 3 acquires an image of the anterior segment irradiated with slit light by the illumination system 20.
[0247] When the configuration shown in Figure 5 of the second embodiment is applied, when the illumination system 20, the left photographing system 30L and the right photographing system 30R are positioned at a second rotation position different from the first rotation position, each of the left photographing system 30L and the right photographing system 30R acquires an image of the anterior segment illuminated with slit light by the illumination system 20.
[0248] The second rotational position is, for example, a rotational position where the longitudinal direction of the slit light projected onto the anterior eye coincides with the left-right direction (X direction). This allows one or more images to be taken in addition to the anterior eye scan performed at the first rotational position. In this additional image taking, the direction of the slit light is different from that during the anterior eye scan. Typically, the direction of the slit light can be set so that it passes through all of the slit light irradiation areas in the anterior eye scan.
[0249] The image position determination unit 87 determines the relative positions of the images of the anterior eye acquired at the first rotational position based on the images of the anterior eye acquired at the second rotational position. This image position determination adjusts the arrangement of the images of the anterior eye acquired at the first rotational position by referring to the images acquired at the second rotational position.
[0250] For example, the image position determination unit 87 analyzes each image obtained at the first rotation position and an image obtained at the second rotation position to identify a common area between them. Furthermore, the image position determination unit 87 determines the relative position of each image obtained at the first rotation position and an image obtained at the second rotation position based on the identified common area.
[0251] By applying such processing to all the images obtained at the first rotation position, all the images obtained at the first rotation position are arranged with reference to the image obtained at the second rotation position, i.e., the relative positions of all the images obtained at the first rotation position are determined via the image obtained at the second rotation position.
[0252] The processing performed by the image position determination unit 87 may include any information processing, such as image correlation processing, segmentation, pattern matching, processing using artificial intelligence, and processing using cognitive computing.
[0253] The three-dimensional image constructing section 86 arranges the multiple images obtained at the first rotational position in a single three-dimensional coordinate system based on the relative positions determined by the image position determining section 87, and forms a three-dimensional image.
[0254] FIG. 12 shows an example of the irradiation position of the slit light in this embodiment. FIG. 12 shows the state of the anterior eye viewed from the front. When the illumination system 2 and the imaging system 3 are arranged at the first rotation position, the multiple slit light irradiation areas in the anterior eye scan correspond to multiple strip-shaped areas arranged in the X direction with the Y direction as the longitudinal direction. In the anterior eye scan of this example, the slit light is sequentially irradiated onto these strip-shaped areas in the order indicated by the arrow 11. At least one image is taken while the slit light is irradiated onto each strip-shaped area.
[0255] Meanwhile, reference numeral 12 indicates the position of the slit light irradiated to the anterior eye segment when the illumination system 2 and the imaging system 3 are disposed at the second rotation position. The slit light irradiation area 12 corresponding to the second rotation position is a strip-shaped area with the X direction as the longitudinal direction. That is, in this example, the direction of the slit light irradiated to the anterior eye segment at the first rotation position and the direction of the slit light irradiated to the anterior eye segment at the second rotation position are orthogonal to each other. Note that the relationship between the direction of the slit light irradiated to the anterior eye segment at the first rotation position and the direction of the slit light irradiated to the anterior eye segment at the second rotation position is not limited thereto, and it is sufficient that the two directions are different.
[0256] Here, the case where the illumination system 2 and the imaging system 3 are applied has been described, but the same applies to the case where the illumination system 20, the left imaging system 30L, and the right imaging system 30R are applied.
[0257] In this example, both the anterior eye scan at the first rotational position and the imaging at the second rotational position are performed, but the timing of performing these may be arbitrary. For example, it is possible to perform the anterior eye scan at the first rotational position after imaging at the second rotational position, to perform the imaging at the second rotational position after the anterior eye scan at the first rotational position, or to perform the imaging at the second rotational position during the anterior eye scan at the first rotational position.
[0258] The effects achieved by this embodiment will be described.
[0259] The moving mechanism 6A of this embodiment includes a rotation mechanism 62 that rotates the illumination system 2 (20) and the imaging system 3 (30L, 30R) together with the illumination optical axis 2a (20a) as a rotation axis. When the illumination system 2 (20) and the imaging system 3 (30L, 30R) are arranged at a first rotation position, the imaging system 3 (30L, 30R) acquires a plurality of images of the anterior eye segment irradiated with the slit light. Furthermore, when the illumination system 2 (20) and the imaging system 3 (30L, 30R) are arranged at a second rotation position different from the first rotation position, the imaging system 3 (30L, 30R) acquires an image of the anterior eye segment irradiated with the slit light by the illumination system 2 (20). The image position determination unit 87 determines the relative positions of the plurality of images acquired at the first rotation position based on the images acquired at the second rotation position. The three-dimensional image construction unit 86 aligns the plurality of images based on the determined relative positions to construct a three-dimensional image.
[0260] With this configuration, alignment between multiple images acquired at a first rotational position can be performed by referring to an image acquired at a second rotational position, thereby improving the accuracy and precision of 3D image construction.
[0261] Note that "determining the relative positions of the images captured at the first rotation position" includes not only determining the relative positions of the images themselves, but also determining the relative positions of the slit light irradiation areas extracted from the images. Thus, this embodiment includes both a case in which the slit light irradiation areas are extracted after determining the relative positions of the images, and a case in which the relative positions of the images are extracted after extracting the slit light irradiation areas from the images.
[0262] This embodiment also includes determining the relative positions of a group of images selected from a plurality of images acquired at the first rotation position, as in the case where the third embodiment is applied. Furthermore, this embodiment also includes determining the relative positions of a group of images obtained by processing a plurality of images acquired at the first rotation position, as in the case where the fourth embodiment is applied. Thus, this embodiment includes both a case where an image is selected or processed after the relative positions of the plurality of images are determined, and a case where an image is selected or processed and then the relative positions of the selected images or processed images are determined.
[0263] Seventh embodiment In this embodiment, construction of a three-dimensional image as described in the third to sixth embodiments will be described.
[0264] The three-dimensional image constructing unit 88 shown in FIG.
[0265] 1 of the first embodiment is applied, an image region extraction unit 89 extracts an image region corresponding to an irradiation region of the slit light from the illumination system 2 from each of a plurality of images acquired by the imaging system 3 in parallel with the movement of the illumination system 2 and the imaging system 3. The extracted image region is a two-dimensional image region or a three-dimensional image region.
[0266] 5 of the second embodiment is applied, the image region extraction unit 89 can extract an image region corresponding to the irradiation region of the slit light from the illumination system 20 from each of a plurality of images acquired by the left imaging system 30L in parallel with the movement of the illumination system 20, the left imaging system 30L, and the right imaging system 30R. Also, the image region extraction unit 89 can extract an image region corresponding to the irradiation region of the slit light from the illumination system 20 from each of a plurality of images acquired by the right imaging system 30R in parallel with the movement of the illumination system 20, the left imaging system 30L, and the right imaging system 30R. In this example, the extracted image region is a two-dimensional image region or a three-dimensional image region.
[0267] The processing performed by the image area extraction unit 89 is performed in the same manner as the processing for extracting the slit light irradiation area An from the anterior eye image Fn and constructing the slit light irradiation area image Gn, as described, for example, with reference to Figures 3 and 8 in the third embodiment.
[0268] The image synthesis unit 90 constructs a three-dimensional image by synthesizing a plurality of image regions (a plurality of slit light irradiation regions) extracted from a plurality of images by the image region extraction unit 89. The image synthesis unit 90 includes, for example, a process of embedding the plurality of slit light irradiation regions in a single three-dimensional coordinate system, and may further include a process of processing the embedded plurality of slit light irradiation regions. For example, the processing of the plurality of slit light irradiation regions can include noise removal, noise reduction, voxelization, and the like.
[0269] Before combining the multiple slit beam irradiation regions, the relative positions of the multiple slit beam irradiation regions may be determined by applying the processing according to the sixth embodiment.
[0270] The image region extracting unit 89 may be configured to extract an image region corresponding to both the slit light irradiation region and a predetermined region of the anterior eye from each of the multiple images. The predetermined region of the anterior eye may be, for example, a region defined by the anterior surface of the cornea and the posterior surface of the lens.
[0271] For example, image region extraction unit 89 first specifies the slit light irradiation region by threshold processing of luminance information, and then specifies an image region corresponding to the anterior surface of the cornea and an image region corresponding to the posterior surface of the lens by segmentation.
[0272] Next, the image area extraction unit 89 identifies an image area (target image area) corresponding to the area defined by the anterior surface of the cornea and the posterior surface of the lens based on the image area corresponding to the anterior surface of the cornea and the image area corresponding to the posterior surface of the lens.
[0273] Next, the image region extraction unit 89 identifies a common region between the slit-light irradiation region and the target image region, that is, an image region included in both the slit-light irradiation region and the target image region, thereby identifying a two-dimensional image region (cross section) or a three-dimensional image region (slice) in the target image that corresponds to the slit-light irradiation region, for example, in the range from the anterior surface of the cornea to the posterior surface of the lens.
[0274] In this example, image synthesis is performed after extraction of the slit-light irradiation area, but the opposite may be true: extraction of the slit-light irradiation area may be performed after image synthesis. In addition, the extracted image area is not limited to the slit-light irradiation area, and the predetermined area is not limited to the area from the anterior surface of the cornea to the posterior surface of the lens.
[0275] According to this configuration, a 3D image of a desired part of the anterior eye can be obtained from a plurality of images obtained by scanning the anterior eye using slit light. In particular, a 3D image showing the slit light irradiation area, which is the main observation target in slit lamp microscopy, can be constructed, and further, a 3D image showing the part from the anterior surface of the cornea to the posterior surface of the lens, which is the main observation target of the anterior eye, can be constructed.
[0276] Eighth embodiment In this embodiment, rendering of a three-dimensional image constructed in the third to seventh embodiments will be described.
[0277] 14 includes a three-dimensional image construction unit 91 and a rendering unit 92. The three-dimensional image construction unit 91 may be, for example, any one of the three-dimensional image construction unit 82 of the third embodiment, the three-dimensional image construction unit 84 of the fourth embodiment, the three-dimensional image construction unit 85 of the fifth embodiment, the three-dimensional image construction unit 86 of the sixth embodiment, and the three-dimensional image construction unit 88 of the seventh embodiment.
[0278] The rendering unit 92 renders the three-dimensional image constructed by the three-dimensional image construction unit 91 to construct a new image (rendered image).
[0279] Rendering may be any process, including, for example, 3D computer graphics, which is a computational technique for creating a three-dimensional image by converting virtual solid objects (3D images such as stack data and volume data) in a three-dimensional space defined by a three-dimensional coordinate system into two-dimensional information.
[0280] Examples of rendering include volume rendering, maximum intensity projection (MIP), minimum intensity projection (MIP), surface rendering, multiplanar reconstruction (MPR), projection image construction, shadowgram construction, etc. Further examples of rendering include reproducing cross-sectional images obtained with a slit lamp microscope, forming a Scheimpflug image, etc. Additionally, the rendering unit 92 may be capable of performing any processing applied in conjunction with such rendering.
[0281] The rendering unit 92 can specify a region corresponding to a predetermined site in the three-dimensional image of the anterior eye. For example, the rendering unit 92 can specify a region corresponding to the anterior surface of the cornea, a region corresponding to the posterior surface of the cornea, a region corresponding to the anterior surface of the lens, a region corresponding to the posterior surface of the lens, etc. For such image region specification, known image processing such as segmentation, edge detection, threshold processing, etc. is applied.
[0282] The three-dimensional image is typically stack data or volume data. The cross section of the three-dimensional image is specified manually or automatically.
[0283] When a cross section of a three-dimensional image is manually specified, the rendering unit 92 renders the three-dimensional image to construct a display image for manual cross section specification. The display image is typically an image that represents the entire area to be observed, for example, a region from the anterior surface of the cornea to the posterior surface of the lens. The rendering for constructing the display image is typically volume rendering or surface rendering.
[0284] The control unit 7 causes the display image constructed by the rendering unit 92 to be displayed on a display device (not shown). The user specifies a desired cross section on the display image using an operation device such as a pointing device. Position information of the cross section specified on the display image is input to the rendering unit 92.
[0285] Since the display image is a rendered image of a three-dimensional image, there is an obvious positional correspondence between the display image and the three-dimensional image. Based on this correspondence, the rendering unit 92 specifies the position of a cross section in the three-dimensional image that corresponds to the position of the cross section specified in the display image. In other words, the rendering unit 92 specifies a cross section for the three-dimensional image.
[0286] Furthermore, the rendering unit 92 can cut the three-dimensional image at the cross section to construct a three-dimensional partial image. The rendering unit 92 can render the three-dimensional partial image to construct an image for display. Examples of such rendering, examples of three-dimensional partial images, and examples of images for display based on the three-dimensional partial images will be described later.
[0287] When the cross section of the three-dimensional image is automatically specified, for example, the data processing unit 8E (for example, the rendering unit 92) can analyze the three-dimensional image to identify a position or area corresponding to a predetermined part of the anterior eye. For example, it is possible to identify the anterior surface of the cornea, the apex position of the anterior surface of the cornea, the posterior surface of the lens, and the apex position of the posterior surface of the lens.
[0288] Furthermore, the data processing unit 8E (e.g., the rendering unit 92) can apply segmentation to the three-dimensional image to specify image regions corresponding to predetermined parts. For example, it is possible to specify a two-dimensional region corresponding to the anterior surface of the cornea, a three-dimensional region corresponding to the cornea, a three-dimensional region corresponding to the crystalline lens, a three-dimensional region corresponding to the posterior surface of the crystalline lens, a three-dimensional region corresponding to the anterior chamber, and the like.
[0289] The data processing unit 8E (e.g., the rendering unit 92) can specify a cross section for the three-dimensional image based on the position or region specified in this way. For example, it is possible to specify a plane passing through the vertex position of the anterior cornea and the vertex position of the posterior lens as a cross section, or to specify a curved surface corresponding to the anterior lens as a cross section.
[0290] When a cross section is specified for a three-dimensional image, the rendering unit 92 can construct an image that is not limited to a three-dimensional partial image. For example, when a cross section is specified for a three-dimensional image, the rendering unit 92 can construct a two-dimensional cross-sectional image that represents the cross section. Examples of such rendering, examples of two-dimensional cross-sectional images, and examples of display images based on the two-dimensional cross-sectional images will be described later.
[0291] Position information that can be specified for a three-dimensional image is not limited to a cross section, which is a planar or curved two-dimensional region. Another example of position information that can be specified for a three-dimensional region is a slice. A slice is a three-dimensional region having a predetermined thickness, and is typically a thin slice having a uniform thickness.
[0292] When a slice is specified for a three-dimensional image, the rendering unit 92 can construct a three-dimensional slice image corresponding to the slice. The rendering unit 92 can render the three-dimensional slice image to construct an image for display. Examples of such rendering, examples of three-dimensional slice images, examples of images for display based on the three-dimensional slice images, etc. will be described later.
[0293] The effects achieved by this embodiment will be described.
[0294] This embodiment includes a rendering unit 92 that constructs a rendering image by rendering the three-dimensional image constructed by the three-dimensional image construction unit 91. This makes it possible to display a rendering image based on the three-dimensional image constructed by the three-dimensional image construction unit 91, and to observe a desired site of the anterior eye.
[0295] Any rendering method may be used. For example, when a cross section is specified for a three-dimensional image, the rendering unit 92 can cut the three-dimensional image at the cross section to construct a three-dimensional partial image. This allows a desired cross section of the anterior eye segment to be observed, and also allows the three-dimensional morphology of the anterior eye segment to be grasped.
[0296] In another example, when a cross section is specified for a three-dimensional image, the rendering unit 92 can construct a two-dimensional cross-sectional image representing the cross section, thereby making it possible to observe a desired cross section of the anterior segment.
[0297] In yet another example, when a slice is specified for a three-dimensional image, the rendering unit 92 can construct a three-dimensional slice image corresponding to the slice, thereby making it possible to view a desired slice of the anterior segment.
[0298] Ninth embodiment In the slit lamp microscopes according to the first to eighth embodiments, the illumination optical axis and the imaging optical axis form a predetermined angle, and the illumination system and the imaging system function as a Scheimpflug camera. Images obtained by such slit lamp microscopes are accompanied by distortion. This distortion is typically trapezoidal distortion.
[0299] In this embodiment, distortion correction will be described. This distortion correction is typically trapezoid correction (keystone correction). Trapezoid correction is a well-known technique and is disclosed in, for example, JP 2017-163465 A (US Patent Application Publication No. 2017 / 0262163).
[0300] As described above, in the anterior segment (i.e., in real space), the slit light irradiation area has an extension in the Z direction, and is typically defined in the YZ plane if the slit width is ignored. Meanwhile, the optical axis of the imaging system is inclined in the X direction with respect to the optical axis of the illumination system that irradiates the slit light. Therefore, the imaging target area of the anterior segment is rendered larger as it approaches the surface of the subject's eye, and smaller as it approaches the fundus. Therefore, trapezoidal distortion occurs (at least) in the Z direction.
[0301] 15 includes a distortion correction unit 93. The distortion correction unit 93 can be combined with any of the first to eighth embodiments. The distortion correction unit 93 applies distortion correction to an anterior eye image acquired by the imaging system 3 (left imaging system 30L, right imaging system 30R).
[0302] More specifically, the distortion correction unit 93 applies processing (keystone correction) for correcting distortion caused by the optical axis angle θ (θL, θR), which is the angle between the illumination optical axis 2a (20a) and the imaging optical axis 3a (30La, 30Ra), to at least one of the multiple images acquired by the imaging system 3 (30L, 30R) in parallel with the movement of the illumination system 2 (20) and the imaging system 3 (30L, 30R).
[0303] The image to which the distortion correction is applied is not limited to the anterior-segment image itself acquired by the imaging system 3 (30L, 30R), and may be a slit-light irradiation area extracted from the anterior-segment image acquired by the imaging system 3 (30L, 30R). Therefore, the slit-light irradiation area may be extracted after correcting the distortion of the anterior-segment image, or conversely, the slit-light irradiation area may be extracted from the anterior-segment image and then the distortion of this slit-light irradiation area may be corrected.
[0304] Also, like the "image group" in the third and fourth embodiments, this includes correcting distortion of an anterior-segment image selected from the anterior-segment images acquired by the imaging system 3 (30L, 30R) and correcting distortion of an image obtained by processing the anterior-segment image acquired by the imaging system 3 (30L, 30R). Therefore, the anterior-segment image may be selected or processed after the distortion of the anterior-segment image is corrected, or the selected or processed image may be corrected for distortion.
[0305] In a typical embodiment, the slit lamp microscope includes the optical system shown in FIG. 1 or FIG. 5, and distortion in the YZ plane is corrected by the distortion correction unit 93.
[0306] In the example shown in Fig. 1, the imaging optical axis 3a is arranged to be inclined with respect to the illumination optical axis 2a in a third direction (X direction) perpendicular to both a first direction (Z direction) along the illumination optical axis 2a and a second direction (Y direction) along the longitudinal direction of the slit light. Here, the optical axis angle between the illumination optical axis 2a and the imaging optical axis 3a is the angle θ shown in Fig. 1. The distortion correction unit 93 can apply a process for correcting distortion in a plane (YZ plane) including both the first direction (Z direction) and the second direction (Y direction) to the anterior eye image acquired by the imaging system 3.
[0307] In the example shown in Fig. 5, the left photographing optical axis 30La is inclined in a third direction (X direction) perpendicular to both the first direction (Z direction) along the illumination optical axis 20a and the second direction (Y direction) along the longitudinal direction of the slit light with respect to the illumination optical axis 20a. Here, the optical axis angle between the illumination optical axis 20a and the left photographing optical axis 30La is the angle θL shown in Fig. 5. The distortion correction unit 93 can apply a process for correcting distortion in a plane (YZ plane) including both the first direction (Z direction) and the second direction (Y direction) to the anterior eye image acquired by the left photographing optical axis 30La.
[0308] Similarly, the right photographing optical axis 30Ra is inclined in a third direction (X direction) perpendicular to both the first direction (Z direction) along the illumination optical axis 20a and the second direction (Y direction) along the longitudinal direction of the slit light with respect to the illumination optical axis 20a. Here, the optical axis angle between the illumination optical axis 20a and the right photographing optical axis 30Ra is the angle θR shown in Fig. 5. The distortion correction unit 93 can apply a process for correcting distortion in a plane (YZ plane) including both the first direction (Z direction) and the second direction (Y direction) to the anterior eye image acquired by the right photographing optical axis 30Ra.
[0309] A typical keystone correction is performed to return a trapezoidal shape that has been distorted into a rectangle to the original rectangle. In this embodiment, it is possible to apply such a standard keystone correction, but as described below, it may be effective to apply other keystone correction methods.
[0310] In general, when observing an optical slice of the anterior eye (i.e., a slit light irradiation area) using a slit lamp microscope, the optical axis of the observation system (observation optical axis) is tilted relative to the optical axis of the illumination system (illumination optical axis). Thus, the user observes the optical slice extending in the Z direction from an oblique angle. In this case, the angle (observation angle) between the illumination optical axis and the observation optical axis is typically a preset value (e.g., 17.5 degrees, 30 degrees, or 45 degrees). This preset value is called the reference angle (α).
[0311] A correction coefficient for distortion correction (keystone correction) can be set based on the reference angle α and the optical axis angle β (θ, θL, θR). A correction coefficient is set for at least one reference angle α and at least one optical axis angle β (θ, θL, θR). It is also possible to set a correction coefficient for each combination of two or more reference angles and one optical axis angle, to set a correction coefficient for each combination of one reference angle and two or more optical axis angles, or to set a correction coefficient for each combination of two or more reference angles and two or more optical axis angles. In general, it is possible to set a discrete or continuous correction coefficient C (α, β) with one or both of the reference angle α and the optical axis angle β as variables.
[0312] The correction coefficients C(α, β) set in this manner are stored in the distortion correction unit 93. The distortion correction unit 93 can execute processing for correcting distortion based on the correction coefficients C(α, β).
[0313] When the correction coefficient C(α, β) provides multiple values, the distortion correction unit 93 or the user designates one or both of the reference angle α and the optical axis angle β. The distortion correction unit 93 applies a correction coefficient according to the result of this designation. This configuration is applied, for example, when a slit lamp microscope in which the optical axis angle β is variable is used, and a table or graph showing multiple correction coefficients within the variable range of the optical axis angle β is prepared.
[0314] Instead of preparing information indicating the correction coefficient, the following configuration can be applied. That is, the distortion correction unit of this example stores in advance a predetermined arithmetic expression for calculating the correction coefficient. Furthermore, the distortion correction unit of this example receives an input of the reference angle α and / or the optical axis angle β, and calculates the correction coefficient by substituting this input value into the arithmetic expression. The distortion correction unit of this example performs distortion correction using the calculated correction coefficient.
[0315] The effects achieved by this embodiment will be described.
[0316] This embodiment includes a distortion correction unit 93. In the configuration shown in Fig. 1, the distortion correction unit 93 can apply processing to at least one of a plurality of images acquired by the imaging system 3 repeatedly capturing images in parallel with the movement of the illumination system 2 and the imaging system 3 by the moving mechanism 6, in order to correct distortion caused by the optical axis angle θ, which is the angle between the optical axis 2a of the illumination system 2 and the optical axis 3a of the imaging system 3. The same applies to the case where the configuration shown in Fig. 5 or another configuration is adopted.
[0317] According to this configuration, it is possible to provide a preferable image in which the distortion caused by the optical axis angle θ is corrected.
[0318] In the configuration shown in Fig. 1, the optical axis 3a of the optical system 4 included in the imaging system 3 is arranged to be inclined in a third direction (X direction) perpendicular to both the first direction (Z direction) along the optical axis 2a of the illumination system 2 and the second direction (Y direction) along the longitudinal direction of the slit light, with respect to the optical axis 2a of the illumination system 2. The distortion correction unit 93 can execute a process for correcting distortion in a plane (YZ plane) including both the first and second directions. The same applies when the configuration shown in Fig. 5 or another configuration is adopted.
[0319] According to such a configuration, trapezoidal distortion occurs in a plane including both the first direction and the second direction, but this can be corrected.
[0320] In the configuration shown in Fig. 1, the distortion correction unit 93 prestores a correction coefficient C that is set based on a predetermined reference angle α and the optical axis angle θ. The distortion correction unit 93 can apply processing to the image for correcting distortion caused by the optical axis angle θ based on this correction coefficient C. The same applies when the configuration shown in Fig. 5 or another configuration is adopted.
[0321] Tenth embodiment In slit lamp microscopy, the size and shape of tissue, the positional relationship between tissues, etc. may be referred to. In this embodiment, measurements for this purpose will be described.
[0322] 16 includes a measurement unit 94. The measurement unit 94 can be combined with any of the first to ninth embodiments.
[0323] When a measurement unit 94 is combined with the slit lamp microscope according to the first to ninth embodiments, the measurement unit 94 can determine predetermined measurement values by analyzing an anterior segment image acquired by scanning the anterior segment using slit light.
[0324] When the measurement unit 94 is combined with a slit lamp microscope capable of constructing a three-dimensional image, the measurement unit 94 can determine specified measurement values by analyzing the three-dimensional image constructed by the three-dimensional image construction unit 82 (84, 85, 86, 88, 91).
[0325] The measurements may be performed, for example, on parameters indicative of the morphology of tissues (thickness, diameter, area, volume, angle, shape, etc.), parameters indicative of relationships between tissues (distance, direction, etc.), etc. Analysis for the measurements may include, for example, segmentation to identify tissues or their contours.
[0326] According to this embodiment, it is possible to measure parameters that are effective for observing and diagnosing the anterior segment.
[0327] By combining the ninth embodiment capable of executing distortion correction with the measurement unit 94, it is possible to perform measurements based on images to which distortion correction has been applied, which makes it possible to improve measurement accuracy and measurement precision.
[0328] Eleventh embodiment When a slit lamp microscope has a function for capturing video of the anterior segment from a fixed position in parallel with scanning the anterior segment using slit light, like the video recording system 40 of the second embodiment, the function according to this embodiment can be further added.
[0329] The control unit 7A of this embodiment includes a movement control unit 71, and the data processing unit 8H includes a motion detection unit 95. This embodiment also includes a video capture system 40. The video capture system 40 captures video of the anterior eye segment from a fixed position in parallel with an anterior eye segment scan using slit light.
[0330] The movement detection unit 95 analyzes the moving images acquired by the moving image capturing system 40 to detect the movement of the subject's eye E. This movement detection is performed in parallel with the moving image capturing system 40.
[0331] For example, the motion detection unit 95 first analyzes frames sequentially input from the video capture system 40 to identify an image area corresponding to a predetermined part. The predetermined part may typically be the center, center of gravity, or contour of the pupil. The image area is identified based on luminance information assigned to pixels. The motion detection unit 95 can identify a low-luminance image area in the image of the anterior eye as the pupil area, and identify the center of gravity or contour of this pupil area. Alternatively, the motion detection unit 95 can obtain an approximate circle or ellipse of the pupil area, and identify its center or contour.
[0332] In this way, the motion detection unit 95 sequentially detects feature points in the frames input from the video capture system 40. Furthermore, the motion detection unit 95 detects the time change in the position of the sequentially identified feature points. Since the video capture system 40 is fixedly disposed, the motion detection unit 95 can detect the motion of the subject's eye E (in real time) by such processing.
[0333] The movement control unit 71 can control the movement mechanism 6 based on the output from the movement detection unit 95. More specifically, the movement detection unit 95 sequentially inputs information indicating a time change in the position of a feature point in frames sequentially input from the video shooting system 40 to the movement control unit 71. The movement control unit 71 controls the movement mechanism 6 according to the information sequentially input from the movement detection unit 95. This movement control is executed so as to cancel a change in the alignment state caused by the movement of the subject's eye E. Such an operation is called tracking.
[0334] According to this embodiment, when the subject's eye E moves during an anterior eye scan using the slit light, the alignment state is automatically corrected according to the movement. This makes it possible to perform an anterior eye scan using the slit light without being affected by the movement of the subject's eye.
[0335] <Usage form> An exemplary usage form of the slit lamp microscope according to the embodiment will be described. Here, the optical system shown in Fig. 5 is applied. Adjustment of the table, chair, and chin rest, instructions to start shooting, alignment, etc. are performed in the manner described above.
[0336] First, as described in the sixth embodiment, the control unit 7 controls the rotation mechanism 62 so that the longitudinal direction of the slit light irradiated to the anterior eye segment coincides with the left-right direction (X direction). The left imaging system 30L or the right imaging system 30R images the anterior eye segment irradiated with the slit light in that direction.
[0337] This results in the acquisition of an anterior-segment image H0 shown in Fig. 18. The anterior-segment image H0 includes a slit-light irradiation region J0 that is an area irradiated with a slit light having a longitudinal direction in the left-right direction (X direction).
[0338] Both the left imaging system 30L and the right imaging system 30R may capture images of the anterior segment of the eye. In this case, an image of the slit light irradiation area captured from an obliquely upper side and an image of the slit light irradiation area captured from an obliquely lower side are obtained.
[0339] Next, the control unit 7 controls the rotation mechanism 62 so that the longitudinal direction of the slit light irradiated to the anterior eye portion coincides with the up-down direction (Y direction). The control unit 7 controls the illumination system 20, the left photographing system 30L, the right photographing system 30R, and the moving mechanism 6 so as to execute an anterior eye scan using the slit light. That is, the left photographing system 30L and the right photographing system 30R each repeatedly photograph the anterior eye portion of the subject's eye E in parallel with the movement of the illumination system 20, the left photographing system 30L, and the right photographing system 30R by the moving mechanism 6.
[0340] As a result, the left photographing system 30L acquires a first image group including N anterior-segment images HL1-HLN shown in Fig. 19A, and the right photographing system 30R acquires a second image group including N anterior-segment images HR1-HRN shown in Fig. 19B. The anterior-segment image HLn acquired by the left photographing system 30L depicts a slit-light irradiated region JLn photographed diagonally from the left (n=1, 2,...,N). The anterior-segment image HRn acquired by the right photographing system 30R depicts a slit-light irradiated region JRn photographed diagonally from the right (n=1, 2,...,N).
[0341] Here, it is assumed that the anterior eye image HLn and the anterior eye image HRn are associated with each other by the above-mentioned image pairing (n=1, 2, . . . , N). In an actual anterior eye scan, the number N of each of the left and right anterior eye images is set to 200 or more, taking into consideration the resolution of a three-dimensional image that will be constructed later. Note that the number N is arbitrary.
[0342] Figure 20 shows anterior segment images acquired during an actual anterior segment scan, each of which includes a slit-light-illuminated area presented at a high intensity.
[0343] Next, the image region extraction unit 89 of the seventh embodiment (FIG. 13) extracts the slit light irradiation region JLn from the anterior eye image HLn, and extracts the slit light irradiation region JRn from the anterior eye image HRn. FIG 21A shows a plurality of slit light irradiation region images KL1-KLN respectively constructed from the plurality of anterior eye images HL1-HLN. FIG 21B shows a plurality of slit light irradiation region images KR1-KRN respectively constructed from the plurality of anterior eye images HR1-HRN.
[0344] Next, by applying the processing according to the third or fourth embodiment to the slit light irradiation area image KLn and the slit light irradiation area image KRn, multiple slit light irradiation area images containing no artifacts are obtained. None of the multiple slit light irradiation area images K1 to KN illustrated in Fig. 22 contains artifacts. The slit light irradiation area images K1 to KN each contain the slit light irradiation areas J1 to JN.
[0345] Next, the distortion correction (keystone correction) described in the ninth embodiment is applied to each of the slit light irradiation area images K1 to KN. This results in multiple slit light irradiation area images that are free of artifacts and have corrected distortion. None of the multiple slit light irradiation area images P1 to PN shown in Fig. 23 include artifacts. Furthermore, the slit light irradiation area images P1 to PN each include the slit light irradiation areas Q1 to QN.
[0346] Next, the image position determination part 87 of the sixth embodiment determines the relative positions of the multiple slit light irradiation area images P1 to PN based on the anterior eye image H0 shown in Fig. 18. For example, the image position determination part 87 arranges the slit light irradiation area images P1 to PN based on the image area (the curve with the smaller radius of curvature in the slit light irradiation area J0) corresponding to the anterior corneal surface depicted in the anterior eye image H0. This allows the slit light irradiation area images P1 to PN to be arranged in accordance with the curve of the anterior corneal surface.
[0347] The three-dimensional image constructing unit 86 of the sixth embodiment constructs a three-dimensional image based on a plurality of slit light irradiation area images P1 to PN arranged according to the curve of the anterior surface of the cornea. This three-dimensional image does not include artifacts and has its distortion corrected.
[0348] Next, the data processing unit 8 corrects the aspect ratio of the three-dimensional image based on the length (dimension in the Y direction) of the slit light projected onto the anterior segment during anterior segment scanning and the movement distance (dimension in the X direction) of the slit light by the movement mechanism 6. This corrects the ratio between the dimension in the X direction and the dimension in the Y direction of the three-dimensional image.
[0349] Next, the measurement unit 94 of the tenth embodiment analyzes the three-dimensional image to obtain predetermined measurement values. Examples of the measurement parameters include the anterior corneal curvature, the anterior corneal curvature radius, the posterior corneal curvature, the posterior corneal curvature radius, the corneal diameter, the corneal thickness, the corneal topography, the anterior chamber depth, the angle, the anterior lens curvature, the anterior lens curvature radius, the posterior lens curvature radius, the posterior lens curvature radius, the lens thickness, and the like.
[0350] 24 shows a display image R0 obtained by volume rendering an actually acquired three-dimensional image. The rendering is performed by the rendering unit 92 of the eighth embodiment. The control unit 7 causes the display image R0 to be displayed on a display device (not shown). The display image R0 depicts an area defined by the anterior surface of the cornea and the posterior surface of the lens.
[0351] The user can observe the display image R0 displayed on the display device and specify a desired cross section using an operation device (not shown). The dotted line shown in Fig. 25 indicates the position of the cross section specified by the user with respect to the display image R0.
[0352] The rendering unit 92 can construct a three-dimensional partial image by cutting the three-dimensional image at a cross section specified by the user. Image R1 shown in Fig. 26 is a display image obtained by rendering a three-dimensional partial image obtained by cutting the three-dimensional image at the cross section shown in Fig. 25. This display image is also called three-dimensional partial image R1. Three-dimensional partial image R1 is an image representing a three-dimensional region of the anterior eye, with the cross section shown in Fig. 25 as a part of the outer surface.
[0353] Furthermore, the rendering unit 92 can construct a two-dimensional cross-sectional image that represents a cross section specified by a user. Image R2 shown in Fig. 27 is a two-dimensional cross-sectional image obtained by cutting the three-dimensional image at the cross section shown in Fig. 25.
[0354] A user can observe the display image R0 displayed on the display device and specify a desired slice using an operation device (not shown). The two dotted lines shown in Fig. 28 indicate the positions of two cross sections that define the slice specified by the user for the display image R0. In other words, the area between these two cross sections is the slice specified by the user for the display image R0.
[0355] The rendering unit 92 can construct a three-dimensional slice image corresponding to a slice specified by a user. An image R3 shown in Fig. 29 is a display image obtained by rendering a three-dimensional slice image obtained by cutting the three-dimensional image at the cross section shown in Fig. 28. This display image is also called a three-dimensional slice image R3. The three-dimensional slice image R3 is an image representing a three-dimensional region of the anterior eye, with the two cross sections shown in Fig. 28 as a part of the outer surface.
[0356] The user can understand the condition of the anterior segment by rendering a 3D image, observing the outer surface of the anterior segment and a desired cross section, and performing the measurement of the tenth embodiment. Then, an interpretation report can be created.
[0357] Twelfth embodiment In this embodiment, an ophthalmic system including an ophthalmic imaging apparatus and an information processing apparatus will be described. The ophthalmic imaging apparatus has at least a function as a slit lamp microscope. The slit lamp microscope included in the ophthalmic imaging apparatus may be any of the slit lamp microscopes of the first to eleventh embodiments. Hereinafter, the elements, configurations, and symbols described in the first to eleventh embodiments will be applied mutatis mutandis as appropriate.
[0358] The ophthalmologic system 1000 illustrated in FIG. 30 is constructed using a communication path (communication line) 1100 connecting each of T facilities (facility 1 to facility T) where ophthalmologic photography is performed, a server 4000, and a remote terminal 5000m.
[0359] Here, the ophthalmic photography includes at least anterior eye photography using a slit lamp microscope, which includes at least anterior eye scanning using slit light as described in the first to eleventh embodiments.
[0360] Each facility (the tth facility: t=1 to T, T is an integer equal to or greater than 1) includes an ophthalmic imaging device 2000-i t (i t =1~K t , K tIn other words, each facility (the tth facility) is equipped with one or more ophthalmic imaging devices 2000-i t The Ophthalmic Imaging Device 2000-i is installed. t constitute a part of the ophthalmologic system 1000. Note that the ophthalmologic system 1000 may also include an examination device capable of performing examinations other than ophthalmologic examinations.
[0361] The ophthalmic imaging device 2000-i in this example t has both the function of an "imaging device" that takes an image of the subject's eye and the function of a "computer" that processes various data and communicates with external devices. In another example, the imaging device and the computer can be provided separately. In this case, the imaging device and the computer can be configured to be able to communicate with each other. Furthermore, the number of imaging devices and the number of computers are each arbitrary, and for example, a single computer and a plurality of imaging devices can be provided.
[0362] Ophthalmic Imaging Device 2000-i t The "imaging device" in includes at least a slit lamp microscope. This slit lamp microscope may be any of the slit lamp microscopes of the first to eleventh embodiments, and includes at least the configuration of the first embodiment (FIG. 1) or the configuration of the second embodiment (FIG. 5).
[0363] Furthermore, each facility (t-th facility) is provided with an information processing device (terminal 3000-t) that can be used by assistants and subjects. The terminal 3000-t is a computer used in the facility, and may be, for example, a mobile terminal such as a tablet terminal or a smartphone, or a server installed in the facility. Furthermore, the terminal 3000-t may include a wearable device such as wireless earphones. Note that the terminal 3000-t is sufficient as long as it is a computer whose functions can be used in the facility, and may be, for example, a computer (cloud server, etc.) installed outside the facility.
[0364] Ophthalmic Imaging Device 2000-i tThe terminal 3000-t may be configured to be able to communicate with the terminal 3000-t using a network (such as an in-facility LAN) established within the t-th facility, a wide area network (such as the Internet), or a short-range communication technology.
[0365] Ophthalmic Imaging Device 2000-i t may have a function as a communication device such as a server. t The server 4000 and the terminal 3000-t can be configured to directly communicate with each other. t Since the communication can be performed via the above, it is not necessary to provide a function for communicating between the terminal 3000-t and the server 4000.
[0366] The server 4000 is typically installed in a facility different from any of the first to Tth facilities, for example, in a management center. The server 4000 can communicate with a remote terminal 5000m (m=1 to M, M is an integer equal to or greater than 1) via a network (LAN, wide area network, etc.). Furthermore, the server 4000 can transmit and receive the ophthalmic photographing apparatuses 2000-i installed in the first to Tth facilities. t and at least some of the above may be communicated with each other via a wide area network.
[0367] The server 4000 includes, for example, an ophthalmic imaging device 2000-i t and a remote terminal 5000m, a function for recording the contents of this communication, and t and a function for storing data and information acquired by the remote terminal 5000m. The server 4000 may be provided with a data processing function.
[0368] The remote terminal 5000m is an ophthalmic imaging device 2000-i tThe remote terminal 5000m may include a computer that can be used to interpret images of the subject's eye acquired by the remote terminal 5000m (multiple anterior segment images or a three-dimensional rendering image based on these images) and to generate reports.
[0369] The following describes the server 4000. The server 4000 illustrated in FIG.
[0370] The control unit 4010 executes control of each unit of the server 4000. The control unit 4010 may be capable of executing other arithmetic processing. The control unit 4010 includes a processor. The control unit 4010 may further include a RAM, a ROM, a hard disk drive, a solid state drive, etc.
[0371] The control unit 4010 includes a communication control unit 4011 and a transfer control unit 4012 .
[0372] The communication control unit 4011 controls the plurality of ophthalmic photographing apparatuses 2000-i t The communication control unit 4011 executes control related to the establishment of communication between a plurality of devices including the plurality of terminals 3000-t and a plurality of remote terminals 5000m. For example, the communication control unit 4011 transmits control signals for establishing communication to each of two or more devices selected by a selection unit 4120 described later from among the plurality of devices included in the ophthalmologic system 1000.
[0373] The transfer control unit 4012 controls the exchange of information between two or more devices with which communication has been established by the communication establishment unit 4100 (and the communication control unit 4011). For example, the transfer control unit 4012 functions to transfer information transmitted from one of at least two devices with which communication has been established by the communication establishment unit 4100 (and the communication control unit 4011) to the other device.
[0374] As a specific example, the ophthalmic imaging device 2000-i tWhen communication between the ophthalmic imaging apparatus 2000-i and the remote terminal 5000m is established, the transfer control unit 4012 t The transfer control unit 4012 can transfer information transmitted from the remote terminal 5000m (for example, a plurality of anterior eye images obtained by an anterior eye scan using a slit light, or a three-dimensional image constructed based on these anterior eye images) to the remote terminal 5000m. t instructions to the ophthalmic imaging device 2000-i t can be forwarded to.
[0375] The transfer control unit 4012 may have a function of processing information received from a source device. In this case, the transfer control unit 4012 can transmit at least one of the received information and information obtained by processing to a destination device.
[0376] For example, the transfer control unit 4012 transfers the ophthalmic imaging apparatus 2000-i t etc., and transmit a part of the information transmitted from the remote terminal 5000m etc. to the remote terminal 5000m etc. t The information (e.g., an anterior eye image or a three-dimensional image) transmitted from the remote terminal 5000m or the like may be analyzed by the server 4000 or other device, and the analysis results (and the original information) may be transmitted to the remote terminal 5000m or the like.
[0377] Ophthalmic Imaging Device 2000-i t When multiple anterior eye images are transmitted from the remote terminal 5000m, the server 4000 or other device can be configured to construct a three-dimensional image (e.g., stack data or volume data) from these anterior eye images, and the transfer control unit 4012 can be configured to transmit the constructed three-dimensional image to the remote terminal 5000m.
[0378] Ophthalmic Imaging Device 2000-i tWhen stack data is transmitted from the remote terminal 5000m, the server 4000 or other device can be configured to construct volume data from the stack data, and the transfer control unit 4012 can be configured to transmit the constructed volume data to the remote terminal 5000m.
[0379] The data processing that can be performed by the server 4000 or other devices is not limited to the above examples and may include any data processing. For example, the server 4000 or other devices may be capable of performing any processing described in the first to eleventh embodiments, such as three-dimensional image rendering, artifact removal, distortion correction, and measurement.
[0380] The communication establishment unit 4100 is a communication unit for establishing a communication between the plurality of ophthalmic photographing apparatuses 2000-i t and executes a process for establishing communication between at least two devices selected from a plurality of devices including the plurality of terminals 3000-t and a plurality of remote terminals 5000m. In this embodiment, "establishing communication" is a concept including at least one of, for example, (1) establishing one-way communication from a state in which communication is cut off, (2) establishing two-way communication from a state in which communication is cut off, (3) switching from a state in which only reception is possible to a state in which transmission is also possible, and (4) switching from a state in which only transmission is possible to a state in which reception is also possible.
[0381] Furthermore, the communication establishment unit 4100 can execute a process of disconnecting established communication. In this embodiment, "disconnecting communication" is a concept including at least one of, for example, (1) disconnecting communication from a state in which one-way communication is established, (2) disconnecting communication from a state in which two-way communication is established, (3) switching from a state in which two-way communication is established to a state in which one-way communication is established, (4) switching from a state in which both transmission and reception are possible to a state in which only reception is possible, and (5) switching from a state in which both transmission and reception are possible to a state in which only transmission is possible.
[0382] Ophthalmic Imaging Device 2000-i tEach of the terminals 3000-i, 3000-t, and 5000m can transmit to the server 4000 at least one of a communication request (call request) for calling another device (its user) and a communication request (interrupt request) for interrupting communication between the other two devices. The call request and the interrupt request are sent manually or automatically. The server 4000 (communication unit 4200) transmits the ophthalmic imaging devices 2000-i, 2000-t, 3000-m, and 5000m to the server 4000. t , a communication request transmitted from the terminal 3000-t or the remote terminal 5000m.
[0383] In this embodiment, the communication establishment unit 4100 may include a selection unit 4120. The selection unit 4120 may select, for example, the ophthalmic imaging device 2000-i t , the ophthalmic photographing apparatus 2000-i based on a communication request transmitted from the terminal 3000-t or the remote terminal 5000m. t , terminal 3000-t, and remote terminal 5000m, select one or more devices other than the device that has transmitted the communication request.
[0384] A specific example of the process executed by the selection unit 4120 will be described. t Or a communication request from the terminal 3000-t (e.g., the ophthalmic imaging device 2000-i t When a request for interpretation of an image acquired by the ophthalmologic imaging device 2000-i is received, the selection unit 4120 selects, for example, one of the multiple remote terminals 5000m. The communication establishment unit 4100 establishes a connection between the selected remote terminal 5000m and the ophthalmologic imaging device 2000-i. t and establish communication between at least one of the terminals 3000-t and 3000-i.
[0385] The selection of a device in response to a communication request is performed, for example, based on a preset attribute. Examples of the attribute include the type of examination (e.g., type of imaging modality, type of image, type of disease, type of candidate disease, etc.), the required level of expertise and proficiency, and type of language. In order to realize the process according to this example, the communication establishment unit 4100 may include a storage unit 4110 in which pre-created attribute information is stored. The attribute information records attributes of the remote terminal 5000m and / or its user (doctor, optometrist, etc.).
[0386] A user is identified by a pre-assigned user ID. A remote terminal 5000m is identified by, for example, a pre-assigned device ID or network address. In a typical example, the attribute information includes, as attributes of each user, a specialty (e.g., medical department, specialized disease, etc.), a degree of specialty / proficiency, a type of language that can be used, etc.
[0387] When the selection unit 4120 refers to the attribute information, the ophthalmic photographing apparatus 2000-i t A communication request sent from the terminal 3000-t or the remote terminal 5000m may include information about the attributes. t The image interpretation request (i.e., diagnosis request) transmitted from the ophthalmologic imaging device 2000-i may include any of the following information: (1) information indicating the type of imaging modality; (2) information indicating the type of image; (3) information indicating the name of a disease or a candidate disease; (4) information indicating the difficulty of image interpretation; and (5) information indicating the type of image interpretation of the ophthalmologic imaging device 2000-i. t and / or information indicating the language used by the user of terminal 3000-t.
[0388] When such an interpretation request is received, the selection unit 4120 can select one of the remote terminals 5000m based on the interpretation request and the attribute information stored in the storage unit 4110. At this time, the selection unit 4120 compares the information on the attributes included in the interpretation request with the information recorded in the attribute information stored in the storage unit 4110. As a result, the selection unit 4120 selects the remote terminal 5000m corresponding to a doctor (or optometrist) that meets any of the following attributes, for example: (1) a doctor who specializes in the imaging modality; (2) a doctor who specializes in the image type; (3) a doctor who specializes in the disease (candidate disease); (4) a doctor who can perform interpretation of the difficulty level; and (5) a doctor who can use the language.
[0389] Incidentally, the doctor or optometrist is associated with the remote terminal 5000m by, for example, a user ID inputted when logging in to the remote terminal 5000m (or the ophthalmology system 1000).
[0390] The communication unit 4200 communicates with other devices (e.g., the ophthalmic imaging device 2000-i t The data communication method and encryption method are described in detail below. t The communication section may be the same as the communication section (communication section 9 in the first embodiment) provided in the
[0391] The server 4000 includes a data processing unit 4300. The data processing unit 4300 executes various data processing operations. t (particularly, a slit lamp microscope) can process multiple anterior eye images or three-dimensional images acquired by the microscope. The data processing unit 4300 includes a processor, a main storage device, an auxiliary storage device, etc. The auxiliary storage device stores a data processing program, etc. The functions of the data processing unit 4300 are realized by cooperation between software such as a data processing program and hardware such as a processor.
[0392] The data processing unit 4300 may include one or more of data processing unit 8, data processing unit 8A (image selection unit 81, three-dimensional image construction unit 82), data processing unit 8B (artifact removal unit 83, three-dimensional image construction unit 84), data processing unit 8C (three-dimensional image construction unit 85), data processing unit 8D (three-dimensional image construction unit 86, image position determination unit 87), three-dimensional image construction unit 88 (image area extraction unit 89, image synthesis unit 90), data processing unit 8E (three-dimensional image construction unit 91, rendering unit 92), data processing unit 8F (distortion correction unit 93), and data processing unit 8G (measurement unit 94).
[0393] The server 4000 can provide the data obtained by the data processing unit 4300 to other devices. For example, the data processing unit 4300 can t When a three-dimensional image is constructed from a plurality of anterior eye images acquired by the ophthalmic imaging apparatus 2000-i, the server 4000 can transmit the three-dimensional image to the remote terminal 5000m via the communication unit 4200. t Or, when the data processing unit 4300 renders the constructed 3D image, the server 4000 can transmit the constructed rendered image to the remote terminal 5000m via the communication unit 4200. When the data processing unit 4300 applies a measurement process to one or more anterior eye images or 3D images, the server 4000 can transmit the obtained measurement data to the remote terminal 5000m via the communication unit 4200. When the data processing unit 4300 applies a distortion correction to one or more anterior eye images or 3D images, the server 4000 can transmit the corrected images to the remote terminal 5000m via the communication unit 4200.
[0394] Next, the remote terminal 5000m will be described. The remote terminal 5000m illustrated in FIG.
[0395] The control unit 5010 executes control of each unit of the remote terminal 5000m. The control unit 5010 may be capable of executing other arithmetic processing. The control unit 5010 includes a processor, a RAM, a ROM, a hard disk drive, a solid state drive, and the like.
[0396] The control unit 5010 includes a display control unit 5011. The display control unit 5011 controls the display device 6000m. The display device 6000m may be included in the remote terminal 5000m, or may be a peripheral device connected to the remote terminal 5000m. The display control unit 5011 causes the display device 6000m to display an image of the anterior segment of the subject's eye E. Examples of the image of the anterior segment include a slit photographed image, a Scheimpflug photographed image, a rendering image of a three-dimensional image, a front image, an image of another modality (OCT image, etc.), an image showing a measurement result, an image showing an analysis result, and the like.
[0397] The control unit 5010 includes a report creation control unit 5012. The report creation control unit 5012 executes various controls for creating a report regarding the information displayed by the display control unit 5011. For example, the report creation control unit 5012 causes the display device 6000m to display a screen or a graphical user interface (GUI) for creating a report. In addition, the report creation control unit 5012 inputs information input by the user, an image of the anterior segment, measurement data, analysis data, and the like into a predetermined report template.
[0398] Data Processing Unit 5100 The data processing unit 5100 executes various data processing operations. t(particularly, a slit lamp microscope). The data processing unit 5100 can process three-dimensional images or rendering images constructed by another information processing device such as the server 4000. The data processing unit 5100 includes a processor, a main storage device, an auxiliary storage device, etc. The auxiliary storage device stores a data processing program, etc. The functions of the data processing unit 5100 are realized by cooperation between software such as a data processing program and hardware such as a processor.
[0399] The data processing unit 5100 may include one or more of data processing unit 8, data processing unit 8A (image selection unit 81, three-dimensional image construction unit 82), data processing unit 8B (artifact removal unit 83, three-dimensional image construction unit 84), data processing unit 8C (three-dimensional image construction unit 85), data processing unit 8D (three-dimensional image construction unit 86, image position determination unit 87), three-dimensional image construction unit 88 (image area extraction unit 89, image synthesis unit 90), data processing unit 8E (three-dimensional image construction unit 91, rendering unit 92), data processing unit 8F (distortion correction unit 93), and data processing unit 8G (measurement unit 94).
[0400] The communication unit 5200 communicates with other devices (e.g., the ophthalmic imaging device 2000-i t The data communication method and encryption method are described in detail below with respect to the ophthalmic photographing apparatus 2000-i. t The communication unit may be the same as that of the communication unit of the first embodiment.
[0401] The operation unit 5300 is used to operate the remote terminal 5000m and input information to the remote terminal 5000m. In this embodiment, the operation unit 5300 is used to create reports. The operation unit 5300 includes an operation device and an input device. The operation unit 5300 includes, for example, a mouse, a keyboard, a trackball, an operation panel, a switch, a button, a dial, and the like. The operation unit 5300 may include a touch screen.
[0402] The effects achieved by this embodiment will be described.
[0403] The ophthalmic system 1000 includes one or more slit lamp microscopes (ophthalmic imaging devices 2000-i t ) and one or more information processing devices (a server 4000 and / or a remote terminal 5000m). The information processing device is connected to the slit lamp microscope via a communication line, and processes an image of the anterior segment of the subject's eye acquired by the slit lamp microscope.
[0404] Slit lamp microscope (ophthalmic imaging device 2000-i t ) includes an illumination system, a photographing system, and a moving mechanism. The illumination system irradiates a slit light onto the anterior segment of the eye to be examined. The photographing system includes an optical system that guides light from the anterior segment irradiated with the slit light, and an image sensor that receives the light guided by the optical system at an imaging surface. The moving mechanism includes a moving mechanism that moves the illumination system and the photographing system. The object surface along the optical axis of the illumination system, the optical system, and the imaging surface satisfy the Scheimpflug condition. The photographing system acquires multiple images of the anterior segment by repeatedly photographing in parallel with the movement of the illumination system and the photographing system by the moving mechanism.
[0405] Slit lamp microscope (ophthalmic imaging device 2000-i t The illumination system and the imaging system of may be configured so that the imaging system is focused on at least a region defined by the anterior surface of the cornea and the posterior surface of the lens.
[0406] The illumination system may be configured to irradiate the anterior segment with a slit light whose longitudinal direction is in the body axis direction of the subject. In this case, the moving mechanism may be configured to move the illumination system and the imaging system in a direction perpendicular to the body axis direction.
[0407] The length of the slit light may be set to be equal to or greater than the diameter of the cornea in the body axis direction. In addition, the moving distance of the illumination system and the imaging system by the moving mechanism may be set to be equal to or greater than the diameter of the cornea in the direction perpendicular to the body axis direction.
[0408] According to this embodiment having such a configuration, at least the same effects as those of the first embodiment are achieved. In addition, any of the configurations, elements, functions, actions, effects, etc. described in the first embodiment can be applied to this embodiment.
[0409] In this embodiment, a slit lamp microscope (ophthalmic imaging device 2000-i t ) may include a first photographing system and a second photographing system. The first photographing system includes a first optical system that guides light from the anterior segment of the eye irradiated with the slit light, and a first image sensor that receives the light guided by the first optical system at a first image pickup surface. Furthermore, the first photographing system acquires a first group of images by repeatedly photographing in parallel with the movement of the illumination system and the photographing system. The second photographing system includes a second optical system that guides light from the anterior segment of the eye irradiated with the slit light, and a second image sensor that receives the light guided by the second optical system at a second image pickup surface. Furthermore, the second photographing system acquires a second group of images by repeatedly photographing in parallel with the movement of the illumination system and the photographing system. Moreover, the optical axis of the first optical system and the optical axis of the second optical system are arranged in different directions from each other. In addition, the object surface, the first optical system, and the first image pickup surface satisfy the Scheimpflug condition, and the object surface, the second optical system, and the second image pickup surface satisfy the Scheimpflug condition.
[0410] The optical system included in the imaging system may include a reflector and one or more lenses. The reflector is configured and arranged to reflect light from the anterior segment irradiated with the slit light, traveling in a direction away from the optical axis of the illumination system, in a direction toward the optical axis of the illumination system. The one or more lenses are configured and arranged to form an image of the light reflected by the reflector on an imaging plane.
[0411] According to this embodiment having such a configuration, at least the same effects as those of the second embodiment are achieved. In addition, any of the configurations, elements, functions, actions, effects, etc. described in the second embodiment can be applied to this embodiment.
[0412] In this embodiment, the optical axis of the first optical system and the optical axis of the second optical system may be arranged to be inclined in opposite directions to each other with respect to the optical axis of the illumination system. Furthermore, the information processing device (the server 4000 and / or the remote terminal 5000m) may include an image selection unit that determines whether an artifact is included in either of two images acquired substantially simultaneously by the first imaging system and the second imaging system, and selects the other image when it is determined that an artifact is included in one of the two images.
[0413] Furthermore, the information processing device (server 4000 and / or remote terminal 5000m) may include a three-dimensional image construction unit that constructs a three-dimensional image based on an image group including images selected from the first image group and the second image group by the image selection unit.
[0414] According to this embodiment having such a configuration, at least the same effects as those of the third embodiment are achieved. In addition, any of the configurations, elements, functions, actions, effects, etc. described in the third embodiment can be applied to this embodiment.
[0415] In this embodiment, the information processing device (the server 4000 and / or the remote terminal 5000m) may include an artifact removal unit that determines whether an artifact is included in either of the two images acquired substantially simultaneously by the first and second imaging systems by comparing the two images, and removes the artifact when it is determined that an artifact is included in either of the two images.
[0416] Furthermore, the information processing device (the server 4000 and / or the remote terminal 5000m) may include a three-dimensional image construction unit that constructs a three-dimensional image based on a group of images including images from which artifacts have been removed by the artifact removal unit.
[0417] According to this embodiment having such a configuration, at least the same effects as those of the fourth embodiment are achieved. In addition, any of the configurations, elements, functions, actions, effects, etc. described in the fourth embodiment can be applied to this embodiment.
[0418] In this embodiment, the information processing device (the server 4000 and / or the remote terminal 5000m) is a slit lamp microscope (ophthalmic imaging device 2000-i t ) may include a three-dimensional image construction unit that constructs a three-dimensional image based on a plurality of images acquired by the imaging apparatus.
[0419] According to this embodiment having such a configuration, at least the same effects as those of the fifth embodiment are achieved. In addition, any of the configurations, elements, functions, actions, effects, etc. described in the fifth embodiment can be applied to this embodiment.
[0420] In this embodiment, the moving mechanism may include a rotation mechanism that rotates the illumination system and the photographing system together with the optical axis of the illumination system as a rotation axis. Furthermore, when the illumination system and the photographing system are arranged at a first rotation position, the photographing system can acquire a plurality of images, and when the illumination system and the photographing system are arranged at a second rotation position different from the first rotation position, the photographing system can acquire an image of the anterior segment irradiated with the slit light by the illumination system. In addition, the three-dimensional image constructing unit may include an image position determining unit that determines the relative positions of the plurality of images based on the images acquired at the second rotation position.
[0421] According to this embodiment having such a configuration, at least the same effects as those of the sixth embodiment are achieved. In addition, any of the configurations, elements, functions, actions, effects, etc. described in the sixth embodiment can be applied to this embodiment.
[0422] In this embodiment, the three-dimensional image construction unit is a slit lamp microscope (ophthalmic imaging device 2000-i t) an image area extraction unit that extracts an image area corresponding to the irradiation area of the slit light from each of the multiple images acquired by the image area extraction unit, and an image synthesis unit that synthesizes the multiple image areas extracted from the multiple images by the image area extraction unit to construct a three-dimensional image.
[0423] The image region extraction unit is a slit lamp microscope (ophthalmic imaging device 2000-i t ) may be configured to extract an image area corresponding to both the irradiation area of the slit light and a predetermined part of the anterior eye segment from each of the multiple images acquired by the imaging apparatus.
[0424] The predetermined area may be an area defined by the anterior surface of the cornea and the posterior surface of the lens.
[0425] According to this embodiment having such a configuration, at least the same effects as those of the seventh embodiment are achieved. In addition, any of the configurations, elements, functions, actions, effects, etc. described in the seventh embodiment can be applied to this embodiment.
[0426] In this embodiment, the information processing device (the server 4000 and / or the remote terminal 5000m) may include a rendering unit that renders a three-dimensional image and constructs a rendered image.
[0427] When a cross section is specified for a three-dimensional image, the rendering unit can cut the three-dimensional image at that cross section to construct a three-dimensional partial image.
[0428] When a cross-section is specified for a three-dimensional image, the rendering unit can construct a two-dimensional cross-sectional image that represents that cross-section.
[0429] When a slice is specified for a 3D image, the rendering unit can construct a 3D slice image that corresponds to that slice.
[0430] According to this embodiment having such a configuration, at least the same effects as those of the eighth embodiment are achieved. In addition, any of the configurations, elements, functions, actions, effects, etc. described in the eighth embodiment can be applied to this embodiment.
[0431] In this embodiment, the information processing device (the server 4000 and / or the remote terminal 5000m) performs a process for correcting distortion caused by an optical axis angle, which is an angle between the optical axis of the illumination system and the optical axis of the imaging system, on a slit lamp microscope (ophthalmic imaging device 2000-i t ) may include a distortion correction unit that applies distortion correction to at least one of the multiple images acquired by the
[0432] The optical axis of the optical system included in the imaging system may be inclined in a third direction perpendicular to both the first direction along the optical axis of the illumination system and the second direction along the longitudinal direction of the slit light, with respect to the optical axis of the illumination system. In this case, the distortion correction unit can execute a process for correcting distortion in a plane including both the first direction and the second direction.
[0433] The distortion correction unit may be configured to pre-store a correction coefficient that is set based on a predetermined reference angle and an optical axis angle, and to execute processing for correcting distortion based on the correction coefficient.
[0434] According to the present embodiment having such a configuration, at least the same effects as those of the ninth embodiment are achieved. In addition, any of the configurations, elements, functions, actions, effects, etc. described in the ninth embodiment can be applied to this embodiment.
[0435] In this embodiment, the information processing device (the server 4000 and / or the remote terminal 5000m) is a slit lamp microscope (ophthalmic imaging device 2000-i t ) may include a first measurement unit that determines a predetermined measurement value by analyzing at least one of the multiple images acquired by the first measurement unit.
[0436] Furthermore, in this embodiment, the information processing device (the server 4000 and / or the remote terminal 5000m) may include a second measurement unit that determines a predetermined measurement value by analyzing the three-dimensional image constructed by the three-dimensional image construction unit.
[0437] According to this embodiment having such a configuration, at least the same effects as those of the tenth embodiment are achieved. In addition, any of the configurations, elements, functions, actions, effects, etc. described in the tenth embodiment can be applied to this embodiment.
[0438] In this embodiment, a slit lamp microscope (ophthalmic imaging device 2000-i t ) may include a video capture system that captures video of the anterior segment from a fixed position in parallel with the acquisition of multiple images by the capture system.
[0439] In addition, the slit lamp microscope (Ophthalmic imaging device 2000-i t ) may include a movement detection unit that detects the movement of the subject's eye by analyzing moving images acquired by the moving image capturing system.
[0440] In addition, a slit lamp microscope (Ophthalmic Imaging Device 2000-i t ) may include a movement control unit that controls the movement mechanism based on an output from the motion detection unit.
[0441] According to this embodiment having such a configuration, at least the same effects as those of the 11th embodiment are achieved. In addition, any of the configurations, elements, functions, actions, effects, etc. described in the 11th embodiment can be applied to this embodiment.
[0442] <Other matters> The above-described embodiment is merely a typical example of the present invention, and therefore any modifications (omissions, substitutions, additions, etc.) can be made as appropriate within the scope of the gist of the present invention.
[0443] It is possible to configure a program that causes a computer to execute processing related to any one or a combination of any two or more of the first to twelfth embodiments. It is also possible to configure a program that causes a computer to execute processing that is realized by applying any modification within the scope of the gist of the present invention to any one or a combination of any two or more of the first to twelfth embodiments.
[0444] Furthermore, it is possible to create a computer-readable non-transitory recording medium having such a program recorded thereon. This non-transitory recording medium may be in any form, examples of which include a magnetic disk, an optical disk, a magneto-optical disk, and a semiconductor memory.
[0445] The present invention includes a method realized by any one or a combination of any two or more of the first to twelfth embodiments. The present invention also includes a method realized by applying any modification within the scope of the present invention to any one or a combination of any two or more of the first to twelfth embodiments. [Explanation of symbols]
[0446] 1. Slit lamp microscope 2. Lighting system 3. Photography 4 Optical system 5. Image sensor 6 Moving mechanism 7. Control System 8 Data Processing Section 9. Communications Department
Claims
1. an illumination system for irradiating a slit light onto an anterior segment of a subject's eye; an imaging system including an optical system that guides light from the anterior segment of the eye irradiated with the slit light, and an imaging element that receives the light guided by the optical system on an imaging surface; a video capture system that captures video of the anterior eye from the front to sequentially obtain frames depicting a predetermined portion of the anterior eye; a moving mechanism that moves the illumination system and the imaging system without moving the moving image imaging system; Control unit and Including, an object surface along the optical axis of the illumination system, the optical system, and the imaging surface satisfy the Scheimpflug condition; In parallel with the moving image capturing of the anterior eye segment from the front and fixed position by the moving image capturing system, the control unit controls the moving mechanism for moving the illumination system and the capturing system and controls the capturing system for repeatedly capturing images of the anterior eye segment to obtain a plurality of images.
1. A slit lamp microscope comprising:
2. a motion detection unit that analyzes frames sequentially acquired by the video capture system in parallel with the control of the moving mechanism and the control of the capture system to identify feature points corresponding to the predetermined site, and detects the motion of the subject's eye based on a time change in the position of the sequentially identified feature points.
2. A slit lamp microscope as claimed in claim 1.
3. The control unit executes the control of the moving mechanism based on an output from the motion detection unit.
3. A slit lamp microscope as claimed in claim 2.
Citation Information
Patent Citations
Remote medical system
JP2000116732A
Ophthalmologic examination apparatus
JP2004329872A
Apparatus and method for illuminating the lens of the human eye
JP2005512752A
Ophthalmic remote diagnosis system
JP2008284273A
Anterior ocular segment measuring instrument
JP2012055337A