Slit Lamp Microscope

Abstract

To provide a technology for observing a corner angle in detail and surely without bringing a device into contact with a subject eye.SOLUTION: A slit lamp microscope 1 with an exemplary aspect includes a scan part and a storage part 10. The scan part includes an illumination system 2, an imaging system 3 and a movement mechanism 6, and collects an image group by scanning a three-dimensional area including a corner angle CA of a subject eye E by slit light. The storage part 10 stores the image group collected by the scan part.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present invention relates to a slit lamp microscope. [Background technology]

[0002] Diagnostic imaging plays an important role in the field of ophthalmology. Various types of ophthalmic imaging devices are used for diagnostic imaging. Types of ophthalmic imaging devices include slit lamp microscopes, fundus cameras, scanning laser ophthalmoscopes (SLO), and optical coherence tomography (OCT).

[0003] Among these various ophthalmic devices, the most widely and frequently used is the slit lamp microscope, which is used to illuminate the subject's eye with a slit light and observe or photograph the illuminated cross-section from an oblique or lateral direction using a microscope (see, for example, Patent Documents 1 and 2).

[0004] One of the main uses of slit lamp microscopes is the observation of the anterior segment of the eye. In anterior segment observation, doctors observe the entire anterior segment while moving the illumination field and focus position of the slit light to determine whether there is an abnormality. Slit lamp microscopes are also used in prescribing vision correction devices, such as checking the fitting of contact lenses. Furthermore, slit lamp microscopes are also used by people other than doctors, such as optometrists, paramedical staff, and eyeglass store clerks, for the purpose of screening for eye diseases and monitoring the progress of the disease.

[0005] In addition, with the recent progress of information and communication technology, research and development on telemedicine is progressing. Telemedicine is the act of providing medical treatment to patients in remote locations using a communication network such as the Internet. Patent Documents 3 and 4 disclose technologies for operating a slit lamp microscope from a remote location.

[0006] To obtain good images using a slit lamp microscope, delicate and complicated operations such as adjusting the illumination angle and the imaging angle are required. However, in the technologies disclosed in Patent Documents 3 and 4, even when observing the eye of a subject who is right in front of the examiner, an examiner in a remote location must perform difficult operations, which results in problems such as a long examination time and failure to obtain good images.

[0007] As described above, slit lamp microscopes are effective for screening, follow-up observation, and other examinations, but there is currently a shortage of people skilled in operating the device, making it difficult to provide high-quality slit lamp microscopy examinations to many people.

[0008] Furthermore, in remote medical care and screening, the doctor who interprets the images (image diagnosis) is often not present at the imaging location. In such cases, images that are not suitable for interpretation may be provided to the doctor. Considering the difficulty of operation and the long imaging time, it is expected that this problem will be more likely to occur with slit lamp microscopes.

[0009] This type of telemedicine and screening is thought to be particularly effective for diseases in which early detection has a large impact on the course of the disease or for diseases with a high prevalence. One such eye disease is glaucoma. Glaucoma is a major cause of acquired blindness, and its prevalence is known to be approximately 2% in people in their 40s and 11% in people in their 70s.

[0010] In the diagnosis of glaucoma, in addition to fundus observation (fundus camera, SLO, OCT, etc.) and visual field test, anterior segment observation is also performed. The main target of this anterior segment observation is the angle, and the condition of the angle is used to identify the cause and determine the treatment plan. For example, angle-closure glaucoma is differentiated from open-angle glaucoma based on the condition of the angle, and a treatment method (e.g., iridotomy, trabeculoplasty, gonioplasty, etc.) is selected.

[0011] Observation of the iridocorneal angle is typically performed using a gonioscope (see, for example, Patent Document 5). Because the gonioscope is used in contact with the subject's eye, it is necessary to apply eye drops anesthetic or a corneal protective agent (ophthalmic gel) to the subject's eye, which places a burden on the patient.

[0012] Patent Document 6 discloses a slit lamp microscope that can be used to observe the gonioscopic angle, but since it provides an image of one cross section, it cannot provide detailed observation like a gonioscopic microscope.

[0013] Patent Documents 7 and 8 disclose OCT devices that can be used for observing the iridocorneal angle. Although the OCT device has the advantage of being able to image the three-dimensional area of ​​the anterior segment without contact, it is difficult to say that the reliability and reproducibility are sufficient because the angle may not be visualized depending on the condition and characteristics of the subject's eye. In addition, considering the maintenance and cost, it is considered difficult, at least at present, to widely provide remote medical care, screening, and follow-up observation using the OCT device instead of a slit lamp microscope. [Prior art documents] [Patent documents]

[0014] [Patent Document 1] JP 2016-159073 A [Patent Document 2] JP 2016-179004 A [Patent Document 3] JP 2000-116732 A [Patent Document 4] JP 2008-284273 A [Patent Document 5] Special Publication No. 2017-517362 [Patent Document 6] JP 2010-42068 A [Patent Document 7] JP 2014-147501 A [Patent Document 8] JP 2017-18435 A Summary of the Invention [Problem to be solved by the invention]

[0015] One object of the present invention is to achieve both detailed and reliable non-contact angle observation. [Means for solving the problem]

[0016] The slit lamp microscope of an exemplary embodiment includes a scanning unit and a storage unit. The scanning unit collects a group of images by scanning a three-dimensional region including the angle of the subject's eye with a slit light. The storage unit stores the group of images collected by the scanning unit. Effect of the Invention

[0017] According to an exemplary embodiment, it is possible to perform detailed and reliable observation of the angle without bringing the device into contact with the subject's eye. [Brief description of the drawings]

[0018] [Figure 1] FIG. 1 is a schematic diagram showing the configuration of a slit lamp microscope according to an exemplary embodiment. [Figure 2A] 1 is a schematic diagram for explaining the operation of a slit lamp microscope according to an exemplary embodiment. FIG. [Figure 2B] 1 is a schematic diagram for explaining the operation of a slit lamp microscope according to an exemplary embodiment. FIG. [Diagram 3] 1 is a schematic diagram for explaining the operation of a slit lamp microscope according to an exemplary embodiment. FIG. [Figure 4A] FIG. 1 is a schematic diagram showing the configuration of a slit lamp microscope according to an exemplary embodiment. [Figure 4B] FIG. 1 is a schematic diagram showing the configuration of a slit lamp microscope according to an exemplary embodiment. [Figure 4C] FIG. 1 is a schematic diagram showing the configuration of a slit lamp microscope according to an exemplary embodiment. [Figure 4D] FIG. 1 is a schematic diagram showing the configuration of a slit lamp microscope according to an exemplary embodiment. [Figure 5A]FIG. 1 is a schematic diagram showing the configuration of a slit lamp microscope according to an exemplary embodiment. [Figure 5B] FIG. 1 is a schematic diagram for explaining construction of an inference model of a slit lamp microscope according to an exemplary embodiment. [Figure 5C] FIG. 1 is a schematic diagram showing the configuration of a slit lamp microscope according to an exemplary embodiment. [Figure 5D] FIG. 1 is a schematic diagram showing the configuration of a slit lamp microscope according to an exemplary embodiment. [Figure 6] 1 is an actual image acquired by a slit lamp microscope according to an exemplary embodiment. [Figure 7] 1 is a flowchart illustrating the operation of a slit lamp microscope according to an exemplary embodiment. [Figure 8] 1 is a flowchart illustrating the operation of a slit lamp microscope according to an exemplary embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0019] Some exemplary aspects will be described in detail with reference to the drawings. Any known technology, such as those disclosed in the documents cited in this specification, may be combined with the exemplary aspects. The entire disclosure of other applications filed by the applicant may be incorporated into the present disclosure. For example, the entire disclosure of applications filed by the applicant relating to a slit lamp microscope (or a system including a slit lamp microscope or a system connectable to a slit lamp microscope) may be incorporated into the present disclosure.

[0020] The slit lamp microscope according to the exemplary embodiment may be a stationary type or a portable type. The slit lamp microscope according to the exemplary embodiment is typically used in a situation or environment where there is no expert (expert) with respect to the device. The slit lamp microscope according to the exemplary embodiment may be used in a situation or environment where an expert is nearby, or in a situation or environment where an expert can monitor, instruct, and operate the microscope from a remote location. Examples of facilities where the slit lamp microscope according to the exemplary embodiment is installed include spectacles shops, optometrists, medical institutions, health checkup locations, medical examination locations, patients' homes, welfare facilities, public facilities, medical examination vehicles, and the like.

[0021] The device or system according to the exemplary embodiment has at least the functionality of a slit lamp microscope, and may optionally further have an imaging function (modality) other than a slit lamp microscope, an eye characteristic measurement function, an analysis function, and the like.

[0022] An ophthalmic system according to an exemplary embodiment (first ophthalmic system) may include one or more slit lamp microscopes, one or more information processing devices, and one or more image interpretation terminals, and may be usable for remote medical care, for example. The slit lamp microscope may be the slit lamp microscope according to any of the exemplary embodiments, or may be a slit lamp microscope equipped with at least a part of the slit lamp microscope. The information processing device receives an image acquired by the slit lamp microscope and transmits it to the image interpretation terminal. The information processing device may also have a function of managing the image acquired by the slit lamp microscope. Note that an image may be transmitted from the slit lamp microscope to the image interpretation terminal without providing an information processing device. The image interpretation terminal is a computer used by a doctor (typically a specialist such as an ophthalmologist or an image interpretation doctor) to interpret an image acquired by the slit lamp microscope (observe the image to obtain a medical finding). Information input by an image interpretation person to the image interpretation terminal may be converted into an image interpretation report or electronic medical record information by the image interpretation terminal or another computer, for example, and transmitted to the information processing device. In another example, information input by an image interpretation person to the image interpretation terminal can be transmitted to the information processing device. In this case, the information processing device or another computer can convert the information input by the image reader into an image interpretation report or electronic medical record information. The information processing device may manage the image interpretation report or electronic medical record information by itself, or may transfer it to another medical system (e.g., an electronic medical record system).

[0023] An ophthalmic system according to another exemplary embodiment (second ophthalmic system) may include one or more slit lamp microscopes, one or more information processing devices, and one or more reading devices. At least one of the slit lamp microscope and the information processing device may be the same as that of the first ophthalmic system. Also, an image may be transmitted from the slit lamp microscope to the reading device without providing an information processing device. The reading device is, for example, an image processor that operates according to a predetermined program, and / or a computer that uses an artificial intelligence engine (such as an inference engine, an inference model, or a learned model) to interpret an image acquired by the slit lamp microscope. Information derived from an image by the reading device may be converted into an interpretation report or electronic medical record information by the reading device or another computer and transmitted to the information processing device. In another example, the reading device can transmit information derived from an image to the information processing device. In this case, the information processing device or another computer can convert the information derived from an image by the reading device into an interpretation report or electronic medical record information. In still another example, information derived from an image by the image interpretation device and / or information generated based on this information (image interpretation report, electronic medical record information, etc.) may be provided to a doctor as diagnostic support information.

[0024] An ophthalmic system according to yet another exemplary embodiment (third ophthalmic system) may include one or more slit lamp microscopes and one or more information processing devices. The slit lamp microscope may be similar to that of the first ophthalmic system. The information processing device may be similar to that of the first ophthalmic system and / or that of the second ophthalmic system. In other words, the information processing device may be capable of data communication with an image reading terminal or a similar computer of the first ophthalmic system, and / or may be capable of data communication with an image reading device or a similar computer of the second ophthalmic system.

[0025] The slit lamp microscope and ophthalmic system according to the exemplary embodiment can be used for remote medical care. However, as described above, it is not easy to obtain a good image with a slit lamp microscope, and in order to effectively perform interpretation and diagnosis, it is necessary to obtain an image of a wide range of the anterior segment "in advance." Due to these circumstances, it can be said that effective remote medical care using a slit lamp microscope has not been realized. The exemplary embodiment can provide a technology that contributes to the realization of such remote medical care. However, the use of the exemplary embodiment is not limited to remote medical care, and the exemplary embodiment can also be applied to other uses.

[0026] The slit lamp microscope according to the exemplary embodiment can be used to obtain a series of images (images, image sets) that represent a wide range of the anterior segment with good image quality. In particular, the exemplary embodiment can be used to obtain a series of images (images, image sets) that represent a wide range of the angle with good image quality. Furthermore, the exemplary embodiment can be used to evaluate (observe, analyze, judge, determine, infer, estimate, etc.) the angle, such as in diagnosing glaucoma.

[0027] The exemplary embodiment also focuses on the following problem. That is, in the application form (such as remote medical care) assumed by the exemplary embodiment, a series of images (a group of images, a set of images) from a sufficiently wide range of the anterior eye is directly or indirectly provided to the reader by the slit lamp microscope, so that even if the quality of the series of images provided is low, it is difficult to retake them, and as a result, there is a risk of a problem that interpretation cannot be performed at all or only insufficient interpretation can be performed. Therefore, it is necessary to obtain images of "good" quality "in advance". In other words, it is necessary to obtain a series of images having a quality that allows effective diagnosis (interpretation, etc.) all at once before providing them to the reader. However, in addition to the difficulty of operating the slit lamp microscope, it is extremely difficult to obtain a series of images that express the entire target area of ​​observation or interpretation with good image quality, considering the occurrence of blinking and eye movement during shooting. The present disclosure also considers how to deal with such problems.

[0028] Several exemplary aspects will be described below. Any two or more of these aspects can be at least partially combined. In addition, any known technology can be combined with such a combination, and modifications (substitutions, omissions, etc.) based thereon can be made.

[0029] At least a portion of the functionality of the elements disclosed herein is implemented using circuitry or processing circuitry. The circuitry or processing circuitry may be a general purpose processor, a special purpose processor, an integrated circuit, a central processing unit (CPU), a graphics processing unit (GPU), an application specific integrated circuit (ASIC), a programmable logic device (e.g., a simple programmable logic device (SPLD), a complex programmable logic device (CPLD), a field programmable gate array (FPGA), or a combination of a programmable logic device (PLC) and a programmable logic device (PGD)), configured and / or programmed to perform at least a portion of the functionality disclosed. The term "circuitry", "unit", "means" or the like includes any of the above-mentioned circuitry, including a transistor and / or other circuitry, a processor, a processor array, a conventional circuitry, and any combination thereof. A processor is considered to be a processing circuitry or circuitry, including transistors and / or other circuitry. In this disclosure, a circuitry, a unit, a means, or the like is hardware that performs at least some of the disclosed functions or is hardware that is programmed to perform at least some of the disclosed functions. The hardware may be hardware disclosed herein or may be known hardware that is programmed and / or configured to perform at least some of the described functions. In the case where the hardware is a processor that can be considered to be a type of circuitry, a circuitry, a unit, a means, or the like is a combination of hardware and software, and the software is used to configure the hardware and / or the processor.

[0030] An example of a slit lamp microscope according to an exemplary embodiment is shown in Fig. 1. The slit lamp microscope 1 is used to photograph the anterior segment of a subject's eye E. In Fig. 1, the symbol C indicates the cornea, the symbol CL indicates the crystalline lens, the symbol IR indicates the iris, and the symbol CA indicates the angle of the iris. The angle CA is a region located between the cornea C and the iris IR, and is also called the anterior chamber angle.

[0031] The angle has an outlet for aqueous humor (called Schlemm's canal). If the angle narrows, the drainage of aqueous humor is hindered, causing an increase in intraocular pressure and potentially leading to glaucoma. If the angle becomes completely closed, it can cause an acute glaucoma attack accompanied by a sudden increase in intraocular pressure. The slit lamp microscope 1 can be used to observe the angle, and in particular, can be used to capture images of three-dimensional areas including the angle.

[0032] The slit lamp microscope 1 includes an illumination system 2, an imaging system 3, a moving mechanism 6, a control unit 7, a data processing unit 8, a communication unit 9, and a storage unit 10. The slit lamp microscope 1 may be a single device, or may be a system including two or more devices. As an example of the latter, the slit lamp microscope 1 includes a main unit including the illumination system 2, the imaging system 3, and the moving mechanism 6, a computer including the control unit 7, the data processing unit 8, and the communication unit 9, and a communication interface that handles data communication between the main unit and the computer. This computer may be installed, for example, together with the main unit, or may be installed on a network.

[0033] <Lighting System 2> The illumination system 2 irradiates slit light onto the anterior segment of the subject's eye E (particularly, a three-dimensional region including the angle CA). Reference symbol 2a indicates the optical axis (illumination optical axis) of the illumination system 2. The illumination system 2 may have a configuration similar to that of an illumination system of a conventional slit lamp microscope. Although not shown in the figures, the exemplary illumination system 2 includes, in order from the side furthest from the subject's eye E, an illumination light source, a positive lens, a slit forming unit, and an objective lens.

[0034] The illumination light source outputs illumination light. The illumination system 2 may include a plurality of illumination light sources. For example, the illumination system 2 may include an illumination light source that outputs continuous light and an illumination light source that outputs flash light. The illumination system 2 may also include an illumination light source for the anterior segment and an illumination light source for the posterior segment. The illumination system 2 may also include two or more illumination light sources with different output wavelengths. A typical illumination system 2 includes a visible light source as an illumination light source. The illumination system 2 may also include an infrared light source. The illumination light output from the illumination light source passes through a positive lens and is projected onto the slit forming portion.

[0035] The slit forming unit generates slit light by passing a part of the illumination light. A typical slit forming unit has a pair of slit blades. The width of the area (slit) through which the illumination light passes is changed by changing the interval (slit width) between these slit blades, and thus the width of the slit light is changed. The slit forming unit may be configured to change the length of the slit light. The length of the slit light is the cross-sectional dimension of the slit light in a direction perpendicular to the cross-sectional width direction of the slit light corresponding to the slit width. The width and length of the slit light are typically expressed as the dimension of the image of the slit light projected onto the anterior segment of the eye, but are not limited thereto. For example, they can be expressed as the dimension of the cross section of the slit light at any position, or as the dimension of the slit formed by the slit forming unit.

[0036] The slit light generated by the slit forming unit is refracted by the objective lens and irradiated onto the anterior segment of the subject's eye E.

[0037] The illumination system 2 may further include a focusing mechanism for changing the focus position of the slit light. The focusing mechanism, for example, moves an objective lens along the illumination optical axis 2a. The movement of the objective lens can be performed automatically and / or manually. Note that a focusing lens may be disposed at a position on the illumination optical axis 2a between the objective lens and the slit forming part, and the focus position of the slit light may be changed by moving this focusing lens along the illumination optical axis 2a.

[0038] 1 is a top view, and as shown in the figure, in this embodiment, the direction along the axis of the subject's eye E is the Z direction, the direction perpendicular to the Z direction from left to right with respect to the subject is the X direction, and the direction perpendicular to both the X direction and the Z direction is the Y direction. Typically, the X direction is the arrangement direction of the left eye and the right eye, and the Y direction is the direction along the subject's body axis (body axis direction).

[0039] <Photography 3> The imaging system 3 images the anterior segment (particularly, a three-dimensional area including the iridocorneal angle CA) illuminated with the slit light from the illumination system 2. Reference symbol 3a indicates the optical axis (imaging optical axis) of the imaging system 3. The imaging system 3 of this embodiment includes an optical system 4 and an image sensor 5.

[0040] The optical system 4 guides light from the anterior segment of the subject's eye E, which is irradiated with the slit light, to the imaging element 5. The imaging element 5 receives the light guided by the optical system 4 on an imaging surface.

[0041] The light guided by the optical system 4 (i.e., light from the anterior segment of the subject's eye E) includes returned light of the slit light irradiated on the anterior segment, and may further include other light. Examples of returned light include reflected light, scattered light, and fluorescence. Examples of other light include light from the installation environment of the slit lamp microscope 1 (room light, sunlight, etc.). When an anterior segment illumination system for illuminating the entire anterior segment is provided separately from the illumination system 2, the returned light of this anterior segment illumination light may be included in the light guided by the optical system 4.

[0042] The imaging element 5 is an area sensor having a two-dimensional imaging area, and may be, for example, a charge-coupled device (CCD) image sensor or a complementary metal-oxide semiconductor (CMOS) image sensor.

[0043] The optical system 4 may have a configuration similar to that of the imaging system of a conventional slit lamp microscope. For example, the optical system 4 includes, in order from the side closer to the subject's eye E, an objective lens, a variable magnification optical system, and an imaging lens. Light from the anterior segment of the subject's eye E irradiated with the slit light passes through the objective lens and the variable magnification optical system, and is imaged on the imaging surface of the image sensor 5 by the imaging lens.

[0044] The imaging system 3 may further include a focusing mechanism for changing the focus position. The focusing mechanism, for example, moves an objective lens along the imaging optical axis 3a. The movement of the objective lens can be performed automatically and / or manually. Note that a focusing lens may be disposed at a position on the imaging optical axis 3a between the objective lens and the imaging lens, and the focus position may be changed by moving this focusing lens along the imaging optical axis 3a.

[0045] The illumination system 2 and the photographing system 3 function as a Scheimpflug camera. That is, the illumination system 2 and the photographing system 3 are configured so that the object plane along the illumination optical axis 2a, the optical system 4, and the imaging plane of the image sensor 5 satisfy the so-called Scheimpflug condition. More specifically, the YZ plane (including the object plane) passing through the illumination optical axis 2a, the principal plane of the optical system 4, and the imaging plane of the image sensor 5 intersect on the same straight line. This allows photographing to be performed by focusing on all positions in the object plane (all positions in the direction along the illumination optical axis 2a).

[0046] In this embodiment, for example, imaging is performed with the imaging system 3 focused on a three-dimensional region including the angle CA. Regarding the Z direction, for example, imaging can be performed with the imaging system 3 focused on the entire range from the apex (Z=Z1) of the anterior surface of the cornea C to the apex (Z=Z2) of the posterior surface of the crystalline lens CL. Note that Z=Z0 indicates the Z coordinate of the intersection of the illumination optical axis 2a and the imaging optical axis 3a.

[0047] Such conditions are typically realized by the configuration and arrangement of elements included in the illumination system 2, the configuration and arrangement of elements included in the imaging system 3, and the relative positions of the illumination system 2 and the imaging system 3. The parameters indicating the relative positions of the illumination system 2 and the imaging system 3 include, for example, the angle θ between the illumination optical axis 2a and the imaging optical axis 3a. The angle θ is set to, for example, 17.5 degrees, 30 degrees, or 45 degrees. Note that the angle θ may be variable.

[0048] <Movement mechanism 6> The moving mechanism 6 moves the illumination system 2 and the imaging system 3. The moving mechanism 6 includes, for example, a movable stage on which the illumination system 2 and the imaging system 3 are mounted, an actuator that operates according to a control signal input from the control unit 7, and a mechanism that moves the movable stage based on a driving force generated by the actuator. In another example, the moving mechanism 6 includes a movable stage on which the illumination system 2 and the imaging system 3 are mounted, and a mechanism that moves the movable stage based on a force applied to an operating device (not shown). The operating device is, for example, a lever. The movable stage is movable at least in the X direction, and may further be movable in the Y direction and / or Z direction.

[0049] In this embodiment, the moving mechanism 6 moves the illumination system 2 and the imaging system 3 in the X direction, for example. That is, the moving mechanism 6 moves the illumination system 2 and the imaging system 3 in the X direction while maintaining a state in which the above-mentioned Scheimpflug condition is satisfied. In parallel with this movement, the imaging system 3 captures a moving image at a predetermined time interval (imaging rate), for example. As a result, a three-dimensional region of the anterior segment of the subject's eye E is scanned with slit light, and a plurality of images (a group of images) corresponding to a plurality of cross sections within this three-dimensional region are collected.

[0050] In addition, in a typical example, the longitudinal direction (length direction) of the slit light irradiated to the anterior segment by the illumination system 2 is aligned with the Y direction, and the lateral direction (width direction) is aligned with the X direction. Furthermore, the movement mechanism 6 moves the illumination system 2 and the imaging system 3 integrally in the X direction. In other words, the movement mechanism 6 moves the illumination system 2 and the imaging system 3 so that the slit light irradiated to the anterior segment by the illumination system 2 moves in the width direction of the slit light. This makes it possible to simply and efficiently scan the three-dimensional region of the anterior segment. Note that any combination of the orientation and movement direction of the slit light may be used.

[0051] <Control unit 7> The control unit 7 controls each part of the slit lamp microscope 1. For example, the control unit 7 controls the elements of the illumination system 2 (illumination light source, slit forming unit, focusing mechanism, etc.), the elements of the imaging system 3 (focusing mechanism, image sensor, etc.), the movement mechanism 6, the data processing unit 8, the communication unit 9, etc. The control unit 7 may also be capable of executing control for changing the relative positions of the illumination system 2 and the imaging system 3.

[0052] The control unit 7 includes a processor, a main storage device, an auxiliary storage device, etc. The auxiliary storage device stores a control program, etc. The control program, etc. may be stored in a computer or storage device accessible to the slit lamp microscope 1. The functions of the control unit 7 are realized by cooperation between software such as the control program and hardware such as a processor.

[0053] In order to scan a three-dimensional area of ​​the anterior segment of the subject's eye E with slit light, the control unit 7 can apply the following controls to the illumination system 2, the imaging system 3, and the moving mechanism 6.

[0054] First, the control unit 7 controls the moving mechanism 6 to place the illumination system 2 and the imaging system 3 at a predetermined scan start position (alignment control). The scan start position is, for example, a position corresponding to an end (first end) of the cornea C in the X direction, or a position farther away from the axis of the subject's eye E than that.

[0055] 2A indicates an example of a scan start position corresponding to a first end of the cornea C in the X direction. The scan start position X0 substantially corresponds to the position of the angle CA, and a scan starting from the scan start position X0 is applied to a three-dimensional region including the angle CA.

[0056] 2B indicates an example of a scan start position that is farther away from the axis EA of the subject's eye E than a position corresponding to a first end of the cornea C in the X direction. The scan start position X0' corresponds to a position outside the angle CA, and a scan starting from the scan start position X0' is applied to a three-dimensional region including the angle CA.

[0057] The control unit 7 controls the illumination system 2 to start irradiating the anterior segment of the subject's eye E with slit light (slit light irradiation control). Incidentally, the slit light irradiation control may be performed before or during the execution of the alignment control. The slit light is typically continuous light, but may also be intermittent light (pulsed light). The lighting control of the pulsed light is synchronized with the imaging rate of the imaging system 3. Furthermore, the slit light is typically visible light, but may also be infrared light, or a mixture of visible light and infrared light.

[0058] The control unit 7 controls the imaging system 3 to start imaging of a moving image of the anterior segment of the subject's eye E (imaging control). Incidentally, the imaging control may be performed before or during the execution of the alignment control. Typically, the imaging control is performed simultaneously with or after the slit light irradiation control.

[0059] After performing the alignment control, the slit light irradiation control, and the photographing control, the control unit 7 controls the moving mechanism 6 to start moving the illumination system 2 and the photographing system 3 (movement control). The movement control moves the illumination system 2 and the photographing system 3 together. That is, the illumination system 2 and the photographing system 3 are moved while maintaining the relative position (angle θ, etc.) between the illumination system 2 and the photographing system 3. Typically, the illumination system 2 and the photographing system 3 are moved while maintaining a state in which the above-mentioned Scheimpflug condition is satisfied. The illumination system 2 and the photographing system 3 are moved from the above-mentioned scan start position to a predetermined scan end position. The scan end position is, for example, a position corresponding to the end (second end) of the cornea C opposite to the first end in the X direction, similar to the scan start position, or a position further away from the axis of the subject's eye E. In such a case, the range from the scan start position to the scan end position is the scan range. In either case, the scan is applied to a three-dimensional area including the angle CA on the first end side of the cornea C and the angle CA on the second end side.

[0060] Typically, a slit light having the X direction as the width direction and the Y direction as the length direction is irradiated onto the anterior segment, and the illumination system 2 and the imaging system 3 are moved in the X direction, while the imaging system 3 captures a moving image.

[0061] Here, the length of the slit light (i.e., the dimension of the slit light in the Y direction) is set, for example, to be equal to or greater than the diameter of the cornea C on the surface of the subject's eye E. That is, the length of the slit light is set to be equal to or greater than the corneal diameter in the Y direction. Also, as described above, the movement distance of the illumination system 2 and the imaging system 3 by the movement mechanism 6 (i.e., the scanning range) is set to be equal to or greater than the corneal diameter in the X direction. This makes it possible to scan at least the entire cornea C with the slit light. That is, it is possible to apply scanning to a three-dimensional area including the entire angle CA.

[0062] By performing such a scan, multiple anterior eye images with different irradiation positions of the slit light are obtained. In other words, a moving image is obtained that depicts the irradiation position of the slit light moving in the X direction. An example of such multiple anterior eye images (i.e., a group of frames constituting a moving image) is shown in FIG. 3.

[0063] FIG. 3 shows a number of anterior eye images (frame groups, image groups) F1, F2, F3, . . . , FN. The subscript n of these anterior eye images Fn (n=1, 2, . . . , N) represents the time series order. That is, the anterior eye image acquired n-th is represented by the symbol Fn. The anterior eye image Fn includes a slit light irradiation area An. As shown in FIG. 3, the slit light irradiation areas A1, A2, A3, . . . , AN move rightward along the time series. In the example shown in FIG. 3, the longitudinal direction (length direction) of the slit light coincides with the Y direction (up-down direction, body axis direction), the lateral direction (width direction) of the slit light coincides with the X direction (left-right direction, horizontal direction), and the moving direction of the slit light coincides with the X direction. In addition, the scan start position is a position outside (left side) of the first end (left end) of the cornea C, and the scan end position is a position outside (right side) of the second end (right end) of the cornea C. According to the scan of this type, it is possible to image a three-dimensional region including the entire cornea C and the entire angle CA. Note that the scan start position and / or scan end position are not limited to this example, and for example, the scan start position and / or scan end position may be the end of the cornea C in the X direction. In addition, various scan parameters such as the direction of the slit light, the moving direction of the scanning light, the number of scans, etc. can also be set arbitrarily.

[0064] <Data Processing Unit 8> The data processing unit 8 executes various data processing. The data to be processed may be either data acquired by the slit lamp microscope 1 or data input from the outside. The data processing unit 8 can process images acquired by the imaging system 3. For example, the data processing unit 8 can apply a predetermined process to at least some images of the image group Fn collected by the scan of the embodiment shown in FIG. 3. The data processing unit 8 can also apply a predetermined process to at least some images of the image group collected by the scan of another embodiment. The configuration and functions of the data processing unit 8 will be described in this embodiment as well as in other embodiments.

[0065] The data processing unit 8 includes a processor, a main storage device, an auxiliary storage device, etc. The auxiliary storage device stores a data processing program, etc. The data processing program, etc. may include a model (trained model, inference model, etc.) constructed by machine learning. The data processing program, etc. may be stored in a computer or storage device accessible to the slit lamp microscope 1. The functions of the data processing unit 8 are realized by cooperation between software such as the data processing program and hardware such as a processor.

[0066] Several examples of the data processing unit 8 will be described. Figures 4A, 4B, 4C, and 4D show data processing units 8A, 8B, 8C, and 8D, which are first, second, third, and fourth examples of the data processing unit 8, respectively. Note that the configuration of the data processing unit 8 is not limited to these. For example, the data processing unit 8 may include a combination of any two or more of the four data processing units 8A, 8B, 8C, and 8D. In addition, it is possible to provide the data processing unit 8 with any element for obtaining the same type of result or a similar type of result.

[0067] The slit lamp microscope 1 of this embodiment applies one or more scans to the subject's eye E (a three-dimensional region including the angle CA). Each scan results in a group of images such as the multiple anterior segment images F1 to FN shown in Fig. 3. The data processing unit 8 can process the one or more image groups thus obtained.

[0068] The slit lamp microscope 1 may be capable of applying two or more scans to the anterior segment. For example, if a good set of images is not obtained in the first scan, a second scan is performed. More generally, if a good set of images is not obtained in the first to v scans, a v+1 scan is performed (v is an integer equal to or greater than 1). In some exemplary aspects, if a good set of images (image set) is not obtained from the v image sets obtained in the first to v scans, a v+1 scan is performed. In some other exemplary aspects, if none of the v image sets obtained in the first to v scans is a good image set, a v+1 scan is performed. Note that the manner in which two or more scans are performed is not limited to these.

[0069] When two or more scans are performed, the start and end positions (i.e., the scan range) of these scans may be the same, or one or both of the start and end positions may be different. Typically, two or more scans are applied to the same scan range. As a result, a group of images such as the multiple anterior eye images F1 to FN shown in FIG. 3 is obtained in the same number as the number of scans.

[0070] Considering the eye movement of the subject's eye E, the scan range (scan start position, scan end position) is typically defined not by the position or range in the anterior segment but by the operation of the slit lamp microscope 1. For example, the start point of the movement of the illumination system 2 and the imaging system 3 during scanning is set as the scan start position, and the end point is set as the scan end position.

[0071] On the other hand, it is also possible to define the scan range according to the position or range in the anterior segment. In this case, an operation (tracking) is applied in which the illumination system 2 and the imaging system 3 are moved so as to follow the movement of the subject's eye E. The slit lamp microscope 1 of this example has, for example, a tracking function similar to that of a conventional one. The tracking function includes, for example, video capture of the anterior segment, extraction of landmarks from each frame, calculation of displacement between frames using the landmarks, and movement control of the illumination system 2 and the imaging system 3 to cancel the displacement.

[0072] As another example of the definition (setting) of the scan range, it is possible to set the scan range for an image that has already been collected. In other words, it is possible to configure the setting of the scan range to be performed after the fact (after scanning). Note that the scan range in this example represents the range of the image to be provided for later processing.

[0073] A first example of such a post-event scan range setting will be described. The slit lamp microscope of this example is capable of anterior eye photography, and is capable of recognizing the positional relationship between the anterior eye photography optical system and the scanning optical system (illumination system 2 and photography system 3). In this example, first, an image group (wide-area image group) is collected by scanning a sufficiently wide range (particularly in the X direction and Y direction) of the anterior eye, while performing anterior eye photography. Next, a scan range is set for the anterior eye image obtained by anterior eye photography. This setting may be performed either manually or automatically. The automatic setting includes, for example, a process of analyzing the anterior eye image to detect a landmark (for example, the corneal limbus, the iridocorneal angle, or the pupil margin), and a process of setting the scan range by referring to the landmark. When the scan range is set, a partial area of ​​each wide-area image corresponding to this scan range is specified based on the positional relationship of the optical system described above. Finally, an image corresponding to the scan range is formed by cropping the specified partial area from the wide-area image. As a result, an image group corresponding to the set scan range is obtained. In this example, when the fixation of the subject's eye is stable (or when it is assumed or can be assumed), the anterior eye may be photographed as a still image. When the anterior eye is photographed as a moving image, the wide-area image group and the frame group in the moving image are associated with each other based on, for example, the control (synchronization information, etc.) between the scan and the moving image photographing, and the same processing as described above is performed for each pair of the associated wide-area image and frame.

[0074] A second example of the post-scan range setting will be described. In this example, the anterior eye does not need to be photographed in parallel, and a sufficiently wide range (particularly in the X-direction and Y-direction) of the anterior eye is scanned to collect a group of wide-area images. Next, a partial area corresponding to a desired scan range is specified for each wide-area image. This specification may be performed either manually or automatically. The automatic specification includes, for example, a process of analyzing the wide-area image to detect a landmark (for example, the corneal limbus or the iridocorneal angle) and a process of setting the scan range by referring to the landmark. Alternatively, a landmark may be manually specified for any wide-area image (reference wide-area image), and the reference wide-area image and an adjacent wide-area image may be analyzed to specify a landmark for the adjacent wide-area image. By sequentially applying such processing, it is possible to specify landmarks for all wide-area images. Furthermore, a partial area of ​​the wide-area image corresponding to the scan range can be specified based on the landmark, and an image corresponding to the scan range can be formed by cropping the specified partial area from the wide-area image. As a result, a group of images corresponding to the set scan range can be obtained.

[0075] A first example of the data processing unit 8 will be described. The data processing unit 8A shown in FIG. 4A includes an image group evaluation unit 81. The image group evaluation unit 81 evaluates the quality of an image group collected in one scan of the subject's eye E (a three-dimensional region including the angle CA). In some exemplary embodiments, the image group evaluation unit 81 is configured to determine whether the image group satisfies a predetermined condition, and is typically configured to determine whether each image included in the image group satisfies the predetermined condition.

[0076] The predetermined condition (image group evaluation condition) is, for example, a condition related to image quality required for effective interpretation and diagnosis, and may be, for example, a condition related to the subject's eye E, a condition related to the slit lamp microscope 1, a condition related to the environment, etc. The image group evaluation condition may include, for example, either or both of "the image to be evaluated is not affected by blinking (blink condition)" and "the image to be evaluated is not affected by eye movement (eye movement condition)". In addition, the image group evaluation condition may be any index related to image quality evaluation, and may include, for example, any of brightness, contrast, noise, signal-to-noise ratio (SNR), tone reproduction, dynamic range, sharpness, vignetting, aberration (spherical aberration, astigmatism, coma aberration, field curvature, distortion aberration, chromatic aberration, etc.), color accuracy, exposure accuracy, lens flare, moire, and artifacts. The image selection condition is not limited to these examples and may be selected arbitrarily.

[0077] The blinking condition will be described. For an image included in the image group, the image group evaluation unit 81 judges whether or not the image contains a reflected image of slit light irradiated to the anterior part of the subject's eye E. This judgment is a process that utilizes the fact that the reflected image of slit light is not depicted in an image taken during a blink and that the reflected image of slit light is expressed significantly brighter than other regions, and is performed, for example, based on the luminance distribution in the image.

[0078] As an example, the image group evaluation unit 81 creates a luminance histogram from the image and judges whether or not there are pixels with a luminance equal to or greater than a predetermined threshold. If it is judged that there is a luminance equal to or greater than the predetermined threshold, it is judged that the image contains a reflected image of slit light. This example has the advantage that the processing is extremely simple, but there is a risk of erroneously detecting high-luminance noise or reflections of external light.

[0079] As another example, the image group evaluation unit 81 creates a luminance histogram from the image and judges whether or not there are a predetermined number of pixels with a luminance equal to or greater than a predetermined threshold. If it is judged that there are a predetermined number of pixels with a luminance equal to or greater than a predetermined threshold, it is judged that the image contains a reflected image of slit light. This example has the advantage that the above-mentioned erroneous detection can be prevented by simple processing.

[0080] The eye movement conditions will now be described. For each image included in the image group, the image group evaluation unit 81 determines whether or not the image is affected by eye movement by, for example, comparing the image with its adjacent images. This determination is a process that utilizes the fact that "image jumps" occur when eye movement occurs during video capture.

[0081] As an example, the image group evaluation unit 81 detects landmarks from the image and the adjacent images, calculates the amount of displacement of these landmarks, and judges whether the amount of displacement is equal to or greater than a predetermined threshold. If it is determined that the amount of displacement is equal to or greater than the predetermined threshold, it is determined that eye movement has occurred. Here, the landmarks may be, for example, the cornea, iris, pupil, or angle of the eye. The threshold is calculated based on predetermined scan conditions, such as the imaging rate of the imaging system 3 and the moving speed of the moving mechanism 6.

[0082] In another example, the image group evaluation unit 81 may be configured to determine the presence or absence of eye movement from one image. For example, when the shooting rate of the shooting system 3 is slow, if a fast eye movement occurs, a "blur" may occur in the image. The image group evaluation unit 81 can determine the presence or absence of eye movement by utilizing blur detection. Blur detection is typically performed using a known technique such as edge detection.

[0083] The image group evaluation unit 81 may include an artificial intelligence engine for determining whether the input image satisfies the above image selection conditions. This artificial intelligence engine typically includes a convolutional neural network (CNN), and this convolutional neural network is trained in advance using training data including a large number of images acquired by a slit lamp microscope and a determination result of whether each image satisfies the image selection conditions. Note that the images included in the training data are not limited to images acquired by a slit lamp microscope, and may be, for example, images acquired by other ophthalmic modalities (fundus cameras, OCT devices, SLOs, surgical microscopes, etc.), images acquired by image diagnostic modalities of other medical departments (ultrasound diagnostic devices, X-ray diagnostic devices, X-ray CT devices, magnetic resonance imaging (MRI) devices, etc.), images generated by processing actual images, pseudo images, etc. In addition, the method and technology (for example, hardware, software, machine learning methods, types of neural networks, etc.) used in the artificial intelligence engine are arbitrary.

[0084] A series of images constituting an image group collected in one scan may be associated with a plurality of positions in the scan range. This association is performed, for example, by the data processing unit 8. A specific example will be described. The scan range along the X direction is divided into (N-1) sections, the scan start position is set to the first position, and the scan end position is set to the Nth position (N is an integer of 2 or more). In this way, N positions are set in the scan range. The N positions are represented by B1, B2, B3, . . . , BN (not shown). The intervals between the N positions B1 to BN may be equal or different. The number (N) of the positions B1 to BN is set based on, for example, the scan start position, the scan end position, the moving speed (scanning speed) of the slit light, the frame rate of the imaging system 3, and the like. The number (N) of the positions B1 to BN set in this example is equal to the number of images collected in one scan. The number (N) of the positions B1 to BN is not limited to this example, and the setting method is also not limited to this example. Assume that one scan is applied to the anterior segment of the subject's eye E, and a group of images F1, F2, F3, . . . , FN shown in Fig. 3 are acquired. The data processing unit 8 can assign an image Fn to a position Bn. This results in N images Fn (n = 1, 2, . . . , N) corresponding to N positions Bn (n = 1, 2, . . . , N).

[0085] The image group may include only a series of images, or may further include other information. Examples of information included in the image group together with the series of images include various types of additional information such as subject information, subject eye information, shooting date and time, and shooting conditions. Images obtained by other modalities and test data acquired by an examination device can also be included in the image group. Some examples of the configuration and operation of the image group evaluation unit 81 will be described later with reference to Figs. 5A to 5D.

[0086] A second example of the data processing unit 8 will be described. The effectiveness of this example is particularly demonstrated when two or more scans are applied to the subject's eye E (a three-dimensional region including the angle CA). The data processing unit 8B shown in FIG. 4B includes an image set creation unit 82 in addition to the image group evaluation unit 81 similar to that of FIG. 4A. The data processing unit 8B is provided with two or more image groups collected by two or more scans applied to the subject's eye E (a three-dimensional region including the angle CA). The image group evaluation unit 81 of this example may perform quality evaluation on each of these image groups, or may perform quality evaluation only on the image group collected in the first scan (first scan). The image set creation unit 82 selects a series of images corresponding to the scan range from the two or more image groups input to the data processing unit 8B to create an image set.

[0087] The range represented by the series of images constituting the image set may be, for example, a three-dimensional area to which any one of the two or more scans is applied, or may be a three-dimensional area set based on the scan ranges in at least two of the two or more scans. As an example of the former, the maximum scan range or the minimum scan range among the two or more scan ranges to which the two or more scans are respectively applied may be adopted. As an example of the latter, the union or intersection of at least two scan ranges may be adopted.

[0088] The image set may include only the series of images, or may further include other information. Examples of information included in the image set together with the series of images include various types of additional information such as subject information, subject eye information, shooting date and time, shooting conditions, etc. Images obtained by other modalities and test data obtained by an examination device may also be included in the image set.

[0089] A third example of the data processing unit 8 will be described. As with the second example, the effectiveness of this example is particularly evident when two or more scans are applied to the subject's eye E (a three-dimensional region including the angle CA). The data processing unit 8C shown in FIG. 4C includes an image set creation unit 82 similar to that in FIG. 4B in addition to an image group evaluation unit 81 similar to that in FIG. 4A, but the image set creation unit 82 in this example includes a selection unit 821.

[0090] The data processing unit 8C is provided with two or more image groups collected in two or more scans applied to the subject's eye E (a three-dimensional region including the angle CA). The image group evaluation unit 81 in this example may perform quality evaluation on each of these image groups, or may perform quality evaluation only on the image group collected in the initial scan (first scan). The image set creation unit 82 selects a series of images corresponding to the scan range from the two or more image groups input to the data processing unit 8B to create an image set. In creating this image set, the selection unit 821 selects images that satisfy a predetermined condition from the two or more image groups.

[0091] The predetermined condition (image selection condition) may be the same as the image group evaluation condition described above, or may be different. For example, when the image group evaluation unit 81 is configured to provide two or more image groups to the selection unit 821 after the quality evaluation of each image is performed by the image group evaluation unit 81, the selection unit 821 may be configured to select images taking into consideration conditions related to image arrangement (e.g., blink conditions, eye movement conditions, etc.). Note that the image selection conditions are not limited to these examples, and the relationship between the image group evaluation conditions and the image selection conditions is not limited to these examples.

[0092] The following describes the case where the selection unit 821 considers the blink condition and the eye movement condition. In addition, when considering conditions other than these, the selection unit 821 can execute the same process as a specific example (see Figs. 5A to 5D) related to the image group evaluation unit 81 described later.

[0093] Image selection taking blinking conditions into consideration will be described. The blinking conditions are conditions for confirming that "the image to be evaluated is not affected by blinking." For an image included in two or more image groups, the selection unit 821 judges, for example, whether the image contains a reflected image of slit light irradiated to the anterior segment of the subject's eye E. This judgment is a process that utilizes the fact that the reflected image of the slit light is not depicted in an image captured during a blink, and that the reflected image of the slit light is expressed significantly brighter than other regions, and is performed, for example, based on the luminance distribution in the image.

[0094] As an example, the selection unit 821 creates a luminance histogram from the image and judges whether or not there are pixels with a luminance equal to or greater than a predetermined threshold. If it is judged that there is a luminance equal to or greater than the predetermined threshold, it is judged that the image contains a reflected image of slit light. This example has the advantage that the processing is extremely simple, but there is a risk of erroneously detecting high-luminance noise or reflections of external light.

[0095] As another example, the selection unit 821 creates a luminance histogram from the image and determines whether there are a predetermined number of pixels with a luminance equal to or greater than a predetermined threshold. If it is determined that there are a predetermined number of pixels with a luminance equal to or greater than a predetermined threshold, it is determined that the image contains a reflected image of slit light. This example has the advantage that the above-mentioned erroneous detection can be prevented by simple processing.

[0096] Image selection taking into consideration eye movement conditions will be described. The eye movement conditions are conditions for confirming that "the image to be evaluated is not affected by eye movement." For an image included in two or more image groups, the selection unit 821 determines whether or not the image is affected by eye movement, for example, by comparing the image with its adjacent images. This determination is a process that utilizes the fact that "image jumps" occur when eye movement occurs during video capture.

[0097] As an example, the selection unit 821 detects landmarks from each of the image and the adjacent image, calculates the amount of displacement of these landmarks, and judges whether the amount of displacement is equal to or greater than a predetermined threshold. If it is determined that the amount of displacement is equal to or greater than the predetermined threshold, it is determined that eye movement has occurred. Here, the landmarks may be, for example, the cornea, iris, pupil, or angle of the eye. The threshold is calculated based on predetermined scan conditions, such as the imaging rate of the imaging system 3 and the moving speed of the moving mechanism 6.

[0098] In another example, the selection unit 821 may be configured to determine the presence or absence of eye movement from one image. For example, when the imaging rate of the imaging system 3 is slow, if a rapid eye movement occurs, a "blur" may occur in the image. The selection unit 821 can determine the presence or absence of eye movement by utilizing blur detection. The blur detection is typically performed using a known technique such as edge detection.

[0099] As with the image collection evaluator 81, the selector 821 may include an artificial intelligence engine for determining whether the input images satisfy the image selection criteria described above.

[0100] A series of images included in the image set created by the image set creation unit 82 may be associated with multiple positions in the scan range. For example, the selection unit 821 may be configured to select images such that one or more images are assigned to each of multiple positions in the scan range.

[0101] A specific example will be described. As described above, the scan range along the X direction is divided into (N-1) sections, the scan start position is set to the first position, and the scan end position is set to the Nth position (N is an integer equal to or greater than 2). In this way, N positions are set in the scan range. The N positions are represented as B1, B2, B3, ..., BN.

[0102] Assume that two or more scans are applied to the anterior segment of the subject's eye E, resulting in the acquisition of a group of images F1, F2, F3, ..., FN shown in Fig. 3. Note that in the above description, the N images F1 to FN shown in Fig. 3 are considered to be a group of images acquired by one scan, but in this specification, for the sake of simplicity, the N images F1 to FN shown in Fig. 3 may be referred to as an arbitrary group of images (multiple images) (hereinafter the same). For example, in the description of this example, the N images F1 to FN are referred to as a series of images included in an image set.

[0103] For such N positions B1 to BN and N images F1 to FN, the selection unit 821 can assign an image Fn to the position Bn. This provides N images Fn (n=1, 2,...,N) corresponding to the N positions Bn (n=1, 2,...,N), and creates an image set in which the image group Fn is a "series of images."

[0104] In some exemplary embodiments, when the image group evaluation unit 81 evaluates that the quality of the image group obtained in the first scan is not good, a second scan is performed automatically or in response to a user's instruction. When the number of scans applied to the anterior segment is two or more, the slit lamp microscope 1 performs an operation of applying two or more scans to the anterior segment and an operation of selecting a series of images from two or more image groups collected thereby, but the manner of performing these operations may be arbitrary. As a first example, the slit lamp microscope 1 may be configured to alternately repeat a scan of the anterior segment and a selection of images from the image group acquired by this scan in response to the evaluation that the quality of the image group obtained in the first scan is not good. As a second example, the slit lamp microscope 1 may be configured to perform two or more scans together and then select a series of images from two or more image groups collected thereby in response to the evaluation that the quality of the image group obtained in the first scan is not good. These two examples will be described below. Note that instead of or in addition to the selection of images from the image group, the image group evaluation unit 81 may evaluate the image group. As previously discussed, image group evaluation and image selection may be similar, analogous, or interchangeable processes, and in some exemplary aspects, matters described as image group evaluation may be applied to image selection, and conversely, matters described as image selection may be applied to image group evaluation.

[0105] A first example of the mode of scanning and image selection executed after the image group evaluation unit 81 evaluates that the quality of the image group obtained by the first scan is not good is alternating repetition of scanning and image selection. More specifically, in the first example, for example, a set of application of a scan to the anterior eye segment and selection of an image from the image group obtained by this scan is repeatedly executed a predetermined number of times. That is, in the first example, U sets of operations are executed in the order of the first set of operations (scanning and image selection), the second set of operations (scanning and image selection), ..., the Uth set of operations (scanning and image selection) (U is an integer equal to or greater than 1). In addition, the set of the first scan performed before this alternating repetition and the quality evaluation (image group evaluation unit 81) of the image group obtained by the first scan will be called the 0th set of operations.

[0106] Here, the number of scans in the u-th set may be any number equal to or greater than 1 (u=0, 1,...,U). Also, the number of scans in the u1-th set and the number of scans in the u2-th set may be equal to or different from each other (u1=0, 1,...,U; u2=0, 1,...,U; u1≠u2).

[0107] In a first example, the selection unit 821 may be configured to select images from two or more image groups collected in two or more scans that have already been performed to create a provisional image set. That is, the slit lamp microscope 1 may be configured to create a provisional image set from two or more image groups obtained in two or more scans performed up to that point in time during the alternating repetition of scanning and image selection. For example, after the scan in the u-th set is performed, the selection unit 821 is configured to create a provisional image set from all images obtained in the 0-th set to the u-th set. With this configuration, a provisional image set can be created from the images obtained up to the current point in time to build a final image set.

[0108] When the above configuration for creating a provisional image set is applied, the following configuration can be combined. When a new scan is applied to the anterior segment of the subject's eye E, the selection unit 821 first selects an image from a new image group collected in the new scan. Then, the selection unit 821 creates a new provisional image set by adding an image selected from the new image group to a provisional image set based on one or more scans performed before the new scan. For example, after a scan in the (u+1)th set is performed, the selection unit 821 can first select an image from the image group obtained in the (u+1)th set. Furthermore, the selection unit 821 can create a new provisional image set by adding an image selected from the image group obtained in the (u+1)th set to a provisional image set based on the image group obtained in the 0th set to the uth set. According to this configuration, each time a scan is applied to the anterior segment, the provisional image set can be sequentially updated based on the image group obtained in the scan. This makes it possible to reliably and efficiently construct a final image set.

[0109] When the above configuration for creating (and updating) a provisional image set is applied, the following configuration can be combined. The control unit 7 (or the image set creation unit 82 (selection unit 821)) includes an image number counter that counts the number of images included in the provisional image set. When the number of images included in the provisional image set reaches a predetermined number, the control unit 7 controls the scanning unit (illumination system 2, shooting system 3, movement mechanism 6) and the selection unit 821 to terminate the alternating repetition of the application of scan and the selection of images. Here, the predetermined number is the number of a series of images included in the final image set, and is set in advance or from the processing status. In addition, the control unit 7 determines whether the number of images included in the provisional image set has reached the predetermined number. This determination may be made only by comparing the numbers. Alternatively, when a series of images is associated with a plurality of positions in the scan range (as described above), it may be determined whether corresponding images have been assigned to all of the plurality of positions. According to this configuration, when the number required for the final image set is obtained, the alternating repetition of the scan and the selection of images can be automatically terminated.

[0110] When the above-mentioned configuration for creating (and updating) a tentative image set is applied, the following configuration can be further combined. The control unit 7 includes a repetition counter that counts the number of times the alternating repetition of scanning and image selection is performed. The number of times to be counted may be defined in units of pairs of scanning and image selection (the first pair to the Uth pair), or may be defined in units of the number of scans. When the number of repetitions reaches a predetermined number, the control unit 7 controls the scanning unit (illumination system 2, imaging system 3, moving mechanism 6) and the selection unit 821 so as to end the alternating repetition of the application of scanning and the selection of images. When the number of repetitions is defined in units of pairs of scanning and image selection, the predetermined number is equal to the total number of pairs (U+1) set in advance. When the number of repetitions is defined in units of the number of scans, the predetermined number is equal to the total number of scans set in advance. In addition, the control unit 7 determines whether the number of repetitions has reached the predetermined number. According to this configuration, it is possible to automatically end the repetition of scanning and image selection when it has been repeated a predetermined number of times. Without this configuration, scanning and image selection are repeated until the number of images required to construct the final image set is selected, which causes fatigue for the subject and reduces imaging efficiency, and significantly impairs imaging throughput, particularly when imaging multiple subjects in succession.

[0111] As described above, this embodiment may be configured to automatically end the alternating repetition of scanning and image selection. The condition for this automatic end is not limited to the above two examples, and may be, for example, an instruction input from the user. Alternatively, the elapsed time from the start of the alternating repetition of scanning and image selection may be measured, and the alternating repetition may be ended when a predetermined time is reached. In addition, when the repetition rate of scanning and image selection is constant, the automatic end control based on the elapsed time is equivalent to the automatic end control based on the number of repetitions described above. The image set creation unit 82 can create an image set based on a provisional image set when the alternating repetition of scanning and image selection is ended. The provisional image set is included in the image set as, for example, a series of images corresponding to the scanning range. Predetermined subject information, such as subject ID, official ID, name, age, and sex, is separately input to the slit lamp microscope 1. The image set creation unit 82 can create an image set by configuring such subject information, subject eye information (information indicating left eye / right eye, etc.), shooting date and time, shooting conditions, etc. as auxiliary information of a series of images. The image set may also include other images obtained by the slit lamp microscope 1, images obtained by other modalities, and examination data acquired by an examination device. This concludes the description of the first example of the execution mode of scanning and image selection. A specific example of the processing according to this example will be described later.

[0112] Next, a second example of the mode of scanning and image selection executed after the image group evaluation unit 81 evaluates that the quality of the image group obtained in the first scan is not good will be described. This example is configured to perform two or more scans together and then select a series of images from two or more image groups collected thereby. Then, images are selected from the two or more image groups collected in these two or more scans and the image group obtained in the first scan performed before that, and an image set including the selected series of images is created.

[0113] A specific example of such processing will be described. First, the selection unit 821 associates a group of images corresponding to each scan with a plurality of positions (described above) in the scan range. As a result, two or more images corresponding to different scans are assigned to each of the plurality of positions in the scan range.

[0114] Next, for each of the multiple positions in the scan range, the selection unit 821 selects one image from the two or more images assigned to that position. The image selection condition applied in this example may be, for example, the blink condition and eye movement condition described above. As a result, one image is assigned to each of the multiple positions in the scan range. The multiple images associated with the multiple positions in this way are adopted as a series of images included in the image set. This concludes the explanation of the second example of the execution mode of scanning and image selection.

[0115] A fourth example of the data processing unit 8 will be described. As with the second and third examples, the effectiveness of this example is particularly evident when two or more scans are applied to the subject's eye E (a three-dimensional region including the angle CA). The data processing unit 8D shown in FIG. 4D includes an image group evaluation unit 81 similar to that in FIG. 4A and an image set creation unit 82 similar to that in FIG. 4B or FIG. 4C, as well as an image set evaluation unit 83.

[0116] The image set evaluation unit 83 evaluates the quality of the image set created by the image set creation unit 82. This evaluation is to determine whether the image set has sufficient quality for effective diagnosis (image interpretation), and evaluation items and evaluation criteria are determined from this perspective. The evaluation items and evaluation criteria may be common to at least a part of the image group evaluation conditions and / or at least a part of the image selection conditions, but are not limited to them.

[0117] The image set evaluation unit 83 may be configured to perform different evaluations depending on the aspect of the image set. For example, the evaluation applied to an image set created in response to the number of images included in the provisional image set reaching a predetermined number may be different from the evaluation applied to an image set created in response to the number of alternating iterations of scanning and image selection reaching a predetermined number. Note that the same evaluation may be applied regardless of the aspect of the image set.

[0118] Examples of quality evaluation of an image set include evaluation of the quality of each image (which may be the same as the evaluation of an image group), as well as evaluation of the "arrangement order" of a series of images, evaluation of "image skips (missing images)", evaluation of "positional deviation", etc. Defects in an image set, such as rearrangement of the arrangement order, skipping of images, and positional deviation, occur due to eye movement, fixation deviation, etc.

[0119] The evaluation of the arrangement order of a series of images will be described. In some examples, the above-mentioned correspondence (one-to-one correspondence) is set between the series of images and multiple positions in the scan range. The image set evaluation unit 83 can evaluate the arrangement order by using this correspondence.

[0120] Here, the multiple positions in the scan range are ordered according to their positional relationships in real space. An example will be described. As described above, it is assumed that the scan range along the X direction is divided into (N-1) sections, and N positions B1, B2, B3, ..., BN are set in order from the scan start position to the scan end position. That is, the N positions B1 to BN are ordered according to their positional relationships in real space. It is also assumed that N images F1 to FN (a series of images) correspond to the N positions B1 to BN in a one-to-one relationship.

[0121] Under such a premise, the image set evaluation unit 83 arranges the N images F1 to FN according to the arrangement order (relative positional relationship) of the N positions B1 to BN, for example. This process is realized by setting the coordinates of the N positions B1 to BN in a certain three-dimensional coordinate system, and arranging (embedding) the N images F1 to FN according to the set N coordinates. More specifically, the image set evaluation unit 83 can extract slit light irradiation regions A1 to AN (two-dimensional cross-sectional images) from the N images F1 to FN, respectively, set the coordinates of the N positions B1 to BN in the three-dimensional coordinate system, and embed the N two-dimensional cross-sectional images A1 to AN according to the set N coordinates.

[0122] The image set evaluation unit 83 can evaluate whether the arrangement order is appropriate by analyzing the images F1 to FN (two-dimensional cross-sectional images A1 to AN) embedded in the three-dimensional coordinate system. For example, the image set evaluation unit 83 can detect regions of interest (image regions corresponding to sites of interest such as the anterior surface of the cornea, the posterior surface of the cornea, the iris, the pupil, the anterior surface of the lens, the posterior surface of the lens, and the angle) from the images F1 to FN (two-dimensional cross-sectional images A1 to AN), and perform evaluation based on the shape (connectivity, continuity, etc.) of the regions of interest in the arrangement direction (X direction in this example) of the images F1 to FN (two-dimensional cross-sectional images A1 to AN). For example, if a gap of a predetermined size or more exists in the region of interest, it is determined that the arrangement order is not appropriate (there is a change in the arrangement order).

[0123] In another example, the image set evaluation unit 83 constructs a cross-sectional image along the X direction from images F1 to FN (2D cross-sectional images A1 to AN) embedded in a 3D coordinate system. Furthermore, the image set evaluation unit 83 can perform evaluation based on the form (connectivity, continuity, etc.) of this cross-sectional image.

[0124] The evaluation of image skipping and positional deviation can also be performed in the same manner as the evaluation of the arrangement order.

[0125] As with the image group evaluation unit 81 and the selection unit 821, the image set evaluation unit 83 may include an artificial intelligence engine to evaluate whether the input image set has sufficient quality for effective diagnosis.

[0126] When the image set evaluation unit 83 evaluates that the quality of the image set is good, the control unit 7 may be configured to perform control to cause the communication unit 9 to transmit this image set. For example, the control unit 7 prepares transmission information including this image set, and controls the communication unit 9 to transmit this transmission information to a predetermined external device.

[0127] The manner in which an image set or the like is output from the slit lamp microscope 1 is not limited to transmission. Examples of output manners other than transmission include saving in a storage device (such as a database), recording on a recording medium, and printing on a print medium.

[0128] If the image set evaluation unit 83 evaluates that the quality of the image set is not good, the control unit 7 may be configured to perform control to perform a new scan of the subject's eye E (the three-dimensional region including the angle CA), that is, to control to obtain a new image group (a new image set). For example, the control unit 7 may be configured to display and / or output predetermined output information as sound. The predetermined output information has content to prompt the user to retake an image, such as, for example, that the image capture has failed or that retaking an image is necessary.

[0129] Alternatively, the control unit 7 may be configured to send commands to at least the scanning unit (illumination system 2, shooting system 3, movement mechanism 6) and the image set creation unit 82 to automatically start re-photographing (re-executing scanning and image set creation).

[0130] <Communications Division 9> The communication unit 9 performs data communication between the slit lamp microscope 1 and other devices (external devices). That is, the communication unit 9 transmits data to other devices and receives data transmitted from other devices.

[0131] For example, the communication unit 9 can transmit at least a part of the images of the image group collected by scanning a three-dimensional region including the iridocorneal angle CA with slit light to another device (first external device). The communication unit 9 can also transmit data generated from the image group by the data processing unit 8 to another device (second external device). The first external device and the second external device may be the same device or different devices. When the first external device and the second external device are the same device, the external device may be, for example, any of an image reading terminal, an image reading device, and a computer that executes a process different from that of the data processing unit 8. On the other hand, when the first external device and the second external device are different devices, the first external device may be, for example, any of an image reading terminal, an image reading device, a computer that executes a process similar to that of the data processing unit 8, and a computer that executes a process different from that of the data processing unit 8, and the second external device may be any of an image reading terminal, an image reading device, and a computer that executes a process different from that of the data processing unit 8. When the first external device and the second external device are different devices, the control unit 7 may be configured to select an external device to be a destination according to the type of data to be transmitted.

[0132] The communication unit 9 may execute any data communication method. For example, the communication unit 9 includes one or more of various communication interfaces, such as a communication interface conforming to the Internet, a communication interface conforming to a dedicated line, a communication interface conforming to a LAN, a communication interface conforming to short-distance communication, etc. The data communication may be wired communication or wireless communication.

[0133] The data transmitted and received by the communication unit 9 may be encrypted. In that case, for example, the control unit 7 and / or the data processing unit 8 includes at least one of an encryption processing unit that encrypts the data transmitted by the communication unit 9 and a decryption processing unit that decrypts the data received by the communication unit 9.

[0134] <Storage section 10> The storage unit 10 stores various types of data. For example, the storage unit 10 stores a group of images collected by scanning the subject's eye E (e.g., a three-dimensional region including the angle CA) with slit light, an image set created from two or more image groups, analysis data generated by image analysis, and the like. The control unit 7 executes a process of storing data in the storage unit 10 and a process of reading data from the storage unit 10. The storage process and read process are executed as appropriate in various operations of the slit lamp microscope 1.

[0135] The storage unit 10 includes any storage device, and includes at least one of a non-volatile storage device and a volatile storage device. The storage unit 10 includes at least one of a hard disk drive and a semiconductor memory, for example.

[0136] <Image Group Evaluation Unit 81> Several examples of the image group evaluation unit 81 will be described with reference to Figures 5A to 5D. Note that the image group evaluation unit 81 is not limited to these examples, and any modifications (addition, substitution, omission, etc.) are possible. In addition, two or more of these examples and modifications can be at least partially combined.

[0137] A first example of the image group assessment unit 81 will be described with reference to Figures 5A and 5B. This example assesses the quality of an image group using artificial intelligence technology. The image group assessment unit 81A shown in Figure 5A includes an inference unit 811A that assesses the quality of an image group using an inference model 812A.

[0138] The inference model 812A is constructed in advance by machine learning using training data including a plurality of anterior segment images. An apparatus (inference model construction apparatus) for constructing the inference model 812A may be provided in the slit lamp microscope 1 (such as the data processing unit 8) or its peripheral device (such as a computer), or may be another computer.

[0139] 5B is an example of such an inference model construction device, and is assumed to be provided in the slit lamp microscope 1 or its peripheral devices. The model construction unit 90 includes a learning processing unit 91 and a neural network 92.

[0140] The neural network 92 typically includes a convolutional neural network (CNN). An example of the structure of a convolutional neural network is shown in FIG. 5B.

[0141] An image is input to the input layer. Behind the input layer, multiple pairs of convolution layers and pooling layers are arranged. In the example shown in Figure 5B, three pairs of convolution layers and pooling layers are provided, but the number of pairs is arbitrary.

[0142] In the convolution layer, a convolution operation is performed to grasp features (such as contours) from an image. The convolution operation is a multiplication and accumulation operation of a filter function (weighting factor, filter kernel) of the same dimension as the input image for the input image. In the convolution layer, the convolution operation is applied to each of multiple parts of the input image. More specifically, in the convolution layer, the value of each pixel of the partial image to which the filter function is applied is multiplied by the value (weight) of the filter function corresponding to that pixel to calculate the product, and the sum of the products is obtained over multiple pixels of this partial image. The product-sum value thus obtained is substituted for the corresponding pixel in the output image. The convolution operation result for the entire input image is obtained by performing the product-sum operation while moving the part (partial image) to which the filter function is applied. According to such a convolution operation, a large number of images in which various features are extracted using a large number of weighting factors are obtained. In other words, a large number of filtered images such as smoothed images and edge images are obtained. The large number of images generated by the convolution layer are called feature maps.

[0143] In the pooling layer, the feature map generated by the immediately preceding convolution layer is compressed (data thinning, etc.). More specifically, in the pooling layer, statistics of a predetermined neighborhood pixel of a pixel of interest in the feature map are calculated at a predetermined pixel interval, and an image with a smaller size than the input feature map is output. The statistics applied to the pooling operation are, for example, maximum value (max pooling) or average value (average pooling). The pixel interval applied to the pooling operation is called a stride.

[0144] A convolutional neural network can extract many features from an input image by performing processing using multiple pairs of convolutional layers and pooling layers.

[0145] A fully connected layer is provided after the last pair of convolutional and pooling layers. In the example shown in Figure 2, two fully connected layers are provided, but the number of fully connected layers is arbitrary. In the fully connected layer, image classification, image segmentation, regression, and other processes are performed using features compressed by a combination of convolution and pooling. After the last fully connected layer, an output layer is provided to provide the output results.

[0146] In some exemplary embodiments, the convolutional neural network may not include a fully connected layer (e.g., a fully layered convolutional network (FCN)), and may include a support vector machine, a recurrent neural network (RNN), or the like. Machine learning for the neural network 92 may be transfer learning. That is, the neural network 92 may include a neural network that has already been trained using other training data (training images) and has had its parameters adjusted. The model construction unit 90 (learning processing unit 91) may be configured to be capable of applying fine tuning to the trained neural network (92). The neural network 92 may be constructed using, for example, a known open source neural network architecture.

[0147] The learning processing unit 91 applies machine learning using training data to the neural network 92. When the neural network 92 includes a convolutional neural network, the parameters adjusted by the learning processing unit 91 include, for example, filter coefficients of the convolutional layer and connection weights and offsets of the fully connected layer.

[0148] As described above, the training data includes at least a plurality of anterior segment images. The plurality of anterior segment images are typically images acquired by a slit lamp microscope, but are not limited thereto, and may include, for example, images acquired by other ophthalmic modalities (fundus camera, OCT device, SLO, surgical microscope, etc.), images acquired by image diagnostic modalities of other medical departments (ultrasound diagnostic device, X-ray diagnostic device, X-ray CT device, magnetic resonance imaging (MRI) device, etc.), images generated by processing actual images, pseudo images, etc. In addition, the number of training data may be increased using techniques such as data expansion and data augmentation.

[0149] The training method for constructing an inference model may be any method, but may be, for example, any one of supervised learning, unsupervised learning, and reinforcement learning, or a combination of any two or more of them.

[0150] In some exemplary embodiments, supervised learning is performed using training data in which input images are labeled with a final output label. For example, a label indicating whether an image can be read or not is pre-assigned to each of a plurality of anterior eye images included in the training data. The label is generated, for example, by a doctor or another inference model. The learning processing unit 91 can build the inference model 812A by applying supervised learning using such training data to the neural network 92.

[0151] The inference model 812A of this example constructed in this way is a trained model that inputs an image obtained by scanning the anterior segment with a slit light and outputs the possibility of interpretation. Note that the possibility of interpretation, which is the output of the inference model 812A, may be any parameter indicating whether the image group to be evaluated is suitable for interpretation or not, and may be, for example, a determination of whether interpretation is possible or not, a probability that interpretation can be performed, or the validity of the result when interpretation is performed (for example, accuracy, precision), etc.

[0152] In order to prevent processing from concentrating on a particular unit of the neural network 92, the learning processing unit 91 may randomly select and disable some units and perform learning using the remaining units (dropout).

[0153] The method used to build the inference model is not limited to the examples shown here. For example, any method such as a support vector machine, a Bayesian classifier, boosting, a k-means algorithm, a kernel density estimation, a principal component analysis, an independent component analysis, a self-organizing map, a random forest, or a generative adversarial network (GAN) can be used to build the inference model.

[0154] 5A uses such an inference model 812A to evaluate the quality of a group of images collected in one scan of the anterior segment of the subject's eye E. More specifically, the inference unit 811A first inputs the group of images or each image contained therein to the inference model 812A. The inference model 812A derives information indicating the possibility of interpretation from the input group of images or images.

[0155] The inference unit 811A may use the image reading possibility information output from the inference model 812A as an inference result as it is, or may generate an inference result based on the image reading possibility information. As an example of the latter, the inference unit 811A may generate information for display from the image reading possibility information, or may execute a predetermined statistical process.

[0156] A second example of the image group evaluation unit 81 will be described with reference to Fig. 5C. In this example, an image group is converted into a 3D image and quality evaluation is performed. The image group evaluation unit 81B shown in Fig. 5C includes a 3D image construction unit 811B, a comparison unit 812B, and an evaluation processing unit 813B.

[0157] The three-dimensional image constructing section 811B constructs a three-dimensional image from a group of images acquired by one scan of the anterior segment of the subject's eye E. For example, the three-dimensional image constructing section 811B may be configured to construct stack data by embedding the group of images in a single three-dimensional coordinate system. This stack data is constructed, for example, by embedding N two-dimensional cross-sectional images A1 to AN shown in FIG. 3 in the three-dimensional coordinate system according to the arrangement (relative positional relationship) of the N positions B1 to BN described above.

[0158] The three-dimensional image constructing unit 811B may be configured to construct volume data by applying a voxelization process to stack data constructed from the images. Furthermore, the three-dimensional image constructing unit 811B can apply a predetermined rendering to the stack data or the volume data. Examples of the rendering include volume rendering and surface rendering.

[0159] The comparison unit 812B compares the three-dimensional image (stack data, volume data, rendering image, etc.) constructed by the three-dimensional image construction unit 811B with a predetermined reference three-dimensional image. One or more arbitrary number of reference three-dimensional images are prepared.

[0160] The reference three-dimensional image may include one or more reference three-dimensional images corresponding to a normal eye. The reference three-dimensional image corresponding to a normal eye may be, for example, an image acquired by photographing a normal eye (an eye in which no disease is found (a healthy eye)). The photographing modality for acquiring this reference three-dimensional image may be any, but is typically a slit lamp microscope 1 or a similar slit lamp microscope. The reference three-dimensional image corresponding to a normal eye may also be an image acquired by photographing a model of a normal eye (such as a model eye), or an image created by computer graphics from a model of a normal eye or a clinical case.

[0161] The reference three-dimensional image may include one or more reference three-dimensional images corresponding to the diseased eye. The reference three-dimensional image corresponding to the diseased eye may be, for example, an image acquired by photographing an eye that has been definitively diagnosed with a specific disease. The imaging modality for acquiring the reference three-dimensional image may be any, but is typically a slit lamp microscope 1 or a similar slit lamp microscope. The reference three-dimensional image corresponding to the diseased eye may also be an image acquired by photographing a model of the diseased eye (such as a model eye), or an image created by computer graphics from a model or clinical case of the diseased eye.

[0162] The comparison unit 812B executes matching between the 3D image constructed by the 3D image construction unit 811B and a reference 3D image to calculate the value of a predetermined parameter. This image matching may utilize any method, such as image correlation, feature-based matching, region-based matching, machine learning (trained model), etc. The calculated parameters may be any parameters, such as correlation values, matching parameters (angle, scale, similarity, compatibility, etc.), and output parameters of trained models.

[0163] Such image matching is typically a process of quantitatively (i.e., numerically) expressing the extent to which the shape and structure of tissues and areas (such as the cornea, iris, pupil, and angle) depicted in a 3D image resembles the shape and structure of a standard normal eye and / or the shape and structure of a standard diseased eye.

[0164] The evaluation processing unit 813B evaluates the quality of the image group based on the parameter values ​​calculated by the comparison unit 812B. For example, the evaluation processing unit 813B may be configured to evaluate the quality of the image group by comparing the parameter values ​​calculated by the comparison unit 812B with a predetermined threshold value. Alternatively, the evaluation processing unit 813B may be configured to evaluate the quality of the image group by determining whether the parameter values ​​calculated by the comparison unit 812B are within a predetermined range. Note that the method of processing executed by the evaluation processing unit 813B is not limited to these, and may be any method that can be used to derive an evaluation result from the value of a certain parameter.

[0165] The quality evaluation of the image group using the 3D image construction is not limited to this example. For example, the image group evaluation unit 81 may be configured to be capable of performing one or more evaluation processes of evaluating the arrangement order of a series of images constituting the image group, evaluating skipping of images, and evaluating misalignment in the same manner as the image set evaluation unit 83.

[0166] A third example of the image group evaluation unit 81 will be described with reference to Fig. 5D. In this example, the quality of an image group is evaluated by quantitatively evaluating the image quality of the image group. The image group evaluation unit 81C shown in Fig. 5D includes an evaluation data generation unit 811C and an evaluation processing unit 812C.

[0167] The evaluation data generating unit 811C obtains image quality evaluation data from images included in an image group collected in one scan of the anterior segment of the subject's eye E. The image quality evaluation data quantitatively expresses the image quality of the image group.

[0168] Several examples of image quality evaluation processing executed by the evaluation data generating unit 811C will be described. In some exemplary embodiments, the image quality evaluation processing executed by the evaluation data generating unit 811C may be any processing, for example, processing using any known technology such as signal-to-noise ratio (SNR), contrast-to-noise ratio (CNR), root-mean-square (RMS) granularity, Wiener spectrum, modulation transfer function (MTF), quality index (QI), etc.

[0169] For example, the evaluation data generating unit 811C calculates a value of a predetermined image quality evaluation index (image quality evaluation value) as image quality evaluation data of the image group. The image quality evaluation value may be any parameter that quantitatively expresses the quality of the image, and typically, the higher the image quality evaluation value, the higher the image quality evaluation value.

[0170] As an example of a method for calculating an image quality evaluation value, a method for calculating an Image Quality value (IQ value) used in evaluating the image quality of an OCT image will be described below. First, the evaluation data generating unit 811C detects an image region (tissue image region) corresponding to the tissue (site) of the anterior eye and other image regions (background region, non-tissue image region) by applying a predetermined analysis process (e.g., segmentation) to an evaluation region set in an image to be evaluated. Next, the evaluation data generating unit 811C generates a histogram of brightness in the tissue image region and generates a histogram of brightness in the background region. Next, the evaluation data generating unit 811C calculates an image quality evaluation value (IQ value) from the degree of overlap of these two histograms. For example, the IQ value is defined in the range [0, 100] so that when both histograms completely overlap, the IQ value is 0, and when both histograms are completely separated, the IQ value is 100. This image quality evaluation calculation may include, for example, normalization of two histograms, generation of a probability distribution function, calculation of an IQ value using a predetermined calculation formula, and so on.

[0171] In this way, the evaluation data generation unit 811C may be configured to perform a process of identifying a tissue image region corresponding to the tissue of the anterior eye and a background region in the image to be evaluated, a process of creating a first histogram showing the frequency distribution of luminance in the tissue image region, a process of creating a second histogram showing the frequency distribution of luminance in the background region, and a process of calculating an image quality evaluation value (IQ value) as image quality evaluation data based on the first histogram and the second histogram.

[0172] The evaluation processing unit 812C evaluates the quality of the image group based on the image quality evaluation data generated by the evaluation data generating unit 811C. Several methods for quality evaluation based on image quality evaluation data are described below, but the quality evaluation method is not limited to these and may be any method.

[0173] A first example of quality evaluation based on image quality evaluation data will be described. When an IQ value is obtained for each image constituting an image group, the evaluation processing unit 812C compares each of the multiple IQ values ​​obtained for this image group with a predetermined threshold. If all of the multiple IQ values ​​are equal to or greater than the threshold, the evaluation processing unit 812C determines that the quality of this image group is good. On the other hand, if any of the multiple IQ values ​​is less than the threshold, the evaluation processing unit 812C determines that the quality of this image group is not good.

[0174] A second example of quality evaluation based on image quality evaluation data will be described. When an IQ value is obtained for each image constituting an image group, the evaluation processing unit 812C selects the lowest IQ value from among the multiple IQ values ​​obtained for this image group, and compares this minimum IQ value with a predetermined threshold. If the minimum IQ value is equal to or greater than the threshold, the evaluation processing unit 812C determines that the quality of this image group is good. On the other hand, if the minimum IQ value is less than the threshold, the evaluation processing unit 812C determines that the quality of this image group is not good.

[0175] A third example of quality evaluation based on image quality evaluation data will be described. When an IQ value is obtained for each image constituting an image group, the evaluation processing unit 812C applies a predetermined statistical operation to the multiple IQ values ​​obtained for this image group to calculate a statistical value. The type of this statistical value may be any, and may be, for example, an average value, a minimum value, a maximum value, a mode value, a median value, or the like. Note that the case where the statistical value is the minimum value corresponds to the above-mentioned second example. The evaluation processing unit 812C compares the calculated statistical value with a predetermined threshold value. If the statistical value is equal to or greater than the threshold value, the evaluation processing unit 812C determines that the quality of this image group is good. On the other hand, if the statistical value is less than the threshold value, the evaluation processing unit 812C determines that the quality of this image group is not good.

[0176] The processing executed by the evaluation processing unit 812C is not limited to processing based on the image quality evaluation data generated by the evaluation data generating unit 811C. For example, the evaluation processing unit 812C may be configured to be capable of executing one or more evaluation processes of evaluating the arrangement order of a series of images constituting an image group, evaluating skipping of images, and evaluating misalignment (all of the evaluation processes have been described above).

[0177] <Other elements> 1, the slit lamp microscope 1 may include a display device and an operating device. Alternatively, the display device and the operating device may be peripheral devices of the slit lamp microscope 1.

[0178] The display device displays various information under the control of the control unit 7. The display device may include a flat panel display such as a liquid crystal display (LCD).

[0179] The operation devices include devices for operating the slit lamp microscope 1 and devices for inputting information. The operation devices include, for example, buttons, switches, levers, dials, handles, knobs, mice, keyboards, trackballs, operation panels, and the like.

[0180] A device in which a display device and an operation device are integrated, such as a touch screen, may be used.

[0181] The subject and the assistant can operate the slit lamp microscope 1 by using the display device and the operation device.

[0182] <Alignment> The alignment of the slit lamp microscope 1 with respect to the subject's eye E will be described. In general, alignment is an operation for disposing the device optical system at a suitable position for photographing and measuring the subject's eye E. The alignment in this embodiment is an operation for disposing the illumination system 2 and the imaging system 3 at suitable positions for acquiring a plurality of anterior segment images (such as a series of images, a video image, an image group, or an image set) as shown in FIG.

[0183] There are various methods for aligning an ophthalmic apparatus. Some alignment methods are exemplified below, but the methods applicable to this embodiment are not limited to these.

[0184] An alignment method applicable to this embodiment is stereo alignment. Stereo alignment can be applied to an ophthalmic device capable of photographing the anterior eye from two or more different directions, and a specific method thereof is disclosed in JP 2013-248376 A by the present applicant. Stereo alignment includes, for example, the following steps: a step in which two or more anterior eye cameras photograph the anterior eye from different directions to obtain two or more photographed images; a step in which a processor analyzes these photographed images to obtain a three-dimensional position of the subject's eye; and a step in which the processor controls the movement of the optical system based on the obtained three-dimensional position. As a result, the optical system (illumination system 2 and photographing system 3 in this example) is placed at a suitable position relative to the subject's eye. In typical stereo alignment, the position of the pupil (center or center of gravity of the pupil) of the subject's eye is used as a reference.

[0185] In addition to such stereo alignment, any known alignment method can be adopted, such as a method using a Purkinje image obtained by alignment light, a method using an optical lever, a method using an alignment index, etc. In the method using a Purkinje image, or the method using an optical lever or an alignment index, the position of the corneal apex of the subject's eye is used as a reference.

[0186] Note that while typical conventional alignment methods, including the above examples, are performed with the aim of aligning the axis of the test eye with the optical axis of the optical system, in the present embodiment, alignment can be performed to position the illumination system 2 and the imaging system 3 at a position corresponding to the scan start position.

[0187] As a first example of alignment in this embodiment, after performing alignment based on the pupil or corneal vertex of the subject's eye E by applying any of the above-mentioned alignment methods, the illumination system 2 and the imaging system 3 can be moved (in the X direction) by a distance equivalent to a preset standard value of the corneal radius, or by a distance equivalent to a value obtained by adding a predetermined value to the preset standard value of the corneal radius. Note that instead of using the standard value, a previously obtained measured value of the corneal radius of the subject's eye E may be used.

[0188] As a second example, after performing alignment based on the pupil or corneal apex of the subject's eye E by applying any of the above-mentioned alignment methods, an image of the anterior segment of the subject's eye E is analyzed to measure the corneal radius, and the illumination system 2 and the imaging system 3 can be moved (in the X direction) by a distance corresponding to this measurement value or a distance corresponding to a value obtained by adding a predetermined value to this measurement value. The image of the anterior segment analyzed in this example is, for example, an anterior segment image obtained by the imaging system 3, or another image. The other image may be any image, such as an image obtained by an anterior segment camera or an image obtained by an anterior segment OCT.

[0189] As a third example, an image of the anterior eye obtained by an anterior eye camera or imaging system 3 for stereo alignment can be analyzed to determine a first end of the cornea, and by applying stereo alignment, the illumination system 2 and imaging system 3 can be moved to a position corresponding to this first end or to a position shifted outward a predetermined distance from this first end.

[0190] It is also possible to apply any of the above-mentioned alignment methods to perform alignment based on the pupil or corneal apex of the subject's eye E, and start scanning with the slit light from the position determined thereby. Even in this case, a scan sequence can be set to scan a three-dimensional area including the angle CA (e.g., a three-dimensional area including the entire angle CA). For example, the scan sequence is set to scan to the left from the position determined by alignment based on the pupil or corneal apex, and then scan to the right.

[0191] <Other matters> The slit lamp microscope 1 may include a fixation system that outputs light (fixation light) for fixating the subject's eye E. The fixation system typically includes at least one visible light source (fixation light source) or a display device that displays an image such as a landscape chart or a fixation target. The fixation system is disposed, for example, coaxially or non-coaxially with the illumination system 2 or the imaging system 3. The fixation system may include an internal fixation system that presents a fixation target to the subject through an optical path of the device optical system, and / or an external fixation system that presents a fixation target to the subject from outside the optical path.

[0192] The types of images that can be obtained by the slit lamp microscope 1 are not limited to a plurality of anterior eye images as shown in FIG. 3. For example, the slit lamp microscope 1 can obtain a three-dimensional image based on a plurality of anterior eye images, a rendering image based on the three-dimensional image, a transillumination image, a moving image showing the movement of a contact lens worn on the subject's eye, an image showing the gap between the contact lens and the corneal surface by applying a fluorescent agent, and the like. The rendering image will be described in another embodiment. The transillumination image is an image obtained by a transillumination method that uses the retinal reflection of illumination light to depict opacities or foreign bodies in the eye. It should be noted that fundus photography, corneal endothelial cell photography, meibomian gland photography, and the like may also be possible.

[0193] The slit lamp microscope 1 (data processing unit 8) may also be capable of performing analysis processing. An example of such analysis processing is angle analysis. In angle analysis, a calculation is performed to obtain a predetermined angle parameter based on the images (image group, image set) acquired by the slit lamp microscope 1. In the angle parameter calculation, it is necessary to detect both the cornea and the iris from the image in order to determine the angle position. In order to accurately detect the angle position, it is desirable that both the cornea and the iris are depicted with high image quality. An actual image acquired by the slit lamp microscope 1 is shown in FIG. 6. A doctor or a person skilled in the art would understand that this image has sufficiently high image quality.

[0194] Known examples of the angle parameters include AOD (angle opening distance), ACA (anterior chamber angle), TISA (trabecular iris space area), ARA (angle recess area), and AtA (angle-to-angle distance). Methods for calculating the angle parameters are known. Typically, the angle parameter calculation includes a process (e.g., segmentation, feature point detection, etc.) for identifying the position of the angle and / or a predetermined position near the angle, and a measurement process (e.g., distance measurement, ratio calculation, angle calculation, etc.) for determining the value of the angle parameter based on the identified position.

[0195] The parameters calculated by the slit lamp microscope 1 are not limited to the iridocorneal angle parameters. For example, the slit lamp microscope 1 may be capable of calculating any anterior segment parameter. The anterior segment parameters are values ​​that represent the shape of the anterior segment. Examples of the anterior segment parameters include the corneal anterior surface curvature radius, the corneal posterior surface curvature radius, the lens anterior surface curvature radius, the lens posterior surface curvature radius, the corneal diameter (vertical diameter, horizontal diameter (white-to-white)), the corneal thickness (central thickness, peripheral thickness), the lens thickness, the anterior chamber depth, the anterior chamber volume, the pupil diameter, and the pupil center (eccentricity). The anterior segment parameters may be shape distribution data, and may be, for example, various corneal shape maps such as an axial curvature map, a tangential curvature map, an elevation map, a refractive power map, a thickness map (pachymetry map), and a wavefront aberration map. The method of calculating the anterior segment parameters is known. Typically, the anterior eye parameter calculation includes a process for identifying the area and / or position to be measured (e.g., segmentation, feature point detection, etc.) and a measurement process for determining the value of the anterior eye parameter based on the identified area and / or position (e.g., distance measurement, ratio calculation, angle calculation, etc.).

[0196] <Operation> Several examples of the operation of the slit lamp microscope 1 will now be described.

[0197] Although not shown in the drawings, at any stage, a user (subject, examiner, assistant, etc.) inputs subject information to the slit lamp microscope 1. The input subject information is stored in the control unit 7. The subject information typically includes identification information of the subject (subject ID).

[0198] Furthermore, background information can be input. The background information is any information related to the subject, and examples thereof include interview information of the subject, information written by the subject on a prescribed sheet, and information recorded in the subject's electronic medical record. Typically, the background information includes sex, age, height, weight, disease name, candidate disease name, test results (visual acuity value, eye refractive power value, intraocular pressure value, etc.), history of wearing and strength of refractive corrective devices (glasses, contact lenses, etc.), test history, treatment history, etc. These are merely examples, and the background information is not limited to these.

[0199] In preparation for imaging, the table on which the slit lamp microscope 1 is placed, the chair on which the subject sits, and the chin rest of the slit lamp microscope 1 are adjusted (all not shown). For example, the heights of the table, chair, and chin rest are adjusted. The chin rest is provided with a chin rest and a forehead rest to stably position the subject's face.

[0200] Once the preparation is complete, the subject sits on a chair, rests his / her chin on the chin rest, and places his / her forehead on the forehead rest. Before or after these actions, the user performs an instruction operation to start photographing the subject's eye. This operation may be, for example, pressing an imaging start trigger button (not shown) or inputting an instruction voice. Alternatively, the control unit 7 may detect the completion of the preparation phase and automatically transition to the photographing phase. Also, a fixation target (not shown) may be presented to the subject (subject's eye E or its fellow eye).

[0201] <First operation example> A first operation example that is executed after the above preparation will be described with reference to FIG.

[0202] (S1: Alignment) In response to the start of imaging, the slit lamp microscope 1 first aligns the illumination system 2 and the imaging system 3 with respect to the subject's eye E. Unlike general alignment for aligning the optical axis of the optical system with the corneal apex or pupil center of the subject's eye E, the alignment in step S1 is performed to place the illumination system 2 and the imaging system 3 at the start position of the scan performed in step S2. The alignment in step S1 may be performed in any manner, and may be any of the examples described above. Before the start of, during, and / or after the alignment, operations such as adjustment of the image sensor 5 and focus adjustment may be performed.

[0203] (S2: Scan the 3D area including the angle) The slit lamp microscope 1 scans the anterior segment of the subject's eye E by combining irradiation of slit light by the illumination system 2, video capture by the imaging system 3, and movement of the illumination system 2 and the imaging system 3 by a movement mechanism 6. This scan is applied to a three-dimensional area including the iridocorneal angle CA. By performing one scan (scanning from the scan start position to the scan end position), for example, a group of images (multiple anterior segment images) F1 to FN shown in FIG. 3 can be obtained.

[0204] The data processing unit 8 may perform predetermined processing on the image obtained by scanning. For example, any signal processing or image processing such as noise removal, contrast adjustment, brightness adjustment, color correction, etc. may be applied.

[0205] (S3: Evaluate the quality of the images) The image group evaluation unit 81 evaluates the quality of the image group acquired in the scan in step S2.

[0206] (S4: Is the quality good?) If it is determined in step S3 that the quality of the image group is good (S4: Yes), the operation proceeds to step S5. On the other hand, if it is determined in step S3 that the quality of the image group is not good (S4: No), the operation proceeds to step S6.

[0207] (S5: Output a group of images) If it is determined in step S3 that the quality of the image group is good (S4: Yes), the control unit 7 performs control to output the image group. In this example, the control unit 7 controls the communication unit 9 to transmit the image group to another device.

[0208] Examples of devices to which the image group is sent include information processing devices and storage devices. Information processing devices are, for example, servers on a wide area line, servers on a LAN, computer terminals, etc. Storage devices are storage devices provided on a wide area line, storage devices provided on a LAN, etc.

[0209] The image group output in step S5 may include the background information described above. Alternatively, the background information may be supplementary information of the image group. In general, the data structure of the information output in step S5 is arbitrary.

[0210] Moreover, the image group transmitted in step S5 typically includes a series of images of the anterior segment of the right eye of the subject and a series of images of the anterior segment of the left eye. The series of images of the right eye and the series of images of the left eye are obtained by applying the operation of this example to the right eye and the left eye, respectively. The series of images of the right eye and the series of images of the left eye are each accompanied by the above-mentioned subject's eye information, whereby the series of images of the right eye and the series of images of the left eye are distinguished from each other.

[0211] Identification information of the subject is transmitted together with the image group. This identification information may be the subject ID input to the slit lamp microscope 1, or may be identification information generated based on the subject ID. For example, the subject ID (internal identification information) used for personal identification within the facility where the slit lamp microscope 1 is installed can be converted into external identification information to be used outside the facility. This can improve information security regarding personal information such as the image group and background information.

[0212] (S6: Prompt for reshooting) If it is determined in step S3 that the quality of the image group is not good (S4: No), the control unit 7 performs control to collect a new image group from a three-dimensional region including the angle CA. In this example, the control unit 7 executes control to display and / or output information to prompt the user to retake an image. The user performs an instruction operation to start retaking an image or an instruction operation to not take a retaking image.

[0213] When the user performs an instruction operation to start re-imaging, the control unit 7 performs control to execute the operations from step S1 (or step S2) again. Re-imaging is repeated, for example, up to a predetermined number of times.

[0214] On the other hand, when the user instructs not to retake the images, the control unit 7 may, for example, perform control to transmit the images determined to be of poor quality to another device, or may perform control to delete, save, or record the images determined to be of poor quality.

[0215] The image group transmitted from the slit lamp microscope 1 in step S5 (or S6) is sent directly or indirectly to an information processing device. A typical example of this information processing device is the image reading terminal used by a doctor (or optometrist).

[0216] A doctor can use the image interpretation terminal to interpret a series of images included in the image group (for example, a series of images F1 to FN shown in FIG. 3). It is also possible to construct a three-dimensional image based on the series of images, to display a rendering image of the three-dimensional image, and to display background information. Furthermore, it is possible to analyze any of the series of images, to analyze the three-dimensional image, to analyze the rendering image, and to analyze background information using the image interpretation terminal or another information processing device.

[0217] A doctor can use the image interpretation terminal to create a report (image interpretation report) in which information obtained from the image interpretation is recorded. The image interpretation report is provided to, for example, a facility where the slit lamp microscope 1 is installed, a medical institution designated by the subject, an information processing device used by a doctor designated by the subject, an address registered by the subject (email address, address, etc.), etc. Also, the image interpretation report may be sent to a specified database system to store and manage the image interpretation report.

[0218] Another example of an information processing device to which the image group transmitted from the slit lamp microscope 1 in step S5 (or S6) is a radiology device. The radiology device includes a radiology processor. The radiology processor operates, for example, according to a program for radiology interpretation, and analyzes a series of images included in the image group to obtain findings. Furthermore, the radiology processor creates a report based on the obtained findings.

[0219] The image interpretation processor may include an artificial intelligence engine that performs image interpretation using a trained model (inference model), which typically includes a convolutional neural network (CNN) trained using training data including a large number of images acquired by a slit lamp microscope and their image interpretation information.

[0220] When the image reading device includes an artificial intelligence engine and the slit lamp microscope 1 (data processing unit 8) includes an artificial intelligence engine, these artificial intelligence engines can be adjusted to have the same capabilities. In other words, adjustments can be made so that there is no difference (so that the difference is small) between the artificial intelligence engine of the image reading device and the artificial intelligence engine of the slit lamp microscope 1. In other words, the artificial intelligence engine provided in the image reading device may be at least partially the same as the aforementioned artificial intelligence engine provided in the slit lamp microscope 1.

[0221] For example, the same neural network model and the same parameters can be applied to both artificial intelligence engines, and updates of the model and parameters in both artificial intelligence engines can be synchronized.

[0222] Such unified adjustment of the artificial intelligence engines makes it possible to prevent the inconvenience of inconsistencies and errors occurring between the output by the artificial intelligence engine of the slit lamp microscope 1 and the output by the artificial intelligence engine of the image reading device. As described above, the quality evaluation performed before transmitting the image group from the slit lamp microscope 1 evaluates the image quality required for effective interpretation and diagnosis, so unified adjustment of the artificial intelligence engines makes it possible to appropriately evaluate the quality of the image group before transmission. In other words, the image group that can be read by the artificial intelligence engine of the image reading device can be evaluated with high accuracy as a "readable image group" before transmission from the slit lamp microscope 1, and the image group that cannot be read by the artificial intelligence engine of the image reading device can be evaluated with high accuracy as a "non-readable image group" before transmission from the slit lamp microscope 1.

[0223] In addition, in cases where such unified adjustment of artificial intelligence engines is not made or when interpretation is requested of another image reading device (including an artificial intelligence engine with a different model and / or parameters), it is possible to attach the processing conditions (representing the model, parameters, etc.) of the artificial intelligence engine of the slit lamp microscope 1 to the image set, or to attach the processing conditions of the artificial intelligence engine of the image reading device to the image set.

[0224] According to such a first operation example, if a good quality image group is obtained in the first scan, this image group can be provided for subsequent processing (such as image interpretation). Also, if a good quality image group is not obtained in the first scan, the image group can be acquired again. More generally, shooting can be repeated until a good quality image group is acquired. Therefore, whether or not a good quality image group is obtained in the first scan, it is possible to provide a good quality image group for subsequent processing. This concludes the explanation of the first operation example.

[0225] <Second operation example> A second operation example of the slit lamp microscope 1 will be described with reference to FIG.

[0226] Whereas the first operation example is performed by repeatedly scanning (taking pictures) of a three-dimensional region including the angle until a good quality image group (a series of images collected in a single scan) is obtained, the present operation example is performed by repeatedly scanning (taking pictures) until a good quality image set (e.g., a series of images arranged in a predetermined scan range) is obtained.

[0227] In other words, the data finally obtained in the first operation example is a series of images collected in one scan, whereas the data finally obtained in this operation example is, for example, a series of images arranged in a predetermined scan range (a three-dimensional area including the iridocorneal angle). That is, the data finally obtained in this operation example may be a series of images obtained in one scan, as in the first operation example, or may be a series of images selected from two or more image groups obtained in two or more scans, unlike the first operation example.

[0228] Steps S11 to S13 of this operation example may be performed in the same manner as steps S1 to S3 of the first operation example. Therefore, the description of steps S11 to S13 will be omitted. In addition, unless otherwise specified, the matters described in the first operation example can be combined with this operation example.

[0229] (S14: Is the quality good?) If it is determined in step S13 that the quality of the image group is good (S14: Yes), the operation proceeds to step S15. On the other hand, if it is determined in step S13 that the quality of the image group is not good (S14: No), the operation proceeds to step S16.

[0230] (S15: Output image group) If it is determined in step S13 that the quality of the image group collected in the first scan is good (S14: Yes), the control unit 7 performs control to output the image group. As in the first operation example, the control unit 7 can transmit the image group to another device by controlling the communication unit 9.

[0231] (S16: Encourage them to take the photo again) If it is determined in step S13 that the quality of the image group is not good (S14: No), the control unit 7 performs control to prompt the user to retake the image. The user performs an instruction operation to start retaking the image or an instruction operation not to retake the image.

[0232] In this operation example, the case where re-imaging is performed will be described below. If re-imaging is not performed, the same operation as in the first operation example can be executed in this operation example as well.

[0233] (S17: Alignment) When the user performs an instruction operation to start re-imaging, the control unit 7 executes alignment in the same manner as in step S11.

[0234] (S18: Scanning the 3D area including the angle) After the alignment in step S17 is completed, the slit lamp microscope 1 scans the three-dimensional region including the iridocorneal angle CA in the same manner as in step S12, thereby obtaining a new group of images.

[0235] (S19: Image selection) The selection unit 821 selects one or more images that satisfy a predetermined condition from the collection of images including the image group collected in the scan in step S12 and the image group collected in the scan in step S19. If "No" is determined two or more times in step S14, the selection unit 821 selects one or more images that satisfy a predetermined condition from the collection of images including the image group collected in the scan in step S12 and two or more image groups collected in the scan in step S19 that has been performed two or more times.

[0236] In some example embodiments, the operations of steps S18 and S19 may be either an iterative alternating operation of scanning and image selection, or an operation of performing image selection after all scans are performed, as described above. Such coordinated operations of scanning and image selection select a series of images from two or more images obtained from two or more scans.

[0237] (S20: Create image set) The image set creation unit 82 creates an image set including the series of images selected in step S19.

[0238] (S21: Evaluate the quality of the image set) The image set evaluation unit 83 evaluates the quality of the image set created in step S20.

[0239] (S14: Is the quality good?) If it is determined in step S21 that the quality of the image set is good (S14: Yes), the operation proceeds to step S15. On the other hand, if it is determined in step S21 that the quality of the image set is not good (S14: No), the operation proceeds to step S16, and steps S16 to S14 are executed again.

[0240] (S15: Output image set) If it is determined in step S14 that the quality of the image set is good (S14: Yes), the control unit 7 performs control to output the image set. In this example, the control unit 7 controls the communication unit 9 to transmit the image set to another device.

[0241] The destination of the image set may be the same as or different from the destination of the image group. The output image set may include the background information described above. Alternatively, the background information may be information accompanying the image set. As in the case of the image group, the image set to be transmitted may include a series of images of the anterior part of the subject's right eye and a series of images of the anterior part of the left eye, and further, subject information may be accompanied by the series of images of the right eye and the series of images of the left eye, respectively. In addition, identification information of the subject may be transmitted together with the image set.

[0242] The image set transmitted from the slit lamp microscope 1 in step S15 is sent directly or indirectly to an information processing device, which may be, for example, an image reading terminal and / or an image reading device.

[0243] According to such a second operation example, if a good quality image group is obtained in the first scan, this image group can be provided for subsequent processing (such as image interpretation). Also, if a good quality image group is not obtained in the first scan, a new image group can be obtained and a series of images can be selected from two or more image groups obtained up to that point to create a good quality image set. More generally, imaging can be repeated until a good quality image set is obtained. Therefore, if a good quality image group is obtained in the first scan, this image group can be provided for subsequent processing, and if a good quality image group is not obtained in the first scan, it is possible to create a good quality image set from two or more image groups obtained by two or more scans and provide it for subsequent processing. This concludes the explanation of the second operation example.

[0244] The operations that can be performed by the slit lamp microscope 1 of this embodiment are not limited to the above two examples. For example, the slit lamp microscope 1 can perform operations based on at least one or more of the matters described in this embodiment, modifications thereof, and any known technology.

[0245] For example, the slit lamp microscope 1 may be configured to directly or indirectly transmit a group of images collected in a single scan of a three-dimensional region including the angle CA to an information processing device without re-imaging as in the two examples described above.

[0246] The slit lamp microscope 1 may be configured to apply an analytical process to a series of images (image group, image set) collected from a three-dimensional region including the angle CA to obtain analytical data (angle parameter values, anterior segment parameter values, etc.), and to transmit the analytical data directly or indirectly to an information processing device. Alternatively, the slit lamp microscope 1 may be configured to apply an analytical process to a series of images (image group, image set) collected from a three-dimensional region including the angle CA to obtain analytical data (angle parameter values, anterior segment parameter values, etc.), and to transmit the analytical data and the series of images directly or indirectly to an information processing device.

[0247] <Effects> Some features, some actions, and some effects of the slit lamp microscope 1 of this embodiment will be described.

[0248] The slit lamp microscope 1 includes a scanning unit (illumination system 2, imaging system 3, and movement mechanism 6) and a storage unit 10. The scanning unit collects a group of images by scanning a three-dimensional region including the angle CA of the subject's eye E with slit light. The storage unit 10 stores the group of images collected by the scanning unit.

[0249] According to the slit lamp microscope 1, first, a group of images showing a three-dimensional region including the angle CA can be obtained without contact, so there is no need to apply eye drops or a corneal protective agent (ophthalmic gel) to the subject's eye E, and it is possible to reduce the burden on the patient. Also, unlike the slit lamp microscope that provides an image of one cross section as disclosed in Patent Document 6, the slit lamp microscope 1 can obtain a group of images by scanning a three-dimensional region including the angle CA, so it is possible to observe various parts of the angle CA in detail as in the case of using a gonioscope. Furthermore, even in the case of an eye in a state or characteristic where it is impossible or difficult to depict the angle with an extremely precise OCT device, the slit lamp microscope 1 is highly likely to be able to obtain a group of images depicting the angle, so that better images can be obtained more reliably than before, and the reproducibility of the photographing is also improved. In this way, according to the slit lamp microscope 1, it is possible to achieve both detailed and reliable observation of the angle in non-contact observation of the angle.

[0250] As described above, while delicate and complicated operations are required to obtain good images using conventional slit lamp microscopes, such difficult operations must be performed from a remote location with the remote operation technology disclosed in Patent Documents 3 and 4, making it extremely difficult to obtain images of a quality that can withstand diagnosis (image interpretation). Furthermore, although slit lamp microscopes are effective in screening and follow-up observation, considering the difficulty of remote operation, it can even be said that using slit lamp microscopes in remote medical care is practically impossible with conventional technology.

[0251] In contrast, the slit lamp microscope 1 of this embodiment is configured to first scan the subject's eye E and collect a group of images, and therefore has the advantage that there is no need for a doctor to perform remote operation as in the past. In other words, in the past, a doctor performed an examination while operating the microscope from a remote location, but when using the slit lamp microscope 1, the doctor only needs to interpret the group of images acquired in advance. Therefore, the doctor is freed from the effort and time of photographing and can concentrate on interpreting the images. In this way, this embodiment contributes to expanding the scope of provision of high-quality slit lamp microscopy.

[0252] The slit lamp microscope 1 of this embodiment realizes scanning by the following configuration. The scanning unit includes an illumination system 2, an imaging system 3, and a movement mechanism 6. The illumination system 2 irradiates a three-dimensional area including the iridocorneal angle CA with slit light. The imaging system 3 images the three-dimensional area including the iridocorneal angle CA from a direction different from that of the illumination system 2. The movement mechanism 6 moves the illumination system 2 and the imaging system 3. The imaging system 3 repeatedly captures images in parallel with the movement of the illumination system 2 and the imaging system 3 by the movement mechanism 6. This repeated capture is, for example, video capture at a predetermined capture rate.

[0253] In this embodiment, the moving mechanism 6 moves the illumination system 2 and the imaging system 3 so that, during scanning with the slit light, the slit light irradiated by the illumination system 2 onto a three-dimensional region including the angle CA moves in the width direction of the slit light.

[0254] Furthermore, the slit lamp microscope 1 of this embodiment may have a function as a Scheimpflug camera to obtain an image (two-dimensional cross-sectional image) focused on the range from the anterior surface of the cornea to the posterior surface of the crystalline lens. For this purpose, the imaging system 3 may include an optical system 4 that guides light (return light) from a three-dimensional region including the angle CA irradiated with the slit light, and an image sensor 5 that receives the light guided by the optical system 4 on an imaging surface. Furthermore, the slit lamp microscope 1 may be configured such that the object surface along the optical axis of the illumination system 2, the optical system 4, and the image sensor 5 (imaging surface) satisfy the Scheimpflug condition.

[0255] With this configuration, it is possible to focus on the entire three-dimensional area including the angle CA and capture the image, making it possible to obtain an image of good quality.

[0256] As described above, the angle exists between the cornea and the iris, and many of the parameters of the angle are calculated based on the positional relationship between the angle and its surroundings (i.e., the tissue morphology around the angle). According to this aspect, a high-quality image in which the cornea, the iris, and the surroundings of the angle are in focus can be obtained, so that the position of the angle can be identified with high accuracy and precision, and the angle parameters can be calculated with high accuracy and precision.

[0257] The slit lamp microscope 1 of this embodiment may include a communication unit 9 (first communication unit) that transmits the group of images collected by the scanning unit to the first external device. With this configuration, it becomes possible to provide the group of images collected by the scanning unit to the first external device.

[0258] The slit lamp microscope 1 of this embodiment may include a data processing unit 8 that processes the group of images collected by the scanning unit. This configuration makes it possible to perform desired processing on the group of images collected by the scanning unit.

[0259] The slit lamp microscope 1 of this embodiment may include a communication unit 9 (second communication unit) that transmits data generated by the data processing unit 8 from the group of images collected by the scan unit to a second external device. With this configuration, it becomes possible to provide the data generated by the data processing unit 8 from the group of images to the second external device.

[0260] The data processing unit 8 of the slit lamp microscope 1 of this embodiment may include an image group evaluation unit 81 (first evaluation unit). The image group evaluation unit 81 is configured to evaluate the quality of the image group collected by the scanning unit.

[0261] With this configuration, the quality of the images collected by scanning a 3D region including the angle can be evaluated by the slit lamp microscope itself, allowing the quality of the images to be confirmed before being provided to a doctor or image reading device.

[0262] For example, as described below, the control contents can be switched according to the evaluation results of the image group quality by the image group evaluation unit 81. This makes it possible to execute suitable processing when an image group of good quality is obtained, and to execute suitable processing when an image group of good quality is not obtained.

[0263] In this embodiment of the slit lamp microscope 1, when the image group evaluation unit 81 evaluates that the quality of the image group collected by the scanning unit is good, the image group can be transmitted to a second external device via the communication unit 9.

[0264] According to this configuration, once a group of images of good quality has been acquired, the group of images can be provided to, for example, a doctor in a remote location or to an image reading device in a remote location.

[0265] The slit lamp microscope 1 of this embodiment may include a control unit 7 (first control unit) as described below. When the image group evaluation unit 81 evaluates that the quality of the image group is not good, the control unit 7 executes control to cause the scanning unit to execute a new scan of a three-dimensional region including the angle CA. The control to cause the scanning unit to execute a new scan may be, for example, control to prompt the user to retake an image, or control to automatically perform retake an image (control to automatically switch to retake an image).

[0266] According to this configuration, if a group of images of good quality cannot be obtained in one scan, a smooth transition to re-imaging (rescanning) can be made.

[0267] The slit lamp microscope 1 of this embodiment may include an image set creation unit 82. The image set creation unit 82 is configured to create an image set by selecting a series of images corresponding to a predetermined scan range from two or more image groups including an image group already acquired by scanning a three-dimensional region including the iridocorneal angle CA and a new image group collected in a new scan of the three-dimensional region including the iridocorneal angle CA.

[0268] According to this configuration, when two or more scans are applied to the subject's eye, an image set can be created by a series of images selected from two or more image groups obtained by the scans, so that the possibility of obtaining a good quality image set is improved. For example, even if a good image is not obtained due to blinking or eye movement during the execution of a certain scan, it is possible to supplement this with images obtained by other scans.

[0269] The slit lamp microscope 1 of this embodiment may include an image set evaluation unit 83 (second evaluation unit) that evaluates the quality of the image set created by the image set creation unit 82. For example, the image set evaluation unit 83 can evaluate a series of images included in the image set with respect to any of the arrangement order, missing images, and positional deviation. This evaluation is performed by analyzing a series of images in the image set. For example, the quality of the series of images is evaluated based on landmarks (image regions corresponding to tissues such as the cornea, iris, pupil, and angle) in a series of frames.

[0270] By performing such image set evaluation, it is possible to prepare an image set of good quality that enables effective interpretation by a doctor or an image reading device.

[0271] In the slit lamp microscope 1 of this embodiment, when the image set evaluation unit 83 evaluates that the quality of the image set is good, the communication unit 9 can transmit the image set to the second external device.

[0272] According to this configuration, once a good quality image set has been obtained, it is possible to provide the image set to, for example, a doctor in a remote location or to an image reading device in a remote location.

[0273] The slit lamp microscope 1 of this embodiment may include a control unit 7 (second control unit) as described below. When the image set evaluation unit 83 evaluates that the quality of the image set is not good, the control unit 7 executes control to cause the scanning unit to execute a new scan of a three-dimensional region including the angle CA. The control to cause the scanning unit to execute a new scan may be, for example, control to prompt the user to retake an image, or control to automatically perform retake an image (control to automatically transition to retake an image).

[0274] According to this configuration, if an image set of good quality has not been obtained from two or more scans up to the current stage, it is possible to smoothly move to re-imaging (rescanning).

[0275] In the slit lamp microscope 1 of this embodiment, the scanning unit may scan a three-dimensional region including the entire angle CA with slit light. The entire angle CA is a substantially circular area along the corneal limbus (or its vicinity) of the subject's eye E. The slit lamp microscope 1 can collect a group of images corresponding to the three-dimensional region including the entire angle CA by performing a scan including the entire cornea C. This makes it possible to observe the entire angle CA, enabling detailed examination similar to that of a gonioscope.

[0276] <Other matters> The above-described embodiments are merely examples of the present invention. Therefore, any modifications (omissions, substitutions, additions, etc.) within the scope of the present invention can be appropriately made to the above-described embodiments.

[0277] In the above-described embodiment, the image group and / or image set are evaluated after each scan. In another embodiment, the slit lamp microscope may be configured to first collect a plurality of image groups by continuously performing a plurality of scans, and create an image set from these image groups. That is, the slit lamp microscope of this embodiment may be configured as follows: the scanning unit applies two or more scans to a three-dimensional region including the iridocorneal angle to collect two or more image groups; the data processing unit (image set creation unit) selects a series of images corresponding to the scan range from the two or more collected image groups to create an image set. According to this embodiment, a good image set can be obtained unless any inconvenience (blinking, eye movement, etc.) occurs in all of the multiple scans, so that the possibility of acquiring a good image set is increased.

[0278] The slit lamp microscope according to any of the exemplary aspects may have any use, and may have functions therefor. Some exemplary slit lamp microscopes may have a statistical analysis function and / or a follow-up observation function. These functions are used to quantitatively and objectively evaluate the condition of the subject eye (the anterior segment, particularly the angle). According to the slit lamp microscope of the exemplary aspect, as described above, it is possible to perform detailed and reliable non-contact observation of the angle, and therefore it is possible to effectively and suitably perform statistical analysis and follow-up observation. Note that devices other than the slit lamp microscope (such as an information processing device, an image reading terminal, an image reading device, and an ophthalmic device) may have these functions (same below).

[0279] Such a slit lamp microscope has a function (parameter calculation function) of analyzing an image acquired based on a scan of the anterior segment of the subject's eye (a three-dimensional region including the angle) and calculating the value of a predetermined parameter. The image to be analyzed may be any image, for example, a group of images collected by scanning, at least one image included in the group of images, a three-dimensional image constructed from at least a part of the group of images, a rendered image of the three-dimensional image, an image set obtained from two or more groups of images, at least one image included in the image set, a three-dimensional image constructed from at least a part of the image set, and a rendered image of the three-dimensional image. The parameter to be calculated may be any parameter, for example, any of the angle parameters and / or any of the anterior segment parameters described above. The parameter calculation includes processing according to the target parameter, and may typically include segmentation, feature point detection, distance measurement, ratio calculation, angle calculation, and the like.

[0280] The statistical analysis function includes, for example, comparison with normal eye data (normative data comparison function) and comparison with diseased eye data (disease eye data comparison function).

[0281] A slit lamp microscope with a normative data comparison function is provided with a normal eye database (normative database) obtained by statistically processing parameter values ​​obtained from a large number of normal eyes, or is configured to be able to refer to a normative database stored in another device. A typical normative database defines a normal range of parameter values. The slit lamp microscope determines whether or not a parameter value obtained from the subject eye is included in the normal range. If the parameter value obtained from the subject eye is included in the normal range, the subject eye is determined to be normal (at least with respect to this parameter). If the parameter value obtained from the subject eye is determined to be not included in the normal range, the subject eye is determined to be abnormal (at least with respect to this parameter).

[0282] The slit lamp microscope with diseased eye data comparison function is provided with a database (disease eye database) for a specific disease, or is configured to be able to refer to a normative database stored in another device. The diseased eye database is obtained by statistically processing parameter values ​​obtained from a large number of eyes (disease eyes, affected eyes) diagnosed with a specific disease. A typical diseased eye database specifies an abnormal range of parameter values. When the evaluation target is an angle, the specific disease may be glaucoma, or its subtype or pathology (open angle, narrow angle, closed angle, etc.). The slit lamp microscope determines whether the parameter value obtained from the subject eye is included in the abnormal range. If the parameter value obtained from the subject eye is not included in the abnormal range, the subject eye is determined to be normal (at least with respect to this parameter). If the parameter value obtained from the subject eye is determined to be not included in the abnormal range, the subject eye is determined to be abnormal (at least with respect to this parameter).

[0283] A slit lamp microscope with a follow-up observation function typically has a function of comparing time-series data of the same patient or a function of presenting the data in a comparable manner. For example, such a slit lamp microscope has a function of determining the amount of time-series change in multiple parameter values ​​acquired on the first to Kth dates and times for the same patient, a function of determining the trend of these parameter values, a function of comparing the time-series change in these parameter values ​​with standard changes (standard changes in normal or diseased eyes), and a function of estimating future values ​​based on these parameter values ​​(and standard changes). In addition, the slit lamp microscope has a function of presenting the results obtained by any of these functions. Any method, such as a graph, a histogram, a map, or a color code, can be used to present the results.

[0284] The present disclosure provides a method for controlling a slit lamp microscope according to any one of the aspects. The slit lamp microscope includes a processor and a scanning unit that scans an anterior segment of a subject's eye with a slit light to collect a group of images. The control method includes at least a step of causing the processor to control the scanning unit to apply a scan to a three-dimensional region including an angle.

[0285] It is possible to configure a program for causing a computer to execute this control method. Furthermore, it is possible to create a computer-readable non-transitory recording medium on which this program is recorded. This non-transitory recording medium may be in any form, and examples of such a recording medium include a magnetic disk, an optical disk, a magneto-optical disk, and a semiconductor memory.

[0286] The present disclosure provides an imaging method and a processing method according to any of the aspects. The imaging method includes at least a step of collecting a group of images by applying a scan to a three-dimensional region including the angle of the subject's eye. The processing method is a method for processing the group of images collected by applying a scan to the three-dimensional region including the angle of the subject's eye, and may include any processing method (such as a calculation method, an image processing method, or an image analysis method) described in any of the aspects.

[0287] The present disclosure provides a program for causing a computer to execute such an imaging method and / or processing method, and further provides a computer-readable non-transitory recording medium having such a program recorded thereon. [Explanation of symbols]

[0288] 1. Slit lamp microscope 2. Lighting system 3. Photography 4 Optical system 5. Image sensor 6 Moving mechanism 7 Control section 8 Data Processing Section 9. Communications Department 10 Storage section

Claims

1. A scanning unit that scans a three-dimensional region including the iridocorneal angle of the subject's eye with a slit light to collect a group of images; a storage unit that stores the group of images collected by the scanning unit; a data processing unit for processing the group of images; a communication unit that transmits data generated from the image group by the data processing unit to an external device; Including, the scanning unit applies two or more scans to the three-dimensional region to acquire two or more sets of images; The data processing unit includes: an image set creation unit that creates an image set by selecting a series of images corresponding to a scan range from the two or more image groups; a first evaluation unit for evaluating a quality of the set of images collected by the scanning unit; a second evaluation unit that evaluates the quality of the image set created by the image set creation unit; Including, Slit lamp microscope.

2. A scanning unit that scans a three-dimensional region including the iridocorneal angle of the subject's eye with a slit light to collect a group of images; a storage unit that stores the group of images collected by the scanning unit; a data processing unit for processing the group of images; a communication unit that transmits data generated from the image group by the data processing unit to an external device; Including, The data processing unit includes a first evaluation unit that evaluates a quality of the image group collected by the scanning unit, a first control unit that controls the scanning unit to perform a new scan of the three-dimensional region when the first evaluation unit evaluates that the quality of the image group is not good; The data processing unit includes: an image set creation unit that creates an image set by selecting a series of images corresponding to a scan range from two or more image groups including the image group and a new image group acquired by the new scan; a second evaluation unit that evaluates the quality of the image set created by the image set creation unit; Further comprising: Slit lamp microscope.

3. The scanning unit includes: an illumination system that irradiates the three-dimensional area with the slit light; an imaging system that images the three-dimensional area from a direction different from that of the illumination system; a moving mechanism for moving the illumination system and the imaging system; Including, the imaging system repeatedly performs imaging in parallel with the movement of the illumination system and the imaging system by the movement mechanism; 3. The slit lamp microscope of claim 1 or 2.

4. The imaging system includes: an optical system for guiding light from the three-dimensional area irradiated with the slit light; an imaging element that receives the light guided by the optical system on an imaging surface; Including, an object surface along the optical axis of the illumination system, the optical system, and the imaging surface satisfy the Scheimpflug condition; 4. The slit lamp microscope of claim 3.

5. the moving mechanism moves the illumination system and the imaging system such that the slit light irradiated onto the three-dimensional region by the illumination system moves in a width direction of the slit light.

5. A slit lamp microscope according to claim 3 or 4.

6. When the first evaluation unit evaluates that the quality of the image group is good, the communication unit transmits the image group to the external device. The slit lamp microscope according to any one of claims 1 to 5.

7. When the second evaluation unit evaluates that the quality of the image set is good, the communication unit transmits the image set to the external device. The slit lamp microscope according to any one of claims 1 to 6.

8. and a second control unit that controls the scanning unit to perform a new scan of the three-dimensional region when the second evaluation unit evaluates that the quality of the image set is not good. The slit lamp microscope according to any one of claims 1 to 7.

9. The scanning unit scans a three-dimensional region including the entire angle with the slit light. The slit lamp microscope according to any one of claims 1 to 8.

Images