Ophthalmological device, method for controlling ophthalmological device, and recording medium

Abstract

A front imaging unit 4 of this ophthalmologic device 1 according to an embodiment projects illumination light to an anterior eye part of an eye E to be examined and images the anterior eye part from the front. A shine-proof imaging unit 5 projects slit light to the anterior eye part of the eye E to be examined and images the anterior eye part. A positional relationship determination unit 81 determines the positional relationship between a front image generated by the front imaging unit 4 and a shine-proof image generated by the shine-proof imaging unit 5. A display control unit 71 causes a display unit 11 to display the front image generated by the front imaging unit 4, the shine-proof image generated by the shine-proof imaging unit 5, and positional relationship information based on the positional relationship determined by the positional relationship determination unit 81.

Description

Ophthalmic apparatus, method for controlling an ophthalmic apparatus, and recording medium

[0001] The present disclosure relates to an ophthalmic apparatus, a method for controlling an ophthalmic apparatus, and a recording medium.

[0002] Diagnostic imaging plays an important role in the field of ophthalmology. Various types of ophthalmic devices (ophthalmic imaging devices) are used in ophthalmic diagnostic imaging, such as slit lamp microscopes, fundus cameras, scanning laser ophthalmoscopes (SLOs), and optical coherence tomography (OCT). Ophthalmic devices with imaging functions are not limited to these ophthalmic imaging devices; imaging functions are also incorporated into ophthalmic examination devices and ophthalmic measurement devices such as refractometers, keratometers, tonometers, specular microscopes, wavefront analyzers, and microperimeters.

[0003] Although slit lamp microscopes and optical coherence tomography have been primarily used for anterior segment imaging, other modalities have also been proposed, such as ophthalmic devices using Scheimpflug optics (see, for example, Patent Document 1).

[0004] JP 2023-49320 A

[0005] One object of the present disclosure is to provide a new method for suitably presenting to a user images and data obtained by anterior segment imaging using a Scheimpflug optical system.

[0006] One exemplary aspect of an embodiment is an ophthalmologic apparatus including: a first photographing unit including an illumination system that projects illumination light onto an anterior segment of a subject's eye and a frontal photographing system that photographs the anterior segment from the front; a second photographing unit including a slit illumination system that projects slit light onto the anterior segment and a photographing system that photographs the anterior segment, the slit illumination system and the photographing system being configured as a Scheimpflug optical system; a positional relationship determination unit that determines the positional relationship between a front image generated by the first photographing unit and a Scheimpflug image generated by the second photographing unit; a display unit; and a display control unit that causes the display unit to display the front image, the Scheimpflug image, and positional relationship information based on the positional relationship.

[0007] According to the exemplary embodiment described above, it is possible to provide a new method for suitably presenting to a user images and data obtained by anterior eye imaging using a Scheimpflug optical system.

[0008] FIG. 1 is a schematic diagram illustrating a configuration of an ophthalmic apparatus according to a non-limiting aspect of an embodiment. FIG. 2 is a schematic diagram illustrating a configuration of an ophthalmic apparatus according to a non-limiting aspect of an embodiment. FIG. 3 is a schematic diagram illustrating a configuration of an ophthalmic apparatus according to a non-limiting aspect of an embodiment. FIG. 4 is a schematic diagram illustrating a configuration of an ophthalmic apparatus according to a non-limiting aspect of an embodiment. FIG. 5 is a schematic diagram illustrating a configuration of an ophthalmic apparatus according to a non-limiting aspect of an embodiment. FIG. 6 is a schematic diagram illustrating a process performed by an ophthalmic apparatus according to a non-limiting aspect of an embodiment. FIG. 7 is a schematic diagram illustrating a process performed by an ophthalmic apparatus according to a non-limiting aspect of an embodiment. FIG. 8 is a schematic diagram illustrating a process performed by an ophthalmic apparatus according to a non-limiting aspect of an embodiment. FIG. 9 is a flowchart illustrating an operation performed by an ophthalmic apparatus according to a non-limiting aspect of an embodiment. FIG. 10 is a flowchart illustrating an operation performed by an ophthalmic apparatus according to a non-limiting aspect of an embodiment. FIG. 1 is a schematic diagram illustrating the configuration of an ophthalmic apparatus according to a non-limiting aspect of an embodiment. FIG. 2 is a flowchart illustrating the operation performed by the ophthalmic apparatus according to a non-limiting aspect of an embodiment. FIG. 3 is a schematic diagram illustrating the operation performed by the ophthalmic apparatus according to a non-limiting aspect of an embodiment. FIG. 4 is a flowchart illustrating the operation performed by the ophthalmic apparatus according to a non-limiting aspect of an embodiment. FIG. 5 is a flowchart illustrating the operation performed by the ophthalmic apparatus according to a non-limiting aspect of an embodiment. FIG. 6 is a schematic diagram illustrating the configuration of an ophthalmic apparatus according to a non-limiting aspect of an embodiment. FIG. 7 is a flowchart illustrating the operation performed by the ophthalmic apparatus according to a non-limiting aspect of an embodiment.Fig. 1 is a flowchart for explaining operations performed by an ophthalmic apparatus according to a non-limiting aspect of an embodiment. Fig. 2 is a schematic diagram showing the configuration of an ophthalmic apparatus according to a non-limiting aspect of an embodiment. Fig. 3 is a flowchart for explaining operations performed by an ophthalmic apparatus according to a non-limiting aspect of an embodiment. Fig. 4 is a schematic diagram showing the configuration of an ophthalmic apparatus according to a non-limiting aspect of an embodiment. Fig. 5 is a flowchart for explaining operations performed by an ophthalmic apparatus according to a non-limiting aspect of an embodiment.

[0009] Non-limiting embodiments of the present disclosure will now be described.

[0010] Any known technology can be combined with the embodiments. For example, any matter described in the documents cited in this disclosure can be combined with any aspect of the embodiments. Furthermore, at least one of any known document related to the technical field of the present disclosure, any known technology in a technical field similar to the technical field of the present disclosure, and any known technology in a technical field other than the technical field of the present disclosure can be combined with any aspect of the embodiments.

[0011] For example, the disclosures in Patent Document 1 (JP 2023-49320 A) can be incorporated by reference into the present disclosure. More generally, any technical matter disclosed by the applicant of the present application regarding technology related to the present disclosure (matters disclosed in patent applications, papers, etc.) can be incorporated by reference into the present disclosure.

[0012] Any two or more of the various non-limiting aspects of the embodiments may be at least partially combined.

[0013] At least a portion of the functionality of any aspect described in this disclosure is implemented using circuitry or processing circuitry. The circuitry or processing circuitry may be a general-purpose processor, a special-purpose processor, an integrated circuit, a Central Processing Unit (CPU), a Graphics Processing Unit (GPU), an Application Specific Integrated Circuit (ASIC), a programmable logic device (e.g., a Simple Programmable Logic Device (SPLD), a Complex Programmable Logic Device (CPLD), a Field Programmable Gate Array (FPGA)), or a combination of these devices configured and / or programmed to perform at least some of the disclosed functions. Array), conventional circuitry, and any combination thereof. A processor is considered to be processing circuitry or circuitry, including transistors and / or other circuitry. In this disclosure, circuitry, unit, means, or similar terms refers to hardware that performs at least a portion of the disclosed functions or hardware that is programmed to perform at least a portion of the disclosed functions. The hardware may be hardware disclosed herein or known hardware that is programmed and / or configured to perform at least a portion of the described functions. In the case of a processor, where the hardware can be considered to be a type of circuitry, circuitry, unit, means, or similar terms refers to a combination of hardware and software, and the software is used to configure the hardware and / or processor.

[0014] <Overview of the Embodiments> One objective of the embodiments of the present disclosure is to provide a new method for optimally presenting information (images, data, etc.) obtained by anterior ocular segment imaging using a Scheimpflug optical system to a user. The effects of the embodiments of the present disclosure are not limited to the effects achieved by achieving this objective. This disclosure describes several non-limiting aspects of the embodiments. It will be understood by those skilled in the art that each of the disclosed aspects also achieves unique effects according to its characteristics (configuration, operation, action, use, etc.).

[0015] A first aspect of the embodiment is an ophthalmologic apparatus including a first imaging unit, a second imaging unit, a positional relationship determination unit, a display unit, and a display control unit.

[0016] The first imaging section includes an illumination system and a front imaging system.

[0017] The illumination system is configured to project illumination light onto the anterior segment of the subject's eye. The illumination light is light for illuminating the subject's eye. The light used for the illumination light may be light having any characteristics, such as infrared light (near-infrared light), white light, or visible light of a specific wavelength. The illumination system may be capable of selectively generating multiple types of illumination light with different characteristics (e.g., wavelength, light amount, intensity, etc.). The direction in which the illumination system projects the illumination light onto the subject's eye may be any direction. In some examples, the direction may be inclined with respect to the axis of the subject's eye (in other words, inclined with respect to the frontal direction), but in other examples, the direction may be in the frontal direction.

[0018] The front imaging system images the anterior segment of the subject's eye from the front. In other words, the front imaging system is disposed in front of the subject's eye and is configured to detect light (such as return light of illumination light) traveling in the front direction from the subject's eye.

[0019] The second imaging section includes a slit illumination system and an imaging system.

[0020] The slit illumination system is configured to project slit light onto the anterior segment of the subject's eye. The slit light is light having a slit-shaped beam cross section and is generated, for example, using a slit aperture, but the generation method is not limited thereto. The light used for the slit light may have any characteristics, such as white light, visible light of a specific wavelength, infrared light (near-infrared light), etc. The slit illumination system may be capable of selectively generating multiple types of slit light with different characteristics. The characteristics of the slit light may include, for example, optical characteristics such as wavelength, light amount, and intensity, as well as characteristics related to the shape and dimensions of the beam cross section of the slit light, such as the slit light width, slit light length, and slit light direction. The direction in which the slit illumination system projects the slit light onto the subject's eye may be arbitrary. In some examples, the direction may be a frontal direction relative to the subject's eye, but in other examples, the direction may be inclined relative to the frontal direction.

[0021] The imaging system images the anterior segment of the subject's eye. The orientation of the imaging system relative to the subject's eye may be arbitrary, but the following condition must be satisfied: In the second imaging unit, the slit illumination system and imaging system are configured as a Scheimpflug optical system.

[0022] The Scheimpflug optical system is an optical system configured to satisfy the Scheimpflug condition. The Scheimpflug condition is a condition that the object plane, the principal plane of the lens, and the imaging plane intersect on the same straight line. The second imaging unit is configured so that the object plane including the optical axis of the slit illumination system (illumination optical axis), the principal plane of the optical system of the imaging system, and the imaging plane of the imaging system intersect on the same straight line.

[0023] In some examples, the slit illumination system is arranged to project slit light onto the eye to be examined from a frontal direction, and the imaging system is arranged to image the eye to be examined from an oblique direction so as to satisfy the Scheimpflug condition together with the slit illumination system. In other examples, the slit illumination system is arranged to project slit light onto the eye to be examined from an oblique direction, and the imaging system is arranged to image the eye to be examined from a frontal direction or an oblique direction so as to satisfy the Scheimpflug condition together with the slit illumination system.

[0024] The first imaging unit generates a front image of the anterior segment of the subject's eye. The front image is an image of the anterior segment viewed from the front. The second imaging unit generates a Scheimpflug image of the anterior segment of the subject's eye. The Scheimpflug image is an image with a large depth of field generated using a Scheimpflug optical system.

[0025] The positional relationship determination unit determines a positional relationship between the front image of the anterior eye segment generated by the first imaging unit and the Scheimpflug image of the anterior eye segment generated by the second imaging unit. The positional relationship determination unit is realized by a combination of a processor and a computer program. The positional relationship determination unit may be configured to determine the positional relationship using a machine learning-based algorithm (trained model), or may be configured to determine the positional relationship without using a trained model.

[0026] The positional relationship may be the relative position of the Scheimpflug image with respect to the front image, the relative position of the front image with respect to the Scheimpflug image, or the relative position between the front image and the Scheimpflug image with respect to another reference.

[0027] The display may be any type of display device, for example a liquid crystal display (LCD).

[0028] The display control unit causes the display unit to display the front image generated by the first image capturing unit, the Scheimpflug image generated by the second image capturing unit, and the positional relationship information based on the positional relationship determined by the positional relationship determination unit. The display control unit is realized by a combination of a processor and a computer program.

[0029] The positional relationship information is information that visualizes the positional relationship determined by the positional relationship determination unit, and may take any form.

[0030] This aspect is configured to display a front image and a Scheimpflug image of the anterior segment, as well as positional relationship information. Therefore, the user can observe the anterior segment using both the front image and the Scheimpflug image, and can easily understand the positional relationship between the front image and the Scheimpflug image using the positional relationship information. This allows the user to more appropriately interpret the anterior segment. For example, it is possible to improve the efficiency, accuracy, and detail of interpretation. Thus, this aspect provides a new method for more appropriately presenting images and data obtained by anterior segment imaging using a Scheimpflug optical system to the user.

[0031] Furthermore, the frontal image and Scheimpflug image of the anterior segment and the positional relationship information generated by this embodiment can be provided for image analysis using a computer, thereby improving the quality of image diagnosis.

[0032] A second aspect of the embodiment provides an example of information display in the first aspect. This aspect is the ophthalmologic apparatus of the first aspect, in which the positional relationship determination unit is configured to determine a position in the front image generated by the first image capture unit that corresponds to the projection position of the slit light in the Scheimpflug image generated by the second image capture unit as the positional relationship between the front image and the Scheimpflug image. Furthermore, the display control unit is configured to display projection position information indicating the projection position of the slit light in the Scheimpflug image superimposed on the front image. The positional relationship information of this aspect includes this projection position information. In the present disclosure, the projection position information is also referred to as slit light projection position information.

[0033] This aspect is configured to display a front image and a Scheimpflug image of the anterior segment of the eye, as well as projection position information. Therefore, a user can observe the anterior segment using both the front image and the Scheimpflug image. Furthermore, the projection position information allows the user to easily grasp the position in the front image corresponding to the position of the slit light projection area in the Scheimpflug image, i.e., the position in the front image corresponding to the object surface depicted with a large depth of field in the Scheimpflug image. This further improves the quality of image interpretation and analysis.

[0034] A third aspect of the embodiment provides an example of the information display in the first or second aspect. This aspect is the ophthalmologic apparatus of the first or second aspect, in which the imaging system of the second imaging unit includes a pair of imaging systems. The pair of imaging systems images the anterior segment of the subject's eye from different directions.

[0035] For example, the pair of imaging systems may be arranged symmetrically with respect to the projection direction of the slit light onto the anterior segment of the subject's eye (illumination optical axis). In other words, the pair of imaging systems may be arranged tilted at the same angle in opposite directions with respect to the illumination optical axis. Here, the tilt direction of the pair of imaging systems with respect to the illumination optical axis may be the slit light width direction.

[0036] The pair of imaging systems can (substantially) simultaneously image the anterior segment of the subject's eye, meaning that any error in the imaging timing between the pair of imaging systems is negligible in observing the anterior segment.

[0037] The slit illumination system and the pair of imaging systems are each configured as a Scheimpflug optical system, that is, the pair of imaging systems form a pair of Scheimpflug optical systems that share the slit illumination system.

[0038] The display control unit displays on the display unit a pair of Scheimpflug images (Scheimpflug image pair) generated by simultaneously photographing the anterior segment of the subject's eye using a pair of imaging systems of the second imaging unit, together with the front image generated by the first imaging unit and positional relationship information based on the positional relationship determined by the positional relationship determination unit.

[0039] This aspect is configured to display a front image of the anterior segment, a Scheimpflug image pair, and positional relationship information. That is, this aspect is configured to display a front image of the anterior segment, a pair of Scheimpflug images obtained by viewing the anterior segment from different directions, and positional relationship information indicating the positional relationship between the front image and the pair of Scheimpflug images.

[0040] Therefore, the user can observe the anterior segment of the eye using the front image and the Scheimpflug image pair, and can easily grasp the positional relationship between the front image and the Scheimpflug image pair (for example, the position in the front image corresponding to the position of the slit light projection area in the Scheimpflug image pair, i.e., the position in the front image corresponding to the object surface depicted with a large depth of field in the Scheimpflug image pair) using the positional relationship information. This makes it possible to further improve the quality of image interpretation and image analysis.

[0041] Furthermore, although artifacts caused by corneal reflection or the like may be mixed into one of the Scheimpflug images, even in such cases, the user can still preferably observe the anterior segment using the other Scheimpflug image.

[0042] A fourth aspect of the embodiment provides an example of information display in the first to third aspects. This aspect is the ophthalmologic apparatus of any of the first to third aspects, further including an operation unit. The operation unit may be any operation device, such as a mouse, a touchpad, a keyboard, a trackball, an operation panel, or a touch screen.

[0043] The user can use the operation unit to issue a command to enlarge a partial area of ​​one of the front image and the Scheimpflug image (first image) displayed on the display unit. In response to this command, the display control unit executes an enlarged display of the partial area of ​​the first image and an enlarged display of a partial area of ​​the other image (second image) that corresponds to the partial area of ​​the first image.

[0044] In addition to being configured to display a frontal image and a Scheimpflug image of the anterior segment and positional relationship information, this aspect is also configured such that when a user performs an instruction operation to enlarge and display a partial area of ​​a first image among the displayed frontal image and Scheimpflug image, not only is the partial area of ​​the first image enlarged in accordance with this instruction operation, but also a partial area of ​​a second image corresponding to this partial area of ​​the first image is enlarged and displayed.

[0045] Therefore, the user can observe the anterior segment of the eye using the front image and the Scheimpflug image, and can easily grasp the positional relationship between the front image and the Scheimpflug image using the positional relationship information. In addition, the user can observe enlarged images of both the front image and the Scheimpflug image simply by issuing an instruction to enlarge one of the images. This makes it possible to further improve the quality of image interpretation and image analysis, as well as to improve the efficiency and operability of image interpretation work.

[0046] A fifth aspect of the embodiment provides an example of image generation in the first to fourth aspects. This aspect is the ophthalmologic apparatus of any of the first to fourth aspects, further including a movement mechanism that moves the first imaging unit and the second imaging unit. The movement mechanism may, for example, be capable of moving the first imaging unit and the second imaging unit integrally or individually. The movement mechanism may move the first imaging unit and the second imaging unit in any manner, such as parallel movement, rotational movement, reciprocating movement, continuous movement, or intermittent movement. The movement mechanism may move the first imaging unit and the second imaging unit in any direction, such as the slit light width direction, or another direction.

[0047] The second imaging unit is moved by the moving mechanism and images the anterior segment of the eye, onto which slit light is projected by the slit illumination system, multiple times using the imaging system. That is, by combining the second imaging unit and the moving mechanism, the ophthalmic apparatus of this aspect can apply a scan using slit light to the anterior segment. This anterior segment scan collects multiple Scheimpflug images at different projection positions of the slit light.

[0048] The ophthalmologic apparatus of this aspect is configured to generate a plurality of Scheimpflug images corresponding to a plurality of projection positions of the slit light, thereby enabling the user to observe a wide area of ​​the anterior segment of the subject's eye in detail.

[0049] More specifically, the Scheimpflug images generated in this embodiment depict different cross sections (object planes corresponding to the regions onto which the slit light is projected) of the anterior segment of the subject's eye, and each Scheimpflug image has a large depth of field. In other words, the ophthalmic apparatus of this embodiment is configured to provide high-definition (high-resolution) images of a wide three-dimensional region of the anterior segment of the subject's eye. Therefore, this embodiment can further improve the quality of image interpretation and image analysis.

[0050] A sixth aspect of the embodiment provides an example of the information display in the fifth aspect. This aspect is the ophthalmologic apparatus of the fifth aspect, further including an operation unit. The operation unit of this aspect may be a common operation device with the operation unit of the fourth aspect, or may be a separate operation device.

[0051] The positional relationship determination unit determines the positional relationship between the front image captured by the first image capture unit and each of the plurality of Scheimpflug images generated by the second image capture unit. That is, the positional relationship determination unit of this aspect determines the positional relationship between the Scheimpflug image and the front image for each of the plurality of Scheimpflug images generated by the second image capture unit.

[0052] The user can use the operation unit to perform a pointing operation to specify a desired position in the front image displayed on the display unit. For example, the user can specify a part of the anterior segment of the eye (e.g., the corneal apex, iris, pupil, angle, etc.) or an artificial object (e.g., an intraocular lens, an intraocular contact lens, a minimally invasive glaucoma surgery (MIGS) device, etc.) depicted in the front image, or can specify a lesion depicted in the front image.

[0053] When a position in the front image is specified using the operation unit, the display control unit selects a Scheimpflug image corresponding to the specified position from among a plurality of Scheimpflug images and displays the selected Scheimpflug image on the display unit.

[0054] Furthermore, the display control unit displays, superimposed on the front image, projection position information indicating the projection position of the slit light corresponding to the Scheimpflug image automatically selected based on the position specified by the user. The positional relationship information of this aspect includes this projection position information.

[0055] The ophthalmic device of this embodiment is configured to automatically select and display a Scheimpflug image corresponding to a position specified by the user in the frontal image from among multiple Scheimpflug images corresponding to multiple projection positions of the slit light, and to present information indicating the slit light projection position (position of the object surface) corresponding to the selected Scheimpflug image on the frontal image.

[0056] Therefore, by simply specifying a desired position in the displayed front image, the user can observe a Scheimpflug image obtained when the slit light is projected at the specified position (i.e., a Scheimpflug image in which the cross section at the specified position is in focus), and can easily grasp which position in the front image corresponds to the portion of the anterior segment clearly depicted in the Scheimpflug image. Thus, according to this aspect, it is possible to improve the efficiency and operability of image interpretation work.

[0057] A seventh aspect of the embodiment provides an example of the information display in the sixth aspect. This aspect is the ophthalmologic apparatus of the sixth aspect, in which the imaging system of the second imaging unit includes a pair of imaging systems that image the anterior segment from different directions. The slit illumination system and each of the pair of imaging systems are configured as a Scheimpflug optical system. The configuration of the second imaging unit in this aspect may be the same as that of the third aspect.

[0058] The second imaging unit projects slit light onto the anterior segment of the subject's eye using the slit illumination system while being moved by the moving mechanism, and simultaneously images the anterior segment multiple times using the pair of imaging systems, thereby generating multiple Scheimpflug image pairs corresponding to the multiple projection positions of the slit light.

[0059] The user can use the operation unit to perform a pointing operation to specify a position in the front image displayed on the display unit. In response to this pointing operation, the display control unit selects a Scheimpflug image pair corresponding to the specified position in the front image from among the multiple Scheimpflug image pairs and displays the selected Scheimpflug image pair on the display unit.

[0060] Furthermore, the display control unit displays, superimposed on the front image, projection position information indicating the projection position of the slit light corresponding to the Scheimpflug image pair automatically selected based on the position specified by the user in the front image. The positional relationship information of this aspect includes this projection position information.

[0061] The ophthalmic device of this embodiment is configured to apply an anterior segment scan to the subject's eye to collect multiple Scheimpflug image pairs corresponding to multiple projection positions of the slit light, automatically select and display a Scheimpflug image pair from the collected multiple Scheimpflug image pairs that corresponds to a position specified by the user in the frontal image, and present information indicating the slit light projection position (position of the object surface) corresponding to the selected Scheimpflug image pair on the frontal image.

[0062] Therefore, by simply specifying a desired position in the displayed front image, the user can observe a Scheimpflug image pair obtained when the slit light is projected at the specified position (i.e., a Scheimpflug image pair in focus on the cross section at the specified position, the cross section being viewed from different directions), and can easily grasp which position in the front image corresponds to the portion of the anterior eye segment clearly depicted in the Scheimpflug image pair. Thus, according to this aspect, it is possible to improve the efficiency and operability of image interpretation work.

[0063] This aspect is configured to synchronously display a pair of Scheimpflug images acquired simultaneously by a pair of imaging systems, but one of the Scheimpflug images may be selectively displayed. For example, the display control unit may selectively display a Scheimpflug image generated by a pre-specified one of the pair of imaging systems, or may selectively display a Scheimpflug image specified by a user from the Scheimpflug image pair, or may display a Scheimpflug image from the Scheimpflug image pair that satisfies a predetermined condition (e.g., a Scheimpflug image with relatively high image quality). Furthermore, this aspect may be capable of switching between synchronous display and selective display of a pair of Scheimpflug images. This increases the flexibility of the presentation mode of Scheimpflug images, making it possible to improve the efficiency and operability of radiology interpretation work.

[0064] An eighth aspect of the embodiment provides an example of the information display in the fifth to seventh aspects. This aspect is the ophthalmologic apparatus of any one of the fifth to seventh aspects, further including an operation unit. The operation unit of this aspect may be a common operation device with the operation unit of the fourth aspect, or may be a separate operation device.

[0065] The positional relationship determination unit determines the positional relationship between the front image captured by the first image capture unit and each of the plurality of Scheimpflug images generated by the second image capture unit. That is, the positional relationship determination unit of this aspect determines the positional relationship between the Scheimpflug image and the front image for each of the plurality of Scheimpflug images generated by the second image capture unit.

[0066] The user can use the operation unit to perform an instruction operation to select a Scheimpflug image from among the plurality of Scheimpflug images generated by the second imaging unit. For example, the display control unit can display the plurality of Scheimpflug images in a list or sequentially, and the user can use the operation unit to select a desired Scheimpflug image from the displayed Scheimpflug images.

[0067] When a Scheimpflug image is selected from among the plurality of Scheimpflug images using the operation unit, the display control unit causes the display unit to display the selected Scheimpflug image, and also causes projection position information indicating the projection position of the slit light corresponding to the Scheimpflug image to be displayed superimposed on the front image. The positional relationship information of this aspect includes this projection position information.

[0068] The ophthalmic device of this embodiment is configured to display a Scheimpflug image selected by the user from among multiple Scheimpflug images corresponding to multiple projection positions of the slit light, and to present information indicating the slit light projection position (position of the object surface) when the Scheimpflug image was generated on the front image.

[0069] Therefore, by simply selecting a desired Scheimpflug image, the user can observe the Scheimpflug image and easily grasp which position on the front image corresponds to the portion of the anterior segment clearly depicted in the Scheimpflug image. Thus, according to this aspect, it is possible to improve the efficiency and operability of image interpretation work.

[0070] A ninth aspect of the embodiment provides one example of information display in the fifth to eighth aspects. This aspect is the ophthalmologic apparatus of any of the fifth to eighth aspects, further including an image reconstructor. The image reconstructor generates a reconstructed image from a plurality of Scheimpflug images generated by applying an anterior segment scan to the subject's eye. The image reconstructor is realized by a combination of a processor and a computer program.

[0071] The reconstructed image is generated by applying an arbitrary image reconstruction process to the plurality of Scheimpflug images. Examples of reconstructed images generated from the plurality of Scheimpflug images include a front view image (enface image) and an arbitrary cross-sectional image (MPR image). Note that partial images corresponding to a desired region (site, tissue, artifact, lesion, etc.) may be extracted from the plurality of Scheimpflug images by image segmentation, and the reconstructed image may be generated from the extracted partial images.

[0072] The display control unit causes the display unit to display a reconstructed image generated from the multiple Scheimpflug images by the image reconstruction unit. Furthermore, the display control unit causes the display unit to display projection position information indicating the projection position of the slit light corresponding to the displayed Scheimpflug image, superimposed on the reconstructed image. The positional relationship information of this aspect includes this projection position information.

[0073] The ophthalmic device of this embodiment is configured to generate and display a reconstructed image from multiple Scheimpflug images corresponding to multiple projection positions of the slit light, and to present information on this reconstructed image indicating the slit light projection position (position of the object surface) when the displayed Scheimpflug image was generated.

[0074] Therefore, the user can observe the anterior segment using the reconstructed image in addition to the front image and Scheimpflug image, and can easily understand which positions in the front image and the reconstructed image correspond to the portions of the anterior segment clearly depicted in the Scheimpflug image. Thus, according to this aspect, more detailed observation of the anterior segment is possible.

[0075] A tenth aspect of the embodiment provides one example of information display in the fifth to ninth aspects. This aspect is the ophthalmologic apparatus of any of the fifth to ninth aspects, further including an image rendering unit. The image rendering unit generates a three-dimensional rendering image from a plurality of Scheimpflug images generated by applying an anterior segment scan to the subject's eye. The image rendering unit is realized by a combination of a processor and a computer program.

[0076] A 3D rendering image is generated by applying any 3D rendering process to multiple Scheimpflug images. Examples of 3D rendering images generated from multiple Scheimpflug images include volume rendering images and surface rendering images. Note that partial images corresponding to desired regions (sites, tissues, artifacts, lesions, etc.) may be extracted from the multiple Scheimpflug images by image segmentation, and the 3D rendering image may be generated from the extracted partial images.

[0077] The display control unit causes the display unit to display a 3D rendering image generated from the multiple Scheimpflug images by the image rendering unit. Furthermore, the display control unit causes projection position information indicating the projection position of the slit light corresponding to the displayed Scheimpflug image to be superimposed on the 3D rendering image. The positional relationship information of this aspect includes this projection position information.

[0078] The ophthalmic device of this embodiment is configured to generate and display a three-dimensional rendering image from multiple Scheimpflug images corresponding to multiple projection positions of the slit light, and to present information on this three-dimensional rendering image indicating the slit light projection position (position of the object surface) when the displayed Scheimpflug image was generated.

[0079] Therefore, the user can observe the anterior segment of the eye using the 3D rendering image in addition to the front image and Scheimpflug image, and can easily understand which positions in the front image and the 3D rendering image correspond to the portions of the anterior segment of the eye that are clearly depicted in the Scheimpflug image. Thus, according to this aspect, more detailed observation of the anterior segment of the eye is possible.

[0080] An eleventh aspect of the embodiment provides an example of determining a positional relationship in the first to tenth aspects. This aspect is the ophthalmologic apparatus of any of the first to tenth aspects, in which the first imaging unit images the anterior segment of the subject's eye from the front using the front imaging system without projecting illumination light from the illumination system while the second imaging unit images the anterior segment of the subject's eye. In other words, this aspect performs front imaging using the front imaging system of the first imaging unit while performing Scheimpflug imaging using slit light using the second imaging unit. This front imaging is called additional front imaging, and an image generated by this additional front imaging is called an additional front image. In additional front imaging, illumination light from the illumination system of the first imaging unit is not used, and only slit light from the slit illumination system of the second imaging unit is used. Additional frontal photography may be applied to the anterior segment onto which the slit light is projected, at a timing when there is substantially no positional deviation relative to the position of the subject's eye during Scheimpflug photography, such as immediately before or immediately after Scheimpflug photography.

[0081] In this aspect, the first photographing unit performs both front photographing using illumination light from the illumination system and additional front photographing without using illumination light from the illumination system. The positional relationship determination unit calculates a relative displacement between a front image generated by this front photographing and an additional front image generated by the additional front photographing, and determines a positional relationship between the front image obtained by this front photographing and a Scheimpflug image obtained by Scheimpflug photographing performed together with the additional front photographing based on the calculated relative displacement.

[0082] According to this aspect, it is possible to provide a specific configuration and method for determining the positional relationship between the front image and the Scheimpflug image.

[0083] A twelfth aspect of the embodiment provides an example of determining a positional relationship in the eleventh aspect. This aspect is the ophthalmologic apparatus of the eleventh aspect, in which the positional relationship determination unit calculates a relative displacement between a front image acquired by frontal photography and an additional front image acquired by additional front photography by the following first to third steps.

[0084] In a first step, the positional relationship determination unit identifies a position in the front image corresponding to a predetermined portion of the anterior segment of the subject's eye. In a second step, the positional relationship determination unit identifies a position in the additional front image corresponding to the same predetermined portion of the anterior segment of the subject's eye. This predetermined portion may be any portion of the anterior segment, such as the pupil contour or the iris contour. Alternatively, an ellipse approximating the pupil contour or the iris contour may be considered. The first and second steps are performed using, for example, any image segmentation.

[0085] In the third step, the positional relationship determination unit calculates the relative displacement between the front image and the additional front image based on the position in the front image identified in the first step and the position in the additional front image identified in the second step.

[0086] According to this aspect, a specific configuration and method can be provided for determining the relative displacement between a front image and an additional front image, thereby providing a specific configuration and method for determining the positional relationship between the front image and the Scheimpflug image.

[0087] A thirteenth aspect of the embodiment is an ophthalmologic apparatus including a first imaging unit, a second imaging unit, a positional relationship determination unit, an image analysis unit, a display unit, and a display control unit.

[0088] The first imaging section includes an illumination system and a front imaging system.

[0089] The illumination system is configured to project illumination light onto the anterior segment of the subject's eye. The illumination light is light for illuminating the subject's eye. The light used for the illumination light may be light having any characteristics, such as infrared light (near-infrared light), white light, or visible light of a specific wavelength. The illumination system may be capable of selectively generating multiple types of illumination light with different characteristics (e.g., wavelength, light amount, intensity, etc.). The direction in which the illumination system projects the illumination light onto the subject's eye may be any direction. In some examples, the direction may be inclined with respect to the axis of the subject's eye (in other words, inclined with respect to the frontal direction), but in other examples, the direction may be in the frontal direction.

[0090] The front imaging system images the anterior segment of the subject's eye from the front. In other words, the front imaging system is disposed in front of the subject's eye and is configured to detect light (such as return light of illumination light) traveling in the front direction from the subject's eye.

[0091] The second imaging section includes a slit illumination system and an imaging system.

[0092] The slit illumination system is configured to project slit light onto the anterior segment of the subject's eye. The slit light is light having a slit-shaped beam cross section and is generated, for example, using a slit aperture, but the generation method is not limited thereto. The light used for the slit light may have any characteristics, such as white light, visible light of a specific wavelength, infrared light (near-infrared light), etc. The slit illumination system may be capable of selectively generating multiple types of slit light with different characteristics. The characteristics of the slit light may include, for example, optical characteristics such as wavelength, light amount, and intensity, as well as characteristics related to the shape and dimensions of the beam cross section of the slit light, such as the slit light width, slit light length, and slit light direction. The direction in which the slit illumination system projects the slit light onto the subject's eye may be arbitrary. In some examples, the direction may be a frontal direction relative to the subject's eye, but in other examples, the direction may be inclined relative to the frontal direction.

[0093] The imaging system images the anterior segment of the subject's eye. The orientation of the imaging system relative to the subject's eye may be arbitrary, but the following condition must be satisfied: In the second imaging unit, the slit illumination system and imaging system are configured as a Scheimpflug optical system.

[0094] In some examples, the slit illumination system is arranged to project slit light onto the eye to be examined from a frontal direction, and the imaging system is arranged to image the eye to be examined from an oblique direction so as to satisfy the Scheimpflug condition together with the slit illumination system. In other examples, the slit illumination system is arranged to project slit light onto the eye to be examined from an oblique direction, and the imaging system is arranged to image the eye to be examined from a frontal direction or an oblique direction so as to satisfy the Scheimpflug condition together with the slit illumination system.

[0095] The positional relationship determination unit determines a positional relationship between the front image of the anterior eye segment generated by the first imaging unit and the Scheimpflug image of the anterior eye segment generated by the second imaging unit. The positional relationship determination unit is realized by a combination of a processor and a computer program. The positional relationship determination unit may be configured to determine the positional relationship using a machine learning-based algorithm (trained model), or may be configured to determine the positional relationship without using a trained model.

[0096] The positional relationship may be the relative position of the Scheimpflug image with respect to the front image, the relative position of the front image with respect to the Scheimpflug image, or the relative position between the front image and the Scheimpflug image with respect to another reference.

[0097] The image analysis unit analyzes the Scheimpflug image generated by the second imaging unit to generate analysis data. The type of image analysis process performed by the image analysis unit may be any type, such as a process for determining the distribution of values ​​of a predetermined analysis parameter. Examples of the analysis parameter include, but are not limited to, corneal thickness, corneal elevation, iridocorneal angle parameter, anterior chamber depth, anterior chamber cell flare evaluation parameter, and lens opacity evaluation parameter.

[0098] The display may be any type of display device, for example an LCD.

[0099] The display control unit causes the display unit to display the front image generated by the first image capture unit and the Scheimpflug image generated by the second image capture unit. Furthermore, the display control unit causes the analysis data generated by the image analysis unit to be superimposed on the front image based on the positional relationship between the front image and the Scheimpflug image determined by the positional relationship determination unit. The display control unit is realized by a combination of a processor and a computer program.

[0100] The displayed analytical data may be in any form, such as an analytical map showing the distribution of values ​​of a predetermined analytical parameter, including, but not limited to, a corneal thickness map, a corneal elevation map, an angle parameter map, an anterior chamber depth map, an anterior chamber cell flare evaluation parameter map, and a lens opacity evaluation parameter map.

[0101] This aspect is configured to display a front image and a Scheimpflug image of the anterior segment, and to superimpose analysis data obtained from the Scheimpflug image on the front image. Thus, a user can observe the anterior segment using both the front image and the Scheimpflug image, and can easily grasp the positional relationship between the analysis data obtained from the Scheimpflug image and the front image. For example, a user can observe the anterior segment using both the front image and the Scheimpflug image, and can easily grasp how parameter values ​​represented by an analysis map obtained from the Scheimpflug image are distributed in the front image. This allows a user to appropriately interpret an anterior segment image and easily grasp the analysis results of the anterior segment in detail. For example, it is possible to improve the efficiency, accuracy, and detail of interpretation. Thus, this aspect provides a new method for appropriately presenting images and data obtained by anterior segment imaging using a Scheimpflug optical system to a user.

[0102] Furthermore, the frontal image and Scheimpflug image of the anterior segment, positional relationship information, and analysis data generated by this embodiment can be provided to image analysis using a computer, thereby improving the quality of image diagnosis.

[0103] A fourteenth aspect of the embodiment provides an example of image generation in the thirteenth aspect. This aspect is the ophthalmologic apparatus of the thirteenth aspect, further including a movement mechanism that moves the first imaging unit and the second imaging unit. The movement mechanism may, for example, be capable of moving the first imaging unit and the second imaging unit integrally or individually. The movement mechanism may move the first imaging unit and the second imaging unit in any manner, such as parallel movement, rotational movement, reciprocating movement, continuous movement, or intermittent movement. The movement mechanism may move the first imaging unit and the second imaging unit in any direction, such as the slit light width direction, or another direction.

[0104] The second imaging unit is moved by the moving mechanism and images the anterior segment of the eye, onto which slit light is projected by the slit illumination system, multiple times using the imaging system. That is, by combining the second imaging unit and the moving mechanism, the ophthalmic apparatus of this aspect can apply a scan using slit light to the anterior segment. This anterior segment scan collects multiple Scheimpflug images at different projection positions of the slit light.

[0105] The ophthalmologic apparatus of this aspect is configured to generate a plurality of Scheimpflug images corresponding to a plurality of projection positions of the slit light, thereby enabling the user to observe a wide area of ​​the anterior segment of the subject's eye in detail.

[0106] More specifically, the Scheimpflug images generated in this embodiment depict different cross sections (object planes corresponding to the regions onto which the slit light is projected) of the anterior segment of the subject's eye, and each Scheimpflug image has a large depth of field. In other words, the ophthalmic apparatus of this embodiment is configured to provide high-definition (high-resolution) images of a wide three-dimensional region of the anterior segment of the subject's eye. Therefore, this embodiment can further improve the quality of image interpretation and image analysis.

[0107] A fifteenth aspect of the embodiment provides an example of the information display in the fourteenth aspect. This aspect is the ophthalmologic apparatus of the fourteenth aspect, in which the image analysis unit analyzes a plurality of Scheimpflug images generated by the second imaging unit to generate distribution data of values ​​of a predetermined anterior eye parameter. The analysis data in this aspect includes the distribution data.

[0108] The distribution data may be data that expresses the distribution in any manner, such as a color map that expresses the distribution state using colors, or a density map that expresses the distribution state using density.

[0109] The analysis of the plurality of Scheimpflug images performed by the image analyzer may include analysis of any image generated from the plurality of Scheimpflug images, for example, the image analyzer may be configured to analyze a reconstructed image or a three-dimensional rendered image generated from the plurality of Scheimpflug images to generate the distribution data.

[0110] The display control unit displays the distribution data generated from the plurality of Scheimpflug images by the image analysis unit, superimposed on the front image, based on the positional relationship between the front image and the Scheimpflug images determined by the positional relationship determination unit. The displayed distribution data may be, for example, the above-mentioned analysis map.

[0111] According to this aspect, a user can observe the anterior segment of the subject's eye using the front image and the Scheimpflug image, and can also understand the distribution state of the values ​​of predetermined anterior segment parameters using high-quality distribution data generated from multiple Scheimpflug images that depict a wide three-dimensional region of the anterior segment of the subject's eye with high quality. This makes it possible to further improve the quality of image interpretation and image analysis.

[0112] In one variation of the fifteenth aspect, the image analysis unit may be configured to analyze the front image and generate distribution data of the predetermined anterior eye parameter values ​​as the analysis data. Furthermore, the display control unit of this variation may be configured to superimpose the distribution data generated from the front image by the image analysis unit on any one of the front image, the Scheimpflug image, and another image (e.g., a reconstructed image or a three-dimensional rendering image generated from the Scheimpflug image) based on the positional relationship between the front image and the Scheimpflug image determined by the positional relationship determination unit.

[0113] In another variation of the fifteenth aspect, the image analysis unit may be configured to analyze the front image and one or more Scheimpflug images to generate distribution data of predetermined anterior ocular segment parameter values ​​as analysis data. Furthermore, the display control unit of this variation may be configured to superimpose the distribution data generated from the front image and the Scheimpflug image by the image analysis unit on any of the front image, the Scheimpflug image, and another image (e.g., a reconstructed image or a three-dimensional rendering image generated from the Scheimpflug image) based on the positional relationship between the front image and the Scheimpflug image determined by the positional relationship determination unit.

[0114] A sixteenth aspect of the embodiment provides an example of information display in the fifteenth aspect. This aspect is the ophthalmologic apparatus of the fifteenth aspect, including a storage unit and an image registration unit.

[0115] The storage unit stores multiple image groups of the subject's eye generated on multiple dates and times. Each of the multiple image groups includes a front image of the anterior segment of the subject's eye and multiple Scheimpflug images of the anterior segment of the subject's eye. The front image in each of the multiple image groups may be generated by a first imaging unit of the ophthalmic apparatus or by another ophthalmic apparatus. Furthermore, the multiple Scheimpflug images in each of the multiple image groups may be generated by a second imaging unit of the ophthalmic apparatus or by another ophthalmic apparatus. The storage unit may include any storage medium, such as a hard disk drive or a semiconductor memory.

[0116] The image registration unit performs registration between the front images included in the image groups stored in the storage unit. The registration may be performed by any known method. The image registration unit is realized by a combination of a processor and a computer program.

[0117] The positional relationship determining unit determines, for each of a plurality of image groups, the positional relationship between the front image included in the image group and each Scheimpflug image.

[0118] The image analysis unit generates distribution data of the values ​​of a predetermined anterior eye parameter from the plurality of Scheimpflug images included in each of the plurality of image groups.

[0119] The display control unit, for each of the multiple dates and times at which the multiple image groups were generated, displays the distribution data corresponding to that date and time superimposed on the front image corresponding to that date and time based on the positional relationship corresponding to that date and time. That is, for each of the multiple dates and times, the display control unit displays the distribution data generated from the multiple Scheimpflug images obtained at that date and time superimposed on the front image obtained at that date and time based on the positional relationship determined between the front image obtained at that date and time and the multiple Scheimpflug images. For example, the display control unit can display this information corresponding to two or more of the multiple dates and times side by side on the display unit, or can display this information corresponding to two or more of the multiple dates and times sequentially on the display unit.

[0120] According to this aspect, a user can observe changes in the condition of the anterior segment of the subject's eye using front images and Scheimpflug images obtained at multiple dates and times, and can also understand changes in the distribution of the values ​​of the anterior segment parameters. This makes it possible to further improve the quality of image interpretation and image analysis. This aspect is particularly useful in image diagnosis (e.g., follow-up observation) that focuses on changes in the anterior segment of the subject's eye.

[0121] A seventeenth aspect of the embodiment provides an example of determining the positional relationship in the thirteenth to sixteenth aspects. This aspect is the ophthalmologic apparatus of any one of the thirteenth to sixteenth aspects, in which the first imaging unit images the anterior segment of the subject's eye from the front using the front imaging system without projecting illumination light from the illumination system while the anterior segment of the subject's eye is being imaged by the second imaging unit. That is, this aspect generates an additional front image by performing the additional front imaging described above.

[0122] In this aspect, the first photographing unit performs both front photographing using illumination light from the illumination system and additional front photographing without using illumination light from the illumination system. The positional relationship determination unit calculates a relative displacement between a front image generated by this front photographing and an additional front image generated by the additional front photographing, and determines a positional relationship between the front image obtained by this front photographing and a Scheimpflug image obtained by Scheimpflug photographing performed together with the additional front photographing based on the calculated relative displacement.

[0123] According to this aspect, it is possible to provide a specific configuration and method for determining the positional relationship between the front image and the Scheimpflug image.

[0124] An eighteenth aspect of the embodiment provides an example of determining a positional relationship in the seventeenth aspect. This aspect is the ophthalmologic apparatus of the seventeenth aspect, in which the positional relationship determination unit calculates a relative displacement between a front image obtained by frontal photography and an additional front image obtained by additional front photography by the following first to third steps.

[0125] In a first step, the positional relationship determination unit identifies a position in the front image corresponding to a predetermined portion of the anterior segment of the subject's eye. In a second step, the positional relationship determination unit identifies a position in the additional front image corresponding to the same predetermined portion of the anterior segment of the subject's eye. This predetermined portion may be any portion of the anterior segment, such as the pupil contour or the iris contour. Alternatively, an ellipse approximating the pupil contour or the iris contour may be considered. The first and second steps are performed using, for example, any image segmentation.

[0126] In the third step, the positional relationship determination unit calculates the relative displacement between the front image and the additional front image based on the position in the front image identified in the first step and the position in the additional front image identified in the second step.

[0127] According to this aspect, a specific configuration and method can be provided for determining the relative displacement between a front image and an additional front image, thereby providing a specific configuration and method for determining the positional relationship between the front image and the Scheimpflug image.

[0128] The thirteenth to eighteenth aspects of the embodiment may be at least partially combined with any of the features of the first to twelfth aspects. The method of the aspect obtained by such a combination not only exhibits the effects based on each of the combined features, but also exhibits a synergistic effect of the two or more combined features.

[0129] A nineteenth aspect of the embodiment is an ophthalmologic apparatus including a first imaging unit, a second imaging unit, a positional relationship determination unit, an image analysis unit, a display unit, and a display control unit.

[0130] The first imaging section includes an illumination system and a front imaging system.

[0131] The illumination system is configured to project illumination light onto the anterior segment of the subject's eye. The illumination light is light for illuminating the subject's eye. The light used for the illumination light may be light having any characteristics, such as infrared light (near-infrared light), white light, or visible light of a specific wavelength. The illumination system may be capable of selectively generating multiple types of illumination light with different characteristics (e.g., wavelength, light amount, intensity, etc.). The direction in which the illumination system projects the illumination light onto the subject's eye may be any direction. In some examples, the direction may be inclined with respect to the axis of the subject's eye (in other words, inclined with respect to the frontal direction), but in other examples, the direction may be in the frontal direction.

[0132] The front imaging system images the anterior segment of the subject's eye from the front. In other words, the front imaging system is disposed in front of the subject's eye and is configured to detect light (such as return light of illumination light) traveling in the front direction from the subject's eye.

[0133] The second imaging section includes a slit illumination system and an imaging system.

[0134] The slit illumination system is configured to project slit light onto the anterior segment of the subject's eye. The slit light is light having a slit-shaped beam cross section and is generated, for example, using a slit aperture, but the generation method is not limited thereto. The light used for the slit light may have any characteristics, such as white light, visible light of a specific wavelength, infrared light (near-infrared light), etc. The slit illumination system may be capable of selectively generating multiple types of slit light with different characteristics. The characteristics of the slit light may include, for example, optical characteristics such as wavelength, light amount, and intensity, as well as characteristics related to the shape and dimensions of the beam cross section of the slit light, such as the slit light width, slit light length, and slit light direction. The direction in which the slit illumination system projects the slit light onto the subject's eye may be arbitrary. In some examples, the direction may be a frontal direction relative to the subject's eye, but in other examples, the direction may be inclined relative to the frontal direction.

[0135] The imaging system images the anterior segment of the subject's eye. The orientation of the imaging system relative to the subject's eye may be arbitrary, but the following condition must be satisfied: In the second imaging unit, the slit illumination system and imaging system are configured as a Scheimpflug optical system.

[0136] In some examples, the slit illumination system is arranged to project slit light onto the eye to be examined from a frontal direction, and the imaging system is arranged to image the eye to be examined from an oblique direction so as to satisfy the Scheimpflug condition together with the slit illumination system. In other examples, the slit illumination system is arranged to project slit light onto the eye to be examined from an oblique direction, and the imaging system is arranged to image the eye to be examined from a frontal direction or an oblique direction so as to satisfy the Scheimpflug condition together with the slit illumination system.

[0137] The positional relationship determination unit determines a positional relationship between the front image of the anterior eye segment generated by the first imaging unit and the Scheimpflug image of the anterior eye segment generated by the second imaging unit. The positional relationship determination unit is realized by a combination of a processor and a computer program. The positional relationship determination unit may be configured to determine the positional relationship using a machine learning-based algorithm (trained model), or may be configured to determine the positional relationship without using a trained model.

[0138] The positional relationship may be the relative position of the Scheimpflug image with respect to the front image, the relative position of the front image with respect to the Scheimpflug image, or the relative position between the front image and the Scheimpflug image with respect to another reference.

[0139] The image analysis unit analyzes the front image generated by the first imaging unit to generate analysis data. The type of image analysis process executed by the image analysis unit may be any type, and may be, for example, a process for determining the distribution of values ​​of a predetermined analysis parameter.

[0140] The display may be any type of display device, for example an LCD.

[0141] The display control unit causes the display unit to display the front image generated by the first image capture unit and the Scheimpflug image generated by the second image capture unit. Furthermore, the display control unit causes the analysis data generated by the image analysis unit to be superimposed on the Scheimpflug image based on the positional relationship between the front image and the Scheimpflug image determined by the positional relationship determination unit. The display control unit is realized by a combination of a processor and a computer program.

[0142] The displayed analysis data may take any form, for example, an analysis map showing the distribution of values ​​of a predetermined analysis parameter.

[0143] Furthermore, the image on which the analysis data generated by the image analysis unit is superimposed and displayed is not limited to a Scheimpflug image. In some examples, the display control unit can superimpose the analysis data generated by the image analysis unit on an image generated from one or more Scheimpflug images (e.g., one of a reconstructed image and a three-dimensional rendered image).

[0144] This aspect is configured to display a front image and a Scheimpflug image of the anterior segment, and to superimpose analysis data obtained from the front image on the Scheimpflug image. Thus, a user can observe the anterior segment using both the front image and the Scheimpflug image, and can easily grasp the positional relationship between the analysis data obtained from the front image and the Scheimpflug image. For example, a user can observe the anterior segment using both the front image and the Scheimpflug image, and can easily grasp how parameter values ​​represented by an analysis map obtained from the front image are distributed in the Scheimpflug image. This allows a user to appropriately interpret an anterior segment image and easily grasp the analysis results of the anterior segment in detail. For example, it is possible to improve the efficiency, accuracy, and detail of interpretation. Thus, this aspect provides a new method for appropriately presenting images and data obtained by anterior segment imaging using a Scheimpflug optical system to a user.

[0145] Furthermore, the frontal image and Scheimpflug image of the anterior segment, positional relationship information, and analysis data generated by this embodiment can be provided to image analysis using a computer, thereby improving the quality of image diagnosis.

[0146] The nineteenth aspect of the embodiment can be at least partially combined with any of the features of the first to eighteenth aspects. The method of the aspect obtained by such a combination exhibits the effects based on each of the combined features, as well as the synergistic effects of the two or more combined features.

[0147] A twentieth aspect of the embodiment is an ophthalmologic apparatus including a first imaging unit, a second imaging unit, a positional relationship determination unit, a display unit, an operation unit, and a display control unit.

[0148] The first photographing unit includes an illumination system, a front photographing system, and a focal position changing unit.

[0149] The illumination system is configured to project illumination light onto the anterior segment of the subject's eye. The illumination light is light for illuminating the subject's eye. The light used for the illumination light may be light having any characteristics, such as infrared light (near-infrared light), white light, or visible light of a specific wavelength. The illumination system may be capable of selectively generating multiple types of illumination light with different characteristics (e.g., wavelength, light amount, intensity, etc.). The direction in which the illumination system projects the illumination light onto the subject's eye may be any direction. In some examples, the direction may be inclined with respect to the axis of the subject's eye (in other words, inclined with respect to the frontal direction), but in other examples, the direction may be in the frontal direction.

[0150] The front imaging system images the anterior segment of the subject's eye from the front. In other words, the front imaging system is disposed in front of the subject's eye and is configured to detect light (such as return light of illumination light) traveling in the front direction from the subject's eye.

[0151] The focal position changing unit changes the focal position of the front imaging system. The focal position changing unit may have any known configuration and may include, for example, a focus lens. For example, the focus lens is movable along the optical axis of the front imaging system.

[0152] The first imaging unit having such a configuration generates a plurality of front images corresponding to a plurality of focal positions of the front imaging system. In other words, the first imaging unit generates a plurality of front images each focused on a plurality of depth regions of the anterior segment of the subject's eye. For example, the first imaging unit can generate a front image focused on the cornea and its vicinity, a front image focused on the anterior chamber, a front image focused on the iris (pupil) and its vicinity, a front image focused on the lens, etc.

[0153] The second imaging section includes a slit illumination system and an imaging system.

[0154] The slit illumination system is configured to project slit light onto the anterior segment of the subject's eye. The slit light is light having a slit-shaped beam cross section and is generated, for example, using a slit aperture, but the generation method is not limited thereto. The light used for the slit light may have any characteristics, such as white light, visible light of a specific wavelength, infrared light (near-infrared light), etc. The slit illumination system may be capable of selectively generating multiple types of slit light with different characteristics. The characteristics of the slit light may include, for example, optical characteristics such as wavelength, light amount, and intensity, as well as characteristics related to the shape and dimensions of the beam cross section of the slit light, such as the slit light width, slit light length, and slit light direction. The direction in which the slit illumination system projects the slit light onto the subject's eye may be arbitrary. In some examples, the direction may be a frontal direction relative to the subject's eye, but in other examples, the direction may be inclined relative to the frontal direction.

[0155] The imaging system images the anterior segment of the subject's eye. The orientation of the imaging system relative to the subject's eye may be arbitrary, but the following condition must be satisfied: In the second imaging unit, the slit illumination system and imaging system are configured as a Scheimpflug optical system.

[0156] In some examples, the slit illumination system is arranged to project slit light onto the eye to be examined from a frontal direction, and the imaging system is arranged to image the eye to be examined from an oblique direction so as to satisfy the Scheimpflug condition together with the slit illumination system. In other examples, the slit illumination system is arranged to project slit light onto the eye to be examined from an oblique direction, and the imaging system is arranged to image the eye to be examined from a frontal direction or an oblique direction so as to satisfy the Scheimpflug condition together with the slit illumination system.

[0157] The positional relationship determination unit determines a positional relationship between each of a plurality of front images corresponding to a plurality of focus positions generated by the first image capture unit and the Scheimpflug image generated by the second image capture unit. The positional relationship determination unit is realized by a combination of a processor and a computer program. The positional relationship determination unit may be configured to determine the positional relationship using a machine learning-based algorithm (trained model), or may be configured to determine the positional relationship without using a trained model.

[0158] The positional relationship may be the relative position of the Scheimpflug image with respect to the front image, the relative position of the front image with respect to the Scheimpflug image, or the relative position between the front image and the Scheimpflug image with respect to another reference.

[0159] The "positional relationship" in the first to nineteenth aspects includes at least the positional relationship in directions perpendicular to the axis of the eye (called the Z direction) (called the X and Y directions, or the XY directions). In contrast, the "positional relationship" in the present aspect includes at least the positional relationship in the Z direction (depth direction).

[0160] The display may be any type of display device, for example an LCD.

[0161] The operation unit may be any operation device, such as a mouse, a touchpad, a keyboard, a trackball, an operation panel, or a touchscreen.

[0162] The user can use the operation unit to perform a pointing operation to specify a desired position in the Scheimpflug image displayed on the display unit. For example, the user can specify a region of the anterior segment of the eye (e.g., the cornea, the anterior chamber, the iris, the pupil, the angle, etc.) or an artificial object (e.g., an intraocular lens, an intraocular contact lens, a MIGS device, etc.) depicted in the Scheimpflug image, or can specify a lesion depicted in the Scheimpflug image.

[0163] When a position in the Scheimpflug image is specified using the operation unit, the display control unit selects one or more front images from the plurality of front images corresponding to the plurality of focal positions generated by the first photographing unit based on the specified position and the positional relationship determined by the positional relationship determination unit, and displays the selected front images on the display unit. The selected and displayed front images are front images focused on the position specified by the user (or front images focused on a position near the specified position). The display control unit is realized by a combination of a processor and a computer program.

[0164] This aspect is configured to automatically select and display a front image focused at a position specified by a user in a Scheimpflug image from among multiple front images focused at multiple different depth positions of the anterior segment of the subject's eye (in other words, multiple front images with different focal plane depth positions). Thus, while observing the anterior segment using a Scheimpflug image, a user can simply specify a desired depth position in the Scheimpflug image to display a front image focused at that depth position and observe the anterior segment. This allows the user to perform an image interpretation in a more suitable manner. For example, it is possible to improve the efficiency, accuracy, and detail of image interpretation. Thus, this aspect provides a new method for conveniently presenting images and data obtained by anterior segment imaging using a Scheimpflug optical system to a user.

[0165] Furthermore, the frontal image and Scheimpflug image of the anterior segment and the positional relationship information generated by this embodiment can be provided for image analysis using a computer, thereby improving the quality of image diagnosis.

[0166] The twentieth aspect of the embodiment can be at least partially combined with any of the features of the first to nineteenth aspects. The method of the aspect obtained by such a combination exhibits the effects based on each of the combined features, as well as the synergistic effects of the two or more combined features.

[0167] A twenty-first aspect of the embodiment is an ophthalmologic apparatus including a first imaging unit, a second imaging unit, a positional relationship determination unit, a display unit, an operation unit, an image synthesis unit, and a display control unit.

[0168] The first photographing unit includes an illumination system, a front photographing system, and a focal position changing unit.

[0169] The illumination system is configured to project illumination light onto the anterior segment of the subject's eye. The illumination light is light for illuminating the subject's eye. The light used for the illumination light may be light having any characteristics, such as infrared light (near-infrared light), white light, or visible light of a specific wavelength. The illumination system may be capable of selectively generating multiple types of illumination light with different characteristics (e.g., wavelength, light amount, intensity, etc.). The direction in which the illumination system projects the illumination light onto the subject's eye may be any direction. In some examples, the direction may be inclined with respect to the axis of the subject's eye (in other words, inclined with respect to the frontal direction), but in other examples, the direction may be in the frontal direction.

[0170] The front imaging system images the anterior segment of the subject's eye from the front. In other words, the front imaging system is disposed in front of the subject's eye and is configured to detect light (such as return light of illumination light) traveling in the front direction from the subject's eye.

[0171] The focal position changing unit changes the focal position of the front imaging system. The focal position changing unit may have any known configuration and may include, for example, a focus lens. For example, the focus lens is movable along the optical axis of the front imaging system.

[0172] The first imaging unit having such a configuration generates a plurality of front images corresponding to a plurality of focal positions of the front imaging system. In other words, the first imaging unit generates a plurality of front images each focused on a plurality of depth regions of the anterior segment of the subject's eye. For example, the first imaging unit can generate a front image focused on the cornea and its vicinity, a front image focused on the anterior chamber, a front image focused on the iris (pupil) and its vicinity, a front image focused on the lens, etc.

[0173] The second imaging section includes a slit illumination system and an imaging system.

[0174] The slit illumination system is configured to project slit light onto the anterior segment of the subject's eye. The slit light is light having a slit-shaped beam cross section and is generated, for example, using a slit aperture, but the generation method is not limited thereto. The light used for the slit light may have any characteristics, such as white light, visible light of a specific wavelength, infrared light (near-infrared light), etc. The slit illumination system may be capable of selectively generating multiple types of slit light with different characteristics. The characteristics of the slit light may include, for example, optical characteristics such as wavelength, light amount, and intensity, as well as characteristics related to the shape and dimensions of the beam cross section of the slit light, such as the slit light width, slit light length, and slit light direction. The direction in which the slit illumination system projects the slit light onto the subject's eye may be arbitrary. In some examples, the direction may be a frontal direction relative to the subject's eye, but in other examples, the direction may be inclined relative to the frontal direction.

[0175] The imaging system images the anterior segment of the subject's eye. The orientation of the imaging system relative to the subject's eye may be arbitrary, but the following condition must be satisfied: In the second imaging unit, the slit illumination system and imaging system are configured as a Scheimpflug optical system.

[0176] In some examples, the slit illumination system is arranged to project slit light onto the eye to be examined from a frontal direction, and the imaging system is arranged to image the eye to be examined from an oblique direction so as to satisfy the Scheimpflug condition together with the slit illumination system. In other examples, the slit illumination system is arranged to project slit light onto the eye to be examined from an oblique direction, and the imaging system is arranged to image the eye to be examined from a frontal direction or an oblique direction so as to satisfy the Scheimpflug condition together with the slit illumination system.

[0177] The positional relationship determination unit determines a positional relationship between each of a plurality of front images corresponding to a plurality of focus positions generated by the first image capture unit and the Scheimpflug image generated by the second image capture unit. The positional relationship determination unit is realized by a combination of a processor and a computer program. The positional relationship determination unit may be configured to determine the positional relationship using a machine learning-based algorithm (trained model), or may be configured to determine the positional relationship without using a trained model.

[0178] The positional relationship may be the relative position of the Scheimpflug image with respect to the front image, the relative position of the front image with respect to the Scheimpflug image, or the relative position between the front image and the Scheimpflug image with respect to another reference.

[0179] As in the twentieth aspect, the "positional relationship" in this aspect includes at least the positional relationship in the Z direction (depth direction).

[0180] The display may be any type of display device, for example an LCD.

[0181] The operation unit may be any operation device, such as a mouse, a touchpad, a keyboard, a trackball, an operation panel, or a touchscreen.

[0182] The user can use the operation unit to perform a pointing operation to specify a desired position in the Scheimpflug image displayed on the display unit. For example, the user can specify a region of the anterior segment of the eye (e.g., the cornea, the anterior chamber, the iris, the pupil, the angle, etc.) or an artificial object (e.g., an intraocular lens, an intraocular contact lens, a MIGS device, etc.) depicted in the Scheimpflug image, or can specify a lesion depicted in the Scheimpflug image.

[0183] When a position in the Scheimpflug image is specified using the operation unit, the image synthesis unit selects two or more front images from among the multiple front images corresponding to the multiple focal positions generated by the first photographing unit based on the specified position and the positional relationship determined by the positional relationship determination unit, and generates a composite image of the selected two or more front images.

[0184] This image synthesis may be any known process, such as focus synthesis, averaging, integration (projection), image reconstruction, rendering, etc. The two or more front images selected and synthesized are front images focused on a position specified by the user (or front images focused on a position near this specified position). The image synthesis unit is realized by a combination of a processor and a computer program.

[0185] The display control unit causes the display unit to display the composite image generated by the image composition unit. The display control unit is realized by a combination of a processor and a computer program.

[0186] This aspect is configured to automatically select two or more front images focused at a user-specified position in the Scheimpflug image from among multiple front images focused at multiple different depth positions of the anterior segment of the subject's eye (in other words, multiple front images with different focal plane depth positions), and generate and display a composite image of these. Thus, while observing the anterior segment using the Scheimpflug images, a user can simply specify a desired depth position in the Scheimpflug image to display a desired composite image corresponding to that depth position, thereby observing the anterior segment. For example, by simply specifying a desired depth position in the Scheimpflug image, the user can apply focus stacking to two or more front images selected according to the specified position, thereby displaying a focus stacked image with an extended depth of field, thereby observing the anterior segment. This allows the user to perform an image interpretation more efficiently. For example, it is possible to improve the efficiency, accuracy, and detail of image interpretation. Thus, this aspect provides a new method for conveniently presenting images and data obtained by anterior segment imaging using a Scheimpflug optical system to a user.

[0187] Furthermore, the frontal image and Scheimpflug image of the anterior segment, the composite image, and the positional relationship information generated by this embodiment can be provided for image analysis using a computer, thereby improving the quality of image diagnosis.

[0188] The twenty-first aspect of the embodiment can be at least partially combined with any of the features of the first to twentieth aspects. The method of the aspect obtained by such a combination not only exhibits the effects based on each of the combined features, but also exhibits a synergistic effect of the two or more combined features.

[0189] A twenty-second aspect of the embodiment provides a method corresponding to the ophthalmic apparatus of the first aspect. The method of this aspect is a method for controlling an ophthalmic apparatus for photographing an anterior segment of an eye to be examined.

[0190] An ophthalmologic apparatus controlled by the method of this aspect includes a first imaging unit, a second imaging unit, a display unit, and a processor. The first imaging unit includes an illumination system that projects illumination light onto the anterior segment of the eye to be examined, and a front imaging system that images the anterior segment of the eye to be examined from the front. The second imaging unit includes a slit illumination system that projects slit light onto the anterior segment of the eye to be examined, and a imaging system that images the anterior segment of the eye to be examined. The slit illumination system and the imaging system are configured as a Scheimpflug optical system. The method of this aspect includes the following series of steps.

[0191] In the first step, the first photographing unit is controlled to generate a front image of the anterior segment of the subject's eye.

[0192] In the second step, the second photographing unit is controlled to generate a Scheimpflug image of the anterior segment of the subject's eye.

[0193] The third step controls the processor to determine the positional relationship between the front image generated in the first step and the Scheimpflug image generated in the second step.

[0194] The fourth step is to control the processor to display on the display unit the front image generated in the first step, the Scheimpflug image generated in the second step, and positional relationship information based on the positional relationship determined in the third step.

[0195] According to the method of the 22nd aspect, similar to the ophthalmic device of the first aspect, it is possible to provide a new technique for suitably presenting to a user images and data obtained by anterior segment imaging using a Scheimpflug optical system.

[0196] Any of the features of the first to twenty-first aspects can be at least partially combined with the twenty-second aspect. The method of the aspect obtained by such a combination not only exhibits the effects based on each of the combined features, but also exhibits a synergistic effect of the two or more combined features.

[0197] A twenty-third aspect of the embodiment provides a method corresponding to the ophthalmic apparatus of the thirteenth aspect. The method of this aspect is a method for controlling an ophthalmic apparatus for photographing an anterior segment of an eye to be examined.

[0198] An ophthalmologic apparatus controlled by the method of this aspect includes a first imaging unit, a second imaging unit, a display unit, and a processor. The first imaging unit includes an illumination system that projects illumination light onto the anterior segment of the eye to be examined, and a front imaging system that images the anterior segment of the eye to be examined from the front. The second imaging unit includes a slit illumination system that projects slit light onto the anterior segment of the eye to be examined, and a imaging system that images the anterior segment of the eye to be examined. The slit illumination system and the imaging system are configured as a Scheimpflug optical system. The method of this aspect includes the following series of steps.

[0199] In the first step, the first photographing unit is controlled to generate a front image of the anterior segment of the subject's eye.

[0200] In the second step, the second photographing unit is controlled to generate a Scheimpflug image of the anterior segment of the subject's eye.

[0201] The third step is to control the processor to determine the positional relationship between the front image generated in the first step and the Scheimpflug image generated in the second step.

[0202] The fourth step is to control the processor to analyze the Scheimpflug image generated in the second step to generate analysis data.

[0203] In a fifth step, the processor is controlled to display the front image generated in the first step and the Scheimpflug image generated in the second step on the display unit.

[0204] The sixth step is to control the processor to superimpose the analysis data generated from the Scheimpflug image in the fourth step onto the front image displayed on the display unit in the fifth step, based on the positional relationship determined in the third step.

[0205] According to the method of the 23rd aspect, similar to the ophthalmic device of the 13th aspect, it is possible to provide a new technique for suitably presenting to a user images and data obtained by anterior segment imaging using a Scheimpflug optical system.

[0206] Any of the features of the first to twenty-second aspects can be at least partially combined with the twenty-third aspect. The method of the aspect obtained by such a combination not only exhibits the effects based on each of the combined features, but also exhibits a synergistic effect of the two or more combined features.

[0207] A twenty-fourth aspect of the embodiment provides a method corresponding to the ophthalmic apparatus of the nineteenth aspect. The method of this aspect is a method for controlling an ophthalmic apparatus for photographing an anterior segment of an eye to be examined.

[0208] An ophthalmologic apparatus controlled by the method of this aspect includes a first imaging unit, a second imaging unit, a display unit, and a processor. The first imaging unit includes an illumination system that projects illumination light onto the anterior segment of the eye to be examined, and a front imaging system that images the anterior segment of the eye to be examined from the front. The second imaging unit includes a slit illumination system that projects slit light onto the anterior segment of the eye to be examined, and a imaging system that images the anterior segment of the eye to be examined. The slit illumination system and the imaging system are configured as a Scheimpflug optical system. The method of this aspect includes the following series of steps.

[0209] In the first step, the first photographing unit is controlled to generate a front image of the anterior segment of the subject's eye.

[0210] In the second step, the second photographing unit is controlled to generate a Scheimpflug image of the anterior segment of the subject's eye.

[0211] The third step controls the processor to determine the positional relationship between the front image generated in the first step and the Scheimpflug image generated in the second step.

[0212] The fourth step is to control the processor to analyze the front image generated in the first step and generate analysis data.

[0213] In a fifth step, the processor is controlled to display the front image generated in the first step and the Scheimpflug image generated in the second step on the display unit.

[0214] The sixth step is to control the processor to superimpose the analysis data generated from the front image in the fourth step onto the Scheimpflug image displayed on the display unit in the fifth step, based on the positional relationship determined in the third step.

[0215] According to the method of the 24th aspect, similar to the ophthalmic device of the 19th aspect, it is possible to provide a new technique for suitably presenting to a user images and data obtained by anterior segment imaging using a Scheimpflug optical system.

[0216] The features of any of the first to twenty-third aspects can be at least partially combined with the twenty-fourth aspect. The method of the aspect obtained by such a combination not only exhibits the effects based on each of the combined features, but also exhibits a synergistic effect of the two or more combined features.

[0217] A twenty-fifth aspect of the embodiment provides a method corresponding to the ophthalmic apparatus of the twentieth aspect. The method of this aspect is a method for controlling an ophthalmic apparatus for photographing an anterior segment of an eye to be examined.

[0218] An ophthalmologic apparatus controlled by the method of this aspect includes a first imaging unit, a second imaging unit, a display unit, an operation unit, and a processor. The first imaging unit includes an illumination system that projects illumination light onto the anterior segment of the eye to be examined, a front imaging system that images the anterior segment of the eye to be examined from the front, and a focal position changing unit that changes the focal position of the front imaging system. The second imaging unit includes a slit illumination system that projects slit light onto the anterior segment of the eye to be examined, and a imaging system that images the anterior segment of the eye to be examined. The slit illumination system and the imaging system are configured as a Scheimpflug optical system. The method of this aspect includes the following series of steps.

[0219] The first step is to control the first imaging unit to generate a plurality of front images of the anterior segment of the subject's eye corresponding to a plurality of focal positions of the front imaging system.

[0220] In the second step, the second photographing unit is controlled to generate a Scheimpflug image of the anterior segment of the subject's eye.

[0221] The third step controls the processor to determine the positional relationship between each of the multiple front images corresponding to the multiple focus positions generated in the first step and the Scheimpflug image generated in the second step.

[0222] In the fourth step, when a position in the Scheimpflug image is specified using the operation unit, the processor is controlled to display one or more front images out of the multiple front images generated in the first step on the display unit based on the specified position and the positional relationship determined in the third step.

[0223] According to the method of the 25th aspect, similar to the ophthalmic device of the 20th aspect, it is possible to provide a new technique for suitably presenting to a user images and data obtained by anterior segment imaging using a Scheimpflug optical system.

[0224] Any of the features of the first to twenty-fourth aspects can be at least partially combined with the twenty-fifth aspect. The method of the aspect obtained by such a combination not only exhibits the effects based on each of the combined features, but also exhibits a synergistic effect of the two or more combined features.

[0225] A twenty-sixth aspect of the embodiment provides a method corresponding to the ophthalmic apparatus of the twenty-first aspect. The method of this aspect is a method for controlling an ophthalmic apparatus for photographing an anterior segment of an eye to be examined.

[0226] An ophthalmologic apparatus controlled by the method of this aspect includes a first imaging unit, a second imaging unit, a display unit, an operation unit, and a processor. The first imaging unit includes an illumination system that projects illumination light onto the anterior segment of the eye to be examined, a front imaging system that images the anterior segment of the eye to be examined from the front, and a focal position changing unit that changes the focal position of the front imaging system. The second imaging unit includes a slit illumination system that projects slit light onto the anterior segment of the eye to be examined, and a imaging system that images the anterior segment of the eye to be examined. The slit illumination system and the imaging system are configured as a Scheimpflug optical system. The method of this aspect includes the following series of steps.

[0227] The first step is to control the first imaging unit to generate a plurality of front images of the anterior segment of the subject's eye corresponding to a plurality of focal positions of the front imaging system.

[0228] In the second step, the second photographing unit is controlled to generate a Scheimpflug image of the anterior segment of the subject's eye.

[0229] The third step controls the processor to determine the positional relationship between each of the multiple front images corresponding to the multiple focus positions generated in the first step and the Scheimpflug image generated in the second step.

[0230] In the fourth step, when a position in the Scheimpflug image is specified using the operating unit, the processor is controlled to generate a composite image of two or more front images from the plurality of front images generated in the first step based on the specified position and the positional relationship determined in the third step.

[0231] In a fifth step, the composite image generated in the fourth step is displayed on a display unit.

[0232] According to the method of the 26th aspect, similar to the ophthalmic device of the 21st aspect, it is possible to provide a new technique for suitably presenting to a user images and data obtained by anterior segment imaging using a Scheimpflug optical system.

[0233] Any of the features of the first to twenty-fifth aspects can be at least partially combined with the twenty-sixth aspect. The method of the aspect obtained by such a combination not only exhibits the effects based on each of the combined features, but also exhibits a synergistic effect of the two or more combined features.

[0234] A 27th aspect of the embodiment is a program causing a computer to execute the method according to any one of the 22nd to 26th aspects. The computer of the 27th aspect includes the processor according to any one of the 22nd to 26th aspects.

[0235] According to the program of the 27th aspect, similar to the methods of any of the 22nd to 26th aspects, it is possible to provide a new method for suitably presenting to a user images and data obtained by anterior segment imaging using a Scheimpflug optical system.

[0236] Any of the features of the first to twenty-sixth aspects can be at least partially combined with the twenty-seventh aspect. The method of the aspect obtained by such a combination not only exhibits the effects based on each of the combined features, but also exhibits a synergistic effect of the two or more combined features.

[0237] A twenty-eighth aspect of the embodiment is a computer-readable non-transitory recording medium having the program of the twenty-seventh aspect recorded thereon.

[0238] According to the recording medium of the 28th aspect, similar to the program of the 27th aspect, it is possible to provide a new method for suitably presenting to a user images and data obtained by anterior segment imaging using a Scheimpflug optical system.

[0239] Any of the features of the first to twenty-sixth aspects can be at least partially combined with the twenty-eighth aspect. The method of the aspect obtained by such a combination not only exhibits the effects based on each of the combined features, but also exhibits a synergistic effect of the two or more combined features.

[0240] The present disclosure describes various non-limiting aspects, including aspects 1 to 28. The present disclosure mainly describes exemplary aspects of an ophthalmic device, exemplary aspects of a method for controlling an ophthalmic device, exemplary aspects of a program, and exemplary aspects of a recording medium. However, the categories of aspects of the embodiments are not limited thereto. For example, it will be understood by those skilled in the art that embodiments according to the present disclosure can provide various aspects of a medical method, various aspects of an imaging method, various aspects of a data processing method, and the like.

[0241] <Ophthalmic Apparatus> Several non-limiting exemplary aspects of the ophthalmic apparatus according to the embodiment will be described. The ophthalmic apparatus according to the embodiment has an anterior ocular segment imaging function, and in particular, has a frontal imaging function and a Scheimpflug imaging function. The Scheimpflug imaging function of the embodiment uses an anterior ocular segment scanner that moves a Scheimpflug optical system using slit light as illumination light, but any features of the present disclosure may be applied to other types of anterior ocular segment scanners. This disclosure describes in detail several examples of slit lamp microscopes configured to be capable of anterior ocular segment scanning, but the anterior ocular segment scanning method and applicable configurations are not limited to these examples. The Scheimpflug imaging function of some aspects may not be capable of performing anterior ocular segment scanning.

[0242] 1 shows an example of the configuration of an ophthalmic apparatus according to one embodiment. The ophthalmic apparatus 1 of this embodiment is used for imaging the anterior segment of a subject's eye E, and includes an illumination unit 2, an imaging unit 3, a movement mechanism 6, a control unit 7, a data processing unit 8, a communication unit 9, and a user interface (UI) 10. The cornea of ​​the subject's eye E is indicated by the symbol Co, the iris by the symbol Ir, and the crystalline lens by the symbol Cr. The ophthalmic apparatus 1 may further include elements not shown, such as a fixation optical system, an observation system, and an alignment system.

[0243] According to the convention in the field of ophthalmology, the direction along the axis of the subject's eye E is defined as the Z direction (axial direction, Z axis), and the plane perpendicular to the Z direction is defined as the XY plane. The Z direction (Z axis) is also defined as the direction of the optical axis of the front imaging system 3A described below. The left-right direction (horizontal direction) with respect to the subject is defined as the X direction (X axis), and the direction perpendicular to both the X and Z directions (up-down direction, body axis direction) is defined as the Y direction (Y axis).

[0244] The communication unit 9 performs data communication between the ophthalmologic apparatus 1 and other devices. That is, the communication unit 9 transmits data to other devices and receives data transmitted from other devices. The communication unit 9 may perform any data communication method. For example, the communication unit 9 includes one or more of various communication interfaces, such as a communication interface conforming to the Internet, a communication interface conforming to a dedicated line, a communication interface conforming to a LAN, and a communication interface conforming to short-range communication. The data communication may be wired communication or wireless communication.

[0245] The data transmitted or received by the communication unit 9 may be encrypted data. The control unit 7 and / or the data processing unit 8 may include either or both of an encryption processing unit that encrypts data transmitted by the communication unit 9 and a decryption processing unit that decrypts data received by the communication unit 9.

[0246] The user interface 10 includes any user interface device such as a display device, an operation device, etc. By using the user interface 10, users such as a doctor, a patient, and an assistant can operate the ophthalmic apparatus 1 and input information to the ophthalmic apparatus 1. At least a part of the user interface 10 may be a peripheral device of the ophthalmic apparatus 1.

[0247] The display device displays various types of information under the control of the control unit 7. The display device may include a flat panel display such as an LCD. The operation device includes a device for operating the ophthalmic apparatus 1 and a device for inputting information. The operation device includes, for example, a button, a switch, a lever, a dial, a handle, a knob, a mouse, a touchpad, a keyboard, a trackball, an operation panel, etc. A device in which the display device and the operation device are integrated, such as a touch screen, may also be used.

[0248] The illumination unit 2 is configured to project illumination light onto the anterior segment of the subject's eye E. The illumination unit 2 includes an illumination system 2A and a slit illumination system 2B.

[0249] The illumination system 2A is configured to project illumination light onto the anterior segment of the subject's eye E. The illumination light is, for example, infrared light (near-infrared light) or visible light. The illumination system 2A projects the illumination light onto the anterior segment of the subject's eye E from a predetermined direction. The projection direction of the illumination light may be arbitrary, and for example, the illumination light is projected onto the anterior segment from the front or obliquely.

[0250] The slit illumination system 2B is configured to project slit light from the front onto the anterior segment of the subject's eye E. The slit light is, for example, visible light emitted toward the anterior segment along the optical axis of the slit illumination system 2B.

[0251] The photographing unit 3 is configured to photograph the subject's eye E. The photographing unit 3 includes a front photographing system 3A and a photographing system 3B.

[0252] The front imaging system 3A is configured to image the anterior segment of the subject's eye E from the front.

[0253] The imaging system 3B is configured to photograph the anterior segment of the subject's eye E, for example, configured to photograph the anterior segment of the subject's eye E obliquely and from mutually different directions. In this embodiment, the imaging system 3B includes two imaging systems 3BL and 3BR (also referred to as a left imaging system 3BL and a right imaging system 3BR) (see FIG. 3 ), but may include three or more.

[0254] As shown in Fig. 2, the illumination system 2A and the front imaging system 3A form a first imaging unit (referred to as a front imaging unit 4) used for front imaging of the anterior segment of the eye. The front imaging system 3A is disposed in front of the subject's eye E. The optical axis (imaging optical axis) 3Aa of the front imaging system 3A is disposed parallel to the Z direction (i.e., disposed along the Z axis). The illumination system 2A may be disposed in any position.

[0255] The front imaging unit 4 projects illumination light onto the anterior segment of the subject's eye E using the illumination system 2A, and also images the anterior segment onto which the illumination light is projected from the front using the front imaging system 3A. In this way, a front image of the anterior segment of the subject's eye E is generated.

[0256] 3, the imaging system 3B includes two imaging systems 3BL and 3BR. The imaging system 3BL is disposed on the left side as one faces the eye E, and the imaging system 3BR is disposed on the right side as one faces the eye E. The slit illumination system 2B and the imaging systems 3BL and 3BR, together with the scanning mechanism 5B, form a second imaging unit (referred to as a Scheimpflug imaging unit 5) used for Scheimpflug imaging of the anterior segment (anterior segment scanning).

[0257] The combination of the slit illumination system 2B and the photographing system 3BL forms a Scheimpflug optical system that satisfies the Scheimpflug condition. That is, the slit illumination system 2B and the photographing system 3BL are configured so that an object plane including the optical axis (illumination optical axis) 2Ba of the slit illumination system 2B, a principal plane of the optical system of the photographing system 3BL, and an imaging plane of the image sensor of the photographing system 3BL intersect on the same straight line. The same applies to the combination of the slit illumination system 2B and the photographing system 3BR.

[0258] The illumination optical axis 2Ba of the slit illumination system 2B is arranged parallel to the Z direction (i.e., arranged along the Z axis). The optical axis (imaging optical axis) 3BLa of the imaging system 3BL is tilted by an angle θL with respect to the illumination optical axis 2Ba in a first direction (+X direction or −X direction) defined by the X axis. On the other hand, the optical axis (imaging optical axis) 3BRa of the imaging system 3BR is tilted by an angle θR with respect to the illumination optical axis 2Ba in a second direction (−X direction or +X direction) opposite to the first direction. Here, the first direction is the leftward direction, and the second direction is the rightward direction. The angles θL and θR may be equal to each other or may be different from each other. In this embodiment, the angles θL and θR are assumed to be equal to each other.

[0259] The Scheimpflug photographing unit 5 projects slit light onto the anterior segment of the subject's eye E using the slit illumination system 2B, and photographs the anterior segment onto which the slit light is projected from an oblique angle using the photographing systems 3BL and 3BR, thereby generating a pair of Scheimpflug images of the anterior segment of the subject's eye E.

[0260] The Scheimpflug imaging unit 5 is used to scan the anterior segment of the subject's eye E. The slit illumination system 2B and the imaging systems 3BL and 3BR form a movable unit 5A that is moved by a scanning mechanism 5B. The scanning mechanism 5B moves the movable unit 5A in the X direction. The scanning mechanism 5B includes an actuator such as a motor and a mechanism for moving the movable unit 5A in the X direction by the driving force generated by the actuator. The scanning mechanism 5B may be at least a part of the moving mechanism 6.

[0261] In an anterior segment scan, the slit illumination system 2B projects slit light onto the anterior segment of the subject's eye E from the front. The cross section of the slit light projected onto the anterior segment (i.e., the projected image of the slit light on the anterior segment) has a generally slit-like shape (thin line or thin strip shape) with the Y direction as the longitudinal direction (slit light length direction) and the X direction as the lateral direction (slit width direction). Each of the imaging systems 3BL and 3BR performs repeated imaging (video imaging) to generate time-series images. The scanning mechanism 5B moves the movable unit 5A in the X direction (slit width direction). By applying an anterior segment scan combining these operations to the anterior segment of the subject's eye E, the Scheimpflug imaging unit 5 acquires time-series images collected while moving across the projection area of ​​the slit light. In other words, the Scheimpflug imaging unit 5 collects a series of Scheimpflug images, each depicting a plurality of different cross sections of the anterior segment of the subject's eye E.

[0262] The series of Scheimpflug images (Scheimpflug image group) acquired by such an anterior segment scan includes a series of Scheimpflug images acquired by the imaging system 3BL and a series of Scheimpflug images acquired by the imaging system 3BR. For example, the imaging timing (frame acquisition timing) of the imaging system 3BL and the imaging timing of the imaging system 3BR are synchronized with each other. As a result, in the anterior segment scan of this example, two Scheimpflug image groups are acquired by photographing the anterior segment of the subject's eye E from two different directions, and the two Scheimpflug image groups are time-correlated. Note that the anterior segment scan may be performed using either the imaging system 3BL or the imaging system 3BR.

[0263] The anterior segment scanning technique of this example may be similar to that described in Patent Document 1 (JP 2023-49320 A). Furthermore, the slit illumination system 2B and the imaging systems 22L and 22R may have a configuration similar to that of the slit lamp microscope described in Patent Document 1 (JP 2023-49320 A). In this case, the slit illumination system 2B includes an illumination light source that generates visible light, a slit forming unit that forms a slit opening for converting the generated visible light into slit light, and an objective lens that projects the formed slit light onto the anterior segment of the subject's eye E. Furthermore, the imaging system 3BL includes an optical system including an objective lens, a variable magnification optical system, and an imaging lens, as well as an imaging element that detects the light guided by this optical system. The imaging element is an area sensor such as a charge-coupled device (CCD) image sensor or a complementary metal-oxide semiconductor (CMOS) image sensor. The imaging system 3BR has a configuration similar to that of the imaging system 3BL.

[0264] 4 shows a non-limiting example of the optical system of the ophthalmic apparatus 1. The optical system of this example includes an illumination optical system 20, a left imaging optical system 30L and a right imaging optical system 30R, a front imaging optical system 40, and anterior eye illumination light sources 50L and 50R.

[0265] The illumination optical system 20 is an example of a slit illumination system 2B, and the left and right photographing optical systems 30L and 30R are examples of a photographing system 3B. The left photographing optical system 30L is an example of a photographing system BL, and the right photographing optical system 30R is an example of a photographing system BR. The anterior eye illumination light sources 50L and 50R are examples of an illumination system 2A, and the front photographing optical system 40 is an example of a front photographing system 3A.

[0266] Reference symbol 20a denotes the optical axis (illumination optical axis) of the illumination optical system 20, reference symbol 30La denotes the optical axis (left photographing optical axis) of the left photographing optical system 30L, and reference symbol 30Ra denotes the optical axis (right photographing optical axis) of the right photographing optical system 30R. The illumination optical system 20 and the left photographing optical system 30L are arranged so that the illumination optical axis 20a and the left photographing optical axis 30La form an angle θL. The illumination optical system 20 and the right photographing optical system 30R are arranged so that the illumination optical axis 20a and the right photographing optical axis 30Ra form an angle θR. In this embodiment, the angles θL and θR are equal to each other. A position Z0 on the Z axis (coordinate Z0) indicates the intersection of the illumination optical axis 20a, the left photographing optical axis 30La, and the right photographing optical axis 30Ra.

[0267] The illumination light source 21 of the illumination optical system 20 outputs illumination light (e.g., visible light). The illumination light refracted by the positive lens 22 is projected onto the slit forming unit 23. The slit forming unit 23 forms an opening (slit) that allows a portion of the illumination light to pass through. The illumination light (slit light) that passes through the slit is refracted by the objective lens groups 24 and 25, reflected by the beam splitter 47, and projected onto the anterior segment of the subject's eye E.

[0268] The slit forming unit 23 can change the dimensions of the slit (slit width, slit length). This can change the dimensions of the slit light (slit light width, slit light length) projected onto the subject's eye E. The slit forming unit 23 can change the orientation of the slit. This can change the direction of the slit light (slit light orientation) projected onto the subject's eye E. The illumination optical system 20 may be able to generate the light beam projected onto the subject's eye E, for example, by changing the form (shape, dimensions, etc.) of the opening of the slit forming unit 23 or by using another element (light source, optical system, laser scan projector, etc.).

[0269] The reflector 31L and the imaging lens 32L of the left photographing optical system 30L guide the light from the anterior segment onto which the slit light is projected by the illumination optical system 20 (light traveling in the direction of the left photographing optical system 30L) to the image sensor 33L. The image sensor 33L receives the guided light on an imaging surface 34L.

[0270] Similarly, the right photographing optical system 30R guides light from the anterior segment onto which slit light is projected by the illumination optical system 20 (light traveling in the direction of the right photographing optical system 30R) to the image sensor 33R via a reflector 31R and an imaging lens 32R, and receives the light on the image sensor surface 34R of the image sensor 33R.

[0271] The object plane along the illumination optical axis 20a, the optical system including the reflector 31L and the imaging lens 32L, and the imaging surface 34L of the image sensor 33L are arranged to satisfy the Scheimpflug condition. That is, the illumination optical system 20 and the left photographing optical system 30L form a Scheimpflug optical system.

[0272] Similarly, the object plane along the illumination optical axis 20a, the optical system including the reflector 31R and the imaging lens 32R, and the imaging surface 34R of the image sensor 33R are arranged to satisfy the Scheimpflug condition. That is, the illumination optical system 20 and the right photographing optical system 30R form a Scheimpflug optical system.

[0273] The anterior-segment illumination light sources 50L and 50R include light-emitting elements that output light for illuminating the anterior segment, and may include, for example, light-emitting diodes (LEDs) that generate visible light or infrared light (near-infrared light). In this example, two anterior-segment illumination light sources 50L and 50R are provided, but any number of anterior-segment illumination light sources may be provided. In this example, the anterior-segment illumination light sources 50L and 50R are disposed outside the left and right photographing optical systems 30L and 30R, respectively, but their locations may be any location.

[0274] The front imaging optical system 40 images the anterior segment of the subject's eye E from the front. The optical path of the front imaging optical system 40 is coaxially coupled to the optical path of the illumination optical system 20 by a beam splitter 47. The positional relationship between the illumination optical system 20 and the front imaging optical system 40 with respect to the beam splitter 47 may be reversed.

[0275] Light from the anterior eye segment onto which illumination light is projected by the anterior eye illumination light sources 50L and 50R (light traveling in the direction of the front imaging optical system 40) is guided to the beam splitter 47. The light transmitted through the beam splitter 47 is reflected by the reflector 48, refracted by the objective lens 41, and focused by the imaging lens 42 onto the imaging surface of the imaging element 43 (area sensor).

[0276] The type of optical element used as the beam splitter 47 is determined depending on, for example, the relationship between the wavelength of the illumination light from the illumination optical system 20 and the wavelength of the illumination light from the anterior-segment illumination light sources 50L and 50R, and may be, for example, a half mirror or a dichroic mirror. In another aspect, a polarizing beam splitter or the like may be used.

[0277] 4, it is possible to perform frontal photography of the anterior eye segment using the anterior eye illumination light sources 50L and 50R and the frontal photography optical system 40, and to perform Scheimpflug photography of the anterior eye segment using the illumination optical system 20, the left photographing optical system 30L, and the right photographing optical system 30R. Furthermore, by combining the optical system of Fig. 4 with the scanning mechanism 5B of Fig. 3, it is possible to perform an anterior eye segment scan using the illumination optical system 20 and the left photographing optical system 30L and / or the right photographing optical system 30R.

[0278] Returning to Fig. 1, the moving mechanism 6 moves the illumination unit 2 and the imaging unit 3. The moving mechanism 6 can move the illumination unit 2 and the imaging unit 3 three-dimensionally (i.e., in the X, Y, and Z directions). The structure (including the illumination unit 2 and the imaging unit 3) moved by the moving mechanism 6 is called an optical head or the like.

[0279] The control unit 7 controls each unit of the ophthalmologic apparatus 1. For example, the control unit 7 controls elements of the illumination unit 2 (light source, optical elements, mechanism, etc.), elements of the imaging unit 3 (image pickup element, optical elements, mechanism, etc.), the movement mechanism 6, the data processing unit 8, the communication unit 9, the user interface 10, etc.

[0280] The control unit 7 includes a processor, a main storage device, an auxiliary storage device, etc. Computer programs such as various control programs are stored in the auxiliary storage device. These computer programs may be stored in a computer or storage device accessible to the ophthalmic apparatus 1. The functions of the control unit 7 are realized by cooperation between software such as the control programs and hardware such as the processor.

[0281] The data processing unit 8 executes various types of data processing. The data to be processed may be either data acquired by the ophthalmologic apparatus 1 or data input from an external source.

[0282] The data processing unit 8 includes a processor, a main storage device, an auxiliary storage device, etc. Computer programs such as various data processing programs are stored in the auxiliary storage device. These computer programs may be stored in a computer or storage device accessible to the ophthalmic apparatus 1. The functions of the data processing unit 8 are realized by cooperation between software such as the data processing programs and hardware such as the processor.

[0283] 5 shows a non-limiting example of the processing system of the ophthalmologic apparatus 1. The user interface 10 includes a display unit 11 made up of the above-mentioned display device and an operation unit 12 made up of the above-mentioned operation device. The control unit 7 includes a display control unit 71 that controls the display unit 11. The front imaging unit 4 performs front imaging of the anterior segment under the control of the control unit 7. The Scheimpflug imaging unit 5 performs Scheimpflug imaging of the anterior segment (anterior segment scan) under the control of the control unit 7.

[0284] The data processing unit 8 of this example includes a positional relationship determination unit 81, an image reconstruction unit 82, and an image rendering unit 83. Note that, in some aspects, the data processing unit 8 may not include one or both of the image reconstruction unit 82 and the image rendering unit 83. In other words, the image reconstruction unit 82 and the image rendering unit 83 are optional elements included in the data processing unit 8.

[0285] The positional relationship determination unit 81 executes processing to determine the positional relationship between a front image generated by photographing the anterior eye segment using the front photographing unit 4 and a Scheimpflug image generated by photographing the anterior eye segment using the Scheimpflug photographing unit 5. The function of the positional relationship determination unit 81 is realized by cooperation between software such as a positional relationship determination program and hardware such as a processor.

[0286] An example of processing executed by the positional relationship determination unit 81 will be described. In this example, the aforementioned additional frontal photography is performed. The additional frontal photography is an anterior segment photography performed by the frontal photography unit 4 in parallel with Scheimpflug photography by the Scheimpflug photography unit 5, and is performed without anterior segment illumination by the frontal photography unit 4. That is, in this example, while the Scheimpflug photography unit 5 projects slit light onto the anterior segment of the subject's eye E, photography is performed by the photography system 3B of the Scheimpflug photography unit 5 and by the frontal photography system 3A of the frontal photography unit 4. As a result, a frontal image of the anterior segment onto which only slit light is projected (additional frontal image) is also generated, along with a Scheimpflug image of the anterior segment of the subject's eye E.

[0287] Schematic diagrams of a Scheimpflug image and an additional front image obtained substantially simultaneously by such parallel imaging are shown in FIGS. 6A and 6B, respectively.

[0288] The Scheimpflug image 100 in Fig. 6A is an image obtained by photographing the anterior segment of the subject's eye E from an oblique right direction using the photographing system 3BR in Fig. 3 (the right photographing optical system 30R in Fig. 4 ) while slit light is projected from the front direction by the slit illumination system 2B in Fig. 3 (the illumination optical system 20 in Fig. 4 ). Reference numeral 101 denotes an image of the cornea Co (corneal image) brightened by the projection of the slit light, i.e., a corneal reflection image of the slit light. Reference numeral 102 denotes an image of the iris Ir (iris image) brightened by the projection of the slit light, i.e., an iris reflection image of the slit light. That is, the corneal image 101 corresponds to the intersection region of the slit light and the cornea Co (the slit light projection region on the cornea Co), and the iris image 102 corresponds to the intersection region of the slit light and the iris Ir (the slit light projection region on the iris Ir).

[0289] The additional front image 103 in Fig. 6B is an image obtained by photographing the anterior segment of the eye E from the front direction using the front imaging system 3A in Fig. 1 and Fig. 2 while slit light is projected from the front direction by the slit illumination system 2B in Fig. 3 (the illumination optical system 20 in Fig. 4). Reference numeral 104 denotes the area onto which the slit light is projected, and includes a corneal reflection image of the slit light.

[0290] In this example, the front image capturing unit 4 performs a front image capturing operation that combines anterior eye illumination and anterior eye imaging, in addition to the additional front image capturing operation. A front image 105 in Fig. 6C is a schematic diagram of an image obtained by this front image capturing operation.

[0291] Since the time when the front image 105 in Figure 6C was acquired is different from the time when the additional front image 103 in Figure 6B was acquired, there is generally a positional shift between these two images 103 and 105 due to eye movement of the test eye E, etc.

[0292] The positional relationship determining unit 81 of this example determines the positional relationship between the Scheimpflug image 100 of FIG. 6A and the front image 105 of FIG. 6C by using the additional front image 103 of FIG. 6B.

[0293] The positional relationship determination unit 81 first analyzes the additional front image 103 in FIG. 6B to identify an image region corresponding to a predetermined portion of the anterior segment of the eye. The predetermined portion may be any portion, such as the pupil contour or the iris contour. In this example, it is assumed that the pupil contour 106 is detected in the additional front image 103.

[0294] 6C, the positional relationship determining unit 81 identifies an image region corresponding to the same predetermined portion of the anterior segment of the eye. In this example, the pupil contour 107 in the front image 105 is detected.

[0295] 6C shows the positional relationship between the pupil contour 106 in the additional front image 103 and the pupil contour 107 in the front image 105. The positional relationship determination unit 81 determines the relative displacement between the additional front image 103 and the front image 105 by calculating the amount of positional deviation between the pupil contour 106 and the pupil contour 107. For example, the positional relationship determination unit 81 determines the center of the ellipse approximating the pupil contour 106 and the center of the ellipse approximating the pupil contour 107, and then determines the amount of positional deviation between these two centers. This amount of positional deviation is used as the relative displacement between the additional front image 103 and the front image 105.

[0296] Any known image registration method can be used to calculate the relative displacement between the additional front image 103 and the front image 105. For example, thresholding, histograms, clustering, edge detection, region growing, etc. can be applied.

[0297] Alternatively, an image registration method using a mathematical model (trained model) constructed by machine learning may be applied. This machine learning is performed using training data including, for example, a set of image pairs of the same subject (e.g., the anterior segment of the eye) and tags assigned to each image pair (the registration result of the image pair). The mathematical model trained by this machine learning includes, for example, a convolutional neural network (CNN). This machine learning method may be any method, including, for example, supervised learning and / or semi-supervised learning. The positional relationship determination unit 81 in this example inputs the additional front image 103 and the front image 105 to the trained model and determines the relative displacement between the additional front image 103 and the front image 105 based on the corresponding output from the trained model.

[0298] The use of a machine learning-based algorithm is not limited to the processes described herein, and any part or all of the processes performed by the positional relationship determination unit 81 may be performed by a machine learning-based algorithm.

[0299] The positional relationship determining unit 81 analyzes the additional front image 103 in FIG. 6B to detect the slit light projection area 104 .

[0300] Furthermore, based on the slit light projection area 104 in the additional front image 103 and the above-mentioned relative displacement, the positional relationship determination unit 81 specifies a position in the front image 105 that corresponds to the position of the slit light projection area 104 in the additional front image 103. That is, the positional relationship determination unit 81 moves the position of the slit light projection area 104 in the additional front image 103 in accordance with the relative displacement between the additional front image 103 and the front image 105 (see FIG. 8 ). This destination position 108 is a position in the front image 105 that corresponds to the slit light projection area (corneal image 101) in the Scheimpflug image 100 in FIG. 6A .

[0301] In this way, the positional relationship determination unit 81 of this example determines the positional relationship between the Scheimpflug image (100) generated by the Scheimpflug photographing unit 5 and the front image (105) generated by the front photographing unit 4. More specifically, the positional relationship determination unit 81 of this example determines, as the positional relationship between the Scheimpflug image (100) and the front image (105), a position in the front image (105) that corresponds to the slit light projection position in the Scheimpflug image (100).

[0302] The positional relationship determination process that can be performed by the positional relationship determination unit 81 is not limited to this example. In another example, the positional relationship determination unit 81 can estimate the gaze direction during additional frontal imaging based on the shape of an approximate ellipse of the pupil outline in the additional frontal image (103), estimate the gaze direction during frontal imaging based on the shape of an approximate ellipse of the pupil outline in the frontal image (105), and determine the relative displacement between the additional frontal image (103) and the frontal image (105) using the estimated gaze direction during additional frontal imaging and the estimated gaze direction during frontal imaging. For this process, for example, the technique described in the following document can be used: Yuk-Hoi Yiu et al. (2019). DeepVOG: Open-source pupil segmentation and gaze estimation in neuroscience using deep learning, Journal of Neuroscience Method, 2019 Aug. 1: 324: 108307. This concludes the description of the positional relationship determination unit 81.

[0303] Next, the image reconstructing unit 82 will be described. The image reconstructing unit 82 generates a reconstructed image from a plurality of Scheimpflug images collected by applying an anterior ocular segment scan to the subject's eye E. The function of the image reconstructing unit 82 is realized by cooperation between software such as an image reconstruction program and hardware such as a processor.

[0304] The image reconstructor 82 may be configured to apply any known image reconstruction process to the plurality of Scheimpflug images. The type of reconstructed images generated may be any type, such as enface images or MPR images.

[0305] In some aspects, the image reconstructing unit 82 may apply any known image segmentation for detecting images of predetermined objects (sites, tissues, artifacts, lesions, etc.) to the multiple Scheimpflug images and generate a reconstructed image from a group of images extracted from the multiple Scheimpflug images. For example, the image reconstructing unit 82 may apply segmentation to the multiple Scheimpflug images to extract a group of corneal images, and apply image reconstruction processing to the extracted group of corneal images to generate a reconstructed image of the cornea Co of the test eye E.

[0306] Next, a description will be given of the image rendering unit 83. The image rendering unit 83 generates a three-dimensional rendering image from a plurality of Scheimpflug images collected by applying an anterior segment scan to the subject's eye E. The function of the image rendering unit 83 is realized by cooperation between software such as an image rendering program and hardware such as a processor.

[0307] The image rendering unit 83 may be configured to apply any known image rendering process to the plurality of Scheimpflug images, and the generated three-dimensional rendered images may be of any type, such as volume rendered images or surface rendered images.

[0308] In some aspects, the image rendering unit 83 may apply any known image segmentation for detecting images of predetermined objects (sites, tissues, artifacts, lesions, etc.) to the multiple Scheimpflug images and generate a 3D rendered image from a group of images extracted from the multiple Scheimpflug images. For example, the image rendering unit 83 may apply segmentation to the multiple Scheimpflug images to extract a group of corneal images, and apply rendering to the extracted group of corneal images to generate a 3D rendered image of the cornea Co of the test eye E.

[0309] An example of the operation of the ophthalmologic apparatus 1 of this embodiment will now be described. Figures 7 to 9 show three non-limiting examples of the operation of this embodiment.

[0310] 7 , the ophthalmologic apparatus 1 first generates a front image by performing frontal photography on the anterior segment of the subject's eye E (S1). The generated front image is sent to the positional relationship determination unit 81 by the control unit 7.

[0311] The ophthalmologic apparatus 1 also applies Scheimpflug photography and additional front photography to the anterior segment of the subject's eye E to generate a Scheimpflug image and an additional front image (S2). The generated Scheimpflug image and additional front image are sent to the positional relationship determination unit 81 by the control unit 7.

[0312] The frontal photograph may be taken after the Scheimpflug photograph and the additional frontal photograph. The date and time of the frontal photograph may be different from the date and time of the Scheimpflug photograph and the additional frontal photograph. In this case, the ophthalmologic apparatus 1 can acquire the necessary images from the image database using, for example, the communication unit 9.

[0313] The positional relationship determining unit 81 analyzes the front image generated in step S1 to detect the pupil contour (S3), and analyzes the additional front image generated in step S2 to detect the pupil contour (S4).

[0314] Next, the positional relationship determination unit 81 calculates the relative displacement between the additional front image and the front image based on the pupil contour detected from the front image in step S3 and the pupil contour detected from the additional front image in step S4 (S5).

[0315] The positional relationship determination unit 81 then analyzes the additional front image generated in step S2 to detect the slit beam projection position (S6). The process of detecting the slit beam projection position from the additional front image may be performed at any time after step S2.

[0316] Furthermore, based on the relative displacement between the additional front image and the front image obtained in step S5, the positional relationship determination unit 81 estimates the position in the front image generated in step S1 that corresponds to the slit light projection position detected from the additional front image in step S6 (S7).

[0317] The display control unit 71 displays the front image generated in step S1 and the Scheimpflug image generated in step S2 on the display unit 11, and also displays slit light projection position information indicating the slit light projection position in the Scheimpflug image at the position in the front image determined in step S7 (S8).

[0318] 7 , it is possible to visually indicate to the user the position of the slit light projection in the Scheimpflug image (in other words, the position of the object surface in the corresponding Scheimpflug photograph) corresponding to the position in the front image obtained by a separate photograph. This allows the user to view the Scheimpflug image and the front image obtained separately, taking into account the positional relationship between these images. Therefore, this operational example makes it possible to appropriately present to the user images and data obtained by anterior eye imaging using a Scheimpflug optical system.

[0319] The user can use the operation unit 12 to issue an instruction to enlarge the displayed front image or Scheimpflug image. When an instruction to enlarge the front image is issued, i.e., when a partial region of the front image and a magnification factor are specified, the display control unit 71 can execute an enlarged display of the front image corresponding to the specification (i.e., a display process for enlarging the specified partial region at the specified magnification factor) and an enlarged display of the Scheimpflug image (i.e., a display process for enlarging a partial region of the Scheimpflug image corresponding to the partial region of the front image at the same magnification factor). Conversely, when an instruction to enlarge the Scheimpflug image is issued, i.e., when a partial region of the Scheimpflug image and a magnification factor are specified, the display control unit 71 can execute an enlarged display of the Scheimpflug image corresponding to the specification (i.e., a display process for enlarging the specified partial region at the specified magnification factor) and an enlarged display of the front image (i.e., a display process for enlarging a partial region of the front image corresponding to the partial region of the Scheimpflug image at the same magnification factor). This concludes the description of the operation example shown in FIG. 7.

[0320] The operational example of Figure 8 describes a case where an anterior segment scan is applied to the subject's eye E, that is, a case where multiple Scheimpflug photographs are applied to the subject's eye E using multiple different cross sections of the anterior segment as the object plane.

[0321] In this operation example, the ophthalmologic apparatus 1 first generates a front image by performing frontal photography on the anterior segment of the subject's eye E (S11). The generated front image is sent to the positional relationship determination unit 81 by the control unit 7.

[0322] The ophthalmologic apparatus 1 also applies an anterior segment scan to the subject's eye E and performs video capture (additional frontal capture) of the anterior segment, thereby collecting a series of Scheimpflug images (Scheimpflug image group) and collecting multiple additional front images (additional front image group, multiple video frames) (S12). The control unit 7 sends the collected Scheimpflug image group and additional front image group to the positional relationship determination unit 81. The Scheimpflug image group and the additional front image group are associated with each other. The association between the Scheimpflug image group and the additional front image group may be one-to-one, one-to-many, or many-to-one. For example, when one Scheimpflug capture and one additional frontal capture are synchronized, the Scheimpflug image group and the additional front image group are associated with each other in a one-to-one relationship. A similar approach can be applied to cases where the Scheimpflug image group and the additional front image group are associated with each other in a one-to-many or many-to-one relationship.

[0323] The relationship between the frontal imaging, the anterior eye segment scan, and the additional frontal imaging (video imaging) may be the same as in steps S1 and S2 of the operation example of FIG.

[0324] The positional relationship determination unit 81 analyzes the front image generated in step S11 to detect the pupil contour (S13), and analyzes each additional front image in the group of additional front images generated in step S12 to detect the pupil contour (S14).

[0325] Next, for each group of additional front images generated in step S12, the positional relationship determination unit 81 calculates the relative displacement between the additional front image and the front image based on the pupil contour detected from the additional front image in step S14 and the pupil contour detected from the front image in step S13 (S15).

[0326] The positional relationship determination unit 81 then analyzes each of the additional front images generated in step S12 to detect the slit beam projection position (S16). The process of detecting the slit beam projection position from the additional front image may be performed at any time after step S12.

[0327] Furthermore, for each additional front image group generated in step S12, the positional relationship determination unit 81 estimates a position in the front image generated in step S11 that corresponds to the slit light projection position detected from the additional front image in step S16, based on the relative displacement between the additional front image and the front image calculated in step S15 (S17). This allows the position in the front image that corresponds to the slit light projection position in each Scheimpflug image collected in step S12 to be estimated.

[0328] The display control unit 71 displays on the display unit 11 the front image generated in step S11 and one or more Scheimpflug images in the Scheimpflug image group generated in step S12, and also displays slit light projection position information indicating the slit light projection position in each displayed Scheimpflug image at the position in the front image determined for each Scheimpflug image in step S17 (S18).

[0329] The displayed Scheimpflug image can be switched automatically or manually. When an automatic or manual instruction to switch the displayed Scheimpflug image is issued, the display control unit 71 can display slit light projection position information indicating the slit light projection position in the newly displayed Scheimpflug image at the position in the front image determined in step S17 for the newly displayed Scheimpflug image. This allows the presentation position of the slit light projection position information presented on the front image to be switched in response to the switching of the display of the Scheimpflug image.

[0330] Conversely, when a position on the front image is specified automatically or manually, the display control unit 71 selects a Scheimpflug image of the slit light projection position (object surface position) corresponding to the specified position (or a position nearby) from the Scheimpflug image group and displays the selected Scheimpflug image. This allows the displayed Scheimpflug image to be switched in response to switching of the specified position on the front image.

[0331] According to the operational example of Fig. 8 , similar to the operational example of Fig. 7 , images and data obtained by anterior segment imaging using a Scheimpflug optical system can be suitably presented to the user. Moreover, as described above, it is also possible to implement various display modes between a series of Scheimpflug images collected by anterior segment scanning and a front image. Furthermore, the linked control of display magnification changes between the Scheimpflug images and the front image described in the operational example of Fig. 7 can be applied to this mode. This concludes the explanation of the operational example of Fig. 8 .

[0332] In the operation example of Fig. 9, an anterior eye scan is applied to the subject's eye E, similar to the operation example of Fig. 8. The difference between this operation example and the operation example of Fig. 8 is that in the operation example of Fig. 8, the slit light projection position is detected from all additional front images collected by additional front imaging (video imaging) performed in parallel with the anterior eye scan, whereas in this operation example, the slit light projection position is detected from only one additional front image. Note that the slit light projection position may be detected from two or more additional front images (not all of them).

[0333] The processes and operations performed in steps S21 to S25 of this operational example may be similar to the processes and operations performed in steps S11 to S15 of the operational example of Fig. 8, respectively. Therefore, a description of steps S21 to S25 will be omitted. Note that the anterior segment scan in step S22 is performed according to predetermined scan conditions. These scan conditions include, for example, a scan speed and a scan interval (distance interval and / or time interval).

[0334] In step S26, the positional relationship determination unit 81 analyzes one of the multiple additional front images generated in step S22 (referred to as a first additional front image) to detect a slit light projection position (referred to as a first slit light projection position) (S26). The process of detecting the first slit light projection position from the first additional front image may be performed at any time after step S22. The first additional front image may be arbitrarily selected from the group of additional front images, and may be, for example, the first generated additional front image.

[0335] Next, the positional relationship determination unit 81 estimates the position in the front image generated in step S21 that corresponds to the first slit light projection position detected from the first additional front image in step S26 based on the relative displacement between the front image obtained in step S25 and the first additional front image (S27).

[0336] Next, the positional relationship determination unit 81 estimates the slit light projection position (referred to as the second slit light projection position) of an additional front image (referred to as the second additional front image) other than the first additional front image in the additional front image group based on the scan conditions applied to the anterior eye scan in step S22 and the first slit light projection position detected from the first additional front image in step S26 (S28). The number of second additional front images may be arbitrary, and for example, the first additional front image and a plurality of second additional front images may cover all of the additional front image group.

[0337] For example, if any of the movement speed of the slit light in an anterior eye scan (the movement speed of the movable unit 5A in Figure 3), the distance interval between images taken in an anterior eye scan (the distance interval between the slit light projection positions in two temporally adjacent images), and the time interval between images taken in an anterior eye scan (the time interval between two temporally adjacent images) is known, the positional relationship determination unit 81 can estimate the slit light projection position in any additional front image from these scan conditions and the first slit light projection position in the first additional front image.

[0338] Next, the positional relationship determination unit 81 estimates a position in the front image generated in step S21 that corresponds to the second slit light projection position estimated from the second additional front image in step S28 based on the relative displacement between the front image obtained in step S25 and the second additional front image (S29).

[0339] The display control unit 71 displays on the display unit 11 the front image generated in step S21 and one or more Scheimpflug images in the Scheimpflug image group generated in step S22, and also displays slit light projection position information indicating the slit light projection position in each displayed Scheimpflug image at the position in the front image determined for each Scheimpflug image in steps S27 and S29 (S30).

[0340] Display-related matters (processing, operation, control, mode, etc.) are the same as those in the operational example of FIG. 8 . According to the operational example of FIG. 9 , similar to the operational examples of FIGS. 7 and 8 , images and data obtained by anterior segment imaging using a Scheimpflug optical system can be conveniently presented to the user. Moreover, similar to the operational example of FIG. 8 , various display modes can be implemented between a series of Scheimpflug images and a front image acquired by anterior segment scanning. Furthermore, the coordinated control of display magnification changes between the Scheimpflug images and the front image described in the operational example of FIG. 7 can also be applied to this mode. Furthermore, the operational example of FIG. 9 can display information similar to that in the operational example of FIG. 8 simply by detecting the slit light projection position from one additional front image, thereby achieving effects such as reduced processing resources, reduced processing load, and shorter processing time. This concludes the description of the operational example of FIG. 9 .

[0341] A description will be given of a display screen presented by the ophthalmologic apparatus 1 of this embodiment. An exemplary display screen 110 in Fig. 10 presents a pair of Scheimpflug images 111L and 111R, a front image 112, a horizontal cross-sectional image (enface image) 113, and a vertical cross-sectional image 114.

[0342] In this example, an anterior segment scan by the Scheimpflug imaging unit 5 having a pair of imaging systems (left imaging system 3BL and right imaging system 3BR, left imaging optical system 30L and right imaging optical system 30R) and frontal imaging by the frontal imaging unit 4 are applied to the anterior segment of the subject's eye E. Synchronously with this anterior segment scan, additional frontal imaging (video imaging) is performed, and a corresponding additional frontal image is obtained for each Scheimpflug image acquired in the anterior segment scan. Using the additional frontal images acquired by this additional frontal imaging, a positional relationship between each Scheimpflug image acquired in the anterior segment scan and the frontal image acquired by the frontal imaging is determined. The corresponding positional relationship is associated with each Scheimpflug image and stored in a referable manner in a storage device within the control unit 7.

[0343] The pair of Scheimpflug images 111L and 111R are generated by capturing images of the anterior segment of the subject's eye E substantially simultaneously using a pair of imaging systems of the Scheimpflug imaging unit 5. The Scheimpflug images 111L and 111R are any of a plurality of Scheimpflug image pairs acquired in an anterior segment scan. The Scheimpflug image pair to be displayed is selected by, for example, the user or the display control unit 71.

[0344] The front image 112 is generated by photographing the anterior segment of the subject's eye E using the front photographing unit 4 .

[0345] The axial cross-sectional image 113 is generated by the image rendering unit 83 from the Scheimpflug images collected in the anterior segment scan. More specifically, the image rendering unit 83 generates volume data (voxel data) from the Scheimpflug images and cuts the volume data along an XY plane to generate the axial cross-sectional image 113. This XY plane is specified by, for example, the user or the display control unit 71.

[0346] The vertical cross-sectional image 114 is generated by the image reconstruction unit 82 from the Scheimpflug images collected in the anterior segment scan. More specifically, the image reconstruction unit 82 receives a ZX cross-section designated by the user or the display control unit 71, and reconstructs an image of the ZX cross-section from the Scheimpflug images to generate the vertical cross-sectional image 114.

[0347] The Scheimpflug images 111L and 111R are obtained by combining slit light projection from the front direction and imaging from an oblique direction, and the high-brightness images depicted therein (corneal image, iris image, lens image, etc.) are images within the slit light projection area (YZ cross section, object plane). The front image 112 and horizontal cross section image 113 are images expressed in an XY coordinate system. The vertical cross section image 114 is an image expressed in a ZX coordinate system.

[0348] 10 further presents positional relationship information indicated by dotted lines. The vertical lines superimposed on the Scheimpflug images 111L and 111R indicate the positions of the XY cross sections depicted in the horizontal cross-sectional image 113, and the horizontal lines indicate the positions of the ZX cross sections depicted in the vertical cross-sectional image 114.

[0349] The vertical lines superimposed on the front image 112 indicate the positions of the slit light projection areas (YZ cross sections, object planes) in the Scheimpflug images 111L and 111R, and the horizontal lines indicate the positions of the ZX cross sections depicted in the vertical cross-sectional image 114. These vertical lines correspond to projection position information indicating the projection positions of the slit light.

[0350] Similarly, the vertical lines superimposed on the horizontal cross-sectional image 113 indicate the positions of the slit light projection areas (YZ cross-sections, object planes) in the Scheimpflug images 111L and 111R, and the horizontal lines indicate the positions of the ZX cross-sections depicted in the vertical cross-sectional image 114. These vertical lines correspond to projection position information indicating the projection positions of the slit light.

[0351] The vertical lines superimposed on the vertical cross-sectional image 114 indicate the positions of the slit light projection areas (YZ cross-sections, object planes) in the Scheimpflug images 111L and 111R, and the horizontal lines indicate the positions of the XY cross-sections depicted in the horizontal cross-sectional image 113. These vertical lines correspond to projection position information indicating the projection positions of the slit light.

[0352] By using such a display screen 110, the user can observe the anterior segment of the subject's eye E using various images, and can also easily grasp the positional relationship between these images.

[0353] When the user uses the operation unit 12 to give an instruction to enlarge and display a partial area of ​​any image (referred to as a designated image) displayed on the display screen 110, the display control unit 71 can enlarge and display the partial area of ​​the designated image and can also enlarge and display a partial area of ​​another image that corresponds to the partial area of ​​the designated image. The other image that is automatically enlarged and displayed may be one or more images other than the designated image.

[0354] When the user specifies a position in the front image 112 (or the axial image 113) using the operation unit 12, the display control unit 71 can apply display control corresponding to the specified position to another image. For example, the display control unit 71 can select a Scheimpflug image pair corresponding to the specified position from among multiple Scheimpflug image pairs acquired in the anterior segment scan and display them as new Scheimpflug images 111L and 111R. Furthermore, the display control unit 71 can display slit light projection position information corresponding to the selected Scheimpflug image pair superimposed on another image.

[0355] When the user uses the operation unit 12 to select a Scheimpflug image pair from among a plurality of Scheimpflug image pairs collected in an anterior segment scan, the display control unit 71 can display the selected Scheimpflug image pair as new Scheimpflug images 111L and 111R. Furthermore, the display control unit 71 can display slit light projection position information corresponding to the selected Scheimpflug image pair as the positional relationship information superimposed on another image that is displayed superimposed on the front image.

[0356] Some embodiments of the ophthalmologic apparatus 1 can present analysis data obtained from a Scheimpflug image by superimposing it on a front image. A non-limiting example of a processing system of the ophthalmologic apparatus 1 configured in this manner is shown in FIG. 11 . The configuration of FIG. 11 is used instead of the configuration of FIG. 5 or is at least partially added to the configuration of FIG. 5 . As an example of the latter, some embodiments of the ophthalmologic apparatus 1 include the configuration of FIG. 5 as well as the memory unit 13, image analysis unit 84, and image registration unit 85 of FIG. 11 . Hereinafter, descriptions of matters common to the configuration of FIG. 5 may be omitted, and matters related to FIG. 5 will be referenced as necessary.

[0357] 11 includes a storage unit 13, and the data processing unit 8 of this example includes a positional relationship determination unit 81, an image analysis unit 84, and an image registration unit 85. Note that, in some aspects, the data processing unit 8 does not need to include the storage unit 13 and the image registration unit 85. That is, the storage unit 13 and the image registration unit 85 are optional elements included in the data processing unit 8.

[0358] The storage unit 13 includes a storage device. The storage unit 13 may be included in the control unit 7 or may be provided separately from the control unit 7.

[0359] As in the case of Figure 5, the positional relationship determination unit 81 performs processing to determine the positional relationship between a front image generated by photographing the anterior eye using the frontal photographing unit 4 and a Scheimpflug image generated by photographing the anterior eye using the Scheimpflug photographing unit 5.

[0360] The image analysis unit 84 analyzes the Scheimpflug image generated by photographing the anterior segment using the Scheimpflug photographing unit 5 to generate analysis data.

[0361] The types of image analysis that can be performed by the image analysis unit 84 may be any anterior segment analysis that can be performed using a Scheimpflug image of the anterior segment, such as corneal thickness analysis, corneal shape analysis, iridocorneal angle analysis, anterior chamber flare / cell analysis, and lens opacity analysis.

[0362] The parameters calculated by the image analysis unit 84 include corneal thickness (central thickness, peripheral thickness), corneal elevation, anterior corneal radius of curvature, posterior corneal radius of curvature, anterior lens radius of curvature, posterior lens radius of curvature, corneal diameter (vertical diameter, horizontal diameter (white-to-white)), lens thickness, anterior chamber depth, anterior chamber volume, pupil diameter, pupil center (eccentricity), axial curvature, tangential curvature, and angle parameters (AOD (angle opening distance), ACA (anterior chamber angle), TISA (trabecular iris space area), ARA (angle recess area), and AtA (angle-to-angle distance), opacity parameters (position, size, shape, number, density, concentration, etc.), parameters related to inflammatory cells (anterior chamber cells) or proteins (anterior chamber flare) (density (concentration), number, position, distribution, etc.).

[0363] Furthermore, the image analysis unit 84 can detect information related to an artificial object applied to the subject's eye E. For example, the image analysis unit 84 can detect a mark indicating the orientation of an intraocular lens for astigmatism (toric IOL), and can detect a mark or alignment mark indicating the center position of an intraocular lens or an intraocular contact lens.

[0364] For information on anterior segment analysis that can be performed by the image analysis unit 84, see, for example, Japanese Patent Application Laid-Open No. 2021-040856 (US2023 / 0000346A1), Japanese Patent Application Laid-Open No. 2022-007433 (US2023 / 0359008A1), Japanese Patent Application Laid-Open No. 2022-035168, Japanese Patent Application Laid-Open No. 2023-039046 (WO2023 / 037658A1), and Japanese Patent Application Laid-Open No. 2022-131654 (PCT / JP2023 / 028514).

[0365] The image registration unit 85 performs registration between multiple images to be referenced in follow-up observations, etc. The registration method may be any known method, including a machine learning-based registration algorithm and / or a non-machine learning-based registration algorithm.

[0366] In this embodiment, frontal photography and Scheimpflug photography are performed on the subject's eye E at each of a plurality of dates and times. Additional frontal photography may be performed in parallel with each Scheimpflug photography. Therefore, in this embodiment, image groups generated at each of a plurality of dates and times are handled. The image group at each date and time includes at least a front image of the subject's eye E and a Scheimpflug image of the subject's eye E (Scheimpflug image group), and may further include additional front images (additional front image group). The plurality of image groups generated for the subject's eye E at multiple dates and times are stored in the storage unit 13. The registration unit 85 performs registration between the plurality of frontal images included in such a plurality of image groups.

[0367] An example of the operation of the ophthalmologic apparatus 1 of this embodiment will be described.

[0368] 12 , the ophthalmologic apparatus 1 first generates a front image by performing frontal photography on the anterior segment of the subject's eye E (S41). The generated front image is sent to the positional relationship determination unit 81 by the control unit 7.

[0369] The ophthalmologic apparatus 1 also collects a series of Scheimpflug images (Scheimpflug image group) and a plurality of additional front images (additional front image group, a plurality of video frames) by performing video capture (additional front image capture) of the anterior segment while applying an anterior segment scan to the subject's eye E (S42). The collected Scheimpflug image group and additional front image group are sent to the positional relationship determination unit 81 by the control unit 7.

[0370] The relationship between the frontal imaging, the anterior eye segment scan, and the additional frontal imaging (video imaging) may be the same as in steps S1 and S2 of the operation example of FIG.

[0371] The positional relationship determination unit 81 analyzes the front image generated in step S41 to detect the pupil contour (S43), and analyzes each additional front image in the group of additional front images generated in step S42 to detect the pupil contour (S44).

[0372] Next, for each of the additional front images generated in step S42, the positional relationship determination unit 81 calculates the relative displacement between the additional front image and the front image based on the pupil contour detected from the additional front image in step S44 and the pupil contour detected from the front image in step S43 (S45), thereby obtaining the positional relationship between each Scheimpflug image and the front image.

[0373] The image analysis unit 84 then analyzes the Scheimpflug images generated in step S42 to generate analysis data (S46). The analysis data in this example is an analysis map representing the distribution of a predetermined parameter. Note that the process of generating analysis data from the Scheimpflug images may be performed at any time after step S42.

[0374] The display control unit 71 displays the front image generated in step S41 on the display unit 11, and also displays the analysis map generated in step S46 superimposed on the front image based on the relative position calculated in step S45 (S47). An example of information displayed in step S47 is shown in Fig. 13. In Fig. 13, a corneal thickness map 121 is presented on a front image 120 of the anterior segment of the subject's eye E.

[0375] According to the operation example of Fig. 12, analysis data generated from an image obtained by anterior segment imaging using a Scheimpflug optical system can be aligned with a separately acquired front image and then superimposed and displayed. This concludes the explanation of the operation example of Fig. 12.

[0376] 14 , the ophthalmologic apparatus 1 first generates a front image by performing frontal photography on the anterior segment of the subject's eye E (S51). The generated front image is sent to the positional relationship determination unit 81 by the control unit 7.

[0377] The ophthalmologic apparatus 1 also collects a series of Scheimpflug images (Scheimpflug image group) and a plurality of additional front images (additional front image group, a plurality of video frames) by performing video capture (additional front image capture) of the anterior segment while applying an anterior segment scan to the subject's eye E (S52). The collected Scheimpflug image group and additional front image group are sent to the positional relationship determination unit 81 by the control unit 7.

[0378] The relationship between the frontal imaging, the anterior eye segment scan, and the additional frontal imaging (video imaging) may be the same as in steps S1 and S2 of the operation example of FIG.

[0379] The positional relationship determination unit 81 analyzes the front image generated in step S51 to detect the pupil contour (S53), and analyzes each additional front image in the group of additional front images generated in step S52 to detect the pupil contour (S54).

[0380] Next, for each of the additional front images generated in step S52, the positional relationship determination unit 81 calculates the relative displacement between the additional front image and the front image based on the pupil contour detected from the additional front image in step S54 and the pupil contour detected from the front image in step S53 (S55), thereby obtaining the positional relationship between each Scheimpflug image and the front image.

[0381] Furthermore, the image analysis unit 84 analyzes the front image generated in step S51 and detects marks (feature points) of the artificial object implanted in the anterior segment of the subject's eye E (S56).

[0382] In this example, the detected artifact mark is the center position of the intraocular contact lens. The detection of this center position includes, for example, a process of detecting the edge of the intraocular contact lens, a process of determining an ellipse approximating the detected edge, and a process of identifying the center of this ellipse.

[0383] The marks of the artificial object detected in step S56 may be marks actually attached to the artificial object, or may be feature points based on the characteristics of the artificial object (shape, optical properties, material, etc.) Note that the process of detecting the marks of the artificial object from the front image may be performed at any time after step S51.

[0384] The display control unit 71 displays an image of the anterior segment of the subject's eye E on the display unit 11, and also displays information indicating the position of the artificial mark detected in step S56 (mark position information) superimposed on this display image (S57).

[0385] For example, when the front image generated in step S51 is displayed, since the artificial mark is detected from this front image, the display control unit 71 displays the mark position information superimposed on an obvious position in the front image.

[0386] When the additional front shot generated in step S52 is displayed, the display control unit 71 displays the mark position information superimposed on a position in the additional front image determined based on the relative position obtained in step S55.

[0387] Similarly, when a Scheimpflug image generated in step S52 is displayed, or when a reconstructed image and / or a three-dimensional rendering image generated from the Scheimpflug image group generated in step S52 is displayed, the display control unit 71 superimposes and displays mark position information at a position in the displayed image determined based on the relative position obtained in step S55.

[0388] According to the operation example shown in Fig. 14 , information indicating the marks (feature points) of the intraocular prosthesis obtained by frontal photography of the anterior segment can be superimposed on the frontal image obtained by this frontal photography, and further, the information can be superimposed after being aligned with a separately acquired image (such as a Scheimpflug image, an additional frontal image, a reconstructed image, or a three-dimensional rendering image).

[0389] 15 illustrates another example of presenting mark position information of an intraocular prosthesis. The ophthalmic apparatus 1 of this example applies first front imaging to the anterior segment of the subject's eye E to generate a first front image (S61). The modality of the first front imaging may be any. The ophthalmic apparatus 1 also applies second front imaging to the anterior segment of the subject's eye E to generate a second front image (S62). The modality of the second front imaging may also be any.

[0390] Next, the image analysis unit 84 analyzes the front image generated in step S61 and detects marks (feature points) of the artificial object implanted in the anterior segment of the subject's eye E (S63).

[0391] If only the first front image is displayed out of the first front image generated in step S61 and the second front image generated in step S62 (S64: Yes), the process proceeds to step S67. On the other hand, if only the second front image is displayed out of the first front image and the second front image, or if both the first front image and the second front image are displayed (S64: No), the process proceeds to step S65. Note that the image to be displayed is selected by, for example, the user or the display control unit 71.

[0392] If both the first and second front images are displayed, or if only the second front image is displayed (S64: No), the positional relationship determination unit 81 analyzes the first front image to detect the pupil contour, and analyzes the second front image to detect the pupil contour (S65). Furthermore, the positional relationship determination unit 81 calculates the relative displacement between the first front image and the second front image based on the pupil contour detected from the first front image in step S64 and the pupil contour detected from the second front image in step S65 (S66).

[0393] If only the first front image of the first and second front images is displayed (S64: Yes), mark position information is superimposed and displayed at an obvious position in the first front image (S67).

[0394] Furthermore, when only the second front image of the first and second front images is displayed, the display control unit 71 displays the second front image on the display unit 11 and also displays the mark position information superimposed on the position in the second front image determined based on the relative position obtained in step S66 (S67).

[0395] Furthermore, when both the first front image and the second front image are displayed, the display control unit 71 causes the display unit 11 to display the first front image and the second front image, and also causes the display unit 11 to superimpose and display the mark position information at an obvious position in the first front image, and also causes the display unit 11 to superimpose and display the mark position information at a position in the second front image determined based on the relative position obtained in step S66 (S67).

[0396] According to the operation example shown in Fig. 15 , information indicating the marks (feature points) of the intraocular prosthesis obtained by frontal photography of the anterior segment can be superimposed on the frontal image obtained by this frontal photography, and furthermore, the information can be superimposed on a separately acquired frontal image after being aligned with the frontal image.

[0397] An example of the information displayed in step S57 of Fig. 14 and step S67 of Fig. 15 is shown in Fig. 16. In Fig. 16, mark position information indicating the center position of an intraocular contact lens implanted in the anterior segment of the subject's eye E is superimposed on a front image 130 of the anterior segment of the subject's eye E. The mark position information in this example includes edge position information 131 indicating the position of the edge (outer edge) of the intraocular contact lens, and a center position guide 132 indicating the center position of the intraocular contact lens by the intersection position of a vertical line and a horizontal line. The information display in this example allows the user to easily understand how the intraocular contact lens implanted in the subject's eye E is positioned.

[0398] In the operation example of FIG. 17, a mode that is useful for follow-up observation and the like will be described.

[0399] The ophthalmologic apparatus 1 of this embodiment first acquires a data set of the subject's eye E acquired on a plurality of different dates and times (S71). The acquired data set is stored in the storage unit 13.

[0400] The data set acquired in step S71 includes multiple image groups acquired by photographing the subject's eye E at multiple dates and times. The image groups at each date and time include, for example, a front image of the anterior segment of the subject's eye E and multiple Scheimpflug images (Scheimpflug image group). An additional front image group acquired in parallel with the Scheimpflug image group may also be included. If the positional relationship between the front image and the Scheimpflug image group at each date and time has already been determined, the additional front image group is not necessary. If the Scheimpflug image is not displayed, analysis data (such as an analysis map) generated from the Scheimpflug image group may be included in the data set instead of the Scheimpflug image. In this case, for example, the positional relationship between the front image and the analysis map at each date and time may already be determined. If not, the positional relationship can be determined via the additional front image group.

[0401] The registration unit 85 performs registration between the plurality of front images at the plurality of dates and times (S72), thereby performing registration between the plurality of front images at the plurality of dates and times, registration between the plurality of Scheimpflug image groups at the plurality of dates and times, registration between the plurality of analysis maps at the plurality of dates and times, etc.

[0402] The user can specify a desired date and time from among a plurality of dates and times using the operation unit 12 (S73). Information on the specified date and time is sent to the control unit 7. The control unit 7 reads out the Scheimpflug image group and the front image for the specified date and time from the storage unit 13 and sends them to the positional relationship determination unit 81.

[0403] The positional relationship determining unit 81 determines the positional relationship between the Scheimpflug image group and the front image at the specified date and time (S74).

[0404] The image analysis unit 84 analyzes the Scheimpflug images for the specified date and time to generate an analysis map (S75). Note that the order of the processing of step S74 and the processing of step S75 may be reversed, or these processes may be performed in parallel.

[0405] If the process of step S74 and / or the process of step S75 is unnecessary, the process is skipped. Also, if the data set does not include a Scheimpflug image, for example, an analysis map is read out from the data set instead of a Scheimpflug image.

[0406] The display control unit 71 displays the necessary information on the display unit 11 (S76). For example, as in FIG. 13 , the analysis map generated from the Scheimpflug images at the specified date and time is aligned with the front image at the specified date and time and then superimposed and displayed. At this time, since the front image at the specified date and time is registered with the front image at another date and time, it is displayed in a state aligned with the front image at another date and time. Similarly, the analysis map at the specified date and time and the analysis map at another date and time are displayed in a state aligned with each other.

[0407] If an instruction to end the information display is given (S77: Yes), the process ends (END). The user can specify a different date and time (S73) without ending the information display (S77: No). In this case, steps S74 to S77 are executed again.

[0408] According to the operation example of Figure 17, in follow-up observations using analysis data generated from Scheimpflug images or frontal images, the user can observe images and analysis data obtained at multiple dates and times in a state where they are aligned with each other.

[0409] In the operation example of FIG. 18, another mode that is useful for follow-up observation and the like will be described.

[0410] The ophthalmologic apparatus 1 of this embodiment first acquires a group of Scheimpflug images of the anterior segment of the subject's eye E acquired on a plurality of different dates and times (S81). The acquired group of Scheimpflug images is stored in the storage unit 13.

[0411] The registration unit 85 performs registration between the multiple Scheimpflug image groups taken at multiple dates and times (S82). This registration is performed, for example, using the parts depicted in the Scheimpflug images (pupil, iris, cornea, corneal apex, etc.) as reference positions. Alternatively, if additional frontal images are acquired for each Scheimpflug image group, registration may be performed using the additional frontal images.

[0412] The user can specify a desired date and time from among a plurality of dates and times using the operation unit 12 (S73). Information on the specified date and time is sent to the display control unit 71. The display control unit 71 reads out the Scheimpflug images for the specified date and time from the storage unit 13.

[0413] The display control unit 71, for example, causes the display unit 11 to display any one of the Scheimpflug images of the group of Scheimpflug images of the specified date and time (S74). The display control unit 71 may also cause the display unit 11 to display a reconstructed image and / or a three-dimensional rendering image generated from the group of Scheimpflug images of the specified date and time.

[0414] When the user specifies another date and time using the operation unit 12 (S75), the display control unit 71 reads out the Scheimpflug image group for this other specified date and time from the storage unit 13, selects a Scheimpflug image corresponding to the same cross-section as the Scheimpflug image displayed in step S74, and displays it on the display unit 11 (S76). That is, it is possible to display a Scheimpflug image obtained with slit light projected onto substantially the same cross-section of the anterior segment. When the reconstructed image and / or three-dimensional rendering image was displayed in step S74, the display control unit 71 displays a reconstructed image and / or a three-dimensional rendering image generated from the Scheimpflug image group for the other specified date and time on the display unit 11.

[0415] If an instruction to end the information display is given (S87: Yes), the process ends (END). The user can specify a different date and time (S85) without ending the information display (S87: No). In this case, steps S86 to S87 are executed again.

[0416] According to the operation example of Figure 18, in follow-up observation using Scheimpflug images acquired on multiple dates and times, the user can observe a desired cross-section of the anterior segment using Scheimpflug images acquired on multiple dates and times.

[0417] In another aspect of the ophthalmologic apparatus 1, the image analysis unit 84 can generate analysis data (such as an analysis map) by analyzing a front image of the anterior segment of the subject's eye E. In this case, the display control unit 71 can display the front image and the Scheimpflug image on the display unit 11, and can superimpose the analysis data generated from the front image on the Scheimpflug image based on the positional relationship determined by the positional relationship determination unit 81.

[0418] The ophthalmic apparatus 1 of some embodiments can perform anterior ocular imaging (multifocal photography) using focus stacking. A non-limiting example of an optical system of the ophthalmic apparatus 1 of this embodiment is shown in FIG. 19 , and a non-limiting example of a processing system is shown in FIG. 20 . The configuration of FIG. 19 is used instead of the configuration of FIG. 4 . The configuration of FIG. 20 is used instead of the configuration of FIG. 5 or FIG. 11 , or is at least partially added to the configuration of FIG. 5 or FIG. 11 . Hereinafter, a description of matters common to the configurations of any of FIGS. 4 , 5 , and 11 may be omitted, and matters related to any of FIGS. 4 , 5 , and 11 will be cited as necessary.

[0419] The optical system of Fig. 19 is the same as the optical system of Fig. 4 except that a focus lens 40 is added to the front photographing optical system 40. The focus lens 40 is disposed between an objective lens 41 and an imaging lens 42. The focus lens 40 is moved along the optical axis of the front photographing optical system 40 by a focus lens moving mechanism (not shown). This changes the focal position of the front photographing optical system 40.

[0420] The processing system in Fig. 20 is obtained by adding a focal position changing unit 45 to the front imaging unit 4 of the processing system in Fig. 5 and by adding an image synthesis unit 86 to the data processing unit 8. The data processing unit 8 may include, for example, any one of an image reconstruction unit 82, an image rendering unit 83, an image analysis unit 84, and an image registration unit 85. As will be described in detail later, the positional relationship determination unit 81 of this embodiment is configured to execute processing different from that of the positional relationship determination unit 81 of the above-described embodiments.

[0421] The focal position changing unit 45 in this example includes a focus lens 44 and a focus lens moving mechanism. The configuration of the focal position changing unit 45 is not limited to this example, and may be any configuration that can change the focal position of the front imaging system 3A (front imaging optical system 40).

[0422] The focal position changing unit 45 may be configured to move the focal position of the front imaging system 3A by moving at least a part of the front imaging system 3A. Alternatively, the focal position changing unit 45 may be configured to move the focal position of the front imaging system 3A by changing the focal length of the front imaging system 3A. Alternatively, the focal position changing unit 45 may be configured to move the focal position of the front imaging system 3A by inserting an optical element (such as a lens) into the optical path of the front imaging system 3A or by retracting an optical element from the optical path of the front imaging system 3A. The focal position changing unit 45 may be configured to move the focal position by moving the entire front imaging system 3A along its optical axis. Alternatively, the focal position changing unit 45 may be configured to move the focal position by moving an objective lens of the front imaging system 3A (e.g., the objective lens 41 of the front imaging optical system 40) along its optical axis.

[0423] The positional relationship determination unit 81 in each of the above aspects determines the positional relationship in the X and Y directions between the front image generated by frontal photography and the Scheimpflug image generated by Scheimpflug photography. In contrast, the positional relationship determination unit 81 in this aspect determines the positional relationship in the Z direction (axial direction) between multiple front images generated by multifocal front photography (referred to as a multifocal front image group) and the Scheimpflug image generated by Scheimpflug photography. The process of determining the positional relationship in the Z direction will be described later.

[0424] The image composition unit 86 includes a processor configured to perform any known focus composition process (depth composition process). In general, focus composition process includes a process of extracting in-focus partial images based on contrast or the like from each of a plurality of images acquired by multi-focus photography while focusing on a plurality of different positions on the subject, and a process of combining the extracted partial images.

[0425] An example of the operation of the ophthalmologic apparatus 1 of this embodiment will be described below. Fig. 21 shows an example of multifocal frontal photography applied to the anterior segment of the subject's eye E, and Fig. 22 shows an example of information display based on a group of images (group of multifocal frontal images) obtained by this multifocal frontal photography.

[0426] 21 , the ophthalmologic apparatus 1 first aligns the anterior segment of the subject's eye E (S91). This alignment is performed, for example, so that a desired portion of the anterior segment (tissue, lesion, artifact, etc.) is positioned at the center of the frame for Scheimpflug photography. Any known alignment method may be applied for the alignment, and either automatic alignment or manual alignment may be used.

[0427] Once alignment is complete, Scheimpflug photography is performed on the anterior segment of the subject's eye E (S92). This Scheimpflug photography may generate one or more Scheimpflug images, or may be an anterior segment scan. Frontal photography may be performed in parallel with or approximately at the same time as this Scheimpflug photography (additional frontal photography). The Scheimpflug images generated in step S92 are stored, for example, in a storage device within the control unit 7.

[0428] Next, the positional relationship determination unit 81 determines the starting position (referred to as the initial focus position) of the focus position to be moved in the multifocal frontal photography of the anterior segment of the test eye E based on the Scheimpflug image obtained by the Scheimpflug photography in step S92 (S93).

[0429] An example of a process for determining an initial focal position will be described. The positional relationship determination unit 81 first estimates the focal position of the frontal imaging unit 4 at the time when Scheimpflug imaging was performed in step S92 (referred to as a current focal position). For example, the positional relationship determination unit 81 can estimate the current focal position based on the Scheimpflug image obtained in step S92 or the optical systems of the frontal imaging unit 4 and the Scheimpflug imaging unit 5 (e.g., design information of the optical system of the ophthalmic apparatus 1). As a result, a depth position in the Scheimpflug image corresponding to the current focal position of the frontal imaging unit 4 is estimated.

[0430] When additional frontal photography is performed together with Scheimpflug photography in step S92, the positional relationship determination unit 81 analyzes the additional frontal image obtained in the additional frontal photography to identify the depth position at which the image is in focus (i.e., the depth position corresponding to the current focal position), and can identify the position in the Scheimpflug image corresponding to the depth position by comparing and analyzing the Scheimpflug image obtained in step S92 with the additional frontal image. This allows the depth position in the Scheimpflug image corresponding to the current focal position of the frontal photography unit 4 to be estimated.

[0431] Furthermore, the positional relationship determination unit 81 can determine an initial focal position based on the estimated current focal position of the front imaging unit 4 and scale information of the Scheimpflug image (the correspondence between the distance in the image and the distance in real space). Here, the scale information is predetermined and known based on the configuration of the optical system of the Scheimpflug imaging unit 5. The initial focal position is determined, for example, taking into consideration the tissue to be imaged by Scheimpflug imaging. When the target range of Scheimpflug imaging ranges from the cornea to the crystalline lens, the initial focal position is set to a position closer to the ophthalmic apparatus 1 than the corneal apex, or a position closer to the fundus than the crystalline lens. The information obtained in step S93 (such as the initial focal position and the current focal position) is stored, for example, in a storage device within the control unit 7.

[0432] Next, the control unit 7 moves the focal position of the front imaging system to the initial focal position determined in step S93 (S94).

[0433] Subsequently, under the control of the control unit 7, the front photographing unit 4 applies multifocal front photographing to the anterior segment of the subject's eye E starting from the initial focus position determined in step S93 (S95).

[0434] In the multifocal frontal imaging of step S95, the frontal imaging unit 4 performs frontal imaging of the anterior segment of the subject's eye E multiple times while moving the focal position in the axial direction (Z direction). This generates multiple front images (multifocal frontal image group) each focused at multiple different depth positions. Furthermore, in the multifocal frontal imaging of step S95, the moving speed of the focal position may be approximately constant.

[0435] When the initial focal position is set to a position closer to the corneal apex of the ophthalmic apparatus 1, the front imaging unit 4 performs front imaging multiple times while moving the focal position from the initial focal position toward the fundus. When the initial focal position is set to a position closer to the fundus than the crystalline lens, the front imaging unit 4 performs front imaging multiple times while moving the focal position from the initial focal position toward the cornea. By performing such multifocal front imaging, a group of multifocal front images can be obtained, including, for example, one or more front images focused on the cornea, one or more front images focused on the anterior chamber, one or more front images focused on the iris (pupil), and one or more front images focused on the crystalline lens.

[0436] The group of multifocal front images acquired by the multifocal front photographing in step S95 is stored, for example, in a storage device in the control unit 7 (S96).

[0437] In the operation example of FIG. 22 , first, an image display mode is specified (S101). The image display mode includes a focus stacking display mode. The mode is specified manually or automatically. In the manual mode specification, for example, the user specifies a desired mode using the operation unit 12. In the automatic mode specification, for example, an image display mode corresponding to a higher-level selection mode (such as an observation mode or a disease-specific mode) is specified by the control unit 7 (display control unit 71).

[0438] If the focus stacking display mode is selected (S101: Yes), the process proceeds to step S102. If the focus stacking display mode is not selected (S101: No), the process proceeds to step S104.

[0439] If the focus stacking display mode is selected (S101: Yes), the display control unit 71 reads out the group of multifocal front images saved in step S96 from the storage device and sends them to the image synthesis unit 86. The image synthesis unit 86 applies focus stacking processing to the group of multifocal front images to generate an extended depth-of-field image (S102).

[0440] The display control unit 71 causes the display unit 11 to display the depth-of-field extended image generated in step S102 (S103). If the focus stacking display mode is selected (S101: Yes), the processing of this operation example ends (END).

[0441] If the focus stacking display mode is not selected (S101: No), the positional relationship determination unit 81 estimates a depth position in the Scheimpflug image corresponding to the initial focus position in the multifocal frontal imaging in step S95 (S104). This process is performed based on, for example, the information on the initial focus position saved in step S93, design information on the optical system of the frontal imaging unit 4, design information on the optical system of the Scheimpflug imaging unit 5, and scale information of the image generated by the Scheimpflug imaging unit 5 (correspondence between distances in the Scheimpflug image space and distances in real space). As a result, a front image corresponding to the initial focus position among the group of multifocal frontal images (i.e., a front image obtained by imaging with the initial focus position set) is associated with a depth position in the Scheimpflug image.

[0442] Next, the positional relationship determination unit 81 estimates the depth position in the Scheimpflug image corresponding to the focal position of each front image included in the multifocal front image group (S105). This process is performed based on, for example, the depth position in the Scheimpflug image corresponding to the initial focal position estimated in step S104, scale information of the Scheimpflug image, the moving speed of the focal position in the multifocal front imaging in step S95, etc. As a result, each front image obtained in the multifocal front image group is associated with a depth position in the Scheimpflug image.

[0443] Next, a depth position in the Scheimpflug image is specified (S106). This depth position specification may be performed manually or automatically. In manual specification, for example, the user uses the operation unit 12 to specify a desired depth position in the displayed Scheimpflug image. Alternatively, the user uses the operation unit 12 to specify a desired region of the anterior segment of the eye. The data processing unit 8 performs a predetermined analysis process (e.g., segmentation) on the Scheimpflug image to identify a depth position corresponding to the specified region. On the other hand, in automatic specification, for example, a depth position corresponding to a higher-level selection mode (such as an observation mode or a disease-specific mode) is specified. In this automatic specification, an analysis process such as segmentation is applied to the Scheimpflug image.

[0444] The display control unit 71 selects a front image from the group of multifocal front images that corresponds to the depth position in the Scheimpflug image specified in step S106 based on the correspondence between the group of multifocal front images and the depth position in the Scheimpflug image obtained in step S105, and displays the selected front image on the display unit 11 (S107). If the focus stacking display mode is not selected (S101: No), the processing of this operation example is now completed (END).

[0445] According to the operation examples of Figures 21 and 22, in addition to being able to provide the user with an extended depth-of-field image by applying multifocal frontal photography to the anterior segment of the subject's eye E, it is also possible to provide the user with a frontal image focused at a desired depth position of the anterior segment of the subject's eye E with a simple operation or automatically.

[0446] When an anterior eye scan is performed by the Scheimpflug imaging unit 5, the ophthalmologic apparatus 1 generates a front image (reconstructed image, rendered image, etc.) from the Scheimpflug image group collected by the anterior eye scan, determines a positional relationship between the Scheimpflug front image and a front image (extended depth-of-field image, selected front image, etc.) based on the multifocal front image group, and can present positional relationship information indicating this positional relationship. The determination of the positional relationship and the display of the positional relationship information can be performed in the same manner as in any of the above-described aspects.

[0447] Fig. 23 shows an example of information display that can be executed instead of the example of operation in Fig. 22. Steps S101 to S106 in Fig. 23 are the same as steps S101 to S106 in Fig. 22, respectively.

[0448] In this operation example, the display control unit 71 selects, from the group of multifocal front images, a front image corresponding to the depth position in the Scheimpflug image specified in step S106 and one or more front images corresponding to depth positions near the specified depth position, and sends the selected two or more front images to the image synthesis unit 86. The image synthesis unit 86 applies focus stacking processing to the selected two or more front images to generate an extended depth-of-field image (S108). The number of front images selected from the group of multifocal front images may be any number, for example, a preset number or a number set by the user or the display control unit 71. Similarly, the range (number) of nearby depth positions may be any number, for example, a preset range or a range set by the user or the display control unit 71.

[0449] The display control unit 71 causes the display unit 11 to display the depth-of-field extended image generated in step S108 (S109). If the focus stacking display mode is not selected (S101: No), the processing of this operation example ends (END).

[0450] According to the operation examples of Figures 21 and 23, in addition to being able to provide the user with an extended depth-of-field image by applying multifocal frontal photography to the anterior segment of the subject's eye E, it is also possible to provide the user with a frontal image focused on the desired depth position of the anterior segment of the subject's eye E and nearby depth positions with a simple operation or automatically.

[0451] When an anterior eye scan is performed by the Scheimpflug imaging unit 5, the ophthalmologic apparatus 1 generates a front image (reconstructed image, rendered image, etc.) from the Scheimpflug image group collected by the anterior eye scan, determines a positional relationship between the Scheimpflug front image and a front image (extended depth-of-field image, selected front image, etc.) based on the multifocal front image group, and can present positional relationship information indicating this positional relationship. The determination of the positional relationship and the display of the positional relationship information can be performed in the same manner as in any of the above-described aspects.

[0452] The ophthalmic apparatus 1 of some embodiments is capable of performing high dynamic range (HDR) synthesis. High dynamic range synthesis is a process for generating an image (a dynamic range expanded image, a high dynamic range image) having a wider dynamic range than the dynamic range of the original image. FIG. 24 shows a non-limiting example of a processing system of the ophthalmic apparatus 1 of this embodiment. The configuration of FIG. 24 is used instead of the configuration of FIG. 5 , FIG. 11 , or FIG. 20 , or is at least partially added to the configuration of FIG. 5 , FIG. 11 , or FIG. 20 . Hereinafter, a description of matters common to the configuration of FIG. 5 , FIG. 11 , or FIG. 20 may be omitted, and matters related to FIG. 5 , FIG. 11 , or FIG. 20 will be cited as necessary.

[0453] 24 is obtained by adding an exposure amount changing unit 46 to the front photographing unit 4 of the processing system in FIG. 5 and by adding an image synthesis unit 87 to the data processing unit 8. The data processing unit 8 may include, for example, any one of an image reconstruction unit 82, an image rendering unit 83, an image analysis unit 84, an image registration unit 85, and an image synthesis unit 86.

[0454] The exposure amount changing unit 46 of this example has a configuration for changing the exposure amount (also called exposure) in frontal imaging of the anterior segment. The exposure amount changing unit 46 may have any configuration that can be employed to change the exposure amount. At least one element of the exposure amount changing unit 46 may be provided in the illumination system 2A or the frontal imaging system 3A.

[0455] In some examples, the exposure amount changing unit 46 may be configured to change the exposure amount by utilizing the illumination system 2 A. Also, in some examples, the exposure amount changing unit 46 may be configured to change the exposure amount by utilizing the front imaging system 3 A.

[0456] In one example, the exposure amount changer 46 changes the exposure amount by changing the exposure time of the image sensor (camera) of the front imaging system 3A. The exposure amount changer 46 in this example includes a first exposure time changer (not shown) having a configuration for changing the exposure time of the front imaging system 3A. The first exposure time changer may include, for example, a mechanical shutter or an electronic shutter provided in the imaging optical path. The first exposure time changer may also include an electronically controlled light intensity adjustment filter disposed in the imaging optical path, or a light intensity adjustment filter that can be inserted into or removed from the imaging optical path.

[0457] In another example, the exposure amount changing unit 46 changes the exposure amount by changing the intensity of the illumination light projected onto the anterior segment by the illumination system 2A. The exposure amount changing unit 46 in this example includes a second illumination intensity changing unit (not shown) having a configuration for changing the intensity of the illumination light. The second illumination intensity changing unit may include, for example, a light source driving circuit that drives the light source (illumination light source) of the illumination system 2A, an electronically controlled light intensity adjusting filter arranged in the illumination light path, or a light intensity adjusting filter that can be inserted into or removed from the illumination light path.

[0458] The positional relationship determination unit 81 of this embodiment determines the positional relationship between a plurality of front images generated by high dynamic range photography (referred to as a group of multi-dynamic range front images) and a Scheimpflug image generated by Scheimpflug photography. This process is similar to the process executed by the positional relationship determination unit 81 in FIG. 5 .

[0459] The image composition unit 87 includes a processor configured to execute any known high dynamic range composition process. In general, high dynamic range composition is an image process in which the same subject is photographed multiple times while changing the amount of exposure (high dynamic range photography), and the multiple images thus obtained are combined to generate an image having a wide dynamic range with little blown-out highlights or crushed shadows (an expanded dynamic range image).

[0460] The image synthesis unit 87 generates an image with expanded dynamic range by applying high dynamic range synthesis to a group of multi-dynamic range front images collected by high dynamic range photography.

[0461] The display control unit 71 causes the display unit 11 to display the expanded dynamic range image generated by the image synthesis unit 87. At this time, the display control unit 71 applies any known tone mapping process to the expanded dynamic range image to reduce the dynamic range, thereby generating an image having a standard dynamic range that can be displayed on the display unit 11 (a standard dynamic range (SDR) image or a low dynamic range (LDR) image). Tone mapping includes, for example, a process of reducing the contrast of the entire image or a process of reducing the contrast of local areas of the image. Furthermore, the display control unit 71 causes the display unit 11 to display the generated standard dynamic range image.

[0462] An example of the operation of the ophthalmologic apparatus 1 of this embodiment will be described with reference to FIG.

[0463] In this operation example, the ophthalmologic apparatus 1 first performs alignment with the anterior segment of the subject's eye E (S111). After the alignment is completed, the Scheimpflug photographing unit 5 applies Scheimpflug photography to the anterior segment of the subject's eye E under the control of the control unit 7 (S112). The Scheimpflug image generated in step S112 is stored in, for example, a storage device in the control unit 7.

[0464] Furthermore, under the control of the control unit 7, the front imaging unit 4 applies high dynamic range imaging to the anterior segment of the subject's eye E (S113). The order of Scheimpflug imaging and high dynamic range imaging may be reversed. The multi-dynamic range front image group (multi-DR front image group) acquired by the high dynamic range imaging in step S113 is stored, for example, in a storage device within the control unit 7 (S114).

[0465] This completes the anterior segment imaging phase, and the process moves to the information display phase. In the information display phase, first, an image display mode is specified (S115). The image display mode includes a high dynamic range composite display mode. The mode is specified manually or automatically. In the manual mode specification, for example, the user specifies a desired mode using the operation unit 12. In the automatic mode specification, for example, an image display mode corresponding to a higher-level selected mode (such as an observation mode or a disease-specific mode) is specified by the control unit 7 (display control unit 71).

[0466] If the high dynamic range composite display mode is selected (S115: Yes), the process proceeds to step S116. If the high dynamic range composite display mode is not selected (S115: No), the process proceeds to step S118.

[0467] If the high dynamic range composite display mode is selected (S115: Yes), the display control unit 71 reads out the group of multi-dynamic range front images saved in step S114 from the storage device and sends them to the image composition unit 87. The image composition unit 87 applies high dynamic range composition processing to the group of multi-dynamic range front images to generate an expanded dynamic range image (S116).

[0468] The display control unit 71 displays the dynamic range expanded image generated in step S116 on the display unit 11 (S117). If the high dynamic range composite display mode is selected (S115: Yes), the processing of this operation example ends (END).

[0469] If the high dynamic range composite display mode is not selected (S115: No), the exposure amount is specified (S118). This exposure amount specification may be performed manually or automatically. In the manual specification, for example, the user specifies the desired exposure amount by operating a graphical user interface (e.g., a slider bar or a dial) displayed on the display unit 11 using the operation unit 12 (e.g., a mouse). On the other hand, in the automatic specification, for example, the exposure amount is specified according to a higher-level selected mode (such as an observation mode or a disease-specific mode).

[0470] The display control unit 71 selects a front image corresponding to the exposure amount specified in step S118 from the group of multi-dynamic range front images, and displays the selected front image on the display unit 11 (S119). If the high dynamic range composite display mode is not selected (S115: No), the processing of this operation example ends (END).

[0471] According to the operation example of Figure 25, in addition to being able to provide the user with a high dynamic range image by applying high dynamic range photography to the anterior segment of the subject's eye E, it is also possible to provide the user with a front image of the desired exposure amount with a simple operation or automatically.

[0472] When an anterior eye scan is performed by the Scheimpflug imaging unit 5, the ophthalmologic apparatus 1 generates a front image (reconstructed image, rendered image, etc.) from the Scheimpflug images collected in the anterior eye scan, determines a positional relationship between the Scheimpflug front image and a front image (expanded dynamic range image, selected front image, etc.) based on the multi-dynamic range front image group, and can present positional relationship information indicating this positional relationship. The determination of the positional relationship and the display of the positional relationship information can be performed in the same manner as in any of the above-described aspects.

[0473] Some embodiments of the ophthalmic apparatus 1 can selectively display an image of a predetermined region (such as tissue, a lesion, or an artifact) depicted in a Scheimpflug image. A non-limiting example of a processing system for the ophthalmic apparatus 1 of this embodiment is shown in FIG. 26 . The configuration of FIG. 26 may be used instead of the configuration of FIG. 5 , 11 , 20 , or 24 , or may be at least partially added to the configuration of FIG. 5 , 11 , 20 , or 24 . Hereinafter, descriptions of matters common to the configuration of FIG. 5 , 11 , 20 , or 24 may be omitted, and matters related to FIG. 5 , 11 , 20 , or 24 will be cited as necessary.

[0474] The processing system in Fig. 26 is obtained by adding an image segmentation unit 88 to the data processing unit 8 in the processing system in Fig. 5. The data processing unit 8 may include, for example, any one of an image reconstruction unit 82, an image rendering unit 83, an image analysis unit 84, an image registration unit 85, an image synthesis unit 86, and an image synthesis unit 87.

[0475] The image segmentation unit 88 of this example executes segmentation, which is image processing for dividing an image into a plurality of regions.

[0476] The type of segmentation that can be performed by the image segmentation unit 88 may be any type and may include, for example, one or more of the following: semantic segmentation, which detects the class to which every pixel of an image belongs; instance segmentation, which identifies the particular instance of an object to which every pixel of an image belongs; and panoptic segmentation, which combines semantic and instance segmentation.

[0477] Furthermore, any segmentation method may be performed by the segmentation unit 88. Common segmentation methods include thresholding, clustering, dual clustering, data compression, histogram methods, edge detection, region-growing methods, partial differential equation-based methods, calculus of variations, graph partitioning, watershed methods, model-based segmentation, multi-scale segmentation, semi-automated segmentation, trainable segmentation (e.g., neural network segmentation), etc. The segmentation unit 88 may be configured to perform one or more of these methods and / or other methods.

[0478] An example of the operation of the ophthalmologic apparatus 1 of this embodiment will be described with reference to FIG.

[0479] In this operation example, the ophthalmologic apparatus 1 first aligns the anterior segment of the subject's eye E (S121). Once the alignment is complete, the Scheimpflug photographing unit 5, under the control of the control unit 7, applies Scheimpflug photographing to the anterior segment of the subject's eye E (S122). In this operation example, an anterior segment scan is applied to the subject's eye E, and a group of Scheimpflug images is generated. The generated group of Scheimpflug images is stored in a storage device in the control unit 7, for example.

[0480] Further, under the control of the control unit 7, the front photographing unit 4 applies front photographing to the anterior segment of the subject's eye E (S123). The order of Scheimpflug photographing (anterior segment scanning) and front photographing may be reversed. The front image generated by the front photographing in step S113 is stored in, for example, a storage device in the control unit 7.

[0481] The anterior segment imaging phase is now complete, and the process moves to the information display phase. In the information display phase, the segmentation unit 88 first applies segmentation to each of the Scheimpflug images generated in step S122 (S124). This results in a label being assigned to each pixel in each Scheimpflug image. The label assigned to the pixel may include an identifier indicating the location of the anterior segment (e.g., tissue, lesion, or artifact).

[0482] Next, a region of the anterior segment is designated (S125). This region designation can be performed manually or automatically. In the manual mode designation, for example, the user designates a desired region using the operation unit 12. In the automatic mode designation, for example, a region corresponding to a higher-level selection mode (such as observation mode or disease-specific mode) is designated by the control unit 7 (display control unit 71).

[0483] The display control unit 71 extracts pixels to which labels corresponding to the regions designated in step S125 have been assigned from each Scheimpflug image generated in step S122 (S126).

[0484] The display control unit 71 causes the display unit 11 to display an image based on the pixel groups extracted from each Scheimpflug image in step S126 (S127). The displayed image may be, for example, a partial image of one Scheimpflug image made up of pixel groups extracted from that Scheimpflug image, a reconstructed image generated by the image reconstruction unit 82 from pixel groups extracted from two or more Scheimpflug images, or a three-dimensional rendering image generated by the image rendering unit 83 from pixel groups extracted from two or more Scheimpflug images. The image displayed in this manner is an image of the region specified in step S125.

[0485] It is also possible for the image analysis unit 84 to analyze an image based on the pixel group extracted from the Scheimpflug image group in step S126.

[0486] According to the operation example of Figure 27, it is possible to generate an image of a desired area from a Scheimpflug image generated by Scheimpflug photography (anterior segment scan) with simple operations or automatically and provide it to the user.

[0487] Some embodiments of the ophthalmologic apparatus 1 may be configured to perform pupillography. Pupilography is a test that measures and analyzes (evaluates) the pupil's response to stimuli such as light. Conventional pupillography typically involves capturing an image of the anterior eye using an infrared video camera. In contrast, this embodiment detects the pupil's response by analyzing a Scheimpflug image generated by Scheimpflug photography and / or a frontal image generated by frontal photography. The data processing unit 8 of the ophthalmologic apparatus 1 of this embodiment includes an element (a pupillary movement analysis unit (not shown)) that performs a process of analyzing pupillary movement. The pupillary movement analysis unit detects pupil images from each image to be analyzed and determines changes over time (such as changes in position, size, and shape) of the detected pupil images. The display control unit 71 displays information (such as a graph) showing changes over time in the pupil images on the display unit 11.

[0488] Some embodiments of the ophthalmic apparatus 1 are capable of performing manual segmentation or semi-manual segmentation. For example, the ophthalmic apparatus 1 of this embodiment may be capable of segmentation using a Segment Anything Model (SAM). SAM is a model capable of generating prompts (e.g., points, bounding boxes, natural language, etc.). In the medical field, SAM is applied to annotate medical images. The ophthalmic apparatus 1 of this embodiment can perform a process of generating training data based on the results obtained by such segmentation and / or a process of providing the results obtained by such segmentation to a training data generation device. The ophthalmic apparatus 1 of this embodiment may also have a function of performing machine learning using the generated training data to generate or update an image segmentation model, or a function of performing segmentation of a Scheimpflug image or a frontal image using the image segmentation model.

[0489] Some embodiments of the ophthalmic device 1 may be configured to perform cataract classification based on the lens and display the classification results superimposed on the Scheimpflug image or the en face image. This process updates the technique described in the following document: Alfred Wegener et al. (2009). Photography of the anterior eye segment according to Scheimpflug's principle: options and limitations—a review, Clinical and Experimental Ophthalmology 2009; 37: 144-154.

[0490] In some embodiments, the ophthalmologic apparatus 1 may be configured to remove unnecessary image regions before performing image reconstruction or 3D rendering when generating a reconstructed image or a 3D rendered image from a Scheimpflug image group acquired by performing an anterior segment scan on the subject's eye E. The image regions to be removed include regions outside the subject's eye E (e.g., an air region anterior to the cornea), image regions posterior to the iris, and image regions posterior to the lens. A user can specify the image regions to be excluded using the operation unit 12. The data processing unit 8 can also analyze the Scheimpflug image group to identify the image regions to be excluded. For example, the data processing unit 8 is configured to perform a process of labeling each pixel by applying segmentation to the Scheimpflug image group, a process of removing pixels assigned with a predetermined label from the Scheimpflug image group, and a process of generating an image (e.g., a reconstructed image, a 3D rendered image) from the remaining pixels.

[0491] Some non-limiting aspects of the ophthalmic apparatus according to the embodiment have been described above. Any two or more aspects can be at least partially combined.

[0492] The category of the embodiments according to the present disclosure is not limited to ophthalmic devices. Examples of embodiments in categories other than ophthalmic devices include ophthalmic image processing devices (information processing devices), methods for controlling ophthalmic devices, methods for controlling ophthalmic image processing devices, methods for photographing the anterior segment of the eye, methods for diagnosing the anterior segment of the eye, programs, and recording media. The embodiments in these categories can also achieve the same effects as those of the ophthalmic device.

[0493] The recording medium is a non-transitory computer-readable recording medium and may take any form, such as a magnetic disk, an optical disk, a magneto-optical disk, or a semiconductor memory.

[0494] Any of the features described in this disclosure regarding the ophthalmic device may be combined with other embodiments of the same category, and the resulting combination may provide advantages based on the combined features.

[0495] The embodiments and aspects described in the present disclosure are merely examples, and any modifications (omissions, substitutions, additions, etc.) within the scope of the present invention can be applied to the embodiments and aspects of the present disclosure.

[0496] REFERENCE SIGNS LIST 1 ophthalmic device 4 frontal photographing unit 5 Scheimpflug photographing unit 71 display control unit 81 positional relationship determining unit 11 display unit

Claims

1. An ophthalmic device comprising: a first photographing unit including an illumination system that projects illumination light onto the anterior segment of a subject's eye and a front photographing system that photographs the anterior segment from the front; a second photographing unit including a slit illumination system that projects slit light onto the anterior segment of the eye and a photographing system that photographs the anterior segment, the slit illumination system and the photographing system being configured as a Scheimpflug optical system; a positional relationship determination unit that determines the positional relationship between a front image generated by the first photographing unit and a Scheimpflug image generated by the second photographing unit; a display unit; and a display control unit that causes the display unit to display the front image, the Scheimpflug image, and positional relationship information based on the positional relationship.

2. The ophthalmologic device of claim 1, wherein the positional relationship determination unit determines a position in the front image corresponding to the projection position of the slit light in the Scheimpflug image as the positional relationship, and the display control unit displays projection position information indicating the projection position of the slit light superimposed on the front image as the positional relationship information.

3. An ophthalmic device according to claim 1 or 2, wherein the imaging system of the second imaging unit includes a pair of imaging systems that image the anterior segment from different directions, the slit illumination system and each of the pair of imaging systems are configured as Scheimpflug optical systems, and the display control unit displays on the display unit a Scheimpflug image pair generated by simultaneously imaging the anterior segment with the pair of imaging systems, together with the front image and the positional relationship information.

4. An ophthalmologic device according to any one of claims 1 to 3, further comprising an operation unit, wherein when an instruction to enlarge and display a partial area of ​​a first image of the front image and the Scheimpflug image is given using the operation unit, the display control unit executes an enlarged display of the partial area of ​​the first image and an enlarged display of a partial area of ​​a second image corresponding to the partial area of ​​the first image.

5. An ophthalmic device according to any one of claims 1 to 4, further comprising a movement mechanism for moving the first photographing unit and the second photographing unit, wherein the second photographing unit, while being moved by the movement mechanism, photographs the anterior segment of the eye onto which the slit light is projected multiple times, thereby generating multiple Scheimpflug images corresponding to the multiple projection positions of the slit light.

6. An ophthalmologic device according to claim 5, further comprising an operation unit, wherein the positional relationship determination unit determines the positional relationship between the front image and each of the plurality of Scheimpflug images, and when a position in the front image is specified using the operation unit, the display control unit selects a Scheimpflug image corresponding to the specified position from among the plurality of Scheimpflug images and displays it on the display unit, and also displays projection position information indicating the projection position of the slit light corresponding to the selected Scheimpflug image as the positional relationship information superimposed on the front image.

7. The ophthalmologic device of claim 6, wherein the imaging system of the second imaging unit includes a pair of imaging systems that images the anterior segment from different directions, the slit illumination system and each of the pair of imaging systems are configured as a Scheimpflug optical system, the second imaging unit, while being moved by the moving mechanism, performs simultaneous imaging of the anterior segment onto which the slit light is projected multiple times using the pair of imaging systems to generate multiple Scheimpflug image pairs corresponding to multiple projection positions of the slit light, and when a position in the front image is specified using the operation unit, the display control unit selects a Scheimpflug image pair corresponding to the specified position from the multiple Scheimpflug image pairs and displays it on the display unit, and also displays projection position information indicating the projection position of the slit light corresponding to the selected Scheimpflug image pair as the positional relationship information superimposed on the front image.

8. An ophthalmologic device according to any one of claims 5 to 7, further comprising an operation unit, wherein the positional relationship determination unit determines the positional relationship between the front image and each of the plurality of Scheimpflug images, and when a Scheimpflug image is selected from the plurality of Scheimpflug images using the operation unit, the display control unit displays the selected Scheimpflug image on the display unit and also displays projection position information indicating the projection position of the slit light corresponding to the selected Scheimpflug image superimposed on the front image as the positional relationship information.

9. An ophthalmologic device according to any one of claims 5 to 8, further comprising an image reconstruction unit that generates a reconstructed image from the plurality of Scheimpflug images, wherein the display control unit causes the reconstructed image to be displayed on the display unit, and causes projection position information indicating the projection position of the slit light corresponding to the displayed Scheimpflug image to be displayed superimposed on the reconstructed image as the positional relationship information.

10. An ophthalmologic device according to any one of claims 5 to 9, further comprising an image rendering unit that generates a three-dimensional rendering image from the plurality of Scheimpflug images, wherein the display control unit causes the three-dimensional rendering image to be displayed on the display unit, and causes projection position information indicating the projection position of the slit light corresponding to the displayed Scheimpflug image to be displayed superimposed on the three-dimensional rendering image as the positional relationship information.

11. An ophthalmic device according to any one of claims 1 to 10, wherein, while the anterior segment is being photographed by the second photographing unit, the first photographing unit performs additional front photographing to photograph the anterior segment from the front without projecting the illumination light, thereby generating an additional front image, and the positional relationship determination unit calculates the relative displacement between the front image and the additional front image, and determines the positional relationship based on the relative displacement.

12. The ophthalmologic device of claim 11, wherein the positional relationship determination unit identifies a position in the front image corresponding to a predetermined portion of the anterior segment and a position in the additional front image corresponding to the predetermined portion, and calculates the relative displacement based on the specified position in the front image and the specified position in the additional front image.

13. An ophthalmic device comprising: a first photographing unit including an illumination system that projects illumination light onto the anterior segment of the eye to be examined and a front photographing system that photographs the anterior segment from the front; a second photographing unit including a slit illumination system that projects slit light onto the anterior segment of the eye and a photographing system that photographs the anterior segment, the slit illumination system and the photographing system being configured as a Scheimpflug optical system; a positional relationship determination unit that determines the positional relationship between a front image generated by the first photographing unit and a Scheimpflug image generated by the second photographing unit; an image analysis unit that analyzes the Scheimpflug image and generates analysis data; a display unit; and a display control unit that displays the front image and the Scheimpflug image on the display unit and displays the analysis data superimposed on the front image based on the positional relationship.

14. An ophthalmic device according to claim 13, further comprising a moving mechanism for moving the first photographing unit and the second photographing unit, wherein the second photographing unit, while being moved by the moving mechanism, photographs the anterior segment onto which the slit light is projected multiple times, thereby generating multiple Scheimpflug images corresponding to multiple projection positions of the slit light.

15. The ophthalmologic device of claim 14, wherein the image analysis unit analyzes the plurality of Scheimpflug images to generate distribution data of values ​​of predetermined anterior segment parameters as the analysis data, and the display control unit displays the distribution data superimposed on the front image based on the positional relationship.

16. An ophthalmologic device according to claim 15, further comprising: a memory unit that stores a plurality of image groups generated on a plurality of dates and times for the subject's eye, each image group including a front image and a plurality of Scheimpflug images; and an image registration unit that performs registration between the plurality of front images included in the plurality of image groups, wherein the positional relationship determination unit determines the positional relationship between the front image and each Scheimpflug image included in each of the plurality of image groups, the image analysis unit generates the distribution data from the plurality of Scheimpflug images included in each of the plurality of image groups, and the display control unit, for each of the plurality of dates and times, displays the distribution data corresponding to the date and time superimposed on the front image corresponding to the date and time based on the positional relationship corresponding to the date and time.

17. An ophthalmologic device according to any one of claims 13 to 16, wherein, while the anterior segment is being photographed by the second photographing unit, the first photographing unit performs additional front photographing to photograph the anterior segment from the front without projecting the illumination light, thereby generating an additional front image, and the positional relationship determination unit calculates the relative displacement between the front image and the additional front image, and determines the positional relationship based on the relative displacement.

18. An ophthalmic device according to claim 17, wherein the positional relationship determination unit identifies a position in the front image corresponding to a predetermined portion of the anterior segment and a position in the additional front image corresponding to the predetermined portion, and calculates the relative displacement based on the specified position in the front image and the specified position in the additional front image.

19. An ophthalmic device comprising: a first photographing unit including an illumination system that projects illumination light onto the anterior segment of the eye to be examined and a frontal photographing system that photographs the anterior segment from the front; a second photographing unit including a slit illumination system that projects slit light onto the anterior segment of the eye and a photographing system that photographs the anterior segment, the slit illumination system and the photographing system being configured as a Scheimpflug optical system; a positional relationship determination unit that determines the positional relationship between a front image generated by the first photographing unit and a Scheimpflug image generated by the second photographing unit; an image analysis unit that analyzes the front image and generates analysis data; a display unit; and a display control unit that displays the front image and the Scheimpflug image on the display unit and displays the analysis data superimposed on the Scheimpflug image based on the positional relationship.

20. An ophthalmic device comprising: a first imaging unit including an illumination system that projects illumination light onto the anterior segment of a subject's eye, a front imaging system that images the anterior segment from the front, and a focal position changing unit that changes the focal position of the front imaging system, and that generates multiple front images corresponding to multiple focal positions of the front imaging system; a second imaging unit including a slit illumination system that projects slit light onto the anterior segment of the eye and a imaging system that images the anterior segment, the slit illumination system and the imaging system being configured as a Scheimpflug optical system; a positional relationship determination unit that determines the positional relationship between each of the multiple front images corresponding to the multiple focal positions generated by the first imaging unit and the Scheimpflug image generated by the second imaging unit; a display unit; an operation unit; and a display control unit that, when a position in the Scheimpflug image is specified using the operation unit, causes one or more of the multiple front images to be displayed on the display unit based on the specified position and the positional relationship.

21. An ophthalmic device comprising: a first imaging unit including an illumination system that projects illumination light onto the anterior segment of the eye to be examined, a front imaging system that images the anterior segment from the front, and a focal position changing unit that changes the focal position of the front imaging system, and that generates a plurality of front images corresponding to a plurality of focal positions of the front imaging system; a second imaging unit including a slit illumination system that projects slit light onto the anterior segment of the eye and a imaging system that images the anterior segment, the slit illumination system and the imaging system being configured as a Scheimpflug optical system; a positional relationship determination unit that determines the positional relationship between each of the plurality of front images corresponding to the plurality of focal positions generated by the first imaging unit and the Scheimpflug image generated by the second imaging unit; a display unit; an operation unit; an image synthesis unit that, when a position in the Scheimpflug image is specified using the operation unit, generates a composite image of two or more front images of the plurality of front images based on the specified position and the positional relationship; and a display control unit that displays the composite image on the display unit.

22. A method for controlling an ophthalmic apparatus for photographing the anterior segment of a subject's eye, wherein the ophthalmic apparatus comprises: a first photographing unit including an illumination system that projects illumination light onto the anterior segment of the subject's eye and a frontal photographing system that photographs the anterior segment from the front; a second photographing unit that includes a slit illumination system that projects slit light onto the anterior segment and a photographing system that photographs the anterior segment, the slit illumination system and the photographing system being configured as a Scheimpflug optical system; a display unit; and a processor; the method comprising the steps of causing the first photographing unit to generate a frontal image of the anterior segment; causing the second photographing unit to generate a Scheimpflug image of the anterior segment; causing the processor to determine the positional relationship between the frontal image and the Scheimpflug image; and causing the processor to display the frontal image, the Scheimpflug image, and positional relationship information based on the positional relationship on the display unit.

23. A method for controlling an ophthalmic apparatus for photographing an anterior segment of an eye to be examined, the ophthalmic apparatus comprising: a first photographing unit including an illumination system that projects illumination light onto the anterior segment of the eye to be examined and a front photographing system that photographs the anterior segment from the front; a second photographing unit that includes a slit illumination system that projects slit light onto the anterior segment of the eye and a photographing system that photographs the anterior segment, the slit illumination system and the photographing system being configured as a Scheimpflug optical system; a display unit; and a processor, the method comprising the steps of: causing the first photographing unit to generate a front image of the anterior segment; causing the second photographing unit to generate a Scheimpflug image of the anterior segment; causing the processor to determine a positional relationship between the front image and the Scheimpflug image; causing the processor to analyze the Scheimpflug image and generate analysis data; and causing the processor to display the front image and the Scheimpflug image on the display unit. and causing the processor to superimpose the analysis data on the front image displayed on the display unit based on the positional relationship.

24. A method for controlling an ophthalmic apparatus for photographing an anterior segment of an eye to be examined, the ophthalmic apparatus comprising: a first photographing unit including an illumination system that projects illumination light onto the anterior segment of the eye to be examined and a front photographing system that photographs the anterior segment from the front; a second photographing unit that includes a slit illumination system that projects slit light onto the anterior segment of the eye and a photographing system that photographs the anterior segment, the slit illumination system and the photographing system being configured as a Scheimpflug optical system; a display unit; and a processor, the method comprising the steps of: causing the first photographing unit to generate a front image of the anterior segment; causing the second photographing unit to generate a Scheimpflug image of the anterior segment; causing the processor to determine a positional relationship between the front image and the Scheimpflug image; causing the processor to analyze the front image and generate analysis data; and causing the processor to display the front image and the Scheimpflug image on the display unit. and causing the processor to superimpose the analysis data on the Scheimpflug image displayed on the display unit based on the positional relationship.

25. A method for controlling an ophthalmic apparatus for photographing an anterior segment of an eye to be examined, the ophthalmic apparatus comprising: a first photographing unit including an illumination system for projecting illumination light onto the anterior segment of the eye to be examined, a front photographing system for photographing the anterior segment from the front, and a focal position changing unit for changing the focal position of the front photographing system; a second photographing unit including a slit illumination system for projecting slit light onto the anterior segment of the eye and a photographing system for photographing the anterior segment, the slit illumination system and the photographing system being configured as a Scheimpflug optical system; a display unit; an operation unit; and a processor; the method comprising the steps of: causing the first photographing unit to generate a plurality of front images corresponding to a plurality of focal positions of the front photographing system; causing the second photographing unit to generate a Scheimpflug image of the anterior segment; and causing the processor to determine a positional relationship between each of the plurality of front images corresponding to the plurality of focal positions and the Scheimpflug image. and when a position in the Scheimpflug image is specified using the operation unit, causing the processor to display one or more front images of the plurality of front images on the display unit based on the specified position and the positional relationship.

26. A method for controlling an ophthalmic apparatus for photographing an anterior segment of an eye to be examined, the ophthalmic apparatus comprising: a first photographing unit including an illumination system for projecting illumination light onto the anterior segment of the eye to be examined, a front photographing system for photographing the anterior segment from the front, and a focal position changing unit for changing the focal position of the front photographing system; a second photographing unit including a slit illumination system for projecting slit light onto the anterior segment of the eye and a photographing system for photographing the anterior segment, the slit illumination system and the photographing system being configured as a Scheimpflug optical system; a display unit; an operation unit; and a processor; the method comprising the steps of: causing the first photographing unit to generate a plurality of front images corresponding to a plurality of focal positions of the front photographing system; causing the second photographing unit to generate a Scheimpflug image of the anterior segment; and causing the processor to determine a positional relationship between each of the plurality of front images corresponding to the plurality of focal positions and the Scheimpflug image. When a position in the Scheimpflug image is specified using the operation unit, the method includes: causing the processor to generate a composite image of two or more front images of the plurality of front images based on the specified position and the positional relationship; and displaying the composite image on the display unit.

27. A computer-readable non-transitory recording medium having recorded thereon a program for causing a computer to execute the method of any one of claims 22 to 26.

Images