Ophthalmologic apparatus, method for determining fundus imaging distance, program, and recording medium

JP2025034514APending Publication Date: 2025-03-13TOPCON CORPORATION
View PDF 3 Cites 0 Cited by

Patent Information

Application Number
JP2023140931
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2023-08-31
Publication Date
2025-03-13

AI Technical Summary

Benefits of technology

【0012】 本開示に係る実施形態のいくつかの態様によれば、スリットスキャン方式の眼底撮影においてフレアの無い画像を取得するための新規な技術を提供することができる。

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2025034514000001_ABST
    Figure 2025034514000001_ABST
Patent Text Reader

Abstract

To acquire an image free of flare in slit-scan type fundus imaging.SOLUTION: An imaging unit 2 of an ophthalmologic apparatus 1 according to an embodiment projects illumination light onto a fundus Ef via an optical scanner 30 and detects returning light using an image sensor 51 operable in a rolling shutter mode. An image analysis unit 421 analyzes an image of the fundus Ef and obtains a luminance parameter value. A pupil diameter data acquisition unit 422 acquires pupil diameter data of the eye to be examined E. A control amount determination unit 423 determines a control amount for the distance between the eye to be examined E and the imaging unit 2 on the basis of the luminance parameter value obtained by the image analysis unit 421 and the pupil diameter data acquired by the pupil diameter data acquisition unit 422. A movement control unit 424 controls a movement mechanism 3 on the basis of the control amount, thereby adjusting the distance between the eye to be examined E and the imaging unit 2.SELECTED DRAWING: Figure 8
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present disclosure relates to an ophthalmic apparatus, a method for determining a fundus photographing distance, a program, and a recording medium. [Background technology]

[0002] Fundus photography is one of the powerful and common techniques for ophthalmic diagnosis, and is performed using a fundus camera or a scanning laser ophthalmoscope (SLO). The fundus photography modality disclosed in Patent Document 1 is configured to generate a fundus image by illuminating the fundus with slit light and detecting the return light with a rolling shutter type imaging device (e.g., a rolling shutter type CMOS image sensor). This fundus photography modality collects multiple images by synchronously repeating the movement of the projection position of the slit light on the fundus and the detection (photography) of the return light by the imaging device, and synthesizes these images, thereby making it possible to obtain a fundus image with a simple configuration. Such a fundus photography modality is called slit scan, etc.

[0003] It is known that flare may occur in an image generated by slit scanning, and that reducing the illumination light amount is generally effective in removing or reducing flare. In addition, since there is a trade-off between the illumination light amount and the shooting time in slit scanning, it is known that the possibility of fixational eye movement increases with an extension of the shooting time associated with a decrease in the illumination light amount, and conversely, the possibility of flare increases with an increase in the illumination light amount associated with a shortening of the shooting time. Furthermore, it is known that the possibility of flare occurrence differs for each examined eye, and therefore it is necessary to deal with each examined eye. Note that flare is an image of unnecessary light generated by the reflection and scattering of return light (e.g., corneal reflected light) from the examined eye by an optical element.

[0004] In addition to explaining these matters, Patent Document 2 discloses an ophthalmologic apparatus configured to determine the presence or absence of flare based on an infrared fundus image of the subject's eye and control conditions for slit scanning. This condition control includes control of a light flux limiting member (slit, iris diaphragm) provided in the illumination optical system, control of a light flux limiting member (photography diaphragm) provided in the photographing optical system, control of the illumination light amount, and control of the photographing time (exposure time of the image sensor).

[0005] Many ophthalmic devices used for fundus photography are configured to perform automatic alignment (auto-alignment) of the optical system to the subject's eye before photography. For example, the ophthalmic device described in Patent Document 3 performs auto-alignment of the subject's eye and auto-focusing of the fundus before fundus photography. This conventional auto-alignment is characterized by adjusting the alignment target position in the up-down, left-right, and right-handed directions (XY directions) based on the size of the pupil of the subject's eye. On the other hand, alignment in the front-back direction (far-near direction, Z direction) is performed by a well-known method that refers to a split image of the anterior eye image. Patent Document 3 also discloses that when the subject's eye is determined to have a small pupil based on the size of the flare area in the fundus image, adjustment of the alignment target position in the XY directions is automatically started. [Prior art documents] [Patent documents]

[0006] [Patent Document 1] U.S. Patent No. 7,831,106 [Patent Document 2] JP 2021-145896 A [Patent Document 3] JP 2016-185192 A Summary of the Invention [Problem to be solved by the invention]

[0007] One object of the present disclosure is to provide a novel technique for acquiring an image without flare in slit-scan fundus photography. [Means for solving the problem]

[0008] One aspect of an embodiment according to the present disclosure is an ophthalmologic apparatus including an imaging unit, a moving mechanism, an image analysis unit, a pupil diameter data acquisition unit, a control amount determination unit, and a movement control unit. The imaging unit includes an illumination optical system that projects illumination light from a light source onto the fundus of the subject's eye via an optical scanner, and an imaging optical system that detects return light of the illumination light with a first image sensor operable in a rolling shutter mode. The moving mechanism is configured to move the imaging unit. The image analysis unit is configured to analyze an image of the fundus of the subject's eye to determine a value of a predetermined luminance parameter. The pupil diameter data acquisition unit is configured to acquire pupil diameter data of the subject's eye. The control amount determination unit is configured to determine a control amount of a distance between the subject's eye and the imaging unit based on the value of the luminance parameter determined by the image analysis unit and the pupil diameter data acquired by the pupil diameter data acquisition unit. The movement control unit is configured to control the moving mechanism based on the control amount determined by the control amount determination unit.

[0009] Another aspect of the embodiment according to the present disclosure is a method for determining a distance between a test eye and an imaging unit for fundus photography. The fundus photography is performed using an ophthalmologic apparatus including an imaging unit configured to project illumination light from a light source onto the fundus of the test eye via an optical scanner and detect the return light of the illumination light with an image sensor operable in a rolling shutter mode. The method of this aspect includes a first step of acquiring an image of the fundus of the test eye, a second step of analyzing the image acquired in the first step to obtain a value of a predetermined luminance parameter, a third step of acquiring pupil diameter data of the test eye, and a fourth step of determining a distance between the test eye and the imaging unit based on the value of the luminance parameter obtained in the second step and the pupil diameter data acquired in the third step.

[0010] Yet another aspect of the embodiment of the present disclosure is a program for causing a computer to execute a method according to the embodiment.

[0011] Yet another aspect of the embodiment according to the present disclosure is a computer-readable non-transitory recording medium having a program according to the embodiment recorded thereon. Effect of the Invention

[0012] According to some aspects of the embodiments of the present disclosure, a novel technique for acquiring an image without flare in slit-scan fundus photography can be provided. [Brief description of the drawings]

[0013] [Figure 1] 1 is a schematic diagram for explaining one non-limiting example of the configuration of an ophthalmologic apparatus according to an embodiment. [Diagram 2] 1 is a schematic diagram for explaining one non-limiting example of the configuration of an ophthalmologic apparatus according to an embodiment. [Diagram 3] 1 is a schematic diagram for explaining one non-limiting example of the configuration of an ophthalmologic apparatus according to an embodiment. [Figure 4] 1 is a schematic diagram for explaining one non-limiting example of the configuration of an ophthalmologic apparatus according to an embodiment. [Diagram 5] 1 is a schematic diagram for explaining one non-limiting example of the operation of an ophthalmic apparatus according to an embodiment. [Figure 6] 1 is a schematic diagram for explaining one non-limiting example of the operation of an ophthalmic apparatus according to an embodiment. [Figure 7] 1 is a schematic diagram for explaining one non-limiting example of the operation of an ophthalmic apparatus according to an embodiment. [Figure 8] 1 is a schematic diagram for explaining one non-limiting example of the configuration of an ophthalmologic apparatus according to an embodiment. [Figure 9A] 1 is an example of a fundus image containing flare acquired by a rolling shutter slit scan. [Figure 9B]1 is an example of a fundus image containing flare, captured by global shutter photography. [Figure 10] 1 is a schematic diagram for explaining one non-limiting example of the operation of an ophthalmic apparatus according to an embodiment. [Figure 11] 1 is a schematic diagram for explaining one non-limiting example of the configuration of an ophthalmologic apparatus according to an embodiment. [Figure 12] 1 is a schematic diagram for explaining one non-limiting example of the configuration of an ophthalmologic apparatus according to an embodiment. [Figure 13] 1 is a schematic diagram for explaining one non-limiting example of the configuration of an ophthalmologic apparatus according to an embodiment. [Figure 14] 1 is a schematic diagram for explaining one non-limiting example of the operation of an ophthalmic apparatus according to an embodiment. [Figure 15] 1 is a schematic diagram for explaining one non-limiting example of the operation of an ophthalmic apparatus according to an embodiment. [Figure 16] 11 is a flowchart for explaining one non-limiting example of an operation performed by an ophthalmologic apparatus according to an embodiment. [Figure 17] 11 is a flowchart for explaining one non-limiting example of an operation performed by an ophthalmologic apparatus according to an embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0014] Certain non-limiting aspects of the embodiments of the present disclosure will now be described in detail with reference to the drawings.

[0015] Any known technology can be combined with any aspect of the present disclosure. For example, any matter disclosed in the documents cited in this specification can be combined with any aspect of the present disclosure. In addition, any known technology in the technical field related to the present disclosure can be combined with any aspect of the present disclosure. For example, any technical matter (matters disclosed in patent applications, papers, etc.) disclosed by the applicant of the present application regarding the technology related to the present disclosure or the technology applicable to the technology can be incorporated by reference in any aspect of the present disclosure.

[0016] Any two or more of the various aspects described in this disclosure may be combined, at least in part.

[0017] At least a portion of the functionality of the elements described in this disclosure is implemented using circuitry or processing circuitry. The circuitry or processing circuitry may be a general purpose processor, a special purpose processor, an integrated circuit, a central processing unit (CPU), a graphics processing unit (GPU), an application specific integrated circuit (ASIC), a programmable logic device (e.g., a simple programmable logic device (SPLD), a complex programmable logic device (CPLD), a field programmable gate array (FPGA), or a combination of a programmable logic device (PLC) and a programmable logic device (PLC)) configured and / or programmed to perform at least a portion of the disclosed functionality. The term "circuitry", "unit", "means" or the like includes any of the above-mentioned circuitry, including a transistor and / or other circuitry, a processor, a processor array, a conventional circuitry, and any combination thereof. A processor is considered to be a processing circuitry or circuitry, including transistors and / or other circuitry. In this disclosure, a circuitry, a unit, a means, or the like is hardware that performs at least some of the disclosed functions or is hardware that is programmed to perform at least some of the disclosed functions. The hardware may be hardware disclosed herein or may be known hardware that is programmed and / or configured to perform at least some of the described functions. In the case where the hardware is a processor that can be considered to be a type of circuitry, a circuitry, a unit, a means, or the like is a combination of hardware and software, and the software is used to configure the hardware and / or the processor.

[0018] A first aspect of an ophthalmologic apparatus according to a non-limiting embodiment includes an imaging unit, a movement mechanism, an image analysis unit, a pupil diameter data acquisition unit, a control amount determination unit, and a movement control unit.

[0019] The photographing section is an element for photographing the fundus of the subject's eye, and includes an illumination optical system and a photographing optical system.

[0020] The illumination optical system is an element for illuminating the fundus of the subject's eye, and is configured to project illumination light from a light source onto the fundus of the subject's eye via an optical scanner.

[0021] The light source may be an element of the imaging part (illumination optics) or an external light source, in which case the light generated by the external light source is input to the illumination optics through a light guide (e.g., fiber optics and / or bulk optics).

[0022] The optical scanner is an element of the illumination optical system, and is configured to change the traveling direction of the illumination light.

[0023] The photographing optical system detects return light of the illumination light projected onto the fundus of the subject's eye by the illumination optical system with a first image sensor operable in a rolling shutter mode.

[0024] The return light of the illumination light includes reflected light and scattered light of the illumination light applied to the subject's eye, and is light that is incident on the imaging section (imaging optical system).

[0025] The first image sensor is an element of the photographing section (photographing optical system). The operation mode (control mode) of the first image sensor may be only the rolling shutter mode, or may be the rolling shutter mode and another mode. An example of the other mode is a global reset release shutter mode. The rolling shutter mode and the global reset release shutter mode will be described later. In another example, the first image sensor may be an imaging unit that combines a global shutter type image sensor and a slit diaphragm. The slit diaphragm may be configured mechanically and / or electronically.

[0026] The moving mechanism is configured to move the imaging unit. The portion of the imaging unit moved by the moving mechanism may be the entire imaging unit, or only a part of the imaging unit.

[0027] The image analysis unit is configured to analyze an image of the fundus of the subject's eye to obtain a value of a predetermined brightness parameter. The function of the image analysis unit is realized, for example, by cooperation between hardware including a processor and software including a program for causing the processor to execute image analysis processing.

[0028] In some examples, the image analyzed by the image analysis unit may be an image acquired using an imaging method other than the rolling shutter method, and specific examples of this include an image acquired by applying a slit scan in global reset release shutter mode to the fundus of the test eye, or an image acquired by applying imaging using a global shutter type image sensor to the fundus of the test eye.

[0029] If the first image sensor of the photographing optical system is capable of operating in global reset release shutter mode, an image of the fundus of the test eye acquired by slit scanning in global reset release shutter mode using the first image sensor may be provided to the image analysis unit, or an image of the fundus of the test eye acquired by slit scanning in global reset release shutter mode using another rolling shutter type image sensor or an image of the fundus of the test eye acquired by photographing using another global shutter type image sensor may be provided to the image analysis unit.

[0030] On the other hand, when the first image sensor of the photographing optical system cannot operate in the global reset release shutter mode, an image of the fundus of the test eye acquired by slit scanning in the global reset release shutter mode using another rolling shutter type image sensor, or an image of the fundus of the test eye acquired by photographing using another global shutter type image sensor is provided to the image analysis unit.

[0031] The luminance parameter (type of parameter) obtained by the image analysis unit is, for example, determined in advance. In some aspects, the luminance parameter may be a parameter (corneal reflection parameter) related to the corneal reflection light of the illumination light projected onto the subject's eye.

[0032] Examples of corneal reflection parameters obtained from an image of the fundus of the test eye include parameters obtained from luminance information of the image (e.g., a luminance histogram) (e.g., maximum luminance, luminance distribution, the number of pixels having a luminance value equal to or greater than a threshold, etc.), parameters obtained from luminance information of a partial region of the image (e.g., a luminance histogram) (e.g., maximum luminance, luminance distribution, the number of pixels having a luminance value equal to or greater than a threshold, etc.), and parameters indicating the appearance of a partial region of the image (e.g., shape, dimensions, position, etc.).

[0033] The partial region may be, for example, a high-luminance region in the image. The high-luminance region is, for example, an image region that is estimated to be an image of corneal reflected light, and is identified by a predetermined segmentation method (for example, threshold processing on luminance).

[0034] Although some examples of brightness parameters are described in this disclosure, the applicable brightness parameters are not limited to these and may be any brightness parameter that can be used to determine the value (control amount) of a parameter for controlling the distance between the test eye and the imaging unit.

[0035] The pupil diameter data acquisition unit is configured to acquire measurement data (pupil diameter data) of the pupil diameter of the subject's eye.

[0036] The method of acquiring pupil diameter data of the subject's eye may be any predetermined method. The pupil diameter data acquisition unit in some examples may include a pupil diameter calculation unit that calculates the pupil diameter by analyzing an anterior segment image generated by photographing the anterior segment of the subject's eye by the ophthalmic device. Also, the pupil diameter data acquisition unit in some examples may include a pupil diameter calculation unit that calculates the pupil diameter by analyzing an anterior segment image acquired by photographing the anterior segment of the subject's eye by another ophthalmic device.

[0037] The functions of these pupil diameter calculation units are realized, for example, by cooperation between hardware including a processor and software including a program for causing the processor to execute the pupil diameter calculation process.

[0038] Various methods are known for calculating the pupil diameter from an anterior eye image, including, for example, methods that utilize threshold processing, edge detection, pattern matching, segmentation, and the like.

[0039] Another method for acquiring pupil diameter data of the subject's eye is to input the pupil diameter data acquired by another ophthalmic apparatus to the ophthalmic apparatus by accepting the pupil diameter data. In this case, the pupil diameter data acquisition unit includes a data accepting unit configured to accept the pupil diameter data. In some examples, the data accepting unit may include a communication device that accepts the pupil diameter data of the subject's eye through a communication line.

[0040] In addition, in some examples, the data receiving unit may include a data reader device that reads out the pupil diameter data of the subject's eye recorded in a recording medium from the recording medium.

[0041] In a typical example, the pupil diameter data acquisition unit acquires actual measurement data of the pupil diameter of the subject eye. However, when it can be assumed that the pupil diameter of the subject eye and the pupil diameter of the fellow eye are substantially equal, the pupil diameter data of the fellow eye of the subject eye may be acquired and used as the pupil diameter data of the subject eye.

[0042] The control amount determination unit is configured to determine a control amount of the distance between the subject's eye and the photographing unit based on the value of the brightness parameter calculated from the image of the fundus of the subject's eye by the image analysis unit and the pupil diameter data of the subject's eye acquired by the pupil diameter data acquisition unit. The function of the control amount determination unit is realized, for example, by cooperation between hardware including a processor and software including a program for causing the processor to execute a control amount determination process.

[0043] The distance between the subject's eye and the photographing unit is typically defined as the distance between the subject's eye and a specific member arranged at the front (closest to the subject's eye) of the members constituting the optical system included in the photographing unit. In a typical example, this specific member is an objective lens, and the distance between the subject's eye and the photographing unit is defined as the distance between the front surface of the objective lens (the surface close to the subject's eye) and the subject's eye. Note that the distance corresponding to the control amount determined by the control amount determination unit is not limited to the distance in such a typical example, and may be any distance representing the distance between the subject's eye and the photographing unit.

[0044] A well-known parameter that indicates the distance between the subject's eye and an imaging unit is the working distance (WD). The working distance is the distance between the subject's eye and an ophthalmic device (optical system) that must be achieved in order for the ophthalmic device to acquire data (photograph, measure, etc.) of the subject's eye, and is preset as a value specific to each ophthalmic device (predefined value, default value). The working distance is determined based on the configuration of the optical system, the part of the subject's eye that is the subject of data acquisition, and the like. In general, the positioning operation between the subject's eye and the ophthalmic device is called alignment, and in particular, the operation for matching the distance between the subject's eye and the ophthalmic device to the working distance is called Z alignment.

[0045] The control amount determined by the control amount determination unit may be a value (amount) of any parameter that can be used to control the distance between the subject's eye and the imaging unit. In some examples, the control amount may be a value of a physical distance (a value of a distance in real space). This value of the physical distance may be the distance between the subject's eye and the imaging unit, or may be a change from the current distance between the subject's eye and the imaging unit (a movement distance from a current position). In some examples, the control amount may be a parameter value (such as a voltage value, a current value, or a pulse number) of a control signal applied to an element (in this embodiment, a movement mechanism) for changing the distance between the subject's eye and the imaging unit. The control amount may be a scalar value or a vector value.

[0046] In some examples, the control amount may include position information. For example, the control amount may include information indicating a position of the image capture unit corresponding to the physical distance in addition to or instead of the physical distance value.

[0047] The movement control unit is configured to control the movement mechanism based on the control amount determined by the control amount determination unit. This makes it possible to move the imaging unit according to the control amount, and in particular, to change (adjust) the distance between the subject's eye and the imaging unit according to the control amount. The function of the movement control unit is realized, for example, by cooperation between hardware including a processor and software including a program for causing the processor to execute a movement control process.

[0048] In some examples, the control amount includes a value of the distance between the subject's eye and the imaging unit (target distance value), and the movement control unit controls the movement mechanism so that the distance between the subject's eye and the imaging unit matches this target distance value. In some examples, the control amount includes a movement distance from a current position between the subject's eye and the imaging unit, and the movement control unit controls the movement mechanism so as to move the imaging unit by this movement distance. In some examples, the control amount includes a parameter value of a control signal applied to the movement mechanism, and the movement control unit controls the movement mechanism by generating a control signal corresponding to this parameter value and applying it to the movement mechanism.

[0049] Flare is an artifact that occurs in an image due to the return light from the subject's eye (especially the corneal reflected light having a relatively high brightness). Conditions that affect the occurrence and degree of flare include the intensity of the illumination light and the distance between the subject's eye and the imaging unit.

[0050] According to the first aspect, the distance between the subject's eye and the imaging unit can be automatically adjusted based on the brightness parameter value calculated from the image of the fundus of the subject's eye and the pupil diameter data of the subject's eye. After this automatic adjustment, the fundus of the subject's eye can be photographed using the rolling shutter mode. This makes it possible to provide an image without flare by fundus photography using the slit scan method.

[0051] The expression "image without flare" includes not only an image that does not contain any flare at all, but also an image that contains a low level of flare, an image in which the level of flare has been reduced, and an image in which the influence of flare is small from the viewpoint of image diagnosis.

[0052] In conventional techniques aimed at eliminating or reducing flare, the amount of illumination light (illumination intensity) is generally controlled. In contrast, in the first aspect, the object is achieved by controlling the distance between the subject's eye and the imaging unit. This makes it possible to generate an image of the subject's eye without flare, without extending the light reception time (exposure time, imaging time) by the image sensor, and therefore without increasing the possibility of fixational eye movement occurring during imaging of the subject's eye.

[0053] Furthermore, according to the first aspect, since the control of the distance between the subject's eye and the photographing unit is configured to be executed, there is no need to execute the condition control described in Patent Document 2 (specifically, control of the light flux limiting member of the illumination optical system, control of the light flux limiting member of the photographing optical system, control of the illumination light amount, control of the photographing time). Therefore, there are no problems associated with the control of the light flux limiting member (e.g., reduction in the amount of illumination light projected onto the fundus, reduction in the amount of return light projected onto the image sensor, etc.), problems associated with reduction in the illumination light amount (e.g., extension of the photographing time, etc.), or problems associated with extension of the photographing time (e.g., reduction in image quality caused by fixational eye movement, etc.).

[0054] In addition, the technology described in Patent Document 3 is characterized in that when the subject's eye is determined to have a small pupil based on the flare dimension, the target position of the alignment in the XY directions is automatically adjusted, while the alignment in the Z direction is performed by a well-known method that refers to a split image of the anterior eye image. In contrast, the first aspect is configured to automatically perform the alignment in the Z direction based on the value of the luminance parameter and the pupil diameter data, and is clearly different from the technology described in Patent Document 3.

[0055] Although the first aspect is characterized by controlling the distance between the subject's eye and the photographing unit, it is not intended to prohibit the execution of other controls. Some examples may be configured to execute other controls (e.g., control of a light flux limiting member of an illumination optical system, control of a light flux limiting member of an imaging optical system, control of an illumination light amount, control of imaging time, and one or more controls other than these) in addition to the control of the distance between the subject's eye and the imaging unit.

[0056] In addition, some examples may be configured to selectively execute control of the distance between the subject's eye and the imaging unit and another control. The selection of the control may be performed by a user or automatically based on the state of the subject's eye or the state of the image.

[0057] A second aspect of the ophthalmic apparatus according to a non-limiting embodiment may include the features described below in addition to the first aspect described above.

[0058] The illumination optical system of this embodiment is configured to project infrared illumination light onto the fundus of the subject's eye. Some examples of the illumination optical system include a light source (infrared light source) that emits light in the infrared range. Some examples of the illumination optical system include a light source (e.g., a white light source) that emits light in a wavelength range including the infrared range, and a filter that transmits the infrared component of this light.

[0059] The first image sensor of the present embodiment is configured to be able to operate in a global reset release shutter mode in addition to the rolling shutter mode. In some examples, the first image sensor is a rolling shutter camera with a global reset release shutter function.

[0060] The photographing unit of this embodiment is configured to acquire an infrared image (first infrared image) of the fundus of the test eye using infrared illumination light projected onto the fundus of the test eye by an illumination optical system and slit scanning in a global reset release shutter mode using a first image sensor.

[0061] The image analysis unit of this embodiment is configured to analyze a first infrared image of the fundus of the subject's eye acquired by slit scanning in the global reset release shutter mode, and to determine the value of a predetermined brightness parameter.

[0062] According to the second aspect, both fundus photography for determining the value of the brightness parameter (slit scan in global reset release shutter mode) and photography for obtaining a fundus image used for diagnosis or the like (slit scan in rolling shutter mode) can be performed by a single image sensor (first image sensor). This makes it possible to simplify the configuration of the optical system. Typically, slit scan in global reset release shutter mode is performed using infrared illumination light, and slit scan in rolling shutter mode is performed using visible illumination light. Thus, the first image sensor has sensitivity in both the infrared wavelength range and the visible wavelength range.

[0063] A third aspect of the ophthalmic apparatus according to a non-limiting embodiment may include the features described below in addition to the second aspect described above.

[0064] The optical scanner of this embodiment is configured to move the projection position of the infrared illumination light projected onto the fundus of the subject's eye by the illumination optical system. That is, the optical scanner of this embodiment is one of the elements for realizing slit scanning of the fundus using the infrared illumination light, and may be any type of optical deflection device, such as a galvanometer scanner, a MEMS scanner, or a resonant scanner.

[0065] It is known that an image obtained by slit scanning in the global reset release shutter mode may have flare in (at least) two places, similar to the flare that occurs in an image obtained by a global shutter camera. In slit scanning in the global reset release shutter mode, when the illumination light is moved in the vertical direction (Y direction), typically, flare occurs in the upper and lower regions of the obtained image. Also, in slit scanning in the global reset release shutter mode, when the illumination light is moved in the horizontal direction (X direction), typically, flare occurs in the left and right regions of the obtained image.

[0066] In this way, in a typical image obtained by slit scanning in the global reset release shutter mode, a first flare occurs on the origin side (starting point side of movement) of the moving illumination light, and a second flare occurs on the end side (end point side of movement). The positional relationship between the first flare and the second flare is relative. The first flare occurs closer to the origin side of movement than the second flare, and conversely, the second flare occurs closer to the end point of movement than the first flare. Also, the first flare occurs at a position closer to the origin side of movement with respect to the center position of the movement range, and the second flare occurs at a position closer to the end point of movement with respect to the center position of the movement range.

[0067] The photographing unit of this embodiment is configured to execute slit scan in the global reset release shutter mode at the timing when the first infrared image depicting both the first flare (first high luminance area) occurring on the movement start side of the infrared illumination light and the second flare (second high luminance area) occurring on the movement end side is acquired. An example of a method for determining this timing will be described later.

[0068] According to the third aspect, an image depicting both types of flares can be acquired by one slit scan in the global reset release shutter mode, so that it is possible to obtain abundant and rapid information on the flare occurring in the image.

[0069] A fourth aspect of the ophthalmologic apparatus according to a non-limiting embodiment may include the following features in addition to any one of the first to third aspects described above.

[0070] As in the second and third aspects, the illumination optical system of this aspect is configured to be capable of projecting infrared illumination light onto the fundus of the subject's eye.

[0071] The imaging optical system of this embodiment includes a first image sensor operable in rolling shutter mode, as well as a second image sensor of a global shutter type.

[0072] In some examples, the imaging optical system includes an optical path splitting element (beam splitter) that splits the optical path of the return light into a first branched optical path and a second branched optical path, and the first image sensor is disposed in the first branched optical path and the second image sensor is disposed in the second branched optical path.

[0073] Typically, the slit scan in the global reset release shutter mode is performed using infrared illumination light, and the slit scan in the rolling shutter mode is performed using visible illumination light, so that the first image sensor has sensitivity in the visible wavelength range and the second image sensor has sensitivity in the infrared wavelength range.

[0074] The optical path splitting element is configured to guide light in the visible wavelength range to the first optical path and light in the infrared wavelength range to the second optical path. This optical path splitting element is, for example, a dichroic mirror. If a reduction in the amount of light is acceptable, a half mirror can be used as this optical path splitting element. In some examples, a polarizing beam splitter can be used that utilizes the polarization characteristics of the return light to separate light in the infrared wavelength range and light in the visible wavelength range.

[0075] The photographing unit of this embodiment is configured to obtain an infrared image (second infrared image) of the fundus of the subject's eye by using infrared illumination light projected onto the fundus of the subject's eye by an illumination optical system and a second image sensor of a global shutter type. The photographing method for obtaining the second infrared image is the same as that of infrared fundus photography by a general fundus camera (including a global shutter type camera).

[0076] The image analysis unit of this embodiment is configured to analyze a second infrared image acquired by photographing using a second image sensor of a global shutter type to determine a value of a predetermined brightness parameter.

[0077] The fourth aspect is configured to perform both fundus photography (slit scan in global reset release shutter mode) for obtaining the value of the brightness parameter and fundus slit scanning (slit scan in rolling shutter mode) using separate image sensors. Therefore, it is possible to switch between these two types of photography methods by simple control (for example, switching the wavelength range of the illumination light).

[0078] A fifth aspect of an ophthalmologic apparatus according to a non-limiting embodiment may include the features described below in addition to any one of the above first to fourth aspects.

[0079] The image analysis unit of this embodiment is configured to determine, as a value of a predetermined brightness parameter, the maximum brightness value in the image of the fundus of the test eye and / or the value of a parameter indicating the appearance of a high brightness area in the image of the fundus of the test eye.

[0080] The fifth aspect provides some examples of values ​​of brightness parameters obtained by the image analysis unit. Examples of types of brightness parameters provided by this aspect include the value of the brightest pixel in the image (the brightness of the brightest position in the flare), the shape, size, and position of the image area (high brightness area) identified as a flare, etc.

[0081] By using the brightness parameters according to this embodiment, it is possible to grasp the characteristics and properties of the flare depicted in the image of the subject's eye, and it is possible to suitably control the distance between the subject's eye and the imaging unit. Note that the types of brightness parameters provided by this embodiment are not limited to the examples given here.

[0082] A sixth aspect of the ophthalmologic apparatus according to a non-limiting embodiment may include the following features in addition to any one of the above first to fifth aspects.

[0083] The control amount determination unit of this embodiment is configured to compare the value of the brightness parameter determined by the image analysis unit with a predetermined first threshold value (brightness threshold value), and determine the control amount of the distance between the test eye and the imaging unit based on the result of this comparison.

[0084] The luminance threshold may be a predetermined value (default value). In some examples, a plurality of luminance thresholds are prepared in advance and selectively used in each process. The plurality of luminance thresholds may be determined based on, for example, attributes of the subject (e.g., age, sex, race, medical history, etc.) and attributes of the subject's eye (e.g., pupil size, iris color, medical history, etc.).

[0085] In some examples, the luminance threshold is determined when the fundus is photographed. The luminance threshold may be determined based on, for example, attributes of the subject, attributes of the subject's eye, and the state of the image of the fundus of the subject's eye. The state of the image of the fundus of the subject's eye may be, for example, the state of luminance in the entire image (statistics of luminance, luminance distribution, noise, etc.) or the state of luminance in a specific region of the image.

[0086] According to the sixth aspect, it is possible to change the control of the distance between the subject's eye and the imaging unit based on a specific criterion (brightness threshold). Some examples of this will be described below.

[0087] A seventh aspect of an ophthalmic apparatus according to a non-limiting embodiment may include the following features in addition to the sixth aspect described above.

[0088] The movement control unit of this aspect is configured to execute control of the movement mechanism for adjusting the relative position of the imaging unit with respect to the subject's eye before the image of the fundus of the subject's eye to be provided to the image analysis unit is acquired. That is, in this aspect, after the imaging unit is aligned with the subject's eye, the image of the fundus of the subject's eye to be analyzed by the image analysis unit is acquired.

[0089] The alignment performed before acquiring an image of the fundus of the subject's eye includes at least alignment and may further include tracking. This alignment is typically three-dimensional alignment (XY alignment and Z alignment). Tracking is a combined operation of detecting the positional relationship between the fundus and the imaging unit and adjusting the relative position based on the result of this detection, which is performed to maintain the relative position (proper alignment state) between the fundus of the subject's eye and the imaging unit achieved by the alignment.

[0090] The control amount determination unit of this embodiment is configured to compare the value of the brightness parameter determined by the image analysis unit with a brightness threshold, and execute a process of determining the control amount only if the value of the brightness parameter is greater than or equal to the brightness threshold.

[0091] In the seventh aspect having such a configuration, only when it is determined that the flare depicted in the image of the fundus of the subject's eye is strong (i.e., the flare strength is not within the allowable range), the control amount is determined and the distance between the subject's eye and the imaging unit is controlled based on this control amount. According to this aspect, when it is required to remove or reduce the flare, the distance between the subject's eye and the imaging unit is adjusted for the purpose of removing or reducing the flare. This makes it possible to obtain an image without flare by performing fundus photography using the slit scan method after this distance adjustment.

[0092] On the other hand, when the value of the brightness parameter is less than the brightness threshold value, in other words, when it is determined that the flare depicted in the image of the fundus of the test eye is not strong (i.e., the strength of the flare is within the allowable range), the control amount is not determined, and therefore, the distance adjustment between the test eye and the imaging unit for the purpose of removing or reducing the flare is not performed. As a result, when it is considered that removing or reducing the flare is not important from the viewpoint of image diagnosis, this distance adjustment is skipped and the process moves to fundus photography using the slit scan method. This makes it possible to speed up the examination and shorten the time.

[0093] As described above, according to the seventh aspect, it is possible to improve the quality of the examination by eliminating or reducing the flare, and also to reduce the labor required for the examination and improve the throughput by speeding up or shortening the time required for the examination. These effects achieved by this aspect are useful in actual medical practice.

[0094] An eighth aspect of an ophthalmic apparatus according to a non-limiting embodiment may include the features described below in addition to the sixth or seventh aspect described above.

[0095] The ophthalmologic apparatus of this aspect further includes a luminance threshold determination unit. The luminance threshold determination unit has a function of determining a luminance threshold to be compared with the value of the luminance parameter determined by the image analysis unit. The luminance threshold determined by the luminance threshold determination unit is provided to the control amount determination unit and used in a comparison process with the value of the luminance parameter.

[0096] In the series of processes performed in this embodiment to determine the brightness threshold, first, a fundus image data set is prepared. The fundus image data set is a data set including a plurality of fundus images.

[0097] The type of fundus image included in the fundus image dataset may be arbitrary. Some examples of the fundus image dataset may include an image (biological fundus image) obtained by photographing the fundus of a living eye. The biological fundus image may be anonymized. Some examples of the fundus image dataset may include a processed fundus image obtained by processing the biological fundus image. The processed fundus image may be anonymized. Some examples of the fundus image dataset may include a fundus image (virtual fundus image) generated using computer technology such as computer graphics or generative artificial intelligence.

[0098] The fundus image dataset may include fundus images having specific attributes. For example, the fundus image dataset may include any of fundus images of eyes diagnosed (by a doctor and / or a computer) as normal eyes (healthy eyes), fundus images of eyes diagnosed as not having a specific disease, fundus images of eyes diagnosed as having a specific disease, and fundus images of eyes diagnosed as having some disease. The attributes of the fundus images may also include attributes of the subject (e.g., age, sex, race, medical history, etc.) and attributes of the subject's eye (e.g., pupil size, iris color, medical history, etc.). When the fundus image dataset includes two or more sub-datasets corresponding to two or more attributes, respectively, the brightness threshold determination unit may be configured to determine two or more brightness thresholds corresponding to the two or more sub-datasets, respectively.

[0099] The fundus image data set thus prepared is provided to a brightness threshold determination unit configured to obtain a maximum brightness value distribution of the fundus image data set and determine a brightness threshold based on the maximum brightness value distribution. The maximum brightness value distribution is distribution information generated based on the maximum brightness values ​​of a plurality of fundus images included in the fundus image data set.

[0100] In some examples, the brightness threshold determiner identifies a maximum brightness value in each of the plurality of fundus images included in the fundus image dataset, thereby obtaining a plurality of maximum brightness values ​​respectively corresponding to the plurality of fundus images included in the fundus image dataset.

[0101] The brightness threshold determiner of the present example then determines a statistical representation of the obtained maximum brightness values. This statistical representation may take any form, such as a histogram, a graph, a map, etc. The determined statistical representation is the maximum brightness value distribution.

[0102] The brightness threshold determination unit of this example determines the brightness threshold based on the determined maximum brightness value distribution. Any method may be used to determine the brightness threshold from the maximum brightness value distribution, and for example, a predetermined calculation process (e.g., statistical calculation) is applied to the maximum brightness value distribution. This calculation process may include a process of comparing a group of maximum brightness values ​​of fundus images with flare (or strong flare) with a group of maximum brightness values ​​of fundus images without flare (or weak flare). An example of the process of determining the brightness threshold will be described later.

[0103] The control amount determination unit of this embodiment is configured to compare the brightness threshold value thus determined with the value of the brightness parameter calculated by the image analysis unit, and to determine the control amount based on the result of this comparison.

[0104] According to the eighth aspect, an example for determining the luminance threshold can be provided, and a good quality luminance threshold can be provided by a statistical approach based on a fundus image data set.

[0105] In addition, by preparing multiple brightness thresholds corresponding to multiple attributes, selecting a brightness threshold according to the state of the test eye, and using the selected brightness threshold, it is possible to improve the quality of the control amount determination process.

[0106] A ninth aspect of an ophthalmic apparatus according to a non-limiting embodiment may include the following features in addition to the eighth aspect described above.

[0107] The brightness threshold determination unit of this embodiment is configured to calculate a weighted F value (Fβ score) of the maximum brightness value distribution obtained from the fundus image data set, and determine a brightness threshold based on this Fβ score. An example of the processing content executed in this embodiment will be described later.

[0108] The ninth aspect provides a preferred example of a statistical method for determining the luminance threshold.

[0109] A tenth aspect of an ophthalmic apparatus according to a non-limiting embodiment may include the features described below in addition to the eighth or ninth aspect described above.

[0110] The brightness threshold determining unit of this embodiment is configured to determine at least two brightness thresholds based on a maximum brightness value distribution determined from the fundus image data set.

[0111] The luminance threshold determiner in some examples may be configured to determine at least two luminance thresholds respectively corresponding to the at least two attributes, as described above.

[0112] The brightness threshold determination unit in some examples may be configured to determine at least two brightness thresholds according to the flare detection level. For example, when three stages are set as the degree of sensitivity of the flare detection (flare detection sensitivity), the brightness threshold determination unit can determine a brightness threshold for high sensitivity detection, a brightness threshold for medium sensitivity detection, and a brightness threshold for low sensitivity detection based on the maximum brightness value distribution obtained from the fundus image data set.

[0113] The control amount determination unit of this embodiment is configured to select one brightness threshold from the at least two brightness thresholds determined by the brightness threshold determination unit, compare the value of the brightness parameter determined by the image analysis unit with the selected brightness threshold, and determine the control amount based on the result of this comparison.

[0114] According to the tenth aspect, a desired luminance threshold can be selected from a plurality of prepared luminance thresholds, so that flare removal or flare reduction can be performed according to the user's request or the requirements of the examination contents. An example of the processing contents executed in this aspect will be described later.

[0115] An eleventh aspect of an ophthalmic apparatus according to a non-limiting embodiment may include the following features in addition to any one of the above first to tenth aspects.

[0116] The control amount determining unit of this embodiment is configured to determine the control amount based on the magnitude of the pupil diameter data value acquired by the pupil diameter data acquiring unit. That is, in this embodiment, the content of the control of the distance between the subject's eye and the imaging unit is determined according to at least the size of the pupil of the subject's eye. The configuration of this embodiment is made in consideration of the fact that the presence or absence and the degree of flare are affected by the size of the pupil.

[0117] Non-limiting examples of such an eleventh aspect include a twelfth aspect and thirteenth to fifteenth aspects.

[0118] In a twelfth aspect, the control amount determination unit is configured to determine the control amount based on the magnitude of the pupil diameter data value acquired by the pupil diameter data acquisition unit so that the reduction in the peripheral light amount of the illumination light projected onto the fundus of the subject's eye by the illumination optical system becomes equal to or less than a second predetermined threshold (peripheral light amount threshold). The configuration of the twelfth aspect is made in consideration of the fact that the change in the peripheral light amount of the illumination light accompanying the change in the distance between the subject's eye and the imaging unit depends on the pupil diameter of the subject's eye.

[0119] The amount representing the reduction in peripheral light intensity evaluated by the control amount determination unit of this embodiment may be any physical amount, for example, the amount of reduction or the reduction rate. The amount of reduction is the amount of change relative to a reference value of peripheral light intensity. The reduction rate is the ratio of the amount of reduction relative to the reference value of peripheral light intensity. The reference value of peripheral light intensity may be, for example, the value of peripheral light intensity in an image of the fundus of the test eye provided to the image analysis unit, and is calculated by the control amount determination unit (or the image analysis unit or another element) analyzing the image. The amount of change in peripheral light intensity is, for example, the amount of change from the value of peripheral light intensity in an image of the fundus of the test eye.

[0120] According to the 12th aspect, it is possible to control the distance between the test eye and the imaging unit so that an image of acceptable brightness is obtained by slit scanning performed after controlling the distance between the test eye and the imaging unit.

[0121] In a thirteenth aspect, control amount information is prepared in advance. The control amount information includes a correspondence relationship between a pupil diameter value and a control amount. This correspondence relationship may be, for example, a correspondence relationship between a range (a numerical range) of the pupil diameter value and the control amount.

[0122] In some examples of control amount information, a control amount value is assigned to each of two or more ranges of pupil diameter values. In this control amount information, for example, a first control amount to a Kth control amount are assigned to a first pupil diameter value range to a Kth pupil diameter value range, respectively (K is an integer of 2 or more). Such control amount information defines a discrete correspondence between pupil diameter values ​​and control amounts. The discrete correspondence may take any form, and may be, for example, a table or a graph.

[0123] In some examples, the control amount information defines a continuous correspondence between the pupil diameter value and the control amount, and may be, for example, a graph or a formula expressing the relationship between the pupil diameter value and the control amount.

[0124] The control amount determination unit, for example, selects a value corresponding to a value (pupil diameter value) indicated by the pupil diameter data of the subject's eye from among a plurality of values ​​of the control amount included in the control amount information. More generally, the control amount determination unit applies a value (pupil diameter value) indicated by the pupil diameter data of the subject's eye to the control amount information, thereby determining a control amount corresponding to the subject's eye. The process of applying the pupil diameter value to the control amount information may include, for example, a process of calculating a control amount by substituting the pupil diameter value into a formula, a process of determining a control amount corresponding to the pupil diameter value from a table or graph, etc.

[0125] The movement control unit of this embodiment controls the movement mechanism to adjust the distance between the test eye and the imaging unit, based on the value of the control amount obtained by the control amount determination unit from the control amount information, for example by any of the processes described above.

[0126] According to the thirteenth aspect, it is possible to provide an example of a process for determining a control amount for adjusting the distance between the subject's eye and the imaging unit. By improving the quality of the control amount information, it is possible to improve the quality (accuracy, precision, repeatability, etc.) of the distance adjustment between the subject's eye and the imaging unit according to the size of the pupil.

[0127] The control amount information used in the thirteenth aspect may be generated by an apparatus or system other than the ophthalmic apparatus according to the embodiment, but the ophthalmic apparatus according to the embodiment may have a function for generating the control amount information. The fourteenth aspect provides an example of an ophthalmic apparatus having a function for generating the control amount information.

[0128] An ophthalmologic apparatus according to a fourteenth aspect includes a control amount information generating unit. The control amount information generating unit is configured to generate control amount information based on, for example, one or more pieces of information (1) to (4) shown below: (1) a distance between the eye and the imaging unit; (2) a reduction in the peripheral light amount of the illumination light (for example, a reduction amount or a reduction rate); (3) a probability that a high-luminance area occurs in a fundus image; and (4) a pupil diameter value.

[0129] In this disclosure, a case where control amount information is generated based on the relationships between these four pieces of information (1) to (4) will be described in detail later. The relationships between the pieces of information (1) to (4) can be obtained by actual measurements and / or calculations (computer simulations such as ray tracing). Note that a person skilled in the art would be able to understand from the description of this case that the embodiment is not limited to this case.

[0130] According to the fourteenth aspect, it is possible to provide an example of a process for generating control amount information, and to provide good quality control amount information based on any of the four pieces of information (1) to (4).

[0131] The fifteenth aspect provides an example of the above case in which control amount information is generated based on the relationship between the four pieces of information (1) to (4). In this aspect, control amount information is generated in which values ​​of the control amount corresponding to two or more ranges of pupil diameter values ​​are recorded.

[0132] First, two or more ranges of pupil diameter values ​​are set. These ranges may be set based on standard classifications of pupil diameters, or may be set based on clinical data, etc. The control amount information generating unit of this embodiment is configured to determine the value of the control amount to be assigned to each of the two or more ranges of pupil diameter values ​​such that the reduction in the peripheral light amount of the illumination light is equal to or less than a second predetermined threshold value (peripheral light amount threshold value).

[0133] As in the twelfth aspect, the fifteenth aspect is configured in consideration of the fact that the change in the peripheral light amount of the illumination light caused by the change in the distance between the subject's eye and the photographing unit depends on the pupil diameter of the subject's eye. Any of the matters related to the twelfth aspect can be applied to the fifteenth aspect. An example of this aspect will be described later.

[0134] According to the fifteenth aspect, it is possible to control the distance between the test eye and the imaging unit so that an image of acceptable brightness is obtained by slit scanning performed after controlling the distance between the test eye and the imaging unit.

[0135] A sixteenth aspect of the ophthalmologic apparatus according to a non-limiting embodiment may include the following features in addition to any one of the first to fifteenth aspects described above.

[0136] The control amount determination unit of this embodiment is configured to determine whether or not to execute a process for determining a control amount for adjusting the distance between the subject's eye and the imaging unit, based on the value of the brightness parameter obtained by the image analysis unit. For example, similar to the seventh embodiment, the control amount determination unit of this embodiment may be configured to compare the value of the brightness parameter obtained by the image analysis unit with a predetermined threshold, and determine to execute the process for determining the control amount when the value of the brightness parameter is equal to or greater than the threshold, and determine not to execute the process for determining the control amount when the value of the brightness parameter is less than the threshold.

[0137] When it is determined that the process of determining the control amount is to be executed, the control amount determination unit of this embodiment is configured to determine the control amount based on the pupil diameter data acquired by the pupil diameter data acquisition unit. The method of determining the control amount based on the pupil diameter data may be, for example, any of the methods described in the eleventh to fifteenth embodiments, another method described in the present disclosure, or a method other than these.

[0138] According to the 16th aspect, an example of the operation of the 1st to 15th aspects can be provided. This operation example is to determine whether or not to adjust the distance between the subject's eye and the imaging unit based on the value of the luminance parameter obtained by the image analysis unit. If it is determined that the distance adjustment is not to be performed, the process proceeds to slit scanning of the fundus of the subject's eye. If it is determined that the distance adjustment is to be performed, a control amount is determined based on the pupil diameter data acquired by the pupil diameter data acquisition unit, and the distance between the subject's eye and the imaging unit is adjusted by controlling the moving mechanism based on this control amount, and then a slit scan of the fundus of the subject's eye is performed.

[0139] A seventeenth aspect of the ophthalmologic apparatus according to a non-limiting embodiment may include the following features in addition to any one of the first to sixteenth aspects described above.

[0140] In this aspect, the movement control unit controls the movement mechanism based on the control amount determined by the control amount determination unit to expand the distance between the subject's eye and the imaging unit. This makes it possible to remove or reduce flare contained in the image (first image) of the fundus of the subject's eye analyzed by the image analysis unit to determine the control amount. In other words, no flare occurs in the image (second image) acquired by the slit scan performed after the distance is expanded, or the flare occurring in the second image is weaker (e.g., lower in brightness and / or smaller in size) than the flare in the first image. On the other hand, the brightness of the image may decrease as the distance between the subject's eye and the imaging unit is expanded to remove or reduce the flare, and a second image darker than the allowable range may be obtained. This aspect has been made with attention to such problems and has the following configuration.

[0141] The image analysis unit of this embodiment is configured to determine a new value of the brightness parameter by analyzing a new image of the fundus of the test eye obtained after the distance between the test eye and the imaging unit is increased by the movement control unit.

[0142] The brightness parameters may be of the same type as the brightness parameters determined from the first image, or may be of a different type, and the new image may be an image acquired by slit scanning or an image acquired by another modality (e.g., an image acquired by slit scanning in global reset release shutter mode, an image acquired by a global shutter type camera, etc.).

[0143] The control amount determination unit of this embodiment is configured to determine a new control amount for controlling the distance between the test eye and the imaging unit based on the new value of the brightness parameter obtained by analyzing this new image.

[0144] For example, the control amount determination unit determines the new control amount by comparing the new value of the brightness parameter with a predetermined value. The predetermined value to be compared with the new value of the brightness parameter may be a preset threshold value, the value of the brightness parameter determined from the first image, or another value.

[0145] This comparison process determines whether the new image has sufficient brightness. If it is determined that the new image has sufficient brightness, the operation according to this embodiment is terminated. In other words, the process of determining a new control amount is not executed. On the other hand, if it is determined that the new image does not have sufficient brightness, the control amount determination unit determines a new control amount for acquiring an image brighter than the new image. This new control amount is a value for reducing the distance between the subject's eye and the imaging unit. The movement control unit according to this embodiment controls the movement mechanism based on this new control amount.

[0146] According to the seventeenth aspect, when the brightness of an image obtained after the distance between the subject's eye and the imaging unit is enlarged for the purpose of removing or reducing flare is insufficient, the distance between the subject's eye and the imaging unit can be shortened so as to obtain a brighter image. There is a trade-off between the brightness of an image and the occurrence state of flare. The configuration and operation of the seventeenth aspect are designed to obtain a brighter image with a lower degree of flare, taking this trade-off into consideration.

[0147] Any feature of the present disclosure and / or any feature of the known art may be combined with the first to seventeenth aspects. An ophthalmic device obtained by such a combination further exhibits the action and effect of the combined features, as well as the synergistic action and effect of the combination of features.

[0148] Another aspect of the embodiment provides a method for determining a distance between an ophthalmic apparatus performing a slit scan and a test eye, the ophthalmic apparatus including an imaging unit configured to project illumination light from a light source onto a fundus of the test eye via an optical scanner and detect return light of the illumination light with an image sensor operable in a rolling shutter mode.

[0149] The method of this aspect is a method for determining the distance between the subject's eye and the photographing unit for fundus photography using this ophthalmic apparatus, and includes the following steps. In a first step, the computer acquires an image of the fundus of the subject's eye. In a second step, the computer analyzes the image of the fundus of the subject's eye acquired in the first step to determine a value of a predetermined brightness parameter. In a third step, the computer acquires pupil diameter data of the subject's eye. In a fourth step, the computer determines the distance between the subject's eye and the photographing unit based on the value of the brightness parameter determined in the second step and the pupil diameter data acquired in the third step. The ophthalmic apparatus can move the photographing unit so that the distance between the subject's eye and the photographing unit coincides with the distance determined in the fourth step.

[0150] The computer that executes the first to fourth steps may be a processor (and memory) included in the ophthalmic apparatus, or may be a device separate from the ophthalmic apparatus.

[0151] The first to fourth steps and the movement of the photographing unit based on the distance determined thereby correspond to the elements of the ophthalmic apparatus of the first aspect described above. Specifically, the first step corresponds to an element for acquiring the fundus of the subject's eye to be analyzed by the image analysis unit, the second step corresponds to the image analysis unit, the third step corresponds to the pupil diameter data acquisition unit, the fourth step corresponds to the control amount determination unit, and the movement of the photographing unit corresponds to the movement control unit.

[0152] According to the method of this aspect, like the ophthalmologic apparatus of the first aspect, it is possible to provide an image without flare by fundus photography using the slit scan method.

[0153] Any feature of the present disclosure (e.g., any feature related to the ophthalmic device according to the embodiment) and / or any feature related to the known art can be combined with the method according to the embodiment. The method obtained by such a combination further exhibits the action and effect of the combined features, as well as the synergistic action and effect of the combination of the features.

[0154] Another aspect of the embodiment provides a program for causing a computer to execute the method according to the embodiment. Also, another aspect of the embodiment provides a computer-readable non-transitory recording medium having the program according to the embodiment recorded thereon. The same effect can be achieved by these aspects. Note that the recording medium according to the embodiment may be a recording medium of any form, and may be, for example, any of a magnetic disk, an optical disk, a magneto-optical disk, and a semiconductor memory.

[0155] The aspects of the embodiments according to the present disclosure are not limited to an ophthalmic apparatus, a method for determining a fundus photographing distance, a program, and a storage medium. For example, a person skilled in the art would understand that the present disclosure provides an embodiment of a method for controlling an ophthalmic apparatus, an embodiment of a method for photographing a subject's eye, an embodiment of a method for processing ophthalmic information, and the like, and further provides similar embodiments in fields other than ophthalmology.

[0156] Exemplary embodiments A non-limiting example of the configuration of an ophthalmic apparatus according to an embodiment is shown in Fig. 1. The ophthalmic apparatus 1 of this example functions as an ophthalmic imaging apparatus capable of imaging the fundus of a living eye using a slit-scan type modality.

[0157] The ophthalmic apparatus 1 includes an imaging unit 2, a moving mechanism 3, a processor 4, a memory 5, and a user interface 6. Unless otherwise specified, the hardware elements included in the ophthalmic apparatus 1 may be similar to the hardware elements of an existing slit-scan type ophthalmic imaging apparatus.

[0158] The photographing unit 2 is configured to be capable of performing slit scanning by photographing the fundus of the subject's eye with a rolling shutter type image sensor (image pickup device) while moving the projection position of the slit light on the fundus of the subject's eye. In other words, the photographing unit 2 is configured to illuminate the fundus of the subject's eye while moving the irradiation position (irradiation range) of the slit-shaped illumination light (slit light), and to receive the return light from the fundus with an image sensor in which light receiving elements are arranged one-dimensionally or two-dimensionally.

[0159] Signals are read out from the image sensor that detects the return light under the control of the processor 4, and signals are read out sequentially from the light receiving elements at the return light receiving positions corresponding to the respective irradiation positions of the slit light in synchronization with the timing of the movement of the irradiation position of the slit light. This signal reading is performed by a rolling shutter method. A non-limiting example of the specific configuration of the imaging unit 2 will be described later.

[0160] The image sensor provided in the ophthalmic apparatus 1 is operable at least in the rolling shutter mode. Image sensors of some embodiments may be operable in the rolling shutter mode and the global reset release shutter mode.

[0161] In some embodiments, by using an imaging unit (imaging device) that combines a global shutter image sensor and a mechanically or electronically configured slit diaphragm instead of a rolling shutter image sensor, it is possible to perform a shooting operation similar to that of a rolling shutter image sensor. The shooting operation of this embodiment is an example of slit scanning in the rolling shutter mode.

[0162] The photographing unit 2 includes a hardware element (focus adjustment unit) for performing focus adjustment (focusing) of the optical system provided in the photographing unit 2. Any method of focus adjustment may be used. For example, focus adjustment may be performed using a configuration that changes the focal length (position of the focal point) of a lens disposed between the subject (fundus of the subject's eye) and an image sensor, or focus adjustment may be performed using a configuration that changes the distance between the lens and the image sensor.

[0163] The moving mechanism 3 is configured to move the imaging unit 2. The moving mechanism 3 is configured to move the imaging unit 2 three-dimensionally under the control of the processor 4, and includes, for example, a mechanism for moving a stage on which the imaging unit 2 is mounted in the X direction, a mechanism for moving it in the Y direction, and a mechanism for moving it in the Z direction. Each mechanism includes an actuator (for example, a stepping motor) that operates under the control of the processor 4.

[0164] The processor 4 realizes the functions according to this embodiment by executing processes in accordance with programs stored in the memory 5 and / or other storage devices.

[0165] The memory 5 stores various computer programs and various data. In a typical embodiment, the memory 5 includes a non-volatile memory and a volatile memory.

[0166] The memory 5 stores control programs and / or control data for causing the ophthalmic device 1 to perform specified operations, and calculation programs and / or calculation data for causing the ophthalmic device 1 to perform specified calculation processing.

[0167] Further, data acquired by the ophthalmic apparatus 1 is stored in the memory 5. For example, data generated by the ophthalmic apparatus 1 and data acquired by the ophthalmic apparatus 1 from an external source are stored in the memory 5. The programs and data stored in the memory 5 are not limited to those exemplified here.

[0168] The user interface 6 is an element (hardware element, software element, protocol) for exchanging information between the ophthalmic apparatus 1 and its user. The user interface 6 includes, for example, an input unit (operation unit) that is a means for providing information from the user to the ophthalmic apparatus 1, and an output unit that is a means for providing information from the ophthalmic apparatus 1 to the user. Non-limiting examples of the hardware elements of the input unit include an operation panel, a mouse, a keyboard, a trackball, a switch, a button, a dial, a scanner, an optical character recognition (OCR) device, a microphone, a camera (video camera), and the like. Non-limiting examples of the hardware elements of the output unit include a display, a printer, a speaker, and the like. The user interface 6 may include a device in which an input function and an output function are integrated, such as a touch screen.

[0169] Although not shown in the drawings, the ophthalmic apparatus 1 includes elements for aligning the imaging unit 2 with the subject's eye E, similar to existing ophthalmic apparatuses of the same type. Any method of alignment may be used by the ophthalmic apparatus 1, and may include, for example, stereo alignment for determining the position of the subject's eye E using two or more anterior eye cameras as described in JP 2013-248376 A, a method for determining the position of the subject's eye E by analyzing a front image of the subject's eye E (for example, an observation image of the anterior eye Ea), or a method for determining the position of the subject's eye E by projecting an alignment index onto the anterior eye Ea. The ophthalmic apparatus 1 includes hardware elements and software elements according to the alignment method.

[0170] A non-limiting example of the configuration of the imaging unit 2 is shown in Fig. 2. Fig. 2 is a side view. In Fig. 2, the direction along the optical axis of the optical system (the optical axis of the objective lens 46) is the Z direction (front-back direction, working distance direction), one direction perpendicular to the Z direction (left-right direction, horizontal direction in this example) is the X direction, and the direction perpendicular to both the Z direction and the Y direction (up-down direction, vertical direction in this example) is the Y direction.

[0171] The photographing unit 2 in this example includes a light source 10, an illumination optical system 20, an optical scanner 30, a photographing optical system 40, and an imaging device 50. The illumination optical system 20 projects illumination light from the light source 10 onto the fundus Ef of the subject's eye E via the optical scanner 30. The light source 10 may be considered as an element of the illumination optical system 20. The optical scanner 30 moves the position (projection position) of the slit light projected onto the fundus Ef by the illumination optical system 20. The optical scanner 30 may be considered as an element of the illumination optical system 20. The photographing optical system 40 guides the return light of the slit light projected onto the fundus Ef by the illumination optical system 20 to the imaging device 50. The imaging device 50 may be considered as an element of the photographing optical system 40. Each element of the photographing unit 2 will be described below.

[0172] The light source 10 generates light (illumination light) for illuminating the subject's eye E. The light source 10 may include a visible light source that generates light in the visible region (for example, a white light source that generates white light). The light source 10 may also include an infrared light source (near-infrared light source) that generates light in the infrared region (near-infrared region).

[0173] The light source 10 may be capable of switching between and outputting light in two or more different wavelength regions. In this case, the light source 10 may include one light source (a wavelength-tunable light source) capable of outputting light in two or more different wavelength regions, may include a light source device that combines a broadband light source such as a white light source with a wavelength selection element such as a bandpass filter, or may include a light source device that combines two or more light sources that output light in different wavelength regions with an optical path coupling element (a dichroic mirror, a half mirror, etc.).

[0174] The light source 10 may include any type of light source, such as one or more of a light emitting diode (LED), a laser diode (LD), a halogen lamp, and a xenon lamp.

[0175] When the imaging unit 2 is appropriately aligned with the subject's eye E, the light source 10 is disposed at a position optically non-conjugate with respect to each of the fundus Ef and the iris.

[0176] In some embodiments, under the control of the processor 4, the light source 10 outputs visible light when performing slit scanning in rolling shutter mode, and outputs infrared light for other purposes, such as slit scanning in global reset release shutter mode, alignment, focus adjustment, etc. Note that the focus adjustment may be performed using visible light.

[0177] The illumination optical system 20 generates slit-shaped illumination light (slit light) from the light emitted by the light source 10 and projects it onto the fundus Ef of the subject's eye E. In this example, the illumination optical system 20 includes an iris diaphragm 21, a slit aperture diaphragm (slit) 22, a relay lens 23, an optical scanner 30, a relay lens 31, a hole mirror 45, and an objective lens 46. The relay lens 23 includes one or more lenses, the relay lens 31 includes one or more lenses, and the objective lens 46 includes one or more lenses.

[0178] The photographing optical system 40 guides the return light of the illumination light (slit light) projected onto the fundus Ef of the subject's eye E by the illumination optical system 20 (and the optical scanner 30) to the imaging device 50. In this example, the photographing optical system 40 includes an objective lens 46, a hole mirror 45, a focus lens 47, and an imaging lens 48. The focus lens 47 includes one or more lenses, and the imaging lens 48 includes one or more lenses. A relay lens may be provided between the focus lens 47 and the imaging lens 48. This relay lens includes one or more lenses.

[0179] Light output from the light source 10 (specifically, a portion of this light) passes through an opening formed in the iris diaphragm 21, an opening formed in the slit aperture diaphragm 22, and a relay lens 23, and is guided to the optical scanner 30.

[0180] When the imaging unit 2 is properly aligned with the subject's eye E, the iris diaphragm 21 (specifically, the opening formed in the iris diaphragm 21) is positioned at a position that is approximately optically conjugate with the iris (pupil) of the subject's eye E.

[0181] The iris diaphragm 21 has one or more openings formed at positions spaced apart from the optical axis of the illumination optical system 20. For example, in the iris diaphragm 21 according to the non-limiting example shown in FIG. 3, two openings 21A and 21B having predetermined dimensions (a predetermined length and a predetermined width) are formed along a circle centered on the optical axis O of the illumination optical system 20.

[0182] The opening of the iris diaphragm 21 defines the incidence state (incident position, incident shape) of the illumination light on the pupil of the subject's eye E. For example, when the iris diaphragm 21 having the openings 21A and 21B is used, in a state in which the optical axis O (optical axis of the objective lens 46) of the illumination optical system 20 is arranged so as to substantially coincide with the pupil center of the subject's eye E (that is, in a state in which the alignment in the XY directions is appropriate), the illumination light (slit light) can be guided to the fundus Ef through a position spaced from the pupil center (specifically, two positions arranged point-symmetrically with respect to the pupil center).

[0183] In some embodiments, an optical element that deflects light from light source 10 may be provided between light source 10 and iris diaphragm 21 to optimize the light amount distribution in the direction connecting the opening of iris diaphragm 21 and the opening (slit) of slit aperture diaphragm 22. Also, by configuring the relative position between light source 10 and the opening of iris diaphragm 21 to be changeable, the light amount distribution of light passing through the opening of iris diaphragm 21 may be made variable.

[0184] When the imaging unit 2 is properly aligned with the subject's eye E, the slit aperture stop 22 (specifically, the opening formed in the slit aperture stop 22) is positioned at a position that is approximately optically conjugate with the fundus Ef of the subject's eye E.

[0185] The slit aperture diaphragm 22 has an aperture with its longitudinal direction corresponding to a direction along a line (row direction) along which signals are read out from the image sensor 51 (described later) by a rolling shutter system. For example, the slit aperture diaphragm 22 according to the non-limiting example shown in FIG. 4 has an aperture 22A having predetermined dimensions (predetermined length and predetermined width) in a region including the optical axis O of the illumination optical system 20.

[0186] The opening formed in the slit aperture diaphragm 22 determines the shape of a projected image of the slit light on the fundus Ef of the subject's eye E. The longitudinal direction of the slit formed in the slit aperture diaphragm 22 may be referred to as the slit length direction. Also, the lateral direction of the slit formed in the slit aperture diaphragm 22 may be referred to as the slit width direction.

[0187] The slit aperture stop 22 can be moved in a direction along the optical axis of the illumination optical system 20 by a moving mechanism 22M (see FIG. 2). The moving mechanism 22M operates under the control of the processor 4. The processor 4 may be configured to control the moving mechanism 22M depending on the state of the subject's eye E (e.g., refractive power (refractive power, diopter), fundus shape, etc.).

[0188] The light that passes through the opening of the iris diaphragm 21 is converted into slit-shaped illumination light (slit light) by passing through the opening of the slit aperture diaphragm 22. The slit light is guided to the optical scanner 30 via the relay lens 23, deflected by the optical scanner 30, and guided to the hole mirror 45 via the relay lens 31.

[0189] The hole mirror 45 is an optical component used in existing fundus cameras and functions as an optical path coupling component that couples the optical path of the illumination optical system 20 and the optical path of the photographing optical system 40. An opening (or a light transmitting portion) is formed at the center position of the hole mirror 45. For example, the outer edge of this opening is circular. The optical axis of the illumination optical system 20 and the optical axis of the photographing optical system 40 intersect at the opening of the hole mirror 45. A reflecting portion (mirror portion) is formed around the opening of the hole mirror 45.

[0190] The slit light guided to the hole mirror 45 via the relay lens 31 is reflected by the reflecting portion, refracted by the objective lens 46, and enters the subject's eye E. The slit light entering the subject's eye E is projected onto the fundus Ef.

[0191] In some embodiments, the shape of the projected image (projection area) of the slit light on the fundus Ef is substantially slit-shaped, and the longitudinal direction of the slit-shaped projected image substantially coincides with the X-direction. In this case, the optical scanner 30 deflects the slit light generated by the iris diaphragm 21 and the slit aperture diaphragm 22 so as to move the projected image of the slit light on the fundus Ef in the Y-direction.

[0192] The longitudinal direction of the projected image of the slit light on the fundus Er is not limited to the X direction, and the moving direction of the projected image by the optical scanner 30 is not limited to the Y direction. For example, the longitudinal direction of the projected image of the slit light can be set to the Y direction, and the moving direction of the projected image by the optical scanner 30 can be set to the X direction. At least one of the direction and moving direction of the projected image of the slit light may be variable.

[0193] When the imaging unit 2 is appropriately aligned with the subject's eye E, the optical scanner 30 is disposed at a position that is approximately optically conjugate with the iris of the subject's eye E. This makes it possible to deflect the slit light in a predetermined direction (Y direction in a typical embodiment of this embodiment) with a position in the pupil of the subject's eye E (or a position in the vicinity of the pupil) as a pivot (scan axis, deflection central axis), and to project the slit light sequentially onto a plurality of slit-shaped partial regions formed by virtually dividing a predetermined scan range of the fundus Ef. In other words, it becomes possible to perform a slit scan of the fundus Ef.

[0194] The reflected light of the slit light projected onto the fundus Ef exits the subject's eye E through the pupil of the subject's eye Ef and enters the photographing unit 2. The light (returned light) that enters the photographing unit 2 from the subject's eye E is guided to the hole mirror 45 via the objective lens 46. This returned light passes through the opening of the hole mirror 45 (or passes through the light-transmitting portion) and is guided to the imaging device 50 via the focus lens 47 and imaging lens 48 and detected.

[0195] The optical scanner 30 can, for example, deflect the slit light one-dimensionally or two-dimensionally. The optical scanner 30 for one-dimensional deflection deflects the slit light in a predetermined deflection angle range based on a predetermined direction. This deflection angle range is defined in a direction corresponding to the moving direction of the slit light in the fundus Ef (for example, the Y direction). The optical scanner 30 capable of two-dimensional deflection is, for example, a combination of two optical scanners that provide different deflection directions. The type of optical deflection device used in the optical scanner 30 may be any type, and may be, for example, a galvano scanner.

[0196] The focus lens 47 can be moved in a direction along the optical axis of the imaging optical system 40 by a moving mechanism 47M (see FIG. 2). The moving mechanism 47M operates under the control of the processor 4. The processor 4 may be configured to control the moving mechanism 47M depending on the state of the subject's eye E (e.g., refractive power, fundus shape, etc.).

[0197] The imaging device 50 includes an image sensor 51 that detects return light guided by the photographing optical system 40. Under the control of the processor 4, the imaging device 50 can read out a signal from the image sensor 51 that detects the return light.

[0198] The image sensor 51 functions as a pixelated light receiver. When the imaging unit 2 is appropriately aligned with the subject's eye E, the light receiving surface (detection surface, imaging surface) of the image sensor 51 is disposed at a position that is approximately optically conjugate with the fundus Ef of the subject's eye E. A signal generated by the image sensor 51 through photoelectric conversion is read out by a rolling shutter method under the control of the processor 4.

[0199] In some embodiments, the image sensor 51 includes a CMOS image sensor. In this case, the image sensor 51 includes a plurality of pixel groups arranged in a row direction, and the plurality of pixel groups are arranged in a column direction. More specifically, the image sensor 51 includes a plurality of pixels arranged two-dimensionally, a plurality of vertical signal lines, and a horizontal signal line. Each pixel includes a photodiode and a capacitor. The vertical signal line is provided for each pixel group arranged in a column direction (vertical direction) perpendicular to the row direction (horizontal direction). Each vertical signal line is selectively electrically connected to a pixel group in which a charge corresponding to the detection result of the return light is accumulated. The horizontal signal line is selectively electrically connected to the plurality of vertical signal lines. Each pixel accumulates a charge corresponding to the detection result of the return light, and the accumulated charge is read out, for example, sequentially for each pixel group in the row direction. For example, a voltage corresponding to the charge accumulated in each pixel is supplied to the vertical signal line for each line in the row direction. The plurality of vertical signal lines are selectively electrically connected to the horizontal signal line. By sequentially performing the above-described read operation for each line in the row direction in the vertical direction, it is possible to read out detection results from a plurality of pixels arranged two-dimensionally.

[0200] A received light image corresponding to a desired virtual aperture shape extending in the row direction is obtained by reading out the detection results from the image sensor 51 using a rolling shutter method. This control is well known and is disclosed in, for example, U.S. Patent No. 7,831,106.

[0201] The slit scan performed by the ophthalmologic apparatus 1 will be described with reference to Fig. 5. In Fig. 5, the symbol IP indicates the position (projection range) of the projected image of the slit light on the fundus Ef, and the symbol OP indicates the position (aperture range) of a virtual aperture on the light receiving surface SR of the image sensor 51.

[0202] The ophthalmic device 1 deflects the slit light using the optical scanner 30, thereby moving the projection range IP of the slit light on the fundus Ef in the slit width direction (e.g., Y direction, column direction, vertical direction) perpendicular to the slit length direction (e.g., X direction, row direction, horizontal direction).

[0203] In reading out signals from the image sensor 51 under the control of the processor 4, the pixel group from which signals are to be read out is switched sequentially on a line-by-line basis, thereby sequentially setting the aperture range OP.

[0204] The aperture range OP corresponding to the projection range IP is set so as to include a range IP' where the return light of the slit light projected onto the projection range IP is projected onto the light receiving surface SR. In other words, the aperture range OP of the light receiving surface SR corresponding to the projection range IP of the slit light is set as a light receiving area that coincides with the projection range IP', or is set as a wider light receiving area that includes the projection range IP'.

[0205] The processor 4 executes control for moving the projection range IP of the slit light and control for moving the aperture range OP in parallel with each other. For example, the processor 4 executes these two controls (and one or more additional controls) synchronously (in cooperation with each other).

[0206] According to the slit scan performed in this manner, the imaging target range of the fundus Ef can be scanned while the projection range IP of the slit light and the aperture range OP of the image sensor 51 are moved in coordination with each other. This makes it possible to obtain a high-quality fundus image with high contrast without being affected by unnecessary scattered light. Moreover, this effect can be achieved with a simple configuration.

[0207] As described above, there are several operation modes (operation methods) for slit scanning. In this embodiment, the rolling shutter mode and the global reset release shutter mode will be described.

[0208] Slit scanning in the rolling shutter mode will now be described. An example of a control mode for slit scanning in the rolling shutter mode is shown in FIG.

[0209] 6, the horizontal axis indicates time [t] and the vertical axis indicates the line number. The intersection of the vertical axis and the horizontal axis corresponds to the start time of the slit scan.

[0210] The line number is an identifier of a plurality of pixel lines included in a light receiving element array (pixel array) arranged on the light receiving surface of the image sensor 51. In some aspects, the line number is an identifier of a plurality of pixel lines arranged in a row direction, and each pixel line is made up of a group of pixels arranged in a column direction. In other aspects, the line number is an identifier of a plurality of pixel lines arranged in a column direction, and each pixel line is made up of a group of pixels arranged in the row direction.

[0211] Each pixel line may be a group of pixels arranged in one row, or may be two or more rows. Furthermore, two pixel lines with consecutive line numbers may be adjacent pixel lines in the pixel array of the image sensor 51, or may be non-adjacent pixel lines with one or more pixel lines intervening therebetween in the pixel array of the image sensor 51.

[0212] The number of pixel lines used for the slit scan in the rolling shutter mode may be any number. In the example shown in Fig. 6, 1920 pixel lines are used. Each pixel line in Fig. 6 is denoted by L(n) (n=1, 2, . . . , 1920).

[0213] In each pixel line L(n), the period indicated by diagonal lines indicates the period during which scanning is performed (scan period), and the period indicated by solid lines indicates the period during which signals are read out (read period). In the rolling shutter mode of FIG. 6, the length (scan time) RSt of the scan period of all pixel lines L(1) to L(1920) is set to be equal, but the embodiment is not limited to such a setting. The read period may be set arbitrarily.

[0214] 6, the difference between the scan start time of the n-th pixel line L(n) and the scan start time of the next n+1-th pixel line L(n+1) is a constant value ΔRSt (n=1 to 1919). Note that the difference between the scan start times does not have to be constant.

[0215] 6, RRt indicates the time required to read out signals from 1920 pixel lines L(1) to L(1920) (total readout time), and RTt indicates the time required for slit scanning (scanning time).

[0216] In this way, in the slit scan in the rolling shutter mode of FIG. 6, control is performed so that scanning and signal readout corresponding to multiple pixel lines L(1) to L(1920) are performed sequentially with a constant time difference ΔRSt in the order of line numbers n=1 to 1920.

[0217] The slit scan in the global reset release shutter mode will now be described. An example of the control mode for the slit scan in the global reset release shutter mode is shown in Fig. 7. As in Fig. 6, the horizontal axis indicates time [t], the vertical axis indicates the line number, and the intersection of the vertical axis and the horizontal axis corresponds to the start time of the slit scan.

[0218] The number of pixel lines used for the slit scan in the global reset release shutter mode may be any number. In the example shown in Fig. 7, 1920 pixel lines L(n) are used (n = 1, 2, ..., 1920), similar to Fig. 6.

[0219] Unlike the rolling shutter mode of Fig. 6, in the global reset release shutter mode of Fig. 7, the scan start times of all pixel lines L(1) to L(1920) are the same, and the scan times of all pixel lines L(1) to L(1920) are different from each other. If the scan time of each pixel line L(n) is represented as GSt(n), then for any different line numbers n1 and n2 (n1 ≠ n2), GSt(n1) is different from GSt(n2) (GSt(n1) ≠ GSt(n2)).

[0220] 7, the difference between the scan time GSt(n) of the n-th pixel line L(n) and the scan time GSt(n+1) of the next n+1-th pixel line L(n+1) is a constant value ΔGSt (n=1 to 1919). Note that the difference in scan time does not have to be constant.

[0221] GRt indicates the time required to read out signals from 1920 pixel lines L(1) to L(1920) (total readout time), and GTt indicates the time required for slit scanning (scan time).

[0222] In this way, in the slit scan of the global reset release shutter mode in FIG. 7, the scans corresponding to all pixel lines L(1) to L(1920) start simultaneously, and the scans of the pixel lines L(1) to L(1920) are sequentially completed with a certain time difference ΔGSt in the order of line number n=1 to 1920 to perform signal readout.

[0223] In such a slit scan in the global reset release shutter mode, a common exposure period (common exposure time Ct) is set for all pixel lines L(1) to L(1920). This common exposure time Ct corresponds to the exposure time in shooting using a global shutter type image sensor.

[0224] In some embodiments, a black spot for removing harmful reflected light can be provided between the optical scanner 30 and the hole mirror 45. The black spot is placed at a position that is approximately optically conjugate with the position of the central ghost caused by the reflection of the slit light by the objective lens 46.

[0225] In some embodiments, a focus index projection optical system that generates a focus adjustment index (split index) projected onto the fundus Ef is provided between the optical scanner and the hole mirror, and a mechanism for moving the focus index projection optical system is provided. Note that the configuration for focus adjustment is not limited to this.

[0226] The processor 4 executes various control processes and various arithmetic processes. The processor 4 is configured to execute, for example, control (slit scan control) for causing the imaging unit 2 to execute the slit scan described with reference to Figs. 5 to 7, and position adjustment (alignment process) of the imaging unit 2 for acquiring an image without flare. The processes executed by the processor 4 are not limited to these, and it is possible to execute, for example, focus adjustment and display control.

[0227] The slit scan control may be performed by a known method. In contrast, the alignment process of the present embodiment is a novel technique. Several examples of the alignment process will be described below.

[0228] In order to execute a new alignment process, the ophthalmic apparatus 1 of this embodiment is configured to execute a series of processes including analysis of a fundus image, acquisition of pupil diameter data, determination of an alignment control amount, and movement of the photographing unit 2. By executing this new series of processes (i.e., by adopting a configuration including new software elements), the ophthalmic apparatus 1 makes it possible to acquire an image without flare in fundus photography using the slit scan method.

[0229] 8 shows a non-limiting example of the configuration of the processor 4. The processor 4 in this example includes an imaging control unit 410 and an alignment processing unit 420. The alignment processing unit 420 includes an image analysis unit 421, a pupil diameter data acquisition unit 422, a control amount determination unit 423, and a movement control unit 424.

[0230] The imaging control unit 410 executes control of the imaging unit 2 to image the subject's eye E. Under the control of the imaging control unit 410, the imaging unit 2 can image the fundus Ef of the subject's eye E, and may further be capable of imaging the anterior segment Ea.

[0231] The photographing control unit 410 causes the photographing unit 2 to execute, for example, the slit scan of Fig. 5. The photographing control unit 410 is configured to cause the photographing unit 2 to execute, for example, the slit scan of the rolling shutter mode of Fig. 6. The slit scan of the rolling shutter mode of this example is performed using visible light and / or infrared light. The visible image and / or infrared image acquired by this slit scan is provided, for example, for diagnosis of the subject's eye E.

[0232] The photographing control unit 410 may be configured to cause the photographing unit 2 to execute, for example, the slit scan in the global reset release shutter mode of FIG. 7. The slit scan in the global reset release shutter mode of this example is performed using, for example, infrared light. The infrared image acquired by this slit scan is provided to, for example, an alignment process executed in preparation for the slit scan in the rolling shutter mode. By using the infrared image for alignment, it is possible to avoid miosis of the subject's eye E.

[0233] When the photographing unit 2 includes an optical system of a general fundus camera (that is, an optical system including a global shutter type camera), the photographing control unit 410 is configured to execute photographing control similar to that of a processor of a general fundus camera.

[0234] The alignment processing unit 420 executes processing for aligning the photographing unit 2 (the illumination optical system 20 and the photographing optical system 40) with the subject's eye E.

[0235] The alignment in this embodiment is an operation for providing an effect different from general alignment (i.e., XY alignment for aligning the axis of the test eye with the optical axis of the device optical system, and Z alignment for matching the distance between the test eye and the device optical system to the working distance), and specifically, it is an adjustment of the position between the test eye and the device optical system, one of the purposes of which is to obtain a flare-free fundus image by slit scanning.

[0236] The fundus image 101 shown in Fig. 9A is an image obtained by photographing the fundus of the subject's eye using a rolling shutter type slit scan. This slit scan was performed using visible illumination light, and the fundus image 101 is a color image. Flare 101A occurs in this color fundus image 101.

[0237] 9B is an image obtained by applying global shutter photography to the fundus of the same subject eye. This photography is performed using infrared illumination light, and the fundus image 102 is a grayscale image. This photography is performed, for example, using a slit scan of a global reset release shutter type or a global shutter type camera. Two flares 102A and 102B are generated in the infrared fundus image 102.

[0238] The flare 101A and the flares 102A and 102B are all derived from the corneal reflection of the illumination light. Therefore, it is considered possible to estimate the state of the flare 101A from the states of the flares 102A and 102B. For example, it is considered possible to estimate the state of the flare in the image acquired by the slit scan by performing infrared photography using a global shutter method before performing slit scanning using a rolling shutter method for acquiring a color fundus image used for image diagnosis, etc., and analyzing the state of the flare in the acquired infrared fundus image. More specifically, it is possible to estimate whether or not the slit scan image contains a flare based on whether or not the infrared fundus image contains a flare, and it is also possible to estimate the state of the flare that may occur in the slit scan image based on the state of the flare in the infrared fundus image (brightness, size, position, etc.). These matters are findings discovered by the inventor.

[0239] The likelihood of flare occurring depends on each individual eye. For example, the amount of corneal reflection (corneal reflectance) and ocular tissue structure (tissue shape, tissue arrangement, etc.) vary from eye to eye. Therefore, whether the corneal reflection of the illumination light enters the device optical system varies from eye to eye, and the intensity and direction of the corneal reflection entering the device optical system also vary from eye to eye. Therefore, it is very difficult to estimate the state of flare in an image obtained by slit scanning using the rolling shutter method without performing preliminary shooting and processing. In this embodiment, as the preliminary shooting and processing, infrared shooting using the global shutter method and analysis of the infrared fundus image are performed, thereby making it possible to estimate the state of flare in an image obtained by slit scanning using the rolling shutter method.

[0240] As described above, the alignment processing unit 420 includes the image analysis unit 421 , the pupil diameter data acquisition unit 422 , the control amount determination unit 423 , and the movement control unit 424 .

[0241] The image analysis part 421 is configured to analyze an image of the fundus Ef of the subject's eye E to obtain values ​​of predetermined luminance parameters.

[0242] The image provided to the image analysis unit 421 may be any image acquired by photographing the fundus Ef of the subject's eye E. In some examples, an image generated by the ophthalmic apparatus 1 is provided to the image analysis unit 421. In some examples, an image generated by an ophthalmic imaging device other than the ophthalmic apparatus 1 is provided to the image analysis unit 421.

[0243] In some examples, an image generated by shooting using a rolling shutter type camera (i.e., an image generated by slit scanning) is provided to the image analysis unit 421. Here, the shooting using the rolling shutter type camera may be slit scanning in a rolling shutter mode or slit scanning in a global reset release shutter mode.

[0244] In some examples, an image generated by shooting using a global shutter camera is provided to the image analysis unit 421. This image may be, for example, an image generated by shooting using a general fundus camera optical system.

[0245] As illustrated above, there are various modes for the process of providing an image to the image analysis unit 421, and the following three modes are typical examples.

[0246] In the first embodiment, the photographing unit 2 applies a slit scan in a global reset release shutter mode using infrared illumination light to the fundus Ef of the subject's eye E. An image (first infrared image) generated by this slit scan is provided to the image analysis unit 421. This embodiment can be performed using the optical system of FIG.

[0247] In this embodiment, a typical image provided to the image analysis unit 421 contains two flares as shown in Fig. 9B. In this embodiment, in order to obtain flare information in such an image abundantly and quickly, the image control may be executed so that an image depicting both flares is obtained by one slit scan in the global reset release shutter mode. An example of this shooting control will be described with reference to Fig. 10.

[0248] In Fig. 10, the horizontal axis indicates time [t], and the vertical axis indicates the moving direction (scanning direction) of the projection position of the slit light. In this example, the scanning direction is the Y direction, and the vertical axis indicates the Y coordinate. The symbols FU and FL indicate two flares mixed into the image.

[0249] In this example, a slit scan is performed from above downward. The symbol SP indicates the scan start position, and the symbol EP indicates the scan end position. When a slit scan is started from the upper scan start position SP toward the lower scan end position EP, a downward flare FL (a flare FL on the scan end position EP side) occurs first, followed by an upper flare FU (a flare FU on the scan start position SP side). Hereinafter, the former will be referred to as a lower flare FL, and the latter will be referred to as an upper flare FU.

[0250] In order to generate a single image depicting both the lower flare FL and the upper flare FU, the imaging control unit 410 of this example executes exposure control of the image sensor 51 so as to include a period during which both the flares FL and FU are occurring. In Fig. 10, exposure is performed during a period from time t1 to time t2.

[0251] Such photographing control including exposure control is executed as follows, for example, after XY alignment and Z alignment executed under the control of the processor 4. At the time of completion of XY alignment and Z alignment, the optical axis of the photographing unit 2 (optical axis of the objective lens 46) and the axis of the subject's eye E substantially coincide with each other, and the distance between the photographing unit 2 (objective lens 46) and the subject's eye E substantially coincides with a predetermined working distance. In addition, the operation mode (shutter mode) of the image sensor 51 is set to a global reset release shutter mode.

[0252] Upon receiving a predetermined imaging trigger (e.g., a signal indicating that XY alignment and Z alignment are completed), the imaging control unit 410 starts moving the infrared illumination light (slit light) from the scan start position SP (time t0). The intensity of the infrared illumination light used is set to, for example, the minimum setting value among the possible setting values.

[0253] The shooting control unit 410 starts exposure of the image sensor 51 when a predetermined delay time has elapsed from time t0 (time t1). This delay time is a preset time, and is determined, for example, by measuring the timing of flare occurrence in advance, or by theoretical calculation and / or simulation based on the moving speed of the slit light, the configuration of the optical system, etc.

[0254] When a predetermined exposure time has elapsed from the start of exposure (time t1), the shooting control unit 410 ends the exposure of the image sensor 51 (time t2). This exposure time is a preset time, and is determined, for example, in the same manner as the above-mentioned delay time.

[0255] When the projection position of the slit light reaches the scan end position EP, the imaging control unit 410 ends the slit scan of this example (time t3).

[0256] By executing such imaging control, a single image depicting both the upper flare FU and the lower flare FL can be generated by slit scanning in the global reset release shutter mode. In this example, the image generated in this manner is provided to the image analysis unit 421.

[0257] In the second embodiment, the photographing unit 2 includes a global shutter type image sensor in addition to the rolling shutter type image sensor 51. An image (second infrared image) generated using this global shutter type camera is provided to the image analysis unit 421.

[0258] This embodiment can be implemented, for example, by using an imaging device 50A shown in Fig. 11 instead of the imaging device 50 in Fig. 2. The imaging device 50A in Fig. 11 includes an image sensor 52 in addition to the image sensor 51 similar to that of the imaging device 50 in Fig. 2. The image sensor 51 is of a rolling shutter type, and the image sensor 52 is of a global shutter type.

[0259] The imaging device 50A further includes an optical path splitting element (beam splitter) 53. The optical path splitting element 53 splits the optical path of the light that has passed through the imaging lens 48 into an optical path that reaches the image sensor 51 and an optical path that reaches the image sensor 52. The optical path splitting element 53 may be any optical element having an optical path splitting function, and may be, for example, any one of a half mirror, a dichroic mirror, and a polarizing beam splitter.

[0260] The optical system applicable to this embodiment is not limited to the configuration in Fig. 11. The optical system in some examples includes an optical path splitting element that splits the optical path that has passed through the focus lens 47 in Fig. 2 into a first optical path and a second optical path, a first imaging lens and a rolling shutter type image sensor disposed in the first optical path, and a second imaging lens and a global shutter type image sensor disposed in the second optical path.

[0261] In the third embodiment, an image of the fundus Ef of the subject's eye E generated by another ophthalmic imaging device is provided to the image analysis unit 421. The modality of this other ophthalmic imaging device may be arbitrary.

[0262] Although not shown in the drawings, this embodiment includes a data receiving unit that receives an image generated by another ophthalmic imaging device. The data receiving unit includes, for example, either a communication device that receives an image via a communication line or a data reader device that reads an image from a recording medium.

[0263] Next, a description will be given of an example of the luminance parameter calculated by the image analysis unit 421. The luminance parameter may be any type of parameter related to flare occurring in a fundus image, for example, any type of parameter related to corneal reflection light of illumination light (corneal reflection parameter), or any luminance parameter usable for determining a control amount for adjusting the distance between the subject's eye E and the imaging unit 2.

[0264] In this embodiment, the case where the image analysis unit 421 determines the maximum luminance value will be described, but those skilled in the art will understand that the same process can be performed when determining the value of another type of luminance parameter, some examples of which have been described above.

[0265] The image analysis unit 421 identifies the maximum value among the values ​​(luminance values) of a plurality of pixels that constitute the input image. This maximum luminance value may be a value identified from all pixels that constitute the image, or may be a value identified from a portion of the pixels. In the former case, the image analysis unit 421 can identify the maximum luminance value by comparing the magnitude of the luminance values ​​of all pixels in the image.

[0266] An example of obtaining a maximum luminance value from some pixels of an input image will be described. The image analysis unit 421 of this example first identifies a partial region of the input image. This partial region is a high luminance region. The high luminance region is identified based on, for example, the position (coordinates) of the pixel, the magnitude of the luminance value (comparison with a threshold value, etc.), the state of the region (position, shape, size, etc.), etc. Furthermore, the image analysis unit 421 of this example identifies the maximum value of the luminance values ​​of all pixels included in the identified high luminance region. The luminance value identified in this way is used as the maximum luminance value of this image. According to this example, for example, two high luminance regions corresponding to the upper flare FU and the lower flare FL of FIG. 10, respectively, are identified, and the maximum luminance values ​​in these high luminance regions are identified.

[0267] The pupil diameter data acquisition unit 422 is configured to acquire pupil diameter data of the subject's eye E.

[0268] In some examples, an image (anterior eye image) generated by the imaging unit 2 imaging the anterior eye portion Ea of the subject's eye E is provided to the pupil diameter data acquisition unit 422. The pupil diameter data acquisition unit 422 in this example is configured to execute, for example, a process of specifying a pupil region by applying predetermined image processing (for example, threshold processing, edge detection, pattern matching, segmentation, etc.) to the anterior eye image, and a process of determining the dimension of the specified pupil region (pupil diameter).

[0269] In some examples, another ophthalmic imaging device captures an anterior segment Ea of the subject's eye E to generate an anterior segment image. The pupil diameter data acquisition unit 422 of this example includes a data receiving unit (such as a communication device or a data reader device) that receives the anterior segment image generated by the other ophthalmic imaging device. Furthermore, the pupil diameter data acquisition unit 422 of this example is configured to execute, for example, a process of specifying a pupil region by applying a predetermined image processing to the anterior segment image, and a process of determining the dimensions of the specified pupil region (pupil diameter).

[0270] The control amount determination unit 423 is configured to determine a control amount of the distance between the test eye E and the photographing unit 2 based on the brightness parameter value obtained by the image analysis unit 421 and the pupil diameter data acquired by the pupil diameter data acquisition unit 422.

[0271] The control amount determined by the control amount determination unit 423 may be the value (amount) of any parameter that can be used to control the distance between the subject's eye E and the imaging unit 2, and may be, for example, the distance between the subject's eye E and the imaging unit 2 (objective lens 46), the amount of change from the current distance between the subject's eye E and the imaging unit 2 (objective lens 46), and the parameter value of a control signal provided to the moving mechanism 3.

[0272] In some examples, the control amount determiner 423 may be configured to compare the brightness parameter value determined by the image analyzer 421 with a threshold value (brightness threshold value) and determine the control amount based on the result of this comparison.

[0273] The luminance threshold applied to the comparison with the luminance parameter value may be, for example, any one of a preset value (default value), one or more values ​​selected from a plurality of preset luminance thresholds (a plurality of default values), and one or more values ​​determined at the time of photographing the subject's eye E. Any method may be used to determine the luminance threshold, and some non-limiting examples thereof will be described later.

[0274] In this example, before the image of the fundus Ef of the subject's eye E to be processed by the alignment processing unit 420 is acquired by the photographing unit 2, position adjustment of the photographing unit 2 with respect to the subject's eye E (for example, only XY alignment and Z alignment, or XY alignment, Z alignment, and tracking) can be performed. This makes it possible to provide the alignment processing unit 420 with a better fundus image than when fundus photography is performed without position adjustment. This position adjustment before fundus photography may be performed by the movement control unit 424 controlling the movement mechanism 3 according to a known method.

[0275] When an image of the fundus Ef of the subject's eye E acquired by fundus photography after the position adjustment is input to the alignment processing unit 420, the image analysis unit 421 calculates a brightness parameter value from this image, and the control amount determination unit 423 compares this brightness parameter value with a brightness threshold. The control amount determination unit 423 of this example executes a control amount determination process when the brightness parameter value is equal to or greater than the brightness threshold, and does not execute a control amount determination process when the brightness parameter value is less than the brightness threshold.

[0276] In this example, when a strong flare occurs, the control amount is determined and the distance between the eye E and the imaging unit 2 is adjusted, but when a strong flare does not occur (when no flare occurs or when only a weak flare occurs), these processes are not performed. Here, a strong flare and a weak flare are distinguished based on a brightness threshold value.

[0277] When tracking is performed in addition to XY alignment and Z alignment before fundus photography, even if eye movement occurs between alignment and fundus photography, positional deviation can be canceled by tracking, so that fundus photography can always be performed with a good relative position between the subject's eye E and the photography unit 2. Therefore, the processing according to this example (i.e., comparison of the brightness parameter value with the brightness threshold value, determination of the control amount based on the comparison result, and movement control of the photography unit 2 based on the control amount) can be effectively performed.

[0278] In contrast, when only XY alignment and Z alignment are performed before fundus photography, that is, when fundus photography is performed without performing tracking after XY alignment and Z alignment, there is a possibility that an image obtained from fundus photography performed when there is a positional misalignment between the test eye E and the photography unit 2 will be input to the alignment processing unit 420.

[0279] In such a case, the ophthalmologic device 1 may be configured to execute, for example, any of the following operation examples (1) to (3): (1) execute the processing related to this example; (2) determine a control amount and control the movement of the photographing unit 2 based on this control amount regardless of the magnitude relationship between the brightness parameter value and the brightness threshold; (3) if the brightness parameter value is equal to or greater than the brightness threshold, determine a control amount and control the movement of the photographing unit 2 based on this control amount, and if the brightness parameter value is less than the brightness threshold, execute a different alignment (auto alignment and / or manual alignment).

[0280] Next, some examples of determining the luminance threshold value will be described. The processor that executes the process of determining the luminance threshold value may be provided in the ophthalmic device 1, or may be provided in another device (ophthalmic device, information processing device, etc.). A configuration example in the former case is shown in Fig. 12. Illustration of the latter case is omitted.

[0281] 12 is an element applicable to the ophthalmologic apparatus 1 in place of the processor 4 in FIG. 8, and has the same configuration as the processor 4, except that it includes a luminance threshold determination unit 430. When the luminance threshold determination processor is provided in another device, this luminance threshold determination processor may have the same function and configuration as the luminance threshold determination unit 430.

[0282] The brightness threshold determination unit 430 may be configured to perform, for example, a process of obtaining a maximum brightness value distribution of a fundus image data set acquired in advance, and a process of determining a brightness threshold based on the maximum brightness value distribution. This brightness threshold determination process can be performed in the manner described above, but an exemplary process carried out by the inventor will be described below.

[0283] The inventors used three ophthalmic imaging devices to photograph the left and right eye of 10 subjects twice each. For each fundus photograph, the inventors photographed three times using a global shutter method with infrared illumination light. This resulted in a fundus image data set consisting of 360 infrared fundus images.

[0284] The inventors identified the maximum brightness value of each infrared fundus image and created a histogram showing the relationship between the maximum brightness value and the number of images. This histogram is a statistical representation showing the distribution state of the maximum brightness values ​​in this fundus image data set, and can further be considered as a statistical representation showing the relationship between the flare state (presence or absence of flare and its intensity) and the maximum brightness value.

[0285] The inventors determined the brightness threshold by applying a statistical operation to such a maximum brightness value distribution. This statistical operation is a weighted F-value (Fβ score). The Fβ score is one of the evaluation indices for binary classification problems, and is defined as a weighted harmonic mean of precision and recall, which are in a trade-off relationship with each other. Specifically, the Fβ score is defined by the following formula: Fβ=[(1+β 2 ) × precision × recall] / [β 2 × precision + recall].

[0286] Here, precision indicates the proportion of those predicted to be correct that were actually correct, and recall indicates the proportion of those predicted to be correct that were actually correct. β is a positive real number and is a coefficient that indicates how much more importance is attached to recall compared to precision. The minimum value of the Fβ score is 0, and the maximum value is 1.

[0287] The larger the value of coefficient β, the higher the sensitivity of flare detection (flare detection sensitivity, flare detection ability). In other words, the larger the value of coefficient β, the smaller the luminance value determined to be a flare (i.e., the smaller the luminance threshold value). On the other hand, there is also a higher possibility that an image in which no flare actually occurs will be erroneously determined to be an image containing a flare.

[0288] The inventors have determined the following luminance threshold set by using such maximum luminance value distribution and statistical calculation. This luminance threshold set includes three luminance thresholds with different flare detection sensitivities. The luminance threshold having high flare detection sensitivity (luminance threshold for high-sensitivity detection) is set to a luminance value of 40, the luminance threshold having medium flare detection sensitivity (luminance threshold for medium-sensitivity detection) is set to a luminance value of 66, and the luminance threshold having low flare detection sensitivity (luminance threshold for low-sensitivity detection) is set to a luminance value of 88.

[0289] When a luminance threshold for high-sensitivity detection is used, it has an advantage of being able to detect low-luminance flares, but a disadvantage of increasing the possibility of erroneously determining that a non-flare area is a flare. When a luminance threshold for low-sensitivity detection is used, it has an advantage of reducing the possibility of such erroneous detection, but a disadvantage of being unable to detect low-luminance flares. The luminance threshold for medium-sensitivity detection has properties intermediate between the luminance threshold for high-sensitivity detection and the luminance threshold for low-sensitivity detection. The number of luminance thresholds to be determined is not limited to three, and may be any number equal to or greater than one.

[0290] When multiple brightness thresholds are prepared, the brightness threshold to be used can be selected in consideration of the properties of each brightness threshold. In addition, two or more brightness thresholds may be used in alignment processing based on one fundus image. In this case, the control amount can be determined based on two or more flare detection results obtained using two or more brightness thresholds. For example, it is possible to select one of two or more flare detection results and determine the control amount, or to integrate two or more flare detection results and determine the control amount.

[0291] In some examples, the control amount determination unit 423 compares the brightness parameter value obtained by the image analysis unit 421 with the brightness threshold value determined in the above manner. If the brightness parameter value is equal to or greater than the brightness threshold value, the process proceeds to the next step of the control amount determination process, and if the brightness parameter value is less than the brightness threshold value, the control amount determination process (and therefore the alignment process) ends. In other words, if it is determined that the fundus image contains flare, the process proceeds to the next step of the control amount determination process, and if it is determined that the fundus image does not contain flare, the control amount determination process (and therefore the alignment process) ends.

[0292] As described above, the control amount determination process is performed based on the brightness parameter value and the pupil diameter data. In some examples, when the brightness parameter value is equal to or greater than the brightness threshold value, the control amount determination unit 423 proceeds to a process of determining the control amount based on the pupil diameter data. Some examples of this process are described below.

[0293] The pupil diameter data includes measurement data of the pupil diameter of the subject's eye E. This measurement data may be, for example, a measurement value of the pupil diameter of the subject's eye E and / or an evaluation result of the measurement value of the pupil diameter of the subject's eye E. This evaluation result may be, for example, a result of comparing the measurement value with a brightness threshold, a numerical range to which the measurement value belongs, etc. In these cases, the control amount is determined based on the magnitude of the value of the pupil diameter data.

[0294] In some examples of the aspect of determining the control amount based on the magnitude of the pupil diameter data value, the control amount is determined with attention paid to the peripheral light amount at the time of fundus photography. More specifically, the control amount is determined so that the reduction in the peripheral light amount at the time of fundus photography is not large, in other words, so that fundus photography is performed with an allowable peripheral light amount.

[0295] The control amount determination unit 423 in this example may be configured to determine a control amount based on the magnitude of the pupil diameter data value so that the reduction in the peripheral light amount of the illumination light projected onto the fundus Ef of the subject's eye E by the illumination optical system 20 becomes equal to or less than a threshold value (peripheral light amount threshold value). Here, the reduction in the peripheral light amount may be, for example, any one of a reduction rate, a reduction amount, an evaluation result of the reduction rate, and an evaluation result of the reduction amount.

[0296] The peripheral light amount threshold used to determine the control amount may be, for example, one preset value (default value), one or more values ​​selected from a plurality of preset peripheral light amount thresholds (a plurality of default values), or one or more values ​​determined when photographing the subject's eye E. Any method may be used to determine the peripheral light amount threshold, and some non-limiting examples will be described later.

[0297] In some examples of the aspect of determining the control amount based on the magnitude of the pupil diameter data value, control amount information prepared in advance is used. The control amount information is information indicating the correspondence between the pupil diameter value and the control amount. For example, the control amount information defines two or more ranges of pupil diameter values ​​(two or more intervals of pupil diameter values), and a control amount value is assigned to each range.

[0298] The control amount determination unit 423 of this example acquires, from the control amount information, a value of the control amount corresponding to the value of the pupil diameter data (i.e., the measured value of the pupil diameter of the subject's eye E, etc.) acquired by the pupil diameter data acquisition unit 422. Then, the movement control unit 424 of this example adjusts the position of the imaging unit 2 by controlling the movement mechanism 3 based on the acquired control amount value.

[0299] Next, some examples of generation of the control amount information will be described. The processor that executes the process of generating the control amount information may be provided in the ophthalmic device 1, or may be provided in another device (ophthalmic device, information processing device, etc.). A configuration example in the former case is shown in FIG. 13. Illustration of the latter case is omitted.

[0300] 8, and has a similar configuration to the processor 4, except that it includes a control amount information generating unit 440. When the control amount information generating processor is provided in another device, the control amount information generating processor may have the same function and configuration as the control amount information generating unit 440.

[0301] The control amount information generating unit 440 may be configured to generate the control amount information based on the relationship between, for example, the following four factors: (1) the distance between the eye and the imaging unit 2; (2) the reduction in peripheral light intensity of the illumination light; (3) the probability that a high-brightness area will occur in the fundus image; and (4) the pupil diameter value of the eye.

[0302] On the premise that the alignment state in the XY directions is good (i.e., the axis of the eye and the optical axis of the imaging unit 2 are aligned), the "distance" of the first factor (1) may be defined as the distance in the Z direction. The "decrease" of the second factor (2) may be defined as a decrease rate or an amount of decrease. The "high luminance area" of the third factor (3) may be defined as an image area estimated to be a flare.

[0303] An example of the relationship between these four factors is shown in Figure 14. In Figure 14, four graphs are shown: F, P(2.5), P(3.0), and P(3.5).

[0304] The horizontal axis of the coordinate system in which these graphs are defined indicates the offset from a predetermined working distance, i.e., the offset from a reference position corresponding to the working distance. The unit of the offset is millimeters. An offset of "0" indicates the reference position corresponding to the working distance of the ophthalmic apparatus 1 (the illumination optical system 20 and the photographing optical system 40 of the photographing unit 2). A negative offset indicates a position closer to the eye than the reference position, and a positive offset indicates a position farther from the eye than the reference position. Meanwhile, the vertical axis of this coordinate system indicates the probability of flare occurrence and the rate of reduction in peripheral light intensity.

[0305] Graph F shows the relationship between the offset from the working distance and the probability of occurrence of flare. Graph P(2.5) shows the relationship between the offset from the working distance and the rate of reduction in peripheral light when an eye with a pupil diameter value of 2.5 mm is being photographed. Graph P(3.0) shows the relationship between the offset from the working distance and the rate of reduction in peripheral light when an eye with a pupil diameter value of 3.0 mm is being photographed. Graph P(3.5) shows the relationship between the offset from the working distance and the rate of reduction in peripheral light when an eye with a pupil diameter value of 3.5 mm is being photographed.

[0306] The relationships shown by these four graphs F, P(2.5), P(3.0), and P(3.5) were discovered by the inventor. In order to obtain these graphs, the following two conditions were assumed: (1) when the offset from the working distance is +1.0 mm or more, no flare occurs; (2) the allowable range of the rate of reduction in peripheral light amount is from 0 percent to 40 percent. Graph L(40) in FIG. 14 shows 40 percent, which is the maximum allowable rate of reduction in peripheral light amount.

[0307] By considering the four graphs F, P(2.5), P(3.0), and P(3.5) derived under these assumptions, we can see the following three things.

[0308] First, when the pupil diameter value is 2.5 mm or less, if the offset from the working distance is a positive value, the reduction rate of peripheral light exceeds 40 percent. In other words, when the pupil diameter value is 2.5 mm or less, if the photographing unit 2 is placed at a position farther from the eye than the reference position corresponding to the working distance, the brightness of the obtained image will be insufficient. Therefore, when the pupil diameter value of the eye to be photographed is 2.5 mm or less, fundus photography should not be performed with the photographing unit 2 placed at a position farther from the eye than the reference position corresponding to the working distance. In other words, fundus photography of an eye with a pupil diameter value of 2.5 mm or less should be performed with the photographing unit 2 placed at the reference position corresponding to the working distance (or at a position closer to the eye than the reference position).

[0309] Second, if the pupil diameter value is greater than 2.5 mm and less than 3.5 mm, then the offset from the working distance can be determined, for example, as follows.

[0310] If the pupil diameter value in this example is φ, then a graph P(φ) corresponding to the pupil diameter value φ can be obtained in the same manner as the graph P(2.5) in Fig. 14. The offset amount in this example can be determined based on at least the graph P(φ) and the graph L(40). For example, it is possible to set an offset amount corresponding to an arbitrary point on a line segment (which is a part of the graph P(φ)) having a first end at the intersection of the graph P(φ) and the graph L(40) and a second end at the intersection of the graph P(φ) and the line indicating the offset amount "zero" as the offset amount corresponding to the pupil diameter value φ.

[0311] As one specific example, when the pupil diameter value φ=3.0 millimeters, the graph P(3.0) in Fig. 14 is considered. In this example, as shown in Fig. 15, an offset amount corresponding to an arbitrary point on a line segment Q (which is a part of graph P(3.0)) having a first end at an intersection Q1 between the graph P(3.0) and the graph L(40) and a second end at an intersection Q2 between the graph P(3.0) and the line M(0) indicating the offset amount "zero" is set to the offset amount corresponding to the pupil diameter value φ=3.0 millimeters in this example.

[0312] For example, the difference (φ-φ0=+0.5 mm) between the pupil diameter value φ0=2.5 ​​mm as a reference and the pupil diameter value φ=3.0 mm in this example is set as the offset amount Δ(3.0) corresponding to the pupil diameter value φ=3.0 mm in this example. Here, the offset amount Δ(3.0)=+0.5 mm corresponding to the pupil diameter value φ=3.0 mm in this example corresponds to point Q0 on the line segment Q. In other words, the offset amount Δ(3.0)=+0.5 mm corresponding to the pupil diameter value φ=3.0 mm in this example corresponds to the intersection Q0 of the line segment Q and the line indicating the offset amount "+0.5".

[0313] In this way, when the pupil diameter value φ is greater than 2.5 millimeters and less than 3.5 millimeters (i.e., when 2.5<φ<3.5), the difference value (φ-2.5) obtained by subtracting 2.5 (millimeters) from the pupil diameter value φ (millimeters) is set as the offset amount Δ(φ) corresponding to the pupil diameter value φ, so that the offset amount Δ(φ) when the pupil diameter value φ belongs to the interval (2.5, 3.5) can be expressed as a continuous function.

[0314] It should be noted that the offset amount for the range of pupil diameter values ​​in this example may be defined as a continuous function, a discrete function, or another function, even when another range of pupil diameter values ​​is applied.

[0315] Thirdly, when the pupil diameter value is 3.5 mm or more, as can be seen from the above precondition (1) and the relationship between graph P(3.5) and graph F, no flare occurs when the offset from the working distance is +1.0 mm or more. Therefore, the offset amount Δ(φ) corresponding to a pupil diameter value φ of 3.5 mm or more is set to +1.0 mm. Note that if the offset amount is made larger than +1.0 mm, not only will there be no effect in reducing flare, but the reduction in peripheral light intensity will also increase, so it is considered advantageous to set the offset amount Δ(φ)=+1.0 mm.

[0316] Based on the first to third considerations described above, in this example, the offset amount Δ(φ) corresponding to the pupil diameter value φ is defined as follows: Δ(φ) = 0 (when φ≦2.5), Δ(φ) = φ-2.5 (when 2.5<φ<3.5), Δ(φ) = 1 (when Δ≧3.5).

[0317] In this example, the two pupil diameter values ​​"2.5" and "3.5" are used as thresholds for evaluating the size of the pupil diameter of the subject's eye, that is, as thresholds for determining the offset amount from the working distance. Note that the pupil diameter values ​​used as thresholds are not limited to the values ​​in this example, and may be arbitrarily determined depending on the design concept for control of the ophthalmic apparatus, the conditions to be considered, and the like.

[0318] The control amount information generating unit 440 generates control amount information including a control amount indicating the offset amount Δ(φ) determined as described above. The control amount indicating the offset amount Δ(φ) may be, for example, the offset amount Δ(φ) itself (i.e., the value of the physical distance), or may be a parameter value of a control signal applied to the moving mechanism 3 (such as a voltage value, a current value, or a pulse number calculated from the offset amount Δ(φ)). The generated control amount information is stored in the memory 5, for example.

[0319] The movement control unit 424 is configured to adjust the distance between the subject's eye E and the imaging unit 2 by controlling the movement mechanism 3 based on the control amount determined by the control amount determination unit 423. Some non-limiting examples of the processing executed by the movement control unit 424 will be described later.

[0320] A non-limiting example of the operation of the ophthalmologic apparatus 1 according to this embodiment will be described with reference to Fig. 16 and Fig. 17. Fig. 16 is a flowchart showing the whole operation example (steps S1 to S5), and Fig. 17 is a flowchart showing the details of step S3 in the flowchart of Fig. 16.

[0321] In this operation example, the ophthalmologic apparatus 1 first executes auto-alignment (S1) and auto-focus (S2). Steps S1 and S2 are at least a part of a preparatory operation for photographing the fundus Ef of the subject's eye E.

[0322] The auto-alignment in step S1 includes XY alignment and Z alignment of the imaging unit 2 with respect to the subject's eye E. The auto-alignment is performed under the control of the processor 4. Instead of or in addition to the auto-alignment, manual alignment may be performed. Completion of the auto-alignment may be used as a trigger to cause the ophthalmic apparatus 1 to start tracking. The tracking is performed under the control of the processor 4.

[0323] The autofocus in step S2 is an operation for focusing the imaging unit 2 on the fundus Ef of the subject's eye E. The autofocus is performed under the control of the processor 4. The autofocus may be performed in parallel with tracking. Instead of or in addition to the autofocus, manual focusing may be performed.

[0324] Triggered by the completion of the autofocus in step S2, the ophthalmologic apparatus 1 executes adjustment of the offset of the working distance of the photographing unit 2, that is, adjustment of the distance between the subject's eye E and the photographing unit 2 (S3).

[0325] In this operation example, since alignment (particularly Z alignment) is performed in step S1, the distance between the subject's eye E and the photographing unit 2 at the start of step S3 can be considered to be substantially equal to the default working distance. In general, the time required for autofocus in step S2 is sufficiently short, so it is considered that step S3 is started while the alignment state achieved in step S1 is almost maintained. In addition, when tracking is performed, the ability to maintain the alignment state achieved in step S1 is improved.

[0326] In conventional ophthalmic devices, the completion of auto-alignment and auto-focusing is used as a trigger for photographing (auto-shoot function), so it is not possible to avoid the situation where an image containing flare or an image with insufficient brightness is obtained (at least, it is difficult to avoid such a situation). In contrast, the present embodiment aims to obtain an image without flare and with sufficient brightness by performing a working distance offset step (S3) between auto-focusing (S2) and auto-shooting (S4). The details of step S3 will be described later.

[0327] Triggered by the completion of the offset of the working distance of the imaging unit 2 (S3), the ophthalmologic apparatus 1 applies a slit scan of the rolling shutter method (rolling shutter mode) to the fundus Ef of the subject's eye E (S4).

[0328] The fundus image generated in step S4 is stored in, for example, the memory 5 or another storage device (S5). In addition, this fundus image is displayed on, for example, a display device of the user interface 6, output by another device, transmitted to another device, and processed by the processor 4 or another processor. This is the end of the processing according to this operation example (END).

[0329] Next, a non-limiting example of a series of steps for performing step S3 (offsetting the working distance) will be described with reference to Fig. 17. Triggered by the completion of autofocus (S2), the ophthalmic apparatus 1 (imaging unit 2) applies infrared fundus photography using a global shutter system to the fundus Ef of the subject's eye E (S11).

[0330] The infrared fundus photography in step S11 is executed under the control of the processor 4 (photography control unit 410). This infrared fundus photography is, for example, photography using a slit scan in a global reset release shutter mode or a global shutter type image sensor. By such step S11, an infrared fundus image of the fundus Ef of the subject's eye E is acquired (for example, see FIG. 9B).

[0331] Next, the ophthalmologic apparatus 1 (image analysis unit 421) analyzes the infrared fundus image acquired in step S11 to calculate a luminance parameter value (S12). This step is executed according to any of the examples described above.

[0332] Next, the ophthalmic apparatus 1 (control amount determination unit 423) compares the luminance parameter value obtained in step S12 with a threshold value (S13). This threshold value is determined in advance by, for example, the ophthalmic apparatus 1 (luminance threshold value determination unit 430 in FIG. 12) or another device, and is stored in the control amount determination unit 423 or the memory 5.

[0333] If the brightness parameter value calculated in step S12 is equal to or greater than the threshold value (S13: Yes), the operation of this example proceeds to step S14. On the other hand, if the brightness parameter value calculated in step S12 is less than the threshold value (S13: No), the operation of this example proceeds to step S15c.

[0334] If the luminance parameter value calculated in step S12 is equal to or greater than the threshold value (S13: Yes), the ophthalmologic apparatus 1 (control amount determining unit 423) executes evaluation of the pupil diameter value φ of the subject's eye E (S14).

[0335] The pupil diameter value φ of the subject's eye E is acquired at any stage before step S14. For example, during the period immediately after the completion of step S2 until immediately before the start of step S14, the ophthalmic apparatus 1 can acquire an anterior eye image of the subject's eye E by the imaging unit 2, and obtain the pupil diameter value φ from this anterior eye image by the pupil diameter data acquisition unit 422. Alternatively, before the start of step S14, the ophthalmic apparatus 1 can acquire the pupil diameter value φ of the subject's eye E from another device by the pupil diameter data acquisition unit 422.

[0336] The evaluation in step S14 uses control amount information generated in advance. The control amount information records a relationship between the pupil diameter value φ and the control amount, and more specifically, records two or more values ​​of the control amount, each assigned to two or more ranges of the pupil diameter value φ. The control amount information is generated in advance by, for example, the ophthalmic apparatus 1 (the control amount information generating unit 440 in FIG. 13) or another device, and is stored in the control amount determining unit 423 or the memory 5.

[0337] The control amount information for this operational example records the following information: (1) offset amount Δ(φ) for the first range of pupil diameter value φ (φ≧3.5) = +1.0 (millimeters); (2) offset amount Δ(φ) for the second range of pupil diameter value φ (2.5<φ<3.5) = φ-2.5 (millimeters) (0<Δ(φ)<+1.0); (3) offset amount Δ(φ) for the third range of pupil diameter value φ (φ≦2.5) = 0 (millimeters).

[0338] In other words, the control amount information in this operation example records the following information: (1) if the pupil diameter value φ is 3.5 millimeters or more, the photographing unit 2 is moved back by 1.0 millimeter from the reference position corresponding to the working distance (i.e., the distance between the subject's eye E and the photographing unit 2 is set to "working distance + 1.0 (millimeters)"); (2) if the pupil diameter value φ is greater than 2.5 millimeters and less than 3.5 millimeters, the photographing unit 2 is moved back by "φ-2.5 (millimeters)" from the reference position corresponding to the working distance (i.e., the distance between the subject's eye E and the photographing unit 2 is set to "working distance + φ-2.5 (millimeters)"); (3) if the pupil diameter value φ is 2.5 millimeters or less, the photographing unit 2 is not moved from the reference position corresponding to the working distance (i.e., the distance between the subject's eye E and the photographing unit 2 is maintained at the working distance).

[0339] In step S14, if it is determined that the pupil diameter value φ belongs to the first range indicated in the control amount information (S14:φ≧3.5), the ophthalmic device 1 (control amount determination unit 423) sets the value of the offset amount Δ(φ) to “+1.0 (millimeters)” (S15a).

[0340] Furthermore, if it is determined that the pupil diameter value φ falls within the second range (S14: 2.5<φ<3.5), the ophthalmic device 1 (control amount determination unit 423) sets the value of the offset amount Δ(φ) to “φ-2.5 (millimeters)” (S15b).

[0341] Furthermore, if it is determined that the pupil diameter value φ falls within the third range (S14: φ≦2.5), the ophthalmologic apparatus 1 (control amount determination unit 423) sets the value of the offset amount Δ(φ) to “0 (millimeters)” (S15c). In this case, the process of step S3 is terminated (S3: End) without moving the photographing unit 2, and the process proceeds to step S4 (auto shoot).

[0342] After the offset amount Δ(φ) is set in step S15a or S15b, the ophthalmic apparatus 1 (movement control unit 424) controls the movement mechanism 3 to move the imaging unit 2 by this offset amount Δ(φ) (S16).

[0343] This completes the process of step S3 (offsetting the working distance of the imaging unit 2) (S3: end). Triggered by the completion of the process of step S3, the ophthalmologic apparatus 1 applies a rolling shutter type slit scan to the fundus Ef of the subject's eye E to generate a fundus image (S4), and stores this fundus image (S5). This completes the process of this operation example (end).

[0344] A modification of the above-described operation example will be described. In the above operation example, when the pupil diameter value φ exceeds 2.5, fundus photography is performed by placing the photographing unit 2 at a distance farther than the default working distance. The brightness of an image acquired under these conditions may be lower than the brightness predicted based on, for example, Figs. 14 and 15 (i.e., an image darker than predicted may be obtained). To address this issue, an optional process described below may be performed.

[0345] After the distance between the test eye E and the photographing unit 2 is increased in step S16 of Figure 17, the ophthalmic device 1 again applies global shutter type infrared fundus photography to the fundus Ef of the test eye E to obtain a new image of the fundus Ef.

[0346] Next, the image analysis unit 421 analyzes this new image to obtain a new brightness parameter value (a second brightness parameter value).

[0347] Next, the control amount determination unit 423 compares the second luminance parameter value with the luminance parameter value calculated in step S12 (the first luminance parameter value), and determines a new control amount based on the result of this comparison.

[0348] For example, when any of the following comparison results is obtained, the control amount determination unit 423 can set a negative offset amount: (1) when the second luminance parameter value is smaller than the first luminance parameter value; (2) when the decrease (decrease rate, decrease amount) of the second luminance parameter value relative to the first luminance parameter value is larger than a predefined threshold; (3) when the second luminance parameter value is smaller than a predefined threshold. Here, the negative offset amount corresponds to control for decreasing the distance between the subject's eye E and the imaging unit 2. The magnitude (absolute value) of the negative offset amount may be a default value or may be a value determined based on the result of the above comparison.

[0349] The movement control unit 424 controls the movement mechanism 3 based on the new control amount (negative offset amount) set by the control amount determination unit 423. This reduces the distance between the subject's eye E and the imaging unit 2, which acts to increase the brightness of the image.

[0350] As described above, there is a trade-off between image brightness and the occurrence state of flare. This modified example is designed taking this trade-off into consideration. For example, any of the steps or parameters of this modified example can be designed so as to satisfy both the conditions related to image brightness and the conditions related to flare, and a series of steps of this modified example can be configured to be repeated.

[0351] It will be understood by those skilled in the art that the ophthalmic device 1 according to the present embodiment provides embodiments in categories other than ophthalmic devices. For example, the ophthalmic device 1 according to the present embodiment can provide an embodiment of a method for determining a fundus photographing distance, an embodiment of a method for controlling an ophthalmic device, an embodiment of a method for photographing a subject's eye, an embodiment of a method for processing ophthalmic information, an embodiment of a program for causing a computer to execute any of the methods, an embodiment of a storage medium on which any of the programs are recorded, and the like.

[0352] This disclosure presents some embodiments and some aspects thereof. These embodiments and aspects are merely non-limiting examples of the present invention. Therefore, any modification (omission, substitution, addition, etc.) within the scope of the gist of the present invention can be made to the embodiments and aspects presented in this disclosure. [Explanation of symbols]

[0353] 1 Ophthalmology equipment 2. Photography Department 3 Moving mechanism 4 processors 5. Memory 6 User Interface 410 Shooting control section 420 Alignment Processing Section 421 Image Analysis Unit 422 Pupil diameter data acquisition unit 423 Control amount determination unit 424 Movement control section 430 Luminance threshold determination unit 440 Control amount information generation unit

Claims

1. an imaging unit including an illumination optical system that projects illumination light from a light source onto the fundus of the subject's eye via an optical scanner, and an imaging optical system that detects return light of the illumination light with a first image sensor that is operable in a rolling shutter mode; A moving mechanism that moves the imaging unit; an image analysis unit that analyzes the image of the fundus to obtain a value of a predetermined brightness parameter; a pupil diameter data acquisition unit that acquires pupil diameter data of the subject's eye; a control amount determination unit that determines a control amount of a distance between the subject's eye and the imaging unit based on the value of the luminance parameter calculated by the image analysis unit and the pupil diameter data acquired by the pupil diameter data acquisition unit; a movement control unit that controls the movement mechanism based on the control amount determined by the control amount determination unit; 13. An ophthalmic device comprising:

2. the illumination optical system is capable of projecting infrared illumination light onto the fundus; the first image sensor is further operable in a global reset release shutter mode; the photographing unit obtains a first infrared image of the fundus by using the infrared illumination light and photographing in the global reset release shutter mode; The image analysis unit analyzes the first infrared image to obtain the value of the brightness parameter. The ophthalmic device of claim 1.

3. The optical scanner moves a projection position of the infrared illumination light, the photographing unit performs the photographing at a timing when the first infrared image is acquired in which both a first high-luminance region occurring on a movement start point side of the infrared illumination light and a second high-luminance region occurring on a movement end point side of the infrared illumination light are depicted. The ophthalmic device of claim 2.

4. the illumination optical system is capable of projecting infrared illumination light onto the fundus; the imaging optical system further includes a second image sensor of a global shutter type; the photographing unit obtains a second infrared image of the fundus using the infrared illumination light and the second image sensor; The image analysis unit analyzes the second infrared image to obtain the value of the brightness parameter. The ophthalmic device of claim 1.

5. The brightness parameter includes at least one of a maximum brightness in the image of the fundus and a parameter indicating a state of a high brightness area in the image of the fundus. The ophthalmic device of claim 1.

6. The control amount determination unit determines the control amount based on a result of a comparison between the value of the luminance parameter obtained by the image analysis unit and a predetermined first threshold value. The ophthalmic device of claim 1.

7. the movement control unit controls the movement mechanism to adjust a relative position of the imaging unit with respect to the subject's eye at least prior to acquisition of the image of the fundus; the control amount determination unit executes determination of the control amount only when the value of the luminance parameter is equal to or greater than the first threshold value. The ophthalmic device of claim 6.

8. A brightness threshold determination unit is further configured to obtain a maximum brightness value distribution of a fundus image data set acquired in advance, and to determine the first threshold value based on the maximum brightness value distribution, the control amount determination unit determines the control amount based on a result of a comparison between the value of the luminance parameter and the first threshold determined by the luminance threshold determination unit. The ophthalmic device of claim 6.

9. the luminance threshold determination unit calculates a weighted F-number of the maximum luminance value distribution, and determines the first threshold based on the weighted F-number; 9. The ophthalmic device of claim 8.

10. The luminance threshold determination unit determines at least two first thresholds based on the maximum luminance value distribution; the control amount determination unit selects one first threshold from the at least two first thresholds, and determines the control amount based on a result of a comparison between the value of the luminance parameter and the one first threshold.

9. The ophthalmic device of claim 8.

11. The control amount determination unit determines the control amount based on a magnitude of the value of the pupil diameter data. The ophthalmic device of claim 1.

12. the control amount determination unit determines the control amount based on the magnitude of the value of the pupil diameter data such that a reduction in the peripheral light amount of the illumination light projected onto the fundus by the illumination optical system becomes equal to or less than a second predetermined threshold value. The ophthalmic device of claim 11.

13. the control amount determination unit acquires a control amount value corresponding to the magnitude of the value of the pupil diameter data from default control amount information in which a control amount value is assigned to each of two or more ranges of pupil diameter values; The movement control unit controls the movement mechanism based on the value of the control amount acquired from the control amount information. The ophthalmic device of claim 11.

14. a control amount information generating unit that generates the control amount information based on a relationship between a distance between the eye and the photographing unit, a reduction in peripheral light amount of the illumination light, a probability of a high luminance area occurring in the fundus image, and a pupil diameter value. The ophthalmic device of claim 13.

15. the control amount information generation unit determines a value of a control amount to be assigned to each of the two or more ranges of the pupil diameter value such that the reduction in the peripheral light amount of the illumination light is equal to or less than a second predetermined threshold value.

15. The ophthalmic device of claim 14.

16. the control amount determination unit determines whether or not to execute the determination of the control amount based on the value of the luminance parameter, and determines the control amount based on the pupil diameter data when it is determined that the determination of the control amount is to be executed. The ophthalmic device of claim 1.

17. the image analysis unit analyzes a new image of the fundus acquired after the distance between the subject's eye and the imaging unit is enlarged by the movement control unit to obtain a new value of the brightness parameter; the control amount determination unit determines a new control amount based on a result of a comparison between the value of the luminance parameter and the new value; The movement control unit controls the movement mechanism based on the new control amount. The ophthalmic device of claim 1.

18. A method for determining a distance between a subject's eye and an imaging unit for fundus photography using an ophthalmologic apparatus including an imaging unit configured to project illumination light from a light source onto a fundus of a subject's eye via an optical scanner and detect return light of the illumination light with an image sensor operable in a rolling shutter mode, comprising: acquiring an image of the fundus; analyzing the image of the fundus to determine a value of a predetermined brightness parameter; Acquire pupil diameter data of the subject's eye; determining the distance based on the value of the luminance parameter and the pupil diameter data; method.

19. A program causing a computer to execute the method of claim 18.

20. A non-transitory computer-readable recording medium having the program of claim 19 recorded thereon.

Citation Information

Patent Citations

  • Ophthalmologic apparatus, and control method of ophthalmologic apparatus

    JP2016185192A

  • Ophthalmologic apparatus, control method thereof, and program

    JP2021145896A

  • Laser scanning digital camera with simplified optics and potential for multiply scattered light imaging

    US7831106B2