Ophthalmic device and control program for the device

The ophthalmic apparatus uses a three-dimensional movement system and manual input correction to enhance alignment accuracy by adapting to automatic detection failures, ensuring efficient alignment of the examination unit with the subject's eyes.

JP7786396B2Active Publication Date: 2025-12-16NIDEK CO LTD
View PDF 9 Cites 0 Cited by

Patent Information

Application Number
JP2022572074
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Priority Date
2020-12-25
Filing Date
2021-12-06
Publication Date
2025-12-16
Estimated Expiration
2041-12-06

AI Technical Summary

Technical Problem

Existing ophthalmic devices face issues with accurate alignment of the examination unit with the subject's eyes due to erroneous detection or prolonged time in detecting eye positions, especially under varying facial conditions or environments.

Method used

The ophthalmic apparatus employs a three-dimensional movement system for the examination unit, combined with facial and anterior segment imaging, allowing for manual input correction of eye positions, and a control program that adjusts alignment based on both detected and designated positions, ensuring precise alignment even when automatic detection fails.

Benefits of technology

This approach ensures robust and efficient alignment of both eyes by allowing manual correction and adaptive control, improving alignment accuracy and reducing detection time, particularly in challenging conditions.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007786396000001
    Figure 0007786396000001
  • Figure 0007786396000002
    Figure 0007786396000002
  • Figure 0007786396000003
    Figure 0007786396000003
Patent Text Reader

Abstract

An ophthalmic apparatus equipped with a first photographic means for capturing a facial image and a second photographic means for capturing an anterior eye image, the ophthalmic apparatus comprising: a control means for executing an adjustment process that includes a position acquisition step for acquiring the position of a subject's eye to be determined on the basis of the facial image, a first control step for controlling a drive means on the basis of the acquired position of the subject's eye so as to cause the subject's eye to fall within a shooting range of the second photographic means, and a second control step for adjusting the position of an examination unit relative to the subject's eye by controlling the drive means after the first control step on the basis of the anterior eye image; a first acquisition means which acquires, as a detecting position, the subject's eye position that is determined through analysis of the facial image; and a second acquisition means which receives an input operation relating to the position of the subject's eye with respect to the facial image and then acquires, as a designated position, the position of the subject's eye that is determined on the basis of the input operation.
Need to check novelty before this filing date? Find Prior Art

Description

[Technical Field]

[0001] The present disclosure relates to an ophthalmic apparatus for examining an eye to be examined and a control program for the ophthalmic apparatus. [Background technology]

[0002] In an ophthalmic device having an examination unit for examining a subject's eyes, a technique is known in which a facial image including the subject's left and right eyes is captured and the captured facial image is analyzed to detect the position of the subject's eyes. Also known is an automatic alignment technique in which the examination unit is moved based on the detection result to roughly align the examination unit with the subject's eyes, and then the technique proceeds to precise alignment based on an anterior segment image (see, for example, Patent Document 1). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2017-64058 Summary of the Invention

[0004] However, when analyzing a facial image to detect the position of the subject's eye, depending on the condition of the subject's face or the examination environment, the position of the subject's eye may not be detected, the position may be erroneously detected, or the time required to detect the subject's eye may be prolonged. In such cases, there is a problem that alignment cannot be performed properly.

[0005] In view of the above problems, the present disclosure has as its technical object to provide an ophthalmic apparatus and a control program for the ophthalmic apparatus that can perform good alignment.

[0006] (1) An ophthalmologic apparatus having an examination unit for examining an eye to be examined, comprising: a driving means for three-dimensionally moving the examination unit relative to the eye to be examined; a first photographing means for photographing a facial image including the left and right eyes to be examined; and a second photographing means for photographing an image of the anterior segment of the eye to be examined. a display means for displaying at least the facial image;a first acquisition means for detecting a position of the subject's eye by analyzing the face image and acquiring the position of the subject's eye identified by the detection as a detected position; The facial image is displayed before the first acquisition means completes the process of detecting the position of the subject's eye, and the displayed facial image is a second acquisition means for receiving an input operation of a position of the subject's eye relative to the face image, and acquiring the position of the subject's eye specified based on the input operation as a designated position; a position acquisition step of acquiring the detected position as the position of the subject's eye when the detected position is acquired by the first acquisition step, and acquiring the designated position as the position of the subject's eye when the designated position is acquired by the second acquisition step after the detection process of the position of the subject's eye by the first acquisition step has started, regardless of whether the detected position has been acquired; a first drive control step of controlling the drive means based on the acquired position of the subject's eye so that the subject's eye is included in the imaging range of the second imaging means; and a second drive control step of controlling the drive means based on the anterior eye image after the first drive control step, and adjusting the relative position of the examination unit with respect to the subject's eye. Equipped with When the left eye and the right eye are successively examined, the control means can acquire the positions of the left eye and the right eye collectively in the position acquisition step in the adjustment process for one of the left eye and the right eye to be examined first, and when the positions of the left eye and the right eye are acquired collectively in the position acquisition step, the control means can request the input operation for each eye. It is characterized by: (2) An ophthalmologic apparatus having an examination unit for examining an eye to be examined, comprising: a driving means for three-dimensionally moving the examination unit relative to the eye to be examined; a first photographing means for photographing a face image including the left and right eyes to be examined; a second photographing means for photographing an image of an anterior segment of the eye to be examined; a display means for displaying at least the face image; a first acquisition means for detecting the position of the eye to be examined by analyzing the face image and acquiring the position of the eye to be examined identified by the detection as a detected position; a second acquisition means for displaying the image before the first acquisition means completes a process of detecting the position of the eye to be examined, accepting an input operation of the position of the eye to be examined relative to the displayed face image, and acquiring the position of the eye to be examined identified based on the input operation as a designated position; and a position detecting means for detecting the detected position by the first acquisition means, acquiring the detected position as the position of the eye to be examined, when the first acquisition means acquires the designated position, when the second acquisition means acquires the designated position after the first acquisition means starts a process of detecting the position of the eye to be examined, regardless of whether the detected position has been acquired. a control means for executing an adjustment process including: a position acquisition step; a first drive control step for controlling the drive means based on the acquired position of the test eye so that the test eye is included in the shooting range of the second photographing means; and a second drive control step for controlling the drive means based on the anterior eye image after the first drive control step to adjust the relative position of the examination unit with respect to the test eye; and when only one designated position is input by the input operation, the control means is further provided with a discrimination means for discriminating between left and right of the test eye based on whether the designated position is in the right eye region or the left eye region in the image captured by the first photographing means, and the control means performs the first drive control step based on the input designated position and then proceeds to the second drive control step, and determines the left or right to move the examination unit relative to the test eye based on the discrimination result of the discrimination means in order to test the unexamined test eye after completion of the examination of one of the right and left test eyes, controls the drive means so that the examination unit approaches the unexamined test eye based on the determined left or right, and proceeds to the second drive control step. (3) a driving means for three-dimensionally moving an examination unit for examining the subject's eye relative to the subject's eye; a first photographing means for photographing a facial image including the subject's right and left eyes; and a second photographing means for photographing an image of an anterior segment of the subject's eye. a display means for displaying at least the facial image; A control program executed by a control unit of the ophthalmic apparatus, a first acquisition step of detecting the position of the subject's eye by analyzing the face image and acquiring the position of the subject's eye identified by the detection as a detected position; a second acquisition step of displaying the face image before the detection process of the position of the subject's eye by the first acquisition step is completed, accepting an input operation of the position of the subject's eye relative to the displayed face image, and acquiring the position of the subject's eye identified based on the input operation as a designated position; and, if the detected position is acquired by the first acquisition step, acquiring the detected position as the position of the subject's eye, and if the designated position is acquired by the second acquisition step after the detection process of the position of the subject's eye by the first acquisition step has started, acquiring the designated position as the position of the subject's eye regardless of whether the detected position has been acquired. a first drive control step of controlling the drive means based on the acquired position of the eye to be examined so that the eye to be examined is included in the imaging range of the second imaging means; and a second drive control step of controlling the drive means based on the anterior eye image after the first drive control step to adjust the relative position of the examination unit with respect to the eye to be examined. Furthermore, when the left eye and the right eye are successively tested, the positions of the left eye and the right eye can be acquired collectively in the position acquisition step in the adjustment process for one of the left eye and the right eye to be tested first, and when the positions of the left eye and the right eye are acquired collectively in the position acquisition step, the input operation for each eye can be requested. It is characterized by: (4) A control program executed in an ophthalmologic apparatus including a driving means for three-dimensionally moving an examination unit for examining the eye to be examined relative to the eye to be examined, a first photographing means for photographing a facial image including the left and right eyes to be examined, a second photographing means for photographing an anterior eye image of the eye to be examined, and a display means for displaying at least the facial image, the control program being executed by a control unit of the ophthalmologic apparatus, the control program including a first acquisition step for detecting the position of the eye to be examined by analyzing the facial image and acquiring the position of the eye to be examined identified by the detection as a detected position, a second acquisition step for displaying the facial image before the detection process of the position of the eye to be examined by the first acquisition step is completed, accepting an input operation for the position of the eye to be examined relative to the displayed facial image, and acquiring the position of the eye to be examined identified based on the input operation as a designated position, and if the detected position is acquired by the first acquisition step, acquiring the detected position as the position of the eye to be examined, and if the designated position is acquired by the second acquisition step after the detection process of the position of the eye to be examined by the first acquisition step has started, acquiring the designated position as the position of the eye to be examined regardless of whether the detected position is acquired. The ophthalmologic apparatus is caused to perform a control step of executing an adjustment process including a position acquisition step of acquiring the position of the eye, a first drive control step of controlling the drive means based on the acquired position of the eye so that the eye is included in the shooting range of the second photographing means, and a second drive control step of controlling the drive means based on the anterior eye image after the first drive control step to adjust the relative position of the examination unit with respect to the eye; and further, if only one designated position is input by the input operation, a discrimination step is performed of determining whether the eye is left or right based on whether the designated position is in the right eye region or the left eye region in the image captured by the first photographing means, and after performing the first drive control step based on the input designated position, the apparatus proceeds to the second drive control step, and after completing the examination of one of the left and right eye, the apparatus determines whether the examination unit should be moved relative to the eye to be examined based on the discrimination result of the discrimination step in order to examine the unexamined eye, and controls the drive means so that the examination unit approaches the unexamined eye based on the determined left or right, and proceeds to the second drive control step. [Brief explanation of the drawings]

[0007] [Figure 1] FIG. 1 is a schematic view illustrating the appearance of an ophthalmologic apparatus. [Figure 2] FIG. 2 is a block diagram showing a control system of the ophthalmologic apparatus. [Figure 3] FIG. 1 is a schematic diagram illustrating an optical system of an ophthalmic apparatus. [Figure 4] FIG. 4 is a flowchart showing the operation of the ophthalmologic apparatus. [Figure 5] FIG. 10 is a flowchart showing the operation of the ophthalmologic apparatus when the positions of the left and right eyes to be examined are input. [Figure 6]FIG. 10 is a flowchart showing the operation of the ophthalmologic apparatus when the position of either the left or right eye to be examined is input. [Figure 7] FIG. 10 is a schematic diagram of the display when the position of the subject's eye is detected by analyzing a face image. [Figure 8] FIG. 10 is a schematic diagram of the display when the position of the subject's eye is not detected by analyzing the face image. [Figure 9] FIG. 10 is a schematic diagram of the display when a position on a face image is input by an examiner. [Figure 10] 10A and 10B are diagrams illustrating the display on the display when guiding the examiner to input a designated position toward a selected eye on a face image. [Figure 11] FIG. 10 is a schematic diagram of a display when the position of an eye to be examined is detected based on the position on a face image input by an examiner. [Figure 12] FIG. 10 is a schematic diagram of a display in which a plurality of candidate pupil regions detected on a face image are displayed. DETAILED DESCRIPTION OF THE INVENTION

[0008] 1 to 12 are diagrams illustrating the configuration of an ophthalmologic apparatus according to an embodiment of the present disclosure.

[0009] <Summary> For example, an ophthalmic device (e.g., ophthalmic device 1) includes an eye examination means (e.g., examination unit 2) for examining the subject's eye, a driving means (e.g., driving unit 4), a first photographing means (e.g., face photographing unit 3), a second photographing means (e.g., an anterior eye photographing optical system 60), a control means (e.g., control unit 70), a first acquisition means (e.g., control unit 70), and a second acquisition means (e.g., control unit 70).

[0010] Furthermore, for example, the eye examination means includes an examination optical system (for example, a measurement optical system 20) for examining (including measuring) the subject's eye.

[0011] For example, the ophthalmologic device may include at least one of a base (e.g., base 5) on which an eye examination means is mounted, a face support means (e.g., face support unit 9), a detection means (e.g., control unit 70), an input means (e.g., operation unit 8), an alarm means (e.g., display 7), a display means (e.g., display 7), and a discrimination means (e.g., control unit 70).

[0012] For example, the face support means may be configured to support the subject's face in a fixed positional relationship with respect to the base. For example, the face support means may include a chin rest on which the subject's chin can be placed.

[0013] For example, the driving means is configured to move the ophthalmology means three-dimensionally relative to the subject's eye. For example, the ophthalmology means is mounted on a base so as to be movable in the X direction (left-right direction), Y direction (up-down direction), and Z direction (front-back direction) relative to the subject's eye supported by the face support means. For example, the driving means moves the ophthalmology means in the X direction, Y direction, and Z direction relative to the base. Furthermore, for example, the ophthalmologic apparatus may be provided with a chin rest driving means (e.g., a chin rest driving unit 12). For example, the chin rest driving means is provided on the face support means to drive the chin rest in the Y direction. In this case, the driving means may include the chin rest driving means as a configuration for moving the ophthalmology means in the Y direction relative to the subject's eye.

[0014] For example, the first photographing means is configured to photograph a facial image including the left and right eyes to be examined.

[0015] For example, the second photographing means is configured to photograph an image of the anterior segment of the subject's eye. For example, the second photographing means is configured to photograph an image of the anterior segment of the subject's eye at a magnification higher than the magnification of the first photographing means. For example, the first photographing means may also serve as the second photographing means, and the magnification may be changeable.

[0016] For example, the detection means detects the precise alignment state of the ophthalmological examination means with respect to the subject's eye based on the anterior eye image captured by the second imaging means.

[0017] For example, the display means displays a facial image captured by the first imaging means. For example, the display means may display an anterior eye image captured by the second imaging means. For example, the display means may simultaneously display a facial image and an anterior eye image. In this case, for example, the control means may display the facial image larger than the anterior eye image when performing alignment based on the facial image. Furthermore, the control means may display the anterior eye image larger than the facial image when transitioning to alignment based on the anterior eye image. Note that, for example, alignment based on the facial image adjusts the positional relationship between the subject's eye and the optometry means until alignment based on the anterior eye image is possible. For example, alignment based on the anterior eye image adjusts the positional relationship between the subject's eye and the optometry means to a predetermined positional relationship. Note that the predetermined positional relationship is, for example, a positional relationship between the subject's eye and the optometry means that allows examination by the optometry means.

[0018] For example, the input means is provided in the ophthalmologic apparatus so that the examiner can specify and input a position corresponding to the eye to be examined relative to the facial image captured by the first imaging means. For example, the input means is configured to allow input of a specified position for roughly aligning the ophthalmological examination means relative to the eye to be examined. For example, the input means includes a pointing device (e.g., at least one human interface such as a touch panel, joystick, mouse, keyboard, trackball, or button). For example, the input means is configured to allow input of a specified position relative to the facial image displayed on the display means during rough alignment. For example, the facial image for inputting the specified position may be a video or a still image captured by the first imaging means.

[0019] For example, the control unit controls the drive unit to perform an adjustment process to adjust the relative position of the examination unit with respect to the subject's eye. For example, the adjustment process performed by the control unit includes a position acquisition step, a first drive control step, and a second drive control step.

[0020] For example, the position acquiring step is a step of acquiring the position of the subject's eye identified based on a face image.

[0021] For example, the first drive control step is a step of controlling the drive means so that the acquired position of the subject's eye is included in the imaging range of the second imaging means. For example, the first drive control step may be a coarse alignment step for roughly aligning the examination unit with the subject's eye.

[0022] For example, the second drive control step is a step of controlling the drive means based on the anterior eye image after the first drive control step to adjust the relative position of the examination unit with respect to the subject's eye. For example, the second drive control step may be precision alignment for precisely aligning the examination unit with respect to the subject's eye.

[0023] For example, the first acquisition means detects the position of the eye to be examined by analyzing the face image, and acquires the position of the eye to be examined identified by the detection as the detected position.

[0024] For example, the second acquisition means may receive an input operation for the position of the subject's eye relative to the face image and acquire the position of the subject's eye identified based on the input operation as a designated position. For example, in the position acquisition step, the second acquisition means may acquire the designated position based on the input operation for the position of the eye relative to the face image displayed on the display means. Then, for example, the control means executes the adjustment process of the first drive control step based on the position of the subject's eye acquired by the second acquisition means.

[0025] For example, the second acquisition means detects the position of the subject's eye by using a part of the face image based on coordinates specified by an input operation in the face image as an analysis target, and acquires the position of the subject's eye identified by the detection as the specified position. For example, the part of the face image to be analyzed is within a predetermined area based on the specified coordinates.

[0026] For example, in the position acquiring step, if there are multiple candidates for the position of the subject's eye identified based on the face image, the display means may display the identified candidates for the position of the subject's eye. In this case, the second acquiring means acquires a candidate designated from the multiple candidates by an input operation of the examiner as the designated position.

[0027] For example, by providing the second acquisition means, alignment can be performed well when the first acquisition means is unable to detect the position of the subject's eye due to the condition of the subject's face (e.g., the subject's mascara, eyelashes, ptosis, etc.) or the examination environment (the background of the subject's face photographed by the first photographing means, illumination light, ambient light, etc.), or when it takes a long time to detect the subject's eye.

[0028] Furthermore, for example, when the control means receives an input operation for a designated position after the adjustment process using the detected position has started, the control means may perform the first drive control step based on the designated position regardless of the position detected by the first acquisition means. This allows for good alignment even when it takes a long time for the first acquisition means to detect the eye to be examined.

[0029] For example, when the left and right eyes are successively tested, the control means may be capable of simultaneously acquiring the positions of the left and right eyes in a position acquisition step in the adjustment process for one of the left and right eyes to be tested first. When the positions of the left and right eyes are simultaneously acquired in the position acquisition step, input operations for each of the eyes to be tested may be required. This allows the examiner to recognize the need to input the positions of the left and right eyes and prevents the examiner from forgetting to input the positions.

[0030] Furthermore, when the left and right eyes are successively examined, the control means may perform the first drive control step in a predetermined procedure using designated positions corresponding to one of the examined eyes, and after the examination of one eye is completed, may perform the first drive control step using designated positions corresponding to the other eye. In this case, for example, the ophthalmologic apparatus may be provided with a discrimination means (e.g., the control unit 70) for discriminating whether the two designated positions correspond to the left eye or the right eye.

[0031] For example, the discrimination means discriminates whether the two designated positions correspond to the left eye or the right eye based on the positional relationship between the two designated positions or the positional relationship between the designated positions and the face image. Then, for example, the control means determines, based on the result of the left / right discrimination, which of the two designated positions corresponds to the eye predetermined to be tested first, and starts executing the first drive control step. This allows for good alignment in the test of both eyes.

[0032] The predetermined procedure may be, for example, a procedure that determines which of the left and right test eyes to start the test with. Alternatively, the predetermined procedure may be, for example, a procedure that determines that the test should start with the test eye whose designated position is input first.

[0033] For example, the control means may wait to execute the first drive control step until the positions of the two eyes, the left eye and the right eye, are input. For example, the ophthalmologic apparatus may be provided with a notification means (e.g., the display 7) that notifies the examiner to prompt the examiner to input the position of the subject's eye if the position of the other eye is not input within a predetermined time after the position of one of the left eye and the right eye is input. Alternatively, for example, if the position of the other eye is not input within a predetermined time, the control means may start executing the first drive control step using the position of one of the eyes.

[0034] Furthermore, for example, the discrimination means may be configured to, when a single designated position is input by an input operation, discriminate between the left and right of the subject's eye based on whether the designated position is located in the right eye region or the left eye region of the facial image. In this case, for example, the control means performs a first drive control step based on the input designated position, and then proceeds to a second drive control step. In order to test the unexamined eye after testing one of the left and right subjects' eyes, the control means determines the left-right direction in which to move the testing unit relative to the subject's eye based on the discrimination result of the discrimination means, controls the driving means so that the testing unit approaches the unexamined eye based on the determined direction, and then proceeds to the second drive control step. This allows for good alignment in consecutive tests of both the left and right eyes, even when a single designated position is input.

[0035] For example, if the notification means fails to acquire the detected position (i.e., if an acquisition error occurs) in the adjustment process using the detected position, the notification means issues a notification to request the examiner to input a designated position. This allows the examiner to know that the first acquisition means has failed to detect the position of the subject's eye, and allows the examiner to perform a good alignment by inputting the position of the subject's eye.

[0036] It should be noted that the present disclosure is not limited to the devices described in the present embodiment. For example, a control program (software) that performs the functions of the above-described embodiments may be supplied to a system or device via a network or various storage media. Then, a control unit (e.g., a CPU) of the system or device may read and execute the program.

[0037] For example, the control program executed in the ophthalmic apparatus may be executed by a control unit of the ophthalmic apparatus to cause the ophthalmic apparatus to execute a control step of performing an adjustment process to adjust the relative position of the examination unit with respect to the subject's eye. For example, the control step includes various processing steps as described above, which are performed by the control unit.

[0038] <Example> An ophthalmic device according to the present disclosure will be described with reference to the drawings. In the following description, an ophthalmic device will be described as an example of an eye refractive power measurement device, but the present disclosure can also be applied to other ophthalmic devices such as a corneal curvature measurement device, an ocular pressure measurement device, a fundus camera, an OCT (Optical Coherence Tomography), an SLO (Scanning Laser Ophthalmoscope), a micro perimeter, etc.

[0039] The ophthalmic apparatus of this embodiment objectively measures, for example, the ocular refractive power of the subject's eye. For example, the ophthalmic apparatus of this embodiment may perform measurements for each eye, or may perform measurements for both eyes simultaneously (binocular vision). The ophthalmic apparatus mainly includes, for example, an examination unit, an imaging unit, a drive unit, and a control unit.

[0040] The appearance of the ophthalmologic apparatus will be described with reference to FIG. 1. As shown in FIG. 1, the ophthalmologic apparatus 1 of this embodiment mainly includes an examination unit 2, a face photographing unit 3, and a drive unit 4. The examination unit 2 examines the subject's eye. The examination unit 2 may include, for example, an optical system that measures the subject's eye's refractive power, corneal curvature, intraocular pressure, etc. The examination unit 2 may also include an optical system for photographing the anterior segment, fundus, etc. of the subject's eye. In this embodiment, the examination unit 2 that measures refractive power will be described as an example. The face photographing unit 3 photographs, for example, the face of the subject's eye. The face photographing unit 3 photographs, for example, the face including the left and right eyes. The drive unit 4 moves, for example, the examination unit 2 and the face photographing unit 3 in up, down, left, right, front, and back directions (three-dimensional directions) relative to a base 5.

[0041] Furthermore, the ophthalmologic apparatus 1 of this embodiment may include, for example, a housing 6, a display 7, an operation unit 8, a face support unit 9, etc. For example, the housing 6 houses the examination unit 2, the face photographing unit 3, the drive unit 4, etc.

[0042] The display 7 displays, for example, a face image If captured by the face photographing unit 3, an anterior-eye-segment image Ia captured by the anterior-eye-segment photographing optical system 60, and measurement results. For example, when precision alignment (see FIG. 4 ), which will be described later, is started, the display on the display 7 is switched from the face image If to the anterior-eye-segment image Ia. For example, the face image If and the anterior-eye-segment image Ia may be displayed simultaneously on the display 7. For example, the control unit 70 may cause the display 7 to display either the face image If or the anterior-eye-segment image Ia, whichever is selected by the examiner. In this case, for example, the ophthalmologic apparatus 1 is provided with a selection means (for example, a switch) for selecting whether to display the face image If or the anterior-eye-segment image Ia. Furthermore, the display 7 may be provided integrally with the ophthalmologic apparatus 1 or provided separately from the apparatus.

[0043] For example, the ophthalmologic apparatus 1 may include an operation unit 8. For example, the operation unit 8 includes a pointing device capable of specifying a position on the screen of the display 7. The pointing device may be any of various human interfaces such as a touch panel, a joystick, a mouse, a keyboard, a trackball, or a button. Various operation instructions are input to the operation unit 8 by the examiner.

[0044] In this embodiment, the display 7 has a touch function, and the operation unit 8 also functions as the display 7. That is, the examiner operates the ophthalmic apparatus 1 by touching the display 7. The operation unit 8 is used for various settings of the ophthalmic apparatus 1 and for operations at the start of measurement. In this embodiment, the operation unit 8 is also used by the examiner to specify coordinates (positions) on the face image If displayed on the display 7. For example, two-dimensional coordinate axes (x-axis and y-axis) are set in advance by a program on the display 7, and the position (specified point) touched by the examiner is recognized by the control unit 70 (see FIG. 2). The two-dimensional coordinate axes (x-axis and y-axis) on the display 7 are names given for the purpose of explanation, and are different from the X direction (left-right direction), Y direction (up-down direction), and Z direction (front-back direction) that are directions in which the inspection unit 2 drives.

[0045] In addition, the configuration in which the control unit 70 recognizes input by touch is similar to that described in Japanese Patent Application Laid-Open No. 2014-205078, so please refer to this publication.

[0046] The face support unit 9 may include, for example, a forehead rest 10 and a chin rest 11. The chin rest 11 may be moved in the up and down direction by being driven by a chin rest drive unit 12.

[0047] As shown in FIG. 2, the ophthalmic apparatus 1 includes a control unit 70. The control unit 70 controls various aspects of the ophthalmic apparatus 1. The control unit 70 includes, for example, a general central processing unit (CPU) 71, a flash ROM 72, a RAM 73, and the like. For example, the flash ROM 72 stores a control program for controlling the ophthalmic apparatus 1, initial values, and the like. For example, the RAM temporarily stores various pieces of information. The control unit 70 is connected to the examination unit 2, the face imaging unit 3, the drive unit 4, the display 7, the operation unit 8, the chin rest drive unit 12, a memory unit (for example, a non-volatile memory) 74, and the like. The memory unit 74 is, for example, a non-transitory storage medium that can retain stored contents even when the power supply is cut off. For example, a hard disk drive, a removable USB flash memory, or the like can be used as the memory unit 74.

[0048] The face photographing unit 3 can photograph, for example, a face including the left and right eyes of the subject. For example, as shown in FIG. 3, the face photographing unit 3 of this embodiment includes, for example, a photographing optical system 3A that photographs the face of the subject. The photographing optical system 3A mainly includes, for example, an image sensor 3Aa and an image pickup lens 3Ab. The face photographing unit 3 is, for example, a non-telecentric optical system. This eliminates the need for, for example, a telecentric lens, and allows for a simpler configuration. Furthermore, the photographing range can be wider than with a telecentric optical system.

[0049] The face photographing unit 3 of this embodiment is moved together with the inspection unit 2 by the driving unit 4. Of course, the face photographing unit 3 may be configured to be fixed to a base 5, for example, and not to move.

[0050] In the present embodiment shown in FIG. 1 , the face photographing unit 3 is provided above the examination unit 2, but the position of the face photographing unit 3 is not limited thereto. For example, the face photographing unit 3 may be provided below or to the side of the examination unit 2. In addition, in the present embodiment, the horizontal position of the face photographing unit 3 (the optical axis of the photographing optical system 3A) is the same as the optical axis L2 of the examination unit 2, but this is not limited thereto. For example, assuming that measurement is started from the right eye of the subject, the initial horizontal position of the examination unit 2 may be located on the right eye side as seen from the subject, and the face photographing unit 3 may be located in the horizontal center of the base 5, like the chin rest 11. Of course, the face photographing unit 3 may be provided so that the measurement optical axis of the examination unit 2 and the photographing optical axis of the face photographing unit 3 are coaxial. Furthermore, the face photographing unit 3 may be positioned independently of the movement of the examination unit 2. For example, the face photographing unit 3 may be provided on the base 5 so as to be three-dimensionally drivable, and may be three-dimensionally driven relative to the subject's eye by a drive unit (second drive unit) separate from the drive unit (first drive unit) 4. Of course, as in this embodiment, the first driving unit that moves the inspection unit 2 and the second driving unit that moves the face photographing unit 3 may be used together.

[0051] The examination unit 2 measures, examines, photographs, etc., the subject's eye. The examination unit 2 may include, for example, a measurement optical system that measures the refractive power of the subject's eye. For example, as shown in FIG. 3 , the examination unit 2 may include a measurement optical system 20, a fixation target presenting optical system 40, an alignment target projecting optical system 50, and an observation optical system (anterior eye photographing optical system) 60.

[0052] The measurement optical system 20 has a projection optical system (light projection optical system) 20a and a light receiving optical system 20b. The projection optical system 20a projects a light beam onto the fundus Ef through the pupil of the subject's eye. The light receiving optical system 20b extracts a ring-shaped light beam (fundus reflected light) reflected from the fundus Ef through the pupil periphery and captures a ring-shaped fundus reflected image that is mainly used to measure refractive power.

[0053] The projection optical system 20a has a light source 21, a relay lens 22, a hole mirror 23, and an objective lens 24 on an optical axis L1. The light source 21 projects a spot-shaped light source image from the relay lens 22 to the objective lens 24 and onto the fundus Ef via the center of the pupil. The light source 21 is moved in the direction of the optical axis L1 by a movement mechanism 33. The hole mirror 23 has an opening that allows the light beam from the light source 21 to pass through the relay lens 22. The hole mirror 23 is positioned optically conjugate with the pupil of the subject's eye.

[0054] The light-receiving optical system 20b shares the hole mirror 23 and the objective lens 24 with the projection optical system 20a. The light-receiving optical system 20b also has a relay lens 26 and a total reflection mirror 27. The light-receiving optical system 20b further has a light-receiving diaphragm 28, a collimator lens 29, a ring lens 30, and an image sensor 32 on the optical axis L2 in the reflection direction of the hole mirror 23. A two-dimensional light-receiving element such as an area CCD can be used for the image sensor 32. The light-receiving diaphragm 28, the collimator lens 29, the ring lens 30, and the image sensor 32 are moved in the direction of the optical axis L2 together with the light source 21 of the projection optical system 20a by a movement mechanism 33. When the light source 21 is positioned optically conjugate with the fundus Ef by the movement mechanism 33, the light-receiving diaphragm 28 and the image sensor 32 are also positioned optically conjugate with the fundus Ef.

[0055] The ring lens 30 is an optical element for shaping the fundus reflected light guided from the objective lens 24 via the collimator lens 29 into a ring shape. The ring lens 30 has a ring-shaped lens portion and a light-blocking portion. When the light-receiving diaphragm 28 and the image sensor 32 are positioned optically conjugate with the fundus Ef, the ring lens 30 is positioned optically conjugate with the pupil of the subject's eye. The image sensor 32 receives ring-shaped fundus reflected light (hereinafter referred to as a ring image) via the ring lens 30. The image sensor 32 outputs image information of the received ring image to the control unit 70. As a result, the control unit 70 displays the ring image on the display 7 and calculates refractive power based on the ring image.

[0056] 3, in this embodiment, a dichroic mirror 39 is disposed between the objective lens 24 and the subject's eye. The dichroic mirror 39 transmits light emitted from the light source 21 and fundus reflected light corresponding to the light from the light source 21. The dichroic mirror 39 also guides a light beam from a fixation target presenting optical system 40 (described later) to the subject's eye. Furthermore, the dichroic mirror 39 reflects light reflected from the anterior eye segment from an alignment target projecting optical system 50 (described later) and guides the anterior eye reflected light to an anterior eye photographing optical system 60.

[0057] As shown in FIG. 3, an alignment target projection optical system 50 is disposed in front of the subject's eye. The alignment target projection optical system 50 mainly projects a target image onto the anterior segment of the eye, which is used for aligning the optical system with respect to the subject's eye. The alignment target projection optical system 50 includes a ring target projection optical system 51 and a target projection optical system 52. The ring target projection optical system 51 projects diffused light onto the cornea of ​​the subject's eye E, projecting a ring target 51a. In the ophthalmic apparatus 1 of this embodiment, the ring target projection optical system 51 is also used as an anterior segment illumination system for illuminating the anterior segment of the subject's eye E. The target projection optical system 52 projects parallel light onto the cornea of ​​the subject's eye, projecting an infinity target 52a.

[0058] The fixation target presenting optical system 40 includes a light source 41, a fixation target 42, a relay lens 43, and a reflecting mirror 46 on an optical axis L4 in the reflection direction. The fixation target 42 is used to fixate the subject's eye during objective refractive power measurement. For example, the fixation target 42 is illuminated by the light source 41 and presented to the subject's eye.

[0059] The light source 41 and the fixation target 42 are moved together in the direction of the optical axis L4 by a drive mechanism 48. The presentation position (presentation distance) of the fixation target may be changed by moving the light source 41 and the fixation target 42. This allows refractive power measurement to be performed while fogging the subject's eye.

[0060] The anterior-segment photographing optical system 60 includes an imaging lens 61 and an imaging element 62 on an optical axis L3 in the direction of reflection of the half mirror 63. The imaging element 62 is disposed at a position optically conjugate with the anterior segment of the subject's eye. The imaging element 62 photographs the anterior segment illuminated by the ring target projection optical system 51. The output from the imaging element 62 is input to the control unit 70. As a result, an anterior-segment image Ia of the subject's eye photographed by the imaging element 62 is displayed on the display 7 (see FIG. 2). The imaging element 62 also photographs alignment target images (in this embodiment, the ring target 51a and the infinity target) formed on the cornea of ​​the subject's eye by the alignment target projection optical system 50. As a result, the control unit 70 can detect the alignment target images based on the photographing results of the imaging element 62. The control unit 70 can also determine whether the alignment state is appropriate based on the position at which the alignment target images are detected.

[0061] <Binocular examination> The operation of the ophthalmologic apparatus 1 of this embodiment will be described below with reference to the flowcharts of FIGS. 4 and 5. In this embodiment, for example, detection of the pupil position of the subject's eye based on the facial image If, ​​coarse alignment based on the detected pupil position, and fine alignment based on the anterior eye image Ia are automatically performed. The control unit 70 performs measurement (examination) after the fine alignment is completed. The flowcharts of FIGS. 4 and 5 are for the case where the subject's right eye and left eye are successively examined.

[0062] In this embodiment, the position of the pupil is detected as the position of the subject's eye, but the present disclosure is not limited to this, and other characteristic parts such as the inner corner of the eye may also be detected.

[0063] (1) When the position of the subject's eye is correctly detected by analyzing the facial image. First, a case where the position of the eye to be examined is normally detected by analyzing the face image captured by the face photographing unit 3 will be described.

[0064] For example, in an initial state before the start of the examination, the examination unit 2 is positioned at a rear position away from the subject and at the center of the base 5. In this state, as shown in FIG. 7 , a facial image If including the subject's left and right eyes to be examined is captured by the facial imaging unit 3, and the control unit 70 acquires the facial image If. The control unit 70 analyzes the acquired facial image If and detects the positions of the left and right pupils (pupil EPR of the right eye and pupil EPL of the left eye) (S101). The pupil positions of the subject's eyes identified by the detection are acquired as the detected positions. For example, the control unit 70 may detect the edges of the facial image and detect the positions of the pupils from the facial image based on the edges' shapes, etc. See, for example, the method described in Japanese Patent Application Laid-Open No. 2017-196304 for an example of a pupil detection method.

[0065] Thereafter, if there is no input to the display 7 (touch panel) (S102: No) and the control unit 70 determines that the pupil positions of both eyes have been detected based on the facial image (S103: Yes), the direction in which the inspection unit will be moved is set based on the detected left and right pupil positions (S104), and rough alignment is performed (S105).

[0066] A brief description will be given of a method for setting the direction in which the control unit 70 moves the examination unit 2 in S104. Note that, for the left and right eyes to be examined, the eye to be examined first is programmed in advance. For example, it is preset so that the examination starts from the right eye.

[0067] The control unit 70 identifies the pupil EPR of the right eye from among the pupil positions of both eyes detected by analyzing the face image If. The control unit 70 performs calculations based on the identified position (x, y) (two-dimensional coordinates) of the pupil EPR of the right eye, and determines the direction (three-dimensional coordinates) in which the pupil EPR of the right eye is located relative to the examination unit 2. Thereafter, the control unit 70 controls the driving of the drive unit 4 to move the examination unit 2 in the determined direction, thereby performing rough alignment with the right eye (S105).

[0068] Note that for a method of determining the direction in which the test eye is located from the coordinates on the facial image If (i.e., a coarse alignment method), the technology described in previous publications (e.g., Patent Publication No. 2017-64058, Patent Publication No. 2019-63043) can be used, so please refer to these publications.

[0069] Next, the control unit 70 shifts from coarse alignment to fine alignment (S109). For example, while the inspection unit 2 is being moved for coarse alignment, the control unit 70 analyzes the anterior eye image Ia captured by the anterior eye imaging optical system 60. As a result of analyzing the anterior eye image Ia, when the alignment index projected onto the cornea by the alignment index projecting optical system 50 becomes detectable, the control unit 70 shifts from coarse alignment to fine alignment.

[0070] For example, in the precision alignment in this embodiment, the control unit 70 controls the driving of the drive unit 4 based on the alignment index projected by the alignment index projection optical system 50, and performs XY-direction alignment to align the measurement optical axis of the examination unit 2 with the center of the cornea or the center of the pupil, and Z-direction alignment to adjust the distance between the examination unit and the cornea of ​​the subject's eye to a predetermined working distance.

[0071] For example, in this embodiment, the control unit 70 performs alignment in the XY directions by changing the position of the examination unit 2 so that the measurement optical axis of the examination unit 2 coincides with the center of the cornea based on the ring target 51a projected by the ring target projection optical system 51 (alignment in the XY directions). For example, the cornea center and the measurement optical axis are aligned by changing the position of the examination unit 2 in the XY directions so that the center of the ring of the ring target 51a coincides with the measurement optical axis.

[0072] For example, in this embodiment, the control unit 70 detects the alignment state in the working distance direction based on the ratio between the spacing of the infinity index 52a projected by the index projection optical system 52 and the diameter of the ring index 51a projected by the ring index projection optical system 51, as alignment in the Z direction, and moves the inspection unit 2 based on the detection result. Note that the working distance alignment technology can utilize, for example, the technology disclosed in Japanese Patent Laid-Open Publication No. 10-127581, so please refer to this publication for details. Note that the alignment method based on these indexes is an example of precision alignment, and is not limited to this configuration and method.

[0073] Next, when the precise alignment is completed, the control unit 70 automatically issues a trigger signal to start measurement, and starts measurement of the eye to be examined by the measurement optical system 20 of the examination unit 2. For example, the examination unit 2 measures the ocular refractive power of the eye to be examined (S110).

[0074] Next, the control unit 70 controls the driving of the driving unit 4 based on the position corresponding to the unmeasured left eye pupil EPL among the positions of the left and right pupils acquired in S101, and performs rough alignment (S111).

[0075] Thereafter, the control unit 70 performs precision alignment in the same manner as that performed on the eye to be examined that has already been measured (S112), and when the alignment is complete, automatically issues a trigger signal to perform measurement (S113).

[0076] (2) When a specified position is entered for a face image Next, the operation when a designated position is input for the face image If will be described, focusing on the difference from the operation when the position of the eye to be examined is normally detected (when a designated position is not input).

[0077] The control unit 70 starts detecting the pupil positions of the left and right eyes by analyzing the face image If captured by the face capturing unit 3 (S101). Here, the position of the subject's eye may be erroneously detected due to the subject's mascara, eyelashes, ptosis, etc., which may result in failure of pupil detection by face image analysis (i.e., an acquisition error). Note that erroneous detection of the position of the subject's eye also includes cases where the position of the subject's eye is not detected. At this time, the control unit 70 determines whether pupil detection by face image analysis was successful within a predetermined time (S103). Furthermore, if the pupil position is not captured within the predetermined time (timeout), the control unit 70 determines that pupil detection has failed (acquisition error).

[0078] If pupil detection fails (S103: No), the control unit 70 performs error processing (S106). In this embodiment, for example, as error processing, the control unit 70 displays on the display 7 a message that the position of the subject's eye (pupil position) has not been detected properly, and notifies the user that a position corresponding to the subject's eye needs to be specified using the operation unit 8. For example, as shown in FIG. 8, the control unit 70 displays a message 201 instructing the user to touch the pupil on the face image displayed on the display 7 (see FIG. 8). The message 201 is cleared when an "OK" display 201a is touched, and the display 7 transitions to a state in which it can accept input.

[0079] When a facial image is displayed on the display 7 and the examiner touches the screen of the display 7 to specify a position on the facial image (S102), the control unit 70 acquires the position on the facial image touched by the examiner as the pupil position instead of the pupil position detected by the facial image analysis in S101, and performs coarse alignment by controlling the drive unit 4 using the input specified position.

[0080] Note that touching the display 7 is one example of a method for specifying the pupil position on the face image, and is not limited to this. For example, the pupil position on the face image may be specified by a mouse or a button.

[0081] 9, when two designated positions, a designated position SP1 corresponding to the right eye of the subject and a designated position SP2 corresponding to the left eye, can be input for the face image If, ​​the control unit 70 waits to start the coarse alignment until the second designated position is input. If the second designated position is not input within a predetermined time, the control unit 70 may display a message to prompt the input of the second designated position. Of course, displaying this message is one example of a notification means, and the present invention is not limited to this. The examiner may be prompted to input the designated position by other means, such as sound or flashing light.

[0082] The face image If displayed on the display 7 when the examiner inputs the designated position corresponding to the eye to be examined may be a moving image captured by the face photographing unit 3 or a still image.

[0083] For example, when a position on the facial image If is specified on a moving image, the control unit 70 may display on the display 7 a still image of the facial image If at the time the specified position is input. For example, the control unit 70 may temporarily switch the display on the display 7 from a moving image to a still image while the examiner is touching the display 7 to input the specified position. Of course, the specified position on the still image may be changeable by the examiner's input. For example, the control unit 70 may stop pupil detection processing based on the facial image while the examiner is changing the specified position on the still image.

[0084] When a designated position corresponding to the eye to be examined is input for the face image If, ​​the control unit 70 acquires the coordinates of the designated position, determines the direction in which to move the inspection unit 2 based on the acquired coordinates (S107), and controls the drive unit 4 to perform coarse alignment of the inspection unit 2 (S108). A method for performing coarse alignment based on the input of the designated position will be described below with reference to the flowchart in FIG.

[0085] When two positions are specified within a predetermined time on the face image displayed on the display 7, the control unit 70 acquires the coordinates of each of the specified positions on the face image If displayed on the display 7 (S201). For example, in this embodiment, when the examiner touches the positions of the left and right pupils on the face image If displayed on the display 7, the coordinates of positions SP1 and SP2 corresponding to the pupils of the left and right eyes to be examined are acquired, respectively (see FIG. 9).

[0086] To allow the examiner to identify the touched position, the control unit 70 may control the display of the display 7 to superimpose visually distinguishable marks on the touched positions SP1 and SP2. Furthermore, to prevent the examiner from confusing the right and left of the subject's eye in the facial image If displayed on the display 7, the control unit 70 may display a right-left display 76, consisting of a right-side display 76R indicating the subject's right eye on the left side of the facial image If and a left-side display 76L indicating the subject's left eye on the right side of the facial image If. The control unit 70 may also display a clear button 78 to allow the examiner to redo the input if the examiner touches the face image If by mistake. For example, when the clear button 78 is pressed, the control unit 70 discards the input position and accepts another input from the examiner. Furthermore, the control unit 70 may store the facial image If and the mark at the input position when the specified position is input to the facial image If in the storage unit 74. In this case, the control unit 70 may call up the image and display it on the display 7, thereby enabling the examiner to confirm the specified position.

[0087] Furthermore, when the examiner specifies the same positions of the left and right eyes to be examined two or more times, the control unit 70 may acquire the last input position as the specified position. In this case, the control unit 70 may detect that the same positions of the left and right eyes to be examined have been input using a determination means described later.

[0088] Next, the control unit 70 determines which of the two designated positions corresponds to the left or right eye of the subject (S202). For example, the control unit 70 determines whether the eye is left or right based on the positional relationship between the two designated positions. That is, the control unit 70 refers to the coordinates on the display 7 for each of the two designated positions and compares the positions in the x direction. This allows the control unit 70 to determine the left-right relationship between the two designated positions. For example, the left designated position can be associated with the right eye of the subject, and the right designated position can be associated with the left eye of the subject. Furthermore, the determination of left or right regarding the two designated positions may be performed based on the positional relationship of the designated positions with respect to the facial image If. That is, the designated position located on the left side of the facial image If is determined to correspond to the right eye, and the designated position located on the right side of the facial image If is determined to correspond to the left eye. Note that the left and right areas are, for example, areas that are experimentally determined in advance.

[0089] Next, the control unit 70 determines a designated position corresponding to the one of the two positions predetermined for first measurement based on the result of left / right discrimination performed in S202, and calculates the direction to move the inspection unit 2 based on the coordinates of the position corresponding to the determined eye to be examined (S203). The method for determining the direction to move the inspection unit 2 for rough alignment can be achieved by replacing the two-dimensional coordinates (x, y) on the face image, which are the position of the pupil detected by analyzing the face image in the above-mentioned S105, with the coordinates (x, y) of the designated position designated by the examiner.

[0090] In this embodiment, which of the left and right test eyes is to be measured first is set in advance and stored in the storage unit 74. Alternatively, instead of determining in advance which eye is to be measured first, the eye corresponding to the first of the two positions specified by the examiner in S201 may be measured first. In this case, the control unit 70 matches the left / right discrimination result with the left / right measurement result.

[0091] Next, the control unit 70 controls the drive unit 4 based on the specified position to move the examination unit 2 in the obtained direction, thereby performing coarse alignment (S108). Note that in the coarse alignment, the position of the chin rest 11 may be adjusted based on the specified position for the face image If. For example, if the position of the subject's eye in the Y direction corresponding to the specified position is outside the movement range of the examination unit 2 (optical axis L1) caused by the drive unit 4, the control unit 70 may control the drive of the chin rest drive unit 12 to move the chin rest 11 in the Y direction so that the position of the subject's eye corresponding to the specified position falls within the movement range of the examination unit 2.

[0092] Next, similar to when the position of the subject's eye is normally detected by analyzing the face image described above, when the alignment index projected onto the anterior eye segment by the alignment index projection optical system 50 is detected by analyzing the anterior eye segment image, the control unit 70 shifts from control for performing coarse alignment to control for performing fine alignment. The control unit 70 controls the driving of the drive unit 4 to perform fine alignment based on the alignment index from the anterior eye segment image (S109). When the fine alignment is completed, the control unit 70 performs measurement of the subject's eye (S110).

[0093] Thereafter, the control unit 70 performs coarse alignment for the unmeasured eye of the left or right eye to be examined (S111). In this case, the control unit 70 determines the direction in which to move the inspection unit 2 using the coordinates (x, y) corresponding to the other unmeasured eye to be examined, among the coordinates of the designated position for the face image If acquired in S107. Then, the control unit 70 performs coarse alignment by moving the inspection unit 2 in the determined direction (S111).

[0094] Thereafter, the control unit 70 performs precision alignment (S112) and measurement (S113) in the same manner as that performed on the first measured eye.

[0095] As a result of the above, even if the position of the subject's eye is not properly detected by analyzing the facial image, smooth automatic alignment can be performed while reducing the examiner's workload compared to manual alignment by the examiner.

[0096] <Monocular test> Next, an example of a monocular examination (examination of only one of the two eyes to be examined) will be described. For example, the ophthalmologic apparatus 1 is provided with an eye-to-be-examined selection switch (eye-to-be-examined selection means) (not shown) that can select a binocular examination mode for consecutively examining the right and left eyes of the examinee, a right eye examination mode for selectively examining only the right eye of the two eyes to be examined, and a left eye examination mode for examining only the left eye.

[0097] Here, when a single eye test for the right or left eye is selected, the right eye of the subject is displayed on the left side of the screen and the left eye is displayed on the right side of the screen in the facial image displayed on the screen of the display 7, and the left and right eyes of the subject are displayed in reverse left and right directions as seen by the examiner. For this reason, in a single eye test, the examiner may mistakenly recognize the left and right of the subject's eye and specify the position of the wrong eye.

[0098] Therefore, the control unit 70 guides the examiner to input a designated position toward the selected eye in the facial image. For example, the control unit 70 controls the display on the display 7 to provide guidance so that the examiner can recognize the eye that is to be touched.

[0099] For example, when the right eye is selected, the control unit 70 displays the face image If on the display 7 with a difference in brightness between the left region from the center of the face image and the right region from the center of the face image, as shown in Fig. 10. This guidance display can guide the user to touch the eye to be examined that is included in the higher brightness (highlighted side) of the left and right sides of the face image and specify the position.

[0100] Furthermore, the guidance display is not limited to the example in Fig. 10. For example, with regard to the right display 76R and the left display 76L in Fig. 9, the display of the eye selected by the subject's eye selection switch may be displayed so as to be distinguishable from the other. For example, the control unit 70 changes the display corresponding to the selected eye to a predetermined color (e.g., orange).

[0101] <Example of transformation> In the above embodiment, as an example of performing coarse alignment using designated positions (SP1, SP2), when the designated positions (SP1, SP2) are input via the operation unit 8, the drive of the drive unit 4 is switched from control based on the detection result of the position of the subject's eye detected by analyzing a facial image to control based on the designated positions. However, this is not limited to this. For example, when the designated positions are input via the operation unit 8, the face image may be analyzed to detect the pupil position within a predetermined area (AP1, AP2) based on the designated positions (SP1, SP2), and the drive unit 4 may be driven based on the pupil position (EPR, EPL) detected by analysis of the predetermined area (see FIG. 11). This control method is preferably applied to cases where the wrong part is detected as the pupil due to poor pupil position detection through facial image analysis (e.g., cases where the pupil is erroneously detected due to hair, shadows of a mask covering the nose and mouth, black areas in the background outside the face, noise from reflected light due to makeup, moles, an eye patch, a scar, eyebrows, eyelashes, etc.). This control method is also suitable for use when the examiner touches the display 7 with his / her finger, even if the examiner is not highly skilled and is unable to accurately touch and specify the position of the pupil.

[0102] Furthermore, when the eye to be examined is not detected as a result of performing face image analysis within the predetermined area (AP1, AP2), the control unit 70 may perform alignment with the designated positions (SP1, SP2). In this case, the control unit 70 may notify the examiner that the eye to be examined has not been detected and that alignment with the designated positions (SP1, SP2) will be performed by displaying a message on the display 7.

[0103] In order to detect that an incorrect region has been detected as the pupil, the control unit 70 may calculate reliability based on the characteristics of the detected region (for example, the difference in contrast with the surroundings or the shape). For example, the reliability is a value that evaluates the characteristics of the detected region. For example, if the reliability is lower than a predetermined threshold, the control unit 70 may determine that an incorrect region has been detected as the pupil and request the examiner to input a specified position.

[0104] Furthermore, control of coarse alignment using the designated positions (SP1, SP2) may be performed as follows. That is, for example, if an incorrect region is detected as the pupil during pupil position detection by analyzing a facial image, multiple candidate regions 75a, 75b, 75c, 75d, 75e, 75f, and 75g detected as the pupil are displayed on the display 7, as shown in FIG. 12. The examiner checks the display of these candidate regions 75a-75g and designates the position of an area to be identified as the pupil by touching it. As a result, the control unit 70 limits the area of ​​the designated position to be the target for pupil position detection, and controls the drive unit 4 based on the pupil position detected by the analysis to perform coarse alignment.

[0105] In the above embodiment, the input of the designated position for the facial image is performed when detection of the position of the subject's eye fails (in the case of an acquisition error), but this is not limited to this. For example, if detection of the position of the subject's eye based on the facial image takes a long time, coarse alignment may not be performed for a long time, and the examiner may wait without operating the ophthalmic apparatus 1, which may make the time until transition to fine alignment seem long. To ensure successful automatic alignment even in such cases, when the control unit 70 receives input of a designated position via a touch panel or the like while detecting the position of the subject's eye based on the facial image, the control unit 70 may perform coarse alignment based on the input of the designated position, regardless of the detection of the position of the subject's eye based on the facial image.

[0106] In the above embodiment, the coarse alignment is performed after the examiner designates two pupil positions in the facial image If. However, the coarse alignment may be performed after one designated position is input. Alternatively, for example, if the second designated position is not input within a predetermined time, the coarse alignment may be started using the first designated position. The control in this case will be described with reference to the flowcharts in FIGS. 4 and 6.

[0107] In the flowchart of FIG. 4, when an input is made to the display 7 in S102, the control unit 70 acquires the coordinates of the designated position in S107 and uses the result to determine the direction in which to move the examination unit 2. The processing of S107 when there is one designated position is shown in the flowchart of FIG. 6. The control unit 70 accepts input specifying one position as the pupil position for a predetermined period of time and acquires the coordinates of the designated position (S301). Note that if no input is made within the predetermined period of time, for example, the device times out. When the timeout occurs, for example, the control unit 70 may notify the examiner to touch the face image displayed on the display 7 and input the pupil position.

[0108] Next, the control unit 70 determines whether the designated position corresponds to the left or right eye to be examined (S302). As an example of a method of determination, the control unit 70 can determine that the position of the right eye to be examined has been designated when the left half of the face image from the left-right central axis has been touched, and can determine that the position of the left eye to be examined has been designated when the right half of the face image from the left-right center has been touched. Note that the left-right center is an example of a criterion for dividing the face image, and may differ depending on the configuration of the device.

[0109] Next, based on the coordinates (two-dimensional coordinates) (x, y) on the specified face image, the direction to move the inspection unit 2 is determined (S303), and coarse alignment is performed (S108 in FIG. 4). This coarse alignment can be performed in the same way as when the positions of both eyes to be inspected are specified and coarse alignment is performed for one of them. That is, coarse alignment can be performed by replacing the alignment control based on the coordinates (x, y) obtained by analyzing the face image with the coordinates (x, y) on the specified face image.

[0110] Next, the control unit 70 performs precision alignment in the same manner as described above (S109), and performs measurement of the aligned eye to be examined (S110).

[0111] Next, the control unit 70 performs coarse alignment for the unmeasured subject's eye (S111). If the input position of the subject's eye is one, after completing measurement of the subject's eye for which a designated position has been input based on the left / right discrimination result in S302, the control unit 70 identifies the subject's eye for which a designated position has not been input, and moves the inspection unit 2 in the direction of that subject's eye to perform coarse alignment.

[0112] Because the left and right test eyes are at approximately the same height in the Y direction, the control unit 70 does not move the test unit 2 in the Y direction, but instead controls the drive unit 4 to move it in the X direction. At this time, the control unit 70 moves the test unit 2 in the direction where the other eye is located based on the result of left-right discrimination. The positions of the left and right test eyes are approximately equal relative to the center of the test eye. Therefore, the amount of movement of the test unit 2 in the X direction can be obtained based on the amount of movement of the test unit 2 relative to the reference position (center position) of the base 5 when one test eye is measured. For example, the amount of movement of the test unit 2 in the X direction relative to the reference position (center position) of the base 5 can be obtained from the X-direction drive data of the drive unit 4. Furthermore, because the position of the test unit 2 in the Z direction relative to the left and right test eyes can be considered to be approximately the same, the Z-direction position of the test unit 2 when measuring one eye can be used. As a result, the control unit 70 performs coarse alignment for the other eye to be examined, analyzes the anterior eye image Ia acquired by the anterior eye imaging optical system 60, and if an alignment target is detected, performs fine alignment based on the detection result. After completing the fine alignment, the control unit 70 automatically issues a trigger signal to perform measurement using the measurement optical system 20. When the control unit 70 obtains measurement results for both eyes, it outputs separate measurement results for the left and right eyes that correspond to the left / right discrimination result in S302.

[0113] According to the above, even when the examiner inputs the position of only one of the left and right eyes to be examined, alignment can be performed satisfactorily.

[0114] In this embodiment, for example, the facial image If displayed on the display 7 may be enlarged or reduced. For example, the examiner may be able to enlarge or reduce the image by pinching on the touch panel. In this case, for example, the examiner may be able to specify the position of the subject's eye in the Z direction based on the amount by which the facial image is enlarged or reduced.

[0115] The ophthalmologic apparatus 1 may also be configured to use machine learning to increase the accuracy with which the control unit 70 detects the subject's eye from the facial image If from the next time onward, based on information about a position specified on the facial image If. In this case, the control unit 70 acquires parameters such as the coordinates of the position specified on the facial image and the contrast difference between the specified position and its surroundings as success factors. For example, based on the acquired success factors, the control unit 70 increases the accuracy with which the control unit 70 detects the subject's eye from the next time onward by analyzing the facial image. [Explanation of symbols]

[0116] 1 Ophthalmology equipment 2. Inspection Department 3. Face Photography Section 4 Drive unit 5 bases 7. Display 8 Control section 20 Measurement optical system 70 Control Unit

Claims

1. An ophthalmic apparatus including an examination unit for examining an eye to be examined, a driving means for three-dimensionally moving the examination unit relative to the subject's eye; a first image capturing means for capturing a facial image including the left and right eyes of the subject; a second imaging means for capturing an image of the anterior segment of the subject's eye; a display means for displaying at least the facial image; a first acquisition means for detecting a position of the subject's eye by analyzing the face image and acquiring the position of the subject's eye identified by the detection as a detected position; a second acquisition means for displaying the face image before the first acquisition means completes the process of detecting the position of the subject's eye, receiving an input operation for the position of the subject's eye relative to the displayed face image, and acquiring the position of the subject's eye identified based on the input operation as a designated position; a position acquisition step of acquiring the detected position as the position of the subject's eye when the detected position is acquired by the first acquisition step, and acquiring the designated position as the position of the subject's eye when the designated position is acquired by the second acquisition step after the detection process of the position of the subject's eye by the first acquisition step has started, regardless of whether the detected position has been acquired; a first drive control step of controlling the drive means based on the acquired position of the subject's eye so that the subject's eye is included in an imaging range of the second imaging means; and a second drive control step of controlling the drive means based on the anterior eye image after the first drive control step, and adjusting the relative position of the examination unit with respect to the subject's eye, When the left eye and the right eye are successively examined, the control means can collectively acquire the positions of the left eye and the right eye in the position acquisition step in the adjustment process for one of the left eye and the right eye to be examined first, The ophthalmologic apparatus according to claim 1, wherein, when the positions of the left eye and the right eye are acquired collectively in the position acquisition step, the input operation for each eye can be requested.

2. 2. The ophthalmic apparatus according to claim 1, The ophthalmic device is characterized in that the control means performs the first drive control step using the designated position corresponding to one of the test eyes in a predetermined procedure, and after the examination of one of the test eyes is completed, performs the first drive control step using the designated position corresponding to the other eye.

3. An ophthalmic device having an examination unit for examining a subject's eye, a driving means for three-dimensionally moving the examination unit relative to the subject's eye; a first image capturing means for capturing a facial image including the left and right eyes of the subject; a second imaging means for capturing an image of the anterior segment of the subject's eye; a display means for displaying at least the facial image; a first acquisition means for detecting a position of the subject's eye by analyzing the face image and acquiring the position of the subject's eye identified by the detection as a detected position; a second acquisition means for displaying the face image before the first acquisition means completes the process of detecting the position of the subject's eye, receiving an input operation for the position of the subject's eye relative to the displayed face image, and acquiring the position of the subject's eye identified based on the input operation as a designated position; a position acquisition step of acquiring the detected position as the position of the subject's eye when the detected position is acquired by the first acquisition step, and acquiring the designated position as the position of the subject's eye when the designated position is acquired by the second acquisition step after the detection process of the position of the subject's eye by the first acquisition step has started, regardless of whether the detected position has been acquired; a first drive control step of controlling the drive means based on the acquired position of the subject's eye so that the subject's eye is included in an imaging range of the second imaging means; and a second drive control step of controlling the drive means based on the anterior eye image after the first drive control step, and adjusting the relative position of the examination unit with respect to the subject's eye, a discrimination means for discriminating between left and right of the subject's eye based on whether the designated position exists in a right eye region or a left eye region in the image captured by the first photographing means when the designated position is one by the input operation; The control means After the first drive control step is performed based on the input designated position, the process proceeds to the second drive control step; determining whether the examination unit should be moved relative to the eye to be examined based on the discrimination result of the discrimination means in order to examine the unexamined eye after completing the examination of one of the eyes to be examined, an ophthalmologic apparatus that controls the driving means so that the examination unit approaches the unexamined subject's eye based on the determined left and right, and then proceeds to the second drive control step.

4. A control program executed in an ophthalmologic apparatus including: a driving means for three-dimensionally moving an examination unit for examining an eye to be examined relative to the eye to be examined; a first photographing means for photographing a facial image including the right and left eyes to be examined; a second photographing means for photographing an anterior eye image of the eye to be examined; and a display means for displaying at least the facial image, By executing the control unit of the ophthalmic device, a first acquisition step of detecting a position of the subject's eye by analyzing the face image and acquiring the position of the subject's eye identified by the detection as a detected position; a second acquisition step of displaying the face image before the completion of the process of detecting the position of the subject's eye by the first acquisition step, accepting an input operation of the position of the subject's eye relative to the displayed face image, and acquiring the position of the subject's eye identified based on the input operation as a designated position; a position acquisition step of acquiring the detected position as the position of the subject's eye when the detected position is acquired by the first acquisition step, and acquiring the designated position as the position of the subject's eye when the designated position is acquired by the second acquisition step after the detection process for the position of the subject's eye by the first acquisition step has started, regardless of whether the detected position has been acquired; a first drive control step of controlling the drive means based on the acquired position of the subject's eye so that the subject's eye is included in the imaging range of the second imaging means; and a control step of executing an adjustment process, including: a first drive control step of controlling the drive means based on the anterior eye image after the first drive control step, and adjusting the relative position of the examination unit with respect to the subject's eye; and causing the ophthalmic device to execute the above. When the left eye and the right eye are successively examined, the positions of the left eye and the right eye can be acquired collectively in the position acquiring step in the adjustment process for one of the left eye and the right eye to be examined first, a control program, wherein, in the position acquisition step, when the positions of the left eye and the right eye are acquired simultaneously, the input operation for each eye can be requested.

5. A control program executed in an ophthalmic device comprising: a driving means for moving an examination unit for examining an eye to move three-dimensionally relative to the eye; a first photographing means for photographing a facial image including the left and right eyes to be examined; a second photographing means for photographing an image of the anterior segment of the eye to be examined; and a display means for displaying at least the facial image, By executing the control unit of the ophthalmic device, a first acquisition step of detecting a position of the subject's eye by analyzing the face image and acquiring the position of the subject's eye identified by the detection as a detected position; a second acquisition step of displaying the face image before the completion of the process of detecting the position of the subject's eye by the first acquisition step, accepting an input operation of the position of the subject's eye relative to the displayed face image, and acquiring the position of the subject's eye identified based on the input operation as a designated position; a position acquisition step of acquiring the detected position as the position of the subject's eye when the detected position is acquired by the first acquisition step, and acquiring the designated position as the position of the subject's eye when the designated position is acquired by the second acquisition step after the detection process for the position of the subject's eye by the first acquisition step has started, regardless of whether the detected position has been acquired; a first drive control step of controlling the drive means based on the acquired position of the subject's eye so that the subject's eye is included in the imaging range of the second imaging means; and a control step of executing an adjustment process, including: a first drive control step of controlling the drive means based on the anterior eye image after the first drive control step, and adjusting the relative position of the examination unit with respect to the subject's eye; and causing the ophthalmic device to execute the above. When the number of designated positions input by the input operation is one, a determination step is executed in which the designated position exists in a right eye region or a left eye region in the image captured by the first photographing means, and After the first drive control step is performed based on the input designated position, the process proceeds to the second drive control step; A control program characterized by determining the left or right side to move the examination unit relative to the eye to be examined based on the discrimination result of the discrimination step in order to examine the unexamined eye after completing the examination of one of the left and right eyes, controlling the drive means so that the examination unit approaches the unexamined eye to be examined based on the determined left or right side, and transitioning to the second drive control step.

Citation Information

Patent Citations

  • Opthalmonogy device

    JP1998216089A

  • Ophthalmologic instrument

    JP2006288610A

  • Eye image photographing device and authentication device

    JP2009015518A

  • Spectacle wearing parameter measuring apparatus, spectacle wearing parameter measurement program and position designation method

    JP2015064700A

  • Ophthalmic apparatus and ophthalmic apparatus control program

    JP2017064058A