Ophthalmic device and control method thereof
By using multiple cameras in the ophthalmic device to take the anterior eye image of the examined eye from different directions, detect the pupil image and judge the face support status, the problem of reducing the accuracy of eye characteristics acquisition caused by the face not being properly supported is solved, and high-precision and reliable eye characteristics acquisition are achieved.
Patent Information
- Application Number
- CN202080074739.0
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Priority Date
- 2019-10-29
- Filing Date
- 2020-09-30
- Publication Date
- 2025-08-22
- Estimated Expiration
- 2040-09-30
AI Technical Summary
In an ophthalmic device, if the face of the subject is not properly supported, the accuracy of eye characteristics acquisition will be reduced or failed, and the prior art cannot effectively solve this problem.
By setting a face support part in an ophthalmic device, multiple cameras take the anterior eye image of the examined eye from different directions, detect the pupil image, and judge whether the face is correctly supported by estimation and judgment components, automatic alignment and support position adjustment are achieved.
It realizes high-precision acquisition of eye characteristics when the face of the subject is correctly supported, improves the reliability and accuracy of the ophthalmic device, and reduces the operating burden and time of the detector.
Smart Images

Figure CN114615922B_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to an ophthalmic apparatus including a face support portion for supporting a subject's face and a control method thereof. Background Art
[0002] In ophthalmology, ophthalmic devices acquire (measure, photograph, and observe, etc.) various eye characteristics of the eye under examination, such as fundus photographic images, fundus tomographic images, eye refractive power, intraocular pressure, number of corneal endothelial cells, and corneal shape. In this case, from the perspective of the precision, accuracy, and image quality of the acquired eye characteristics, the alignment, i.e., the position of the probe (optical system) of the ophthalmic device relative to the eye under examination is very important. Therefore, in ophthalmic devices, so-called fully automatic alignment (hereinafter simply referred to as automatic alignment) is usually performed, that is, the relative position of the eye under examination with respect to the probe is detected while the face of the subject is supported by a face support such as a chin rest, and based on the detection result, the optical system is moved relative to the eye under examination, thereby automatically performing alignment.
[0003] For example, Patent Documents 1 and 2 disclose an ophthalmologic device that uses a stereo camera positioned opposite a face supported by a face support to simultaneously image the anterior ocular portion of a subject's eye from different directions. This ophthalmologic device automatically aligns a probe with respect to the subject's eye based on the three-dimensional position of the subject's eye obtained by analyzing the images captured by the stereo camera.
[0004] Prior art literature
[0005] Patent Literature
[0006] Patent Document 1: Japanese Patent Application Laid-Open No. 2013-248376
[0007] Patent Document 2: Japanese Patent Application Laid-Open No. 2014-200678 Summary of the Invention
[0008] Problems to be solved by the invention
[0009] However, if the subject's face is not properly supported by a face support such as a chin rest, for example, if the subject's face is lifted off the chin rest, the face (the subject's eye) may move while acquiring the eye characteristics of the subject's eye. As a result, the accuracy of the acquired eye characteristics may decrease or the acquisition of the eye characteristics may fail. For example, if the face moves during fundus photography of the subject's eye, the fundus image may be blurred or halos may appear, or the photography may fail. No matter how the accuracy of automatic alignment is improved, this problem cannot be solved.
[0010] The present invention has been made in view of the above circumstances, and an object of the present invention is to provide an ophthalmologic apparatus and a control method thereof, which are capable of acquiring the ocular characteristics of an eye to be examined with high accuracy and reliability.
[0011] Means used to solve problems
[0012] An ophthalmic device for achieving the purpose of the present invention comprises: a face support portion that supports the face of an examinee; an anterior ocular image acquisition portion that repeatedly acquires an anterior ocular image of the examinee's eye of the face supported by the face support portion; a pupil image detection portion that detects the pupil image of the examinee's eye for each anterior ocular image based on the anterior ocular images repeatedly acquired by the anterior ocular image acquisition portion; and a judgment portion that judges whether the face is correctly supported by the face support portion based on the detection result of the pupil image of each anterior ocular image by the pupil image detection portion.
[0013] According to this ophthalmologic apparatus, the ocular characteristics of the eye to be examined can be acquired in a state in which the face of the subject is correctly supported by the face support portion.
[0014] In another aspect of the ophthalmologic apparatus of the present invention, an anterior segment image acquisition unit repeatedly acquires anterior segment images from a plurality of cameras, the plurality of cameras capturing an eye under examination from mutually different directions. A pupil image detection unit includes: a first detection unit for detecting a pupil image from an anterior segment image captured by a first camera among the plurality of cameras; an estimation unit for estimating, based on a detection result of the first detection unit, an existing range of a pupil image that is included in an anterior segment image captured by a second camera among the plurality of cameras, different from the first camera, and that moves in response to slight fixation movements of the eye under examination; a second detection unit for detecting a pupil image within the existing range of the anterior segment image captured by the second camera, based on an estimation result of the estimation unit; and a repetitive control unit for repeatedly operating the first detection unit, the estimation unit, and the second detection unit each time the anterior segment image acquisition unit acquires an anterior segment image. A judgment unit for judging whether the face of the subject is correctly supported by the face support unit based on the repeated detection results of the second detection unit. Thus, ocular characteristics of the subject's eye can be acquired while the subject's face is correctly supported by the face support unit.
[0015] In an ophthalmic device in another embodiment of the present invention, the anterior segment image acquisition unit performs a first image acquisition process and a second and subsequent image acquisition process. In the first image acquisition process, the anterior segment image is acquired by a first camera and a second camera that photograph the inspected eye from different directions. In the second and subsequent image acquisition processes, the anterior segment image is repeatedly acquired from the second camera. The pupil image detection unit includes: a first detection unit that detects a pupil image from the anterior segment image acquired by the anterior segment image acquisition unit from the first camera in the first image acquisition process; and an estimation unit that estimates the pupil image of the anterior segment based on the detection result of the first detection unit. The pupil image included in the anterior ocular image acquired by the eye image acquisition unit from the second camera is also estimated based on the presence range of the pupil image, which moves due to slight fixation movement of the examined eye. The second detection unit detects the pupil image within the presence range of the anterior ocular image acquired by the anterior ocular image acquisition unit from the second camera based on the estimation result of the estimation unit. The repetition control unit repeatedly operates the second detection unit each time the anterior ocular image acquisition unit acquires an anterior ocular image from the second camera in subsequent image acquisition processes. The judgment unit determines whether the face is correctly supported by the face support unit based on the repeated detection results of the second detection unit. This can shorten the time required for the judgment unit to complete the judgment.
[0016] In another embodiment of the ophthalmic device of the present invention, the determination unit determines that the face is correctly supported by the face support unit if the pupil image is detected within the presence range for a predetermined time or longer based on repeated detection results by the second detection unit. If the pupil image is not detected within the presence range for a predetermined time or longer, the determination unit determines that the face is not correctly supported by the face support unit. Thus, the ophthalmic characteristics of the subject's eye can be acquired while the subject's face is correctly supported by the face support unit.
[0017] In another embodiment of the ophthalmic device of the present invention, the estimation unit creates a template indicating the range and shape of the pupil image from the anterior ocular segment image captured by the first camera based on the detection results of the first detection unit. The second detection unit detects the pupil image from the range of the anterior ocular segment image captured by the second camera through template matching based on the template created by the estimation unit. This allows for simple detection of the pupil image from the anterior ocular segment image captured by the second camera.
[0018] In another embodiment of the ophthalmologic apparatus of the present invention, the anterior ocular segment image acquisition unit repeatedly acquires an anterior ocular segment image from any one of a plurality of cameras that capture images of the examined eye from different directions. This allows the determination of whether the face is properly supported by the face support unit using a single existing camera.
[0019] Another aspect of the ophthalmic apparatus of the present invention includes an ocular characteristics acquisition unit that acquires ocular characteristics of a subject's eye using an objective lens, an anterior ocular segment observation system that images the subject's eye using the objective lens, and an anterior ocular segment image acquisition unit that repeatedly acquires anterior ocular segment images from the anterior ocular segment observation system. This allows the use of the existing anterior ocular segment observation system to determine whether the face is properly supported by the face support unit.
[0020] Another embodiment of the ophthalmic device of the present invention includes: an ocular characteristics acquisition unit for acquiring ocular characteristics of a subject's eye using an objective lens; an ophthalmic device body housing the ocular characteristics acquisition unit; a relative movement mechanism for moving the ophthalmic device body relative to the subject's eye; a relative position detection unit for detecting the relative position of the subject's eye relative to the ophthalmic device body based on an anterior ocular segment image acquired by the anterior ocular segment image acquisition unit; and an alignment control unit for driving the relative movement mechanism based on the detection result of the relative position detection unit to align the ophthalmic device body relative to the subject's eye. This allows for simultaneous execution of processing for determining whether the face is correctly supported by the face support unit and automatic alignment processing.
[0021] In another embodiment of the ophthalmic apparatus of the present invention, a notification unit is provided for notifying the user of the determination result when the determination unit determines that the face is not properly supported by the face support unit.
[0022] Another embodiment of the ophthalmic apparatus of the present invention includes a support position changing mechanism for changing the support position of the face by the face support unit, and a notification unit actuating the support position changing mechanism to change the support position. This allows notification to the subject that the face is not properly supported by the face support unit.
[0023] Another aspect of the ophthalmic device of the present invention includes a support position changing mechanism for changing the support position of the face by the face support unit; a support position change control unit for driving the support position changing mechanism to change the support position of the face if the judgment unit determines that the face is not correctly supported by the face support unit; and a re-judgment control unit for repeatedly operating the anterior ocular segment image acquisition unit, the pupil image detection unit, and the judgment unit if the support position of the face has been changed by the support position changing mechanism. This allows the user to correctly support their face with the face support unit without any operation or reminder, thereby reducing the user's effort and time.
[0024] In order to achieve the purpose of the present invention, a control method for an ophthalmic device comprises: an anterior ocular image acquisition step of repeatedly acquiring an anterior ocular image of an eye under examination of a face supported by a face support portion supporting the face of the subject; a pupil image detection step of detecting the pupil image of the eye under examination for each anterior ocular image based on the anterior ocular images repeatedly acquired by the anterior ocular image acquisition step; and a judgment step of judging whether the face is correctly supported by the face support portion based on the pupil image detection result of each anterior ocular image in the pupil image detection step.
[0025] Effects of the Invention
[0026] The present invention can accurately and reliably acquire the ocular characteristics of the eye to be examined. BRIEF DESCRIPTION OF THE DRAWINGS
[0027] Figure 1 This is a front perspective view of the ophthalmologic apparatus according to the first embodiment as viewed from the subject's side.
[0028] Figure 2 This is a rear perspective view of the ophthalmologic apparatus as viewed from the examiner's side.
[0029] Figure 3 It is a front view of the lens housing.
[0030] Figure 4 This is a schematic diagram showing an example of the configuration of a probe of an ophthalmologic apparatus.
[0031] Figure 5 This is a functional block diagram of the arithmetic control unit of the first embodiment.
[0032] Figure 6 This is an explanatory diagram for explaining the pupil image detection process performed by the first detection unit.
[0033] Figure 7 This is an explanatory diagram for explaining the creation of a template by the estimation unit.
[0034] Figure 8 This is an explanatory diagram for explaining the detection process of detecting the pupil image from the front ocular image by the second detection unit.
[0035] Figure 9 This is an explanatory diagram showing an example of warning information displayed on a monitor.
[0036] Figure 10 This is an explanatory diagram showing an example of reporting to the subject that the subject's face is not correctly supported by the face support unit.
[0037] Figure 11 This is a flowchart showing the flow of a process for acquiring ocular characteristics of an eye to be examined, particularly a process for determining face support, performed by the ophthalmologic apparatus according to the first embodiment.
[0038] Figure 12 This is a flowchart showing a process of acquiring eye characteristics of an eye to be examined by the ophthalmologic apparatus of the second embodiment, particularly a flow of a face support determination process in the method for controlling the ophthalmologic apparatus of the present invention.
[0039] Figure 13 This is a functional block diagram of the arithmetic control unit of the ophthalmologic apparatus according to the third embodiment.
[0040] Figure 14 This is a flowchart showing a process of acquiring eye characteristics of an eye to be examined by the ophthalmologic apparatus according to the third embodiment, and in particular, a flow of a face support determination process in the method for controlling the ophthalmologic apparatus according to the present invention. DETAILED DESCRIPTION
[0041] [Overall Configuration of Ophthalmologic Apparatus According to First Embodiment]
[0042] Figure 1 This is a front perspective view of the ophthalmologic apparatus 10 according to the first embodiment as viewed from the subject's side. Figure 2 This is a perspective view of the back of the ophthalmologic apparatus 10 as viewed from the side of the examinee. In addition, the X direction in the figure is the left-right direction ( Figure 4 The Y direction is the up-down direction, and the Z direction is the front-to-back direction (also called the working distance direction) parallel to the front direction approaching the subject and the rear direction away from the subject.
[0043] like Figure 1 as well as Figure 2 As shown, the ophthalmologic apparatus 10 is a multifunctional device composed of a fundus camera and an optical coherence tomography scanner. The optical coherence tomography scanner uses optical coherence tomography (OCT) to obtain an OCT image as a tomographic image. The ophthalmologic apparatus 10 acquires (measures, photographs, and observes, etc.) the fundus Ef (refer to Figure 4 ) fundus photography and OCT images as the subject eye E (reference Figure 4 The ophthalmologic apparatus 10 includes a base 11, a face support 12, a stand 13, and a probe 14.
[0044] A stand 13 is provided on the base 11. In addition, an operation control unit 22 (see FIG. 1 ) described later is accommodated in the base 11. Figure 4 ).
[0045] A face support 12 is integrally provided with the base 11 at a position forward of the probe 14 in the Z direction. The face support 12 includes a chin rest 12a and a forehead rest 12b, which are adjustable in the Y direction (vertical direction), and supports the subject's face in a position facing the main body of the ophthalmic device, including the probe 14 (objective lens 43 described later).
[0046] In addition, the face support portion 12 is provided with an electric lifting mechanism 12c corresponding to the support position changing mechanism of the present invention. The electric lifting mechanism 12c is a well-known actuator such as a motor drive mechanism, and is controlled by the calculation control unit 22 (see Figure 4 ), the chin rest 12a and the forehead rest 12b are moved in the Y direction, thereby changing the support position of the subject's face.
[0047] Furthermore, an external fixation lamp 15 is provided on the face support portion 12. The external fixation lamp 15 has a light source for emitting fixation light, and the position and emission direction of the light source can be adjusted arbitrarily. The external fixation lamp 15 is used in external fixation. External fixation is a fixation method as described below, that is, by adjusting the position of the light source of the external fixation lamp 15, the subject's eye E (refer to Figure 4 ) in any direction, or rotate it more than during internal fixation, or when internal fixation is not possible, adjust the direction of the eye E by guiding the line of sight of the eye E or the fellow eye.
[0048] The gantry 13 is provided so as to be movable in the X and Z directions (front-back, left-right directions) relative to the base 11. An operating unit 16 is provided on the gantry 13. A probe 14 is provided on the gantry 13 so as to be movable in the Y direction.
[0049] In addition, an electric drive mechanism 17 (see FIG. 1 ) corresponding to the relative movement mechanism of the present invention is provided on the stand 13. Figure 4 The electric drive mechanism 17 is a well-known actuator such as a motor drive mechanism, and is controlled by the calculation control unit 22 (see Figure 4 ), the stage 13 is moved in the XZ direction, and the probe 14 is moved in the Y direction. Thus, the probe 14 moves relative to the eye E to be examined in the XYZ direction.
[0050] The operation unit 16 is provided on the gantry 13 at the Z-direction rear side (the examiner side) of the probe 14. The operation unit 16 includes operation buttons for performing various operations of the ophthalmologic apparatus 10 and an operation lever 16a.
[0051] The operating lever 16a is an operating member for manually moving the probe 14 in the X, Y, and Z directions. For example, if the operating lever 16a is tilted in the Z direction (front-back direction) or the X direction (left-right direction), the electric drive mechanism 17 (see FIG. Figure 4 ) moves the probe 14 in the Z direction or the X direction. In addition, if the operating rod 16a is rotated about its long axis, the electric drive mechanism 17 moves the probe 14 in the Y direction (vertical direction) according to the rotational operation direction.
[0052] The probe 14 constitutes the main body of the ophthalmic device of the present invention. Figure 4 The fundus camera unit 14a and the OCT unit 14b are shown. In addition, a monitor 18 is provided on the back side of the probe 14 on the Z-direction rear side (the examiner side). In addition, a lens housing 19 is provided on the front side of the probe 14 on the Z-direction front side (the examinee side).
[0053] The monitor 18 uses, for example, a touch screen liquid crystal display device. The monitor 18 displays the inspected eye E (see Figure 4 ) and input screens for various setting operations.
[0054] Figure 3 19 is a front view of the lens housing portion 19. Figure 3 As shown, the lens housing 19 houses an objective lens 43, which constitutes the fundus camera unit 14a (see Figure 4 ) and has an optical axis OA parallel to the Z direction. Furthermore, the lens housing 19 is provided with eight fixation holes 19a (also referred to as fixation lamps) spaced evenly along the circumference of the objective lens 43 so as to surround the objective lens 43. Each fixation hole 19a selectively emits a fixation light in the Z direction in response to operation of the operating unit 16.
[0055] Each fixation hole 19a is located between the peripheral fixation and the inspected eye E (see Figure 4 ) is used for photographing the anterior chamber angle (iris edge), etc. Peripheral fixation is a fixation method in which the subject's eye E is caused to largely turn in a desired direction by selectively lighting each fixation hole 19a.
[0056] Furthermore, a stereo camera 20, equivalent to the multiple cameras of the present invention, is provided on the front face of the probe 14 near the lens housing 19. The stereo camera 20 includes a first camera 20a and a second camera 20b. The first camera 20a and the second camera 20b are arranged on the Z-direction forward side of the probe 14 (the surface facing the examinee's eye E) so as to sandwich the objective lens 43 from the left and right sides.
[0057] Figure 41 is a schematic diagram showing an example of the structure of the probe 14 of the ophthalmologic apparatus 10. Figure 4 As shown, the probe 14 includes a fundus camera unit 14 a , an OCT unit 14 b , a stereo camera 20 , an arithmetic control unit 22 , and the like.
[0058] The fundus camera unit 14a has an optical system substantially similar to that of conventional fundus cameras. It uses the objective lens 43 to acquire (photograph) various observation images of the anterior ocular segment Ea and other components of the subject's eye E, and also acquires a photographic fundus image of the fundus Ef, which represents ocular characteristics of the subject's eye E. The OCT unit 14b uses the objective lens 43 and a portion of the optical system of the fundus camera unit 14a to acquire an OCT image of the fundus Ef, which represents ocular characteristics of the subject's eye E. Thus, the fundus camera unit 14a functions as both the ocular characteristics acquisition unit and the anterior ocular segment observation system of the present invention. Furthermore, the OCT unit 14b functions as the ocular characteristics acquisition unit of the present invention.
[0059] The calculation control unit 22 is housed in the base 11 (or may be in the stylus head 14 ), and is a calculation processing device such as a personal computer that performs various calculation processes and control processes.
[0060] [Fundus Camera Unit]
[0061] The fundus camera unit 14 a includes an illumination optical system 30 and an imaging optical system 50 as optical systems for acquiring observation images of the anterior ocular segment Ea and the like and a fundus photographic image which is a two-dimensional image representing the surface morphology of the fundus Ef.
[0062] The illumination optical system 30 irradiates the fundus Ef with illumination light. The imaging optical system 50 guides the fundus reflected light of the illumination light reflected from the fundus Ef to imaging elements 57 and 60, such as CMOS (Complementary Metal Oxide Semiconductor) or CCD (Charge Coupled Device). Furthermore, the imaging optical system 50 guides signal light output from the OCT optical system 80 (OCT unit 14b) to the fundus Ef, and guides the signal light that has passed through the fundus Ef to the OCT optical system 80.
[0063] The illumination optical system 30 includes an observation light source 31 , a reflecting mirror 32 , a condenser lens 33 , a visible light cut filter 34 , an imaging light source 35 , a reflecting mirror 36 , relay lenses 37 and 38 , an aperture 39 , a relay lens 40 , a perforated mirror 41 , a dichroic mirror 42 , and an objective lens 43 .
[0064] In addition to the objective lens 43, dichroic mirror 42 and perforated mirror 41 already described, the imaging optical system 50 also includes a focusing lens 51, a reflecting mirror 52, a half-reflecting mirror 53, a sight mark display unit 54, a dichroic mirror 55, a focusing lens 56, an imaging element 57, a reflecting mirror 58, a focusing lens 59 and an imaging element 60.
[0065] The observation light source 31, such as a halogen lamp or an LED (Light Emitting Diode), emits observation illumination light. The observation illumination light emitted from the observation light source 31 is reflected by the reflector 32, passes through the condenser lens 33, and transmits through the visible light cutoff filter 34, thereby becoming near-infrared light. The observation illumination light that has passed through the visible light cutoff filter 34 is temporarily focused near the imaging light source 35, reflected by the reflector 36, and then passes through relay lenses 37 and 38, an aperture 39, and a relay lens 40. The observation illumination light is then reflected by the periphery of the perforated mirror 41 (the area surrounding the aperture), passes through the dichroic mirror 42, and is refracted by the objective lens 43, illuminating the fundus Ef.
[0066] The fundus reflected light of the observation illumination light is refracted by the objective lens 43, passes through the dichroic mirror 42, the hole formed in the central area of the perforated mirror 41, and the focusing lens 51, and is then reflected by the reflecting mirror 52. Furthermore, the fundus reflected light passes through the half-mirror 53 and is reflected by the dichroic mirror 55. As a result, it is imaged by the focusing lens 56 onto the light-receiving surface of the imaging element 57. The imaging element 57 captures (receives) the fundus reflected light and outputs an imaging signal to the calculation control unit 22 described later. The calculation control unit 22 causes the monitor 18 to display various observation images based on the imaging signal output from the imaging element 57. Furthermore, when the imaging optical system 50 is focused on the anterior segment Ea of the eye E to be examined, the observation image of the anterior segment Ea is displayed on the monitor 18. When the imaging optical system 50 is focused on the fundus Ef, the observation image of the fundus Ef is displayed on the monitor 18.
[0067] The imaging light source 35, for example, uses a xenon lamp or an LED light source, and emits imaging illumination light. The imaging illumination light emitted from the imaging light source 35 irradiates the fundus Ef along the same path as the observation illumination light described above. The fundus-reflected light of the imaging illumination light is guided to the dichroic mirror 55 along the same path as the fundus-reflected light of the observation illumination light, passes through the dichroic mirror 55, and is then reflected by the reflector 58. The image is then formed by the condenser lens 59 onto the light-receiving surface of the imaging element 60.
[0068] The imaging element 60 captures (receives) light reflected from the fundus and outputs an imaging signal to the calculation control unit 22, which will be described later. The calculation control unit 22 causes the monitor 18 to display a fundus image based on the imaging signal output from the imaging element 60. The monitor 18 that displays the various observation images and the monitor 18 that displays the fundus image may be the same monitor or different monitors.
[0069] The optotype display unit 54 is used to project fixation light, a fixation target (bright dot image), onto the inner part of the examinee's eye E through the objective lens 43. For example, a dot matrix liquid crystal display (LCD) or a matrix light-emitting diode (LED) is used. The optotype display unit 54 displays the fixation target. Furthermore, the display form (shape, etc.) and display position of the fixation target can be arbitrarily set in the optotype display unit 54.
[0070] A portion of the fixation light from the fixation target displayed on the optotype display section 54 is reflected by the half mirror 53 and then projected onto the examinee's eye E via the reflective mirror 52, the focusing lens 51, the aperture of the perforated mirror 41, the dichroic mirror 42, and the objective lens 43. Thus, the fixation target and the optotype for visual acuity measurement are presented to the examinee's eye E via the objective lens 43.
[0071] The fundus camera unit 14a includes a focusing optical system 70. The focusing optical system 70 generates a spectroscopic index for focusing on the fundus Ef. In addition to the objective lens 43, dichroic mirror 42, and perforated mirror 41 described above, the focusing optical system 70 further includes an LED 71, a relay lens 72, a spectroscopic index plate 73, a binaural diaphragm 74, a reflective mirror 75, a condenser lens 76, and a reflective rod 77.
[0072] When focusing is performed by the focusing optical system 70, the reflective surface of the reflective rod 77 is placed on the optical path of the illumination optical system 30. The focused light emitted from the LED 71 passes through the relay lens 72 and is separated into two beams by the spectroscopic index plate 73. The beams are then temporarily imaged on the reflective surface of the reflective rod 77 via the binocular aperture 74, the reflective mirror 75, and the condenser lens 76. The beams are then reflected by the reflective surface toward the relay lens 40. The focused light is then projected onto the fundus Ef via the relay lens 40, the perforated mirror 41, the dichroic mirror 42, and the objective lens 43.
[0073] The fundus reflected light of the focused light passes through the objective lens 43, the dichroic mirror 42, and the hole portion of the perforated mirror 41, and is then photographed by the imaging element 57 via the focusing lens 51, the reflecting mirror 52, the half-reflecting mirror 53, the dichroic mirror 55, and the focusing lens 56. The imaging element 57 photographs the fundus reflected light of the focused light and outputs an imaging signal. As a result, the observation image and the spectral mark are displayed on the monitor 18. The calculation control unit 22 described later analyzes the position of the spectral mark and moves the focusing lens 51, etc., as in the past, thereby automatically focusing. In addition, the examiner can also manually focus based on the spectral mark displayed on the monitor 18.
[0074] The dichroic mirror 42 branches the optical path of the OCT optical system 80 from the optical path for fundus imaging. The dichroic mirror 42 reflects light in the wavelength band used for OCT measurement and transmits light for fundus imaging. The optical path of the OCT optical system 80 includes, in order from the OCT unit 14b side, a collimator lens unit 81, an optical path length changing unit 82, a galvano scanner 83, a focusing lens 84, a reflective mirror 85, and a relay lens 86.
[0075] The optical path length changer 82 includes, for example, a corner cube and a mechanism for moving it. The optical path length changer 82 can move in the direction of the arrow shown in the figure to change the optical path length of the OCT optical system 80. This change in optical path length is used to adjust the optical path length according to the axial length of the eye E being examined and to adjust the interference state.
[0076] The galvano-scanner 83 changes the propagation direction of the signal light passing through the optical path of the OCT optical system 80. This allows the fundus Ef to be scanned using the signal light. The galvano-scanner 83 includes, for example, a galvano mirror for scanning the signal light in the X direction, a galvano mirror for scanning in the Y direction, and a mechanism for independently driving these galvano mirrors. This allows the signal light to be scanned in any direction on the XY plane.
[0077] [OCT unit]
[0078] The OCT unit 14b includes an interferometric optical system used to acquire OCT images of the fundus Ef. Similar to conventional OCT devices, this unit 14b splits low-coherence light into reference light and signal light, causes the signal light passing through the fundus Ef to interfere with the reference light passing through the reference optical path to generate interference light, and then detects the spectral components of this interference light. The detection results (detection signals) generated by the OCT unit 14b are output to the arithmetic control unit 22. The specific configuration of the OCT unit 14b is conventional (e.g., see Patent Document 1 above), and therefore a detailed description thereof will be omitted here.
[0079] [Stereo Camera]
[0080] The first camera 20a and the second camera 20b constituting the stereo camera 20 simultaneously (or substantially simultaneously) and continuously capture (video capture) images of the anterior ocular segment Ea from different directions, in this embodiment, from the left and right directions. Reference symbol OB in the figure denotes the optical axes of the first camera 20a and the second camera 20b.
[0081] The first camera 20a continuously captures the anterior segment Ea from one side in the left and right directions, and outputs an anterior segment image D1 (see FIG. 1 ) as an observed image of the anterior segment Ea to the calculation control unit 22. Figure 5 The second camera 20b continuously captures the anterior segment Ea from the other side in the left and right directions, and outputs the anterior segment image D2 (see FIG. 1 ) as the observed image of the anterior segment Ea to the calculation control unit 22. Figure 5 ). Furthermore, the arrangement of the first camera 20a and the second camera 20b may be reversed. The anterior ocular images D1 and D2 are used for face support determination (also called chin support determination) and for automatic alignment of the probe 14 with respect to the eye E to be examined. Face support determination refers to determining whether the subject's face is correctly (appropriately) supported by the face support unit 12, and for automatically aligning the probe 14 with respect to the eye E to be examined.
[0082] [Calculation control unit]
[0083] Figure 5 FIG. 2 is a functional block diagram of the operation control unit 22 of the first embodiment. Figure 5 As shown, the calculation control unit 22 includes a general control unit 90, a storage unit 92, an image forming unit 94, and a data processing unit 96. Furthermore, the aforementioned electric lifting mechanism 12c, fundus camera unit 14a, OCT unit 14b, external fixation lamp 15, operation unit 16, electric drive mechanism 17, monitor 18, fixation port 19a, and stereo camera 20 are connected to the calculation control unit 22.
[0084] The storage unit 92 stores not only the control program executed by the integrated control unit 90 but also OCT image data, fundus image data, and inspected eye information (including examinee information). The storage unit 92 also stores a template 120 described below.
[0085] The image forming unit 94 and the OCT unit 14b together constitute the eye characteristics acquisition unit of the present invention. They analyze the detection signals input from the OCT unit 14b to form an OCT image of the fundus Ef. The specific method for forming an OCT image is the same as that used in conventional OCT devices, so its description is omitted here. The data processing unit 96 performs image processing and other operations on the OCT image formed by the image forming unit 94, the fundus image and various observation images acquired by the fundus camera unit 14a, and the anterior ocular images D1 and D2 acquired by the stereo camera 20.
[0086] The integrated control unit 90 comprehensively controls the operation of each part of the ophthalmologic apparatus 10. The integrated control unit 90 performs face support judgment based on the anterior ocular images D1 and D2 input from the stereo camera 20, and performs automatic alignment based on the anterior ocular images D1 and D2 when it is judged that the face is correctly supported by the face support unit 12. Then, after the automatic alignment, the integrated control unit 90 controls the fundus camera unit 14a and the OCT unit 14b to obtain fundus photography images of the fundus Ef and OCT images. In addition, Figure 5 In the figure, only the functions of face support judgment, automatic alignment and acquisition of eye characteristics of the examined eye E (fundus imaging and OCT image) are shown, and other functions are well-known technologies, so specific illustrations are omitted.
[0087] The functions of integrated control unit 90 are implemented using various processors. These include CPUs (Central Processing Units), GPUs (Graphics Processing Units), ASICs (Application Specific Integrated Circuits), and programmable logic devices (such as SPLDs (Simple Programmable Logic Devices), CPLDs (Complex Programmable Logic Devices), and FPGAs (Field Programmable Gate Arrays). The various functions of integrated control unit 90 can be implemented by a single processor or by multiple processors of the same or different types.
[0088] When acquiring ocular characteristics (fundus images and OCT images) of the examined eye E, the integrated control unit 90 functions as an anterior ocular segment image acquisition unit 100, a pupil image detection unit 102, a determination unit 104, a notification control unit 106, a relative position detection unit 108, an alignment control unit 110, and an ocular characteristics acquisition control unit 112. Furthermore, the "unit" described as part of the arithmetic control unit 22 may also be a "circuit," "device," or "equipment." In other words, the "unit" may be comprised of firmware, software, hardware, or a combination thereof.
[0089] [Face support judgment]
[0090] The anterior segment image acquisition unit 100 is used for both face support determination and automatic alignment, and functions as an image input interface connected by wire or wirelessly to the first camera 20a and the second camera 20b of the stereo camera 20. The anterior segment image acquisition unit 100 repeatedly acquires anterior segment images D1 and D2 from the first camera 20a and the second camera 20b, respectively, which continuously capture the anterior segment Ea, and repeatedly outputs the acquired anterior segment images D1 and D2 to the pupil image detection unit 102 and the relative position detection unit 108.
[0091] The pupil image detection unit 102 is used for face support determination. The pupil image detection unit 102 repeatedly performs detection processing on each of the anterior ocular images D1 and D2, which are repeatedly input from the anterior ocular image acquisition unit 100. The detection processing is to detect the pupil image 116 (see FIG. 116 ) of the pupil of the subject's eye E from the anterior ocular images D1 and D2. Figure 6 ) processing. The detection processing of the pupil image 116 by the pupil image detection unit 102 is different from the detection processing of the pupil image 116 by the relative position detection unit 108 during automatic alignment, which will be described later. As long as the pupil image 116 can be detected within the range of the micro-movement of the eye E undergoing fixation, the processing is simple.
[0092] The pupil image detection unit 102 functions as a first detection unit 102 a , an estimation unit 102 b , a second detection unit 102 c , and an iterative control unit 102 d .
[0093] Figure 6 1 is an explanatory diagram for explaining the detection process of the pupil image 116 by the first detection unit 102a. Figure 6 As well as the aforementioned Figure 5 As shown, the first detection unit 102a detects the pupil image 116 from the anterior ocular segment image D1 captured by the first camera 20a. Furthermore, of the first camera 20a and the second camera 20b, the one that captures a clearer image of the anterior ocular segment Ea may be designated as the "first camera 20a," and the other as the "second camera 20b."
[0094] The first detection unit 102a, for example, performs known binarization, labeling, and circularity filtering on the full-size anterior segment image D1. Labeling assigns the same label (or the same number) to consecutive white or black pixels within the binarized anterior segment image D1. Circularity filtering detects areas within the labeled anterior segment image D1 whose circularity exceeds a predetermined value. Thus, the first detection unit 102a can detect the pupil image 116 from the anterior segment image D1 and output a detection result indicating the shape and position of the pupil image 116 to the estimation unit 102b.
[0095] The method for detecting the pupil image 116 from the anterior ocular segment image D1 by the first detection unit 102a is not limited to the above-described methods (binarization, labeling, and filtering), and a known method may be used. In particular, a method that enables simple detection is preferred.
[0096] Figure 7 1 is an explanatory diagram for explaining how the estimating unit 102b creates the template 120. Figure 7 as well as Figure 5 As shown, the estimating unit 102b creates a template 120 used in the detection (template matching) of the pupil image 116 from the anterior segment image D2 by the second detecting unit 102c described later, based on the detection result of the pupil image 116 in the anterior segment image D1 by the first detecting unit 102a.
[0097] Specifically, the estimating unit 102b estimates the shape of the pupil image 116 in the anterior segment image D2 based on the shape of the pupil image 116 in the anterior segment image D1 detected by the first detecting unit 102a, and creates shape information 120a corresponding to the estimation result.
[0098] Furthermore, the estimation unit 102b estimates the existence range 118 of the pupil image 116 in the anterior segment image D2 based on the position of the pupil image 116 in the anterior segment image D1 detected by the first detection unit 102a, and creates existence range information 120b corresponding to the estimation result. The existence range 118 indicates the range in which the pupil image 116 that moves in the anterior segment image D2 in response to the fixation micro-movement of the subject's eye E exists. Figure 7 (described later Figure 8 Similarly, in order to prevent the drawing from being complicated, the existence range 118 is illustrated to be exaggerated than the actual range.
[0099] The method for generating the presence range information 120b is not particularly limited, as the positional relationship and imaging magnification of the first camera 20a and the second camera 20b are well known. Therefore, the estimating unit 102b can estimate the position of the pupil image 116 within the anterior segment image D2 based on the position of the pupil image 116 within the anterior segment image D1 detected by the first detection unit 102a. Furthermore, the extent to which the pupil image 116 shifts within the anterior segment image D2 in response to the subject's eye E's fixation movement can also be determined in advance through experiments or simulations. Therefore, the estimating unit 102b can estimate the presence range 118 and generate the presence range information 120b based on the detection results of the first detection unit 102a, the positional relationship and imaging magnification of the first camera 20a and the second camera 20b, and the amount of displacement of the pupil image 116 in response to the subject's eye E's fixation movement.
[0100] Then, the estimating unit 102 b creates a template 120 including the shape information 120 a and the existence range information 120 b , and stores the template 120 in the storage unit 92 .
[0101] Figure 8 1 is an explanatory diagram for explaining the detection process of the second detection unit 102c detecting the pupil image 116 from the anterior ocular segment image D2. Figure 8 as well as Figure 5 As shown, the second detection unit 102c detects the pupil image 116 from within the existing range 118 of the anterior ocular segment image D2 by well-known template matching based on the template 120 (shape information 120a and existing range information 120b) stored in the storage unit 92. Specifically, the second detection unit 102c determines the existing range 118 within the anterior ocular segment image D2 based on the existing range information 120b, and detects the pupil image 116 having a shape corresponding to the shape information 120a from within the existing range 118.
[0102] Furthermore, the second detection unit 102 c may detect the pupil image 116 from the existing range 118 in the anterior ocular segment image D2 by performing the same detection process of the pupil image 116 as the first detection unit 102 a described above, instead of template matching.
[0103] Whenever the anterior ocular image acquisition unit 100 repeatedly acquires anterior ocular segment images D1 and D2 from the first camera 20a and the second camera 20b, the repetitive control unit 102d repeatedly operates the first detection unit 102a, the estimation unit 102b, and the second detection unit 102c. This repeatedly causes the first detection unit 102a to detect a pupil image 116 from the anterior ocular segment image D1, the estimation unit 102b to create a template 120, and the second detection unit 102c to detect the pupil image 116 from the anterior ocular segment image D2 (existence range 118).
[0104] return Figure 5 , the judgment unit 104 performs face support judgment based on the repeated detection results of the second detection unit 102c. However, when the face of the subject is correctly supported by the face support unit 12, the movement of the face is basically suppressed. Therefore, even if the pupil image 116 in the anterior ocular segment image D2 moves within the anterior ocular segment image D2 due to the slight movement of the subject's eye E during fixation, it remains within the existence range 118 within the predetermined time. On the contrary, when the face of the subject is not correctly supported by the face support unit 12, such as when the face floats off the chin rest 12a, the face will move. Therefore, the state in which the pupil image 116 is within the existence range 118 of the anterior ocular segment image D2 cannot last for the predetermined time. Therefore, based on the repeated detection results of the second detection unit 102c, the judgment unit 104 judges whether the face supported by the face support unit 12 has moved within the predetermined time, thereby making it possible to perform face support judgment on whether the face is correctly supported by the face support unit 12.
[0105] Specifically, the judgment unit 104 judges whether the number of consecutive detections of the pupil image 116 from the existence range 118 of the anterior eye image D2 has reached a predetermined number of times based on the repeated detection results of the second detection unit 102c, that is, whether the pupil image 116 has been detected from the existence range 118 for more than a predetermined time set in advance (continuously).
[0106] Furthermore, if the pupil image 116 is detected within the existing range 118 for a period of time exceeding the predetermined time, the determination unit 104 determines that the face of the subject supported by the face support unit 12 has not moved, and that the face is correctly supported by the face support unit 12. Conversely, if the pupil image 116 is not detected within the existing range 118 for a period of time exceeding the predetermined time, the determination unit 104 determines that the face of the subject supported by the face support unit 12 has moved, and that the face is not correctly supported by the face support unit 12.
[0107] If the determination unit 104 determines that the face is correctly supported by the face support unit 12, the determination result is output to the relative position detection unit 108 and the alignment control unit 110. If the determination unit 104 determines that the face is not correctly supported by the face support unit 12, the determination result is output to the notification control unit 106.
[0108] Figure 9 1 is an explanatory diagram showing an example of the warning information 124 being displayed (reported) by the monitor 18. Figure 9 as well as Figure 5 As shown, when the judgment result from the judgment unit 104 is input to the notification control unit 106, the notification control unit 106 causes the monitor 18 to display a warning message 124. The warning message 124 is information indicating that the face is not correctly supported by the face support unit 12. Thus, the warning message 124 is notified to the examinee. Therefore, in this case, the notification control unit 106 and the monitor 18 function as the notification unit of the present invention. Alternatively, instead of displaying the warning message 124 on the monitor 18, the warning message may be output from a speaker (not shown), or the warning message 124 may be displayed and output from the speaker (not shown).
[0109] Figure 10 1 is an explanatory diagram showing an example of notifying the subject that the subject's face is not correctly supported by the face support unit 12. Figure 10 as well as Figure 5As shown, when the judgment result from the judgment unit 104 is input to the notification control unit 106, the notification control unit 106 drives the electric lifting mechanism 12c, for example, to move the chin rest 12a and forehead rest 12b up and down in the Y direction, thereby changing the position of the chin rest 12a and other components supporting the face. This notifies the subject that the face is not being properly supported by the face support unit 12. Therefore, in this case, the notification control unit 106 and the face support unit 12 function as the notification unit of the present invention.
[0110] [Auto Alignment]
[0111] return Figure 5 The relative position detection unit 108 and the alignment control unit 110 are used in the automatic alignment and operate upon receiving the judgment result from the judgment unit 104 .
[0112] Based on the anterior ocular images D1 and D2 input from the anterior ocular image acquisition unit 100, the relative position detection unit 108 detects pupil images 116 (pupil area, pupil shape) from each of the anterior ocular images D1 and D2, and determines the characteristic position of each pupil image 116 corresponding to the pupil center or corneal vertex. Next, based on the positions and imaging magnifications of the first and second cameras 20a and 20b, and the characteristic positions of the anterior ocular images D1 and D2, the relative position detection unit 108 calculates the relative position (three-dimensional position) of the examinee's eye E with respect to the probe 14 using a known method (see Japanese Patent Application Laid-Open No. 2013-248376). The relative position detection unit 108 then outputs this calculation result as a detection result of the relative position of the examinee's eye E to the alignment control unit 110.
[0113] However, unlike the detection processing performed by the first detection unit 102a during face support determination described above, the detection processing performed by the relative position detection unit 108 to detect the pupil image 116 from the anterior ocular segment images D1 and D2 is a precise process that requires accurate determination of the characteristic position described above. For example, the relative position detection unit 108 binarizes the anterior ocular segment images D1 and D2 and accurately calculates the relative position of the examined eye E based on the binarized anterior ocular segment images D1 and D2.
[0114] The alignment control unit 110 drives the electric drive mechanism 17 based on the detection result of the relative position of the eye E to be examined by the relative position detection unit 108 , and performs automatic alignment of the probe 14 with respect to the eye to be examined.
[0115] [Acquisition of Eye Characteristics]
[0116] After the automatic alignment is completed, the ocular characteristics acquisition control unit 112 operates to acquire ocular characteristics of the examined eye E (captured fundus images and OCT images of the fundus Ef). Specifically, the ocular characteristics acquisition control unit 112 drives the fundus camera unit 14a to acquire captured fundus images of the fundus Ef. Furthermore, the ocular characteristics acquisition control unit 112 drives the OCT optical system 80, the OCT unit 14b, the image forming unit 94, and other components to acquire OCT images of the fundus Ef.
[0117] [Function of the Ophthalmologic Apparatus of the First Embodiment]
[0118] Figure 11 This is a flowchart showing the process of acquiring the eye characteristics of the examined eye E by the ophthalmologic apparatus 10 of the first embodiment of the above-described structure, and in particular, the flow of the face support determination process of the control method of the ophthalmologic apparatus 10 of the present invention. Figure 11 As shown, when the examiner turns on the power of the ophthalmologic apparatus 10 or performs a measurement start operation (acquisition operation) through the operation unit 16 , acquisition of the eye characteristics of the examinee's eye E starts (step S1 ).
[0119] The integrated control unit 90 controls the first camera 20a and the second camera 20b to start continuous imaging of the anterior segment Ea of the eye to be examined E. Consequently, the anterior segment image acquisition unit 100 acquires anterior segment images D1 and D2 from the first camera 20a and the second camera 20b, respectively, and outputs these anterior segment images D1 and D2 to the pupil image detection unit 102 (step S2, corresponding to the anterior segment image acquisition step of the present invention).
[0120] When the anterior ocular images D1 and D2 are input to the pupil image detection unit 102, as already described, Figure 6 As shown, the first detection unit 102a detects the pupil image 116 from the anterior segment image D1 by performing binarization, labeling, and filtering on the anterior segment image D1, and outputs the detection results of its position and shape to the estimation unit 102b (step S3).
[0121] Then, as already mentioned Figure 7 As shown, the estimation unit 102b estimates the shape and existence range 118 of the pupil image 116 in the anterior ocular segment image D2 based on the detection result from the first detection unit 102a, thereby creating a template 120 (shape information 120a and existence range information 120b) (step S4). Then, as described above, Figure 8 As shown, the second detection unit 102 c performs template matching based on the template 120 , thereby detecting the pupil image 116 from within the existing range 118 of the anterior ocular segment image D2 (step S5 ).
[0122] If the pupil image 116 is detected within the presence range 118 of the anterior ocular segment image D2, the repetitive control unit 102d repeatedly executes the processing from steps S3 to S6 (Yes in step S6, No in step S7). If the pupil image 116 is not detected within the presence range 118 of the anterior ocular segment image D2, the process proceeds to step S12, described later (No in step S6). Steps S3 to S6 correspond to the pupil image detection step of the present invention.
[0123] Thereafter, each time the anterior ocular image acquisition unit 100 repeatedly acquires anterior ocular images D1 and D2 from the first camera 20a and the second camera 20b, the repetitive control unit 102d repeatedly executes the processing from step S3 to step S6 described above until a YES determination is made in step S7 or a NO determination is made in step S6.
[0124] Based on the repeated detection results of the second detection unit 102c, if the pupil image 116 is continuously detected within the presence range 118 of the anterior ocular image D2 a predetermined number of times, that is, if the pupil image 116 is continuously detected for a predetermined time period or longer, the judgment unit 104 determines that the face is correctly supported by the face support unit 12 (Yes in step S7, proceed to step S8). Step S8 and step S12, described later, correspond to the judgment steps of the present invention. The judgment unit 104 then outputs the judgment result that the face is correctly supported by the face support unit 12 to the relative position detection unit 108 and the alignment control unit 110. Thus, after the face support judgment is made, automatic alignment automatically begins.
[0125] The relative position detection unit 108 detects the relative position of the eye E to be examined with respect to the stylus 14 based on the anterior ocular segment images D1 and D2 input from the anterior ocular segment image acquisition unit 100, and outputs the detection result to the alignment control unit 110 (step S9). The alignment control unit 110 then drives the electric drive mechanism 17 based on the detection result of the relative position of the eye E to automatically align the stylus 14 with respect to the eye E (step S10).
[0126] Once the automatic alignment is complete, the eye characteristics acquisition control unit 112 drives the fundus camera unit 14a to acquire a photographic image of the fundus Ef, or drives the OCT optical system 80, OCT unit 14b, and image forming unit 94 to acquire an OCT image of the fundus Ef. This completes the acquisition of the eye characteristics of the examined eye E (step S11).
[0127] On the other hand, if the second detection unit 102c does not detect the pupil image 116 within the presence range 118 of the anterior ocular segment image D2 (No in step S6), the determination unit 104 determines that the face is not properly supported by the face support unit 12 (step S12). The determination unit 104 then outputs the determination result that the face is not properly supported by the face support unit 12 to the notification control unit 106.
[0128] The report control unit 106 receives the input of the judgment result from the judgment unit 104, as described above. Figure 9 as well as Figure 10 As shown, the monitor 18 displays a warning message 124 or the electric lift mechanism 12c is driven to move the chin rest 12a and other components up and down in the Y direction. This notifies the examiner and the subject that the subject's face is not properly supported by the face support 12 (step S13). The examiner then reminds the subject to pay attention or adjusts the position of the chin rest 12a and other components so that the subject's face is properly supported by the face support 12. The process from step S1 onward is then repeated.
[0129] [Effects of this embodiment]
[0130] As described above, in this embodiment, it is possible to determine whether the subject's face is correctly supported by the face support unit 12 based on the anterior ocular images D1 and D2 captured by the stereo camera 20. Therefore, the ocular characteristics of the subject's eye E can be acquired while the subject's face is correctly supported by the face support unit 12. This prevents the face from moving during acquisition of the ocular characteristics of the subject's eye E, thereby preventing the acquired ocular characteristics from being inaccurate or failing to acquire the ocular characteristics. Furthermore, since the existing stereo camera 20 can be used, face support determination can be performed simply by modifying the software. As a result, the ocular characteristics of the subject's eye E can be acquired with high accuracy and reliability.
[0131] Furthermore, since face support determination and automatic alignment can be performed using the anterior ocular images D1 and D2 captured by the first camera 20a and the second camera 20b, face support determination and automatic alignment (detection of the relative position of the examined eye E) can be performed in parallel.
[0132] [Second embodiment]
[0133] Next, the ophthalmologic apparatus 10 according to a second embodiment of the present invention will be described. Each time the anterior ocular image acquisition unit 100 repeatedly acquires anterior ocular segment images D1 and D2 from the first camera 20a and the second camera 20b, the repetitive control unit 102d of the pupil image detection unit 102 of the first embodiment described above repeatedly operates the first detection unit 102a, the estimation unit 102b, and the second detection unit 102c. This repeatedly causes the first detection unit 102a to detect a pupil image 116 from the anterior ocular segment image D1, the estimation unit 102b to create a template 120, and the second detection unit 102c to detect a pupil image 116 from the anterior ocular segment image D2 (template matching).
[0134] In contrast, in the second embodiment, the second detection unit 102c repeatedly detects the pupil image 116 from the second and subsequent anterior segment images D2 using (referring to) the template 120 generated based on the first anterior segment image D1 (template matching). Besides, the ophthalmologic apparatus 10 of the second embodiment has essentially the same configuration as the ophthalmologic apparatus 10 of the first embodiment, except for the functional differences between the anterior segment image acquisition unit 100 and the repetitive control unit 102d. Therefore, components identical in function or configuration to those of the first embodiment are denoted by the same reference numerals, and their descriptions are omitted.
[0135] In the face support determination process, the anterior ocular segment image acquisition unit 100 of the second embodiment performs the following processes: a first image acquisition process of acquiring anterior ocular segment images D1 and D2 from the first camera 20a and the second camera 20b, and a second and subsequent image acquisition processes of repeatedly acquiring anterior ocular segment image D2 from the second camera 20b.
[0136] Every time the second detection unit 102c detects the pupil image 116 from within the existing range 118 of the anterior ocular segment image D2, the repetitive control unit 102d of the second embodiment repeatedly operates the second detection unit 102c until the determination unit 104 makes a determination.
[0137] Figure 12 This is a flowchart showing the process of acquiring the eye characteristics of the examined eye E by the ophthalmologic apparatus 10 according to the second embodiment, and in particular, showing the flow of the face support determination process in the control method of the ophthalmologic apparatus 10 according to the present invention. Figure 11 The first embodiment shown is basically the same, so the description is omitted.
[0138] If the answer is no in step S7, the anterior segment image acquisition unit 100 acquires the anterior segment image D2 from the second camera 20b and outputs the anterior segment image D2 to the second detection unit 102c (step S7A). In this case, the operation of the first camera 20a may or may not be stopped.
[0139] Next, the repetitive control unit 102d of the second embodiment repeatedly operates the second detection unit 102c. As a result, the second detection unit 102c performs template matching based on the template 120 generated by the estimation unit 102b after the first image acquisition process, and detects the pupil image 116 from the anterior ocular image D2 acquired by the second image acquisition process (steps S5 and S6).
[0140] Thereafter, the following processes, namely, the process of step S7A by the anterior ocular segment image acquisition unit 100 and the processes of steps S5 and S6 by the second detection unit 102 c , are repeatedly executed until a YES determination is made in step S7 or a NO determination is made in step S6 .
[0141] Thus, in the second embodiment, the pupil image 116 can be detected from the anterior ocular segment image D2 acquired in the second and subsequent image acquisition processes based on the template 120 generated by the estimation unit 102b after the first image acquisition process. Consequently, in the second and subsequent face support determination processes, the steps of acquiring the anterior ocular segment image D1, detecting the pupil image 116 from the anterior ocular segment image D1, and generating the template 120 can be omitted. Consequently, the time required for the second and subsequent face support determination processes is shortened.
[0142] [Third embodiment]
[0143] Figure 13 This is a functional block diagram of the calculation control unit 22 of the ophthalmologic apparatus 10 according to the third embodiment. In each of the above embodiments, when the determination unit 104 determines that the subject's face is not properly supported by the face support unit 12, the notification control unit 106 reports the determination result. In contrast, in the ophthalmologic apparatus 10 according to the third embodiment, if the determination unit 104 determines that the subject's face is not properly supported by the face support unit 12, the face support determination process is executed again after the face support position of the chin rest 12a and other components is changed.
[0144] like Figure 13 As shown, the ophthalmic apparatus 10 of the third embodiment is basically the same in configuration as the ophthalmic apparatus 10 of the above-described embodiments, except that the integrated control unit 90 also functions as the support position change control unit 130 and the re-determination control unit 132. Therefore, portions having the same functions or configurations as those of the above-described embodiments are denoted by the same reference numerals, and their descriptions are omitted.
[0145] Figure 14 This is a flowchart showing the process of acquiring the eye characteristics of the examined eye E in the ophthalmologic apparatus 10 of the third embodiment, and in particular, showing the flow of the face support determination process in the control method of the ophthalmologic apparatus 10 of the present invention. Figure 12Since the respective processes of the second embodiment shown are basically the same, detailed description thereof will be omitted.
[0146] like Figure 13 as well as Figure 14 As shown, if the determination unit 104 determines that the face is not properly supported by the face support unit 12 (step S12), the support position change control unit 130 is activated. The support position change control unit 130 drives the electric lifting mechanism 12c to change the support position of the subject's face by the face support unit 12, for example, to the upper side in the Y direction (step S14).
[0147] For example, the support position change control unit 130 drives the electric lift mechanism 12c to raise the face support position of the face support unit 12 by approximately 5 mm. Alternatively, the support position change control unit 130 monitors (detects) the position of the pupil image 116 within at least one of the anterior ocular segment images D1 and D2 acquired by the anterior ocular segment image acquisition unit 100 and drives the electric lift mechanism 12c to slowly change the face support position of the face support unit 12 upward in the Y direction until the position of the pupil image 116 changes. Alternatively, the support position of the subject's face may be changed downward instead of upward in the Y direction.
[0148] In this way, by changing the supporting position of the face support part 12 on the subject's face, especially changing it to the upper side in the Y direction, the support of the subject's face by the face support part 12 can be changed from an incorrect state to a correct state, or the subject can be reminded that the face is not correctly supported by the face support part 12.
[0149] When the face support position of the face support unit 12 has changed, the judgment control unit 132 controls the various parts of the integrated control unit 90 (the anterior ocular image acquisition unit 100, the pupil image detection unit 102, and the judgment unit 104) to repeatedly execute the processing of steps S1 to S7A described above. In this way, the face support judgment processing described in the second embodiment is repeatedly executed. Figure 11 The same as the first embodiment shown, the processing of steps S1 to S7 described above is repeatedly executed.
[0150] Thereafter, the processes of step S14 and step S1 to step S7A (step S7 ) are repeatedly executed until the determination unit 104 determines that the face is correctly supported by the face support unit 12 .
[0151] Thus, in the third embodiment, if the subject's face is not properly supported by the face support unit 12, the face support determination process is repeatedly executed while changing the face support position of the face support unit 12. This allows the ophthalmic apparatus 10 to automatically transition to the subsequent process (steps S9 to S11) without the subject having to perform any operation. This can reduce the subject's effort and time.
[0152] While the above embodiments describe an example of a stereo camera 20 (a first camera 20a and a second camera 20b), the eye E to be examined may be imaged using three or more cameras. In this case, the anterior segment image acquisition unit 100 also repeatedly acquires an anterior segment image D1 captured by the first camera 20a of the plurality of cameras and an anterior segment image D2 captured by one or more second cameras 20b of the plurality of cameras. Furthermore, the first detection unit 102a detects a pupil image 116 for each anterior segment image D1 captured by the first camera 20a. Furthermore, the estimation unit 102b estimates an existing range 118 for each anterior segment image D2 captured by one or more second cameras 20b (creating a template 120). Furthermore, the second detection unit 102c detects a pupil image 116 within the existing range 118 for each of the one or more anterior segment images D2. Furthermore, the determination unit 104 determines whether the number of consecutive detections of the pupil image 116 within the existing range 118 for each of the one or more anterior segment images D2 has reached a predetermined number.
[0153] In each of the above-mentioned embodiments, based on the anterior ocular images D1 and D2 continuously captured by the first camera 20a and the second camera 20b, the pupil image detection unit 102 performs detection of the pupil image 116 of each anterior ocular image D1 and D2, and the judgment unit 104 performs face support judgment, but the camera used in the face support judgment can also be one.
[0154] In this case, the anterior segment image acquisition unit 100 repeatedly acquires anterior segment images D1 or D2 (hereinafter referred to as single anterior segment images) continuously captured by either the first camera 20a or the second camera 20b. Furthermore, the pupil image detection unit 102 repeatedly detects the pupil image 116 for each single anterior segment image. The determination unit 104 then performs a face support determination based on whether the position of the pupil image 116 within the single anterior segment image remains within a range corresponding to the micro-fixation movement of the examined eye E (equivalent to the aforementioned presence range 118) for a predetermined period of time. This allows face support determination to be performed using a single camera.
[0155] In this case, the anterior segment image acquisition unit 100 may repeatedly acquire observation images of the anterior segment Ea from the imaging optical system 50 (equivalent to the anterior segment observation system of the present invention) that can continuously capture images of the anterior segment Ea via the objective lens 43. In this case, face support determination can also be performed using the same method as when using either the first camera 20a or the second camera 20b.
[0156] In the above-described embodiments, the calculation control unit 22 is built into the stylus 14, but may be provided outside the base 11 and the stylus 14. That is, the ophthalmic apparatus 10 of the present invention is also applicable to an apparatus compatible with telemedicine.
[0157] In the above-mentioned embodiments, the acquisition of fundus photography of the fundus Ef and the acquisition of OCT images are cited as examples of obtaining the ocular characteristics of the inspected eye E, but the present invention is also applicable to an ophthalmic device 10 for obtaining various ocular characteristics of the inspected eye E, such as the ocular refractive power, intraocular pressure, number of corneal endothelial cells, and corneal shape.
[0158] Description of Reference Numerals
[0159] 10…Ophthalmic devices
[0160] 12…Face support
[0161] 12a… chin rest
[0162] 12b…forehead stop
[0163] 12c…Electric lifting mechanism
[0164] 14…Probe
[0165] 14a…Fundus camera unit
[0166] 14b…OCT unit
[0167] 16…Operation Department
[0168] 17…Electric drive mechanism
[0169] 18…Monitor
[0170] 20…Stereo camera
[0171] 20a…First Camera
[0172] 20b…Second camera
[0173] 22…Calculation control unit
[0174] 30…Illumination optical system
[0175] 43…Objective lens
[0176] 50…Camera optical system
[0177] 70…focusing optical system
[0178] 80…OCT optical system
[0179] 90…Integrated Control Department
[0180] 100…Anterior ocular image acquisition unit
[0181] 102…Pupil image detection unit
[0182] 102a…first detection unit
[0183] 102b…Presumption part
[0184] 102c…Second detection unit
[0185] 102d…Repetitive Control Unit
[0186] 104…Judgment Department
[0187] 106…Report Control Department
[0188] 108…Relative position detection unit
[0189] 110…Alignment control unit
[0190] 112…Eye characteristics acquisition control unit
[0191] 116…Pupil image
[0192] 118…Existence range
[0193] 120…Template
[0194] 120a…Shape information
[0195] 120b…Existence range information
[0196] 124…Warning message
[0197] D1, D2…Anterior eye image
[0198] E…Examined eye
[0199] Ea…anterior eye
[0200] Ef…fundus.
Claims
1. An ophthalmic device, wherein: have: A face support part, which supports the face of the examinee; an anterior ocular segment image acquiring unit that repeatedly acquires, from a single camera, an anterior ocular segment image of the subject's eye supported by the face supporting unit; a pupil image detecting unit that repeatedly detects the pupil image of the eye to be examined for each of the anterior segment images repeatedly acquired by the anterior segment image acquiring unit; as well as The judgment unit judges whether the face is correctly supported by the face supporting unit based on the detection result of the pupil image of each of the anterior ocular images by the pupil image detection unit, and judges that the face is correctly supported by the face supporting unit when the position of the pupil image in the anterior ocular image is within the existence range corresponding to the fixation micro-movement of the examined eye for a predetermined time.
2. The ophthalmic device according to claim 1, wherein The anterior ocular segment image acquisition unit repeatedly acquires the anterior ocular segment image from any one of a plurality of cameras that capture images of the eye to be examined from mutually different directions.
3. The ophthalmic device according to claim 1, wherein have: an eye characteristics acquisition unit that acquires the eye characteristics of the eye under examination through an objective lens, and an anterior ocular observation system for photographing the inspected eye through the objective lens; The anterior segment image acquisition unit repeatedly acquires the anterior segment image from the anterior segment observation system.
4. The ophthalmic device according to any one of claims 1 to 3, wherein have: an eye characteristics acquisition unit for acquiring the eye characteristics of the eye under examination through an objective lens; an ophthalmic device body, accommodating the eye characteristics acquisition unit; a relative movement mechanism for causing the ophthalmic device body to move relative to the eye to be examined; a relative position detection unit configured to detect a relative position of the eye to be examined relative to the ophthalmologic apparatus body based on the anterior segment image acquired by the anterior segment image acquisition unit; as well as The alignment control section drives the relative movement mechanism based on the detection result of the relative position detection section to align the ophthalmologic apparatus body with respect to the eye to be examined.
5. The ophthalmic device according to any one of claims 1 to 3, wherein A reporting unit is provided for reporting a result of the determination by the determination unit when the determination unit determines that the face is not correctly supported by the face supporting unit.
6. The ophthalmic device according to claim 5, wherein A support position changing mechanism is provided to change the support position of the face supporting portion on the face. The reporting unit drives the support position changing mechanism to change the support position.
7. The ophthalmic device according to any one of claims 1 to 3, wherein have: a support position changing mechanism for changing the support position of the face support portion on the face; a support position change control unit that drives the support position change mechanism to change the support position of the face when the judgment unit judges that the face is not correctly supported by the face support unit; as well as The re-determination control unit repeatedly operates the anterior ocular segment image acquisition unit, the pupil image detection unit, and the determination unit when the support position of the face is changed by the support position changing mechanism.
8. An ophthalmic device, wherein: have: A face support part, which supports the face of the examinee; an anterior ocular segment image acquiring unit that repeatedly acquires an anterior ocular segment image of the subject's eye of the face supported by the face supporting unit; a pupil image detecting unit configured to detect a pupil image of the eye to be examined for each of the anterior segment images repeatedly acquired by the anterior segment image acquiring unit; as well as a judgment unit that judges whether the face is correctly supported by the face supporting unit based on the detection result of the pupil image of each of the anterior ocular segments by the pupil image detection unit, The anterior ocular segment image acquisition unit repeatedly acquires the anterior ocular segment image from a plurality of cameras, the plurality of cameras capturing images of the inspected eye from mutually different directions. The pupil image detection unit includes: a first detection unit configured to detect the pupil image from the anterior ocular segment image captured by a first camera among the plurality of cameras; an estimating unit that estimates, based on the detection result of the first detecting unit, an existence range corresponding to the micro-movement of fixation of the subject's eye, of the pupil image included in the anterior ocular segment image captured by a second camera different from the first camera among the plurality of cameras and the pupil image that moves according to the micro-movement of fixation of the subject's eye; a second detecting unit that detects the pupil image from within the existing range of the anterior ocular segment image captured by the second camera based on the estimation result of the estimating unit, and a repetitive control unit configured to repeatedly operate the first detection unit, the estimating unit, and the second detection unit each time the anterior segment image acquiring unit acquires the anterior segment image; The determination unit determines whether the face is correctly supported by the face support unit based on the repeated detection results of the second detection unit. Based on the repeated detection results of the second detection unit, the judgment unit judges that the face is correctly supported by the face supporting unit when the pupil image is detected within the existence range for more than a predetermined time, and judges that the face is not correctly supported by the face supporting unit when the pupil image is detected within the existence range for less than the predetermined time.
9. The ophthalmic device according to claim 8, wherein The estimating unit creates a template showing the existence range and shape of the pupil image from the anterior ocular segment image captured by the first camera based on the detection result of the first detecting unit, The second detection unit detects the pupil image from within the existing range of the anterior ocular segment image captured by the second camera through template matching based on the template created by the estimation unit.
10. The ophthalmic device according to claim 8, wherein have: an eye characteristics acquisition unit for acquiring the eye characteristics of the eye under examination through an objective lens; an ophthalmic device body, accommodating the eye characteristics acquisition unit; a relative movement mechanism for causing the ophthalmic device body to move relative to the eye to be examined; a relative position detection unit configured to detect a relative position of the eye to be examined relative to the ophthalmologic apparatus body based on the anterior segment image acquired by the anterior segment image acquisition unit; as well as The alignment control section drives the relative movement mechanism based on the detection result of the relative position detection section to align the ophthalmologic apparatus body with respect to the eye to be examined.
11. The ophthalmic device according to claim 8, wherein A reporting unit is provided for reporting a result of the determination by the determination unit when the determination unit determines that the face is not correctly supported by the face supporting unit.
12. The ophthalmic device according to claim 11, wherein A support position changing mechanism is provided to change the support position of the face supporting portion on the face. The reporting unit drives the support position changing mechanism to change the support position.
13. The ophthalmic device according to claim 8, wherein have: a support position changing mechanism for changing the support position of the face support portion on the face; a support position change control unit that drives the support position change mechanism to change the support position of the face when the judgment unit judges that the face is not correctly supported by the face support unit; as well as The re-determination control unit repeatedly operates the anterior ocular segment image acquisition unit, the pupil image detection unit, and the determination unit when the support position of the face is changed by the support position changing mechanism.
14. An ophthalmic device, wherein: have: A face support part, which supports the face of the examinee; an anterior ocular segment image acquiring unit that repeatedly acquires an anterior ocular segment image of the subject's eye of the face supported by the face supporting unit; a pupil image detecting unit configured to detect a pupil image of the eye to be examined for each of the anterior segment images repeatedly acquired by the anterior segment image acquiring unit; as well as a judgment unit that judges whether the face is correctly supported by the face supporting unit based on the detection result of the pupil image of each of the anterior ocular segments by the pupil image detection unit, The anterior ocular segment image acquisition unit performs a first image acquisition process and a second and subsequent image acquisition processes, wherein in the first image acquisition process, the anterior ocular segment image is acquired from a first camera and a second camera that photograph the subject's eye from different directions, and in the second and subsequent image acquisition processes, the anterior ocular segment image is repeatedly acquired from the second camera. The pupil image detection unit includes: a first detection unit that detects the pupil image from the anterior ocular segment image acquired by the anterior ocular segment image acquisition unit from the first camera in the first image acquisition process; an estimating unit that estimates, based on the detection result of the first detecting unit, an existence range corresponding to the micro-movement of fixation of the subject's eye, which is both the pupil image included in the anterior ocular segment image acquired by the anterior ocular segment image acquiring unit from the second camera and the pupil image that moves according to the micro-movement of fixation of the subject's eye; a second detecting unit that detects the pupil image within the existing range of the anterior ocular segment image acquired by the anterior ocular segment image acquiring unit from the second camera based on the estimation result of the estimating unit, and a repetitive control unit configured to repeatedly operate the second detection unit each time the anterior segment image acquisition unit acquires the anterior segment image from the second camera in the second and subsequent image acquisition processes; The determination unit determines whether the face is correctly supported by the face support unit based on the repeated detection results of the second detection unit. Based on the repeated detection results of the second detection unit, the judgment unit judges that the face is correctly supported by the face supporting unit when the pupil image is detected within the existence range for more than a predetermined time, and judges that the face is not correctly supported by the face supporting unit when the pupil image is detected within the existence range for less than the predetermined time.
15. The ophthalmic device according to claim 14, wherein The estimating unit creates a template showing the existence range and shape of the pupil image from the anterior ocular segment image captured by the first camera based on the detection result of the first detecting unit, The second detection unit detects the pupil image from within the existing range of the anterior ocular segment image captured by the second camera through template matching based on the template created by the estimation unit.
16. The ophthalmic device according to claim 14, wherein have: an eye characteristics acquisition unit for acquiring the eye characteristics of the eye under examination through an objective lens; an ophthalmic device body, accommodating the eye characteristics acquisition unit; a relative movement mechanism for causing the ophthalmic device body to move relative to the eye to be examined; a relative position detection unit configured to detect a relative position of the eye to be examined relative to the ophthalmologic apparatus body based on the anterior segment image acquired by the anterior segment image acquisition unit; as well as The alignment control section drives the relative movement mechanism based on the detection result of the relative position detection section to align the ophthalmologic apparatus body with respect to the eye to be examined.
17. The ophthalmic device according to claim 14, wherein: A reporting unit is provided for reporting a result of the determination by the determination unit when the determination unit determines that the face is not correctly supported by the face supporting unit.
18. The ophthalmic device according to claim 17, wherein A support position changing mechanism is provided to change the support position of the face supporting portion on the face. The reporting unit drives the support position changing mechanism to change the support position.
19. The ophthalmic device according to claim 14, wherein have: a support position changing mechanism for changing the support position of the face support portion on the face; a support position change control unit that drives the support position change mechanism to change the support position of the face when the judgment unit judges that the face is not correctly supported by the face support unit; as well as The re-determination control unit repeatedly operates the anterior ocular segment image acquisition unit, the pupil image detection unit, and the determination unit when the support position of the face is changed by the support position changing mechanism.
20. A method for controlling an ophthalmic device, wherein: have: an anterior ocular segment image acquiring step of repeatedly acquiring an anterior ocular segment image of the subject's eye supported by a face supporting portion that supports the subject's face; a pupil image detecting step of detecting a pupil image of the eye to be examined for each of the anterior segment images repeatedly acquired in the anterior segment image acquiring step; as well as A judgment step, based on the detection result of the pupil image of each of the anterior ocular images in the pupil image detection step, judging whether the face is correctly supported by the face supporting portion, and when the position of the pupil image in the anterior ocular image is within the existence range corresponding to the fixation micro-movement of the examined eye for a predetermined time, it is determined that the face is correctly supported by the face supporting portion.
Citation Information
Patent Citations
Ophthalmic apparatus
JP2013248376A
Ophthalmologic apparatus
JP2014200678A
Ophthalmic apparatus
CN107495919A