Ophthalmologic apparatus, method for creating inspection image candidate in ophthalmologic apparatus, and program for creating inspection image candidate in ophthalmologic apparatus

Abstract

To broaden options for obtaining appropriate inspection images even from images other than still images acquired through an operation by an examiner in an ophthalmologic apparatus.SOLUTION: An ophthalmologic apparatus includes: an imaging unit (anterior eye part observation system 270) that captures at least one of a video of a subject eye and a first still image being an inspection image; an operation unit 294 for instructing the capture of the first still image; a second still image creation unit 213 that creates a second still image by outputting a still image from the video; a storage unit 220 that stores at least the video, the first still image, and the second still image; a display unit 203 that displays the first still image and the second still image side by side; and a control unit 210 that controls the imaging unit, the operation unit 294, the second still image creation unit 213, the storage unit 220, and the display unit 203.SELECTED DRAWING: Figure 2

Description

[Technical field]

[0001] The present disclosure relates to an ophthalmic apparatus, a test image candidate generating method for an ophthalmic apparatus, and a test image candidate generating program for an ophthalmic apparatus. [Background technology]

[0002] Conventionally, in ophthalmic devices, as described in Patent Document 1 (see paragraph 0044), video capture has been performed as observation images during the preparation stage such as alignment, and still images have been captured and used as the captured images used for examining the subject's eye. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Patent Publication No. 2022-68488 Summary of the Invention [Problem to be solved by the invention]

[0004] Incidentally, when capturing a test image, which is a still image, in an ophthalmologic device, only the still image captured by the examiner pressing the capture button is stored, and although moving images are also captured for displaying live images before shooting, the moving images displayed as live images are not saved.

[0005] However, capturing a still image by pressing the capture button is not always successful, and there are cases where a still image included in a moving image being displayed as a live video is more suitable as an inspection image.

[0006] Therefore, an object of the present disclosure is to expand options for obtaining appropriate examination images from images other than still images acquired by operation of an examiner in an ophthalmic apparatus. [Means for solving the problem]

[0007] In order to achieve the above-mentioned objective, the ophthalmologic apparatus of the present disclosure includes an imaging unit that captures at least one of a moving image of the test eye and a first still image which is an examination image, an operation unit that instructs the capture of the first still image, a second still image creation unit that outputs a still image from the recorded moving image and creates a second still image, a memory unit that stores at least the moving image, the first still image, and the second still image, a display unit that displays the first still image and the second still image side by side, the imaging unit, the operation unit, the second still image creation unit, the memory unit, and a control unit that controls the display unit.

[0008] In addition, the method for creating a candidate examination image for an ophthalmic device disclosed herein executes an alignment start detection step in which the detection unit detects the start of an alignment process for eye examination, an alignment end detection step in which the detection unit detects the end of the alignment process, a video capture start step in which the imaging unit starts capturing a video, a first still image capture step in which the examiner operates the operation unit to capture a first still image and store it in the memory unit, a video storage step in which the imaging unit stops capturing the video and stores the video in the memory unit, and a second still image creation step in which the second still image generation unit outputs a still image from the video and creates a second still image. Effect of the Invention

[0009] According to the present disclosure, it is possible to expand options for obtaining appropriate examination images from images other than still images acquired by operation of an examiner in an ophthalmologic apparatus. [Brief description of the drawings]

[0010] [Figure 1] FIG. 1 is a diagram showing an overview of an ophthalmic apparatus according to the present disclosure. [Diagram 2] 2 is a block diagram showing a functional configuration of the ophthalmologic apparatus of the present disclosure. FIG. [Diagram 3] 1 is a flowchart for explaining a basic process flow of a test image candidate generating method for an ophthalmologic apparatus according to the present disclosure. [Figure 4] 10 is a diagram illustrating an example of a screen in which a first still image and a second still image are displayed side by side on a display unit. FIG. [Diagram 5]13 is a flowchart for explaining the flow of additional processing of the test image candidate generation method for the ophthalmologic apparatus of the present disclosure. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0011] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS An embodiment of the present disclosure will be described with reference to the drawings.

[0012] The ophthalmic device according to the embodiment of the present disclosure may be any of ophthalmic devices such as a fundus camera, a scanning laser ophthalmoscope (SLO), a slit lamp microscope, an ophthalmic surgery microscope, etc., mainly using an OCT (optical coherence tomography) to measure the human eye. In particular, a method in which a still image to be used as an examination image and a live video continuously taken during measurement can be regarded as the same is suitable. For example, imaging using visible light is not very suitable because it is dazzling to the subject and places a burden on the subject, and is performed instantaneously and not continuously. On the other hand, imaging using infrared light is suitable because both continuous live video and still image shooting are performed at the same time so that the subject does not feel dazzled, and this may include imaging using a color fundus camera using near-infrared light.

[0013] 1 is a diagram showing an overview of an ophthalmic apparatus of the present disclosure, and FIG 2 is a block diagram showing a functional configuration of the ophthalmic apparatus 200. In FIG 1, an ophthalmic apparatus 200 includes a measurement unit 201, a chin rest unit 202, and a display unit 203.

[0014] The measurement unit 201 has a function of measuring the eye of the subject. The position of the measurement unit 201 can also be controlled by a moving mechanism 291 controlled by the control unit 210. For example, it is driven in the horizontal direction (X direction, Z direction) in FIG. 1 and in the vertical direction (Y direction) perpendicular thereto.

[0015] The chin rest 202 is connected to the main body of the ophthalmologic apparatus 200, is a part that can be driven in the XYZ directions, and has a function of supporting the chin and face of the subject. The chin rest 202 may be equipped with a forehead rest that supports the forehead of the subject. In addition, it is sufficient that the subject's eyes are fixed so as not to move during measurement, and it is not necessarily required that the chin is directly supported. The control unit 210 controls the drive of the chin rest 202, and drives it to support the subject's chin in an appropriate position.

[0016] 2, the ophthalmic apparatus 200 includes a control unit 210, a memory unit 220, a Z alignment system 221, an XY alignment system 222, a keratometry system 230, a reflex measurement projection system 241, a reflex measurement light receiving system 242, an OCT optical system 250, a fixation photography system 260, an anterior eye observation system 270, a movement mechanism 291, a display unit 203, and an operation unit 294. Note that a description of configurations and details that are less related to the functions of the test image candidate creation method of the ophthalmic apparatus of the present disclosure will be omitted.

[0017] The control unit 210 includes a processor, and controls each unit of the ophthalmic apparatus 200. The control unit 210 also performs processing for writing data to the storage unit 220, processing for reading data from the storage unit 220, and various processing using the read data.

[0018] The operation unit 294 is, for example, an operation device for moving the measurement position of the measurement unit 201, and may be a touch panel display integrated with the display unit 203. In this case, the operation can be performed by touching the screen. Alternatively, the operation unit 294 is an operation lever, button, or the like attached to the main body of the ophthalmic apparatus 200. For example, an operation on the operation unit 294 is output to the control unit 210, and the position of the measurement unit 201, etc. is operated.

[0019] The storage unit 220 has a function of storing various programs and various data required for control in the control unit 210. In addition, it can store still image files such as acquired moving image files and still images (still images such as a first still image and a second still image), and information calculated based on the image information.

[0020] The video file may include at least one of fundus image information and fundus tomographic information. Here, the fundus image information is an infrared image or color image of the fundus captured by a fundus camera, a scanning laser ophthalmoscope, or the like, and the fundus tomographic information is a b-scan image captured by an OCT device. The fundus tomographic information may include a three-dimensional OCT image and an OCTA (angiography) image. The storage unit 220 is realized by various storage media such as an HDD, an SSD, and a flash memory.

[0021] The control unit 210 also functions as a position controller that controls the positions of the measuring unit 201 and the chin rest 202 via the moving mechanism 291. In response to the received operation information, each movable component of the ophthalmic apparatus 200, such as the measuring unit 201 and the chin rest 202, can be moved by a predetermined movement amount and a predetermined movement speed along the X, Y and Z directions.

[0022] The moving mechanism 291 is a device for moving the measurement unit 201, which houses multiple optical systems (Z alignment system 221, XY alignment system 222, keratometry measurement system 230, etc.), back and forth and left and right, and is equipped with an actuator such as a pulse motor for generating a driving force, and a transmission mechanism such as a rack and pinion for transmitting the driving force.

[0023] The anterior eye observation system 270 has a function of capturing a moving image of the anterior eye of the subject's eye. The anterior eye observation system 270 includes an illumination light source (not shown) and irradiates the anterior eye of the subject's eye with illumination light (e.g., infrared light). The irradiated light is reflected from the subject's eye and forms an image on an imaging element such as an area sensor through an optical system (not shown) inside the ophthalmic device 200, such as an objective lens, a dichroic mirror, an aperture (telecentric aperture), a half mirror, a relay lens, and an imaging lens.

[0024] The imaging element captures images and outputs signals at a set rate, and the captured image signals are sent to the control unit 210, and based on the captured images, a moving image of the anterior eye is displayed on the screen of the display unit 203. This image is displayed as, for example, an infrared moving image. The anterior eye observation system 270 may further have a function of capturing an examination image (first still image) of the fundus.

[0025] The Z alignment system 221 and the XY alignment system 222 have a function of performing auto-alignment processing by operations controlled by the control unit 210.

[0026] The flow of the auto-alignment process by the anterior eye observation system 270 will be briefly described below. When an instruction to start the auto-alignment is given, the control unit 210 causes the anterior eye observation system 270 to start real-time live video capture of the anterior eye. In this disclosure, this capture is a capture that does not store a video. Next, the pupil positions of both eyes are specified, and the measurement optical axis is moved by the moving mechanism 291. If the pupil position is further specified after the movement and it is determined that the image of the anterior eye is located within a predetermined area of ​​the frame, the XY alignment ends. Next, the three-dimensional position of the pupil center of the subject's eye is calculated, and based on this, the measurement unit 201 is moved so that the position in the Z direction relative to the subject's eye is a predetermined working distance, and when the positions converge, the Z alignment ends. In the auto-alignment process, the control unit 210 may analyze the position of the alignment index and move the optical system to automatically perform alignment. With the above, the alignment ends. The detection unit 211 of the control unit 210 detects that the alignment has been completed.

[0027] The detection unit 211 has a function of detecting the start and end of alignment processing for eye examination. For example, detection is possible by acquiring a control signal, command, etc. from the control unit 210 that instructs the start and end of alignment processing.

[0028] The first still image generating unit 212 has a function of creating a still image that is a candidate for an examination image as a first still image and storing it in the storage unit 220 when the examiner operates the operation unit 294 to capture a still image. The first still image generating unit 212 may also construct a composite image of images such as a plurality of OCT images constructed by montage photography. Image synthesis is performed by a known method disclosed in, for example, JP 2020-048910 A.

[0029] The second still image generating unit 213 has a function of outputting and creating, as a second still image, a still image that is a candidate for an inspection image to be compared with the first still image from the captured and stored moving image. Since a moving image is a collection of still images of a plurality of frames that are continuous in time, it is possible to extract images sampled at a predetermined timing and interval from the moving image and output them as the second still image, or to synthesize the plurality of output images to create the second still image.

[0030] FIG. 3 is a flowchart for explaining the flow of basic processing of the test image candidate generating method for the ophthalmologic apparatus of the present disclosure.

[0031] In step S100, the detection unit 211 detects the start of auto-alignment processing for eye examination (auto-alignment start detection step).

[0032] In step S101, the detection unit 211 detects the end of the auto-alignment process (auto-alignment end detection step). The time required for the auto-alignment is, for example, less than one minute. If the auto-alignment process has not been completed (No), the detection unit 211 returns to the previous step, and if the auto-alignment process has been completed (Yes), the detection unit 211 proceeds to the next step.

[0033] In step S102, the photographing unit (the "anterior eye observation system 270" in this disclosure corresponds to an example of an "photographing unit") starts taking a video (video taking start step). The video taken here is a live video, but is taken to save and store the video that will be the basis for creating the second still image. In other words, even if a video is created before the alignment process is completed, the position of the optical system and the subject's eye is likely to be inappropriate and the obtained video is likely to be inappropriate as a source for cutting out an image for testing, so video taking is started at this timing in order to create the second still image from the video taken after the alignment process is completed.

[0034] In step S103, the control unit 210 displays the live video on the display unit 293.

[0035] In step S104, the control unit 210 stores the captured video in the storage unit 220. Since video files have a large data capacity, for example, only the most recent 30 seconds to 1 minute may be stored. Also, an application that automatically determines the image quality may be provided, so that only the clear parts of the video are stored in the storage unit 220.

[0036] In step S105, it is determined whether the examiner operates the shooting button (operation unit 294) while the live video is being displayed and shot. If the examiner shoots (Yes), then in step S106, shooting data, i.e., a first still image, is acquired. The first still image shot in step S106 is stored in the storage unit 220, and the live video is also shot and stored in the storage unit 220 after shooting ends (video storage step). On the other hand, if the examiner does not shoot (No), then the display and shooting of the live video continues until shooting is performed.

[0037] In step S107, the second still image generating section 213 outputs a still image from the moving image stored in the storage section 220, and generates a second still image (second still image generating step).

[0038] In step S108, the control unit 210 displays the first still image and the second still image side by side as test image candidates on the display unit 203 (test image candidate presenting step).

[0039] Fig. 4 shows an example of a screen in which a first still image and a second still image are displayed side by side on the display unit 203. In this figure, P1 is displayed as the first still image, and P2 is displayed as the second still image. The number of first still images displayed is not limited to one as in this figure, and multiple first still images may be displayed. Multiple second still images may also be displayed in the same manner.

[0040] In step S109, the examiner accepts the selection of the first still image as a candidate test image using the operation unit 294 (selection step). For example, the examiner selects any still image with clear image quality and operates the "Enter" button, thereby determining the final test image.

[0041] This can expand options for obtaining appropriate examination images from still images other than those acquired by the examiner's operation in the ophthalmologic apparatus 200. This method can eliminate the need to retake a still image, particularly when the first still image is not clear.

[0042] As shown in the flowchart of Fig. 3, it is preferable to start capturing the moving image after the auto-alignment process is completed, but this is not limited to this. Even during the auto-alignment process, several frames of images of the subject's eye that can be used for the examination image may be captured, so the start timing of capturing the moving image may be changed as appropriate.

[0043] The above is the basic process flow of the test image candidate generating method for the ophthalmologic apparatus of the present disclosure, but a process flow that may be further added will be described with reference to FIG.

[0044] 5 is a flowchart for explaining the flow of additional processing of the test image candidate generating method for the ophthalmologic apparatus of the present disclosure. Here, steps S200 to S201 are similar to steps S108 to S109 described above, and therefore a description thereof will be omitted.

[0045] In step S202, the examiner determines whether to use the first still image as a candidate for the examination image. If the examiner selects that the first still image will be used (Yes) using the operation unit 294, in step S203, the control unit 210 deletes the moving image (and the second still image) from the storage unit 220 (image deletion step).

[0046] On the other hand, if the examiner does not use the first still image (No) and selects the second still image as the candidate test image, the first still image is deleted from the storage unit 220 in step S204. This is mainly the case when the first still image is unclear and not appropriate as a test image. Note that since there is a possibility that the second still image will be created again from the moving image, the moving image and the still image do not necessarily need to be deleted.

[0047] In this way, it is possible to delete unnecessary moving image files that are large in capacity and put a strain on the storage capacity of the storage unit 220. In particular, when a moving image includes at least one of fundus image information and fundus tomographic information, the capacity is large, and the capacity reduction effect of such processing is significant.

[0048] Additional notes will be given regarding the configuration of the present disclosure described above. [1] 1. An ophthalmic device comprising: an imaging unit that captures at least one of a moving image of the subject's eye and a first still image that is an examination image; an operation unit for instructing to capture the first still image; a second still image creation unit that outputs a still image from the moving image and creates a second still image; a storage unit that stores at least the moving image, the first still image, and the second still image; a display unit that displays the first still image and the second still image side by side; a control unit that controls the photographing unit, the operation unit, the second still image creation unit, the storage unit, and the display unit; An ophthalmic device comprising: [2] A detection unit that detects the start and end of an alignment process for the eye examination is further provided, The control unit is when the detection unit detects the start of the alignment process, the image capture unit starts capturing the video; The ophthalmologic apparatus according to [1], wherein when the detection unit detects the end of the alignment process, the captured video is stored in the memory unit. [3] the second still image creation unit creates a plurality of the second still images from the moving image; The ophthalmologic apparatus according to [2], wherein a plurality of the second still images are displayed on the display unit. [4] The ophthalmologic apparatus according to [3], wherein the display unit has a selection unit capable of selecting either the first still image or the second still image. [5] The ophthalmologic apparatus according to [4], wherein the control unit deletes the video and the second still image from the storage unit when the first still image is selected as the examination image. [6] The ophthalmologic apparatus according to any one of [1] to [5], wherein the video includes at least one of fundus image information and fundus tomographic information. [7] A method for creating a test image candidate for an ophthalmic device, comprising: an alignment start detection step in which the detection unit detects the start of an alignment process for the eye examination; an alignment end detection step in which the detection unit detects the end of the alignment process; A video shooting start step in which the shooting unit starts shooting the video; a first still image capturing step in which an examiner operates an operation unit to capture a first still image and store the first still image in a storage unit; a moving image storage step in which the imaging unit stops capturing the moving image and stores the moving image in the storage unit; A test image candidate creating method comprising: a second still image creating step in which a second still image generating unit outputs a still image from the moving image and creates a second still image. [8] After the second still image creating step, The test image candidate creation method described in [7], wherein a control unit executes a test image candidate presenting step of displaying the first still image and the second still image side by side as test image candidates on a display unit. [9] After the test image candidate presentation step, A selection step of accepting a selection by an examiner using the operation unit of the first still image as a candidate for an examination image; The control unit executes an image deletion step of deleting the video and the second still image from the memory unit.

[10] A test image candidate generation program for an ophthalmic apparatus, comprising: an alignment start detection step in which the detection unit detects the start of an alignment process for the eye examination; an alignment end detection step in which the detection unit detects the end of the alignment process; A video shooting start step in which the shooting unit starts shooting the video; a first still image capturing step in which an examiner operates an operation unit to capture a first still image and store the first still image in a storage unit; a moving image storage step in which the imaging unit stops capturing the moving image and stores the moving image in the storage unit; A test image candidate creation program for executing a second still image creation step in which a second still image generation unit outputs a still image from the moving image and creates a second still image. [Explanation of symbols]

[0049] 200 Ophthalmology equipment 201 Measuring section 202 Chin rest 203 Display section 210 Control section 211 Detection unit 212 1st still image generation section 213 Second generated image generation section 220 Storage section 221 Z alignment system 222 XY alignment system 230 Kerato Measurement System 270 Anterior segment observation system 291 Moving mechanism

Claims

1. 1. An ophthalmic device comprising: an imaging unit that captures at least one of a moving image of the subject's eye and a first still image that is an examination image; an operation unit for instructing to capture the first still image; a second still image creation unit that outputs a still image from the moving image and creates a second still image; a storage unit that stores at least the moving image, the first still image, and the second still image; a display unit that displays the first still image and the second still image side by side; a control unit that controls the photographing unit, the operation unit, the second still image creation unit, the storage unit, and the display unit; An ophthalmic device comprising:

2. A detection unit that detects the start and end of an alignment process for the eye examination is further provided, The control unit is when the detection unit detects the start of the alignment process, the image capture unit starts capturing the video; The ophthalmologic apparatus according to claim 1 , wherein the captured video is stored in the storage unit when the detection unit detects the end of the alignment process.

3. the second still image creation unit creates a plurality of the second still images from the moving image; The ophthalmologic apparatus according to claim 2 , wherein a plurality of the second still images are displayed on the display unit.

4. The ophthalmologic apparatus according to claim 3 , wherein the display unit has a selection unit capable of selecting either the first still image or the second still image.

5. The ophthalmologic apparatus according to claim 4 , wherein the control unit deletes the moving image and the second still image from the storage unit when the first still image is selected as a test image.

6. The ophthalmologic apparatus according to claim 1 , wherein the video includes at least one of fundus image information and fundus tomographic information.

7. A method for creating a test image candidate for an ophthalmic device, comprising: an alignment start detection step in which the detection unit detects the start of an alignment process for the eye examination; an alignment end detection step in which the detection unit detects the end of the alignment process; A video shooting start step in which the shooting unit starts shooting the video; a first still image capturing step in which an examiner operates an operation unit to capture a first still image and store the first still image in a storage unit; a moving image storage step in which the imaging unit stops capturing the moving image and stores the moving image in the storage unit; A test image candidate creating method that executes a second still image creating step in which a second still image generating unit outputs a still image from the moving image and creates a second still image.

8. After the second still image creating step, The test image candidate generating method according to claim 7 , further comprising the step of: executing a test image candidate presenting step in which a control unit displays the first still image and the second still image side by side as test image candidates on a display unit.

9. After the test image candidate presentation step, a selection step of accepting a selection by an examiner using the operation unit of the first still image as a candidate for an examination image; The test image candidate generating method according to claim 8 , further comprising the step of: executing an image deleting step in which the control unit deletes the moving image and the second still image from the storage unit.

10. A test image candidate generation program for an ophthalmic apparatus, comprising: an alignment start detection step in which the detection unit detects the start of an alignment process for the eye examination; an alignment end detection step in which the detection unit detects the end of the alignment process; A video shooting start step in which the shooting unit starts shooting the video; a first still image capturing step in which an examiner operates an operation unit to capture a first still image and store the first still image in a storage unit; a moving image storage step in which the imaging unit stops capturing the moving image and stores the moving image in the storage unit; A test image candidate creation program for executing a second still image creation step in which a second still image generation unit outputs a still image from the moving image and creates a second still image.

Images