Information processing device, information processing method, and program

Abstract

To improve the efficiency of shooting when shooting continuously. [Solution] The information processing device of the present disclosure is an information processing device that performs a first control which sequentially executes a plurality of processes relating to the imaging of an eye to be examined, and a second control which is started when the first control is being performed and sequentially executes a plurality of processes relating to the imaging of an eye to be examined, and controls to change at least one of the execution timing of at least one of the plurality of processes executed in the first control and the execution timing of at least one of the plurality of processes executed in the second control, based on first memory information relating to the amount of memory required to execute the first process executed in the first control and second memory information relating to the amount of memory required to execute the second process executed in the second control.

Description

[Technical Field]

[0001] The disclosure of the present specification relates to an information processing apparatus, an information processing method, and a program. [Background Art]

[0002] By using a tomographic imaging apparatus such as Optical Coherence Tomography (OCT), the internal structure of an eye to be examined can be observed three-dimensionally. OCT is widely used in ophthalmic practice because it is useful for more accurately diagnosing diseases.

[0003] In imaging performed by a tomographic imaging apparatus, a plurality of imaging procedures may be performed consecutively, such as imaging the left eye after imaging the right eye.

[0004] Here, Patent Document 1 discloses that two or more imaging procedures are consecutively performed in imaging by a tomographic imaging apparatus. [Prior Art Documents] [Patent Documents]

[0005] [Patent Document 1] Japanese Unexamined Patent Publication No. 2023-158820 [Summary of the Invention] [Problem to be Solved by the Invention]

[0006] A tomographic image captured by a tomographic imaging apparatus requires analysis processing such as layer boundary detection processing. The analysis processing is performed, for example, by an information processing apparatus such as a computer. In order to perform the analysis processing, a large amount of temporary storage area (memory) may be required. Therefore, even when consecutive imaging is intended, the next imaging may not be started due to insufficient memory until the analysis processing of the previous imaging is completed. As a result, the imaging efficiency may decrease.

[0007] Therefore, the purpose of this disclosure is to improve the efficiency of shooting when shooting is performed continuously. [Means for solving the problem]

[0008] The information processing device of this disclosure includes a first control that sequentially executes a plurality of processes related to the imaging of the eye under examination, and a second control that is started when the first control is being performed and sequentially executes a plurality of processes related to the imaging of the eye under examination. An information processing device that performs the following: first memory information relating to the amount of memory required to execute a first process executed in the first control, and second memory information relating to the amount of memory required to execute a second process executed in the second control, and controls to change at least one of the execution timing of [Effects of the Invention]

[0009] According to this disclosure, the efficiency of shooting can be improved when shooting is performed continuously. [Brief explanation of the drawing]

[0010] [Figure 1] This diagram illustrates the ophthalmic examination apparatus according to Embodiments 1, 2, 3, 4, and 5. [Figure 2] This diagram illustrates the optical system included in the ophthalmic examination apparatus according to Embodiments 1, 2, 3, 4, and 5. [Figure 3] This diagram illustrates the configuration of the ophthalmic control processing device according to Embodiments 1, 2, 3, 4, and 5. [Figure 4] Examples of the display of the shooting screen according to Embodiments 1, 2, 3, 4, and 5 are shown. [Figure 5] An example of the display of the protocol setting screen according to Embodiments 1, 2, 3, 4, and 5 is shown. [Figure 6] Examples of inspection sequences according to embodiments 1, 2, 3, 4, and 5 are shown. [Figure 7] An example of a flowchart showing the operation of the ophthalmic examination device according to Embodiment 1 is shown. [Figure 8] An example of a flowchart showing the operation of the ophthalmic examination device according to Embodiment 2 is shown. [Figure 9] An example of a flowchart showing the operation of the ophthalmic examination device according to Embodiment 3 is shown. [Figure 10] An example of a flowchart showing the operation of the ophthalmic examination device according to Embodiment 4 is shown. [Figure 11] An example of a flowchart showing the operation of the ophthalmic examination device according to Embodiment 5 is shown. [Modes for carrying out the invention]

[0011] Hereinafter, exemplary embodiments for carrying out the present disclosure will be described in detail with reference to the drawings. However, the dimensions, materials, shapes, and relative positions of components described in the following embodiments are arbitrary and can be modified depending on the configuration of the apparatus to which the present disclosure applies or various conditions. In addition, the same reference numerals will be used between drawings to indicate elements that are identical or functionally similar. Furthermore, some components, members, and processes that are not explanatoryly important may be omitted in each drawing.

[0012] While this embodiment describes a combined fundus camera and OCT device, it is not limited to this. A standalone OCT device or an OCT device with SLO (Single-Laser Laser) functionality may also be used, as may other devices such as AO-SLO or ultrasound.

[0013] <Embodiment 1> The ophthalmic examination device 10 of this embodiment will be described with reference to Figures 1 to 7. The ophthalmic examination device 10 of this embodiment can optimally perform imaging without causing imaging failure due to insufficient memory, even when the analysis processing of the previous imaging is in progress, when imaging an ophthalmic examination including one or more OCT examination data is performed by the ophthalmic imaging device 100.

[0014] (System Configuration) Referring to FIG. 1, the system configuration of an ophthalmic examination apparatus 10 will be described. FIG. 1 is a diagram showing the configuration of the ophthalmic examination apparatus 10 according to the present embodiment. As shown in FIG. 1, the ophthalmic examination apparatus 10 is configured to enable communication when an ophthalmic control processing apparatus 300 is connected to an ophthalmic photographing apparatus 100, an input unit 320, and a display control unit 310 via an interface. The ophthalmic examination apparatus 10 is an example of an information processing system. The ophthalmic control processing apparatus 300 is an example of an information processing apparatus. The ophthalmic photographing apparatus 100 is an example of a photographing apparatus.

[0015] The ophthalmic photographing apparatus 100 is an apparatus that acquires examination data by measuring or photographing an eye to be examined. The ophthalmic photographing apparatus 100 includes a photographing optical system 170, a stage unit 171, and a base unit 200. The ophthalmic photographing apparatus 100 of the present embodiment is a combined photographing apparatus of a fundus camera and OCT. The ophthalmic photographing apparatus 100 acquires a fundus photograph as examination data by photographing with the fundus camera. Further, the ophthalmic photographing apparatus 100 acquires an infrared fundus image and a tomographic image as examination data through OCT photographing and measurement. The photographing optical system 170 is an optical system for acquiring an anterior segment observation image, a fundus photograph, an infrared fundus image, and a tomographic image of the eye to be examined. The stage unit 171 enables the photographing optical system 170 to move vertically, longitudinally, and laterally. The base unit 200 incorporates a spectroscope to be described later.

[0016] The ophthalmic control processing apparatus 300 is a computer that executes control of the ophthalmic photographing apparatus 100, control of alignment operations, reconstruction and layer recognition of tomographic images, image processing of fundus photographs, image display, and the like. Further, the ophthalmic control processing apparatus 300 includes a storage unit 304 that stores examination protocols (such as photographing patterns), patient information, photographing data, image data, measurement data, and analysis data of past examinations, and the like.

[0017] The input unit 320 issues instructions to the computer. The input unit 320 is composed of a keyboard and a mouse. The display unit 310 is composed of, for example, a monitor. When a touch panel is used, part or all of the input unit 320 is built into the display unit 310.

[0018] (Configuration of Ophthalmic Photographing Apparatus) The configuration of the imaging optical system 170, the stage section 171, and the base section 200 (spectrometer) in the ophthalmic imaging apparatus 100 of this embodiment will be explained with reference to Figure 2.

[0019] The imaging optical system 170 consists of a measurement optical system for capturing images of the anterior segment Ea of the eye E under examination, as well as two-dimensional frontal and tomographic images of the fundus Ef of the eye E under examination. The various optical systems arranged within the imaging optical system 170 are described below.

[0020] In the imaging optical system 170, the objective lens 101 is positioned opposite the eye E under examination. On the optical axis L1 of the objective lens 101, a first dichroic mirror 102 and a second dichroic mirror 103 are positioned, functioning as an example of an optical path separation unit. These dichroic mirrors branch the optical path from the objective lens 101 into the optical path for the anterior segment observation system (optical axis L2), the optical path for the fundus imaging system (optical axis L3), and the optical path for the OCT optical system (optical axis L5), according to wavelength band.

[0021] A lens 120, a prism 121, an aperture 122, a lens 123, and an image sensor 124 are arranged on the optical axis L2 in the reflection direction of the second dichroic mirror 103. The image sensor 124 is a monochrome sensor with sensitivity in the infrared region. These optical components arranged on the optical axis L2 constitute an anterior segment observation system for observing the anterior segment Ea. In addition, an anterior segment observation light source 125 is placed near the objective lens 101. The anterior segment observation light source 125 illuminates the anterior segment of the eye E under examination using infrared light.

[0022] The image sensor 124 is connected to the ophthalmic control processing unit 300. The ophthalmic control processing unit 300 generates an anterior eye observation image based on the signal output by the image sensor 124, and can output the anterior eye observation image to the display unit 310 or store it in the storage unit 304.

[0023] On the optical axis L3 in the transmission direction of the second dichroic mirror 103, a perforated mirror 131, a photographic aperture 132, a focusing lens 133, an imaging lens 134, a third dichroic mirror 135, and an image sensor 136 are arranged. The perforated mirror 131 has an opening in the center. The focusing lens 133 can be moved on the optical axis L3 by a drive unit such as a motor (not shown) controlled by the ophthalmic control processing unit 300. The ophthalmic control processing unit 300 can adjust the focus of light passing through the optical path of the fundus imaging system by controlling the drive unit to move the focusing lens 133 in the optical axis direction.

[0024] The optical path along the optical axis L3 is branched by the third dichroic mirror 135 into optical paths leading to the image sensor 136 and optical paths leading to the fixation lamp 137, according to wavelength band. The image sensor 136 is positioned in the transmission direction of the third dichroic mirror 135 and is a sensor for frontal fundus images that combines video and still image capture for observation, and is sensitive to both visible and infrared light. The fixation lamp 137 is positioned in the reflection direction of the third dichroic mirror 135 and generates visible light to encourage the subject to fixate. In addition, other optical components such as an aperture (not shown) may be provided in the optical path of the fundus imaging system to cut off the light beam necessary for fundus imaging.

[0025] On the optical axis L4 in the reflection direction of the perforated mirror 131, the corneal baffle 140, relay lens 141, focus indicator unit 142, lens 143, and ring slit 144 are arranged in this order. The corneal baffle 140 has a light-shielding point in the center. The ring slit 144 has a ring-shaped slit opening.

[0026] The focus indicator unit 142 is an optical component that provides an indicator for focusing using the focus lens 133. In this embodiment, as an example of an indicator, it illuminates a split emission line. The focus indicator unit 142 according to this embodiment has a split indicator member that can move along the optical axis L4 in conjunction with the focus lens 133. The split indicator member is also configured to be inserted into and removed from the optical path of the optical axis L4 by a drive unit such as a motor (not shown) controlled by the ophthalmic control processing device 300.

[0027] The split emission line projected by the focus indicator unit 142 passes through the relay lens 141 and is reflected by the perforated mirror 131 towards the second dichroic mirror 103. The split emission line reflected by the perforated mirror 131 is projected onto the fundus Ef of the eye under examination via the second dichroic mirror 103, the first dichroic mirror 102, and the objective lens 101. The ophthalmic control processing device 300 can calculate the amount of focus shift by detecting the position of the split emission line from the fundus observation image.

[0028] Furthermore, a crystalline lens baffle 145, which serves as a light-shielding member with a light-shielding point, and a dichroic mirror 146, which has the characteristic of transmitting infrared light and reflecting visible light, are arranged on the optical axis L4. A condenser lens 147 and a white LED light source 148 are arranged in the reflection direction of the dichroic mirror 146. The white LED light source 148 is a light source for imaging, consisting of multiple white LEDs that emit visible light. A condenser lens 149 and an infrared LED light source 150 are arranged in the transmission direction of the dichroic mirror 146. The infrared LED light source 150 is an observation light source, consisting of multiple infrared LEDs that emit steady infrared light. The white LED light source 148 and the infrared LED light source 150 are controlled by the ophthalmic control processing device 300.

[0029] An illumination optical system for illuminating the fundus Ef is formed by the objective lens 101, the dichroic mirror 146, the optical elements between them, and the condenser lenses 147 and 149. The fundus Ef of the eye under examination can be illuminated through the illumination optical system by light from a white LED light source 148 or an infrared LED light source 150.

[0030] Lens 151, mirror 152, OCTX scanner 153-1, OCTY scanner 153-2, focus lens 154, and lens 155 are arranged on the optical axis L5 in the reflection direction of the first dichroic mirror 102. The OCTX scanner 153-1 and OCTY scanner 153-2 are composed of deflection means such as galvanometer mirrors and function as scanning units that scan the measurement light over the fundus Ef of the eye under examination E. Furthermore, the OCTX scanner 153-1 and OCTY scanner 153-2 have an optical conjugate relationship with the position of the pupil of the eye under examination E, near their central positions. In Figure 1, the optical path between the OCTX scanner 153-1 and OCTY scanner 153-2 is configured within the plane of the paper, but in reality it is configured perpendicular to the plane of the paper. The scanning unit that scans the measurement light may also be configured using a MEMS mirror or the like that can deflect light in two dimensions with a single unit.

[0031] In this embodiment, the OCTX scanner 153-1 can scan the measurement light in the X direction, and the OCTY scanner 153-2 can scan the measurement light in the Y direction, which is orthogonal to the X direction. In this embodiment, an example of 3D scanning is described in which the X direction is the primary scanning direction and the Y direction is the secondary scanning direction, but the scanning direction is not limited to this. The primary scanning direction and secondary scanning direction in 3D scanning and raster scanning may be directions that intersect each other, for example, the Y direction may be the primary scanning direction and the X direction may be the secondary scanning direction. Alternatively, the primary scanning direction and secondary scanning direction may be oblique directions having components in the X and Y directions that intersect each other. Furthermore, the scan pattern is not limited to 3D scanning, and may be, for example, radial scanning, cross scanning, circle scanning, raster scanning, etc.

[0032] The focus lens 154 can be moved along the optical axis L5 by a drive unit such as a motor (not shown) controlled by the ophthalmic control processing unit 300. The ophthalmic control processing unit 300 can adjust the focus of the measurement light passing through the optical path of the OCT interferometry system by controlling the drive unit to move the focus lens 154 along the optical axis.

[0033] The focus adjustment of the measurement light is performed so that the measurement light emitted from the fiber end of the optical fiber 156-2, which acts as a light source, is imaged onto the fundus Ef. Here, the fiber end of the optical fiber 156-2 has an optical conjugate relationship with the fundus Ef of the eye under examination E. The focus lens 154, which functions as a focus adjustment unit, is positioned between the fiber end, which is the light source of the measurement light, and the OCTX scanner 153-1 and OCTY scanner 153-2, which function as scanning units. Therefore, by adjusting the focus using the focus lens 154, the image of the measurement light emitted from the fiber end can be imaged onto the fundus Ef of the eye under examination E, and the light returned from the fundus Ef can be efficiently returned to the optical fiber 156-2.

[0034] Next, the optical path from the measurement light source 157, the reference optical system, and the configuration of the spectrometer 200 will be described. The measurement light source 157 is a light source that emits light to obtain measurement light to be incident on the measurement optical path (optical path of the OCT interferometer). In this embodiment, a typical low-coherent light source, an SLD (Super Luminescent Diode), is used as the measurement light source 157. The central wavelength of the light emitted from the measurement light source 157 is 880 nm, and the wavelength width is approximately 60 nm. Here, the wavelength width is an important parameter because it affects the resolution in the optical axis direction of the obtained tomographic image. In addition, although an SLD was selected as the type of light source here, any light source that emits low-coherent light will suffice, and ASE (Amplified Spontaneous Emission), etc., can also be used. The central wavelength of the measurement light can be, for example, near-infrared light, considering that the eye is being measured. Furthermore, it is necessary to have a certain degree of wavelength difference between the wavelengths used in the optical paths of the OCT interferometry system (optical axis L5), the anterior eye observation optical path (optical axis L2), and the fundus imaging system (optical axis L3). In this embodiment, the above wavelengths were selected as the wavelengths of the SLD from these viewpoints.

[0035] Light emitted from the measurement light source 157 is guided to the optical coupler 156 via optical fiber 156-1. The light guided to the optical coupler 156 is split by the optical coupler 156 into measurement light directed toward optical fiber 156-2 and reference light directed toward optical fiber 156-3. Here, the optical coupler 156 functions as an example of a splitter that divides the light from the measurement light source 157 into measurement light and reference light. Optical fibers 156-1 to 156-4 are single-image type optical fibers connected to and integrated with the optical coupler 156.

[0036] In this embodiment, the measurement light in the OCT optical system is emitted from the fiber end of the optical fiber 156-2 as the light source. The measurement light passes through the optical path of the OCT optical system described above and irradiates the fundus Ef of the eye E being photographed, and through reflection and scattering by the retina, it reaches the optical coupler 156 again through the same optical path.

[0037] Meanwhile, the reference light reaches the reference mirror 160 via optical fiber 156-3, lens 158, and dispersion-compensating glass 159 inserted to match the dispersion of the measurement light and the reference light, and is reflected. The reference light reflected by the reference mirror 160 returns along the same optical path and reaches the optical coupler 156 again.

[0038] The reference light and the measurement light (return light), which have once again reached the optical coupler 156, are combined by the optical coupler 156. Here, when the optical path length of the measurement light and the optical path length of the reference light become approximately the same, interference between the two lights occurs due to this combination. The reference mirror 160 is held in an adjustable position in the optical axis direction of the reference light by a drive unit such as a motor (not shown) controlled by the ophthalmic control processing unit 300. By using such a drive unit, it is possible to match the optical path length of the reference light to the optical path length of the measurement light, which varies depending on the eye E under examination. The resulting interference light is led to the spectrometer 200 via the optical fiber 156-4.

[0039] The spectrometer 200 is equipped with a lens 201, a diffraction grating 202, a lens 203, and a line sensor 204. Interfering light emitted from the optical fiber 156-4 becomes approximately parallel light after passing through lens 201, is then spectrally separated by the diffraction grating 202, and is imaged onto the line sensor 204 by lens 203. Each element in the line sensor 204 outputs a signal (interference signal) corresponding to the received light to the ophthalmic control processing device 300. The ophthalmic control processing device 300 can acquire the signal output from the line sensor 204 using an image acquisition unit 303 (described later), sample it at a predetermined timing, and perform predetermined signal processing to generate a tomographic image.

[0040] The Michelson interferometer is composed of a measurement light source 157, an optical coupler 156, optical fibers 156-1 to 156-4, a lens 158, a dispersion compensation glass 159, a reference mirror 160, and a spectrometer 200. In this embodiment, a Michelson interferometer is used as the interferometer, but a Mach-Zehnder interferometer may also be used.

[0041] The ophthalmic imaging device 100 is further provided with an imaging optical system 170. The imaging optical system 170 includes three motors (not shown) controlled by an ophthalmic control processing device 300. The ophthalmic control processing device 300 can move the imaging optical system 170 in three dimensions (X, Y, Z) by controlling the drive of the stage unit 171. This allows the ophthalmic control processing device 300 to align the imaging optical system 170 with respect to the eye E under examination.

[0042] (Configuration of ophthalmic control devices) Next, the configuration of the ophthalmic control processing device 300 in this embodiment will be described with reference to Figure 3. Figure 3 schematically shows the configuration of the ophthalmic control processing device 300. The ophthalmic control processing device 300 is connected to the ophthalmic imaging device 100, the input unit 320, and the display unit 310. The ophthalmic control processing device 300 is provided with an imaging control unit 301, an analysis unit 303, a storage unit 304, and a display control unit 302. The ophthalmic control processing device 300 is, for example, a computer equipped with a CPU.

[0043] The imaging control unit 301 controls the ophthalmic imaging device 100 to perform alignment and imaging. It also acquires signal data for captured anterior eye observation images, infrared fundus images, fundus photographs, and tomographic images.

[0044] The imaging control unit 301 reads imaging information such as the examination protocols and sequences for the OCT and fundus camera from the storage unit 304 and performs imaging. It also stores the captured tomographic images, infrared fundus images, and fundus photographs in the storage unit 304 along with imaging information such as the examination protocol and alignment parameters. Furthermore, the imaging control unit 301 processes the signal data of the tomographic images captured by the ophthalmic imaging device 100 and the raw images from the fundus camera into tomographic images and fundus photographs, respectively, via the analysis unit 303, and stores them in the storage unit 304 as examination data. Infrared fundus images and tomographic images required during imaging alignment are created via the analysis unit 303 and sent to the display control unit 302 without being stored in the storage unit 304. In addition, if the examination protocol is the OCTA method, the imaging control unit 301 controls the ophthalmic imaging device 100 to send the signal data of the tomographic images scanned at the same position to the analysis unit 303.

[0045] The analysis unit 303 generates a tomographic image using the signal data of the tomographic image. Subsequently, it generates a motion contrast image and stores it in the storage unit 304. The analysis unit 303 also analyzes the layer boundaries of the acquired tomographic image and stores the analysis results together with the tomographic image in the storage unit 304. On the other hand, if the fundus photograph examination protocol settings require the generation of additional images, the analysis unit 303 generates images in addition to forming the fundus photograph and stores them in the storage unit 304. For example, it performs digital filter image processing on a color fundus photograph to generate a filtered image (red-free or cobalt). The analysis unit 303 also analyzes the fundus photograph. If the analysis determines that a cataract is present, it performs a sharpening process on the cataract image and stores it in the storage unit 304.

[0046] The display control unit 302 displays preview images of anterior eye observations, infrared fundus images, and tomographic images received from the ophthalmic imaging device 100 via the imaging control unit 301 for imaging alignment, as well as fundus photographs, tomographic images, and infrared fundus images acquired through imaging, on the display unit 310. The display control unit 302 also makes changes to the display unit 310 and gives instructions to the imaging control unit 301 based on the content entered by the operator via the input unit 320. Furthermore, the display control unit 302 displays fundus photographs, tomographic images, and infrared fundus images stored in the storage unit 304 on the display unit 310 when specified by the operator via the input unit 320.

[0047] The memory unit 304 is divided into two types: a long-term memory unit 304a and a temporary memory unit 304b. The long-term memory unit 304a is implemented using an HDD or SSD, and its main role is to store data for the long term. The temporary memory unit 304b is implemented using RAM, and its main role is to temporarily store data handled by the shooting control unit 301, the analysis unit 303, and the display control unit 302.

[0048] The long-term memory unit 304a stores information about the eye under examination (patient's name, age, sex, etc.) and device information of the ophthalmic imaging device 100 that took the images (model name, type of fundus camera and OCT, etc.). It also stores the captured fundus photographs, tomographic images, motion contrast images, and infrared fundus images. Furthermore, it stores imaging information (left and right eyes, imaging size, imaging format, ISO sensitivity of the fundus camera, small pupil imaging format, number of scans in the X-axis direction and Y-axis direction of the OCT, number of repeated scans at the same position, etc.). It also stores imaging alignment parameter information (fixation light position, imaging position, focus value of infrared fundus images and OCT, C-Gate position, etc.). In addition, it stores parameters set by the operator (luminance contrast adjustment value, judgment of image loss, etc.).

[0049] Furthermore, because the temporary storage unit 304b has limited capacity, data for interrupted processing may be moved from the temporary storage unit 304b to the long-term storage unit 304a in order to free up capacity. In addition, the contents of the temporary storage unit 304b may be copied to the long-term storage unit 304a as a backup in case the temporary storage unit 304b loses data.

[0050] Furthermore, when the shooting control unit 301, analysis unit 303, and display control unit 302 handle data stored in the long-term storage unit 304a, the storage unit 304 copies that data to the temporary storage unit 304b. In addition, temporary data from programs that is not stored in the long-term storage unit 304a is stored on the temporary storage unit 304b.

[0051] (Screenshot from an ophthalmic imaging device) Next, referring to Figure 4, the screen displayed by the display control unit 302 for performing imaging with the ophthalmic imaging device 100 of this embodiment will be described. Figures 4(a) and 4(b) are imaging screens 400 for acquiring examination data for a patient specified on a patient screen (not shown) by taking OCT and fundus camera images with the ophthalmic imaging device 100. The internal configuration of the imaging screen 400 differs between OCT and fundus camera. Figure 4(a) shows the OCT imaging screen 400. Figure 4(b) shows the fundus camera imaging screen 400. Depending on the examination protocol selected in the examination protocol selection area 410, the screen switches to the OCT imaging screen 400a for OCT and to the fundus camera imaging screen 400b for fundus camera.

[0052] The examination protocol selection area 410 is a common area for both the OCT imaging screen 400a and the fundus camera imaging screen 400b, where you can set the left and right eyes, examination protocol, fixation light type, etc. The examination protocol has pre-set imaging methods and one or more imaging patterns, imaging size, initial fixation light position, etc. The imaging method is, for example, individual imaging or automatic sequence imaging. The imaging pattern is, for example, imaging unit (fundus camera or OCT) and imaging format (for fundus camera units, color imaging or FAF imaging, etc.; for OCT units, cross scan, multi-cross scan, 3D scan, or OCTA scan, etc.).

[0053] The operator can select a desired examination protocol from one or more available protocols. If the imaging method is individual imaging, the operator can select the imaging pattern to be performed from the imaging patterns set for the selected examination protocol. The imaging screen switches depending on whether the imaging unit for the imaging pattern is an OCT or a fundus camera. If the imaging method is automatic sequence imaging, the imaging screen for the imaging unit that will be the first imaging pattern in the sequence will be displayed.

[0054] The OCT imaging screen 400a has an anterior eye preview 420, fundus preview 430a, and OCT preview 450, and displays anterior eye observation images, infrared fundus images, and tomographic images acquired from the ophthalmic imaging device 100. The imaging control unit 301 performs imaging alignment by adjusting the pupil position including depth from the anterior eye observation image, the focus position and scan position from the infrared fundus image, and the coherence gate position from the tomographic image. There are automatic and manual imaging alignment methods. In the individual imaging method, when the start button 440 is pressed, the imaging control unit 301 performs automatic alignment in the order of pupil position, focus position, and coherence gate position. After that, manual alignment by the operator becomes possible, and by pressing the capture button 441 after manual alignment, the selected imaging pattern is executed. In the case of automatic sequence shooting, after pressing the start button 440, the shooting control unit 301 performs automatic alignment, similar to the individual shooting method, and then the shooting control unit 301 continues to perform shooting in the order of the shooting patterns set in the selected examination protocol. If realignment is required, such as when the fixation light position changes in the next shooting pattern, automatic alignment is performed again before the next shooting. In automatic sequence shooting, pressing the pause button (not shown) switches to a state where manual alignment is possible, and the operator can perform manual alignment and then resume automatic sequence shooting.

[0055] The anterior eye preview 420 displays the anterior eye observation image acquired from the ophthalmic imaging device 100. The operator can adjust the vertical position of the eye under examination E by pressing the chin rest position adjustment button 421 on the chin rest part (not shown) of the ophthalmic imaging device 100. The operator can also adjust the position of the imaging optical system 170 relative to the eye under examination E by operating the up / down / left / right buttons and depth adjustment button 422 on the anterior eye preview 420 to move the stage part 171 of the ophthalmic imaging device 100. The anterior eye preview 420 shows a circle mark indicating the pupil guide position, a plus mark indicating the center of the imaging optical axis, and a dot mark indicating the target position of the pupil center. The operator determines the pupil position by adjusting the position of the chin rest and imaging optical system 170 using these marks as a reference. Note that the positions of the marks other than the optical axis center may be changed according to the fixation light position and the condition of the eye under examination E, such as cataracts. Furthermore, the imaging control unit 301 has an anterior eye tracking function, which calculates the amount of movement of the eye under examination E from the pupil position detected from the anterior eye observation image, and operates the stage unit 171 to maintain the pupil position determined by automatic or manual alignment.

[0056] The fundus preview 430a displays an infrared fundus image acquired from the ophthalmic imaging device 100. The operator can change the focus position by operating the focus adjustment unit 431. The focus adjustment unit 431 can adjust the focus for both the fundus observation image and the OCT. By pressing the auto-focus adjustment button on the focus adjustment unit 431, the imaging control unit 301 automatically adjusts the focus position. The fixation lamp position is also indicated on the fundus preview 430a and is set to the initial fixation lamp position for the selected imaging pattern. The operator can change the fixation position of the eye under examination by moving the fixation lamp mark on the fundus preview 430a. Furthermore, a scan pattern indicating the position and range for acquiring tomographic images is displayed on the fundus preview 430a. The operator can change the position, size, tilt, and scan interval of the scan pattern by operating on the scan pattern on the fundus preview 430a or by using the editing buttons in the fundus preview button area 432a. Furthermore, the imaging control unit 301 has a fundus tracking function that can detect fundus movement from the infrared fundus image and maintain the position of the specified scan pattern. Depending on the ophthalmic imaging device 100, the dimensions of the infrared fundus image may change depending on the focus position. In that case, the image acquisition unit 303 may enlarge or reduce the image so that the display content in the fundus preview 430a does not change depending on the focus position. This ensures that the fixation light and scan pattern are maintained even when the focus position is changed. In addition, the imaging control unit 301 has an automatic exposure (AE) function that adjusts the brightness of the image from the acquired infrared fundus image. Also, if the contrast of the acquired infrared fundus image is poor, the contrast may be automatically adjusted so that the focus adjustment is easier to see.

[0057] The OCT Preview 450 displays tomographic images created by the image acquisition unit 303 from OCT signal data acquired from the ophthalmic imaging device 100. By operating the coherence gate adjustment unit 451, the operator can control the imaging control unit 301 to move the coherence gate position within the ophthalmic imaging device 100, thereby adjusting the depth-direction position of the acquired tomographic image. Furthermore, by pressing the automatic coherence gate adjustment button on the coherence gate adjustment unit 451, the imaging control unit 301 automatically adjusts the coherence gate position. The OCT Preview 450 also displays quality indicators based on the displayed tomographic image. These quality indicators are calculated, for example, from the signal intensity of the OCT signal data and the brightness and noise level of the imaged tomographic image.

[0058] The operator instructs the imaging control unit 301 to perform OCT imaging by pressing the capture button 441, based on the alignment details and quality indicators in the anterior eye preview 420, fundus preview 430a, and OCT preview 450. The imaging control unit 301 images the subject eye E based on the selected imaging pattern, and the acquired data is reconstructed into a tomographic image in the analysis unit 303, while also acquiring an infrared fundus image. The acquired tomographic image and infrared fundus image are displayed on an imaging result confirmation screen (not shown). If the tomographic image is a 3D scan or OCT, the analysis unit 303 generates a frontal fundus image from the three-dimensional tomographic image and motion contrast data, and displays it on the imaging result confirmation screen. On the imaging result confirmation screen, the operator can input whether the imaging was successful or unsuccessful. The imaging control unit 301 saves the tomographic image, tomographic image quality indicators, infrared fundus image, imaging information, and imaging alignment parameter information as OCT examination data in the storage unit 304, along with the operator's selection of imaging or unsuccessful. Furthermore, data other than that required for displaying the shooting result confirmation screen is processed by the analysis unit 303 as a parallel process separate from the operation of the shooting screen 400 and stored in the storage unit 304. Specifically, data used for post-examination diagnosis, such as layer recognition data obtained from layer analysis and smoothed images obtained from tomographic image overlay processing, is stored in the storage unit 304.

[0059] The fundus camera imaging screen 400b has an anterior eye preview 420, a fundus preview 430b, and an imaging result confirmation area 460, and displays anterior eye observation images, infrared fundus images, and fundus photographs acquired from the ophthalmic imaging device 100. Imaging alignment is performed with the fundus camera as with the OCT imaging screen 400a, but only the pupil position and focus position are adjusted; adjustment of the scan position and coherence gate position is not required.

[0060] The anterior eye preview 420 shares the same mechanism as the OCT imaging screen 400a, and the anterior eye observation image, operation method, and alignment method are the same. However, in the fundus camera, due to the positional relationship between the eye E under examination and the imaging optical system 170 based on anterior eye alignment, a high-luminosity area in the peripheral region called corneal flare appears in the fundus photograph. Therefore, in the fundus camera, the accuracy of the automatic alignment and tracking functions may be set more strictly than in the OCT.

[0061] In the fundus preview 430b, an infrared fundus image is acquired from the ophthalmic imaging device 100 and displayed with a mask applied by the image acquisition unit 303. The method for adjusting the focus position is the same as in the fundus preview 430a of the OCT imaging screen 400a. The scaling of the fundus observation image based on the focus position, as well as the AE function and automatic contrast adjustment, may also be performed in the same way as in the OCT imaging screen 400a, but it is preferable to perform the scaling after the masking process. In addition, a fixation light mark is displayed in the fundus preview 430b, and the fixation position of the eye under examination can be changed using the same operation as in the OCT imaging screen 400a. In the fundus preview button area 432b of the fundus camera imaging screen 400b, fundus photograph shooting parameters such as switching the small pupil imaging format, shooting light intensity, shooting size, ISO sensitivity, shooting magnification, and color correction can be changed. When the small pupil imaging format or shooting magnification is changed, shooting indicators are displayed on the fundus preview 430b, and the operator and the shooting control unit 301 adjust the alignment position and shooting timing based on the indicators.

[0062] The operator instructs the shooting control unit 301 to take a picture with the fundus camera by pressing the shooting button 441, based on the alignment information in the anterior eye preview 420 and fundus preview 430b. The shooting control unit 301 performs the shooting based on the selected shooting pattern and the shooting parameters set in the shooting preview button area 432b. The shooting control unit 301 acquires the image as a fundus photograph by performing mask processing on the captured image using the analysis unit 303. The acquired image is displayed in the shooting result confirmation area 460. The operator can input success or failure of the shooting by selecting the OK button 461 or NG button 462. The acquired image, along with the operator's input, shooting information, and shooting alignment parameter information, is saved in the storage unit 304 as examination data for the fundus camera. If the initial values ​​of brightness, contrast, gamma value, and each color tone have been changed in advance, the analysis unit 303 performs image processing before mask processing. Furthermore, if the selected shooting pattern settings include settings for generating digital color filter image processing images, the analysis unit 303 performs the specified image processing from the fundus photograph stored in the storage unit 304. This image processing is performed as a parallel process separate from the operation of the shooting screen 400. The processed image is stored in the storage unit 304. In automatic sequence shooting, the shooting control unit 301 performs automatic shooting after automatic alignment. At that time, it uses the anterior eye preview 420, which is performing anterior eye tracking, to determine the shooting timing and perform shooting. In order to prevent shooting failures due to blinking, the result of blink detection may be used to determine the shooting timing. Specifically, the timing immediately after blink detection is determined as the shooting timing. It often takes several seconds or more between blinks. By determining the timing immediately after blink detection as the shooting timing, the possibility of overlap between shooting and blinking is reduced. Furthermore, it is expected that anterior eye tracking will be unstable immediately after blink detection. Therefore, the timing immediately after blink detection, and when anterior eye tracking has recovered from its unstable state, may be determined as the timing when image capture is possible.

[0063] When the selected examination protocol's imaging method is automatic sequence imaging, and the operator presses the start button 440, the display control unit 302 displays the automatic sequence imaging progress dialog 470 on the imaging screen 400. The automatic sequence imaging progress dialog 470 is illustrated in Figure 4(c). The automatic sequence imaging progress dialog 470 presents the operator with the details and progress of the automatic sequence imaging.

[0064] The automatic sequence shooting progress dialog 470 has a shooting sequence progress 471, an individual shooting progress 472, and a pause button 473. On the shooting sequence progress 471, the shooting formats of the selected examination protocol are listed. If the target eye setting of the examination protocol is binocular, the shooting formats are listed for both the left and right eyes separately. If the target eye setting of the examination protocol is unilateral, the shooting formats are listed only for the current left and right eyes. An indicator of the shooting status is displayed for each listed examination protocol, allowing the operator to check the shooting format being shot, the shooting format that has been shot, and the shooting format that is scheduled to be shot.

[0065] In the individual shooting progress 472, the shooting status of the currently being shot format is displayed. If alignment is in progress, the current alignment details are displayed; if shooting is in progress, the total number of tomographic images to be acquired and the number of tomographic images acquired are displayed. When multiple shooting formats are being shot in automatic sequence shooting, the shooting control unit 301 determines whether the next shooting format can be shot after one shooting format has been completed. If the next shooting format can be shot with the same alignment details, shooting begins. If the alignment details, such as the left / right eyes or fixation light position, are different, the left / right eye switching or fixation light position change is performed, and then the necessary alignment is performed again before shooting begins.

[0066] Furthermore, the operator can stop the automatic sequence shooting at an intermediate stage by pressing the pause button 473 if they need to interrupt or manually align the eye under examination, based on the condition of the eye E. When the pause button 473 is pressed, the display control unit 302 hides the automatic sequence shooting progress dialog 470, enabling operation on the shooting screen 400. At this time, the shooting button 441 is replaced with a resume button. When the operator presses the resume button, the display control unit 302 displays the automatic sequence shooting progress dialog 470 again, and the shooting control unit resumes automatic sequence shooting from the point in time when the pause button 473 was pressed.

[0067] Furthermore, by adding a pause setting to the examination protocol settings, it is possible to ensure that a pause is always performed at a specific timing. For example, by adding a setting to pause when switching between left and right eyes, the system will stop when automatic sequence shooting of both eyes is completed after shooting of one eye. This allows the operator to confirm the recovery from pupillary constriction caused by shooting one eye, especially when fundus camera shooting is performed, before starting to shoot the other eye. Also, by setting the system to automatically pause after alignment is completed, the operator can be sure to confirm the results of the automatic alignment performed by the shooting control unit 301 before shooting. In addition, instead of pausing, it is also possible to set waiting times at each point in the examination protocol settings. By setting the system to pause for a specified time when switching between left and right eyes, the shooting control unit 301 can pause for the amount of pupillary constriction recovery without operator intervention and perform automatic sequence shooting of both eyes. Furthermore, by setting the system to pause for a specified time after automatic alignment, the operator can decide whether to perform manual alignment between automatic alignment and automatic shooting.

[0068] Furthermore, the imaging control unit 301 may perform a guidance function for the subject as a way to ensure proper imaging alignment. For example, this could include voice instructions from a speaker (not shown) prompting the subject to fixate on the fixation light or change the fixation light position, indicating when the subject can blink, or giving a signal to start imaging, depending on the imaging alignment sequence. In addition, symbols or letters indicating the direction of the fixation position may be displayed in the line of sight of the subject eye E, or a countdown for imaging may be displayed. The imaging control unit 301 may also change the timing of the operation of the ophthalmic imaging device 100 in accordance with the execution of the guidance function. For example, in the case of voice guidance, there is a method of synchronizing the end of the voice prompt to start imaging with the start of imaging so that imaging begins after the voice prompt to start imaging has been read aloud. Another method is to wait until the voice related to the previous operation of the ophthalmic imaging device 100 has finished, thereby synchronizing the start of the next operation with the voice. For example, when starting imaging, an announcement to start imaging may be made, and imaging may start in synchronization with the end of the announcement. Furthermore, when prompting blinking, it is also acceptable to either wait a certain amount of time after the voice prompt is read aloud before starting the recording, or to start recording only after a blink has been detected.

[0069] (Display screen for the inspection protocol settings according to this embodiment) Referring to Figure 5, the screen for creating inspection protocols in this embodiment will be described. Figure 5 is the protocol setting screen 500 for creating one of the inspection protocols. When one inspection protocol is specified from the storage unit 304 on the shooting screen 400, the shooting control unit 301 performs shooting according to the specified inspection protocol. An example of setting up automatic sequence shooting will be described below.

[0070] The inspection protocol settings screen 500 has an imaging method setting area 510, an imaging format list setting area 520, an imaging format setting area 530, a recommended environment display area 540, an OK button 550, and a Cancel button 560. The inspection protocol settings screen 500 is displayed as a screen for creating a new inspection protocol or modifying an existing inspection protocol from the inspection protocol list screen (not shown). When modifying an existing inspection protocol setting, the contents of the selected existing protocol setting are reflected and displayed in the protocol settings screen 500. Each inspection protocol setting can be identified by the inspection protocol name 501 entered on the inspection protocol settings screen 500.

[0071] In the imaging method setting area 510, the operator can select whether the examination protocol is individual imaging 511 or automatic sequence imaging 512. If individual imaging 511 is selected, the operator can select one imaging format from those registered in the examination protocol and perform imaging. For example, if automatic sequence imaging 512 is selected, all imaging formats registered in the examination protocol can be captured with a single imaging command. Furthermore, the imaging method setting area 510 has detailed settings for both individual imaging 511 and automatic sequence imaging 512. In individual imaging 511, an automatic transition setting 513 is available to determine whether the imaging format selected after imaging will be the next imaging format or remain the same. In automatic sequence imaging 512, an eye setting 514 is available to determine whether both eyes or one eye will be imaged with a single imaging command, and a sequence adjustment setting 515 is available to determine whether to include pauses and specific waiting times in the imaging sequence.

[0072] In the shooting format list setting area 520, you can add, delete, and rearrange the shooting formats to be set as an examination protocol in the shooting format list 523. In the shooting format selection menu 521, you can select the shooting formats that can be registered in the shooting format list 523. The selectable shooting formats change depending on the conditions. These conditions include, for example, the software license registration status, the contents already registered in the shooting format list 523, and PC specifications such as memory capacity. For example, if OCTA requires activation through software license registration and is not activated, the OCTA shooting format will not be displayed in the shooting format selection menu 521. Also, if the OCTA shooting format requires a minimum of 8GB of memory and the PC has 4GB of memory, the OCTA shooting format will not be displayed in the shooting format selection menu 521. Furthermore, if automatic sequence shooting 512 is selected and the fundus camera shooting format is already registered in the shooting format list 523, the shooting format will not be displayed in the shooting format selection menu 521.

[0073] After selecting a shooting format in the shooting format selection menu 521, selecting the add button 522 will add the selected shooting format to the shooting format list 523.

[0074] The imaging format list 523 displays the imaging formats created or modified on the examination protocol setting screen 500 in the order in which they will be taken. Imaging formats added to the imaging format list 523 can be selected, and the details of the selected imaging format are displayed in the imaging format setting area 530. When an imaging format is selected, the delete button 524 and the order change button 525 become active. The delete button 524 can be used to remove the selected imaging format from the list, and the order change button 525 can be used to change the order of the selected imaging formats.

[0075] In the imaging format setting area 530, detailed settings for the imaging format selected in the imaging format list 523 can be configured. If the selected imaging format is OCT, the horizontal resolution of the tomographic image (A-Scan count) and the number of tomographic images (B-Scan count) can be set. Other settings that can be configured include the size of the imaging range of the tomographic image, the orientation of the tomographic image, the fixation light position, the number of repeated scans required for tomographic image overlay and OCTA, the C-Gate direction, and the initial display items on the report screen. Note that some settings may change depending on the connected ophthalmic imaging device 100, the software license registration status, and the PC specifications. For example, if there is an item in the A-Scan count selection that cannot be captured with the memory capacity installed in the PC, it is possible to prevent the imaging format that cannot be captured from being executed on the imaging screen 400 by not displaying it as an option in advance.

[0076] In the recommended environment display area 540, the required memory capacity and recommended memory capacity when executing the inspection protocol on the shooting screen 400 are displayed based on the current settings in the shooting method setting area 510, the shooting formats registered in the shooting format list 523, and the detailed settings for each shooting format. The required memory capacity is the minimum capacity required when executing using the inspection protocol, and may not be available if used continuously or if other processes are running on the PC. It is desirable to calculate the required memory capacity by referring to a fixed value for the memory capacity required by the OS and system, or by referring to the current amount of memory used as set in the protocol setting screen 500. The recommended memory capacity is the amount of memory that allows continuous shooting even if the analysis processing of the previous inspection protocol by the analysis unit 303 is not yet complete. The recommended memory can be calculated by doubling the memory capacity required to execute the inspection protocol calculated in the required memory, or by adding the maximum memory capacities for shooting and analysis processing, respectively. Furthermore, it may also be calculated by referring to other inspection protocols that have already been created and using the maximum memory capacity of the analysis unit 303 within those protocols. Furthermore, if the selection options in the shooting format selection menu 521 or the shooting format setting area 530 are not restricted based on PC specifications or software license registration status, the recommended environment suggestion area 540 may present any environmental requirements that are lacking for the actual implementation of the inspection protocol. Environmental requirements include, for example, license registration, presence or absence of a GPU, and the difference between installed memory and required memory.

[0077] The OK button 550 saves the contents of the protocol settings screen 500 to the memory unit 304. The Cancel button 560 discards the contents of the protocol settings screen 500. If the protocol settings screen 500 is opened to modify an already created inspection protocol, the OK button updates the inspection protocol saved in the memory unit 304. Note that the OK button 550 may be disabled if no imaging format is selected in the imaging format list 523, or if the PC does not meet the required memory capacity displayed in the recommended environment display area 540. Alternatively, the OK button 550 may be enabled, and an error message may be displayed when the OK button is pressed.

[0078] (Timeline flow of the testing protocol implementation) Referring to Figure 6(a), the time-series flow of the examination protocol performed on the imaging screen 400 and the processing time of each step will be explained. Figure 6(a) shows the processing content and flow of the examination protocol in chronological order. The examination protocol is shown as an example of an automatic sequence imaging 512 with two imaging formats registered. After selecting the examination protocol, when the start button 440 is pressed, the ophthalmic control processing device 300 processes in the following order: alignment phase 600, imaging phase 610, and analysis processing phase 620 for each imaging format. Note that the examination protocol shown in Figure 6(a) is an example of either the first control or the second control. Also, the alignment phase 600, imaging phase 610, and analysis processing phase 620 for each imaging format are examples of either the first or second processing. Furthermore, the alignment phase 600 is an example of either the first or second alignment processing. Also, the imaging phase 610 is an example of either the first or second imaging processing. Furthermore, analysis processing phase 620 is an example of the first analysis process or an example of the second analysis process.

[0079] In the alignment phase 600, the imaging control unit 301 first performs anterior eye alignment by moving the stage unit 171 based on the anterior eye observation image so that the imaging optical system 170 of the ophthalmic imaging device 100 is properly positioned in the pupil of the eye E being examined. The processing time for anterior eye alignment varies depending on the positional relationship between the eye E being examined and the stage unit 171 at the start of imaging. For example, the processing time is shorter if the stage unit 171 is already close to the expected pupil position.

[0080] Next, the imaging control unit 301 performs autofocus to adjust the focus position of the fundus observation image that becomes observable after anterior eye alignment. Autofocus can be performed by acquiring fundus observation images at a specific range of focus positions and identifying the optimal focus position from a histogram, or by displaying a focus indicator such as a split and moving the focus position so that the indicator shows the optimal position. The processing time differs depending on the method used.

[0081] Next, the imaging control unit 301 performs auto-C-Gate, which moves the coherence gate (C-Gate) position to display the tomographic image at the optimal position. There are several methods for auto-C-Gate, and the processing time required differs depending on the method. For example, one method determines the optimal C-Gate position from the tomographic observation image and brightness value histogram after moving the C-Gate to a specific range of positions. Another method calculates and sets the optimal position from the tomographic observation image displayed after moving the C-Gate to a provisional position estimated from the current focus value.

[0082] Finally, the imaging control unit 301 confirms that the adjusted stage position, focus position, and C-Gate position have been successfully implemented, and then performs automatic imaging to begin shooting. In automatic imaging, the system checks whether the necessary conditions for imaging are met, such as the pupil position and pupillary constriction state adjusted in anterior eye alignment, blinking state, facial and eye movements, scan position, C-Gate position, and tomographic image signal intensity, before starting the imaging. If the starting conditions are not met, the imaging control unit 301 performs additional alignment processing. The processing time for automatic imaging varies depending on the alignment state of the eye E being examined. The shortest time occurs when no additional alignment processing is required. In the case of a fundus camera imaging protocol, flare and brightness of the fundus observation image are included in the shooting start conditions.

[0083] In the imaging phase 610, imaging is performed sequentially according to the selected examination protocol. The time required for one imaging format varies depending on the format, and the time increases with the number of A-Scans performed. Rescans are performed during imaging to re-capture any failed images due to blinking or eye movements, and the process moves to the next stage after all images have been acquired. When moving to the next imaging format, adjustments are made to start the next imaging. During the adjustment, the imaging control unit 301 checks the imaging start conditions performed in the auto imaging of the alignment phase 300 to confirm whether the next imaging format can be started, and performs additional alignment processing as needed. In addition, depending on the changes in imaging conditions between the previous and next imaging formats, part or all of the alignment phase is re-executed. For example, if the OCT imaging range or C-Gate direction changes, the optimal C-Gate position changes, so the auto C-Gate alignment is re-executed. Also, if the fixation light position is changed, additional alignment is performed, such as checking the fixation state of the subject's eye. Furthermore, if the procedure includes fundus camera examination, confirmation of pupillary constriction and fixation recovery after fundus photography may be performed as an additional alignment check.

[0084] After all imaging formats have been completed, the analysis unit 303 reconstructs and visualizes tomographic images from the captured OCT signal data in order to display the imaging results. Furthermore, the display control unit 302 generates the necessary images for the imaging result confirmation screen from the obtained tomographic images and other data, and displays them on the confirmation screen. If a fundus camera imaging format is used, the analysis unit 303 performs necessary image processing, such as masking, on the received images, and the display control unit 302 displays these on the confirmation screen.

[0085] In analysis phase 620, the necessary analysis processing is performed to display the captured OCT data on a diagnostic screen (not shown). Common analysis includes layer recognition and position determination of the optic disc and macula. Individual processing for each imaging format is also performed, such as optic disc shape analysis, overlay processing, and decorrelation value calculation for motion contrast image generation. Since these analysis results are not needed on the imaging screen 400, they are processed in parallel with the imaging screen 400. Analysis processing is performed while the data is stored in the temporary storage unit 304b for each imaging format. Once the analysis is complete, the results are added to the examination data stored in the long-term storage unit 304a. The analysis results for all captured imaging formats are saved, and all processing of the examination protocol is completed. If a fundus camera imaging format is available, the analysis unit 303 generates additional images, such as digital filter images, according to the detailed settings of the imaging format and saves them to the long-term storage unit 304a.

[0086] (Flowchart showing the start time of the inspection protocol when memory is insufficient due to parallel analysis processing according to this embodiment) Next, referring to Figures 7, 6(b), and 6(c), we will describe the flow for displaying the start time when memory becomes insufficient due to parallel analysis processing during the execution of the inspection protocol. Figure 7 is a flowchart of the operation for displaying the start time of the selected inspection protocol according to this embodiment. In this embodiment, the method for switching the start button 440 between enabled and disabled is shown as a result of the determination of whether or not to start.

[0087] Let's consider the case where the ophthalmic control processing unit 300 does not have enough memory for the memory required by the examination protocol being used. In this case, even if there is sufficient memory at the start of the examination protocol, both the examination protocol and the parallel analysis processing may consume a large amount of memory simultaneously after they start. In that case, due to insufficient memory capacity, the examination protocol cannot be safely started until the analysis processing is completed. Also, if the parallel analysis processing is frequently paused to execute the examination protocol, when multiple shooting formats such as automatic sequence shooting 512 are executed simultaneously, shooting formats for which the analysis processing has not been completed tend to accumulate. Therefore, when an operation to select an examination protocol is performed on the shooting screen 400, the display control unit 302 determines whether or not to execute the parallel analysis processing based on the content of the analysis processing, and switches the start button 440 to enabled or disabled.

[0088] Specifically, in step S701, the operator selects an inspection protocol to execute from the inspection protocol selection area 410. Here, the inspection protocol for automatic sequence imaging 512 is selected. If there is already an inspection protocol selected as the default when the imaging screen 400 is displayed, and the operator uses the default inspection protocol, this step can be performed when the imaging screen 400 is displayed. Note that the inspection protocol selected in step S701 is an example of the second control.

[0089] In step S702, the display control unit 302 of the ophthalmic control processing device 300 checks whether there are parallel analysis processes (analysis processes currently being executed by the analysis unit 303 or subsequent analysis processes). If there are no parallel analysis processes, it is determined that the examination protocol can be executed, and in step S714, the display control unit 302 activates the start button. If there are analysis processes, steps S703 and later are executed. Note that parallel analysis processes are an example of the first processes executed in the first control.

[0090] Here, for example, the examination protocol selected in step S701 is a protocol for examining the patient's right eye, and the examination protocol for the parallel analysis process is a protocol for examining the patient's left eye. However, the combination of examination protocols is not limited to this. It may be a combination for examining the right eye of the same patient consecutively, or a combination for examining the right eye of different patients consecutively.

[0091] In step S703, the ophthalmic control processing device 300 calculates the maximum memory capacity for the alignment phase 600 and the imaging phase 610 when executing the examination protocol selected in step S701. The memory capacity used in the alignment phase 600 is calculated from the content of the alignment to be performed. Alternatively, the memory capacity may be calculated from the case that uses the most memory. Alternatively, the memory capacity may be calculated from the memory capacity measured in advance when the alignment to be performed was executed. The memory capacity used in the imaging phase 610 is calculated from the total number of A-Scans of the imaging format registered in the selected examination protocol. In reality, the maximum memory capacity may change due to rescans and the order of imaging formats, so the actual measured memory capacity used may be referenced from values ​​prepared in advance for each combination within the examination protocol. Note that the maximum memory capacity for the alignment phase 600 and the maximum memory capacity for the imaging phase 610 are examples of second memory information.

[0092] In step S704, the ophthalmic control processing unit 300 checks the memory capacity used in the parallel analysis processes (the analysis process executed by the analysis unit 303 and subsequent analysis processes) and determines the remaining memory capacity Mremain of the ophthalmic control processing unit 300 when maximum memory is being used. Note that the memory capacity used in the parallel analysis processes is an example of the first memory information.

[0093]

number

[0094] Here, Mall_current refers to the memory capacity currently used by the ophthalmic control processing unit 300, and Mpp_current refers to the memory usage currently used by the analysis unit 303. By subtracting these, the memory usage of the ophthalmic control processing unit 300 other than the analysis processing can be obtained. Next, Mpp_max refers to the maximum memory usage among the analysis processing that has not yet been started by the analysis unit 303. Using Equation 1, the maximum memory usage for the analysis processing of the currently running and planned imaging formats is determined, and the largest value among them is taken as Mpp_max. Note that Mpp_current and Mpp_max are examples of the first memory information.

[0095] Each analysis process can be calculated from the analysis content for each shooting format, the total number of A-scans for each shooting format, and the number of repeated shots. However, it is also possible to prepare memory usage values ​​in advance for each shooting format and setting. In that case, setting values ​​determined from actual measurements can reduce the error with the actual values. For analysis processes of shooting formats that the analysis unit 303 is currently performing, it is desirable to calculate from the unperformed processes within the analysis process. For example, if the layer recognition process has already been completed, the maximum memory usage for processes other than layer recognition should be determined. The maximum memory usage can be calculated from the detailed settings of the shooting format during the analysis process and the remaining processing content. However, the memory usage for each process may be saved in advance in the storage unit 304 and referenced. Alternatively, the ratio relationship of memory usage for each process within the analysis process may be set in advance, and the maximum memory usage may be calculated from the highest ratio value among the remaining processes. By adding Mpp_max to the memory usage of the ophthalmic control processing device 300 other than the calculated analysis process, the maximum memory usage of the ophthalmic control processing device 300 when the remaining analysis processes are executed can be determined. By subtracting the calculated maximum memory usage from the memory capacity Mall installed in the ophthalmic control processing unit 300, the remaining capacity Mremain is calculated.

[0096] In step S705, the ophthalmic control processing unit 300 checks whether there is sufficient remaining memory capacity when executing the examination protocol. Specifically, it checks whether the remaining memory capacity of the ophthalmic control processing unit 300 at the maximum memory usage of the analysis processing phase 620, as determined in S704, is greater than the maximum memory capacity of the examination protocol, as determined in S703. If it is greater, it is determined that there is sufficient remaining memory capacity to execute the examination protocol, and in step S714, the display control unit 302 activates the start button. If it is less, it is determined that there is insufficient remaining memory capacity, and steps S706 and beyond are executed.

[0097] In step S706, the ophthalmic control processing device 300 checks whether the remaining memory capacity determined in step S704 is greater than the maximum memory capacity of the alignment phase 600 determined in step S703. If the remaining memory capacity is small, it determines that the examination protocol cannot be started and proceeds to steps S710 and later; if it is large, it proceeds to steps S707 and later.

[0098] In step S707, the ophthalmic control processing device 300 calculates the time required for the alignment phase 600 of the examination protocol. The time required for the alignment phase 600 varies depending on the condition of the ophthalmic imaging device 100 and the eye E being examined, the method being used, etc. Therefore, it is desirable to calculate the sum of the shortest times for each process in the alignment phase 600.

[0099] In steps S708 and S710, the ophthalmic control processing unit 300 calculates the completion time for the parallel analysis processes. The analysis unit 303 calculates the time required for each analysis process for the imaging format that is currently being analyzed or is scheduled for analysis. The time required for each analysis process can be calculated based on the analysis content for each imaging format, the total number of A-Scans and repeated images for each imaging format, and the specifications of the CPU or GPU of the ophthalmic control processing unit 300 that is executing the analysis. Alternatively, the processing time may be prepared in advance for each analysis content and then calculated by multiplying it by a coefficient according to the specifications of the ophthalmic control processing unit 300. Furthermore, the processing time and coefficient may be prepared by the analysis unit 303 performing analysis on sample data in advance. For imaging formats that the analysis unit 303 is currently analyzing, a more accurate completion time can be calculated by using the remaining analysis process or the elapsed time since the start of the analysis. In addition, a buffer that takes error into account may be added to the calculated completion time of the analysis process.

[0100] In step S709, the ophthalmic control processing unit 300 checks whether the completion time of the analysis process calculated in step S708 is shorter than the time of the alignment phase 600 calculated in step S707. Figure 6(b) shows an example of the transitions for two examination protocols arranged in chronological order. If the completion time of the analysis process is short, the analysis process is completed during the alignment phase 600, as shown in Figure 6(b), and the memory used for the analysis process is released before the start of the imaging phase 610. Therefore, it is determined that the examination protocol can be performed, and in step S714, the display control unit 302 activates the start button. If the completion time of the analysis process is long, steps S711 and later are executed.

[0101] In step S711, the display control unit 302 of the ophthalmic control processing device 300 disables the start button because the selected examination protocol cannot be executed at this time. In other words, by disabling the start button, the timing of the execution of the selected examination protocol is delayed.

[0102] In step S712, the ophthalmic control processing unit 300 calculates the time until the selected examination protocol can be started. The calculation is divided into two cases in step S706: when there is insufficient memory capacity for alignment and when there is sufficient memory capacity. If it is determined that there is insufficient memory capacity, the timing when the analysis is completed becomes the timing when alignment can be started, as shown in Figure 6(c). Specifically, the time taken for the alignment phase 610 calculated in alignment step S710 becomes the start time. On the other hand, if it is determined that there is sufficient memory capacity, it is necessary to wait for the analysis process to be completed by the time the imaging phase 610 starts, as shown in Figure 6(d). Therefore, the difference between the time taken for the alignment phase 610 calculated in step S707 and the time when the analysis process is completed calculated in step S708 becomes the time until the examination protocol can be started. Note that the waiting time shown in Figures 6(c) and 6(d) is a waiting process and is an example of a process executed in the second control.

[0103] In step S713, the display control unit 302 of the ophthalmic control processing device 300 informs the operator that the examination protocol cannot be started. Specifically, this can be done by displaying the start time calculated in step S712 on the imaging screen 400. For example, the display control unit 302 can display the start time in the start waiting display area 401 on the imaging screen 400 to inform the operator that the examination protocol cannot be started and how long it will take until it can be started. After this step, the process is repeated back to step S702, so that the start time can be constantly updated and displayed while the procedure is unavailable, and the process moves to the timing step S710 when the procedure becomes available, and the start button becomes enabled.

[0104] According to the embodiment described above, when the analysis processing of the previous image is being performed in parallel and the next inspection protocol is to be executed, the operator can be presented with a start time for the inspection protocol that will not result in insufficient memory. This makes it possible to prompt the operator to start the inspection protocol at an appropriate time without running out of memory during execution, even in environments where there is insufficient memory to continuously execute the inspection protocol of the automatic sequence imaging 512.

[0105] In this embodiment, the selection of an examination protocol triggers a determination of whether the examination protocol can be started, and if it cannot be started, the system displays the time until it can be started. However, this is not limited to this. If the start button is used as the trigger, a message may be displayed if it cannot be started, and the time until it can be started may be displayed in that message. In this case, unless the operator cancels, the system will automatically start when the time until it can be started reaches zero, eliminating the need to press the start button each time to check the waiting time. The system may also display the information at all times, not just on the shooting screen 400. In this case, on screens other than the shooting screen 400, the determination may be based on the examination protocol that is selected by default when the shooting screen 400 is entered. This allows the operator to check in advance when the examination for the next patient can be started. If the examination protocol selected changes for each patient, the system may determine and display the time until it can be started when the patient is selected on a patient selection screen (not shown). In addition, although the display control means 302 displays the time until it can be started, it may also simultaneously display the insufficient memory amount and the recommended memory displayed on the protocol setting screen 500. This allows the user to confirm whether the operating environment is sufficient.

[0106] <Embodiment 2> In this embodiment, we will describe the flow by which the display control unit 302 presents the start time using the transition of remaining memory capacity when the inspection protocol cannot be started due to the memory usage of parallel analysis processes. The memory usage of the analysis process varies depending on the shooting format of the analysis process and the content of the analysis process, and the maximum memory capacity decreases each time a process requiring that maximum memory capacity is completed. Therefore, the timing at which the required memory capacity for the inspection protocol can be secured may be earlier than the start time calculated from the completion time of the parallel analysis processes. Thus, it is desirable to calculate the start time from the transition of memory usage of the analysis process.

[0107] (Calculation flow of the start time taking into account the transition of memory usage in the analysis process according to this embodiment) Referring to Figures 8 and 6(e), we will explain the flow for calculating the start time when parallel analysis processes are performed during the execution of the inspection protocol, based on the transition of memory usage of the analysis processes. Figure 8 shows a flowchart of the operation for calculating the start time that takes into account the transition of memory usage of the analysis processes according to this embodiment.

[0108] Figure 6(e) shows a case in parallel analysis processes where the current analysis process (Analysis 1) does not have enough memory to start the inspection protocol, but the next analysis of the shooting format does. In the case of Figure 6(e), shooting can start at the timing when the next analysis process of the shooting format (Analysis 2) begins. The display control unit 302 checks the transition of memory usage for the analysis processes in chronological order and calculates and displays the start time from the transition of memory usage. Note that the current analysis process (Analysis 1) is an example of the first analysis process. Also, the next analysis process of the shooting format (Analysis 2) is an example of the third analysis process.

[0109] Specifically, steps S801 to S809 are the same as steps S701 to S711 in Figure 7, and steps S810 and S815 are the same as steps S711 and S714 in Figure 7.

[0110] In step S811, the display control unit 302 of the ophthalmic control processing device 300 calculates the transition of memory usage for the analysis processing being performed by the analysis unit 303 in a time series and determines whether the selected examination protocol will be able to be performed before all analysis processing is completed. Specifically, it calculates the remaining memory capacity for each of the imaging formats, including the imaging format currently being analyzed, by calculating Mpp_max in step S804 for each imaging format and arranging them in a time series to check the transition of the remaining memory capacity.

[0111] In step S812, the ophthalmic control processing unit 300 uses the memory capacity transition obtained in step S811 to find the timing at which the examination protocol can be started. Specifically, it checks the timing at which the maximum memory capacity for the alignment phase 600 and the imaging phase 610 of the examination protocol, obtained in step S803, is secured. The method of checking is as follows: If the remaining memory capacity for the alignment phase 600 is determined to be sufficient in step S806, it checks the timing at which the memory usage for the imaging phase 610 will not be insufficient for the subsequent analysis processing. If the remaining memory capacity for the alignment phase 600 is insufficient, it checks the timing at which the memory usage for both the alignment phase 600 and the imaging phase 610 will not be insufficient. If the memory usage for the alignment phase 600 is less than that of the imaging phase 610, it may first determine the analysis processing that will not result in insufficient memory usage for the imaging phase 610, and then check whether the alignment phase 600 can be performed. Specifically, in the analysis process prior to the analysis process in which the imaging phase 610 can be started, it is confirmed that the remaining memory capacity for the time required for the alignment phase 600, calculated in step S807, is greater than the memory usage for the alignment phase. If it is insufficient, the system searches for a timing in the subsequent analysis process in which the alignment phase can be executed and extracts the optimal starting timing.

[0112] In step S813, the ophthalmic control processing device 300 calculates the start time of the examination protocol. Specifically, it calculates the time until the start time of the examination protocol determined in step 812 using the method performed in step S808. For example, if the next analysis process after the currently running analysis process is the start time of the examination protocol, the start time is calculated by subtracting the elapsed time since the start of the currently running analysis process from the time required for the currently running analysis process.

[0113] In step S814, the ophthalmic control processing device 300 uses the start-up time obtained in step S813 to display on the imaging screen 400 the time during which imaging cannot be started.

[0114] According to the embodiment described above, when imaging cannot be started due to the memory usage of parallel analysis processing, the timing at which remaining memory capacity becomes available can be determined, thereby more accurately indicating to the operator the time when the inspection protocol can be started.

[0115] In this embodiment, the remaining memory capacity during analysis processing was checked in chronological order for each shooting format, but this is not limited to this. The remaining memory capacity may be calculated by arranging the memory usage of each individual process within the analysis process in chronological order, or a more accurate transition may be obtained at a finer level. This allows for a more accurate start time to be presented when the processing time for each individual analysis process is long.

[0116] <Embodiment 3> This embodiment describes a flow for shortening the start time by optimizing the processing order of analysis processes when parallel analysis processes prevent image acquisition from starting due to memory usage. If there are multiple image acquisition formats scheduled for analysis, and the order of analysis for the memory-intensive image acquisition format is delayed, the inspection protocol may not be able to start until the analysis for the memory-intensive format is completed. In such cases, it is desirable to change the order of analysis processes to shorten the start time of the inspection protocol.

[0117] (A flow that changes the order of analysis processing based on the transition of memory usage according to this embodiment) Referring to Figures 9 and 6(f), the flow of subsequent analysis processes when there are parallel analysis processes during the execution of the inspection protocol will be explained. Figure 9 shows a flowchart of the operation of changing the order of analysis processes based on the transition of memory usage according to this embodiment.

[0118] If the analysis unit 303 has multiple parallel analysis processes scheduled, the order of the analysis processes can be changed. Specifically, if an analysis process with a large memory usage is scheduled to be processed after an analysis process with a small memory usage that can be performed in parallel with the inspection protocol, the order of the analysis processes can be changed. For example, by changing the order of the analysis processes as shown in Figure 6(f), the time required to start the inspection protocol can be shortened. The display control unit 302 checks which analysis processes will consume the most memory and changes the order of the analysis processes so that these processes are executed first.

[0119] Specifically, steps S901 to S911 are the same as steps S801 to S811 in Figure 8, and steps S914 to S916 are the same as steps S813 to S815 in Figure 8.

[0120] In step S912, the ophthalmic control processing unit 300 checks, based on the memory capacity transition obtained in step S911, whether there are any analysis processes other than the currently running analysis process that can be performed in parallel with the examination protocol. Next, it checks whether there are any analysis processes scheduled that cannot be performed after the analysis process in question. If there are any scheduled analysis processes, step S913 is performed. If there are no scheduled analysis processes, the start time is calculated using the memory capacity transition in step S914 and beyond.

[0121] In step S913, the ophthalmic control processing device 300 optimizes the transition of memory usage in the analysis process by changing the order of the analysis processes performed by the analysis unit 303. Specifically, it extracts analysis processes from the remaining memory capacity of each analysis process obtained in step S911 that have a value less than the maximum memory capacity of the examination protocol calculated in step S903, and changes the order so that they are executed immediately after the analysis process currently being performed. At this time, it is desirable to change the order to the order with the smallest remaining memory capacity. This eliminates the need to change the order again even if the selection of the examination protocol is changed.

[0122] The inspection protocol after the order has been changed is shown in the upper part of Figure 6(f). This figure shows that the order of the analysis processes has been changed from Analysis 1, Analysis 2, Analysis 3 to Analysis 1, Analysis 3, Analysis 2. Specifically, because Analysis 3 uses more memory than Analysis 2, the order has been changed so that Analysis 3 is executed immediately after the currently running analysis process (Analysis 1). In other words, because the remaining memory capacity when Analysis 3 is being executed is less than the remaining memory capacity when Analysis 2 is being executed, the order has been changed so that Analysis 3 is executed immediately after the currently running analysis process (Analysis 1). Because the processing for Analysis 3 uses a large amount of memory, it cannot be processed in parallel with the imaging process. On the other hand, because the processing for Analysis 2 uses less memory, it can be processed in parallel with the imaging process. Therefore, by changing the execution order of Analysis 2 and Analysis 3, the start timing of the imaging process can be advanced.

[0123] According to the embodiment described above, if imaging cannot be started due to the memory usage of parallel analysis processes, the time required for the selected examination protocol to become available for imaging can be shortened by changing the order of the analysis processes.

[0124] In this embodiment, the order of the inspection protocols was changed when there was insufficient memory on the capture screen 400. However, the order of the analysis processing for each inspection protocol may be optimized before execution. In that case, the execution of the next inspection protocol can be optimized.

[0125] Furthermore, if there is an accumulation of analysis processing for multiple test protocols, it is desirable to prioritize the order of the test protocols and change the order for each protocol. This prevents a situation where previously performed test protocols remain unanalyzed indefinitely, preventing diagnosis.

[0126] <Embodiment 4> In this embodiment, when the inspection protocol can be implemented by temporarily suspending the analysis process, the flow for planning to temporarily suspend the analysis process and starting the inspection protocol will be described. When the analysis unit 303 has multiple analysis processes, if the memory usage of all analysis processes is large, the inspection protocol may not be able to start until all analysis processes are completed. In that case, it is desirable to temporarily suspend the subsequent analysis process and start the inspection protocol in accordance with the completion time of the current analysis process.

[0127] (Flow to temporarily suspend the analysis process according to this embodiment and execute the inspection protocol) Referring to Figures 10 and 6(g), the flow for temporarily pausing subsequent analysis processes when the operator starts an inspection protocol while there are multiple analysis processes will be explained. Figure 10 shows a flowchart of the operation for applying the temporary pausing of analysis processes according to this embodiment.

[0128] If the analysis unit 303 has multiple analysis processes scheduled and the shooting control unit 301 needs to wait until all analysis processes are completed, it is possible to prioritize shooting by temporarily suspending the subsequent analysis processes, as shown in Figure 6(g).

[0129] Specifically, step S1001 is the same as step S701 in Figure 8, and steps S1003 to S1009 are basically the same as steps S702 to S708. However, this is the flow after the operator presses the start button 440 in step S1002. If the inspection protocol can be started in steps S1003 and S1006, the process proceeds to step S1016 to start the inspection protocol.

[0130] Step S1010 is basically the same as S709, but if the analysis process is completed by the 610 imaging phase, the inspection protocol is started in step S1016; otherwise, steps S1011 onwards are performed.

[0131] In step S1011, the ophthalmic control processing device 300 checks whether one or more analyses can be started before the start of the imaging phase 610. Specifically, if the completion time of the analysis process currently being performed, calculated in step S1009, is less than the time required for the alignment phase 600, step S1012 is performed; otherwise, steps S1014 and subsequent steps are performed.

[0132] In step S1012, the ophthalmic control processing unit 300 plans for the analysis unit 303 to temporarily suspend subsequent analysis processes, and proceeds to step S1016 to start automatic sequence imaging 512. Specifically, it sets the analysis processes scheduled to be performed after the currently running analysis process to be temporarily suspended until the completion of the imaging phase 610 of the examination protocol, and to resume the suspended analysis processes when the completion of the imaging phase 610 is triggered. In addition, the analysis process for the imaging format captured in the imaging phase 610 is set to be performed after the suspended analysis processes.

[0133] In step S1013, if the imaging control unit 301 is unable to perform the alignment phase 600 due to insufficient remaining memory capacity, the ophthalmic control processing unit 300 calculates the completion time for the analysis process currently being performed by the analysis unit 303. The calculation method is the same as in step 1009.

[0134] In step S1014, the ophthalmic control processing unit 300 calculates the time until imaging can begin, assuming that imaging cannot be started immediately. If there is insufficient remaining memory capacity to perform the alignment phase 600, it refers to the completion time of the current analysis process determined in step S1013. If the currently performed analysis process is not completed by the imaging phase 610, it calculates the difference between the completion time of the currently performed analysis process alone and the time required for the alignment phase 600 of the examination protocol, from the analysis process completion time calculated in S1009. The time required for the alignment phase 600 is the time determined in step S1008.

[0135] In step S1015, the display control unit 302 of the ophthalmic control processing device 300 presents the operator with the start time calculated in step S1014. After presenting the time, the display control unit 302 returns to step S1003 and repeats the process, presenting the operator with the start time and enabling the examination protocol to be started when it becomes possible to begin.

[0136] According to the embodiment described above, even if the inspection protocol cannot be started immediately due to parallel analysis processing, the waiting time can be reduced and the imaging can be prioritized and started.

[0137] In step S1012, the plan was to temporarily suspend all subsequent analysis processes other than the one currently being performed, but this is not the only option. If one of the subsequent analysis processes is possible during the alignment phase, the plan may be to perform the possible analysis process and then temporarily suspend all subsequent analysis processes.

[0138] Furthermore, although the display control unit 302 repeatedly updates and displays the waiting time until the start of the inspection protocol by returning to step S1003 after presenting the waiting time in step S1015, this is not limited to that. In addition to presenting the time, the display control unit 302 may also present the operator with the option to cancel the automatic start of the inspection protocol. In this case, the operator can change the inspection protocol or perform other actions according to the presented time.

[0139] In this case, the waiting time was reduced by temporarily pausing the analysis process if the examination protocol could not be started. Alternatively, in addition to pausing, the data could be transferred to an analysis processing device (not shown) connected to the ophthalmic control processing device 300 via a network, and the analysis processing could be performed on its behalf. In that case, the analysis processing to be paused is requested from the analysis processing device in step S1012. At that time, it is necessary to consider the memory consumption for network transfer, and if this is not possible, pausing is required. If analysis processing is requested, the ophthalmic control processing device 300 checks whether the analysis processing of the analysis processing device has been completed after the examination protocol has been executed. If it is completed, it receives the analysis results; if not, it performs periodic checks. This reduces the number of analysis processing processes that require temporary pausing.

[0140] <Embodiment 5> In this embodiment, we will describe a flow that allows the examination protocol to be started by adjusting the contents of the alignment phase 600 if the analysis process currently being performed is not completed by the start of the imaging phase 610. If the time available to start the examination protocol is short, the operator and the imaging control unit 301 will have to wait during that time, and will need to repeatedly check whether it is possible to start until it is possible. If the alignment phase 600 is available and the time available to start is short, the waiting time can be consumed in the alignment phase 600 of the selected examination protocol, thereby reducing the number of times the operator is informed that imaging cannot be started.

[0141] (Flow for adjusting alignment content when the start time according to this embodiment is short) Referring to Figure 11, we will now describe the flow of adjusting the contents of the alignment phase 600 and starting the inspection protocol when the operator starts the inspection protocol and the waiting time for the parallel analysis process is short. Figure 10 shows a flowchart of the operation of adjusting the alignment contents when starting the inspection protocol according to this embodiment.

[0142] Specifically, steps S1101 to S1111 are basically the same as steps S1001 to S1011 in Figure 10, but if one or more analyses are not completed by the imaging phase in step S1111, steps S1113 and onward are performed. Also, steps S1116 and S1118 are the same as steps S1013 and S1016 in Figure 10, respectively.

[0143] In step S1113, the ophthalmic control processing device 300 calculates the difference between the completion time of the analysis process currently being performed and the alignment time of the selected protocol obtained in step S1108, from the completion time of the analysis process calculated in step S1109.

[0144] In step S1114, the ophthalmic control processing device 300 determines whether the start time obtained in step S1113 is within a specific time (within a predetermined time). The specific time is determined according to the content of the alignment phase 600 of the selected examination protocol. The time required for the alignment phase 600 calculated in S1108 is calculated using the shortest possible times for anterior eye alignment, autofocus, auto C-Gate, and auto imaging, but it can be extended by changing the content of each process. For example, if autofocus or auto C-Gate uses a method of moving within a specific range to determine the optimal position, the processing time can be extended by a certain amount of time by reducing the speed of movement. In addition, the alignment time can be naturally extended by adding a certain amount of time when switching between each process. For anterior eye alignment, the shortest time is when the anterior eye alignment position is already correct at the start, but this varies greatly depending on the state at the start. Therefore, by checking the anterior eye alignment state at the start of imaging once, the time required for the alignment phase can be calculated as an extended time. In this case, the anterior eye alignment time can be extended by reducing the speed at which the stage unit 171 moves. Finally, the total of the extended times for each alignment phase 600 is calculated and it is determined whether it is greater than or equal to the start time determined in step S1113. If it is greater than or equal to the start time, steps S1115 onwards are performed; if it is less than or equal to the start time, step S1117 is performed.

[0145] In step S1115, the ophthalmic control processing device 300 implements the extension of the alignment phase 600 determined in step S1116 before the alignment begins. At this time, it is preferable to make changes that exceed the start time rather than reflecting them in all processes that can extend the alignment. For example, a priority can be set in advance for the processes that can extend the time of the anterior eye alignment, and the time can be added in order of priority. Then, the application of the extension can be stopped when the start time is exceeded. By setting a priority in advance, the alignment phase 600 can be performed without unnecessary extension processes. Alternatively, after setting all alignment extensions, the actual extension time can be counted after the start of the examination protocol, and the system can stop extending the alignment once the start time is exceeded.

[0146] Step S1112 is essentially the same as step S1012 in Figure 10. The analysis unit 303 plans to temporarily suspend the subsequent analysis process and proceeds to step S1118 to start the inspection protocol.

[0147] In step S1117, the display control unit 302 of the ophthalmic control processing device 300 informs the operator that imaging cannot be started. If the remaining memory capacity for the alignment phase is insufficient, it displays the time required for the current analysis process to be completed, calculated in step S1116. If it is determined in step S1114 that extending the alignment phase will not allow the start time to be met, it displays the start time calculated in step S1113. Alternatively, it displays the start time obtained by subtracting the alignment extension time used in S1114 from the start time.

[0148] According to the embodiment described above, even if the inspection protocol cannot be started due to parallel analysis processing, the inspection protocol will start immediately if the waiting time is short. Therefore, the inspection protocol can be performed without making the operator or the subject feel like they are waiting.

[0149] Furthermore, unlike normal alignment, the alignment operation and time will change, which may cause discomfort to the operator. Therefore, the display control unit 302 may display a message to the operator such as "Memory adjustment mode is being applied." This allows the operator to be informed that the installed memory capacity is insufficient for performing the inspection protocol.

[0150] Furthermore, while the alignment time extension method is applied in a distributed manner to the processing content and connections of the alignment phase 600, it is not limited to this. The shooting control unit 301 may automatically add the waiting time to the parts where a waiting time is specified in the sequence adjustment setting 515 of the protocol setting screen 500. Alternatively, the operator may set in advance on the shooting setting screen (not shown) to insert a wait at a specific point if an extension is necessary. In this case, the operator can secure additional extension time for the parts where they want a waiting time.

[0151] (Other embodiments) Furthermore, the disclosed technology can also be realized by performing the following process: that is, the disclosed technology can also be realized by supplying software (programs) that implement one or more functions of the various embodiments described above to a system or device via a network or storage medium, and the computer (or CPU, MPU, etc.) of that system or device reads and executes the program. The computer may have one or more processors or circuits and may include a network of separate computers or separate processors or circuits for reading and executing computer executable instructions. In this case, the processor or circuit may include a central processing unit (CPU), a microprocessing unit (MPU), a graphics processing unit (GPU), an application-specific integrated circuit (ASIC), or a field-programmable gateway (FPGA). The processor or circuit may also include a digital signal processor (DSP), a dataflow processor (DFP), or a neural processing unit (NPU).

[0152] (Composition 1) A first control that sequentially executes multiple processes related to the imaging of the eye under examination, A second control, which is initiated when the first control is being performed, sequentially executes a plurality of processes related to the imaging of the eye under examination, An information processing device that performs the following: An information processing device that controls the execution timing of at least one of the execution timings

[0153] (Configuration 2) Based on the first memory information and the second memory information, it is determined whether the execution of the first process and the second process can be executed in parallel. If it is determined that it is executable, the execution timing of the multiple processes executed in the first control and the execution timing of the multiple processes executed in the second control will not be changed. If it is determined that the process is not executable, the information processing device according to configuration 1 controls the execution timing of at least one of the processes executed in the first control and the execution timing of at least one of the processes executed in the second control to be changed.

[0154] (Composition 3) The information processing device according to configuration 2, wherein the plurality of processes performed in the first control include a first alignment process relating to the alignment of the eye to be examined and an imaging device for imaging the eye to be examined, a first imaging process for imaging the eye to be examined using the imaging device, and a first analysis process for analyzing the image captured by the imaging device.

[0155] (Composition 4) The information processing device according to configuration 3, wherein the plurality of processes performed in the second control include a second alignment process relating to the alignment of the eye to be examined and an imaging device for imaging the eye to be examined, a second imaging process for imaging the eye to be examined using the imaging device, and a second analysis process for analyzing the image captured by the imaging device.

[0156] (Composition 5) The first imaging process and the second imaging process are processes for capturing a tomographic image of the eye under examination. The information processing apparatus according to configuration 4, wherein the first analysis process and the second analysis process are processes for performing layer recognition of the tomographic image.

[0157] (Composition 6) The first process described above is the first analysis process, The second process is the second imaging process, If the amount of memory required to execute the second imaging process is less than the remaining memory capacity of the information processing device calculated using the amount of memory required to execute the first analysis process, then it is determined that the first analysis process and the second imaging process can be executed in parallel. The information processing device according to configuration 4 or 5, which determines that the first analysis process and the second imaging process cannot be executed in parallel if the amount of memory required to execute the second imaging process is greater than the remaining capacity of the memory.

[0158] (Composition 7) The plurality of processes performed in the first control further include a third analysis process that is performed following the first analysis process, An information processing device according to any one of configurations 4 to 6, which controls the timing of the execution of the third analysis process based on the amount of memory required to execute the first analysis process, the amount of memory required to execute the third analysis process, and the amount of memory required to execute the second imaging process.

[0159] (Composition 8) The information processing device according to configuration 7, which controls the execution timing of the first analysis process and the execution timing of the third analysis process so that, if the amount of memory required to execute the first analysis process is less than the amount of memory required to execute the third analysis process, the third analysis process is executed with priority over the first analysis process.

[0160] (Composition 9) An information processing device according to any one of configurations 4 to 8, which, when it is determined that the execution of the first analysis process and the second imaging process cannot be executed in parallel, performs control to display on the display unit the time at which the second control can be started based on the time required for the first analysis process.

[0161] (Composition 10) The information processing device according to any one of configurations 4 to 9, wherein, if it is determined that the execution of the first analysis process and the second imaging process cannot be executed in parallel, and the time required for the first analysis process is within a predetermined time, the processing time of the second alignment process is extended.

[0162] (Composition 11) A photographic device for photographing the eye under examination, An information processing system comprising an information processing device according to any one of configurations 1 to 10, which is connected to the aforementioned imaging device in a manner that enables communication.

[0163] (Method 1) A first control that sequentially executes multiple processes related to the imaging of the eye under examination, A second control, which is initiated when the first control is being performed, sequentially executes a plurality of processes related to the imaging of the eye under examination, A control method for an information processing device that performs the following: A control method for an information processing device that controls the execution timing of at least one of the execution timings

[0164] (Program 1) A program that causes a computer to execute the control method for the information processing device described in Method 1. [Explanation of symbols]

[0165] 10. Ophthalmic Examination Equipment 300 Ophthalmic Control Processing System 100 Ophthalmic imaging equipment 320 Input section 310 Display Control Unit

Claims

1. A first control that sequentially executes multiple processes related to the imaging of the eye under examination, A second control, which is initiated when the first control is being performed, sequentially executes a plurality of processes related to the imaging of the eye under examination, An information processing device that performs the following: An information processing device that controls the execution timing of at least one of the execution timings

2. Based on the first memory information and the second memory information, it is determined whether the execution of the first process and the second process can be performed in parallel. If it is determined that it is executable, the execution timing of the multiple processes executed in the first control and the execution timing of the multiple processes executed in the second control will not be changed. If it is not determined to be executable, the information processing apparatus according to claim 1, which controls to change at least one of the execution timing of at least one of the multiple processes executed in the first control and the execution timing of at least one of the multiple processes executed in the second control.

3. The information processing apparatus according to claim 2, wherein a plurality of processes performed in the first control include a first alignment process relating to the alignment of the eye to be examined and an imaging device for imaging the eye to be examined, a first imaging process for imaging the eye to be examined using the imaging device, and a first analysis process for analyzing the image captured by the imaging device.

4. The information processing apparatus according to claim 3, wherein the plurality of processes performed in the second control include a second alignment process relating to the alignment of the eye to be examined and an imaging device for imaging the eye to be examined, a second imaging process for imaging the eye to be examined using the imaging device, and a second analysis process for analyzing the image captured by the imaging device.

5. The first imaging process and the second imaging process are processes for capturing a tomographic image of the eye under examination. The information processing apparatus according to claim 4, wherein the first analysis process and the second analysis process are processes for performing layer recognition of the tomographic image.

6. The first process is the first analysis process, The second process is the second imaging process, If the amount of memory required to execute the second imaging process is less than the remaining memory capacity of the information processing device, calculated using the amount of memory required to execute the first analysis process, then it is determined that the first analysis process and the second imaging process can be executed in parallel. The information processing device according to claim 4, which determines that the first analysis process and the second imaging process cannot be executed in parallel if the amount of memory required to execute the second imaging process is greater than the remaining capacity of the memory.

7. The plurality of processes performed in the first control further include a third analysis process that is performed following the first analysis process, The information processing apparatus according to claim 4, which controls the timing of the execution of the third analysis process based on the amount of memory required to execute the first analysis process, the amount of memory required to execute the third analysis process, and the amount of memory required to execute the second imaging process.

8. The information processing apparatus according to claim 7, wherein if the amount of memory required to execute the first analysis process is less than the amount of memory required to execute the third analysis process, the execution timing of the first analysis process and the execution timing of the third analysis process are controlled to be changed so that the third analysis process is executed with priority over the first analysis process.

9. The information processing apparatus according to claim 4, which, when it is determined that the execution of the first analysis process and the second shooting process cannot be executed in parallel, performs control to display on the display unit the time at which the second control can be started based on the time required for the first analysis process.

10. The information processing device according to claim 4, wherein if it is determined that the execution of the first analysis process and the second imaging process cannot be executed in parallel, and the time required for the first analysis process is within a predetermined time, the processing time of the second alignment process is extended.

11. A photographic device for photographing the eye under examination, An information processing system comprising an information processing device according to any one of claims 1 to 10, which is connected to the aforementioned imaging device in a manner that enables communication.

12. A first control that sequentially executes multiple processes related to the imaging of the eye under examination, A second control, which is initiated when the first control is being performed, sequentially executes a plurality of processes related to the imaging of the eye under examination, A control method for an information processing device that performs the following: A control method for an information processing device that controls the execution timing of at least one of a plurality of processes executed in the first control and the execution timing of at least one of a plurality of processes executed in the second control, based on first memory information relating to the amount of memory required to execute a first process executed in the first control and second memory information relating to the amount of memory required to execute a second process executed in the second control.

13. A program that causes a computer to execute the control method for the information processing device described in claim 12.

Images