Ophthalmologic information processing system, ophthalmologic imaging device, and control method
The ophthalmic information processing system integrates with ophthalmic imaging devices to provide seamless image capture and diagnostic support, reducing operational complexity and costs by eliminating the need for dedicated software and separate data registration.
Patent Information
- Application Number
- JP2025076472
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2025-05-01
- Publication Date
- 2025-07-30
- Estimated Expiration
- 2041-09-03
AI Technical Summary
Existing ophthalmic imaging devices and image diagnostic devices require dedicated software and separate data registration operations, leading to increased human, time, and financial costs in ophthalmic medical facilities.
An ophthalmic information processing system communicably connected to an ophthalmic imaging device, allowing seamless operations from image capture to diagnostic support, with an operation control unit that executes instructions from both internal and external devices, and a diagnostic support unit that processes images for diagnostic support.
The system reduces the workload of medical staff by enabling seamless image capture to diagnostic support, eliminating the need for dedicated software and separate data registration, and allowing flexible operation across devices with different specifications.
Smart Images

Figure 2025111778000001_ABST
Abstract
Description
Technical Field
[0001] The present disclosure relates to an ophthalmic information processing system, an ophthalmic imaging device, and a control method for performing diagnostic support based on a fundus image of an eye to be examined.
Background Art
[0002] In recent years, systemization in the field of ophthalmology has been progressing. Patent Document 1 discloses a terminal device for operating a plurality of ophthalmic devices. Patent Document 2 also discloses a technique for obtaining an automatic diagnosis result for each of a plurality of diseases in an eye to be examined by inputting an ophthalmic image into a mathematical model trained by a machine learning algorithm.
Prior Art Documents
Patent Documents
[0003]
Patent Document 1
Patent Document 2
Summary of the Invention
Problems to be Solved by the Invention
[0004] However, when using an ophthalmic imaging device and an image diagnostic device, medical personnel in the field of ophthalmology and the like may feel bothered. For example, it may be necessary to use dedicated software attached to each of these devices, or it may be necessary to perform separate data registration operations for each of these devices. In addition, when newly introducing an image diagnostic device, it may be necessary to introduce an ophthalmic imaging device that matches the specifications of the image diagnostic device. This can lead to an increase in human, time, and financial costs in ophthalmic medical-related facilities.
[0005] One aspect of the present disclosure aims to realize an ophthalmic information processing system, an ophthalmic imaging device, and a control method that seamlessly perform operations from photographing a fundus image of an eye to be examined to providing diagnostic support based on the fundus image.
Means for Solving the Problem
[0006] To solve the above problems, an ophthalmic information processing system according to an aspect of the present disclosure is communicably connected to an ophthalmic imaging device including an imaging unit that captures an image of an eye to be examined, and an operation control unit that can execute operations related to the imaging of the eye to be examined according to an input operation to the own device and can execute the operations according to an instruction from an external device, and includes an operation instruction unit that instructs the ophthalmic imaging device to be an operation target to perform the operation, an image acquisition unit that acquires the image of the eye to be examined captured according to the instruction from the ophthalmic imaging device, and a diagnostic support unit that takes the acquired image of the eye to be examined as an input and outputs diagnostic support information for the image of the eye to be examined.
[0007] Further, an ophthalmic imaging device according to an aspect of the present disclosure may include the operation control unit that executes the operation according to the instruction from the ophthalmic information processing system.
[0008] Also, to solve the above problems, a control method according to an aspect of the present disclosure is a control method executed by one or more information processing devices, and at least one of the information processing devices is communicably connected to an ophthalmic imaging device including an imaging unit that captures an image of an eye to be examined, and an operation control unit that can execute operations related to the imaging of the eye to be examined according to an input operation to the own device and can execute the operations according to an instruction from an external device, and includes an instruction step of instructing the ophthalmic imaging device to be an operation target to perform the operation, an acquisition step of acquiring the image of the eye to be examined captured according to the instruction from the ophthalmic imaging device, and a diagnostic support step of taking the acquired image of the eye to be examined as an input and outputting diagnostic support information for the image of the eye to be examined.
Advantages of the Invention
[0009] According to the present disclosure, it is possible to realize an ophthalmic information processing system, an ophthalmic imaging device, and a control method that seamlessly perform from imaging of an image of an eye to be examined to diagnostic support based on the image of the eye to be examined.
Brief Description of the Drawings
[0010]
Figure 1
Figure 2
Figure 3
Figure 4
Figure 5
Figure 6
Figure 7
Figure 8
Figure 9
Figure 10
Embodiments for Carrying Out the Invention
[0011] 〔Embodiment〕 Hereinafter, an embodiment of the present disclosure will be described in detail. FIG. 1 is a schematic diagram showing a configuration example of an ophthalmic information processing system 1 according to this embodiment and the configuration of its peripheral devices.
[0012] <Overview of Ophthalmic Information Processing System 1> The ophthalmic information processing system 1 is, generally speaking, a system for obtaining diagnostic support information 31, 33 based on the subject eye image 21 captured by the ophthalmic imaging device 20. It is assumed that the entity that designs, develops, or provides the ophthalmic imaging device 20 (hereinafter referred to as the "ophthalmic imaging device business operator" or "first business operator") is different from the entity that designs, develops, or provides the ophthalmic information processing system 1 (hereinafter referred to as the "ophthalmic information processing system business operator" or "second business operator").
[0013] The ophthalmic imaging device 20 is a device equipped with an imaging unit (camera) that captures the subject eye image 21 of the subject and a function that executes operations related to the imaging of the subject eye image 21 (hereinafter referred to as "imaging-related operations"). Typical examples of imaging-related operations include at least one of the start of the imaging sequence, the stop of the imaging sequence, the switching between the left and right subject eyes, the optimization of the imaging unit (optimize), alignment (position adjustment of the device with respect to the subject eye), capture, transfer of imaging data, initial operations associated with patient switching, and transition to the imaging standby state, but are not limited thereto. The optimization of the imaging unit may be, for example, adjustment of focus, sensitivity adjustment, etc. By adjusting the sensitivity, any one of the light amount, gain, and exposure time can be adjusted. Also, the transition to the imaging standby state is, for example, an operation such as switching the ophthalmic imaging device 20 to the power-saving mode after the imaging is completed and when there is no next patient.
[0014] The ophthalmic imaging device 20 may be provided with a so-called automatic alignment function. In this case, the ophthalmic imaging device 20 may further include an alignment detection unit (not shown) and a drive unit (not shown). As an example, the alignment detection unit may detect the positional relationship between the eye to be examined and the imaging unit as an aligned state. Further, the drive unit may drive the imaging unit in the XYZ directions with respect to the eye to be examined. Based on the detection result of the aligned state, the drive unit is controlled. As a result, the eye to be examined and the imaging unit are adjusted to a predetermined positional relationship suitable for imaging. Further, after completion of the automatic alignment, the ophthalmic imaging device 20 may automatically image the eye to be examined. Such an imaging sequence including automatic alignment and automatic imaging may be executed in one or both of the local mode and the remote mode described later.
[0015] The eye image 21 is not limited in type as long as it is an image in which part or all of the eye to be examined is captured, and may be, for example, a fundus image, an anterior segment image, a corneal endothelial cell image, a gonioscopic image, or the like. That is, the ophthalmic imaging device 20 may be, for example, a fundus camera, an optical coherence tomography (OCT) device, a scanning laser ophthalmoscope (SLO), an anterior segment image analysis device, a corneal endothelial cell imaging device, a gonioscopic imaging device, an automatic slit lamp imaging device, or the like. Further, the type of the eye image based on the imaging method is not limited, and may be, for example, an SLO image, a two-dimensional OCT image, a three-dimensional OCT image, a topographic image, a slit lamp image, or the like.
[0016] The ophthalmic imaging device 20 has at least an operation mode (hereinafter referred to as the "remote mode") in which it executes imaging-related operations according to instructions from an external device (typically, the ophthalmic information processing system 1). When the ophthalmic imaging device 20 is in the remote mode, an operator does not have to be present beside the ophthalmic imaging device 20. The ophthalmic imaging device 20 does not have to request the input of subject information including the identification information 24 of the subject when in the remote mode. The ophthalmic imaging device 20 transmits the captured eye image 21 of the subject to an external device (typically, the ophthalmic information processing system 1) when in the remote mode.
[0017] In addition to the remote mode, the ophthalmic imaging device 20 may have an operation mode (hereinafter referred to as the "local mode") in which it executes imaging-related operations according to input operations on the device itself without being remotely controlled (i.e., stand-alone). The ophthalmic imaging device 20 requests the input of subject information including the identification information 24 when in the local mode. The ophthalmic imaging device 20 may or may not transmit the captured eye image 22 of the subject to an external device (typically, the ophthalmic information processing system 1) when in the local mode. The eye image 22 is the one in which the eye image 21 of the subject and the identification information 24 of the subject are associated with each other.
[0018] Hereinafter, it will be described that the ophthalmic imaging device 20 has the remote mode and the local mode and can switch between the two. That is, it is assumed that the ophthalmic imaging device 20 can execute imaging-related operations according to input operations on the device itself and can also execute imaging-related operations according to instructions from an external device. If the ophthalmic imaging device 20 equipped with both modes is manufactured, it is not necessary to divide the product lineup of the ophthalmic imaging device 20.
[0019] The ophthalmic information processing system 1 typically includes at least an ophthalmic information processing device 10 and a diagnostic support system 30, as shown in FIG. 1. The entity that designs, develops, or provides the ophthalmic information processing device 10 and the entity that designs, develops, or provides the diagnostic support system 30 may be the same or different. That is, the ophthalmic information processing system entity may be composed of multiple entities. Also, each function of the ophthalmic information processing device 10 and the diagnostic support system 30 may be integrated and implemented in one information processing device, or may be distributed and implemented in two or more information processing devices. For example, the ophthalmic information processing device 10 may also have the functions of the diagnostic support system 30. Also, for example, the functions of the diagnostic support system 30 may be distributed among multiple medical-related facilities.
[0020] The ophthalmic information processing device 10 is communicably connected to one or a plurality of ophthalmic imaging devices 20. The ophthalmic information processing device 10 gives instructions to each of the ophthalmic imaging devices 20 operating in the remote mode. Specifically, the ophthalmic information processing device 10 instructs each of the ophthalmic imaging devices 20 operating in the remote mode to perform imaging-related operations, and acquires the eye examination images 21 taken by the instructed ophthalmic imaging devices 20 from the ophthalmic imaging devices 20. At this time, when communicating with the ophthalmic imaging device 20, it is one of the features of the ophthalmic information processing system 1 to use a dedicated software interface provided by the ophthalmic imaging device operator. The form of the software interface is not limited, and typically may be an API (Application Programming Interface) or a command equivalent thereto. The software interface may be provided as an SDK (Software Development Kit) including an API or a command equivalent thereto. By using a dedicated software interface, the software design and development required for communication with the ophthalmic imaging device 20 can be realized simply and at low cost, and can be realized with a high degree of freedom that is not easily restricted by the specifications, environment, etc. on the side of the ophthalmic imaging device 20, which is very useful. For example, for the ophthalmic information processing system operator, the ophthalmic imaging device 20 can be directly controlled, and the overall operation optimization design including the ophthalmic information processing system 1 can be realized, and the degree of freedom in the design and development of the operation interface and the like is increased. It is even more preferably useful when cooperating with a plurality of ophthalmic imaging devices 20 having different specifications and the like. Note that the conventional control software used for controlling an ophthalmic imaging device usually can only be installed and used and cannot be conveniently improved, and it is difficult to perform the highly flexible design and development as described above.
[0021] The ophthalmic information processing device 10 transmits the eye examination images 21 and 22 acquired from the ophthalmic imaging device 20 to the diagnosis support system 30 that is communicably connected.
[0022] The diagnostic support system 30 is a system for providing diagnostic support. The diagnostic support system 30 takes the subject eye image 21 acquired from the ophthalmic information processing device 10 as input and outputs diagnostic support information 31 for the subject eye image 21. Also, the diagnostic support system 30 takes the subject eye image 22 acquired from the ophthalmic information processing device 10 as input and outputs diagnostic support information 33 for the subject eye image 22. The entity implementing the diagnostic support in the diagnostic support system 30 is typically one or more computers, but may also include one or more doctors. The processing content for the subject eye images 21 and 22 is not limited, and may be image analysis processing, processing using artificial intelligence, or a combination thereof.
[0023] The diagnostic support system 30 transmits the output diagnostic support information 31 and 33 to the ophthalmic information processing device 10.
[0024] The ophthalmic information processing device 10 may generate diagnostic support information 32 that associates the diagnostic support information 31 acquired from the diagnostic support system 30 with the identification information 54 of the subject who had the subject eye image 21 from which the diagnostic support information 31 was derived taken. Here, the source of the identification information 54 is not the ophthalmic imaging device 20. That is, one of the features of the ophthalmic information processing system 1 is that the diagnostic support information 32 associated with the identification information 54 can be generated without depending on the ophthalmic imaging device 20. As a result, it is not necessary to register and manage the identification information of the subject in the ophthalmic imaging device 20, nor is it necessary to coordinate the identification information between the ophthalmic imaging device 20 and the ophthalmic information processing system 1. Therefore, the complexity involved in registering and managing the identification information of the subject can be reduced. Conventionally, in addition to the need to register the identification information of the subject in the ophthalmic imaging device, it was also normal to register the identification information of the subject for use in the system that handles the subject eye images taken by the ophthalmic imaging device, and data registration and management were complicated.
[0025] The source of the identification information 54 is, but not limited to, as an example, an electronic medical record system 50 that is communicably connected to the ophthalmic information processing apparatus 10. The electronic medical record system 50 is a system that includes a database for managing an electronic medical record containing subject information. Note that the operation management form of the electronic medical record system 50 may be different from that of the ophthalmic information processing system 1.
[0026] The ophthalmic information processing apparatus 10 may generate a report 41 including the diagnostic support information 32 or 33. The report 41 may include the subject eye images 21, 22, etc. The ophthalmic information processing apparatus 10 may transmit the generated report 41 to the electronic medical record system 50 via the communication network N. The report 41 may be stored in the electronic medical record system 50, or may be transmitted from the electronic medical record system 50 directly or via the ophthalmic information processing system 1 to the output device 40. Typical examples of the output device 40 include information processing terminals such as a PC (Personal Computer) used by medical staff or a subject, a tablet terminal, a printer, etc., but are not limited thereto as long as output such as display and printing of the report 41 is possible.
[0027] The ophthalmic information processing system 1 has the functions outlined above. Therefore, the ophthalmic information processing system 1 is a system that is functionally very different from a conventional information processing terminal equipped with control software used to control an ophthalmic imaging device and an image viewer for viewing subject eye images captured by the ophthalmic imaging device. According to the ophthalmic information processing system 1, it is possible to seamlessly perform from the capture of a subject eye image to diagnostic support based on the subject eye image, and it is possible to reduce the workload of ophthalmic medical staff, etc.
[0028] Also, as described above, when the ophthalmic information processing system 1 provided by the ophthalmic information processing system provider communicates with the ophthalmic imaging device 20 provided by the ophthalmic imaging device provider, it uses a dedicated software interface provided by the ophthalmic imaging device provider. For example, the ophthalmic information processing system 1 generates an instruction in accordance with the specifications of the software interface and gives the instruction to the ophthalmic imaging device 20. Then, the ophthalmic imaging device 20 executes imaging-related operations based on the instruction. Therefore, the ophthalmic information processing system 1 provided by the ophthalmic information processing system provider can perform a series of processes from the imaging of the eye image 21 by the ophthalmic imaging device 20 to obtaining the diagnostic support information 31, 33 based on the eye image 21 without being restricted by other specifications, environments, etc. on the side of the ophthalmic imaging device 20 provided by the ophthalmic imaging device provider. Also, on the side of the ophthalmic imaging device provider, the ophthalmic imaging device 20 can be operated based on an instruction from the ophthalmic information processing system 1 without customizing the ophthalmic imaging device 20 according to the specifications of the ophthalmic information processing system 1 provided by the ophthalmic information processing system provider.
[0029] <Arrangement example of each device> The arrangement example of each device will be described with reference to FIGS. 2 and 3. A typical example of the location where the ophthalmic information processing device 10 is placed is a medical-related facility M as shown in FIG. 2. A typical example of the medical-related facility M is a hospital. The medical-related facility M may be a clinic, an inspection facility, a pharmacy, a drugstore, or an ophthalmology-related store. The ophthalmic information processing device 10 is connected to a communication network N including a LAN (Local Area Network) laid in the medical-related facility M, for example.
[0030] A typical example of the location where the diagnostic support system 30 is placed is a facility different from the medical facility M where the ophthalmic information processing device 10 is placed, as shown in FIG. 2. In this case, the ophthalmic information processing device 10 is connected to the diagnostic support system 30 via, for example, a VPN (Virtual Private Network) on the Internet. The diagnostic support system 30 may be a system composed of a server or the like constructed on the cloud. Note that the diagnostic support system 30 may be placed in the medical facility M where the ophthalmic information processing device 10 is placed. In this case, the ophthalmic information processing device 10 and the diagnostic support system 30 are connected by a LAN laid in the medical facility M.
[0031] A typical example of the location where the output device 40 is placed is the medical facility M where the ophthalmic information processing device 10 is placed, as shown in FIG. 2. In this case, the output device 40 is connected to a communication network N including, for example, a LAN laid in the medical facility M. Also, the output device 40 may be placed in a facility different from the medical facility M where the ophthalmic information processing device 10 is placed. In this case, the communication network N to which the output device 40 is connected may include a VPN on the Internet or the like. Also, the output device 40 may be portable and have an undetermined placement location.
[0032] A typical example of the location where the electronic medical record system 50 is placed is the medical facility M where the ophthalmic information processing device 10 is placed. In this case, the electronic medical record system 50 is connected to a communication network N including, for example, a LAN laid in the medical facility M.
[0033] The placement location of the ophthalmic imaging device 20 can be assumed in various ways. As shown in FIG. 2, one typical example of the placement location of the ophthalmic imaging device 20 is a medical-related facility M. The ophthalmic imaging device 20 placed in the medical-related facility M is connected to the ophthalmic information processing device 10 via a LAN laid in the medical-related facility M. A plurality of ophthalmic information processing devices 10 may be placed in the medical-related facility M. In the case of the example shown in FIG. 2, within the medical-related facility M, imaging of the subject eye images 21, 22, acquisition of diagnostic support information 31, 33, and output of a report 41 are performed. The operators of the ophthalmic imaging device 20, the ophthalmic information processing device 10, and the output device 40 may be the same person.
[0034] A second typical example of the placement location of the ophthalmic imaging device 20 is a medical-related facility L different from the medical-related facility M, as shown in FIG. 3. The medical-related facility L may be a clinic, an examination facility, a pharmacy, a drugstore, or an ophthalmic-related store. The ophthalmic imaging device 20 placed in the medical-related facility L is connected to the ophthalmic information processing device 10 via, for example, a VPN on the Internet or the like. As shown in FIG. 3, each of a plurality of ophthalmic imaging devices 20 may be placed in different medical-related facilities L. In the case of the example shown in FIG. 3, each of the subject eye images 21, 22 taken at one or more medical-related facilities L is collected at one medical-related facility M, and acquisition of diagnostic support information 31, 33 and output of a report 41 are performed at the medical-related facility M. In the case of the example shown in FIG. 3, the operator of the ophthalmic imaging device 20 and the operators of the ophthalmic information processing device 10 and the output device 40 are usually different. Since it is assumed that the ophthalmic imaging devices 20 placed in each of the medical-related facilities L may have different specifications, environments, etc., in the arrangement example shown in FIG. 3, an ophthalmic information processing system 1 that uses a dedicated software interface for communication with the ophthalmic imaging device 20 is suitable.
[0035] <Main Configuration of Ophthalmic Information Processing System 1> FIG. 4 is a block diagram showing the main configurations of the ophthalmic information processing system 1 and the ophthalmic imaging device 20. As described above, the ophthalmic information processing system 1 typically includes an ophthalmic information processing device 10 and a diagnostic support system 30.
[0036] (Ophthalmic Information Processing Device 10) The ophthalmic information processing device 10 includes an input unit 107, a control unit 100, and a storage unit 110.
[0037] The input unit 107 is a device that receives input operations for the ophthalmic information processing device 10. Examples of the input unit 107 include a keyboard, a mouse, a touch panel, a microphone, etc. When the input unit 107 is a touch panel, the input unit 107 may also have an information display function. The input unit 107 outputs a signal corresponding to the received input operation to the control unit 100.
[0038] The storage unit 110 is a memory that stores various data and various software used by the ophthalmic information processing device 10. The storage unit 110 may be a storage device connected to the ophthalmic information processing device 10. The storage unit 110 may be a storage device connected to the ophthalmic information processing device 10.
[0039] The storage unit 110 may include an image storage unit 1101, a diagnostic support information storage unit 1102, and a report storage unit 1103. The image storage unit 1101 stores the subject eye images 21, 22. The diagnostic support information storage unit 1102 stores the diagnostic support information 31, 33. The report storage unit 1103 stores the report 41.
[0040] The control unit 100 comprehensively controls each function of the ophthalmic information processing device 10. The control unit 100 is a processor such as a CPU (Central Processing Unit), for example. The control unit 100 reads out a program for realizing each function from the storage unit 110 and expands it into a RAM (Random Access Memory), for example. As a result of the expansion, the control unit 100 includes at least a communication control unit 101. The communication control unit 101 includes an operation instruction unit 1011, an image acquisition unit 1012, and a software interface (abbreviated as "software IF") 1013. Further, the control unit 100 may further include an operation target selection unit 103, a subject information acquisition unit 104, an association unit 105, and a report generation unit 106.
[0041] A program for realizing the functions of the operation instruction unit 1011, the image acquisition unit 1012, the subject information acquisition unit 104, the association unit 105, and the report generation unit 106 is provided by an ophthalmic information processing system provider. On the other hand, the software IF 1013 is provided to the ophthalmic information processing system provider directly by the ophthalmic imaging device provider or via an intermediary.
[0042] The operation target selection unit 103 selects the ophthalmic imaging device 20 to be the operation target from a plurality of ophthalmic imaging devices 20. The ophthalmic imaging device 20 to be the operation target is an ophthalmic imaging device 20 operating in the remote mode. In addition, when there is only one predetermined ophthalmic imaging device 20 to be the operation target, the selection by the operation target selection unit 103 is not necessary. The operation target selection unit 103 may select the ophthalmic imaging device 20 to be the operation target according to the input operation received by the input unit 107. Further, the operation target selection unit 103 may automatically select the ophthalmic imaging device 20 to be the operation target based on a predetermined rule.
[0043] The operation instruction unit 1011 instructs the ophthalmic imaging device 20 to be the operation target to perform imaging-related operations. It is preferable that the instruction conforms to the specifications of the software IF 1013 (that is, the instruction is performed via the software IF 1013). Specifically, it is preferable that the operation instruction unit 1011 transmits a command 11 conforming to the specifications of the software IF 1013 for causing the ophthalmic imaging device 20 to execute imaging-related operations.
[0044] Software IF 1013 is a set of dedicated software interfaces for instructing the ophthalmic imaging device 20 to perform imaging-related operations and for acquiring the subject eye images 21, 22, and is typically a set of APIs. As an example, Software IF 1013 is distributed or downloaded from a server (not shown) that provides Software IF 1013 to the ophthalmic information processing device 10 and installed in the ophthalmic information processing device 10. Also, as an example, Software IF 1013 recorded on a recording medium such as a USB (Universal Serial Bus) memory may be read out and installed in the ophthalmic information processing device 10. Thus, the method of providing Software IF 1013 is not limited.
[0045] The timing at which the operation instruction unit 1011 instructs the ophthalmic imaging device 20 to perform imaging-related operations is not limited. The timing may be, for example, immediately after the ophthalmic imaging device 20 is selected by the operation target selection unit 103, or may be the timing according to the input operation received by the input unit 107, or may be the timing based on a predetermined rule.
[0046] The image acquisition unit 1012 acquires the subject eye image 21 captured by the ophthalmic imaging device 20 operating in the remote mode in accordance with the instruction of the operation instruction unit 1011. The image acquisition unit 1012 preferably acquires the subject eye image 21 via the Software IF 1013.
[0047] The image acquisition unit 1012 transmits the subject eye image 21 acquired from the ophthalmic imaging device 20 to the diagnostic support system 30. The transmission timing of the subject eye image 21 is not limited and may be, for example, immediately after the image acquisition unit 1012 acquires the subject eye image 21, or may be the timing according to the input operation received by the input unit 107, or may be the timing based on a predetermined rule.
[0048] The image acquisition unit 1012 may store the eye image 21 acquired from the ophthalmic imaging device 20 in the image storage unit 1101. The storage timing of the eye image 21 is not limited. The storage timing may be, for example, immediately after the image acquisition unit 1012 acquires the eye image 21, before the image acquisition unit 1012 transmits the eye image 21 to the diagnostic support system 30, after the image acquisition unit 1012 transmits the eye image 21 to the diagnostic support system 30, or at a timing based on a predetermined rule.
[0049] The image acquisition unit 1012 may acquire the eye image 22 captured by the ophthalmic imaging device 20 operating in the local mode. Also in this case, it is preferable that the image acquisition unit 1012 acquires the eye image 22 via the software IF 1013. The image acquisition unit 1012 may transmit the acquired eye image 22 to the diagnostic support system 30. The transmission timing of the eye image 22 is not limited. The transmission timing may be, for example, immediately after the image acquisition unit 1012 acquires the eye image 22, at a timing corresponding to the input operation received by the input unit 107, or at a timing based on a predetermined rule.
[0050] The image acquisition unit 1012 may store the acquired eye image 22 in the image storage unit 1101. The storage timing of the eye image 22 is not limited. The storage timing may be, for example, immediately after the image acquisition unit 1012 acquires the eye image 22, before the image acquisition unit 1012 transmits the eye image 22 to the diagnostic support system 30, after the image acquisition unit 1012 transmits the eye image 22 to the diagnostic support system 30, or at a timing based on a predetermined rule.
[0051] The subject information acquisition unit 104 acquires subject information 53 including at least the identification information 54 of the subject whose eye image 21 is to be photographed. The subject information acquisition unit 104 may acquire the subject information 53 in response to an input operation received by the input unit 107. The acquisition timing of the subject information 53 is not limited. The acquisition timing may be, for example, before the image acquisition unit 1012 transmits the eye image 21 to the diagnostic support system 30, after the image acquisition unit 1012 transmits the eye image 21 to the diagnostic support system 30, or at the timing corresponding to the input operation received by the input unit 107.
[0052] As an example, the acquisition source of the subject information 53 is the patient information database 501 included in the electronic medical record system 50. The patient information database 501 is a database that records patient information.
[0053] FIG. 5 is a diagram showing an example of the data structure of the patient information database 501. As shown in FIG. 5, the patient information database 501 may include information such as name, age, gender, past history, previous examination date, hospital visit history, etc. as the subject information 53 using the patient ID as the identification information 54 as a key. Further, the patient information database 501 may further include information such as past eye images 21·22, diagnostic support information 31·33, findings, etc. The subject information acquisition unit 104 may acquire, from the patient information database 501, in addition to the patient ID as the identification information 54, each of the above-mentioned information associated with the patient ID.
[0054] The association unit 105 acquires the diagnostic support information 31 for the subject's eye image 21 of the subject from the diagnostic support system 30. The association unit 105 generates the diagnostic support information 32 with identification information by associating the acquired diagnostic support information 31 with the subject information 53 of the subject who had the eye image 21 from which the diagnostic support information 31 was derived, and which was acquired by the subject information acquisition unit 104 (including at least the identification information 54). The generation timing of the diagnostic support information 32 is not limited. For example, it may be immediately after both the diagnostic support information 31 and the subject information 53 are acquired, or it may be at a timing corresponding to the input operation received by the input unit 107.
[0055] As described above, the identification information 54 is acquired from the patient information database 501 of the electronic medical record system 50 as an example. That is, the ophthalmic information processing system 1 can generate the diagnostic support information 32 with the identification information 54 without depending on the ophthalmic imaging device 20. Therefore, it is not necessary to register and manage the identification information of the subject in the ophthalmic imaging device 20, nor is it necessary to link the identification information between the ophthalmic imaging device 20 and the ophthalmic information processing system 1. As described above, by using the ophthalmic information processing system 1, the complexity related to the registration and management of the identification information of the subject can be reduced.
[0056] FIG. 6 is a diagram showing an example of the data structure of the diagnostic support information 32 with identification information. In the example shown in FIG. 6, the diagnostic support information 31 is represented by one folder. It should be understood that there is one or more files (not shown) related to the diagnostic support information 31 in the folder. In the example shown in FIG. 6, only the identification information 54 is associated with the diagnostic support information 31, but it is not limited to this. For example, in addition to the identification information 54, the association unit 105 may generate the diagnostic support information 32 by associating each information (name, age, gender, medical history, previous examination date, hospital visit history, past eye images 21 and 22 of the subject, findings, etc.) acquired by the subject information acquisition unit 104 from the patient information database 501 with the diagnostic support information 31.
[0057] The association unit 105 may store the diagnostic support information 31 and 32 in the diagnostic support information storage unit 1102. The association unit 105 may store the diagnostic support information 31 and 32 in the patient information database 501.
[0058] The report generation unit 106 generates a report 41 including the diagnostic support information 32. The report generation unit 106 may obtain the diagnostic support information 32 from the association unit 105 or may read it from the diagnostic support information storage unit 1102.
[0059] Also, the report generation unit 106 generates a report 41 including the diagnostic support information 33 for the eye image 22 to be examined. The report generation unit 106 may obtain the diagnostic support information 33 from the diagnostic support system 30 or may read it from the diagnostic support information storage unit 1102.
[0060] The timing of generating the report 41 is not limited. For example, it may be immediately after the report generation unit 106 obtains the diagnostic support information 32 and 33, or it may be at the timing according to the input operation received by the input unit 107. The report generation unit 106 may store the generated report 41 in the report storage unit 1103. The report generation unit 106 may store the obtained diagnostic support information 32 and 33 in the diagnostic support information storage unit 1102.
[0061] The reader of the report 41 may be a medical professional, the subject to be examined, or both. Therefore, the report generation unit 106 may generate the report 41 in a display format according to the reader. For example, the report 41 for medical professionals may have a higher level of detail or use ophthalmic jargon. On the other hand, the report 41 for the subject to be examined may have a lower level of detail or not use ophthalmic jargon. The report generation unit 106 may determine the display format of the report 41 according to the input operation received by the input unit 107.
[0062] The report generation unit 106 transmits the generated report 41 to the electronic medical record system 50 via the communication network N. The transmission timing of the report 41 is not limited. For example, it may be immediately after the report generation unit 106 generates the report 41, or it may be at a timing corresponding to the input operation received by the input unit 107. Note that the electronic medical record system 50 may transmit the report 41 directly or via the ophthalmic information processing system 1 to the output device 40. The destination output device 40 may be predetermined, or may be determined according to the input operation received by the electronic medical record system 50, or may be determined according to the input operation received by the ophthalmic information processing system 1. The transmission mode to the output device 40 is not limited. For example, it may be transmitted using a file transfer system, or may be transmitted by attaching it to a general-purpose email. The file format of the report 41 is not limited. For example, it may be PDF (Portable Document Format).
[0063] The report generation unit 106 may directly transmit the generated report 41 to the output device 40. Also, the report generation unit 106 may store the generated report 41 in the report storage unit 1103.
[0064] FIG. 7 is a diagram showing an example of the report 41. The report 41 shown in FIG. 7 shows an example including the diagnostic support information 32. As an example, the report 41 includes a subject information display column 411 and a diagnostic support information display column 412. Also, as an example, the report 41 may further include an image display column 413 and a finding display column 414.
[0065] All or part of the subject information 53 associated with the diagnostic support information 32 is displayed in the subject information display column 411. In the subject information display column 411, for example, identification information 54, name, gender, age, medical history, previous examination date, hospital visit history, etc. may be displayed. For example, when it is necessary not to identify the subject, the name may not be displayed.
[0066] In the diagnostic support information display column 412, all or part of the text indicating the diagnostic support information included in the diagnostic support information 32 is displayed. In FIG. 7, examples showing the symptoms and severity classification of diabetic retinopathy are shown. As an example, texts such as "with macular edema" and "simple retinopathy" are displayed.
[0067] In the image display column 413, for example, the examined eye image 21 included in the diagnostic support information 32 (which may be processed such as highlighting abnormal areas, etc.), the image analysis result 35 of the examined eye image 21, etc. are displayed. In the image display column 413, for example, the past examined eye images 21 of the same subject and the image analysis results of the examined eye image 21 may be displayed. By displaying the past examined eye images 21, medical staff and the subject can easily confirm the course of the symptoms.
[0068] The findings display column 414 is, for example, a column for medical staff to add findings. The report 41 with findings added may be transmitted from the information processing terminal used by the doctor directly or via the ophthalmic information processing system 1 to the information processing terminal used by the subject.
[0069] (Diagnostic support system 30) The diagnostic support system 30 includes a diagnostic support unit 301. The diagnostic support unit 301 takes the examined eye image 21 acquired from the ophthalmic information processing device 10 as input and outputs diagnostic support information 31 for the examined eye image 21. Similarly, the diagnostic support unit 301 takes the examined eye image 22 acquired from the ophthalmic information processing device 10 as input and outputs diagnostic support information 33 for the examined eye image 22. The processing content of the diagnostic support unit 301 may be image analysis or processing using artificial intelligence. When using artificial intelligence, the diagnostic support unit 302 may utilize a diagnostic model generated by machine learning the correlation between the examined eye image and the diagnostic support information.
[0070] The program for realizing the functions of the diagnostic support unit 301 is provided by the ophthalmic information processing system operator.
[0071] The diagnostic support information 31 and 33 may be composed of one or more electronic files including images, texts, numerical data, or combinations thereof. Examples of the images included in the diagnostic support information 31 and 33 are the eye images 21 and 22 themselves, and images obtained by processing such as highlighting abnormal areas in the eye images 21 and 22, but are not limited thereto. Examples of the texts included in the diagnostic support information 31 and 33 are texts representing image analysis results, texts representing diagnostic support information, texts representing treatment methods, etc., but are not limited thereto. Specific examples of the texts included in the diagnostic support information 31 and 33 are disease names, symptoms, degrees of symptom progression, therapeutic agents, etc., but are not limited thereto.
[0072] As an example, when the eye images 21 and 22 are retinal images and macular edema is recognized by diagnostic support, the diagnostic support unit 301 may output diagnostic support information 31 and 33 including an image indicating the location of macular edema and texts such as "macular edema present" and "simple retinopathy". Thereby, for example, the report 41 shown in FIG. 7 can be created.
[0073] <Main Component Configuration of Ophthalmic Imaging Device 20> Returning to FIG. 4, the main component configuration of the ophthalmic imaging device 20 will be described. As shown in FIG. 4, the ophthalmic imaging device 20 includes, for example, a control unit 200, an imaging unit 206, an input unit 207, and a storage unit 210.
[0074] The imaging unit 206 is a camera for imaging the eye image 21 of the subject. The imaging unit 206 is controlled by an operation control unit 202, which will be described later. The imaging unit 206 may add EXIF (Exchangeable Image File Format) information such as the imaging date and time and position information to the eye image 21.
[0075] The input unit 207 is a device that receives input operations for the ophthalmic imaging device 20. Typical examples of the input operations are operations for causing the ophthalmic imaging device 20 operating in the local mode to execute imaging-related operations, and operations for inputting or selecting the subject information 23.
[0076] As the input unit 207, for example, it may be a touch panel, buttons, or switches mounted on the ophthalmic imaging device 20, or it may be a mouse and keyboard of an information terminal device connected to the ophthalmic imaging device 20. When the input unit 207 is a touch panel, the input unit 207 may also have an information display function. The input unit 207 outputs a signal corresponding to the received input operation to the control unit 200.
[0077] The storage unit 210 is a memory that stores various data and various software used by the ophthalmic imaging device 20. The storage unit 210 may be a storage device connected to the ophthalmic imaging device 20. The storage unit 210 may include an image storage unit 2101 and a subject information storage unit 2102. The image storage unit 2101 stores the eye images 21 and 22 of the subject. The subject information storage unit 2102 stores subject information 23 including the identification information 24 of the subject. Typical examples of the information included in the subject information 23 are identification information 24, name, date of birth, gender, etc. The code system of the identification information 24 may be a code system different from the patient ID managed by the electronic medical record system 50.
[0078] The control unit 200 comprehensively controls each function of the ophthalmic imaging device 20. The control unit 200 is, for example, a processor such as a CPU. The control unit 200 reads out, for example, a program for realizing each function from the storage unit 210 and expands it into the RAM. As a result of the expansion, the control unit 200 includes a mode switching unit 201, an operation control unit 202, a subject information reception unit 203, and a correspondence unit 205.
[0079] The mode switching unit 201 switches the operation mode of the ophthalmic imaging device 20. Specifically, the mode switching unit 201 switches between a local mode and a remote mode. Typically, the mode switching unit 201 switches the mode according to an input operation received by the input unit 207. The mode switching unit 201 may switch the mode according to an instruction from an external device, or may switch the mode according to a predetermined rule.
[0080] The operation control unit 202 controls the imaging unit 206 and executes imaging-related operations. The operation control unit 202 switches the processing content between the remote mode and the local mode.
[0081] The processing content of the operation control unit 202 in the remote mode is as follows. The operation control unit 202 causes the imaging unit 206 to capture the eye image 21 by executing imaging-related operations according to an instruction from the ophthalmic information processing system 1 (specifically, the ophthalmic information processing apparatus 10). When a command is transmitted from the ophthalmic information processing apparatus 10 via the software IF 1013, the operation control unit 202 may receive the command and execute imaging-related operations according to the content of the received command. The operation control unit 202 acquires the eye image 21 captured by the imaging unit 206. The operation control unit 202 may attach related information to the acquired eye image 21. The related information may be, for example, the identification information of the imaging unit 206. The operation control unit 202 transmits the acquired eye image 21 to the ophthalmic information processing system 1 (specifically, the ophthalmic information processing apparatus 10). Here, it should be noted that the identification information of the subject is not associated with the eye image 21. The transmitted eye image 21 is acquired by the image acquisition unit 1012 via the software IF 1013 in the ophthalmic information processing apparatus 10. Note that the operation control unit 202 may store the eye image 21 in the image storage unit 2101. The eye image 21 stored in the image storage unit 2101 may be output (displayed, printed, etc.) to an output device (not shown).
[0082] The processing details of the operation control unit 202 in the local mode are as follows. According to the input operation from the input unit 207, the operation control unit 202 executes shooting-related operations to cause the imaging unit 206 to capture the eye image 21. The operation control unit 202 acquires the eye image 21 captured by the imaging unit 206. The operation control unit 202 may attach relevant information to the acquired eye image 21. The relevant information may be, for example, the identification information of the imaging unit 206. The operation control unit 202 transmits the eye image 21 captured by the imaging unit 206 to the association unit 205. The operation control unit 202 may acquire from the association unit 205 the eye image 22 associated with the subject information 23 including the identification information 24 generated by the association unit 205 based on the eye image 21. The operation control unit 202 may transmit the acquired eye image 22 to the ophthalmic information processing system 1 (specifically, the ophthalmic information processing device 10). Note that the operation control unit 202 may store the eye image 22 in the image storage unit 2101. The eye image 22 stored in the image storage unit 2101 may be output (displayed, printed, etc.) to an output device (not shown).
[0083] In the local mode, the subject information reception unit 203 receives the input or selection of the subject information 23 according to the input operation from the input unit 207. The person performing the input operation may be the subject or a medical staff member. The subject information 23 may be newly input or read from the subject information storage unit 2102 and selected. The subject information 23 includes at least the identification information 24 of the subject. The identification information 24 may be newly issued or read from the subject information storage unit 2102 and selected.
[0084] In the remote mode, the subject information reception unit 203 may operate in the same manner as in the local mode, or may not receive the input or selection of the subject information 23. In the latter case, the subject information reception unit 203 may display a message indicating that the input or selection of the subject information 23 is not received on the input unit 207 having a display function or on a display unit (not shown).
[0085] When in the remote mode, the operation control unit 202 may execute imaging-related operations regardless of whether subject information 23 is input. That is, when in the remote mode, even if the subject information reception unit 203 receives the input or selection of the subject information 23, the operation control unit 202 may execute the imaging-related operations instructed in the remote mode.
[0086] In the local mode, the association unit 205 acquires the imaged eye image 21 captured by the imaging unit 206 from the operation control unit 202, and generates the imaged eye image 22 by associating the acquired imaged eye image 21 with the subject information 23 that at least includes the identification information 24 and is received by the subject information reception unit 203. FIG. 8 is a diagram showing an example of the data structure of the imaged eye image 22 with identification information. In the example shown in FIG. 8, the imaged eye image 21 is represented by one folder. It should be understood that one or more files (not shown) related to the imaged eye image 21 exist in the folder. In the example shown in FIG. 8, only the identification information 24 is associated with the imaged eye image 21, but it is not limited thereto. For example, the association unit 205 may generate the imaged eye image 22 by associating, in addition to the identification information 24, subject information 23 other than the identification information 24 (such as name) with the imaged eye image 21.
[0087] In the remote mode, the association unit 205 may operate in the same manner as in the local mode, or may stop operating.
[0088] The association unit 205 may store the imaged eye image 22 in the image storage unit 2101.
[0089] <Flow of processing> FIG. 9 is a sequence diagram showing an example of the flow of processing until a report 41 is obtained based on the imaged eye image 21 captured by the ophthalmic imaging device 20 operating in the remote mode. Each process in the ophthalmic information processing system 1 is executed and controlled by one or more information processing devices. It is sufficient that there is at least one information processing device communicably connected to the ophthalmic imaging device 20.
[0090] In the ophthalmic imaging device 20, the mode switching unit 201 switches to the remote mode according to an input operation or the like received by the input unit 207 (step S1). Note that step S1 may be executed at the latest by the time step S3 is executed.
[0091] In the ophthalmic information processing device 10, the operation target selection unit 103 selects the ophthalmic imaging device 20 to be the operation target (step S2). The operation instruction unit 1011 instructs the ophthalmic imaging device 20 selected in step S2 to perform imaging-related operations via the software IF 1013 (steps S3, instruction step).
[0092] In the ophthalmic imaging device 20, the operation control unit 202 executes the imaging-related operations instructed in step S3 (step S4). The operation control unit 202 transmits the eye image 21 of the subject captured by the imaging unit 206 in the imaging-related operations executed in step S4 to the ophthalmic information processing device 10 (step S5).
[0093] In the ophthalmic information processing device 10, the image acquisition unit 1012 acquires the eye image 21 of the subject transmitted in step S5 from the ophthalmic imaging device 20 via the software IF 1013 (step S6, acquisition step). That is, the image acquisition unit 1012 acquires the eye image 21 of the subject captured according to the instruction in step S3. The image acquisition unit 1012 transmits the eye image 21 of the subject acquired in step S6 to the diagnostic support system 30 (step S7).
[0094] In the diagnostic support system 30, the diagnostic support unit 301 receives the eye image 21 of the subject acquired in step S6 and transmitted in step S7, uses the received eye image 21 of the subject as an input, and outputs diagnostic support information 31 for the eye image 21 of the subject (step S8, diagnostic support step).
[0095] In the ophthalmic information processing device 10, the subject information acquisition unit 104 acquires the subject information 53 of the subject for whom the eye image 21 of the subject acquired in step S6 was captured from the electronic medical record system 50 (step S9). Note that step S9 may be executed before step S7.
[0096] The association unit 105 generates diagnostic support information 32 by associating the diagnostic support information 31 output in step S8 with the identification information 54 included in the subject information 53 acquired in step S9 (step S10). The report generation unit 106 generates a report 41 including the diagnostic support information 32 generated in step S10, and transmits the generated report 41 to the electronic medical record system 50 (step S11).
[0097] The electronic medical record system 50 acquires the report 41 transmitted in step S11 (step S12), and transmits the acquired report 41 to the output device 40 (step S13). The output device 40 acquires the report 41 transmitted in step S13, and outputs the report 41 (step S14).
[0098] Through the above procedures, the ophthalmic information processing system 1 acquires the subject eye image 21 captured by the ophthalmic imaging device 20 operating in the remote mode, and outputs diagnostic support information 31 for the subject eye image 21 based on the acquired subject eye image 21. Further, the ophthalmic information processing system 1 generates a report 41 including the diagnostic support information 32, and transmits the report 41 to the electronic medical record system 50. Then, the electronic medical record system 50 transmits the report 41 to the output device 40. As a result, the subject or medical staff who is the user of the output device 40 can view the report 41.
[0099] In addition, since the software IF1013 is used for the communication with the ophthalmic imaging device 20, the ophthalmic information processing system operator can easily and inexpensively realize the design and development of the software required for the communication with the ophthalmic imaging device 20, and can realize it with a high degree of freedom that is less subject to restrictions such as the specifications and environment of the ophthalmic imaging device 20 side.
[0100] In addition, the ophthalmic information processing system 1 can generate diagnostic support information 32 associated with identification information 54 without depending on the ophthalmic imaging device 20. Therefore, it is not necessary to register and manage the identification information of the subject in the ophthalmic imaging device 20, nor is it necessary to link the identification information between the ophthalmic imaging device 20 and the ophthalmic information processing system 1. As described above, by using the ophthalmic information processing system 1, the complexity involved in registering and managing the identification information of the subject can be reduced.
[0101] FIG. 10 is a sequence diagram showing an example of the processing flow from obtaining a fundus image 22 of an eye to be examined captured by the ophthalmic imaging device 20 operating in the local mode until a report 41 is obtained. Each process in the ophthalmic information processing system 1 is executed and controlled by one or more information processing devices. It is sufficient that there is at least one information processing device communicably connected to the ophthalmic imaging device 20.
[0102] In the ophthalmic imaging device 20, the mode switching unit 201 switches to the local mode according to an input operation or the like received by the input unit 207 (step S21). The operation control unit 202 executes imaging-related operations according to the input operation from the input unit 207 (step S22). The subject information reception unit 203 receives the input or selection of subject information 23 including at least the identification information 24 according to the input operation from the input unit 207 (step S23). Step S23 may be executed before step S22. The association unit 205 generates a fundus image 22 of the eye to be examined based on the fundus image 21 of the eye to be examined captured by the imaging unit 206 in the imaging-related operation executed in step S22 and the subject information 23 received in step S23 (step S24). The operation control unit 202 transmits the fundus image 22 of the eye to be examined generated in step S24 to the ophthalmic information processing device 10 (step S25).
[0103] In the ophthalmic information processing apparatus 10, the image acquisition unit 1012 acquires the subject eye image 22 transmitted in step S25 via the software IF 1013 (step S26). The image acquisition unit 1012 transmits the subject eye image 22 acquired in step S26 to the diagnostic support system 30 (step S27).
[0104] In the diagnostic support system 30, the diagnostic support unit 301 receives the subject eye image 22 transmitted in step S27, uses the received subject eye image 22 as an input, and outputs diagnostic support information 33 for the subject eye image 22 (step S28).
[0105] The report generation unit 106 generates a report 41 including the diagnostic support information 33 output in step S28, and transmits the generated report 41 to the electronic medical record system 50 (step S29).
[0106] The electronic medical record system 50 acquires the report 41 transmitted in step S29 (step S30), and transmits the acquired report 41 to the output device 40 (step S31). The output device 40 acquires the report 41 transmitted in step S31 and outputs the report 41 (step S32).
[0107] Through the above procedure, the ophthalmic information processing system 1 acquires the subject eye image 22 captured by the ophthalmic imaging device 20 operating in the local mode, and outputs diagnostic support information 33 for the subject eye image 22 based on the acquired subject eye image 22. Further, the ophthalmic information processing system 1 generates a report 41 including the diagnostic support information 33 and transmits the report 41 to the electronic medical record system 50. Then, the electronic medical record system 50 transmits the report 41 to the output device 40. Thereby, the subject or medical personnel who is the user of the output device 40 can view the report 41.
[0108] In this way, the ophthalmic information processing system 1 can also generate the diagnostic support information 33 and the report 41 based on the subject eye image 22 captured by the ophthalmic imaging device 20 operating in the local mode.
[0109] The ophthalmic information processing system 1 may be provided by an ophthalmic information processing system provider as a program for realizing each function of the ophthalmic information processing system 1. That is, a program for realizing each function of the operation instruction unit 1011 that executes the instruction process, the image acquisition unit 1012 that executes the acquisition process, and the diagnostic support unit 301 that executes the diagnostic support process may be provided by the ophthalmic information processing system provider. In the instruction process, an instruction conforming to the specification of the software IF 1013 is generated, and the instruction is given to the ophthalmic imaging device 20. The ophthalmic imaging device 20 executes imaging-related operations based on the instruction. Therefore, by using each function realized by the program provided by the ophthalmic information processing system provider, a series of processes from the imaging of the eye image 21 by the ophthalmic imaging device 20 to obtaining the diagnostic support information 31, 33 based on the eye image 21 can be implemented without being restricted by other specifications, environments, etc. on the side of the ophthalmic imaging device 20 provided by the ophthalmic imaging device provider. Also, on the side of the ophthalmic imaging device provider, the ophthalmic imaging device 20 can be operated based on an instruction from the ophthalmic information processing system 1 without customizing the ophthalmic imaging device 20 according to the specifications of the ophthalmic information processing system 1 provided by the ophthalmic information processing system provider.
[0110] 〔Example of realization by software〕 The functions of the ophthalmic information processing system 1 and the ophthalmic imaging device 20 (hereinafter referred to as the "system" and the "device" respectively) may be programs for causing a computer to function as the system and the device. The functions can be realized by a program for causing a computer to function as each control block of the system and the device (especially each part included in the control units 100 and 200).
[0111] In this case, the system and the apparatus include a computer having at least one control device (e.g., a processor) and at least one storage device (e.g., a memory) as hardware for executing the program. By executing the program with this control device and storage device, each function described in each of the above embodiments is realized.
[0112] The program may be recorded on one or more computer-readable recording media, rather than temporarily. This recording medium may or may not be provided in the apparatus. In the latter case, the program may be supplied to the apparatus via any wired or wireless transmission medium.
[0113] Also, part or all of the functions of each of the above control blocks can also be realized by a logic circuit. For example, an integrated circuit in which a logic circuit functioning as each of the above control blocks is formed is also included in the scope of the present disclosure. In addition to this, for example, it is also possible to realize the functions of each of the above control blocks by a quantum computer.
[0114] The present disclosure is not limited to the above-described embodiments, and various modifications are possible within the scope shown in the claims.
Explanation of Signs
[0115] 1 Ophthalmic information processing system 10 Ophthalmic information processing apparatus 20 Ophthalmic imaging apparatus 21 Eye image (eye image without associated identification information) 22 Eye image (eye image with associated identification information) 23 Subject information 24 Identification information 30 Diagnosis support system 31 Diagnosis support information (diagnosis support information without associated identification information) 32 Diagnosis support information (diagnosis support information with associated identification information) 33 Diagnostic support information (diagnostic support information associated with identification information) 40 Output device 41 Report 53 Subject information 54 Identification information 101 Communication control unit 103 Operation target selection unit 104 Subject information acquisition unit 105 Association unit 106 Report generation unit 201 Mode switching unit 202 Operation control unit 203 Subject information reception unit 205 Association unit (second association unit) 206 Imaging unit 301 Diagnostic support unit 1011 Operation instruction unit 1012 Image acquisition unit 1013 Software interface
Claims
1. An ophthalmic information processing system communicably connected to an ophthalmic imaging device including an imaging unit that captures an image of an eye to be examined, and an operation control unit that can execute operations related to the imaging of the image of the eye to be examined according to an input operation on the own device and can execute the operations according to an instruction from an external device, the system comprising: an operation instruction unit that instructs the ophthalmic imaging device, which is an operation target, to perform the operation; an image acquisition unit that acquires an image of the eye to be examined captured according to the instruction from the ophthalmic imaging device; and a diagnostic support unit that takes the acquired image of the eye to be examined as an input and outputs diagnostic support information for the image of the eye to be examined.
2. The operation according to claim 1, wherein the operation is at least any one of start of an imaging sequence, stop of the imaging sequence, switching between a left eye to be examined and a right eye to be examined, optimization of the imaging unit, alignment, capture, transfer of imaging data, initial operations associated with patient switching, and transition to an imaging standby state.
3. The operation instruction unit according to claim 1 or 2, wherein the operation instruction unit instructs the operation via a software interface for instructing the operation, and the image acquisition unit acquires the image of the eye to be examined via a software interface for acquiring the image of the eye to be examined.
4. The ophthalmic information processing system according to any one of claims 1 to 3, further comprising: a subject information acquisition unit that acquires identification information of a subject whose image of the eye to be examined is captured; and an association unit that associates the diagnostic support information for the image of the eye to be examined of the subject with the identification information of the subject.
5. The ophthalmic information processing system according to claim 4, further comprising: a report generation unit that generates a report including the diagnostic support information associated with the identification information.
6. The ophthalmic information processing system according to any one of claims 1 to 5, further comprising: an operation target selection unit that selects the ophthalmic imaging device to be the operation target from a plurality of the ophthalmic imaging devices.
7. An ophthalmic imaging device comprising the operation control unit that executes the operation according to the instruction from the ophthalmic information processing system according to any one of claims 1 to 6.
8. The ophthalmic imaging apparatus according to claim 7, further comprising a mode switching unit configured to switch between a local mode in which the operation control unit executes the operation according to an input operation on the apparatus and a remote mode in which the operation control unit executes the operation according to an instruction from the ophthalmic information processing system.
9. The ophthalmic imaging apparatus according to claim 8, further comprising a subject information reception unit configured to receive input of identification information of a subject in the local mode, and a second association unit configured to associate the captured image of the subject eye with the input identification information.
10. The ophthalmic imaging apparatus according to claim 9, wherein in the remote mode, the operation control unit executes the operation regardless of whether the identification information is input. The ophthalmic imaging apparatus according to claim 9.
11. The ophthalmic imaging apparatus according to claim 9 or 10, wherein in the local mode, the operation control unit transmits the image of the subject eye associated with the identification information to the ophthalmic information processing system, and in the remote mode, the operation control unit transmits the image of the subject eye not associated with the identification information to the ophthalmic information processing system.
12. A control method executed by one or more information processing apparatuses, wherein at least one of the information processing apparatuses is communicably connected to an ophthalmic imaging apparatus including an imaging unit configured to capture an image of a subject eye, and an operation control unit configured to be capable of executing an operation related to the imaging of the subject eye according to an input operation on the own apparatus and also capable of executing the operation according to an instruction from an external apparatus, the control method including: an instruction step of instructing the operation to the ophthalmic imaging apparatus to be an operation target; an acquisition step of acquiring, from the ophthalmic imaging apparatus, the image of the subject eye captured according to the instruction; and a diagnostic support step of using the acquired image of the subject eye as an input and outputting diagnostic support information for the image of the subject eye.
13. The ophthalmic imaging apparatus is provided by a first service provider, a program for causing the information processing apparatus to execute the instruction step, the acquisition step, and the diagnostic support step is provided by a second service provider different from the first service provider, in the instruction step, the instruction is generated in accordance with the specification of a software interface provided from the first service provider to the second service provider, and the operation control unit executes the operation according to the instruction. The control method according to claim 12.
14. The operation is at least one of the start of a photographing sequence, the stop of the photographing sequence, the switching between the left eye to be examined and the right eye to be examined, the optimization of the photographing unit, alignment, capture, transfer of photographing data, initial operations associated with patient switching, and transition to a photographing standby state, according to the control method of claim 12 or 13.
15. The software interface is an API (Application Programming Interface) or an SDK (Software Development Kit), according to the control method of claim 13.
Citation Information
Patent Citations
Systems and methods for enabling customers to undergo vision tests and eye health examinations
JP2016503537A
Processing fundus images using machine learning models
JP2019528113A
Systems and methods for automated detection of regions of interest in retinal images
US20150110348A1
Terminal device, terminal control program, ophthalmic apparatuses operated by terminal device, and optometry system
JP2017029369A
Ophthalmic image processing device and ophthalmic image processing program
WO2019207800A1