Systems, methods, and computer-readable storage media for capturing images of the eye.

Abstract

A system for capturing images of one or more eyes includes an eye imaging device having a camera configured to capture eye images. The system determines a workflow for capturing eye images using the eye imaging device. The workflow is determined based on a risk score for a given patient. The system performs the workflow on the eye imaging device to capture eye images, performs a microvascular assessment based on the captured eye images, and adjusts the risk score based on the microvascular assessment.

Description

Technical Field

[0001] This invention relates to the assessment of microvessels using an ocular imaging device, and more specifically, to a system, method, and computer-readable storage medium for capturing images of one or more eyes. Background Technology

[0002] It is frequently observed that some patients diagnosed with a disease have mild symptoms at the onset of the illness, but then their condition rapidly deteriorates. For example, patients diagnosed with sepsis or coronavirus may experience mild symptoms that subsequently lead to acute respiratory distress, multiple organ failure, septic shock, and thrombosis.

[0003] In patients diagnosed with sepsis or coronavirus, endothelial cell dysfunction can occur, leading to microvascular problems and rapid deterioration of the patient's condition. Changes in microvessels may precede changes in macroscopic vital signs such as heart rate, respiratory rate, and blood pressure, and can help predict patient deterioration. Summary of the Invention

[0004] This disclosure generally relates to an ocular imaging device and a method of using the device. In one possible configuration, the ocular imaging device provides an improved risk score for the deterioration of a patient's condition and improves patient access to the device. Various aspects are described herein, including but not limited to the following.

[0005] On one hand, a system for capturing images of one or more eyes includes: an eye imaging device having a camera configured to capture images of the eyes; and a computing device having at least one processor and a memory storing instructions, which, when executed by the at least one processor, cause the system to: determine a workflow for capturing images of the eyes using the eye imaging device, the workflow being determined based on a risk score for a given patient; perform the workflow on the eye imaging device to capture images of the eyes; perform a microvascular assessment based on the captured images of the eyes; and adjust the risk score based on the microvascular assessment.

[0006] On the other hand, a method for capturing one or more eye images includes: determining a workflow for capturing one or more eye images using an ocular imaging device, the workflow being determined based on a risk score for a given patient; performing the workflow on the ocular imaging device to capture eye images; performing a microvascular assessment based on the captured eye images; and adjusting the risk score according to the microvascular assessment.

[0007] On the other hand, a non-transitory computer-readable storage medium includes computer-readable instructions that, when read and executed by a computing device, cause the computing device to: determine a workflow for capturing one or more eye images using an ocular imaging device, the workflow being determined based on a risk score for a given patient; perform the workflow on the ocular imaging device to capture one or more eye images; perform a microvascular assessment based on the captured eye images; and adjust the risk score based on the microvascular assessment. Attached Figure Description

[0008] The following drawings, which form part of this application, are illustrations of the described techniques and are not intended to limit the scope of the invention in any way.

[0009] Figure 1 An example of a system for capturing images of the fundus is shown schematically.

[0010] Figure 2 yes Figure 1 An isometric view of an example of a mid-eye imaging device.

[0011] Figure 3 yes Figure 2 Another isometric view of the eye imaging device.

[0012] Figure 4 yes Figure 2 Bottom view of the eye imaging device.

[0013] Figure 5 yes Figure 2 The eye imaging device provides a view from the patient's perspective when in use.

[0014] Figure 6 yes Figure 2 Another view of the eye imaging device, which is located on the patient's head and positioned above the eyes.

[0015] Figure 7 An eye imaging device is shown attached to an arm connected to a first-type patient support device.

[0016] Figure 8 An eye imaging device is shown attached to an arm connected to a second type of patient support device.

[0017] Figure 9 The illustration shows what can be used for adjustment. Figure 2 The position of the eye imaging device Figure 7 and Figure 8 The components of the arm.

[0018] Figure 10 It shows Figure 1The system is used to capture at least one image of a patient's eyes while the patient is in a patient support device.

[0019] Figure 11 This illustrates connection to a first type of detection booth with a digital display. Figure 2 An eye imaging device.

[0020] Figure 12 This illustrates connection to a second type of detection booth with a digital display. Figure 2 An eye imaging device.

[0021] Figure 13 It shows that it can be made by Figure 11 and Figure 12 The disease risk assessment method implemented at the testing kiosks.

[0022] Figure 14 It shows the use of Figure 2 A method for capturing at least one image of a patient's eye using an eye imaging device.

[0023] Figure 15 The schematic diagram illustrates what can be used to achieve Figure 2 An example of a computing device for the contents of an eye imaging device. Detailed Implementation

[0024] Figure 1 An exemplary system 100 for capturing images of the eye (including the fundus) is schematically illustrated. Similar systems are described in U.S. Patent Application No. 16 / 443,234, filed June 17, 2019; U.S. Patent Application No. 16 / 229,939, filed December 21, 2018; and U.S. Patent Application No. 16 / 230,315, filed December 21, 2018, all of which are incorporated herein by reference in their entirety.

[0025] exist Figure 1 In the example shown, system 100 includes a patient P, an eye imaging device 102, a computing device 1500 including an image processor 106, a camera 104 communicatively connected to the computing device 1500, a display 108 communicatively connected to the computing device 1500, a timer 112 communicatively connected to the computing device 1500, and a network 110. See below for reference. Figure 2-6 An embodiment of the exemplary eye imaging device 102 will be shown and described in more detail.

[0026] In some embodiments, clinician C may use the display 108 of the eye imaging device 102 to capture and view one or more images of patient P's eyes. Alternatively, patient P may use the eye imaging device 102 independently, thus capturing one or more images of their own eyes without the assistance of clinician C.

[0027] Therefore, clinician C or patient P can use ocular imaging device 102 to create a digital image set of patient P's eye. In some examples, the digital images of patient P's eye include fundus images. As used herein, "fundus" refers to the fundus of the eye and includes the retina, optic nerve, macula, vitreous body, choroid, and posterior pole.

[0028] The eye imaging device 102 can be used to capture one or more images of the patient P's eye to screen for eye diseases (such as diabetic retinopathy), monitor the progression of diseases that may affect microvessels (such as sepsis or coronavirus), and determine disease risk assessments that predict the likelihood of the patient's disease worsening.

[0029] One technique for fundus imaging requires mydriasis or dilation of the patient's pupil, which can be painful and / or inconvenient for the patient P. The ocular imaging device 102 does not require the administration of mydriatic drugs to the patient P before imaging, although the device can still image the fundus if mydriatic drugs have already been administered.

[0030] The eye imaging device 102 includes a camera 104 in communicative communication with an image processor 106. The camera 104 is a digital camera including a lens, aperture, and sensor array. The lens of the camera 104 may be a zoom lens, such as a lens driven by a stepper motor, or it may be a fluid lens, also known as a liquid lens. In some embodiments, the camera 104 records fundus images of one eye at a time. In other embodiments, the camera 104 records images of both eyes substantially simultaneously. In such embodiments, the eye imaging device 102 may include two separate cameras, one for each eye.

[0031] Image processor 106 is operatively coupled to camera 104 and configured to communicate with display 108 and network 110. Image processor 106 controls the operation of camera 104 and display 108. Figure 15 An exemplary computing device including a processing unit such as an image processor 106 is shown in more detail.

[0032] An exemplary eye imaging device 102 is connected to a network 110. Network 110 may include any type of wireless network, wired network, or any communication network known in the art. For example, wireless connectivity may include cellular network connectivity and connectivity using protocols such as 802.11a, b, and / or g. In other examples, a direct wireless connection may be established between the eye imaging device 102 and an external display using one or more wired or wireless protocols such as Bluetooth, Wi-Fi Direct, Radio Frequency Identification (RFID), or Zigbee. Other configurations are also possible.

[0033] Timer 112 can be used to inform the clinician C or patient P when an image or group of images should be captured by the ocular imaging device 102. See below for further details. Figure 14 Method 1400 provides a more detailed description of the use of timer 112.

[0034] In some embodiments, image processor 106 processes one or more images captured by camera 104 to generate output such as a disease risk assessment that predicts the likelihood of a patient's disease worsening based on microvascular assessment. Subsequently, eye imaging device 102 can utilize network 110 to transmit the output to server 114, which is remotely located relative to the patient P and clinician C.

[0035] In an alternative embodiment, image processor 106 transmits one or more captured images to server 114 via network 110, and server 114 processes the one or more images captured by camera 104 and generates output. In other alternative embodiments, processing of the one or more images captured by camera 104 is shared between image processor 106 and server 114 of eye imaging device 102, such that image processor 106 performs some processing on the one or more captured images, while server 114 performs other processing on the one or more captured images.

[0036] Figure 2-5 An example of an ocular imaging device 102 is shown, including a housing 200 comprising a support assembly. The housing 200 supports a display 108 at a first end 202, and the housing 200 is configured to engage one or both eyes of a patient P at opposing ends 204. As will be described herein, the ocular imaging device 102 can be used to implement one or more of the aforementioned fundus imaging methods.

[0037] like Figure 3 and Figure 5As shown, housing 200 includes apertures 206 for imaging one or both eyes at a time. Camera 104 of the eye imaging device 102 is located within a cavity 208 formed at the end 204 of housing 200. In some embodiments, housing 200 supports members for raising and lowering camera 104 to align it with the eyes of patient P. When housing 200 is close to patient P's head, camera 104 can move in three directions to achieve imaging of both eyes of patient P.

[0038] The housing 200 supports a position guide for the patient P, such as a surface 210 located on opposite ends 204 of the housing 200, the surface 210 being configured to engage the head of the patient P. In some embodiments, the housing 200 may also support other position guides, such as an optional adjustable chin rest. Figure 6 As shown in the example, surface 210 is configured to rest against the head of patient P and surround patient P's eyes. When patient P uses eye imaging device 102 to take one or more images of their eyes, such as without the help or assistance of clinician C, the positioning guide such as surface 210 can help patient P align their eyes with one or both holes 206.

[0039] In such Figure 2-5 In the exemplary embodiment shown, the housing 200 supports the display 108. In some embodiments, the system 100 may also use an auxiliary display to display at least one image captured by the camera 104, which is part of a smartphone, tablet, or an external monitor positioned separately from the housing 200.

[0040] Display 108 is used to reproduce images generated by ocular imaging device 102 in a size and format readable by a clinician. For example, display 108 may be a liquid crystal display (LCD) or an active-matrix organic light-emitting diode (AMOLED) display. Display 108 may be touch-sensitive.

[0041] The housing 200 of the exemplary eye imaging device 102 is handheld. The display 108 can show images of the eye and controls for capturing those images. In some embodiments, the display 108 is a touchscreen. In some embodiments, the housing 200 also supports one or more user input buttons near the display 108. The display 108 and the user input buttons can be used to capture one or more images of the patient P's eye. Therefore, the eye imaging device 102 can be configured to enable a clinician C to implement one or more automated and / or manual workflows to capture images of the patient P's eye.

[0042] Furthermore, the eye imaging device 102 can be configured to automatically execute workflows to capture one or more images of patient P's eyes without requiring patient P or clinician C to control the operation of the eye imaging device 102 using display 108 or one or more user input buttons near display 108. This configuration helps reduce the exposure of clinician C and other caregivers in hospital emergency rooms or operating rooms when patient P uses the eye imaging device 102 without the assistance of clinician C, such as when using the eye imaging device 102 to monitor for contact infectious diseases like coronaviruses (e.g., COVID-19).

[0043] The eye imaging device 102 can detect when the patient P's eye aligns with one or both holes 206 at the end 204 of the housing 200, thereby positioning the patient P and preparing him for an image capture procedure. In some embodiments, the camera 104 of the eye imaging device 102 can detect when the patient P's eye aligns with one or both holes 206. In other embodiments, a sensor 212 can be used to detect when the surface 210 contacts or otherwise engages with the patient P's face. In some embodiments, the sensor 212 can be a pressure sensor that detects when the surface 210 presses against the patient P's head, or it can be a light sensor that detects when the patient P's face covers the sensor 212. Alternative configurations of the sensor 212 are possible.

[0044] like Figure 4 As shown, the housing 200 includes a connecting plate 214 accessible by removing one or more fasteners 216. Figure 7-10 As will be described in detail in the embodiments shown, the connecting plate 214 can be used to connect the eye imaging device 102 to another device, such as a hinged arm or a detection booth.

[0045] Figure 7 An eye imaging device 102 connected to an arm 300 is shown, and an arm 300 connected to a first-type patient support device 400 is further shown. Figure 7 In the example shown, the patient support device 400 is a medical operating table. Figure 7 As shown, the patient support device 400 includes wheels 416, allowing it to move around the hospital's acute care unit or operating room. Furthermore, the patient support device 400 includes a mattress 418 supported on a frame 412, which is adjustable between a flat position and a tilted position. Figure 7 In the image, mattress 418 is shown in an inclined position.

[0046] The patient support device 400 further includes a right sidebar assembly having at least one right sidebar mounted on the right side of the frame 412, and a left sidebar assembly having at least one left sidebar mounted on the left side of the frame 412. In this example, the right sidebar assembly includes an upper right sidebar 410A and a lower right sidebar 410B, and the left sidebar assembly includes an upper left sidebar 410C and a lower left sidebar 410D.

[0047] exist Figure 7 In the illustrated embodiment, arm 300 is connected at its first end to the upper right sidebar 410A and at its second end to the eye imaging device 102. In other embodiments, the first end of arm 300 may be connected to any one of the sidebars 410A-410D.

[0048] In other alternative embodiments, the first end of the arm 300 may be directly connected to the frame 412 of the patient support device 400 without being connected to the side rails 410A-410D. In other embodiments, the first end of the arm 300 may be connected to the headboard 413 or the footboard 414 of the patient support device 400. Other connection locations between the arm 300 and the patient support device 400 are possible.

[0049] Figure 8 An ocular imaging device is shown connected to arm 300, and arm 300 is connected to a second type of patient support device 402. Figure 8 In the example shown, the patient support device 402 is a stretcher. Although Figure 7 and Figure 8 Medical operating tables and stretchers are shown and described, but the ocular imaging device 102 can also be connected via arm 300 to other types of patient support devices inside and outside the hospital environment, including but not limited to chairs, recliners, tables, etc. Additionally, the ocular imaging device 102 can also be connected via arm 300 to other types of structures such as walls and to other types of devices such as portable or fixed supports.

[0050] With the above Figure 7 Like the described medical operating table, the patient support device 402 includes one or more foldable side rails 430 connected to a frame 432. Arms 300 may be connected to the side rails 430 or directly to the frame 432 without being connected to the side rails 430. The patient support device 402 also includes a mattress 434 adjustable between a flat and tilted position and includes wheels 436 to allow the patient support device 402 to be moved around a hospital's emergency room or operating room.

[0051] like Figure 7 and 8As shown, arm 300 is connected at its second end to housing 200 of eye imaging device 102. In some embodiments, arm 300 may be connected to connecting plate 214 located at the bottom of housing 200. Alternatively, arm 300 may be connected to other locations on housing 200 of eye imaging device 102.

[0052] Figure 9 The components of arm 300 are shown schematically. Now refer to... Figure 7-9 The arm 300 includes a plurality of links 302 connected together by a joint 304, enabling the arm 300 to move in various directions, including up, down, left, right, forward, backward, and any position in between. Therefore, the arm 300 is an articulated arm that can be used to adjust the position of the eye imaging device 102 in a 360-degree field of motion.

[0053] When patient P is supported on patient support devices 400, 402, patient P can manually adjust the position of the ocular imaging device 102 (when it is connected to arm 300). For example, patient P can manually grasp the housing 200 to remove it from its storage position, and can place the housing 200, more specifically, as Figure 6 As shown, surface 210 is brought into close contact with the patient's face. Alternatively, or in addition to manual adjustment, arm 300 can also be moved by one or more motors 306, which can be controlled by the patient P using one or more types of user input devices associated with arm 300.

[0054] In some embodiments, one or more user input buttons 308 may be placed on the patient support devices 400, 402, and may be used by the patient P to control the movement of the arm 300 via the motor 306 to adjust the position of the ocular imaging device 102. For example, the user input buttons 308 may be placed on the side rails 410, 430 of the patient support devices 400, 402. Alternatively, or in addition to the user input buttons 308, a remote control 310 may be provided for the patient P to use to control the movement of the arm 300 via the motor 306 to adjust the position of the ocular imaging device 102.

[0055] In some other embodiments, the movement of arm 300 and the positioning of eye imaging device 102 are performed automatically by controller 312, so that no input is required from patient P, or only partial input is required. For example, when arm 300 automatically operates to place eye imaging device 102 in front of patient P's head, all patient P needs to do is move eye imaging device 102 a few inches to press surface 210 against patient P's head.

[0056] Figure 10A method 500 for capturing at least one image of a patient P's eye is shown. In some embodiments, method 500 may be performed by an eye imaging device 102 and by using, for example... Figure 7-9 The arm 300 shown is used to perform this action. Method 500 includes operation 502: reminding the patient P that they need to use the ocular imaging device 102 to take one or more images of their eyes. The reminder may be from a speaker on the patient support device 400, 402 (e.g., see [link]). Figure 7 The sound alert is emitted by the speaker 440 on the upper right sidebar 410A.

[0057] After issuing the alert, method 500 includes operation 504: using arm 300 to move the eye imaging device 102 in front of the patient P's head. In some embodiments, the movement of arm 300 in operation 504 is performed automatically by controller 312. For example, the position of the eye imaging device 102 relative to the patient P can be adjusted by controller 312 controlling one or more motors 306 without patient input.

[0058] When the eye imaging device 102 is placed in front of the patient P's head, method 500 includes operation 506: prompting the patient P to grasp the housing 200 and place the eye imaging device 102 on their head, as... Figure 6 As shown in the example provided, as mentioned above, an alert can be a sound alert or any other type of notification.

[0059] Next, method 500 includes operation 508: using camera 104 or sensor 212 to detect the alignment of patient P's eye with one or both holes 206 within a cavity 208 formed at the end 204 of housing 200. When it is detected that patient P's eye is not aligned with one or both holes 206 (i.e., "No" in operation 508), operation 506 can be repeated to instruct patient P to place eye imaging device 102 on their head.

[0060] Next, method 500 includes operation 510: when camera 104 or sensor 212 detects that patient P's eye is aligned with aperture 206 (i.e., "yes" in operation 508), one or more images of patient P's eyes are automatically captured. Advantageously, the image capture requires no input from patient P, so that patient P does not need to operate display 108 or any user input buttons near display 108 to capture one or more images of their eyes. Therefore, it becomes easier for patient P to use eye imaging device 102, especially when clinician C cannot assist patient P.

[0061] After the image acquisition procedure is completed, method 500 may include operation 512: sending another reminder to notify patient P that the image acquisition procedure is complete and removing the eye imaging device 102 from their head. As described above, the reminder may be an audible reminder or any other type of notification, including a notification displayed within the cavity 208 formed at the end 204 of the housing 200 that patient P can see while the eye imaging device 102 is held on patient P's head.

[0062] Next, method 500 may include operation 514: using camera 104 or sensor 212 to detect whether the eye imaging device 102 has been removed from the head of patient P. When camera 104 or sensor 212 detects that the eye imaging device 102 has not been removed from the head of patient P (i.e., "no" in operation 514), operation 512 may be repeated to issue another reminder to instruct patient P to remove the eye imaging device 102 from their head.

[0063] Subsequently, method 500 includes operation 516: using arm 300 to remove eye imaging device 102 from the head of patient P, and moving eye imaging device 102 to a position that does not interfere with the patient P's position when held on patient support devices 400, 402. For example, arm 300 may retract eye imaging device 102 within frames 412, 432 or behind side rails 410, 430 of patient support devices 400, 402, so that it does not obstruct patient P when not in use. In operation 516, the movement of arm 300 may be automatic, such that one or more motors 306 may be controlled via controller 312 to automatically adjust the position of eye imaging device 102 relative to patient P without patient input.

[0064] In some embodiments, other diagnostic devices may be attached to arm 300. For example, some diagnostic devices may require precise placement relative to the patient P, and arm 300 may automatically move these devices to position them correctly. Other diagnostic devices that may be used with arm 300 include devices for recording heart and lung sounds and for recording images of the patient's larynx.

[0065] Although the method 500 described above is performed without the assistance of a clinician C, it is contemplated that in some embodiments, the clinician C may assist the patient P in placing the eye imaging device 102 over their head. This is especially likely to occur in patients who, even if the eye imaging device 102 is placed in front of them using the arm 300, are too weak or their condition has deteriorated to grasp and move the eye imaging device 102.

[0066] Figure 11 An eye imaging device 102 is shown connected to a first-type detection booth 600. Figure 11In the example shown, testing kiosk 600 is a standalone testing kiosk that can be placed within a hospital, such as an emergency room, where the eye imaging device 102 can be used for disease risk assessment, such as sepsis or coronavirus. It is anticipated that testing kiosk 600 can be used in other healthcare settings such as primary care physician offices, health clinics, pharmacies, long-term care facilities, nursing homes, etc. Furthermore, testing kiosk 600 can be used in non-medical settings, such as office buildings or airport terminal lobbies.

[0067] like Figure 11 As shown, the eye imaging device 102 is connected to a base 602 including a base 604. In some embodiments, the eye imaging device 102 is fixed to the base so that it cannot be removed from the base. In some embodiments, the height of the base 602 can be adjusted to accommodate users of different heights. In alternative embodiments, the eye imaging device 102 is removably connected to the base 602 so that it can be picked up by the user and placed on the user's head for disease risk assessment, and then returned to the base 602 after the disease risk assessment is completed. In some embodiments, the eye imaging device 102 can be tethered to the base with a cord to prevent theft of the system. In some embodiments, the power supply to the eye imaging device 102 is recharged when the eye imaging device 102 is mounted and / or docked on the base 602.

[0068] The testing booth 600 includes a digital display 606 also connected to the base 602. The digital display 606 can be used to display instructions to a user for performing a disease risk assessment method using the eye imaging device 102. In some embodiments, the method for disease risk assessment is described below. Figure 13 The method 1300 is described in more detail below. In some embodiments, one or more speakers 608 may be embedded in the base 602 or may be included in the digital display 606 to provide audio commands to a user. The digital display 606 may display a disease risk assessment based on one or more abnormalities that may be detected by the eye imaging device 102.

[0069] The digital display 606 is a touchscreen that allows users to input additional information that can be used to calculate a risk score. For example, users can use the digital display 606 to input data such as their height, weight, body mass index (BMI), comorbidities, age, symptoms, exposure to infectious diseases (such as COVID-19), and other similar information.

[0070] Figure 12 An eye imaging device 102 connected to a second type of detection booth 700 is shown. Figure 12In the example shown, the testing booth 700 is an integrated testing booth that may include multiple devices 716 for measuring a user's vital signs and providing enhanced disease risk assessment. Devices 716 may include means for measuring a user's body temperature, SpO2, blood pressure, heart rate, and respiratory rate.

[0071] Similar to the aforementioned testing kiosk 600, the testing kiosk 700 can be placed within hospitals, such as emergency rooms, where the eye imaging device 102 can be used for disease risk assessment, such as sepsis or coronavirus. It is anticipated that the testing kiosk 700 can be used in other healthcare settings such as primary care physician offices, health clinics, pharmacies, long-term care facilities, nursing homes, etc. The testing kiosk 700 can also be used in non-medical settings such as office buildings or airport terminal lobbies.

[0072] The testing booth 700 may include a compartmentalized structure 702, which includes a wall 704 to protect user privacy, and may include a bench 706 for users to sit on. Similar to the testing booth 600 described above, the testing booth 700 includes a digital display 708, which can be used to display instructions requiring the user to use the ocular imaging device 102 to perform a method for disease risk assessment. Furthermore, one or more speakers 710 may be embedded in the compartmentalized structure 702, or may be included in the digital display 708 to provide audio instructions to the user. The digital display 708 may display the disease risk assessment based on one or more abnormalities that may be detected by the ocular imaging device 102.

[0073] The testing booth 700 may include one or more input devices 712 mounted to a counter 714, which is connected to a wall 704. In some embodiments, the one or more input devices 712 include a touchscreen. Users can use the one or more input devices 712 to input other information that can be used to calculate a risk score. For example, users can use the one or more input devices 712 to input data such as their height, weight, body mass index (BMI), comorbidities, age, symptoms, exposure to infectious diseases (e.g., COVID-19), and other similar information.

[0074] like Figure 12 As shown, multiple eye imaging devices 102 can be mounted on a compartmentalized structure 702. In this embodiment, a user can remove the eye imaging device 102 from the wall 704 and place it over their head. When the image capturing process is complete, the user can return the eye imaging device 102 to the wall 704 for storage. In some embodiments, the eye imaging device 102 can be secured to the wall 704 with a tether to prevent theft. In some embodiments, the power supply to the eye imaging device 102 is recharged when it is mounted and / or docked to the wall 704.

[0075] Figure 13 A disease risk assessment method 1300, which can be implemented by testing kiosks 600 and 700, is illustrated. Method 1300 may include operation 1302: requesting a user to input health information using a digital display 606 in the case of testing kiosk 600 or using one or more input devices 712 in the case of testing kiosk 700. The health information input by the user may include, but is not limited to, the user's height, weight, body mass index (BMI), comorbidities, age, symptoms, exposure to infectious diseases (e.g., COVID-19), and other relevant data that may help determine a disease exacerbation risk score. In an embodiment of testing kiosk 700, one or more devices 716 may be used to acquire vital sign data including the user's body temperature, SpO2, blood pressure, heart rate, and respiratory rate.

[0076] Next, method 1300 includes operation 1304: reminding the user to use the eye imaging device 102 to capture one or more images of their eyes. The reminder may be displayed on digital displays 606, 708, or may be an audible reminder emitted from one or more speakers 608, 710 of the detection booth 600, 700. Other types of reminders are also possible.

[0077] In the exemplary detection booth 600, the reminder may simply request the user to press their face against the eye imaging device 102. In an embodiment where the height of the base 602 is adjustable, the reminder may instruct the user to adjust the height of the base 602 so that the eye imaging device 102 is level with their head, and then press their face against the surface 210 of the eye imaging device 102. In an embodiment where the eye imaging device 102 is removably attached to the base 602, the reminder may request the user to remove the eye imaging device 102 from the base 602 and place it over their head.

[0078] In the exemplary testing booth 700, a reminder may instruct a user to remove the eye imaging device 102 from the wall 704 and place it over their head. In embodiments where the eye imaging device 102 is fixed to the wall 704 of the testing booth 700, the reminder may simply request the user to press their face against the surface 210 of the eye imaging device 102.

[0079] Next, method 1300 includes operation 1306: using camera 104 or sensor 212 to detect whether the user's eye is aligned with aperture 206. When camera 104 or sensor 212 does not detect that the user's eye is aligned with aperture 206 (i.e., "No" in operation 1306), method 1300 repeats operation 1304 to issue another reminder to instruct the user to correctly place eye imaging device 102 on their head.

[0080] When camera 104 or sensor 212 detects that the user's eye is aligned with aperture 206 (i.e., "yes" in operation 1306), method 1300 proceeds to operation 1308: capturing at least one image. At least one image is captured automatically without any user input, thus eliminating the need for the user to operate the display 108 of the eye imaging device 102 or any user input buttons near the display 108 to capture the image. This makes it easier for the user to use the eye imaging device 102.

[0081] After the image capturing procedure is completed, method 1300 includes operation 1310: sending another reminder to notify the user that the image capturing procedure is complete and removing their head from the surface 210 of the eye imaging device 102. In some embodiments, the reminder is an audible reminder. Alternatively, or in combination with an audible reminder, a notification that the user can see can be displayed within the cavity 208 while the user's face is pressed against the surface 210 of the eye imaging device 102.

[0082] Subsequently, method 1300 includes operation 1312: calculating a risk score based on information input to digital displays 606, 708 in operation 1302 and one or more anomalies detected by an image-capturing procedure executed in operation 1308. In some embodiments, the risk score is displayed on digital displays 606, 708. In some embodiments, in addition to displaying the risk score, method 1300 may also display a referral for the user based on the risk score, such as seeking immediate medical attention.

[0083] Figure 14 A method 1400 for capturing one or more images of the eye of a patient P using an eye imaging device 102 is illustrated. Method 1400 can be performed in an embodiment where the eye imaging device 102 is connected to an arm 300, and the arm 300 is connected to... Figure 7 and 8 The patient support devices 400 and 402 are shown. Furthermore, method 1400 can be performed in the following embodiment, wherein the eye imaging device 102 is as follows... Figure 11 and 12 Part of the testing booths 600 and 700 shown.

[0084] Method 1400 includes an initial operation 1402: acquiring patient data. Patient data may include age, comorbidities, symptoms, discomfort, laboratory results, previous vital sign readings, etc. Patient data can be obtained directly from the patient, for example, by answering a questionnaire that allows the patient or clinician to input patient data via a user input device. Alternatively, when the patient's identity is known, patient data can be obtained from the patient's electronic medical record (EMR).

[0085] Next, method 1400 includes operation 1404: calculating an initial risk score for the patient based on the obtained patient data. The risk score represents the risk that the patient will experience a severe deterioration of their disease. A high-risk score indicates that patient P is likely to experience a severe deterioration of their disease. A low-risk score indicates that patient P is unlikely to experience a severe deterioration of their disease.

[0086] In some embodiments, a risk score for viruses such as COVID-19 is calculated. In such embodiments, the risk score increases with age and comorbidities, including but not limited to cancer, chronic kidney disease, chronic obstructive pulmonary disease (COPD), immunodeficiency (i.e., a weakened immune system), obesity (e.g., a body mass index (BMI) of 30 or higher), severe heart disease (such as heart failure, coronary artery disease, or cardiomyopathy), sickle cell disease, and type 2 diabetes. Furthermore, the risk score for COVID-19 may also increase with the following conditions: moderate to severe asthma, cerebrovascular disease affecting blood flow to the brain, cystic fibrosis, hypertension or high blood pressure, neurological disorders such as dementia, liver disease, pregnancy, pulmonary fibrosis (such as lung tissue damage or scarring), smoking, thalassemia, and type 1 diabetes.

[0087] In some embodiments, a risk score for sepsis is calculated. In such embodiments, the risk score is based on age and comorbidities, including but not limited to pregnancy, weakened immune system, chronic diseases (such as diabetes, lung disease, kidney disease, liver disease, dementia, and cancer), previous hospitalization, use of indwelling prosthetic devices (such as catheters, heart valves, vascular bypass grafts, lenses, artificial joints, and central nervous system shunts), and malnutrition. The identification of sepsis risk and monitoring of sepsis progression are described in U.S. Patent Application No. 16 / 832,672, filed March 27, 2020; U.S. Patent Application No. 16 / 847729, filed April 14, 2020; and U.S. Patent Application No. 62 / 893,985, filed August 30, 2019, all of which are incorporated herein by reference in their entirety.

[0088] In some embodiments, the eye imaging device 102 automatically calculates a risk score based on acquired patient data. In alternative embodiments, the eye imaging device 102 may receive the calculated risk score from another device, which may transmit the calculated risk score to the eye imaging device 102 via network 110. In some other embodiments, the eye imaging device 102 may receive a calculated risk score from a user who inputs the risk score using display 108 or one or more user input buttons located near display 108.

[0089] Next, method 1400 includes operation 1406: determining whether the risk score is high or low. When the risk score is low (i.e., "No" in operation 1406), method 1400 proceeds to operation 1408: configuring the eye imaging device 102 to perform a first type of workflow. When the risk score is high (i.e., "Yes" in operation 1406), method 1400 proceeds to operation 1416: configuring the eye imaging device 102 to perform a second type of workflow. In some embodiments, the risk score is a numerical value, and the decision in operation 1406 is determined by comparing the risk score to a threshold, such that when the risk score is less than the threshold, the risk score is determined to be low, and when the risk score exceeds the threshold, the risk score is determined to be high.

[0090] The first type of workflow can be simpler than the second type. For example, the first type of workflow may involve taking a single image, while the second type of workflow may involve taking multiple images under different lighting conditions, filters, refractive powers, etc. Each of the multiple images from the second type of workflow can highlight different features of the patient P's eye for analysis.

[0091] like Figure 14 As shown, after configuring the eye imaging device 102 to perform a first type of workflow in operation 1408, method 1400 proceeds to operation 1410: capturing at least one image in the first type of workflow. Similarly, after configuring the eye imaging device 102 to perform a second type of workflow in operation 1416, method 1400 proceeds to operation 1418: capturing at least one image in the second type of workflow. As described above, the first and second types of workflows can be initiated when the camera 104 or sensor 212 detects that the patient's eye is aligned with one or both holes 206 within the cavity 208 of the housing 200 of the eye imaging device 102. Therefore, the eye imaging device 102 can capture at least one image in both the first and second types of workflows without requiring the patient or clinician to control the operation of the eye imaging device 102 using the display 108 or one or more user input buttons near the display 108.

[0092] In some embodiments, the eye imaging device 102 is connected via a network 110 to one or more systems that can identify suitable persons authorized to use the eye imaging device 102 to capture at least one image. For example, access may be permitted to certain persons, such as patients or clinicians assigned to patients, while access may be denied to certain persons, such as clinicians not assigned to patients.

[0093] After completing operation 1410, method 1400 proceeds to operation 1412: analyzing at least one image captured in the first type of workflow to determine if any anomalies are present. When no anomalies are detected (i.e., "No" in operation 1412), method 1400 terminates at operation 1414. When one or more anomalies are detected (i.e., "Yes" in operation 1412), method 1400 proceeds to operation 1420: modifying the risk score based on the detected one or more anomalies. For example, the detected one or more anomalies may increase the risk score. In some embodiments, when one or more anomalies are detected (i.e., "Yes" in operation 1412), method 1400 may include manual control 1413 such that method 1400 does not automatically proceed to operation 1420, but instead, terminates at operation 1414 when the clinician determines that they have sufficient information and further analysis is unnecessary.

[0094] After completing operation 1418, method 1400 similarly performs operation 1420: modifying the risk score based on data obtained from at least one image taken in the second type of workflow. Data obtained from at least one image taken in the second type of workflow can increase or decrease the risk score of patient deterioration. For example, the risk score may be increased in operation 1420 when one or more abnormalities are detected in at least one image taken in the second type of workflow. Alternatively, the risk score may be decreased in operation 1420 when no abnormalities are detected in at least one image taken in the second type of workflow.

[0095] Therefore, the risk score determined in operation 1420 is an enhanced risk score that takes into account the microvascular assessment of at least one image taken in the first or second workflow. Advantageously, by adjusting the risk score to take into account the microvascular assessment, the enhanced risk score is more accurate in predicting the progression of diseases that may affect the microvessels in a patient. As mentioned above, diseases that may affect the microvessels include sepsis and COVID-19.

[0096] Next, method 1400 proceeds to operation 1422: storing the enhanced risk score and at least one image captured during the first or second type of workflow in a memory, which a clinician can access for further analysis. The memory may be located on the eye imaging device 102 itself, or it may be remotely located relative to the eye imaging device 102, such as on a cloud network. The eye imaging device 102 is connected via network 110 to one or more systems that can identify the appropriate person permitted to access the enhanced risk score and at least one image. For example, access may be permitted to certain individuals, such as patients or clinicians assigned to patients, while access may be denied to certain individuals, such as clinicians not assigned to patients.

[0097] Alternatively, in addition to storing the enhanced risk score and at least one image, operation 1422 may also include sending the enhanced risk score and at least one image directly to a clinician for further analysis. In this example, network 110 may be used to send at least one image to a clinician, and one or more systems connected to network 110 may be used to identify the correct clinician to whom the enhanced risk score and at least one image are sent.

[0098] Next, method 1400 proceeds to operation 1424: determining whether the workflow is complete. When the workflow is complete (i.e., "Yes" in operation 1424), method 1400 ends at operation 1414. When the workflow is not complete (i.e., "No" in operation 1424), method 1400 proceeds to operation 1424: setting or resetting timer 112 of the ocular imaging device 102 based on the enhanced risk score (see...). Figure 1 ).

[0099] As described above, timer 112 can be used to inform clinicians or patients when images or sets of images should be taken using the ocular imaging device 102. For example, after a predetermined time period has elapsed, timer 112 can trigger a reminder to remind clinicians or patients to take additional images using the ocular imaging device 102. The reminder can be generated on the ocular imaging device 102, such as via a flash or audio command, or in other cases, the reminder can be generated on another device such as patient support devices 400, 402 (see [link to relevant documentation]). Figure 7 and 8 It can be generated on a device, such as a smartphone or tablet, that is associated with a clinician or patient.

[0100] As an illustrative example, when the improved risk score is high, timer 112 can be set to have shorter time intervals, resulting in more frequent reminders. When the improved risk score is low, timer 112 can be set to have longer time intervals, resulting in fewer reminders. Furthermore, when the improved risk score increases compared to a previously calculated risk score, the time interval set for reminders by timer 112 can be shortened. Alternatively, when the improved risk score decreases compared to a previously calculated risk score, the time interval set for reminders by timer 112 can be extended. In some embodiments, timer 112 is automatically controlled by computing device 1500 such that the time interval of reminders triggered by timer 112 is automatically adjusted without any input from clinicians or patients, and is automatically updated based on the improved risk.

[0101] Next, method 1400 proceeds to operation 1428: determining whether the patient P's condition has changed, for example, whether the patient's condition has improved or worsened. In some embodiments, the change in the patient's condition is determined based on data obtained from at least one image taken in operations 1410, 1418. Alternatively, or in addition to data obtained from at least one image taken in operations 1410, 1418, the change in the patient's condition may also be determined by updating vital sign measurements or other observations of the patient during method 1400.

[0102] When it is determined that the patient P's condition has not changed (i.e., "No" in operation 1428), method 1400 continues to capture additional images using the same workflow used for image capture in operations 1410 and 1418. When it is determined that the patient P's condition has changed (i.e., "Yes" in operation 1428), method 1400 proceeds to operation 1430: reconfiguring the ocular imaging device 102 based on the changed condition to perform a different type of workflow than the first and second types described above.

[0103] As an illustrative example, when a patient's condition is improving, the eye imaging device 102 can be reconfigured to perform a less complex workflow, allowing it to capture fewer or less detailed images. As another illustrative example, when a patient's condition is worsening, the eye imaging device 102 can be reconfigured to perform a more complex workflow, allowing it to capture more or more detailed images.

[0104] In some embodiments, the eye imaging device 102 is reconfigured in operation 1430 regardless of detected changes in the patient's condition. In such embodiments, fewer images or image types are taken to monitor the patient's progress because fewer images or image types may be needed as the patient's condition remains stable.

[0105] Method 1400 may repeat operations 1418-1430 multiple times as needed until the workflow is complete (i.e., "Yes" in operation 1424). Each time operations 1418-1430 are repeated, the ocular imaging device 102 may automatically adjust the type of one or more images it captures based on the reconfiguration performed in operation 1430. For example, during the first performance of operations 1418-1430, an image sequence providing rich data is acquired in operation 1418, and with each repetition of operations 1418-1430, as the patient's condition progresses, fewer images or fewer image types are acquired in operation 1418.

[0106] Furthermore, repeated operation 1420 provides an improved risk score trend based on updated microvascular assessments derived from images acquired from the ocular imaging device 102. The risk score trend can indicate the progression of the patient's condition. Furthermore, repeated operation 1422 can provide clinicians with a continuously updated and improved risk score.

[0107] Method 1400 can improve the use of the eye imaging device 102 in acute care units or medical operating rooms by using a timer 112 to remind the user when the user should use the eye imaging device 102 to take an image or group of images. Method 1400 can also provide early detection of the deterioration of a patient's disease (e.g., COVID-19 and sepsis) by continuously monitoring microvascular changes in the patient's eye.

[0108] Figure 15 An exemplary computing device 1500 is schematically illustrated, which can be used to implement the functions of the present invention, such as the eye imaging device 102 and server 114 described above. The computing device 1500 includes a processing unit 1502, a system memory 1508, and a system bus 1520 coupling the system memory 1508 to the processing unit 1502. In some embodiments, the processing unit 1502 is... Figure 1 The image processor 106 of the mid-eye imaging device 102. The processing unit 1502 is an example of a processing device such as a central processing unit (CPU). The system memory 1508 includes random access memory (“RAM”) 1510 and read-only memory (“ROM”) 1512. Basic input / output logic is stored in the ROM 1512, and the basic input / output logic contains basic routines such as those that help transfer information between elements within the computing device 1500 during startup.

[0109] The computing device 1500 may also include a mass storage device 1514 capable of storing software instructions and data. The mass storage device 1514 is connected to the processing unit 1502 via a mass storage controller (not shown) connected to the system bus 1520. The mass storage device 1514 and its associated computer-readable data storage medium provide non-volatile, non-transitory storage for the computing device 1500.

[0110] Although the description of the computer-readable data storage medium herein refers to a mass storage device, those skilled in the art will understand that a computer-readable data storage medium can be any available, non-transitory physical device or article of manufacture from which data and / or instructions can be read. Mass storage device 1514 is an example of a computer-readable storage device.

[0111] Computer-readable data storage media include volatile and non-volatile, removable and non-removable media implemented in any method or technology for storing information such as computer-readable software instructions, data structures, program modules or other data. Exemplary types of computer-readable data storage media include, but are not limited to, RAM, ROM, EPROM, EEPROM, flash memory or other solid-state storage technologies, or any other medium that can be used to store information and is accessible by a device.

[0112] The computing device 1500 can operate in a network environment via network 110 (e.g., a local network, the Internet, or another type of network) and using a logical connection to remote network devices (including server 114). The computing device 1500 is connected to network 110 via network interface unit 1504 connected to system bus 1520. Network interface unit 1504 can also be used to connect to other types of networks and remote computing systems.

[0113] The computing device 1500 may also include an input / output controller 1506 for receiving and processing inputs from a plurality of input devices. Similarly, the input / output controller 1506 may provide outputs to a plurality of output devices.

[0114] Mass storage device 1514 and RAM 1510 can store software instructions and data. The software instructions may include an operating system 1518 suitable for controlling the operation of the device. Mass storage device 1514 and / or RAM 1510 also store software instructions 1516, which, when executed by processing unit 1502, enable the device to provide the functionality of the device discussed in this document.

[0115] The various embodiments described above are for illustrative purposes only and should not be construed as limiting in any way. Various modifications can be made to the above embodiments without departing from the true spirit and scope of the invention.

Claims

1. A system for capturing images of one or more eyes, the system comprising: An eye imaging device having a camera configured to capture images of the eye; and A computing device having at least one processor and a memory storing instructions, which, when executed by the at least one processor, cause the system to: A workflow for capturing images of the eye using the eye imaging device is determined, the workflow being based on a risk score for a given patient, wherein the risk score represents the likelihood of disease exacerbation affecting macroscopic vital signs; The workflow is performed on the eye imaging device to capture images of the eye; Microvascular assessment based on the captured images of the eye; Based on the microvascular assessment, the risk score is adjusted to generate an improved risk score; and Set a timer to trigger an alert to take additional eye images using an eye imaging device, where the timer setting is based on an enhanced risk score.

2. The system according to claim 1, wherein, The memory stores other instructions that, when executed by the at least one processor, cause the system to adjust the workflow on the ocular imaging device based on the microvascular assessment.

3. The system according to claim 1, wherein, The memory stores other instructions that, when executed by the at least one processor, cause the system to adjust the workflow on the eye imaging device based on disease progression.

4. The system according to claim 2, wherein, The workflow of the eye imaging device is adjusted to capture different numbers and types of eye images.

5. The system according to claim 1, wherein, The workflow performed on the ocular imaging device involves capturing a single image of a predetermined type based on the patient's risk score.

6. The system according to claim 1, wherein, The workflow performed on the ocular imaging device captures a predetermined sequence of images for the microvascular assessment.

7. The system according to claim 1, wherein, The eye imaging device is connected to an arm that is controllable to adjust the position of the eye imaging device relative to the patient, and wherein the arm is an articulated arm comprising one or more motors controlled by the computing device to position the eye imaging device in front of the patient.

8. The system according to claim 1, wherein, The ocular imaging device is mounted on a testing booth that includes a digital display configured to output instructions to the patient to use the ocular imaging device for disease risk assessment.

9. The system according to any one of the preceding claims, wherein, The computing device is part of the eye imaging device or part of a server remotely located relative to the eye imaging device.

10. A non-transitory computer-readable storage medium comprising computer-readable instructions, said computer-readable instructions causing the computing device, when read and executed, to: A workflow for capturing one or more eye images using an ocular imaging device is determined, the workflow being based on a risk score for a given patient, wherein... Risk scores indicate the likelihood of disease exacerbation affecting macroscopic vital signs; The workflow is performed on the eye imaging device to capture images of the one or more eyes; Microvascular assessment based on the captured images of the eye; The risk score is adjusted based on the microvascular assessment to generate an improved risk score; as well as Set a timer to trigger an alert to take additional eye images using an eye imaging device, where the timer setting is based on an enhanced risk score.

11. The non-transitory computer-readable storage medium of claim 10, further comprising computer-readable instructions that, when read and executed by the computing device, cause the computing device to: The workflow on the eye imaging device is adjusted based on the microvascular assessment.

12. The non-transitory computer-readable storage medium of claim 10, further comprising computer-readable instructions that, when read and executed by the computing device, cause the computing device to: The workflow on the eye imaging device is adjusted based on disease progression.

13. The non-transitory computer-readable storage medium according to claim 11, wherein, The workflow was adjusted to capture different numbers and types of eye images.

Images