Biomedical imaging devices, systems, and methods of use

Abstract

A modular ophthalmic device comprising: a first optical device having a light source and an imaging sensor; a first input coupler having an optical interface connection and a physical interface connection for aligning and securing the input optical module; a first optical output; an optical path; and an output coupler fixing the third optical device.

Description

Technical Field

[0001] The present disclosure relates to biomedical imaging devices and systems, and in particular, to modular biomedical imaging devices and systems. Background Art

[0002] Imaging of an organ (e.g., an eye) is important for identifying disorders of the organ. Various imaging techniques can be used to capture images of the internal compartments of the eye. For example, scanning laser ophthalmoscopy (SLO) imaging can provide a 2-dimensional image of a portion of the eye such as the retina, vitreous body, trabecular meshwork, or cornea. Optical coherence tomography (OCT) imaging can provide a 3-dimensional image and / or a cross-sectional image of a portion of the retina, vitreous body, trabecular meshwork, or cornea. Other imaging techniques can be used to capture images of at least a portion of the fundus of the eye.

[0003] Imaging of the eye can be used to identify eye conditions that require treatment. Treatment of eye conditions can be performed using lasers, with the specific target location of the laser beam or pulses determined based on the captured images.

[0004] The imaging device and the therapeutic laser may be combined into a single device.There is a need for additional, new and / or improved biomedical imaging devices capable of imaging and / or treating one or more conditions. Summary of the invention

[0005] According to the present disclosure, an ophthalmic device is provided, comprising: a first optical device, the first optical device comprising a first light source and a first imaging sensor capable of generating image data using the first light source; a first input coupler, the first input coupler comprising: a physical interface connector for aligning and fixing the input optical module, and an optical interface connector; a first optical output; an optical path, coupling the first optical device and the optical interface connector of the first input coupler to the first optical output; and an output coupler, providing a physical interface connector for aligning and fixing a third optical device.

[0006] In another embodiment of the device, the device further comprises a controller for controlling the operation of the device and providing one or more of: a calibration function for registering connected input modules and output modules for use with the device; an image registration function; and a retinal tracking function.

[0007] In another embodiment of the device, the first input coupler further comprises an electrical interface connection.

[0008] In another embodiment of the device, the electrical interface connection provides a communication channel to a controller of the device.

[0009] In another embodiment of the device, the device further comprises: a first tunable lens for the first optical device in the optical path; and a second tunable lens for the first input coupler in the optical path.

[0010] In another embodiment of the device, the first tunable lens and the second tunable lens are controlled by a controller to co-align light from the first optical device with the optical interfacing connection of the first input coupler.

[0011] In another embodiment of the device, the device further comprises a second input coupler comprising: a physical interface connection for aligning and fixing the fourth optical device; and an optical interface connection.

[0012] In another embodiment of the device, the second input coupler further comprises an electrical interface connection.

[0013] In another embodiment of the device, the output coupler further comprises an electrical interface connection.

[0014] In another embodiment of the device, the optical path includes one or more of the following: a beam splitter / optical combiner; an optical circulator; a filter; a galvanometer; a tunable lens; a lens; and a grating.

[0015] According to the present disclosure, there is also provided an ophthalmic system, comprising: a basic ophthalmic device according to any one of claims 1 to 10; and an input optical module fixed to a first input coupler.

[0016] In another embodiment of the system, the input optical module comprises at least one of: an imaging device comprising a light source and a sensor, an optical interfacing connection optically coupled to the first input coupler; and a therapeutic laser.

[0017] In another embodiment of the system, the input optical module further comprises one or more of: an optical device; a guide laser; a graphics processing unit; and an additional input coupler.

[0018] In another embodiment of the system, the input optics module provides one or more of: a 2D imaging system; a scanning laser ophthalmoscope (SLO) imaging system; an optical coherence tomography (OCT) imaging system; and a therapeutic laser therapy system.

[0019] In another embodiment of the system, the system further comprises an additional input optical module secured to the base ophthalmic device.

[0020] In another embodiment of the system, the system further comprises an output optics module secured to a base ophthalmic device.

[0021] In another embodiment of the system, the output optical module includes one or more of: an optical device; a graphics processing unit; an additional input coupler; an additional output coupler; and a sensor.

[0022] According to the present disclosure, a kit for an ophthalmic device is also provided, comprising: a first optical module, the first optical module comprising: one or more optical components for providing ophthalmic functions to the ophthalmic device; a physical interface connector for mechanically fixing the first optical module to the ophthalmic device; an optical interface connector for optically coupling at least a portion of the one or more optical components to the ophthalmic device; and a module identifier for uniquely identifying the first optical module; and authorizing the ophthalmic device to use one or more software components to provide ophthalmic functions using the first optical module identified by the module identifier.

[0023] In another embodiment of the kit, the first optical module includes one of an input module and an output module.

[0024] In another embodiment of the kit, the first optical module comprises an input module, and the kit further comprises an output module.

[0025] In another embodiment of the kit, the kit includes at least one input module and output module adapted to perform one or more of: central photocoagulation; peripheral photocoagulation; femtosecond laser vitreous therapy; YAG laser vitreous therapy; and femtosecond laser glaucoma therapy.

[0026] In another embodiment of the kit, the software component includes functionality for performing automatic treatment planning using machine learning.

[0027] According to the present disclosure, a method for operating an ophthalmic device is also provided, which includes an internal imaging system and one or more input modules connected to the ophthalmic device, the method including: identifying one or more input modules connected to the device; for each connected input module, determining whether the connected input module includes an optical component that needs to be aligned with the internal imaging system or other identified input modules; and for each input module that needs to be aligned, controlling a tunable lens of the device within an optical path optically coupled to the corresponding input module that needs to be aligned to align the corresponding input module.

[0028] In another embodiment of the method, the alignment of the input modules aligns an optical path of each input module with an optical path of an internal imaging system.

[0029] In another embodiment of the method, the alignment of the input module aligns the depth of focus to a common depth of focus of the other components.

[0030] In another embodiment of the method, the alignment of the input module aligns the depth of focus to a different depth of focus than other components.

[0031] In another embodiment of the method, the aligning uses image registration techniques to determine the required adjustment.

[0032] In another embodiment of the method, the method further comprises using image registration techniques to co-register the images captured by the ophthalmic device.

[0033] In another embodiment of the method, one or more output modules are connected to an ophthalmic device, and the method further includes: identifying one or more output modules connected to the device; for each connected output module, determining whether the connected output module includes optical components that need to be aligned with an internal imaging system or other identified input modules and output modules; and for each output module that needs to be aligned, controlling a tunable lens of the device within an optical path optically coupled to the corresponding output module that needs to be aligned to align the corresponding output module.

[0034] In another embodiment of the method, the method further comprises: determining requirements and / or limitations of the connected input modules and output modules; determining one or more possible operating modes based on at least one of the requirements and limitations of the connected input modules and output modules; and enabling at least one possible operating mode. BRIEF DESCRIPTION OF THE DRAWINGS

[0035] Further features and advantages of the present disclosure will become apparent from the following detailed description taken in conjunction with the accompanying drawings, in which:

[0036] Figure 1 Components of an ophthalmic system are shown;

[0037] Figure 2 Components of another ophthalmic system are shown;

[0038] Figure 3 Components of an ophthalmic device are shown;

[0039] FIG. 4A to FIG. 4I Components of various input modules for use with an ophthalmic device are shown;

[0040] FIG. 5A to FIG. 5O Components of various output modules for use with an ophthalmic device are shown;

[0041] Figure 6 Components of another ophthalmic system are shown;

[0042] Figure 7 An illustrative database for storing module registration data is shown;

[0043] Figure 8 A method of using an ophthalmic system is shown;

[0044] Fig. 9 Another method of using an ophthalmic system is shown; and

[0045] Fig.10 A method of calibrating an ophthalmic system is shown. DETAILED DESCRIPTION

[0046] Biomedical imaging systems and devices can be used to provide a variety of imaging and possible treatment options. Medical imaging systems and devices can be set as modular systems. Medical imaging systems and devices are further described herein, with specific reference to ophthalmic devices for imaging and possibly treating eyes. Ophthalmic devices are designed to provide a function for examining a patient's eyes and possibly examining and / or treating a patient's eye condition. These devices may include, for example, an ophthalmoscope for examining the fundus of a patient's eye, a tonometer for measuring pressure in a patient's eye, a visual field analyzer for testing a patient's visual field, and a laser treatment device that can be used for photocoagulation, ablation, cutting or otherwise treating eye tissue. Although these devices are useful for ophthalmologists, they may be expensive. In addition, many devices that may be required may require a relatively large footprint, and may require a patient to move from one device to another, which increases the time required to diagnose and / or treat a patient. As further described herein, an ophthalmic system can be provided that can be used for multiple purposes, including diagnosing and treating various eye conditions. The system includes a base device that can provide an imager for performing imaging functions of a patient's eye. In addition to the imager of the base device, the base device also includes a physical input coupler that allows additional optical input devices to be physically and optically connected to the base device. A variety of different optical input devices can be provided to provide different functions, including, for example, additional imaging and / or treatment devices. In addition to the physical input coupler, the base device also provides an output physical coupler that allows optical output devices to be physically and optically coupled to the base device. The output optical device can provide various functions, such as possibly providing additional focusing or defocusing optical devices. The base device, together with possible different input and output optical modules, can provide an ophthalmologist with a single device that can be used to provide multiple functions for examining, diagnosing and / or treating different eye conditions. The ophthalmic system described herein provides a cost-effective device that can be used to replace possible multiple devices.

[0047] Figure 1 Components of an ophthalmic system are shown. The ophthalmic system 100 includes a basic device 102 that can provide basic functions. The basic functions 104 are Figure 11 is depicted as an imaging device, which includes a light source 106 and an imager or image sensor 108 that can detect light from the light source and generate image data. The light source can be a visible light source and / or an invisible light source. In addition, the light source can be a coherent light source and / or an incoherent light source. A beam splitter device 110 is provided, which allows light from the light source 106 to pass to an optical path 112 of the base device, and provides light returned from the optical path 112 to the imager 108. The beam splitter device can be provided in various forms depending on the light source and the imager. For example, the beam splitter can be configured as a two-way mirror, which allows light from the light source to pass, but reflects the return light to the imager. Alternative devices may include polarizing beam splitters and non-polarizing beam splitters, optical circulators, or other devices.

[0048] Regardless of the specific implementation of the light source 106, the imager 108 and beam splitter 110 of the base imaging function 104 are optically coupled to an optical path 112 of the base device. The optical path 112 may be coupled to another beam combiner / beam splitter device 114 (which may be, for example, a dichroic mirror) and one or more optical devices 116. The optical device 116 may include one or more lenses that may adjust the focus of light from the light source through an optical output port 118 of the base device 102 to the patient's eye or other target 120. The optical device may include other optical devices such as filters, adjustable mirrors, shutters or apertures, adaptive optics, etc. Light from the light source may be returned from the patient's eye through the output port 118 and returned to the optical path 112, where it is provided to the imager 108 to generate image data of the eye or target.

[0049] The base device 102 also includes a physical output coupler 122 that can be used to align and lock the optical output module (not shown in FIG. 1 ). The physical output coupler 122 is depicted as three pins extending downward from the device; however, it will be understood that the physical coupling means can be provided by various physical connectors that can physically locate and align the output module to the base device and lock the module in place. The base device 102 also includes a physical input coupler 124 that includes a physical alignment feature depicted as a pair of pins, and an optical input port 126 that provides optical coupling between an input optical module connected to the input coupler 124 and a second optical path 128 optically coupled to the second beam splitter 114 (and thus to the optical device 116 and the optical output port 118). The output physical coupler 122 and the input physical coupler 124 are depicted as providing different physical interfaces, with the output coupler using three pins and the input coupler using two pins, so as to prevent the input module and the output module from being incorrectly coupled to the base device. Although depicted as providing different physical coupling interfaces, the output coupler and input coupler may use the same physical interface.

[0050] The base device 102 provides imaging functionality 104 as well as a physical connector 124 for connecting one or more input modules to the base device. Figure 1 Various input modules 130a, 130b, 130c, 130d (collectively referred to as input modules 130) are shown in FIG. Each module includes a corresponding physical interface 132 that engages with the physical interface 124 of the base device to align and secure the input module to the base device. The input module 130 also includes an optical interface 134 that optically couples to the optical input port 126 when the input module is physically coupled to the base device.

[0051] Each input module 130 may be used to provide a different functionality. For example, input module 130a is depicted as providing a light source 136 and an imaging sensor 138 and a beam splitter 140. Input module 130a may provide an alternative device compared to the imaging function 104 provided by the base device. An additional input module 130b is depicted as providing an additional light source 142 that may provide, for example, improved illumination or illumination of a different bandwidth for imaging by the imaging device. To be used with such an input module, the beam splitter 114 should return at least a portion of the light from the light source 142 to the imager 108. Another input module 130c is depicted as providing an imager 144 that may use the light source 106 of the base device to capture alternative, additional and / or improved image data. When used with such an input module, the beam splitter 114 should return at least a portion of the light from the light source 106 of the base device. Another input module 130d depicted provides a laser source 146 that may be used as a light source for an imaging device or as a therapeutic laser for treating the patient's eye 122.

[0052] Figure 2 Components of another ophthalmic system are shown. System 200 is similar to the system described above with reference to FIG. 1 and includes a base device 202 having an input module and an output module physically and optically coupled thereto. Base device 202 provides an imaging function 204 having an imaging source 206 and an imaging sensor 208. Imaging function 204 may be combined with Figure 2 Additional optics and / or components not depicted in the drawings. The imaging source and sensor may vary depending on the imaging functionality provided. For example, the imaging functionality may provide a digital ophthalmoscope using a white light source and a 2D image sensor (such as a CMOS sensor) and appropriate optics. Alternatively, the imaging functionality may provide an SLO (scanning laser ophthalmoscope) functionality that uses a laser source with scanning optics (such as a galvanometer, a resonant scanner, a rotating mirror) for scanning a laser across the patient's eye to generate an image of the eye.

[0053] The base device 202 has an optical path 212 that provides an optical path between the imaging function 204 and a beam combiner / beam splitter device 214 that is optically coupled to one or more optical devices 216, such as focusing optics. The focusing optics may include one or more adjustable lenses. Additionally or alternatively, the optical devices may include scanning optics for controlling the direction of light on the patient's eye. The base device 202 includes an optical output port 218 that allows the optical device to be optically coupled to a corresponding optical coupler of an output optical module 220 that is mechanically, electrically, and data transferably coupled to the base device via a physical interface connector 222. The physical connector may include cooperating features on the base device and the output module 220.

[0054] The output module 220 is depicted as providing an optical device 224 including movable lenses 224a, 224b that can be used to adjust the depth of focus of the light source and imager onto the patient's eye 230 through the output port 228. Other output modules including various different components for providing different functions can be provided. FIG. 5A to FIG. 5O An exemplary output module is further described.

[0055] In addition to the output module 220, the ophthalmic system 200 includes an input optical module 232 that is mechanically coupled to the base device 202 using a physical interface 234 between the module and the device. The physical interface 234 may include cooperating features on each of the input module 232 and the base device 202 that align and lock the input module in place relative to the base device. As depicted, the input module 232 provides another light source 236 and a corresponding imaging sensor 238 and a beam combiner / beam splitter or other optical device 240 for directing light from the light source to the optical interface 242 between the input module 232 and the base device 202, and from the optical interface 242 to the sensor 238. The optical interface 242 couples the input module to a second optical path 244 of the base device 202, which in turn is optically coupled to the output module 220 through the beam combiner / beam splitter 214 and the optical device 216.

[0056] The input module may provide an imaging modality different from the imaging function 204 of the base device. For example, the base device may be provided with SLO imaging functionality, while the input module 232 may provide OCT (optical coherence tomography) imaging. It will be appreciated that Figure 2 Not all imaging components used to provide OCT imaging are depicted.

[0057] The base device 202 may also include a controller 250 for controlling the operation of the ophthalmic system 200. The controller may control the operation of the imaging functions of the base device as well as provide a user interface for operating the system 200. The user interface may be provided as a graphical user interface displayed on a display (not shown) of the base device, or may include an interface provided on a remote device that may communicate with the controller via a communication module, such as a The controller 250 may be configured as one or more separate control devices (such as an FPGA (field programmable gate array), an ASIC (application specific integrated circuit), and / or a central processing unit (CPU)) that operate together to provide the functionality of the system 200.

[0058] The above-described base devices 102, 202 provide internal imaging functions and interfaces for mechanically and optically coupling input modules and output modules to the base device. In addition to the physical and optical interfaces between the input / output modules and the base device, there are also electrical interfaces 246 for output modules and electrical interfaces 248 for input modules. The electrical interfaces 246, 248 provide one or more electrical connections between the modules and the base device. The electrical interfaces can couple the input / output modules to the controller 250 of the base device to provide power to the components of the input / output modules and provide communication paths. As depicted, the input modules and output modules can each include one or more controllers 246, 248. The controllers of the modules can communicate with the controller of the base device to coordinate the operation of the modules. In addition, the controllers of the input modules and output modules can provide information for configuring the modules with the base device. For example, the controller 252 of the output module can transmit identification information stored in the module to the controller of the base device 202. The identification information can provide the base device with information about how the base device can control the output module and other information such as possible other requirements and / or limitations of the output module.

[0059] As described above, the controller of the output module or input module can transmit identification information about the module. The identification information can be provided in a variety of ways, such as using an RFID tag 256 on the module and an RFID tag reader 258 on the base device 202, which can transmit the identification information of the module stored in the RFID tag. In addition to providing identification information to the base device, the base device can also provide the module with the identification information of the base device to allow the module to identify the base device and possibly adjust the operation of the input module or output module to operate with the base device.

[0060] Using the basic ophthalmic device as described above, additional modules can be provided, whether input modules and / or output modules that can expand the functionality of the basic device. Different input modules and output modules can be combined in different kits to provide various functions. FIG. 4A to FIG. 4I and FIG. 5A to FIG. 5O Illustrative input modules and output modules are further described.

[0061] Figure 3 Components of an ophthalmic device are shown. A base device 302 is similar to the base devices 102, 202 described above. The base device 302 includes an imaging function 304 provided by a light source 306 and an imaging sensor 308, which are coupled to a common optical path, for example, by a combiner / beamsplitter device or apparatus 310a. Additional optical devices 310b may be included as part of the internal imaging. The optical devices 310b may include, for example, focusing lenses and / or scanning / aiming optics, slits and / or apertures, and / or adaptive optics and / or dispersion compression / compensation optics, and / or spatial light modulators, and / or scanning optics such as rotating mirrors and / or galvanometers, and / or reference arms. Light for the imaging function 304 is coupled to an optical path 312 of the base device, which passes through an optical combiner / beamsplitter device 314 and one or more optical devices 316, such as lenses, filters, scanning optics, etc. The optical path terminates at an optical output port 318, which can deliver light to / from the patient's eye or other device such as a surgical lens, or to / from the optical output module. A mechanical connection interface 320 is provided to align and secure the output module to the base device in an orientation that couples the optical output port of the base device with the optical port of the output module. Similarly, when the output module is physically connected to the base device, an electrical interface connection 322 can be formed between the output module and the base device. The electrical connection can provide an electrical communication path between a controller of the output module and a controller 324 of the base device.

[0062] The input modules may be similarly connected to the base device. The input connections may include an optical interface connection 326, a physical interface connection 328, and an electrical interface connection 330. The optical interface connection 326 may provide an optical path between the input module and a second optical path 332 of the base device connected to the combiner / splitter device 314. The base device may include additional connections for the input modules, each of which may include an optical interface 334, a physical interface connection 336, and an electrical interface connection 338. The optical interface connection 334 may couple the connected module to a third optical path 340 and the optical combiner / splitter 314 of the base device.

[0063] The base device is depicted as also including a plurality of tunable lens (TL) devices 342, 344, 346. Each tunable lens is arranged in the optical path from an input module or imaging function. Figure 3 318 of the base device disposed at the output may include a tunable lens or other optical device provided for use as a tunable lens. The tunable lenses may be individually controlled to adjust the focus of light in the corresponding optical path. The tunable lenses may be controlled to co-align the devices. For example, if one input module provides imaging functionality in addition to the imaging functionality of the base device, two tunable lenses may be controlled, for example, by the controller 346, to co-align the two imaging devices so that the position within one imaging device matches the position within the other imaging device. A similar function may be provided to co-align another input module that may provide, for example, a therapeutic laser with one or more imaging devices. Co-alignment of the devices may be performed in a variety of ways, including, for example, identifying a common feature on an imaging system, and controlling one or more tunable lenses to adjust the position of the common feature in an image captured by one or more imaging devices. Although described as tunable lenses, the same or similar functionality may be provided by other optical devices such as adaptive optics (such as a spatial light modulator).

[0064] The importance of co-alignment may depend on the application of the device. For example, if the device is used to image a patient's eye for general examination, co-alignment of images captured by different imaging devices, which may be internal to the device or provided by a connected module, may not be very important because the captured images are intended to be viewed individually by a physician and therefore the alignment of individual features is not very important. Alternatively, if the images are analyzed in conjunction with each other to possibly diagnose an eye condition, then it may be more important that the images are co-aligned, however in the case of diagnosis it may not be critical to have the physical systems co-aligned because the images can be registered to each other through processing after being captured. If the system is used to treat an eye condition, such as using a therapeutic laser input module connected to a base system, then it may be critical that the laser and imaging system used to determine the treatment target are co-aligned so that the target identified in the image captured by one or more imaging devices is correctly aimed by the treatment laser. Therefore, the operation of the tunable lens and the accuracy with which the connected optical device is co-aligned may depend on the current application.

[0065] Additionally or alternatively, the tunable lenses 342, 344, 346 may be used to adjust the depth of focus of each optical device. Depending on the particular arrangement of the optical devices within and connected to the base device, different applications may be provided and different depths of focus of the system may be required. For example, if the internal imaging device of the base device is an SLO imaging device, and the input module includes an OCT imager and a therapeutic laser that passes through the scanning optics of the OCT imager and is co-aligned with the OCT source laser, then various eye conditions may be imaged and treated. For example, in the case of imaging and treating a retinal tear, both the SLO and OCT with the therapeutic laser should have associated tunable lenses that are configured to provide the same depth of focus to both optical devices and are aligned with each other so that a point in one imaging system can be directly mapped to a point in the other imaging and therapeutic system. This co-alignment and depth of focus allows the use of aligned SLO and OCT images to identify a tear in the retina and then use the therapeutic laser to treat the tear. Conversely, the same SLO and OCT imaging and therapeutic system may be configured to treat different conditions, such as floaters. In this case, the tunable lens of the SLO can focus the imaging depth on the retina in order to capture an image of the floater or its shadow on the retina. The SLO image can then be used to aim the OCT imaging and treatment system, and the tunable lens of the OCT imaging and treatment system is used to adjust the focal depth within the vitreous humor where the floater is located. Once the floater is identified within the vitreous humor, the treatment laser (which is aligned with the OCT laser and passes through the same scanning and focusing optics) can be operated to aim and break up the floater. The different optical systems can be co-aligned so that their beams are co-linear with each other along the optical path. Although the beams can be aligned with each other, they can be focused at different depths / lengths along the optical path.

[0066] The controller 324 may provide various functions 348, including, for example, a system calibration function 350, an image co-registration function 352, and a retinal tracking function 352. This function is merely an example, and other functions may be provided. The calibration function 350 may determine which connected components include optical elements that require calibration, for example, to align the optical elements. The calibration may include controlling a tunable lens located within the optical path of the device to align the optical elements. The alignment may be to a desired reference position (such as the center of the lens), or may be relative to other components. The calibration function adjusts the components of the system so that they operate together to provide the desired function. The calibration may include adjusting an optical device including a tunable lens to align different optical devices with each other, adjusting the depth of focus, adjusting operating parameters of light sources and sensors, etc. The calibration process may be performed one or more times, including, for example, initially when setting up the system, when modifying the system by adding or removing modules, when starting or restarting the system, when treating a new patient, and / or when desired or needed by the user.

[0067] The co-registration function 352 can allow two or more images to be registered with each other. The registration process can identify common features in one image and match them to corresponding features in other images. Registration can be used to provide a mapping that maps the location of the common features in one image to the location of corresponding features in other images. The mapping can be used to align optical systems or for other processes. Co-registration can be applied to images of the same modality or different modalities. In addition or alternatively, co-registration can be applied to a current image captured from an imaging device of the system, and / or a current image previously captured by the system or using other imaging devices.

[0068] Retinal tracking functionality 354 can be used to track the movement of the patient's eye during use of the imaging system. Retinal tracking can be used to adjust imaging parameters such as target position and depth of focus. Although the images are described as individual images, the images can be captured as a video stream of images. Retinal tracking can be applied to the streaming images to track the patient's eye movement in real time. Retinal tracking can be applied to an entire image or frame and / or a sub-frame band of an image or frame.

[0069] FIG. 4A to FIG. 4I Components of various input modules for use with an ophthalmic device are shown. FIG. 4A to FIG. 4I Each of the input modules 402a-402g depicted in FIG. 4 (collectively, input modules 402) includes a physical interface connection 404 that allows the input module to be physically secured to a base device. The physical interface connection 404 provides one or more features that allow the input module to be aligned and secured in place so that an optical port 406 of the input module is arranged with and optically coupled to a corresponding optical path of the base device. Alternatively, the optical connection can be established before the input module is physically connected to the base device using the physical interface connection. The input module can also have an electrical interface connection 408 for electrically connecting the input module to the base device. The input modules 402 can each include one or more controllers 410 for operating the input module in conjunction with the base device (possibly in conjunction with other input modules and one or more output modules).

[0070] Go to Figure 4A, the input module 402a is depicted as providing an imaging device that includes an imaging light source 412, which can be, for example, an incoherent light source (such as white light), a coherent light source (such as a laser, which can be a continuous laser or a pulsed laser operating at, for example, femtoseconds, picoseconds, or nanoseconds). The light source can provide light of one or more wavelengths within the visible spectrum and the invisible spectrum. The input module 402a also includes an imaging device, such as a CMOS sensor, a photodiode, an avalanche photodiode, a balanced photodetector, or other sensor that can capture light from the light source 412 that returns from striking the patient's eye. A combiner / splitter device 416 directs light from the light source 412 to the optical port 406 of the input module, and directs light returned from the optical port 406 to the imager sensor 414. The sensor 414 can transmit the captured image data to the controller 410, which in turn can transmit the image data to the base device via the electrical interface 408.

[0071] Go to Figure 4B , input module 402b is similar to input module 402a, but includes one or more additional optical devices 418, which can be arranged between combiner / splitter 416 and optical port 406. Optical device 418 can include, for example, focusing lens and / or scanning / aiming optics, slits and / or apertures, and / or adaptive optics and / or dispersion compression / compensation optics, and / or spatial light modulators, and / or scanning optics such as rotating mirrors and / or galvanometers, and / or reference arms. Input module 402b can be used to provide various functions, such as SLO imaging, OCT imaging, hyperspectral imaging, Raman spectroscopy, slit lamp imaging, etc.

[0072] Go to Figure 4C , input module 402c is similar to input module 402a, but includes an input module interface connector that provides a physical interface 420 for connecting additional input modules to input module 402c. Input module 402c also includes an optical port for coupling additional input modules to a combiner / splitter device 416 of input module 402c.

[0073] Go to Figure 4D , input module 402d includes a therapeutic laser 426 that can be used to treat eye conditions. Figure 4DNot shown in the drawings, the input module 402d may include one or more optical devices, such as a focusing lens and / or scanning / aiming optics, and / or adaptive optics and / or dispersion compression / compensation optics, and / or a spatial light modulator, and / or scanning optics such as a rotating mirror and / or a galvanometer, and / or a reference arm. Additionally or alternatively, the optics of the base device may be used to focus and / or aim or otherwise steer the treatment laser. Furthermore, the input module 402d may include one or more safety devices to ensure that the treatment laser 426 cannot fire unless it is determined to be safe to do so, and to ensure that if one or more components fail, the input module fails in a safe mode in which the treatment laser cannot fire.

[0074] Go to Figure 4E , input module 402e provides a combination of input module 402a and input module 402e. Input module 402e can provide an imaging system and a treatment system that can aim and treat a condition in the eye. Input module 402e can include additional optical components, such as a focusing lens and / or scanning / aiming optics, and / or adaptive optics and / or dispersion compression / compensation optics, and / or a spatial light modulator, and / or scanning optics such as a rotating mirror and / or a galvanometer, and / or a reference arm. In addition, additional optical devices can be provided for aligning the imaging device (or light source 412 and imager 414) with the treatment laser. The alignment ensures that the light source 412 and the treatment laser are colinear along the optical path.

[0075] For example, if the imaging device is an OCT imaging device, the light source 412 is a laser source, and when the treatment laser is fully aligned with the OCT source laser, the two laser beams or pulses will be aligned together so that the beams are collinear with each other along the entire optical path they have in common. The alignment components can also be used to align the treatment laser with the optical port 404 of the input module. The alignment components can include a rough alignment component and a fine alignment component. The rough alignment component can include a positioning optical device arranged, for example, in a Z-fold arrangement, a four-shaped arrangement, or any other type of arrangement suitable for aligning the treatment beam. After passing through the positioning optical device, the treatment beam can pass through a beam splitter that directs a small portion of the beam to a rough alignment sensor and another portion to an optical coupler 416 of the input module 402a. The split beam used for alignment is further separated by a second beam splitter that is used to direct the light into two separate paths with different lengths, which terminate at corresponding sensors that can determine the incident position of the light on two orthogonal axes (such as the X-axis and the Y-axis). The sensor can be, for example, a CMOS sensor, which provides a relatively large sensor area so that the incident position can be detected even if the beam is relatively poorly aligned. The fine alignment component can be similar to the coarse alignment, but the detection sensor uses two orthogonal photodiodes (QPDs) that provide more accurate position detection of the incident laser instead of using a CMOS sensor. As with the coarse alignment, the path length to each QPD should be different to ensure that the path of the beam is aligned along the path. That is, if the path length is the same, the sensor will only confirm that the path is aligned at a specific position, but the beam may diverge or converge from that point.

[0076] Although alignment features have been described above with respect to input module 402e, similar alignment features may be provided in other input modules, and / or in the base device itself, to align one or more components with each other. Depending on the accuracy of alignment required, alignment features may be omitted entirely, or one or more of coarse alignment features and fine alignment features may be provided. Coarse alignment only.

[0077] Go to Figure 4F, input module 402f is similar to input module 402e, however, instead of providing imaging light source 412 and image sensor 414, input module 402e provides a guide laser 428 as well as a treatment laser. Guide laser 428 can be a relatively low power laser source and can have a similar / different wavelength that can be captured by another imaging sensor of, for example, the base device or an additional input module or output module. The guide laser can be aligned with the treatment laser and used to verify that the treatment laser will be aimed at the correct location within the patient's eye before treatment with the treatment laser. The input module can include additional components not depicted, such as optical devices, including focusing lenses and / or scanning / aiming optics, and / or adaptive optics and / or dispersion compression / compensation optics, and / or spatial light modulators, and / or scanning optics such as rotating mirrors and / or galvanometers, and / or reference arms and alignment components.

[0078] Go to Figure 4G , input module 402g is similar to input module 402a, but the input module includes additional processing resources, which are depicted as graphics processing units (GPUs) 430. The additional processing resources can be used directly by the input module to process images captured by imager 412 before providing the processed results to the base device. Additionally or alternatively, the additional processing resources can be used directly by the base device, for example, to process image data captured by components other than components of input module 402g. In such embodiments, the electrical interface connection between input module 402g and the base device can provide a high-speed and high-bandwidth communication interface.

[0079] Go to Figure 4H , input module 402h is similar to input module 402F. The input module includes a pump laser 432 that can be used to excite a target sample, a probe laser 434, and an imager 436 for the probe laser that can image the excited target sample. The input module may include additional components not depicted, such as optical devices including focusing lenses and / or scanning / aiming optics, and / or adaptive optics and / or dispersion compression / compensation optics, and / or spatial light modulators, and / or scanning optics such as rotating mirrors and / or galvanometers, and / or reference arms and alignment components.

[0080] Go to Fig. 4I, the input module 402i does not include optical components, but is used as a physical adapter. In addition to the input connectors 404, 406, 408, the input module provides another connector including a physical interface 438, an optical interface 440 and an electrical interface 442. The optical interfaces 406, 440 are optically coupled together. The electrical interface 442 can be connected together. Although not shown, the adapter can also include a controller. If necessary, the controller can convert signals between the electrical interfaces and provide information about the module to other connected modules or devices.

[0081] A plurality of different input modules using the same physical, optical and electrical interface connections have been described above. The base device may use one or more different physical, optical and / or electrical interface connections. For example, a first physical, optical and electrical interface may be provided for use with an input module providing relatively simple imaging functionality, while a separate physical, optical and electrical interface may be provided for an input module providing a therapeutic laser. As an example, one interface may provide a higher quality connection in terms of alignment accuracy of the input module, quality of the optical connection, and bandwidth provided by the electrical connection.

[0082] The above input modules have been described separately. One or more components described with reference to one input module may be combined with components from one or more other input modules. Similarly, components described for a single input module may be provided in separate modules.

[0083] FIG. 5A to FIG. 5O Components of various output modules for use with an ophthalmic device are shown. FIG. 5A to FIG. 5HThe output modules 502a-502h (collectively referred to as output modules 502) depicted in each of the embodiments include a first optical port 504 for optically coupling the output module to a base device and a physical interface connector 506 that allows the output module to be physically fixed to the base device. The physical interface connector 506 is depicted as a physical interface connector that is physically different from the input module so that the input module and the output module are not incorrectly attached to the base device. The physical interface connector 506 provides one or more features that allow the output module to be aligned and fixed in place so that the optical port 504 of the output module is arranged with and optically coupled to the corresponding optical path of the base device. Alternatively, the optical connection can be established before the output module is physically connected to the base device using the physical interface connector. The output modules 502a and 502c-502h each include an output optical port 508 that provides an optical port for outputting light or inputting return light. The output module 502 may also have an electrical interface connector 510 for electrically connecting the output module to the base device. The output modules 502 may each include one or more controllers 512 for operating the output modules in conjunction with a base device (possibly along with other output modules and one or more input modules).

[0084] Go to Figure 5A , an output module 502a is shown that provides an optical device 514 in the light path between optical port 504 and optical port 508. The optical device 514 may include filters, apertures, lenses, mirrors, focusing lenses, scanning / aiming optics, adaptive optics, dispersion compression / compensation optics, spatial light modulators, scanning optics such as rotating mirrors and / or galvanometers, reference arms, alignment components, etc. The optical device allows manipulation of light that passes through or reflects / refracts out of the optical device. The optical device 514 can be used, for example, to filter light, focus light, and / or scan or aim light. The optical device 514 can be a passive optical device, or it can be an active optical device whose optical properties can be controlled, for example, by controller 512. For example, the output module 502a can provide a variable depth of focus to allow imaging of different parts of the eye, such as the retina and the lens.

[0085] Go to Figure 5B, an output module 502b providing an optical sensor 516 is shown. Although depicted as a single optical sensor, the optical sensor 516 can be provided as a plurality of different optical sensors and different optical devices, such as lenses, beam splitters / combiners, filters, etc. The output module 502b can provide one or more sensors and can provide various alignment and / or calibration and / or configuration functions. For example, the output module 502b can provide various alignment sensors to ensure that different imaging components of the ophthalmic device are aligned. The sensor readings can be provided to the controller of the base device and used to adjust other components to ensure that they are correctly aligned. In addition or alternatively, the output component can have one or more calibrated sensors that can be used to calibrate or verify the calibration of other components. For example, the sensor can provide a power sensor that can determine the power of the laser and be used to configure the laser device to provide certain power levels, or to verify that the laser device is providing a specific power level. Additional or replaceable sensors can be provided to determine the spectrum of light. The sensor 516 providing data can be used to align the component, verify that the component is working within the operating threshold, adjust the component to operate within the operating threshold, etc.

[0086] Go to Figure 5C , output module 502c is similar to output module 502a, but includes an additional physical connection 518 and an electrical interface connection for connecting to another output module. Output module 502c can provide the same functionality as output module 502a while allowing additional output modules to be coupled to the device. For example, output module 502c can allow calibration output module 502b to be coupled to output module 502c. The output module may include one or more components whose quality may deteriorate over time, and by attaching calibration module 502b to output module 502c, it can be verified that the operating parameters of output module 502c are still within allowable thresholds and may therefore still be usable. This configuration of output module 502c combined with calibration output module 502b can be used to ensure that the device continues to operate at a desired performance level.

[0087] Go to Figure 5D , output module 502d is similar to output module 502a and provides an optical device 522. Optical device 522 can be similar to optical device 514 of output module 502a, but it can provide a greater range of operation or adjustability. For example, optical device 522 can provide a greater depth of focus than optical device 514 of output module 502a.

[0088] Go to Figure 5E, output module 502e is similar to output module 502a, but includes additional processing resources, depicted as a graphics processing unit (GPU) 524. The additional processing resources can be used by the base device, for example, to process image data captured by other components. The electrical interface connection between input module 502e and the base device can provide a high-speed and high-bandwidth communication interface.

[0089] Go to Fig. 5F , output module 502f is similar to output module 502a, but module 502f includes an alignment device 526, which can provide one or more alignment features (depicted as three black diamonds) that can be targeted by the imaging function of the device. The alignment features of alignment device 526 can be located at precisely known locations on the alignment device. By imaging the alignment features, other imaging components of the device can be aligned with the known locations of the alignment features. Alignment device 526 is depicted as being disposed between optical port 504 and optical device 514, however, it can also be disposed between optical device 514 and optical port 508, thereby allowing optical device 514 to help focus the imaging device on the alignment features. The alignment features can be disposed in a position that can be imaged by the imaging device without affecting the imaging of the patient's eye.

[0090] Go to Figure 5G , output module 502g is similar to output module 502a, but includes an input optical port 528 and associated input physical interface connections 530 and electrical interface connections 532. Optical port 528 is optically coupled to an optical path that connects it to a beam combiner / beam splitter 534, which combines the input path with the optical path from the base device. Output module 502g can allow additional input modules to be coupled to output module 502g. The input modules can include an illumination source and a camera sensor, which can be used to provide a video of the patient's eye during examination and possible treatment.

[0091] Go to Figure 5H, output module 502h is similar to output module 502a, but also includes a physical connector 536 that can be used to connect to other devices. For example, during an examination and / or treatment, a patient can place a special lens on their eye, where one end of the lens provides a feature for connecting to the physical connector 536. The physical connector and special lens can improve the delivery of therapeutic laser pulses to the patient's eye. In addition or alternatively, the physical connector 536 can be used to connect the module to an optical fiber, which can be used, for example, as an endoscope or remote imaging device for imaging an internal part of a patient. In addition or alternatively, the physical connector 536 can be connected to a fixed plate or structure for holding, supporting, or providing a reference point for placing a target relative to the imaging system. The target on the fixed plate or surface can be, for example, an external part of the patient, such as the head, arm, hand, chest, hind leg, or foot.

[0092] Go to Fig.5I , the output module 502i provides a display 538. The display can be used for various functions, such as displaying information to the patient, displaying entertainment media to the patient, including videos, movies, television / programs, video games, etc. Although not shown, the output module can be coupled to a remote control device that allows the patient to control the display. Additionally or alternatively, the display can be used as part of the imaging / therapy process, such as by providing a target for the user to focus on or identify, such as peripheral testing, reading text, etc.

[0093] Go to Figure 5J , output module 502j is shown, similar to module 502a. Output module 502j provides scanning optics, which can be used to scan light on a target or otherwise adjust the position at which the light is focused. The scanning optics can provide scanning along one or both of the X-axis and the Y-axis. The scanning optics can include, for example, one or more rotating mirrors, micro-electromechanical (MEM) mirror devices, galvanometers, resonant scanners, etc.

[0094] Go to Figure 5K , output module 502k is similar to output module 502i. Instead of providing a display, module 502k provides a fixation target 542 (which may be an LED light) and one or more optical elements for changing the apparent position of the light source, thereby allowing the position of the patient's gaze to be adjusted.

[0095] Go to Figure 5L , output module 5021 is similar to output module 502j. Instead of providing scanning optics, module 5021 provides dispersion compensating optics 544. The dispersion compensating optics may be controllable to compensate for varying dispersion that may occur within an object such as a patient's eye.

[0096] Go to Figure 5M, output module 502m is similar to output module 502j. Instead of providing scanning optics, module 502m provides a tunable lens 546. The tunable lens may be controllable, for example, to adjust the depth of focus of light passing through the tunable lens.

[0097] Go to Figure 5N , output module 502n is similar to output module 502j. Instead of providing scanning optics, module 502n provides adaptive optics 546. The adaptive optics may be, for example, a spatial light modulator, and may be controllable, for example, to compensate for distortions in the optical system.

[0098] Go to Fig.5O , the input module 502o does not include optical components, but is used as a physical adapter. In addition to the output connector including the optical interface 504, the physical interface 506 and the electrical interface 510, the output module also provides another connector including the physical interface 550, the output optical interface 508 and the electrical interface 552. The optical interfaces 504 and 508 are optically coupled together. The electrical interfaces 510 and 552 can be connected together. Although not shown, the adapter can also include a controller. If necessary, the controller can convert signals between the electrical interfaces and provide information about the module to other connected modules or devices.

[0099] The output modules described above have been described separately. One or more components described with reference to one output module may be combined with components from one or more other output modules. Similarly, components described with reference to a single output module may be provided in separate modules. Furthermore, although the input modules and output modules have been described separately above, components described with reference to the input modules may be used as components of the output modules, and components described with reference to the output modules may be used as components of the input modules.

[0100] Various examples of different input modules and output modules have been described above. Although described separately, the components of different input modules can be combined together in a single input module. Similarly, the components of different output modules can be combined together in a single output module. One or more input modules and output modules can be used with a basic device to provide various ophthalmic functions, such as imaging of the patient's pupil, providing a virtual ophthalmoscope for 2D imaging of the fundus of the patient's eye, SLO imaging function, OCT imaging function, laser treatment function (possibly using one or more different lasers, such as femtosecond lasers, continuous wave lasers, etc.). The different arrangements of the basic device, input module, output module and software components for operating components can be combined in various ways to provide various functions. Input modules, output modules and software components can be provided as different kits, which can be used to provide diagnostic functions and treatment of diseases or disorders for one or more diseases or disorders. The following table provides examples of how different input modules, output modules and software components can be combined with a common basic device to provide different functions. Different input modules, output modules and operating software can be combined together into kits for different applications. The input modules and output modules may provide new physical capabilities to the base device, such as providing one laser or different types of lasers and specific optics that allow focusing on different parts of the eye. While the input modules and output modules may provide different physical capabilities, different software components may provide different software functions. For example, the base software may allow manual evaluation of images and planning of treatment plans, while different software components may provide machine learning (ML) components for providing automatic evaluation and treatment planning. In the table below, it is assumed that the base device provides SLO imaging capabilities; however, the base device may provide different functions.

[0101]

[0102] Table 1: This table shows different arrangements of component kits that provide different functions

[0103] Various medical imaging devices and systems have been described above. The system has been described as including a base device and one or more connected input modules and output modules operable with the base device. One or more kits may be provided that combine one or more input modules, output modules, and authorization to use the modules and associated software functions in the kit to allow the modules to be used with the base device. In addition to the modules and authorization to enable the modules, the kit may be provided with a base device. The kit may be associated with one or more applications.

[0104] Figure 6Components of another ophthalmic system are shown. System 600 is depicted as including an ophthalmic base device 602 and connected input modules 604 and output modules 606. The combined base device and input / output modules can provide diagnostic and therapeutic functions for diagnosing and treating one or more ophthalmic conditions. The ophthalmic device 602 can be coupled to a local user interface device, depicted as a display 608, which allows a user such as an ophthalmologist or other trained professional to interact with the device. Although depicted as a display, the interface can be provided in various ways, including using a separate computer device, a mobile computing device such as a mobile phone or tablet, or possibly immersive display technology, such as a virtual reality headset. The controller of the base device 602 can include a central processing unit (CPU) 610 or other type of controller such as an FPGA or ASIC, as well as a memory 612, possible non-volatile storage devices 614, and one or more input / output connections for coupling one or more devices such as the display 608 to the processor. The input / output devices can include one or more wireless radios, such as and / or A radio, a wired Ethernet adapter, a graphical display, and various input components including a touch screen, a keyboard, a mouse, a voice interface, a gesture-based interface, etc. The memory 612 may store instructions that, when executed by the processor, configure the base device to provide various functions including, for example, module registration and authentication functions 618, calibration functions 620, ophthalmic functions 622, remote operation functions 624, and patient management functions 626.

[0105] The base device 602 may operate in a standalone environment or may be connected to other devices via one or more communication networks 628. The other devices may include, for example, a computing device 638 that provides remote operation functionality 632 at a remote location. Although depicted as a computer, the remote computing device may include a variety of computing devices, including, for example, a mobile phone or tablet, or possible immersive display technology, such as a virtual reality headset. The base device 602 may communicate with one or more backend servers 634 or computing devices via the network 628, and may provide module registration and authentication functionality 636 as well as data structures for storing module data 638, data structures for storing patient data, and patient management functionality 640.

[0106] The module registration and verification function 618 can provide the function of registering the attached module for use with the base device and possibly with the remote server 634. The registration process can be initiated when the base device detects that a new module is connected and / or when the base device is started or restarted, or optionally at the request of the user. The registration process can include the base device determining the unique identifier of the attached module, for example using an RFID reader, a communication path with the attached module, or other means. The registration process can use the unique identifier to determine information about the module, or can provide module information together with the unique identifier. The module information can be provided by the attached module or can be retrieved by the base device. For example, the base device can transmit the unique ID of the connected module to the remote server 634, which returns the module information stored in association with the unique ID to the base device. The module information can provide information that can be used to determine the compatibility of the module and verify that the device can use the attached module to provide certain functions. For example, the registration process can retrieve module information about the connected input module and output module, and can determine that the input module and output module are compatible with each other, and verify that the input module and output module and the software on the base device can provide certain functions (such as detecting and treating certain diseases). The module information for each module may include information about the module, such as the broad classification of the module, operating parameters of the module, other required modules or components required for proper operation, and other limitations (such as incompatible devices or components), and possible expiration information for the module.

[0107] It may be desirable for an ophthalmic device to use a trusted module manufactured by a known and identifiable manufacturer. A cryptographic process may be used to ensure that the base device, along with any connected input / output modules and software components, is trusted. For example, an input module may be associated with public and private encryption keys that can be used to verify that the module is trusted. Similarly, input modules and output modules may use similar cryptographic processes to verify that the base device to which the module is connected is a trusted base device. If a module is verified to be trusted, its operation may be prevented, or it may be caused to operate in a different mode, which may, for example, only operate base components that do not pose a security risk.

[0108] Once the connected modules have been registered with the base device and possibly a remote server, the calibration function 620 may be used to calibrate the modules. The calibration process provided by the calibration function 620 may depend on the attached modules and the base device, and may depend on the operating mode of the device. The calibration process may configure the optical components of the attached components to operate within the operating parameters for a particular operating mode. For example, if the device is operating in a diagnostic mode, the calibration process may perform a rough alignment of the imaging components, but may not align the therapeutic laser with the imaging components because it is not used in the diagnostic mode. In addition to aligning one or more components, the calibration function may also calibrate other operating parameters of the device, such as frame rate, bit depth, and resolution of captured images for one or more connected imaging devices. Other operating parameters may include optical parameters, such as power level, spectrum, pulse duration, etc.

[0109] Once the device and attached modules are calibrated, the device can be operated in one or more operating modes that are verified to work with the attached components. The operating modes can provide various ophthalmic functions. For example, the ophthalmic function 622 operates the attached modules to provide diagnostic functions in diagnosing one or more eye conditions, such as age-related macular degeneration (AMD), wet AMD, diabetic retinopathy, glaucoma, floaters, vitreomacular traction, and other diseases. This function can allow the automatic identification of disease conditions within the captured image data. The professional can evaluate the identified disease conditions within the image data and may specify a treatment plan that specifies the treatment location and treatment parameters for treating the condition. The treatment plan can be stored in association with the patient data. Alternatively, the device can provide a function for automatically generating a treatment plan for a patient, which can then be verified by the professional.

[0110] The device may be capable of operating in a remote operation mode, which allows a professional to operate the device from a remote location. The remote location may be a physically close location, such as in an adjacent room, or may be a physically distant location, such as in another city or country. The remote operation function 624 on the device 602 cooperates with the remote operation function 632 on the remote computing device 630. The remote operation function can transmit remote commands and provide a remote graphical interface to provide feedback to the user on the remote device. The remote operation functions 624, 632 may include functions for periodically or continuously testing the quality of the communication channel between the device 602 and the remote device 630. The quality of the communication channel can be characterized by upload bandwidth, download bandwidth, round-trip time or "ping" and jitter. Depending on the operating mode of the device, the operation of the device can be suspended or changed. For example, if the device is operating in a treatment mode and the quality of the communication channel drops below a required quality threshold, the treatment can be suspended and the operating mode of the device can be switched to a mode in which the treatment is suspended but imaging for diagnosis and treatment planning can still be performed. Similarly, if the device is operating in an imaging mode and the quality of the communication channel decreases, the remote operation function can change the bandwidth used by the user interface. For example, a reduced bandwidth user interface may send lower quality images to reduce demands on the communication channel.

[0111] In addition to the ophthalmic functions, the device 602 may also provide a patient management function 626 that provides an interface for users who manage patients and their interactions with the device 602. The patient management function may provide an interface for professionals to capture patient details (such as patient name, demographics, etc.). The patient management function may also provide a scheduling function for scheduling patient visits, which may include taking into account the estimated amount of time for the procedure being scheduled. The patient management function may also provide an interface for storing and viewing images from the device, additional information related to the images (such as area maps), and treatment plans and images before and after treatment. Although described as being provided by the base device 602, the patient management function may be provided by other devices such as a remote device 638 or a backend server 634, or a combination of these devices.

[0112] Figure 7 An illustrative database for storing module data is shown. Figure 7The module data depicted in is merely illustrative, and additional information may be stored, and the information may be stored in a structure different from the described structure. Database 702 may be, for example, the module data storage structure 638 described above. Database 702 stores a plurality of different tables, each of which stores a plurality of records. These tables are arranged as identification tables 704, which store information of the various components of the identification system, whether it is a basic device, an input module, an output module, or a software component. Identification table 704 may store records including information about components, such as a unique ID or serial number of the component, the manufacturer of the component, and the model of the component. The table may also store encrypted information associated with the component, such as a public key associated with the component. Depending on the cryptographic technique used, the encrypted information may be stored as one or more one-time encryption keys or other information for cryptographically protecting communications and verifying the identity of the module.

[0113] The database 702 may also store compatibility information in a compatibility table 706. The compatibility table may store compatibility using brand and model as keywords to link the information to the records in the identity table 704. The compatibility information may provide information about the hardware compatibility and software compatibility of the component. The compatibility information may be specified in a variety of ways, but is described as specifying the requirements for the component to work correctly and the limitations of the component. As an example, an output component may be designed to provide focusing optics for a therapeutic laser and may work with a wide range of therapeutic lasers. These requirements may indicate the different lasers that may work with it. Alternatively, the limitations may specify limitations on the parameters of the component. For example, while the illustrative output module may work with a wide range of different lasers, the optics may only work within a specific band of the spectrum and may have a maximum power rating. These limitations may apply to input modules used with the device. Similar compatibility information may be stored for software components.

[0114] The database may also store calibration data or other data associated with various components in a details table 708. Records in the details table may be linked to records in the identity table 704 using a unique identifier or serial number. The details information may include information such as the date of manufacture, as well as calibration information. For optical devices that may be used to treat patients, it is desirable to ensure that the components operate within specified parameters, and therefore the database may store information about when components were calibrated and recalibrated. For example, a treatment laser may be calibrated and certified at the time of manufacture, and after a certain amount of time or after a certain amount of operation, the component may need to be recalibrated and certified. The details information may include additional information, such as purchase information, owner information, warranty information, etc.

[0115] Figure 8A method of using an ophthalmic system is shown. Method 800 can be performed by a base device at various times, such as during startup, before use in treating a new patient, or according to the operator's expectations. Method 800 enables an attached module (802) that can be implemented in various ways. For example, the base device can query the attached modules through an electrical connection or other communication path to retrieve a module identification from each attached module. Enabling the module can also include a process for verifying that the module is certified or approved to operate with the base device. The enabling of the module can be completed on all attached modules, or the attached modules can be identified and presented to the operator to identify which components should be enabled. In the case where the use of the component requires payment based on the number of times it is used, etc., such a process may be beneficial. In addition or alternatively, the module can be enabled or disabled according to the expiration of the module. The module can expire, for example, after a certain length of time or amount of use. Expiration can be used to enable / disable the module. Expired modules can be discarded, recalibrated, recertified, repaired, replaced, etc.

[0116] Once the module is enabled, the operator can select an operating mode based on the enabled model. For example, the operating mode may include modes for evaluation, screening, diagnosis, and treatment. In addition, the operating mode that can be provided may depend on the type of disease or condition being evaluated, screened, diagnosed, or treated. The device can be configured with components that can treat one or more of AMD, VMT, diabetic retinopathy, glaucoma, floaters, retinal tears. The device can also be configured with a suite of different modules and / or components (such as software components) to provide additional functionality such as pupil imaging, virtual ophthalmoscopy, etc.

[0117] Once an operating mode is selected, such as treatment of a particular disease, the compatibility of the enabled components is verified for use together in the particular operating mode. This verification may include verifying that the operating parameters of all components are within the threshold limits of the operating mode and that the required software components are available for the device. If the operating mode is invalid (no at 808), for example, one or more components cannot operate together, the method may notify the operator or return to select a different operating mode (804) or possibly enable other components (802). If the selected operating mode is valid, that is, the enabled modules / components are operable to provide the selected operating mode, then patient data for the current patient may be retrieved (810). The patient data may include, for example, previously captured images of the patient, and possible treatment plans for the patient, which may be specified as a regional map for treatment. The retrieved patient data (such as a previously captured image of the patient's eye) may be compared to the currently captured image of the patient in order to attempt to register the images together (812). The image registration process may be accomplished using, for example, vein segmentation of the image. Registration may ensure that the correct patient information is being used for the current patient. Alternatively, an image of the patient's eye may be captured and used as a biometric identifier to retrieve associated patient information. Regardless, the registration process ensures that the correct patient information is retrieved for the current patient. If the patient is being treated for a disease or condition, the registration may also be completed on a treatment plan. Once image registration is complete, the device's operating mode (814) may be enabled and assessment, screening, diagnosis, and / or treatment performed.

[0118] Image registration can provide a metric for evaluating the quality of registration between two images, which can be captured using the same or different modalities, and captured at the same or different times. Verifying image registration can identify a set of landmarks that can be coordinates within the image being registered. Landmarks can be identified using an ORB (Oriented Fast and Rotated BRIEF) process, a SIFT (Scale Invariant Feature Transform) process, and / or a HOG (Histogram of Oriented Gradients) process. The identified landmarks are associated with feature vectors, where each landmark includes a vector of N features. The landmarks and associated features of the images are compared to match the landmarks across the images. The average distance and / or maximum distance between the closest matching landmarks can be used as a measure of the accuracy of the registration between the two images, where the average distance and / or maximum distance between the closest matching landmarks can be determined as the Euclidean distance between the feature vectors of the landmarks being compared. In addition or alternatively, the number of landmarks that match within a threshold feature distance and the number of unmatched features can be used as a measure of the quality of the registration. If the registration between the images is of sufficient quality, a mapping may be determined that transforms the positions of matching landmarks in one registered image to the positions of corresponding matching landmarks in the other image. The mapping may include one or more linear or non-linear transformations.

[0119] Fig. 9Another method for using an ophthalmic system is shown. Method 900 is similar to method 800 described above. Method 900 begins with a base device collecting configuration information for a module (902). The configuration information may include details about the base device, the connected modules, and the software components on the device. The configuration information is transmitted to a registration server (904), and a verification message for the module is received from the registration server (906). The registration server may be a remote server or may be a local server or computing device. Alternatively, the functionality described as being provided by the registration server may be provided within the system itself, such as by a controller of the base device. The verification message may indicate which modules are verified for operation, such as as a result of having a subscription to use the module, or the module is within an authenticated operating window. Additionally, the verification message may include information about possible operating modes that are verified to work with the component. The possible operating modes may also specify operating parameters of one or more modules / components in order to use a particular operating mode. Once the verification message is received, the possible operating modes of the valid modules may be determined (908). If the verification message includes details about the possible operating modes, the determination may be made by retrieving information from the message. Alternatively, if the validation message does not include possible operating modes, the device may use the modules / components determined to be valid from the validation message to determine which operating modes are possible. An operating mode is selected from the possible operating modes (910) and the module is calibrated for the selected operating mode (912). The calibration may include configuring one or more operating parameters of the module / component and co-aligning one or more of the modules or components as may be required for the operating mode. Once the components are calibrated, the operating mode may be enabled (914). Prior to enabling the operating mode, the device may register a previously captured patient image with a currently captured patient image to ensure that the correct patient data is used for the patient, as described above with reference to Figure 8 as described.

[0120] When the base device transmits the configuration information to the registration server, the configuration information is received (916) and for each module (918) or component in the configuration information, the module data is verified (920) to verify that the module / component can be used. The next module is verified (922) until all modules are processed. Compatibility information for the valid modules / components is retrieved (924) and the compatibility information is used to determine possible operating modes for the modules (926). Once the modules are verified and possible operating modes are determined, a verification message can be constructed and returned to the base device (928). The verification message can indicate which modules / components are verified and can also include possible operating modes that can be used with the valid modules.

[0121] Fig.10A method for calibrating an ophthalmic system is shown. Method 1000 may use a calibration module, such as the one described above with reference to Figure 5B The method 1000 may be used to calibrate one or more modules. The method 1000 determines which module needs calibration (1002). If a module has been reinstalled, if a module needs to be recalibrated or authenticated after a period of time or usage, it may be determined which modules need calibration based on which modules may be used in the operating mode. Once the modules that need calibration are determined, the modules being calibrated (1004) are operated and sensor data from a calibration component is captured (1006), which may be provided in the calibration module or in the device or other modules. The operating parameters of the module being calibrated and possibly other components or modules may be adjusted based on the sensor data (1008). For example, the sensor data may be used to adjust a tunable lens to calibrate the alignment and / or focus of an imaging device or a therapeutic laser. Additional calibration may include, for example, adjusting the power level of the device, adjusting the spectrum, and adjusting other optical devices. If the calibration is complete (no at 1010), the method may return to operating the module (1004) to capture sensor data (1006) and further adjust operating parameters (1008). If calibration is complete (1010), calibration information may be sent to a registration server (1012) for storing details about the calibration, which may be used to ensure that the module is operating within proper operating parameters.

[0122] Those of ordinary skill in the art will understand that Figures 1 to 10 The systems and components shown may include components and / or steps not shown in the drawings. For simplicity and clarity of illustration, the elements in the drawings are not necessarily drawn to scale, are merely schematic, and do not limit the structure of the elements. It will be apparent to those skilled in the art that various variations and modifications may be made without departing from the scope of the invention as defined in the claims.

[0123] Although certain components and steps have been described, it is contemplated that the components and steps described individually may be combined into fewer components or steps, or the steps may be performed sequentially, non-sequentially, or simultaneously. In addition, although described above as occurring in a particular order, it will be understood by those of ordinary skill in the art of the current teachings that the particular order of certain steps relative to other steps may be changed. Similarly, a single component or step may be provided by multiple components or steps. It will be understood by those of ordinary skill in the art, in view of the current teachings, that the components and processes described herein may be provided by various combinations of software, firmware, and / or hardware, in addition to the specific implementations described herein as illustrative examples.

[0124] The techniques of various embodiments may be implemented using software, hardware, and / or a combination of software and hardware. Various embodiments relate to devices, such as nodes that can be used in a communication system or a data storage system. Various embodiments also relate to non-transitory machines, such as computer-readable media, such as ROM, RAM, CD, hard disk, etc., which include machine-readable instructions for controlling a machine (e.g., a processor) to implement one, more, or all steps of one or more methods described.

[0125] Some embodiments relate to a computer program product including a computer-readable medium, the computer-readable medium including a code for causing one or more computers to implement various functions, steps, actions and / or operations (e.g., one or more or all of the above steps). According to an embodiment, the computer program product may and sometimes does include different codes for each step to be performed. Therefore, the computer program product may and sometimes does include a code for each individual step of a method, such as a method of operating a communication device (e.g., a wireless terminal or node). The code may be in the form of a machine, such as a computer executable instruction stored on a computer-readable medium, such as a RAM (random access memory), a ROM (read-only memory) or other type of storage device. In addition to relating to a computer program product, some embodiments also relate to a processor configured to implement one or more of the various functions, steps, actions and / or operations of one or more of the above methods. Therefore, some embodiments relate to a processor, such as a CPU, configured to implement some or all of the steps of the method described herein. The processor may be used in, for example, a communication device or other devices described in this application.

[0126] In view of the above description, many additional variations of the methods and apparatus of the various embodiments described above will be apparent to those skilled in the art. Such variations are considered to be within the scope of the teachings of the present disclosure.

Claims

1. An ophthalmic device, include: a first optical device comprising a first light source and a first imaging sensor capable of generating image data using the first light source; A first input coupler comprising: A physical interface connection for aligning and securing the input optical module; and Optical interface connectors; a first optical output; an optical path coupling the first optical device and an optical interface connection of the first input coupler to the first optical output; and An output coupler that provides a physical interface connection for aligning and securing the third optical device.

2. The ophthalmic device of claim 1 , further comprising a controller for controlling the operation of the device and providing one or more of the following: a calibration function for registering connected input modules and output modules for use with the device; Image registration capabilities; and Retina tracking function.

3. The ophthalmic device according to claim 2, in, The first input coupler also includes an electrical interface connection.

4. The ophthalmic device according to claim 3, in, The electrical interface connection provides a communication channel to a controller of the device.

5. The ophthalmic device according to claim 1, further comprising: include: a first tunable lens for a first optical device in the optical path; as well as A second tunable lens is used for the first input coupler in the optical path.

6. The ophthalmic device according to claim 5, in, The first tunable lens and the second tunable lens are controlled by the controller to co-align light from the first optical device with the optical interfacing connection of the first input coupler.

7. The ophthalmic device of claim 1 , further comprising a second input coupler, the second input coupler include: a physical interface connection for aligning and securing the fourth optical device; as well as Optical interface connectors.

8. The ophthalmic device according to claim 7, in, The second input coupler also includes an electrical connector.

9. The ophthalmic device according to claim 1, in, The output coupler also includes an electrical interface connection.

10. The ophthalmic device according to claim 1, in, The optical path includes one or more of the following: Optical splitters / combiners; Optical circulator; Optical filter; Galvanometer; Tunable lenses; lens; and Grating.

11. An ophthalmic system, include: A basic ophthalmic device according to any one of claims 1 to 10; as well as An input optical module is secured to the first input coupler.

12. The ophthalmic system according to claim 11, in, The input optical module includes at least one of the following: an imaging device comprising a light source and a sensor optically coupled to the optical interface connection of the first input coupler; and Therapeutic lasers.

13. The ophthalmic system according to claim 12, in, The input optical module further includes one or more of the following: Optical devices; Guide lasers; Graphics processing unit; and Additional input coupler.

14. The ophthalmic system according to claim 13, in, The input optical module provides one or more of the following: 2D imaging system; Scanning Laser Ophthalmoscope (SLO) imaging system; Optical coherence tomography (OCT) imaging systems; and Therapeutic laser treatment systems.

15. The ophthalmic system of claim 11, further comprising an additional input optical module secured to the base ophthalmic device.

16. The ophthalmic system of claim 11, further comprising an output optics module secured to the base ophthalmic device.

17. The ophthalmic system according to claim 12, in, The output optical module includes one or more of the following: Optical devices; Graphics processing unit; Additional input coupler; additional output coupler; and sensor.

18. A kit for an ophthalmic device, include: The first optical module comprises: one or more optical components for providing ophthalmic functionality to the ophthalmic device; a physical interface connection for mechanically securing the first optical module to the ophthalmic device; an optical interface connection for optically coupling at least a portion of the one or more optical components to the ophthalmic device; and a module identifier for uniquely identifying the first optical module; and The ophthalmic device is authorized to use one or more software components to provide ophthalmic functionality using the first optical module identified by the module identifier.

19. The kit according to claim 18, in, The first optical module includes one of an input module and an output module.

20. The kit according to claim 18, in, The first optical module includes an input module, and the kit further includes an output module.

21. The kit according to claim 20, in, The kit includes at least one input module and an output module adapted to perform one or more of the following: Central photocoagulation; Peripheral photocoagulation; Femtosecond laser vitreous treatment; YAG laser vitreous therapy; and Femtosecond laser glaucoma treatment.

22. The kit according to claim 21, in, The software component includes functionality for performing automated treatment planning using machine learning.

23. A method of operating an ophthalmic device, the ophthalmic device comprising an internal imaging system and one or more input modules connected to the ophthalmic device, the method include: identifying one or more input modules connected to the device; for each connected input module, determining whether the connected input module includes optical components that require alignment with the internal imaging system or other identified input modules; as well as For each input module that needs to be aligned, the tunable lens of the device is controlled within an optical path optically coupled to the corresponding input module that needs to be aligned, so as to align the corresponding input module.

24. The method according to claim 23, in, The alignment of the input modules aligns the optical path of each of the input modules with the optical path of the internal imaging system.

25. The method according to claim 24, in, Alignment of the input module aligns the depth of focus to a common depth of focus of the other components.

26. The method according to claim 24, in, The alignment of the input module aligns the depth of focus to a different depth of focus than the other components.

27. The method according to claim 23, in, The alignment uses image registration techniques to determine the required adjustments.

28. The method of claim 27, further comprising using the image registration technique to co-register images captured by the ophthalmic device.

29. The method according to claim 23, in, One or more output modules are connected to the ophthalmic device, the method further comprising: identifying one or more output modules connected to the device; for each connected output module, determining whether the connected output module includes optical components that require alignment with the internal imaging system or other identified input modules and output modules; and For each output module that needs to be aligned, the tunable lens of the device is controlled to be within an optical path optically coupled to the corresponding output module that needs to be aligned, so as to align the corresponding output module.

30. The method according to claim 29, further comprising: include: Determine requirements and / or limitations for connected input and output modules; determining one or more possible modes of operation based on at least one of requirements and limitations of the connected input modules and output modules; as well as At least one of the possible operating modes is enabled.

Images