Bio-ocular Measurement Using Deep Learning

Abstract

In one possible embodiment, a method for estimating biometric landmark dimension measurements of a human eye includes receiving one or more images of the human eye via a host computer. In response to receiving the one or more images, the method includes using a deep learning algorithm to generate a preliminary set of landmark point locations in the one or more images via the host computer, and then using a post-hoc processing routine on the host computer to refine the preliminary set of landmark point locations, thereby generating a final set of estimated landmark point locations. Additionally, biometric landmark dimension measurements are automatically generated via the host computer using the final set of estimated landmark point locations. A dataset including the set of estimated landmark point locations is then output. The host computer executes instructions from memory to perform the method.

Description

[Technical Field]

[0001] The present disclosure relates to an autonomous, artificial intelligence-based method and associated system for deriving accurate patient biometric measurements, particularly measurements related to the anatomy of the human eye. Biometrics is the process of applying disciplined statistical analysis to a collected set of biometric measurements. In the context of ophthalmology, biological data includes detailed anatomical measurements of the internal structures of a patient's eye. Patient biometry is therefore an important pre- and post-operative component accompanying each pre- and post-operative phase of refractive surgery, intraocular lens selection and insertion, retinal surgery, and other surgical or diagnostic procedures. [Background technology]

[0002] Historically, diagnosis of human ocular conditions has relied on noninvasive imaging techniques, with ultrasound biomicroscopy (UBM) and optical coherence tomography (OCT) becoming prevalent in modern medicine. Regarding UBM, this imaging technique is commonly used to image the anterior segment of the eye using ultrasound energy in a higher frequency range relative to conventional ultrasound scanning frequencies (e.g., 50–100 MHz). In contrast, OCT is an interferometric method that directs low-coherence, elongated light waves into the eye to image fundus structures such as the macula and optic nerve. During UBM, OCT, or other image collection of a patient's eye, practitioners historically mark relevant landmark features in the image and measure the distance between them. The pixel-to-pixel distance in the image can be converted to a meaningful scale, such as millimeters. The annotated images are then relied upon to evaluate the patient's ocular anatomy, as well as before and after performing eye surgery. Summary of the Invention [Means for solving the problem]

[0003] Disclosed herein are non-invasive, rapid assessment methods and associated systems for detecting landmark features in images of a human eye and subsequently estimating landmark dimensions between such landmark features. The present teachings rely on deep learning artificial intelligence (AI) techniques, such as, but not necessarily limited to, the exemplary convolutional neural network (CNN) described herein. The present approach operates in an autonomous manner using one or more input images and the AI-based image processing techniques described herein to generate a dataset of intraocular dimensions in a manner that is highly reliable, reproducible, and accurate relative to traditional methods of performing patient biometric measurements.

[0004] As is understood in the art, preoperative surgical planning and postoperative treatment planning require accurate knowledge of certain landmark dimensions. Ophthalmic surgery in general may require measurements of anterior chamber depth, lens thickness, lens diameter, or other important intraocular dimensions. Traditional approaches to measuring landmark dimensions include the use of manual box thresholds and hard-coding of dimensional data for a given image of a patient's eye. Such approaches tend to be highly dependent on the surgeon's unique skill set and may be suboptimal in terms of accuracy, speed, and reproducibility.

[0005] Unlike existing technologies, the AI-generated results of the present disclosure are then refined in real time using classical image processing techniques to reduce noise in the final dimension estimate, particularly in the axial region of the eye. The distances between refined landmark locations may be scaled by image size, ultimately providing an accurate estimate of the measurement of interest without the need for human intervention. A user can optionally interface with the host computer in some embodiments to tune the deep learning / AI-based predictions to customize the predicted results to the user's preferences or professional judgment.

[0006] In an exemplary embodiment disclosed herein, a method for estimating biometric landmark dimensional measurements of a human eye includes receiving one or more images of the human eye via a host computer. In response to receiving the one or more images, the method may include generating a preliminary set of landmark point locations within the one or more images via the host computer using a deep learning algorithm. The method also includes refining the preliminary set of landmark point locations using a post-hoc processing routine on the host computer, thereby generating a final set of estimated landmark point locations. As part of this exemplary embodiment, the method may include automatically generating biometric landmark dimensional measurements via the host computer using the final set of estimated landmark point locations, and then outputting a dataset including the set of estimated landmark point locations.

[0007] The method can include receiving one or more images of the human eye from an imaging device in communication with a host computer. In non-limiting implementations, the imaging device can be, but is not limited to, an ultrasound biomicroscopy (UBM) device or an optical coherence tomography (OCT) device.

[0008] The deep learning algorithm in an exemplary configuration may be a convolutional neural network (CNN). In such an embodiment, generating the preliminary set of landmark point locations may include processing one or more images through the CNN. Refining the preliminary set of landmark point locations using a post-hoc processing routine may include refining image pixel intensity, contrast, and / or sharpness levels to emphasize at least one landmark point location in the preliminary set of landmark point locations.

[0009] In some aspects of the present disclosure, automatically generating biometric landmark dimension measurements via the host computer using the final set of estimated landmark point locations may include automatically measuring respective linear distances between different estimated landmark point locations in the final set of estimated landmark point locations, where the linear distances may correspond to one or more of anterior chamber depth, lens diameter, and lens thickness of the person's eye, among other possible intraocular dimensions.

[0010] Outputting the dataset including the set of estimated landmark point locations may include displaying and / or printing an annotated image of the human eye including the linear distances, and / or displaying and / or printing a data table including the linear distances.

[0011] Also disclosed herein is a host computer configured to estimate ocular biometric landmark dimension measurements. The host computer includes a memory having instructions for a deep learning algorithm recorded or stored thereon, input / output (I / O) circuitry for communicating with an imaging device, and a processor. The imaging device may, in some embodiments, be an integral part of the host computer. Execution of the instructions by the processor causes the host computer to receive one or more images of a human eye and, in response to receiving the one or more images, generate a preliminary set of landmark point locations within the one or more images using a deep learning algorithm. Execution also causes the processor to refine the preliminary set of landmark point locations using a post-hoc processing module, thereby generating a final set of estimated landmark point locations, automatically generate biometric landmark dimension measurements using the final set of estimated landmark point locations, and output a dataset including the set of estimated landmark point locations.

[0012] The above-mentioned features and advantages of the present disclosure, as well as other possible features and advantages, will become readily apparent from the following detailed description of the best mode for carrying out the disclosure, when read in conjunction with the accompanying drawings. [Brief explanation of the drawings]

[0013] [Figure 1] FIG. 1 is a schematic diagram of an autonomous system for deriving measurements from a set of images using the methods described herein. [Figure 2] FIG. 2 is a flowchart of the method according to an example embodiment. [Figure 3] FIG. 3 is a representative image of a human eye showing various landmark features or points of interest. [Figure 4] FIG. 4 is a representative image of FIG. 3 after processing by an exemplary convolutional neural network according to the present disclosure. [Figure 5] Figure 5 is a representative image of Figures 3 and 4 showing the adjusted landmark positions after post-hoc processing. [Figure 6] FIG. 6 is a representative image of FIG. 5 after automatic dimensional annotation according to the present disclosure. DETAILED DESCRIPTION OF THE INVENTION

[0014] The foregoing and other features of the present disclosure will become more fully apparent from the following description and appended claims, taken in conjunction with the accompanying drawings. The present disclosure will be described with additional specificity and detail through the use of the accompanying drawings, with the understanding that these drawings illustrate only some embodiments according to the present disclosure and should not be considered as limiting its scope. Any dimensions disclosed in the drawings or elsewhere in this specification are for illustrative purposes only.

[0015] Elements of the present disclosure are described herein. However, it will be understood that the disclosed embodiments are merely exemplary, and that other embodiments may take various alternative forms. The drawings are not necessarily to scale, and some features may be exaggerated or minimized to show details of specific components. Therefore, specific structural and functional details disclosed herein should not be construed as limiting, but merely as a representative basis for teaching those skilled in the art how to employ the present disclosure in various ways.

[0016] In the following description, certain terms may be used for reference purposes only and, therefore, are not intended to be limiting. For example, terms such as "upper" and "lower" refer to directions within the referenced drawings. Terms such as "front," "rear," "forward," "rearward," "left," "right," "rear," and "side" describe the orientation and / or location of a component or portion of an element within a consistent but arbitrary frame of reference that becomes clear by reference to the text and associated drawings that describe the component or element being discussed. Furthermore, terms such as "first," "second," and "third" may be used to describe separate components. Such terms may include those specifically mentioned above, derivatives thereof, and words of similar import.

[0017] FIG. 1 schematically illustrates a system 20 for estimating a predetermined dimension within a human patient's eye 22. The system 20 includes an imaging device 30 in wired or remote communication with a host computer (host) 50, the latter configured to execute a deep learning / artificial intelligence (AI)-based method 40 in cooperation with input data (arrows AA) from the imaging device 30. While the host computer 50 and the imaging device 30 are shown separately in FIG. 1 for illustrative clarity, those skilled in the art will understand that in certain embodiments, the imaging device 30 may be integrated with the host computer 50 such that the imaging device 30 forms an integral component or operating element of the host computer 50. An exemplary embodiment of the method 40 is shown in FIG. 2 and described below with reference to FIGS. 3-6, which illustrate representative embodiments of various inputs, intermediate data, and outputs to and from the host computer 50.

[0018] In connection with an exemplary ophthalmic or optical use as contemplated herein, imaging device 30 of Figure 1 is configured to collect energy in a predetermined band of the electromagnetic spectrum toward / within eye 22, as indicated by arrow BB. Imaging device 30 operates in this manner for the purpose of collecting one or more digital images 24 of the internal anatomical structures of eye 22. However, other anatomical structures may be imaged within the scope of the present disclosure.

[0019] As understood in the art, the eye 22 works in conjunction with the brain to enable vision. Accordingly, the eye 22 is uniquely configured among bodily organs to receive and process light stimuli, thereby generating electrochemical nerve impulses that are ultimately converted by the brain into images and / or colors. For the eye 22 to perform its intended biological function, the cornea, lens, ciliary muscle, zonules, vitreous humor, macula, optic nerve, retina, ventricles, and other critical ocular anatomical structures must function effectively. However, due to factors such as injury, age, disease, and genetics, patients may require surgical intervention to preserve or enhance their vision. In such cases, as with routine examinations, practitioners may choose to utilize an imaging device 30 to provide a view of the internal anatomical details of the eye 22.

[0020] To this end, the imaging device 30 shown in FIG. 1 may be variously embodied as an ultrasound biomicroscopy (UBM) device, an optical coherence tomography (OCT) device, or any other medically relevant embodiment of the imaging device 30. Unlike traditional color images, the medical images provided by the imaging device 30 are not clear and distinct depictions of the eye 22, but rather pixelated grayscale images that require unique collection and analysis expertise. An exemplary UBM image 24-1 is shown in FIG. 3 with annotations as described below. To quickly and accurately detect features or landmarks of interest in the image 34 of FIG. 1 , therefore, the host computer 50 is software-programmed and hardware-equipped, i.e., configured, to execute a deep learning / AI-based method 40 in response to receiving input data AA including the collected image 24.

[0021] The term "deep learning," as used herein and in general technology, refers to a machine learning technique in which one or more computers, in this case the host computer 50, learn features and / or tasks directly from provided training data. Such data may be in the form of image, text, and / or audio data. Machine learning implementations may employ neural networks, a typical embodiment of which includes an input layer, several intermediate hidden layers, and an output layer. In deep learning techniques employing neural networks, the neural networks may be multi-layered, with their constituent neurons arranged in tens or even hundreds of different hidden layers, hierarchical models, and high-level filters.

[0022] Deep learning, particularly in the realm of image processing, can incorporate convolutional neural networks (CNNs), and the host computer 50 of FIG. 1 includes such a CNN 25 in one possible embodiment, as shown. The CNN 25 is configured to receive and process pixel data from a set of training images via various artificial neurons, automatically classifying the input images and the constituent pixel data into specific categories. Thus, the goal of CNNs such as this one, and potentially other deep learning techniques usable within the scope of this disclosure, is to output an approximation of an unknown function via interconnected neurons. Each neuron is selectively activated based on a corresponding activation threshold to pass data to other interconnected neurons. Thus, the learning process involves applying respective adjustable weights within each neuron that are continuously updated based on the CNN 25's exposure to additional images 24, possibly periodically updated using previous classification errors. Finally, a nonlinear transformation is applied to the linear combination of the various neural outputs using an activation function to generate a predicted output file 26, e.g., a recognized landmark feature for a given input image 24 or set thereof, as indicated by arrow CC in FIG. 1.

[0023] 1, while shown as a schematic diagram of a single device for illustrative simplicity, the host computer 50 may include any number of networked or interconnected computing devices, each having sufficient computer-readable medium or memory (M) and one or more processors (P). The memory (M) may be in the form of a non-transitory (e.g., tangible) medium that participates in providing data / instructions, which may then be read by the processor (P). The memory (M) may take many forms, including, but not limited to, non-volatile and volatile media.

[0024] Although omitted for simplicity of illustration, the host computer 50 may include a high-speed clock, input / output (I / O) circuitry 21 for communicating with the imaging device 30, and possibly other hardware components, which may be contained within a tower or other computer housing 50C along with memory (M) and a processor (P). In addition, the host computer 50 accesses or itself hosts the CNN 25 described above and a post-hoc processing module 30, the operation of which is described below with reference to FIG. 2. To facilitate user interaction with the images 24 when performing the method 40, the host computer 50 may also include various peripheral devices, such as, but not limited to, a display screen 28, a keyboard 29, and a mouse 32. Upon completion of the method 40, the host computer 50 may generate an output file 26 containing estimated landmark measurements; an exemplary output file 26 is shown in FIG. 6 and described below.

[0025] In some embodiments, the methods 40 and underlying functionality of the CNN 25 and post-hoc processing module 30 can be accessed via an application (“app”) tile 52 to invoke computer-executable code or instructions. Such code can be written in, for example, JAVA, Markdown, R, or other suitable coding languages. For example, a user can open the application via the app tile 52 and then point to a folder containing AVI-formatted or other suitable images or videos to be processed. The AVI file can be parsed by the host computer 50 into individual, discrete images to which deep learning is then applied. The user can then interact with the prediction results, such as by selecting new landmarks on automatically selected frames or by selecting different frames of the video to analyze. The user can also zoom and / or brighten the image to more accurately identify landmark features.

[0026] Referring to FIG. 2, method 40 applies deep learning functions to image 24 to ultimately predict a set of measurements for eye 22 shown in FIG. 1. Thus, method 40 may be used to estimate certain important biometric landmark dimensional measurements for human eye 11 of FIG. 1. In exemplary embodiments such as those described above, deep learning is provided via a deep learning algorithm, e.g., CNN 25. In such embodiments, method 40 begins at preliminary block B42 by training CNN 25 to correctly identify predetermined landmark locations within image 24. Training may include, beginning at block B42, defining the convolutional structure of CNN 25. With respect to defining the structure, block B42 may include defining the number of hidden layers and their constituent neurons, including assigned weights and filters, thresholds, etc., as would be understood by one skilled in the art.

[0027] Additionally, as part of block B42, method 40 may include compiling a set of training images in which landmarks of interest are pre-marked. Representative landmarks are shown, by way of example, at points 1-15 in FIG. 2 . Parameters of the CNN 25 are learned from the training images using, for example, a backpropagation optimization algorithm or other suitable techniques. Depending on the number of images available for training, either a single or multiple CNNs 25 may be used in different implementations. That is, if only a small number of training images are available for training purposes in block B42, multiple CNNs 25 will be trained to reduce uncertainty in the predictions. Conversely, if thousands of training images are available for training, a single CNN 25 will be sufficient to accurately predict landmark locations in newly collected images 24.

[0028] As will be appreciated, and as summarized separately above, a given CNN 25 includes a convolutional layer that receives a set of inputs, in this example, training images at block B42. Each artificial neuron in the CNN 25 can be represented as a set of input values, each with an associated weight, along with a function that sums the weights and maps the result to a predicted output. Artificial neurons in the form of filters or kernels are then used to perform an element-wise multiplication function by moving across the input image and multiplying the values ​​in the filter with the image pixel values. In this manner, a feature map is generated.

[0029] Thus, the convolutional layers of the CNN 25 used as part of method 40 can utilize filters in the form of matrices to detect the presence or absence of particular features or patterns in the training images of block B42, the same processing occurring later in the execution of method 40. Multiple hidden layers, e.g., more convolutional layers or more pooling layers, can receive the feature maps and then process them through additional filters. The predicted results are then passed as predictions through the output layer, which in this method 40 include one, some, or all of the display landmarks 1-15 shown in representative image 24-1 of FIG. 3 . In this manner, the CNN 25 can extract high-level landmark features, such as corners, edges, and curvature, from a set of input images.

[0030] In effect, block B42 allows the CNN 25 to be trained by comparing its classification of a given set of training images to a predetermined correct baseline classification, i.e., verified reference images. Errors from initial and subsequent classification iterations can be fed back to the CNN 25 and used to modify various neural weights and filters, as many times as necessary to properly train the CNN 25. Once the CNN 25 is trained, method 40 then proceeds to block B44.

[0031] Block B44 entails receiving one or more images 34 of the eye 22 via the host computer 50, effectively inputting the collected images 24 of FIG. 1 into the host computer 50 and the CNN 25 or other deep learning algorithm suitable for that application. Some embodiments of block B44 may include collecting one or more images 24 when using the imaging device 30 and then digitally transmitting the collected images 24 to the host computer 50.

[0032] Referring briefly to Figure 3, a baseline image 24-1 of the eye 22 of Figure 1 is shown, for illustrative purposes only, overlaid with a UBM image with representative landmark points nominally labeled 1 through 15. Visible at the top of Figure 3 is a corneal echo 42 with a recognizable pattern that helps locate and identify the remaining imaged structures of the eye 22. Key landmark interest points may be recognized in image 24-1 by an ophthalmologist or person skilled in the art as follows:

[0033] [Table 1]

[0034] As part of block B44, in response to receiving one or more images 24, host computer 50 can use a deep learning algorithm, in this example, CNN 25, to generate a preliminary set of landmark point locations within image 24. CNN 25 can estimate the distribution and locations of landmark points 1-15 described above by processing multiple images 24 similar to image 24-1 through the trained CNN 25 as part of block B44. FIG. 4 shows a representative initial deep learning result as image 24-2, with the estimated locations provided by CNN 25 shown as clusters of open circles in regions 44A and 44B, and the average value for a given landmark point shown as a closed circle in the center of such region.

[0035] Thus, FIG. 4 is a representative example of the results of CNN 25 processing multiple different images 24 of eye 22, for example, by separating a video stream captured over a predetermined sampling interval into multiple temporally related discrete images 24. Processing each image 24 can provide slightly different predicted landmark points, resulting in clusters of regions 44A and 44B, as shown. Also shown in FIG. 4 via triangles for reference are the true locations of each of landmark points 1-15 shown in FIG. 3. Thus, block B44 may include calculating the mode or mean of each set of landmark position estimates to provide a single estimated landmark point location. Method 40 then proceeds to block B46.

[0036] Block B46 involves refining the preliminary set of landmark point locations using post-hoc processing module 30, then performing a predetermined post-hoc processing routine to generate a final set of estimated landmark point locations. Exemplary techniques for post-hoc processing include refining image pixel intensity, contrast, sharpness, and the like to provide detail for one or more specific landmark interest points. For example, FIG. 5 shows an exemplary result image 24-2 of a final set of estimated landmark point locations made possible using such post-hoc processing after filtering out noise and further refining the results in a specific central region between brackets DD and EE, encompassing landmark points 5, 6, and 7 of FIG. 3, which are particularly important in deriving anterior chamber depth and lens thickness. Thus, the predicted landmark positions or locations from CNN 25 can be post-hoc adjusted in block B46 to incorporate additional image information into the predictions. Because post-hoc processing occurs on a flat, two-dimensional image, corresponding X and Y coordinates are available for each landmark interest point. Method 40 then proceeds to block B48 of FIG. 2.

[0037] At block B48, method 40 of FIG. 2 concludes by automatically generating biometric landmark dimension measurements using the final set of estimated landmark point locations, with the determination of such measurements or dimensions being performed by host computer 50 of FIG. 1, with the identification of such measurements optionally being pre-programmed into the memory (M) of host computer 50. For example, host computer 50 may automatically calculate the straight-line distance between any of representative landmark points 1-15 of FIG. 3, whose positions or locations were predicted by operation of CNN 25 and then refined by post-hoc processing module 30. A given landmark dimension may be determined by scaling the distance between any two landmarks so located by the pixel resolution of image 24 of the subject.

[0038] 1 can generate an output file 26 containing the estimated landmark measurements, and thus block B48 encompasses outputting a data set containing the set of estimated landmark point locations, for example, by displaying a data table on the display screen 28 and / or by printing a data table containing the linear distances. A user can adjust any of the landmark locations, in which case user-specified measurements may appear in separate columns in such a table. An exemplary embodiment of optional image content for such an output file 26 is represented as annotated image 24-4 in FIG. 6, with various landmark dimensions depicted and labeled as follows: ACD=Anterior chamber depth STS=distance between grooves CPD = ciliary process diameter LD=Lens diameter LT = lens thickness Such representative dimensions are commonly used for intraocular lens power calculations, refractive surgery customization, and retinal disease diagnosis and surgery, among other procedures.

[0039] The present solution, enabled by method 40 and the disclosed CNN 25, therefore allows for rapid initial identification of landmark points within the eye 22 shown in Figure 1. The initial estimated landmark locations are then refined via a post-hoc processing module 30 using classical image processing techniques. The distances between the refined landmark locations form an estimate of the true measurement, and in some cases, a mode of multiple landmark location estimates can be used as the final measurement.

[0040] By using the lens as an example of an anatomical structure to be identified in raw image 24, the CNN 25 described above is not instructed as to where the lens is located in image 24, or indeed whether the lens even appears in image 24. Instead, CNN 25 is taught the properties of the lens, and then, during subsequent operations, CNN 25 is tasked with locating similar "lens-like" features in image 24. Thus, method 40 replaces the human-specified region of interest in a given image of eye 22 of FIG. 1 in deriving accurate biometric measurements.

[0041] The solution of the present invention may be fully automated, or in other embodiments, may maintain a limited role for the surgeon or practitioner, for example, during post-hoc processing. In either case, implementation of method 40 significantly improves the accuracy, reproducibility, and reliability of ocular measurements over existing methods. Furthermore, post-hoc refinement of the estimates reduces noise in the final estimate, particularly in the axial region of the eye 22. A useful measure is the overall improved prediction accuracy provided through a larger number of images 24, with predictions being made regardless of the number of images 24 provided to the CNN 25.

[0042] While the detailed description and drawings or figures support and explain the present disclosure, the scope of the disclosure is defined solely by the claims. Although some of the best modes and alternative embodiments for carrying out the claimed disclosure have been described in detail, there are numerous alternative designs and embodiments for carrying out the disclosure defined in the appended claims.

[0043] Furthermore, the features of the various embodiments shown in the drawings or described herein should not necessarily be understood as independent embodiments. Rather, each of the characteristics described in one of the example embodiments can be combined with one or more other desirable characteristics from other embodiments, resulting in other embodiments not described in words or by reference to drawings. Accordingly, such other embodiments are encompassed within the scope of the appended claims. According to aspect (1), there is provided a method for estimating ocular biomarker dimension measurements, comprising: receiving one or more images of the eye via a host computer; In response to receiving the one or more images, generating, via the host computer, a preliminary set of landmark point locations within the one or more images using a deep learning algorithm; refining the preliminary set of landmark point locations using post-hoc processing routines on the host computer, thereby generating a final set of estimated landmark point locations; automatically generating the biometric landmark dimension measurements via the host computer using the final set of estimated landmark point locations; outputting a dataset including said set of estimated landmark point locations; The method includes: According to aspect (2), receiving one or more images of the eye via the host computer includes receiving the one or more images of the eye from an imaging device in communication with the host computer. According to aspect (3), the imaging device includes an ultrasound biomicroscope (UBM) device. According to aspect (4), the imaging device includes an optical coherence tomography (OCT) device. According to aspect (5), the deep learning algorithm is a convolutional neural network (CNN), and generating the preliminary set of landmark point locations includes processing the one or more images through the CNN. According to aspect (6), the method further includes training the CNN using another set of training images of one or both eyes before receiving the one or more images of the eye via the host computer. According to aspect (7), refining the preliminary set of landmark point locations using the post-hoc processing routine includes refining image pixel intensity, contrast, and / or sharpness levels to enhance at least one landmark point location within the preliminary set of landmark point locations. According to aspect (8), automatically generating the biometric landmark dimension measurements via the host computer using the final set of estimated landmark point locations includes automatically measuring each straight-line distance between different estimated landmark point locations in the final set of estimated landmark point locations. According to aspect (9), the respective linear distances include one or more of the anterior chamber depth, the lens diameter, and the lens thickness of the eye. According to aspect (10), outputting the dataset including the set of estimated landmark point locations includes displaying and / or printing an annotated image of the eye including the linear distances. According to aspect (11), outputting the dataset including the set of estimated landmark point locations includes displaying and / or printing a data table including the straight-line distances. According to aspect (12), the method further includes collecting the one or more images of the eye as collected images using an imaging device and then digitally transmitting the collected images to the host computer. According to aspect (13), there is provided a host computer configured to estimate ocular biomarker dimension measurements, the host computer comprising: a memory in which instructions for a deep learning algorithm are recorded or stored; an input / output (I / O) circuit for communicating with the imaging device; a processor, wherein execution of the instructions by the processor causes the host computer to: receiving one or more images of the eye; In response to receiving the one or more images, generating a preliminary set of landmark point locations within the one or more images using the deep learning algorithm; refining the preliminary set of landmark point locations using a post-hoc processing module of the host computer, thereby generating a final set of estimated landmark point locations; automatically generating said biometric landmark dimension measurements using said final set of estimated landmark point locations; a processor for outputting a dataset including said set of estimated landmark point locations; The host computer includes: According to aspect (14), the one or more images include an ultrasound biomicroscopy (UBM) image and / or an optical coherence tomography (OCT) image. According to aspect (15), the deep learning algorithm is a convolutional neural network (CNN) that has been previously trained using a set of training images. According to aspect (16), execution of the instructions by the processor causes the host computer to refine the preliminary set of landmark point locations by refining one or more of image pixel intensity, contrast, and / or sharpness level to enhance at least one landmark point location in the preliminary set of landmark point locations. According to aspect (17), execution of the instructions by the processor causes the host computer to automatically generate the biometric landmark dimension measurements by automatically measuring each straight-line distance between different estimated landmark point locations in the final set of estimated landmark point locations. According to aspect (18), the imaging device is further provided. According to aspect (19), execution of the instructions by the processor causes the host computer to output the dataset including the set of estimated landmark point locations by displaying and / or printing an annotated image of the eye and a data table including linear distances, the linear distances corresponding to one or more of anterior chamber depth, lens diameter, and lens thickness of the eye. According to aspect (20), there is provided a method for estimating biometric landmark dimension measurements of a human eye, the method comprising: receiving one or more ultrasound images of the person's eye via a host computer; In response to receiving the one or more ultrasound images, generating a preliminary set of landmark point locations within the one or more images via the host computer using a convolutional neural network (CNN); using a post-hoc processing routine on the host computer to refine the image pixel intensity, contrast, and / or sharpness levels of the preliminary set of landmark point locations to enhance at least one landmark point location, thereby generating a final set of estimated landmark point locations; automatically measuring respective linear distances between different estimated landmark point locations in the final set of estimated landmark point locations, thereby generating biometric landmark dimension measurements including anterior chamber depth, lens diameter, and / or lens thickness of the person's eye; outputting the annotated image and a data table containing the linear distances; The method includes:

Claims

1. 1. A method for estimating ocular biomarker dimension measurements, comprising: receiving one or more images of the eye via a host computer; In response to receiving the one or more images, generating via the host computer a preliminary set of landmark locations within the one or more images using a deep learning algorithm, the preliminary set of landmark locations within the one or more images including estimated locations of landmark features in the one or more images of the eye; refining the preliminary set of landmark locations using a post-hoc processing routine on the host computer, the post-hoc processing routine including refining one or more of image pixel intensity, contrast, and sharpness level to enhance at least one of the landmark locations in the preliminary set of landmark locations, and generating a final set of estimated landmark locations by refining the preliminary set of landmark locations using the post-hoc processing routine; automatically generating the biometric landmark dimension measurements via the host computer using the final set of estimated landmark locations, the biometric landmark dimension measurements including automatically measuring respective linear distances between different estimated landmark locations in the final set of estimated landmark locations, the respective linear distances including one or more of anterior chamber depth, lens diameter, and lens thickness of the eye; outputting a dataset comprising the final set of estimated landmark locations and the straight-line distances between the estimated landmark locations; A method comprising:

2. 10. The method of claim 1, wherein receiving the one or more images of the eye via the host computer comprises receiving the one or more images of the eye from an imaging device in communication with the host computer.

3. The method of claim 2 , wherein the imaging device comprises an ultrasound biomicroscopy (UBM) device.

4. The method of claim 2 , wherein the imaging device comprises an optical coherence tomography (OCT) device.

5. 2. The method of claim 1 , wherein the deep learning algorithm is a convolutional neural network (CNN) and generating the preliminary set of landmark locations comprises processing the one or more images through the CNN.

6. 6. The method of claim 5, further comprising training the CNN with a separate set of monocular or binocular training images prior to receiving the one or more images of the eye via the host computer.

7. The method of claim 1, wherein outputting the dataset including the final set of estimated landmark positions includes displaying and / or printing an annotated image of the eye including the straight-line distances.

8. The method of claim 1, wherein outputting the dataset including the final set of estimated landmark positions includes displaying and / or printing a data table including the straight-line distances.

9. 10. The method of claim 1, further comprising collecting the one or more images of the eye as collected images using an imaging device and then digitally transmitting the collected images to the host computer.

10. A host computer configured to estimate the biolandmark dimension measurements of the eye using the method of claim 1, comprising: a memory in which instructions for a deep learning algorithm are recorded or stored; Input / output (I / O) circuitry in communication with the imaging device; a processor, wherein execution of the instructions by the processor causes the host computer to: receiving the one or more images of the eye; responsive to receiving the one or more images, generating the preliminary set of landmark locations within the one or more images using the deep learning algorithm; refining the preliminary set of landmark locations using a post-hoc processing module of the host computer, thereby generating the final set of estimated landmark locations; automatically generating the biometric landmark dimension measurements using the final set of estimated landmark locations; outputting a dataset including the final set of estimated landmark locations; A host computer comprising:

Images