Determination of ophthalmic-related biometrics of at least one eye from images of the eye region.

Abstract

The present invention relates to a computer-implemented method for determining individual biometric parameters of at least one eye and a corresponding method for manufacturing spectacle lenses taking into account the determined biometric data. Furthermore, the invention relates to corresponding computer program products and devices. The method for determining biometric data comprises the steps of providing image data, the image data including: at least one image of at least a portion of the user's eye area and / or geometric information about at least a portion of the user's eye area obtained directly from the at least one image of the at least a portion of the user's eye area; and determining, based on the provided image data, individual additional data including at least one individual biometric parameter of at least one eye of the user using a statistical model describing a relationship between the image data and the additional data.

Description

Technical Field

[0001] The present invention relates to a (computer-implemented) method for determining eye biometric data and a corresponding method for manufacturing spectacle lenses taking into account the determined biometric data. Furthermore, the present invention relates to a corresponding computer program product and device.

Background Art

[0002] In the calculation of spectacle lenses, particularly progressive spectacle lenses, the biometrics of the eyes of the spectacle wearer can be taken into account, as described, for example, in US Patent No. 9,910,294 (B2). These biometric spectacle lenses provide a great advantage because the imaging quality is not evaluated at the apex sphere, which is a virtual point of a simple model, but actual imaging occurs on the retina of the eye. Therefore, the interaction between individual aberrations that occur during refraction and propagation through the eye's media is also taken into account.

[0003] However, a disadvantage of this method is that extensive measurements using complex equipment and devices are required. This causes a great deal of labor and high costs. As a result, the advantages of high-quality biometric spectacle lenses can only be utilized by a relatively small percentage of visually impaired patients.

Summary of the Invention

Problems to be Solved by the Invention

[0004] The object of the present invention is to use the advantages of biometric spectacle lenses on a wide scale without incurring the disadvantage of complex measurements.

Means for Solving the Problems

[0005] This object is achieved by a computer-implemented method for determining eye biometric data, a corresponding device, and a corresponding computer program product, as well as a method for manufacturing spectacle lenses having the features specified in the respective independent claims and a corresponding device.

[0006] This invention is based on the remarkable discovery that it is possible to determine or derive individual biometric parameters of at least one of the user's eyes, and such biometric parameters are used to improve the individual calculation, manufacture, or adjustment of spectacle lenses using data obtained from one or more images of at least a portion of the user's eye area. Thus, it is possible to calculate and manufacture individual biometric spectacle lenses with high imaging quality and wearing comfort without requiring complex and cost-intensive measurement of additional biometric data for that purpose.

[0007] A first aspect of the present invention is a computer implementation method for determining individual biological parameters of at least one of the user's eyes, The purpose is to provide image data, and the image data is - At least one image of at least a portion of the user's eye area, and / or - To provide, which includes or consists of geometric information relating to at least a portion of the user's eye area, obtained directly from at least one image of at least a portion of the user's eye area. The present invention relates to a computer implementation method that includes determining, based on provided image data, individual additional data, including at least one individual biometric parameter of at least one eye of the user, using a statistical model that describes the relationship between the image data and the additional data.

[0008] The present invention is particularly advantageous because image data may be recorded or already recorded on a common and very simple device (camera), and such a device does not need to be specifically designed so that additional data can be directly determined from the image data. For example, this method is advantageous because, if it is not possible to directly determine individual additional data from the individual image data of a person being measured, such a relationship cannot be derived from a measurement method used without additional information about corresponding additional data from other people, for example, because the device providing the image data is not capable of directly measuring additional information.

[0009] The statistical model may be derived, or already derived, using a statistical analysis of the training dataset with multiple reference datasets, each of which includes image data and additional data assigned to the image data. This method may include providing a statistical model that describes the relationship between the image data and the additional data. Alternatively or additionally, this method may include providing a training dataset and deriving a statistical model using a statistical analysis of the training dataset. Deriving a statistical model may include, for example, training the original (untrained) model using the training dataset. For example, the model may include several model parameters that are modified or adapted during training with the training dataset.

[0010] In the scope of this application, the term “provide” includes “specify,” “transmit,” “obtain,” “read,” “retrieve from memory, database, and / or table,” and “receive.” In the scope of this application, the term “determine” also includes “specify,” “calculate,” “identify,” and “predict.”

[0011] Therefore, the value of at least one parameter of a person associated with the biometrics of one or, favorably, both eyes of the person is estimated within a data set associated with the person, which includes data associated with or determined from images of at least a portion of the eye area. The determination is made using a statistical model that maps the relationship between the parameter, which applies to at least several people, and the data associated with at least one image of a portion of the eye area.

[0012] The values ​​determined in this way can be taken into consideration in calculations for other ophthalmic lenses, such as spectacle lenses, contact lenses, or intraocular lenses.

[0013] Image data Within the scope of this description, image data is, in particular, data associated with an image of at least a portion of the user's field of vision. This refers to (particularly geometric) data / information relating to at least a portion of the user's field of vision, or data / information relating to at least a portion of the user's field of vision, that can be obtained directly from, or derived from, a direct image of at least a portion of the field of vision, particularly a camera image, and / or at least one image of at least a portion of the user's field of vision, or data / information that is directly derived from at least one image of at least a portion of the user's field of vision. For example, the camera image itself may be used in this manner to determine the pupillary distance from it, and based on such pupillary distance, for example, additional data may then be determined using a statistical model, or the individual pupillary distances determined from the camera image may then be provided as image data for determining the additional data using a statistical model. It is also possible to determine the additional data directly from individual camera images without first explicitly determining individual values ​​of pupillary distance.

[0014] These descriptions regarding image data apply to individual image data used, for example, in the context of individual orders for determining individual biometric data, as well as to statistical image data that can be part of the corresponding reference data in the context of training datasets, on which statistical models have been or may have been created or trained.

[0015] In a preferred embodiment, the image data is - One or more camera images that can be seen particularly from the front by at least one eye, preferably both eyes. - One or more camera images in which at least one eye can be seen, particularly from the side. - pupillary distance, - The distance from the apex of the cornea to the plane on which the iris is located. - The geometric path of a portion of the corneal surface (for example, the vertical portion of the cornea in a lateral camera image), - The distance to the center of rotation of the eye (especially the optical center of rotation of the eye), - Corneal diameter (white-to-white measurement, especially horizontal measurement), - The shape and / or position of the pupil or part thereof (in a given representation, for example, a closed or open polygon, a spline coefficient, etc.), - The shape and / or position of the outer edge of the iris or a portion thereof (in a given representation, for example, a closed or open polygon, a spline coefficient, etc.), - 3D model of the eye area (e.g., 3D point cloud, 3D edge network, etc., which can be determined using a depth camera), - Current line of sight, - The presence and / or preferably its form / degree of strabismus The image data includes one or more of the above parameters, or consists of one or more of the above parameters.

[0016] Additional data Additional data is, or includes, biometric data of at least one of the user's eyes, in particular, such biometric data which cannot be directly read or measured from image data (e.g., as geometric distance between marked points), but image data has been determined or determined, for example, by conventional methods, particularly at the discretion of (e.g., by an optician), in connection with ordering spectacle lenses, and is particularly considered in the case of individual selection and / or optimization and / or adjustment of spectacle or at least one spectacle lens. For example, additional data may include data which is (usually) recorded or has been recorded by an aberration meter, topograph, Scheinproof camera, OCT, biometer, fundus camera, (low coherence) laser reflectometer, and / or another measuring device or another multi-angle refraction method.

[0017] In a preferred embodiment, at least one individual biological parameter is - The length of the eye (especially the overall geometric length of the eye), - Optical path length of the eye (integral of refractive index along a light beam of a given wavelength, such as 550 nm, passing through the point of highest visual acuity on the retina and the center of the pupil), - One or more geometric distances and / or optical path lengths between the vertices of the refractive surfaces of the eye relative to each other or relative to a common reference point (e.g., the point of highest visual acuity on the retina) and the vertices of the refractive surfaces of the eye, - The shape (e.g., the shape and / or inclination of one of the corneal or lens surfaces) of the refractive surface, which can exist in a given parameterization (e.g., radius of curvature and orientation of the main part, Zernike coefficients of vertex depth, geometric curvature or equivalent representation, e.g., power vector or polar coordinate representation) and should be understood with respect to a coordinate system (e.g., a coordinate system in which the line of sight coincides with the negative direction of the z-axis and the x-axis is located in the horizontal plane), - The diameter or radius of the physical aperture (i.e., the aperture of the iris) or the optical entrance pupil (image of the iris through the cornea) of the eye, which can be given under a given illumination condition (e.g., given or average indoor illumination) that is different from the dominant illumination condition especially when image data is recorded, - The refractive index of the optical medium of the eye, - The size and / or shape of the retina, especially the size and / or shape of the fovea, - The orientation of the retina (especially the fovea), e.g., the direction of the vector orthogonal to the retina within the point of highest visual acuity with respect to the light incidence direction (e.g., the light ray passing through the center of the pupil and the point of highest visual acuity), - The position and orientation of the receptors on the retina, - The size of the receptive field on the retina includes one or more of the parameters of.

[0018] The biometric data of at least one of the user's eyes can relate in particular to the data of an individual eye, or the data of one or both eyes with respect to the head, or the data of both eyes relative to each other.

[0019] Additional data may include one or more of the following parameters in particular: higher-order aberrations of the eye or at least the cornea (coma, trefoil, secondary astigmatism, spherical aberration, etc.), lower-order and higher-order aberrations of the cornea (spherical (Sph), cylindrical (Cyl), axial (or M, J0, J45), coma, trefoil, secondary astigmatism, spherical aberration, etc.), anterior chamber depth, distance and near distance, and / or pupil diameter under twilight and photopic conditions.

[0020] Additional data within the reference data set may include, in addition to image data, data recorded or measured for previous orders of biometric spectacle lenses by, for example, an aberration meter, topographer, Scheinproof camera, OCT, biometer, fundus camera, (low coherence) laser reflectometer, and / or other measuring devices.

[0021] The individual supplemental data specified based on the user's standard individual data and the supplemental data determined using a statistical model may, but are not required, be of the same type of supplemental data included in the reference data set and used to derive the statistical model.

[0022] Statistical models A statistical model can be a statistical model derived from an existing dataset (training dataset) using statistical methods. Exemplary statistical methods include regression (especially linear regression of nonlinear features, nonlinear regression, nonlinear regression of attentional mechanisms, nonlinear multitask regression, nonparametric or semiparametric regression, etc.), classification methods, and other machine learning methods. Machine learning algorithms are described, for example, in Jeremy Watt, Reza Borhani, and Aggelos Katsaggelos, "Machine Learning Refined: Foundations, Algorithms, and Applications," Cambridge University Press, 2020.

[0023] The statistical model takes at least some of the individual image data and / or variables derived therefrom as input variables and uses them to compute at least some additional individual bioparameters or additional data. The relationship between the image data and the image data specified by the statistical model may be linear or nonlinear. Furthermore, this relationship may be multiparametric.

[0024] In a preferred embodiment, at least the statistical model is - Linear models (which may be associated with nonlinear features of parameters representing geometric information about the eye area, e.g., nonlinear functions), - Gaussian process, - Neural networks (for example, deep neural networks), - Decision tree or regression tree (regression tree), - Boltzmann Machine (Restricted Boltzmann Machine), - Support Vector Machine It includes one or more of the above models, or preferably is based on one or more of the above models.

[0025] Exemplary statistical models are linear or nonlinear regression models. For example, neural networks, including deep neural networks, can be used as nonlinear regression models. It is also possible to use other nonlinear regression models known from the field of machine learning. Regression models, such as neural networks, can be trained using a provided training dataset.

[0026] Statistical models can also be combinations of several different types of statistical models, such as linear regression models, nonlinear regression models (such as neural networks), classification models, and / or combinations of other statistical models.

[0027] Preferably, the statistical model is further improved when new data is added (for example, when new data is added to the ongoing training of a neural network). To improve the estimation or prediction by the statistical model, additional parameters not associated with the eye region, such as age, sex, ethnicity, height, weight, and head circumference, may be used in addition to the data associated with the eye region images. The statistical model may also include constraints (for example, that the predicted eye model is consistent with known refractions).

[0028] Statistical models derived from training datasets can be stored in suitable storage devices such as databases, calculators, computers, or data clouds. At least a portion of the training dataset used for derivation can be stored together with the statistical models.

[0029] The statistical models derived from the training dataset can also be reviewed and / or modified sequentially or at regular intervals, for example, based on a new baseline dataset. Accordingly, this method may include modifying the statistical models.

[0030] Training dataset A statistical model describing the relationship between image data and additional data is derived using statistical methods based on a training dataset containing multiple distinct datasets (reference datasets). Each of the reference datasets may include, for example, image data and additional data of a specific user determined using a suitable measurement method. Different reference datasets within the training dataset may preferably include data (image data and additional data) from multiple different users (reference users).

[0031] For this purpose, existing orders for biometric eyeglass lenses can be used to train a neural network or another statistical model using the dataset. For new individual orders, additional measurement data (additional data) can be calculated or predicted based on the individual image data included in the new order, using the trained statistical model. Thus, biometric eyeglass lenses can be calculated based on individual image data and additional data calculated from it using a neural network or other statistical model.

[0032] The number of reference data sets may vary. For example, reference data sets of 10, 100, 1,000, 10,000, 100,000, or more than 1,000,000 may be used. The reference data sets preferably cover a wide range, preferably the entire range, over which spectacle lenses may be ordered later. For example, the reference data sets may cover a range of refractive values ​​of -20 dpt to +20 dpt for spherical lenses and -8 dpt to +8 dpt for cylindrical lenses.

[0033] Furthermore, a method for determining individual biological parameters of at least one of the user's eyes may include transmitting individual image data and calculated individual additional data to an external entity such as an ophthalmic lens manufacturer, manufacturing unit, or manufacturing device.

[0034] A second aspect of the present invention is a method for manufacturing eyeglass lenses, One of the methods of the invention described herein, particularly in one of the preferred embodiments described herein, determines additional individual data including at least one individual biometric parameter of at least one eye of the user based on the provided image data, The present invention relates to a method that includes calculating eyeglass lenses based on determined individual additional data.

[0035] For example, spectacle lenses may be calculated using the method described in U.S. Patent No. 9,910,294(B2), or using another known method in which individual biometric parameters are taken into consideration when calculating spectacle lenses. This method may also include manufacturing the calculated spectacle lenses. Spectacle lenses can be, for example, single-vision, multi-vision, or progressive lenses.

[0036] In particular, the present invention provides a method for manufacturing eyeglass lenses and / or a manufacturing data set for manufacturing eyeglass lenses, - To provide image data, and the image data is - At least one image of at least the user's eye area, and / or - To provide geometric information relating to at least a portion of the user's eye area, obtained directly from at least one image of at least a portion of the user's eye area, - Based on the provided image data, determine individual additional data, including at least one individual biometric parameter of at least one of the user's eyes, using a statistical model that describes the relationship between the image data and the additional data. - A method that includes calculating eyeglass lenses based on determined individual additional data.

[0037] A third aspect of the present invention is a computer implementation method for determining a statistical model, - To provide multiple reference datasets in the training dataset, each of which includes image data and additional data associated with the image data. - Using statistical analysis of the training dataset, derive a statistical model that describes the relationship between image data and additional data, - The present invention relates to a computer implementation method that includes storing statistical models in a memory device.

[0038] A fourth aspect of the present invention relates to a computer program product that, when loaded into the memory of a computer and executed, causes a computer to execute a method according to one of the above aspects.

[0039] The aforementioned preferred embodiments and their advantages also apply to the above-described methods and computer program products.

[0040] A method according to one of the above embodiments may be carried out using a device designed accordingly. Accordingly, a fifth aspect of the present invention relates to a device for determining individual biological parameters of at least one of a user's eyes, comprising a computing device designed to carry out the above-described method for determining individual biological parameters.

[0041] In particular, the present invention provides a device for determining at least one individual biological parameter of a user's eye, and this device - To provide image data, and the image data is - At least one image of at least the user's eye area, and / or - To provide geometric information relating to at least a portion of the user's eye area, obtained directly from at least one image of at least a portion of the user's eye area, - A computing device designed to perform the following: determine, based on provided image data, individual additional data including at least one individual biometric parameter of at least one of the user's eyes, using a statistical model that describes the relationship between the image data and the additional data.

[0042] The computing device is preferably, This is an image data input interface for providing individual image data of users, and the image data is, - At least one image of at least a portion of the user's eye area, and / or - An image data input interface including geometric information relating to at least a portion of the user's eye area, obtained directly from at least one image of at least a portion of the user's eye area, - An additional data calculation device for calculating individual additional data, wherein the additional data includes at least one individual bioparameter of at least one eye of the user, the calculation is performed using a statistical model based on individual image data, the statistical model is derived using statistical analysis of a training data set with multiple reference data sets, each of which reference data sets includes image data and additional data associated with the image data, and the additional data calculation device may comprise this device.

[0043] Furthermore, the device may include a model input interface for providing statistical models. For example, statistical models may be stored in a device such as a database, a calculator, and / or a data or calculator cloud. Additionally, the device may provide a training data set input interface for providing training data sets, and a model computing device for deriving or computing statistical models using statistical analysis of the training data sets. Statistical models may be derived or computed, for example, by training an original (untrained) model using the training data sets.

[0044] A sixth aspect of the present invention is a device for manufacturing eyeglass lenses and / or providing eyeglass lens manufacturing data, A device for determining at least one individual biological parameter of a user's eye according to a fifth embodiment, The present invention relates to a device comprising a lens calculation device designed to calculate spectacle lenses based on at least calculated individual biological parameters.

[0045] The manufacturing device may also include a manufacturing device for producing calculated spectacle lenses.

[0046] The aforementioned devices for providing, determining, specifying, or calculating data (such as (individual) image data, (individual) additional data, statistical models, model parameters, weights, etc.) may be implemented by a suitably configured or programmed data processing device (in particular, a special hardware module, computer, or computer system such as a computer or data cloud) having a suitable computing unit, electronic interface, storage, and data transmission unit. The device may further include, at a minimum, a preferably interactive graphical user interface (GUI) that enables a user to view and / or input and / or modify the data.

[0047] The above-described device may also have a suitable interface that allows data (such as training datasets, reference datasets, (individual) image data, (individual) additional data) to be transmitted, input, and / or read. The device may also include at least one storage unit for storing the data used, for example, in the form of a database.

[0048] The manufacturing device may, for example, include at least one CNC-controlled machine for the direct processing of lens blanks according to the determined optimization specifications. Alternatively, spectacle lenses may be manufactured using a casting process. The finished spectacle lens may have a first simple spherical or rotationally symmetric aspherical surface and a second individual surface calculated as a function of individual image data and individual additional data to be calculated. The simple spherical or rotationally symmetric aspherical surface may be the front surface (i.e., the surface facing the object) of the spectacle lens. However, it is also possible, of course, to place the individual surface as the front surface of the spectacle lens. Both surfaces of the spectacle lens may be calculated individually.

[0049] Devices for manufacturing eyeglass lenses may be designed as standalone units or as independent machines, meaning that all components of the device (particularly the device for determining at least one individual bioparameter of the user's eye and the lens calculation device) may be part of the same system or be part of the same machine. However, in preferred embodiments, devices for manufacturing eyeglass lenses are not designed as standalone units but are implemented by different (particularly independent) systems or machines. For example, the device for determining at least one individual bioparameter of the user's eye and the lens calculation device may be implemented as a first system (particularly comprising a computer), and the manufacturing device may be implemented as a second system. The various systems may be located in different locations, i.e., physically separated from one another. For example, one or more systems may be located at the front end, and one or more other systems at the back end. The individual systems may be located, for example, at different company locations or operated by different companies. Here, the individual systems, in particular, have means of communication for exchanging data with each other. Preferably, different systems of the device can communicate directly with each other, in particular over a network (e.g., over a local area network and / or the internet). The above description relating to a device for manufacturing eyeglass lenses applies not only to this device but generally to all devices described within the scope of the present invention. In particular, the devices described herein may be designed as a system. In particular, a system may include a plurality of devices (which may be locally isolated) designed to carry out individual method steps of the corresponding method.

[0050] Further aspects of the present invention relate to spectacle lenses manufactured by the above manufacturing method. Furthermore, the present invention provides the use of spectacle lenses manufactured by the above manufacturing method in a predetermined average, conceptual, or individual wearing position in front of the user's eyes to correct the user's visual impairment.

[0051] Preferred embodiments of the present invention are described below with reference to the accompanying drawings. The individual elements of the embodiments described are not limited to each embodiment. Conversely, elements of these embodiments may be combined with each other as desired to create new embodiments. [Brief explanation of the drawing]

[0052] [Figure 1] This is a diagram illustrating an exemplary method for determining individual biometric data from at least one of the user's eyes and calculating eyeglass lens values. [Figure 2] This is a diagram of an exemplary reference data set. [Figure 3] This is a diagram of an exemplary linear regression model. [Figure 4] This is a diagram illustrating an exemplary nonlinear regression model. [Figure 5] This figure shows the component c² 0 of the Zernike coefficient of the cornea as a function of pupillary distance (Figure 5A) or spherical distance (Figure 5B). [Modes for carrying out the invention]

[0053] Figure 1 shows an exemplary method for determining individual biometric parameters of at least one of the user's eyes and calculating spectacle lenses based on the determined individual biometric parameters. This method includes the following steps:

[0054] Step S1: Create or provide a training dataset 1 from multiple datasets (reference datasets) 10, each reference dataset including image data 12 and additional data 14 assigned to this image data.

[0055] An exemplary reference data set 10 is shown in Figure 2. Image data 12 is particularly, - One or more camera images that can be seen particularly from the front by at least one eye, preferably both eyes. - One or more camera images in which at least one eye can be seen, particularly from the side. - pupillary distance, - The distance to the center of rotation of the eye (especially the optical center of rotation of the eye), - Corneal diameter (white-to-white measurement, especially horizontal measurement), - The shape and / or position of the pupil or part thereof (in a given representation, for example, a closed or open polygon, a spline coefficient, etc.), - The shape and / or position of the outer edge of the iris or a portion thereof (in a given representation, for example, a closed or open polygon, a spline coefficient, etc.), - 3D model of the eye area (e.g., 3D point cloud, 3D edge network, etc., which can be determined using a depth camera), - Current line of sight, - The presence and / or preferably its form / degree of strabismus Includes one or more of the data or parameters.

[0056] Additional data 14 is particularly noteworthy. - The length of the eye (especially the overall geometric length of the eye), - Optical path length of the eye (integral of refractive index along a light beam of a given wavelength, such as 550 nm, passing through the point of highest visual acuity on the retina and the center of the pupil), - One or more distances between the vertices of the refractive planes of the eye relative to each other, or between the vertices of the refractive planes of the eye and another common reference point (e.g., the highest point of visual acuity on the retina), - The shape of the refractive surface (e.g., the shape and / or inclination of one of the corneal or lens surfaces), which can exist in a given parameterization (e.g., radius and orientation of curvature of the main part, Zernike coefficient of vertex depth, geometric curvature or equivalent representation, e.g., by power vector or polar coordinate representation), and should be understood in relation to a coordinate system (e.g., a coordinate system where the line of sight coincides with the negative z-axis and the x-axis lies in the horizontal plane), - The diameter or radius of the physical opening of the eye (i.e., the opening of the iris) or the optical entrance pupil (the image of the iris passing through the cornea) given under given lighting conditions (e.g., given or average indoor lighting), - Refractive index of the optical medium of the eye, - Retinal size and / or shape, especially foveal size and / or shape, - The orientation of the retina (especially the fovea), for example, the direction of a vector perpendicular to the retina within the point of highest visual acuity with respect to the direction of light incidence (e.g., light rays passing through the center of the pupil and the point of highest visual acuity), - Location and orientation of receptors on the retina, - Size of the receptive field on the retina Includes one or more of the data or parameters.

[0057] Existing orders for biometric spectacle lenses may be used to form training data sets, with additional data recorded using measurement methods. Exemplary measurement methods include measurements using aberration meters, topographers, Scheinproof cameras, OCT, and / or biometers.

[0058] Step S2: Using statistical methods, relationships between image data and additional data are derived from multiple reference datasets. In other words, a statistical model is determined or trained based on the training dataset to describe relationships such as correlations between image data and additional data.

[0059] The determination of a statistical model may, for example, involve training an untrained neural network with a training dataset, the training dataset comprising multiple reference datasets. The trained neural network may be tested using a test dataset and / or certified using a certification dataset. The test dataset and certification dataset may each contain multiple datasets (reference datasets) from a previous order, for example, the multiple reference datasets shown in Figure 2. Preferably, the reference datasets included in the test dataset are not included in the certification dataset or the training dataset. Similarly, the reference datasets included in the certification dataset are preferably not included in the test dataset or the training dataset.

[0060] Step S3: Provide an individual data set (individual order) that includes at least individual image data. Individual image data may be recorded by the optician as part of an individual order for eyeglasses for a user. An individual order may also include further individual information, in particular individual refractive data, especially if this is individual information that can be determined without complex measurements. This may include simple refractive data (in particular low-order aberrations), as well as / or individual wearing conditions, as well as / or information about the user's ethnicity and / or age and / or height and / or sex and / or weight.

[0061] Step S4: Based on the individual image data contained in the individual datasets provided in Step S3, and based on the relationship between the image data and the additional data determined in Step S2, individual additional data (additional data) is calculated. For example, the individual image data may be input to the trained neural network in Step S2. The corresponding output data of the neural network may be used directly as individual additional data. In addition to using the output data of the neural network directly, it is also possible to first subject this output data to further processing (validation, smoothing, filtering, categorization, transformation, etc.).

[0062] Step S5: Based on the individual image data included in the individual data set provided in Step S3, and further based on the individual additional data calculated in Step S4, the individual spectacle lens is calculated.

[0063] The calculation of individual spectacle lenses specifically includes the calculation of at least one surface of the spectacle lens based on individual image data and calculated individual additional data. The surface thus calculated may be the back or front surface of the spectacle lens. "Calculation of at least one surface of the spectacle lens" includes the calculation of at least a portion of the surface or a part of the surface. In other words, "calculation of at least one surface of the spectacle lens" means the calculation of at least a portion of the surface or the calculation of the entire surface.

[0064] The surface opposite to the surface being calculated can be a simple surface, such as a sphere, rotationally symmetric, aspherical, annular, or non-annular surface. It is also possible to calculate both surfaces individually.

[0065] Individual spectacle lenses can be calculated using known methods, for example, using the method known from U.S. Patent No. 9,910,294(B2).

[0066] Figures 3 and 4 show exemplary statistical models 2, each trained on training dataset 1. Thus, such statistical models can be designed, at least partially, as neural networks.

[0067] If the statistical model is based on or consists of a neural network, for example, the input layer of the neural network is occupied by at least a portion of the image data and / or auxiliary variables computed therefrom. The output layer outputs values ​​for at least one additional parameter or at least a portion of the additional data. The neural network may also preferably include one or more hidden layers in addition to the input and output layers. During the training of the initial untrained neural network, the weights are modified using a suitable learning algorithm. The trained neural network specifies the relationship between the image data and the additional data. The structure of the neural network (number and type of layers, number and type of neurons in different layers, how layers and neurons are connected to each other, etc.) and the learning algorithm may vary.

[0068] Figure 3 shows an exemplary linear regression model with input and output layers. The output variable f(x), having K variables, is computed from the multidimensional input variable x in dimension D (for example, D=26).

[0069] f(x)=Wx (1) In the above equation,

number

[0070] Figure 4 shows an exemplary nonlinear regression model with an input layer, an output layer, and several hidden layers. Here, the output variable f(x) with variable k is computed from the multidimensional input variable x in dimension D (for example, D=26).

[0071] f(x) = σ(W) 3 σ(W 2 σ(W 1 x))) (2) σ(a) = max(a,0) Normalized Linear Unit (ReLU) In the above equation,

number

number

number

[0072] Figure 5 shows an example of a preferred embodiment using an exemplary linear model. The example shown is based on the calculation of the Zernike coefficient of the cornea of ​​an eye having a diameter of approximately 7 mm around the corneal apex, based on the pupillary distance. This means that the pupillary distance is used as image data, which may be determined directly or indirectly from, or has been determined in this way, from at least one image of at least a portion of the user's eye area. In particular, Figure 5A shows a training dataset containing a number of reference datasets, which for a number of people or eyes, each pupillary distance is associated with the Zernike coefficient c² of the cornea for a radius of 3.55 mm. 0 It relates to (mean curvature).

[0073] Preferably, a simple linear regression is used as the statistical model, thereby determining the Zernike coefficient of the cornea, which unfolds around the corneal apex with a radius of 3.55 mm, from the pupillary distance (PD) as a parameter associated with the ocular region. For the individual determination of the Zernike coefficient, the model parameters are determined using a statistical model employing linear regression.

[0074] c2 0 (PD)=-304.1μm+0.9422μm / mmPD.

[0075] The predicted frequency for this model is 0.11 (R-squared adjusted).

[0076] This model can be improved by adding additional terms such as white-to-white (WTW).

[0077] c2 0 (PD,WTW)=-329,7μm+0,9841μm / mmPD+2,172μm / mmWTW Here, the predicted frequency is 0.15 (R-squared adjusted).

[0078] A comparison with Figure 5B also demonstrates that the present invention's method, using individual image data, makes it possible to access (statistical) correlations with (optically) relevant parameters for the optimization and manufacture of individual spectacle lenses, which was not or is not anticipated in the prior art. In particular, Figure 5B shows the mean corneal curvature (c² 0The statistical distribution of ) is shown as a function of the spherical equivalent of the associated refractive error of the eye. When they appear physiologically separated, there is no significant statistical correlation between mean corneal curvature and spherical equivalent, even when a change in mean corneal curvature has a very large effect on the spherical equivalent of the refractive error of the eye. For very simple (not individually optimized) spectacle lenses, knowledge of spherical equivalent is sufficient to enable the selection of a suitable spectacle lens. However, for improved individual manufacturing or adjustment of spectacle lenses, it is clearly beneficial to know details about the individual refractive plane of the eye, for example. Thus, improved individual adjustment of spectacle lenses can usually be achieved by knowledge of mean corneal curvature (as additional data), or at least by statistical estimation. This advantage of knowing (or approximating) additional data is achieved by very simple means in the method according to the present invention.

[0079] Other parameters not necessarily related to the eye range (e.g., user age and / or gender) can also be used. Instead of linear functions, nonlinear functions (e.g., neural networks) and residual distributions other than normal distributions can also be adjusted (e.g., to enable robust determination of model parameters from data that may contain outliers).

[0080] In a more preferred embodiment, a statistical description of the length of the eye (AL) is made using image data, that is, particularly based on the pupillary distance, and especially taking into account the spherical equivalent of refraction (M). For individual determination of the length of the eye, model parameters are determined in a statistical model by linear regression.

number

[0081] Using the geometric parameters of the eye region, namely pupillary distance (image data), a comparison of the predicted frequencies of a linear model that does not consider pupillary distance is possible.

number

[0082] The predicted frequency for this model is 0.63 (R-squared adjusted).

[0083] In a more preferred embodiment, information regarding corneal topography is determined using image data. A trained artificial deep neural network is preferably used as a statistical model that is trained or in training with respect to the relationship between images of the eye region (image data) and corneal topography (additional data). In particular, the last layer of the network, which may be pre-trained on image data, is preferably trained to determine corneal topography. In particular, the biometrics of an eye having at least one of the features of ethnicity, (approximate) age, head size (e.g., head circumference), eye color, height, and weight (which may be intermediate variables), which are extracted or learned by the statistical model as features formed by the statistical model, can be determined at least partially and / or approximately from images of the peripheral regions of the head and / or eyes (image data). Other features that suggest a causal relationship to be learned by the model, or for which a corresponding correlation cannot be ruled out, can be similarly considered deductively.

[0084] In addition to image data, if available, additional parameters (extension data) such as ethnicity, (approximate) age, head size (e.g., head circumference), eye color, height, and weight are preferably used as input data for training or determining the additional data in the creation and / or application of statistical models.

[0085] In a preferred embodiment, additional data includes data relating to corneal topography (e.g., as curvature, as a Zernike polynomial, or using another general description), which is associated by a statistical model with at least two images of the ocular region or eye taken from different directions as image data (e.g., using a two-camera video-centering device with two cameras). Preferably, singularities of the iris imaged by different regions of the cornea are sought in the images. Under assumptions (e.g., the iris is flat and / or the physical aperture diaphragm is round, the refractive index of the cornea is known, and the anterior chamber of the eye), the corneal shape is determined (e.g., by varying mathematical models of the anterior and possibly posterior surfaces of the cornea, as well as models of the location of singularities on the iris), and the same physical model of the cornea must describe the location of singular iris points in all images where possible. Particularly preferably, the images are recorded simultaneously so that the pupils are in the same state.

[0086] In particular, in a special case, the present invention relates to determining the anterior chamber depth, in a preferred embodiment, under the assumption that the boundary between the iris and cornea and the sclera lies in the same plane.

[0087] It is also possible to draw conclusions (additional data) regarding corneal astigmatism using the ellipticity of the pupil shape (image data).

[0088] Since the values ​​may already be derived from images of the ocular region (e.g., white-to-white of corneal diameter), statistical models can be used to calculate more complex properties of ocular biometry (e.g., naturally occurring corneal shape in appropriate parameterization, as well as anterior chamber depth and / or corneal central thickness or thickness distribution), and are not necessarily limited to overly simplified models (e.g., models of the cornea as part of a sphere or torus). In this way, the naturally occurring morphology of the cornea can be optimally estimated. Assumptions regarding the iris or pupil can also rely on statistical models of other parameters such as age, refractive error, ethnicity, sex, or other known variables (see possible parameters above).

[0089] A more preferred embodiment relates to determining corneal topography (additional data) from the shape of a line running between the cornea and the sclera (image data), or, alternatively or additionally, from the outer boundary of the iris (image data). Preferably, the shape of a line running between the cornea and the sclera, or the shape of the outer boundary of the iris, for example, White-to-white measurements taken horizontally and vertically. For example, the flat oval shape of a line parameterized by a semi-axis, and its orientation relative to the horizontal, A flat shape consisting of two circular or oval sections. For example, the three-dimensional shape of a line determined by several images from different directions (e.g., using a stereo camera system), Parameterization using the Fourier coefficient of the distance from a specified point (e.g., the center of mass of the pupil) to the boundary as a function of angle. This is parameterized.

[0090] In the case of suitable parameterization representing assumptions about the shape of the line, even if the line (between the cornea and sclera, or alternatively or additionally, the outer boundary of the iris) is not fully visible in the image (for example, because it is partially covered by the eyelid), the parameters can still be determined, particularly using statistical models. The parameters may relate to height, which is already known (for example, by using already calibrated data, or by allowing approximate calibration at known pupillary distances).

[0091] Corneal topography is preferably determined from these parameters, which uses a statistical model based on predictions from existing datasets that include both known corneal topography of the boundary between the cornea and sclera and suitable parameters.

[0092] Another preferred embodiment involves using a statistical model to determine corneal topography (additional data) from the geometric profile (image data) of only a single portion of the corneal surface, for example, only the vertical portion of the cornea in a lateral camera image, with other variables also being considered in the statistical model.

[0093] In summary, while conventional video centering is known to be used to individually improve lenses, it should be noted that it does not use statistical models to estimate parameters associated with the bio-eye. For example, pupil diameter or pupillary distance may be determined, but this is done without using statistical models, whereas statistical models improve the determination of these parameters by imaging the physical aperture diaphragm of the eye (iris) through the cornea, which is not known in detail, but this is something that can be estimated using statistical models.

[0094] Within the scope of the present invention, data relating to at least the ocular area can be determined from images showing one or two eyes. Such image data can be determined particularly from a greater distance and can be performed much more quickly than a complete measurement of ocular biometrics.

[0095] Data associated with ocular biometrics can be geometric data (e.g., descriptions of the refractive surfaces of the eye, and, if several surfaces exist, their relative positions to each other), and may include the shape of the cornea in particular (e.g., one of the corneal surfaces, especially the anterior surface of the cornea). In this way, complex eye models can be determined, thereby allowing for better individual fitting of spectacle lenses, without the need to perform complex measurements to determine complex eye models in individual cases, nor the availability of corresponding measuring devices.

[0096] Data associated with ocular biometrics can also be related to a single eye in isolation (distinguishable from the rotation point of the eye, which is a bioparameter of the head or both eyes, rather than a bioparameter of a single eye itself). The optical properties of a complex eye model may be determined using such parameters related to a single eye in isolation, which may be used to calculate improved spectacle lenses, and there is no need for a corresponding measuring device to determine a complex eye model in an individual case. In particular, to determine such an eye model in an individual case (i.e., after a statistical model has been provided), a lighting device specifically designed for this purpose is not required (e.g., in the case of a keratometer or shineproof camera). A simple lighting device such as an LED is sufficient, and this may, in some cases, be powered on only for a short time (e.g., as a flash to illuminate at least the eye area).

[0097] In particular, in preferred embodiments, the present invention is a method for determining the biometrics of the eye, Preferably, the steps include recording image data of the eye using a camera system (stereo camera system) having one or two cameras calibrated relative to each other, The steps include providing and / or applying a statistical model to predict biometrics (e.g., corneal curvature or anterior chamber depth) as an input parameter set, based on at least one of the following input parameter sets, Parameter set 1: Imaging of the iris through the cornea by one or two cameras from one or different angles. Parameter set 2: Iris boundary, Parameter Set 3: Interpupillary Distance of a Person The method involves a training process that includes a step of providing a statistical model, during which associated biometrics of the eye are known and used for training, in addition to parameter 1 and / or 2 and / or 3. Both the iris boundary and pupillary distance can be determined from the image. [Explanation of Symbols]

[0098] 1. Training Data Set 2. Statistical Models 10 Reference Data Sets 12 Image data 14 Additional Data S1~S5: Method Steps

Claims

1. A computer-based method for determining individual biological parameters of at least one eye of a user, Providing image data to a computing device, wherein the image data is - At least one image of at least a portion of the user's eye area, and / or - Includes geometric information relating to at least a portion of the user's eye area obtained directly from at least one image of at least a portion of the user's eye area, A computer implementation method comprising determining, by the computing device, based on the provided image data, individual additional data including at least one individual biological parameter of at least one of the user's eyes, using a statistical model that describes the relationship between the image data and the additional data.

2. The method according to claim 1, wherein the statistical model (2) is derived using a statistical analysis of the training data set (1) with a plurality of reference data sets (10), each of which includes reference image data and reference additional data assigned to the reference image data.

3. The method according to claim 1, wherein the statistical model (2) is derived using a statistical analysis of the training data set (1) with a plurality of reference data sets (10), each of which reference data sets (10) includes reference image data and reference additional data assigned to the reference image data.

4. The training data set (1) is provided to the statistical model calculation device, The method according to claim 2 or 3, further comprising deriving the statistical model (2) by the statistical model computing device using a statistical analysis of the training data set (1), wherein deriving the statistical model (2) includes training the original model using the training data set (1).

5. The aforementioned image data, - One or more camera images showing one or both eyes from the front, - One or more camera images showing at least one eye from the side, - pupillary distance, - Distance of the center of rotation of the eye, - Corneal diameter, - The shape and / or position of the pupil, or the shape and / or position of a portion of the pupil, - The shape and / or position of the outer edge of the iris, or the shape and / or position of the portion of the iris, - 3D model of the eye area, - Current line of sight when the image was taken, - Presence of strabismus and / or form of strabismus and / or degree of strabismus The method according to one of claims 1 to 4, comprising one or more images or parameters.

6. The at least one individual biological parameter is - Eye length, - Optical path length of the eye, - One or more distances between the vertices of the refractive planes of the eye relative to each other, or between the vertices of the refractive planes of the eye and another common reference point, - The shape and / or inclination of one of the surfaces of the cornea or lens, - The diameter or radius of the physical opening of the eye, - Refractive index of the optical medium of the eye, - Retinal size and / or shape, or foveal size and / or shape, - Retina orientation, - Location and orientation of receptors on the retina, - Size of the receptive field on the retina The method according to one of claims 1 to 5, comprising one or more of the parameters.

7. The aforementioned statistical model, - Linear model, - Gaussian process, - Neural networks, - Decision tree or regression tree, - Boltzmann machine, - Support Vector Machine The method according to one of claims 1 to 6, comprising one or more of the models.

8. A method for manufacturing eyeglass lenses, Determining individual additional data (14) including at least one individual biological parameter of at least one eye of the user, wherein the individual additional data (14) is determined by the method of any one of claims 1 to 7, A method comprising calculating the eyeglass lens based on the determined individual additional data.

9. A computer program that, when loaded onto and executed by a computer, causes the computer to carry out the method described in any of claims 1 to 8.

10. A device for determining individual biological parameters of at least one eye of a user, comprising a processor and a storage medium for storing a program for causing the processor to perform the method according to any one of claims 1 to 7.

11. A device for manufacturing eyeglass lenses, A device for determining individual biological parameters of at least one eye of a user as described in claim 10, A device comprising a lens calculation device designed to calculate the spectacle lens based on the determined individual biological parameters.

Images