System and method of obtaining fit and fabrication measurements for eyeglasses using combined camera imaging and depth map scanning

Abstract

A system and method for determining measurements to correctly fit prescription lenses (44) to eyeglass frames (24). The eyeglass frames (24) are selected and worn on the face. The individual wearing the eyeglass frames (24) is imaged with a camera (32) and scanned with a 3D imaging system (34) in at least two orientations. The relative displacement of the eyeglass frames (24) relative the electronic imaging device (30) between the first orientation and the second orientation is measured using one or more internal measurement units (15, 35). The internal measurement units (15, 35) collect displacement data (43). Measurement points (48) are identified on the eyeglass frames (24) and / or the individual wearing the eyeglass frames (24). Data is stereoscopically analyzed using the displacement data (43) to determine 3D coordinates for the measurement points (48). Distances between coordinates are calculated. The distances correspond to fabrication measurements needed to fabricate prescription lenses (44).

Description

[0001] SYSTEM AND METHOD OF OBTAINING FIT AND FABRICATION MEASUREMENTS FOR EYEGLASSES USING COMBINED CAMERA IMAGING AND DEPTH MAP SCANNING

[0002] TECHNICAL FIELD OF THE INVENTION

[0003] In general, the present invention relates to measurement systems and methods that are used to properly fit prescription eyewear. More particularly, the present invention relates to systems and methods that passively obtain measurements by imaging and / or scanning an individual to obtain the data required to fabricate and fit prescription lenses.

[0004] BACKGROUND ART

[0005] In the growing age of technology, many companies, such as Apple®, Google® and Meta® have integrated electronics into eyeglasses. Such eyeglasses are commercially known as "smart glasses" in the electronics industry and are exemplif ied by U. S. Patent No. 9, 285, 592 to Olsson and U. S. Patent No. 9, 075, 249 to Heinrich. When smart glasses are sold to the public, the vast majority of smart glasses sold are selected from a limited number of frame types and lens types that are offered by the source company. The lenses in the smart glasses typically have no optical power. However, as the popularity of smart glasses increases, the number of frames that are available has also increased. It is anticipated that in the near future, the technology smart glasses will be incorporated into any eyeglass frame that has enough space to hold the required electronics.

[0006] Currently, some companies enable consumers to purchase customized smart glasses that contain prescription lenses. In such a scenario, a consumer must have an existing eyeglass prescription and must forward the prescription to the manufacturer. The manufacturer creates lenses in accordance with the prescription and assembles the lenses into the smart glasses. The peripheral dimensions of the lenses cannot be changed because the lenses must be fit into the complicated assembly of the smart glasses. The initial prescription is obtained in a standard manner. That is, the prescription is obtained from vision tests performed by an optometrist or similar eyecare professional. Generally, when the eyeglass prescription is created, the dimensions of the lenses used within smart glasses are net considered. Thus, certain measurements must be obtained to compensate for the dimensional requirements and lens glass types used in smart glasses. In order for prescription lenses to be most effective, the manufacturing of the lenses should take into account the dimensions and shape of the frames to which the prescription lenses are going to be applied. Furthermore, custom fabrication of the lenses should also be varied to accommodate the anatomical features of the individual who will wear the eyeglass f rames. When prescription lenses are fitted for a particular set of f rames and for a part icular individual, several measurements must be made in order to ensure that the prescription lenses are fabricated properly. The needed measurements are commonly referred to as "ophthalmic measurements" in the industry. Many of the needed ophthalmic measurements depend solely upon the style and model of the eyeglass f rames selected. Other ophthalmic measurements depend upon the anatomy of the individual being fitted. Still other ophthalmic measurements depend upon how the eyeglass frames sit upon the face when being worn in a normal manner and how an individual looks through their eyewear lenses when performing various daily activities.

[0007] In addition to an individual ' s facial anatomy, the position of the head and the posture of the body also have significant effects on the proper fitting of eyeglasses. Few people have a fully erect posture and view their environment by only looking straight ahead. Rather, most people have a slight slouch. Furthermore, most people look slightly downward as they walk or when they sit. Some people also have a tendency to tilt their head to one side or another as they drive or read. Each one of these head positions causes an individual to look through a slightly different section of the lenses in a set of eyeglasses.

[0008] In order to obtain all the anatomical measurements needed, eyeglass frames are worn by an individual. An optician or other technician then uses a variety of instruments to quantify the measurement variables needed to properly create prescription lenses for those eyeglass frames on that individual. However, when a consumer is purchasing smart glasses, this cannot be done. Due to the sophistication of the smart glasses, the smart glasses are not currently assembled in an eyeglass store or in an optometrist' s office.

[0009] Rather, smart glasses are assembled in the facilities of the smart glasses manufacturer. This is currently required because with smart glasses, electronic elements are integrated into, onto, and / or adjacent the lenses. The equipment needed to integrate the lenses into the frames is only found at the manufacturer' s facilities. In future designs, it should be anticipated that the lense s of smart glas ses will be made to be interchangeable and that prescript ion lenses can be manufactured and installed in the facilities of an optometrist or other eyecare profe s sional.

[0010] In the prior art, there are systems that enable an individual to purchase pre scription eyewear in a remote fashion. Some prior art systems use virtual 3D models of both the user ' s face and of the eyeglas s frame s. The virtual eyeglass frames are then superimposed over the virtual face to as ses s aesthetics and fit. Such prior art systems are exemplified by U. S. Patent No. 9, 817, 248 to Yang. These prior art systems are sufficient for viewing the way eyeglas ses look on an individual. However, such systems s imply position virtual eyeglas ses in front of a virtual face. There are no adjustments for how gravity causes the eyeglas ses to rest on the nose or how an individual orients his / her head.

[0011] Accordingly, any measurements that are obtained f rom such virtual model systems are only estimates and are not completely accurate.

[0012] U. S. Patent Application Publication No.

[0013] 2014 / 0257839 to Suter, and U. S. Patent No.

[0014] 10, 831, 042 to El-Ha jal et al. show prior art systems that enable an individual to buy prescription eyewear online. The systems take an existing prescription for eyewear and adapt the prescription to any set of eyeglass frames that are selected online by the user. However, these systems rely on imagery of the individual wearing the eyeglasses. The images are taken at different angles that can offset the measurements being made.

[0015] In addition to using images to obtain ophthalmic measurements, depth map data can also be used. In U. S. Patent No. 11, 579, 472 to El-Hajal et al., a depth map is obtained using a light time-of-flight system. In such a system, light is directed toward the target field. The light reflects off objects in the target field and the reflected light is received. The time difference between the emission of the light and receiving the reflected light can be used to determine distance. The full data obtained can then be used to map the target field. As such 3D imaging systems become smaller and more sophisticated. The 3D imaging systems are now capable of being integrated into handheld electronic devices, such as smart phones and tablet computers.

[0016] 3D imaging systems enable an individual to passively scan an object and create a depth map of that object. A depth map contains per-pixel data with associated depth-related information, therein producing a three-dimensional mapping of targeted points in an observed space.

[0017] Optikam Tech, Inc of Quebec Canada released the OptikamPad software application, wherein a "LIDAR+" measurement mode is used to obtain ophthalmic measurements. In the "LIDAR+" measurement mode a dual image system is used that includes 2D images and LIDAR depth maps. The dif ferent images are taken from different viewpoints by moving the camera of the iPad® downwards between snapshots while the customer maintains their head position.

[0018] When using a 3D imaging system to generate a three-dimensional mapping of a face, determining the depth from the camera to the general face plane can be accomplished with marginal accuracy. The difficulty is determining depth between points at the target face plane of the individual wearing the glasses. For example, it is difficult to determine the distance between the lens and the eye, i. e., the vertex distance, due to shadow outlines and current resolution limits on 3D scanning technology. Current 3D scanners that are used on common handheld electronics do not generally offer enough granularity to determine millimeter or submillimeter precision. The lack of accuracy can produce false depths in a three-dimensional representation.

[0019] A need exists to accurately obtain depth related ophthalmic measurements. The invention described herein uses facial and eyewear landmarks and 3D scanning technology (such as lidar but not exclusively) to detect f acial / eyewear landmarks which may be easier to detect with higher accuracy, and then pair the data with depth information from the 3D scanning system to calculate the relative pose between views. The pose is then matched with common ophthalmic measurement points and triangulates their 3D position and compute ophthalmic measurements. In general, it is much easier to accurately determine 3D depth information from a 3D scanner of facial and eyewear landmarks, rather than determining direct depth information of common measurement points which often are located behind eyewear being worn.

[0020] The need for an improved imaging system that uses 3D scanning data in conjunction with image data to accurately calculate ophthalmic measurements is met by the present invention as described and claimed below. DISCLOSURE OF THE INVENTION

[0021] The present invention is a system and method for determining the measurements needed by a lens fabricator to correctly fit prescription lenses to a set of eyeglass frames. A set of eyeglass frames are provided into which prescription lenses are to be set. To determine the measurements needed to produce the prescription lenses, the eyeglass frames are selected and are worn on the face of an individual. The individual wearing the eyeglass frames is imaged and scanned in a first orientation to obtain a first set of image / scan data. The relative position between the eyeglass frames and the electronic imaging device is altered. The individual wearing the eyeglass frames is again imaged and scanned in the second orientation to obtain a second set of image / scan data.

[0022] The relative displacement of the eyeglass frames relative to the electronic imaging device between the first orientation and the second orientation is measured using one or more internal measurement units. The internal measurement units collect displacement data.

[0023] Measurement points are identified on the eyeglass frames and / or the facial features outside of what is occluded by the glasses, such as the nose or cheeks. The first set of image / scan data and the second set of image / scan data are stereoscopically analyzed using the displacement data to determine 3D coordinates for the measurement points. Once the 3D coordinates of the measurement points are known, the distances between the coordinates can be calculated. The distances correspond to fabrication measurements that are needed to fabricate prescription lenses for the eyeglass frames.

[0024] BRIEF DESCRIPTION OF THE DRAWINGS

[0025] For a better understanding of the present invention, reference is made to the following description of exemplary embodiments thereof, considered in conjunction with the accompanying drawings, in which:

[0026] FIG. 1 shows the hardware of a first exemplary embodiment of the present invention system used to scan and image an individual;

[0027] FIG. 2 shows a front camera image of an individual wearing eyeglass frames and some of the point-to-point distances that must be quantified to fabricate lenses for the eyeglass frames; FIG. 3 is a front depth map scan of an individual wearing eyeglass frames and some of the measurement points used when measuring point-to-point distances;

[0028] FIG. 4 is a side depth map scan of an individual wearing eyeglass frames and some of the measurement points used when measuring point-to-point distances;

[0029] FIG. 5 is a block diagram showing the methodology of the present invention system; and

[0030] FIG. 6 shows the hardware of a second exemplary embodiment of the present invention system used to scan and image an individual.

[0031] DETAILED DESCRIPTION OF BEST MODE FOR CARRYING OUT THE INVENTION

[0032] The present invention system and method can be used to determine the measurements needed to accurately fabricate prescription lenses for a set of eyeglass frames. The frames and lenses can be used to form smart glasses, eyeglasses, sunglasses, or safety glasses. Only two exemplary embodiments of the present invention system and method are illustrated. These embodiments are exemplary and are intended to represent two of the best modes contemplated for the invention. The exemplary embodiments, however, are used for the purpose of explanation only and should not be considered a limitation when interpreting the scope of the appended claims.

[0033] For the purposes of this description, "smart glasses" shall be considered all eyeglasses that have electronics that, among other features, include a camera and the ability to image and position sensors such as Internal Measurement Units (IMUs ) that are capable of determining position in space and / or displacement. The term "eyeglass frames" shall be considered to be the frames of the smart glasses that contain the camera and other electronics.

[0034] Referring to Fig. 1, it will be understood that a system user 10 who wants prescription lenses to be manufactured into a set of smart glasses 12 must first visit an optometrist or similarly qualified individual in order to obtain a corrective lens prescription. Typically, an eye exam is conducted using diagnostic equipment 14, such as a phoropter. The diagnostic information obtained from the eye exam is used to generate prescription data 16. The prescription data 16 may be stored in a cloud accessible database 19 that is accessed through a data network 18, such as the Worldwide Web.

[0035] An eye exam need not be performed to use the present invention system. If prescription data 16 is required, the prescription data 16 can be obtained from records of old exams or even by analyzing the current eyewear of the user 10. It will therefore be understood that the prescription data 16 is obtained from some source and may be presented in many formats including a written prescription.

[0036] Once the prescription data 16 is obtained from a source, the user 10 selects the eyeglass frames 24 of the smart glasses 12 into which the prescription lenses are to be mounted. See Block 22. The user 10 can bring his / her own eyeglass frames 24.

[0037] Alternately, samples of eyeglass frames 24 are made available to the user 10 at a fitting. The models and sizes of the smart glasses 12 need not be known.

[0038] The smart glasses 12 contain a camera 20 and electronics that include an IMU 15. The IMU 15 measures displacement of the smart glasses 12 in three-dimensional space over time. The user 10 who is being fitted for the smart glasses 12 is positioned in front of an electronic imaging device 30 that contains a different camera 32, a 3D imaging system 34 and an IMU 35. The 3D imaging system 34 is capable of producing a depth map and can be a structured light system or a time-of-f light system, such as a LIDAR system or other such 3D scanning system.

[0039] There are multiple makes and models of smart phones, tablet computers, and smart cameras that can both capture an image and create a depth map with a 3D imaging system. Any such device can be utilized as the "electronic imaging device" in this disclosure.

[0040] The user 10 places the eyeglass frames 24 on his / her head. The user 10 is then both imaged and scanned by the electronic imaging device 30 in at least two orientations. This produces first orientation image / scan data 40 and second orientation image / scan data 42. As will be explained, when the images / scans are taken, the electronic imaging device 30 denotes the relative position in space associated with each of the images. Accordingly, the first orientation image / scan data 40 and the second orientation image / scan data 42 also have corresponding displacement data 43. In this manner, the changes in position between any two images and / or scans can be calculated. The first orientation image / scan data 40 and the second orientation image / scan data 42 are collected by the electronic imaging device 30 by imaging / scanning the user 10 from different points of view. Both the first orientation image / scan data 40 and the second orientation image / scan data 42 contain traditional camera image data that is produced by the camera 32 in the electronic imaging device 30. The first orientation image / scan data 40 and the second orientation image / scan data 42 also contain a corresponding 3D depth map for each captured 2D image. The depth map is created by the 3D imaging system 34. The 2D images can lack detail due to shadows and areas blocked by the eyeglass frames 24. The 3D imaging system 30 can be used to provide the detail lacking in the 2D images. 3D scanners often offer poor performance while performing scans of areas behind eyeglasses due to occlusions as well as the presence of a lens, whether glass or plastic. Therefore, a combination of 2D images and 3D scans where common points may be determined on the f rame, can provide more accurate stereoscopic measurement results. The process is aided by IMU sensors on either the capturing device or the glasses themselves, or both, in order to aid in determining proper displacement baseline between sets of images.

[0041] The electronic imaging device 30 can be held directly in front of the user 10 wearing the smart glasses 12. It is preferred that the electronic imaging device 30 be used to image / scan the user 10 in at least two offset positions. Imaging and scanning at different orientations enable stereoscopic data analysis for enhanced or more accurate eyewear measurements. See Block 60. The different orientations can be achieved either by moving the electronic imaging device 30, or by the user 10 slightly adjusting his / her head posture. This can be accomplished by tilting or turning the head while maintaining eye contact with the electronic imaging device 30. The IMUs 35 in the electronic imaging device 30 is utilized to determine relative position in space associated with both the captured 2D camera images and the 3D scan images. Alternatively, a positional reference point can be captured to determine displacement between the images at the first orientation and the images in the second orientation. The displacement data 43 measured by the IMU 35 is used to determine positional displacement between images / scans.

[0042] Positional displacement is a needed variable in the stereoscopic data analysis being performed. The 2D image data from the camera 32 and the 3D scan data from the 3D imaging system 30 are used in conjunction with the positional data to perform stereoscopic data analysis and determine and / or confirm some of the measurements needed to properly fabricate prescription lenses 44 for the eyeglass frames 24. The first orientation image / scan data 40 and / or the second orientation image / scan data 42 can be the result of a selfie, wherein the user 10 takes his / her own images by holding the electronic imaging device 30 in outstretched arms. Alternatively, the images / scans can be taken by another individual, such as an optician.

[0043] The purpose of the present invention system is to provide a way to capture the fit of the eyeglass frames 24 and to obtain many of the measurements needed to create prescription lenses 44 for the eyeglass frames 24. The measurements are obtained by both imaging the user 10 wearing the eyeglass frames 24 with the camera 32 and scanning the user 10 using the electronic imaging device 30. Preferably, at least two sets of images / scans are obtained from different orientations to allow for stereoscopic positional analysis. The changes in position between images / scans can be determined by the IMU 35 in the electronic imaging device 30 and / or the IMU 15 in the smart glasses 12. If only the electronic imaging device 30 is moved between images / scans, only displacement data 43 from the electronic imaging device 30 need be considered. Conversely, if only the smart glasses 12 are moved between images / scans, only displacement data 43 from the smart glasses 12 need be considered. In most cases, there will be movement in both the electronic imaging device 30 and the smart glasses 12. Accordingly, the displacement data 43 from both sources will have to be combined and considered.

[0044] As will be explained, some of the ophthalmic measurements can be determined by analyzing the camera image 36. However, some ophthalmic measurements are better determined through back projection techniques that involve the use of both the 2D image data and its corresponding 3D scan data. 3D scanners typically lack precision required to determine depth related ophthalmic measurements. However, by utilizing both 2D image data and 3D scan data, measurements can be accurately determined. Vector data is used to determine real scale.

[0045] Referring to Fig. 2 in conjunction with Fig. 1, it will be understood that certain measurements must be taken from the eyeglass frames 24 that reference the anatomy of the head. Collectively, some of the major variables that are needed to fabricate a set of prescription eyeglasses are present in Table 1 below:

[0046] TABLE 1

[0047] Frame Dimension Variables

[0048] A - Lens Length

[0049] B - Lens Height

[0050] ED - Effective Diameter

[0051] GC - Geometrical Centers

[0052] DBC - Distance between the geometric centers

[0053] DL - Datum Line

[0054] L - Frame Length

[0055] DBL - Distance Between Lenses

[0056] FWA - Frame Wrap Angle

[0057] Anatomical Dependent Variables

[0058] PH - Pupil Height

[0059] PD - Pupil Distance

[0060] PTA - Pantoscopic Tilt Angle

[0061] RVD - Rear Vertex Distance

[0062] Fig. 2 shows the camera image 36 of a user 10 wearing the eyeglass frames 24 of smart glasses 12. The eyeglass frames 24 have lens openings 45 which can be fitted with prescription lenses 44 by the manuf cturer. Referring to Table 1 in conjunction with Fig. 2, it will be understood that each model and style of eyeglass frames 24 has its own critical dimensions that need to be known in order to shape the prescription lenses 44 for the eyeglass frames 24. Those measurement variables include the overall peripheral shape of the eyeglass frames 24. Eyeglass f rames 24 retain the prescription lenses 44 in a lens plane. Typically, the lens plane associated with smart glasses 12 is at a slight angle relative to the vertical. This tilt angle is sometimes referred to as the "device panto" in the industry. The tilt of the lens plane is also affected by the tilt angle of the user ' s head. This tilt angle is caused by posture and the way an individual holds his / her head. The device panto is a difficult measurement to assess from a single face-front camera image.

[0063] Within the overall shape of the eyeglass frames 24, there are the lens length " A" and the lens height " B". There is an effective diameter " ED" as measured through the geometric center " GC" of each lens 44. The geometric centers " GC" of both lenses 44 align horizontally on the datum line " DL". The distance between the geometric centers " DBC" is the distance between the geometric centers " GC" in the horizontal plane. The frame length " L" is the distance between temples in the horizontal plane. The bridge size, or distance between lenses " DBL" is the minimum distance between the left and right lenses 44. The frame wrap angle " FWA" describes the horizontal angle of the lens plane in front of the eyes. The pantoscopic tilt angle " PTA" corresponds to the total vertical tilt of the lens plane. The proper pantoscopic tilt angle " PTA" for an individual is highly dependent upon the natural head posture of the individual. This is due to the vertical plane being a constant and any downward tilt of the head directly changing the tilt of the eyeglass frames 24 relative the vertical plane. As such, the pantoscopic tilt angle " PTA" is the sum of the tilt angle caused by the device panto plus the tilt angle cause by head posture.

[0064] Other measurements that depend upon the anatomy of the user 10 wearing the eyeglass frames 24 include pupil height " PH", pupil distance " PD", and rear vertex distance " RVD". The pupil height " PH" is the measured height of the pupils above the bottom of the prescription lenses 44. The pupil distance " PD" is the distance between pupils in the horizontal plane. The rear vertex distance " RVD" is the gap distance between the pupil and the lens 44. The pantoscopic tilt angle " PTA, " pupil height " PH" and the rear vertex distance " RVD" are measurements that depend upon how the prescription lenses 44 are held in front of the eyes. These measurements also depend upon how the user 10 normally orients his / her head when looking through the prescription lenses 44, which determines the points on the lenses 44 where the line of sight passes through the lenses 44. Most, if not all, of the measurements of Table 1 are readily obtained from the camera images 36 of the smart glasses 12 when worn. However, these camera images 36 have no scale.

[0065] Referring to Fig. 3 and Fig. 4 in conjunction with Fig. 1, the illustrations intended to represent exemplary data sets created using camera imaging and / or 3D scanning. Fig. 3 shows the first orientation image / scan data 40 of Fig. 1. Fig. 4 shows the second orientation image image / scan data 42. Fig. 3 is a front image / scan. Fig. 4 is an offset image / scan of the same. The displacement data 43 that indicated the positional changes from Fig. 3 to Fig. 4 can be read directly from the IMU 15 of the smart glasses and the IMU 35 of the electronic imaging device. The first orientation image / scan data 40 and the second orientation image / scan data 42 are analyzed on the electronic imaging device 30 to identify measurement points 48. If the measurement points 48 cannot be clearly ascertained using a single image or scan, multiple images / scans are analyzed stereoscopically using the displacement data 43. In this manner, all measurement points can be determined and / or confirmed with a high degree of accuracy.

[0066] Referring to all figures, it will be understood that the image data and the depth map data form the first orientation image / scan data 40 and the second orientation image / scan data 42 are analyzed using the application software 26. The analysis can be performed by the electronic imaging device 30 or on a remote computer via the data network 18. The application software 26 can identify specific critical measurement points 48 and can calculate those points directly or through stereoscopic analysis. The measurement points 48 correspond to end points between where measurements are typically taken. Some of the measurement points 48, such as the centers of the eyes and the ends of the eyeglass frames 24 may be automatically identified with imaging software. However, due to the large variety in eyeglass frame shapes, faces shapes, frame colors and skin color, reference to the camera image 36 may be needed to ensure all important measurement points 48 are identified.

[0067] The first orientation image / scan data 40 and the second orientation image / scan data 42 can be taken by the electronic imaging device 30 when the user 10 is posed. However, it is preferred that the image data and depth map data be taken while the user 10 is wearing the eyeglass frames 24 in a natural manner. The user 10 is instructed to wear the eyeglass frames 24 in a comfortable position. The user 10 may then be asked to recreate a common situational simulation. If the user 10 typically wears eyeglasses when sitting at a desk, then the user 10 is asked to sit at a desk. If the user 10 typically wears eyeglasses when walking, then the user 10 is asked to walk. Similar situational simulations can be practiced for other activities, such as standing, reading, driving and the like. What is of importance is that the user 10 wears the eyeglass frames 24 in the same manner as they would in real life. Likewise, it is important that the user 10 places his / her body in the same positions and holds his / her head in the same manner as he / she would in everyday life. In this manner, the positions in which the user 10 holds his / her head are measured during natural posture. Likewise, the orientation of the eyeglass frames 24 on the face are also measured in natural orientations for a particular individual. Accordingly, the overall orientation of the eyeglass frames 24 is true to everyday life.

[0068] Referring to Fig. 5 in conjunction with the prior figures, the details of the operation of the present invention measurement system are described. In order to utilize the measurement system, a set of eyeglass frames 24 is first selected. See Block 50. The user 10 is instructed to wear the eyeglass frames 24 in a comfortable manner. See Block 52. The user 10 is then asked to participate in a situational activity. See Block 54. For example, if the user 10 typically wears eyeglasses when sitting at a desk, the user 10 is asked to sit at a desk. If the user 10 typically wears eyeglasses when walking, the user 10 is asked to walk. Similar situational activities can be practiced for other common situations, such as standing, reading and like. What is of importance is that the user 10 wears the eyeglass frames 24 in the same manner as he / she would in real life.

[0069] During the performance of the situational activities, the user 10 is imaged with the camera 32 and imaged with the 3D imaging system 34 while in a first orientation. This produces the first orientation image / scan data 40. See Block 55. The user 10 is subsequently scanned in a different second orientation. This produces the second orientation image / scan data 42. See Block 56. The displacement between the first orientation and the second orientation is measured by the IMU 15 in the smart glasses 12 and / or the IMU 35 in the electronic imaging device 30. This produces the displacement data 43. See Block 57.

[0070] An optician, lens fabricator or other such technician identifies measurement points 48 needed for the fabrication of the prescription lenses 44. See Block 58.

[0071] Referring to Block 60, it will be understood that the first orientation image / scan data 40 and the second orientation image / scan data 42 are subjected to stereoscopic analysis using the displacement data to calculate perspective angles. This identifies the exact coordinates of all the selected measurement points 48 in a 3D reference frame. See Block 62. The operational software 26 run by the electronic imaging device 30 then can calculate the exact distances between the various measurement points 48 in 3D coordinates. See Block 64. As a result, when combined with the location of common ophthalmic measurement points, all the fabrication measurements presented in Table A can be obtained.

[0072] Once all the variables listed in Table A become known, proper prescription lenses 44 can be fabricated for the eyeglass frames 24. See Block 66. The prescription lenses 44 are not only properly crafted for magnification, but are customized for how the eyeglass frames 24 hold the lenses 44 in front of the eyes of the user 10.

[0073] Many smart glasses contain cameras and 3D imaging systems. The 3D imaging systems are designed into smart glasses to provide the cameras with autofocus capabilities and other advanced imaging capabilities. Referring to Fig. 6, an alternate embodiment of the present invention system 70 in shown. In this embodiment, eyeglass frames 72 are provided that contain both a camera 74 and a 3D imaging system 76. The eyeglass frames 72 also contain an IMU 75 that can measure displacement of the eyeglass f rames 72. In this embodiment, there is no need for a separate electronic imaging device. Rather, the smart glasses 78 can serve as its own smart imaging device.

[0074] In the system 70, the user 10 selects the eyeglass frame 72 of the smart glasses 78 and wears the eyeglass frames 72. The smart glasses 78 are activated and the user is instructed to look into a mirror 80 in a first orientation and at least one second orientation. The mirror 80 has the ability to reflect both visible light and the infrared light utilized by the 3D imaging system 76. Accordingly, the mirror 80 may be provided by the eyewear professional conducting the fitting.

[0075] The user 10 wears the eyeglass frames 72 in a comfortable manner. The user 10 looks into the mirror 80, wherein the camera 74 of the smart glasses 12 captures the mirrored image and the 3D imaging system 76 captures a depth map scan. The 3D scan would capture the depth map of a virtual face behind the mirror at roughly twice the distance of the actual face to the mirror. This action is repeated in at least two orientations. The first orientation image / scan data 82 and the second orientation image / scan 84 are processed with use of the displacement data of the IMU 75 in the manner previously described to produce three-dimensional coordinates of selected measurement points. The calculations can be performed by the electronics within the smart glasses 78. Alternatively, the smart glasses 78 can be linked to an external computer via a data network. In either scenario, all the fabrication measurements presented in Table A can be calculated. Once all the variables listed in Table A become known, proper prescription lenses can be fabricated for the eyeglass frames 72. The prescription lenses are not only properly crafted for magnification, but are customized for how the eyeglass frames 72 hold the lenses in front of the eyes of the user.

[0076] It will be understood that the exemplary embodiments of the present invention system that are illustrated and described are merely exemplary and that many aspects of the systems can be redesigned in manners that are functionally equivalent. All such variations, modifications and alternate embodiments are intended to be included within the scope of the present invention as claimed.

Claims

WHAT IS CLAIMED IS:

1. A method of obtaining at least some measurements needed to correctly fabricate prescript ion lenses ( 44 ), said method comprising the steps of:providing eyeglass frame s ( 24 ) into which said prescription lenses ( 44 ) are to be set;having an individual wear said eyeglas s f rames ( 24 );imaging and scanning the individual wearing said eyeglas s frame s (24 ) in a first orientation to obtain a first set of image / s can data ( 40 );imaging and scanning the individual wearing said eyeglas s frame s (24 ) in a second orientation to obtain a second set of image / scan data ( 42 );determining di splacement of the individual wearing said eyeglas s frames ( 24 ) between said first orientation and said second orientation, therein producing displacement data ( 43 );identifying measurement point s ( 48 ) on the individual and said eyeglass f rame s ( 24 );stereoscopically analyzing said first set of image / scan data ( 40 ) and said second set of image / scan data ( 42 ) in conjunction with said displacement data ( 43 ) to determine coordinates forsaid measurement points (48); andcalculating distances between said coordinates, wherein said distances are fabrication measurements needed to fabricate prescription lenses (44 ) for said eyeglass frames (24 ).

2. The method according to Claim 1, wherein imaging and scanning the individual wearing said eyeglass frames (24 ) in said first orientation is performed by an electronic imaging device (30) that can be moved relative to said eyeglass frames (24 ).

3. The method according to claim 1, wherein said electronic imaging device (30 ) contains an internal measurement unit (35 ) that produces at least some of said displacement data (43) as said electronic imaging device (30 ) is moved relative to said eyeglass frames (24 ).

4. The method according to claim 1, wherein said eyeglass frames (24 ) contain an internal measurement unit (15 ) that produces at least some of said displacement data ( 43) as said electronic imaging device (30) is moved relative to said eyeglass frames (24 ).

5. The method according to Claim 1, wherein said eyeglas s frame s (24 ) are for smart glas ses ( 12 ), wherein imaging and scanning the individual wearing said eyeglas s frames ( 24 ) in said first orientation is performed by an electronic imaging device ( 30 ) that is contained within said eyeglas s f rames ( 24 ).

6. The method according to claim 5, further including providing a mirror ( 80 ), wherein said smart glas ses ( 12 ) image and scan themselves via said mirror ( 80 ).

7. The method according to Claim 1, wherein said distances between coordinates are indicative of lens length, lens width, and frame length for said eyeglas s frame s ( 24 ).

8. The method according to Claim 1, wherein said distances between said coordinates are indicative of a pupil height and pupil distance for the individual wearing said eyeglass f rames ( 24 ).

9. The method according to Claim 1, wherein said distances between said coordinates include distances between points on both said eyeglas sframes (24 ) and the individual from which a pantoscopic tilt angle and rear vertex distance can be measured.

10. A method of obtaining at least some measurements needed to correctly fabricate lenses ( 44 ) for an individual, said method comprising the steps of:providing eyeglass frames (24 ) into which said lenses (44 ) are to be set;providing an electronic imaging device (30 ) having a camera (32 ) and a 3D imaging system (34 ), wherein said electronic imaging device (30 ) images and scans said eyeglass frames (24 ) being worn by the individual in a first orientation and in a second orientation, therein producing a first orientation set of data (40) and a second orientation set of data (42 );calculating coordinates for selected points on said eyeglass frames (24 ) using said first orientation set of data (40) and said second orientation set of data (42 );calculating distances between at least some of said selected points, wherein said distances are fabrication measurements needed to fabricate said lenses (44 ) for said eyeglass frames (24).

11. The method according to claim 10, further including imaging and scanning the individual wearing said eyeglas s frames ( 24 ) in said first orientation with an electronic imaging device ( 30 ) that can be moved relative to said eyeglas s frames ( 24 ).

12. The method according to claim 11, wherein said electronic imaging device ( 30 ) contains an internal measurement unit (35 ) that produces displacement data ( 43 ) indicative of movement between said electronic imaging device ( 30 ) and said eyeglas s frame s ( 24 ).

13. The method according to claim 10, wherein said eyeglas s frame s (24 ) contain an internal measurement unit ( 15 ) that produce s displacement data ( 43 ) indicative of movement between said electronic imaging device ( 30 ) and said eyeglas s f rames ( 24 ).

14. The method according to Claim 10, wherein said eyeglas s frame s (24 ) are for smart glas ses ( 12 ), wherein providing an electronic imaging device ( 30 ) having a camera (32 ) and a 3D imaging system(34 ) includes providing smart glasses ( 12 ) that contain said electronic imaging device (30 ).

15. The method according to claim 14, further including providing a mirror (80 ), wherein said smart glasses (78 ) image and scan themselves via said mirror (80 ).

16. The method according to Claim 10, further including the step of fabricating said lenses (44 ) using said fabrication measurements.

17. The method according to Claim 10, wherein said fabrication measurements include measurements for pupil height, pantoscopic tilt angle, and rear vertex distance.

18. The method according to Claim 10, wherein said fabrication measurements include measurements for lens length, lens width, and frame length.

19. The method according to Claim 10, wherein said fabrication measurements include measurements for pupil height and pupil distance.

Images