METHOD AND DEVICE FOR MEASURING THE LOCAL BREAKING FORCE AND / OR THE BREAKING FORCE DISTRIBUTION OF A EYEGLASS LENS
Patent Information
- Application Number
- DE502020009532
- Authority / Receiving Office
- DE · DE
- Patent Type
- Patents
- Current Assignee / Owner
- Priority Date
- 2019-04-23
- Filing Date
- 2020-04-22
- Publication Date
- 2024-11-07
- Estimated Expiration
- 2040-04-22
AI Technical Summary
Current methods for measuring the local refractive power and refractive power distribution of spectacle lenses are either complex, require significant equipment, or fail to provide accurate, localized measurements, particularly for individualized, toric, and progressive lenses.
A method using an image capture device to capture images of a scene with and without the spectacle lens from multiple recording positions, employing image processing and triangulation to determine the local refractive power by calculating the coordinates of structure points and minimizing error through ray tracing, allowing for precise measurement of refractive power distribution across the lens.
Enables simple, equipment-efficient determination of local refractive power and refractive power distribution with high accuracy, ensuring correct alignment and positioning of spectacle lenses for optimal vision, particularly for complex lens designs.
Description
[0001] The invention relates to a method for measuring the local refractive power and / or the refractive power distribution of a left and / or right spectacle lens, preferably in a spectacle frame. Furthermore, the invention relates to a computer program product comprising a computer program with program code and a device for implementing the method.
[0002] In order to enable a spectacle wearer to see clearly, the lenses in the frame must be correctly positioned and aligned to the wearer's eyes. Correct alignment and positioning is fundamentally necessary for all spectacle lenses. Correct alignment and positioning of the lenses is particularly important for customized optical lens designs, toric lens designs, lenses with high dioptric power, and progressive lenses. Progressive lenses enable wearers to see clearly in different usage situations, e.g. at different distances, simply by changing the direction of gaze, without the need for any major accommodation by the eyes. Progressive lenses are designed according to DIN EN ISO 13666:2013-10, paragraph 8.3.5 Spectacle lenses with at least one progressive surface and an increasing (positive) dioptric power when the wearer looks downwards. Customized spectacle lenses and / or progressive lenses have one or more reference points, e.g. a distance visual point and / or a near visual point, the position of which must be adapted to the position of the pupils of the wearer's eyes depending on the usage situation. According to DIN EN ISO 13666:2013-10, paragraph 5.16, the distance visual point is the assumed position of the visual point on a spectacle lens for distance vision under certain conditions. According to DIN EN ISO 13666:2013-10, paragraph 5.17, the near visual point is the assumed position of the visual point on a spectacle lens for near vision under certain conditions. With toric spectacle lens designs, there is also the need for the cylindrical power to be oriented correctly for the wearer.
[0003] A method and device of the type mentioned above are known from WO 2016 / 207412 A1. This describes the measurement of the local refractive power of a left and / or right spectacle lens in a spectacle frame using a measuring device in which the spectacle frame is arranged. This measuring device contains an image capture device and a display for displaying a test structure, the position of which is known relative to the image capture device. By means of the image capture device, the test structure displayed on the display is captured using an imaging beam path that passes through the left and / or right spectacle lens in the spectacle frame. In addition, a section of the spectacle frame is captured using the display, which defines a coordinate system of the spectacle frame.In a computer unit, the local refractive power of a left and / or right spectacle lens is then determined by means of image processing from the captured section of the spectacle frame and the captured image of the test structure as well as from the coordinates of the test structure and the captured image of the test structure in a coordinate system referenced to the coordinate system of the spectacle frame.
[0004] EP 2 608 109 A1 discloses a method for determining the refractive power of a spectacle lens in the wearing position. A photograph of the wearer without the frame and a photograph of the wearer with the frame are taken, and the size of the iris is determined in both photographs. The refractive power of the spectacle lens is determined from the difference in size and the focal length of the camera. This method requires the wearer to be wearing the spectacles. Furthermore, this method does not allow for the local determination of the refractive power at individual points on the spectacle lens or the determination of the individual optical paths through the spectacle lens.
[0005] US 2015 / 0362998 A1 and US 10,019,140 B1 each describe methods for determining the distance of a person's face from an image capture device capturing that face using photogrammetry.
[0006] WO 2016 / 076530 A1 discloses a method for measuring the refractive power of spectacles, in which the refractive power of the lens is determined from the difference in size of an object between a picture taken without a spectacle lens and a picture taken through the spectacle lens.
[0007] WO 2017 / 134275 A1 describes the measurement of the global refractive power of a left and / or right spectacle lens in a spectacle frame by evaluating at least one image of a left and / or right spectacle lens in a spectacle frame, captured against a background whose geometry is either known or estimated. In addition, at least one image of the background without the spectacle frame is captured. From these images, only a global refractive power of the front and back surfaces of the lens is determined, but not a local refractive power at different locations on the lens or a refractive power distribution.
[0008] US 2015 / 0029323 A1 describes an image processing device with a memory and a processor coupled to the memory, which serves to determine the optical properties of a pair of spectacles by evaluating images of the wearer, which are captured by an image capture device and show the wearer with and without the spectacles. US 2015 / 0029323 A1 states that the refractive power of a spectacle lens in the spectacles can be determined based on the spatial position of a facial contour of the face of a spectacle wearer captured through spectacles with spectacle lenses and the spatial position of a captured facial contour of this face.
[0009] The object of the invention is to determine the focusing or dioptric power of a left and / or right spectacle lens for distance and / or near vision in a simple manner and without requiring significant equipment complexity. In particular, the object of the invention is to determine a local refractive power at different locations on a spectacle lens, i.e., a refractive power distribution, with high accuracy.
[0010] This object is achieved by the method specified in claim 1 and claim 2. Advantageous developments of the invention are specified in the dependent claims.
[0011] In the method specified in claim 1 for measuring the local refractive power of a left and / or a right spectacle lens in a spectacle frame, in a first step at least one first image of a scene is captured from at least one first recording position by means of at least one image capture device, said at least one first image having many structural points and containing a left and / or a right spectacle lens in a spectacle frame, the at least one imaging beam path for each of these structural points passing through the first or the second spectacle lens of the spectacle frame.
[0012] This invention defines refractive power as the focusing power or dioptric power of a spectacle lens. According to the definition given in DIN EN ISO 13666:2013-10, paragraph 9.2, this invention defines the focusing power as the collective term for the spherical and astigmatic power of a spectacle lens. According to the definition given in DIN EN ISO 13666:2013-10, paragraph 9.3, this invention defines the dioptric power of a spectacle lens as the collective term for the focusing and prismatic power of the spectacle lens. According to the definition given in DIN EN ISO 13666:2013-10, paragraph 10.9, this invention defines the prismatic power of a spectacle lens as the collective term for prismatic deflection and base position.
[0013] For this invention, local refractive power means the local focusing effect or the local dioptric effect of a spectacle lens.
[0014] For this invention, refractive power distribution means the spatially resolved focusing effect or the spatially resolved dioptric effect of a spectacle lens.
[0015] For the purposes of the invention, a scene is defined as a section of an environment that can be captured with at least one image capture device, e.g., with at least one digital camera integrated, for example, into a smartphone or a tablet computer. A scene can be, for example, a section of a room in an apartment, a section of a shop, or a part of a landscape. However, a scene can also contain a face or just the left eye and / or the right eye of a person wearing the glasses.
[0016] At least one structural point of a scene is understood here to be a geometric point whose image can be clearly identified in at least one image or recording of the scene by capturing the scene with at least one image capture device due to a brightness and / or color of an image of points adjacent to this point that differs from the image of this point. A structural point can, for example, be located at a corner or edge of a structure in the scene.
[0017] In the present case, however, the term "structural point" of a scene also encompasses a point in a stationary, time-invariant pattern, e.g., at least one point in a regular or irregular dot pattern, at least one point in a regular or irregular stripe pattern, at least one point in a regular or irregular check pattern, at least one point in a barcode, at least one point in a 2D code, and / or at least one point within a written text, for example, a newspaper or a book or an electronic display device, e.g., a screen. In particular, at least one stationary, time-invariant structural point in a scene can be at least one point on a structured surface, for example, a structured tablecloth or on structured wallpaper.
[0018] However, the term structural point of a scene is also understood here to mean at least one point in a scene whose position can change over time, such as at least one point on the face of a spectacle wearer that is moving, such as a point on the eyebrows, on the lips or a point on the iris. If the position of the at least one structural point in a scene changes over time, its displacement is preferably reconstructed, as far as possible, and then taken into account when determining the local refractive power of a left and / or right spectacle lens. In the event that the displacement of such a structural point cannot be reconstructed, it is advantageous if this structural point is not taken into account when determining the local refractive power and / or the refractive power distribution of a left and / or right spectacle lens.
[0019] The invention preferably understands at least one image capture device to be a digital camera, which is integrated, for example, in a mobile device such as a mobile phone, a smartphone, or a tablet computer. The digital camera can be designed as a stereo camera, a multi-camera, an image sensor with one lens, an image sensor with at least two lenses, and / or a so-called plenoptic camera. It should be noted that a mobile device specified in the above-mentioned manner can also have multiple image capture devices in the form of a digital camera.
[0020] A mobile terminal device is understood to mean, in particular, a device which comprises at least one programmable processor and at least one image capture device, e.g. at least one camera, and at least one acceleration sensor, and which is preferably designed to be worn, i.e. is configured in terms of dimensions and weight such that it can be carried by a person. Further components can be present in the mobile terminal device, such as at least one screen, at least one light source for, for example, visible light from a wavelength range of 380 nm to 780 nm and / or infrared light from a wavelength range of 780 nm to 1 mm and / or at least one light receiver with a sensitivity for, for example, visible light from a wavelength range of 380 nm to 780 nm and / or infrared light from a wavelength range of >780 nm to 1 mm.Typical examples of such mobile terminals are smartphones or tablet PCs, which can have at least one screen, for example a sensor screen (touchscreen), at least one image capture device, e.g. at least one camera, at least one acceleration sensor, at least one light source, at least one light receiver and further components, such as wireless interfaces for mobile radio or WLAN (wireless LAN).
[0021] In this context, an imaging beam path for a structural point is understood to be the path of the light rays that optically image the structural point from the scene as a structural point image into the image of the scene in at least one image capture device. The principal ray of the imaging beam path for a structural point is referred to below as the optical axis forming an axis of symmetry.
[0022] In the method specified in claim 1, in a further step, which can be carried out before or after the first step or simultaneously with the first, at least two further images of the scene without the first and / or the second spectacle lens of the spectacle frame or without the spectacle frame containing the first and / or the second spectacle lens with the structural points depicted in the first image are captured by means of at least one image capture device from at least two different recording positions, wherein at least one of the recording positions can be identical to the at least one first recording position. The at least one image capture device in the further step can be identical to or different from the at least one image capture device from the first step.Preferably, the at least one image capture device in the further step is identical to the at least one image capture device from the first step. Subsequently, in a calculation step, the coordinates of the structural points in a coordinate system are determined from the at least two further images of the scene by image analysis using triangulation.Subsequently, in a step of determining a local refractive power for at least a section of the left spectacle lens and / or a section of the right spectacle lens, the local refractive power is determined from the coordinates of the structural points and the image of the structural points in the at least one first image of the scene by means of an inverse approach, in which the optical interfaces of the left and / or right spectacle lens are calculated from the imaging beam paths for the structural points by minimizing an error size by varying the interface to be determined in each case, wherein the error size for the interface is determined by creating a comparison of beam points in front of and behind the interface by means of ray tracing.
[0023] The method specified in claim 2 for measuring the local refractive power of a left and / or a right spectacle lens in a spectacle frame provides, in a first step, for capturing at least one first image of a scene from at least one first recording position by means of at least one image capturing device, said at least one first image having many structural points and containing a left and / or a right spectacle lens in a spectacle frame, said at least one imaging beam path for each of said structural points passing through the first or the second spectacle lens of the spectacle frame.
[0024] As stated above, the imaging beam path for a structural point is understood here to be the path of the light rays that cause an optical imaging of the structural point from the scene as a structural point image into the image of the scene captured by at least one image capture device. The principal ray of the imaging beam path for a structural point is referred to below as the optical axis forming an axis of symmetry.
[0025] In a further step, which can occur before or after the first step or at the same time as the first step, at least two further images of the scene with the left and / or right spectacle lens in a spectacle frame are captured by means of at least one image capture device from at least two different further recording positions different from the first recording position, each with at least one imaging beam path for the structural points depicted in the first image, wherein this at least one imaging beam path does not pass through the first and second spectacle lenses of the spectacle frame. Then, in a further step, the coordinates of the structural points in a coordinate system are calculated from the respective at least one beam path of the structural points that did not pass through the left and right spectacle lenses by image analysis using triangulation.Subsequently, the local refractive power for at least one section of the left spectacle lens and / or for at least one section of the right spectacle lens is determined from the coordinates of the structural points and the image of the structural points in the at least one first image of the scene using an inverse approach, in which the optical interfaces of the left and / or right spectacle lens are calculated from the imaging beam paths for the structural points by minimizing an error size by varying the interface to be determined in each case, wherein the error size for the interface is determined by creating a comparison of beam points in front of and behind the interface using ray tracing.
[0026] In an advantageous development of a method specified above for measuring the local refractive power of a left and / or a right spectacle lens, preferably in a spectacle frame, a plurality of structural points in a scene are recorded from at least one first recording position in a first image of the scene, and the steps following the recording are carried out on the basis of this respective plurality of structural points.
[0027] In this context, a plurality of structural points is understood to mean a set of points consisting of at least three structural points. It is advantageous if the local refractive power of a left and / or right spectacle lens is measured using at least 10, preferably at least 100, particularly preferably at least 1000, and most preferably at least 10,000 structural points. It is advantageous if the local refractive power of a left and / or right spectacle lens is measured using a number Z of structural points for which the following applies: 100 ≤ Z ≤ 1000.
[0028] By measuring the local refractive power at a variety of different locations on the left and / or right lens, it is possible to determine a refractive power distribution for the left and / or right lens.
[0029] The image analysis of each image preferably includes image processing technologies such as classification, segmentation and triangulation. Using object recognition methods such as segmentation and classification, each image is preferably examined for objects of the scene and / or spectacle frame classes. The object recognition methods can be of a classical nature, such as thresholding, edge- or region-based segmentation, optical flow, or learning nature. If the object recognition methods are of a learning nature, as in the case of the application of learning algorithms, it is necessary to train a neural network with augmented training data in advance. The result of each of these object recognition methods is the position, orientation and boundaries of the objects, here the scene and / or spectacle frame classes. Additional information is the existence of the respective objects in the respective images.For example, it can be determined in this way whether a pair of spectacle frames and / or lenses are present in the image or not. Thus, the classification as to whether it is a first or a second image can be made even after each image has been captured. The classification as to whether it is a first or a second image can still be made without knowing whether it was a first or a second image.
[0030] In the methods specified above, the structural points can each be only stationary or both stationary and time-invariant. Alternatively, the displacement of at least one structural point can be known and / or its displacement can be reconstructed and taken into account when determining the refractive power distribution. Preferably, the structural points are each stationary, particularly preferably both stationary and time-invariant.
[0031] From the refractive power distribution of a left and / or right spectacle lens or at least a portion of a left and / or right spectacle lens determined in one of the methods described above, conclusions can be drawn about the local refractive power at a specific location on the spectacle lens.
[0032] In the methods specified above, in the respective first step, in which at least one first image of a scene is captured from at least one first recording position by means of at least one image capture device, the edge or the edge curve of the left and / or right spectacle lens in a spectacle frame can optionally be captured.
[0033] Preferably, the edge curve is the shape-defining boundary of the lens located on the front surface of the spectacle frame facing away from the face, which in the case of half-rim or full-rim spectacles partially or completely coincides with the front, inner edge of the spectacle frame. In the case of full-rim spectacles, the edge curve on the front surface of the spectacle frame facing away from the face is equal to the front outer edge of the lens or the front inner edge of the frame. In the case of half-rim spectacles, the edge curve on the front surface of the spectacle frame facing away from the face is equal to the front outer edge of the lens or the front inner edge of the frame, provided that a structure is provided by the frame. In the case of half-rim spectacles, provided that there is no structure provided by the frame, the edge curve on the front surface of the spectacle frame facing away from the face is equal to the front outer edge of the lens.In the case of rimless glasses, there is no analogous structure of the frame, ie the term edge curve always refers to the outer edge of the lens on the front surface of the frame facing away from the face.
[0034] If, in the method specified in claim 1, an image capture device arranged in a mobile terminal is used, which contains at least two digital cameras, a stereo camera, a multi-camera, a camera chip with at least two lenses or a plenoptic camera, it may be sufficient to capture a single image of the scene with the spectacle frame containing the first and / or the second spectacle lens, wherein this first image has at least one structural point, and to capture a single further image of the scene without the spectacle frame containing the first and / or the second spectacle lens with the same structural points of the first image of a scene.To increase the accuracy of the method according to claim 1, preferably at least two images of the scene with the spectacle frame containing the first and / or the second spectacle lens and at least two images of the scene without the spectacle frame containing the first and / or the second spectacle lens are captured.
[0035] If, in the method specified in claim 2, an image capture device arranged in a mobile terminal is used, which contains at least two digital cameras, a stereo camera, a multi-camera, a camera chip with at least two lenses, or a plenoptic camera, it may be sufficient to capture a single image of the scene with the spectacle frame containing the first and / or the second spectacle lens, wherein this first image has at least one structural point, wherein the at least one imaging beam path for each of these structural points passes through the first and / or the second spectacle lens, and to capture a single further image of the scene with the spectacle frame containing the first and / or the second spectacle lens, wherein this at least one further image is captured from a recording position different from the first recording position,so that the at least one imaging beam path for each of these structural points does not pass through the first and second spectacle lenses of the spectacle frame. In this embodiment of the method according to claim 2, to increase its accuracy, at least two first images with the spectacle frame and at least two further images of the scene with the spectacle frame are preferably created from different recording positions than the first two recording positions.
[0036] For measuring spectacle lenses with a strongly negative refractive power, i.e. with a principal section with a negative refractive power of less than or equal to -3 dpt, it is advantageous if the scene for determining the local refractive power and / or the refractive power distribution of a left and / or right spectacle lens, in each case preferably in a spectacle frame, contains at least one structural point, preferably at least one stationary, time-invariant structural point, which is detected through a left and / or right spectacle lens and which has a distance from the spectacle lens to be measured, which is preferably between 5 mm and 200 mm.
[0037] The distance of a structural point from a spectacle lens is understood to be the distance of the structural point to the point of intersection of the principal ray of the imaging beam path on the side of the lens facing the structural point. It should be noted that by capturing additional images of the scene from additional, different recording positions, it is fundamentally possible to specify the principal ray for optical imaging in the image capture device for each structural point within the distance range specified above.
[0038] For measuring spectacle lenses with a strongly positive refractive power, i.e. with a principal section with a positive refractive power greater than or equal to +3 dpt, it is advantageous if the scene for determining the local refractive power and / or the refractive power distribution of a left and / or right spectacle lens, in each case preferably in a spectacle frame, contains at least one structural point, preferably at least one stationary, time-invariant structural point, which is detected through a left and / or right spectacle lens and which has a distance from the spectacle lens to be measured that is preferably in front of the focal point of the stronger principal section. This distance is preferably between 5 mm and 100 mm.
[0039] For measuring spectacle lenses with a low refractive power, ie with a main section with a negative refractive power of less than -3 dpt or with a main section with a positive refractive power of greater than +3 dpt, good measurement results are achieved in scenes with at least one structural point, preferably at least one stationary, time-invariant structural point, the distance of which from the spectacle lens to be measured, preferably in a spectacle frame, is up to 600 mm, preferably in a range of 5 mm to 500 mm.
[0040] A finding of the invention is in particular that the local refractive power and / or refractive power distribution of a spectacle lens can be determined very precisely with the method according to the invention if the distance of at least one structural point, preferably at least one stationary, time-invariant structural point, in a scene from a spectacle lens in a spectacle frame is between 10 mm and 50 mm, preferably between 30 mm and 40 mm.
[0041] An advantageous embodiment of the invention provides that a plurality of first images of the scene and a plurality of further images of the scene are captured, each including the spectacle lens whose local refractive power and / or refractive power distribution is to be determined, wherein this spectacle lens is preferably located in a spectacle frame. Alternatively, the spectacle frame can also be removed from the scene when capturing the plurality of further images. For capturing a plurality of first images of the scene and a plurality of further images of the scene, it is advantageous if these span at least part of a hemisphere or a hemisphere around the scene and / or cover a plurality of different recording positions with different recording directions and / or recording distances. The coordinates of the at least one structural point can then be calculated from the plurality of further images of the scene.
[0042] A correspondingly large number of captured first images of the scene and captured further images of the scene increase the accuracy of the method for measuring the local refractive power and / or the refractive power distribution of a left and / or a right spectacle lens, preferably in a spectacle frame.
[0043] By capturing a plurality of images of the scene, in particular of the head, by means of the image capturing device by displacing the at least one image capturing device or, in the case of a stationary image capturing device, by rotating the scene, in particular of the head, wherein the left eye and / or the right eye of the spectacle wearer of the spectacle frame looks towards the displaced image capturing device and from the plurality of images of the scene, in particular of the head, captured thereby, through-vision beam paths for different viewing directions of the left eye and / or right eye of the spectacle wearer of the spectacle frame through the left spectacle lens and / or the right spectacle lens are calculated and for each viewing direction a local refractive power k(x, y) of the left spectacle lens and / or the right spectacle lens is determined, it is possibleto determine the local refractive power of the lenses in the spectacle frame worn by the wearer for a viewing direction chosen by the wearer.
[0044] Measuring the local refractive power and / or the refractive power distribution of a left and right lens in a pair of spectacle frames allows for conclusions to be drawn about the so-called binocular power of a pair of spectacles, i.e., a pair of spectacle frames including both lenses. Binocular power refers to the assessment of the focusing or dioptric power of the left and right lenses for a specific viewing direction. Binocular power can also include higher-order aberrations of the lens, such as coma, or prismatic aberrations.
[0045] Measuring the local refractive power and / or the refractive power distribution of a left and right spectacle lens in a spectacle frame makes it possible to determine whether, for a specific viewing direction, e.g., the astigmatic power, comprising the difference in refractive power in the principal sections and their direction, of the spectacle lens deviates significantly from the binocular target values. The binocular target values are understood to be the subjectively determined refraction of both eyes, comprising the sphere, cylinder with axis, and prism with base position. For the wearer, a deviation from the binocular target values is not or only slightly noticeable if, for example, the deviation of the astigmatic power of the left and right spectacle lenses from the binocular target values is the same.However, this deviation from the binocular target values is clearly noticeable to the spectacle wearer if the deviation of the astigmatic power of the left and right lenses from the binocular target values is different.
[0046] It should be noted that an incorrect prismatic power between the right and left lenses is perceived as very unpleasant by a spectacle wearer. An incorrect nasal prismatic power is more likely to be accepted by a spectacle wearer than an incorrect temporal prismatic power and / or an incorrect elevation prismatic power.
[0047] The method specified above offers the particular advantage that by simultaneously measuring a right and a left spectacle lens in a spectacle frame, the deviation of the prismatic power of the left spectacle lens and the right spectacle lens from a binocular target value in a wearing situation can be determined.
[0048] An advantageous embodiment of the invention provides that the coordinates of the structural points are calculated by evaluating displacements of the images of the structural points in the scene in the images taken from different recording positions in a coordinate system. Feature detection methods, so-called "feature detection methods," can be used, e.g., gradient-based feature descriptors such as SIFT and SURF features or binary feature descriptors such as BRIEF or BRISK features.
[0049] The coordinates of the structural points can be related to any fixed coordinate system, in particular to a coordinate system determined by the at least one image capture device during a recording position. This coordinate system is preferably referenced to the coordinate system of the spectacle frame, which can be defined by a section of the spectacle frame. Two mutually referenced coordinate systems are understood to be coordinate systems for which the coordinates of a point or vector from one coordinate system in the other coordinate system are known. In particular, by determining distances between the coordinates of the structural points, it is possible to determine the local refractive power and / or the refractive power distribution of a left and / or right spectacle lens in a spectacle frame, even based on scenes with temporal changes, such as the face of a spectacle wearer.
[0050] In a further advantageous embodiment of the invention, it is provided that by evaluating neighborhood relationships between the structural points in the scene, a displacement of at least one structural point in a coordinate system is detected, and the coordinates of at least one structural point displaced in a scene are not taken into account when determining the local refractive power and / or refractive power distribution for at least a portion of the right spectacle lens and / or the left spectacle lens in the coordinate system of the spectacle frame. In this way, it can be ensured that movements of structural points in a scene have no influence on the measurement result for the local refractive power and / or refractive power distribution of a left and / or right spectacle lens in a spectacle frame and do not falsify the measurement result.
[0051] The invention is based in particular on the idea that the recording of a plurality of images of a scene, in particular the recording of a film or video sequence of a scene, with at least one image capture device from different recording positions and / or recording directions, the calculation of so-called intrinsic parameters of the at least one image capture device as well as its spatial position in relation to the scene by means of image processing, for example using SLAM algorithms, ie algorithms for the simultaneous localization and mapping ( S simultaneous L localization and Mapping) is possible if the scene contains characteristic structural features with at least one structural point. It is advantageous here if the scene contains characteristic structural features with a large number of clearly defined, preferably stationary, time-invariant structural points. Such characteristic structural features can be, for example, brightness gradients on objects with, for example, an intersection of two edge lines, characteristic colors of objects, or even characteristic geometric shapes of objects.
[0052] In the present invention, intrinsic parameters of an image capture device are understood to be the focal length f of a camera in the image capture device, the coordinates of the image center Z x and Z y , the shear parameter s as well as the scaling parameters mx and my due to differently scaled coordinate axes of the image plane. These parameters are used in a camera calibration operator K ‾ = f ⋅ m x s Z x ⋅ m x 0 f ⋅ m y Z y ⋅ m y 0 0 1 summarized. Within the scope of the invention, intrinsic parameters of a camera can also be distortion parameters, which serve to determine image distortions, in particular radial and tangential distortions. The intrinsic parameters of an image capture device describe how a 3D coordinate of an object point is mapped onto an image plane of the image capture device or how the associated beam path can be calculated from a given point on the image plane in a coordinate system that is fixed to the image capture device.
[0053] The position of an image acquisition device with respect to a coordinate system in space is determined by a rotation operator R ‾ = R 11 R 12 R 13 R 21 R 22 R 23 R 31 R 32 R 33 with det R ‾ = 1 , which determines the rotation of the camera around the center of the coordinate system, and a translation vector T → = t 1 t 2 t 3 , which determines the displacement of the camera center relative to the origin of the coordinate system. A coordinate c in this coordinate system is represented by the mapping rule f c = K ‾ ⋅ R ‾ ⋅ c + T ‾ and the calculation of the corresponding two-dimensional inhomogeneous coordinates by dividing the result vector by its third coordinate to the corresponding 2D coordinates on the image plane of the camera.
[0054] Conversely, a two-dimensional pixel coordinate y in homogeneous coordinates on the image plane of the camera using the imaging rule g y = R ‾ T ⋅ K ‾ − 1 ⋅ y − T ‾ the corresponding light beam that is imaged onto this coordinate can be determined.
[0055] From the multitude of images of a scene, the information of a 3D model of the scene without the spectacle frame, the information regarding the position and orientation of the spectacle frame in the scene, and the information regarding the position of at least one image capture device in the scene are then determined for each individual captured image, i.e., for each point in time of a capture. From this, the ray paths through the spectacle lenses are then determined in order to calculate the local refractive power and / or refractive power distribution of the left and / or right spectacle lens.
[0056] An advantageous development of the invention therefore provides for the use of a SLAM algorithm for calculating the coordinates of the at least one structural point. This increases the accuracy of calculating the coordinates and positions of the image capture devices, minimizes the computational effort required to determine the coordinates of at least one structural point in a scene, and thus keeps the computation time required for this process to a minimum.
[0057] In particular, a SLAM algorithm makes it possible to calculate both a three-dimensional geometry of the scene and the positions of the at least one image capture device when capturing images of the scene from images of the same scene captured from different recording positions, thus showing the scene from different perspectives. A SLAM algorithm comprises a feature recognition routine that detects features present in the scene and a matching routine that recognizes the corresponding feature for each feature in a recording in the images captured from different recording positions.From the corresponding positions of each feature in the image recordings, a three-dimensional model of the scene is then created based on the intrinsic parameters of the at least one image capture device and the positions of the image capture devices in space associated with the recordings.
[0058] A computer program product according to the invention contains a computer program with program code for carrying out the method steps specified above when the computer program is loaded into a computer unit and / or executed in a computer unit.
[0059] A device according to the invention for measuring the local refractive power and / or the refractive power distribution of a left and / or right spectacle lens in a spectacle frame contains at least one image capture device and a computer unit into which a computer program with program code for carrying out the method steps specified above is loaded.
[0060] Such a device can be embodied, in particular, as a smartphone, a tablet computer, or even a digital camera. Advantageous embodiments of the invention are described below, which are illustrated schematically in the drawings.
[0061] The accuracy of a SLAM algorithm, which determines both the position and / or orientation of the at least one image capture device and the position of the structural points in the image, is preferably determined by the calibration of the at least one image capture device used. Such a calibration is capable of assigning a three-dimensional light beam incident on the respective image capture device to each pixel coordinate C of the at least one image capture device. Mathematically, such a calibration can be described as an intrinsic camera calibration operator. Kwhich contains the intrinsic parameters described above. This camera calibration operator K can be determined, for example, from a recording of a special calibration pattern, e.g., a checkerboard pattern or a dot pattern, by means of the at least one image capture device. Alternatively, it is also possible to determine the intrinsic camera calibration operator by evaluating a plurality of images of at least one scene directly from the plurality of images of the scene, which may be based on different recording positions. K to determine.
[0062] Using the calibration described above, the SLAM algorithm can assign to each structural point a plurality of three-dimensional light rays incident on the respective image capture device, which do not pass through the left and right spectacle lenses. From these coordinates, the spatial coordinates of the structural points can then be determined. From these spatial coordinates and the images of the structural points observed through the right and / or left spectacle lenses by the at least one recording unit, a plurality of imaging beam paths can be determined, which pass through the right and / or left spectacle lenses and, after refraction by the right and / or left spectacle lenses, reach the respective known structural point. This ray model thus spanned is preferably used to determine the dioptric power or the local refractive power or the refractive power distribution of the left and / or right spectacle lenses.
[0063] In the case of a regular pattern, its periodicity is also recorded by recording the scene. In a further embodiment of the invention, the local focusing power of the pattern can be inferred from the interpretation of the local direction-dependent magnification or the local direction-dependent reduction of the pattern by at least the right and / or left spectacle lens. According to DIN EN ISO 13666:2013-10, paragraph 9.2, the focusing power is the collective term for the spherical and astigmatic power of a spectacle lens. The local focusing power can thus be determined, for example, specifically at the distance visual point and / or the near visual point. Alternatively, the refractive power distribution of the spectacle lens can be inferred by determining the local focusing power at several points on the spectacle lens.
[0064] In a further aspect, the method described above can be used together with at least one further method. This at least one further method can be, for example, a method for determining a refractive error of a user's eye, preferably a method according to EP 19 170 561.5, wherein this method comprises the following steps: a) displaying a character on a screen, wherein a parameter of the character displayed on the screen is changed; b) detecting an eye movement metric of the user's eye as a function of the character displayed on the screen; and c) determining a point in time at which the eye movement metric of the user's eye results in a recognition threshold of the user for the character displayed on the screen; and d) determining a value for the refractive error of the user's eye from the parameter determined at that point in time.
[0065] Alternatively or in addition to the method described above, the at least one further method may, for example, also be a method for determining at least one optical parameter of a spectacle lens, preferably a method according to the European patent application with the application reference EP19170551.6, this method comprising the following steps: a) capturing an image using a spectacle lens; and b) determining at least one optical parameter of the spectacle lens by means of image processing of the image, wherein the image comprises an eye area including the eyes and / or a facial area adjacent to the eyes of a user of the spectacle lens.
[0066] Alternatively or in addition to the methods described above, the at least one additional method may also be a method for determining a refractive error of a user's eye, preferably a method according to the European patent application with the application reference EP19170558.1, which method comprises the following steps: a) displaying a character on a screen, wherein a parameter of the character displayed on the screen is changed; b) detecting a reaction of the user as a function of the character displayed on the screen; c) determining a point in time at which the user's reaction results in the character displayed on the screen being recognizable to the user; and d) determining a value for the refractive error of the user's eye from the parameter determined at that point in time, wherein the parameter on the
[0067] The character displayed on the screen is a periodic pattern, wherein the parameter of the pattern displayed on the screen comprises at least one spatial frequency, and the value for the refractive error is determined from the spatial frequency of the pattern determined at that time.
[0068] Alternatively or in addition to the methods described above, a method for determining the refractive power distribution of a spectacle lens is also possible as at least one additional method, preferably a method according to the European patent application with the application number EP19170714.0, which enables a local refractive power to be determined from the size and / or shape comparison of the image of the anterior segment of the eye for a specific viewing direction. For this purpose, at least one image of the anterior segment of the eye is taken with and without a spectacle lens in front of it, and the images with and without the spectacle lens are compared with each other.
[0069] In a higher-level application, the various methods described above, i.e. the method according to the invention and the at least one further method, can be combined in order to obtain, for example, greater accuracy or a plausibility check of the results obtained in the individual methods from a comparison of the results obtained in each case. The various methods described above can be carried out one after the other or simultaneously in the higher-level application. If the various methods are carried out one after the other, their order can be independent of one another and / or they can be in any desired order. If the various methods are carried out one after the other, it may be preferable to carry out at least one of the methods according to the invention for determining the refractive power distribution last. A higher-level application can, for example, be a computer program comprising the various methods. They show:
[0070] Fig. 1 shows a scene with a spectacle frame and with an image capture device arranged in different recording positions; Fig. 2 shows a section of a first image of the scene captured by the image capture device in a first recording position; Fig. 3 shows a section of a second image of the scene captured by the image capture device in a further recording position different from the first recording position; Fig. 4 shows a coordinate system of the scene and a coordinate system of the image capture device with a spectacle lens; Fig. 5 shows a ray model of a spectacle frame when observing the scene from two different perspectives; Fig. 6 shows a refractive power distribution calculated from the ray model of the spectacle frame; Fig. 7 shows a flowchart of an embodiment of a method for measuring a left and / or right spectacle lens in a spectacle frame; Fig.Fig. 8 shows a flow diagram of a further embodiment of a method for measuring a left and / or right spectacle lens in a spectacle frame; Fig. 9 shows a further scene with a spectacle frame and with an image capture device arranged in different recording positions; Fig. 10 shows a further scene without the spectacle frame and with the image capture device; Fig. 11 shows a further scene with a spectacle frame and with an image capture device arranged in different recording positions; Fig. 12 shows a section of the image of the scene captured by the image capture device in the first recording position; Fig. 13 shows a further scene without the spectacle frame and with the image capture device; and Fig. 14 shows a section of the image of the scene captured by the image capture device and without the spectacle frame.
[0071] The Fig. 1shows as a scene 10 a table 12 with a tablecloth 14, on which a pair of glasses 16 with a frame 18 and with left and right lenses 20, 22 accommodated therein are arranged next to further objects 24 in the form of a knife, a bottle, a cup, a book and a cigar. The Fig. 1 The scene 10 shown is time-invariant and contains as structure points 26 characteristic points of a pattern of the tablecloth 14 and the objects 24, which define a coordinate system 25 of the scene 10, as well as characteristic points of the spectacle frame 18 of the spectacles 16.
[0072] To measure the local refractive power of the left and right lenses 20, 22 in the glasses 16, the scene 10 is recorded in a plurality of different recording positions 32, 34, 36, ... using the camera 28 in an image capture device 30 embodied as a smartphone. A user holds the smartphone, switched to video mode, with one hand and moves it along a trajectory 38. The user thus records the scene 10 from different perspectives using the camera 28 of the image capture device 30. The image capture device 30 contains a computer unit 40 for processing the images of the scene 10 captured by the camera 28.
[0073] The Fig. 2 is a section 42 of a first image of the scene 10 captured by the image capture device 30 from a first recording position 32 with images 26' of structural points 26. In the Fig. 3a further section 42 of a first image of the scene 10 with images 26' of structural points 26 is shown, captured by the image capture device 30 from a further recording position 36 different from the first recording position 32.
[0074] When the image capture device 30 is displaced relative to the scene 10, as can be seen from the Fig. 2 and Fig. 3 results, a plurality of structural points 26 are each captured with an imaging beam path that passes through or does not pass through the first and / or second spectacle lens 20, 22 in the spectacle frame 18 of the spectacles 16. Furthermore, when the image capture device 30 is displaced relative to the scene 10, images of the scene 10 are captured that contain a section of the spectacle frame 18 defining a coordinate system 44 of the spectacle frame 18.
[0075] The Fig. 4shows the coordinate system 25 of the scene 10 and a coordinate system 46 of the image capture device 30 with a spectacle lens 20, 22. From the many captured images of the scene 10, the computer unit 40 in the image capture device 30 calculates the coordinates of the structure points 26 of a pattern 27 in the scene using a SLAM algorithm by means of a ray model in a coordinate system 46 referenced to the image capture device 30, which in turn is referenced to the coordinate system 25 of the scene 10 and the coordinate system 44 of the spectacle frame 18 of the spectacles 16.
[0076] The Fig. 5shows a ray model of the glasses 16 with imaging beam paths guided into the camera 28 of the image capture device 30 with main rays 53, 53' for structure points 26, when the scene 10 is captured from two different recording positions 32, 34. Such a ray model requires not only knowledge of the positions of the image capture device 30 but also a three-dimensional model for the scene 10 as well as knowledge of the position of the Fig. 1 shown glasses 16 in the scene 10 and, in addition, also the information as to which structural points 26 in the scene 10 the image capture device 30 captures through the left spectacle lens 20 or the right spectacle lens 22 of the glasses 16.
[0077] To do this in the Fig. 5 To calculate the beam model shown, reference is made to the Fig. 4 proceeded as follows: From the pixel coordinate in homogeneous coordinates C = C x C y 1 of a structure point 26 of a pattern 27 of the scene 10 imaged in the camera 28 of the image capture device 30 is determined by a known camera calibration operator K a main ray of an imaging beam path incident on the camera optics in the form of a three-dimensional vector in the coordinate system 46 of the image capture device of the camera 28 r → 0 = K ‾ − 1 ⋅ C with K ‾ = K 11 K 12 K 13 K 21 K 22 K 23 K 31 K 32 K 33 From the known spatial position of the camera 28 and its spatial position in the coordinate system 25, the translation operator K ‾ = K 11 K 12 K 13 K 21 K 22 K 23 K 31 K 32 K 33 and the rotation operator R ‾ = R 11 R 12 R 13 R 21 R 22 R 23 R 31 R 32 R 33 with det R ‾ = 1 These are then r 0 by linear transformation r → Szene = R ‾ T ⋅ r → 0 − T ‾ from the coordinate system 46 of the image capture device of the camera 28 by a rotation operator R corresponding rotation into the coordinate system 25' and then by a translation operator Tcorresponding translation into the coordinate system 25 of scene 10.
[0078] By detecting and tracking stationary, time-invariant structural points 26, whose imaging beam paths do not pass through the lenses, over several recordings at different recording positions 32, 34, 36 by means of feature matching algorithms, the position of each of these structural points 26 in the scene 10 in the coordinate system 46 of the image capture device 30 can be deduced from the intrinsic parameters of the image capture device as well as the location and position of an image capture device at the time of capturing an image.
[0079] From each imaged structural point 26, a principal ray 53, 53', which passes through a spectacle lens 20, 22 of the spectacles 16, is then calculated according to the position of the image capture device 30. From this and the 3D coordinate of the point, a ray model is then obtained that reflects different viewing conditions of the same spectacles 16 in the same scene 10 and that describes the image rays that are deflected and correspond to the various positions of an image capture device.
[0080] Using a so-called inverse approach, it is then possible to determine from this data set both the position and the shape and location as well as the refractive index of the material of the left and right spectacle lenses 20, 22 in the spectacle frame 18 of the spectacles 16 and thus also their optical effect for a spectacle wearer.
[0081] An inverse approach is a reversal of the so-called forward calculation, in which the path of light rays through an optical system consisting of known optical interfaces and known refractive indices between the interfaces is calculated in an optical ray tracing. Provided that the interfaces, their normals and the refractive indices are known, it is possible to uniquely calculate each light ray through the system. In the case of the inverse approach, an optical interface or refractive index is sought that matches a given number of light rays. To determine an error size, the forward calculation is carried out using the area determined using the inverse approach and a comparison is then made of ray points in front of and / or behind the respective interface.By varying the area to be determined, the error magnitude is then specifically minimized using an optimization method. As an alternative to pure optimization methods, which can determine the minimum of an error function through parameter variations, it is also possible to use so-called light-path triangulation methods, which can also be used in combination with an optimization method. Such methods are described, for example, in the aforementioned publication "KN Kutukalos and E. Steger, A Theory of Refractive and Specular 3D Shape by Light-Path Triangulation, University of Toronto."
[0082] The dioptric power of spectacle lenses can be calculated, if their shape and refractive index are known, particularly by forward calculation of beams. The vertex power of a spectacle lens can be determined, for example, by propagating a parallel beam of rays with a diameter of approximately 5 mm, corresponding to the size of the eye's pupil, through the lens in such a way that its chief ray—i.e., its optical axis on the eye side—exits the lens perpendicularly. The value of the vertex power is then the inverse of the distance from the surface of the lens from which the chief ray emerges to the point of the smallest beam waist or extension of the beam.
[0083] In spectacle lenses comprising at least one toric power, the direction-dependent expansion of the beam exhibits two minima. The distance between these two minima and the surface of the lens describes the effect of the two principal sections. The difference between these two principal sections describes the cylindrical effect of the lens. The total deflection of the principal ray by the lens is considered the prismatic effect of the lens at that particular point.
[0084] The so-called intrinsic camera calibration operator is used to convert pixel coordinates C of the camera 28 in the image capture device 30 to the beam vector of an imaging beam path K. The camera calibration operator Kcan be determined, for example, from a recording of a special calibration pattern, e.g., a checkerboard pattern or a dot pattern, using the image capture device. Alternatively, it is also possible to determine the intrinsic camera calibration operator by evaluating a plurality of recordings or images of the scene 10 directly from recordings or images of the scene 10 based on different recording positions 32, 34, 36. K to determine.
[0085] In the Fig. 6 is a graph 52 to a based on the in the Fig. 5 The distribution of the refractive power k(x,y) for the left and right lenses 20, 22 calculated from the ray model of the glasses 16 shown can be seen.
[0086] The Fig. 7 is a flow chart 54 of the above-described method for measuring a left and / or right spectacle lens 20, 22 in a pair of spectacles 16.
[0087] In a first step S1, at least a first image of a scene 10 with a plurality of structural points 26 and with a left and / or a right spectacle lens 20, 22 in a pair of spectacles 16 and with a section of the spectacle frame 18 of the spectacles 16 defining a coordinate system 44 of the spectacle frame 18 of the spectacles 16 is captured by means of an image capture device 30 with an imaging beam path for structural points 26 which passes through the first and / or the second spectacle lens 20, 22 of the spectacles 16.
[0088] In a step S2 following step S1, at least two further images of the scene 10 without the first and / or the second spectacle lens 20, 22 of the spectacles 16 with the structural points 26 depicted in the first image are then captured by means of the image capture device 30.
[0089] In a step S3, the coordinates of the stationary, time-invariant structural points 26 in the coordinate system 25 of the scene 10, which is referenced to the coordinate system 46 of the image capture device 30 in the different recording positions, are then calculated from the at least two further images of the scene 10 by means of image analysis.
[0090] In a step S4 following step S3, the refractive power distribution k(x, y) is then determined for at least a portion of the left spectacle lens 20 in the coordinate system 44 of the spectacle frame 18 referenced to the coordinate system 25 of the scene 10 and / or the refractive power distribution k(x, y) is determined for at least a portion of the right spectacle lens 22 in a coordinate system 25 of the scene 10 referenced to the coordinate system 44 of the spectacle frame 18 from the coordinates of the stationary, time-invariant structural points 26 and the image of the structural points 26 in the at least one first image of the scene 10.
[0091] The Fig. 8 shows a flow chart 54 for an alternative method to the method described above for measuring a left and / or right spectacle lens 20, 22 in a pair of spectacles 16, which is described below with reference to the Fig. 9 to Fig. 12 described.
[0092] Here again, in a first step S1, as in the Fig. 9 to see, by means of an image capture device 30 a sequence of first images of a time-invariant scene 10 with a plurality of structure points 26 and with a left and / or a right spectacle lens 20, 22 in a pair of spectacles 16 is captured together with a section of the spectacle frame 18 which has a Fig. 4 shown coordinate system 44 of the spectacle frame 18 is defined.
[0093] As in the Fig. 9 As can be seen, the capture of images of the scene 10 takes place with imaging beam paths for structure points 26, which at least partially pass through the first and / or the second spectacle lens 20, 22 of the spectacles 16 and are at least partially guided past the first and / or the second spectacle lens 20, 22 of the spectacles 16.
[0094] In a step S2 following step S1, as shown in the Fig. 10As can be seen, a sequence of further images of the scene 10 with stationary, time-invariant structural points 26, but without the glasses 16, is captured. It should be noted that step S2 can also occur before step S1 or simultaneously with it.
[0095] In a step S3, the coordinate system 25 of the scene 10 is referenced to the coordinate system 44 of the spectacle frame 18, and the coordinates of the structural points 26 in the coordinate system 25 of the scene 10, which is referenced to the coordinate system 46 of the image capture device 30 in the different recording positions, are then calculated from the at least one further image of the scene 10 by means of image analysis.
[0096] Then, in a step S4, the refractive power distribution k(x,y) is determined for at least a portion of the left spectacle lens 20 in the coordinate system 44 of the spectacle frame 18 referenced to the coordinate system 25 of the scene 10 and / or the refractive power distribution k(x,y) is determined for at least a portion of the right spectacle lens 22 in the coordinate system 44 of the spectacle frame 18 from the coordinates of the structural points 26 and the image of the structural points 26 in the at least one first image of the scene 10.
[0097] As the Fig. 11 to Fig. 14 show, the measurement of a left and / or right spectacle lens 20, 22 in a spectacle frame 18 is also possible by capturing images of a scene 10 in which a spectacle wearer is present with and without spectacles. Fig. 11to see, by means of an image capture device 30, a sequence of first images of a time-invariant scene 10 with a plurality of structure points 26 and with a left and / or a right spectacle lens 20, 22 in a spectacle frame 18 is captured together with a section of the spectacle frame 18, which defines a coordinate system 44 of the spectacle frame 18. As the Fig. 12 shows, the capture of images of the scene 10 takes place with imaging beam paths for structural points 26, which at least partially pass through the first and / or the second spectacle lens 20, 22 of the spectacles 16 and which are guided at least partially past the first and / or the second spectacle lens 20, 22 of the spectacles 16.
[0098] Then, as in the Fig. 13 and Fig. 14As can be seen, a sequence of further images of the scene 10 with structural points 26, but without the glasses 16, is captured. The coordinates of the structural points 26 are then calculated from the at least one further image of the scene 10 by means of image analysis in a coordinate system 25 of the scene 10, which coordinate system is referenced to the coordinate system 46 of the image capture device 30 at different recording positions, and the coordinate system 25 of the scene 10 is referenced to the coordinate system 44 of the spectacle frame 18.Then, the refractive power distribution k(x,y) is determined for at least a portion of the left spectacle lens 20 in the coordinate system 44 of the spectacle frame 18 and / or the refractive power distribution k(x,y) is determined for at least a portion of the right spectacle lens 22 in the coordinate system 44 of the spectacle frame 18 from the coordinates of the structural points 26 and the image of the structural points 26 in the at least one first image of the scene 10.
[0099] Because structure points 26 are in scene 10, which are in the Fig. 11 and Fig. 13shown, can shift due to movements of the spectacle wearer, the computer unit of the image capture device 30 here contains a program routine by means of which the position of the structure points 26 is calculated by evaluating neighborhood relationships, in particular distances between the structure points 26 in the scene 10, in a coordinate system 25 of the scene 10 referenced to the coordinate system 44 of the spectacle frame 18.
[0100] It can be provided to evaluate the neighborhood relationships between the structural points 26 in the scene 10 in order to detect a displacement of structural points 26 in a coordinate system 25 of the scene 10 and not to take into account the coordinates of structural points 26 displaced in a scene 10 when determining the refractive power distribution for at least a section of the right spectacle lens 22 and the left spectacle lens 20 in the coordinate system 44 of the spectacle frame 18, so that movements of structural points 26 in the scene 10 do not falsify the measurement result for the local refractive power of the left and right spectacle lenses 20, 22.
[0101] In summary, the following should be noted in particular: The invention relates to a method for measuring the local refractive power or the refractive power distribution of a left and / or a right spectacle lens 20, 22 in a spectacle frame 18. At least one first image of a scene 10 with at least one structural point 26 and with a left and / or a right spectacle lens 20, 22 in a spectacle frame 18 is acquired by means of an image acquisition device 30 from at least a first recording position 32 with at least one imaging beam path for structural points 26, which passes through the first and / or the second spectacle lens 20, 22 in the spectacle frame 18. At least two further images of the scene 10 without the first and / or the second spectacle lens 20,22 of the spectacle frame 18 or without the spectacle frame containing the left and / or right spectacle lens with the structural points 26 depicted in the first image are captured by the image capture device 30 from at least two different recording positions 32, 34, 36, one of which may be identical to the first recording position, and the coordinates of the structural points 26 are calculated in a coordinate system 25 from the at least two further images of the scene 10 by means of image analysis, or at least two further images of the scene 10 with the left and / or right spectacle lens 20, 22 are captured by an image capture device 30 from at least two further recording positions different from the first recording position with at least one imaging beam path for the structural points 26 depicted in the first image, which does not pass through the first and / or second spectacle lens 20, 22 of the spectacle frame 18,in order to then determine a refractive power distribution k(x,y) for at least a portion of the left spectacle lens 20 in a coordinate system 25 of the scene 10 referenced to the coordinate system 44 of the spectacle frame 18 and / or a refractive power distribution k(x,y) for at least a portion of the right spectacle lens 22 in a coordinate system 25 from the coordinates of the structural points 26 and the image of the structural points 26 in the at least one first image of the scene 10. List of reference symbols
[0102] 10Scene 12Table 14Tablecloth 16Glasses 18Glass frame 20Left lens 22Right lens 24Objects 25Scene coordinate system 25Scene coordinate system after translation 26Structural point 26Images of structural point 27Pattern 28Camera 30Image capture device 32, 34, 36Shooting position 38Trajectory 40Computer unit 42Detail 44Frame coordinate system 46Image capture device coordinate system 48Left eye 50Right eye 52Graph 53, 53Principal ray 54Flowchart C pixel coordinate K Camera calibration operator RRotation operator T Translation operator S1,S2,S3,S4Step k(x,y)local refractive power or refractive power distribution
Claims
1. Method for measuring the local refractive power of a left and / or a right spectacle lens (20, 22) in a spectacle frame (18), including a step of capturing at least one first image representation of a scene (10) with many structure points (26) and with a left and / or a right spectacle lens (20, 22) in the spectacle frame (18) by means of at least one image capture device (30) from at least one first recording position (32) with at least an imaging beam path for each of these structure points (26), said imaging beam path passing through the left and / or the right spectacle lens (20, 22), including a step of capturing at least two further image representations of the scene (10) without the left and / or the right spectacle lens (20, 22) of the spectacle frame (18) or without the spectacle frame (18) containing the left and / or the right spectacle lens (20, 22) with the structure points (26) imaged in the first image representation by means of the at least one image capture device (30) from at least two different recording positions (32, 34, 36), one of which can be identical to the first recording position (32); and including a step of calculating the coordinates of the structure points (26) in a coordinate system (25) from the at least two further image representations of the scene (10) by means of image evaluation by means of triangulation, characterized by a step of determining a local refractive power of the left spectacle lens (20) and / or of the right spectacle lens (22) from the coordinates of the structure points (26) and the image of the structure points (26) in the at least one first image representation of the scene (10) by means of an inverted approach, in which the optical interfaces of the left and / or right spectacle lens (20, 22) are calculated from the imaging beam paths for the structure points (26) by virtue of the variation of the interface to be determined in each case leading to a minimization of an error term, the error term being determined for the interface by virtue of ray tracing being used to create a comparison of beam points upstream and downstream of the interface.
2. Method for measuring the local refractive power of a left and / or a right spectacle lens (20, 22) in a spectacle frame (18), including a step of capturing at least one first image representation of a scene (10) with many structure points (26) and with a left and / or a right spectacle lens (20, 22) in the spectacle frame (18) by means of at least one image capture device (30) from at least one first recording position (32) with at least an imaging beam path for each of these structure points (26), said imaging beam path passing through the left and / or the right spectacle lens (20, 22), including a step of capturing at least two further image representations of the scene (10) with the left and / or the right spectacle lens (20, 22) by means of at least one image capture device (30) from at least two different further recording positions (34, 36), which differ from the first recording position (32) and which each have at least one imaging beam path for the structure points (26) captured in the first image representation, said imaging beam paths not passing through the left and the right spectacle lens (20, 22) of the spectacle frame (18); and including a step of calculating the coordinates of the structure points (26) from the at least two further image representations of the scene (10) by means of image evaluation by means of triangulation, characterized by a step of determining a local refractive power of the left spectacle lens (20) and / or of the right spectacle lens (22) from the coordinates of the structure points (26) and the image of the structure points (26) in the at least one first image representation of the scene (10) by means of an inverted approach, in which the optical interfaces of the left and / or right spectacle lens (20, 22) are calculated from the imaging beam paths for the structure points (26) by virtue of the variation of the interface to be determined in each case leading to a minimization of an error term, the error term being determined for the interface by virtue of ray tracing being used to create a comparison of beam points upstream and downstream of the interface.
3. Method according to Claim 1 or 2, characterized by capturing a multiplicity of first image representations of the scene (10) and a multiplicity of further image representations of the scene (10), wherein the coordinates of the structure points (26) in the coordinate system (25) are calculated from the multiplicity of further image representations of the scene (10).
4. Method according to any of Claims 1-3, characterized in that the scene (10) contains a left eye (48) and / or right eye (50) of a spectacle wearer of the spectacle frame (18).
5. Method according to Claim 4, characterized in that the image capture device (30) is used to capture a multiplicity of image representations of the scene (10) with a displacement of the image capture device (30), wherein the left eye (48) and / or the right eye (50) of the wearer of the spectacle frame (18) gazes at the displaced image capture device (30) and viewing beam paths for different viewing directions of the left eye (48) and / or right eye (50) of the wearer of the spectacle frame (18) through the left spectacle lens (20) and / or the right spectacle lens (22) of the spectacle frame (18) are calculated from the multiplicity of image representations of the scene (10) captured in the process and a local refractive power k(x, y) of the left spectacle lens (20) and / or of the right spectacle lens (22) is determined for each viewing direction therethrough.
6. Method according to any of Claims 1 to 5, characterized in that a SLAM algorithm is used to calculate intrinsic parameters of the at least one image capture device (30).
7. Method according to Claim 6, characterized by intrinsic parameters from the group of focal length, image centre, shearing parameters, scaling parameters, distortion parameters.
8. Method according to any of Claims 1 to 7, characterized in that a SLAM algorithm is used to calculate the coordinates of the structure points (26) and / or the recording positions (32, 34, 36) of the at least one image capture device (30) in the coordinate system (25); and / or in that the coordinates of at least some of the structure points (26) in the scene (10) are invariant; and / or in that the coordinates of the structure points (26) are calculated in a coordinate system (25) by evaluating displacements between the image representations of the structure points (26) in the scene (10) from different recording positions (32, 34, 36).
9. Method according to any of Claims 1 to 8, characterized in that a displacement of structure points (26) in a coordinate system (25) is recognized by evaluating proximity relations between the structure points (26) in the scene (10), and the coordinates of structure points (26) displaced in a scene (10) are not taken into account when determining a refractive power distribution k(x,y) for at least one section of the right spectacle lens (22) and / or the left spectacle lens (20).
10. Method for measuring the refractive power distribution k(x,y) of a left and / or a right spectacle lens (20, 22) in a spectacle frame (18), wherein a local refractive power of the left and / or right spectacle lens (20, 22) is measured according to any of Claims 1 to 9 at a plurality of different locations on the left and / or right spectacle lens (20, 22).
11. Computer program product comprising a computer program having program code for carrying out all method steps which are specified in any of Claims 1 to 10 when the computer program is loaded on a computer unit of an apparatus according to Claim 12 and / or executed on a computer unit of an apparatus according to Claim 12.
12. Apparatus for measuring the local refractive power of a left and / or a right spectacle lens (20, 22) in a spectacle frame (18), comprising an image capture device (30) and comprising a computer unit (40), loaded onto which is a computer program with program code for carrying out all method steps specified in any of Claims 1 to 9, or for measuring the refractive power distribution of a left and / or a right spectacle lens (20, 22) in a spectacle frame (18), comprising an image capture device (30) and comprising a computer unit (40), loaded onto which is a computer program with program code for carrying out all method steps specified in Claim 10.
13. Apparatus according to Claim 12, embodied as a smartphone or as a tablet computer or as a camera (28).
14. Computer-readable data medium, on which the computer program product according to Claim 11 is stored.
15. Data medium signal, which transmits the computer program according to Claim 11.
