Optical system for pupil detection of a user of data glasses
The optical system for smart glasses uses virtual cameras generated by a projector unit with deflection devices and holographic elements to accurately detect the pupil center and model the eye, addressing the complexity and cost issues of separate camera-based systems.
Patent Information
- Application Number
- DE102024201170
- Authority / Receiving Office
- DE · DE
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2024-02-09
- Publication Date
- 2025-08-14
AI Technical Summary
Existing optical systems for smart glasses require a separate camera for pupil detection, which increases complexity and cost.
An optical system for smart glasses that uses a projector unit with an actuatable deflection device and photodetector to generate virtual cameras that sweep over the pupil, allowing for pupil detection without a separate camera, utilizing infrared light and holographic optical elements to redirect light beams for precise pupil center determination.
Enables precise and computationally efficient pupil detection by generating virtual cameras that sweep over the pupil, determining the pupil center accurately, and allowing for three-dimensional modeling of the eye, while eliminating the need for a separate camera.
Smart Images

Figure 00000000_0000_ABST
Abstract
Description
[0001] The invention relates to an optical system for pupil detection of a user of data glasses. The invention also relates to data glasses with the optical system and a method for pupil detection of a user of data glasses using an optical system. State of the art
[0002] Document US10852817B1 discloses an optical system that uses an imaging system to generate an image of the eye using a camera. The entire eye region is captured by a detector and subsequently imaged onto a camera sensor.
[0003] The invention is based on the object of developing an optical system which does not require such a separate camera for the pupil detection of a user of data glasses. Disclosure of the invention
[0004] To achieve this object, an optical system for pupil detection of a user of data glasses according to claim 1 is proposed. Furthermore, data glasses according to claim 10 and a method for pupil detection of a user of data glasses according to claim 11 are proposed.
[0005] The optical system for pupil detection of a user of data glasses comprises at least one projector unit with at least one first light source for generating at least one first light beam invisible to the human eye. The invisible light beam is, in particular, an infrared first light beam. The projector unit also has a controllable deflection device for the at least one first light beam. The controllable deflection device is, in particular, designed for scanningly deflecting the first light beam onto at least one optical element of the optical system. The controllable deflection device is, in particular, at least one rotatably mounted micromirror. The optical system also comprises the at least one optical element, which is designed to deflect the incoming first light beam at a first point in time such that a first virtual camera is generated.A virtual camera is understood in particular to be a virtual junction of several light beams which emit first light beams from the junction, in particular in the form of a light cone. The first light beam of the first virtual camera completely covers a pupil of the user at the first point in time. Furthermore, the optical element is designed to redirect the incoming first light beam at a second point in time following the first point in time in such a way that a second virtual camera is generated. Here, too, the virtual camera is understood in particular to be a virtual junction of several light beams which emit first light beams from the junction, in particular in the form of a light cone. The first light beam of the second virtual camera completely covers the pupil of the user at the second point in time.The optical system further comprises a photodetector which is designed to detect the first light beam scattered back by the pupil, in particular at the first and second points in time. The photodetector is in particular a photodiode or a CCD sensor. The photodetector is in particular arranged externally to the projector unit. Alternatively, the photodetector is integrated into the projector unit, in particular the first light source, and is designed as a laser feedback interferometry (LFI) sensor. The optical system further comprises a computing unit which is designed to determine a first center of a pupil of the user of the data glasses from the first light beam detected, in particular at the first and second points in time. The first center is in particular the center, in particular the center of gravity, of the pupil in the pupil plane of the user.Determining the first pupil center enables a precise and computationally efficient method for pupil detection.
[0006] Preferably, the first virtual camera redirects the first light beam, in particular a scanning one, in the form of a first light cone toward the user's pupil. The second virtual camera redirects the first light beam, in particular a scanning one, in the form of a second light cone toward the user's pupil. In this context, the computing unit is configured to generate a first image of the pupil from the first light beam detected by the photodetector at the first time and a second image of the pupil from the first light beam detected by the photodetector at the second time.Furthermore, the computing unit serves to determine the first center, in particular the first center of gravity, of the user's pupil as a function of an intersection point of the first light beam, which is arranged in a second center, in particular a second center of gravity, of the first image of the pupil, and the first light beam, which is arranged in a third center, in particular a third center of gravity, of the second image of the pupil. In this case, the pupil is usually elliptical. This allows the center of the user's pupil to be determined easily and reliably. Preferably, the computing unit is designed to determine the first center of the user's pupil as a function of a minimum distance between the first light beam, which is arranged in the second center of the first image of the pupil, and the first light beam, which is arranged in the third center of the second image of the pupil.This is particularly helpful in a case where there is no specific intersection point of the first light rays.
[0007] The optical system preferably has a first deflection unit, in particular a tilting mirror, as the first optical element and a first holographic optical element as the second optical element. The first deflection unit is designed to deflect the first light beam at at least two different deflection angles onto the first holographic optical element, such that the first light beam impinges on at least a first partial region of the first holographic optical element at a first angle of incidence at a first time and on at least a second partial region of the first holographic optical element at a second time at a second angle of incidence. The first and second partial regions of the first holographic optical element overlap at least partially.The first holographic optical element is configured to redirect the first light beam upon impingement on the first holographic optical element at the first angle of incidence at the first time such that the first light beam redirected by the first holographic optical element completely sweeps over a pupil of the user of the data glasses. Furthermore, the first holographic optical element is configured to redirect the first light beam upon impingement on the first holographic optical element at the second angle of incidence at the second time such that the first light beam redirected by the first holographic optical element completely sweeps over the pupil of the user of the data glasses.
[0008] Preferably, the optical system alternatively comprises an optical segment lens as the third optical element and a second holographic optical element as the fourth optical element. The segment lens here has at least a first and a second segment with mutually different optical deflection functions, such that the first light beam is deflected in the first segment onto at least a first partial region of the second holographic optical element and in the second segment onto at least a second partial region of the second holographic optical element. The first and second segments are in particular arranged adjacent to one another. The first and second partial regions of the second holographic optical element here at least partially overlap.The second holographic optical element is designed to redirect the first light beam coming from the first segment upon impingement on the second holographic optical element such that the first light beam redirected by the second holographic optical element completely sweeps over the pupil of the data glasses user. The second holographic optical element is designed to redirect the first light beam coming from the second segment upon impingement on the second holographic optical element such that the first light beam redirected by the second holographic optical element completely sweeps over the pupil of the data glasses user.
[0009] Preferably, the optical system alternatively comprises a third holographic optical element as the fifth optical element and a fourth holographic optical element as the sixth holographic optical element with mutually different optical deflection functions. The third and fourth holographic optical elements are arranged adjacent to one another. The third holographic optical element is designed to deflect the first light beam upon impingement on the third holographic optical element such that the deflected first light beam completely sweeps over the user's pupil. The fourth holographic optical element is designed to deflect the first light beam upon impingement on the fourth holographic optical element such that the deflected first light beam completely sweeps over the user's pupil.
[0010] The computing unit is preferably designed to determine a position of the eye of the user of the data glasses relative to the spectacle lens of the data glasses. For this purpose, a distance of the eye of the user of the data glasses relative to the spectacle lens of the data glasses is determined. Such a distance can be determined in particular from the two virtual camera nodes and the first center of the pupil. In order to determine the position, the computing unit is designed to determine a plurality of different first centers of the user's pupil and to create a three-dimensional spherical model of the user's eye from these. Here, xc, yc and zc (the respective center of the sphere in space) are determined from the data points and the radius of the sphere is assumed to be constant at 12 mm. In the simplest case, a least-squares algorithm can be used to fit the eye model, in which all data points are calculated over a specific time window, e.g.100 samples are accumulated and then the fitting error is minimized. To be more robust against outliers, the RANSAC (random sample consensus) approach can be used alternatively, in which the fit function is iteratively fitted taking outliers into account. It is also conceivable to formulate a minimization problem, for example by iteratively fitting the optimal position of the eyeball center using a gradient-based optimizer (e.g., Levenberg-Marquardt or Gauss-Newton). This approach uses the triangulation approach and an approach for estimating the three-dimensional eyeball center to determine the respective distance of the eye to the lens using many different pupil detections. This allows any slipping of the glasses to be detected and reacted to accordingly.
[0011] Preferably, the computing unit is designed to determine a gaze vector of the user of the data glasses depending on the determined first center of the pupil and in particular additionally depending on a determined eyeball center of the user of the data glasses.
[0012] A further subject matter of the present invention is data glasses with the optical system described above. Preferably, the respective first, second, third, and / or fourth holographic optical element of the optical system are arranged in a lens of the data glasses. The first and second virtual cameras, in particular the nodes of the first and second virtual cameras, are arranged on a side of the lens facing away from the user's eye.
[0013] A further subject matter of the present invention is a method for pupil detection of a user of data glasses by means of an optical system. The optical system is in particular the optical system described above. Here, at a first point in time, a first light beam invisible to the human eye, in particular an infrared first light beam, is emitted by means of a first light source of a projector unit of the optical system. In a further method step, the first light beam coming from the first light source is deflected, in particular by scanning, onto at least one optical element of the optical system by means of a controllable deflection device of the projector unit. Furthermore, the first light beam coming from the controllable deflection device is deflected at the first point in time by means of the optical element in such a way that a first virtual camera is generated.Furthermore, at the first point in time, the user's pupil is completely scanned by the first virtual camera, and the first light beam backscattered by the pupil is detected by a photodetector. In a further method step, the first light beam coming from the controllable deflection device is deflected by the optical element at a second point in time following the first point in time in such a way that a second virtual camera is generated. Furthermore, at the second point in time, the user's pupil is completely scanned by the second virtual camera, and the first light beam backscattered by the pupil is detected by the photodetector. In a further method step, the first center, in particular a first center of gravity, of the pupil of the user of the data glasses is determined from the first light beam detected, in particular at the first and second points in time.
[0014] Preferably, the first light beam, in particular a scanning one, is redirected in the form of a first light cone toward the user's pupil by means of the first virtual camera at the first time, and a first image of the pupil is generated by the computing unit from the first light beam detected by the photodetector at the first time. Furthermore, the first light beam, in particular a scanning one, is redirected in the form of a second light cone toward the user's pupil by means of the second virtual camera at the second time, and a second image of the pupil is generated by the computing unit from the light beam detected by the photodetector at the second time.Furthermore, the first center of the user's pupil is determined as a function of an intersection point of the first light beam, which is arranged in a second center, in particular a second center of gravity, of the first image of the pupil and the first light beam, which is arranged in a third center, in particular third center of gravity, of the second image of the pupil. Description of the drawings Fig. 1 shows a first embodiment of an optical system for pupil detection of a user of data glasses. Fig. 2 shows a second embodiment of an optical system for pupil detection of a user of data glasses. Fig. 3 shows a third embodiment of an optical system for pupil detection of a user of data glasses. Fig. 4 shows the determination of the center of a user’s pupil using two virtual cameras. Fig. Figure 5 shows a three-dimensional spherical model of the user’s eye. Fig. 6 shows a method for pupil detection of a user of data glasses using an optical system. Description of the embodiments
[0015] The Fig. 1 schematically shows a first embodiment of an optical system 11 for pupil detection of a user of data glasses. The optical system 1, which is designed as data glasses, comprises a projector unit 32 with at least one first light source 2 for generating at least one first light beam 10a and 10b invisible to the human eye. The invisible first light beam 10a and 10b is designed as an infrared first light beam. Furthermore, the projector unit 32 comprises a controllable deflection device (not shown for the sake of simplicity) for the at least one first light beam 10a and 10b. The controllable deflection device has at least one rotatably mounted micromirror and is designed in particular for the scanning deflection of the first light beam onto at least one optical element of the optical system 11.In this case, the at least one optical element is designed as an optical segment lens 3 as the third optical element and as a second holographic optical element 8 as the fourth optical element, which redirect the incoming first light beam 10a at a first point in time such that a first virtual camera 6 is generated. The first light beam 10c of the first virtual camera 6 completely sweeps over a pupil 4 of the user at the first point in time. Furthermore, the optical element is designed to redirect the incoming first light beam 10b at a second point in time following the first point in time such that a second virtual camera 7 is generated. The first light beam 10d of the second virtual camera 7 completely sweeps over the pupil 4 of the user at the second point in time.Furthermore, the optical system 11 comprises a photodetector 5, which is designed to detect the first light beam backscattered by the pupil 4, in particular at the first and second points in time. The photodetector is designed as a photodiode or alternatively as a CCD sensor. Furthermore, the optical system 11 comprises a computing unit 34, which is designed to determine a first center, in particular a first center of gravity, of a pupil 4 of the user of the data glasses from the first light beam detected, in particular at the first and second points in time.
[0016] The segment lens 3 has a first segment 3a and a second, adjacent segment 3b with mutually different optical deflection functions, such that the first light beam 10a is deflected in the first segment 3a onto a first partial region 31a of the second holographic optical element 8 and in the second segment 3b onto a second partial region 31b of the second holographic optical element 8. The first partial region 31a and second partial region 31b of the second holographic optical element 8 overlap at least partially. The second holographic optical element 8 is designed to deflect the first light beam 10a coming from the first segment 3a upon impingement on the second holographic optical element 8 such that the first light beam 10a deflected by the second holographic optical element 8 completely sweeps the pupil 4 of the user of the data glasses.The second holographic optical element 8 is further designed to redirect the first light beam 10b coming from the second segment 3b upon impingement on the second holographic optical element 8 such that the first light beam 10b redirected by the second holographic optical element 8 completely sweeps over the pupil 4 of the user of the data glasses.
[0017] In this embodiment, the computing unit 34 is integrated into the projector unit 32. The projector unit 32, in turn, is integrated into a temple 1 of the data glasses.
[0018] In this embodiment, the second holographic optical element 8 of the optical system 1 is arranged in a spectacle lens 49 of the data glasses. The first virtual camera 6 and the second virtual camera 7, in particular the nodes of the first 6 and second virtual cameras 7, are arranged on a side of the spectacle lens 49 facing away from the user's eye.
[0019] Fig. 2 schematically shows a second embodiment of an optical system 16 for pupil detection of a user of data glasses. In contrast to the previous embodiment, the optical element, which is designed to deflect the incoming first light beam 17a and 17b at a first time and a second time such that a first 13 and a second virtual camera 14 are generated, is designed as a third holographic optical element 20a as the fifth optical element and as a fourth holographic optical element 20b as the sixth holographic optical element. The third holographic optical element 20a and the fourth holographic optical element 20b have different optical deflection functions and are arranged adjacent to one another.The third holographic optical element 20a is configured to redirect the first light beam 17a upon impingement on the third holographic optical element 20a such that the redirected first light beam 17c completely sweeps the user's pupil 15. The fourth holographic optical element 20b is configured to redirect the first light beam 17b upon impingement on the fourth holographic optical element 20b such that the redirected first light beam 17d completely sweeps the user's pupil 15.
[0020] In this embodiment, too, the optical system 16 has a projector unit 9 with at least one first light source 19 for generating the first light beam 17a and 17b, which is invisible to the human eye. Furthermore, the projector unit 9 here also has a controllable deflection device (not shown for the sake of simplicity) for the at least one first light beam 17a and 17b for scanningly deflecting the first light beam 17a and 17b onto the third 20a and fourth holographic optical element 20b. The computing unit 18 is also integrated into the projector unit 9 in this case. The projector unit 9 is also integrated into a spectacle temple 12 here. The photodetector 52 is in this case designed as a laser feedback interferometry sensor and is integrated into the projector unit 9 for this purpose.
[0021] Fig. Figure 3 schematically shows a third embodiment of an optical system 30 for pupil detection of a user of data glasses. In contrast to the previous embodiments, the optical element configured to deflect the incoming first light beam 22a and 22b at a first time and a second time such that a first 27 and a second virtual camera 28 are generated is configured as a first deflection unit 23 as the first optical element and as a first holographic optical element 25 as the second optical element.The first deflection unit 23 is in this case designed as a tilting mirror and serves to deflect the first light beam 22a and 22b at at least two different deflection angles onto the first holographic optical element 25, so that the first light beam 22a impinges on a first partial region 25a of the first holographic optical element 25 at a first angle of incidence at a first time and on a second partial region 25b of the first holographic optical element 25 at a second time at a second angle of incidence. The first partial region 25a and second partial region 25b of the first holographic optical element 25 partially overlap.The first holographic optical element 25 is designed to redirect the first light beam 22a upon impingement on the first holographic optical element 25 at the first angle of incidence at the first time such that the first light beam 22c redirected by the first holographic optical element 25 completely sweeps over a pupil 26 of the user of the data glasses. Furthermore, the first holographic optical element 25 is designed to redirect the first light beam 22b upon impingement on the first holographic optical element 25 at the second angle of incidence at the second time such that the first light beam 22d redirected by the first holographic optical element 25 completely sweeps over the pupil 26 of the user of the data glasses.
[0022] In this embodiment, the optical system 30 also has a projector unit 21 with at least one first light source 43 for generating the first light beam 22a and 22b, which is invisible to the human eye. Furthermore, the projector unit 21 also has a controllable deflection device (not shown for simplicity) for the at least one first light beam 22a and 22b for scanningly deflecting the first light beam 22a and 22b onto the first holographic optical element 25. In this case, the computing unit 44 is separately integrated into a spectacle temple 24. The projector unit 21 is also integrated into the spectacle temple 24. The photodetector 53 is in turn separately integrated into the spectacle temple 24.
[0023] Fig. 4 shows the determination of a first center 36 of a pupil 35 of the user by means of two virtual cameras 40 and 41. The first virtual camera 40 serves to redirect the first light beam, in particular a scanning one, at a first point in time in the form of a first light cone towards the pupil 35 of the user. The second virtual camera 41 serves to redirect the first light beam 54b, in particular a scanning one, at a second point in time in the form of a second light cone towards the pupil 35 of the user. The computing unit, not shown here for the sake of simplicity, is designed to generate a first image 39 of the pupil 35 from the first light beam detected at the first point in time by means of the photodetector (not shown here), and a second image 38 of the pupil 35 from the first light beam detected at the second point in time by means of the photodetector.Furthermore, the computing unit serves to determine the first center 36, in particular the center of gravity, of the user's pupil 35, which is in particular elliptical, as a function of an intersection point of the first light beam 54a, which is arranged in a second center, in particular a second center of gravity, of the first image 39 of the pupil 35 and the first light beam 54b, which is arranged in a third center, in particular third center of gravity, of the second image 38 of the pupil 35.
[0024] Furthermore, the computing unit is optionally designed to determine the first center 36 of the pupil 35 of the user as a function of a minimum distance between the first light beam 35a, which is arranged in the second center of the first image 39 of the pupil 34, and the first light beam 54b, which is arranged in the third center of the second image 38 of the pupil 35.
[0025] Furthermore, the computing unit is optionally designed to determine a position, in particular a distance 37, of the eye 42 of the user of the data glasses relative to the virtual cameras 40 and 41 and thus also to the spectacle lens of the data glasses (not shown here).
[0026] In addition, the computing unit is optionally designed to determine a gaze vector of the user of the data glasses depending on the determined first center of the pupil 35 of the user of the data glasses.
[0027] Fig. Figure 5 schematically shows a three-dimensional spherical model 48 of the user's eye. In this context, the computing unit (not shown here) is configured to determine a plurality 45 of different first centers of the user's pupil and to create the spherical model of the user's eye from these. Furthermore, the two virtual cameras 46 and 47, which emit the first light beams onto the pupil, are shown.
[0028] Fig.6 shows, in the form of a flowchart, a method for pupil detection of a user of data glasses using an optical system. In a method step 60, a first light beam invisible to the human eye, in particular an infrared first light beam, is emitted at a first point in time by a first light source of a projector unit of the optical system. In a subsequent method step 70, the first light beam coming from the first light source is deflected, in particular by scanning, onto at least one optical element of the optical system by means of a controllable deflection device of the projector unit. Furthermore, in a method step 80, the first light beam coming from the controllable deflection device is deflected at the first point in time by means of the optical element in such a way that a first virtual camera is generated.Furthermore, in a method step 100, the user's pupil is completely scanned at the first point in time by the first virtual camera. In a method step 110, the light beam backscattered by the pupil at the first point in time is detected by a photodetector. In a subsequent method step 130, the first light beam is emitted by the first light source at a second point in time following the first point in time. In a subsequent method step 140, the first light beam coming from the controllable deflection device is deflected by the optical element in such a way that a second virtual camera is generated. In a subsequent method step 160, the user's pupil is completely scanned at the second point in time by the second virtual camera.In a subsequent method step 170, the first light rays scattered back from the pupil at the second time are detected by the photodetector. In a subsequent method step 190, a first center, in particular a first center of gravity, of the pupil of the data glasses user is determined from the first light beam detected, in particular at the first and second time points. The method is then terminated.
[0029] In an optional method step 90, the first light beam, in particular a scanning one, is redirected in the form of a first light cone towards the user's pupil by means of the first virtual camera at the first point in time. In a further optional method step 120, a first image of the pupil is generated by means of the computing unit from the light beam detected at the first point in time by means of the photodetector. In a further optional method step 150, at the second point in time, the first light beam, in particular a scanning one, is redirected in the form of a second light cone towards the user's pupil by means of the second virtual camera. In a further optional method step 180, a second image of the pupil is generated by means of the computing unit from the light beam detected at the second point in time by means of the photodetector.In a further optional method step 200, the first center of the user's pupil is determined as a function of an intersection point of the first light beam, which is arranged in a second center, in particular a second center of gravity, of the first image of the pupil and the first light beam, which is arranged in a third center, in particular third center of gravity, of the second image of the pupil. QUOTES CONTAINED IN THE DESCRIPTION
[0000] This list of documents submitted by the applicant was generated automatically and is included solely for the convenience of the reader. This list is not part of the German patent or utility model application. The DPMA assumes no liability for any errors or omissions. Cited patent literature
[0000] US 10852817B1
[0002]
Claims
[1] Optical system (11, 16, 30) for pupil detection of a user of data glasses, at least comprising - a projector unit (9, 21, 32) with at least one first light source (2, 19, 43) for generating at least one first light beam (10a, 10b, 17a, 17b, 22a, 22b) invisible to the human eye, in particular an infrared first light beam, and with a controllable deflection device for the at least one first light beam (10a, 10b, 17a, 17b, 22a, 22b), in particular for scanning deflection of the first light beam (10a, 10b, 17a, 17b, 22a, 22b) onto at least one optical element of the optical system (9, 21, 32), and - the at least one optical element which is designed to redirect the incoming first light beam (10a, 10b, 17a, 17b, 22a, 22b) at a first point in time in such a way that a first virtual camera (6, 13, 27, 40, 46) is generated, wherein the first light beam (10c, 17c, 22c, 54a) of the first virtual camera (6, 13, 27, 40, 46) completely sweeps over a pupil (4, 15, 26, 35) of the user at the first point in time, and wherein the optical element is designed to redirect the incoming first light beam (10a, 10b, 17a, 17b, 22a, 22b) at a second point in time following the first point in time in such a way that a second virtual camera (7, 14, 28, 41, 47), wherein the first light beam (10d, 17d, 22d, 54b) of the second virtual camera (7, 14, 28, 41, 47) completely covers the pupil (4, 15, 26, 35) of the user at the second time, and - a photodetector (5, 52, 53), in particular a photodiode or a CCD sensor, wherein the photodetector (5, 52, 53) is designed to detect the first light beam scattered back by the pupil (4, 15, 26, 35), in particular at the first and second time points, and - a computing unit (18, 34, 44), wherein the computing unit (18, 34, 44) is designed to determine a first center (36), in particular a first center of gravity, of a pupil (4, 15, 26, 35) of the user of the data glasses from the first light beam detected, in particular at the first and second times. [2] Optical system (11, 16, 30) according to claim 1, characterized bythat the first virtual camera (6, 13, 27, 40, 46) deflects the, in particular scanning, first light beam (10c, 17c, 22c, 54a) in the form of a first light cone in the direction of the pupil (4, 15, 26, 35) of the user, and the second virtual camera (7, 14, 28, 41, 47) deflects the, in particular scanning, first light beam (10d, 17d, 22d, 54b) in the form of a second light cone in the direction of the pupil (4, 15, 26, 35) of the user, wherein the computing unit (18, 34, 44) is designed to generate a first image (39) of the pupil from the first light beam detected at the first time by means of the photodetector (5, 52, 53) (4, 15, 26, 35) and from the first light beam detected at the second time by means of the photodetector (5, 52, 53), to generate a second image (38) of the pupil (4, 15, 26, 35), and to determine the first center (36), in particular the center of gravity, of the pupil (4, 15, 26,35) of the user as a function of an intersection point of the first light beam (10c, 17c, 22c, 54a), which is arranged in a second center, in particular a second center of gravity, of the first image (39) of the pupil (4, 15, 26, 35) and the first light beam (10d, 17d, 22d, 54b), which is arranged in a third center, in particular a third center of gravity, of the second image (38) of the pupil (4, 15, 26, 35). [3] Optical system (11, 16, 30) according to claim 2, characterized by in that the computing unit (18, 34, 44) is designed to determine the first center (36) of the pupil (4, 15, 26, 35) of the user as a function of a minimum distance between the first light beam (10c, 17c, 22c, 54a) which is arranged in the second center of the first image (39) of the pupil (4, 15, 26, 35) and the first light beam (10d, 17d, 22d, 54b) which is arranged in the third center of the second image (38) of the pupil (4, 15, 26, 35). [4] Optical system (11, 16, 30) according to one of claims 1 to 3, characterized bythat the optical system (11, 16, 30) has a first deflection unit (23), in particular a tilting mirror, as the first optical element and a first holographic optical element (25) as the second optical element, wherein the first deflection unit (23) is designed to deflect the first light beam (10a, 10b, 17a, 17b, 22a, 22b) at at least two different deflection angles onto the first holographic optical element (25), so that the first light beam (10a, 10b, 17a, 17b, 22a, 22b) impinges at a first time with a first angle of incidence on at least a first partial area (25a) of the first holographic optical element (25), and at a second time with a second angle of incidence on at least a second partial area (25b) of the first holographic optical element (25), wherein the first (25a) and second partial region (25b) of the first holographic optical element (25) at least partially overlap,wherein the first holographic optical element (25) is designed to deflect the first light beam (10a, 10b, 17a, 17b, 22a, 22b) upon impingement on the first holographic optical element (25) at the first angle of incidence at the first time such that the first light beam (10c, 17c, 22c, 54a) deflected by the first holographic optical element (25) completely sweeps over a pupil (4, 15, 26, 35) of the user of the data glasses, and wherein the first holographic optical element (25) is designed to deflect the first light beam (10a, 10b, 17a, 17b, 22a, 22b) upon impingement on the first holographic optical element (25) at the second angle of incidence at the second time such that the first light beam (10c, 17c, 22c, 54a) deflected by the first holographic optical element (25) deflected first light beam (10d, 17d, 22d, 54b) completely covers the pupil (4, 15, 26, 35) of the user of the data glasses., [5] Optical system (11, 16, 30) according to one of claims 1 to 3, characterized bythat the optical system (11, 16, 30) has an optical segment lens (3) as a third optical element and a second holographic optical element (8) as a fourth optical element, wherein the segment lens (3) has at least a first (3a) and a second, in particular mutually adjacent, segment (3b) with different optical deflection functions, so that the first light beam (10a, 10b, 17a, 17b, 22a, 22b) is deflected in the first segment (3a) onto at least a first partial area (31a) of the second holographic optical element (8), and in the second segment (3b) onto at least a second partial area (31b) of the second holographic optical element (8), wherein the first (31a) and second partial areas (31b) of the second holographic optical element (8) at least partially overlap, wherein the second holographic optical element (8) is designed to the first light beam (10a, 10b, 17a, 17b) coming from the first segment (3a),17b, 22a, 22b) upon impingement on the second holographic optical element (8) in such a way that the first light beam (10c, 17c, 22c, 54a) deflected by the second holographic optical element (8) completely sweeps over the pupil (4, 15, 26, 35) of the user of the data glasses, and wherein the second holographic optical element (8) is designed to deflect the first light beam (10a, 10b, 17a, 17b, 22a, 22b) coming from the second segment (3b) upon impingement on the second holographic optical element (8) in such a way that the first light beam (10d, 17d, 22d, 54b) deflected by the second holographic optical element (8) completely sweeps over the pupil (4, 15, 26, 35) of the user of the data glasses. [6] Optical system (11, 16, 30) according to one of claims 1 to 3, characterized bythat the optical system (11, 16, 30) has a third holographic optical element (20a) as a fifth optical element and a fourth holographic optical element (20b) as a sixth holographic optical element with different optical deflection functions, wherein the third (20a) and fourth holographic optical element (20b) are arranged adjacent to one another, wherein the third holographic optical element (20a) is designed to deflect the first light beam (10a, 10b, 17a, 17b, 22a, 22b) upon impingement on the third holographic optical element (20a) in such a way that the deflected first light beam (10c, 17c, 22c, 54a) completely sweeps over the pupil (4, 15, 26, 35) of the user, wherein the fourth holographic optical element (20b) is designed to deflect the first light beam (10a, 10b, 17a, 17b, 22a, 22b) upon impingement on the fourth holographic optical element (20b) such that the deflected first light beam (10d,17d, 22d, 54b) completely covers the pupil (4, 15, 26, 35) of the user. [7] Optical system (11, 16, 30) according to one of claims 1 to 6, characterized by in that the computing unit (18, 34, 44) is additionally designed to determine a position, in particular a distance (37), of the eye (42) of the user of the data glasses relative to the spectacle lens (49) of the data glasses, wherein the computing unit (18, 34, 44) determines a plurality (45) of different first centers (36) of the pupil (4, 15, 26, 35) of the user in order to determine the position and creates a three-dimensional spherical model (48) of the user's eye therefrom. [8] Optical system (11, 16, 30) according to one of claims 1 to 7, characterized by that the computing unit (18, 34, 44) is designed to determine a gaze vector of the user of the data glasses as a function of the determined first center (36) of the pupil (4, 15, 26, 35) of the user of the data glasses. [9] Data glasses with an optical system (11, 16, 30) according to one of claims 1 to 8. [10] Data glasses according to claim 9, characterized by that the respective first (25), second (8), third (20a) and / or fourth holographic optical element (20b) of the optical system (11, 16, 30) is arranged in a spectacle lens (49) of the data glasses, and the first (6, 13, 27, 40, 46) and second virtual camera (7, 14, 28, 41, 47), in particular the node points of the first (6, 13, 27, 40, 46) and second virtual camera (7, 14, 28, 41, 47), are arranged on a side of the spectacle lens (49) facing away from the user's eye. [11] Method for pupil detection of a user of data glasses by means of an optical system (11, 16, 30), in particular an optical system (11, 16, 30) according to one of claims 1 to 9, wherein the method comprises the following method steps: - emitting (60) at least one first light beam (10a, 10b, 17a, 17b, 22a, 22b) invisible to a human eye, in particular an infrared first light beam, by means of a first light source (2, 19, 43) of a projector unit (9, 21, 32) of the optical system (11, 16, 30) at a first time, and - deflecting (70), in particular scanning deflection, the first light beam (10a, 10b, 17a, 17b, 22a, 22b) coming from the first light source onto at least one optical element of the optical system (11, 16, 30) by means of a controllable deflection device of the projector unit (9, 21, 32), and - deflecting (80) the first light beam (10a, 10b, 17a, 17b, 22a, 22b) coming from the controllable deflection device at the first time by means of the optical element in such a way that a first virtual camera (6, 13, 27, 40, 46) is generated, and - completely scanning (100) the pupil (4, 15, 26, 35) of the user at the first time by means of the first virtual camera (6, 13, 27, 40, 46), and - detection (110) of the first light beam scattered back from the pupil (4, 15, 26, 35) at the first time by means of a photodetector (5, 52, 53), and - emitting (130) the first light beam (10a, 10b, 17a, 17b, 22a, 22b) by means of the first light source (2, 19, 43) at a second time following the first time by means of the light source (2, 19, 43), and - deflecting (140) the first light beam (10a, 10b, 17a, 17b, 22a, 22b) coming from the controllable deflection device at the second time by means of the optical element in such a way that a second virtual camera (7, 14, 28, 41, 47) is generated, and - completely scanning (160) the pupil (4, 15, 26, 35) of the user at the second time by means of the second virtual camera (7, 14, 28, 41, 47), and - detection (170) of the first light beam scattered back by the pupil (4, 15, 26, 35) at the second time by means of the photodetector (5, 52, 53), and - Determining (190) a first center (36), in particular a first center of gravity, of the pupil (4, 15, 26, 35) of the user of the data glasses from the first light beam detected, in particular at the first and second points in time. [12] Method according to claim 11, characterized by that the procedure comprises the following additional procedural steps: - deflecting (90) the, in particular scanning, first light beam (10a, 10b, 17a, 17b, 22a, 22b) in the form of a first light cone in the direction of the pupil (4, 15, 26, 35) of the user by means of the first virtual camera (6, 13, 27, 40, 46) at the first time, and - generating (120) a first image (39) of the pupil (4, 15, 26, 35) from the light beam detected at the first time by means of the photodetector (5, 52, 53) by means of the computing unit (18, 34, 44), and - deflecting (150) the, in particular scanning, first light beam (10a, 10b, 17a, 17b, 22a, 22b) in the form of a second light cone in the direction of the pupil (4, 15, 26, 35) of the user by means of the second virtual camera (7, 14, 28, 41, 47) at the second time, and - generating (180) a second image (38) of the pupil (4, 15, 26, 35) from the light beam detected at the second time by means of the photodetector (5, 52, 53) by means of the computing unit (18, 34, 44), and - Determining (200) the first center (36) of the pupil (4, 15, 26, 35) of the user as a function of an intersection point of the first light beam (10c, 17c, 22c, 54a), which is arranged in a second center, in particular a second center of gravity, of the first image (39) of the pupil (4, 15, 26, 35) and the first light beam (10d, 17d, 22d, 54b), which is arranged in a third center, in particular third center of gravity, of the second image (38) of the pupil (4, 15, 26, 35).
Citation Information
Patent Citations
Method and apparatus for determining an eye position using a laser device for data glasses and laser device
DE102022202000A1
Optical system for pupil detection of a user of data glasses
DE102022203800A1
Eye tracking method and system and integration of the same with wearable heads-up displays
US20200142479A1