Method for determining a surface speed of an eye of a user of a spectacle device arranged on the head of the user
The method employs laser feedback interferometry sensors and a camera in smart glasses to track the eye's surface speed and position, ensuring accurate eye tracking even when the glasses slip, addressing the inconsistency in existing technologies by merging measurement signals for precise and energy-efficient tracking.
Patent Information
- Application Number
- PCT/EP2024/056918
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2023-05-24
- Filing Date
- 2024-03-15
- Publication Date
- 2024-11-28
AI Technical Summary
Existing eye tracking methods for smart glasses fail to accurately determine the surface speed of a user's eye when the glasses device slips, leading to inconsistent measurements.
A method utilizing a glasses device equipped with first and second laser feedback interferometry sensors with switchable deflection devices for infrared modulated light beams, combined with a camera sensor, to detect and track the eye's position and surface speed, ensuring the light beams hit the eye even if it moves relative to the sensors, and employing a computing unit to merge measurement signals for precise and energy-efficient eye tracking.
This approach allows for accurate and continuous determination of the user's eye surface speed and viewing direction, even when the glasses slip, providing reliable and resource-saving high-speed eye tracking.
Smart Images

Figure EP2024056918_28112024_PF_FP_ABST
Abstract
Description
[0001] Description
[0002] title
[0003] Procedure for the one it one one
[0004] User of a of the user
[0005] The invention relates to a method for determining a surface velocity of an eye of a user of a spectacle device arranged on the user's head. Furthermore, the invention relates to an optical system for determining a surface velocity of an eye of a user of a spectacle device arranged on the user's head, and to a spectacle device comprising the optical system.
[0006] State of the art
[0007] Various eye tracking methods for smart glasses have already been proposed, for example the observation of IR glints on the user's eye using camera sensors.
[0008] Based on this, the invention is based on the object of developing a method for determining a surface speed of an eye of a user of a spectacle device arranged on the user's head, which method ensures the determination of the surface speed of the eye even if the spectacle device arranged on the user's head slips.
[0009] Disclosure of the invention
[0010] To achieve the object, a method for determining a, in particular first and second, surface speed of an eye of a user of a spectacle device arranged on the user's head is proposed according to claim 1. Furthermore, an optical system for determining a surface speed of an eye of a user of a spectacle device arranged on the user's head is proposed according to claim 7 and a spectacle device with the optical system according to claim 15. In the method for determining a, in particular first and second, surface speed of an eye of a user of a spectacle device arranged on the user's head, the spectacle device comprises at least one first sensor.The first sensor comprises at least one first laser feedback interferometry sensor with a first, in particular switchable, deflection device for a first modulated light beam, in particular an infrared beam, emitted by the first laser feedback interferometry sensor. Furthermore, the first sensor comprises a second laser feedback interferometry sensor with a second, in particular switchable, deflection device for a second modulated light beam, in particular an infrared beam, emitted by the second laser feedback interferometry sensor. Furthermore, the spectacle device comprises a computing unit and / or a second sensor embodied as a camera sensor.In the method for determining the surface velocity of the user's eye, a first position of the eye, in particular relative to the first and second laser feedback interferometry sensors, is first detected at a first point in time by means of the first sensor and / or the second sensor. Furthermore, a first control signal of the first deflection device of the first laser feedback interferometry sensor is generated by means of the computing unit such that the first modulated light beam emitted by means of the first laser feedback interferometry sensor strikes the user's eye at the first point in time. Furthermore, a second control signal of the second deflection device of the second laser feedback interferometry sensor is generated by means of the computing unit such that the second modulated light beam emitted by means of the second laser feedback interferometry sensor strikes the user's eye at the first point in time.In addition, a first measurement signal is detected by the first laser feedback interferometry sensor as a function of the first light beam reflected back by the user's eye at the first point in time. Furthermore, a second measurement signal is determined by the second laser feedback interferometry sensor as a function of the second light beam reflected back by the user's eye at the first point in time. A first surface speed of the user's eye is then determined by the computing unit as a function of the detected first and second measurement signals. In addition, a second position of the user's eye, in particular relative to the first and second laser feedback interferometry sensors, is detected by the first sensor and / or the second sensor at a second point in time following the first point in time.Subsequently, a third control signal of the first deflection device of the first laser feedback interferometry sensor is generated by the computing unit such that the first modulated light beam emitted by the first laser feedback interferometry sensor strikes the user's eye at the second point in time. Furthermore, a fourth control signal of the second deflection device of the second laser feedback interferometry sensor is generated by the computing unit such that the second modulated light beam emitted by the second laser feedback interferometry sensor strikes the user's eye at the second point in time. Subsequently, a third measurement signal is acquired by the first laser feedback interferometry sensor as a function of the first light beam reflected back from the user's eye at the second point in time.Furthermore, a fourth measurement signal is recorded by the second laser feedback interferometry sensor as a function of the second light beam reflected back from the user's eye at the second time. A second surface velocity of the user's eye is then determined by the computing unit as a function of the recorded third and fourth measurement signals. This method ensures that the light beams always hit the user's eye, even if the position of the user's eye changes relative to the laser feedback interferometry sensors.
[0011] Preferably, the positions of the user's eye are detected at different times as a function of the recorded distances of the first and / or second laser feedback interferometry sensor relative to the user's eye. In this context, different areas of the user's eye are preferably assigned different distances of the first and / or second laser feedback interferometry sensor relative to the user's eye. Alternatively, the positions of the user's eye are detected at different times as a function of image data acquired by the second sensor, in particular an infrared camera system. A threshold-based approach can be used to detect laser spots in the image data, since the infrared light rays of the LFI sensors are imaged as extremely bright points in the image of the IR camera. Alternatively, and preferably, a learning method can be used.In this context, Convolutional Neural Networks (CNNs) and Mask R-CNNs are particularly worth mentioning. These have the advantage that, in addition to detecting laser spots, they also classify whether the laser hits the eyelids, eyelashes, outside the eye, or whether the laser hits the eye, thus providing valid measurements accordingly.
[0012] Preferably, in addition to determining a viewing direction of the user's eye, the method provides for the detection of, in particular, first and third measurement signals as a function of the first light beam reflected back by the user's eye by means of the first laser feedback interferometry sensor at a first detection frequency. Furthermore, in particular, second and fourth measurement signals as a function of the second light beam reflected back by the user's eye are detected by means of the second laser feedback interferometry sensor at a second detection frequency. The detection of the measurement signals detected by means of the first and second laser feedback interferometry sensors takes place simultaneously. Accordingly, in particular, the first detection frequency corresponds to the second detection frequency.Furthermore, a fifth measurement signal is captured by the second sensor as a camera system with a third capture frequency, which is, in particular, significantly lower than the first and second capture frequencies. The fifth measurement signal corresponds to a, in particular absolute, viewing direction of the user's eye. Furthermore, in at least one method step, the measurement signals from the various sensors are fused to determine the, in particular instantaneous, viewing direction of the user's eye, which is assumed at a time between two consecutive viewing directions determined with the first and / or second capture frequencies. The method thus offers the possibility of determining the viewing direction in an energy-efficient manner at high speed. In this context, the measurement signals from the various sensors are preferably fused by evaluating a discretized integral sequence.This advantageously enables simple, (computing) resource-efficient, yet precise high-speed eye tracking. In particular, when evaluating the discretized integral sequence, the absolute positions determined (most recently) with the second update frequency are used as offset parameters (e.g., OS and 0S). In particular, when evaluating the discretized integral sequence, integration is performed based on the current offset parameters over the data points of the first measurement signals determined (in the sequence up to the next data point of the second measurement signal), in particular over the surface velocities.
[0013] A further subject of the present invention is an optical system for determining a surface velocity of an eye of a user of a spectacle device arranged on the user's head. The optical system comprises a first sensor, which in turn comprises at least one first laser feedback interferometry sensor with a first, in particular switchable, deflection device for a first modulated light beam, in particular an infrared one, emitted by the first laser feedback interferometry sensor. Furthermore, the first sensor comprises a second laser feedback interferometry sensor with a second, in particular switchable, deflection device for a second light beam, in particular an infrared one, emitted by the second laser feedback interferometry sensor. Furthermore, the optical system comprises a computing unit and / or a second sensor embodied as a camera sensor.The first and / or second sensor is designed to detect a first position of the eye at a first point in time. The computing unit serves to generate a first control signal of the first deflection device of the first laser feedback interferometry sensor such that the first modulated light beam emitted by the first laser feedback interferometry sensor strikes the user's eye at the first point in time. Furthermore, the computing unit serves to generate a second control signal of the second deflection device of the second laser feedback interferometry sensor such that the second modulated light beam emitted by the second laser feedback interferometry sensor strikes the user's eye at the first point in time. The first laser feedback interferometry sensor is designed to detect a first measurement signal as a function of the first light beam reflected back by the user's eye at the first point in time.The second laser feedback interferometry sensor is used to detect a second measurement signal as a function of the second light beam reflected back by the user's eye at the first point in time. The computing unit is designed to determine a first surface speed of the user's eye as a function of the detected first and second measurement signals. Furthermore, the first and / or second sensor is designed to detect a second position of the user's eye at a second point in time following the first point in time. The computing unit is used to generate a third control signal of the first deflection device of the first laser feedback interferometry sensor such that the first modulated light beam emitted by the first laser feedback interferometry sensor strikes the user's eye at the second point in time.Furthermore, the computing unit is designed to generate a fourth control signal of the second deflection device of the second laser feedback interferometry sensor such that the second modulated light beam emitted by the second laser feedback interferometry sensor hits the user's eye at the second point in time. The first laser feedback interferometry sensor is designed to detect a third measurement signal as a function of the first light beam reflected back by the user's eye at the second point in time. Furthermore, the second laser feedback interferometry sensor serves to detect a fourth measurement signal as a function of the second light beam reflected back by the user's eye at the second point in time. The computing unit is designed to determine a second surface speed of the user's eye as a function of the detected third and fourth measurement signals.The optical system ensures that the light beams always hit the user's eye, even if the position of the user's eye changes relative to the laser feedback interferometry sensors. The deflection devices significantly increase the range within which the eye can move relative to the laser feedback interferometry sensors while still being hit by both light beams, especially simultaneously.
[0014] The first and / or second laser feedback interferometry sensor are preferably designed as static laser feedback interferometry sensors. A static laser feedback interferometry sensor is specifically meant to be arranged opposite the user's eye. In particular, the light beam emitted by the static laser feedback interferometry sensor, in particular the infrared light beam, is radiated directly onto the user's eye, apart from the deflection by the corresponding deflection device. The first and / or second deflection device preferably comprises at least one LC crystal, in particular an LC crystal array, with two opposing electrodes. Depending on the switching state of the at least one LC crystal, the first and / or second light beam is deflected differently.In particular, the LC crystal changes its rotating orientation depending on the switching state, whereby the first and / or second light beam are deflected differently. The opposing electrodes are made in particular of ITO (indium tin oxide). The electrodes are thus transparent to the light beams, in particular laser beams. Preferably, the first and / or second deflection device each additionally has a first optical element for expanding the first and / or second light beam. The first optical element is arranged between the first and / or second laser feedback interferometry sensor and the LC crystal. The first optical element is in particular a lens or a diffractive optical element.Furthermore, the first and / or second deflection device each additionally has a second optical element for focusing the expanded first and / or second light beam coming from the LC crystal in the direction of the user's eye. The second optical element is in particular a collimating lens or a focusing lens. Preferably, the two electrodes of the LC crystal are arranged perpendicularly relative to a beam direction of the first and / or second light beam. Alternatively, the two electrodes of the LC crystal are arranged parallel relative to a beam direction of the first and / or second light beam. The perpendicular arrangement of the electrodes allows for easy integration into the electronic assembly. The parallel arrangement, in contrast, is advantageous because the light beam of the LFI sensor is not influenced by the electrodes and passes through the crystal without further aberrations caused by the electrodes.
[0015] The first and / or second deflection device is preferably designed as a metal lens structure. In this context, the metal lens structure can be applied as a pattern into a silicon substrate using an etching process and subsequently applied to a mechanical, in particular a micromechanical, structure that actuates the metal lens structure and thus deflects the beam of the LFI sensor. Preferably, the first laser feedback interferometry sensor is additionally designed to detect the measurement signals, in particular the first and third, as a function of the first light beam reflected back by the user's eye at a first detection frequency. Furthermore, the second laser feedback interferometry sensor is additionally designed to detect the measurement signals, in particular the second and fourth, as a function of the second light beam reflected back by the user's eye at a second detection frequency.The measurement signals acquired by the first and second laser feedback interferometry sensors are each acquired simultaneously. Furthermore, the second sensor is designed to acquire a fifth measurement signal at a third acquisition frequency, which is, in particular, significantly lower than the first and second acquisition frequencies. The fifth measurement signal corresponds to a, in particular absolute, viewing direction of the user's eye. In this context, the computing unit is designed to fuse the measurement signals from the various sensors to determine the, in particular instantaneous, viewing direction of the user's eye, which is assumed at a time between two viewing directions determined consecutively with the first and / or second acquisition frequency. The optical system thus offers the possibility of determining the viewing direction in an energy-efficient manner at high speed.
[0016] A further subject of the present invention is a spectacle device with the optical system described above. The spectacle device is, in particular, data glasses, in particular AR glasses, or alternatively, VR glasses.
[0017] Description of the drawings
[0018] Figure 1 shows a method for determining a, in particular first and second, surface speed of an eye of a user of a spectacle device arranged on the head of the user.
[0019] Figure 2 shows an optical system for determining the surface velocity of an eye of a user of a spectacle device mounted on the user's head. Figure 3 shows a deflection device for a first modulated light beam, particularly an infrared beam, emitted by a first laser feedback interferometry sensor.
[0020] Figure 4 shows the detection of the positions of the user's eye at different times as a function of the recorded distances of the first laser feedback interferometry sensor relative to the user's eye.
[0021] Figure 5 shows a spectacle device with an optical system for determining a surface velocity of an eye of a user of a spectacle device arranged on the user's head.
[0022] Figure 1 shows a method for determining a surface velocity, in particular a first and second velocity, of an eye of a user of a spectacle device arranged on the user's head in the form of a flowchart. The spectacle device comprises at least one first sensor, which in turn comprises at least one first laser feedback interferometry sensor with a first, in particular switchable, deflection device for a first modulated light beam, in particular an infrared one, emitted by the first laser feedback interferometry sensor. Furthermore, the first sensor comprises a second laser feedback interferometry sensor with a second, in particular switchable, deflection device for a second modulated light beam, in particular an infrared one, emitted by the second laser feedback interferometry sensor.In addition, the glasses device comprises a computing unit and / or a second sensor which is designed as a camera sensor.
[0023] In a method step 100, a first position of the eye, in particular relative to the first and second laser feedback interferometry sensors, is initially detected at a first point in time by means of the first sensor and / or the second sensor. In a method step 110 following method step 100, a first control signal of the first deflection device of the first laser feedback interferometry sensor is generated by means of the computing unit in such a way that the first modulated light beam emitted by means of the first laser feedback interferometry sensor strikes the user's eye at the first point in time. Furthermore, in a method step 120, a second control signal of the second deflection device of the second laser feedback interferometry sensor is generated by means of the computing unit in such a way that the second modulated light beam emitted by means of the second laser feedback interferometry sensor strikes the user's eye at the first point in time.In a method step 130 following method step 120, a first measurement signal is acquired by the first laser feedback interferometry sensor as a function of the first light beam reflected back by the user's eye at the first time. Furthermore, in a method step 140, a second measurement signal is acquired by the second laser feedback interferometry sensor as a function of the second light beam reflected back by the user's eye at the first time. In a method step 150 following method step 140, a first surface speed of the user's eye is further determined by the computing unit as a function of the acquired first and second measurement signals.In a method step 160 following method step 150, a second position of the user's eye, in particular relative to the first and second laser feedback interferometry sensors, is detected by means of the first sensor and / or the second sensor at a second time following the first time. In a method step 170 following method step 160, a third control signal of the first deflection device of the first laser feedback interferometry sensor is generated by the computing unit such that the first modulated light beam emitted by the first laser feedback interferometry sensor strikes the user's eye at the second time.Furthermore, in a method step 180, a fourth control signal of the second deflection device of the second laser feedback interferometry sensor is generated by the computing unit such that the second modulated light beam emitted by the second laser feedback interferometry sensor strikes the user's eye at the second time. In a method step 190 following method step 180, a third measurement signal is detected by the first laser feedback interferometry sensor as a function of the first light beam reflected back by the user's eye at the second time. Furthermore, in a method step 200, a fourth measurement signal is detected by the second laser feedback interferometry sensor as a function of the second light beam reflected back by the user's eye at the second time.In a method step 210 following method step 200, a second surface speed of the user's eye is determined by the computing unit based on the acquired third and fourth measurement signals. The method is then terminated.
[0024] Optionally, the positions of the user's eye are detected at different times depending on the distances recorded by the first and / or second laser feedback interferometry sensor relative to the user's eye. Different areas of the user's eye are assigned different distances of the first and / or second laser feedback interferometry sensor relative to the user's eye. Alternatively, the positions of the user's eye are detected at different times depending on image data captured by the second sensor as a camera system.
[0025] In an optional method step 220 following method step 210, in addition to determining a, in particular instantaneous, viewing direction of the user's eye, the measurement signals, in particular the first and third, are acquired by the first laser feedback interferometry sensor at a first acquisition frequency as a function of the first light beam reflected back by the user's eye. Furthermore, in method step 220, the measurement signals, in particular the second and fourth, are acquired by the second laser feedback interferometry sensor at a second acquisition frequency as a function of the second light beam reflected back by the user's eye. The measurement signals acquired by the first and second laser feedback interferometry sensors are each acquired simultaneously.In a method step 230 following method step 220, a fifth measurement signal is acquired by means of the second sensor as a camera system with a third acquisition frequency. The third acquisition frequency is, in particular, significantly lower than the first and second acquisition frequencies. The fifth measurement signal corresponds to a, in particular absolute, viewing direction of the user's eye. In a further method step 240, the measurement signals from the various sensors are fused, in particular with one another, to determine the, in particular current, viewing direction of the user's eye. In this case, the, in particular current, viewing direction of the user's eye corresponds to a viewing direction that is assumed at a time between two viewing directions successively determined with the first and / or second acquisition frequency.Optionally, the measurement signals of the various sensors are fused by evaluating a discretized integral sequence.
[0026] Figure 2 schematically shows an optical system 60 for determining a surface velocity of an eye 25 of a user of a spectacle device arranged on the user's head. In this context, the optical system 60 has a first sensor, which in turn has a first laser feedback interferometry sensor 21a with a first, in particular switchable, deflection device (not shown here) for a first modulated light beam, in particular an infrared one, emitted by the first laser feedback interferometry sensor 21a. In addition, the first sensor has a second laser feedback interferometry sensor 21b with a second, in particular switchable, deflection device (likewise not shown here) for a second light beam, in particular an infrared one, emitted by the second laser feedback interferometry sensor. In addition, the optical system 60 has a computing unit 30.The first sensor is designed to detect positions of the eye 25, in particular different positions of the eye 25, at different times. The computing unit 30 is designed to generate control signals for the first laser feedback interferometry sensor 21a and the second laser feedback interferometry sensor 21b such that the light beams emitted by the laser feedback interferometry sensors 21a or 21b always impinge on the eye 25. The first region 22 indicates the region within which the eye 25 could move without the provided deflection devices and would still be struck by both light beams, in particular simultaneously.The second region 23 indicates the larger region, now defined by the deflection devices and the resulting possible deflection angles 24a and 24b of the laser feedback interferometry sensors 21a and 21b, within which the eye 25 could move and would still be hit by both light beams, in particular simultaneously. The first laser feedback interferometry sensor 21a serves to detect measurement signals depending on the first light beams reflected back by the user's eye 25 at different times. The second laser feedback interferometry sensor 21b serves to detect measurement signals depending on the second light beams reflected back by the user's eye 25 at different times.The computing unit 30, in turn, is designed to determine surface speeds of the user's eye 25 as a function of the measurement signals acquired at different times by means of the first and second laser feedback interferometry sensors 21 a and 21 b.
[0027] Figure 3 schematically shows a first deflection device 61 for a first modulated light beam 11, in particular an infrared one, emitted by a first laser feedback interferometry sensor 10. The first deflection device 61 comprises an LC crystal 14, which is designed as an LC crystal array. The LC crystal 14 has two opposing electrodes 19 and 68, which in this exemplary embodiment are arranged parallel relative to a beam direction of the first light beam 11. The LC crystal 14 serves to deflect the first light beam 11 differently depending on a switching state, in particular a rotating orientation of the at least one LC crystal 14 that changes depending on the switching state, so that at least two different focal points 16 and 17 of the first light beam 11 are generated on the user's eye 18.
[0028] Furthermore, in this exemplary embodiment, the first deflection device 61 additionally comprises a first optical element 12 for expanding the first light beam 11. The first optical element 12, which is designed as a lens, is arranged between the first laser feedback interferometry sensor 10 and the LC crystal 14. Furthermore, the first deflection device 61 comprises a focusing lens as a second optical element 15 for focusing the expanded first light beam emerging from the LC crystal 14 toward the user's eye 18.
[0029] Figure 4 uses a diagram to show how different areas of the user's eye are assigned different distances of the first and / or second laser feedback interferometry sensor relative to the user's eye. The distance of the corresponding laser feedback interferometry sensor relative to the user's eye is plotted on the X-axis 51, and the probability of occurrence of the respective distance is plotted on the Y-axis 50. The measurement signal cluster 53 corresponds to a cluster into which measurement signals from the sclera of the eye fall. The measurement signal cluster 54 corresponds to a cluster into which measurement signals from the iris of the eye fall, and the measurement signal cluster 55 corresponds to a cluster into which measurement signals from the retina of the eye fall. The measurement signal cluster 52, in turn, corresponds to a cluster into which measurement signals fall if the light beams from the laser feedback interferometry sensors do not fall on the eye.
[0030] Figure 5 schematically shows a spectacle device 42 with an optical system 20 for determining a surface speed of an eye 36 of a user of the spectacle device 42 arranged on the user's head. In this exemplary embodiment, the spectacle device 42 is designed as data glasses with a laser projector 26 for retinal projection.
[0031] The optical system 20 has a first sensor 66, which in turn has a first laser feedback interferometry sensor 38 with a first, in particular switchable, deflection device (not shown here) for a first modulated light beam 44, in particular an infrared one, emitted by the first laser feedback interferometry sensor 38. Furthermore, the optical system 20 has a second laser feedback interferometry sensor 40 with a second, in particular switchable, deflection device (likewise not shown here) for a second light beam 46, in particular an infrared one, emitted by the second laser feedback interferometry sensor 40. The two laser feedback interferometry sensors 38 and 40 are designed as static laser feedback interferometry sensors. In addition, the optical system 20 has a computing unit 67 and a second sensor 37, which is designed as a camera sensor.The second sensor 37 is designed to detect different positions of the user's eye 36 as a function of captured image data within its detection range 39. The computing unit 67 is in turn designed to generate control signals for the first laser feedback interferometry sensor 38 and the second laser feedback interferometry sensor 40 such that the light beams 44 or 46 emitted by the laser feedback interferometry sensors 38 or 40 always impinge on the eye 36. The first laser feedback interferometry sensor 38 serves to detect measurement signals as a function of the first light beams reflected back by the user's eye 36 at different times. The second laser feedback interferometry sensor 40 serves to detect measurement signals as a function of the second light beams reflected back by the user's eye 36 at different times.The computing unit 67, in turn, is designed to determine surface speeds of the user's eye 36 as a function of the measurement signals recorded at different times by means of the first and second laser feedback interferometry sensors 38 and 40.
[0032] Furthermore, in this exemplary embodiment, the first laser feedback interferometry sensor 38 is additionally configured to detect the measurement signals at a first detection frequency as a function of the first light beam reflected back by the user's eye 36. The second laser feedback interferometry sensor 40 is, in turn, configured to detect the measurement signals at a second detection frequency as a function of the second light beam reflected back by the user's eye 36. The measurement signals detected by the first 38 and second laser feedback interferometry sensors 40 are each detected simultaneously. In this context, the second sensor 37 is configured to detect a fifth measurement signal at a third detection frequency, which is, in particular, significantly lower than the first and second detection frequencies. The fifth measurement signal corresponds to a, in particular absolute, viewing direction of the user's eye 36.Furthermore, the computing unit 67 is configured to merge the measurement signals of the various sensors 37, 38, and 40 to determine the, in particular, instantaneous, viewing direction of the user's eye 36. The, in particular instantaneous, viewing direction of the user's eye 36 corresponds to a viewing direction assumed at a time between two viewing directions determined consecutively with the first and / or second detection frequency.
Claims
Claims 1 . Method for determining a, in particular first and second, surface speed of an eye (18, 25, 36) of a user of a spectacle device (42) arranged on the head of the user, the spectacle device (42) at least comprising a first sensor (66), wherein the sensor (66) has at least a first laser feedback interferometry sensor (10, 21a, 38) with a first, in particular switchable, deflection device (61) for a first, in particular infrared, modulated light beam (11, 44) emitted by means of the first laser feedback interferometry sensor (10, 21a, 38), and a second laser feedback interferometry sensor (21b, 40) with a second, in particular switchable, deflection device for a second, in particular infrared, modulated light beam (11, 44) emitted by means of the second laser feedback interferometry sensor (21b, 40). light beam (46), and a computing unit (30, 67), and / or a second sensor (37),which is designed as a camera sensor, the method comprising the following method steps:, Detection (100) of a first position of the eye (18, 25, 36), in particular relative to the first (10, 21a, 38) and second laser feedback interferometry sensor (21b, 40), at a first time by means of the first sensor (66) and / or the second sensor (37), and generation (110) of a first control signal of the first deflection device (61) of the first laser feedback interferometry sensor (10, 21a, 38) by means of the computing unit (30, 67) such that the first modulated light beam (11, 44) emitted by means of the first laser feedback interferometry sensor (10, 21a, 38) strikes the user's eye (18, 25, 36) at the first time, Generating (120) a second control signal of the second deflection device of the second laser feedback interferometry sensor (21 b, 40) by means of the computing unit (30, 67) such that the second modulated light beam (46) emitted by the second laser feedback interferometry sensor (21 b, 40) strikes the user's eye (18, 25, 36) at the first time, detecting (130) a first measurement signal as a function of the first light beam (11, 44) reflected back from the user's eye (18, 25, 36) at the first time by means of the first laser feedback interferometry sensor (10, 21 a, 38), and detecting (140) a second measurement signal as a function of the second light beam (46) reflected back from the user's eye (18, 25, 36) at the first time by means of the second laser feedback interferometry sensor (21 b, 40), and Determining (150) a first surface speed of the user's eye (18, 25, 36) as a function of the detected first and second measurement signals by means of the computing unit (30, 67), and Detection (160) of a second position of the user's eye (18, 25, 36), in particular relative to the first (10, 21 a, 38) and second laser feedback interferometry sensor (21 b, 40), at a second time following the first time by means of the first sensor (66) and / or the second sensor (37), and Generating (170) a third control signal of the first deflection device (61) of the first laser feedback interferometry sensor (10, 21a, 38) by means of the computing unit (30, 67) such that the first modulated light beam (11, 44) emitted by the first laser feedback interferometry sensor (10, 21a, 38) strikes the user's eye (18, 25, 36) at the second time, and Generating (180) a fourth control signal of the second deflection device of the second laser feedback interferometry sensor (21 b, 40) by means of the computing unit (30, 67) such that the second modulated light beam (46) emitted by the second laser feedback interferometry sensor (21 b, 40) strikes the user's eye (18, 25, 36) at the second time, and detecting (190) a third measurement signal as a function of the first light beam (11, 44) reflected back from the user's eye (18, 25, 36) at the second time by means of the first laser feedback interferometry sensor (10, 21 a, 38), and detecting (200) a fourth measurement signal as a function of the second light beam (46) reflected back from the user's eye (18, 25, 36) at the second time by means of the second laser feedback interferometry sensor (21 b, 40), and Determining (210) a second surface speed of the user's eye (18, 25, 36) as a function of the detected third and fourth measurement signals by means of the computing unit (30, 67).
2. Method according to claim 1, characterized in that the detection (100, 160) of the positions of the user's eye (18, 25, 36) at the different times takes place as a function of detected distances of the first (10, 21a, 38) and / or second laser feedback interferometry sensor (21b, 40) relative to the user's eye (18, 25, 36).
3. Method according to claim 2, characterized in that different regions of the user's eye (18, 25, 36) are assigned different distances of the first (10, 21 a, 38) and / or second laser feedback interferometry sensor (21 b, 40) relative to the user's eye (18, 25, 36).
4. Method according to claim 1, characterized in that the detection (100, 160) of the positions of the user's eye (18, 25, 36) at the different times takes place as a function of image data acquired by means of the second sensor (37) as a camera system.
5. Method according to one of claims 1 to 4, characterized in that in addition to determining a, in particular instantaneous, viewing direction of the user's eye, the following method steps are provided: detecting (220) the, in particular first and third, measurement signals as a function of the first light beam (11, 44) reflected back by the user's eye (18, 25, 36) by means of the first laser feedback interferometry sensor (10, 21 a, 38) at a first detection frequency, Detecting the, in particular second and fourth, measurement signals as a function of the second light beam (46) reflected back by the user's eye (18, 25, 36) by means of the second laser feedback interferometry sensor (21 b, 40) at a second detection frequency, wherein the detection of the signals detected by means of the first (10, 21 a, 38) and second Laser feedback interferometry sensor (21 b, 40) detects the measurement signals simultaneously, Detecting (230) a fifth measurement signal by means of the second sensor (37) as a camera system with a third detection frequency, which is, in particular, significantly lower than the first and second detection frequencies, wherein the fifth measurement signal corresponds to a, in particular absolute, viewing direction of the user's eye (18, 25, 36), wherein in at least one method step for determining (240) the, in particular instantaneous, viewing direction of the user's eye (18, 25, 36), which is assumed at a time between two viewing directions determined successively with the first and / or second detection frequency, the measurement signals of the various sensors are fused.
6. Method according to claim 5, characterized in that the measurement signals of the various sensors are fused by evaluating a discretized integral sequence.
7. An optical system (20, 60) for determining a surface velocity of an eye (18, 25, 36) of a user of a spectacle device (42) arranged on the user's head, the optical system comprising: a first sensor (66), the sensor (66) comprising at least one first laser feedback interferometry sensor (10, 21a, 38) with a first, in particular switchable, deflection device (61) for a first, in particular infrared, modulated light beam (11, 44) emitted by the first laser feedback interferometry sensor, and a second laser feedback interferometry sensor (21b, 40) with a second, in particular switchable, deflection device for a second, in particular infrared, light beam (46) emitted by the second laser feedback interferometry sensor (21b, 40), and a computing unit (30, 67), and / or a second sensor (37) which is designed as a camera sensor,wherein the first (66) and / or second sensor (37) is designed to detect a first position of the eye at a first time, wherein the computing unit (30, 67) is designed to generate a first control signal of the first deflection device (61) of the first laser feedback interferometry sensor (10, 21a, 38) such that the first modulated light beam (11, 44) emitted by means of the first laser feedback interferometry sensor (10, 21a, 38) strikes the user's eye (18, 25, 36) at the first time, wherein the computing unit (30, 67) is designed to generate a second control signal of the second deflection device of the second laser feedback interferometry sensor (21b, 40) such that the second modulated light beam (46) emitted by means of the second laser feedback interferometry sensor (21b, 40) strikes the user's eye (18, 25, 36), wherein the first laser feedback interferometry sensor (10, 21 a, 38) is designed to generate a first measurement signal as a function of the image detected by the user's eye (18, 25,36) reflected back first light beam (11, 44), and wherein the second laser feedback interferometry sensor (21b, 40) is designed to detect a second measurement signal as a function of the second light beam (46) reflected back from the user's eye (18, 25, 36) at the first time, wherein the computing unit (30, 67) is designed to determine a first surface speed of the user's eye (18, 25, 36) as a function of the detected first and second measurement signals, wherein the first (66) and / or second sensor (37) is designed to detect a second position of the user's eye (18, 25, 36) at a second time following the first time, and wherein the computing unit (30, 67) is designed to generate a third control signal of the first deflection device (61) of the first laser Feedback interferometry sensor (10, 21a, 38) in such a way that the signal generated by the first laser feedback interferometry sensor (10, 21a,38) emitted first modulated light beam (11, 44) strikes the user's eye (18, 25, 36) at the second time, and wherein the computing unit (30, 67) is designed to generate a fourth control signal of the second deflection device of the second laser feedback interferometry sensor (21b, 40) such that the first modulated light beam (11, 44) emitted by the second laser feedback interferometry sensor (21b, 40) strikes the user's eye (18, 25, 36) at the second time, and wherein the first laser feedback interferometry sensor (10, 21a, 38) is designed to detect a third measurement signal as a function of the first light beam (11, 44) reflected back by the user's eye (18, 25, 36) at the second time, and wherein the second laser feedback interferometry sensor (21b, 40) is designed to detect a fourth measurement signal as a function of the second light beam (46) reflected back by the user's eye (18, 25, 36) at the second time, and wherein the computing unit (30, 67) is designed to determine a second surface speed of the user's eye (18, 25, 36) as a function of the detected third and fourth to determine the measurement signal.
8. Optical system (20, 60) according to claim 7, characterized in that the first (10, 21 a, 38) and / or second laser feedback interferometry sensor (21 b, 40) are designed as static laser feedback interferometry sensors.
9. Optical system (20, 60) according to one of claims 7 or 8, characterized in that the first (61) and / or second deflection device comprises at least one LC crystal (14), in particular an LC crystal array, with two opposite electrodes (19, 68), wherein the first (11, 40) and / or second light beam (46) is deflected differently depending on a switching state, in particular a rotating orientation of the at least one LC crystal (14) which changes depending on the switching state.
10. Optical system (20, 60) according to claim 9, characterized in that the first (61) and / or second deflection device additionally comprises a first optical element (12) for expanding the first (11, 44) and / or second light beam (46), wherein the first optical element (12) is arranged between the first (10, 21a, 38) and / or second laser feedback interferometry sensor (21b, 40) and the LC crystal (14), wherein the first (61) and / or second deflection device additionally comprises a second optical element (15) for focusing the the LC crystal (14) coming, widened first (11, 44) and / or second light beam (46) in the direction of the user's eye (18, 25, 36).
11. Optical system (20, 60) according to one of claims 9 or 10, characterized in that the two electrodes (19, 68) of the LC crystal (14) are arranged perpendicularly relative to a beam direction of the first (11, 44) and / or second light beam (46).
12. Optical system (20, 60) according to one of claims 9 or 10, characterized in that the two electrodes (19, 68) of the LC crystal (14) are arranged parallel relative to a beam direction of the first (11, 44) and / or second light beam (46).
13. Optical system (20, 60) according to one of claims 7 or 8, characterized in that the first (61) and / or second deflection device are designed as a metal lens structure.
14. Optical system (20, 60) according to one of claims 7 to 13, characterized in that the first laser feedback interferometry sensor (10, 21a, 38) is additionally designed to detect the, in particular first and third, measurement signals as a function of the first light beam (11, 44) reflected back by the user's eye (18, 25, 36) at a first detection frequency, and wherein the second laser feedback interferometry sensor (21b, 40) is additionally designed to detect the, in particular second and fourth, measurement signals as a function of the second light beam (46) reflected back by the user's eye (18, 25, 36) at a second detection frequency, wherein the detection of the signals detected by means of the first (10, 21a, 38) and second laser feedback interferometry sensor (21b, 40) detected measurement signals are each carried out simultaneously, and wherein the second sensor (37) is designed to detect a fifth measurement signal with a third detection frequency, which,in particular substantially lower than the first and second detection frequencies, wherein the fifth measurement signal corresponds to a, in particular absolute, viewing direction of the user's eye (18, 25, 36), wherein the computing unit (30, 67) is designed to fuse the measurement signals of the various sensors in order to determine the, in particular instantaneous, viewing direction of the user's eye (18, 25, 36), which is assumed at a time between two viewing directions determined successively with the first and / or second detection frequency.
15. Glasses device (42) with an optical system (20, 60) according to one of claims 7 to 14, wherein the glasses device (42) is designed in particular as data glasses or VR glasses.
Citation Information
Patent Citations
EYE TRACKING ARRANGEMENT
DE102020127593A1
Method for determining the gaze direction of an eye
DE102020206821A1
Beam deflector, method for operating the beam deflector and eye tracking device based on the beam deflector
US20220404681A1
Computing unit for ascertaining the viewing vector of a user of data glasses
WO2023222303A1
