Device and method for smartglasses for generating glints

The device and method for data glasses use a projector and holographic optical element to generate and deflect light beams for eye glints, enhancing gaze estimation accuracy and reducing costs and energy consumption by eliminating infrared sources and complex optics.

WO2025201876A1PCT designated stage Publication Date: 2025-10-02ROBERT BOSCH GMBH
View PDF 3 Cites 0 Cited by

Patent Information

Application Number
PCT/EP2025/056689
Authority / Receiving Office
WO · WO
Patent Type
Applications
Current Assignee / Owner
Priority Date
2024-03-28
Filing Date
2025-03-12
Publication Date
2025-10-02

AI Technical Summary

Technical Problem

Existing data glasses struggle with efficient and reliable generation and detection of glints on the eye for accurate gaze estimation, often requiring additional infrared illumination sources and complex optical systems, which increase costs and energy consumption.

Method used

A device and method using a projector with RGB laser light source and a deflection device, such as a holographic optical element, to generate and deflect multiple spatially offset light beams, creating glints on the eye without additional infrared sources, and employing an event camera for detection, allowing individual beam activation and deflection to enhance glint detection.

Benefits of technology

This approach reduces manufacturing costs, energy consumption, and increases robustness by eliminating the need for extra illumination devices while maintaining gaze estimation accuracy through flexible camera placement and improved glint detection.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure EP2025056689_02102025_PF_FP_ABST
    Figure EP2025056689_02102025_PF_FP_ABST
Patent Text Reader

Abstract

The invention relates to a device (300) for operating smartglasses (400), in particular for estimating a model of an eye (2), comprising: an illumination device (100) which is designed to generate (502) a plurality of spatially offset light beams (104) from light visible to a human user and to emit (504) onto the eye (2) an image (102a, 102b, 102c, 102d; 102e, 102f, 102g, 102h) to be generated in an individual light beam (104a, 104b, 104c, 104d; 104e, 104f, 104g, 104h) of the plurality of light beams (104), wherein the illumination device (100) is designed to individually activate (506), in particular to individually generate, at least some of the plurality of light beams (104), and wherein the illumination device (100) is designed to activate (506), in particular to generate, at least some of the plurality of light beams (104) in such a way that a first number of glints (108), comprising at least two glints (108a, 108b, 108d; 108a', 108c'; 108e, 108f, 108g, 108h, 108e', 108f', 108h'), is produced on the eye (2); and an event camera (200) which is designed to capture (508) the first number of glints (108).
Need to check novelty before this filing date? Find Prior Art

Description

[0001] Description

[0002] title

[0003] Device and method for data glasses for generating glints

[0004] State of the art

[0005] The invention relates to a device and a method for data glasses for generating glints on an eye, in particular for estimating a model of the eye.

[0006] For robust functionality of smart glasses, it is important that, for example, the gaze vector of a user's eye can be reliably determined. To determine the gaze vector, a model of the eye based on glints generated on the eye is often used.

[0007] Therefore, a data groove is desirable that enables efficient and reliable generation and detection of glints on the eye.

[0008] Disclosure of the invention

[0009] Problems of the prior art are solved by a method, a device and data glasses according to one of the independent claims.

[0010] The device for operating data glasses, in particular for estimating a model of an eye, comprises an illumination device which is designed to generate a plurality of light beams, spatially offset from one another, from light visible to a human user, and to radiate an image to be generated in each case in a single light beam of the plurality of light beams onto the eye, and wherein the illumination device is designed to individually activate, in particular individually generate, at least some of the plurality of light beams, wherein the illumination device is designed to activate, in particular generate, at least some of the plurality of light beams in such a way that a first number of glints, comprising at least two glints, is created on the eye; and an event camera which is designed to capture the first number of glints.

[0011] A glint is a specular reflection, especially a specular reflection on a surface, e.g. on a surface of the eye.

[0012] By using visible light to generate the first number of glints, no additional illumination device, such as an infrared radiation source, is required. The illumination device serves to display and project the content to be displayed to the user, in the form of the image to be generated. The illumination device can, for example, be a projector in the form of an RGB laser light source, which is used in many smart glasses.

[0013] The plurality of light beams ensures that at least one light beam is directed onto the pupil of the user's eye, allowing the user to see a clear image. If the pupil moves, another light beam from the plurality of light beams could potentially hit the pupil. Accordingly, there are also light beams that are not captured by the pupil. Activating these light beams creates the first number of glints on the eye. For each light beam from the plurality of light beams that is activated and whose image is not directed onto the pupil, a glint is created. These glints can be induced by deliberately controlling the individual light beams, captured by the event camera, and used to estimate the eye model. This reduces the need for lighting sources, lowering manufacturing costs while maintaining the same quality and functionality of the data glasses.

[0014] By individually activating each of the light beams within the plurality of light beams, the light beams that generate the glints can be deliberately switched on and off, creating, for example, flashing glints that improve detection by the event camera. By individually generating each of the light beams within the plurality of light beams, the light beams that generate the glints can, for example, project an image to the eye that differs from the image intended for the user. This differing image can, for example, be a monochrome image with a specific wavelength to create clearer glints. This improves the detection of the glints by the event camera.

[0015] The use of an event camera compared to a photodiode or photo camera reduces the energy consumption of the data glasses and increases the robustness of the data glasses.

[0016] An advantageous example is characterized in that the device comprises a deflection device, in particular a holographic optical element, which is designed to deflect the plurality of light beams onto the eye and / or to deflect glints arising on the eye, in particular for a specific wavelength range or a specific wavelength of the illumination device, onto the event camera.

[0017] The deflection device can be an important component for the operation of the data glasses, as it allows the illumination device to be arranged outside the user's field of vision, for example, in a temple of the data glasses. The deflection device deflects the majority of light beams, and thus also the image to be generated, onto the user's eye, allowing the user to perceive the image. Since the majority of light beams are used to generate the first number of glints, the deflection device does not need to have any additional functions, such as being able to deflect infrared rays. If the deflection device is designed as a holographic optical element, the stack structure of the holographic optical element is reduced, as only the light beams of visible light need to be deflected. This reduces the complexity of the deflection device and lowers the manufacturing costs of the data groove.

[0018] By deflecting the glints using the deflection device, the flexibility regarding the arrangement of the event camera is increased. The event camera can thus be positioned, for example, outside the user's field of vision. Because the deflection device only deflects light rays of a specific wavelength or wavelength range of the lighting device, an optical filter is created, making the data glasses more robust against interference, such as stray light or glints caused by stray light.

[0019] An advantageous example is characterized in that the deflection device is designed to generate a replica of at least one light beam of the plurality of light beams and to radiate this replica onto the eye, wherein the plurality of light beams is spatially structured in particular in such a way and the deflection device is designed in such a way that no overlap of individual light beams and replicas results, thereby creating a glint for each replica that does not radiate onto the pupil of the eye, wherein the first number of glints also includes the glints created by the replica.

[0020] The replicas of the light beams allow the number of glints to be increased while maintaining the same number of light beams generated by the illumination device. This improves the estimation of the eye model and thus also the performance of the data glasses.

[0021] An advantageous example is characterized in that the deflection device has at least one partial section which is designed to be illuminated by the illumination device, in particular permanently, and to generate a second number of glints on the eye, wherein the at least one partial section is designed such that at least a part of the second number of glints arises outside the pupil of the eye and wherein the event camera is also designed to capture the second number of glints.

[0022] The subsection is provided, for example, on an edge of the deflection device and deflects light from the illumination device onto the eye. Thus, further glints in the form of the second number of glints can arise, in particular outside a range of movement of the pupil. Depending on a configuration of the at least one subsection, a number, a shape, or a location of origin of the glints of the second number of glints on the eye can be manipulated. By increasing the total number of glints, the estimation of the model of the eye is improved and, consequently, the quality of the data glasses is increased. Preferably, the device comprises an evaluation device designed to determine a model of the eye depending on the glints detected by the event camera and, in particular, depending on a detected geometric shape of the detected glints.

[0023] The method for operating the data glasses, in particular for estimating the model of the eye, comprises: generating a plurality of light beams that are spatially offset from one another from light that is visible to a human user; radiating an image to be generated in a respective individual light beam of the plurality of light beams onto the eye by means of the illumination device; individually activating, in particular individually generating, at least a portion of the plurality of light beams, wherein at least a portion of the plurality of light beams is activated, in particular generated, by means of the illumination device in such a way that a first number of glints, comprising at least two glints, is created on the eye; and capturing the first number of glints by means of an event camera.

[0024] Preferably, the method comprises deflecting the plurality of light beams onto the eye by means of a deflection device, in particular a holographic optical element, and / or deflecting glints arising on the eye, in particular for a specific wavelength range or a specific wavelength of the illumination device, onto the event camera by means of the deflection device.

[0025] In an advantageous embodiment, a replica of at least one light beam of the plurality of light beams is generated by means of the deflection device and this replica is radiated onto the eye, the plurality of light beams being spatially structured in particular and the deflection device being designed in such a way that no overlap of individual light beams of the plurality of light beams will result, wherein for each replica that is not radiated onto the pupil of the eye, a glint will be created, wherein the first number of glints also includes the glints created by the replica.

[0026] Preferably, the deflection device has at least one partial section which is illuminated by the illumination device, in particular permanently, and wherein a second number of glints is generated on the eye by means of the at least one partial section, wherein the at least one partial section is designed such that at least a part of the second number of glints will arise outside the pupil of the eye and wherein the second number of glints is also recorded by means of the event camera.

[0027] An advantageous example is characterized in that the method comprises determining a model of the eye depending on the glints detected by the event camera and in particular depending on a detected geometric shape of the detected glints.

[0028] The data glasses comprise the device according to the above embodiments and are designed to carry out the method described above, wherein in particular the lighting device and / or the event camera is arranged on a temple and / or frame of the data glasses and / or the deflection device is arranged on a lens of the data glasses.

[0029] Further advantageous embodiments are apparent from the drawing and the following description. The drawing shows:

[0030] Figure 1a is a schematic representation of a device for operating data glasses;

[0031] Figure 1b is a schematic representation of an eye from a perspective of an event camera of the device;

[0032] Figure 2 is a schematic representation of the device arranged on the data glasses;

[0033] Figure 3a is a schematic representation of an embodiment of the device;

[0034] Figure 3b shows a schematic representation of the eye from a perspective of the event camera of the embodiment of the device; Figure 4 shows a schematic representation of the eye from a perspective of the event camera of an embodiment of the device;

[0035] Figure 5a is a schematic representation of a deflection device of an embodiment of the device;

[0036] Figure 5b is a schematic representation of the eye from a perspective of the event camera of the embodiment of the device;

[0037] Figure 6a shows a flowchart of a method for operating data glasses, in particular for estimating a model of an eye;

[0038] Figure 6b shows a section of a flow diagram of an embodiment of the method;

[0039] Figure 1a shows a device 300 for operating data glasses 400, in particular for estimating a model of an eye 2. The device 300 comprises an illumination device 100 configured to generate a plurality of spatially offset light beams 104 from light visible to a human user and to radiate an image 102a, 102b, 102c, 102d, 102e, 102f, 102g, 102h to be generated onto the eye 2 in a respective individual light beam 104a, 104b, 104c, 104d of the plurality of light beams 104. The illumination device 100 comprises, for example, an RGB laser light source and a deflection device in the form of a tilting mirror. By means of a corresponding control of the RGB laser light source and the tilting mirror, the plurality of light beams 104 can be generated and the respective image 102a, 102b, 102c, 102d to be generated can be emitted.The lighting device 100 may be referred to as a projector or projection device.

[0040] The illumination device 100 is configured to individually activate at least some of the plurality of light beams 104. In order for a user of the data glasses 400 to be able to recognize the image 102a, 102b, 102c, 102d to be generated, at least a single light beam 104a...104d must be emitted onto a pupil 4 of the user's eye 2. In the example, the light beam 104c is emitted onto the pupil 4 of the eye 2, and the user recognizes the image 102c to be generated. The image 102c to be generated is, for example, content to be displayed to the user of the data glasses 400.

[0041] The plurality of light beams 104 enables at least one light beam 104a... 104d to be radiated onto the pupil 4 of the eye 2, even when the pupil 4 moves, allowing the user to recognize the image 102a... 102d to be generated. By individually activating individual light beams 104a... 104d of the plurality of light beams 104, light beams 102a... 102d—in the example, light beams 102a, 102b, 102d—that are not radiated onto the pupil 4 of the eye 2 can be switched on and off at will, since they are not recognized by the user and are also not required for a clear image of the image 102c to be generated. It is conceivable that the light beams 102a... 102d which are not emitted onto the pupil 4, in the example the light beams 102a, 102b, 102d, are activated and deactivated in a modulation frequency.

[0042] The individual light beams 104a...104d of the plurality of light beams 104, for example, radiate the same image 102a...102b to be generated onto the eye. It can be provided that the image 102a...102d to be generated is generated individually in each individual light beam 102a...102d, so that, for example, only the light beam 104c, which is radiated onto the pupil 4 of the eye 2, radiates the image 102c relevant to the user, and the remaining light beams 104a, 104b, 104d, for example, radiate a monochrome image 102a, 102b, 102d. It is conceivable that this monochrome image 102a, 102b, 102d, by means of a control of the corresponding light beams 104a, 104b, 104d, pulses in certain patterns or is activated and deactivated at a modulation frequency.

[0043] The plurality of light beams 104 is selected in such a way, in particular a number and a distribution of the plurality of light beams 104, and the illumination device 100 is configured to activate, in particular to generate, at least a portion of the plurality of light beams 104 in such a way that a first number of glints 108, comprising at least two glints 108a, 108b, 108d, are created on the eye 2. For each individual light beam 104a, 104b, 104d that is activated and whose image 102a, 102b, 102c, 102d does not radiate onto a pupil 4 of the eye 2, a glint 108a, 108b, 108d is created. The light beams 104a... 104d, which do not radiate onto the pupil 4 of the eye 2, but rather, for example, onto an iris 6 or a sclera of the eye, are used to deliberately provoke glints 108a, 108b, 108d on the eye 2, which are captured by an event camera 200 comprised by the device 300.The event camera 200 has, for example, an imaging optics 202 and an event camera sensor 204.

[0044] Figure 1b shows a schematic representation of eye 2 from the perspective of event camera 200. In the example, image 102c projected onto pupil 4 by light beam 104c is not recognizable or detectable by event camera 200. However, the first number of glints 108 are detected by event camera 200. Due to the spherical geometry of eye 2 and the associated spatially longer beam path of individual rays of the individual light beam 104a... 104d, glints located away from pupil 4 are distorted. Point-shaped light beams 104a... 104d and point-shaped images 102a... 102c to be generated are accordingly distorted, for example, into an oval shape.

[0045] Figure 2 shows an embodiment of the device 300, which comprises a deflection device 406. The deflection device 406 is designed to deflect the plurality of light beams 104 onto the eye 2. For this purpose, the deflection device 406 can, for example, comprise a section 406a or an integrated deflection device 406a. The deflection device 406, 406a makes it possible to arrange the illumination device 100 outside the user's field of vision. In the example, the deflection device 406, 406a is arranged in a spectacle lens 404 of the data glasses 400, and the illumination device 100 is arranged in a spectacle temple 402. The deflection device 406, 406a is designed, for example, as a holographic optical element. For reasons of clarity, the individual light beams 104a... 104d are not explicitly shown in the illustration in Figure 2, but only the images 102a... 102d to be generated and the first number of glints 108.

[0046] In one embodiment of the device 300, the deflection device 406 is also designed to deflect glints arising on the eye, for example, the first number of glints 108, onto the event camera 200. For this purpose, the deflection device 406 comprises, for example, a section 406b or an integrated deflection device 406b. It is also conceivable for the deflection devices 406a and 406b to each be separate deflection devices. The deflection device 406, 406b makes it possible to arrange the event camera 200 outside the user's field of vision. In the example, the deflection device 406, 406b is arranged in the lens 404 of the data glasses 400, and the event camera 200 is arranged in the temple 402. The deflection device 406, 406b is designed, for example, as a holographic optical element.Alternatively, by appropriately aligning the event camera 200, the event camera 200 can directly capture the eye 2 and yet be arranged in the temple 402 or a frame of the data glasses 400.

[0047] In one embodiment, the deflection device 406, 406b is configured to deflect the glints occurring on the eye, for example, the first number of glints 108, onto the event camera 200 only for a specific wavelength range or a specific wavelength of the illumination device 100. For example, it is conceivable that a single light beam 104a... 104d, which does not radiate onto the pupil 4 of the eye 2, generates a monochrome image 102a... 102d, and the deflection device 406, 406b is configured to deflect the wavelength of one color of this monochrome image. This wavelength selectivity creates an optical filter that makes the data glasses 400 more robust, since interference, for example, glints caused by stray light, has little to no influence on the detection, in particular of the first number of glints 108, by the event camera 200.

[0048] Figure 3a shows an embodiment of the device 300 in a schematic representation. It can be provided that the deflection device 406, 406a is designed to generate a replica 104a', 104c' of at least one light beam 104a... 104d of the plurality of light beams 104 and to radiate this replica onto the eye 2. The plurality of light beams 104 is spatially structured, in particular, and the deflection device 406, 406a is configured such that no overlap of individual light beams 104a... 104d and replicas 104a', 104c' results. For each replica 104a', 104c' that does not radiate onto the pupil 4 of the eye 2, a glint 108a', 108c' is created, whereby the first number of glints 108 also includes the glints 108a', 108c' created by the replica 104a', 104c'.The individual light beams 104a, 104c of the plurality of light beams 104 generated by the illumination device 100 in the example are shown as dashed lines in Figure 3a for reasons of clarity. It is conceivable that the replicas 104a', 104c' are realized using reflective structures of the deflection device 406, 406a and / or internally conductive structures of the deflection device 406, 406a.

[0049] The replicas 104a', 104c' emit the same image 102a, 102c to be generated as the underlying individual light beams 104a, 104c. Generally, each replica of a light beam also displays the emitted image of that light beam, since the replica is coupled to the respective light beam. Accordingly, activating or deactivating the light beam is also directly transmitted to the corresponding replica.

[0050] Figure 3b shows a schematic representation of eye 2 from a perspective of the event camera 200 of the embodiment of Figure 3a. The image 102c emitted onto pupil 4 by light beam 104c in the example is not recognizable or detectable by the event camera 200. For the light beams 104a, 104c and the replicas 104a', 104c', whose image 102a, 102c is not emitted onto pupil 4, the glints 108a, 108a', 108c' result, which are detectable and detectable by the event camera 200.

[0051] Figure 4 shows a schematic representation of the eye 2 from a perspective of the event camera 200 of an embodiment of the device 300, which is configured to radiate four images 102e, 102f, 102g, 102h to be generated onto the eye 2 using the plurality of light beams 104, comprising four individual light beams 104e...104h. Furthermore, the device 300 is configured to generate a replica 104e'...104h' of each of the four individual light beams 104e...104h and the images 102e...102h to be generated. In the example, the image 102g to be generated hits the pupil 4 of the eye 2 by means of the replica 104g'. The individual light beams 104e... 104h as well as the replicas 104e', 104f', 104h' generate in the example the first number of glints 108e, 108e', 108f, 108f', 108g, 108h, 108h', which are captured by the event camera 200.

[0052] It can be provided that the device 300 is designed to generate a higher or lower number of light beams and / or replicas than the numbers shown. Furthermore, it is conceivable that the plurality of light beams 104 and the replicas 104a... 104h' have an alternative spatial distribution. Figure 5a shows a schematic representation of an embodiment of the deflection device 406, 406a. It can be provided that the deflection device 406, 406a has at least one partial section 408a, 408b, which is designed to be illuminated by the illumination device 100, in particular permanently, and to generate a second number of glints 110, 110a, 110b on the eye 2.

[0053] With the second number of Glints 110, 110a, 110b it can be advantageous to let them flash or to activate them alternately as this allows the advantages of the event chamber to come into play.

[0054] The at least one subsection 408a, 408b is configured such that at least a portion of the second number of glints 110, 110a, 110b is created outside the pupil 4 of the eye 6, and the event camera 200 is also configured to capture the second number of glints 110, 110a, 110b. In the example, a first subsection 408a is configured to generate a first portion 110a of the second number of glints 110, and a second subsection 408b is configured to generate a second portion 110b of the second number of glints 110.

[0055] The glints of the second number of glints 110 can be used as support points for estimating the model of the eye 2. The at least one subsection 408a, 408b is structured such that the second number of glints 110 is created at least partially outside a movement range of the pupil 4. The movement range of the pupil 4 can be considered, for example, as a range that the pupil 4 can normally cover during a movement of the eye 2. Extreme positions of the pupil 4, such as forced lateral vision, are excluded.

[0056] Figure 5b schematically shows a representation of eye 2, from the perspective of event camera 200, with the first number of glints 108 and the second number of glints 110. In this embodiment, the second number of glints 110 is composed of individual point-shaped glints. However, alternative shapes for the glints of the second number of glints 110 are also conceivable, for example, a bar shape.

[0057] It can be provided that the device 300 comprises an evaluation device 302 which is designed to determine a model of the eye 2 depending on the glints 108, 110 detected by the event camera 200 and in particular depending on a detected geometric shape of the detected glints 108, 110. The detected glints 108, 110 comprise all glints detected or detectable by the event camera 200, in particular the first number of glints 108 and / or the second number of glints 110. The geometric shapes relate, for example, to the distortions of the first number of glints 10 shown in Figures 1b, 3b, 4 and 5b. However, these distortions can also occur for the second number of glints 110 and be detected by the event camera 200.

[0058] Figure 6 shows a flowchart of a method 500 for operating data glasses 400, in particular for estimating a model of an eye 2. The method comprises generating 502 a plurality of spatially offset light beams 104 from light visible to a human user and radiating 504 an image 102a, 102b, 102c, 102d, 102e, 102f, 102g, 102h to be generated in a respective individual light beam 104a, 104b, 104c, 104d of the plurality of light beams 104 onto the eye 2 by means of the illumination device 100. The method 500 also comprises individually activating 506, in particular individually generating, at least a portion of the plurality of light beams 104.In this case, the plurality of light beams 104 is selected and the plurality 104 of light beams 104 is activated 506, in particular generated, by means of the illumination device 100 in such a way that a first number of glints 108, comprising at least two glints 108a, 108b, 108d; 108a', 108c'; 108e, 108f, 108g, 108h, 108e', 108f, 108h', is created on the eye 2. For the individual light beam 104a, 104b, 104d that is activated and whose image 102a, 102b, 102c, 102d, 102e, 102f, 102g, 102h is not emitted onto a pupil 4 of the eye 2, a glint 108a, 108b, 108d; 108a', 108c'; 108e, 108f, 108g, 108h, 108e', 108f', 108h' is created. The method 500 further comprises capturing 508 the first number of glints 108 using an event camera 200.

[0059] It can be provided that the method 500 comprises determining 516 a model of the eye 2, depending on the glints 108, 110 detected by the event camera 200 and in particular depending on a detected geometric shape of the detected glints 108, 110.

[0060] Figure 6b shows a flowchart of part of an embodiment of method 500. It can be provided that method 500 includes deflecting 510 the plurality of light beams 104 onto eye 2 by means of a deflection device 406, 406a. Deflection device 406, 406a is, in particular, a holographic optical element.

[0061] It can be provided that the method 500 comprises a deflection 512 of glints 108, 110 arising on the eye 2, in particular for a specific wavelength range or a specific wavelength of the illumination device 100, onto the event camera 200. The glints 108, 110 are deflected by means of the deflection device 406, 406b.

[0062] In one embodiment of the method 500, a replica 104a', 104c' is generated 514 from at least one light beam 104, ..., 104d of the plurality of light beams 104 by means of the deflection device 406, 406a, and this replica is emitted onto the eye 2.

[0063] In this case, the plurality of light beams 104 is spatially structured, in particular, and the deflection device 406, 406a is configured such that no overlap of individual light beams () of the plurality of light beams (104) will result. For each replica 104a', 104c' that is not radiated onto the pupil 4 of the eye 2, a glint 108a', 108c'; 108e', 108f', 108h' is created. The first number of glints 108 also includes the glints 108a', 108c'; 108e', 108f' created by the replica 104a', 104c'.

[0064] 108e', 108f, 108h'.

Claims

Claims 1. Device (300) for operating data glasses (400), in particular for estimating a model of an eye (2), comprising: an illumination device (100) which is designed to generate (502) a plurality of light beams (104) which are spatially offset from one another from light visible to a human user, and in each case an image (102a, 102b, 102c, 102d; 102e, 102f, 102g, 102h) to be generated in a respective individual light beam (104a, 104b, 104c, 104d;104e, 104f, 104g, 104h) of the plurality of light bundles (104) onto the eye (2), wherein the illumination device (100) is designed to individually activate (506), in particular to individually generate, at least some of the plurality of light bundles (104), and wherein the illumination device (100) is designed to activate (506), in particular to generate, at least some of the plurality of light bundles (104) in such a way that a first number of glints (108), comprising at least two glints (108a, 108b, 108d; 108a', 108c'; 108e, 108f, 108g, 108h, 108e', 108f', 108h'), are created on the eye (2); and an event camera (200) configured to capture (508) the first number of glints (108); 2. The device (300) according to claim 1 comprising at least one deflection device (406, 406a, 406b), in particular a holographic optical element, which is designed to deflect (510) the plurality of light bundles (104) onto the eye (2) and / or to deflect (512) glints (108, 110) arising on the eye (2), in particular for a specific wavelength range or a specific wavelength of the illumination device (100), onto the event camera (200).

3. The device (300) according to claim 2, wherein the deflection device (406, 406a) is formed by at least one light beam (104a... 104d; 104e..104h) of the majority of light beams (104) a replica (104a 1, 104c'; 104e', 104f', 104g', 104h') and to radiate this onto the eye (2), wherein the plurality of light beams (104) is spatially structured in particular in such a way and the deflection device (406, 406a) is designed in such a way that no overlap of individual light beams (104a... 104d; 104e.. , 104h) and replicas (104a', 104c'; 104e', 104f, 104g', 104h') results, thereby creating for each replica (104a 1 , 104c'; 104e', 104f', 104h'), which does not radiate onto the pupil (4) of the eye (2), a glint (108a 1 , 108c'; 108e', 108f', 108h'), where the first number of glints (108) also includes the number of glints generated by the replica (104a 1 , 104c'; 104e', 104f , 104h') resulting glints (108a', 108c'; 108e', 108f , 108h').

4. The device (300) according to one of claims 2 or 3, wherein the deflection device (406, 406a, 406b) has at least one partial section (408a, 408b) which is designed to be illuminated by the illumination device (100), in particular permanently, and to generate a second number of glints (110, 110a, 110b) on the eye (2), wherein the at least one partial section (408a, 408b) is designed such that at least a part of the second number of glints (110, 110a, 110b) arises outside the pupil (4) of the eye (6) and wherein the event camera (200) is designed to also capture the second number of glints (110, 110a, 110b).

5. The device (300) according to one of the preceding claims comprising an evaluation device (302) which is designed to determine (516) a model of the eye (2) depending on the glints (108, 110) detected by the event camera (200) and in particular depending on a detected geometric shape of the detected glints (108, 110).

6. A method (500) for operating data glasses (400), in particular for estimating a model of an eye (2), comprising: generating (502) a plurality of spatially offset light beams (104) from light visible to a human user; radiating (504) each image (102a, 102b, 102c, 102d, 102e, 102f, 102g, 102h) to be generated in a respective individual light beam (104a, 104b, 104c, 104d; 104e, 104f, 104g, 104h) of the plurality of light beams (104) onto the eye (2), by means of the illumination device (100); an individual activation (506), in particular an individual generation, of at least a portion of the plurality of light beams (104), wherein at least a portion of the plurality (104) of light beams (104) is activated (506), in particular generated, by means of the illumination device (100) in such a way that a first number of glints (108), comprising at least two glints (108a, 108b, 108d; 108a', 108c'; 108e, 108f, 108g, 108h, 108e', 108f, 108h'), is created on the eye (2); and a detection (508) of the first number of glints (108) by means of an event camera (200).

7. The method (500) according to claim 6 comprising deflecting (510) the plurality of light beams (104) onto the eye (2) by means of a deflection device (406, 406a), in particular a holographic optical element, and / or deflecting (512) glints (108, 110) arising on the eye (2), in particular for a specific wavelength range or a specific wavelength of the illumination device (100), onto the event camera (200) by means of the deflection device (406, 406b).

8. The method (500) according to claim 7, wherein by means of the deflection device (406, 406a) of at least one light beam (104, ..., 104d; 104e ... 104h) of the plurality of light beams (104) a replica (104a 1, 104c'; 104e', 104f', 104g', 104h') is generated (514) and this is radiated onto the eye (2), the plurality of light beams (104) being spatially structured in particular and the deflection device (406, 406a) being designed in such a way that no overlap of individual light beams (104a... 104d; 104e... 104h) of the plurality of light beams (104) will result, wherein for each replica (104a 1 , 104c'; 104e', 104f', 104h'), which is not radiated onto the pupil (4) of the eye (2), a glint (108a 1 , 108c'; 108e', 108f', 108h'), whereby the first number of glints (108) also includes the number of glints generated by the replica (104a 1 , 104c') resulting glints (108a 1 , 108c'; 108e', 108f', 108h').

9. The method (500) according to one of claims 7 or 8, wherein the deflection device (406, 406a, 406b) has at least one partial section (408a, 408b) which is guided by the illumination device (100), in particular permanently, and wherein a second number of glints (110, 110a, 110b) is generated on the eye (2) by means of the at least one partial section (408a, 408b), wherein the at least one partial section (408a, 408b) is designed such that at least a part of the second number of glints (110, 110a, 110b) will arise outside the pupil (4) of the eye (2) and wherein the second number of glints (110, 110a, 110b) is also recorded by means of the event camera (200).

10. The method (500) according to one of claims 6 to 9, comprising determining (516) a model of the eye (2) depending on the glints (108, 110) detected by the event camera (200) and in particular depending on a detected geometric shape of the detected glints (108, 110).

11. A data glasses (400) comprising the device (300) according to one of claims 1 to 5, in particular the lighting device and / or the event camera (200) is arranged on a temple (402) and / or frame of the data glasses (400) and / or the deflection device (406, 406a, 406b) is arranged on a spectacle lens (404), wherein the data glasses (400) are designed to carry out the method (500) according to one of claims 6 to 10.

Citation Information

Patent Citations

  • Method and device for eye tracking using event camera data

    US20200278539A1

  • Systems and methods for event-based gaze tracking

    WO2021174106A1

  • Optical system for a retinal scan display and method for projecting image contents onto a retina

    WO2023274628A1