Method for projecting image content onto retina of user

Abstract

The present invention relates to an optical system (101b) for a virtual retinal display (Retinal Scan Display). In this case, a plurality of first exit pupils (A, B) and a replicated second exit pupil (A ', B') are produced. The computing unit (53a) is designed to compute a workpiece. A second light beam (51a) in a first infrared wavelength range or a modulation of the power of a second light source (83a) detected by means of a first sensor (62a) and / or a third light beam (67a) in a second infrared wavelength range or a third light source (85a) backscattered from the outer surface (56a) of the eye The position of the first exit pupil (A, B) relative to the pupil center point (59a) and the position of the second exit pupil (A ', B') relative to the pupil center point (59a) are determined on the basis of the modulation of the power of the backscattered third light beam (67a) detected by means of a second sensor (65a) and / or on the basis of the modulation of the power of the backscattered third light beam (67a) detected by means of a second sensor (65a) or of the power of the third light source (85a). In addition, the calculation unit (53a) is used for distinguishing the ascertained position of the ascertained first exit pupil (A, B) relative to the pupil center point (59a) and the ascertained position of the ascertained second exit pupil (A ', B') relative to the pupil center point (59a) from each other.

Description

Technical Field

[0001] The present invention relates to an optical system for a virtual retinal display. Additionally, the present invention relates to a method for projecting image content onto a user's retina. Background Art

[0002] A multi-eye window retinal scanning system is known from document US 10,254,547 B2. Here, the positions of multiple exit pupils are determined based on the detected light beams backscattered from the eyes. In addition, it is determined here which exit pupil is currently best oriented relative to the eye. Summary of the invention

[0003] Based on this, the object of the present invention is to develop an optical system for a virtual retinal display which, when replicating the exit pupil, is also able to determine different positions of the exit pupil relative to the pupil center.

[0004] In order to achieve this object, an optical system for a virtual retinal display (Retinal Scan Display) is proposed according to claim 1. Furthermore, a method for projecting image content onto the retina of a user is proposed according to claim 15.

[0005] Here, the optical system has an image source and an image processing device, the image source provides image content in the form of image data, and the image processing device is used for the image data. In addition, the optical system has a projector unit, the projector unit has a first light source that can be modulated in time and has a deflection device that can be controlled, the first light source is used to generate at least one first light beam, especially a visible first light beam, and the deflection device is used to scan the projection image content. In particular, the deflection device is a micromirror, which is supported in a rotatable manner around the first and / or second rotation axis. In addition, the projector unit has a second light source, which is used to generate at least one second light beam in a first infrared wavelength range. In this context, the deflection device that can be controlled is configured to deflect at least one second light beam in a scanning manner. Alternatively or additionally, the projector unit includes a third light source, which is used to generate at least one third light beam in a second infrared wavelength range, which is different from the first infrared wavelength range. In this context, the deflection device that can be controlled is also configured to deflect at least one third light beam in a scanning manner. In addition, the optical system comprises a steering unit onto which the image content can be projected and which is designed to direct the projected image content and the second light beam to the eye of the user. In addition, the optical system comprises an optical segmentation element, which is arranged between the projector unit and the steering unit, by means of which the image content and the second light beam can be projected via different imaging paths onto at least one projection area of ​​the steering unit, so that a plurality of first exit pupils arranged in a spatially offset manner are generated, in particular with a temporal offset. Alternatively or additionally, the third light beam is projected onto at least one projection area of ​​the steering unit via different imaging paths by means of the optical segmentation element, so that a plurality of first exit pupils arranged in a spatially offset manner are generated, in particular with a temporal offset. The optical segmentation element is in particular an optical segmentation lens. In addition, the optical system comprises an optical duplication component, which is arranged in at least one projection area of ​​the deflection unit and is designed to direct the projected image content to the user's eye in a duplicated manner, so that a plurality of spatially offset second exit pupils with the image content are generated, in particular in a time-staggered manner. In addition, the optical duplication component is designed to direct the second light beam to the user's eye in a duplicated manner. Alternatively or additionally, the optical duplication component is designed to direct the third light beam to the user's eye. In addition, the optical system element comprises a first sensor, which is designed to detect a second light beam backscattered from the outer surface of the user's eye, in particular the iris or sclera, or a modulation of the power of the second light source, in particular the laser power.Alternatively or additionally, the first sensor is suitable for detecting a third light beam backscattered from the outer surface of the eye or a modulation of the power of the third light source, in particular a laser power. Alternatively or additionally, the optical system comprises a second sensor configured to detect a third light beam backscattered from the outer surface of the eye or a modulation of the power of the third light source, in particular a laser power. Furthermore, the optical system comprises a calculation unit configured to determine the position of the first exit pupil relative to the pupil center, in particular a different position, and the position of the second exit pupil relative to the pupil center, in particular a different position, based on the backscattered second light beam or the modulation of the power of the second light source detected by means of the first sensor. Alternatively or additionally, the calculation unit is configured to determine the position of the first exit pupil relative to the pupil center and the position of the second exit pupil relative to the pupil center, in particular a different position, based on the backscattered third light beam or the modulation of the power of the third light source detected by means of the second sensor. In addition, the computing unit is used to distinguish the sought position of the first exit pupil relative to the pupil center point from the sought position of the second exit pupil relative to the pupil center point, especially for image processing. This means that, as a result of the calculation operation, the sought position of the first exit pupil and the sought position of the second exit pupil are clearly distinguished from each other. For example, this distinction can be performed by different tables or different output ends of the computing unit. Preferably, this distinction of the sought position is performed by signal analysis processing of sensor data detected by means of the first and / or second sensor. The first and second exit pupils are generated simultaneously as a pair A, A' or B, B' during simple duplication, and can cause double images when imaged on the user's retina at the same time. By distinguishing the position of the first exit pupil from the position of the second exit pupil, confusion, especially ambiguity, can be prevented when image processing is performed by means of an image processing device.

[0006] Preferably, the calculation unit is configured to determine, in particular, only the positions of the first and second exit pupils, which are incident on the user's retina at the time of detecting the backscattered second light beam or the modulation of the power of the second light source. Alternatively or additionally, the calculation unit is configured to determine the positions of the first and second exit pupils, which are incident on the user's retina at the time of detecting the backscattered third light beam or the modulation of the power of the third light source. Therefore, only the positions of the first and second exit pupils are determined and distinguished from each other, which may indeed also cause double vision for the user. For example, the other exit pupils are blocked by the iris and therefore cannot reach the user's retina at all. Preferably, the calculation unit is further configured to determine the corresponding components of the first and second exit pupils, which are incident on the user's retina at the time of detecting the backscattered second light beam or the modulation of the power of the second light source. Alternatively or additionally, the calculation unit is used to determine the corresponding components of the first exit pupil and the second exit pupil, which are incident on the user's retina at the time point of detecting the backscattered third light beam or the modulation of the power of the third light source. Therefore, it is also possible to more accurately distinguish between the first and second exit pupils or the components of the first and second exit pupils that can actually cause double images.

[0007] Preferably, the computing unit is configured to display the determined position of a first exit pupil, in particular a plurality of first exit pupils, in different ways on the image relative to the determined position of a second exit pupil, in particular a plurality of second exit pupils, generated simultaneously with the first exit pupil. Thus, the first and second exit pupils generated as a pair A, A' or B, B' at the same point in time in a simple copy can be displayed in the form of an image, for example as a grayscale image, wherein the first exit pupil is displayed in a different way relative to the second exit pupil. The distinction between the first exit pupil and the second exit pupil can be achieved in particular by different intensities, in particular color intensities, of the first exit pupil relative to the second exit pupil. For this purpose, in particular, light beams of different infrared wavelength ranges can be detected or used for the first and second exit pupils, respectively.

[0008] Preferably, the deflection unit is configured to direct the second light beam to the first exit pupil and to the user's eye. Thus, the first and second light beams have the same beam path from the deflection unit in the direction of the user's eye. Thus, the first exit pupil is formed by means of the first and second light beams, whereby the calculation unit can more accurately determine the position of the exit pupil.

[0009] Preferably, the optical replication component is designed to guide the replicated second light beam to the second exit pupil and to the user's eye. Therefore, the first and second light beams have the same optical path in the direction of the user's eye starting from the optical replication component. Therefore, the second exit pupil is formed by means of the first and second light beams, whereby the calculation unit can more accurately determine the position of the second exit pupil. Here, the distinction between the first and second exit pupil is achieved via signal analysis processing. In particular, in this context, the measured intensities of the first and second exit pupils can be used. The first and second exit pupils that are incident on the pupil at the same time produce different intensity changes compared to the first or second exit pupil that only enters. Preferably, in this context, the optical replication component is also designed to scan, in particular the entire surface, on the eye area including the pupil of the user. The third light beam is scanned in a backscattered manner. The advantage of this is that the relative positions of the individual exit pupils relative to each other and relative to the eye can also be determined by the third light beam. In this context, preferably, only the first sensor is used to detect the second and third light beams. Here, the bandpass filter before the first sensor can be designed in such a way that the two IR wavelength ranges are passed without being attenuated. The first and second exit pupils that do not reach the retina are displayed as bright spots. The first and second exit pupils that enter the pupil and then impinge on the retina disappear in the image. Alternatively, the first sensor is configured to detect the backscattered second light beam and the second sensor is configured to detect the backscattered third light beam. Then, at a later point in time, a fusion or addition of the two results is performed, in particular a fusion or addition in a common image.

[0010] Alternatively, the optical reproduction component is designed to guide the third light beam to the second exit pupil and to the eye of the user. Therefore, the first and third light beams have the same beam path from the optical reproduction component in the direction of the eye of the user. Therefore, the second exit pupil is formed by means of the first and third light beams, whereby the calculation unit can determine the position of the second exit pupil more accurately. In particular, by using light beams of different infrared wavelengths, the first and second exit pupils can be easily distinguished, in particular in an image-based manner.

[0011] Preferably, the first and / or the second sensor is designed as a photodiode.

[0012] Preferably, the projector unit is configured to combine the first light beam and the second light beam into a common light beam. Alternatively, the projector unit is configured to combine the first, second and third light beams into a common light beam.

[0013] Preferably, the deflection unit is configured as a first holographic optical element, in particular a layer. In addition, the optical replication component is configured as a second holographic optical element, in particular a layer. Here, the first and second holographic optical elements are present in a stacked manner, in particular in a stacked manner. Alternatively, the deflection unit and the optical replication component are configured as a third holographic optical element, in particular a common third holographic optical element, in particular a layer. Here, the third holographic optical element has a first deflection function, which guides the projected image content and the second light beam to the user's eyes. In addition, the third holographic optical element has a second deflection function, which guides the projected image content and the second light beam to the user's eyes in a replicated manner. Alternatively or additionally, the second deflection function is used to guide the projected image content and the third light beam to the user's eyes. Such a holographic optical element is also called a multiplexed HOE.

[0014] Preferably, the image processing device is designed to generate sub-image data from the image data based on the different ascertained positions of the first exit pupil relative to the pupil center point and the ascertained positions of the second exit pupil relative to the pupil center point in such a way that only one exit pupil generated on the common imaging path is always imaged on the retina of the user, in particular with the same image data. In particular, the sub-image data include a copy or (distorted, partially blanked, offset, twisted or otherwise scaled) version of the image content. Thus, the generation of double images on the retina of the user is prevented, because for the user, the same image content always fades in only once at the same point in time.

[0015] Preferably, the optical system element is designed as data glasses.

[0016] Another subject of the present invention is a method for projecting image content onto the retina of a user by means of an optical system. The optical system is in particular the optical system described above. The optical system has an image source, which provides image content in the form of image data. Additionally, the optical system has an image processing device for the image data. In addition, the optical system has a projector unit, which has a first light source that can be modulated in time and a deflection device that can be controlled, the first light source is used to generate at least one first light beam, the deflection device is used for at least one first light beam, and the deflection device is used for scanning projection of image content. Additionally, the projector unit has a second light source, the second light source is used to generate at least one second light beam in an infrared wavelength range. In this context, the deflection device that can be controlled is configured to deflect at least one second light beam in a scanning manner. Alternatively or additionally, the projector unit has a third light source, the third light source is used to generate at least one third light beam in a second infrared wavelength range, the second infrared wavelength range being different from the first infrared wavelength range. In this context, the deflection device that can be controlled is configured to deflect at least one third light beam in a scanning manner. In addition, the optical system comprises a steering unit, onto which the image content can be projected, and which is set up to guide the projected image content and the second light beam to the eyes of the user. In addition, an optical segmentation element arranged between the projector unit and the steering unit and an optical copying component are provided, which is arranged in the projection area of ​​the steering unit. In addition, the optical system has a first sensor. Alternatively or additionally, the optical system has a second sensor. In addition, the optical system comprises a computing unit. In the method for projecting the image content onto the retina of the user, firstly, the image content and the second light beam are projected onto at least one projection area of ​​the steering unit via different imaging paths by means of the optical segmentation element, so that a plurality of first exit pupils arranged in a spatially staggered manner are generated, in particular in a time-staggered manner. Alternatively or additionally, the image content and the second light beam are projected onto at least one projection area of ​​the steering unit via different imaging paths by means of the optical segmentation element, so that a plurality of first exit pupils arranged in a spatially staggered manner are generated, in particular in a time-staggered manner. In both cases, at least the individual imaging paths can be controlled individually. Furthermore, the projected image content is directed to the user's eye in a replicated and spatially offset manner by means of the optical duplication component, so that a plurality of replicated second exit pupils with image content arranged spatially offset to one another are generated, in particular in a temporally offset manner. Additionally, the second light beam is directed to the user's eye in a replicated manner by means of the optical duplication component. Alternatively or additionally, the third light beam is directed to the user's eye in a replicated manner by means of the optical duplication component.In addition, a second light beam backscattered from the outer surface of the user's eye, in particular the iris or sclera, or a modulation of the power of the second light source, in particular the laser power, is detected by means of the first sensor. Alternatively or additionally, a third light beam backscattered from the outer surface of the eye or a modulation of the power of the third light source, in particular the laser power, is detected by means of the first sensor. In addition, alternatively or additionally, a third light beam backscattered from the outer surface of the eye or a modulation of the power of the third light source, in particular the laser power, is detected by means of the second sensor. In a further method step, a position, in particular a different position, and a position, in particular a different position, of the first exit pupil relative to the pupil center are determined by means of a calculation unit based on the backscattered second light beam or the modulation of the power of the second light source detected by means of the first sensor. Alternatively or additionally, a position, in particular a different position, and a position, in particular a different position, of the first exit pupil relative to the pupil center are determined by means of a calculation unit based on the backscattered third light beam or the modulation of the power of the third light source detected by the first and / or second sensor. Furthermore, the ascertained position of the first exit pupil relative to the pupil center point and the ascertained position of the second exit pupil relative to the pupil center point are distinguished from one another by means of the computing unit, in particular for image processing by means of the image processing device.

[0017] Preferably, with the aid of an image processing device, sub-image data are generated from the image data based on the different positions of the second exit pupil relative to the pupil center point and the first exit pupil relative to the pupil center point, so that only one exit pupil generated on a common imaging path is always imaged on the retina of the user, in particular with the same image data. BRIEF DESCRIPTION OF THE DRAWINGS

[0018] Figure 1 A first embodiment of an optical system for a virtual retinal display is shown.

[0019] Figure 2 A second embodiment of an optical system for a virtual retinal display is shown.

[0020] Figure 3 A third embodiment of an optical system for a virtual retinal display is shown.

[0021] Figure 4 The arrangement of the first and second exit pupils on the user's exit pupil plane is shown.

[0022] Figure 5 The detected intensities of the first and second exit pupils are shown.

[0023] Figures 6a to 6d Image showing the positions of the first and second exit pupils.

[0024] Figure 7a A first method for projecting image content onto the retina of a user by means of an optical system is shown.

[0025] Figure 7b A second method for projecting image content onto the retina of a user by means of an optical system is shown. DETAILED DESCRIPTION

[0026] Figure 1A first embodiment of an optical system 101a for a virtual retinal display is schematically shown. Here, the optical system 101a has an image source 26a, which provides image content in the form of image data 12a. In addition, the optical system 101a has an image processing device 10a for the image data 12a. In addition, the optical system 101a includes a projector unit 16a, which has a first light source 82a that can be modulated in time and has a deflection device 92a that can be controlled, the first light source is used to generate at least one first light beam, the deflection device is used for at least one first light beam, and the deflection device is used for scanning projection of image content. In addition, the projector unit has a second light source 83a, which is used to generate at least one second light beam in a first infrared wavelength range. The deflection device 92a that can be controlled is at least one micromirror supported in a rotatable manner in this embodiment, and the deflection device is configured to deflect at least one second light beam in a scanning manner. In addition, the optical system 101a has a deflection unit 20a, onto which image content can be projected and which is designed to guide the projected image content and the second light beam to the eye 24a of the user. In addition, the optical system 101a has an optical segmentation element 31a, which is arranged between the projector unit 16a and the deflection unit 20a, by means of which the image content and the second light beam can be projected via different imaging paths 28a and 30a onto at least one projection area 34a of the deflection unit 20a, so that a plurality of spatially offset first exit pupils A and B are generated, in particular in a temporally offset manner. In this exemplary embodiment, the first exit pupils A and B are shown on the exit pupil plane 54a. In this case, different imaging paths 28a and 30a are generated starting from different virtual micromirror positions 102a and 104a, and the different imaging paths can be controlled individually. In this embodiment, the deflection unit 20a is used to guide the second light beam to the first exit pupils A and B and to the user's eye 24a. In addition, the optical system 101a includes an optical duplication component 150a, which is arranged in at least one projection area 34a of the deflection unit 20a and is configured to guide the projected image content to the user's eye 24a in a duplicated manner, so that a plurality of spatially offset second exit pupils A' and B' with the image content are generated, in particular generated in a time-staggered manner. In this embodiment, the second exit pupils A' and B' are shown on the exit pupil plane 54a. In addition, the optical duplication component 150a is configured to guide the second light beam to the user's eye 24a in a duplicated manner. In this embodiment, the optical duplication component 150a is used to guide the duplicated second light beam to the second exit pupils A' and B' and to the user's eye 24a.In addition, the optical system 101a includes a first sensor 62a, which is configured to detect the second light beam 51a backscattered from the outer surface 56a of the user's eye or the modulation of the power of the second light source 83a, in particular the laser power. In addition, the optical system 101a includes a calculation unit 53a, which is configured to determine different positions of the first exit pupil A and B relative to the pupil center 59a and different positions of the second exit pupil A' and B' relative to the pupil center 59a based on the backscattered second light beam 51a or the modulation of the power of the second light source 83a detected by means of the first sensor 62a. In addition, the calculation unit 53a is used to distinguish the determined positions of the first exit pupil A and B relative to the pupil center 59a from the determined positions of the second exit pupil A' and B' relative to the pupil center 59a, in particular for image processing performed by means of the image processing device 10a.

[0027] In this exemplary embodiment, first sensor 62 is designed as a photodiode.

[0028] In particular, the projector unit 16a is used to combine the first light beam and the second light beam into a common light beam 18a.

[0029] In this embodiment, the optical segment element 31 a is configured as an optical segment lens having at least two segments 32 a and 36 a .

[0030] In the illustrated embodiment, the first light source 82a is configured to emit a first red laser beam. In addition, the projector unit 16a includes a fourth light source 84a for generating a green laser beam and a fifth light source 86a for generating a blue laser beam. Here, all light sources are configured as laser diodes. In addition, the projector unit 16a includes a beam merging unit and / or a beam shaping unit 88a. The beam merging unit and / or the beam shaping unit 88a are set up to merge, in particular mix, the laser beams of different colors of the laser diodes 82a, 84a, 86a to produce a color image. The beam merging unit and / or the beam shaping unit 88a are set up to shape the common light beam 18a, in particular the laser beam, leaving the projector unit 16a. Details about the construction of the beam merging unit and / or the beam shaping unit 88a are assumed to be disclosed by the prior art. In addition, the projector unit 16a includes a beam divergence adaptation unit 90a. The beam divergence adaptation unit 90a is provided for adapting the beam divergence of a common light beam 18a, in particular a laser beam, leaving the projector unit 16a, preferably to the path length of the respective currently emitted light beam 18a, which path length is in particular dependent on the arrangement of the optical elements of the optical system 68a. In addition, in this exemplary embodiment, a control unit 80a is provided for a controllable deflection device 92a. The control unit 80a sends a control signal 94a to the controllable deflection device 92a and receives a position signal 96a, in particular a current position signal 96a, of the controllable deflection device 92a.

[0031] In this first exemplary embodiment, the deflection unit 20a is designed as a first holographic optical element 106a, in particular a layer, and the optical copy component 150a is designed as a second holographic optical element 108a, in particular a layer. In this case, two HOEs are present in a stacked manner.

[0032] Optionally, the image processing device 10a is constructed to generate sub-image data 98a and 100a from the image data 12a based on the different determined positions of the first exit pupils A and B relative to the pupil center point 59a and the determined positions of the second exit pupils A' and B' relative to the pupil center point 59a in such a way that only one exit pupil A or A' and B or B' generated on the common imaging path 28a or 30a is always imaged on the user's retina 22a, in particular with the same image data.

[0033] Optionally, the optical system 101a is configured as data glasses, on whose frame or temples (not shown here) different components are arranged. In this embodiment, the deflection unit 20a and the optical copying component 150a are integrated into the lens 68a, in particular the lens 68a of the data glasses.

[0034] Figure 2 A second embodiment of an optical system 101b for a virtual retinal display is schematically shown. In this case, in contrast to the first embodiment, the projector unit 16b additionally comprises a third light source 85a for generating at least one third light beam in a second infrared wavelength range, which is different from the first infrared wavelength range. In this case, the controllable deflection device 92a is configured for also scanning-deflecting the third light beam. The projector unit 16b or its beam combining and / or beam shaping unit 88a is designed to combine the first, second and third light beams into a common light beam 18b.

[0035] Here, the optical segmentation element 31 arranged between the projector unit 16b and the deflection unit 69a is designed for projecting the image content, the second light beam and the third light beam via different imaging paths 28a and 30a onto at least one projection region 34a of the deflection unit 69a, so that a plurality of spatially offset first exit pupils A and B are generated, in particular in a temporally offset manner. Furthermore, in contrast to the first embodiment, the deflection unit 69a and the optical copying component 71a are designed as a third holographic optical element 73a, in particular as a layer. Here, the third holographic optical element 73a has a first deflection function, which directs the projected image content and the second light beam onto the first exit pupils A and B and onto the eye 24a of the user. Furthermore, the third holographic optical element 73a has a second deflection function, which directs the projected image content and the third light beam onto the second exit pupils A' and B' and onto the eye 24a of the user.

[0036] Furthermore, in contrast to the first exemplary embodiment, the optical system 101b has a second sensor 6 which is designed to detect a third light beam 67a backscattered from the eye outer surface 56a or a modulation of the power of the third light source 85a, in particular the laser power.

[0037] The calculation unit 53a is used to determine the position of the first exit pupil A and B relative to the pupil center 59a, in particular different positions, and the position of the second exit pupil A' and B' relative to the pupil center 59a, in particular different positions, based on the modulation of the power of the backscattered second light beam 51a or the second light source 83a detected by means of the first sensor 62a and based on the modulation of the power of the backscattered third light beam 67a or the third light source 85a detected by means of the second sensor 65a. In addition, the calculation unit 53a is used to distinguish the determined position of the first exit pupil A and B relative to the pupil center 59a from the determined position of the second exit pupil A' and B' relative to the pupil center 59a.

[0038] In this exemplary embodiment, the second sensor 65 a is also designed as a photodiode.

[0039] Figure 3 A third embodiment of an optical system 101c for a virtual retinal display is schematically shown. In contrast to the first embodiment, an additional third light source 85a is provided for generating at least one third light beam in a second infrared wavelength range that is different from the first infrared wavelength range. Figure 1 Similarly, the deflection unit 20b and the optical duplication component 150b direct the second light beam and the duplicated second light beam to the first exit pupil A and B and the second exit pupil A' and B', while an additional deflection function is integrated in the optical duplication component 150b, which scans the third light beam over the entire surface of the user's pupil 57a. In this third embodiment, the first sensor 62a is configured to detect not only the second light beam 51a backscattered from the outer surface 56a of the eye, but also the third light beam 67b backscattered from the outer surface 56a of the eye.

[0040] Figure 4 An exemplary arrangement of first exit pupils A, B, C and D and second exit pupils A', B', C' and D' on the user's exit pupil plane 10 is schematically shown. Here, the exit pupils A, A', B, B', C, C', D and D' are staggered and distributed in a pattern, in particular in a grid. A grid should be understood in particular as a regular pattern distributed on a surface. Figure 3 As shown, the first exit pupils B and D almost completely enter the user's pupil 11, while the second exit pupils B' and D' generated at the same time are reflected by the user's iris (not shown here) and therefore do not reach the user's retina. The first exit pupil A and the second exit pupil A' generated at the same time are at least partially arranged in the user's pupil 11. In addition, the first exit pupil C and the second exit pupil C' generated at the same time are at least partially arranged in the user's pupil 11. In both cases, double images can be generated at the user, so it is advantageous to distinguish the first exit pupils A, B, C and D from the second exit pupils A', B', C' and D'.

[0041] For the arrangement of exit pupils A, A', B, B', C, C', D and D', Figure 5 The signal detection of a first exit pupil A and a second exit pupil A′ occurring simultaneously is shown by way of example. Intensity is plotted on the Y-axis 160 and time is plotted on the X-axis 161 .

[0042] At a first point in time 162, only the first exit pupil A reaches (trifft) the pupil, while the second exit pupil A' does not enter the pupil. Therefore, the measured intensity 164 drops. At a subsequent point in time 163, the eye turns and now at least a part of the second exit pupil A' reaches the pupil of the user's eye in addition to the first exit pupil A. Due to the simultaneous entry of the exit pupils A and A', the measured intensity 164 drops more strongly than at the first point in time 163.

[0043] Corresponding to Figure 3 The arrangement of the upper exit pupils A and A', Figure 6a A first image 30 is shown, created at a first point in time, for the position of a first exit pupil A relative to the position of a second exit pupil A' generated simultaneously with the first exit pupil A, ascertained from the backscattered second and / or third light beam. In an area 31, no second and / or third light beam enters the pupil of the user. Therefore, the exit pupils A' and A only partially reach the retina of the user. In order to distinguish between the first exit pupil A and the second exit pupil A', the exit pupils A and A' have different grayscales.

[0044] Corresponding to Figure 3 The arrangement of the upper exit pupils B and B', Figure 6b A second image 40 is shown, which is created at a second point in time after the first point in time, and which is used for the position determined based on the backscattered second and / or third light beam of the first exit pupil B. In this case, the first exit pupil B strikes the retina of the user in its entirety, while the associated second exit pupil B' is completely reflected by the iris.

[0045] Corresponding to Figure 3 The arrangement of the upper exit pupils C and C', Figure 6c A third image 50 is shown, created at a third time point after the second time point, for the position of the first exit pupil C relative to the determined position of the second exit pupil C' generated simultaneously with the first exit pupil C, determined based on the backscattered second and / or third light beam. In the area 51, no second and / or third light beam enters the pupil of the user. Therefore, the exit pupils C' and C only partially reach the retina of the user. In order to distinguish between the first exit pupil C and the second exit pupil C', the exit pupils C and C' also have different grayscales here.

[0046] Corresponding to Figure 3 The arrangement of the upper exit pupils D and D', Figure 6dA fourth image 60 is shown, which is created at a fourth point in time after the third point in time, and which is used for the position determined based on the backscattered second and / or third light beam of the first exit pupil D. In this case, the first exit pupil D reaches the retina of the user in its entirety, while the associated second exit pupil D' is completely reflected by the iris.

[0047] In all cases, the computing unit is particularly designed to determine only the positions of the first exit pupils A, B, C and D and the second exit pupils A' and C' which are incident on the retina of the user at the time of detecting the backscattered second light beam or the modulation of the power of the second light source and / or at the time of detecting the backscattered third light beam or the modulation of the power of the third light source.

[0048] Figure 7a A first method for projecting image content onto the retina of a user by means of an optical system is shown in the form of a flow chart. The optical system is in particular Figure 1 And the optical system shown in FIG6 .

[0049] In this case, in a first method step 200, the image content and the second light beam are projected via different imaging paths onto at least one projection area of ​​the deflection unit by means of an optical segmentation element, so that a plurality of first exit pupils arranged in a spatially offset manner are generated, in particular in a time-staggered manner. At least the individual imaging paths can be controlled individually. In addition, in a method step 220, the projected image content is replicated by means of an optical replication component and directed to the user's eye in a spatially offset manner, so that a plurality of replicated second exit pupils with the image content, arranged in a spatially offset manner, are generated, in particular in a time-staggered manner. In addition, the second light beam is directed to the user's eye in a replicated manner by means of the optical replication component. In a subsequent method step 240, the second light beam backscattered from the outer surface of the eye is detected by means of a first sensor or a modulation of the power of a second light source, in particular a laser power, is detected. In a subsequent method step 270, the position of the first exit pupil relative to the pupil center, in particular different positions, and the position of the second exit pupil relative to the pupil center, in particular different positions, are determined by means of a calculation unit based on the backscattered second light beam detected by means of the first sensor or the modulation of the power of the second light source. In a subsequent method step 290, the determined position of the first exit pupil relative to the pupil center and the determined position of the second exit pupil relative to the pupil center are distinguished from each other. The method then ends.

[0050] In method step 300, which is optional and follows method step 290, sub-image data are generated from the image data with the aid of an image processing device based on the different positions of the second exit pupil relative to the pupil center point and the different positions of the first exit pupil relative to the pupil center point in such a way that only one exit pupil generated on a common imaging path is always imaged on the retina of the user, in particular with the same image data.

[0051] Figure 7b A second method for projecting image content onto the retina of a user by means of an optical system is shown in the form of a flow chart. The optical system is in particular an optical system as shown in FIG.

[0052] In a first method step 210, the image content, the second light beam and the third light beam are projected onto at least one projection area of ​​the deflection unit via different imaging paths by means of an optical segmenting element, so that a plurality of first exit pupils arranged in a spatially offset manner are generated, in particular in a time-staggered manner. At least the individual imaging paths can be controlled individually. In addition, in a method step 230, the projected image content is replicated by means of an optical replication component and directed to the user's eyes in a spatially offset manner, so that a plurality of replicated second exit pupils arranged in a spatially offset manner with the image content are generated, in particular in a time-staggered manner. In addition, the third light beam is directed to the user's eyes in a replicated manner by means of the optical replication component. In a subsequent method step 240, the second light beam backscattered from the outer surface of the eye is detected by means of a first sensor or a modulation of the power of a second light source, in particular a laser power, is detected. In a further method step 260, the third light beam backscattered from the outer surface of the eye is detected by means of the first sensor or a modulation of the power of a third light source, in particular a laser power, is detected. Alternatively, in method step 265, a third light beam backscattered from the outer surface of the eye is detected by means of a second sensor or a modulation of the power of a third light source, in particular a laser power, is detected. In the subsequent method step 275, a position, in particular a different position, of the first exit pupil relative to the pupil center and a position, in particular a different position, of the second exit pupil relative to the pupil center are determined by means of a calculation unit based on the backscattered second light beam or the modulation of the power of the second light source detected by means of the first sensor and the third light beam backscattered from the outer surface of the eye or the modulation of the power of the third light source, in particular a laser power, or based on the backscattered second light beam or the modulation of the power of the second light source detected by means of the first sensor and the backscattered third light beam or the modulation of the power of the third light source detected by means of the second sensor. The above method step 300 is then performed and the method step ends.

Claims

1. An optical system (101a, 101b, 101c) for a virtual retinal display (Retinal Scan Display), the optical system comprising at least: a. an image source (26a) providing image content in the form of image data (12a), b. an image processing device (10a) for said image data (12a), c. A projector unit (16a, 16b), the projector unit comprising a first light source (82a) that can be modulated in time and a controllable deflection device (92a) and a second light source (83a) and / or a third light source (85a), the first light source being used to generate at least one first light beam, the controllable deflection device being used for the at least one first light beam for scanning projection of the image content, the second light source being used to generate at least one second light beam in a first infrared wavelength range, wherein the controllable deflection device (92a) is configured to scan and deflect the at least one second light beam, the third light source being used to generate at least one third light beam in a second infrared wavelength range, the second infrared wavelength range being different from the first infrared wavelength range, wherein the controllable deflection device (92a) is configured to scan and deflect the at least one third light beam, d. a steering unit (20a, 69a), onto which the image content can be projected and which is configured to direct the projected image content and the second light beam onto the user's eyes (24a), e. an optical segmentation element (31a) arranged between a projector unit (16a, 16b) and a deflection unit (20a, 69a), the image content and the second light beam and / or the third light beam being projectable via different imaging paths (28q, 30a) onto at least one projection region (34a) of the deflection unit (20a, 69a) by means of the optical segmentation element, so that a plurality of spatially offset first exit pupils (A, B, C, D) are generated, in particular in a temporally offset manner, wherein at least each imaging path (28a, 30a) can be controlled individually, f. an optical copying component (71a, 150a, 150b) which is arranged in at least one projection area (34a) of a deflection unit (20a, 69a) and is designed to direct the projected image content in a replicated manner onto the eye (24a) of the user, so that a plurality of replicated second exit pupils (A', B', C', D') with the image content, which are arranged spatially offset to one another, are generated, in particular in a time-staggered manner, wherein the optical copying component (71a, 150a, 150b) is additionally designed to direct the second light beam in a replicated manner and / or the third light beam onto the eye (24a) of the user, g. a first sensor (62a), which is configured to detect a second light beam (51a) backscattered from an outer surface (56a) of the user's eye, in particular an iris or a sclera, or a modulation of the power of the second light source (83a), in particular a laser power, and / or a third light beam (67a, 67b) backscattered from an outer surface (56a) of the eye, or a modulation of the power of the third light source (85a), in particular a laser power, and / or h. a second sensor (65a) configured to detect a third light beam (67a, 67b) backscattered from the outer surface (56a) of the eye or a modulation of the power, in particular the laser power, of the third light source (85a), i. a calculation unit (53a) configured to determine the first exit pupil (A, B, C, D) based on a backscattered second light beam (51a) detected by means of the first sensor (62a) or a modulation of the power of the second light source (83a), and / or based on a backscattered third light beam (67a, 67b) detected by means of the first sensor (62a) and / or the second sensor (65a) or a modulation of the power of the third light source (85a). The position relative to the pupil center point (59a), in particular different positions, and the position of the second exit pupil (A', B', C', D') relative to the pupil center point (59a), in particular different positions, and the obtained position of the first exit pupil (A, B, C, D) relative to the pupil center point (59a) and the obtained position of the second exit pupil (A', B', C', D') relative to the pupil center point (59a) are distinguished from each other, in particular for the image processing.

2. The optical system (101a, 101b, 101c) according to claim 1, characterized in that: The calculation unit (26a) is constructed to determine, in particular only determine, the positions of a first exit pupil (A, B, C, D) and a second exit pupil (A', B', C', D') as follows: the first exit pupil and the second exit pupil are incident on the user's retina (22a) at a time point when a backscattered second light beam (51a) is detected or a modulation of the power of the second light source (83a) is performed and / or at a time point when a backscattered third light beam (67a, 67b) is detected or a modulation of the power of the third light source (85a).

3. The optical system (101a, 101b, 101c) according to claim 2, characterized in that: The computing unit (26a) is additionally configured to determine corresponding components of the first exit pupil (A, B, C, D) and the second exit pupil (A', B', C', D'), which are incident on the user's retina (22a) at a time point when a backscattered second light beam (51a) is detected or a modulation of the power of the second light source (82a) is performed and / or at a time point when a backscattered third light beam (67a, 67b) is detected or a modulation of the power of the third light source (85a).

4. The optical system (101a, 101b, 101c) according to any one of claims 1 to 3, characterized in that: The calculation unit (26a) is designed to display the ascertained position of the first exit pupil (A, B, C, D) in different ways, in particular with different intensities, on the images (30, 40, 50, 60) relative to the ascertained position of the second exit pupil (A', B', C', D') generated simultaneously with the first exit pupil (A, B, C, D).

5. The optical system (101a, 101b, 101c) according to any one of claims 1 to 4, characterized in that: The deflection unit (20a, 69a) is designed to direct the second light beam to the first exit pupil (A, B, C, D) and to the eye (24a) of the user.

6. The optical system (101a, 101b, 101c) according to any one of claims 1 to 5, characterized in that: The optical replication component (71a, 150a, 150b) is configured to direct the replicated second light beam to the second exit pupil (A', B', C', D') and to the eye (24a) of the user.

7. The optical system (101a, 101b, 101c) according to claim 6, characterized in that: The optical copying element (71a, 150a, 150b) is further configured to scan the third light beam over an eye region including a pupil (57a) of the user, in particular over the entire surface.

8. The optical system (101a, 101b, 101c) according to any one of claims 1 to 5, characterized in that: The optical replication component (71a, 150a, 150b) is configured to direct the third light beam onto the second exit pupil (A', B', C', D').

9. The optical system (101a, 101b, 101c) according to any one of claims 1 to 8, characterized in that: The first sensor (62a) and / or the second sensor (65a) are designed as photodiodes.

10. The optical system (101a, 101b, 101c) according to any one of claims 1 to 9, characterized in that: The projector unit (16a, 16b) is designed to combine the first light beam and the second light beam and / or the third light beam into a common light beam (18a, 18b).

11. The optical system (101a, 101b, 101c) according to any one of claims 1 to 10, characterized in that: The deflection unit (20a, 69a) is designed as a first holographic optical element (106a), in particular a layer, and the optical copy component (71a, 150a, 150b) is designed as a second holographic optical element (108a), in particular a layer.

12. The optical system (101a, 101b, 101c) according to any one of claims 1 to 10, characterized in that: The deflection unit (20a, 69a) and the optical copying component (71a, 150a, 150b) are constructed as a third holographic optical element (73a), in particular a layer, wherein the third holographic optical element (73a) has a first deflection function, which directs the projected image content and the second light beam to the user's eyes (24a), and wherein the third holographic optical element (73a) has a second deflection function, which directs the projected image content and the second light beam in a replicating manner and / or directs the third light beam to the user's eyes (24a).

13. The optical system (101a, 101b, 101c) according to any one of claims 1 to 12, characterized in that: The image processing device (10a) is constructed to generate sub-image data (98a, 100a) from the image data (12a) based on the different determined positions of the first exit pupil (A, B, C, D) relative to the pupil center point (59a) and the determined positions of the second exit pupil (A', B', C', D') relative to the pupil center point (59a), so that only one exit pupil (A, B, C, D, A', B', C', D') generated on a common imaging path (28a, 30a) is always imaged on the retina (22a) of the user, in particular with the same image data (12a).

14. The optical system (101a, 101b, 101c) according to any one of claims 1 to 13, characterized in that: The optical system (101a, 101b, 101c) is designed as data glasses.

15. Method for projecting image content onto a retina of a user by means of an optical system (101a, 101b, 101c), in particular an optical system (101a, 101b, 101c) according to any one of claims 1 to 14, the optical system comprising at least: a. an image source (26a) providing image content in the form of image data (12a), b. an image processing device (10a) for said image data (12a), c. A projector unit (16a, 16b), the projector unit comprising a first light source (82a) that can be modulated in time and a controllable deflection device (92a) and a second light source (83a) and / or a third light source (85a), the first light source being used to generate at least one first light beam, the controllable deflection device being used for the at least one first light beam for scanning projection of the image content, the second light source being used to generate at least one second light beam in a first infrared wavelength range, wherein the controllable deflection device (92a) is configured to scan and deflect the at least one second light beam, the third light source being used to generate at least one third light beam in a second infrared wavelength range, the second infrared wavelength range being different from the first infrared wavelength range, wherein the controllable deflection device (92a) is configured to scan and deflect the at least one third light beam, d. a steering unit (20a, 69a) onto which the image content can be projected and which directs the projected image content and the second light beam onto the user's eyes (24a), e. an optical segmentation element (31a) arranged between the projector unit (16a, 16b) and the deflection unit (20a, 69a), f. an optical copying member (71a, 150a, 150b) arranged in the projection area (34a) of the deflection unit (20a, 69a), g. a first sensor (62a) and / or a second sensor (65a), h. a computing unit (53a), wherein the image content and the second and / or third light beam are projected via different imaging paths (28a, 30a) onto at least one projection region (34a) of the deflection unit (20a, 69a) by means of the optical segmentation element (31a), so that a plurality of spatially offset first exit pupils (A, B, C, D) are generated, in particular generated in a temporally offset manner (200, 210), wherein at least the individual imaging paths (28a, 30a) can be controlled individually, wherein the projected image content is directed in a replicated and spatially offset manner to the user's eye (24a) by means of the optical copying component (71a, 150a, 150b), so that a plurality of replicated second exit pupils (A', B', C', D') with the image content, which are arranged spatially offset to one another, are generated, in particular in a temporally offset manner, wherein the second light beam and / or the third light beam are additionally directed in a replicated manner (220, 230) to the user's eye (24a) by means of the optical copying component (71a, 150a, 150b), wherein a second light beam backscattered from the outer surface (56a) of the user's eye, in particular the iris or sclera, or a modulation of the power of the second light source (83a), in particular the laser power, and / or a third light beam (67a, 67b) backscattered from the outer surface (56a) of the eye, or a modulation of the power of the third light source (85a), in particular the laser power, is detected (240, 260) by means of the first sensor (62a), and / or wherein a third light beam (67a, 67b) backscattered from the outer surface (56a) of the eye or a modulation of the power, in particular the laser power, of the third light source (85a) is detected (265) by means of the second sensor (65a), wherein, with the aid of the computing unit (53a), based on the backscattered second light beam (51a) detected by the first sensor (62a) or the modulation of the power of the second light source (83a) and / or the backscattered third light beam (67a, 67b) from the outer surface of the eye (56a) or the modulation of the power, in particular the laser power, of the third light source (85a), and / or based on the backscattered third light beam (67a, 67b) detected by the second sensor (65a) or the modulation of the power of the third light source (85a), a power value (270) is determined. , 275) the position of the first exit pupil (A, B, C, D) relative to the pupil center point (59a), in particular different positions, and the position of the second exit pupil (A', B', C', D') relative to the pupil center point (59a), in particular different positions, and the obtained position of the first exit pupil (A, B, C, D) relative to the pupil center point (59a) and the obtained position of the second exit pupil (A', B', C', D') relative to the pupil center point (59a) are distinguished from each other (290), in particular for the image processing.

Images