Method and apparatus for projecting a pattern of interest onto a modified retinal region of the human eye - Patents.com

Abstract

The present invention relates to a method for projecting a pattern of interest (6) onto an altered retinal region (5) of a human eye, comprising the steps of providing a pulsed input light beam (20), modulating and splitting the pulsed input light beam (20) into a modulated pulsed light pattern of modulated pulsed sub-beams (40) based on the pattern of interest (6), the modulated light pattern forming a pulsed output beam (4) reflecting the pattern of interest (6), and individual pulse width modulation of the modulation duty cycles (32) of the individual modulated sub-beams (40) forming the output beam (4), and a correspondingly adapted apparatus.

Description

[Technical field]

[0001] The present invention relates to a method and corresponding apparatus for projecting a pattern of interest onto an area of ​​the modified human retina, for example via implantation of a retinal implant, in order to restore its photosensitive properties. [Background technology]

[0002] Retinal dysfunction, especially caused by degenerative retinal diseases, is a major cause of visual impairment or blindness.

[0003] It is known to utilize modifications of the retinal region of the human eye, for example by utilizing a retinal implant, in other words a retinal prosthesis, in order to at least partially restore the visual function of a patient. In this regard, several different types of retinal implants based on different operating principles are known.

[0004] Retinal implants have in common that they are typically placed sub-retina, epiretina, or epichoroidally in the patient's eye, thereby essentially replacing damaged photoreceptors. In this regard, information about the visual scene is captured by a camera and transmitted to an electrode array implanted in the retina.

[0005] Among the common retinal implants, implants that include skin-penetrating wires are known. These wires have the risk of infection and scarring. Therefore, more recent implants use various wireless technologies, for example by delivering power and visual information via an inductive coil. Furthermore, it is known to deliver power inductively and visual information optically through the pupil, or to deliver both visual information and power optically.

[0006] A particularly useful type of wireless information transfer to a retinal implant is based on projecting a stimulating pattern, preferably of infrared light, onto the eye: when the gaze direction is such that a part of the implant is illuminated by a part of the pattern, the implant converts that part of the signal into an electrical current and stimulates the retina accordingly.

[0007] The retinal implant is an array of stimulating electrodes or pixels, each of which contains one or more photodiodes that capture the light delivered by the visual processor and convert it into a stimulating electrical current.

[0008] Several implant arrays can be placed in the subretinal space, typically in or near the foveal region.

[0009] Alternatively, an approach known as optogenetics has been proposed, which treats the remaining retinal cells by gene therapy to restore their photosensitive behavior. Optogenetics refers to the combination of genetics and optics to control well-defined events in specific cells of living tissue. Optogenetics consists in (i) genetically modifying target cells to render them sensitive to light by the expression of an exogenous photoreactive protein in the cell membrane, and (ii) providing a lighting device capable of providing light to said photoreactive protein.

[0010] In the following paragraphs of this patent, a retinal region of a human eye that has been modified to restore light-sensitive behavior by implantation of a retinal prosthesis or optogenetic modification of the human eye is referred to as a "modified retinal region."

[0011] It is known to use projector devices, such as augmented reality goggles, to project light or a light beam, respectively, into a human eye. A projector unit, e.g. projector optics, of the projector device projects a pulsed light beam at least partially into the human eye, i.e. the transmitted image enters the eye through the pupil of the eye and is directed towards the retina.

[0012] Thereby, it is possible to provide the patient with an illumination pattern of interest, but since the illumination is constant with each pulse of the pulsed light beam, the patient is only able to sense a single light-dark contrast.

[0013] Nevertheless, safety issues are associated with the use of such projector apparatus, for example, projector apparatus and methods of use need to ensure that the retinal illumination is below a certain duty cycle, e.g., 0.5, which may be required to ensure proper safety of modified retinal regions, e.g., retinal implants, e.g., to ensure pulsed electrical function of the implant and proper discharge between electrical pulses.

[0014] Similarly, optical safety may require a projector apparatus and method of use that ensures that the illumination of the retina respects the duty cycle to ensure that the average light irradiance does not reach a safety threshold. That way, high light irradiance can be tolerated if modulated with a low enough duty cycle. This can be done by providing a command to the light source to periodically shut down between pulses at a particular duty cycle. It can also be done by ensuring that the micromirrors are periodically turned off between pulses at a particular duty cycle. However, for medical applications, it is usually necessary to ensure safety and the associated duty cycle even under a single fault condition. Summary of the Invention

[0015] It is an object of the present invention to provide a method for projecting a pattern of interest onto a modified retinal area of ​​a human eye, and a corresponding device for projecting a pattern of interest onto said modified retinal area.

[0016] Said object is solved by a method for projecting a pattern of interest onto a modified retinal region of a human eye comprising the features of claim 1. Further preferred embodiments are given in the dependent claims, the description and the drawings.

[0017] Thus, in a first aspect, a method is proposed for projecting a pattern of interest onto an altered retinal region of a human eye or a method of operating a device described herein for projecting a pattern of interest, said method comprising the steps of providing a pulsed input light beam, preferably comprising coherent or incoherent light and / or light having a wavelength preferably in the near infrared field, and modulating and splitting said pulsed input light beam into a modulated pulsed light pattern of modulated pulsed sub-beams based on said pattern of interest, said modulated light pattern forming a pulsed output beam reflecting the pattern of interest, said method being characterized by the step of performing individual pulse width modulations of the modulation duty cycles of the individual modulated sub-beams forming the output beam.

[0018] The individual pulse width modulation of the individual sub-beams allows the modulation duty cycle of each sub-beam to be adjusted individually and separately, so that the illumination duration of each sub-beam can be controlled individually. That is, for each period of the pulsed output beam, the illumination duration at the retinal implant to which the output beam is directed can vary within the output beam, since each sub-beam can include an individual duty cycle. Thus, the photodiodes of the retinal implant can be exposed to different illumination durations, which results in different stimulation currents and / or different stimulation durations at the retina. This can achieve a grey level perception of the projection pattern illuminated via the output beam. In other words, it may be possible to illuminate the retina with a pattern that is converted into different perceived grey levels within one pulse period. Thus, a patient provided with a corresponding photosensitive retinal implant may be able to sense or perceive at least a basic greyscale image. The latter may improve or facilitate the patient's orientation and enhance their visual capabilities.

[0019] Here, the pattern of interest may be based on a captured and projected picture or image, which may include dark and light areas, preferably pixels, containing different brightness values.

[0020] Preferably, the modified retinal region may be provided via the implantation of a retinal prosthesis.

[0021] According to a further exemplary embodiment, the input light beam comprises a constant peak irradiance, such that the irradiance impinging on the retinal implant can be precisely specified, determined and / or calculated, thus achieving both reliable operation of the retinal implant and prevention of retinal damage due to unknown excess irradiance.

[0022] Alternatively or additionally, the input light beam may include a substantially pulsed wave form, since a light beam so formed may have the advantage of being of substantially constant illumination intensity during each duty cycle.

[0023] Preferably, the input light beam includes a constant period.

[0024] According to another preferred embodiment, the input light beam comprises a constant duty cycle or the duty cycle of the input light beam is controlled.

[0025] According to yet another preferred embodiment, an optimal adaptation of the grey scale distribution in the output beam can be achieved if the modulation period is synchronous with the period of the pulsed input light beam, in other words the period of the pulse width modulation corresponding to the modulation period and thus the period of the sub-beams is synchronous with the period of the pulsed input light beam.

[0026] According to another preferred embodiment, the method can be optimized in that the maximum individual modulation duty cycle of the individual sub-beams corresponds to the duty cycle of the pulsed input light beam.

[0027] In order to prevent damage to the retina due to excessive irradiation, preferably the duty cycle of the pulsed input light beam may be less than 0.5, preferably less than 0.4, particularly preferably less than 0.3 of the period of the pulsed input light beam, and / or preferably the maximum possible duty cycle of the sub-beam may be less than 0.5, preferably less than 0.4, particularly preferably less than 0.3 of the period of the pulsed input light beam.

[0028] According to another preferred embodiment the pattern of interest is obtained by capturing visual information, preferably an image, and dividing the captured visual information, preferably the captured image, into a pattern of pixels which, if present in said visual information, preferably in said image, reflect at least different brightness values.

[0029] Preferably, after any image processing of the captured image, brightness values ​​are assigned to pixels or regions of the processed image.

[0030] The object is further solved by an apparatus for projecting a pattern of interest onto a modified retinal region of a human eye, preferably comprising a retinal implant, comprising the features of claim 7. Further preferred embodiments are shown in the dependent claims, the description and the drawings.

[0031] Thus, in a second aspect, an apparatus is proposed for projecting a pattern of interest onto an altered retinal region of a human eye, said apparatus comprising a light source for providing a pulsed input light beam, preferably a light beam of coherent or incoherent light, preferably light having a wavelength in the near infrared field, and a modulation micromirror array for modulating and splitting the pulsed input light beam into a modulated light pattern of modulated pulsed sub-beams, the orientation of each of the micromirrors of the micromirror array being individually controllable based on the pattern of interest such that the sub-beams form a pulsed output beam reflecting the pattern of interest. The apparatus is further configured and adapted to perform individual pulse width modulation of the sub-beams forming the output beam by individually controlling the modulated duty cycle of each individual micromirror.

[0032] The apparatus makes it possible to achieve the effects and advantages described with respect to the method.

[0033] According to a preferred embodiment, the device is further adapted such that the modulation period of the orientation control of the micromirror is synchronized with the period of the pulsed input light beam.

[0034] Due to the synchronization of the micromirror array and the modulation by the input light beam pulses, the maximum individual modulation duty cycle of the micromirrors can preferably correspond to the duty cycle of the pulsed input light beam.

[0035] In order to prevent damage to the retina by the output light beam, preferably the duty cycle of the pulsed input light beam can be set to 0.5 or less, preferably 0.4 or less, particularly preferably 0.3 or less relative to the period of the pulsed input light beam, and / or preferably the maximum possible duty cycle of the sub-beams can be 0.5 or less, preferably 0.4 or less, particularly preferably 0.3 or less relative to the period of the pulsed input light beam.

[0036] According to another preferred embodiment, the device further comprises a camera for capturing visual information, preferably an image, and / or a processing unit for dividing said captured visual information, preferably said captured image, into a pattern of pixels forming a pattern of interest, said pixels which, if present in said visual information, preferably in said image, reflect at least different brightness values.

[0037] Furthermore, it is important to note that for wearable electronic devices such as projector devices, the battery life needs to be as long as possible in order to maximize the run time between battery or power charges. Therefore, for a given reasonable battery size, the power consumption of the device needs to be minimized. Advantageously, the proposed light source modulation according to the present invention allows the light source to be periodically shut down between pulses, significantly reducing its power consumption. Furthermore, it limits the power consumption required for cooling the laser light source, for example via a Peltier element or fan operation, when it is only operating for a short time. Thus, pulsing the laser light source with a certain duty cycle significantly increases the battery life.

[0038] The present disclosure will be more readily understood by reference to the following detailed description when considered in conjunction with the accompanying drawings, in which: [Brief description of the drawings]

[0039] [Figure 1] FIG. 1 shows a schematic diagram of an apparatus for projecting a pattern of interest onto a photosensitive modified retinal region of the human eye. [Diagram 2] FIG. 2 shows a schematic detail of the pattern of interest of FIG. 1, which is the illuminated area of ​​the modified retinal region. [Diagram 3] FIG. 3 illustrates a schematic of a pulsed input light beam including a pulse wave shape and corresponding modulated pulse sub-beams. [Figure 4] FIG. 4 shows diagrammatically another input light beam having substantially the form of a pulsed wave and corresponding micromirror pulses for three different micromirrors resulting in three different sub-beams. [Diagram 5] FIG. 5 shows a schematic example of a region of interest pattern projected onto a retinal implant via the sub-beams of FIG.

[0040] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS The present invention will now be described in more detail with reference to the accompanying drawings, in which like elements are given like reference numerals and may not be described repeatedly in order to avoid redundant description.

[0041] 1 shows diagrammatically an apparatus 1 for projecting a pattern of interest 6 onto an altered retinal region 5 of a human eye. The apparatus 1 includes a light source 2 providing a pulsed input light beam 20 comprising light having a wavelength in the near infrared field.

[0042] An input light beam 20 is directed to a modulating micromirror array 3 which comprises a plurality of micromirrors 30 which can be individually steered such that the orientation of each of the micromirrors 30 can be individually adjusted and / or controlled. The modulating micromirror array 3 according to this particular embodiment is provided in the form of a digital micromirror device known per se.

[0043] An input light beam 20 is reflected by the micromirror array 3 to form an output beam 4. The output beam 4 is made up of multiple sub-beams 40, into which the input beam 20 is split upon striking individual micromirrors 30 of the micromirror array 3. The orientations of the micromirrors 30 are individually adjusted such that a pattern of interest 6 projected onto a modified retinal region 5 is reflected by the multiple sub-beams 40.

[0044] In this respect, the pattern of interest 6 is based on an image captured by a camera (not shown) that has been processed into a digital pattern of pixels, said pixels containing greyscale values ​​corresponding to the luminance values ​​of the respective regions of the image. Such data processing is known per se.

[0045] That is, only those micromirrors 30 corresponding to pixels having brightness values ​​above a predetermined threshold are controlled to reflect the input light beam 20, while those micromirrors 30 corresponding to pixels having brightness values ​​below the predetermined threshold are oriented so as not to contribute to the formation of the output beam 4.

[0046] Optionally, the modified retinal region 5 may include a retinal implant, preferably a photosensitive retinal implant.

[0047] The output beam 4 thus substantially reflects the pattern of interest 6. When the output beam 4 hits the modified retinal area 5, only the corresponding part of the modified retinal area 5, which includes the retinal implant, is illuminated by the output beam 4, or in particular by the sub-beam 40. The sub-beam 40 reflects the pattern of interest at the retinal implant. As a result, only the corresponding photosensitive diodes of the retinal implant convert light into an electric current. These are located at the projected pattern of interest 6. Thus, the person with the retinal implant can perceive the pattern of interest 6.

[0048] FIG. 2 shows a schematic detailed view of a pattern of interest 6 , which is an illuminated area of ​​a modified retinal region 5 .

[0049] The input light beam 20 is pulsed to have a waveform that includes the shape of a pulse wave, as can be seen, for example, from Fig. 3. The light beam 20 is pulsed by the light source 2 to include a constant illumination 23, which is illuminated during each duty cycle 22 of each period 21 of the wave of the light beam 20.

[0050] Thus, since the output beam 4 is essentially based on the input beam 20, the output beam 4 is also pulsed, and the period of the output beam 4 and the duty cycle of the output beam 4 also generally correspond to the period 21 and duty cycle 22 of the input light beam 20. The pattern of interest 6 thus includes a uniform illumination across its entire surface, as shown in FIG.

[0051] To achieve the ability to also provide greyscale information to the output beam 4, the apparatus 1 is further configured and adapted to perform individual pulse width modulation on each of the sub-beams 40. The latter is achieved by individually controlling the modulation duty cycle 32 of each of the individual micromirrors 30.

[0052] In other words, the time at which each of the micromirrors 30 is oriented in a position to reflect the input light beam 20 and provide a sub-beam 40 that contributes to the output beam 4 can be set individually and differently for each micromirror 30 depending on the corresponding grayscale level of the pixel of the pattern of interest 6 that correlates with the respective micromirror 30.

[0053] In this regard, pulse width modulation is performed such that for each micromirror pulse cycle, the modulation duty cycle 32 can be adjusted individually. That is, if the camera is constantly capturing images, changes in the brightness level of the pixels may result in changes in the modulation duty cycle 32. Thus, if the brightness level increases, the modulation duty cycle 32 increases accordingly, and conversely, if the brightness level decreases, the modulation duty cycle 32 decreases accordingly.

[0054] 3, the modulation period 31 of the micromirror pulses 33, which corresponds to the output beam period 41, is synchronized with the period 21 of the input light beam 20. Furthermore, optionally, the maximum possible modulation duty cycle 32 of the micromirror 30 is set to correspond to the constant duty cycle 22 of the input light beam 20.

[0055] Thereby, it can be achieved that the micromirror 30 does not operate when the light source 2 is not irradiated, thereby obtaining a safe operating power for the device 1.

[0056] 3 shows two sub-sequence micromirror pulse cycles for individual micromirrors 30 and thus sub-beams 40. The modulation duty cycle 32 shown in the first is smaller than the modulation duty cycle 32' shown in the second, and the irradiance 42 is constant for each modulation duty cycle 32, 32'. Thus, a patient with a retinal implant will perceive each region of the image as being brighter.

[0057] As can be further seen in the figure, both modulation duty cycles 32, 32' are shorter than duty cycle 22. Thus, the patient perceives a luminance level that is lower than the maximum possible perceptible luminance. For safety reasons, duty cycle 22 is limited to 30% of period 21, thus preventing retinal damage due to excessive exposure.

[0058] To provide a redundant safety system, the duty cycle 32 of the micromirror 30 is also limited to 30% of the period 21 or modulation period 31. Thus, if the light source erroneously emits a constant light beam, the maximum possible duty cycle of the output beam 4 is limited to the duty cycle 32 of the micromirror 30. Thus, it can be achieved that even if the safety setting of the light source 2 fails, no excessive irradiance hits the retina. Furthermore, even if the micromirror 30 fails to pulse and / or gets stuck in the "on" position, the source pulse ensures that the pulse duration of the output light beam 4 is not longer than the source pulse duration, i.e., longer than the duty cycle 22.

[0059] FIG. 4 illustrates an exemplary embodiment of a waveform of an input light beam 20 having substantially the form of a pulsed wave, including a constant source irradiance 23, a constant duty cycle 22 of the pulses 24, and a constant period 21.

[0060] Below the waveform of the input light beam 20, micromirror pulses 33, 33', 33'' are shown for three different micromirrors 30, resulting in three different sub-beams 40, 40', 40''.

[0061] The micromirror pulses 33, 33', 33" are distinguished from one another in that the duty cycles 32, 32', 32" of the corresponding pulses 34, 34', 34" are different.

[0062] That is, the radiation power of each of the sub-beams 40, 40', 40" is distinct from the others, with the first sub-beam 40 having a lower radiation power than the second and third sub-beams 40', 40", and the second sub-beam 40' having a lower radiation power than the third sub-beam 40".

[0063] As a result, for example, if a first region 61 of the pattern of interest 6 is illuminated with a sub-beam corresponding to sub-beam 40, a patient with a retinal implant will perceive a darker grayscale value than a second region 62 illuminated with a sub-beam corresponding to sub-beam 40' and a third region 63 illuminated with a sub-beam corresponding to sub-beam 40", the latter containing the lightest grayscale values.

[0064] An example of said areas 61, 62, 63 of a pattern of interest 6 projected onto a modified retinal area 5 containing a retinal implant can be seen in FIG.

[0065] Thus, the device 1 and corresponding method make it possible to provide patterns with different grey levels to a patient with a photosensitive retinal implant.

[0066] Furthermore, as mentioned above, power consumption for performing the method and / or for operation of device 1 can be reduced and / or optimized because the light source can be switched off between pulses, thus consuming less energy between pulses and thus reducing power.

[0067] It is clear to those skilled in the art that these embodiments and items merely describe examples of multiple possibilities. Therefore, the embodiments shown herein should not be understood as forming limitations on these features and configurations. Any possible combination and configuration of the described features can be selected according to the scope of the present invention. [Explanation of symbols]

[0068] 1 device 2 light source 20 Input light beam 21 cycles 22 Duty Cycle 23 Irradiance 24 Pulse 3. Micromirror array 30 Micromirror 31 Modulation Period 32 Modulation Duty Cycle 33 Micromirror Pulse 34 Pulse 4 Output Beams 40 Sub Beam 41 Output beam period 42 Irradiance 5. Patterns of Altered Retinal Areas of Interest 6 61 First Area 62 Second Area 63 The Third Region

Claims

1. A device (1) for projecting a pattern of interest (6) onto a modified retinal area (5) of a human eye, comprising: a light source (2) for providing a pulsed input light beam (20); a modulating micromirror array (3) for modulating and splitting said pulsed input light beam (20) into a modulated light pattern of modulated pulsed sub-beams (40); the orientation of each of the micromirrors (30) of the modulated micromirror array (3) is individually controllable based on the pattern of interest (6) such that the pulsed sub-beams (40) form a pulsed output beam (4) that reflects the pattern of interest (6); The apparatus (1) is configured and adapted to perform individual pulse width modulation of the pulsed sub-beams (40) forming the pulsed output beam (4) by individually controlling the modulation duty cycle (32) of each of the micromirrors (30).

2. 2. The device (1) of claim 1, further adapted to synchronize a modulation period (31) of the orientation control of the micromirror (30) with a period (21) of the pulsed input light beam (20).

3. 3. The apparatus (1) according to any of claims 1 to 2, wherein a maximum individual modulation duty cycle (32) of the micromirrors (30) corresponds to a duty cycle (22) of the pulsed input light beam (20).

4. The device (1) according to any one of claims 1 to 3, which satisfies at least one of the following <1> and <2>. <1> The duty cycle (22) of the pulsed input light beam (20) is 0.5 or less with respect to the period (21) of the pulsed input light beam (20). <2> the maximum possible modulation duty cycle (32) of the pulsed sub-beam (40) is less than or equal to 0.5 with respect to the period (21) of the pulsed input light beam (20);

5. 5. The apparatus (1) of claim 4, wherein the duty cycle (22) of the pulsed input light beam (20) is less than or equal to 0.4 with respect to the period (21) of the pulsed input light beam (20).

6. 5. The apparatus (1) of claim 4, wherein the duty cycle (22) of the pulsed input light beam (20) is less than or equal to 0.3 with respect to the period (21) of the pulsed input light beam (20).

7. 5. The apparatus (1) of claim 4, wherein a maximum possible modulation duty cycle (32) of the pulsed sub-beam (40) is less than or equal to 0.4 with respect to the period (21) of the pulsed input light beam (20).

8. 5. The apparatus (1) of claim 4, wherein a maximum possible modulation duty cycle (32) of the pulsed sub-beam (40) is less than or equal to 0.3 with respect to the period (21) of the pulsed input light beam (20).

9. An apparatus (1) as described in any one of claims 1 to 4, further comprising a camera for capturing visual information.

10. The visual information is an image, 10. The device (1) according to claim 9, further comprising a processing unit for dividing the captured visual information into a pattern of pixels forming the pattern of interest (6), said pixels reflecting at least different brightness values.

Images