Device for projecting an image into the eye of a user
Patent Information
- Application Number
- EP2022844181
- Authority / Receiving Office
- EP · EP
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2021-12-28
- Filing Date
- 2022-12-25
- Publication Date
- 2024-11-06
- Estimated Expiration
- Not applicable · inactive patent
AI Technical Summary
Existing augmented reality devices require a large number of laser light sources to project high-resolution images onto the retina, leading to bulkiness and potential interferences due to the use of multiple coherent light sources.
A device that connects multiple light guides to a single laser source to form 'twin pixels' with a minimum angular deviation, using modulators to adjust light intensity and reduce the number of laser sources while maintaining image quality, and incorporates a holographic film with diffraction gratings and electrodes to control light emission points for efficient image projection.
The solution allows for a significant reduction in the number of laser light sources required, minimizing bulkiness and interference while maintaining high image quality and resolution, enabling the formation of a large number of pixels with reduced noise and improved signal-to-noise ratio.
Smart Images

Figure 1.1
Abstract
Description
[0001] Device for projecting an image into the user's eye
[0002] Description
[0003] TECHNICAL FIELD
[0004] The technical field of the invention concerns the projection of an image onto an eye, in augmented reality type applications.
[0005] PREVIOUS ART
[0006] Wearable augmented reality devices, such as glasses, allow users to observe a real scene while viewing additional information. This type of device is often based on micro-screens, which allow an image to be formed in close proximity to a user's eye. Such micro-screens can, for example, be integrated into glasses. An optical system, comprising a set of lenses, allows the eye to perceive a clear image.
[0007] Patent US9632317 describes a device for projecting light onto the retina of an eye without a screen or optical system. The device includes a transparent integrated optical circuit composed of a network of nanometric light guides, an array of electrodes, and a holographic film. Such a device is compact and provides a wide field of vision. In addition, it eliminates the need for a bulky and complex optical system.
[0008] The nanometric light guides make it possible to define a set of emission points on the holographic film, each point being capable of being illuminated by light extracted from a light guide. The set of emission points is subdivided into different emission subsets, each emission subset comprising emission points distributed, as randomly as possible, on the holographic film. The emission points of the same emission subset can be simultaneously illuminated by the different light guides. Under the effect of illumination, each emission point of the same emission subset emits a light wave propagating in the same angular direction to the pupil of the eye, so as to form a single light point at the level of the retina. In this way, each subset of emission points allows the formation of a pixel of the image perceived by the user.An image can be formed by successively illuminating different subsets of emission points, so as to form an image comprising a high number of pixels. The illumination frequency of each subset of emission points is dimensioned so that under the effect of retinal persistence, the user can experience a formation of a fixed image, despite the sequential formation of the different pixels of the image.
[0009] As previously indicated, it is preferable that in the same subset, the emission points are distributed as randomly as possible, so as to avoid effects of repetition of patterns by periodic or quasi-periodic structures during the formation of the image on the retina.
[0010] In US9632317, light is extracted from each light guide by arranging electrically modulated diffraction gratings along the light guide. The diffraction gratings are spaced apart and define point light extraction zones. Under the effect of electrical activation, each diffraction grating allows extraction of the light propagating in a light guide. In US9632317, the light guides are sinusoidal in shape, and extend parallel to each other. However, it is necessary to have a large number of laser light sources, typically several hundred, if one wishes to have a sufficient number of pixels formed simultaneously on the image.
[0011] The inventors propose an optimized configuration, so as to maintain a high number of pixels, while reducing the number of laser light sources and preserving the quality of the images formed on the retina.
[0012] STATEMENT OF THE INVENTION
[0013] A first object of the invention is a device for projecting an image onto the retina of an eye, the image being composed of several pixels, the device comprising:
[0014] - light sources, preferably laser;
[0015] - a transmission medium, comprising:
[0016] • light guides, each light guide being connected to a light source and to a plurality of diffraction gratings, distributed along the light guide, each diffraction grating being electrically adjustable to extract part of the light propagating in the light guide to which it is connected;
[0017] • electrodes, each electrode being configured to modulate diffraction gratings connected to different light guides;
[0018] • emission points, each emission point being formed at a diffraction grating, and extending between an electrode and a light guide, each emission point being configured to emit light, in an angular direction, following an extraction of light propagating in the light guide; the device being such that: different emission points are configured to emit light in the same angular direction, so as to converge on the retina, forming the same pixel, said emission points defining an emission subset, so that each emission subset corresponds to an angular direction of emission of the light; two adjacent pixels of the image are formed by two emission subsets, respectively associated with two different angular directions and spaced apart by an elementary angular difference; the device being characterized in that:
[0019] - a same light source is connected to different light guides, said light guides defining different emission sub-assemblies, called twins, configured to simultaneously form different pixels, called twin pixels, when the light source is activated, the twin emission sub-assemblies being associated with the light source;
[0020] - the respective angular directions of each twin emission subset are spaced from each other by an angular difference greater than or equal to a minimum angular difference, the minimum angular difference corresponding to k times the elementary angular difference, k being greater than or equal to 2;
[0021] - such that the twin pixels, simultaneously formed on the retina, are offset by at least the minimum angular difference.
[0022] The emission points of different twin emission sub-assemblies are preferably connected to the same electrode or to an electrode of the same group of electrodes.
[0023] According to one embodiment:
[0024] - several light sources are respectively connected to different light guides, to form different twin emission sub-assemblies, each twin emission sub-assembly being associated with the same light source;
[0025] - the respective angular directions of each twin emission subset are spaced from each other by an angular difference greater than the minimum angular difference.
[0026] Preferably, the waveguides, connected to the same light source, and forming a twin emission sub-assembly are different from other waveguides connected to said light source, and forming another twin emission sub-assembly associated with the same light source. The minimum angular deviation may be greater than or equal to 0.5° or 1°.
[0027] According to one embodiment:
[0028] - the diameter or diagonal of the emission points is less than or equal to 10 pm, the minimum angular deviation being greater than 1.5;
[0029] - the diameter or diagonal of the emission points is between 10 pm and 20 pm, the minimum angular deviation being greater than 0.8;
[0030] - the diameter or diagonal of the emission points is greater than 20 pm, the minimum angular deviation being greater than 0.5;
[0031] Preferably, the diameter or diagonal of each emission point is greater than 5 pm.
[0032] According to one possibility:
[0033] - the light guides connected to the same light source define first twin emission sub-sets and second twin emission sub-sets, so as to form first twin pixels and second twin pixels respectively;
[0034] - the emission points of each first twin emission subset are connected to first electrodes;
[0035] - the emission points of each second twin emission subset are connected to second electrodes, different from the first electrodes;
[0036] - the device comprises a switch, for powering either the first electrodes or the second electrodes, so that the light emitted by the light source is extracted sequentially either by the emission points of the first emission sub-assemblies, or by the emission points of the second emission sub-assemblies, to sequentially form, on the image, the first twin pixels and the second twin pixels.
[0037] Advantageously, for at least one light source, different modulators are respectively interposed between a light source and different light guides connected to the light source, so as to modulate an intensity of the light propagating in said light guides independently for different light guides connected to the light source.
[0038] According to one possibility:
[0039] - a light source is connected to N different twin emission sub-assemblies, configured to simultaneously form N twin pixels, N being an integer greater than or equal to 2; - the light source is connected to N modulators, each modulator extending between the light source and the waveguides forming a same emission sub-assembly.
[0040] The number of twin emission subsets formed by at least one light source is greater than or equal to 20.
[0041] The device may have fewer than 20 different light sources to form an image, or portion of an image, of at least 200 pixels by 200 pixels.
[0042] According to one embodiment, the device comprises a holographic film, subdivided into different holograms, each hologram being associated with a diffraction grating, and configured to emit the light wave, according to the emission direction, under the effect of light extracted by the diffraction grating with which it is associated, each association between a hologram and a diffraction grating forming a light emission point.
[0043] A second object of the invention is a pair of glasses, comprising glasses lenses, the glasses comprising a device according to any one of the preceding claims, the stack being formed on at least one glass of the glasses.
[0044] A third object of the invention is a method for parameterizing a device according to the first object of the invention, the parameterization comprising: a) modeling a spatial distribution of the noise between two twin pixels, by modifying the minimum angular deviation; b) estimation of the minimum angular deviation as a function of the spatial distribution.
[0045] Step b) may include an estimation of the signal-to-noise ratio as a function of the minimum angular deviation.
[0046] Another object of the invention is a device according to the first object of the invention, the minimum angular deviation of which is parameterized by the method according to the second object of the invention.
[0047] The invention will be better understood by reading the description of the exemplary embodiments presented in the remainder of the description, in conjunction with the figures listed below.
[0048] FIGURES
[0049] Figures 1A and 1B illustrate the principle of self-focusing emission points on a user's retina. Figure 1A shows a set of emission points converging towards a pixel. Figure 1B shows another set of emission points converging towards a pixel adjacent to the pixel described in connection with Figure 1A.
[0050] Figure IC shows an example of a subset of emission points distributed over a transmission medium.
[0051] Figure 1D illustrates a step of recording holograms on a holographic film. Figure 1E illustrates a step of emitting a light wave by emission points formed on the device.
[0052] Figure 2 corresponds to an example of the implantation of light guides and electrodes.
[0053] Figure 3A represents a model of a light wave, produced by a subset of emission points, and reaching a pixel. Figure 3A shows the intensity of the light wave incident on the retina as a function of a position along a direction passing through the center of the pixel.
[0054] Figure 3B corresponds to Figure 3A, the unit of the abscissa axis being angular.
[0055] Figure 3C illustrates a calculation of the signal-to-noise ratio (SNR) associated with a light wave produced by an emission subset and reaching a pixel.
[0056] Figure 4 represents pixels of an image formed on the retina of an eye, as well as a circular perimeter around pixels, the diameter of which determines a minimum angular separation between two pixels, called twins, formed from emission subsets simultaneously illuminated by the same light source.
[0057] Figure 5A shows an evolution of the signal-to-noise ratio of a pixel, called the central pixel, surrounded by 4 neighboring pixels, for different configurations, as a function of the angular distance between the central pixel and each neighboring pixel.
[0058] Figure 5B shows images of a central pixel, surrounded by 4 neighboring pixels, for three different angular separations between the central pixel and each neighboring pixel. In Figure 5B, the pixels result from the simultaneous illumination of emission subsets by the same light source: these are twin pixels.
[0059] Figure 5C shows images of a central pixel, surrounded by 4 neighboring pixels, for three different angular separations between the central pixel and each neighboring pixel. In Figure 5C, the pixels result from the illumination of emission subsets by light sources different from each other.
[0060] Figure 6A schematically illustrates a configuration of light sources, light guides and electrodes allowing 16 emission sub-assemblies to be defined, each emission sub-assembly comprising 4 emission points.
[0061] Figure 6B illustrates 16 pixels that can be formed by the configuration shown in Figure 6A.
[0062] Figure 7A schematically illustrates a configuration of light sources, light guides and electrodes allowing 16 emission sub-assemblies to be defined, each emission sub-assembly having 4 emission points, while reducing the number of light sources compared to the configuration of Figure 6A.
[0063] Figure 7B illustrates 16 pixels that can be formed by the configuration shown in Figure 7A.
[0064] Figure 8A schematically shows the configuration described in connection with Figure 7A, with simultaneous activation of both light sources and activation of half of the electrodes. Figure 8B shows the pixels displayed by the configuration of Figure 8A.
[0065] Figure 9A schematically illustrates the configuration described in connection with Figure 7A, with simultaneous activation of both light sources and activation of the other half of the electrodes. Figure 9B shows the pixels displayed by the configuration of Figure 9A.
[0066] Figure 10 represents an evolution of the signal-to-noise ratio of the image as a function of the angular spacing between a central pixel and 4 neighboring pixels, all the pixels being twin pixels. In Figure 10, the size of each emission point has also been varied.
[0067] Figure 11 shows an example of a twin pixel arrangement, formed by the same light source.
[0068] Figure 12 shows a compromise between the signal-to-noise ratio of the image (left y-axis) and the number of light sources used (right y-axis) as a function of the angular separation between the twin pixels (x-axis).
[0069] PRESENTATION OF SPECIAL EMBODIMENTS
[0070] Figures 1A to 1E illustrate the principles on which the invention is based. These principles are described in the publication Martinez C, “See-through holography retinal projection display concept”, Optica, Vol. 5, No. 10, October 2018. A projection device 1 is arranged facing a pupil P of an eye, the latter focusing the light on the retina R of the eye. The projection device comprises an emission support 10. The emission support 10 is formed of a set of emission points EP, each emission point being capable of being illuminated by a light source. The structure of the emission support 10 is described in connection with Figures 1C and 1D. The emission support 10 is arranged at a distance Zo from the pupil P. The pupil P is arranged at the focal distance f Q of the retina R.
[0071] Each emission point EP shown in Figure 1A is configured to emit light along an angular emission direction 0,y towards the pupil P. Generally speaking, the emission points EP of the emission surface are distributed into different emission subsets EPDj , (Emission Point Distribution) so that the emission points of the same emission subset all emit light propagating parallel to the same angular direction of emission 0^. The angular direction of emission is defined with respect to a reference direction, for example a direction passing through the center of the pupil and perpendicular to the latter. The reference direction is represented by a dot-and-dash line in Figures 1A and 1B.
[0072] Each emission point EP of the same emission subset EPDjj is configured to emit, under the effect of illumination by a light source, a light wave propagating in an angular direction of propagation towards the pupil P. The phase relationship between the different light waves, respectively emitted by the emission points EP of the same emission subset EPDj , makes it possible to form, upstream of the pupil P, a plane wave, with wave vector kjj or, more generally, a wave whose wavefront is controlled. Thus, the wavefront can have a plane, or even spherical or parabolic shape. Downstream of the pupil, each light wave is focused by the pupil and converges to the same pixel R(i,j) on the retina R.
[0073] The projection device 1 thus makes it possible to form an image on the retina R, the image being discretized into several pixels R(i,j), each pixel R(i,j) corresponding to the pixel of an image formed by the projection device 1 on the retina R. In the example shown, the image has a square shape, and the same is true of each pixel composing it. An image can have several hundred pixels on each side.
[0074] The light intensity at pixel level R(i,j) results from the contribution of each light wave, propagating, upstream of the pupil, in the same angular direction 0, y resulting from each emission point EP of the same emission subset EPDjj, after focusing by the lens. The index ij corresponds to an angular coordinate of the light wave which, after focusing by the pupil (or self-focusing), converges towards the pixel R(i,j) on the retina.
[0075] The emission medium is segmented into different emission subsets EPDjj, each subset comprising several emission points EP distributed over the emission surface, each emission subset being associated with the same angular propagation direction Qjj, given by the wave vector kjj, towards the pupil.
[0076] Figure 1B represents another EPD subset i+1The EPDj+l emission subset comprises different EP emission points, each point being associated with the same angular propagation direction 0 i+1J -, given by the same wave vector k i+1 . Downstream of the pupil, each light wave, emitted by each point of the EPD emission subset i+1 , converges to the same pixel R(i + l,j) on the retina R. The pixel R(i + l,j) is adjacent to the pixel R(i,j) shown in Figure 1A. The angular directions 0, y , Qt+ which allow to form respectively two adjacent pixels on the retina, are spaced by an elementary angular deviation / ?. The elementary angular deviation corresponds to an angle, upstream of the pupil, between two angular directions of propagation of light waves converging, downstream of the pupil, towards two adjacent pixels R(i + 1, j), R(i, j) on the retina R. The elementary angular deviation / 3 is typically less than 0.1° or 0.2°. It is for example equal to 0.06°.
[0077] As described in connection with the prior art, it is advantageous for the emission points EP of the same emission subset EPDij to be distributed pseudo-randomly on the emission support 10. Figure IC represents a subset of emission points configured to emit light propagating, towards the pupil P, parallel to the same angular direction 0^. The emission support extends parallel to the pupil, along an axis X and a axis Y. Each emission point EP has coordinates (x EP , y E p) along these axes.
[0078] Figure 1D shows schematically the structure of the projection device 1. The projection device comprises the emission support 10, the latter being connected to several light sources 21 and several switches 23. Preferably, each light source is a laser light source. Each switch makes it possible to connect an electrode 13 to a power supply. The emission support is formed of several transparent layers superimposed on each other: a first layer, in which light guides 11 are formed. Each light guide is configured to receive coherent light, emitted by a laser source 21, and to propagate the coherent light along the emission support. Each light guide can for example be formed of SiN (silicon nitride) deposited on glass. Each guide can extend with a thickness and a width of between 200 nm and 300 nm.a second layer, in which diffraction gratings 12 are formed, such that each diffraction grating 12 is coupled with a light guide 11. Each diffraction grating is configured to extract a portion of the light propagating through the light guide 11. Each diffraction grating 12 corresponds to a periodic variation in refractive index, capable of being electrically modulated. Each diffraction grating 12 may be formed of inclusions, defining a periodic pattern, for example a Bragg grating, in silicon oxide (SiOz). Each inclusion is formed of a material whose refractive index is electrically modulatable, for example a liquid crystal. The diffraction gratings 12 coupled to the same light guide 11 are spaced from each other along the light guide, and are considered to be point-like.When the wavelength of the light is 532 nm, the period of the pattern of the diffraction grating 12 may be between 300 nm and 400 nm. A diffraction grating may extend according to 10 periodic patterns, and thus extend over a length of a few microns, for example between 2 and 10 pm. a third layer, in which transparent electrodes 13 are formed, the electrodes being configured to electrically modulate the refractive index of a material forming the diffraction gratings. The transparent electrodes may be formed of a transparent conductive material, for example ITO (indium tin oxide). Each electrode can thus activate a diffraction grating under the effect of electrical modulation. a fourth layer, corresponding to a holographic film 14. By holographic film is meant a photosensitive medium capable of recording a hologram.The holographic film is assumed to be thin enough to be considered an emitting surface. The holographic film may be a photopolymer, for example poly(methyl methacrylate), or a photoresist.
[0079] The emission support 10 is preferably formed on a plate. It may be a transparent plate 15 when the device is intended to be integrated into a bezel. It may, for example, be a glass or polycarbonate plate.
[0080] Under the effect of polarization by an electrode 13, each point diffraction grating 12 connected to the electrode can be activated, in the sense that it allows extraction of a portion of the light propagating in a light guide 11 to which it is coupled. The extracted light propagates towards an elementary zone of the holographic film 14, the elementary zone storing a hologram. Under the effect of illumination, the hologram forms an emission point EP, emitting a light wave according to a predetermined wave vector k and phase O. Thus, each diffraction grating 12, controlled by an electrode 13, allows coupling of a waveguide 11 with a hologram previously stored in the holographic film. The phase of the light wave emitted by the emission point depends on the phase information stored in the hologram.The light waves emitted by different emission points EP of the same emission subset EPDj are out of phase with each other so that all of these light waves form a coherent wave, with the same wave vector k^, for example plane, propagating towards the pupil P in the same angular direction 0. f .
[0081] Thus, each emission point EP corresponds to a superposition, parallel to the emission surface, between a point diffraction grating 12 coupled to a light guide 11, and an electrode 13, facing a hologram of the holographic film 14.
[0082] The emission points are distributed along an emission surface S. The light guides 11 are arranged parallel to the emission surface S. The same is true of the electrodes 13. Thus, the electrodes 13 are superimposed on the light guides 11. Parallel to the emission surface S, each electrode “crosses” several light guides, so as to define several intersections, each intersection corresponding to a position of an emission point EP. The term “cross” is to be interpreted as designating a superposition of an electrode and a light guide. In Figure 1D, for the purpose of simplification, a light guide 11 is shown coupled to three diffraction gratings 12, the latter being connected to three different electrodes 13, the latter being oriented perpendicular to the light guide 11.
[0083] The holographic film 14 has previously been the subject of a holographic recording, shown diagrammatically in Figure 1D. In a known manner, a hologram is formed by interference between two light waves emitted by a coherent light source: an object light wave and a reference light wave. The interference fringes generated are stored physically or chemically in the holographic film 14. During the recording phase, the light extracted from a light guide 11 acts as a reference beam. In Figure 1D, the following are represented: by dotted arrows, light emitted by the laser light source and propagating in a light guide 11; by solid dashed arrows, the light extracted from each light guide 11, respectively by three diffraction gratings 12, under the effect of activation by the three electrodes 13.The object beam is a beam propagating towards the holographic film along a wave vector k^, so as to converge at a point. of the retina by self-focusing. During the recording step, the object beam can be emitted by a collimated source.
[0084] In Figure 1D, three object beams are shown propagating along the same wave vector k j materialized by dashed arrows. The object beams and each reference beam are emitted by the same laser light source. The recording phase consists of storing holograms, in different elementary zones of the holographic film 14, each recording resulting from an interference between the object beam, propagating according to the same wave vector k j(and therefore the same angular direction 0^) and a reference beam extracted from a light guide 11. During recording: different elementary zones of the holographic film 14 are exposed to an object beam of the same wave vector kÿ, so as to form an emission subset EPDjy of emission points EP corresponding to the same propagation direction. During this exposure, the emission points of the emission subset EPD^ are illuminated by the reference beam, the latter being extracted from the light guides. The other elementary zones of the holographic film 14, located opposite points belonging to other emission subsets, are masked. different elementary zones of the holographic film 14 are respectively exposed to different object beams propagating according to different wave vectors, so as to form emission points associated with different emission directions e 0^.
[0085] Figure 1E illustrates the phase of use of the device 1. In this figure, the elementary zones of the holographic film 14 having recorded a hologram during the holographic recording step are shown in gray. Under the effect of activation by electrodes 13, a portion of the laser light propagating in the light guide 11 is extracted and propagates towards the holographic film 14, as described in connection with Figure 1D. Under the effect of the extracted illumination, each hologram stored in the photosensitive film diffracts a wave which corresponds to the object wave at the time of recording, and in particular in the propagation direction k^. The diffracted wave is represented by mixed dashes in Figure 1E.When using the device: the emission points EP corresponding to the same emission subset EPDij, associated with the same wave vector / c, '-J ,, are activated simultaneously: coherent diffracted waves are thus formed, propagating parallel to the same propagation direction 0^ towards the pupil P: the waves refracted by the pupil converge in the same pixel R(i, ) on the retina.
[0086] Simultaneously, another emission subset EPD^ji can produce coherent diffracted waves propagating towards the pupil P, according to propagation direction 9^ the waves refracted by the pupil converging in the same pixel on the image formed at the level of the retina, the emission points of the emission subset EPD^ji being illuminated by light extracted from other light guides illuminated by another laser light source or the same laser light source and activated by the same group of electrodes.
[0087] EP emission points of different emission subset EPDjj can be activated sequentially, so as to converge sequentially to different pixels on the retina.
[0088] The electrodes 13 and the light guides 11 are distributed in groups. An emission subset EPDj corresponds to emission points EP formed by a superposition of the electrodes of a group of electrodes on light guides of the group of light guides. Thus, each emission subset EPDjj, forming the same pixel 7?(i, j), is associated with a single group of light guides 11 and a single group of electrodes 13.
[0089] Due to retinal persistence, when the activation frequency of the different emission subsets is sufficiently fast, the user perceives an image formed by the different pixels R(i,f).
[0090] The design of a projection device as previously described is confronted with compactness constraints: we consider that the diameter D p of a pupil is of the order of 4 mm. Furthermore, the emission surface S is greater than the surface of a pupil, so that the eye can move opposite the surface, without any degradation of the image formed on the retina being perceived.
[0091] Another requirement concerns the density of emission points. Each pixel R(i, of the image projected on the retina corresponds to a subset of emission EPDjj of emission points EP associated with the same propagation direction9j. The higher the number of emission points EP contributing to the same pixel, the better the quality of the pixel. The number of emission points EP of the same subset of emission EPDjj is preferably greater than 40, or even greater than 55 or 60. Furthermore, the number of subsets of emission points EPDj corresponds to the number of pixels formed on the image. In order to increase the number of pixels in the image formed on the retina, it is necessary to increase the number of emission subsets EPDij respectively associated with different propagation directions 6^.
[0092] Figure 2 illustrates an arrangement of electrodes and light guides as described in US9632317. According to this arrangement: the light guides 11 extend, along a surface parallel to the emission surface, according to sinusoidal curves, along a longitudinal axis X. Two adjacent light guides are translated relative to each other, perpendicular to the X axis. the electrodes 13 extend, along a surface parallel to the emission surface, according to sinusoidal curves, along a lateral axis Y. Two adjacent electrodes are translated relative to each other, perpendicular to the Y axis.
[0093] The light guides are connected to laser light sources 21, for example laser diodes. The electrodes 13 are connected to switches 23. Each switch is configured to activate or deactivate each electrode to which it is connected.
[0094] Other arrangements of light guides and electrodes are possible, for example the arrangement described in application FR2105017.
[0095] However, regardless of the arrangement of the light guides and electrodes, the number of different laser light sources to be used is high. For example, the device described in US9632317 has 400 emission subassemblies, each emission subassembly being formed by 10 waveguides. This requires the use of 400 laser light sources.
[0096] In order to reduce the number of laser light sources, the inventors propose coupling different light guides 11 to the same laser source 21, so as to simultaneously form different pixels, called twin pixels, spaced apart from each other. The intensity of the light propagating in the light guides connected to the same light source can be modulated by placing a modulator 22 between each light guide connected to the laser source. Thus, the intensity of each twin pixel can be adjusted independently. In general, the number of modulators associated with each laser light source corresponds to the number of twin pixels that can be simultaneously formed by the laser light source. Each twin pixel corresponds to an emission subset, called a twin emission subset.However, the inventors found that using the same laser light source to simultaneously form twin pixels can lead to interference in the image formed on the retina. This is because the same laser light source generates different coherent light waves that propagate to different pixels, which can generate cross-interference.
[0097] Figures 3A to 3C illustrate spatial distributions of light wave intensity propagating towards a retinal pixel. Experimental studies have shown that the light intensity, formed by a subset of EPDij emission, around a retinal pixel can be modeled by a sum of two two-dimensional Gaussians: a first two-dimensional Gaussian, of intensity I lt and the half-waist w ltwhich represents the useful signal; a second two-dimensional Gaussian, of intensity I2, and the half-waist w2, which represents the noise. The width w2 is due to diffraction effects by the EP emission points. The smaller these are, the more the diffraction effects increase.
[0098] The term "waist", literally meaning size, corresponds to a characteristic width. It is usually the width of the Gaussian corresponding to a height equal to the maximum height multiplied by e~ 2 .
[0099] If x denotes a coordinate along a line drawn on the image projected onto the retina, centered on a pixel 7?(i,y), the intensity of the light produced by the emission subset EPDj can be expressed according to the relation: with f0 is the focal length of the eye;
[0100] D p is the diameter or diagonal of the support as shown in Figure IC;
[0101] A is the wavelength.
[0102] Figure 3A represents the intensity / (%) (y-axis) after normalization by the maximum intensity measured at the coordinate x=0, as a function of x (x-axis - unit pm). In Figure 3A, the modeled intensity (curve a) is represented, as well as the two Gaussians corresponding respectively to the useful signal and to the noise: curves b and c. Expression (1) can be expressed as a function of an angle ip x relative to a reference direction connecting the pupil to the center of the pixel. The angle ip x is obtained from x according to: with
[0103] Figure 3B represents the intensity I( x ) (y-axis) after normalization by the maximum intensity modeled at the ip coordinate x =0, depending on ip x(abscissa axis - unit degree). Figure 3B shows the modeled intensity (curve a), as well as the two Gaussians corresponding respectively to the useful signal and to the noise: curves b and c.
[0104] Figures 3A and 3B were established considering that each emission point extends along a disk of 10 pm in diameter.
[0105] When the same laser light source illuminates two different twin emission subsets EPDjj, EPDjiji in order to avoid the appearance of noise on the image due to cross interference, it is preferable that the two Gaussians modeling the noise, corresponding to curves c) of Figures 3A and 3B, do not overlap, or as little as possible. Thus, the angular directions respectively associated with the two twin emission subsets
[0106] EPDj, EPDjiji are preferably spaced by an angular gap O- mingreater than or equal to the angle 2fl2, that is to say twice the half-waist of the Gaussian representative of the noise.
[0107] The pixels 7?(i, j) and R(i'>j') respectively defined by the two emission subsets EPDjj, EPDj>j> are referred to as "twin pixels" because they are generated simultaneously by the same laser light source. The emission subsets EPDjj, EPDj>j> respectively associated with the twin pixels are called twin emission subsets. The twin pixels are separated, on the image formed on the retina, by a minimum angle greater than the angle 2fl2, so as to avoid cross interference. The twin emission subsets are configured to be simultaneously activated by electrodes, so as to display the twin pixels simultaneously.
[0108] Figure 4 illustrates projections of rays onto the retina from the same point in the pupil P. The pixels of the image formed on the retina are represented in the form of a grid. Four "twin" pixels, corresponding to dark pixels, are also represented. Around each twin pixel, a dashed circle is drawn whose diameter is equal to 2 times the half-waist w2 of the Gaussian representing the noise. In order to avoid an overlap of two different Gaussians, representing the noise, which would be conducive to the formation of cross-interference, the distance between two twin pixels must be greater than a minimum distance w min such that w min = 2w2.
[0109] The elementary angular difference / 3 between two adjacent pixels, mentioned in connection with figure 1B, has also been represented.
[0110] The minimum distance w min can be expressed as minimum angular deviation Sl min. Using (3), we can write
[0111] The minimum angular deviation Sl min is equal to 2fl2 with fl2= asin -y (6')
[0112] Thus, an important aspect of the invention is that two twin pixels are distant from each other by an angular separation fl greater than or equal to the minimum angular separation Sl min . The minimum angular deviation is defined by modeling the noise affecting the pixel when several twin pixels are formed. The minimum angular deviation is k times the elementary angular deviation P separating two adjacent pixels, where k is an integer greater than or equal to 2.
[0113] The inventors quantified the signal-to-noise ratio associated with the intensity projected by each pixel. The projected intensity corresponds to the percussion response of the system formed by the emission support, the pupil and the lens, usually designated by the acronym PSF (Point Spread Function). The PSF corresponds to the image of a point on the retina. Figure 3C illustrates the PSF, representing a spatial distribution of the intensity on the retina. In Figure 3C, the y-axis corresponds to the luminous intensity / (%) of the image formed on the retina and the x-axis corresponds to a distance x from the origin, the origin corresponding to the center of the pixel formed on the retina.
[0114] The signal-to-noise ratio (SNR) is such that:
[0115] / (O) is the height of the central peak; w is the half-waist of the Gaussian representative of the useful signal, described in connection with Figures 3A and 3B; max ( / (%)) represents the maximum value of the intensity outside the central peak |x|>W of intensity.
[0116] The inventors calculated the signal-to-noise ratio of a pixel obtained by an emission subset of 80 emission points on an emission surface of dimensions 6 mm by 6 mm. In order to simulate the effect of neighboring twin pixels of the modeled pixel, they assumed that each EP emission point contributing to a twin pixel forms a plane wave, the intensity of which is modulated by a Gaussian envelope, as described in connection with Figures 3A to 3C (Gaussian representative of the noise).
[0117] The electric field of the plane wave is such that: x 2 +y 2
[0118] E(x, y) oc e i kxX+k y y ' e i <t>< / t> e w 2 (8) with where: x EP and there EP correspond to the coordinates of the emission point EP on the emission medium 10, as shown in figure IC;
[0119] Z o is the distance between the emission medium 10 and the pupil; x and y are coordinates on the retina, according to the X and Y axes shown in Figure IC. It is assumed that the emission medium is parallel to the retina or can be considered as such.
[0120] O is a phase shift of the light wave emitted by the emission point EP, this phase shift being adjusted according to the coordinates of each emission point so that the wave resulting from the different emission points of the same emission subset is a plane wave. or 6 and Q yare the components of the propagation angle 0^ with respect to the X and Y axes respectively. The inventors used expression (8) to simulate an image formed only by a central pixel and four neighboring pixels regularly distributed around the central pixel. By neighboring pixel, we mean a pixel located in the vicinity of the central pixel. It is not the adjacent pixel. In order to estimate the noise in the image, the useful signal of the four neighboring pixels was removed. The background noise generated around each pixel was kept: central pixel and neighboring pixels. The four neighboring pixels were arranged at different distances from the central pixel.
[0121] In a first configuration, neighboring pixels formed by waves coherent with the light wave forming the central pixel were simulated. This case is representative of the use of the same laser light source to respectively illuminate each emission subset forming each pixel. This is the configuration according to the invention, in which the aim is to maximize the number of emission subsets illuminated by the same laser light source. This is also the least favorable configuration with respect to the formation of cross-interference.
[0122] In a second configuration, neighboring pixels formed by light waves incoherent with the light wave forming the central pixel were simulated. This case is representative of the use of five different laser light sources to respectively illuminate each emission subset forming each pixel. This is a reference configuration, representative of the prior art.
[0123] Figure 5A shows the evolution of the signal-to-noise ratio SNR, as defined in expression (7) (y-axis) as a function of the angular distance between the central pixel and each neighboring pixel (x-axis - unit degree). Curve a) corresponds to the configuration according to the invention: the central pixel and each neighboring pixel are twin pixels. The dotted line corresponds to the signal-to-noise ratio of the central pixel without taking into account the neighboring pixels. Curve b) corresponds to the reference configuration.
[0124] Figure 5B shows simulated images considering distances between the central pixel and the neighboring pixel of 5 pm, 25 pm and 525 pm. These distances correspond respectively to angular deviations of 0.0125°, 0.062°, and 1.35°. In Figure 5B, the configuration according to the invention has been taken into account. The background noise and its attenuation are observed as the distance between twin pixels increases.
[0125] Figure 5C shows images similar to those shown in Figure 5B, considering the reference configuration. Figure 5A shows that twin pixels that are too close together result in a strong decrease in SNR. By moving the twin pixels apart by an angle greater than 1°, or even 1.5°, the impact on SNR is smaller. Beyond 2°, the impact on SNR is negligible.
[0126] Figures 6A and 6B schematically illustrate an addressing method according to the prior art. In a simplified manner, these figures show linear light guides 11 and electrodes 13, the electrodes being perpendicular to the light guides. There are 16 light guides Hi, II2...II16 and four electrodes 13i, 132, 13a, 134. Each light guide is connected to a laser light source 21. Each electrode 13 is connected to a switch 23: the electrodes 13i, 13a are connected to a first switch 23i and the electrodes 132, 134 are connected to a second switch 232. The switches are conductive and connected to a power supply.
[0127] Each emission point EP, represented by an oval shape, is arranged at the intersection of a light guide and an electrode. Each emission point is assigned a label, between 1 and 16, identifying the EPD emission subset to which the emission point belongs. In this example, each EPD emission subset comprises four pixels. There are 16 different emission subsets. Figure 6B represents the 16 pixels respectively formed by the 16 emission subsets after self-focusing. Emission subsets 1 and 9 are activated when electrodes 13i and 133 are activated, and when the laser connected to waveguides 111 and 118 is activated. In Figure 6B, the pixels formed when electrodes 132 and 134 are activated are represented by a bold frame.
[0128] Figures 7A and 7B schematically illustrate an addressing method according to the invention. Only two lasers 21i, 2I2 are used, the latter being coupled to 8 different waveguides. The device comprises modulators 22 arranged between each laser and a set of waveguides. The modulators allow modulation of the intensity of the light propagating towards each emission sub-assembly. The intensity modulation makes it possible to form pixels of different light intensities with the same laser. In Figure 7A, the grayed-out emission points are coupled to the laser 2I2. The same is true in Figure 7B: the grayed-out pixels are emitted by illumination of emission sub-assemblies by the laser 2I2.
[0129] Figure 7B shows the pixels obtained: following activation of laser 21i and switch 234: this allows a display of twin pixels 1, 2, 3 and 4: pixels displayed in white and framed by a thin line. following activation of laser 21i and switch 232: this allows a display of twin pixels 9, 10, 11 and 12: pixels displayed in gray and framed by a thin line, following activation of laser 212 and switch 23i: this allows a display of twin pixels 5, 6, 7, 8: pixels displayed in white and framed by a bold line. following activation of laser 212 and switch 232: this allows a display of twin pixels 13, 14, 15 and 16: pixels displayed in gray and framed by a bold line.
[0130] This way, 16 pixels can be formed using only two laser diodes.
[0131] The modulators 22 make it possible to modulate the intensity of the pixels 1, 2, 3, 4, 9, 10, 11 and 12, activated by the first laser 21i, as well as the intensity of the pixels 5, 6, 7, 8, 13, 14, 15 and 16 activated by the second laser 2I2. In order that the intensities of the pixels 1, 2, 3, 4 on the one hand and 9, 10, 11, 12 on the other hand can be modulated independently of each other, the power supplies 23i and 232 are successively activated.
[0132] Pixels 1 and 9 are respectively generated by a first emission subset, gathering the emission points bearing, in FIG. 7A, the label 1 and a second emission subset, gathering the emission points bearing, in FIG. 7A, the label 9. The emission points belonging respectively to the first and second emission subsets are formed on the same waveguides, connected to the same modulator 22. In order to be able to independently adjust the intensities of pixels 1 and 9, the first emission subset (pixel 1) is activated by first electrodes (13i, 183) while the second emission subset (pixel 9) is activated by second electrodes (132, 134). Sequential activation of the first and second electrodes allows the sequential display of pixels 1 and 9. This allows the modulation of their respective intensities by adjusting the modulator during each display.This aspect also concerns pixels 2 and 10, 3 and 11, 4 and 12, 5 and 13, 6 and 14, 7 and 15, 8 and 16. Thus, the use of sequential activation of different electrodes is relevant when the emission points of different emission subsets are distributed on the same waveguides. The selection of an electrode makes it possible to activate only one emission subset on said waveguides. This allows the sequential display of the pixels respectively associated with the emission subsets formed on common waveguides.
[0133] In Figures 8A and 8B, an arrangement similar to that described in connection with Figures 7A and 7B is shown. In these figures, only the switch 23i is on: this allows simultaneous display of pixels 1, 2, 3, 4 (with the laser source 21i) and pixels 5, 6, 7, 8 (with the laser source 212). Pixels 1, 2, 3 and 4 are twins: pixels shown in white in Figure 8B, framed by a thin line. The same is true of pixels 5, 6, 1, 8: pixels shown in gray in Figure 8B, framed by a thin line. The pixels not displayed are framed by a dotted line: these are pixels 9, 10, 11, 12, 13, 14 and 15.
[0134] Figures 9A and 9B represent a symmetrical configuration: only switch 232 is on: this allows display of pixels 9, 10, 11, 12 (with laser source 21i) and pixels 13, 14, 15, 16 (with laser source 212). Pixels 9, 10, 11 and 12 are twins: pixels shown in white in Figure 9B, framed by a bold line. The same is true of pixels 13, 14, 15 and 16: pixels shown in gray in Figure 9B, framed by a bold line. The pixels not displayed are framed by a dotted line: these are pixels 1 to 8.
[0135] The configurations shown schematically in Figures 8A-8B and 9A-9B can be used successively, according to a repetition period sufficiently high so that, under the effect of retinal persistence, all of the pixels appear simultaneously displayed. The transition from one configuration to the other is carried out by switching the switches 23i and 232. The switching makes it possible to activate only one emission subset among different emission subsets arranged on common waveguides. The emission subsets connected to the same laser light source, and distributed on waveguides different from each other, activated by common electrodes, form twin pixels: they are simultaneously activated, by the electrodes, so as to simultaneously form several pixels.
[0136] The width of the two-dimensional Gaussian w2 representing the noise around a pixel depends on the size of the emission points EP. As the size of the emission points decreases, the diffraction effects increase. The inventors studied the influence of the size of the emission points on the SNR. To do this, they performed the modeling described in connection with Figure 5A (curve a) for different sizes of emission points.
[0137] Figure 10 shows the evolution of the SNR, as a function of the angular separation between the central pixel and four neighboring twin pixels, for different sizes between 5 pm and 40 pm. The SNR obtained with a single pixel for each size is also shown: see dotted lines. Figure 10 was established based on disc-shaped emission points. It can be seen that the smaller the size of the emission points, the more the SNR is degraded. In particular, it is preferable that the size of each emission point be greater than or equal to 10 pm when using circular emission points.
[0138] Example of sizing.
[0139] Taking into account the above, a device 1 can be sized comprising an emission support 10 defining a field of observation of 15°. The emission support extends over a surface area of 6mm x 6 mm. Its diameter D pis considered to be 6 mm. Each waveguide 11, 300 nm wide, was spaced from each other by a period dn= 1.5 pm. Each electrode is spaced from each other by a period d î3 = 5 pm. We use a number of waveguides Nu = 9 and a number of electrodes N î3 = 9 per EPD emission subset.
[0140] We can thus form a number of pixels N pix such as
[0141] Taking into account the values previously indicated, the number of pixels N pix is equal to 59000, or 243 x 243.
[0142] Using a configuration as shown in Figures 6A and 6B, the number of laser light sources would be 444.
[0143] Taking into account emission points of size 10 pm x 10 pm, we obtain a minimum gap = 2fl2= 1.87°, we can distribute the twin pixels according to a square tiling, as shown in Figure 11. A first group of twin pixels can comprise 8x8 pixels, regularly distributed according to a square mesh with a spatial pitch of 750 pm, i.e. a total image width of 5.5 mm. The other groups of pixels are regularly arranged in a frame with a side of 5.5 mm, either in groups of 8x8 or in groups of 7 x 7. This results in a total of ten groups of twin pixels, which requires only ten laser diodes. In Figure 12, we have represented the first group of pixels, containing 8x8 pixels, and a second group of pixels, comprising 7x7 pixels.
[0144] The number of laser light sources required to regularly tile the image can be estimated by the expression: where FOV corresponds to the field of observation and 11 corresponds to the angular separation between two twin pixels. N taser corresponds to the number of lasers in the reference configuration, i.e. 444 lasers.
[0145] The lower the number of laser light sources, the greater the number of twin pixels, which, for a fixed image size, is likely to increase the noise. The inventors calculated a noise factor r], which corresponds to a ratio between the noise obtained by a configuration of a central pixel surrounded by 4 neighboring pixels, respectively with 5 different laser sources and with the same laser source. This amounts to comparing the noises respectively obtained in the configurations according to the invention and the reference configurations described in connection with FIGS. 5A to 5C.
[0146] The noise factor is expressed according to the expression: where B and B2 are the noise amplitudes in the first configuration (invention) and the reference configuration respectively. Each noise amplitude is such that B= max ( / (%)) in the configuration concerned. This is the denominator of expression (7).
[0147] The noise factor r], expressed as a percentage, is shown in Figure 12: curve a: left ordinate axis. In Figure 12 the abscissa axis corresponds to the minimum angle between twin pixels, unit degree. Curve b: represents the number of laser light sources required by the system (right ordinate axis) as a function of the angular pitch between two twin pixels (abscissa axis). As the angular pitch decreases, the number of light sources also decreases. It can be seen that by considering an angular pitch between 1.5° and 2°, for example 1.8 or 1.9°, an acceptable noise factor is obtained for a reasonable number of laser sources. By reducing the angle between two twin pixels, a reduced number of laser light sources can be implemented, at the expense of strong cross-interference effects.By increasing the angle between two twin pixels, the cross interference effects are reduced, at the expense of the number of laser light sources to be used. In Figure 12, the curve has been extended to the prior art configuration (444 laser sources).
[0148] The invention may be implemented on portable augmented reality devices, in particular glasses, or visors, or screens, and more generally, on surfaces, intended to be placed facing an eye so as to form an image superimposed on the image that the eye perceives on the surface or through the surface.
Claims
26 DEMANDS 1. Device (1) for projecting an image onto the retina of an eye, the image being composed of several pixels, the device comprising: - laser light sources (21); - a transmission medium (10), comprising: • light guides (11), each light guide being connected to a light source and to a plurality of diffraction gratings (12), distributed along the light guide, each diffraction grating being electrically modulated to extract a portion of the light propagating in the light guide to which it is connected; • electrodes (13), each electrode being configured to modulate diffraction gratings connected to different light guides; • emission points (EP), each emission point being formed at the level of a diffraction grating, and extending between an electrode and a light guide, each emission point being configured to emit light, along an angular direction (Qÿ), following the extraction of light propagating in the light guide; the device being such that: different emission points (EP) are configured to emit light along the same angular direction (0^), so as to converge on the retina, forming the same pixel (R(i,j)), said emission points defining an emission subset (EPDj), such that to each emission subset corresponds an angular direction of light emission; two adjacent pixels (R(j,j), (R(i + 1,j))) of the image are formed by two emission subsets (EPDij, EPDj) i+1 j)), respectively associated with two angular directions (0, y , 0 i+1) different and spaced by an elementary angular gap ( / 3); the device being characterized in that: - the same light source is connected to different light guides, said light guides defining different emission subsets, called twins, configured to simultaneously form different pixels, called twin pixels, when the light source is activated, the twin emission subsets being associated with the light source; - the respective angular directions of each twin emission subset are spaced from each other by an angular gap (fl) greater than or equal to a gap minimal angular the minimum angular deviation corresponding to k times the elementary angular deviation ( / 3), k being greater than or equal to 2; - such that the twin pixels, simultaneously formed on the retina, are offset by at least the minimum angular separation.
2. Device according to claim 1, in which the emission points of different twin emission subsets are connected to the same electrode.
3. Device according to claim 1, wherein: - several light sources are respectively connected to different light guides, to form different twin emission subsets, each twin emission subset being associated with the same light source; - the respective angular directions of each twin emission subset are spaced from each other by an angular gap greater than the minimum angular gap.
4. Device according to any one of the preceding claims, wherein the waveguides, connected to the same light source, and forming a twin emission subset are different from other waveguides, connected to said light source, and forming another twin emission subset.
5. A device according to any one of the preceding claims, wherein the minimum angular deviation (n m i„) is greater than or equal to 0.5° or 1°.
6. A device according to any one of the preceding claims, wherein: - the diameter or diagonal of the emission points is less than or equal to 10 pm, the minimum angular deviation being greater than 1.5; - the diameter or diagonal of the emission points is between 10 pm and 20 pm, the minimum angular deviation being greater than 0.8; - the diameter or diagonal of the emission points is greater than 20 pm, the minimum angular deviation being greater than 0.5; 7. Device according to any one of the preceding claims, wherein the diameter or diagonal of each emission point is greater than 5 pm.
8. Device according to any one of the preceding claims, in which - light guides connected to the same light source define twin first emission subsets and twin second emission subsets, so as to form twin first pixels and twin second pixels respectively; - the emission points of each first twin emission subset are connected to first electrodes; - the emission points of each second twin emission subset are connected to second electrodes, different from the first electrodes; - the device includes a switch (33), to power either the first electrodes, or the second electrodes, so that the light emitted by the light source is extracted sequentially either by the emission points of the first emission subset, or by the emission points of the second emission subset, to form sequentially, on the image, the first twin pixels and the second twin pixels.
9. Device according to any one of the preceding claims, wherein for at least one light source, different modulators (22) are respectively interposed between a laser light source and different light guides connected to the light source, so as to modulate an intensity of the light propagating in said light guides independently for different light guides connected to the light source.
10. Device according to claim 9, wherein: - a light source is connected to N different twin emission subsets, configured to simultaneously form N twin pixels, N being an integer greater than or equal to 2; - the light source is connected to N modulators (22), each modulator extending between the light source and the waveguides forming the same emission subset.
11. Device according to any one of the preceding claims, wherein the number of twin emission subsets formed by at least one light source is greater than or equal to 20.
12. Device according to any one of the preceding claims, comprising fewer than 20 different light sources to form an image, or part of an image, of at least 200 pixels by 200 pixels. 29 13. Device according to any one of the preceding claims, comprising a holographic film (14), subdivided into different holograms, each hologram being associated with a diffraction grating (12), and configured to emit the light wave, along the emission direction (0^), under the effect of light extracted by the diffraction grating to which it is associated, each association between a hologram and a diffraction grating forming a point emission (PE) of light.
14. A pair of glasses comprising spectacle lenses, the glasses comprising a device according to any one of the preceding claims, the stack (10) being formed on at least one lens of the glasses.
15. A method for parameterizing a device according to any one of claims 1 to 13, the parameterization comprising: a) modeling a spatial distribution of noise between two twin pixels by modifying the minimum angular separation; b) estimating the minimum angular separation as a function of the spatial distribution.
