Light field image projection system for temporally sequentially generating virtual images using single narrowband light source for each color
By using narrowband point light sources and separation equipment to generate virtual light sources, the problem of difficult to achieve small shape factors and efficient design of existing light field projectors is solved, and a compact, flexible and efficient light field projection effect is achieved.
Patent Information
- Application Number
- CN202280094129.6
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2022-03-25
- Publication Date
- 2024-11-08
AI Technical Summary
Due to the use of large spatially diverse light source arrays, existing light field projectors are difficult to build cost-effective light field projectors with small shape factors, and it is difficult to achieve compact and flexible equipment design.
Using a light field image projection system including narrowband point light sources, separation equipment and spatial light modulators, multiple incident beams and virtual light sources are generated through separation equipment, a virtual viewpoint is formed using monocular depth of field technology, and a compact and holographic reflection combiner is achieved through a holographic reflection combiner. Flexible design.
A light field projection system with small shape factors is implemented, capable of projecting with a single or a small number of point light sources, with good perspective performance, and can project virtual content on any depth plane.
Smart Images

Figure CN118922763A_ABST
Abstract
Description
Technical Field
[0001] The present disclosure relates to a near-eye light field image projection system, and more particularly to a light field image projection system with a small form factor. The present disclosure relates to a wearable device including a light field image projection system. Background Art
[0002] Known light field projectors include a light source, which typically includes an array of point light sources collimated into a collimated beam. The collimated beam illuminates a spatial light modulator (SLM) at different incident angle sets. Each reflected (or transmitted) beam will carry specific image information produced by the modulation of the SLM. Intermediate optics, which may include combiner optics, re-image the point light sources into viewpoints. The viewpoints form a light field eye box, allowing the user to see a true 3D rendering of a digital scene. Typically, an array of point light sources uses LED light sources to sequentially generate viewpoints that form a light field.
[0003] Large arrays of spatially disparate light sources do not allow for the construction of cost-effective light field projectors of small form factors. Summary of the invention
[0004] The present disclosure relates to a light field image projection system, which includes: a light source, including a single narrowband point light source for each color, and configured to emit narrowband light whose wavelength spectrum is narrowband; a separation device, configured to sequentially generate multiple incident light beams and form multiple virtual light sources at different positions in a first image plane; an SLM, configured to generate a modulated beam light and a virtual image for each incident light beam; and a combiner, configured to project the virtual image at a virtual viewpoint within an eye box area, and transmit natural light from the real world toward the eye box, each viewpoint containing an image of a virtual scene viewed from the viewpoint. The separation device is further configured to guide the incident light beam to the SLM so that the incident light beam is incident on the surface of the SLM at different incident angles, and so as to sequentially select at least one of the virtual viewpoints visible in the eye box.
[0005] In an embodiment, the separation device includes: a diffraction element configured to generate multiple incident light beams at different incident angles from a narrow-band light source; an optical lens configured to form multiple virtual light sources; and an active shutter array configured to sequentially select at least one of the virtual viewpoints visible in the eye box.
[0006] In another embodiment, the separation device comprises a lens array comprising a plurality of lenslets, each lenslet generating an incident light beam at an angle of incidence different from an angle of incidence of an incident light beam generated by another lens.The lenslets generate a focused or defocused beam.
[0007] In yet another embodiment, the separation device comprises a beam steering device and a lens array comprising a plurality of lenslets, the beam steering device being steerable to direct the narrowband light towards one of the lenslets to generate an incident light beam at a certain incident angle.
[0008] The point light source may include a laser light source. In particular, the point light source may include a red laser point light source configured to generate red light, a green laser point light source configured to generate green light, and a blue laser point light source configured to generate blue light.
[0009] The combiner may comprise a holographic reflective holographic combiner.
[0010] The present disclosure further relates to a wearable device, such as augmented / mixed reality or smart glasses, including a light field image projection system.
[0011] The light field image projection system disclosed in this article has a small form factor. When used with a holographic reflective holographic combiner, the light field image projection system can be made more compact and has great flexibility in its shape. The light field image projection system has very good perspective performance.
[0012] The light field image projection system does not require an array including multiple point light sources, but may use only a single point light source or a small number of point light sources. In any case, the light field image projection system requires fewer point light sources than the total number of viewpoints. BRIEF DESCRIPTION OF THE DRAWINGS
[0013] Exemplary embodiments of the invention are disclosed in the description and illustrated by the accompanying drawings, in which:
[0014] Figure 1a schematically illustrates a light field image projection system according to an embodiment;
[0015] Figure 1b A light field image projection system according to an alternative configuration is shown;
[0016] Figure 2a A light field image projection system according to an embodiment is shown;
[0017] Figure 2b Shows Figure 2a Alternative configurations of light field image projection systems;
[0018] Figure 2c Shows Figure 2a Another alternative configuration of the light field image projection system;
[0019] Figure 3 represents a light field image projection system according to yet another embodiment;
[0020] Figure 4A light field image projection system including projection optics and a combiner according to an embodiment is shown;
[0021] Figure 5 a to Figure 5 c shows a structure including three narrow-band point light sources ( Figure 5 Different embodiments of the light source of a); and
[0022] Figure 6a reporting a time series of switching states of a FLCoS-based spatial light modulator of a light field image projection system according to an embodiment; and
[0023] Figure 6b A time sequence of switching states of an FLCoS-based spatial light modulator of a light field image projection system according to another embodiment is reported. DETAILED DESCRIPTION
[0024] Figure 1a A near-eye light field image projection system according to an embodiment is schematically illustrated.The light field image projection system comprises a light source 10 comprising a single narrow-band point light source for each color and configured to emit narrow-band light 200 whose wavelength spectrum is narrow-band.
[0025] The light field image projection system further comprises a separation device 20 , 30 , 70 , 80 configured to sequentially generate a plurality of incident light beams 220 and form a plurality of virtual light sources 50 at different positions in the first image plane 31 .
[0026] The light field image projection system further comprises an SLM 40 configured to generate a modulated beam 240 and a virtual image for each incident light beam 220 .
[0027] The light field image projection system further comprises a combiner 100 (see Figure 4 ), the combiner 100 is configured to project virtual images at virtual viewpoints 60a to 60c within the eye box area 121, and transmit natural light from the real world 180 toward the eye box area 121. Each virtual image generated by the spatial light modulator 40 corresponds to a view seen from it at the virtual viewpoint position, and then a light field image can be formed. Therefore, each virtual viewpoint 60a to 60c contains a virtual image of the virtual scene viewed from the virtual viewpoint 60a to 60c.
[0028] exist Figure 1a In the configuration of , the separation device comprises a diffractive element 20 configured to generate a plurality of incident light beams 220 incident on the surface of the SLM 40 at different incident angles θ.
[0029] The diffraction element 20 may include a diffraction optical element (DOE), a holographic optical element (HOE), a liquid crystal polarization grating (LCPG), a semi-reflective surface, a Fresnel lens array, a mirror, or a metasurface. The separation device further includes a first optical lens 70 configured to form a plurality of virtual light sources 50a to 50c. The first optical lens 70 focuses the incident light beam 220 forming the incident light beam 220 into the first image plane 31 so as to form an array of virtual light sources 50a to 50c. Figure 1a , three incident light beams 220 are shown, forming three virtual light sources 50a to 50c at different positions in the first image plane 31. The diffraction element 20 and the first optical lens 70 can be configured to generate any number of incident light beams 220 and virtual light sources 50a to 50c. The virtual light sources 50a to 50c can be further formed in the first image plane 31 in any two-dimensional arrangement.
[0030] Refer again Figure 1a , the first optical lens 70 is a single lens. Depending on the incident angle θ of the incident light beam 220, each of the incident light beams 220 passes through a portion of the first optical lens 70. The portion of the first optical lens 70 focuses the incident light beams 220 passing through it so as to form light sources 50a to 50c in the first image plane 31.
[0031] In one aspect, the separation device further includes a pixelated active shutter array 30, which is configured to sequentially select at least one of the virtual viewpoints 60a to 60c visible in the eye box 121. The active shutter array 30 allows each of the incident light beams 220 to be transmitted to the rest of the optical system or not to be transmitted to the rest of the optical system. The active shutter 30 may include a transparent or reflective ferroelectric liquid crystal device. Alternatively, the active shutter 30 may include a liquid crystal array or an active micromirror array. The type of active shutter 30 may be selected depending on the shutter speed required. The active shutter array may be configured to function in transmission or reflection.
[0032] Each virtual viewpoint 60a to 60c may be projected in a time series. For example, the pixelated shutter array 30 may allow the virtual light source 50a to reach the virtual viewpoint 60a while blocking the virtual light sources 50b and 50c, and thus blocking the virtual viewpoints 60b and 60c. At this moment, only the virtual viewpoint 60a will be visible and transmitted or reflected by the optical system. At a later moment, only the virtual light source 50b will be able to be transmitted by the active shutter 30, and the virtual viewpoint 60b will be visible, and so on for the virtual light source 50c.
[0033] A corresponding image is generated by the SLM 40 for each virtual viewpoint 60a to 60c. For example, when the virtual light source 50a is allowed to reach the virtual viewpoint 60a by the shutter array 30, a 2D image of the virtual scene is generated by the SLM 40, and the 2D image of the virtual scene corresponds to the view seen from it at the virtual viewpoint position 60a. The same process is repeated in time series for other virtual viewpoints 60b and 60c. The 2D image of the virtual scene corresponds to the view seen from it at the virtual viewpoint position 60b or 60c each time. Then a light field image is formed. Note that since any number of virtual light sources 50a to 50c can be generated, the light field image projection system can project any number of virtual viewpoints 60a to 60c in time series.
[0034] The refresh rate at which the sequence of virtual viewpoints 60a to 60c is generated may be fast enough to occur within the integration time of the eye, which is typically between 20 Hz and 1000 Hz.
[0035] Thus, the light field image projection system uses a single narrow-band point light source of at least each color to enable time-sequential virtual viewpoint generation based on the active shutter array 30 and the passive beam splitter 20 that sequentially select the visible virtual viewpoints 60a to 60c. The light field image projection system further enables projection of 3D images with monocular depth of field, which allows virtual content to be placed on any depth plane.
[0036] The light field image projection system may further include a first projection optical device 27, which is arranged between the separation device 20, 30, 70, 80 and the SLM 40 and is configured to collimate and project the incident light beam 220 so as to form an intermediate image in the intermediate image plane 127 coinciding with the position of the SLM 30. The light field image projection system may further include a second projection optical device 90, which is arranged between the SLM 40 and the eye box 121 and is configured to project the modulated beam 240 so as to form the virtual viewpoints 60a to 60c.
[0037] The incident light beam 220 has a luminous intensity (the wavelength-weighted power emitted by the incident light beam 220) that substantially corresponds to the luminous intensity of the narrowband light 200 divided by the number of virtual light sources 50. Assuming that the intensity profile of the narrowband light 200 is Gaussian, the intensity profile of the envelope of each of the virtual light sources 50 is also Gaussian, so that the intensity of each separate virtual light source 50 is unequal and follows the Gaussian envelope.
[0038] exist Figure 1a In the case of the light field image projection system shown in , the numerical aperture NA of the system can be defined by NA=D / 2f, where f is the focal length of the first optical lens 70 and D is the size of the incident light beam 220.
[0039] Assuming a 10 mm incident beam 220 and 25 virtual light sources 50 (e.g., a 5×5 array of virtual light sources 50), the ratio of the luminous intensity of a single virtual light source 50 to the luminous intensity of the narrowband light 200 is 4%. In this configuration, the numerical aperture NA of the virtual light source 50 corresponds to 0.2 (where f=5 mm and D=2 mm).
[0040] Figure 1b A light field image projection system according to an alternative configuration is shown, in which the first optical lens 70 is a lens array including a plurality of lenslets 71. In this configuration, each incident light beam 220 passes through one of the lenslets 71 depending on the angle of incidence θ. Each lenslet 71 focuses the incident light beam 220 passing through it so as to form light sources 50a to 50c in the first image plane 31. Optionally, the light field image projection system may further include a second optical element 25. The second optical element 25 allows the main rays (or principal rays) of each incident light beam 220 to be placed parallel to each other before they reach the first optical lens 70. In the absence of the second optical element 25, the main rays of the incident light beam 220 would diverge from each other and require a larger first optical lens 70, and also require a larger active shutter 30 and first projection optical device 27, thus making the projection system larger.
[0041] As in Figure 1b As shown in the figure, the size of the narrow-band light 200 can be made to substantially correspond to the size of the small lens 71 .
[0042] Figure 2a 1 shows a light field image projection system according to another embodiment. The separation device includes a lens array 70, which includes a plurality of small lenses 71. The lens array 70 is configured to focus at least a portion of the narrowband light 200 so as to generate an incident light beam 220 and form an array of virtual light sources 50a to 50c in the first image plane 31. In particular, each small lens 71 generates an incident light beam 220 and forms a corresponding virtual light source 50a to 50c. The generated incident light beam 220 is incident on the surface of the SLM 40 at different incident angles θ. The small lens 71 may include a converging lens or a diverging lens.
[0043] The separation device may further comprise an active shutter array 30 as described above.
[0044] The active shutter array 30 may be arranged at different positions in the optical path of the incident light beam 220 or the modulated light beam 240 .
[0045] Reference Figure 1a and Figure 2a, the active shutter array 30 is substantially arranged in the first image plane 31 so that at least one of the virtual light sources 50a to 50c is transmitted or reflected at a given time.
[0046] exist Figure 1b In the configuration, the active shutter array 30 is arranged near the focus of the small lens 71, in particular between the lens array 70 and the first image plane 31.
[0047] Figure 2b Shows Figure 2a An alternative configuration of a light field image projection system is shown in FIG. 1 , in which an active shutter array 30 is arranged between the light source 10 and the separation device 20 .
[0048] Figure 2c Shows Figure 2a Another alternative configuration of the light field image projection system is shown in which the active shutter array 30 is arranged between the SLM 40 and the eye box 121. For example, the active shutter array 30 can be arranged near the virtual viewpoints 60a to 60c.
[0049] As in Figure 2a to Figure 2c As shown in FIG. 2 , the size of the narrowband light 200 may substantially correspond to the size of the lens array 70 .
[0050] exist Figure 2a to Figure 2c The arrangement of the active shutter array 30 shown in FIG. 1 may be implemented in Figure 1a and Figure 1b In the configuration of the light field image projection system shown in FIG.
[0051] This position can also be used in a configuration with a beam splitter 20. Note that more than one light source 10 can be allowed to pass through at the same time. This can be used to generate brighter images, peripheral images, or to fill in the color of an object.
[0052] exist Figure 1b , Figure 2a to Figure 2c In the case of the light field image projection system shown in , the numerical aperture NA of the virtual light source 50 can be defined by NA=D / 2f, where f is the focal length of the first optical lens 70, and D is the diameter size of the lenslet 71 when the beam fills the lenslet aperture. As discussed above, assuming a 10 mm incident light beam 220 and 25 virtual light sources 50 (e.g., an array of 5×5 virtual light sources 50), the ratio of the luminous intensity of a single virtual light source 50 to the luminous intensity of the narrowband light 200 is 4%. The numerical aperture NA is given by the size of the lenslet 71 (NA=0.2 for a lenslet diameter of 2 mm).
[0053] More generally, in Figure 1a , Figure 1b , Figure 2a to Figure 2cIn the case of the light field image projection system shown in , the ratio of the luminous intensity of a single virtual light source 50 to the luminous intensity of the narrowband light 200 depends on the number of virtual light sources 50. In an embodiment, the ratio of the luminous intensity of a single virtual light source 50 to the luminous intensity of the narrowband light 200 is at least 1%. Alternatively, the ratio of the luminous intensity of a single virtual light source 50 to the luminous intensity of the narrowband light 200 may be at least 5%, 10% or 20%.
[0054] According to yet another embodiment, a light field image projection system is shown in Figure 3 In this configuration, the separation device comprises a beam steering device 80 and a lens array 70, the lens array 70 comprising a plurality of lenslets 71. The beam steering device 80 is steerable so as to direct the narrowband light 200 towards one of the lenslets 71 to generate an incident light beam 220 at a given incident angle θ.
[0055] The beam steering device 80 may include a tiltable tilt mirror in order to direct the narrowband light 200 towards one of the lenslets 71 .
[0056] The beam steering device 80 may be configured to steer in a first position, stopping its movement in the first position for a time duration during which the light source 10 is turned on, such that the incident light beam 220 is directed towards one of the lenslets 71. The beam steering device 80 may be further configured to steer in a second position, stopping its movement in the second position for a time duration during which the light source 10 is turned on, such that the incident light beam 220 is directed towards another lenslet 71. During the steering of the beam steering device 80, the light source 10 is turned off. The beam steering device 80 may be configured to steer in any number of positions corresponding to the number of lenslets 71 in the lens array 70, and stop its movement, such that the incident light beam 220 is directed towards one of the lenslets 71. Virtual viewpoints 60a to 60c are generated whenever the light source 10 is turned on and the incident light beam 220 is directed towards one of the lenslets 71.
[0057] In one aspect, the incident light beam 220 may pass through the second optical element 25 before reaching the lenslets 71 of the lens array 70. Figure 1b As discussed, the second optical element 25 allows placing the chief rays of each incident light beam 220 parallel to each other before they reach the first optical lens 70 .
[0058] As in Figure 3 As illustrated in FIG. 1 , the size of the narrowband light 200 may substantially correspond to the size of the lenslet 71. In this configuration, a major portion of the narrowband light 200, and possibly substantially the entire narrowband light 200, is used to generate the incident light beam 220 and to form the virtual light source 50, and thus to form the virtual viewpoints 60a to 60c. In contrast, in Figure 1a , Figure 1b and Figure 2a to Figure 2c In the configuration of the light field image projection system shown in FIG. 1 , the narrowband light 200 is separated, and only a portion of the narrowband light 200 is used to generate the incident light beam 220 and is used to form the virtual viewpoints 60 a to 60 c. The remaining portion of the narrowband light 200 is blocked by the active shutter 30. Therefore, only a portion of the initial narrowband light 200 is used to create the virtual viewpoints 60 a to 60 c. Therefore, the incident light beam 220 has a luminous intensity substantially corresponding to the luminous intensity of the narrowband light 200.
[0059] In an alternative configuration, the narrowband light 200 may be collimated by the collimating optical element 101 .
[0060] Figure 1b to Figure 3 The light field image projection system in the configuration further comprises a first projection optical device 27 which is arranged between the separation devices 20 , 30 , 70 , 80 and the SLM 40 and is configured to collimate and project the incident light beam 220 .
[0061] Figure 4 A schematic representation of a light field image projection system is shown, which includes a second projection optics 90 arranged between the SLM 40 and the combiner 100. The second projection optics 90 is configured to form intermediate virtual viewpoints 60a to 60c in an intermediate image plane 110 between the second projection optics 90 and the combiner 100. The second projection optics 90 may include a plurality of refractive, reflective, diffractive or free-form optical surfaces. The combiner 100 is transparent or translucent, allowing virtual images to be projected at the virtual viewpoints 60a to 60c within the eye box area 121, and transmitting natural light from the real world 180 toward the eye box 121. The combiner 100 may include a reflective holographic, a transmissive holographic, a refractive, a reflective or a diffractive combiner.
[0062] In a preferred embodiment, the combiner 100 comprises a holographic reflective holographic combiner allowing selective reflection of the 3 RGB color components of the projector while allowing the rest of the visible spectrum to be transmitted. The holographic reflective combiner 100 has a broadband acceptance angle of incoming light between 15° and 80°.
[0063] In an embodiment, the light source 10 includes a laser point light source. In a possible configuration, the light source 10 may include a red laser point light source configured to generate red light, a green laser point light source configured to generate green light, and a blue laser point light source configured to generate blue light. In another possible configuration, the light source 10 may include a single narrow-band point light source configured to emit white light including red light, green light, and blue light.
[0064] Compared to LED light sources, laser light sources have sufficient optical power density to be separated into multiple virtual light sources. The separated single laser point light sources can therefore be advantageously used in combination with a holographic combiner. A possible alternative includes using an array of small VCSEL lasers, each VCSEL laser being a single point light source. When using a VCSEL laser array, no separate device is required to generate multiple incident light beams 220. In fact, each incident light beam 220 is generated by a VCSEL laser of the array. However, VCSEL laser arrays are currently only available for emitting red light. On the other hand, edge-emitting lasers are technically difficult to integrate in array form, are bulky, and are costly.
[0065] In addition, compared with LED light sources, laser light sources are essentially monochromatic and produce significantly reduced dispersion on the projection system, especially in the combiner. Using multiple laser light sources to replace the current multiple LEDs is a challenge in terms of miniaturization, packaging and power consumption of the device. A light field image projection system using a single narrow-band light source for each color is therefore advantageous.
[0066] Figure 5 a to Figure 5 c illustrates different embodiments of the light source 10. In particular, Figure 5 FIG. 1 shows that the light source 10 includes three narrowband point light sources 10a to 10c, for example, one narrowband point light source for each color. The light source 10 includes a first narrowband point light source 10a emitting red narrowband light 200, a second narrowband point light source 10c emitting green narrowband light 200, and a third narrowband point light source 10c emitting blue narrowband light 200.
[0067] In one aspect, the first point light source 10a can be collimated by the collimating optical element 101, and then reflected by the mirror 102. Similarly, the second point light source 10b and the third point light source 10c can also be collimated by the collimating optical element 101, and reflected by the dichroic plate 103. The dichroic plate 103 allows a specific color to be reflected and another color to be transmitted. For example, the first point light source 10a is transmitted by the dichroic plate 102, and the second point light source 10b is reflected by the dichroic plate 102, effectively combining the first point light source 10a and the second point light source 10b. At the exit of the light source 10, the first point light source 10a, the second point light source 10b and the third point light source 10c are combined in a single narrowband light 200. An aperture lens 105 can be added to expand the numerical aperture of the light source 10.
[0068] exist Figure 5 In the configuration of b, the light source 10 does not include the lens 105, so that the narrow-band light 200 remains collimated or has a small numerical aperture.
[0069] exist Figure 5c, the point light sources 10a to 10c are combined using a single collimating optical element 106. The point light sources 10a, 10b and 10c may be arranged along a row one on top of another in a triangular shape or in a square shape (as in Figure 5 c). When the single collimating optical element 106 is placed at a distance close to the focal length f of the single collimating optical element 106 to the point light sources 10a to 10c, the point light sources 10a to 10c overlap at the focal plane 107 of the collimating optical element 106 at the distance f on the side of the collimating optical element 106 opposite to the light source 10.
[0070] Return to reference Figure 3 In the projection system configuration shown in FIG. 8 , the SLM 40 may include ferroelectric liquid crystal on silicon (FLCoS). The light field image projection system may further include a controller 300 configured to control a switching state of the SLM 40 in synchronization with the beam steering device 80 and the light source 10 .
[0071] Figure 6a The switching states of the FLCoS-based SLM 40 are reported as a function of time t. The FLCoS can display image information corresponding to the illumination of the light source, which is Figure 6a In FIG. 1 , the narrow-band point light sources 10a to 10c are illustrated by colors such as red (R), green (G), or blue (B), corresponding to the narrow-band point light sources 10a to 10c that emit red, green, and blue narrow-band lights 200, respectively. Figure 6a , the numbers 0, 1 and 2 correspond to the positions of the sequential virtual light sources 50a to 50c.
[0072] As in Figure 6a As shown in FIG. 1 , for one image information R1, for example, red image information, the FLCoS takes a specific amount of time (or forward setup time t11) to switch to the correct state. The forward setup time t11 corresponds to the time of the FLCoS R channel forward data for the virtual light sources 50a to 50c. The FLCoS remains in the correct state during the forward illumination time t111, which corresponds to the time during which the light source 10 is actually turned on to project an image. Illuminating the FLCoS before or after the illumination time t111 window will result in lower image contrast.
[0073] After the positive illumination time t111, in order to maintain the balanced charge level of the FLCoS, negative image information is sent to the FLCoS with a timing similar to the positive image information (shown by the dashed line -R1 step during the negative setup time t11 and the negative illumination time T111). Without this charge balance, the FLCoS SLM may be damaged. During the negative setup time T11 and the negative illumination time T111, there is no light source illumination. In other words, the controller 300 turns on the light source 10 during the positive illumination times t111, t121, t131 when the beam steering device 80 is not moving and directs the narrowband light 200 toward one of the small lenses 71, and turns off the light source 10 at any other time.
[0074] The same illumination sequence described above applies to other colors, including green (G1) with positive and negative setup times t12 and illumination times t121, T121, and blue (B1) with positive and negative setup times t13 and illumination times t131, T131.
[0075] Looking at the global RGB sequential illumination of a particular virtual light source position 50a to 50c (e.g., R1 / G1 / B1), the beam steering device 80 (such as a tilt mirror) needs to be in a stable position at least during a stable time t3, which covers the three RGB illumination times t111, t121, and t131. After this, the beam steering device 80 requires a specific amount of time (switching time t4) to switch to the next position corresponding to the next virtual light source 50a to 50c in the virtual point source array 50 before the additional image information R2 (e.g., red image information) needs to be turned on during t211. The switching time t4 is shown here as the sum of the times T13, T131, and t21, which is essentially associated with the entire projection data flow of the high-level system architecture. As such, the switching time t4 can be very small, in the range of 50μs to 500μs. Therefore, the beam steering device 80 needs to switch at least as fast as the switching time t4, which can be a very strict physical constraint.
[0076] Figure 6b An alternative time series of the switching states of the FLCoS-based SLM 40 is reported. Figure 6a In other words, at least one positive setting time t11, t12, t13 and positive irradiation time t111, t112, t113 of a color is inverted (or reversed) with respect to the corresponding negative setting time T11, T12, T13 and negative irradiation time T111, T112, T113.
[0077] During the negative setup time T11, T12, T13 and the irradiation time T111, T121, T131 of the previous irradiation step and the positive setup time of the subsequent irradiation step, the beam steering device moves from one position to another. During the negative setup time and negative irradiation time of the previous irradiation step and the negative setup time and negative irradiation time and the positive setup time of the subsequent irradiation step, the beam steering device 80 therefore has more time to move from one position to another.
[0078] By reversing the timing, the switching time t4 can be increased by at least 30% or more (increased switching time t41) depending on the values of the irradiation times t121 and t131. Figure 6a Compared with the timing of Figure 6b The inverted timing preserves the order of positive and negative image data sent to the FLCoS SLM 40 for the same color and virtual light source position, which means that irreversible damage will be introduced to the FLCoS-based SLM 40.
[0079] Optionally, with Figure 6a Compared with the timing of , the timing of the positive setting time t12 and positive irradiation time t121 and the negative setting time T12 and negative irradiation time T121 for green and the positive setting time t13 and positive irradiation time t131 and the negative setting time T13 and negative irradiation time T131 for blue can also be reversed.
[0080] It is to be understood that the present invention is not limited to the exemplary embodiments described above, and other implementation examples are possible within the scope of the patent claims. For example, the light source 10 may include two or more than three narrow-band point light sources 10a to 10c, and / or two or more than three virtual light sources 50a to 50c.
[0081] Reference Numbers and Symbols
[0082] 10 light source; 10a first narrowband point light source; 10b second narrowband point light source; 10c third narrowband point light source; 20 beam splitter; 25 second optical element; 30 active shutter; 31 first image plane; 40 spatial light modulator; 50, 50a, 50b, 50c virtual light source; 60, 60a, 60b, 60c virtual viewpoint; 70 first optical lens, lens array; 71 lens; 80 beam steering device; 90 second projection optical device; 100 combiner; 101 collimating optical element; 102 mirror; 103 dichroic plate; 105 lens; 106 collimating optical element; 107 focal plane; 110 intermediate image plane; 180 natural light from the real world; 200 narrowband light; 220 incident light beam; 240 modulated light beam; 300 controller; θ incident angle; t11 positive setting time for red R1; t111 positive irradiation time for red R1; T11 negative setting time for red R1; T111 negative irradiation time for red R1; t12 positive setting time for green G1; t121 positive irradiation time for green G1; T12 negative setting time for green G1; T121 negative irradiation time for green G1; T13 positive setting time for blue B1; t131 positive irradiation time for blue B1; T13 negative setting time for blue B1; T131 negative irradiation time for blue B1; t3 stabilization time; t4 switching time.
Claims
1. A light field image projection system, comprising: a light source (10) comprising a single narrow-band point light source for each color and configured to emit narrow-band light (200) whose wavelength spectrum is narrow-band; A separation device (20, 30, 70, 80) configured to sequentially generate a plurality of incident light beams (220) and form a plurality of virtual light sources (50) at different positions in a first image plane (31); A spatial light modulator (40) configured to generate a modulated light beam (240) and a virtual image for each incident light beam (220); as well as a combiner (100) configured to project virtual images at virtual viewpoints (60) within the eyebox region (121) and transmit natural light from the real world (80) toward the eyebox (121), each viewpoint (60) containing an image of a virtual scene viewed from the viewpoint (60); wherein the separation device (20, 30, 70, 80) is further configured to direct the incident light beam (220) to the spatial light modulator (40) so that the incident light beam (220) is incident on the surface of the spatial light modulator (40) at different incident angles (θ) and so as to sequentially select at least one of the virtual viewpoints (60) visible in the eye box (121); and The ratio of the luminous intensity of the single virtual light source 50 to the luminous intensity of the narrow-band light (200) is at least 1%.
2. The projection system of claim 1, wherein the incident light beam (220) has a luminous intensity substantially corresponding to the luminous intensity of the narrowband light (200) divided by the number of virtual light sources (50).
3. A projection system according to claim 1 or claim 2 (FIG. 1a), wherein the separation device comprises: A diffraction element (20) configured to generate the plurality of incident light beams (220) at different incident angles (θ) from the narrowband light (200); An optical lens (70) configured to form the plurality of virtual light sources (50); and an active shutter array (30) configured to sequentially select at least one of the virtual viewpoints (60) visible in the eye box (121).
4. The projection system of claim 3 (FIG. 1a), wherein the optical lens is a single lens (70), each of the incident light beams (220) passing through a portion of the lens (70) depending on the angle of incidence (θ) of the incident light beam (220).
5. The projection system according to claim 3 (FIG. 1b), wherein the optical lens (70) is a lens array comprising a plurality of small lenses (71), each incident light beam (220) passing through one of the small lenses (71) depending on the angle of incidence (θ).
6. The projection system according to any one of claims 3 to 5, wherein the diffractive element (20) comprises a diffractive optical element (DOE), a holographic optical element (HOE), a liquid crystal polarization grating (LCPG), a semi-reflective surface, a mirror or a metasurface.
7. A projection system according to claim 1 or claim 2 (Figures 2a to 2c), wherein the separation device comprises a lens array (70), the lens array (70) comprising a plurality of small lenses (71), each small lens (71) generating an incident light beam (220) at an incident angle (θ) different from the incident angle (θ) of the incident light beam (220) generated by another lens (71).
8. The projection system according to any one of claims 5 to 7 (Fig. 2a to 2c), wherein the size of the narrow-band light (200) substantially corresponds to the size of the lens array (70).
9. The projection system according to claim 1 ( FIG. 3 ), wherein the separation device comprises a beam steering device ( 80 ) and a lens array ( 70 ) comprising a plurality of lenslets ( 71 ), the beam steering device ( 80 ) being steerable so as to direct the narrowband light ( 200 ) towards one of the lenslets ( 71 ) to generate an incident light beam ( 220 ) at an incident angle ( θ ).
10. The projection system according to claim 9 (FIG. 3), wherein the size of the narrowband light (200) substantially corresponds to the size of the small lens (71), so that the incident light beam (220) has a luminous intensity that is substantially 100% of the luminous intensity of the narrowband light (200).
11. The projection system according to any one of claims 1 to 10, wherein the active shutter array (30) comprises a transparent or reflective ferroelectric liquid crystal device or an active micromirror array.
12. A projection system according to any one of claims 1 to 10 (Figure 1a), wherein the active shutter array (30) is substantially arranged in the first image plane (31) so that at least one of the virtual light sources (50) is transmitted at a given time.
13. The projection system according to any one of claims 1 to 10 (Fig. 2b), wherein an active shutter array (30) is arranged between the light source (10) and the separation device (70).
14. The projection system according to any one of claims 1 to 10 (Fig. 2c), wherein an active shutter array (30) is arranged between the spatial light modulator (40) and the eye box (121).
15. The projection system according to any one of claims 1 to 14, wherein the light source (10) comprises a laser light source.
16. The projection system according to any one of claims 1 to 15, wherein the light source (10) comprises a red laser point light source configured to generate red light, a green laser point light source configured to generate green light, and a blue laser point light source configured to generate blue light.
17. The projection system according to any one of claims 1 to 15, wherein the light source (10) comprises a single narrow-band point light source configured to emit white light comprising red light, green light and blue light.
18. The projection system of any one of claims 1 to 16, wherein the combiner (100) comprises a holographic reflective holographic combiner.
19. The projection system according to any one of claims 9 to 18, wherein the SLM (40) comprises ferroelectric liquid crystal on silicon; and The light field image projection system comprises a controller (300) configured to control a switching state of the SLM (40) in synchronization with a beam steering device (80) and a light source (10).
20. The projection system according to claim 19, wherein the controller (300) is configured to switch the color state of the SLM (40) during the positive setting time (t11, t12, t13) and the negative setting time (T11, T12, T13), and to keep the SLM (40) in the switched color state during the positive illumination time (t111, t121, t131) and the negative illumination time (T111, T121, T131); wherein the controller (300) is further configured to turn on the light source (10) during the forward illumination time (t111, t121, t131) when the beam steering device (80) is not moving and directs the narrowband light (200) toward one of the lenslets (71), and turn off the light source (10) at any other time; wherein the beam steering device moves from one position to another during a negative setup time (T11, T12, T13) and a negative irradiation time (T111, T121, T131) of a preceding irradiation step and a positive setup time of a subsequent irradiation step; and At least one positive setup time (t11, t12, t13) and positive irradiation time (t111, t112, t113) of a color is inverted with the corresponding negative setup time (T11, T12, T13) and negative irradiation time (T111, T112, T113), so that the beam steering device (80) can have more time to move from one position to another during the negative setup time and negative irradiation time of the most recent irradiation step and the negative setup time and negative irradiation time of the next irradiation step plus the positive setup time of the next irradiation step.
21. A wearable device comprising the light field image projection system according to any one of claims 1 to 20.
22. The wearable device of claim 21, comprising an augmented / mixed reality device or smart glasses.
