Small head-up display and its waveguide
A pair of elongated waveguides with inclined reflective surfaces expands the eyebox in head-up displays, addressing the limited angle range of light propagation through the pupil, enhancing image perception and accommodating eye movement in a compact design.
Patent Information
- Application Number
- JP2023073888
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Priority Date
- 2022-05-10
- Filing Date
- 2023-04-27
- Publication Date
- 2024-12-17
- Estimated Expiration
- 2043-04-27
AI Technical Summary
Existing display systems face limitations in expanding the range of angles of light rays that can propagate through the eye's pupil for imaging, particularly in applications like head-up displays, where the display device is relatively small and the projection distance is significantly larger than the diameter of the pupil, leading to a narrow visual field and restricted movement of the eyeballs.
The use of a pair of elongated waveguides with inclined reflective surfaces to replicate the exit pupil, expanding the range of angles by guiding light through a pair of waveguides that taper along their length, allowing for a more compact design that enlarges the eyebox while maintaining a wide viewing zone, even with eye movement.
This configuration effectively enlarges the eyebox, allowing for a wider viewing angle and improved image perception, even with head movement, while maintaining a compact form factor suitable for applications like automotive head-up displays.
Smart Images

Figure 0007601939000001 
Figure 0007601939000002 
Figure 0007601939000003
Abstract
Description
[Technical Field]
[0001] The present disclosure relates to pupil expansion or replication, particularly for diffracted light fields consisting of diverging ray bundles. More specifically, the present disclosure relates to display systems including waveguide pupil expanders and methods for pupil expansion using waveguides. Some embodiments relate to two-dimensional pupil expansion. Some embodiments relate to image forming units and head-up displays, such as automotive head-up displays (HUDs). [Background technology]
[0002] Light scattered from an object contains both amplitude and phase information. This amplitude and phase information can be captured, for example, on a photosensitive plate by well-known interference techniques to form a holographic recording, or "hologram," containing interference fringes. The hologram may be reconstructed by illumination with appropriate light to form a two- or three-dimensional holographic reconstruction, or reconstructed image, representing the original object.
[0003] Computer-generated holography can numerically simulate the process of interference. Computer-generated holograms may be calculated by techniques based on mathematical transforms, such as the Fresnel transform or the Fourier transform. These types of holograms are sometimes called Fresnel / Fourier transform holograms, or simply Fresnel / Fourier holograms. Fourier holograms may be considered as a Fourier domain / planar representation of an object or a frequency domain / planar representation of an object. Computer-generated holograms may also be calculated, for example, by coherent ray tracing or point cloud methods.
[0004] The computer-generated hologram may be encoded on a spatial light modulator configured to modulate the amplitude and / or phase of incident light. Light modulation may be achieved using, for example, electrically addressable liquid crystals, optically addressable liquid crystals, or micromirrors.
[0005] A spatial light modulator may include a plurality of individually addressable pixels, sometimes called cells or elements. The light modulation scheme may be binary, multilevel, or continuous. Alternatively, the device may be continuous (i.e., not composed of pixels), and thus the light modulation may be continuous across the device. A spatial light modulator may be reflective, meaning that modulated light is output through reflection. A spatial light modulator may also be transmissive, meaning that modulated light is output through transmission.
[0006] Holographic projectors may be provided using the techniques described herein, such as in head-up display (HUD) applications. Summary of the Invention
[0007] Aspects of the present disclosure are defined in the accompanying independent claims.
[0008] Broadly, this disclosure relates to image projection. This disclosure relates to image projection methods and image projection devices constituting display devices. This disclosure also relates to projection systems comprising an image projector and a viewing system, where the image projector projects or relays light from a display device to the viewing system. This disclosure applies equally to monocular and binocular viewing systems. The viewing system may consist of one or both of an observer's eyes. The viewing system includes an optical element (e.g., a lens in a human eye) having a light intensity and a viewing plane (e.g., the retina in a human eye). The projector may be referred to as a "light engine." The display device and the image formed (or perceived) using the display device are spatially separated from each other. The image is formed on a display plane or perceived by the observer. In some embodiments, the image is a virtual image, and the display plane may be referred to as a virtual image plane. In other embodiments, the image is a real image formed by holographic reconstruction, and the image is projected or relayed to the viewing plane. The image is formed by illuminating a diffraction pattern (e.g., a hologram) displayed on the display device.
[0009] A display device comprises pixels. The pixels of the display may display a diffraction pattern or structure that diffracts light. The diffracted light may form an image at a plane spatially separated from the display device. As is well known in optics, the magnitude of the maximum diffraction angle is determined by the size of the pixel and other factors, such as the wavelength of the light.
[0010] In embodiments, the display device is a spatial light modulator, such as a liquid crystal on silicon ("LCOS") spatial light modulator (SLM). Light propagates from the LCOS toward a viewing object / system, such as a camera or the eye, through a range of diffraction angles (e.g., from zero to a maximum diffraction angle). In some embodiments, magnification techniques may be used to expand the range of available diffraction angles beyond the conventional maximum diffraction angle of the LCOS.
[0011] In some embodiments, an image (formed from a displayed hologram) is propagated to the eye, for example, an intermediate holographic reconstruction / image formed in free space between the display device and the observer or on a receiving surface such as a screen may be propagated to the observer.
[0012] In other embodiments, the hologram itself (light) is propagated to the eye. For example, the spatially modulated light of the hologram (not yet fully converted into a holographic reconstruction, i.e., image)—informally said to be “encoded” in / by the hologram—is propagated directly to the observer's eye. A real or virtual image may be perceived by the observer. In these embodiments, there is no intermediate holographic reconstruction / image formed between the display device and the observer. In these embodiments, the lens of the eye is sometimes spoken of as performing the hologram-to-image transformation or conversion. The projection system, or light engine, may be configured so that the observer looks substantially directly at the display device.
[0013] We refer to a "light field" herein as a "complex light field." The term "light field" simply refers to a pattern of light that has finite magnitude in at least two orthogonal spatial directions, e.g., x and y. The term "complex" is used herein simply to indicate that the light at each point in the light field may be defined by an amplitude and phase value and may therefore be represented by a complex number or set of values. For hologram computation purposes, a complex light field may be a two-dimensional array of complex numbers, where the complex numbers define the light intensity and phase at multiple discrete locations within the light field.
[0014] According to well-known optical principles, the range of angles of light propagating from a display device that can be seen by the eye or other viewing object / system varies with the distance between the display device and the viewing object. For example, at a viewing distance of one meter, only a small range of angles from an LCOS propagates through the eye's pupil to be imaged on the retina at a given eye position. The range of angles of light rays that can propagate from the display device, pass through the eye's pupil, and be imaged on the retina at a given eye position determines the portion of the image that is "seen" by the observer. In other words, not all parts of the image are visible from any one point on the viewing plane (e.g., any one eye position within a viewing window such as an eye motion box).
[0015] In some embodiments, the image perceived by the observer is a virtual image that appears upstream of the display device—i.e., the observer perceives the image as being farther away from them than the display device. Thus, conceptually, the observer can think of the virtual image as being viewed through a "display-device-sized window" that is very small, e.g., 1 cm in diameter, and located at a relatively large distance, e.g., 1 meter. The user also sees the display-sized window through the pupil of their eye, which may also be very small. This results in a narrow field of view, and the range of visible angles is highly dependent on the position of the eyes at any given time.
[0016] A pupil expander addresses the problem of how to expand the range of angles of light rays that could propagate from a display device and pass through the eye's pupil to form an image. Display devices are generally (relatively) small and have (relatively) large projection distances. In some embodiments, the projection distance is at least one order of magnitude—e.g., at least two orders of magnitude—larger than the diameter or width of the display device's entrance pupil and / or aperture (i.e., the size of the pixel array). Embodiments of the present disclosure relate to configurations in which a hologram of an image, rather than the image itself, is propagated to the human eye. In other words, the light received by the observer is modulated according to the hologram of the image. However, other embodiments of the present disclosure may relate to configurations in which an image, rather than a hologram, is propagated to the human eye—for example, so-called indirect viewing, in which light from a holographic reconstruction or "reconstructed image" formed on a screen (or in free space) is propagated to the human eye.
[0017] The use of a pupil expander widens the viewing zone (i.e., the user's eyebox) horizontally, thereby allowing the user to view an image while still allowing some eye movement. As will be appreciated by those skilled in the art, in an imaging system, the viewing zone (the user's eyebox) is the area in which the observer's eyes can perceive an image. The present disclosure relates to non-infinite virtual image distances—i.e., near-field optical virtual images.
[0018] Traditionally, two-dimensional pupil expanders include a one- or greater-dimensional optical waveguide formed using a pair of opposing reflective surfaces, each of which emits light that forms a viewing window, such as an eyebox or eye motion box. Light received from a display device (e.g., spatially modulated light from an LCOS) is replicated by the or each waveguide to increase the field of view (or viewing zone) in at least one dimension. In particular, the waveguides split the amplitude of the incoming light wavefront, generating extra rays or "replicas," thereby expanding the viewing window.
[0019] The display device may have an active or viewing area with a first dimension that may be less than 10 cm, such as less than 5 cm or less than 2 cm. The propagation distance between the display device and the viewing system may be greater than 1 m, such as greater than 1.5 m or greater than 2 m. The light propagation distance in the waveguide may be up to 2 m, such as up to 1.5 m or up to 1 m. The method may be able to receive an image and determine a corresponding hologram of sufficient quality in less than 20 ms, such as less than 15 ms or less than 10 ms.
[0020] In some embodiments, described solely by way of example of a diffractive or holographic light field according to the present disclosure, a hologram is configured to send light into multiple channels, each channel corresponding to a different portion (i.e., subarea) of an image. The hologram may be displayed or otherwise rendered on a display device, such as a spatial light modulator. When displayed on an appropriate display device, the hologram can spatially modulate light that can be converted into an image by a viewing system. The channels formed by the diffractive structures are referred to herein as "hologram channels," simply reflecting that they are channels of light in which image information is encoded by the hologram. The light in each channel is said to be in the hologram domain, rather than the image domain or spatial domain. In some embodiments, the hologram is a Fourier or Fourier transform hologram, and therefore the hologram domain is in the Fourier domain or frequency domain. The hologram may also be a Fresnel or Fresnel transform hologram. The hologram is described herein as sending light into multiple hologram channels, each corresponding to a different image subarea, simply reflecting that the image that can be reconstructed from the hologram has a finite size and can be arbitrarily divided into multiple image subareas. Importantly, the hologram of this embodiment is unique in how it distributes image content when illuminated. Specifically, the hologram divides the image content by angle. That is, because the hologram is two-dimensional, each point on the image is associated with a unique ray angle—or at least a unique set of angles—in the spatially modulated light created by the hologram when illuminated. To be clear, this hologram's behavior is unconventional. The spatially modulated light created by this particular hologram can be arbitrarily divided into multiple hologram channels when illuminated, with each hologram channel defined by a range (in two dimensions) of ray angles. It will be appreciated from the above that any possible hologram channel (i.e., subrange of ray angles) in the spatially modulated light is associated with a respective portion or subarea of the image.That is, all the information needed to reconstruct a portion or sub-area of an image is contained within a sub-range of angles of the spatially modulated light formed from the hologram of the image. When the spatially modulated light is viewed as a whole, it does not necessarily indicate the presence of multiple discrete light channels. However, in some arrangements, multiple spatially separated hologram channels are formed by intentionally leaving the region of the target image from which the hologram is computed blank or empty (i.e., no image content is present).
[0021] However, the hologram can still be identified. For example, if only a contiguous portion or subarea of the spatially modulated light formed by the hologram is reconstructed, only a subarea of the image will be visible. Reconstructing different contiguous portions or subareas of the spatially modulated light will result in different subareas of the image. A further unique feature of this type of hologram is that the cross-sectional shape of any hologram channel substantially corresponds to (i.e., is substantially the same as) the shape of the entrance pupil, at least in the correct plane from which the hologram was calculated, although the dimensions may differ. Each light channel / hologram channel propagates at a different angle or range of angles from the hologram. These are examples of ways to characterize or identify this type of hologram, but other methods may also be used. In summary, the holograms disclosed herein are characterized and identifiable by how the image content is distributed in the light encoded by the hologram. Again, for the avoidance of any doubt, references herein to holograms configured to direct light or angularly split an image into multiple holographic channels are intended to be exemplary only, and the present disclosure applies equally to pupil expansion of any type of holographic light field, as well as any type of diffractive light field.
[0022] The system can be provided in a compact and streamlined physical form, making it suitable for a wide range of real-world applications, including those where space is limited and real estate is at a premium, such as in head-up displays (HUDs) for vehicles and automobiles.
[0023] In accordance with the present disclosure, pupil expansion is provided for diffracted light, which may include a diverging ray bundle. The diffracted light may be output by a display device, such as a pixelated display device, such as a spatial light modulator (SLM), arranged to display a diffractive structure, such as a hologram. The diffracted light field may be defined by a "cone of light." Thus, the magnitude of the diffracted light field (defined on a two-dimensional plane) increases with propagation distance from the corresponding diffractive structure (i.e., the display device).
[0024] The spatial light modulator may be arranged to display a hologram. The diffracted or divergent light may include light encoded in or by the hologram, as opposed to being light of the image or holographic reconstruction. In such embodiments, the pupil expander may be said to replicate the hologram or form at least one replica of the hologram, thus conveying that the light reaching the observer is spatially modulated according to the hologram of the image, rather than the image itself. That is, a diffracted light field is propagated to the observer.
[0025] In some embodiments, two one-dimensional waveguide pupil expanders are provided, each one-dimensional waveguide pupil expander positioned to effectively increase the size of the system's exit pupil by forming multiple replicas or copies of the spatial light modulator's exit pupil (or the light at the exit pupil). An exit pupil may be understood to be the physical area from which light is output by the system. Each waveguide pupil expander may also be said to be positioned to expand the size of the system's exit pupil. Each waveguide pupil expander may also be said to be positioned to expand / increase the size of the eyebox where an observer's eyes are located to see / receive the light output by the system.
[0026] A pupil expander for a head-up display is provided. The head-up display has an eyebox having a first dimension (e.g., a horizontal or x-dimension) and a second dimension (e.g., a vertical or y-dimension). The pupil expander includes a pair of first waveguides arranged to replicate the pupil of the eyebox in the first dimension. Each waveguide is elongated and tapered along its length such that its first / input end is narrower than its second / output end. The waveguides are arranged such that their first / input ends are substantially close to each other and their respective second / output ends are substantially distant from each other.
[0027] Each first waveguide of the pair of first waveguides may include a pair of reflective surfaces. The pair of reflective surfaces may comprise a first surface. At least a portion of the first surface may be substantially reflective. The first surface may comprise an input port at or toward the input end. The pair of reflective surfaces may comprise a second surface. At least a portion of the second surface may be partially reflective-transmissive. The second surface may comprise an output port. The partially reflective-transmissive portion of the second surface may form or comprise the output port. The pair of surfaces may be arranged such that input light is received at the input port. The pair of surfaces may be arranged to provide waveguide for the input light therebetween. The second surface may be arranged such that a replica of the input light is emitted by the second surface, for example, by the partially reflective-transmissive portion. In some embodiments, the first surface may be parallel to the second surface. In other words, the pair of surfaces arranged to provide waveguiding for the input light therebetween may be parallel. This may advantageously mean that the replicas of the input light emitted by the second surface are emitted at the same angle to each other.
[0028] In other words, each first waveguide may comprise a pair of reflective surfaces comprising a first substantially reflective surface and a second partially reflective-transmissive surface arranged to provide waveguiding of the input light therebetween. The pair of reflective surfaces may be parallel.
[0029] Input light to a waveguide pupil expander or replicator, as described herein, may comprise a diffracted light field, e.g., comprising a diverging ray bundle. As a result, the size of the light field increases with propagation distance along the light's propagation path through the waveguide. The diverging ray bundle causes the light field to expand, or one could say its cross-sectional area increases, with propagation distance. Furthermore, as the propagation distance increases along the length of the waveguide from the first / input end to the second / output end, the size of the light field also increases with each "bounce" (i.e., "replica" of the incident beam / pupil). [The cross-sectional area of the light field increases, corresponding to the increasing angle with propagation distance along the length of the waveguide.] To accommodate this expansion in the size of the light field, the inventors have found that when using a single waveguide to provide pupil expansion in the first dimension, the width of each parallel reflective surface of the waveguide (e.g., corresponding to the waveguide "height" in the second dimension) should increase along the length of the waveguide, from the input end to the output end. This ensures that replicas formed at all positions along the length of the waveguide meet the two-dimensional field of view requirement (e.g., 5 degrees), but this can lead to a significant increase in the size / height of the waveguide in the second dimension and thus the overall size / height of the two-dimensional pupil expander, resulting in a too bulky arrangement and therefore taking up too much space for installation requirements.
[0030] Disclosed herein is a pair of first waveguides for providing pupil expansion in a first dimension. The waveguides are elongated and tapered (slanted) along their lengths—which generally correspond to the direction of pupil expansion or replication—so that the first / input end of each waveguide is narrower than its second / output end. The waveguides are arranged so that their first / input ends are substantially close to each other and their second / output ends are substantially far from each other. Because the pupil expansion in the first dimension is provided by a pair of first waveguides instead of a single waveguide, the length of each waveguide is shorter than the length of a single waveguide that provides the same pupil expansion in the first dimension. Therefore, the size / height of the pupil expander in the second dimension can be reduced, providing a more compact arrangement.
[0031] As described above, each first waveguide comprises a pair of surfaces along which input light is guided. These surfaces may be referred to as waveguide surfaces. The width of each of the waveguide surfaces may increase along the length of the respective waveguide. As described above, the length may be defined from the input end to the output end. The width may be a dimension substantially perpendicular to the length. It is the increasing width of the waveguide surfaces that causes the first waveguide to slope. In particular, when the pair of (waveguide) surfaces are parallel (as described above), it may be the increasing width of the waveguide surfaces that causes the first waveguide to have a sloped shape. The width of the pair of (waveguide) surfaces may at least double from the input end to the output end. Input light guided by the pair of (waveguide) surfaces may be incident on each of the pair of surfaces multiple times as the input light is guided from the input end to the output end. The input light may be diverging input light having a light field that increases with propagation distance. The pair of first waveguides may advantageously be arranged such that the increasing width of the pair of (waveguide) surfaces ensures that the size of the light field does not exceed the width of the respective (waveguide) surfaces over the length of the first waveguides. In other words, the tapered shape / width of the pair of (waveguide) surfaces can compensate for the increasing light field of diverging input light.
[0032] Each first waveguide may be in the form of a tilted block or slab. The tilted block or slab may have a pair of opposing parallel surfaces and a pair of opposing non-parallel surfaces. Each of the pair of non-parallel surfaces may be orthogonal to the surfaces of the pair of parallel surfaces. The spacing between the pair of parallel surfaces may be constant along the length of the first waveguide. The spacing between the pair of non-parallel surfaces may increase along the length of each first waveguide from the input port to the output port. The pair of non-parallel surfaces may be sidewalls. The pair of opposing sidewalls of each first waveguide may be non-waveguiding (in other words, the pair of opposing sidewalls may not be positioned to guide input light therebetween). This may result in the width of the pair of (waveguiding) surfaces increasing along the length of each first waveguide from the input end to the output end. The width and / or length of each of the opposing sidewalls may be substantially constant.
[0033] In an embodiment, the waveguides of a pair of first waveguides are arranged to provide pupil expansion in opposite directions in a first dimension (e.g., +x and −x, respectively). The propagation paths of light through the first waveguides may be said to be in opposite directions in the first dimension. Thus, the first waveguides form replicas of the pupil (i.e., pupil expansion or duplication) in opposite directions in the first dimension.
[0034] As described above, the head-up display has an eyebox. This may be a single eyebox. The eyebox may be for receiving a pair of eyes of a user. Each of the pair of first waveguides is arranged to replicate a pupil in a first dimension of the eyebox. In other words, each of the pair of first waveguides is arranged to contribute to an expansion of the (single) eyebox in the first dimension of the eyebox. The pair of first waveguides may be arranged to emit multiple replicas of input light. The multiple replicas may comprise a first subset and a second subset. The first subset of the multiple replicas may be emitted by a first waveguide of the pair of first waveguides. The second subset of the multiple replicas may be emitted by a second first waveguide of the pair of first waveguides. The pair of first waveguides may be arranged such that each of the multiple replicas contributes to the eyebox.
[0035] The (single) eyebox may be a substantially continuous eyebox. As used herein, a (single) eyebox being substantially continuous means that a visual system (such as a pupil of a user's eye) may be positioned substantially anywhere within a (single) continuous portion of a plane defined in space to receive one or more replicas of input light. For example, a first subset of replicas may contribute to a first (e.g., left) portion of the eyebox, and a second subset of replicas may contribute to a second (e.g., right) portion of the eyebox. The first and second portions of the eyebox may be adjacent to or adjacent to each other. The first and second portions of the eyebox may be adjacent to each other. In other words, both first waveguides are positioned to expand the (single, continuous) eyebox of the head-up display in a first dimension. The (single) eyebox may be positioned to include both of the user's eyes.
[0036] Providing a pair of first waveguides, each contributing to the expansion (in a first dimension) of a single eyebox, is unconventional. As described herein, the inventors have discovered that this arrangement allows for the creation of a relatively large, expanded eyebox while maintaining a relatively compact pupil expander. Having a pair of first waveguides each contributing to the expansion of a single eyebox differs from head-mounted devices that direct different output light toward different eyes of a user. Such a head-mounted device may include a first waveguide positioned to output light to the user's left eye and a second waveguide positioned to output light to the user's right eye. This does not result in a single eyebox formed by the light emitted from the two waveguides. Instead, two spatially separated viewing windows, one for the left eye and one for the right eye, may be formed. The arrangement of the first waveguides allows for a relatively much larger (single) eyebox than would be created (or required) in a head-mounted device. For example, a relatively large eyebox can allow substantial movement of the user's (driver's) head relative to the pupil expander while the user's head is maintained within the eyebox, which is not necessary in a head-mounted device where there is no substantial relative movement between the device and the user's head.
[0037] In some embodiments, each waveguide of a pair of first waveguides has substantially the same length. In such an arrangement, each waveguide may be arranged to form approximately half the required number of replicas in the first dimension. As a result, the length of each first waveguide is approximately half the length of a single waveguide arranged to form the same number of replicas in the first dimension. In some examples, the waveguides of a pair of first waveguides are arranged in a substantially symmetrical configuration. This allows the orientation of one first waveguide to be reversed relative to the other first waveguide, while still using the same components for both waveguides of the pair of first waveguides. In some embodiments, the symmetrical configuration may be a V-shaped configuration.
[0038] In an embodiment, the waveguides of the pair of first waveguides are arranged in a substantially planar configuration. The planar configuration also facilitates providing a more compact arrangement. In an embodiment, the substantially planar configuration lies in a plane in which the pupil replica formed by the pair of first waveguides propagates.
[0039] In some embodiments, the waveguides of a pair of first waveguides are arranged in a configuration tilted in the same direction.
[0040] In some arrangements, the first / input ends of a pair of first waveguides overlap in the first dimension. Thus, the array of replicas output by one first waveguide overlaps in the first dimension with the array of replicas output by the other first waveguide. The inventors have found that providing a partial overlap between the first waveguides, such that one or more replicas of the array of replicas formed by the first waveguides overlap in the first dimension, leads to an improved viewing experience.
[0041] A pupil expander is provided that includes a pair of first waveguides, each arranged to replicate a pupil in a first dimension, and the first waveguides are arranged such that an array of replicas formed by one first waveguide overlaps in the first dimension with an array of replicas formed by the other first waveguide.
[0042] In some embodiments, the amount of overlap is less than the size of a single replica in the first dimension. These arrangements may be advantageously used in embodiments in which a first replicator is arranged to magnify or replicate a diffracted light field containing a hologram having angular content or channels, as described herein. In such embodiments, the waveguides of a pair of first waveguides may receive different input light (e.g., conveying different ranges of angular content or channels). In particular, the inventors have unexpectedly discovered that using a pair of first waveguides to form respective arrays of replicas that partially overlap in the first dimension (i.e., the dimension of pupil expansion) also improves the viewing experience.
[0043] In other embodiments, the amount of overlap is equal to or greater than the size of a single replica in the first dimension.
[0044] In some embodiments, the first / input ends of a pair of first waveguides are offset in the second dimension to ensure that the first / input end of one first waveguide does not shadow / obstruct light input into the first / input end of the other first waveguide when the first / input ends overlap in the first dimension. The input ports of each of the first waveguides can be said to be spatially separated in the second dimension, or stacked heightwise.
[0045] In an embodiment, the first pair of waveguides is optically coupled to a second waveguide positioned to expand the pupil in the second dimension of the eyebox. For example, a flat / folding mirror can optically couple a replica output by the first pair of waveguides to the second waveguide.
[0046] In some arrangements, the substantially planar configuration of the pair of first waveguides is substantially parallel to the plane of the second waveguide, e.g., the plane of the second waveguide may correspond to a major face of the second waveguide (i.e., one of its parallel reflective faces).
[0047] In some embodiments, the input port to the second waveguide comprises a transflective element, such as a transflective surface or surface coating. Optionally, the reflectivity of the transflective element may be graded in the second dimension. Using a partially reflective / partially transmissive input port for the second waveguide can efficiently incouple and trap all rays of a diverging ray bundle (including overlapping replicas of the diverging light field) incident on the input port. This type of input port is therefore synergistic with embodiments comprising a pair of first waveguides that overlap in the first dimension so that one or more overlapping replicas are formed. Furthermore, because the diverging input light field propagates a shorter distance along each waveguide of a pair of first waveguides than with a single first waveguide, the required input port for the second waveguide is correspondingly shorter (in the second dimension, i.e., the dimension of the pupil expansion of the second waveguide). Using a short transflective input port for the second waveguide can reduce the associated loss of optical efficiency.
[0048] In some embodiments, the waveguides of a pair of first waveguides are tilted to reduce the size / height of the substantially planar configuration in the second dimension, which can further improve the incoupling efficiency into the second waveguide. As one skilled in the art will appreciate, the corresponding tilt of the replica formed and propagated to the eyebox can be compensated for by applying a correction to the image content of the diffracted light field or by applying an opposite tilt to the orientation of the display system when installed in the installation location.
[0049] In an embodiment, each first waveguide comprises a first surface that is substantially reflective and a second / opposing surface that is partially reflective-transmissive to provide a waveguide therebetween.
[0050] In some embodiments, a first end of one first waveguide comprises an input port for a first display system, and a first end of the other first waveguide comprises an input port for a second display system. In some examples, a pair of first waveguides may be used in a binocular display system including a first display system for a left eye and a second display system for a right eye. In some arrangements, one first waveguide is positioned to expand an exit pupil of the first display system in a first dimension, and the other first waveguide is positioned to expand an exit pupil of the second display system in the first dimension.
[0051] In this disclosure, the term “replica” is used simply to reflect the division of spatially modulated light so that a complex light field is directed along multiple different optical paths. The term “replica” is used to refer to each occurrence or instance of a complex light field after a replication event, such as partial reflection / transmission by a pupil expander. Each replica travels a different optical path. Some embodiments of the present disclosure relate to the propagation of light encoded with a hologram rather than an image, i.e., light that is spatially modulated with a hologram of an image rather than the image itself. Those skilled in the art of holography will understand that the complex light field associated with the propagation of holographically encoded light varies with propagation distance. The use of the term “replica” herein is independent of propagation distance; therefore, two branches or paths of light associated with a replication event are referred to as “replicas” of each other, even if the branches have different lengths, such that the complex light field evolves differently along each path. That is, two complex light fields are considered “replicas” according to the present disclosure, even if they are associated with different propagation distances, provided that they result from the same replication event or series of replication events.
[0052] According to the present disclosure, a "diffracted light field" is a light field formed by diffraction. The diffracted light field may be formed by illuminating a corresponding diffraction pattern. According to the present disclosure, an example of a diffraction pattern is a hologram, and an example of a diffracted light field is a holographic light field or a light field that forms a holographic reconstruction of an image. The holographic light field forms a (holographic) reconstruction of an image on a reconstruction plane. The holographic light field propagating from a hologram to a reconstruction plane can be said to contain light encoded in the hologram or light from the hologram region. The diffracted light field is characterized by a diffraction angle that is determined by the smallest feature size of the diffracting structures and the wavelength of the light (of the diffracted light field). According to the present disclosure, a "diffracted light field" can also be said to be a light field that forms a reconstruction on a plane spatially separated from a corresponding diffracting structure. An optical system for propagating the diffracted light field from a diffracting structure to an observer is disclosed herein. The diffracted light field may form an image.
[0053] The term "hologram" refers to a recording containing amplitude or phase information about an object, or some combination thereof. The term "holographic reconstruction" refers to an optical reconstruction of an object formed by illuminating a hologram. The system disclosed herein is described as a "holographic projector" because the holographic reconstruction is a real image and spatially separated from the hologram. The term "reconstruction field" refers to the two-dimensional area where the holographic reconstruction is formed and perfectly focused. When a hologram is displayed on a spatial light modulator containing pixels, the reconstruction field is repeated in multiple diffraction orders, each of which is a replica of the zeroth reconstruction field. The zeroth reconstruction field is the brightest reconstruction field and therefore typically corresponds to the preferred or first reconstruction field. Unless otherwise noted, the term "reconstruction field" should be interpreted as referring to the zeroth reconstruction plane. The term "reconstruction plane" refers to a plane in space that contains all reconstruction fields. The terms "image," "reconstructed image," and "image region" refer to the area of the reconstruction field illuminated by light that forms the holographic reconstruction. In some embodiments, an "image" may include individual spots which may be referred to as "image spots" or, for convenience, "image pixels."
[0054] The terms "encoding," "writing," or "addressing" are used to describe the process of providing a plurality of pixels of an SLM with a respective plurality of control values that respectively determine the modulation level of each pixel. The pixels of the SLM are said to be configured to "display" a light modulation distribution in response to receiving the plurality of control values. Thus, the SLM "displays" a hologram, and the hologram can be thought of as an array of light modulation values or levels.
[0055] It has been found that holographic reconstructions of acceptable quality can be formed from "holograms" that contain only phase information related to the Fourier transform of the original object. Such holographic recordings are sometimes referred to as phase-only holograms. While the embodiments relate to phase-only holograms, the present disclosure is equally applicable to amplitude-only holography.
[0056] The present disclosure is equally applicable to forming a holographic reconstruction using amplitude and phase information associated with the Fourier transform of the original object. In some embodiments, this is achieved by complex modulation using a so-called full complex hologram, which contains both amplitude and phase information associated with the original object. Such a hologram may be referred to as a full complex hologram because the value (gray level) assigned to each pixel of the hologram has an amplitude component and a phase component. The value (gray level) assigned to each pixel may be represented as a complex number having both an amplitude component and a phase component. In some embodiments, a full complex computer-generated hologram is calculated.
[0057] Reference may be made to the phase value, phase component, phase information, or simply phase of a pixel of a computer-generated hologram or spatial light modulator as shorthand for "phase delay." That is, any phase value described is actually a number (e.g., ranging from 0 to 2π) representing the amount of phase delay provided by that pixel. For example, a spatial light modulator pixel described as having a phase value of π / 2 changes the phase of received light by π / 2 radians. In some embodiments, each pixel of a spatial light modulator is operable at one of multiple possible modulation values (e.g., phase delay values). The term "gray level" may also be used to refer to multiple available modulation levels. For example, the term "gray level" may be used for convenience to refer to multiple available phase levels in a phase-only modulator, even if the different phase levels do not provide different shades of gray. The term "gray level" may also be used for convenience to refer to multiple available complex modulation levels in a complex modulator.
[0058] Thus, a hologram includes an array of gray levels, i.e., an array of optical modulation values, such as an array of phase delay values or complex modulation values. A hologram is also considered a diffraction pattern because it is a pattern that, when displayed on a spatial light modulator, undergoes diffraction when illuminated with light of a wavelength comparable to, and typically shorter than, the pixel pitch of the spatial light modulator. This specification refers to combining a hologram with other diffraction patterns, such as diffraction patterns that function as lenses or diffraction gratings. For example, a hologram may be combined with a diffraction pattern that functions as a diffraction grating to shift the reconstruction field to the reconstruction plane, or a diffraction pattern that functions as a lens to focus the holographic reconstruction at the reconstruction plane of near-field light.
[0059] Although various embodiments and groups of embodiments may be disclosed separately in the following detailed description, any feature of any embodiment or group of embodiments may be combined with any other feature or combination of features of any embodiment or group of embodiments, i.e., all possible combinations and permutations of features disclosed in this disclosure are contemplated.
[0060] In this disclosure, the term "substantially" when applied to a structural unit of a device may be interpreted to mean that the structural unit is produced within the technical limits of what is technically acceptable for the method used to produce it. [Brief explanation of the drawings]
[0061] Particular embodiments will now be described, by way of example only, with reference to the following figures: [Figure 1] FIG. 1 is a schematic diagram showing a reflective SLM producing a holographic reconstruction on a screen. [Figure 2] FIG. 1 is a diagram showing an image for projection consisting of eight image regions / components V1 to V8. [Figure 3] FIG. 1 shows a hologram displayed on an LCOS that directs light to multiple discrete regions. [Figure 4] FIG. 4 illustrates a system including a display device that displays the hologram calculated as shown in FIGS. 2 and 3. [Figure 5A] FIG. 1 is a perspective view of a system including two replicators arranged to expand a light beam in two dimensions. [Figure 5B] FIG. 1 is a perspective view of another system including two replicators arranged to expand a light beam in two dimensions. [Figure 6] FIG. 1 is a side view of an elongated waveguide replicator for expanding divergent input light in a first dimension. [Figure 7] FIG. 1 is a side view of a replicator including a pair of elongated waveguides arranged to expand divergent input light in a first dimension, according to an embodiment. [Figure 8]FIG. 10 is a side view of a replicator including a pair of elongated waveguides arranged to expand divergent input light in a first dimension, according to another embodiment. [Figure 9] FIG. 9 is a top view of the replicator of FIG. 8. [Figure 10A] 9A and 9B show examples of one-dimensional arrays of replicas formed by each of a pair of elongated waveguides in the embodiment of FIG. 8. [Figure 10B] FIG. 10B shows an overlapping replica of the sequence of FIG. 10A. [Figure 11] 9 is a perspective view of the output ends of a pair of elongated waveguides of the embodiment of FIG. 8, illustrating how the output light can be coupled into a second waveguide for expansion in a second dimension. [Figure 12] 12 shows an example of a two-dimensional array of replicas formed by the second waveguide of FIG. 11 as viewed in the eyebox of a display system.
[0062] The same reference numbers are used throughout the drawings to refer to the same or similar parts. DETAILED DESCRIPTION OF THE INVENTION
[0063] The present invention is not limited to the embodiments described below, but extends to the full scope of the appended claims, i.e., the present invention may be embodied in various forms and should not be construed as being limited to the described embodiments, which are presented for illustrative purposes.
[0064] Terms in the singular may also include the plural unless specifically stated otherwise.
[0065] A structure described as being formed on top / bottom of another structure, or above / below other structures, should be interpreted to include cases where the structures contact each other and also where a third structure is disposed between them.
[0066] In describing temporal relationships, for example, when the temporal order of events is described as "after," "succeeding," "next," "before," etc., the present disclosure should be construed to include sequential and non-sequential events unless otherwise specified. For example, unless words such as "just," "immediately," or "immediately" are used, the description should be construed to include non-sequential events.
[0067] Terms such as "first," "second," and the like may be used herein to describe various elements, but these elements are not limited by these terms. These terms are used only to distinguish one element from another. For example, a first element could be termed a second element, and similarly, a second element could be termed a first element, without departing from the scope of the appended claims.
[0068] In this disclosure, the term "substantially" when applied to a structural unit of a device may be interpreted to mean that the structural unit is produced within the technical limits of the method used to produce it.
[0069] Features of the various embodiments may be partially or wholly combined or combined with one another and may interoperate with one another in various ways. Some embodiments may be performed independently of one another or may be performed together in an interdependent manner.
[0070] optical configuration FIG. 1 illustrates an embodiment in which a computer-generated hologram is encoded on a single spatial light modulator. The computer-generated hologram is the Fourier transform of the object for reconstruction. Thus, the hologram can be said to be a Fourier domain, frequency domain, or spectral domain representation of the object. In this embodiment, the spatial light modulator is a reflective liquid crystal on silicon (LCOS) device. The hologram is encoded on the spatial light modulator, and the holographic reconstruction is formed on a receiving surface, such as a screen or diffuser, in the reconstructed field.
[0071] A light source 110, e.g., a laser or laser diode, is positioned to illuminate the SLM 140 through a collimating lens 111. The collimating lens directs a generally flat wavefront of light into the SLM. In FIG. 1, the wavefront direction is off-normal (e.g., 2 or 3 degrees away from a true right angle to the plane of the transparent layer). However, in other embodiments, a generally flat wavefront is provided at normal incidence, and a beam splitter arrangement is used to separate the input and output optical paths. In the embodiment shown in FIG. 1, the arrangement is such that light from the light source is reflected from the mirrored back surface of the SLM and interacts with the light modulating layer to form an exit wavefront 112. The exit wavefront 112 is applied to an optical system including a Fourier transform lens 120, which focuses it onto a screen 125. More specifically, the Fourier transform lens 120 receives the beam of modulated light from the SLM 140 and performs a frequency-space transformation to generate a holographic reconstruction on the screen 125.
[0072] Specifically, in this type of holography, each pixel in the hologram contributes to the overall reconstruction: there is no one-to-one correlation between a particular point on the reconstructed field (or image pixel) and a particular light-modulating element (or hologram pixel). In other words, the modulated light leaving the light-modulating layer is dispersed across the reconstructed field.
[0073] In these embodiments, the position of the holographic reconstruction in space is determined by the refractive (focusing) power of the Fourier transform lens. In the embodiment shown in FIG. 1, the Fourier transform lens is a physical lens. That is, the Fourier transform lens is an optical Fourier transform lens, and the Fourier transform is performed optically. Any lens can function as a Fourier transform lens, but the performance of the lens limits the accuracy of the Fourier transform it performs. Those skilled in the art understand how to use lenses to perform optical Fourier transforms.
[0074] Hologram Calculation In some embodiments, the computer-generated hologram is a Fourier transform hologram, or simply a Fourier hologram or Fourier-based hologram, in which an image is reconstructed in the far field by utilizing the Fourier transform properties of a positive lens. A Fourier hologram is calculated by Fourier transforming the desired light field in the reconstruction plane back to the lens plane. A computer-generated Fourier hologram may be calculated using a Fourier transform. The embodiments relate, by way of example, to Fourier holography and Gerchberg-Saxton-type algorithms. The present disclosure is equally applicable to Fresnel holography and Fresnel holograms, which may be calculated in a similar manner. In some embodiments, the hologram is a phase hologram or a phase-only hologram. However, the present disclosure is also applicable to holograms calculated by other techniques, such as those based on point cloud methods. UK Patent Application GB2112213.0, filed August 26, 2021, which is incorporated herein by reference, discloses an exemplary hologram calculation method that can be combined with the present disclosure.
[0075] In some embodiments, a real-time engine is provided that is configured to receive image data and use an algorithm to compute a hologram in real time. In some embodiments, the image data is a video comprising a series of image frames. In other embodiments, the hologram is pre-computed, stored in computer memory, and recalled as needed for display on the SLM. That is, in some embodiments, a repository of pre-defined holograms is provided.
[0076] Light Modulation The display system includes a display device defining an exit pupil of the display system. The display device is a spatial light modulator. The spatial light modulator may be a phase modulator. The display device may be a liquid crystal on silicon, "LCOS," spatial light modulator.
[0077] Light Channeling The optical systems disclosed herein are also applicable to pupil expansion with any diffracted light field. In some embodiments, the diffracted light field is a holographic light field, i.e., a complex light field that is spatially modulated according to a hologram of the image, rather than the image itself. In some embodiments, the hologram is a special type of hologram that angularly splits / channels the image content. This type of hologram is described further herein as merely one example of a diffracted light field compatible with the present disclosure. Other types of holograms can be used in combination with the display systems and light engines disclosed herein.
[0078] Display systems and methods including waveguide pupil expanders are described below. As is well known to those skilled in the art, a waveguide can be configured as a “pupil expander” because it can be used to increase the area where light from a relatively small light emitter, such as a relatively small SLM or other pixelated display device as used in the arrangements described herein, can be viewed by (or with) a human observer or other viewing system located at a greater distance from the light emitter, such as a relatively large distance. The waveguide accomplishes this by increasing the number of transmission points through which light is emitted toward the observer. As a result, the light can be viewed from multiple different observer positions, and, for example, an observer can move their head, and therefore their line of sight, while still being able to see the light from the light emitter. That is, the waveguide pupil expander can expand the observer’s “eyebox” or “eye motion box.” This has many useful use cases, including, but not limited to, head-up displays, such as automotive head-up displays.
[0079] The display systems described herein may be configured to direct light, such as a diffracted light field, through a waveguide pupil expander to provide pupil expansion in at least one dimension, e.g., two dimensions. The diffracted light field may include light output by a spatial light modulator (SLM), such as an LCOS SLM. For example, the diffracted light field may include light encoded by a hologram displayed by the SLM. For example, the diffracted light field may include light of a holographically reconstructed image corresponding to the hologram displayed by the SLM. The hologram may include, but is not limited to, a computer-generated hologram (CGH), such as a point cloud hologram, a Fresnel hologram, or a Fourier hologram. The hologram is sometimes referred to as a "diffractive structure" or a "modulation pattern." The SLM or other display device may be configured to display a diffractive pattern (or modulation pattern) including a hologram and one or more other elements, such as a software lens or a diffraction grating, in a manner well known to those skilled in the art.
[0080] A hologram may be calculated to provide channeling of a diffracted light field. This is described in detail in GB 2101666.2, GB 2101667.0, and GB 211213.0, all of which are incorporated herein by reference. In general terms, a hologram may be calculated to correspond to an image to be holographically reconstructed. The image to which the hologram corresponds is sometimes referred to as the "input image" or "target image." A hologram may be calculated to form a light field (output by the SLM) consisting of cones of spatially modulated light when displayed on an SLM and appropriately illuminated. In some embodiments, the cones have multiple contiguous optical channels of spatially modulated light corresponding to respective contiguous regions of the image. However, the present disclosure is not limited to this type of hologram.
[0081] Although reference is made herein to a "hologram" or "computer-generated hologram (CGH)," it will be understood that the SLM may be configured to dynamically display multiple different holograms, either in succession or sequence, and the systems and methods described herein are applicable to the dynamic display of multiple different holograms.
[0082] 2 and 3 show an example of the type of hologram that may be displayed on a display device such as an SLM, which may be used in combination with the pupil expanders disclosed herein, but this example should not be considered limiting with respect to the present disclosure.
[0083] FIG. 2 illustrates an image 252 for projection, consisting of eight image regions / components, V1 through V8. FIG. 2 shows eight image components only as an example; image 252 can be divided into any number of components. FIG. 2 also illustrates an encoded light pattern 254 (i.e., a hologram) from which image 252 can be reconstructed, for example, when transformed by the lenses of an appropriate viewing system. Encoded light pattern 254 consists of first through eighth sub-holograms or components H1 through H8, corresponding to the first through eighth image components / regions V1 through V8. FIG. 2 further illustrates how a hologram can resolve image content by angle. Thus, a hologram may be characterized by the light channeling it performs. This is illustrated in FIG. 3. Specifically, the hologram in this example directs light into multiple discrete regions. The discrete regions are disk-shaped in the illustrated example, but other shapes are also contemplated. The optimum disk size and shape may be related to the size and shape of the entrance pupil of the viewing system after propagation through the waveguide.
[0084] FIG. 4 illustrates a system 400 that includes a display device for displaying the holograms calculated as shown in FIGS.
[0085] System 400 comprises a display device, in this arrangement, comprising an LCOS 402. LCOS 402 is arranged to display a modulation pattern (or "diffraction pattern") comprising a hologram and to project holographically encoded light towards an eye 405, which comprises a pupil acting as an aperture 404, a lens 409, and a retina (not shown) acting as a viewing surface. A light source (not shown) is arranged to illuminate LCOS 402. Lens 409 of eye 405 performs the conversion of the hologram to an image. The light source may be of any suitable type, and may comprise, for example, a laser light source.
[0086] Vision system 400 further comprises a waveguide 408 disposed between LCOS 402 and eye 405. The presence of waveguide 408 allows the eye to receive all angular content from LCOS 402, even at relatively large projection distances as shown. Waveguide 408 acts as a pupil expander in a well-known manner and will therefore only be briefly described herein.
[0087] Briefly, the waveguide 408 shown in FIG. 4 comprises a substantially elongated structure. In this example, the waveguide 408 comprises an optical slab of refractive material, although other types of waveguides are well known and can be used. The waveguide 408 is positioned to intersect the cone of light (i.e., the diffracted light field) projected from the LCOS 402, e.g., at an oblique angle. In this example, the size, position, and orientation of the waveguide 408 are configured so that light from each of eight ray bundles within the cone of light enters the waveguide 408. Light from the cone of light enters the waveguide 408 through its first planar surface (closest to the LCOS 402) and is guided at least partially along the length of the waveguide 408 before emitting through its second planar surface (closest to the eye) substantially opposite the first surface. As will be appreciated, the second planar surface is partially reflective and partially transmissive. In other words, as each ray of light travels within the waveguide 408 from a first planar surface and strikes a second planar surface, some of the light is transmitted out of the waveguide 408, and some is reflected off the second planar surface and back toward the first planar surface. The first planar surface is reflective, so all light striking it from within the waveguide 408 is reflected toward the second planar surface. Thus, some of the light may simply refract between the two planar surfaces of the waveguide 408 before being transmitted, while other light may reflect and therefore undergo one or more reflections (or "bounces") between the planar surfaces of the waveguide 408 before being transmitted.
[0088] FIG. 4 illustrates nine "bounce" points, B0 through B8, along the length of waveguide 408. While light for all points (V1 through V8) of the image as shown in FIG. 2 is transmitted from the waveguide at each "bounce" from the second planar surface of waveguide 408, only light from a certain angular portion of the image (e.g., one light from V1 through V8) has a trajectory that allows it to reach eye 405 from each respective "bounce" point, B0 through B8. Furthermore, light from different angular portions of the image, V1 through V8, reaches eye 405 from each respective "bounce" point. Thus, each angular channel of encoded light reaches the eye only once from waveguide 408 in the example of FIG. 4.
[0089] The waveguide 408 forms multiple replicas of the hologram at respective "bounce" points B1-B8 along its length, corresponding to the direction of pupil expansion. As shown in FIG. 4, the multiple replicas may be linearly extrapolated to corresponding multiple replica or virtual display devices 402'. This corresponds to "unfolding" the light path within the waveguide, extrapolating the replica light rays to a "virtual plane" without internal reflection within the waveguide. Thus, the light of the expanded exit pupil can be considered to emanate from a virtual plane (also referred to herein as an "expanded modulator") comprising the display device 402 and the replica display device 402'.
[0090] The methods and arrangements described above can be implemented in a variety of different applications and viewing systems, for example, they may be implemented in a head- or helmet-mounted device (HMD), such as a head-up display (HUD) or an augmented reality (AR) HMD.
[0091] Although this specification has generally discussed virtual images, where the eye must transform the modulated light received to form the perceived image, the methods and arrangements described herein can be applied to real images.
[0092] 2D pupil expansion While the arrangement shown in Figure 4 includes a single waveguide that provides pupil expansion in one dimension, pupil expansion can be provided in more than one dimension, such as two dimensions. Additionally, while the example of Figure 4 uses holograms calculated to form channels of light that each correspond to a different portion of the image, this disclosure and the systems described below are not limited to such hologram types.
[0093] FIG. 5A is a perspective view of a system 500 that includes two replicators 504, 506 arranged to expand a light beam 502 in two dimensions.
[0094] In the system 500 of FIG. 5A, the first replicator 504 comprises a first pair of surfaces stacked parallel to one another and arranged to provide replication or pupil expansion in a manner similar to the waveguide 408 of FIG. 4. The first pair of surfaces are similar (possibly identical) in size and shape to one another and are substantially elongated in one direction. A collimated light beam 502 is directed to enter the first replicator 504. As is well known to those skilled in the art, through a process of internal reflection between the two surfaces and partial transmission of light from each of multiple output points on one of the surfaces (the top surface as shown in FIG. 5A), the light of the light beam 502 is replicated in a first direction along the length of the first replicator 504. In this manner, a first replica light beam 508 is projected from the first replicator 504 toward the second replicator 506.
[0095] The second replicator 506 comprises a second pair of surfaces stacked parallel to one another and positioned to receive each of the collimated light beams of the first plurality of light beams 508 and to provide replication, or pupil expansion, by expanding each of the light beams in a second direction substantially perpendicular to the first direction. The first pair of surfaces have similar (possibly identical) sizes and shapes to one another and are substantially rectangular. The rectangular shape is applied to the second replicator such that it has a length along a first direction to receive the first plurality of light beams 508 and a length along a second, orthogonal direction to provide replication in the second direction. Through a process of internal reflection between the two surfaces and partial transmission of light from each of a plurality of output points on one of the surfaces (the top surface, as shown in FIG. 5A ), light from each light beam in the first plurality of light beams 508 is replicated in the second direction. Thus, second replicator 506 emits second plurality of light beams 510, which include replicas of incident light beam 502 along each of the first and second directions, and second plurality of light beams 510 can be considered to constitute a two-dimensional grid or array of replica light beams.
[0096] 5A combine to provide a two-dimensional replicator (or "two-dimensional pupil expander"), whereby a replica light beam 510 may be emitted along a light path to an extended eyebox of a display system such as a head-up display.
[0097] In the system of Figure 5A, the first replicator 504 is a waveguide comprising a pair of elongated rectangular reflective surfaces stacked parallel to one another, and similarly, the second replicator 506 is a waveguide comprising a pair of rectangular reflective surfaces stacked parallel to one another. In other systems, the first replicator may be a solid elongated rectangular waveguide and the second replicator may be a solid planar rectangular waveguide, each comprising a solid optically transparent material such as glass. In this case, the pair of parallel reflective surfaces is formed by a pair of opposing major sidewalls, optionally including respective reflective and reflective-transmissive surface coatings known to those skilled in the art.
[0098] FIG. 5B is a perspective view of a system 500 including two replicators 520, 540 arranged to replicate a light beam 522 in two dimensions, the first replicator being a solid, elongated waveguide 520 and the second replicator being a solid, planar waveguide 540.
[0099] In the system of FIG. 5B, the first replicator / waveguide 520 is positioned so that its pair of elongated, parallel reflective surfaces 524a, 524b are perpendicular to the plane of the second replicator / waveguide 540. Accordingly, the system includes an optical coupler positioned to couple light from the output port of the first replicator 520 to the input port of the second replicator 540. In the illustrated arrangement, the optical coupler is a planar / folding mirror 530 positioned to fold and rotate the optical path of the light to achieve the required optical coupling from the first replicator to the second replicator. As shown in FIG. 5B, the mirror 530 comprises a one-dimensional array of replicas extending in the first dimension and is positioned to receive light from the output port / reflective-transmissive surface 524a of the first replicator / waveguide 520. Mirror 530 is tilted to direct the received light along its length in the second dimension at an angle that provides waveguiding and replication to an input port on the (fully) reflective surface of second replicator 540. Mirror 530 is one example of an optical element capable of redirecting light in the manner shown, and it will be understood that one or more other elements may be used instead to perform this task.
[0100] In the illustrated arrangement, the (partially) reflective-transmissive surface 524a of the first replicator 520 is adjacent to the input port of the first replicator / waveguide 520, which receives the input beam 522 at an angle to provide waveguiding and replication along its length in the first dimension. Thus, the input port of the first replicator / waveguide 520 is located in the same plane as the reflective-transmissive surface 524a at its input end. Those skilled in the art will appreciate that the input port of the first replicator / waveguide 520 may be located in any other suitable location.
[0101] 5B can provide first replicator 520 and mirror 530 as part of a first, relatively thin layer in a plane in the first and third dimensions (illustrated as the x-z plane). In particular, the size or "height" of the first planar layer—in which first replicator 520 is located—in the second dimension (illustrated as the y-dimension) is reduced. Mirror 530 is configured to direct light away from the first layer / surface (i.e., "first planar layer") in which first replicator 520 is located and toward a second layer / surface (i.e., "second planar layer") in which second replicator 540 is located, located above and substantially parallel to the first layer / surface. Thus, the overall size or "height" of a system with first and second replicators 520, 540 and mirror 530 located in first and second planar layers stacked in the first and third dimensions (illustrated as the xz planes) is compact in the second dimension (illustrated as the y dimension). Those skilled in the art will appreciate that many variations on the arrangement of Figure 5B for implementing the present disclosure are possible and contemplated.
[0102] Pupil dilation in one dimension for diverging light In some implementations, the input light to the first replicator is divergent. For example, as described herein, the input light may include a diffracted light field—e.g., corresponding to a hologram—consisting of diverging bundles of rays. Thus, as the light propagates along the length of the waveguide, the magnitude of the light field increases with distance.
[0103] FIG. 6 is a side view of an example waveguide 600 forming a first replicator, showing the shape of one of its pair of parallel reflective surfaces, such as a partially reflective transmissive surface that forms an output port. One skilled in the art would understand that the other reflective surfaces of waveguide 600 have the same shape. In the example waveguide 600, the width of the reflective surface in the second dimension (illustrated as the y-dimension) varies along the length / elongation of waveguide 600, which extends in the first dimension (illustrated as the x-dimension) of pupil expansion. In particular, the width of the reflective surface increases from first / input end 601 to second / output end 602, as indicated by arrow 610, to accommodate the increasing size of the divergent light field along the length of waveguide 600 (in the second dimension, illustrated as the y-dimension). In the illustrated example, waveguide 600 is tapered along its length such that its first / input end 601 is narrower than its second / output end 602. The width of the waveguide may be said to taper outward along its length, from its input end 601 to its output end 602. Thus, in embodiments in which the waveguide 600 is a solid, elongated waveguide, the spacing between a pair of opposing non-reflecting / non-waveguiding sidewalls increases along the length of the waveguide 600 in a manner that tapers from a minimum size / thickness at its first / input end to a maximum size / thickness 620 in a second dimension (illustrated as the y-dimension) at its second / output end 602.
[0104] In some implementations, the amount of pupil expansion / replication required for the first replicator requires a relatively long waveguide in the elongation direction (i.e., the first dimension of pupil expansion). As one skilled in the art will appreciate, input light to the first replicator (and each of the output replicas) substantially propagates in a third direction orthogonal to the first and second dimensions. In some configurations, the first replicator is positioned at an acute angle for waveguiding and replica formation between its pair of parallel reflective surfaces. For example, in the configuration shown in FIG. 5A, the first replicator 504 is tilted at an acute angle relative to the plane of the second replicator 506 in the first and third dimensions, which can cause a relatively long waveguide to occupy significantly more space in the second dimension compared to a non-tilted configuration. As a result, the space required for the waveguide increases as the waveguide length increases. Furthermore, in some arrangements, the angled geometry of the parallel reflective surfaces for propagating the diverging input light may further increase the space required for the waveguide in the second dimension, further increasing the overall occupied volume. Thus, in some implementations, the replicator may be too bulky to fit within the space available for the display system, such as under the dashboard of a car in an automotive head-up display implementation.
[0105] Figure 7 is a side view of a first replicator arranged to provide pupil expansion in a first dimension, comprising a pair of first waveguides 700, 700', according to an embodiment. Similar to the side view of Figure 6, Figure 7 illustrates the shape of one of a pair of parallel reflective surfaces, such as a (partially) reflective-transmissive surface, that forms the output port of each of the waveguides 700, 700'. The waveguides 700, 700' may be solid, elongated waveguides, as described above.
[0106] Similar to the waveguide 600 of FIG. 6, the parallel reflective surfaces have a sloped shape for propagating diverging input light. Thus, as shown in FIG. 7, each first waveguide 700, 700′ is elongated and sloped along its length so that its first input end 701, 701′ is narrower than its second / output end 702, 702′. The waveguides 700, 700′ are arranged so that their first input ends 701, 701′ are substantially proximal (or adjacent) to one another, i.e., centrally located, and their second / output ends 702, 702′ are substantially distal (or remote) from one another. Each first waveguide 700, 700′ is arranged to provide pupil expansion / replication of the input beam in a first dimension (illustrated as the x-dimension) by forming a replica along its length from its input / proximal end 701, 701′ to its output / distal end 702, 702′. Thus, the first waveguides 700, 700' are arranged to propagate the input light beam in opposite directions in the first dimension, as indicated by arrows 710, 710', thus providing pupil expansion / replication. Because the input / proximal ends 701, 701' of both waveguides 700, 700' are centered, the illustrated arrangement has the advantage that any residual light at the output ends 702, 702' of the waveguides 700, 700' can be filtered out at the end of the replicator. For example, to avoid undesired reflections of stray light that may enter the field of view of the display system, the housing at the end of the replicator can be arranged to absorb light.
[0107] In the illustrated example, each first waveguide 700, 700′ has substantially the same length and is therefore arranged to form approximately half the required number of replicas in the first dimension (i.e., to provide half the amount of pupil widening / duplication). Those skilled in the art will understand that other arrangements with waveguides of different lengths are possible and are contemplated.
[0108] The first waveguides 700, 700' are arranged in a symmetrical configuration about an axis of symmetry 780 extending in the third dimension through their centers, i.e., between their respective input ends 701, 701'. In implementation, the pair of first waveguides 700, 700' may comprise solid elongated waveguides, as described above. Thus, in practice, the first waveguides 700, 700' may be identical, and thus each waveguide 700, 700' may comprise the same custom-made or off-the-shelf optical component, such as a faithful elongated waveguide of the same shape, size, and material, but arranged in a mirrored orientation relative to each other (e.g., about the axis of symmetry 780). Because each waveguide 700, 700' has a reduced length compared to the single waveguide of FIG. 6, the maximum size / thickness in the second dimension (illustrated as the y-dimension) at its output end 702, 702' is similarly reduced.
[0109] The first / input ends 701, 701′ of the first waveguides 700, 700′ overlap one another in a first dimension (illustrated as the x-dimension), causing the one-dimensional arrays of replicas formed to partially overlap one another, as described further below with reference to FIGS. 10A and 10B . Thus, to allow separate input light beams to be received through the input ports at the respective first / input ends 701, 701′, the first waveguides 700, 700′ are staggered relative to one another in a second dimension (illustrated as the y-dimension) at their first / input ends 701, 701′. The input ends 701, 701′ can be said to be stacked in the second dimension (in “height”). This staggering or stacking means that the maximum size / height 720 of the first replicators in the second dimension is greater than the maximum size / thickness of the output ends 702, 702′ of the waveguides 700, 700′. Notably, the first waveguides 700, 700′ are staggered at their proximal first / input ends 701, 701′, where the varying size / thickness in the second dimension is minimal. However, because a corresponding staggering is not required at their distal second / output ends 702, 702′, the first waveguides 700, 700′ overlap in the second dimension by tilting (i.e., increasing size / thickness in the second dimension) such that the maximum size / height 720 of the first replicator is reduced.
[0110] In the illustrated embodiment, the pair of first waveguides 700, 700′ of the first replicator are arranged substantially planar. In particular, each waveguide of the pair of first waveguides 700, 700′ lies within a plane in the first and third dimensions (illustrated as the x and z dimensions) such that the direction of pupil expansion by each first waveguide 700, 700′ is precisely in the first dimension, as indicated by arrows 710, 710′. Thus, the maximum size / height 720 of the first replicator in the second dimension (illustrated as the y dimension) represents the “height” of the substantially planar configuration of the first replicator—between the dotted lines in FIG. 7—which contributes to the overall “height” of the two-dimensional pupil expander in the second dimension, as described further below. The substantially planar configuration can occupy (or be located within) a first planar layer, as described above, that extends in first and third dimensions (illustrated as the x- and z-dimensions) and has a height or thickness in a second dimension (illustrated as the y-dimension). Notably, the inner surface 785 of the symmetric configuration—an imaginary plane in the first and third dimensions (illustrated as the x-z plane) that passes through the axis of symmetry 780—of the pair of first waveguides 700, 700′ is located at half of its maximum size / height 720 in the second dimension.
[0111] FIG. 8 is a side view of a first replicator arranged to provide pupil expansion in a first dimension comprising a pair of first waveguides 800, 800′ according to another embodiment. The first waveguides 800, 800′ are substantially similar to the pair of first waveguides 700, 700′ of the embodiment of FIG. 7 and are similarly arranged to provide pupil expansion in opposite directions in the first dimension (illustrated as the x-dimension), as indicated by arrows 810, 810′. Therefore, the arrangement of FIG. 8 will not be described in detail herein. However, in contrast to the embodiment of FIG. 7, the pair of first waveguides 800, 800′ are tilted to further reduce the maximum size / height 820 of the first replicator in the second dimension (illustrated as the y-dimension). In particular, an inner surface 885—an imaginary plane passing through the axis of symmetry of the symmetrical configuration of the pair of first waveguides 800, 800′—is tilted at an acute angle relative to the first dimension. In particular, the symmetric configuration shown in FIG. 7—having a maximum size / height 720 in the second dimension, as shown by the dotted line in FIG. 7—is tilted clockwise about its axis of symmetry 880—a central axis extending in the third dimension—by a global tilt angle θ—to the position shown in FIG. 8—having a smaller maximum size / height 820 in the second dimension, as shown by the dotted line in FIG. 8.
[0112] It is noteworthy that the global tilt angle θ applied to the pair of first waveguides 800, 800′—out of the plane of the first and third dimensions (illustrated as the xz plane)—means that the pupil expansion direction of each of the pair of first waveguides 800, 800′ is tilted by the same global tilt angle θ with respect to the first dimension (but in different directions with respect to the axis of symmetry 880), as indicated by arrows 810, 810′. As a result, the generally planar arrangement of the pair of first waveguides 800, 800′ of FIG. 8 may be defined in a tilted coordinate system with modified first and second dimensions x′, y′ that are tilted by the global tilt angle θ with respect to the (original) first and second dimensions x, y. The third dimension z′ of the tilted coordinate system is identical to the (original) third dimension z.
[0113] FIG. 9 is a top view of the first replicator of the embodiment of FIG. 8. Those skilled in the art will understand that the top view of the first replicator of the embodiment of FIG. 7 is the same. Thus, FIG. 9 illustrates a substantially planar configuration (in the plane of the first and third dimensions) of the first replicator in the plane of the drawing. The substantially planar configuration prevails in the propagation planes of both the input light and the pupil replica formed by the first replicator. In the illustrated arrangement, a pair of first elongated waveguides 800, 800′ are arranged in a substantially V-shaped configuration within the plane of the first and third dimensions. The input light beam is incident in a direction parallel to the third dimension (illustrated as the z-dimension). Thus, for each waveguide 800, 800′, the angle of the V-shaped configuration is selected to provide oblique incidence of the input light beam at the parallel reflective surfaces for waveguiding and replica formation. Furthermore, by positioning the pair of waveguides 800, 800' at angles to each other substantially in planes in the first and second dimensions, forming a substantially planar V-shaped configuration, and providing input light beams parallel in the third dimension, the first replicator is more compact in the first dimension. As described above with reference to FIG. 8 , the first / input ends of the pair of first waveguides 800, 800'—located at the center of the first replicator—are staggered or overlapped in the second dimension. Thus, neither the first / input ends of the pair of first waveguides 800, 800', nor their respective input ports, shadow the other due to overlap in the first dimension. In the illustrated arrangement, the input ends of the first waveguides 800, 800' are positioned to receive separate input beams 950, 950' through their respective input ports at the other perfectly reflective surface of each pair of parallel reflective surfaces. Each input beam 950, 950' has a parallel optical path in the third dimension (illustrated as the z or z' dimension). Thus, one waveguide 800 of a pair of first waveguides 800, 800' receives the first input optical beam 950 at its input / proximal end and forms an array of replicas R1-Rn extending in a first direction in the first dimension (x or x' dimension) that are output in the third dimension (illustrated as the z or z' dimension) from an output port comprising a pair of parallel reflective (partially) reflective-transmissive surfaces along the length of the waveguide 800 to its output / distal end.Similarly, the other waveguide 800′ of the pair of first waveguides 800, 800′ receives a second input light beam 950′ at its input / proximal end and forms an array of replicas R1′-Rn′ extending in a second direction in the first dimension that are output in a third dimension from an output port along the length of the waveguide 800′ to an output / distal end. As will be appreciated by those skilled in the art, the pair of arrays of replicas R1-Rn, R1′-Rn′ formed by each first waveguide 800, 800′ of the first replicator have parallel optical paths that are in the same direction as the optical path of the input beam 950, 950′ (but are offset in the second dimension), and the exit pupil of the (or each) display device or system providing the input beam 950, 950′ is expanded in the first dimension.
[0114] Furthermore, as described above with reference to Figure 8, the first / input ends of the pair of first waveguides 800, 800' overlap (partially) in the first dimension. As a result, as shown in Figure 9, the replicas R1, R1' formed by each one of the pair of first waveguides 800, 800' also overlap (partially) in the first dimension.
[0115] Figure 10A shows an example of a pair of one-dimensional arrays of replicas R1-Rn, R1'-Rn' formed by a pair of first waveguides 800, 800' of a first replicator according to the embodiment of Figure 8. Figure 10B shows the overlapping of the replicas of Figure 10A in more detail.
[0116] As shown in FIG. 10A, each array of replicas R1-Rn, R1'-Rn' formed by each of the pair of first waveguides 800, 800' extends substantially in the first dimension (shown as the x' dimension) that is rectified / tilted. In some embodiments, each replica is substantially a replica of the hologram displayed on the display device. As will be appreciated by those skilled in the art, in some embodiments, each replica replicates the pupil of the display device. As previously mentioned, the input light beam to the first replicator is provided by a display device (e.g., an LCoS) that is relatively small compared to the projection distance and therefore has a very small pupil. Each replica shown in FIG. 10A is a rectangular region—having a length a and a width b, as shown in FIG. 10B—that, in embodiments, corresponds to the dimensions of the display device.
[0117] Because the first / input ends 801, 801′ of the pair of first waveguides 800, 800′ are staggered or stacked in the second dimension (illustrated as the y′ dimension), the respective arrays of replicas R1-Rn, R1′-Rn′ formed by the first replicators are staggered relative to one another in the second dimension. This is shown in FIG. 10B as the staggered / displacement Δy′ between replicas R1, R1′ in the second dimension. In some embodiments, Δy′ is zero. Furthermore, due to the global tilt angle θ of the pair of first waveguides 800, 800′ in the embodiment of FIG. 8, the array of replicas R1-Rn, R1′-Rn′ is also tilted at the global tilt angle θ with respect to the first dimension (illustrated as the x dimension of the (original / uncorrected) coordinate system). As a result, when the one-dimensional array of replicas propagates into the eyebox, it may appear to an observer to be tilted with respect to the first dimension (e.g., horizontal). Therefore, as one skilled in the art will appreciate, the tilt may be corrected using known techniques, such as adjusting the image content of the input light beam to correct for the tilt so that the array of replicas R1-Rn, R1'-Rn' extends in the first dimension at the eyebox, or by providing an opposing tilt to the entire display system when installed in its installed location.
[0118] Because the first / input ends of the pair of first waveguides 800, 800′ overlap in a first dimension (illustrated as the x′ dimension), the array of two replicas formed also overlaps in the first dimension. In particular, as shown in FIG. 10B , the first replicas R1, R1′ overlap in the first dimension by a displacement Δx′. In other examples, the overlap / displacement Δx′ may include the entire length a of a single replica, such that the first replicas R1, R1′ completely overlap in the first dimension. In further examples, the overlap / displacement Δx′ may be greater than one replica (i.e., Δx′ > a, such as between 2a and 3a), such that it extends across the second replica R2, R2′ and optionally the third replica R3, R3′ of the replica array.
[0119] The inventors have surprisingly discovered that overlapping two arrays of replicas improves the viewing experience in the eyebox, particularly, but not exclusively, when the input beam carries (or is encoded with) a hologram having angular content / channels, and the perceived image quality is improved, especially when the viewer's eyes are positioned in the eyebox where the arrays overlap.
[0120] The first replicator according to the embodiment can be implemented in a system including two replicators arranged to two-dimensionally expand / replicate an input light beam, for example, as described above with reference to FIG. 5A or 5B. In particular, a second replicator comprising a waveguide having a pair of substantially rectangular (e.g., square) parallel reflective surfaces may be arranged to receive the one-dimensional array of replicas from the first replicator as an input light beam. For example, the second replicator may comprise a solid, planar, rectangular waveguide 540, as in the system of FIG. 5B. The second replicator is arranged to provide pupil expansion of the one-dimensional array of replicas / light beams in a second direction substantially perpendicular to the first direction. Thus, the second replicator forms a two-dimensional array of replicas that are propagated to the eyebox of the display system.
[0121] FIG. 11 illustrates an exemplary system including a first replicator of the embodiment of FIG. 8 and a second replicator 840 arranged according to the system of FIG. 5B. The first replicator comprises a pair of solid, elongated waveguides 800, 800′ arranged in a substantially planar configuration for expanding the pupil in a first dimension, as described above. For ease of illustration, FIG. 11 shows only the output ends of the pair of first waveguides 800, 800′. The system further comprises a second waveguide 840 for expanding the pupil in a second dimension. The second waveguide comprises a solid, substantially planar, rectangular waveguide 840 whose major opposing surfaces—forming the pair of parallel reflective surfaces of the waveguide—are parallel to the plane of the first replicator and thus lie in the plane of the first and third dimensions (illustrated as the x-z plane). As described above, the replicas R1-Rn, R1'-Rn' formed by the first pair of waveguides 800, 800' are output by the first replicator in the third dimension (illustrated as the z-dimension). Accordingly, the system further comprises an optical element, illustrated as a flat / folding mirror 830, positioned to fold and / or rotate the optical path of the output light containing the one-dimensional array of replicas, as shown by the exemplary dashed lines, to optically couple the array of replicas / light beams into the input port of waveguide 840 at an angle for waveguiding in the second dimension and replica formation.
[0122] Thus, the exemplary system has a generally planar arrangement that extends substantially in a plane in the first and third dimensions and has a height in the second dimension. As described herein, the system occupies or may be said to be located within stacked first and second planar layers. By minimizing the height—by reducing the maximum size / height of the first replicator in two dimensions—a more compact arrangement is provided that provides comparable two-dimensional pupil expansion that can be accommodated in less space than conventional arrangements to meet field-of-view and eyebox size requirements. Notably, mirror plane / fold 830 contributes to the overall system compactness by allowing the input and replica beams of the first replicator to propagate substantially parallel to the plane of the second replicator, rather than substantially orthogonal as in the system of, for example, FIG. 5A.
[0123] FIG. 12 illustrates a two-dimensional array of replicas formed at the output port of the second replicator 840 of the system of FIG. 11, which are propagated to and viewed by the eyebox of a display system. Notably, the first replicator expands the exit pupil in the horizontal dimension of the eyebox, while the second replicator expands the exit pupil in the vertical direction. Thus, two one-dimensional arrays of replicas R1-Rn, R1'-Rn' formed by the respective waveguides 800, 800' of the first replicator extend in the horizontal dimension of the eyebox. In the illustrated embodiment, the offset / displacement Δy' between the two arrays of replicas R1-Rn, R1'-Rn' formed by the first replicator in the second dimension substantially corresponds to the spacing in the second dimension between the replicas formed by the second replicator 840 (e.g., corresponding to the replica width b). In this way, replica patterns (possibly substantially seamless patterns) are formed in the second dimension (ie, at different vertical positions within the eyebox).
[0124] As shown in FIG. 12 , the array of replicas R1-Rn formed by one first waveguide 800 is visible to the right side of the eyebox (by one or both eyes), while the array of replicas R1'-Rn' formed by the other first waveguide 800' is visible to the left side of the eyebox (by one or both eyes). Both arrays of replicas R1-Rn and R1'-Rn' are visible from the center of the eyebox (by the left and right eyes, respectively). The dividing boundary between the two arrays of replicas R1-Rn and R1'-Rn' is staggered or stepped due to the overlap of the input ends of the pair of first waveguides 800, 800', as described above. As will be appreciated by those skilled in the art, this stepped boundary may be moved to the left or right half of the eyebox based on installation requirements by changing the amount and direction of overlap in the first dimension.
[0125] A system including a first replicator according to an embodiment may be used in a holographic head-up display, as described herein. In some arrangements, holographically encoded light, such as a hologram comprising angular channels / contents as described above with reference to FIGS. 2-4, or an image, may be input to the replicator system to provide two-dimensional pupil expansion / replication. In some embodiments, the input light beams to the pair of first waveguides 800, 800′ may be the same (e.g., provided by the same display device or system). Thus, in an example using a hologram comprising angular channels / contents, the input beams to both first waveguides 800, 800′ may carry all angular channels / contents in the horizontal and vertical directions. In other embodiments, the input light beams to the pair of first waveguides 800, 800′ may be different (e.g., provided by respective / different display devices or systems). Thus, in an example, the input beams 950, 950′ may carry different image contents. For example, the input beam 950 into one first waveguide 800 may carry a hologram or image for the right eye, and the input beam 950' into the other first waveguide 800' may carry a hologram or image for the left eye. Thus, the input beam 950 into one first waveguide 800 may be received from a first / right-eye display system, and the input beam 950' into the other first waveguide 800' may be received from a second / left-eye display system.
[0126] In an example using holograms containing angular channels / content, the input beam 950 to one first waveguide 800 may carry a first hologram containing angular channels / content for the right side of the horizontal field of view (e.g., 0° to +5° of the horizontal field of view), while the input beam 950' to the other first waveguide 800' may carry a second hologram containing angular channels / content for the left side of the horizontal field of view (e.g., 0° to -5° of the horizontal field of view). Notably, in such an example, all horizontal angular content can be seen (horizontally) from the area around the center of the eyebox, such that the entire field of view (e.g., -5° to +5°) can be seen by a viewer using one eye in the eyebox. In particular, one eye located at the very center of the eyebox (i.e., 0 degrees) may receive light rays for the entire field of view (i.e., both holograms). Thus, for a near-center eyebox position (i.e., 0 degrees horizontally), one eye may receive light rays of a first hologram from the replica array formed by one of the first waveguides (e.g., corresponding to the angular channel on the left side of the field of view), while the other eye may receive light rays of a second hologram from the replica array formed by another of the first waveguides (e.g., corresponding to the angular channel on the right side of the field of view). As will be appreciated by those skilled in the art, this effect persists until the observer moves to an eyebox position far from the center (0 degrees), where both eyes can receive light rays only from the same replica array, and therefore the same first waveguide, and both eyes receive light rays of the same hologram. Thus, the amount of overlap of the replica arrays R1-Rn and R1'-Rn' in the first dimension (e.g., the horizontal dimension) may be selected according to installation conditions to optimize the viewing experience at the eyebox.
[0127] In other arrangements, a holographic reconstruction (or "reconstructed image") of the hologram may be formed, and light from the holographic reconstruction or image may be input into a replica system to provide two-dimensional pupil expansion. The input light beams 950, 950' to the pair of first waveguides 800, 800' may be the same or different, as described above.
[0128] In some embodiments, the input ports (or "entrance apertures") of at least the second waveguide 840, and optionally the pair of first waveguides 800, 800', comprise (partially) transmissive-reflective elements instead of being fully transmissive. In particular, the input ports are formed on one of a pair of parallel reflective surfaces of each waveguide 840, e.g., its fully reflective surface. The transmissive-reflective elements at the input ports are positioned to receive and partially transmit input light and partially reflect the light within the waveguide. Examples of transmissive-reflective elements suitable for the input ports of the waveguides are described in co-pending UK patent application 2118613.5, filed December 21, 2021, which is incorporated herein by reference.
[0129] As described in co-pending UK Patent Application No. 2118613.5, the use of a partially transmissive-partially reflective input port of a waveguide allows for the incoupling and trapping of all rays of a diverging ray bundle incident on the input port. Thus, in implementations with holograms having multiple angular channels, light representing all different angular components can be coupled into the waveguide and trapped within it. As described in UK Patent Application No. 2118613.5, the transmissive-reflective element may be stepped in the direction of pupil expansion to retain more angular content. However, due to the reduced "height" (in the second dimension) of the pair of first waveguides 800, 800' forming the first replicator of the embodiment, the input port window required to couple the one-dimensional array of replicas R1-Rn, R1'-Rn' to the second waveguide 840 is reduced. Therefore, the second waveguide 840 requires an input port that is smaller (i.e., shorter in the second dimension) than would be required for a single waveguide, resulting in improved light incoupling efficiency into the second waveguide. There is therefore synergy between UK Patent Application 2118613.5 and the present disclosure.
[0130] Disclosed herein is a system that uses diffracted light to form an image and provide an eyebox size and field of view suitable for real-world applications, such as head-up display applications in the automotive industry. Diffracted light is light that forms a holographic reconstruction of an image from a diffractive structure, e.g., a hologram, such as a Fourier hologram or a Fresnel hologram. The use of diffraction and diffractive structures necessitates display devices with a high density of very small (e.g., 1 micrometer) pixels, which in practice translates to small (e.g., 1 centimeter) display devices. The inventors addressed the problem of how to provide 2D pupil expansion using a diffracted light field, e.g., diffracted light containing diverging (uncollimated) ray bundles.
[0131] In various scenarios, a display system includes a display device arranged to provide or form diffracted or divergent light, such as a pixelated display device, e.g., a spatial light modulator (SLM) or a liquid crystal on silicon (LCoS) SLM. In such scenarios, the aperture of the spatial light modulator (SLM) serves as the aperture stop of the system. That is, the size of the aperture of the spatial light modulator, and more specifically, the area bounding the array of light-modulating pixels formed in the SLM, defines the size (e.g., spatial extent) of the bundle of light rays that can exit the system. In accordance with the present disclosure, the system's exit pupil is expanded to reflect the fact that the system's exit pupil (limited by the small display device pixel size due to the diffraction of light) is spatially expanded and larger using at least one pupil expander.
[0132] Additional Features The methods and processes described herein may be embodied on a computer-readable medium. The term "computer-readable medium" includes a medium configured to store data temporarily or permanently, such as a random access memory (RAM), a read-only memory (ROM), a buffer memory, a flash memory, and a cache memory. The term "computer-readable medium" should also be interpreted to include any medium or combination of media capable of storing instructions for execution by a machine, such that the instructions, when executed by one or more processors, cause the machine to perform, in whole or in part, any one or more of the methods described herein.
[0133] The term "computer-readable medium" also encompasses cloud-based storage systems. The term "computer-readable medium" includes, but is not limited to, one or more tangible, non-transitory data repositories (e.g., data volumes) in the exemplary form of a solid-state memory chip, an optical disk, a magnetic disk, or any suitable combination thereof. In some exemplary embodiments, instructions for execution may be carried by a carrier medium. Examples of such carrier media include transitory media (e.g., a propagating signal carrying the instructions).
[0134] It will be apparent to those skilled in the art that various modifications and variations can be made without departing from the scope of the appended claims. This disclosure covers all modifications and variations that come within the scope of the appended claims and their equivalents.
Claims
1. 1. A pupil expander for a head-up display, the head-up display having an eyebox with a first dimension and a second dimension, the pupil expander comprising: a pair of first waveguides arranged to replicate the pupil in the first dimension, each of the pair of first waveguides being elongated and tapered in an elongation direction such that an input end is narrower than an output end; The input ends of the pair of first waveguides are disposed close to each other, and the output ends of the pair of first waveguides are disposed far from each other; A pupil expander, wherein the pair of first waveguides are arranged in a planar configuration and are tilted relative to a direction of the first dimension to reduce a size of the planar configuration in the second dimension.
2. The pupil expander of claim 1 , wherein the pair of first waveguides are arranged to provide pupil expansion in opposite directions of the first dimension.
3. The pupil expander of claim 1 , wherein each of the pair of first waveguides has the same length.
4. The pupil expander of claim 1 , wherein the planar configuration is in a propagation plane of a pupil replica formed by the pair of first waveguides.
5. The pupil expander of claim 1 , wherein the pair of first waveguides are arranged in a configuration that tapers in the same direction.
6. 2. The pupil expander of claim 1, wherein the input ends of the pair of first waveguides partially overlap in the first dimension, and optionally, the amount of overlap in the first dimension is less than a size of a replica in the first dimension.
7. 2. The pupil expander of claim 1 , wherein the input ends of the pair of first waveguides are staggered in the second dimension such that the output ends of the pair of first waveguides overlap in the second dimension.
8. The pupil expander of claim 1 , wherein the input ports of the pair of first waveguides are spatially separated in the second dimension.
9. 10. The pupil expander of claim 1, further comprising a second waveguide configured to replicate a pupil in the second dimension of the eyebox, the pair of first waveguides being optically coupled to the second waveguide.
10. 10. The pupil expander of claim 9, further comprising an optical element positioned to optically couple output light of the pair of first waveguides to the second waveguide, and optionally a flat / folding mirror.
11. 10. The pupil expander of claim 9, wherein the pair of first waveguides are arranged in a planar configuration parallel to a plane of the second waveguide.
12. 10. The pupil expander of claim 9, wherein an input port to the second waveguide comprises a partially transmissive, partially reflective element, such as a partially transmissive, partially reflective surface and optionally a stepped partially transmissive, partially reflective surface.
13. 2. The pupil expander of claim 1 , wherein each first waveguide comprises a pair of parallel reflective surfaces arranged to provide guiding of input light therebetween, the pair comprising a first substantially reflective surface and a second partially reflective transmissive surface.
14. 2. The pupil expander of claim 1, wherein the input end of one first waveguide comprises an input port for a first display system and the input end of the other first waveguide comprises an input port for a second display system.
15. The pupil expander of claim 1 , wherein input light to at least one of the first pair of waveguides comprises divergent light, e.g., a diffracted light field comprising divergent ray bundles.
16. A head-up display comprising an eye expander according to any one of claims 1 to 15.
Citation Information
Patent Citations
Pupil expansion method
JP2021152643A
Systems and methods for binocular distortion compensation of displays
JP2021530735A
Optical apparatus and method
US20100328794A1
Display waveguide assembly with color cross-coupling
US20200116996A1
Display device and system
US20210294101A1
