Optical systems with optical expansion couplers

By employing a combined optical system of non-diffractive input couplers and cross-couplers in a head-mounted device, even-order diffraction of light is achieved using surface undulations or holographic phase grating structures, thus solving the problems of bulky devices and poor optical performance, and realizing lightweight and efficient optical expansion effects.

CN116953848BActive Publication Date: 2026-11-10APPLE INC
View PDF 3 Cites 0 Cited by

Patent Information

Application Number
CN202311132614.0
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Priority Date
2020-03-26
Filing Date
2020-05-26
Publication Date
2026-11-10
Estimated Expiration
2040-05-26

AI Technical Summary

Technical Problem

Existing head-mounted displays suffer from bulky design and poor optical performance, especially in virtual reality and augmented reality devices, where efficient optical expansion and dispersion control are difficult to achieve.

Method used

An optical system employing a combination of non-diffractive input coupler, cross coupler, and output coupler utilizes surface undulation grating or holographic phase grating structures to achieve even-order diffraction and expansion of light in the waveguide, thereby mitigating dispersion effects and guiding light to the eyebox via total internal reflection.

Benefits of technology

It achieves lightweight and high-efficiency optical performance in optical systems, supports extended field of view and wide optical bandwidth, while reducing dispersion effects and providing uniform pupil distribution.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN116953848B_ABST
    Figure CN116953848B_ABST
Patent Text Reader

Abstract

This disclosure relates to an optical system having an optical extension coupler. An electronic device may include a display that generates light for an optical system that redirects light toward an eyebox. The optical system may include a waveguide, a non-diffractive input coupler, a cross-coupler, and an output coupler. The cross-coupler extends the light in a first direction. The cross-coupler performs even-order diffraction on the light and couples the light back into the waveguide at an angle suitable for total internal reflection. The output coupler extends the light in a second direction while coupling the light out of the waveguide. The cross-coupler may include a surface-roughened grating or a holographic grating embedded within the waveguide or formed in a separate substrate. The optical system can guide light toward the eyebox without dispersion and while supporting an extended field of view and optical bandwidth.
Need to check novelty before this filing date? Find Prior Art

Description

[0001] Case Separation Statement

[0002] This application is a divisional application of the invention patent application with PCT international application number PCT / US2020 / 034587, international application date May 26, 2020, Chinese national phase application number 202080018199.4, and invention title "Optical System with Optical Extender Coupler".

[0003] Cross-reference to related applications

[0004] This patent application claims priority to U.S. Patent Application No. 16 / 831,147, filed March 26, 2020, and U.S. Provisional Patent Application No. 62 / 854,905, filed May 30, 2019, the entire contents of which are incorporated herein by reference. Technical Field

[0005] This disclosure relates in general to optical systems, and more specifically to optical systems for displays. Background Technology

[0006] Electronic devices may include displays that present images close to the user's eyes. For example, devices such as virtual reality and augmented reality headsets may include displays with optical elements that allow the user to view the display.

[0007] Designing devices like these can be challenging. If not handled carefully, the components used to display content can be unsightly and bulky, and may not exhibit the expected level of optical performance. Summary of the Invention

[0008] Electronic devices such as head-mounted displays may have one or more near-eye displays that generate images for the user. A head-mounted display may be a pair of virtual reality glasses or an augmented reality headset, which allows an observer to view both computer-generated images and real-world objects in the observer's surrounding environment.

[0009] A near-eye display may include a display unit that generates light and an optical system that redirects light from the display unit toward an eye box. The optical system may include a waveguide, an input coupler on the waveguide, a cross-coupler on the waveguide, and an output coupler on the waveguide. The input coupler may be a non-diffractive input coupler, such as an input prism that couples light into the waveguide and toward the cross-coupler. The cross-coupler may spread the light coupled into the waveguide in a first direction. The cross-coupler may perform an even number of diffractions on the light and may couple the diffracted light back into the waveguide at an angle suitable for total internal reflection in the waveguide. The output coupler may receive light from the cross-coupler. The output coupler may spread the light in a second direction perpendicular to the first direction while simultaneously coupling the light out of the waveguide.

[0010] The cross-coupler may include surface-roughened gratings, meta-gratings, or holographic phase gratings, such as volumetric holograms embedded within a waveguide or formed on a separate substrate adhered to the outer surface of the waveguide. This optical system can guide light toward the eyebox without dispersion and while supporting extended field of view and optical bandwidth. Attached Figure Description

[0011] Figure 1 These are illustrations of exemplary systems with displays based on some implementation schemes.

[0012] Figure 2 This is a top view of an exemplary optical system for a display according to some embodiments, the optical system including an input coupler, a cross coupler, and an output coupler.

[0013] Figure 3 This is a front view of an exemplary optical system having a cross coupler and an output coupler according to some embodiments, wherein the cross coupler causes the coupled light to diffract an even number of times and simultaneously expands the light in a first direction, and the output coupler expands the light in a second direction.

[0014] Figure 4 This is an illustration of an exemplary cross-coupler with a non-rectangular shape according to some implementation schemes.

[0015] Figure 5 This is a top cross-sectional view of an exemplary waveguide with a cross-coupler according to some embodiments, the cross-coupler being formed by a surface-undulation grating structure on the waveguide.

[0016] Figure 6 This is a top cross-sectional view of an exemplary waveguide with a cross-coupler according to some embodiments, the cross-coupler being formed by a surface-undulating grating structure embedded in a grating medium used to form the output coupler of the waveguide.

[0017] Figure 7This is a top cross-sectional view of an exemplary waveguide with a cross-coupler according to some embodiments, the cross-coupler being formed by a surface-undulating grating structure on the same side of the waveguide as the input coupling prism.

[0018] Figure 8 This is a top cross-sectional view of an exemplary waveguide with a cross-coupler according to some embodiments, the cross-coupler being formed by a surface-undulating grating structure embedded in a grating medium on the same side of the waveguide as the input coupling prism.

[0019] Figure 9 It is based on some implementation schemes shown. Figures 5 to 8 The surface undulation grating structure of the type shown can be formed in a substrate with a relatively high refractive index to ensure that light of different wavelengths coupled in propagates through the k-space diagram of the waveguide.

[0020] Figure 10 This is a cross-sectional top view of an exemplary waveguide with a cross-coupler formed by a volume holographic grating structure, according to some implementation schemes.

[0021] Figure 11 This is a front view of an exemplary output coupler with variable diffraction efficiency according to some implementation schemes.

[0022] Figure 12 and Figure 13 The image is a front view of an exemplary optical system having a cross-coupler and an output coupler according to some embodiments. The cross-coupler has a single grating structure that diffracts the coupled light an even number of times and simultaneously expands the light in a first direction, and the output coupler expands the light in a second direction. Detailed Implementation

[0023] Figure 1 An exemplary system is illustrated, having a device with one or more near-eye display systems. System 10 may be a head-mounted device having one or more displays, such as a near-eye display 20 mounted within a support structure (housing) 8. The support structure 8 may be shaped like a pair of glasses (e.g., a support frame), may be formed with a helmet-shaped housing, or may have other configurations to help mount and secure components of the near-eye display 20 to the user's head or near their eyes. The near-eye display 20 may include one or more display modules such as display module 20A, and one or more optical systems such as optical system 20B. Display module 20A may be mounted in the support structure such as support structure 8. Each display module 20A may emit light 38 (image light), which is redirected toward the user's eye at eye box 24 using an associated one of the optical systems 20B.

[0024] The control circuit 16 can be used to control the operation of the system 10. The control circuit 16 may include storage and processing circuitry for controlling the operation of the system 10. The circuit 16 may include storage devices such as hard disk drive storage devices, non-volatile memory (e.g., electrically programmable read-only memory configured to form a solid-state drive), volatile memory (e.g., static or dynamic random access memory), etc. The processing circuitry in the control circuit 16 may be based on one or more microprocessors, microcontrollers, digital signal processors, baseband processors, power management units, audio chips, graphics processing units, application-specific integrated circuits (ASICs), and other integrated circuits. Software code may be stored on the memory in the circuit 16 and run on the processing circuitry in the circuit 16 to implement operations for the system 10 (e.g., data acquisition operations, operations involving the use of control signals to adjust components, image rendering operations to generate image content for display to a user, etc.).

[0025] System 10 may include input / output circuitry such as input-output device 12. Input-output device 12 may be used to allow system 10 to receive data from external devices (e.g., tethered computers, portable devices such as handheld devices or laptops) or other electrical devices, and to allow users to provide user input to head-mounted device 10. Input-output device 12 may also be used to collect information about the environment in which system 10 (e.g., head-mounted device 10) operates. Output components in device 12 may allow system 10 to provide output to a user and may be used to communicate with external electronic devices. Input-output device 12 may include sensors and other components 18 (e.g., image sensors, accelerometers, depth sensors, light sensors, haptic output devices, speakers, batteries, wireless communication circuitry for communication between system 10 and external electronic devices, etc.).

[0026] Display module 20A can be a liquid crystal display, an organic light-emitting diode display, a laser-based display, a reflective display, or other types of display. Optical system 20B can form lenses that allow an observer (e.g., the observer's eye at peephole 24) to view an image on display 20. Two optical systems 20B can exist associated with the user's respective left and right eyes (e.g., for forming a left lens and a right lens). A single display 20 can generate images for both eyes, or a pair of displays 20 can be used to display images. In a configuration with multiple displays (e.g., a left-eye display and a right-eye display), the focal length and position of the lenses formed by optical system 20B can be selected such that any gaps between the displays will be invisible to the user (e.g., allowing the images from the left and right displays to seamlessly overlap or merge).

[0027] If needed, optical system 20B may include components (e.g., an optical combiner, etc.) to allow real-world image light from a real-world image or object 28 to be optically combined with virtual (computer-generated) images, such as virtual images in image light 38. In this type of system (sometimes called an augmented reality system), the user of system 10 can view both real-world content and computer-generated content overlaid on top of the real-world content. Camera-based augmented reality systems may also be used in device 10 (e.g., an arrangement where a camera captures a real-world image of object 28 and digitally merges that content with virtual content at optical system 20B).

[0028] If necessary, system 10 may include wireless circuitry and / or other circuitry to support communication with a computer or other external device (e.g., a computer that provides image content to display 20). During operation, control circuitry 16 may provide image content to display 20. This content may be received remotely (e.g., from a computer or other content source coupled to system 10) and / or may be generated by control circuitry 16 (e.g., text, other computer-generated content, etc.). The content provided to display 20 by control circuitry 16 may be viewed by an observer at eyebox 24.

[0029] Figure 2 It is possible Figure 1 A top view of the exemplary optical system 20B used in system 10. (See figure) Figure 2 As shown, the optical system 20B may include optical elements such as waveguide 50, input optics 58, output optics 60, input coupler 52, cross coupler 54, and output coupler 56. Input optics 58 may include a collimating lens or other optical components that transmit image light 38 to input coupler 52. This can be achieved via display module 20A (… Figure 1 The display unit in the optical system 20B provides image light 38 to the optical system 20B. This display unit can be a liquid crystal display, organic light-emitting diode display, cathode ray tube, plasma display, projector display (e.g., a micromirror array-based projector), liquid crystal on a silicon display, or other suitable type of display. The optical system 20B can be used to present the light 38 output from the display unit to the eyebox 24.

[0030] Waveguide structures, such as waveguide 50 in optical system 20B, may be formed from one or more stacked layers of polymer, glass, or other transparent substrates capable of guiding light via total internal reflection. Input coupler 52, cross coupler 54, and output coupler 56 may each be partially or completely embedded within waveguide 50 or mounted to the surface of waveguide 50. Some of the optical couplers 52, 54, and 56 may be mounted to the surface of waveguide 50, while the others are embedded within waveguide 50. Output optics 60 may include a lens that helps focus light 38 coupled out of waveguide 50 by output coupler 56 onto eyebox 24. Input optics 58 and / or output optics 60 may be omitted if desired.

[0031] Input coupler 52 can be configured to couple light 38 from the display module into waveguide 50, while output coupler 32 can be configured to couple light 38 from within waveguide 50 out of waveguide 50 and toward eyebox 24. For example, when light 38 from input optics 58 is incident on input coupler 52, input coupler 52 can redirect light 38 such that the light propagates within waveguide 50 toward output coupler 56 (e.g., along the X-axis) via total internal reflection. When light 38 is incident on output coupler 56, output coupler 32 can redirect light 38 away from waveguide 28 toward eyebox 24 (e.g., backward along the Z-axis).

[0032] exist Figure 2 In this example, a cross-coupler 54 is optically interposed between an input coupler 52 and an output coupler 56. In this example, the input coupler 52 redirects light 38 toward the cross-coupler 54. The cross-coupler 54 extends the light 38 in a first direction and also couples (redirects) the extended light back into the waveguide 50. The waveguide 50 propagates the light extended by the cross-coupler 54 to the output coupler 56 via total internal reflection. If desired, the output coupler 56 can then extend the light received from the cross-coupler 54 in a second direction different from (e.g., perpendicular to) the first direction. If desired, the output coupler 56 can provide optical power to the light coupled out of the waveguide. Consider an example where the light 38 coupled into the waveguide 50 via the input coupler 52 includes a pupil. The extension of the light 38 by the cross-coupler 54 and the output coupler 56 can be used to extend the pupil in multiple (e.g., orthogonal) dimensions, thereby allowing a relatively large eyebox 24 to be filled with a pupil of light 38 having a sufficiently and substantially uniform intensity over the entire area of ​​the eyebox.

[0033] Input coupler 52, cross coupler 54, and output coupler 56 may be based on reflective and refractive optics, or on holographic (e.g., diffractive) optics. In an arrangement where couplers 52, 54, or 56 are formed by reflective and refractive optics, the coupler may include one or more reflectors (e.g., micromirrors, partial mirrors, or arrays of other reflectors). In an arrangement where couplers 52, 54, or 56 are based on holographic optics, couplers 52, 54, and 56 may include holographic media such as photopolymers, gelatin such as dichromate gelatin, silver halide, liquid crystals with dispersed holographic polymers, or other suitable volumetric holographic media. Holographic recordings (e.g., holographic phase gratings, sometimes referred to herein as holograms) may be stored in the holographic medium. The holographic medium may sometimes be referred to herein as a grating medium.

[0034] Holographic recordings can be stored as optical interference patterns (e.g., alternating regions of different refractive indices) within a photosensitive optical material such as a holographic medium. This optical interference pattern can generate a holographic phase grating, which, when illuminated by a given light source, diffracts light to produce a three-dimensional reconstruction of the holographic recording. The holographic phase grating can be a non-switchable diffraction grating encoded with a permanent interference pattern, or it can be a switchable diffraction grating where the emitted light can be modulated by controlling the electric field applied to the holographic recording medium. If desired, multiple holographic phase gratings (holograms) can be recorded within a grating medium of the same volume (e.g., superimposed within a grating medium of the same volume). The holographic phase grating can be, for example, a volumetric hologram within a grating medium.

[0035] If desired, one or more of couplers 52, 54, and 56 may be implemented using other types of diffraction grating structures, such as surface-ruffled grating structures. Surface-ruffled grating structures include diffraction gratings (e.g., surface-ruffled gratings) formed by mechanical cutting, etching, or otherwise in a surface-ruffled grating medium. The surface-ruffled grating diffracts light incident on the surface-ruffled grating. Instead of modulating the refractive index in the grating medium (as performed to generate a holographic phase grating such as a volume hologram), the surface-ruffled grating is generated by varying the physical thickness of the medium across its lateral regions. If desired, multiple surface-ruffled gratings (e.g., two surface-ruffled gratings) may be multiplexed within a surface-ruffled grating medium of the same volume.

[0036] In a suitable arrangement sometimes described herein as an example, the input coupler 52 is a non-diffractive input coupler (e.g., an input coupler that does not include diffraction gratings such as surface undulation gratings or holographic phase gratings). For example, the input coupler 52 may include an input prism, an angled surface (edge) of the waveguide 50, etc. Using a non-diffractive input coupler such as an input prism allows light 38 to be coupled into the waveguide 50 without producing the dispersion that would otherwise be associated with input coupling using diffractive elements. In another suitable arrangement, the input coupler 52 may be formed using diffraction gratings such as volume holograms or other grating structures. In these cases, any dispersion introduced by the input coupler can be reversed by the output coupler as the light diffracts out of the waveguide (e.g., in the case where the output coupler includes a holographic phase grating such as a volume hologram).

[0037] The cross-coupler 54 may include a diffraction grating structure that diffracts light 38 coupled to waveguide 50 by the (non-diffraction) input coupler 52. The grating structure in the cross-coupler 54 may include a surface undulation grating structure (e.g., one or more surface undulation gratings) or a phase grating structure such as a volume holographic grating structure (e.g., a set of at least partially overlapping volume holograms). The grating structure in the cross-coupler 54 may be configured to diffract light 38 an even number of times. At least one diffraction in the diffraction may be used in a first direction (e.g., entering and / or exiting along the Y-axis). Figure 2 The light is extended (in a plane) 38. At least one diffraction in the diffraction can be used to redirect the extended light back into the waveguide 50 at a certain angle, so that the light propagates to the output coupler 54 by total internal reflection. By making the light diffract an even number of times, any dispersion effects associated with making the light diffract once can be reversed by making the light diffract the corresponding subsequent times. This can be used to mitigate the dispersion of the light transmitted to the output coupler 56.

[0038] The output coupler 56 may include a diffraction grating structure, such as a volume holographic grating structure or other holographic phase grating. In another suitable arrangement, the output coupler 56 may include a mirror structure such as a venetian blind mirror. The output coupler 56 may reflect or diffract light 38. The reflection / diffraction of light 38 by the output coupler 56 may be used to extend light 38 in a second direction (e.g., along the X-axis) and to couple the extended light toward the eyebox 24 out of the waveguide 50.

[0039] Figure 3 To illustrate a front view of how the cross-coupler 54 may include a grating structure of waveguide 50, which extends light 38 while also causing light 38 to diffract an even number of times to reduce dispersion. Figure 3As shown, waveguide 50 may include a waveguide substrate having a lateral (external) surface 114. A non-diffractive input coupler 52, such as an input prism 70, may be mounted to surface 114. The input prism 70 may couple light 38 downwards (e.g., along the +Z direction) into waveguide 50 and toward a cross coupler 54. The cross coupler 54 may be formed on a side surface of the waveguide substrate in waveguide 50, or may be embedded within waveguide 50.

[0040] The cross-coupler 54 may include a first diffraction grating structure 72 and a second diffraction grating structure 74. The first grating structure 72 may at least partially overlap with the second grating structure 74 (e.g., within an overlap region 76). The grating structures 72 and 74 may be superimposed on each other, for example, within a grating medium of the same volume (area) within the overlap region 76. The overlap region 76 may have a width (e.g., parallel to the Y-axis) approximately equal to (e.g., greater than or equal to) the width of the input prism 70. This is merely illustrative. The overlap region 76 may have a width less than or equal to the width of the input prism 70, or may have other shapes. The overlap region 76 need not have a uniform width.

[0041] Light 38 coupled parallel to the X-axis into waveguide 50 (sometimes referred to herein as DC light 86) can be guided by cross-coupler 54 back into waveguide 50 and toward output coupler 56 without propagating in the vertical direction. DC light 86 can propagate to output coupler 56 along the length of waveguide 50 via total internal reflection. Light 38 coupled to waveguide 50 at a non-zero angle relative to the X-axis can be propagated vertically by first grating structure 72 and / or second grating structure 74 (e.g., by causing the light to diffract vertically in a direction parallel to the Y-axis, which is sometimes referred to herein as the “first direction”). First grating structure 72 and / or second grating structure 74 can be configured to cumulatively diffract the light an even number of times as light 38 re-enters waveguide 50 to propagate to output coupler 56 via total internal reflection (e.g., to mitigate dispersion caused by a single diffraction instance).

[0042] For example, light 38 at a positive angle relative to DC light 86 can be coupled into waveguide 50 and guided to cross-coupler 54, as indicated by arrow 88. The first grating structure 72 may include stripes 78 oriented at a non-parallel angle relative to stripes 78 in the second grating structure 74. The first grating structure 72 and the second grating structure 74 may include surface-roughened gratings or holographic phase gratings such as volume holograms. When grating structures 72 and 74 are formed by holographic phase gratings, stripes 78 may represent lines of constant refractive index of the grating medium. When grating structures 72 and 74 are formed using surface-roughened gratings, stripes 78 may represent lines of constant thickness of the grating medium. Stripes 78 are characterized by a period Λ (e.g., a modulation period of the refractive index or a modulation period of the thickness of the grating medium) and an orientation (e.g., defined by the direction of the grating vector of grating structures 72 and 74, wherein the grating vector is perpendicular to the orientation of stripe 78). Stripes 78 may also have associated fringe angles defined relative to the normal of the side surface 114.

[0043] The period, orientation, and fringe angle of grating structures 72 and 74 can configure the grating structures to diffract light from a specific incident angle range and within a specific wavelength range within a specific output angle range. These factors can be selected to configure cross-coupler 54 to vertically extend light 38 while diffracting the light an even number of times, and simultaneously diffracting the light back into waveguide 50 at angles within the wavelengths (colors) included in light 38 and at angles within the incident angle provided to the cross-coupler by the input prism 70, such that the light can propagate along waveguide 50 via total internal reflection.

[0044] Consider an example of using surface-roughened gratings to form grating structures 72 and 74. In this example, grating structure 74 can be configured to perform a first diffraction, wherein light incident at an incident angle associated with arrow 88 (e.g., light incident along the +X, -Y, and -Z directions) diffracts at corresponding output angles, as indicated by arrow 90 (e.g., output angles along the +Y and +X directions). Grating structure 74 can also be configured to perform a (subsequent) second diffraction, wherein light incident at an incident angle associated with arrow 90 (e.g., the output angle of the first diffraction) diffracts at corresponding output angles, as indicated by arrow 92 (e.g., output angles along the +X, -Y, and +Z directions). The first diffraction can introduce dispersion, wherein incident light 38 of different wavelengths diffracts at slightly different output angles. The second diffraction can reverse the dispersion introduced by the first diffraction (e.g., by diffracting light from the first diffraction back into waveguide 50 at the same output angle for each wavelength). The second diffraction generated by arrow 92 can guide the light back into waveguide 50 at a certain angle, so that the light can propagate along the length of waveguide 50 to output coupler 56 through total internal reflection.

[0045] Similarly, grating structure 72 can be configured to perform a first diffraction, wherein light incident at an incident angle associated with arrow 88' (e.g., light incident along the +X, +Y, and -Z directions) diffracts at corresponding output angles, as indicated by arrow 90' (e.g., output angles along the -Y and +X directions). Grating structure 72 can also be configured to perform a (subsequent) second diffraction, wherein light incident at an incident angle associated with arrow 90' (e.g., the output angle of the first diffraction) diffracts at corresponding output angles, as indicated by arrow 92' (e.g., output angles along the +X, +Y, and +Z directions). The first diffraction can introduce dispersion, wherein incident light 38 of different wavelengths diffracts at slightly different output angles. The second diffraction can reverse the dispersion introduced by the first diffraction. The second diffraction associated with arrow 92' can guide light back into waveguide 50 at an angle, allowing light to propagate along the length of waveguide 50 to output coupler 56 via total internal reflection.

[0046] The diffraction of grating structures 72 and 74 in the vertical direction (e.g., in the +Y / -Y direction) can be used to extend light 38 in the vertical direction (e.g., parallel to the Y-axis). Output coupler 56 can diffract or reflect light received from cross coupler 54 toward the eyebox, as shown by arrow 84, while also extending the light in a horizontal direction different from (e.g., orthogonal to) the vertical direction (e.g., output coupler 56 can extend light in a direction parallel to the X-axis, as shown by arrow 82). This allows the pupil of the light coupled into waveguide 50 to extend in two dimensions until the light is received at the eyebox.

[0047] Grating structures 72 and 74 can each perform a first diffraction within an angular range relative to DC light 86 (e.g., grating structure 72 diffracts light 38 within a continuous incident angle range between arrow 88 and the X-axis, while grating structure 74 diffracts light 38 within a continuous incident angle range between arrow 88' and the X-axis). A second diffraction performed by grating structures 72 and 74 can similarly be performed within the corresponding incident angle range. If desired, diffraction grating structures (e.g., volume holograms, surface undulation gratings, etc.) such as an optional diffraction beam catcher 77 can be formed on waveguide 50. The diffraction beam catcher 77 can be configured to diffract low-angle light, such as DC light 86, to locations other than output coupler 56 (e.g., toward other optics, light traps such as absorbing materials, etc.), as indicated by arrow 79. This can help ensure, for example, that light of uniform intensity is provided to output coupler 56 (e.g., because DC light 86 can be brighter than diffracted light 92' and 92).

[0048] Surface-undulation gratings exhibit a relatively wide wavelength bandwidth. This allows grating structures 72 and 74 to be implemented using a single surface-undulation grating each, while still exhibiting satisfactory diffraction efficiency for each wavelength of light 38 (e.g., across the entire visible spectrum). In other words, cross-coupler 54 can diffract and spread light 38 for each wavelength using only two surface-undulation gratings (e.g., one surface-undulation grating in grating structure 72 and another surface-undulation grating in grating structure 74). In another suitable arrangement, cross-coupler 54 may include more than two surface-undulation gratings. In these cases, additional surface-undulation grating dielectric layers can be stacked on top of each other, with each layer comprising one or two associated surface-undulation gratings.

[0049] When using holographic phase gratings such as volumetric holograms to implement grating structures 72 and 74, each volumetric hologram exhibits a much narrower wavelength bandwidth than a surface-undulation grating. For example, a volumetric hologram diffracts light from a specific incident angle range within a specific wavelength range that is much narrower than the wavelength range diffracted by a similar surface-undulation grating. To diffract each wavelength in the light 38, grating structures 72 and 74 may each include a corresponding set of multiplexed volumetric holograms (or other holographic phase gratings). Each volumetric hologram in this set may be configured to diffract (e.g., Bragg-matched) light from different corresponding wavelength ranges and / or incident angle ranges, but may each diffract incident light within the same output angle range. Each volumetric hologram in this set may at least partially overlap. For example, each volumetric hologram in this set may be superimposed within a grating medium of the same volume, or may be partitioned between different grating medium layers (e.g., where each layer includes at least one volumetric hologram from the set). In this way, the holographic phase grating (e.g., a volume hologram) in the cross-coupler 54 can jointly perform an even number of diffractions (e.g., diffractions indicated by arrows 88, 90, 92, 88', 90', and 92') on incident light over a wide wavelength range and at each incident angle provided by the input prism 70. This set of volume holograms in grating structure 72 may sometimes be referred to herein as a volume hologram structure. Similarly, this set of volume holograms in grating structure 74 may sometimes be referred to herein as a volume hologram structure.

[0050] Figure 3The example only shows two diffraction operations performed by each grating structure. This is merely illustrative. If desired, each grating structure may perform four, six, eight, or any other desired even-number of diffraction operations. Performing even-numbered diffractions in this way allows any dispersion associated with the first diffraction to be reversed by the corresponding additional diffraction, and allows light to be redirected toward the output coupler 56. If only a single diffraction operation (or any other odd-numbered diffraction operation) is performed, the light may be directed elsewhere in the system (e.g., away from the output coupler 56, as indicated by arrow 94). In these cases, if desired, the output coupler 56 may be repositioned or expanded in size so that stray light associated with arrow 94 is also received at the output coupler. In addition to the light that has been diffracted an even number of times, a portion of the image light coupled into the waveguide may be passed to the output coupler without being diffracted by the cross-coupler (e.g., for certain portions of the image). Figure 3 The architecture may not need to interact with cross-couplers.

[0051] In another suitable arrangement, the cross-coupler 54 can be implemented using a meta-grating structure (e.g., grating structures 72 and 74 can each be formed using a corresponding meta-grating). Other types of diffraction gratings (e.g., non-meta-gratings) typically exhibit periodic structures and dispersion. For example, the grating causes the propagation angle to vary with wavelength during the first diffraction, thus the pupil replicas at different wavelengths will be spatially separated within the waveguide. The propagation angle is recovered by the grating during the second diffraction (e.g., to compensate for dispersion). However, the pupil spacing can introduce color inhomogeneities into the image.

[0052] In contrast, the meta-grating is a non-periodic component of the high-refractive-index dielectric resonator (e.g., formed on surface 114 of waveguide 50 or on or within the waveguide). The meta-gratings in grating structures 72 and 74 can, for example, be formed on surface 114 of waveguide 50. Each dielectric resonator in the meta-grating can be designed to impart a phase delay to the incident light. The phase delay of each dielectric resonator can be controlled independently for different wavelengths. Through a suitable configuration of the dielectric resonator distribution, a wavelength-dependent phase distribution can be obtained, such that all wavelengths diffract at the same output angle. In this way, the pupil can propagate and expand without introducing color separation.

[0053] Figure 3 The example (where the cross coupler 54 has a rectangular shape) is merely illustrative. In general, the cross coupler 54 (e.g., the first grating structure 72, the second grating structure 74, and / or the overlapping region 76) may have any desired shape (e.g., a triangular shape, a trapezoidal shape, other polygonal shapes, circular shapes, elliptical shapes, combinations of these shapes, etc.) with any desired number of straight edges and / or curved edges. Figure 4This is a schematic diagram of one possible shape for the cross-coupler 54. For example... Figure 4 As shown, the cross coupler 54 may have five sides, and the overlapping region 76 may also have five sides. The first grating structure 72 and the second grating structure 74 may have non-uniform lengths (e.g., parallel to the X-axis). For example, the shape of the cross coupler 54 may be selected to make the output coupler 56 ( Figure 3 The amount of light received at the point is maximized. Other shapes can be used. The output coupler 56 can also be configured in any desired shape and does not need to be rectangular. If desired, the cross coupler 54 can be formed using only one of the first grating structure 72 or the second grating structure 74. If desired, the grating structures 72 and 74 can be non-overlapping (e.g., the overlapping region 76 can be omitted).

[0054] Figure 5 This is a top cross-sectional view of waveguide 50 in an example of forming a cross-coupler 54 using a surface-undulation grating structure (e.g., as along...). Figure 3 (Observe in the direction of the arrow at 95 degrees). For example... Figure 5 As shown, waveguide 50 may include one or more waveguide substrates, such as substrate 108 and substrate 110. A holographic recording medium, such as grating medium 106, may be interposed (stacked) between substrates 108 and 110. A lateral (e.g., planar) surface 120 of grating medium 106 may contact substrate 108. A lateral surface 122 of grating medium 106 may contact substrate 110. An output coupler 56 may be formed within grating medium 106 (e.g., using a volumetric hologram or other holographic phase grating recorded in grating medium 106, a venetian blind mirror embedded in grating medium 106, etc.). If desired, an optional antireflective coating 118 may be laminated onto surfaces 120 and / or 122 at the output coupler 56. For example, the antireflective coating 118 may prevent unwanted light reflections within grating medium 106 during writing (recording) of the holographic phase grating within the output coupler 56.

[0055] An input prism 70 may be mounted to the outer surface 114 of the substrate 108. The input prism 70 couples image light 38 into the waveguide 50 and towards the cross-coupler 54. The cross-coupler 54 may include a surface undulation grating structure, such as surface undulation grating structure 100. The surface undulation grating structure 100 may be used to form a first grating structure 72 (e.g., the surface undulation grating structure 100 may include at least the functions of...). Figure 3 The surface undulation gratings associated with the first and second diffractions of arrows 88', 90', and 92' can be used to form the second grating structure 74 (e.g., the surface undulation grating structure 100 may include at least those performing the same function as...). Figure 3The surface undulation gratings associated with the first and second diffractions of arrows 88, 90 and 92) or may be used to form overlapping region 76 (e.g., the surface undulation grating structure 100 may include surface undulation gratings for forming the first grating structure 72 and surface undulation gratings for forming the second grating structure 74, which are superimposed in the same region).

[0056] like Figure 5 As shown, a surface-undulation grating structure 100 can be formed within a substrate such as a surface-undulation grating substrate (dielectric) 112. For example, the surface-undulation grating in the surface-undulation grating structure 100 can be defined by ridges (peaks) 102 and valleys (minimums 104) in the thickness of the surface-undulation grating substrate 112. Figure 5 In the example, the surface undulation grating structure 100 is a binary structure, wherein the grating is defined by a first thickness associated with peak 102 or a second thickness associated with valley 104. This is merely illustrative. The surface undulation grating structure 100 may be non-binary if desired (e.g., may include any desired number of thicknesses following any desired profile, may include peaks 102 at non-parallel fringe angles relative to the Y-axis, etc.). The surface undulation grating substrate 112 may exhibit a relatively high refractive index (e.g., greater than the bulk refractive index of the grating medium 106). The surface undulation grating substrate 112 may be adhered to the surface 116 of the waveguide substrate 110 using an adhesive layer 115. The adhesive layer 115 may have a relatively low refractive index (e.g., less than the refractive index of the surface undulation grating substrate 112). For example, the surface undulation grating structure 100 may be fabricated separately from the output coupler 56 in the waveguide 50 and may be adhered to the waveguide 50 after fabrication.

[0057] The input prism 70 couples the image light 38 into the waveguide 50 and towards the surface-roughened grating structure 100. The surface-roughened grating structure 100 diffracts the light 38 an even number of times and simultaneously extends the light 38 in a direction parallel to the Y-axis. The final diffraction performed by the surface-roughened grating structure 100 couples the light 38 (e.g., as extended light) back into the waveguide 50 at an angle, allowing the light to continue propagating along the length of the waveguide 50 via total internal reflection. The light 38 is then coupled out of the waveguide 50 via the output coupler 56, as indicated by arrow 38'. The output coupler 56 also extends the light 38 in a direction parallel to the X-axis. In this way, the output coupler 56 and the cross-coupler 54 can jointly extend the light 38 in two dimensions before providing the extended light to the eyebox.

[0058] Using a surface-ruffled grating structure to form the cross-coupler 54 allows for higher light throughput compared to using a volume hologram. Performing even-order diffraction with the cross-coupler 54 mitigates any dispersion introduced by the surface-ruffled grating structure. Using a non-diffractive input coupler, such as an input prism 70, allows light 38 to be coupled into the waveguide 50 without introducing dispersion. These examples are merely illustrative, and the cross-coupler 54 can be implemented using a volume hologram if desired, and the input prism 70 can be implemented using other input coupling structures (e.g., holograms or other diffraction gratings, angled surfaces of the waveguide 50, etc.). In another arrangement, the substrate 110 can be omitted, and the surface-ruffled grating substrate 112 can be positioned in contact with the surface 122 of the grating medium 106.

[0059] If desired, optional light homogenization structures, such as one or more beamsplitter layers 124, can be embedded within the grating medium 106. Beamsplitter 124 can be formed using a metallic coating, a dielectric coating, a dielectric layer with a different refractive index, or other partially reflective structures. If desired, one or more beamsplitters 124 can be mounted to surfaces 120, 122, 114, and / or 116. Beamsplitter 124 can transmit a first portion of light 38 while reflecting a second portion of light 38. This can be used to laterally replicate the pupil of light 38 provided to the surface-undulating grating structure 100, the output coupler 56, and ultimately to the eyebox (e.g., to ensure uniform light intensity filling of the eyebox). When more than one beamsplitter 124 is provided in the waveguide 50, the beamsplitters can partially overlap, completely overlap, or not overlap. If desired, the beamsplitters can exhibit variable reflectivity (e.g., a beamsplitter can exhibit greater reflectivity at one end than at the opposite end). Reflectivity can vary continuously or in discrete steps.

[0060] In another suitable arrangement, the surface undulation grating structure 100 may be embedded within the grating medium 106. Figure 6 This is a schematic diagram illustrating how the surface-undulating grating structure 100 can be embedded within the grating medium 106. For example... Figure 6 As shown, substrate 110 can be omitted, and surface-roughened grating substrate 112 can be positioned in contact with surface 122 of grating medium 106 (e.g., grating medium 106 can be molded over surface-roughened grating substrate 112). Surface-roughened grating structure 100 can be embedded within grating medium 106. If desired, an optional transparent dielectric coating 130 can be laminated over surface-roughened grating structure 100 (e.g., coating 130 can be interposed between surface-roughened grating structure 100 and grating medium 106). Coating 130 can be used to improve diffraction efficiency and broaden the angular response of surface-roughened grating structure 100. Coating 130 can be formed of titanium oxide, silicon nitride, tantalum pentoxide, or any other desired material.

[0061] Figure 5 and Figure 6 The example (where the surface undulation grating structure 100 is formed on the side of waveguide 50 opposite to the input prism 70) is merely illustrative. If desired, the surface undulation grating structure 100 can be formed on the same side of waveguide 50 as the input prism 70, such as... Figure 7 and Figure 8 As shown.

[0062] like Figure 7 As shown in the example, the surface-roughened grating substrate 112 can be mounted to the surface 114 of the substrate 108 using an adhesive layer 115. An input prism 70 can be mounted to the surface-roughened grating substrate 112. The input prism 70 can couple light into the waveguide 50. The coupled light can be reflected from one or more surfaces of the waveguide 50 onto the surface-roughened grating structure 100.

[0063] like Figure 8 As shown in the example, substrate 108 can be omitted, and surface-roughened grating substrate 112 can be positioned to contact surface 120 of grating medium 106. Surface-roughened grating structure 100 can be embedded within grating medium 106. Input prism 70 can be mounted to surface-roughened grating substrate 112. Input prism 70 can couple light into waveguide 50. The coupled light can be received directly at surface-roughened grating structure 100, or reflected from one or more surfaces of waveguide 50 toward surface-roughened grating structure 100.

[0064] These examples are merely illustrative. More than one surface-roughened grating structure may be provided on waveguide 50 if desired. In these cases, multiple surface-roughened grating substrates 112 with associated surface-roughened grating structures may be stacked on top of each other. Any desired input coupling structure may be used. If desired, Figure 5 The beam splitter 124 and / or anti-reflective coating 118 are set in Figures 6 to 8 In the waveguide. If needed, it can be... Figure 6 130 layers of coating are stacked on Figure 8 The surface undulation grating structure below 100.

[0065] The surface-undulating grating substrate 112 may be provided with a relatively high refractive index (for example, the refractive index is greater than the refractive index of substrates 108 and 110 and greater than the bulk refractive index of grating medium 106). Figure 9 This is a k-space schematic diagram illustrating how forming a surface-undulating grating substrate 112 with a relatively high refractive index allows the entire field of view of the input prism 70 to couple back into the waveguide 50 so that light 38 of each wavelength can propagate to the output coupler 56 via total internal reflection.

[0066] like Figure 9 As shown, k is plotted on the horizontal axis. x / k media And draw k along the vertical axis y / k media , where k x / k media Let X be the x-component of the k-vector of light propagating through optical system 20B, and k y / k media This represents the Y component. For clarity, Figure 9 The Z component is omitted (e.g., Figure 9 (A two-dimensional projection of the three-dimensional k-space is shown). Region 150 represents the field of view from the output coupler 56 (e.g., as provided at the eyebox). Region 158 represents the light 38 coupled into the waveguide 50 via the input prism 70. Since the input prism 70 does not introduce dispersion, the light coupled into the waveguide 50 is represented by the same region 158 in k-space, independent of wavelength. Similarly, since any dispersion introduced into the system is mitigated as the light couples out of the waveguide, the field of view from the output coupler 56 is represented by the same region 150 in k-space, independent of wavelength.

[0067] The first diffraction performed by the surface-undulating grating structure 100 is schematically represented by arrow 168. Because the first diffraction introduces dispersion, light of different wavelengths is diffracted into different regions in k-space, such as regions 162, 164, and 166. As an example only, region 162 could correspond to a blue wavelength, region 164 to a green wavelength, and region 166 to a red wavelength. For clarity, Figure 9 The example only shows the diffraction of a portion of region 158 located below the horizontal axis. In practice, a portion of region 158 located above the horizontal axis also diffracts in the first diffraction to additional regions below the horizontal axis (e.g., additional regions corresponding to regions 162, 164, and 166).

[0068] Curve 152 represents the lower limit of total internal reflection that can still be supported by waveguide 50. If diffraction from region 158 produces light falling within curve 152, the light will be diffracted at an angle that waveguide 50 cannot support total internal reflection, and the light will propagate inappropriately to the output coupler. Curve 154 represents the upper limit of diffraction supported by the surface-roughened grating substrate 112. If diffraction from region 158 produces light falling outside curve 154, the surface-roughened grating structure 100 will be unable to perform additional diffraction on the light (e.g., couple the light back into the waveguide). In other words, the first diffraction from region 158 needs to produce light falling between curves 152 and 154 in order to provide light to the output coupler 56. However, as Figure 9As shown, the dispersion produced by the first diffraction can generate light with some wavelengths (e.g., the wavelengths associated with region 166) falling outside that region. This may cause the cross-coupler to be unable to direct some wavelengths of light 38 to the output coupler 56.

[0069] To mitigate these effects, the surface-undulation grating substrate 112 may be provided with a material having a relatively high refractive index (e.g., glass or other materials with a relatively high refractive index). The refractive index of the surface-undulation grating substrate 112 may, for example, be greater than the bulk refractive index of the grating medium 106. Providing a surface-undulation grating medium with a relatively high refractive index in this way can extend curve 154 to curve 154', as indicated by arrow 160. When each of the regions 162, 164, and 166 falls between curves 154' and 152, light of each wavelength from the first diffraction can be satisfactorily diffracted back into the waveguide at an angle suitable for total internal reflection (e.g., so that the light is properly directed to the output coupler). Since the surface-undulation grating structure 100 performs an even number of diffractions, the dispersion associated with arrow 168 is diffracted by the corresponding subsequent diffractions in the surface-undulation grating structure 100 (e.g., by the diffraction with the first diffraction). Figure 3 The second diffraction (associated with arrows 92 and 92') is reversed.

[0070] Figure 10 This is a schematic diagram illustrating how the cross-coupler 54 can be formed from a holographic phase grating such as a volume hologram. Figure 10 As shown, an additional grating medium 180 may be stacked on surface 116 of substrate 110. An additional waveguide substrate 182 may be disposed below the grating medium 180. Cross-coupler 54 may include a volume hologram structure 184 in the grating medium 180. The volume hologram structure 184 may include one or more at least partially overlapping volume holograms (e.g., a set of volume holograms each diffracting a corresponding wavelength range and / or incident angle at the same output angle range). The volume holograms may be disposed in a separate layer of the grating medium or may be superimposed on the same grating medium layer of the same volume.

[0071] The input prism 70 couples light 38 into the waveguide 50 and towards the volume hologram structure 184. The volume hologram structure 184 performs an even number of diffractions on the coupled light, expands the light in a direction parallel to the Y-axis, and can be adapted to an angle of total internal reflection to diffract the light back into the waveguide 50. If desired, the volume hologram in the volume hologram structure 184 may include fringes with a constant pitch, variable period, and / or variable fringe angle. The period (e.g., Λ) refers to the spacing between fringes measured along the grating vector (i.e., the vector orthogonal to the fringes); the pitch (e.g., ρ) refers to the distance between fringes measured along the grating surface (e.g., the surface of surface 116 or substrate 182); and the fringe angle refers to the angle between the grating surface normal (e.g., the Z-axis) and the grating vector. In other words, the period can vary on the structure 184 (e.g., it can vary depending on the direction of the grating vector). Figure 10 The pitch can be constant across the entire structure 184, and the stripe angle can vary across the structure 184 (e.g., depending on the position along the X-axis). Figure 10 The position of the X-axis varies. A constant-pitch, variable-period grating helps maintain high diffraction efficiency over a range of incident angles for a given wavelength. This type of volume phase holographic grating can in turn help avoid undesirable color shifts, efficiency losses, and brightness variations in optical systems. This example is merely illustrative, and other types of volume holograms or other holographic phase gratings can be used if desired. If desired, the grating medium 180 can be disposed at the surface 114 of the substrate 108. If desired, an additional grating medium can be stacked on top of the grating medium 180. If desired, one or more beam splitters 124 can be used. Figure 5 ) set in Figure 10 The grating medium 106 or waveguide 50, or elsewhere. If needed, it can be placed within or above the grating medium 106. Figure 10 The output coupler is set at position 56. Figure 5 Anti-reflective coating 130.

[0072] During implementation, DC optical 86 ( Figure 3 It can have a greater brightness than the vertically extended light supplied to the output coupler 56 (e.g., as...). Figure 3 (As indicated by arrows 92 and 92'). To mitigate this brightness difference, the output coupler 56 may be configured with a diffraction efficiency that varies depending on its position along the Y-axis. Figure 11 This is a schematic diagram illustrating how the output coupler 56 can be configured with variable diffraction efficiency.

[0073] like Figure 11As shown, the output coupler 200 may have a central region 200 for receiving DC light 86. The DC light may have a greater brightness than the diffracted light incident on the output coupler 200 within the peripheral region 202. To mitigate this brightness difference, the output coupler 56 may have a greater diffraction efficiency within the peripheral region 202 than within the central region 200. This allows the light supplied to the eyebox to exhibit uniform brightness across the entire eyebox.

[0074] If desired, the output coupler 56 may include any desired number of regions with different diffraction efficiencies (e.g., regions closer to the central horizontal axis of the output coupler 56 exhibit greater diffraction efficiency than regions farther from the central horizontal axis). In another suitable arrangement, the diffraction efficiency of the output coupler 56 may vary continuously depending on its position along the Y-axis. Curve 206 illustrates an exemplary continuous diffraction efficiency of the output coupler 56. As shown by curve 204, the diffraction efficiency may be a smoothly varying curve, exhibiting a minimum at the center of the output coupler 56 and a maximum at the edges of the output coupler 56. This is merely illustrative, and in general, curve 204 may exhibit any other desired shape. If desired, the diffraction efficiency of the output coupler 56 may vary discretely or continuously along the X-axis or any other axis.

[0075] Figure 11 The example (where the diffraction efficiency of output coupler 56 varies depending on its position) is merely illustrative. The diffraction efficiency of cross coupler 54 can be varied depending on its position if desired. Figure 11 The output coupler 56 can be replaced, for example, by a cross coupler 54 (e.g., the cross coupler 54 can have the combination described above). Figure 11 The output coupler 56 has a variable diffraction efficiency. If desired, both the cross coupler 54 and the output coupler 56 can have diffraction efficiencies that vary continuously or discretely depending on their position along one or more axes. If desired, the holograms used to form the cross coupler 54 and / or the output coupler 56 can be comb-shifted. The comb-shifted holograms can include a set of holograms in a first region of the grating medium and a second set of holograms in an adjacent second region of the grating medium. The grating frequencies of the second set can each be located within an adjacent frequency gap between the grating frequencies of the first set (e.g., where the grating vectors of the first and second sets are oriented in the same direction). This, for example, can allow for more uniform diffraction across the entire eyebox.

[0076] The above example of the cross-coupler 54 having two grating structures 72 and 74 is merely illustrative, which are used to extend the light 38 while also causing the light 38 to diffract an even number of times to reduce dispersion. In another suitable arrangement, the cross-coupler 54 may include a single grating structure having fringes oriented in the same direction to extend the light 38 while also causing the light 38 to diffract an even number of times to reduce dispersion. Figure 12 This is a schematic diagram showing how the cross-coupler 54 may include a single grating structure having stripes oriented in the same direction to extend the light 38, while also causing the light 38 to diffract an even number of times to reduce dispersion.

[0077] like Figure 12 As shown, the cross-coupler 54 may include a single grating structure 236 having stripes 78 oriented in a single direction (e.g., stripes having grating vectors oriented in a single direction and characterized by a period Λ). At least some of the cross-couplers 54 may be laterally interposed (e.g., along the X-axis) between the input prism 70 and the output coupler 56 (e.g., where the input prism 70 is laterally interposed between at least some of the cross-couplers 54 and the left edge 220 of the waveguide 50). The input prism 70 may couple light 38 into the waveguide 50, as indicated by arrow 222. The grating structure 236 may extend the coupled light 38 in a first direction (while the output coupler 56 may extend the light in a second direction) and may provide light to the output coupler 56, as indicated by arrow 226. The grating structure 236 may be configured to diffract light 38 an even number of times (e.g., to mitigate dispersion caused by a single diffraction instance) when the light reaches the output coupler 56 or when the light is coupled back into the waveguide to propagate via total internal reflection.

[0078] Figure 12 The examples provided are merely illustrative. A cross-coupler 54 with grating structure 224 can be inserted between other edges of waveguide 50 and output coupler 56. For example, as... Figure 13 As shown, at least some of the grating structures 224 of the cross-coupler 54 can be laterally inserted between the top edge 230 of the waveguide 50 and the output coupler 56. The input prism 70 can be laterally inserted between at least some of the grating structures 224 and the edge 230. In this example, the input prism 38 couples light 38 into the waveguide 50 along the Y-axis, as indicated by arrow 232. The grating structure 224 expands the light 38 before providing it to the output coupler 56 and allows the light 38 to diffract an even number of times, as indicated by arrow 234. The output coupler 56 can expand the light in a direction different from the expansion direction provided by the grating structure 224. Figure 12 and Figure 13In the example, the grating structure 224 may include a surface-roughened grating, a meta-grating, a holographic phase grating such as a volume hologram, etc. The grating structure 224 may be disposed in a layer of the waveguide 50, such as... Figures 5 to 8 and Figure 10 As shown, or at any other desired location on waveguide 50.

[0079] The physical environment refers to the physical world that people can sense and / or interact with without the aid of electronic systems. Physical environments, such as physical parks, include physical objects such as physical trees, physical buildings, and physical people. People can directly sense and / or interact with the physical environment through senses such as sight, touch, hearing, taste, and smell.

[0080] Conversely, a computer-generated reality (CGR) environment refers to a fully or partially simulated environment that people sense and / or interact with via electronic systems (e.g., electronic systems including the display systems described herein). In CGR, a subset of a person's physical motion, or a representation thereof, is tracked, and in response, one or more characteristics of one or more virtual objects simulated in the CGR environment are adjusted in a manner consistent with at least one physical law. For example, a CGR system may detect a person's head rotation and, in response, adjust the graphical content and sound field presented to the person in a manner similar to how such views and sounds change in a physical environment. In some cases (e.g., for accessibility reasons), the adjustment of characteristics of virtual objects in the CGR environment may be done in response to a representation of physical motion (e.g., a voice command).

[0081] Humans can use any of their senses to sense and / or interact with CGR objects, including sight, hearing, touch, taste, and smell. For example, a person can sense and / or interact with an audio object that creates a 3D or spatial audio environment that provides the perception of a point audio source in 3D space. As another example, audio objects can enable audio transparency, which selectively introduces ambient sound from the physical environment, with or without computer-generated audio. In some CGR environments, a person can sense and / or interact only with audio objects. Examples of CGR include virtual reality and mixed reality.

[0082] A virtual reality (VR) environment is a simulated environment designed to provide one or more senses entirely based on computer-generated sensory input. A VR environment includes multiple virtual objects that a person can sense and / or interact with. Examples of virtual objects include trees, buildings, and computer-generated images representing human avatars. A person can sense and / or interact with virtual objects in a VR environment through the simulation of their presence within the computer-generated environment and / or through the simulation of a subgroup of physical movements of a person within the computer-generated environment.

[0083] Compared to VR environments, which are designed to be entirely based on computer-generated sensory input, mixed reality (MR) environments are simulated environments designed to incorporate sensory input from the physical environment, or representations thereof, in addition to computer-generated sensory input (e.g., virtual objects). On the virtual continuum, a mixed reality environment is any state between a purely physical environment as one end and a virtual reality environment as the other end, but not including either end.

[0084] In some MR environments, computer-generated sensory input can respond to changes in sensory input from the physical environment. Additionally, some electronic systems used to present an MR environment can track position and / or orientation relative to the physical environment, enabling virtual objects to interact with real objects (i.e., physical objects or representations of them from the physical environment). For example, a system can cause movement so that virtual trees appear stationary relative to the physical ground. Examples of mixed reality include augmented reality and augmented virtual reality.

[0085] Augmented reality (AR) environments are simulated environments in which one or more virtual objects are overlaid on a physical environment or a representation thereof. For example, an electronic system for presenting an AR environment may have a transparent or semi-transparent display through which a person can directly view the physical environment. The system can be configured to present virtual objects on the transparent or semi-transparent display, allowing a person to perceive the virtual objects overlaid on the physical environment. Alternatively, the system may have an opaque display and one or more imaging sensors that capture images or videos of the physical environment, which are representations of the physical environment. The system combines the images or videos with virtual objects and presents the combination on the opaque display. A person uses the system to indirectly view the physical environment via images or videos of the physical environment and perceive the virtual objects overlaid on the physical environment. As used herein, video of the physical environment displayed on an opaque display is referred to as “pass-through video,” meaning that the system uses one or more image sensors to capture images of the physical environment and uses those images when presenting the AR environment on the opaque display. Alternatively, the system may have a projection system that projects virtual objects onto a physical environment, such as as a hologram or on a physical surface, so that a person can use the system to perceive the virtual objects superimposed on the physical environment.

[0086] Augmented reality environments also refer to simulated environments where the representation of the physical environment is transformed by computer-generated sensory information. For example, in providing pass-through video, a system can transform images from one or more sensors to apply a selected viewpoint (e.g., viewpoint) different from the viewpoint captured by the imaging sensor. Alternatively, the representation of the physical environment can be transformed by graphically modifying (e.g., magnifying) portions of it, such that the modified portion is a representative but not realistic version of the original captured image. Furthermore, the representation of the physical environment can be transformed by graphically removing or blurring portions of it.

[0087] Augmented virtual (AV) environments are simulated environments in which a virtual or computer-generated environment is combined with one or more sensory inputs from a physical environment. Sensory inputs can be representations of one or more characteristics of the physical environment. For example, an AV park could have virtual trees and virtual buildings, but a person's face could be realistically reproduced from an image taken of a physical person. Similarly, virtual objects could adopt the shape or color of a physical object imaged by one or more imaging sensors. Furthermore, virtual objects could use shadows that correspond to the sun's position within the physical environment.

[0088] Many different types of electronic systems enable people to sense and / or interact with a variety of CGR environments. Examples include head-mounted systems, projection-based systems, head-up displays (HUDs), vehicle windshields with integrated display capabilities, windows with integrated display capabilities, displays shaped as lenses designed to be placed on a person's eyes (e.g., similar to contact lenses), headphones / earpieces, speaker arrays, input systems (e.g., wearable or handheld controllers with or without haptic feedback), smartphones, tablets, and desktop / laptop computers. Head-mounted systems may have one or more speakers and an integrated opaque display. Alternatively, head-mounted systems may be configured to receive an external opaque display (e.g., a smartphone). Head-mounted systems may incorporate one or more imaging sensors for capturing images or video of the physical environment, and / or one or more microphones for capturing audio of the physical environment. Head-mounted systems may have transparent or semi-transparent displays instead of opaque displays. Transparent or semi-transparent displays may have a medium through which light representing the image is directed to the person's eyes. The display can utilize digital light projection, OLED, LED, uLED, liquid crystal on silicon, laser scanning light source, or any combination of these technologies. The medium can be an optical waveguide, holographic medium, optical combiner, optical reflector, or any combination thereof. In one embodiment, a transparent or translucent display can be configured to selectively become opaque. Projection-based systems can employ retinal projection techniques that project graphic images onto the human retina. Projection systems can also be configured to project virtual objects onto a physical environment, such as as holograms or on a physical surface. The display systems described herein can be used in these types of systems and for any other desired display arrangements.

[0089] According to one embodiment, an optical system is provided for redirecting light generated by a display module toward an eyebox. The optical system includes: a waveguide; a non-diffractive input coupler configured to couple light generated by the display module into the waveguide; a cross-coupler located on the waveguide and configured to perform an even number of diffractions on the light coupled to the waveguide by the non-diffractive input coupler, the even number of diffractions being configured to propagate the light in the first direction, and the waveguide being configured to propagate the light propagated in the first direction via total internal reflection; and an output coupler located on the waveguide and configured to couple the light propagated by the cross-coupler in the first direction out of the waveguide, while propagating the light in a second direction different from the first direction.

[0090] According to another implementation, the cross coupler includes a surface undulation grating.

[0091] According to another embodiment, the surface undulation grating has stripes oriented in a first direction.

[0092] According to another embodiment, the cross coupler further includes an additional surface undulation grating having stripes oriented in a second direction different from the first direction.

[0093] According to another implementation, the surface undulation grating overlaps with an additional surface undulation grating in the overlapping region of the cross coupler.

[0094] According to another implementation, the overlapping region has a non-uniform width.

[0095] According to another embodiment, a surface undulation grating and an additional surface undulation grating are formed in a first surface undulation grating substrate, and the cross coupler further includes a second surface undulation grating substrate, the second surface undulation grating substrate including at least one additional surface undulation grating and stacked over the first surface undulation grating substrate.

[0096] According to another embodiment, the waveguide includes a first waveguide substrate and a second waveguide substrate, and a medium interposed between the first waveguide substrate and the second waveguide substrate, and a surface undulation grating and an additional surface undulation grating are formed in a surface undulation grating substrate stacked on the first waveguide substrate.

[0097] According to another embodiment, the output coupler includes a louvered reflector embedded in the medium.

[0098] According to another embodiment, the medium includes a grating medium, and the output coupler includes a set of volume holograms recorded in the grating medium.

[0099] According to another implementation, the surface undulation grating has a non-binary distribution.

[0100] According to another embodiment, the waveguide includes a dielectric having a first surface and a second surface, and a waveguide substrate stacked on the first surface dielectric, wherein a surface undulation grating is formed in a surface undulation grating dielectric stacked on the second surface of the dielectric, and the surface undulation grating is embedded in the dielectric.

[0101] According to another embodiment, the medium includes a grating medium, and the output coupler includes a set of volume holograms recorded in the grating medium.

[0102] According to another embodiment, the optical system includes an optically transparent coating located on a surface-undulating grating and interposed between the surface-undulating grating and the grating medium.

[0103] According to another embodiment, the optical system includes an anti-reflection layer on the surface of the waveguide substrate located at the output coupler.

[0104] According to another embodiment, the grating medium has a bulk refractive index, and the refractive index of the surface-undulating grating medium is greater than the bulk refractive index of the grating medium.

[0105] According to another embodiment, the output coupler has a diffraction efficiency that varies depending on the position along the first direction.

[0106] According to another embodiment, the output coupler has a first diffraction efficiency along the central axis of the output coupler and a second diffraction efficiency greater than the first diffraction efficiency at the peripheral edge of the output coupler.

[0107] According to another implementation, the cross-coupler has a diffraction efficiency that varies depending on the position.

[0108] According to another embodiment, the waveguide includes a first waveguide substrate and a second waveguide substrate, and a first grating medium interposed between the first waveguide substrate and the second waveguide substrate. The cross coupler includes a substrate, a second grating medium, and a set of holographic phase gratings located in the second grating medium, and the second grating medium is interposed between the substrate and the first waveguide substrate.

[0109] According to another embodiment, a set of holographic phase gratings includes multiple volumetric holograms that are at least partially overlapping.

[0110] According to another embodiment, the output coupler includes an additional set of holographic phase gratings located in the first grating medium.

[0111] According to another embodiment, a set of holographic phase gratings has stripes with a variable period and a constant pitch at the substrate.

[0112] According to another embodiment, the non-diffractive input coupler includes a non-diffractive input coupler selected from the group consisting of: a prism mounted to the waveguide and an angled edge of the waveguide.

[0113] According to another embodiment, the optical system includes a partially reflective beamsplitter embedded in a waveguide, wherein light coupled into the waveguide by a non-diffractive input coupler is configured to strike the partially reflective beamsplitter before being received at a cross-coupler.

[0114] According to another implementation, the cross-coupler includes a meta-grating located on the waveguide.

[0115] According to one embodiment, a head-mounted device is provided, comprising: a display module that generates image light; a waveguide having a first waveguide substrate and a second waveguide substrate and a grating medium interposed between the first waveguide substrate and the second waveguide substrate; a surface-undulating grating structure formed by the second waveguide substrate and embedded within the grating medium; an input prism mounted to the first waveguide substrate and configured to couple image light into the waveguide and toward the surface-undulating grating structure; and an output coupler having a set of volumetric holograms in the grating medium, the surface-undulating grating structure being configured to: extend image light along a first axis, perform an even number of diffractions on the image light, and guide the image light into the waveguide and toward the output coupler, the output coupler being configured to extend image light along a second axis perpendicular to the first axis and being configured to couple image light out of the waveguide.

[0116] According to another embodiment, the surface undulation grating structure includes a first surface undulation grating and a second surface undulation grating formed in a second waveguide substrate. The first surface undulation grating includes a first fringe having a first orientation, and the second surface undulation grating includes a second fringe having a second orientation that is not parallel to the first orientation. The first surface undulation grating and the second surface undulation grating overlap in the overlapping region of the surface undulation grating structure.

[0117] According to another embodiment, the head-mounted device includes an optically transparent coating located on a first surface undulation grating and a second surface undulation grating and interposed between a second waveguide substrate and a grating medium.

[0118] According to another embodiment, the head-mounted device includes a partially reflective beamsplitter located on a grating medium, and the surface-undulating grating structure is configured to receive image light from the partially reflective beamsplitter.

[0119] According to another embodiment, a set of volume holograms has a diffraction efficiency that varies depending on the position along the first axis.

[0120] According to one embodiment, a display system is provided, the display system comprising: a waveguide; an input coupler configured to couple light into the waveguide; a cross coupler located on the waveguide, the cross coupler including a first diffraction grating structure having a first fringe oriented in a first direction and a second diffraction grating structure having a second fringe oriented in a second direction, the first diffraction grating structure overlapping the second diffraction grating structure in an overlapping region of the cross coupler, the overlapping region being aligned with the input coupler, and the first diffraction grating structure and the second diffraction grating structure each being configured to diffract light coupled to the waveguide by the input coupler an even number of times; and an output coupler located on the waveguide, the output coupler configured to receive light diffracted by the cross coupler, extend the light in a given direction, and couple the light out of the waveguide.

[0121] According to another embodiment, the first diffraction grating structure includes a first surface undulation grating, the second diffraction grating structure includes a second surface undulation grating, both the first and second surface undulation gratings are formed in a surface undulation grating substrate layer adhered to the outer surface of the waveguide, the first and second surface undulation gratings are configured to extend light coupled into the waveguide by the input coupler in an additional direction perpendicular to a given direction, and the output coupler includes a set of volume holograms embedded in the waveguide.

[0122] According to another embodiment, the first diffraction grating structure includes a first element grating located on the waveguide, and the second diffraction grating structure includes a second element grating located on the waveguide.

[0123] The foregoing description is merely illustrative and various modifications can be made to the described implementation scheme. The described implementation scheme can be implemented independently or in any combination.

Claims

1. An optical system for redirecting light generated by a display module toward an eyebox, the optical system comprising: The waveguide includes a first waveguide substrate and a second waveguide substrate; A non-diffraction input coupler, configured to couple the light generated by the display module to the waveguide; A cross-coupler located on the waveguide, wherein the cross-coupler includes a surface-roughened grating formed in a surface-roughened grating substrate, and wherein the waveguide is configured to propagate the light via total internal reflection; and An output coupler located on the waveguide, wherein the output coupler includes a set of volume holograms recorded in a grating medium, wherein the output coupler is configured to couple light out of the waveguide, wherein the grating medium has opposing first and second surfaces, wherein a third surface of a first waveguide substrate contacts the first surface of the grating medium, wherein a surface-undulating grating substrate is stacked on a fourth surface of the first waveguide substrate, and wherein a second waveguide substrate is stacked on the second surface of the grating medium.

2. The optical system according to claim 1, wherein the fifth surface of the second waveguide substrate contacts the second surface of the grating medium.

3. The optical system according to claim 2, wherein the non-diffraction input coupler is stacked on the second waveguide substrate.

4. The optical system of claim 2, wherein the non-diffraction input coupler is mounted to the surface-undulating grating substrate.

5. The optical system of claim 2, wherein the surface-undulating grating substrate has a first refractive index, wherein the surface-undulating grating substrate is adhered to the first waveguide substrate by an adhesive layer, and wherein the adhesive layer has a second refractive index less than the first refractive index.

6. The optical system of claim 2, wherein the beam splitter is embedded within the grating medium.

7. The optical system of claim 2, wherein the antireflective coating is laminated on a portion of the first surface of the grating medium, and wherein the portion is aligned with the set of volume holograms.

8. The optical system of claim 5, wherein the non-diffraction input coupler is stacked on the waveguide substrate.

9. The optical system of claim 5, wherein the non-diffraction input coupler is stacked on the surface-undulating grating substrate.

10. A head-mounted device, comprising: Display module, which generates image light; Waveguide, the waveguide having a waveguide substrate; A cross-coupler having a surface undulation grating structure formed in a surface undulation grating substrate, and the surface undulation grating structure being configured to guide the image light into the waveguide and toward the output coupler; An input coupler configured to couple the image light into the waveguide and toward the surface-undulating grating structure; An output coupler having a set of volumetric holograms formed in a grating medium, and the output coupler being configured to couple the image light out of the waveguide, wherein the surface-undulating grating structure is embedded within the grating medium, and wherein the grating medium is interposed between the waveguide substrate and the surface-undulating grating substrate.

11. The head-mounted device of claim 10, wherein the input coupler comprises an input prism stacked on the waveguide substrate.

12. The head-mounted device of claim 10, wherein the input coupler comprises an input prism stacked on the surface-undulating grating substrate.

13. The head-mounted device of claim 10, wherein a transparent dielectric coating is laminated on the surface undulating grating structure.

14. A display system, comprising: A waveguide, the waveguide comprising a waveguide substrate having opposing first and second surfaces; An input coupler configured to couple light into the waveguide, wherein the input coupler is mounted to the first surface of the waveguide substrate; A cross-coupler located on the waveguide, wherein the cross-coupler is configured to diffract the light coupled to the waveguide by the input coupler, and wherein the cross-coupler includes a surface undulation grating structure in a surface undulation grating substrate. An output coupler located on the waveguide, wherein the output coupler is configured to receive light diffracted by the cross coupler and couple the light out of the waveguide, wherein the output coupler includes a set of volume holograms recorded in a grating medium, wherein the grating medium is stacked on the second surface of the waveguide substrate, and wherein the grating medium is interposed between the waveguide substrate and the surface-undulating grating substrate.

15. The display system of claim 14, wherein the first surface of the waveguide substrate is an outer surface.

16. The display system of claim 14, wherein the input coupler comprises a prism.

17. The display system of claim 14, wherein the third surface of the grating medium contacts the second surface of the waveguide substrate.

18. The display system of claim 17, wherein the waveguide further comprises an additional waveguide substrate interposed between the grating medium and the surface-undulating grating substrate.

19. The display system of claim 18, wherein the fourth surface of the grating medium contacts the fifth surface of the additional waveguide substrate.

20. The display system of claim 19, wherein the surface-undulating grating substrate is adhered to the sixth surface of the additional waveguide substrate.

Citation Information

Patent Citations

  • Optical waveguide lens and display device

    CN107797287A

  • Optical systems for displays

    CN109416470A

  • Input coupling

    US20180149791A1