Methods, systems, and articles for augmented reality devices with layered eyepieces

Abstract

An augmented reality system includes an eyepiece, the eyepiece further including a polymer stack; a monolithic glassy optical element or a dual glassy optical element sandwiching a polymer laminate, the first side or a portion of the first side of which is laminated to the polymer laminate; a set of surface relief grating structures implemented on the second side or a portion of the second side of the monolithic glassy optical element, and a projector projecting a beam of one or more images at a plurality of different depths onto the user's eye through an eyepiece. Creating and presenting virtual content to a user using at least the above eyepiece is also described.

Description

[0001] Cross - Reference to Related Applications

[0002] This application claims the benefit of U.S. Provisional Patent Application Serial No. 63 / 382,675, filed on November 7, 2022, entitled "Methods, Systems, and Products for an Extended Reality Device with a Hierarchical Eyepiece". The content of the above - mentioned U.S. Provisional Application is hereby expressly incorporated by reference in its entirety for all purposes.

[0003] Copyright Notice

[0004] A portion of the disclosure of this patent document contains material that is subject to copyright protection. The copyright owner has no objection to the facsimile reproduction by anyone of the patent document or the patent disclosure, as it appears in the Patent and Trademark Office patent file or records, but otherwise reserves all copyrights. Background Art

[0005] Modern computing and display technologies have facilitated the development of so - called "virtual reality" (VR), "augmented reality" (AR) experiences, "mixed reality" (MR) experiences, and / or extended reality (XR) experiences (collectively referred to hereinafter as "extended reality" and / or "XR") systems, in which digitally reproduced images or portions thereof are presented to a user in a manner that appears real or can be perceived as real. VR scenarios typically involve presenting digital or virtual image information without transparency to other actual real - world visual inputs, while AR or MR scenarios typically involve presenting digital or virtual image information as an enhancement to the visualization of the real world surrounding the user, such that the digital or virtual image (e.g., virtual content) appears to be part of the real world. However, MR can integrate virtual content in a context - meaningful way, while AR cannot.

[0006] The application scope of extended reality technologies has expanded from, for example, gaming, military training, simulation - based training, etc. to productivity and content creation and management. Extended reality systems are capable of creating virtual objects that appear real or are perceived as real. When such capabilities are applied to Internet technologies, the functions of the Internet and the user experience can be further extended and enhanced, such that the use of network resources is no longer limited by the flat two - dimensional representation of web pages.

[0007] Typically, an augmented reality (AR) / mixed reality (MR) eyepiece stack is composed of separate red (R), green (G), and blue (B) waveguide layers stacked together, with a gap of dozens of micrometers between consecutive layers. A multi-pupil liquid crystal on silicon (LCOS) projector is designed to direct light of each color into a corresponding input coupling grating (ICG) (e.g., direct green light into the ICG of the green waveguide layer). However, since the ICGs in the super-pupil must be very close, stray light from the wrong color (usually from the diffraction of the LCOS) may propagate into adjacent ICGs. The stray light can cause ghosting or degrade optical properties such as contrast.

[0008] Coherent artifacts do not look aesthetically pleasing in the virtual image and the situation becomes worse when using a single-wavelength or narrow-wavelength-range light source in the projection source. In addition, the requirements for the "lens" in the eye-wear device have been studied to determine what the outermost component needs to have to meet regulatory standards. In modern extended reality goggle designs, the outermost component is an eye-tracking layer or a laminated thin-film stack that must meet various standards. Moreover, if one wants to achieve a "minimal" glasses-like form factor, i.e., only waveguides (without other lenses or films), the impact resistance of the waveguides themselves needs to be addressed. Current high-refractive-index glasses themselves cannot even meet ANSI Z80.3, so chemically strengthened cover glasses are usually used to protect the waveguides, or some plastic lenses may be required to protect the waveguides. However, both methods will increase the material thickness, air gap, and mass, which is not ideal.

[0009] Therefore, there is a need for methods, systems, and computer program products for extended reality systems. SUMMARY OF THE INVENTION

[0010] In one or more embodiments, methods, systems, and articles for extended reality systems are disclosed. Some embodiments relate to a method of enhancing the integrity and / or functionality of an optical component by laminating a fragile optical component with a polymer laminate in an extended reality system.

[0011] Some embodiments relate to an extended reality system having an eyepiece that includes a single glass-like component with one side or a portion of that side laminated to a polymer laminate or a double glass-like optical component sandwiching a polymer laminate, where the polymer laminate maintains an appropriate refractive index matching the glass, has low haze, low scatter, and high transparency, thus not significantly degrading optical properties while improving the component's ability to meet various regulatory standards.

[0012] Some embodiments relate to methods for manufacturing extended reality eyepieces that include a single glass-like component or a dual-glass optical component sandwiching a polymer laminate, where one side or a portion of one side for an extended reality (XR) device is laminated to the polymer laminate.

[0013] Some embodiments relate to one or more methods for presenting extended reality content to a user using an extended reality device that includes an eyepiece, which also includes a single-piece glass-like component or a dual-glass optical component sandwiching a polymer laminate, where one side or a portion of one side for an extended reality (XR) device is laminated to the polymer laminate.

[0014] In these embodiments, a frame and a projector can be identified. A first optical component having a first refractive index value, a first side, and a second side can also be identified. A stratified waveguide stack can be produced at least by laminating a polymer laminate having a second refractive index value to the first side of the first optical component, where the second refractive index value is determined at least in part based on the first refractive index value of the first optical component. An eyepiece of an extended reality system can be formed at least by integrating the stratified waveguide stack into the frame and aligning the stratified waveguide stack with the projector such that the projector transmits a light beam for an image signal to a user's eye through an extended exit pupil of the stratified waveguide stack.

[0015] Some embodiments relate to an apparatus for manufacturing an eyepiece of an extended reality system by implementing the method recited in claim 16.

[0016] In some other embodiments, a method for an extended reality system can include actions of identifying a frame, a projector, and an eyepiece of the extended reality system. The method can also include an action of expanding a field of view of a primary color light beam at least by transmitting the primary color light beam through an optical component and a polymer laminate fixed to at least a portion of the optical component. In these embodiments, the optical component has a first refractive index value, the polymer laminate has a second refractive index value that is determined at least in part based on the first refractive index value of the optical component in the eyepiece, and the polymer laminate includes color selective properties for the primary colors.

[0017] Some embodiments relate to a system for producing an extended field of view by implementing the above methods.

[0018] Some embodiments relate to one or more optical stacks having a plurality of optical hardware elements. Some embodiments relate to a hardware product that, through a process, manufactures an extended reality eyepiece in an extended reality (XR) device to include a single-piece glass-like component or a dual-glass optical component sandwiching a polymer laminate, where one side or a portion of one side is laminated to the polymer laminate.

[0019] In these embodiments, the optical stack of multiple optical components includes a monolithic glassy optical element having a first side and a second side, a polymer laminate fixed to the first side of the monolithic glassy optical element, and a set of surface relief grating structures implemented on the second side of the monolithic glassy optical component.

[0020] Some embodiments relate to a method of creating virtual content perceived by a user by using the optical stack of the above-mentioned multiple optical components.

[0021] Some embodiments relate to an extended reality device for projecting virtual content to a user, wherein the extended reality device includes an eyepiece, and the eyepiece further includes a single glassy component with one side or a part of that side laminated to the polymer laminate or a double-glassy optical component sandwiching the polymer laminate.

[0022] Some embodiments relate to a hardware system that can be invoked to execute any method, process, or sub-process disclosed herein. The hardware system may include or relate to an extended reality system having at least one processor or at least one processor core that executes one or more execution threads to execute any method, process, or sub-process disclosed herein in some embodiments. The hardware system may also include one or more forms of non-transitory machine-readable storage media or devices for temporarily or persistently storing various types of data or information. Some exemplary modules or components of the hardware system can be found in the system architecture overview section below.

[0023] In these embodiments, the system may include an eyepiece, the eyepiece including a laminate; a monolithic glassy optical element having a first side or a part of the first side laminated to the polymer laminate or a double-glassy optical element sandwiching the polymer laminate; a set of surface relief grating structures implemented on the second side or a part of the second side of the monolithic glassy optical element; and a projector that projects a beam of one or more images at multiple different depths onto the user's eyes through the eyepiece.

[0024] In some of these embodiments, the laminate includes a polymer layer or a non-polymer layer, and the polymer layer includes a polycarbonate layer of the optical component, a polyethylene terephthalate layer of the optical component, or a cycloolefin polymer layer of the optical component, and the non-polymer layer includes a glass layer of the optical component, a glassy layer of the optical component, a lithium niobate (LiNbO3) layer of the optical component, or a silicon carbide (SiC) layer of the optical component.

[0025] Additionally or alternatively, the laminate includes a first layer of optical components, the first layer of optical components being coated with a coating having a coating refractive index value, wherein the coating includes a silicon carbide coating having the coating refractive index value of about 2.5 to 2.6, a titanium oxide coating having the coating refractive index value of about 2.2 to 2.5, a zirconium oxide coating having the coating refractive index value of about 2.1, a silicon nitride or silicon oxynitride coating having the coating refractive index value of about 1.8 to 2.0, a silicon oxide coating having the coating refractive index value of about 1.45, a magnesium fluoride coating having the coating refractive index value of about 1.38, or a polymer coating having the coating refractive index value between about 1.2 and 1.6.

[0026] In some of these embodiments of the above system, the laminate includes multiple layers of optical components, the multiple layers including at least one of a first layer of organic material, a second layer of inorganic material, a third layer of crystalline material, or a fourth layer of birefringent material. In some of the above embodiments, the multiple layers of the optical components include a high refractive index value in the range of 1.7 to 2.65. Additionally or alternatively, the multiple layers of the optical components include a low refractive index value less than or equal to 1.7.

[0027] In some embodiments of the above system, the laminate includes a bend having a curvature of 2000 mm to 200 mm. Additionally or alternatively, the laminate includes multiple layers having multiple respective thicknesses, the multiple respective thicknesses corresponding to one or more thickness variations, and the one or more thickness variations include a range of 0 to 100 nm, less than 200 nm, less than 300 nm, less than 800 nm, or less than 1000 nm, and the multiple layers include at least one of a first optical component having a rectangular prism shape or a second optical component having a wedge shape.

[0028] In some embodiments of the above system, a coupling grating is implemented on the wedge-shaped optical component and includes a first thickness near the coupling grating and a second thickness less than the first thickness. Additionally or alternatively, the laminate includes two layers of optical components, and each of the two layers of the optical components has a respective thickness greater than or equal to 10 microns. Additionally or alternatively, the laminate further includes an intermediate layer located between the two layers of optical components. Additionally or alternatively, the intermediate layer has a thickness greater than or equal to 10 nm.

[0029] In some embodiments, the laminate includes multiple diffraction features providing a light guiding function, and the multiple diffraction features include an embedded grating structure having air pockets. In some of these embodiments, the laminate includes separate multiple diffraction features on an outer surface of the laminate.

[0030] In some embodiments of the above system, the laminate includes a plurality of diffractive features that provide a light guiding function, and the plurality of diffractive features include an embedded grating structure without any air holes. In some of the above embodiments, the laminate includes a separate plurality of diffractive features located on an outer surface of the laminate.

[0031] Some embodiments relate to an article that includes a non-transitory machine-accessible storage medium storing a series of instructions thereon, which, when executed by at least one processor or at least one processor core, cause the at least one processor or the at least one processor core to perform any method, process, or subprocess disclosed herein. Some exemplary forms of non-transitory machine-readable storage media can also be found in the System Architecture Overview section below. BRIEF DESCRIPTION OF THE DRAWINGS

[0032] This patent or application file contains at least one color drawing. The United States Patent and Trademark Office will provide a copy of this patent or patent application publication with color drawings upon request and payment of the necessary fee.

[0033] The drawings illustrate the design and utility of various embodiments of the present invention. It should be noted that the figures are not drawn to scale, and elements of similar structure or function are denoted by the same reference numeral throughout the figures. To better understand how to obtain the above and other advantages and objects of various embodiments of the present invention, the present invention briefly described above will be described in more detail with reference to specific embodiments of the present invention shown in the drawings. It should be understood that these drawings only depict typical embodiments of the present invention and should not be considered as limiting its scope. The present invention will be described and explained with additional specificity and detail by using the drawings, wherein:

[0034] Figure 1A-1 A simplified example of a wearable XR device with a waist pack located outside the XR glasses in some embodiments is shown.

[0035] Figure 1A-2 and 1A-3 More example schematic diagrams of the optical system of an extended reality device in some embodiments are shown.

[0036] Figure 1B An example schematic light stack of an extended reality device in some embodiments is shown.

[0037] Figure 1C-1I Some simplified example schematic diagrams of a stack of optical components that can be used as an eyepiece of an extended reality device in one or more embodiments are shown.

[0038] Figure 1J-1K Some simplified example manufacturing options of the optical components of the extended reality device described herein in one or more embodiments are shown.

[0039] Figure 2A Shows examples of laser projector light entering and leaving in some embodiments, showing a screen-door effect in the near-field image.

[0040] Figure 2B Shows examples of pupil duplication in some embodiments.

[0041] Figure 2C Shows an example stack architecture in some embodiments using an embedded intermediate low-refractive-index film to improve pupil duplication.

[0042] Figure 2D Shows an example stack in some embodiments using an embedded relief structure with or without filling of a low-refractive-index material and an embedded intermediate low-refractive-index layer to improve pupil duplication.

[0043] Figure 2E Shows another example stack architecture in some embodiments using an embedded relief structure with or without filling of a low-refractive-index material and an embedded intermediate low-refractive-index layer to improve pupil duplication.

[0044] Figure 2F Shows another example stack structure in some embodiments showing significant improvement in pupil duplication using a dual ICG (coupled-in grating) and CPE (combined pupil expander), where a second set is embedded and separated by a low-refractive-index intermediate layer.

[0045] Figure 2G Shows some simplified example stack architectures in some embodiments located on one or both sides of a substrate and a second substrate having an additional intermediate low-refractive-index layer.

[0046] Figure 2H Shows some example stack architectures in some embodiments located on one or both sides of a substrate and a second substrate having an additional intermediate low-refractive-index layer.

[0047] Figure 2I Shows some example processes in some embodiments for creating an embedded grating using a pre-patterned relief structure with any type of rigid or flexible substrate.

[0048] Figure 2J Shows some embodiments using Figure 2I Some example variations of the thin-film type of the process shown.

[0049] Figure 2K-2L Shows some embodiments using Figure 2J Some example variations of the thin-film type of the process shown.

[0050] Figure 2L Shows some embodiments usingFigure 2J Some example variations of the thin film type of the process shown.

[0051] Figure 2M-2N Some example surface relief structure stacks for multi-wavelength waveguide stacks in some embodiments are shown.

[0052] Figure 2O Some example surface relief structure stacks for layered multi-wavelength waveguide stacks in some embodiments are shown.

[0053] Figure 3A Some working examples of laminating to an existing thin waveguide substrate in some embodiments are shown, which increases the total thickness and makes the component more robust, while enhancing the blue and / or red uniformity of a larger FoV (field of view).

[0054] Figure 3B An example stack architecture with a low refractive index cover glass in some embodiments is shown, which is laminated to a high refractive index etched waveguide via a refractive index matching UV curable adhesive.

[0055] Figure 3C Some working examples of laminating to an existing thin waveguide substrate in some embodiments are shown, which increases the total thickness and makes the component more robust, while enhancing the blue and / or red uniformity of a larger FoV (field of view).

[0056] Figure 3D A high-level block diagram of a process or system for delivering virtual content to a user using a wearable electronic device with a stack of optical components or elements in some embodiments is shown.

[0057] Figure 4 An example schematic diagram illustrating the data flow in an XR system configured to provide an extended reality (XR) content experience for interacting with the physical world according to some embodiments is shown.

[0058] Figure 5A A detailed schematic diagram of a light guiding optical component of an optical system of an extended reality system in one or more embodiments.

[0059] Figure 5B A more detailed perspective view of a light guiding optical component of an optical system of an extended reality system in one or more embodiments is shown.

[0060] Figure 6 A display system in some embodiments is shown in more detail.

[0061] Figure 7 An example user physical environment and system architecture for managing and displaying productivity applications and / or resources in a three-dimensional virtual space using an extended reality system or device in one or more embodiments is shown.

[0062] Figure 8 Shows a computerized system on which some of the methods described herein can be implemented.

[0063] Figure 9 Shows an example architecture 2500 of an electronic device operably coupled to an optical system or XR device in one or more embodiments.

[0064] FIG. 10A shows a portion of a simplified example eyepiece stack with an intermediate low refractive index layer in some embodiments.

[0065] FIG. 10B-1 shows two corresponding portions of two simplified schematic diagrams of an eyepiece stack in some embodiments.

[0066] FIG. 10B-2 shows some example images that show the results of image uniformity after gamma adjustment for one of the simplified schematic diagrams shown in FIG. 10B-1.

[0067] FIG. 10C-1 shows a portion of a simplified schematic diagram of an eyepiece stack in some embodiments.

[0068] FIG. 10C-2 shows some example images that show the results of image uniformity after gamma adjustment for one of the simplified schematic diagrams shown in FIG. 10C-1.

[0069] FIG. 10D-1 shows a portion of a simplified schematic diagram of an eyepiece stack in some embodiments.

[0070] FIG. 10D-2 shows some example images that show the results of image uniformity after gamma adjustment for one of the simplified schematic diagrams shown in FIG. 10D-1.

[0071] FIG. 10E-1 shows a portion of a simplified schematic diagram of an eyepiece stack in some embodiments.

[0072] FIG. 10E-2 shows some example images that show the results of image uniformity after gamma adjustment for one of the simplified schematic diagrams shown in FIG. 10E-1.

[0073] FIG. 11A shows two corresponding portions of two simplified schematic diagrams of an eyepiece stack in some embodiments.

[0074] FIG. 11B shows a portion of a simplified schematic diagram of an eyepiece stack in some embodiments.

[0075] FIG. 11C shows a portion of a simplified schematic diagram of an eyepiece stack in some embodiments.

[0076] Figure 11D shows a portion of a simplified schematic diagram of an eyepiece stack in some embodiments.

[0077] Figure 11E shows a portion of a simplified schematic diagram of an eyepiece stack in some embodiments.

[0078] Figure 11F shows a portion of a simplified schematic diagram of an eyepiece stack in some embodiments.

[0079] Figure 11G shows a portion of a simplified schematic diagram of an eyepiece stack in some embodiments.

[0080] Figure 11H shows a portion of a simplified schematic diagram of an eyepiece stack in some embodiments.

[0081] Figure 12A shows two corresponding portions of two simplified schematic diagrams of an eyepiece stack in some embodiments.

[0082] Figure 12B shows two corresponding portions of two simplified schematic diagrams of an eyepiece stack in some embodiments.

[0083] Figure 12C shows two corresponding portions of two simplified schematic diagrams of an eyepiece stack in some embodiments.

[0084] Figure 12D shows a portion of a simplified schematic diagram of an eyepiece stack in some embodiments.

[0085] Figure 12E shows a portion of a simplified schematic diagram of an eyepiece stack in some embodiments.

[0086] Figure 13A shows two corresponding portions of two simplified schematic diagrams of an eyepiece stack in some embodiments.

[0087] Figure 13B shows a portion of a simplified schematic diagram of an eyepiece stack in some embodiments.

[0088] Figure 14A shows two corresponding portions of two simplified schematic diagrams of an eyepiece stack in some embodiments.

[0089] Figure 14B shows two corresponding portions of two simplified schematic diagrams of an eyepiece stack in some embodiments.

[0090] Figure 14C shows a portion of a simplified schematic diagram of an eyepiece stack in some embodiments. Detailed Description

[0091] In the following description, in order to provide a thorough understanding of the various disclosed embodiments, certain specific details are set forth. However, those skilled in the art should understand that the embodiments can be practiced without one or more of these specific details, or with other methods, components, materials, and so on. In other instances, well-known structures related to computer systems, server computers, and / or communication networks are not shown or described in detail to avoid unnecessarily obscuring the description of the embodiments.

[0092] It should be noted that, unless the context otherwise requires, throughout the specification and the following claims, the word "comprising" and its variants, such as "comprises" and "comprising", should be construed in an open, inclusive sense, that is, "including but not limited to".

[0093] It should also be noted that throughout the specification, the phrase "in one embodiment" or "in an embodiment" means that a particular feature, structure, or characteristic described in connection with that embodiment is included in at least one embodiment. Thus, the phrases "in one embodiment" or "in an embodiment" that appear throughout this specification do not necessarily refer to the same embodiment. Additionally, the particular features, structures, or characteristics may be combined in any suitable manner in one or more embodiments. Further, the singular forms "a", "an", and "the" as used in this specification and the appended claims include plural referents unless the context clearly dictates otherwise. It should also be noted that the term "or" is generally used in its inclusive sense, including "and / or", unless the context clearly dictates otherwise.

[0094] Various embodiments will now be described in detail with reference to the accompanying drawings, which are provided as illustrative examples of the present invention so that those skilled in the art can practice the present invention. It is noted that the following drawings and examples are not intended to limit the scope of the present invention. When certain elements of the present invention can be implemented, in part or in whole, using known components (or methods or processes), only those parts of these known components (or methods or process flows) that are necessary for understanding the present invention will be described, and the detailed description of the other parts of these known components (or methods or processes) will be omitted so as not to obscure the present invention. The various embodiments relate to the management of virtual reality ("VR"), augmented reality ("AR"), mixed reality ("MR"), and / or extended reality ("XR") systems (collectively referred to as "XR systems" or extended reality systems) in various embodiments.

[0095] Figure 1A-1 A simplified example of a wearable XR device having a hip pack located outside the XR glasses in some embodiments is shown. More specifically, Figure 1A-1A simplified example of a user-wearable VR / AR / MR / XR system is shown. The system includes an optical subsystem 102A and a processing subsystem 104A, and may include multiple personal augmented reality system instances, e.g., a personal augmented reality system for each user. Any neural network described herein can be embedded in whole or in part within or on the wearable XR device. For example, some or all of the neural networks described herein, as well as other peripheral devices (e.g., ToF or time-of-flight sensors), can be embedded separately in the processing subsystem 104A, separately in the optical subsystem 102A, or distributed between the processing subsystem 104A and the optical subsystem 102A.

[0096] Some embodiments of the VR / AR / MR / XR system may include an optical subsystem 102E that delivers virtual content to the user's eyes, and a processing subsystem 104A that performs multiple processing tasks to present the relevant virtual content to the user. The processing subsystem 104A may take the form of, for example, a waist pack that can be conveniently attached to the belt or waistline of pants during use. Alternatively, the processing subsystem 104A may also take the form of, for example, a personal digital assistant or a smartphone-type device.

[0097] The processing subsystem 104A may include one or more processors, e.g., one or more microcontrollers, microprocessors, graphics processing units, digital signal processors, application-specific integrated circuits (ASICs), programmable gate arrays, programmable logic circuits, or other circuits that embody logic or are capable of executing logic embodied in instructions encoded in software or firmware. The processing subsystem 104A may include one or more non-transitory computer or processor-readable media, e.g., volatile and / or non-volatile memory, such as read-only memory (ROM), random access memory (RAM), static RAM, dynamic RAM, flash memory, EEPROM, etc.

[0098] The processing subsystem 104A may be communicatively coupled to the head-mounted component. For example, the processing subsystem 104A may be communicatively connected to the head-mounted component via one or more wires or optical fibers, via a cable with appropriate connectors. The processing subsystem 102A and the optical subsystem 104A may communicate according to various wired protocols, such as and protocol.

[0099] Alternatively or additionally, the processing subsystem 104A can be communicatively coupled to the head-mounted assembly in a wireless manner. For example, the processing subsystem 104A and the optical subsystem 102A can each include a transmitter, a receiver, or a transceiver (collectively referred to as a radio) and an associated antenna to establish wireless communication therebetween. The radio and the antenna can take various forms. For example, the radio can have short-range communication capabilities and can employ communication protocols such as or certain protocols compliant with the IEEE 802.11 standard (e.g., IEEE 802.11n, IEEE 802.11a / c). Various other details of the processing subsystem and the optical subsystem have been described in U.S. Patent Application No. 14 / 707,000, entitled "Eye Tracking Systems and Methods for Augmented Reality or Extended Reality," filed on May 8, 2015, the content of which is hereby expressly incorporated by reference in its entirety for all purposes.

[0100] Figure 1A-2 A basic optical system 100 for projecting an image on a single depth plane is shown. System 100 includes a light source 120 and a LOE 190 having a diffractive optical component (not shown) and an associated input grating 192 ("ICG"). The light source 120 can be any suitable imaging light source, including but not limited to DLP, LCOS, LCD, and fiber optic scanning displays. These light sources can be used in conjunction with any system 100 described herein. The diffractive optical component can be of any type, including volume relief or surface relief. The ICG 192 can be a reflective aluminum-containing portion of the LOE 190. Alternatively, the ICG 192 can be a transmissive diffractive portion of the LOE 190. When using system 100, a virtual light beam 210 from the light source 120 enters the LOE 190 via the ICG 192 and propagates along the LOE 190 by substantially total internal reflection ("TIR") for display to the user's eye. The light beam 210 is virtual because it encodes an image or a portion thereof as directed by system 100. It should be understood that although Figure 1A-2 only one light beam is shown, multiple light beams encoding the image can enter the LOE190 from various angles through the same ICG 192. A light beam "entering" or "being admitted to" the LOE includes, but is not limited to, a light beam that interacts with the LOE and thereby propagates along the LOE by substantially total internal reflection (TIR). Figure 1A-2The system 100 shown can include various light sources 120 (e.g., LEDs, OLEDs, lasers, and masked wide area / bandwidth emitters). Light from the light sources 120 can also be transmitted to the LOE 190 via an optical fiber cable (not shown). In some embodiments, the waveguide with a diffractive element described herein can be designed to work with light having one or more wavelengths in the range of 440 - 460 nm of blue light or "blue-colored light" (a color of light between blue and white), although the wavelength of blue light typically ranges from 450 - 495 nm; one or more wavelengths in the range of 510 - 560 nm of green light or "green-colored light" (a color of light between green and white), although the wavelength of green light typically ranges from 500 - 570 nm; and / or one or more wavelengths in the range of 600 - 640 nm of red light or "red-colored light" (a color of light between red and white), although the wavelength of red light typically ranges from 620 - 750 nm).

[0101] Figure 1A-3 Another optical system 100' is shown, which includes a light source 120, a corresponding plurality (e.g., three) of LOEs 190, and an input grating 192. The optical system 100' also includes three beam splitters 162 (for guiding light to the corresponding LOEs) and three light valves 164 (for controlling the time of illumination of the LOEs). The light valves 164 can be any suitable optical light valve, including but not limited to a liquid crystal light valve. Figure 1A-3 The beam splitters 162 and the light valves 164 are schematically shown, but the configuration that describes the function of the optical system 100' is not specified. The embodiments described below include specific optical component configurations that solve various problems of the optical system.

[0102] When using system 100', the virtual light beam 210 from the light source 120 is split into three virtual sub-beams / bundles 210' by the beam splitter 162. The three beam splitters also redirect the bundles to the corresponding input gratings 192. After the bundles enter the LOE 190 through the corresponding input gratings 192, they propagate along the LOE 190 by means of basic TIR (not shown), where they interact with additional optical structures and are thus presented to the user's eyes. The surface of the input grating 192 at the far end of the optical path can be coated with an opaque material (e.g., aluminum) to prevent light from passing through the input grating 192 and reaching the next LOE 190. The beam splitter 162 can be combined with a wavelength filter to produce red, green, and blue colored bundles. Three monochromatic LOEs 190 are required to display a color image on a single depth plane. Alternatively, each LOE 190 can present a part of a larger single depth plane image area, which is arranged angularly and laterally (''tiled field of view'') within the user's field of view in the same color or different colors. Although all three virtual bundles 210' are depicted as passing through the corresponding light valves 164, typically only one bundle 210' is selectively allowed to pass through the corresponding light valve 164 at a time. In this way, system 100' can coordinate the image information encoded in the light beam 210 and the bundles 210' with the LOE 190, and the bundle 210 and its encoded image information will be transmitted to the user's eyes through the LOE 190.

[0103] Figure 1B An example schematic light stack of an extended reality device in some embodiments is shown. On the object side (e.g., close to the objects in the environment perceived by a user wearing an XR device and far from the user's eyes), this example exemplary light stack can include a decorative window 102B, one or more front refractive lenses 104B, one or more reflective polarizers and depolarizers 106B, one or more dimming optical components 108B, and / or an eyepiece 110B having one or more optical components. It should be noted that the XR device includes at least one of the above optical components, while the other optical components are optional. In addition, each of the above types of optical components can have one or more corresponding optical components, although each type is optional in different embodiments.

[0104] In some embodiments, a polarizer or polariser includes a filter that allows light waves of a specific polarization to pass through while blocking light waves of other polarizations. The polarizer can filter a light beam with an undefined or mixed polarization into a light beam with a defined polarization, i.e., polarized light. Some example types of polarizers include linear polarizers and circular polarizers. In addition to visible light, polarizers can also be used for other types of electromagnetic waves, such as radio waves, microwaves, and X-rays.

[0105] A depolarizer or a depolarizer is an optical device used to disrupt the polarization of light. An ideal depolarizer outputs light with a random polarization regardless of the input, but all practical depolarizers produce a pseudo-random output polarization. Optical systems are usually sensitive to the polarization of the light reaching them (e.g., grating-based spectrometers). Unwanted polarization in the input of such a system can lead to errors in the system output.

[0106] In some embodiments, the dimming optical component or display is an optical lens with a brightness lower than that of, for example, an optical waveguide stack of a light waveguide having one or more waveguides with diffractive and / or holographic optical components, and its main function in some embodiments is to present virtual content to the user. The eyepiece 110B includes a lens or a combination of lenses, and the lenses described herein include a single optical component, which can be connected to one or more other single optical components (e.g., one or more waveguides, one or more adhesive layers, one or more polymer films, etc.) in various ways.

[0107] On the user side (e.g., away from the objects in the environment perceived by the user wearing the XR device and closer to the user's eyes), the exemplary light stack may include, for example but not limited to, one or more LED (light-emitting diode) layers 112B (e.g., MILR LED layers, etc.), one or more post-refractive lenses 114B, one or more medical prescription (RX) inserts 116B (e.g., for correcting myopia, hyperopia, astigmatism, etc.), and the insert is closer to or closest to the eyes 118B of the user wearing the XR device. It should also be noted that the XR device includes at least one of the above optical components on the user side, while other components are optional. In addition, each of the above types of elements may have one or more corresponding elements, although each type is optional in different embodiments.

[0108] Figure 1C-1I Some simplified example schematic diagrams of an optical component stack that can be used as an eyepiece of an extended reality device in one or more embodiments are shown. Figure 1C An example of a layered waveguide architecture is shown, which includes an optical component 102C (e.g., a brittle optical material, glass, single crystal, polycrystalline material, etc.) having a functional optical structure 106C (e.g., surface relief gratings, volume phase holographic gratings, liquid crystal gratings, etc., which can be used interchangeably throughout the specification). In some embodiments, the layered waveguide may include multiple substrates. In some of these embodiments, the thickness of each or more of the multiple substrates is greater than or equal to 10 μm.

[0109] The exemplary layered waveguide architecture may also include a polymer laminate 104C (e.g., a polymer film with a thickness ranging from 10 um to 1000 um) to improve impact resistance, such as the drop impact resistance of a ball or a high-quality projectile with a conical tip, or other impact resistance according to ANSI (American National Standards Institute) standards (such as ANSI Z80.3, Z80.3 - 1006, Z87.1, ANSI Z80.3 - 1996, Non-Prescription Sunglasses and Fashion Eyewear - Requirements, Section 5.1 - Impact Resistance Testing, ANSI Z80.3 - 1996, Non-Prescription Sunglasses and Fashion Eyewear - Requirements, Section 5.3 - Flammability Testing, ISO 10993, Biological Evaluation of Medical Devices - Parts 1 - 12, ISO 14889, Ophthalmic Optics - Basic Requirements for Uncut Spectacle Lenses, Section 4.5, ISO 8980 - 3, Ophthalmic Optics - Uncut Finished Spectacle Lenses - Part 3, Transmittance Specifications and Test Methods, ANSI Z80.3 - 1996, Non-Prescription Sunglasses and Fashion Eyewear - Requirements, Sections 4.4 to 4.8, or any other standard governing the impact resistance of eyewear, etc.). The polymer laminate 104C may be fixed to the waveguide 102C through an adhesive layer (not shown) between 102C and 104C. In some embodiments, the refractive index of the polymer laminate 104C may match the refractive index of the waveguide 102C. In some of these embodiments, the refractive index of the polymer laminate 104C together with the adhesive layer (located between 102C and 104C, but not shown) may match the refractive index of the waveguide 102C. The waveguide 102C may have a grating 106C (e.g., a grating for creating virtual reality content at multiple different depths) on the side opposite to the side to which the polymer laminate 104C is fixed.

[0110] The polymer used to form the polymer laminate may have color selectivity (e.g., a polymer doped with a dye may selectively absorb certain wavelengths of light). In some embodiments, optical components such as the waveguide to which the polymer laminate is fixed may also be made of a polymer. The color-selective optical components described herein may advantageously reduce or block stray light entering the waveguide (e.g., a red, green, or blue waveguide), thereby reducing or eliminating back reflection or backscattering into the eyepiece.

[0111] Generating a polymer optical component can include coating a first polymerizable material on a first region of a first mold, coating a second polymerizable material on a second region of the first mold, bringing the first polymerizable material and the second polymerizable material into contact with a second mold, polymerizing the first polymerizable material and the second polymerizable material to produce a patterned polymer layer between the first mold and the second mold, and separating the patterned polymer layer from the first mold and the second mold to produce a polymer waveguide having an undoped region formed of the first polymerizable material and a doped region formed of the second polymerizable material. The first polymerizable material includes a first resin, and the second polymerizable material includes a second resin and a color component. The first mold, the second mold, or both include protrusions, depressions, or both.

[0112] In some embodiments, the color component is selected to permit transmission of light at a selected wavelength. The concentration of the color component in the second polymerizable material can be in the range of 3 to 3000 parts per million by weight. The light at the selected wavelength typically corresponds to red light, green light, or blue light. The color component includes one or more dyes. In some cases, the color component includes nanoparticle material, and optionally includes one or more dyes. In some embodiments, the first resin and the second resin are the same. The polymer waveguide can include more than one doped region, more than one undoped region, or more than one doped region and more than one undoped region.

[0113] The polymer optical component can include an undoped region containing the first resin, and a doped region containing the second resin and the color component. The refractive indices of the undoped region and the doped region are substantially the same. In some implementations of the third general aspect, the color component is selected to absorb red light, green light, blue light, or any combination thereof.

[0114] Forming a polymer optical component can include: coating a polymerizable material on a first mold; bringing the polymerizable material into contact with a second mold; polymerizing the polymerizable material to produce a patterned polymer layer between the first mold and the second mold; and separating the patterned polymer layer from the first mold and the second mold to produce a doped polymer waveguide. The polymerizable material includes a resin and a color component. The first mold, the second mold, or both contain protrusions, depressions, or both. The color component is selected to absorb red light, green light, blue light, or any combination thereof.

[0115] In some of these embodiments, the doped polymer waveguide does not include one or more undoped regions. The doped polymer waveguide generally absorbs at least 90% of one or more of red, green, and blue light passing through the polymer waveguide. In certain cases, the color component is selected to absorb at least 90% of only red, only green, or only blue light. In certain cases, the polymerizable material is a homogeneous mixture. The thickness of the doped polymer waveguide is generally in the range of about 200 μm to about 1000 μm. The total internal reflection path length of the doped polymer waveguide is generally in the range of about 2 cm to about 15 cm. The refractive index of the doped polymer waveguide is generally greater than about 1.45.

[0116] In some embodiments, the polymer waveguide includes one or more patterned regions and one or more non-patterned regions. The one or more patterned regions and one or more non-patterned regions contain a doped polymer having a color component selected to absorb at least 90% of one or more of red, green, and blue light passing through the polymer waveguide.

[0117] In some of these embodiments, one of the one or more patterned regions can be an input coupling grating (ICG), an exit pupil expander (EPE), an orthogonal pupil expander (OPE), or a combined pupil expander (CPE). The doped polymer waveguide generally does not include one or more undoped regions. It absorbs at least 90% of only red, only green, or only blue light. The doped polymer waveguide can absorb at least 90% of one or more of red, green, and blue light passing through the polymer waveguide, or absorb at least 90% of only red, only green, or only blue light. The doped polymer can be a homogeneous material. The thickness of the doped polymer waveguide is generally in the range of about 200 μm to about 1000 μm. The total internal reflection path length of the doped polymer waveguide is generally in the range of about 2 cm to about 15 cm. The refractive index of the doped polymer waveguide is generally greater than about 1.45.

[0118] In some embodiments, coating the waveguide includes applying one or more portions of a polymerizable material to a first surface of the waveguide and polymerizing the polymerizable material to produce a doped coating on the first surface of the waveguide. The polymerizable material includes a resin and a color component. The waveguide can be formed of glass, polymer, or other suitable optical material. The doped coating is selected to absorb at least 90% of one or more of red, green, and blue light passing through the polymer waveguide. In some embodiments, in addition to or in place of the polymer substrate, the layered waveguide can also include a non-polymer substrate, such as a glass substrate or a glass-like optically grade substrate. Thus, in these embodiments, the layered waveguide can include one or more polymer substrates and one or more non-polymer substrates.

[0119] In some of these embodiments, the doped coating can be a continuous coating. In certain cases, the doped coating forms two or more discontinuous regions on the first surface of the waveguide. The doped coating generally covers the first surface of the waveguide. The first surface of the waveguide can include one or more patterned regions and one or more non-patterned regions, where a polymerizable material is coated on one of the one or more non-patterned regions of the first surface of the waveguide. The waveguide and the doped coating can have substantially the same refractive index. Additionally, one or more additional portions of the polymerizable material can be coated on the second surface of the waveguide and polymerized to produce a second doped coating on the second surface of the waveguide. The second surface is opposite the first surface, and the second doped coating is selected to absorb at least 90% of one or more of red, green, and blue light passing through the polymer waveguide.

[0120] In some embodiments, the coated optical component includes one or more non-patterned regions on the first surface and one or more patterned regions on the first surface. At least one of the one or more non-patterned regions is coated with a doped polymer coating, and the doped polymer coating is selected to absorb at least 90% of one or more of red, green, and blue light passing through the polymer coating. In some implementations of the seventh general aspect, the second surface of the waveguide opposite the first surface includes an additional doped polymer coating.

[0121] In some embodiments, coating the waveguide includes: coating a portion of a first polymerizable material on the first surface of the waveguide; coating a portion of a second polymerizable material on the first surface of the waveguide; and polymerizing the first polymerizable material and the second polymerizable material to produce a first doped coating and a second doped coating on the first surface of the waveguide. The first polymerizable material includes a first resin and a first color component. The second polymerizable material includes a second resin and a second color component. The first doped coating is selected to absorb at least 90% of one or more of the first of red, green, and blue light passing through the polymer waveguide, and the second doped coating is selected to absorb at least 90% of one or more of the second of red, green, and blue light passing through the polymer waveguide.

[0122] In some embodiments, manufacturing a color filter includes applying a portion of a first polymerizable material onto a surface of a first mold, applying a portion of a second polymerizable material onto the surface of the first mold, and applying a portion of a third polymerizable material onto the surface of the first mold. Manufacturing the color filter further includes contacting the first polymerizable material, the second polymerizable material, and the third polymerizable material with a surface of a second mold, and polymerizing the first polymerizable material, the second polymerizable material, and the third polymerizable material to produce a first color filter, a second color filter, and a third color filter. The first polymerizable material includes a first resin and a first color component, the second polymerizable material includes a second resin and a second color component, and the third polymerizable material includes a third resin and a third color component. The first color filter is selected to absorb at least 90% of one or more of a first one of red light, green light, and blue light passing through the first color filter; the second color filter is selected to absorb at least 90% of one or more of a second one of red light, green light, and blue light passing through the second color filter; and the third color filter is selected to absorb at least 90% of one or more of a third one of red light, green light, and blue light passing through the third color filter. In some implementations, the ninth general aspect further includes adhering the first color filter, the second color filter, and the third color filter to an optical substrate or waveguide.

[0123] In some embodiments, a polymer waveguide includes a coupling grating and a pupil expander. The polymer waveguide includes a polymer doped with a color component. The concentration of the color component in the polymer varies from a first side of the polymer waveguide to a second side of the polymer waveguide. In some implementations of the tenth general aspect, the concentration of the color component increases from a first side of the polymer waveguide to a second side of the polymer waveguide.

[0124] In some embodiments, a waveguide structure includes a waveguide configured to transmit light in the visible wavelength range, and a cured adhesive doped with a colorant that absorbs light in the visible wavelength range and transmits ultraviolet light. The cured adhesive is in direct contact with the waveguide. In some of these embodiments, the visible wavelength range may correspond to red light, green light, or blue light or any combination thereof. In certain cases, the visible wavelength range corresponds to cyan, magenta, or yellow light or any combination thereof. The cured adhesive is generally a single layer with a thickness in the range of about 10 μm to about 1.5 mm. The cured adhesive may be fully cured. The cured adhesive generally forms an edge seal.

[0125] Additionally or alternatively, the optical component stack can include a plurality of waveguide structures, and a cured adhesive doped with a colorant that absorbs light in each different visible wavelength range and transmits ultraviolet light. Each waveguide structure has a waveguide configured to transmit light in a different visible wavelength range, and the adhesive is in direct contact with adjacent waveguide structures among the plurality of waveguide structures. In some implementations of the fifteenth general aspect, the cured adhesive is a single layer with a thickness in the range of about 10 μm to about 1.5 mm. In certain implementations of the fifteenth general aspect, the cured adhesive forms an edge seal.

[0126] Additionally or alternatively, forming an optical component structure includes: selecting waveguides configured to transmit light in the visible wavelength range; applying an adhesive doped with a colorant that absorbs light in the visible wavelength range and transmits ultraviolet light to the waveguides; and fully curing the adhesive by a single ultraviolet light irradiation to form a waveguide structure. The thickness of the adhesive is in the range of about 10 μm to about 1.5 mm. In some implementations of the sixteenth general aspect, the adhesive is applied to the edge of the waveguide or the surface of a layer configured to be laminated to another waveguide configured to transmit visible light in another visible wavelength range.

[0127] Figure 1D An example layered waveguide architecture is shown, including an optical component 106D (e.g., a brittle optical material, glass, single crystal, polycrystalline material, etc., which can be collectively referred to as a vitreous component or a vitreous optical component) having a functional optical structure 108D (surface relief grating, volume phase holographic grating, liquid crystal grating, etc.).

[0128] Similar to Figure 1C the example layered waveguide architecture can also include a polymer laminate 104D to improve impact resistance, such as ball drop impact resistance (e.g., an impactor drops from a height of 50 inches, 51.2 inches, etc., or impacts the layered waveguide architecture at a minimum speed of 45.7 m / s, depending on the standard) or other impact resistances that meet various standards (such as ANSI Z80.3, Z80.3 - 1006, Z87.1 (basic impact, high - speed impact, high - speed impact alternative and / or penetration test), 21 CFR 801.40 (Federal Regulations, Title 21, Part 801.410), EN166 (basic and / or enhanced) in the European Union, UL8400 in the United States, or any other standard governing the impact resistance of eyewear, etc.). The polymer laminate 104D can be fixed to the waveguide 102D through an adhesive layer (not shown) located between 106D and 104D. In some embodiments, the refractive index of the polymer laminate 104D can match the refractive index of the waveguide 106D.

[0129] In some of these embodiments, the refractive index of the polymer laminate 104D, along with the adhesive layer (located between 106D and 104D but not shown), can match the refractive index of the waveguide 106D. The waveguide 106D can have a grating 108D (e.g., a grating for creating virtual reality content at multiple different depths) on the side opposite to the side to which the polymer laminate 104D is fixed. In some embodiments, the polymer laminate 104D can include a functional structure 102D, such as an anti-reflection layer on the exposed side (e.g., the side opposite to the side to which the adhesion layer is fixed).

[0130] Figure 1E An example layered waveguide architecture is shown, including an optical component 106E (e.g., a brittle optical material, glass, single crystal, polycrystalline material, etc.) having a functional optical structure 108E (surface relief grating, volume phase holographic grating, liquid crystal grating, etc.). Similar to Figure 1C and 1D , the example layered waveguide architecture can also include a polymer laminate 104E to improve impact resistance, such as ball-drop impact resistance or other impact resistances that meet various standards (such as ANSI Z80.3, Z80.3 - 1006, Z87.1, or any other standard governing the impact resistance of eyewear, etc.). The polymer laminate 104E does not have a functional structure 102D (e.g., an anti-reflection layer) as in Figure 1D , but can include an augmented reality dielectric stack (e.g., a dielectric anti-reflection coating on the exposed side) 102D, such as an anti-reflection dielectric layer on the exposed side (e.g., the side opposite to the side to which the adhesion layer is fixed).

[0131] Figure 1F An example layered waveguide architecture is shown, including an optical component 102F (e.g., a brittle optical material, glass, single crystal, polycrystalline material, etc.), with a polymer laminate 104F fixed to one side of the optical component 102F (e.g., fixed using an adhesive layer between 102F and 104F). Different from the example layered waveguide shown above in Figure 1C , this example layered waveguide architecture can include functional optical structures 108F (surface relief grating, volume phase holographic grating, liquid crystal grating, etc.) on the exposed sides of both the optical component 102F and the polymer laminate 104F simultaneously.

[0132] Figure 1G An example layered waveguide architecture is shown, including an optical component 102G (e.g., a brittle optical material, glass, single crystal, polycrystalline material, etc.), with a polymer laminate 104G fixed to one side of the optical component 102G (e.g., fixed using an adhesive layer between 102G and 104G). Similar to the example layered waveguide architecture shown in Figure 1F , Figure 1GThe example layered waveguide architecture shown may also include a functional optical structure 108G (such as a surface relief grating, a volume phase holographic grating, a liquid crystal grating, etc.) on the exposed side of the optical component 102F.

[0133] Unlike Figure 1F the example layered waveguide architecture shown, Figure 1G the example layered waveguide architecture shown may also include a functional optical structure 108G (such as a surface relief grating, a volume phase holographic grating, a liquid crystal grating, etc.) embedded between 102G and 104G or within the polymer stack 104G or within the optical component 102G, rather than on the exposed side of the optical component 102F as shown Figure 1F In some embodiments with an embedded grating, the layered waveguide architecture may utilize such an embedded grating to achieve light guiding and / or diffraction functions, and in some embodiments, such functions may be achieved through one or more air pockets, while in some other embodiments, there are no air pockets.

[0134] Figure 1H An example layered waveguide architecture is shown, including a polymer stack 104H sandwiched between a first optical component 102H and a second optical component 108H (e.g., 102H and 104H may be made of brittle optical materials, glass, single crystal, polycrystalline materials, etc., although the two do not have to be made of the same material). The polymer stack 104H may be fixed to the optical component 102H or 108H, for example, using an adhesive layer between 102H and 104H and another adhesive layer between 104H and 108H. Figure 1H The example layered waveguide architecture in

[0135] Figure 1I An example layered waveguide architecture is shown, including a polymer stack 104I sandwiched between a first optical component 102I and a second optical component 108I (e.g., 102I and 104I may be made of brittle optical materials, glass, single crystal, polycrystalline materials, etc., although the two do not have to be made of the same material). The polymer stack 104I may be fixed to the optical component 102I or 108I, for example, using an adhesive layer between 102I and 104I and another adhesive layer between 104I and 108I, although the two adhesive layers may or may not be of the same type.

[0136] Figure 1IThe exemplary layered waveguide architectures in [[ ]] may also include functional optical structures 106H (such as surface relief gratings, volume phase holographic gratings, liquid crystal gratings, etc.) located on or within (e.g., embedded) the exposed side of the optical component 102I. Additionally, Figure 1I The exemplary layered waveguide architectures in [[ ]] may also include functional optical structures 110H (such as surface relief gratings, volume phase holographic gratings, liquid crystal gratings, etc.) located on or within (e.g., embedded or buried) the optical component 108I, between the optical component 102I and the polymer laminate 104I, and / or between the optical component 108I and the polymer laminate 104I.

[0137] Figure 1J-1K Simplified example manufacturing options for the optical components of the extended reality devices described herein in one or more embodiments are shown. More specifically, Figure 1J Shown is Figure 1C 、 1D and a manufacturing option (e.g., by casting, molding, or other suitable manufacturing processes) for the exemplary waveguide architecture shown in 1F. For Figure 1C the exemplary waveguide architecture shown, the manufacturing process may utilize the blank bottom mold 104J and the waveguide substrate 102J (e.g., Figure 1C 102C in [[ ]]) as the top mold.

[0138] For Figure 1D the exemplary waveguide architecture shown, the manufacturing process may utilize a bottom mold having a negative pattern for the augmented reality surface relief diffraction grating pattern (e.g., nanostructures, microstructures, etc. for the surface relief diffraction grating pattern). In some embodiments, the exemplary manufacturing process may also utilize a glass waveguide substrate (e.g., Figure 1D the optical component 106D in [[ ]]) as the top mold.

[0139] For Figure 1F the exemplary waveguide architecture shown, the manufacturing process may utilize a bottom mold having a surface relief diffraction grating pattern on the bottom and a glass waveguide (e.g., Figure 1F the optical component 102F in [[ ]]) as the top mold. The two molds may be joined together using a curable resin 106J having the desired or required optical properties (such as clarity, transparency, yellowness, refractive index value, etc.) and the desired or required thickness (e.g., 10um - 1000um) as well as the desired or appropriate total thickness variation (TTV).

[0140] In Figure 1JAmong them, the glass substrate can serve as one of the molds so that the polymer laminate can be directly cast or molded onto the glass substrate. The second mold can be blank on it or have an AR nanostructure pattern or a surface relief grating pattern (or a negative surface relief grating pattern, depending on how the mold is constructed) on it so that the polymer laminate and features can be formed simultaneously.

[0141] Figure 1K Some embodiments are shown Figure 1I Manufacturing options for the example waveguide architectures shown (e.g., by casting, molding, or other suitable manufacturing processes). In these embodiments, optical components (e.g., Figure 1I 102I and 108I in) can be used as the top mold and the bottom mold. A curable resin 106J with the desired or required optical properties (e.g., clarity, transparency, yellowness, refractive index value, etc.) and the desired or required thickness (e.g., 10 um - 1000 um) and the desired or appropriate total thickness variation (TTV) can be used to connect the two molds.

[0142] Figure 2A Examples of the entry and exit of laser projector light in some embodiments are shown, and the mosquito net effect is shown in the near - field image. A simplified example stack including an optical component (e.g., a waveguide) 202A can also include a surface relief grating pattern 204A on one side of the optical component 202A (e.g., Figure 1C-1K the waveguide in). The mosquito net effect refers to the thin dark lines or reticulated appearance caused by the gaps between pixels on a screen or projection image, similar to observing through the mesh or screen of a mosquito net. The mosquito net effect often appears in traditional virtual reality headsets with lower resolution. Some traditional techniques reduce this undesirable mosquito net effect by increasing the resolution. On the other hand, the present disclosure uses various techniques described herein to reduce or even eliminate this undesirable mosquito net effect while being able to present virtual content at a lower resolution, which may cause the mosquito net effect in other extended reality devices.

[0143] In some embodiments, the refractive index value of the optical component 202A is 1.59, and the refractive index value of the surface relief grating pattern 204A is 1.64. The example result image 206A shows some mosquito net effect in the near - field image 208A. The mosquito net effect includes the thin dark lines or reticulated appearance caused by, for example, the gaps between pixels on a screen or projection image.

[0144] Figure 2BShows an example of pupil replication in some embodiments. In these embodiments, the exemplary stacked layered waveguide architecture includes a polymer laminate 204B sandwiched between a first optical component 202B and a second optical component 206B. In some embodiments, the refractive index values of the first optical component 202B, the polymer laminate 204B, and the second optical component 206B are 1.59, 1.31, and 1.59, respectively. Figure 2B The shown exemplary stacked layered waveguide architecture effectively expands and thus "replicates" the pupil (e.g., the exit pupil) by refraction and / or total internal reflection (TIR).

[0145] Figure 2C Shows an exemplary stacked layered waveguide architecture for improving pupil replication with an embedded intermediate low refractive index film in some embodiments. In these embodiments, Figure 2C The shown exemplary stacked layered waveguide architecture includes a polymer laminate 206C sandwiched between a first optical component 208C and a second optical component 204C. The exemplary stacked layered waveguide architecture further includes a third optical component 202C fixed to the distal side of the second optical component 204C (opposite to the side where the intermediate low refractive index laminate 206C is located).

[0146] In some embodiments, the refractive index values of the first optical component 208C, the polymer laminate 206C, the second optical component 204C, and the third optical component 202C are 1.59, 1.31, 1.59, and 1.59, respectively. The exemplary result image 212C shows the effect of reducing, eliminating, or mitigating the moiré effect in the near-field image 214C using Figure 2C the shown exemplary stacked layered waveguide architecture. Figure 2C The shown exemplary stacked layered waveguide architecture 2C also effectively expands and thus "replicates" the pupil (e.g., the exit pupil) by refraction and / or total internal reflection (TIR).

[0147] Figure 2D Shows an exemplary stacked architecture for improving pupil replication using an embedded relief structure and an embedded intermediate low refractive index layer with or without a filled low refractive index material in some embodiments. In these embodiments, Figure 2D The shown exemplary stacked layered waveguide architecture includes a polymer laminate 206D sandwiched between a first optical component 208D and a second optical component 204D. The exemplary stacked layered waveguide architecture further includes a third optical component 202D fixed to the distal side of the second optical component 204D (opposite to the side where the intermediate low refractive index laminate 206D is located). Additionally, the optical component 204D may further include an embedded surface relief structure 214D on or within the second optical component 204D to further reduce the moiré effect in the near-field image, whether or not there is an intermediate low refractive index laminate 206D.

[0148] In some embodiments, the refractive index values of the first optical component 208D, the intermediate low refractive index laminate 206D, the second optical component 204D (with an embedded surface relief structure 214D), and the third optical component 202D are 1.59, 1.31, 1.59, and 1.59, respectively. The exemplary result image 210D shows the effect of reducing, eliminating, or mitigating the moiré effect in the near-field image 212D using the Figure 2D exemplary stacked layered waveguide architecture shown. Figure 2D The exemplary stacked layered waveguide architecture shown further effectively expands and thus "duplicates" the pupil (e.g., the exit pupil) through refraction and / or total internal reflection (TIR).

[0149] Figure 2E Another exemplary stacked architecture is shown that uses an embedded relief structure and an embedded intermediate low refractive index layer with or without a filler of a low refractive index material in some embodiments to improve pupil duplication. In these embodiments, Figure 2E the exemplary stacked layered waveguide architecture includes a first optical component 202E, a second optical component 206E, and an intermediate low refractive index laminate 204E sandwiched between the first optical component 202E and the second optical component 206E. The exemplary stacked layered waveguide architecture further includes a surface relief grating structure 208E built on or within the second optical component 206E, a third optical component 210E, and a fourth optical component 212E fixed on the exposed side of the third optical component 210E. Similar to the use of the intermediate low refractive index laminate 204E, the purpose of the surface relief grating structure 208E is to reduce the moiré effect in the near-field image, whether or not there is an intermediate low refractive index laminate 204E.

[0150] In some embodiments, the refractive index values of the first optical component 202E, the intermediate low refractive index laminate 204E, the second optical component 206E, the third optical component 210E, and the fourth optical component 212E are 1.59, 1.31, 1.59, 1.59, and 1.59, respectively. The exemplary result image 214E shows the effect of reducing, eliminating, or mitigating the moiré effect in the near-field image 216E using the Figure 2E exemplary stacked layered waveguide architecture shown. Figure 2E The exemplary stacked layered waveguide architecture shown further effectively expands and thus "duplicates" the pupil (e.g., the exit pupil) through refraction and / or total internal reflection (TIR).

[0151] Figure 2F Another example is shown of an exemplary stacked architecture in some embodiments that shows significant improvement in pupil duplication using a dual ICG (coupling-in grating) and a CPE (combined pupil expander), where the CPE is embedded and separated by a low refractive index intermediate layer. In these embodiments, Figure 2FThe exemplary stacked layered waveguide architecture shown includes a first optical component 202F, a second optical component 208F, a third optical component 210F, and surface relief grating structures 204F that are embedded within an intermediate low refractive index laminate 206F disposed between the first optical component 202F and the second optical component 208F.

[0152] The exemplary stacked layered waveguide architecture also includes surface relief grating structures 212F that are built on or within an exposed side of the third optical component 210F but near the exposed side. Similar to the use of the intermediate low refractive index laminate 206F, the purpose of the surface relief grating structures 204F is to reduce the moiré effect in the near - field image, whether or not there is an intermediate low refractive index laminate 206F. Figure 2F Some of the exemplary substrates shown may include a polycarbonate substrate having a refractive index of 1.59.

[0153] In some embodiments, the refractive index values of the first optical component 202F, the surface relief grating structures 204F (or the combination of the intermediate low refractive index laminate 206F and the surface relief grating structures 204F), the second optical component 208F, the third optical component 210F, and the surface relief grating structures 212F are 1.59, 1.31, 1.59, 1.59, and 1.65, respectively. The exemplary result image 214F shows the effect of reducing, eliminating, or mitigating the moiré effect in the near - field image 216F using the Figure 2F exemplary stacked layered waveguide architecture shown. Figure 2F The exemplary stacked layered waveguide architecture shown further effectively expands and thus "duplicates" a pupil (e.g., an exit pupil) by refraction and / or total internal reflection (TIR).

[0154] In some embodiments, the substrates described herein may include a polycarbonate substrate having a refractive index (e.g., the speed of light divided by the phase velocity of light in the substrate) of approximately 1.59, for example. In, for example Figure 3A 、 3BIn some embodiments of and / or 3C, the substrate may include lithium niobate (LiNbO3) with a refractive index value of about 2.25, EXG glass with a refractive index value of about 1.51 to 1.52, and an inkjet or printable and UV (ultraviolet) curable transparent adhesive with refractive index values of about 1.31, 1.53, and / or 1.65 (depending on the number of adhesive layers). Nevertheless, it should also be noted that the example materials with example refractive index values provided herein are only for illustration, and the selection of waveguide substrates and their accompanying stacks should not be limited or restricted to any specific polymer materials (e.g., polycarbonate or PC, PET or polyethylene terephthalate, PI or polyimide, COP or cycloolefin polymer, etc.) or inorganic materials (e.g., glass, lithium niobate, silicon carbide, etc.), and these materials can be organic, single crystal, or polycrystalline and / or birefringent (e.g., materials with two different refractive indices).

[0155] In some embodiments, the waveguide substrate for making the eyepiece may include a series of refractive index values, such as high refractive index glass (e.g., 1.7 SCHOTT SF5, 1.8 SF6, HOYA dense tantalum flint glass TAFD55 (2.01), TAFD65 (2.06), etc.) to crystal substrates (e.g., lithium tantalate LiTaO3, lithium niobate LiNbO3 (2.25), silicon carbide (2.65), etc.). Additionally or alternatively, the high refractive index coating may include silicon carbide (SiC) with a refractive index value of about 2.5 to 2.6, titanium dioxide (TiO2) with a refractive index value of about 2.2 to 2.5, zirconium dioxide (ZrO2) with a refractive index value of about 2.1, silicon nitride (Si3N4) and silicon oxynitride (e.g., SiOxNy, where x and y are integers) with a refractive index value of about 1.8 to 2.0, silicon dioxide (SiO2) with a refractive index value of about 1.45, magnesium fluoride (MgF2) with a refractive index value of about 1.38, etc.

[0156] In some embodiments, the following methods can be used to apply thin film coatings on blank or patterned surfaces: processes such as physical vapor deposition (PVD), evaporation, sputtering, or any other suitable physical process, where ion assistance (e.g., using an Ar or O2 plasma field) may or may not be used, or chemical vapor deposition (CVD), such as low pressure PECVD, atmospheric pressure PECVD (plasma enhanced chemical vapor deposition), ALD (atomic layer deposition), or any other suitable chemical process. A fluorinated polymer film with a refractive index of 1.31 can be coated, where poly[4,5-difluoro-2,2-bis(trifluoromethyl)-1,3-dioxole-co-tetrafluoroethylene] is dissolved in Fluorinert TMIn FC-40, the concentration is up to 2% (weight percentage). In some embodiments, a lower refractive index film (e.g., refractive index value less than 1.3) can be formulated as a single-layer or multi-layer colloidal film composition with a porous SiO2-polymer matrix composition using sol-gel technology. In these embodiments, such low refractive index coatings can be applied by methods including but not limited to spin coating, spraying, atomizing, inkjet printing, printing, etc.

[0157] In some embodiments, the patterned imprintable or printable prepolymer material can include a resin material such as, but not limited to, epoxy vinyl ester. In some of these embodiments, the resin can include vinyl monomers (e.g., methyl methacrylate) and / or difunctional or trifunctional vinyl monomers (e.g., diacrylate, triacrylate, dimethacrylate, etc.), where the monomers may or may not contain aromatic molecules. In some of these embodiments, the prepolymer material can include monomers having one or more functional groups such as alkyl, carboxyl, carbonyl, hydroxyl, and / or alkoxy groups. Sulfur atoms and aromatic groups with higher polarizability can be incorporated into these acrylate components to increase the refractive index of the formulation, and its refractive index value generally ranges from, for example, 1.5 to 1.75. In some implementations, the prepolymer material can include a cycloaliphatic epoxy resin, which can be cured using ultraviolet light, heat, or any other suitable curing process. Additionally or alternatively, the prepolymer material can also include an ultraviolet cationic photoinitiator and co-reactants to facilitate effective ultraviolet curing under ambient conditions.

[0158] In some embodiments, incorporating inorganic nanoparticles (NP) (e.g., ZrO 2 and TiO 2 ) into the imprintable or printable resin polymer can significantly increase the refractive index value, further reaching 2.1. For example, the refractive index values of pure (e.g., purity of three 9s or 99.9% or five 9s or 99.999%) ZrO 2 and TiO 2 crystals at 532 nm can reach 2.2 and 2.4 - 2.6 respectively. In some of these embodiments, to prepare an optical nanocomposite of acrylate monomer and inorganic nanoparticles, the particle size can be less than, for example, 10 nm to avoid excessive Rayleigh scattering. In addition, due to the high specific surface area, high polarity of its nanoparticles, and incompatibility with the cross-linked polymer matrix, ZrO 2 NP tends to aggregate in the polymer matrix. In these embodiments, surface modification of the NP can be used to overcome this challenge in some embodiments.

[0159] In these embodiments, ZrO 2The hydrophilic surface can be modified to be compatible with organic matter, enabling the NPs to mix with the polymer almost or substantially uniformly (e.g., within certain acceptable, required, or desired tolerances). Such modification can be achieved, for example, with silanes and carboxylic acids containing capping agents. In some embodiments, one end of the capping agent can be bonded to the ZrO 2 surface, while the other end of the capping agent can include a functional group or a non-functional organic moiety that can participate in acrylate crosslinking. Some examples of surface-modified sub-10 nm ZrO 2 particles include, for example, particles provided by Pixelligent Technologies TM and Cerion Advanced Materials TM . These functionalized nanoparticles are typically sold as homogeneous blends uniformly suspended in a solvent, and these blends can be combined with other base materials to form resist formulations with an ink-jet or printable viscosity and a higher refractive index value.

[0160] In some embodiments, a template (e.g., a superstrate, rigid or flexible) can be used to pattern a prepolymer material, where the inverse tone of the optical functional nanostructures (diffractive and sub-diffractive) is in direct contact with the liquid prepolymer. In these embodiments, the liquid prepolymer material can be coated on a substrate or surface to be patterned, and the patterning methods include, for example but not limited to, drop-on-demand or continuous inkjet systems, slot-die coating, spin coating, blade coating, microgravure coating, screen printing, spraying, or atomization. The template can be in contact with the liquid, and once the liquid fills the template features, it can be crosslinked and patterned, causing the prepolymer with the diffractive pattern to contact the template (e.g., in the case of imprint lithography techniques (e.g., J-FIL TM ), where the prepolymer material is coated by inkjet) including exposing the prepolymer to actinic radiation with a wavelength between 310 nm and 410 nm and an intensity between 0.1 J / cm 2 and 100 J / cm 2 . In some of these embodiments, the method can further include heating the prepolymer to a temperature between 40 °C and 120 °C while exposing the prepolymer to actinic radiation.

[0161] In some embodiments, to enhance adhesion, a crosslinking silane coupling agent can be used between post-patterning (template / mold release) of the prepolymer material and curing on the desired surface or substrate. In some of these embodiments, one end of these coupling agents has an organic functional group and the other end has a hydrolyzable group, which can form durable bonds with different types of organic and inorganic materials. An example of an organic functional group is acryloyl, which can crosslink into a patternable polymer material to form the desired optical pattern / shape. In some other embodiments, the template or mold can be coated with a similar coating, where the acryloyl end can be replaced by a fluorinated chain, which can reduce the surface energy and thus act as a non-bonding release site. In some embodiments, vapor deposition can be carried out at low pressure (e.g., depending on the vacuum of the deposition process), where the coupling agent is delivered in vapor form, with or without an inert gas such as nitrogen (N2), in the presence of reactive -O and / or -OH groups on the surface of the material to be coated. The vapor coating process can deposit a monolayer film as thin as, for example, 0.5 nm to 0.7 nm, and in some embodiments, these films can be made thicker.

[0162] In some embodiments, the pattern in the cured polymer material can be fabricated by directly etching it onto a high refractive index or low refractive index substrate (e.g., an inorganic substrate or an organic substrate) using a corresponding mask, or into a high refractive index or low refractive index film (e.g., a TiO2 film, a SiO2 film, etc.) above the substrate and below the patterned and cured polymer material. In some embodiments, the high refractive index or low refractive index inorganic thin film can be deposited conformally or directionally (e.g., glancing angle deposition), with a refractive index value range of the material from 1.38 to 2.6 (e.g., MgF2, SiO2, ZrO2, TiO2, etc.). In some of these embodiments, the imprinted or etched pattern can be planarized into a curable prepolymer material with a refractive index value of about 1.5 to 2.1, and the methods include but are not limited to drop-on-demand or continuous inkjet systems, slot coating, spin coating, knife coating, microgravure coating, screen printing, spraying or atomization, or any other suitable process, etc.

[0163] In some embodiments, uniform or varying volumes can be achieved, for example, by using a drop-on-demand inkjet coating system, where different regions can receive different droplet densities or volumes. In some cases, a blank template can be used to flatten the surface, or the blank template can include a laminate that needs to be adhered to the patterned substrate. In some embodiments, the thickness variation (refractive index) of each individual layer can be 0 to 50 nm, 0 to 100 nm, less than or equal to 200 nm, less than or equal to 300 nm, less than or equal to 800 nm, less than or equal to 1000 nm, etc., and / or can be wedge-shaped, where the wedge can be thicker or thickest near the ICG (coupling-in grating) and gradually decrease away from the ICG, and vice versa. In some of these embodiments, laminates of opposite wedges can be combined to achieve higher optical wavelength uniformity and scalability in different diffraction pitch waveguides (e.g., improving the uniformity of blue and red in a green EP waveguide).

[0164] Figure 2G Some simplified example stack architectures located on one or both sides of a substrate and a second substrate having an additional intermediate low refractive index layer in some embodiments are shown. The first simplified example stack architecture 200G1 includes an intermediate low refractive index laminate 202G1 sandwiched between a first optical component 204G1 and a second optical component 208G1. A surface relief grating structure 206G1 can be constructed on or within the exposed surface of the first optical component 204G1 but near that surface. Similarly, a surface relief grating structure 210G1 can be constructed on or within the exposed surface of the second optical component 208G1 but near that surface.

[0165] In some of these embodiments, the refractive index values of the surface relief grating structure 206G1, the first optical component 204G1, the intermediate low refractive index laminate 202G1, the second optical component 208G1, and the surface relief grating structure 210G1 can be, for example, 1.65, 1.59 (e.g., polycarbonate substrate), 1.31, 1.59, and 1.65.

[0166] In some embodiments, in the second simplified example stack architecture 200G2, the surface relief grating structure 206G2, the first optical component 204G2, the intermediate low refractive index laminate 202G2, the second optical component 208G2, and the surface relief grating structure 210G2 can be similar or identical to the surface relief grating structure 206G1, the first optical component 204G1, the intermediate low refractive index laminate 202G1, the second optical component 208G1, and the surface relief grating structure 210G1 in 200G1, respectively.

[0167] In some other embodiments, the intermediate low refractive index laminate 202G2 may be made of a cured resin to surround the surface relief grating structure 210G2 on the side of the optical component 204G2 opposite to the surface relief grating structure 206G2.

[0168] In some of these embodiments, the refractive index values of the surface relief grating structure 206G2, the first optical component 204G2, the intermediate low refractive index laminate 202G2, the second optical component 208G2, and the surface relief grating structure 210G2 may be, for example, 1.65, 1.59 (e.g., polycarbonate substrate), 1.31, 1.59, and 1.65.

[0169] In some embodiments, in the third simplified example stack architecture 200G3, the surface relief grating structure 206G3, the first optical component 204G3, the intermediate low refractive index laminate 202G3, the second optical component 208G3, and the surface relief grating structure 210G3 may be similar or identical to the surface relief grating structure 206G1, the first optical component 204G1, the intermediate low refractive index laminate 202G1, the second optical component 208G1, and the surface relief grating structure 210G1 in 200G1, respectively. However, the surface relief grating structure 210G3 may be constructed on or within the exposed surface of the intermediate low refractive index laminate 202G3, but close to the surface, rather than being embedded within the intermediate low refractive index laminate 202G2 in 200G2.

[0170] In some of these embodiments, the refractive index values of the surface relief grating structure 206G3, the first optical component 204G3, the intermediate low refractive index laminate 202G3, the second optical component 208G3, and the surface relief grating structure 210G3 may be, for example, 1.65, 1.59 (e.g., polycarbonate substrate), 1.31, 1.59, and 1.65.

[0171] Figure 2H Some example stack architectures located on one or both sides of a substrate and a second substrate with additional intermediate low refractive index layers in some embodiments are shown. The first simplified example stack architecture 200G4 includes an intermediate low refractive index laminate 202G4 sandwiched between a first optical component 204G4 and a second optical component 208G4. The surface relief grating structure 206G4 may be constructed on or within the exposed surface of the first optical component 204G4, but close to the surface. Different from the surface relief grating structure 210G1, the surface relief grating structure 210G4 may be constructed on or within the intermediate low refractive index laminate 202G4.

[0172] In some of these embodiments, the refractive index values of the surface relief grating structure 206G4, the first optical component 204G4, the surface relief grating structure 210G4, the intermediate low refractive index laminate 202G4, and the second optical component 208G4 can be, for example, 1.65, 1.59 (e.g., polycarbonate substrate), 1.65, 1.31, and 1.59, respectively.

[0173] Compared with the first simplified example stack architecture 200G4, the second simplified example stack architecture 200G5 includes a first optical component 204G5 and first and second surface relief grating structures 206G5 and 210G5 constructed on two opposite sides of the first optical component 204G5. The second simplified example stack architecture 200G5 further includes an intermediate low refractive index laminate 202G5, one side of which is further attached to the exposed side of the second surface relief grating structure 210G5 and the other side of which is further attached to the second optical component 208G5.

[0174] In some of these embodiments, the refractive index values of the surface relief grating structure 206G5, the first optical component 204G5, the surface relief grating structure 210G5, the intermediate low refractive index laminate 202G5, and the second optical component 208G5 can be, for example, 1.65, 1.59 (e.g., polycarbonate substrate), 1.65, 1.31, and 1.59, respectively.

[0175] The third simplified example stack architecture 200G6 includes: a first optical component 204G5; a first surface relief grating structure 206G5 constructed on the exposed side of the first optical component 204G5; a first intermediate low refractive index laminate 206G6 fixed on one side of the first optical component 204G6 (e.g., via an adhesive layer not shown); and a second optical component 208G6 fixed on one side of the second optical component 208G6 and on the other side of the first intermediate low refractive index laminate 206G6. The third simplified example stack architecture 200G6 further includes a surface relief grating structure 210G6 attached to the other side of the second optical component 208G6.

[0176] The third simplified example stack architecture 200G6 further includes a second intermediate low refractive index laminate 212G6 that sandwiches the second surface relief grating structure 210G6 together with the second optical component 208G6. The third simplified example stack architecture 200G6 further includes a third optical component 214G6 fixed on the other side of the second intermediate low refractive index laminate 212G6.

[0177] In some of these embodiments, the refractive index values of the first surface relief grating structure 202G6, the first optical component 204G6, the first intermediate low refractive index laminate 206G6, the second optical component 208G6, the second surface relief grating structure 210G6, the second intermediate low refractive index laminate 212G6, and the third optical component 208G6 can be, for example, 1.65, 1.59 (e.g., polycarbonate substrate), 1.31, 1.59, 1.65, 1.31, and 1.59, respectively.

[0178] Figure 2I Some example processes for creating an embedded grating using a pre-patterned relief structure with any type of rigid or flexible substrate in some embodiments are shown. More specifically, Figure 2I An example process diagram for creating an embedded grating using a pre-patterned relief structure is shown. In these embodiments, this process of creating an embedded grating using a pre-patterned relief can be applied to any type of substrate, whether rigid or flexible. It should be noted that polycarbonate (PC) is mentioned for illustrative purposes only in some embodiments, and other suitable materials (e.g., materials having the desired or required transparency, lower yellowness, refractive index value, density, etc.) can also be used.

[0179] In these embodiments, the first simplified example stack architecture 200I1 includes an optical component 202I1 (e.g., a brittle optical material, glass, single crystal, polycrystalline material, etc.). The optical component 202I1 can have functional optical structures 204I1 and 206I1 (e.g., surface relief gratings, volume phase holographic gratings, liquid crystal gratings, etc., which can be used interchangeably throughout the specification) fixed on two opposite sides of the optical component 202I1.

[0180] In some embodiments, the refractive index values of the optical component 202I1, the first functional optical structure 204I1, and the second functional optical structure 206I1 can be, for example, 1.65, 1.59 (e.g., polycarbonate), and 1.65, respectively. It should be noted that unless otherwise explicitly cited or stated, the terms "functional optical structure", "surface relief grating / element / pattern", "volume phase holographic grating / element / pattern", "liquid crystal grating", "grating / element / pattern", "augmented reality grating / element / pattern", "diffractive optical element / pattern (DOE)", etc. can be used interchangeably.

[0181] The second simplified example stacked architecture 200I2 includes an optical component 202I2, a first functional optical structure 204I2, and a second functional optical structure 206I2, which are respectively the same as or substantially similar to the optical component 202I2, the first functional optical structure 204I2, and the second functional optical structure 206I1 in the first simplified example stacked architecture 200I1. The second simplified example stacked architecture 200I2 further includes a thermoplastic layer 208I2 for accommodating the second functional optical structure 206I2.

[0182] In some embodiments, the thermoplastic layer 208I2 may include poly(propylene carbonate) (PPC), which is a copolymer of carbon dioxide and propylene oxide and is a thermoplastic material. Catalysts such as zinc glutarate are used in the polymerization process. In some embodiments, the thermoplastic layer 208I2 can be used to increase the toughness of some resins (such as the optical components or surface relief grating structures described herein). In some embodiments, the thermoplastic layer 208I2 can be used to bond multiple components (e.g., in a co-molding process) together. In some embodiments, the thickness and / or total thickness variation (TTV) of the thermoplastic layer 208I2 can be determined at least in part based on, for example, the refractive index value of the optical component 202I2 and / or the refractive index value of the functional optical structure 206I2.

[0183] In some embodiments, the refractive index values of the optical component 202I2, the first functional optical structure 204I2, and the second functional optical structure 206I2 can be, for example, 1.65, 1.59 (e.g., polycarbonate), and 1.65, respectively.

[0184] The third simplified example stacked architecture 200I3 includes an optical component 202I3, a first functional optical structure 204I3, a second functional optical structure 206I3, and a thermoplastic layer 208I3 (e.g., PPC), which are respectively the same as or substantially similar to the optical component 202I2, the first functional optical structure 204I2, the second functional optical structure 206I1, and the thermoplastic layer 208I2 in the second simplified example stacked architecture 200I2.

[0185] The third simplified example stacked architecture 200I3 further includes a second optical component 210I3 (e.g., polycarbonate), which is fixed to the second functional optical structure 206I3 by an intermediate thermoplastic layer 208I3.

[0186] In some embodiments, the refractive index values of the optical component 202I3, the first functional optical structure 204I3, the second functional optical structure 206I3, the thermoplastic layer 208I3, and the second optical component 210I3 can be, for example, 1.65, 1.59 (e.g., polycarbonate), 1.65, 1.46, and 1.59, respectively.

[0187] The fourth simplified example stack architecture 200I4 includes an optical component 202I4, a first functional optical structure 204I4, a second functional optical structure 206I4, and a thermoplastic layer 208I4, which are respectively the same as or substantially similar to the optical component 202I3, the first functional optical structure 204I3, the second functional optical structure 206I3, and the thermoplastic layer 208I3 in the third simplified example stack architecture 200I3.

[0188] The fourth simplified example stack architecture 200I4 further includes a second optical component 210I4 (e.g., polycarbonate) fixed on one side of the second functional optical structure 206I4, and a third optical component 212I4 fixed on the other side of the second optical component 210I4 (e.g., through the intermediate thermoplastic layer 208I4). In some embodiments, the refractive index values of the optical component 202I4, the first functional optical structure 204I4, the second functional optical structure 206I4, the thermoplastic layer 208I4, the second optical component 210I4, and the third optical component 212I4 can be, for example, 1.65, 1.59 (e.g., polycarbonate), 1.65, 1.46, 1.59, and 1.59 respectively.

[0189] The fifth simplified example stack architecture 200I5 includes an optical component 202I5, a first functional optical structure 204I5, and a second functional optical structure 206I5, which are respectively the same as or substantially similar to the optical component 202I4, the first functional optical structure 204I4, and the second functional optical structure 206I4 in the fourth simplified example stack architecture 200I4. The difference is that, unlike the fourth simplified example stack architecture 200I4, the fifth simplified example stack architecture 200I5 does not include a thermoplastic layer in the optical stack architecture.

[0190] The fifth simplified example stack architecture 200I5 further includes a second optical component 210I5 (e.g., polycarbonate) fixed on one side of the second functional optical structure 206I5, and a third optical component 212I5 fixed on the other side of the second optical component 210I5 (e.g., using an adhesive layer not shown). In some embodiments, the refractive index values of the optical component 202I4, the first functional optical structure 204I4, the second functional optical structure 206I4, the second optical component 210I4, and the third optical component 212I4 can be, for example, 1.65, 1.59 (e.g., polycarbonate), 1.65, 1.59, and 1.59 respectively.

[0191] Figure 2J Some example variants of the thin film type using the Figure 2I process shown are presented. More specifically, Figure 2JIllustrates the use in some examples Figure 2I Some example additional variations of the film type of the process shown Figure 2J The first set of variations shown starts with the simplified example stack architecture 200I1, which is the same as Figure 2I the simplified example stack architecture 200I1 in. One variation is based on the simplified example stack architecture 200J1 to achieve the same simplified example stack architecture 200J2 as Figure 2I the simplified example stack architecture 200I4 in. Another variation is to exclude the thermoplastic layer in the simplified example stack architecture 200J2 to achieve the same variation 200J3 as Figure 2I the simplified example stack architecture 200I5 in

[0192] Figure 2K-2L Illustrates the use in some embodiments Figure 2J Some example variations of the film type of the process shown. FIG Figure 2K Illustrates another set of variations starting from Figure 2I the simplified example stack architecture 200I1 in. The first variation is substantially similar to Figure 2I the simplified example stack architecture 200I4 in, but adds an optical component 202J with a refractive index value between 1.31 and 1.5 and fixed on the optical component 210I4 and the functional optical structure 206I4 (or the thermoplastic layer 208I4). Another variation is substantially similar to Figure 2I the simplified example stack architecture 200I5 in, but adds an optical component 202J with a refractive index value between 1.31 and 1.5 and fixed on the optical component 210I5 and the functional optical structure 206I5, but without the thermoplastic layer (e.g., 208I4 in the above text).

[0193] Figure 2L Illustrates the use in some embodiments Figure 2J Some example variations of the film type of the process shown. These embodiments start from Figure 2I the simplified example stack architecture 200I1 shown and described above. The first variation is based on the simplified example stack architecture 200I1 to include a thermoplastic layer 208I4 for accommodating the functional optical structure 206I4, an optical component 202J with a refractive index value between 1.31 and 1.5 fixed on the thermoplastic layer 208I4 or the functional optical structure 206I4, and another optical component 212I4 fixed on the optical component 202J

[0194] Figure 2L Another variation shown at the bottom is substantially similar to the simplified example stack architecture described above, except that the thermoplastic layer 208I4 is not included in the simplified example stack architecture

[0195] Figure 2M-2N Shows some example surface relief structure stacks for multi-wavelength waveguide stacks. More specifically, Figure 2M-2N Shows three or four surface relief structure stacks for multi-wavelength waveguide stacks for reducing or eliminating coherent artifacts. Coherent artifacts in optical coherence tomography (OCT) images may introduce false targets (if there is no target at the artifact location), thus severely degrading the image quality. Coherent artifacts may also have a constructive or destructive effect on the targets present at the artifact location. This constructive or destructive interference will cause the real target to be canceled or show an incorrect target echo amplitude. These illustrated embodiments utilize an optical stack including an optical component, an intermediate low refractive index structure, and / or a surface relief grating structure in the multi-wavelength waveguide stack to reduce or eliminate such coherent artifacts.

[0196] Noise mainly related to the coherence of light can cause 3D images to look unrealistic. Therefore, eliminating such coherent noise has been a subject of extensive research since the birth of holography technology. One of the main noise damages is speckle, which is caused by the interference between scatterers with small spacing and random phases within the optical component. Speckle affects visual acuity and reduces image contrast, thus hindering the perception of the finest details, and its impact on reducing contrast sensitivity is more significant than brightness and aberration.

[0197] The first example surface relief structure stack 200M1 includes a first optical component 202M1 and an intermediate low refractive index laminate 204M1, and a surface relief grating structure 208M1 is constructed on one side of the intermediate low refractive index laminate 204M1. The first example surface relief structure stack 200M1 further includes a third optical component 206M1, and the third optical component 206M1 has surface relief grating structures 208M1 constructed on both sides of the first optical component 202M1 and fixed on the intermediate low refractive index laminate 204M1.

[0198] The refractive index values of the surface relief grating structure 208M1, the first optical component 202M1, the intermediate low refractive index laminate 204M1, and the third optical component 206M1 can be, for example, 1.65, 1.59, 1.31, and 1.59, respectively.

[0199] The second exemplary surface relief structure stack 200M2 includes a first optical component 202M2 and an intermediate low refractive index laminate 204M2 (e.g., a curable resin), which has a surface relief grating structure 208M1 built on one side of the first optical component 202M2. The second exemplary surface relief structure stack 200M2 further includes a second optical component 206M2, which has surface relief grating structures 208M2 built on both sides of the first optical component 206M2 and fixed to the intermediate low refractive index laminate 204M2 (e.g., using a curable resin as the intermediate low refractive index laminate 204M2 to connect the upper stack including the first optical component 202M2 and the lower stack including the second optical component 206M2).

[0200] The refractive index values of the surface relief grating structure 208M2, the first optical component 202M2, the intermediate low refractive index laminate 204M2, and the third optical component 206M2 can be, for example, 1.65, 1.59, 1.31 - 1.5, and 1.59, respectively.

[0201] The third exemplary surface relief structure stack 200M3 includes a first optical component 202M3, which has surface relief grating structures 208M3 on both sides. The exemplary surface relief structure stack 200M3 further includes an intermediate component stack, which includes a second optical component 204M3 and two thinner refractive index-matched optical components 210M3. One side of the intermediate component stack is fixed to a set of surface relief grating structures 208M3, which are fixed to the first optical component 202M3.

[0202] The exemplary surface relief structure stack 200M3 further includes a third optical component 206M3, which has surface relief grating structures 208M3 on both sides of the third optical component 206M3. The other side of the aforementioned intermediate component stack is fixed to a set of surface relief grating stacks 208M3, which are fixed to the third optical component 206M3.

[0203] The refractive index values of the surface relief grating structure 208M3, the first optical component 202M3, the second optical component 204M3, the thinner refractive index-matched optical component 210M3, and the third optical component 206M3 can be, for example, 1.65, 1.59, 1.59, 1.59, and 1.59, respectively.

[0204] Figure 2NThe fourth exemplary surface relief structure stack 200M3 shown includes a first optical component 202M4 having surface relief grating structures 208M4 on both sides thereof. The exemplary surface relief structure stack 200M3 further includes an intermediate component stack that includes a second optical component 204M4 and two thinner refractive-index-matching optical components 210M4. One side of the intermediate component stack can be fixed to a set of surface relief grating structures 208M3, which are fixed to the first optical component 202M3, by using a first intermediate low-refractive-index laminate 212M4 (e.g., a curable resin).

[0205] The exemplary surface relief structure stack 200M4 further includes a third optical component 206M4 having surface relief grating structures 208M4 on both sides thereof. The other side of the intermediate stack component can also be fixed to a set of surface relief grating structures 208M4, which are fixed to the third optical component 206M4, by using, for example, a curable resin as the intermediate low-refractive-index laminate 212M4.

[0206] The refractive index values of the surface relief grating structures 208M3, the first optical component 202M4, the second optical component 204M4, the thinner refractive-index-matching optical components 210M3, the third optical component 206M3, and the intermediate low-refractive-index laminate 212M4 can be, for example, 1.65, 1.59, 1.59, 1.59, 1.59, and 1.31 - 1.5, respectively. Reference numerals 200M5 and 200M6 show cross-sectional views of planar and curved multi-wavelength waveguide stacks, respectively, which are achieved by maintaining a substantially uniform gap (e.g., the gap therebetween is within a certain manufacturing tolerance) between two adjacent waveguides. In some embodiments, the waveguide or a portion thereof can include a bend having a radius of curvature in the range of 2000 mm to 200 mm. In some other embodiments, the waveguide or a portion thereof can also have other radii of curvature. In some embodiments, the waveguide can include a single bend; while in some other embodiments, the waveguide can include multiple bends having the same radius of curvature or multiple radii of curvature.

[0207] Figure 2O Exemplary surface relief structure stacks for a layered multi-wavelength waveguide stack in some embodiments are shown. All three examples show a three-layer architecture, but in some other embodiments, more or fewer layers can also be used in the layered multi-wavelength waveguide stack. In Figure 2OIn these illustrated embodiments, the intermediate lower refractive index laminate (e.g., 204O, 210O, or 216O) is sandwiched between two substrates (e.g., 204O is between 202O and 206O, 210O is between 208O and 212O, or 216O is between 214O and 218O).

[0208] Although only the top substrate (e.g., 202O, 208O, or 214O) is shown as being operatively coupled to the surface relief structure or grating 220O, such surface relief structures or gratings 220O can also be implemented in a different manner than described herein, as a supplement or alternative to the surface relief structure or grating 220O.

[0209] In some embodiments, one or more of the substrates (e.g., 202O, 206O, 208O, 212O, 214O, or 218O) can have a non-uniform thickness (e.g., wedge-shaped) in one or more dimensions, or, in some other embodiments, have a uniform thickness in all dimensions. Additionally or alternatively, in some embodiments, the intermediate lower refractive index laminate (e.g., 204O, 210O, or 216O) can have a non-uniform thickness (e.g., wedge-shaped) in one or more dimensions, or, in some other embodiments, have a uniform thickness in all dimensions.

[0210] Figure 3A Some working examples of laminating to an existing thin waveguide substrate in some embodiments are shown, which increases the total thickness and makes the component more robust, while enhancing the blue and / or red uniformity of a larger FoV (field of view). More specifically, Figure 3A It is shown that the techniques described herein can be used to laminate one or more thinner layers onto an existing waveguide substrate to increase the thickness and make it more mechanically stable, while enhancing the blue and / or red uniformity of a larger FoV (field of view). Figure 3A An obvious enhancement of the red field of view is also shown, while maintaining the blue and green fields of view by simply laminating a low refractive index substrate with a known TTV (total thickness variation) to one side of a high refractive index substrate as Figure 3B shown.

[0211] Figure 3A The enhanced field of view 300A by laminating a low refractive index substrate to a single high refractive index substrate is shown, where column 302A represents the field of view without laminating the low refractive index substrate, and column 304A represents the field of view after laminating the low refractive index substrate. 306A, 308, and 310A represent red (FOV enhanced), green (FOV maintained), and blue (FOV maintained), respectively.

[0212] Figure 3BShows some example stack architectures with a low refractive index cover glass in some embodiments, the low refractive index cover glass being laminated to a high refractive index etched waveguide via a refractive index matching UV curable adhesive (e.g., by using a UV curable thiol-acrylate polymerization system or other equivalent systems that can significantly or satisfactorily reduce the birefringence characteristics typically caused by the molding process). More specifically, Figure 3B Shows a low refractive index cover glass laminated to a high refractive index LiNbO3 etched waveguide (lithium niobium oxide) via a refractive index matching UV curable adhesive. In Figure 3B , 302B represents a surface relief grating structure; 304B represents a high refractive index etched waveguide having a thickness (e.g., 500 μm) and a refractive index n = 2.25. 306B represents a refractive index matching UV (ultraviolet) curable adhesive layer having a refractive index value of, for example, 1.52. 308B represents a lower refractive index cover glass having a refractive index value of, for example, 1.52. 310 represents an intermediate lower refractive index laminate having a refractive index value of, for example, 1.3. 312B represents an etched feature.

[0213] Figure 3C Shows some working examples of laminating to an existing thin waveguide substrate in some embodiments, which increases the total thickness and makes the component more robust, while enhancing the blue and / or red uniformity of a larger FoV (field of view). More specifically, Figure 3C Shows the result of laminating a low refractive index cover glass to the Figure 3B shown high refractive index LiNbO3 etched waveguide via a refractive index matching ultraviolet curable adhesive. In Figure 3A , 3B and / or some embodiments shown in 3C, the substrate may include LiNbO3 or EXG glass having a refractive index value of 2.25 (refractive index values in the range of n = 1.51 - 1.52), and use inkjet printable and UV curable transparent adhesives having refractive index values of 1.31, 1.53, and / or 1.65. In some embodiments, the material selection for the waveguide substrate and its attached laminate may include polymer materials (e.g., PC or polycarbonate, PET or polyethylene terephthalate, PI or polyimide, COP or cycloolefin polymer, etc.) or inorganic materials (e.g., glass, LiNbO3, SiC, etc.), and these materials may be organic, crystalline, and / or birefringent.

[0214] In some embodiments, the waveguide substrate for the eyepiece may have a series of refractive indices, for example, from high refractive index glasses (such as SCHOTT SF5 glass with a refractive index value of 1.7, SF6 glass with a refractive index value of 1.8, HOYA dense tantalum flint glass TAFD55 with a refractive index value of 2.01, TAFD65 with a refractive index value of 2.06, etc.) to crystal substrates (such as lithium tantalate LiTaO3, lithium niobate LiNbO3 with a refractive index value of 2.25, silicon carbide or SiC with a refractive index value of 2.65, etc.).

[0215] In some embodiments, the high refractive index coating may include SiC with a refractive index value of 2.5 - 2.6, TiO2 with a refractive index value of 2.2 - 2.5, ZrO2 with a refractive index value of 2.1, Si3N4 and silicon oxynitride (wherein the refractive index value may be 1.8 - 2.0), SiO2 (1.45m), MgF2 (with a refractive index value of 1.38), etc. The thin film coating can be achieved on a blank or patterned surface using the following methods: physical vapor deposition (PVD), such as evaporation or sputtering (with or without ion assistance, such as Ar / O2 plasma), or chemical vapor deposition (CVD), such as low-pressure PECVD (plasma-enhanced chemical vapor deposition), atmospheric pressure PECVD, ALD (atomic layer deposition), etc.

[0216] In some embodiments, a fluorinated polymer film with a refractive index value of 1.31 can be coated, wherein poly[4,5-difluoro-2,2-bis(trifluoromethyl)-1,3-dioxolene-co-tetrafluoroethylene] is dissolved in Fluorinert FC-40, for example, at a concentration of up to 2% (weight percentage). Lower refractive index films (e.g., refractive index value < 1.3) can be formulated into a single-layer or multi-layer colloidal film composition with a porous SiO2-polymer matrix composition using, for example, sol-gel techniques. In these embodiments, such low refractive index coatings can be applied by methods such as, but not limited to, spin coating, spraying / atomizing, inkjet, etc.

[0217] In some embodiments, the patterned imprintable prepolymer material may include a resin material such as epoxy vinyl ester. The resin may include vinyl monomers (e.g., methyl methacrylate) and / or difunctional or trifunctional vinyl monomers (e.g., diacrylate, triacrylate, dimethacrylate, etc.), where the monomers may or may not contain aromatic molecules. In some of these embodiments, the prepolymer material may include monomers having one or more functional groups such as alkyl, carboxyl, carbonyl, hydroxyl, and / or alkoxy groups. Sulfur atoms and aromatic groups, both of which have higher polarizabilities, may be incorporated into these acrylate components to increase the refractive index of the formulation, which typically ranges from 1.5 to 1.75. In some embodiments, the prepolymer material may include a cycloaliphatic epoxy resin, which can be cured using ultraviolet light or heat. Additionally, the prepolymer material may also include an ultraviolet cationic photoinitiator and a co-reactant to facilitate effective ultraviolet curing under ambient conditions.

[0218] Figure 3D FIG. shows a high-level block diagram of a process or system for delivering virtual content to a user using a wearable electronic device having an optical component or element stack in some embodiments. In these embodiments, a light beam of a virtual content data stream may be generated using the wearable electronic device at 302D. The data stream may include a series of digitally encoded signals transmitted to convey virtual content (e.g., one or more frames of virtual content perceived by the user of the wearable electronic device at one or more depths). For example, a central processing unit (CPU), a graphics processing unit (GPU), and / or other electronic components or devices may be operatively coupled to a projector (e.g., a micro-projector, one or more projector optical fibers, or any other suitable optical device, etc.) to convert the data stream of virtual content into a plurality of light beams.

[0219] At 304D, the light beam may be transmitted to a first substrate of the display of the wearable electronic device. The first substrate may be, for example, an optical waveguide such as the polymer substrate or non-polymer substrate described herein. In some embodiments, the first substrate may have a first refractive index value. In these embodiments, the first substrate may be a laminated form of a polymer or non-polymer material having a substantially uniform thickness (e.g., a single nominal thickness with a certain manufacturing tolerance), which has the first refractive index value. In some other embodiments, the first substrate may be designed to have a non-uniform thickness (e.g., a wedge or other linear or curved shape having multiple different thickness values), which has the first refractive index value.

[0220] At 306D, the light beam can further propagate from the first substrate to the intermediate layer. In these embodiments, the intermediate layer can be a laminated form of a polymer or non-polymer material with a substantially uniform thickness (e.g., a single nominal thickness with a certain manufacturing tolerance), which has a second refractive index value. In some other embodiments, the intermediate layer can be designed to have a non-uniform thickness (e.g., a wedge shape or other linear or curved shape with multiple different thickness values), which has a second refractive index value.

[0221] At 308D, the light beam can further propagate from the intermediate layer to the second substrate with a third refractive index value. In these embodiments, the second substrate can be a laminated form of a polymer or non-polymer material with a substantially uniform thickness (e.g., a single nominal thickness with a certain manufacturing tolerance), which has a third refractive index value. In some other embodiments, the second substrate can be designed to have a non-uniform thickness (e.g., a wedge shape or other linear or curved shape with multiple different thickness values), which has a third refractive index value.

[0222] In some of these embodiments, the intermediate layer can be sandwiched (e.g., via molding, using adhesives, etc.) between the first substrate and the second substrate with zero or more intermediate optical layers or elements. For example, the intermediate optical layer or element can include a set of grating structures (e.g., micro-surface or nano-surface relief structures), substrates, low-refractive-index intermediate layers or laminates, adhesive layers, thermoplastic layers, or any other desired and / or required optical components or elements. Additionally, in some embodiments, the second refractive index value of the intermediate layer can be less than the third refractive index value of the second substrate.

[0223] Then, at 310D, the light beam can be transmitted from the second substrate with zero or more intermediate optical components or elements to a user with an exit pupil replicated by the first substrate, the intermediate layer, and / or the second substrate with zero or more intermediate optical elements or components.

[0224] Figure 4 An example schematic diagram of a data stream 400 in an XR system configured to provide an extended reality (XR) content experience for interacting with the physical world according to some embodiments is shown. More specifically, Figure 4An XR system 402 configured to provide an XR content experience that interacts with the physical world 406 is shown. The XR system 402 may include a display 408. In the illustrated embodiment, the display 408 may be worn by a user as part of a head-mounted device such that the user can wear the display over the eyes like a pair of goggles or glasses. At least a portion of the display may be transparent such that the user can observe the see-through reality 410. The see-through reality 410 may correspond to the portion of the physical world 406 that is within the current viewing point of the XR system 402, which may correspond to the user's viewing point when the user wears a head-mounted device incorporating the display and sensors of the XR system to obtain information about the physical world.

[0225] XR content may also be presented on the display 408 and superimposed on the see-through reality 410. To provide precise interaction between the XR content and the see-through reality 410 on the display 408, the XR system 402 may include sensors 422 configured to capture information about the physical world 406. The sensors 422 may include one or more depth sensors that output depth maps 412. Each depth map 412 may have a plurality of pixels, and each pixel may represent the distance to a surface in the physical world 406 in a particular direction relative to the depth sensor. Raw depth data may be received from the depth sensors to create the depth maps. These depth maps are updated as fast as the depth sensors form new images, potentially hundreds or thousands of times per second. However, this data may be noisy and incomplete, and have holes shown as black pixels in the illustrated depth maps.

[0226] The system may include other sensors, such as image sensors. The image sensors may acquire information that can be processed to otherwise represent the physical world. For example, the images may be processed in a world reconstruction component 416 to create a mesh representing connected portions of objects in the physical world. Similarly, metadata about these objects, such as including color and surface texture, may be acquired using sensors and stored as part of the world reconstruction.

[0227] The system may also acquire information about the user's head pose relative to the physical world. In some embodiments, the sensors 410 may include an inertial measurement unit (IMU) that can be used to calculate and / or determine the head pose 414. The head pose 414 of the depth map may indicate, for example, the current viewing point of the sensor that captured the depth map in six degrees of freedom (6DoF), but the head pose 414 may also be used for other purposes, such as associating image information with a particular portion of the physical world, or associating the position of a display worn on the user's head with the physical world. In some embodiments, the head pose information may be acquired by other means than an IMU, such as by analyzing objects in an image.

[0228] The world reconstruction component 416 can receive the depth map 412, the head pose 414, and any other data from the sensors, and integrate this data into the reconstruction 418, which at least appears to be a single combined reconstruction. The reconstruction 418 may be more complete and less noisy than the sensor data. The world reconstruction component 416 can update the reconstruction 418 using the spatial and temporal averaging of sensor data from multiple viewpoints over a period of time.

[0229] The reconstruction 418 can include a physical world representation in one or more data formats (e.g., voxels, meshes, planes, etc.). Different formats can represent alternative representations of the same part of the physical world or different parts of the physical world. In the example shown, on the left side of the reconstruction 418, parts of the physical world are presented as a global surface; on the right side of the reconstruction 418, parts of the physical world are presented as a mesh. The reconstruction 418 can be used for XR functions such as generating a surface representation of the physical world for occlusion handling or physics-based processing. This surface representation may change as the user moves or objects in the physical world change. For example, the component 420 can use various aspects of the reconstruction 418, and the component 420 generates a changing global surface representation in the world coordinate system, which can also be used by other components.

[0230] XR content can be generated based on this information, for example, by the XR application 404. The XR application 404 can be a game program, for example, which performs one or more functions based on the information of the physical world, such as visual occlusion, physics-based interaction, and environmental reasoning. It can perform these functions by querying data in different formats from the reconstruction 418 generated by the world reconstruction component 416. In some embodiments, the component 420 can be configured to output an update when the representation in the region of interest in the physical world changes. For example, the region of interest can be set to approximate a part of the physical world near the user of the system, such as the part within the user's field of view, or projected (predicted / determined) into the user's field of view. The XR application 404 can use this information to generate and update the XR content. The virtual part of the XR content can be combined with the perspective reality 410 and displayed on the display 408, thereby creating a realistic user experience.

[0231] As Figure 5AAs shown, some portions of the above-described light guiding optical element (LOE) 190 can be used as an exit pupil expander 196 ("EPE") to increase the numerical aperture of the light source 120 in the Y direction, thereby improving the resolution of the system 100. Since the light diameter / spot size generated by the light source 120 is small, the EPE 196 expands the apparent size of the exit pupil of the light exiting the LOE 190, thereby improving the system resolution. In addition to the EPE 196, the AR system 100 can also include an orthogonal pupil expander 194 ("OPE") to expand the light rays in both the X (OPE) and Y (EPE) directions. More details regarding the EPE 196 and the orthogonal pupil expander (OPE) 194 have been described in the above-mentioned U.S. Utility Patent Application Serial No. 14 / 555,585 and U.S. Utility Patent Application Serial No. 14 / 726,424, the contents of which are incorporated herein by reference.

[0232] Figure 5A Shown is the LOE 190 with an input coupling grating (ICG) 192, OPE 194, and EPE 196. Figure 5A Shown is a top view of the LOE 190, which is similar to the view of a user's eye. The ICG 192, OPE 194, and EPE 196 can be any type of DOE, including volume or surface relief.

[0233] The ICG 192 is a DOE (e.g., a linear grating) configured to receive the virtual beam 210 from the light source 120 and propagate it via TIR. In Figure 5A the system 100 shown, the light source 120 is located on the side of the LOE 190.

[0234] The OPE 194 is a diffractive optical element (DOE) (e.g., a linear grating) that is tilted in the transverse plane (i.e., perpendicular to the optical path) such that the virtual beam 210 propagating through the system 100 is laterally deflected by 90 degrees. The OPE 194 is also partially transparent and partially reflective along the optical path. Thus, the beam 210 partially passes through the OPE 194 to form multiple (e.g., 11) small beamlets 210'. In the system 100 shown, the optical path is along the X axis, and the OPE 194 is configured to bend the beamlets 210' to the Y axis.

[0235] EPE 196 is a DOE (e.g., a linear grating) that is tilted in the Z plane (i.e., perpendicular to the X and Y directions) such that a small beam 210' propagating through the system 100 will be deflected 90 degrees in the Z plane and toward the user's eye. EPE 196 is also partially transparent and partially reflective along the optical path (Y axis), so that the small beam 210' partially passes through EPE 196 to form a plurality (e.g., seven) of small beams 210'. For clarity, only some of the light beams 210 and small beams 210' are labeled.

[0236] Both OPE 194 and EPE 196 are also at least partially transparent along the Z axis to allow real-world light (e.g., light reflected from real-world objects) to pass through OPE 194 and EPE 196 in the Z direction and reach the user's eye. For the AR system 100, ICG 192 is also at least partially transparent along the Z axis to allow real-world light to pass through. However, when ICG 192, OPE 194, or EPE 196 is the transmissive diffractive portion of the LOE 190, they may inadvertently couple real-world light rays into the LOE 190. As described above, this inadvertently coupled real-world light may be coupled out to the user's eye to form a ghost artifact.

[0237] In some embodiments, the first planar optical waveguide assembly includes: a first planar optical waveguide having opposite first and second faces; a first input coupler (IC) element configured to optically couple a collimated beam to propagate within the first planar optical waveguide along a first optical path via total internal reflection (TIR); a first exit pupil expander (EPE) element associated with the first planar optical waveguide for splitting the collimated beam into an array of one-dimensional small light beams exiting from the second face of the first planar optical waveguide; a second planar optical waveguide having opposite first and second faces; a second IC element configured to optically couple the array of one-dimensional small light beams to propagate within the second planar optical waveguide along respective second optical paths perpendicular to the first optical path via TIR; and a second exit pupil expander (EPE) element associated with the second planar optical waveguide for splitting the array of one-dimensional small light beams into an array of two-dimensional small light beams exiting from the second face of the second planar optical waveguide. In this case, the first face of the second planar optical waveguide may be fixed to the second face of the first planar optical waveguide. The thicknesses of the first and second planar optical waveguides may be substantially equal.

[0238] The second planar optical waveguide assembly may include: a third planar optical waveguide having opposite first and second faces; a third IC element configured to optically couple a first two-dimensional array of light bundles to propagate along respective third optical paths within the third planar optical waveguide via TIR (total internal reflection); a third EPE element associated with the third planar optical waveguide for splitting the two-dimensional array of light bundles into a plurality of two-dimensional arrays of light bundles exiting from the second face of the third planar optical waveguide; a fourth planar optical waveguide having opposite first and second faces; a fourth IC element configured to optically couple the plurality of two-dimensional arrays of light bundles to propagate along respective fourth optical paths perpendicular to the third optical paths within the fourth planar optical waveguide via TIR; and a fourth EPE element associated with the fourth planar optical waveguide for splitting the plurality of two-dimensional arrays of light bundles into a plurality of two-dimensional arrays of light bundles exiting from the second face of the fourth planar optical waveguide as a set of input light bundles.

[0239] In this case, the first face of the fourth planar optical waveguide may be fixed to the second face of the third planar optical waveguide, and the first face of the third planar optical waveguide may be fixed to the second face of the second planar optical waveguide. The first and second planar optical waveguides may each have substantially equal thicknesses, and the third and fourth planar optical waveguides may each have substantially equal thicknesses. In this case, the substantially equal thicknesses of the first and second planar optical waveguides may be different from the substantially equal thicknesses of the third and fourth planar optical waveguides. The equal thicknesses of the third and fourth planar optical waveguides may be greater than the equal thicknesses of the first and second planar optical waveguides.

[0240] Figure 5B Another optical system 100 is shown, which includes an LOE 190 having an ICG 192, an OPE 194, and an EPE 196. The system 100 also includes a light source 120 configured to direct a virtual light beam 210 to the LOE 190 via the ICG 192. The light beam 210 is split into bundles 210' by the OPE 194 and the EPE 196, as described above with reference to Figure 5A that. Further, as the bundles 210' propagate through the EPE 196, they also exit the LOE 190 via the EPE 196 and are directed towards the user's eyes. For clarity, only selected light beams 210 and bundles 210' are labeled.

[0241] Figure 6 A more detailed display system 42 in some embodiments is shown. The display system 42 includes a stereoscopic analyzer 144 connected to a rendering engine 30 and forming part of the visual data and algorithms.

[0242] The display system 42 also includes left and right projectors 166A and 166B and left and right waveguides 170A and 170B. The left and right projectors 166A and 166B are connected to a power source. Each of the projectors 166A and 166B has its respective input terminal for supplying image data to the corresponding projector 166A or 166B. The corresponding projector 166A or 166B generates and emits light of a two-dimensional pattern after being powered on. The left and right waveguides 170A and 170B are respectively positioned to receive light from the left and right projectors 166A and 166B. The left and right waveguides 170A and 170B are transparent waveguides.

[0243] In use, the user wears the head-mounted frame 40 on the head. Components of the head-mounted frame 40 may include, for example, a strap (not shown) that surrounds the back of the user's head. Then, the left and right waveguides 170A and 170B are then positioned in front of the user's left and right eyes 620A and 620B.

[0244] The rendering engine 30 inputs the image data it receives into the stereoscopic analyzer 144. The image data is three-dimensional image data of local content. The image data is projected onto a plurality of virtual planes. The stereoscopic analyzer 144 analyzes the image data and determines left and right image data sets for projection onto each depth plane based on the image data. The left and right image data sets are data sets representing two-dimensional images projected in three-dimensional space to provide depth perception for the user.

[0245] The stereoscopic analyzer 144 inputs the left and right image data sets into the left and right projectors 166A and 166B. Then, the left and right projectors 166A and 166B create left and right light patterns. The components of the display system 42 are shown in a plan view, but it should be understood that when shown in a front view, the left and right patterns are two-dimensional patterns. Each light pattern includes a plurality of pixels. For the sake of illustration, light rays 624A and 626A from two pixels are shown in the figure, which leave the left projector 166A and enter the left waveguide 170A. The light rays 624A and 626A are reflected from the side of the left waveguide 170A. As shown, the light rays 624A and 626A propagate from left to right by total internal reflection within the left waveguide 170A, but it should be understood that the light rays 624A and 626A also propagate in the direction into the paper using a refraction and reflection system.

[0246] Light rays 624A and 626A leave the left optical waveguide 170A through the pupil 628A, and then enter the left eye 620A through the pupil 630A of the left eye 620A. The light rays 624A and 626A then fall on the retina 632A of the left eye 620A. In this way, the left light pattern falls on the retina 632A of the left eye 620A. The user perceives that the pixels formed on the retina 632A are pixels 634A and 636A, and the user perceives these pixels to be at a certain distance on the side of the left optical waveguide 170A opposite to the left eye 620A. Depth perception is created by controlling the focal length of the light.

[0247] In a similar manner, the stereoscopic analyzer 144 inputs the right image dataset into the right projector 166B. The right projector 166B transmits a right light pattern, which is represented by pixels in the form of light rays 624B and 626B. The light rays 624B and 626B are reflected within the right optical waveguide 170B and exit through the pupil 628B. Then, the light rays 624B and 626B enter through the pupil 630B of the right eye 620B and fall on the retina 632B of the right eye 620B. The pixels of the light rays 624B and 626B are perceived as pixels 634B and 636B behind the right optical waveguide 170B.

[0248] The patterns generated on the retinas 632A and 632B are respectively perceived as left and right images. Due to the function of the stereoscopic analyzer 144, the left and right images are slightly different from each other. The left and right images are perceived as a three-dimensional rendering in the user's mind.

[0249] As described above, the left and right optical waveguides 170A and 170B are transparent. Light from real objects such as the table 16 (located on the side of the left and right optical waveguides 170A and 170B opposite to the eyes 620A and 620B) can pass through the left and right optical waveguides 170A and 170B and be projected onto the retinas 632A and 632B.

[0250] In one or more embodiments, the AR system can track the eye pose (e.g., orientation, direction) and / or eye movement of one or more users in a physical space or environment (e.g., a physical room). The AR system can use information (e.g., captured images or image data) collected by one or more sensors or transducers (e.g., cameras), which are positioned and oriented to detect the eye pose and / or movement of the user. For example, the head-mounted component of a single AR system can include one or more inward-facing cameras and / or light sources to track the user's eyes.

[0251] As described above, an AR system can track a user's eye pose (e.g., orientation, direction) and eye movement and construct a "heat map". The heat map can be a world map for tracking and recording the time, frequency, and number of instances of eye poses directed at one or more virtual or real objects. For example, the heat map can provide information about which virtual and / or real objects generate the most number of / times / frequency of eye gazes or stares. This can also allow the system to understand the user's interest in a particular virtual or real object.

[0252] Advantageously, in one or more embodiments, the heat map can be used for advertising or marketing purposes and, in some embodiments, for determining the effectiveness of an advertising campaign. The AR system can generate or determine a heat map representing the spatial region that the user is focusing on. In one or more embodiments, the AR system can render virtual content (e.g., virtual objects, virtual tools, and other virtual constructs such as applications, features, characters, text, numbers, and other symbols), for example, optimizing the position and / or optical properties (e.g., color, luminosity, brightness) based on eye tracking and / or the heat map.

[0253] In one or more embodiments, the AR system can employ pseudo-random noise when tracking eye pose or eye movement. For example, the head-mounted component of a single AR system can include one or more light sources (e.g., LEDs) that are positioned and directed to illuminate the user's eyes when the user wears the head-mounted component. The camera detects the light from the light source reflected from the eyes. For example, the AR system can use Purkinje images 750, e.g., reflections from objects in the eye structure.

[0254] The AR system can change the parameters of the light emitted by the light source, thereby imposing a recognizable pattern on the emitted light (and thus detected) reflected from the eyes. For example, the AR system can pseudo-randomly change the operating parameters of the light source, thereby pseudo-randomly changing the parameters of the emitted light. For example, the AR system can change the emission length (on / off) of the light source. This helps to automatically detect the emitted light and the reflected light from the light emitted and reflected by the ambient light source.

[0255] Figure 7 An example user physical environment and system architecture for managing and displaying productivity applications and / or resources in a three-dimensional virtual space using an extended reality system or device in one or more embodiments is shown. More specifically, Figure 7Illustrates an example user physical environment and system architecture for managing and displaying web pages and web resources in a virtual 3D space using an extended reality system in one or more embodiments. Representative environment 900 includes user landscape 910 seen by user 103 through head-mounted system 960. User landscape 910 is a 3D view of the world, in which content placed by the user can be synthesized on top of the real world. Representative environment 900 also includes access to the Universe application or Universe browser engine 130 via processor 970 operatively coupled to a network (not shown in the figure).

[0256] Although processor 970 is shown as a separate component separate from head-mounted system 960, in alternative embodiments, processor 970 may be integrated with one or more components of head-mounted system 960 and / or may be integrated into other system components within representative environment 900, such as a network, to access a computing network (not shown) and external storage device 150. In some embodiments, processor 970 may not be connected to a network. Processor 970 may be configured with software (e.g., the Universe application or Universe browser engine 130) for receiving and processing information received from head-mounted system 960, local storage device 137, application 140, the computing network, and / or external storage device 150, such as video, audio, and / or other data (e.g., depth camera data).

[0257] The Universe application or Universe browser engine 130 may be a 3D window manager, similar to a 2D window manager that runs on, for example, a desktop computer and manages 2D windows displayed on the desktop computer display. However, the Universe application or Universe browser engine 130 (hereinafter may be simply referred to as "Universe") manages the creation, placement, and display of virtual content 115 (115a and 115b) in a 3D space environment, as well as the interaction between multiple virtual contents 115 displayed in user landscape 910. Virtual content 115 from application 140 is presented to user 903 within one or more 3D window display management units (such as bounded volumes and / or 3D windows, hereinafter may be referred to as prisms 113 (113a and 113b)).

[0258] A prism is a three - dimensional volumetric space within which virtual content is rendered and displayed. The prism exists within the virtual 3D space provided by the extended reality system. In some embodiments, the virtual 3D space provided by the extended reality system may include multiple prisms. In some embodiments, one or more prisms may be placed in the real world (e.g., the user's environment), thereby providing one or more real - world positions for the prisms. In some of these embodiments, one or more prisms may be placed in the real world relative to one or more objects (e.g., physical objects, virtual objects, etc.), one or more two - dimensional surfaces (e.g., the surface of a physical object, the surface of a virtual object, etc.), and / or one or more one - dimensional points (e.g., the vertex of a physical object, the surface of a virtual object, etc.). In some embodiments, a single software application may correspond to multiple prisms. In some embodiments, a single application corresponds to a single prism.

[0259] In some embodiments, a prism may represent a subtree of a multi - application scenario graph of the current position of an extended reality system user. Retrieving one or more prisms previously deployed at the user's current position may include: retrieving instance data of one or more prisms from, for example, an external database (e.g., a database storing a traversable world model in a cloud environment), and using the instance data of the one or more prisms to reconstruct a local database (e.g., an internal traversable world model database containing a smaller portion of the externally stored traversable world model).

[0260] In some of these embodiments, the instance data of a prism includes a data structure defining one or more prism characteristics. Prism characteristics may include, for example, at least one of position, orientation, range width, range height, range depth, anchor type, and / or anchor position. Additionally or alternatively, the instance data of a prism may include key - value pairs of one or more application - specific characteristics (such as status information of virtual content previously rendered into the prism). In some embodiments, the data may be stored entirely locally, and thus no external database is required.

[0261] In some embodiments, a prism includes a 3D bounded space that has fixed and / or adjustable boundaries when created, although degenerate 3D prisms with lower dimensions are also contemplated. The prism can be positioned (e.g., via the Universe browser engine or an instance thereof) in the virtual 3D space of the XR system and / or in a location in the user's environment or anywhere else in the real world when generated. The boundaries of the prism can be defined at least in part by the system (e.g., the Universe browser engine), the user, and / or the web developer based on the size or extent of the content to be rendered within the prism. In some embodiments, only the XR system (e.g., its Universe browser engine) can create and / or adjust the boundaries of the prism on the XR system. In some embodiments, the boundaries of the prism can be displayed (e.g., in a graphically attenuated manner). In some other embodiments, the boundaries of the prism are not displayed.

[0262] The boundaries of the prism define the space in which virtual content and / or rendered content can be created. In some embodiments, the boundaries of the prism can also limit the movement and rotational position and amplitude of a web page panel. For example, when a web page panel is to be positioned, rotated, and / or scaled such that at least a portion of the web page panel is outside the prism, the system (e.g., the Universe browser engine) can prevent such positioning, rotation, and / or scaling.

[0263] In some embodiments, the system can position, rotate, and / or scale the web page panel to the next possible position that is closest to or near the original position, rotation, or scale in response to an original positioning, rotation, or scaling request. In some of these embodiments, the system can display a ghost or frame of the next possible position, rotation, or scale and optionally display a message indicating that the original position, rotation, or scale may cause at least a portion of the web page panel to be outside the prism.

[0264] An application can render graphics into the prism at least in part via the Universe browser engine. In some embodiments, the Universe browser engine renders the scene graph and / or has full control over the positioning, rotation, scaling, etc. of the prism. Additionally, the Universe browser engine can provide the ability to attach one or more prisms to physical objects (e.g., walls, surfaces, etc.) and register the prisms to a traversable world that can be shared among multiple XR system users as described herein.

[0265] Additionally or alternatively, the Universe browser engine can control content sharing among multiple XR system users. In some embodiments, the Universe browser engine can also manage prisms. For example, the Universe browser engine can create prisms, manage positioning and / or capture rules relative to one or more physical objects, provide user interface controls (such as close buttons, action bars, navigation panels, etc.), and track records or data of prisms (such as which application owns or invokes which prism, where the prism is placed, how to anchor the prism - body-centered, world-fixed, etc.).

[0266] In some embodiments, the behavior of a prism can be partially or wholly based on one or more anchor points. In some embodiments, the behavior of a prism can be partially based on positioning, rotation, and / or scaling (such as a user placing web content or the prism itself through user interaction, a developer positioning, rotating, and / or scaling a web page panel, etc.) and / or body dynamics (such as billboards, body-centered, lazy headlock, etc.). In some embodiments, a prism can move within a 3D virtual space. In some of these embodiments, the Universe browser engine can track the movement of the prism (such as body-centered vs. billboard technology, effort-saving billboard technology, swaying when moving, collision bounce, etc.) and manage the movement of the prism.

[0267] Additionally or alternatively, a prism including a browser, a web page panel, and any other virtual content can be transformed in a variety of different ways by applying corresponding transformations to the prism. For example, the prism can move, rotate, scale, and / or transform in a virtual 3D space. In some embodiments, a set of transformations is provided for the transformation of web pages, web page panels, browser windows, and prisms, etc. In some embodiments, a prism with a set of functions can be automatically created. In some embodiments, the set of functions can include, for example, the minimum and / or maximum size that a prism is allowed to have, and / or the aspect ratio for resizing the prism. The set of functions can include the association between the prism and objects (such as virtual objects, physical objects, etc.) in a virtual or physical 3D space environment. Additional virtual content can be rendered into one or more additional prisms, where, in some embodiments, each virtual content can be rendered into a separate prism, or in some other embodiments, two or more virtual contents can be rendered into the same prism.

[0268] In some embodiments, the prism can be completely transparent and thus invisible to the user; or, in some other embodiments, the prism can be translucent and thus visible to the user. Different from traditional web pages displayed within a browser window, the browser window is configurable (e.g., via the Universe browser engine) to be displayed or hidden in the virtual 3D space. In some embodiments, the browser window can be hidden and thus invisible to the user, but some browser controls (e.g., navigation, address bar, home icon, reload icon, bookmark bar, status bar, etc.) can still be visible to the user in the virtual 3D space. In some embodiments, these browser controls can be translated, rotated, and transformed in display together with the corresponding web page; or, in some other embodiments, these browser controls can be displayed independently of the corresponding web page.

[0269] In some embodiments, the prism may not overlap with other prisms in the virtual 3D space. The prism can include one or more general features to ensure that different software applications can interact with each other properly, and / or include one or more application-specific features selected from a list of options.

[0270] In some embodiments, the vertices (806) of the prism can be displayed to the user in a weakened manner (e.g., reduced brightness, etc.) so that the user can understand the scope of the prism, and the virtual object or the rendered web page can be translated or rotated within the scope of the prism. In some embodiments, for example, when the web page or the web page panel is translated or rotated such that a part of the web page or the web page panel extends beyond the scope defined by the prism, the system can still display the remaining part of the web page or the web page panel that is still within the prism, but does not display the part of the web page that extends beyond the scope of the prism. In some other embodiments, the extended reality system restricts the translation, rotation, and transformation of the web page or the web page panel such that the entire web page or the web page panel can be freely translated, rotated, or transformed, but is still restricted by the boundaries of the prism.

[0271] The virtual 3D space may include one or more prisms. Additionally, in some embodiments, a prism may further include one or more other prisms such that the prism can be regarded as the parent of one or more other prisms. In some of these embodiments, a prism tree structure can be constructed, where each node represents a prism and the edge between two connected nodes represents the parent-child relationship between these two connected nodes. Two prisms can move in an overlapping manner, and even one prism can be completely contained within another prism. The containment relationship between two prisms may or may not indicate the existence of a parent-child relationship between these two prisms, although the extended reality system can be configured to allow the user to specify the parent-child relationship between two prisms. Additionally, for a parent-child relationship to exist, the first prism does not have to be completely contained within the second prism. In some embodiments, all child prisms inherit the transformations, translations, and rotations that have been applied or are about to be applied to the parent prism so that the parent prism and its child prisms are transformed, translated, and rotated together.

[0272] The bounded volume / 3D window / prism 113 can be a rectangular body, a cube, a cylinder, or a spatial volume of any other shape that can be positioned and oriented in space. The prism 113 can be a volume display space with boundaries for rendering / displaying content (e.g., virtual content), where the boundaries are not displayed. In some embodiments, the boundaries can be displayed. The prism 113 can present standard basic-level interactions and control over the application content and its position. The prism 113 can represent a subtree of a multi-application scene graph, which can be embedded inside the Universe browser engine 130 or located outside the Universe browser engine but accessible by the Universe browser engine. A scene graph is a common data structure used in vector-based graphics, editing applications, and modern game software. It is used to arrange the logical representation of a graphical scene, typically (but not necessarily) a spatial representation. A scene graph can be regarded as a data structure that defines how the content is positioned and transformed relative to each other within its structure. The application 140 is given an instance of the prism 113 for placing content therein. The application can use relative placement algorithms and arbitrary transformations to render 2D / 3D content within the prism 113, but the Universe browser engine (130) may ultimately still be responsible for the overall interaction mode, such as content extraction. Multiple applications can be rendered to the Universe browser engine (130) via the prism 113, and the prisms 113 are separated by process boundaries. Each application process has n bounded volumes / prisms 113, but this is clearly an n:1 relationship, such that for each bounded volume / prism 113, only one process can run for each application, but there can also be m processes running, each with its own bounded volume / prism 113.

[0273] The Universe browser engine (130) processes 2D and / or 3D content using a prismatic / distributed scenegraph approach. A portion of the Universe browser engine scenegraph is reserved for each application to render. Each interaction with an application (e.g., the launcher menu, the landscape, or the body-centered application area, which will be described in more detail below) can be accomplished via the multi-application scenegraph. One to n rectangular prisms can be assigned to each application, which represent subtrees of the scenegraph. The prisms are not assigned by the client application but are created via the user's interaction within the Universe browser engine (130), e.g., when the user opens a new application in the landscape by clicking a button on the controller. In some embodiments, an application can request a prism from the Universe browser engine (130), but the request may be denied. In some embodiments, if an application requests and is allowed to use a new prism, the application can transform the new prism only relative to one of the other prisms.

[0274] The Universe browser engine (130) includes the virtual content 115 from the application 140 within an object called a prism 113. Each application process or instance can render its virtual content into its respective prism 113 or set of prisms. The Universe browser engine (130) manages the world space (sometimes called the landscape) in which the prisms 113 are displayed. In some embodiments, the Universe browser engine (130) provides the following functions: attaching applications to walls and surfaces, placing prisms anywhere in the space, registering prisms into the world database of the extended reality system, and / or controlling content sharing among multiple users of the extended reality system.

[0275] In some embodiments, the purpose of the prism 113 is to provide behavior and control over content rendering and display. Very similar to a 2D display (where windows can be used to define the position, menu structure, and display of 2D content within the 2D window), with a 3D virtual display, the prism allows the extended reality system (e.g., the Universe browser engine (130)) to wrap controls related to content position, 3D window behavior, and / or the menu structure around the 3D content display, etc. For example, the control can include at least placing virtual content at a specific location in the user's landscape 110, removing virtual content from the landscape 110, duplicating virtual content, and / or placing the copy at another location, etc. In some embodiments, the prism can and can only be created and destroyed by the user. Doing so can explicitly help control the abuse of the provided interface and help the user maintain control over the user's content.

[0276] In addition, in some embodiments, the applications 140 do not know their location in the landscape by volume, only that they exist. In some embodiments, an application may request one or more prisms, and the request may or may not be approved. After a new prism is created, the user may change its location, and / or the application may automatically position the new prism relative to the currently existing prisms associated with the application. In some embodiments, each application 140 that uses the Universal browser engine service to render 3D content (e.g., synthetic 3D content) into the Universal browser engine process is required to first register a listener with the Universal browser engine. The listener can be used to notify the application 140 of the creation and destruction of the rendered prisms based on user movement and the user's interaction with these prisms. The listener is an interface object that receives messages from the inter-process communication system. For example, in the Android operating system, the listener is an object that receives messages through the Android Binder interface. However, any IPC system can be used, and it is not always the case that Binder is used.

[0277] In some embodiments, prisms can be created through the following example interactions: (1) the user extracts content from an extractable node (further disclosed below); (2) the user launches an application from the launcher; (3) the user downloads a nearby traversable world map tile that contains a placement instance of the application that the user has the right to view; (4) the user downloads a nearby traversable world map tile that contains an object detected by the traversable world object recognizer infrastructure, and the given application must render the content of the object; and / or (5) the user triggers a dispatch from another application, and the dispatch must be handled by a different application. In some embodiments, the traversable world model allows the user to effectively transfer a portion of the user's world (e.g., the surrounding environment, interactions, etc.) to another user.

[0278] Extractable content refers to the content (including but not limited to icons, 3D icons, words in a text display, and / or images) within a prism that can be pulled out of the prism using an input device and placed in the landscape. For example, a prism may display a web page showing running shoes for sale. To extract the running shoes, the user can use an input device to select and "pull" out the shoes. A new prism will be created that contains a 3D model representing the shoes, and this prism will move out of the original prism and towards the user. As with any other prism, the user can use an input device to move, zoom in, zoom out, or rotate the new prism containing the shoes in the 3D space of the landscape. An extractable node is a node in the prism scene graph that is marked as extractable content. In the Universe browser engine, extracting content means selecting the extractable node and using an input device to pull the content out of the prism. The input that initiates this pulling action can be aiming a 6dof pointing device at the extractable content and pulling the trigger on the input device.

[0279] Each user's respective extended reality system (e.g., an extended reality device) captures information as the user traverses or is in the environment, and the extended reality system processes this information to generate a traversable world model. More details about the traversable world have been described in U.S. Patent Application No. 14 / 205,126, entitled "Systems and Methods for Augmented Reality and Extended Reality," filed on March 11, 2014, the content of which is hereby expressly incorporated by reference for all purposes. An individual extended reality system can transmit or deliver the traversable world model to a common or shared data set called the cloud. An individual extended reality system can transmit or deliver the traversable world model to other users directly or via the cloud. The traversable world model can efficiently convey or deliver information that at least encompasses the user's field of view. In one embodiment, the system uses pose and orientation information and the 3D points collected above to create the traversable world model.

[0280] In some embodiments, the traversable world model allows users to integrate content (e.g., virtual and / or physical content) with the real world. The traversable world system can include one or more extended reality systems or extended reality user devices capable of connecting to a cloud network, a traversable world model, a set of object recognizers, and a database (e.g., external database 150). The traversable world model can be configured to receive information from the extended reality user device via a network and transmit data to it. For example, based on a user's input, a fragment of the traversable world can be passed from one user to another. The traversable world model can be considered a collection of images, points, and other information (e.g., real-world information) based on which the extended reality system can build, update, and construct a virtual world in the cloud and effectively deliver fragments of the virtual world to individual users. For example, a set of real-world points collected from the extended reality user device can be collected into the traversable world model. Various object recognizers can crawl through the traversable world model to identify objects, label images, etc., and attach semantic information to the objects. The traversable world model can use the database to build its world knowledge, attach semantic information, and store data associated with the traversable world.

[0281] If the prism is visible to the user but its control application is not currently installed, the Universe browser engine can render a temporary placeholder for the application, which, when interacted with, redirects the user to the application store page for that application. In some embodiments, the prism can be destroyed in a similar interaction: (1) the user moves away from the traversable world map tile such that the placed application instance has been unloaded (i.e., removed) from volatile memory; (2) the user destroys the placed application instance; and / or (3) the application requests to close the prism.

[0282] In some embodiments, if the prisms corresponding to an application are not visible and / or not loaded, the processes associated with those prisms may pause or end. Once the placed prisms corresponding to the application are visible again, the processes restart. Prisms may also be hidden, but in some embodiments, this occurs only at the request of the Universe browser engine and the user. In some embodiments, multiple prisms may be placed in exactly the same location. In such embodiments, the Universe browser engine displays only one instance of the placed prisms at a location at a time and manages rendering by hiding the visibility of the prisms (and their associated content) until user interaction is detected, such as the user "swiping" to the next visible element (e.g., prism) at that location.

[0283] In some embodiments, each prism 113 may be exposed to the application 140 via a volume listener interface that includes methods for accessing the properties of the prism 113 and registering the content of shared resources (such as meshes, textures, animations, etc.) in the scene graph sub-tree. In some embodiments, since the application 140 does not know the position of a given prism 113 in 3D space, the volume listener interface may provide accessor methods for a set of cues that help define the position of the given prism in the Universal browser engine, such as hand-centered, staying in the landscape, body-centered, etc. These properties also specify the expected behavior of the prism and can be controlled in a limited way by the user, the application 140, or the Universal browser engine. A given prism may be positioned relative to another prism owned by the application. The application may specify that when placing prisms from the application, the individual prisms should snap together (the two sides of their bounding volumes touch). Additionally, the prism may provide an API (e.g., 118B) for key-value data storage. Some of these key-value pairs can only be written by privileged applications.

[0284] In some embodiments, the application 140 is a client software application that provides content to be displayed to the user 103 in the user landscape 110. For example, the application 140 may be a video streaming application, where video data may be streamed to the user for display on a 2D plane. As another example, the application 140 may be a Halcyon application that provides 3D imaging of physical objects that may represent a past time that was idyllically happy and peaceful for the user. The application 140 provides content that the user may want to include in the user landscape 110. The Universe browser engine manages the placement and management of the content generated by the application 140 via the prisms 113.

[0285] When a non-immersive application is executed / launched in the user landscape 110, its content (e.g., virtual content) will be rendered within the prism 113. A non-immersive application can be an application capable of running and / or displaying content simultaneously with one or more other applications in a shared 3D environment. Although the virtual content may be contained within the prism, the user can still interact with the virtual content, e.g., hovering over an object, clicking on it, etc. The prism 113 can also bind the display content of the application 140 so that different applications 140 do not interfere with each other or with other objects in the user landscape 110. The prism 113 can also provide a useful abstraction for suspending, pausing, and / or minimizing virtual content in the application 140 that is not within the user's field of view or is too far away from the user.

[0286] The prism 113 can be anchored / attached / fixed to various objects within the user landscape 110, including snapping to or anchoring to another prism. For example, a prism 113a displaying virtual content 115 (e.g., a video 115a from a video streaming application) can be anchored to a vertical wall 117a. As another example, a prism 113b displaying a 3D tree 115b from a Halcyon application can be anchored to a table 117b. Additionally, the prism 113 can be anchored relative to the user 103 (e.g., body-centered), where the prism 113 displaying the virtual content 115 can be anchored to the user's body such that when the user's body moves, the prism 113 also moves relative to the movement of the user's body. Body-centered content can be application content that follows the user and maintains a consistent position with the user, such as planes, meshes, etc. For example, a small dialog box follows the user but exists relative to the user's spine rather than the landscape 110. Additionally, the prism 113 can also be anchored to virtual objects, such as a virtual display shown within the user landscape 110. The prism 113 can be anchored in different ways, as described below.

[0287] The Universal browser engine can include a local database 137 for storing the properties and characteristics of the prism 113 for the user. The stored prism information can include the prisms activated by the user within the user landscape 110. The local database 137 can be operatively coupled to an external database 150, which can reside in the cloud or on an external storage device. The external database 150 can be a persistent database for maintaining information about the user and the extended reality environment of other users.

[0288] For example, when a user launches a new application to display virtual content in their physical environment, the local database 137 can store information corresponding to the prisms created by the Universal browser engine and placed at specific locations, where the application 140 can render the content into the prisms 113 for display in the user landscape 110. The information corresponding to the prisms 113, virtual content 115, and application 140 stored in the local database 137 can be synchronized to the external database 150 for persistent storage.

[0289] In some embodiments, persistent storage is important because when the extended reality system is shut down, the data stored in the local database 137 may be erased, deleted, or made non-persistent. Thus, when the user turns on the extended reality system, the Universe browser engine can synchronize with the external database 150 to retrieve an instance of the local database 137 corresponding to the user 103 and the user landscape 110 before the extended reality system was shut down. The local database 137 can be an instance of the external database 150, where the instance of the local database 137 contains information related to the user 103 and their current environment. The external database 150 can also store local database instances of other users, multiple users, the same user over a period of time, and / or other environments. The external database 150 can contain information for managing and sharing virtual content among multiple users of the extended reality system, while the local database 137 stores and maintains information corresponding to the user 103.

[0290] Whenever the application 140 needs to render the virtual content 115 onto the user landscape 110, the Universal browser engine can create the prisms 113 for the application 140. In some embodiments, the prisms 113 created by the Universal browser engine allow the application 140 to focus on the rendered virtual content to be displayed, while the Universal browser engine focuses on creating and managing the placement and display of the prisms 113, where the virtual content 115 is displayed by the application 140 within the boundaries of the prisms.

[0291] Each piece of virtual content 115 rendered by application 140 and displayed in user landscape 110 can be displayed within a single prism 113. For example, if application 140 needs to render two pieces of virtual content (e.g., 115a and 115b) for display in user landscape 110, application 140 can render these two pieces of virtual content 115a and 115b. Since virtual content 115 only contains the rendered virtual content, the Universal browser engine can create prisms 113a and 113b to correspond to each of virtual content 115a and 115b respectively. Prism 113 can contain 3D window management features and characteristics of virtual content 115 to allow the Universal browser engine to manage the virtual content 115 within prism 113 as well as the placement and display of prism 113 in user landscape 110.

[0292] The Universal browser engine can be the first application that user 103 sees when opening the extended reality device. The Universal browser engine can be at least responsible for: (1) rendering the user's world landscape; (2) 2D window management and 3D window (e.g., prism) management of flat applications; (3) displaying and executing the application launcher menu; (4) allowing the user to place virtual content into user landscape 110; and / or (5) managing different display states of prism 113 within user landscape 110.

[0293] The head-mounted system 960 can be an extended reality head-mounted system, which includes a display system (e.g., user interface) located in front of user 103's eyes, speakers coupled to the head-mounted system and located near the user's ear canals, a user sensing system, an environmental sensing system, and a processor (all not shown). The head-mounted system 960 provides user 103 with a display system (e.g., user interface) for interacting with and experiencing the digital world. Such interactions involve the user and the digital world, one or more other users interacting with the representative environment 900, and objects in the digital and physical worlds.

[0294] The user interface can include viewing, selecting, positioning, and managing virtual content via user input through the user interface. The user interface can be at least one of or a combination of a haptics interface device, a keyboard, a mouse, a joystick, a motion capture controller, an optical tracking device, an audio input device, a smartphone, a tablet computer, or the head-mounted system 960. A haptics interface device is a device that allows a human to interact with a computer through physical sensations and movements. Haptics refers to a human-computer interaction technology that includes tactile feedback or other physical sensations to perform operations or processing on a computing device.

[0295] An example of a haptic controller can be a totem (not shown). In some embodiments, the totem is a handheld controller for tracking its position and orientation relative to the head-mounted device 960. In this example, the totem can be a six-degree-of-freedom (6DOF) controller, and the user can move the height and azimuth of the prism (on the spherical shell) by moving the totem up and down. In some embodiments, to move an object closer or farther away, the user can use a joystick on the totem to "push" or "pull" the prism, or can simply move the totem forward or backward. This can change the radius of the shell. In some embodiments, two buttons on the totem can cause the prism to enlarge or shrink. In some embodiments, rotating the totem itself can rotate the prism. Other totem operations and configurations can be used and should not be limited to the above embodiments.

[0296] The user sensing system can include one or more sensors 962 that are operable to detect certain characteristics, properties, or information related to the user 103 wearing the head-mounted system 960. For example, in some embodiments, the sensor 962 can include a camera or optical detection / scanning circuit capable of detecting real-time optical characteristics / measurements of the user 103 (such as one or more of the following: pupil constriction / dilation, angular measurement / location of each pupil, sphericity, eye shape (when the eye shape changes over time), and other anatomical data). This data can provide or be used to calculate information (e.g., the user's visual focus), and the head-mounted system 960 can use this information to enhance the user's viewing experience.

[0297] The environment sensing system can include one or more sensors 964 for obtaining data from the user landscape 910. The objects or information detected by the sensor 964 can be provided as input to the head-mounted system 960. In some embodiments, this input can represent the user's interaction with the virtual world. For example, a user (e.g., user 103) viewing a virtual keyboard on a desktop can make gestures with their fingers as if the user were typing on the virtual keyboard. The movement of the fingers can be captured by the sensor 964 and provided as input to the head-mounted system 960, where the input can be used to change the virtual world or create new virtual objects.

[0298] The sensor 964 can, for example, include a generally outward-facing camera or scanner for capturing and interpreting scene information, for example, by continuously and / or intermittently projected infrared structured light. The environmental sensing system can be used to map one or more elements of the user landscape 910 around the user 103 by detecting and recording one or more elements from the local environment, including static objects, dynamic objects, people, gestures, and various lighting, atmospheric, and acoustic conditions, etc. Thus, in some embodiments, the environmental sensing system can include image-based 3D reconstruction software embedded in a local computing system (e.g., the processor 170), which is operable to digitally reconstruct one or more objects or information detected by the sensor 964.

[0299] In some embodiments, the environmental sensing system provides one or more of the following: motion capture data (including gesture recognition), depth perception, face recognition, object recognition, unique object feature recognition, voice / audio recognition and processing, sound source localization, noise reduction, infrared or similar laser projection, and monochrome and / or color CMOS (complementary metal oxide semiconductor) sensors (or other similar sensors), field of view sensors, and various other optical enhancement sensors. It should be understood that the environmental sensing system can also include other components in addition to the above components.

[0300] As described above, in some embodiments, the processor 970 can be integrated with other components of the head-mounted system 960, integrated with other components of the system of the representative environment 900, or can be a stand-alone device (wearable or separate from the user 103). The processor 970 can be connected to various components of the head-mounted system 960 through a physical wired connection or a wireless connection (e.g., a mobile network connection (including cellular phones and data networks), Wi-Fi, Bluetooth, or any other wireless connection protocol). The processor 970 can include a memory module, an integrated and / or additional graphics processing unit, a wireless and / or wired Internet connection, and a codec and / or firmware capable of converting data from sources (e.g., a computing network, the user sensing system and the environmental sensing system of the head-mounted system 960) into image and audio data, wherein the image / video and audio can be presented to the user 103 via a user interface (not shown).

[0301] The processor 970 is responsible for data processing of the various components of the head-mounted system 960 and data exchange between the head-mounted system 960 and software applications (such as the Universe browser engine, the external database 150, etc.). For example, the processor 970 can be used to buffer and process the data stream between the user 103 and the computing network (including software applications), so as to achieve a smooth, continuous and high-fidelity user experience. The processor 970 can be configured to execute a set of program code instructions. The processor 970 can include a memory for storing the set of program code instructions, wherein the set of program code instructions includes program code for displaying virtual content within a subset of the available 3D displayable space by displaying virtual content within the volumetric display space, and wherein the boundaries of the volumetric display space are not displayed. In some embodiments, the processor can be two or more operatively coupled processors.

[0302] In some embodiments, the extended reality system can be configured to assign common features and application-selected / application-specific features to the prisms from a list of pre-approved options for application-configured display of custom content. For example, the common features can ensure good interaction between different applications. Some examples of common features include maximum / minimum size, non-overlapping prisms (excluding temporary overlaps caused by collision behavior), not displaying content outside the prism boundaries, and the application requires user permission to access sensors or sensitive information. The application-selected / application-specific features can optimize the application experience.

[0303] The application-selected / application-specific features can include maximum / minimum size (within system limits), default size (within system limits), body dynamic type (e.g., none / world lock, billboard, edge billboard, follow / lazy headlock, follow based on external sensors, fade - as described below), sub-prism generation position, sub-prism head pose highlighting, sub-prism relationship behavior, surface behavior, independent transform control, resize and scale, idle state timeout, collision behavior, access permissions / passwords for the application, etc. In another embodiment, the extended reality system can be configured to display virtual content into one or more prisms, wherein, in some embodiments, the one or more prisms do not overlap with each other.

[0304] In some embodiments, one or more prisms can overlap to provide a specific interaction. In some embodiments, one or more prisms can overlap, but only with other prisms from the same application. In another embodiment, the extended reality system can be configured to change the state of the prism at least in part based on the relative positioning and location of the prism with respect to the user. In another embodiment, the extended reality system can be configured to manage content creation in an application and manage content display in a separate application. In another embodiment, the extended reality system can be configured to open an application that provides content to the prism while placing the prism in the extended reality environment.

[0305] In some embodiments, the extended reality system can be configured to assign position, orientation, and extent data to a prism to display virtual content within the prism, where the virtual content is 3D virtual content. In some embodiments, the extended reality system can be configured to pin a launcher application to a real-world object in the extended reality environment. In some embodiments, the extended reality system can be configured to assign a behavior type to each prism, the behavior type including at least one of the following: world lock, billboard, edge billboard, follow head lock, follow based on an external sensor, or fade in / out (described in more detail below). In some embodiments, the extended reality system can be configured to identify the most frequently used content or an application specific to the placement location of the launcher application and thus reorder the applications, for example, from most frequently used to least frequently used. In another embodiment, the extended reality system can be configured to display a favorite application on the placed launcher application, the favorite application being at least in part based on the context relative to the placement location of the launcher.

[0306] System Architecture Overview

[0307] Figure 8A computerized system is shown on which a method for managing an extended reality system or device can be implemented. Computer system 1000 includes a bus 1006 or other communication modules for communicating information, which interconnect the following subsystems and devices: for example, a processor 1007, a system memory 1008 (e.g., RAM), a static storage device 1009 (e.g., ROM), a disk drive 1010 (e.g., magnetic or optical), a communication interface 1014 (e.g., a modem or an Ethernet card), a display 1011 (e.g., a CRT or an LCD), an input device 1012 (e.g., a keyboard), and a cursor control (not shown). The illustrative computing system 1000 can include an Internet-based computing platform that provides, via the Internet, in a ubiquitous and on-demand manner, a shared pool of configurable computer processing resources (e.g., computer networks, servers, storage, applications, services, etc.) and data to other computers and devices. For example, in some embodiments, the computing system 1000 can include a cloud computing platform or can be part of a cloud computing platform.

[0308] According to one embodiment, computer system 1000 performs specific operations by executing one or more sequences of one or more instructions contained in system memory 1008 by one or more processors or processor cores 1007. Such instructions can be read into system memory 1008 from another computer-readable / usable storage medium, such as static storage device 1009 or disk drive 1010. In alternative embodiments, hardwired circuitry may be used in place of or in combination with software instructions to implement the invention. Thus, embodiments of the invention are not limited to any specific combination of hardware circuitry and / or software. In one embodiment, the term “logic” shall refer to any combination of software or hardware used to implement all or part of the invention.

[0309] The various actions or processes described in the foregoing paragraphs can be performed by using one or more processors, one or more processor cores, or a combination thereof 1007, where one or more processors, one or more processor cores, or a combination thereof execute one or more threads. For example, various actions such as determining, identifying, synchronizing, computing graphics coordinates, rendering, transforming, translating, rotating, generating software objects, placing, allocating, associating, etc. can be performed by one or more processors, one or more processor cores, or a combination thereof.

[0310] As used herein, the term "computer-readable storage medium" or "computer-usable storage medium" refers to any non-transitory medium that participates in providing instructions to processor 1007 for execution. Such a medium can take many forms, including but not limited to non-volatile media and volatile media. Non-volatile media includes, for example, optical or magnetic disks, such as disk drive 1010. Volatile media includes dynamic memory, such as system memory 1008. Common forms of computer-readable storage media include, for example, magnetic disk drives (such as floppy disks, flexible disks, or hard disks), flash-based, RAM-based (such as SRAM, DRAM, SDRAM, DDR, MRAM, etc.) or any other solid-state drive (SSD), magnetic tape, any other magnetic or magneto-optical medium, CD-ROM, any other optical medium, any other physical medium with a hole pattern, RAM, PROM, EPROM, FLASH-EPROM, any other memory chip or cartridge, or any other computer-readable medium.

[0311] In an embodiment of the present invention, the execution of an instruction sequence for implementing the present invention is performed by a single computer system 1000. According to other embodiments, two or more computer systems 1000 coupled by a communication link 1015 (e.g., LAN, PTSN, or wireless network) can execute the instruction sequence required to implement the present invention in a coordinated manner.

[0312] Computer system 1000 can send and receive messages, data, and instructions, including programs (e.g., application code), via communication link 1015 and communication interface 1014. The received program code can be executed by processor 1007 upon receipt, and / or stored in disk drive 1010 or other non-volatile storage device for later execution. In one embodiment, computer system 1000 operates in conjunction with data storage system 1031, e.g., a data storage system 1031 that includes database 1032 that is readily accessible to computer system 1000. Computer system 1000 communicates with data storage system 1031 via data interface 1033. Data interface 1033, coupled to bus 1006 (e.g., memory bus, system bus, data bus, etc.), sends and receives electrical, electromagnetic, or optical signals that include data streams representing various types of signal information (e.g., instructions, messages, and data). In an embodiment of the present invention, the functionality of data interface 1033 can be performed by communication interface 1014.

[0313] Figure 9An example architecture 2500 of an electronic device operably coupled to an optical system or XR device in one or more embodiments is shown. The optical system or XR device itself or an external device (e.g., a waist pack) coupled to the optical system or XR device may include one or more printed circuit board assemblies, such as left (2502) and right (2504) printed circuit board assemblies (PCBA). As shown, the left PCBA 2502 contains most of the active electronics, while the right PCBA 604 mainly supports display or projector elements.

[0314] The right PCBA 2504 may include a plurality of projector driver structures that provide image information and control signals to the image generation components. For example, the right PCBA 2504 may carry a first or left projector driver structure 2506 and a second or right projector driver structure 2508. The first or left projector driver structure 2506 connects the first or left projector optical fiber 2510 and a set of signal lines (e.g., piezoelectric driver lines). The second or right projector driver structure 2508 connects the second or right projector optical fiber 2512 and a set of signal lines (e.g., piezoelectric driver lines). The first or left projector driver structure 2506 is communicatively coupled to the first or left image projector, while the second or right projector driver structure 2508 is communicatively coupled to the second or right image projector.

[0315] In operation, the image projectors render virtual content to the user's left and right eyes (e.g., retina) via corresponding optical components (e.g., waveguides and / or compensating lenses for altering light associated with the virtual image).

[0316] For example, the image projectors may include left and right projector assemblies. The projector assemblies may use various different image formation or production techniques, such as fiber - scanned projectors, liquid crystal displays (LCD), LCOS (liquid crystal on silicon) displays, digital light processing (DLP) displays. When using a fiber - scanned projector, the image may be transmitted along the optical fiber and projected via the fiber tip. The tip may be oriented to feed into the waveguide. The fiber tips can project images and are supported in a way that they can bend or oscillate. A plurality of piezoelectric actuators can control the oscillation of the tips (e.g., frequency, amplitude). The projector driver structures supply the image to the corresponding optical fiber and provide control signals to control the piezoelectric actuators, thereby projecting the image onto the user's eyes.

[0317] Continuing the discussion of the right PCBA 2504, the button board connector 2514 can provide communication and physical coupling to the button board 2516, which carries various user-accessible buttons, keys, switches, or other input devices. The right PCBA 2504 can include a right headphone or speaker connector 2518 for communicatively coupling audio signals to the right headphone 2520 or speaker of the headset assembly. The right PCBA 2504 can also include a right microphone connector 2522 for communicatively coupling audio signals from the microphone of the headset assembly. The right PCBA 2504 can also include a right occlusion driver connector 2524 for communicatively coupling occlusion information to the right occlusion display 2526 of the headset assembly. The right PCBA 2504 can also include a board-to-board connector for providing communication with the left PCBA 2502 via its board-to-board connector 2534.

[0318] The right PCBA 2504 can be communicatively coupled to one or more right outward-facing or world-view cameras 2528 worn on the body or head, and optionally coupled to a right camera visual indicator (e.g., an LED) that lights up when an image is captured to indicate to others. The right PCBA 2504 can be communicatively coupled to one or more right-eye cameras 2532 carried by the headset assembly, positioned and oriented to capture right-eye images, thereby allowing tracking, detection, or monitoring of the orientation and / or movement of the right eye. Optionally, the right PCBA 2504 can be communicatively coupled to one or more right-eye illumination sources 2530 (e.g., LEDs) that illuminate the right eye in a certain illumination pattern (e.g., time, space) as described herein to facilitate tracking, detection, or monitoring of the orientation and / or movement of the right eye.

[0319] The left PCBA 2502 can include a control subsystem that can include one or more controllers (e.g., microcontrollers, microprocessors, digital signal processors, graphics processing units, central processing units, application-specific integrated circuits (ASICs), field-programmable gate arrays (FPGAs) 2540, and / or programmable logic units (PLUs)). The control system can include one or more non-transitory computer or processor-readable media for storing executable logic or instructions and / or data or information. The non-transitory computer or processor-readable media can take various forms, such as volatile and non-volatile forms, such as read-only memory (ROM), random access memory (RAM, DRAM, SD-RAM), flash memory, etc. The non-transitory computer or processor-readable media can be formed as one or more registers of, for example, a microprocessor, FPGA, or ASIC.

[0320] The left PCBA 2502 may include a left earphone or speaker connector 2536 for communicatively coupling an audio signal to a left earphone or speaker 2538 of the head-mounted assembly. The left PCBA 2502 may include an audio signal amplifier (e.g., a stereo amplifier) 2542 communicatively coupled to drive the earphone or speaker. The left PCBA 2502 may also include a left microphone connector 2544 communicatively coupling an audio signal from a microphone of the head-mounted assembly. The left PCBA 2502 may also include a left occlusion driver connector 2546 for communicatively coupling occlusion information to a left occlusion display 2548 of the head-mounted assembly.

[0321] The left PCBA 2502 may also include one or more sensors or transducers for detecting, measuring, capturing, or otherwise sensing information about the surrounding environment and / or the user. For example, an acceleration transducer 2550 (e.g., a triaxial accelerometer) may detect acceleration on three axes, thereby detecting motion. A gyroscope sensor 2552 may detect orientation and / or magnetic force or compass heading or azimuth. Other sensors or transducers may be used similarly.

[0322] The left PCBA 2502 may be communicatively coupled to one or more left outward-facing or world-view cameras 2554 worn on the body or head, and optionally coupled to a left camera visual indicator (e.g., an LED) 2556 that lights up when an image is captured to indicate to others. The left PCBA may be communicatively coupled to one or more left-eye cameras 2558 carried by the head-mounted assembly, positioned and oriented to capture left-eye images, thereby allowing tracking, detection, or monitoring of the orientation and / or movement of the left eye. Optionally, the left PCBA 2502 may be communicatively coupled to one or more left-eye illumination sources (e.g., LEDs) 2556 that illuminate the left eye in an illumination pattern (e.g., time, space) as described herein to facilitate tracking, detection, or monitoring of the orientation and / or movement of the left eye.

[0323] The PCBA 2502 and 2504 are communicatively coupled to different computing components (e.g., a waist pack) via one or more ports, connectors, and / or paths. For example, the left PCBA 2502 may include one or more communication ports or connectors to provide communication (e.g., two-way communication) with the waist pack. One or more communication ports or connectors may also provide power from the waist pack to the left PCBA 2502. The left PCBA 2502 may include a power conditioning circuit 2580 (e.g., a DC / DC power converter, an input filter) that is electrically coupled to the communication port or connector and may condition (e.g., boost, buck, smooth current, reduce transients).

[0324] A communication port or connector can, for example, take the form of a data and power connector or transceiver 2582 (e.g., port, port). The right PCBA 2504 can include a port or connector for receiving power from the hip pack. The image generation element can receive power from a portable power source (e.g., a chemical battery, a primary or secondary battery, a supercapacitor, a fuel cell), which can be located, for example, inside the hip pack.

[0325] As shown, the left PCBA 2502 contains most of the active electronic devices, while the right PCBA 2504 mainly supports the display or projector and the associated piezoelectric drive signals. Electrical and / or fiber optic connections are employed at the front, rear, or top of the body-worn or head-mounted component of the optical system or XR device. Both PCBA 2502 and 2504 are communicatively (e.g., electrically, optically) coupled to the hip pack. The left PCBA 2502 includes a power subsystem and a high-speed communication subsystem. The right PCBA 2504 processes the fiber optic display piezoelectric drive signals. In the illustrated embodiment, only the right PCBA 2504 needs to be optically connected to the hip pack. In other embodiments, both the right PCBA and the left PCBA can be connected to the hip pack.

[0326] Although illustrated as employing two PCBA 2502 and 2504, the electronic devices of the body-worn or head-mounted component can also employ other architectures. For example, some implementations can use fewer or more PCBA. For another example, the arrangement of the various components or subsystems can be different from Figure 9 that shown. For example, in some alternative embodiments, Figure 9 some of the components shown on one PCBA can be located on another PCBA, without loss of generality.

[0327] In some embodiments, the optical system or XR device described herein can present virtual content to a user such that the virtual content can be perceived as three-dimensional content. In some other embodiments, the optical system or XR device can present virtual content to the user in a four-dimensional or five-dimensional light field (or optical field).

[0328] FIG. 10A shows a portion of a simplified example eyepiece stack with an intermediate low refractive index layer in some embodiments. More specifically, multiple different eyepiece stacks based on this portion of the simplified example eyepiece stack will be described below to observe changes in the image uniformity (if any) of a sample eyepiece stack measured using a projector. As shown in FIG. 10A, the example eyepiece stack includes three optical layers 1002A, 1004A, and 1006A, where the intermediate layer 1004A has a low refractive index (n or nd) to increase pupil replication in these embodiments.

[0329] FIG10B-1 shows two corresponding portions of two simplified schematic diagrams of an eyepiece stack in some embodiments. More specifically, 1000B shows a first simplified schematic diagram of an eyepiece stack (Comparison 1) having a diffractive structure 1004B on top of a waveguide or optical component 1002B. In some embodiments, the diffractive structure 1004B has a refractive index value of 1.65. In some embodiments, based on material availability considerations, the waveguide or optical component 1002B in the simplified schematic diagram of the eyepiece stack 1000B includes a polycarbonate (PC) having a nominal refractive index value of 1.59 and a nominal thickness of 500 μm, but it should be noted that other materials and / or other nominal refractive index values ​​may also be used.

[0330] 1004B shows a second simplified schematic diagram of another eyepiece stack (Comparison 2) with a diffractive structure 1010B on top of a waveguide 1008B. In some embodiments, the diffractive structure 1010B has a nominal refractive index value of 1.65. In some embodiments, based on material availability considerations, the waveguide or optical component 1008B in the simplified schematic diagram of the eyepiece stack 1006B includes a polycarbonate (PC) with a nominal refractive index value of 1.59 and a nominal thickness of 1000 μm, but it should be noted that other materials and / or other nominal refractive index values ​​may also be used.

[0331] FIG10B-2 shows some example images showing the results of image uniformity after gamma adjustment for one of the simplified schematics shown in FIG10B-1. More specifically, 1012B shows the results of blue light image uniformity after gamma adjustment, where streaks are observed with a reticle projector. 1014B shows the results of blue light image uniformity after gamma adjustment, while showing the screen door effect (SDE). Individual pixels and the spacing between these individual pixels become apparent, resulting in an SDE. 1016B shows the results of green light image uniformity after gamma adjustment, where streaks are observed with a reticle projector. 1018B shows the results of green light image uniformity after gamma adjustment, while showing the screen door effect (SDE).

[0332] FIG. 10C-1 shows a portion of a simplified schematic of an eyepiece stack in some embodiments. More specifically, 1000C shows a simplified schematic of an eyepiece stack (top plate) having a diffraction structure 1004C on top of a first waveguide or optical component 1002C. The first waveguide or optical component 1002C is inseparably connected to a second waveguide or optical component 1010C by two intermediate layers 1006C and 1008C. One of the purposes of including an intermediate layer 1006C with a nominal refractive index value of 1.31 and / or an intermediate layer 1008C with a nominal refractive index value of 1.59 in the exemplary eyepiece stack 1000C is to increase pupil replication or expansion, where the nominal refractive indices of these two intermediate layers are less than or equal to the nominal refractive indices of the waveguides or optical components 1002C and 1010C.

[0333] In some embodiments, the nominal refractive index value of the diffraction structure 1004C is 1.65. In some embodiments, the first waveguide or optical component 1002C and / or the second waveguide or optical component 1010C in the simplified schematic of the eyepiece stack 1000C includes polycarbonate (PC) with a nominal refractive index value of 1.59, and the nominal thickness of the combined eyepiece stack having four layers 1002C, 1006C, 1008C, and 1010C is 900 μm. The selection of polycarbonate for 1002C and 1010C is based on considerations of material availability, but it should be noted that other materials and / or other nominal refractive index values can also be used.

[0334] FIG. 10C-2 shows some example images that illustrate the results of image uniformity after gamma adjustment for one of the simplified schematics shown in FIG. 10C-1. More specifically, 1012C shows the results of blue light image uniformity after gamma adjustment, where stripes were observed with a line projector. In these embodiments shown in FIG. 10C-2, the intermediate layer 1008C was selected because its nominal refractive index value (n = 1.59) matches the refractive index value of the waveguide or optical component 1002C or 1010C, and the result of selecting the refractive index-matched intermediate layer 1008C is that the stripes are better than those of the exemplary eyepiece stack 1000B shown in FIG. 10B-2.

[0335] 1014C shows the results of the blue light image uniformity after gamma adjustment, while showing improved screen door effect (SDE), such as screen door density. 1016C shows the results of the green light image uniformity after gamma adjustment, where stripes are observed with a reticle projector. As described above with respect to 1012C, the intermediate layer 1008C is selected because its nominal refractive index value (n = 1.59) matches the refractive index value of the waveguide or optical component 1002C or 1010C, and selecting the refractive index-matched intermediate layer 1008C for green light results in better stripes than those of the example eyepiece stack 1000B shown in FIG. 10B-2. 1018C shows the results of the green light image uniformity after gamma adjustment, while showing the screen door effect (SDE) of the example eyepiece stack 1000C.

[0336] FIG. 10D-1 shows a part of a simplified schematic diagram of an eyepiece stack in some embodiments. More specifically, 1000D shows a simplified schematic diagram of an eyepiece stack (embedded plate) having a first waveguide or optical component 1002C and a second waveguide or optical component 1010C, which, in some embodiments, sandwich an intermediate layer 1008C having a nominal refractive index value of 1.59 and an intermediate layer 1006C having a nominal refractive index value of 1.31 to have a total nominal thickness of 1000 μm.

[0337] The example eyepiece stack 1000D may further include a diffraction structure 1004C embedded within the intermediate layer 1006C or embedded between the intermediate layer 1004C and the waveguide or optical component 1010C. One of the purposes of including the intermediate layer 1006C having a nominal refractive index value of 1.31 and / or the intermediate layer 1008C having a nominal refractive index value of 1.59 in the example eyepiece stack 1000D is to increase pupil duplication or expansion, where the nominal refractive indices of these two intermediate layers are less than or equal to the refractive indices of the waveguide or optical components 1002C and 1010C.

[0338] In some embodiments, the nominal refractive index value of the diffraction structure 1004C is 1.65. In some embodiments, the first waveguide or optical component 1002C and / or the second waveguide or optical component 1010C in the simplified schematic diagram of the eyepiece stack 1000D includes polycarbonate (PC) having a nominal refractive index value of 1.59, and the nominal thickness of the combined eyepiece stack having four layers 1002C, 1006C, 1008C, and 1010C is 900 μm. The selection of polycarbonate (PC) for 1002C and 1010C is based on material availability considerations, but it should be noted that other materials and / or other nominal refractive index values may also be used.

[0339] FIG. 10D-2 shows some example images showing the results of image uniformity after gamma adjustment for one of the simplified schematics shown in FIG. 10D-1. More specifically, 1002D shows the results of blue light image uniformity after gamma adjustment, where fringes are observed with a reticle projector. In these embodiments shown in FIG. 10D-2, intermediate layer 1002C and / or 1008C and / or embedded diffractive structure 1004C are selected because their nominal refractive index values ​​(e.g., n=1.59 for 1008C, n=1.31 for 1006C, and / or n=1.65 for 1004C) match the refractive index values ​​of waveguide or optical component 1002C or 1010C, and the result of selecting the index-matched intermediate layer 1008C results in improved fringing compared to the example eyepiece stack 1000B shown in FIG. 10B-1.

[0340] 1002D also shows improved uniformity compared to the uniformity produced by the example eyepiece stack 1000B shown in FIG. 10B-1 and the example eyepiece stack 1000C shown in FIG. 10C-1. 1004D shows the results of the blue light image uniformity after gamma adjustment, while showing an improved screen door effect, such as improved screen door density. 1006D shows the results of the green light image uniformity after gamma adjustment, with improved fringes compared to the fringes produced by the example eyepiece stack 1000B shown in FIG. 10B-1 (viewed using a reticle projector) and compared to the fringes produced by the example eyepiece stack 1000C shown in FIG. 10C-1 (viewed using a reticle projector). In some of these embodiments, the configuration can be optionally coated with titanium dioxide (TiO2) prior to embedding the diffractive structure 1004C (as shown in FIG. 10D-1). 1008D shows the results of green light image uniformity after gamma adjustment, and also shows that the screen door effect (SDE) of the example eyepiece stack 1000D is improved in the Y direction (vertical direction) but not in the X direction (horizontal direction).

[0341] FIG10E-1 shows a portion of a simplified schematic diagram of an eyepiece stack in some embodiments. More specifically, as shown in FIG10E-1, 1000E shows a simplified schematic diagram of an eyepiece stack with a dual in-coupled grating (ICG) and a combined pupil expander (CPE) on top of an embedded plate. In some embodiments, the example eyepiece stack 1000E includes a first diffractive structure 1004C located on top of a first waveguide or optical component 1002C to form an upper portion of the example eyepiece stack.

[0342] Example eyepiece stack 1000E also includes a lower portion that includes a second waveguide or optical component 1010C, and, in some embodiments, the first and second waveguides or optical components 1002C and 1010C sandwich an intermediate layer 1008C with a nominal refractive index value of 1.59 and 1006C with a nominal refractive index value of 1.31 to have a total nominal thickness of 1000 μm. The upper and lower portions of the example eyepiece stack can be manually aligned or more precisely aligned using any other suitable method. Example eyepiece stack 1000E can also include a second diffraction structure 1004C1 embedded within intermediate layer 1006C or between intermediate layer 1004C and second waveguide or optical component 1010C.

[0343] One of the purposes of including intermediate layer 1006C with a nominal refractive index value of 1.31 and / or intermediate layer 1008C with a nominal refractive index value of 1.59 in example eyepiece stack 1000E is to increase pupil replication or expansion, where the nominal refractive indices of these two intermediate layers are less than or equal to the refractive indices of waveguides or optical components 1002C and 1010C. In some embodiments, the nominal refractive index value of the first diffraction structure 1004C or the second diffraction structure 1004C1 is 1.65. In some embodiments, the first waveguide or optical component 1002C and / or the second waveguide or optical component 1010C in the simplified schematic of eyepiece stack 1000E includes polycarbonate (PC) with a nominal refractive index value of 1.59, and the nominal thickness of the combined eyepiece stack having four layers 1002C, 1006C, 1008C, and 1010C is 1000 μm. The selection of polycarbonate (PC) for 1002C and 1010C is based on material availability considerations, but it should be noted that other materials and / or other nominal refractive index values can also be used.

[0344] Figure 10E-2 shows some example images that show the results of image uniformity after gamma adjustment for one of the simplified schematics shown in Figure 10E-1. More specifically, 1002E shows the results of blue light image uniformity after gamma adjustment, where improved fringes were observed with a line projector. In these embodiments shown in Figure 10E-2, the selection of intermediate layer 1002C and / or 1008C and / or the selection of the embedded diffraction structure 1004C is because its nominal refractive index value (e.g., n = 1.59 for 1008C, n = 1.31 for 1006C, and / or n = 1.65 for 1004C) matches the refractive index value of waveguide or optical component 1002C or 1010C, and the result of selecting the refractive index-matched intermediate layer 1008C results in improved fringes compared to the fringes produced by example eyepiece stacks 1000B in Figure 10B-1, 1000C in Figure 10C-1, and 1000D in Figure 10D-1.

[0345] The results produced by the exemplary eyepiece stack 1000E look similar to those produced by the combination of a two-sided checkerboard combined pupil expander (CPE) and a dual-incoupling grating (ICG). 1004E shows the results of blue light image uniformity after gamma adjustment, while showing a greatly improved moiré effect. As shown in 1004E, the moiré effect is hardly observable. In some embodiments, the diffractive structure 1004C1 can be pre-coated with titanium dioxide (TiO2) before embedding. 1006E shows the results of green light image uniformity after gamma adjustment, and its stripes are improved compared to those produced by the exemplary eyepiece stacks 1000B shown in FIG. 10B-1, 1000C in FIG. 10C-1, and 1000D in FIG. 10D-1. The results produced by the exemplary eyepiece stack 1000E look similar to those produced by the combination of a two-sided checkerboard combined pupil expander (CPE) and a dual-incoupling grating (ICG). 1008E shows the results of green light image uniformity after gamma adjustment for the exemplary eyepiece stack 1000E, while showing an improved moiré effect (SDE). As can be seen from 1008E, the moiré effect is hardly observable.

[0346] FIG. 11A shows two corresponding portions of two simplified schematic diagrams of an eyepiece stack in some embodiments. More specifically, 1006B shows a first simplified schematic diagram of an eyepiece stack (control 2) having a diffractive structure 1010B on top of a waveguide or optical component 1008B with a nominal thickness of 1000 μm. 1100A shows a second simplified schematic diagram of an eyepiece stack (control 3 or dual-incoupling grating or IGC) having a diffractive structure 1010B on top of a waveguide or optical component 1010B with a nominal thickness of 1000 μm.

[0347] The opposite side of the waveguide or optical component 1008B (opposite to the side forming the diffractive structure 1010B) can be integrated with a separate diffractive structure 1010B1. In some embodiments, the refractive index value of the diffractive structure 1010B and / or 1010B1 is 1.65. In some embodiments, based on considerations of material availability, the waveguide or optical component 1008B in the simplified schematic diagrams of the eyepiece stacks 1006B and / or 1100A includes polycarbonate (PC) with a nominal refractive index value of 1.59 and a nominal thickness of 1000 μm, but it should be noted that other materials and / or other nominal refractive index values can also be used.

[0348] 1100A also shows a second simplified schematic diagram of another eyepiece stack (contrast 3) having a diffraction structure 1010B at the top of waveguide 1008B and a diffraction structure 1010B1 at the bottom of waveguide 1008B. In some embodiments, the nominal refractive index value of diffraction structures 1010B and / or 1010B1 is 1.65. In some embodiments, based on considerations of material availability, waveguide or optical component 1008B in the simplified schematic diagram of eyepiece stack 1100A includes polycarbonate (PC) with a nominal refractive index value of 1.59 and a nominal thickness of 1000 μm, but it should be noted that other materials and / or other nominal refractive index values can also be used.

[0349] Figure 11B shows a portion of a simplified schematic diagram of an eyepiece stack in some embodiments. More specifically, 1100B shows a simplified schematic diagram of an eyepiece stack (top plate and bottom plate) having a diffraction structure 1004C at the top of a first waveguide or optical component 1002C. 1100B also shows a second waveguide or optical component 1010C having a diffraction structure 1004C1 at the bottom thereof. Waveguides or optical components 1002C and 1010C sandwich an intermediate layer 1006C with a nominal refractive index value of 1.31.

[0350] In some embodiments, the nominal refractive index value of diffraction structures 1004C and / or 1004C1 is 1.65. In some embodiments, waveguides or optical components 1002C and / or 1010C in the simplified schematic diagram of eyepiece stack 1100B include polycarbonate (PC) with a nominal refractive index of 1.59, and the nominal thickness of all three layers 1002C, 1006C, and 1010C is 1000 μm. Based on considerations of material availability, the material selection for waveguides or optical components 1002C and 1010C can be polycarbonate (PC), but it should be noted that other materials and / or other nominal refractive index values can also be used.

[0351] Figure 11C shows a portion of a simplified schematic diagram of an eyepiece stack in some embodiments. More specifically, 1100C shows a simplified schematic diagram of an eyepiece stack (top plate and embedded plate) having a diffraction structure 1004C at the top of a first waveguide or optical component 1002C. 1100C also shows a second waveguide or optical component 1010C, and the first and second waveguides or optical components 1002C and 1010C sandwich an intermediate layer 1006C with a nominal refractive index value of 1.31.

[0352] The second diffraction structure 1004C1 can be embedded within the intermediate layer 1006C or between the intermediate layer 1006C and the waveguide or optical component 1002C. In some embodiments, the nominal refractive index value of the diffraction structure 1004C and / or 1004C1 is 1.65. The nominal thicknesses of the waveguide or optical component 1002C and 1010C together with the intermediate layer 1006C and the diffraction structure 1004C1 can be 1000 μm.

[0353] In some embodiments, the waveguide or optical component 1002C and / or 1010C in the simplified schematic diagram of the eyepiece stack 1100C includes polycarbonate (PC) with a nominal refractive index value of 1.59. Based on considerations of material availability, the material selection for the waveguide or optical component 1002C and 1010C can be polycarbonate (PC), but it should be noted that other materials and / or other nominal refractive index values can also be used.

[0354] FIG. 11D shows a portion of the simplified schematic diagram of the eyepiece stack in some embodiments. More specifically, 1100C shows a simplified schematic diagram of an eyepiece stack (embedded combined pupil expander (CPE) with a TiO2 coating for efficiency improvement) having a diffraction structure 1004C on top of the first waveguide or optical component 1002C. 1100C also shows the second waveguide or optical component 1010C, and the first and second waveguide or optical components 1002C and 1010C sandwich the intermediate layer 1006C with a nominal refractive index value of 1.31.

[0355] The second diffraction structure 1004C1 can be embedded within the intermediate layer 1006C or between the intermediate layer 1006C and the waveguide or optical component 1002C. In some embodiments, the diffraction structure 1004C1 can be pre-coated with titanium dioxide (TiO2) before embedding. The exemplary eyepiece stack 1100D can also include a third diffraction structure 1004C2 formed outside the second waveguide or optical component 1010C. In some embodiments, the nominal refractive index value of the diffraction structures 1004C, 1004C1, and / or 1004C2 is 1.65. The nominal thicknesses of the waveguide or optical component 1002C and 1010C together with the intermediate layer 1006C and the diffraction structure 1004C1 can be 1000 μm.

[0356] In some embodiments, the waveguide or optical component 1002C and / or 1010C in the simplified schematic diagram of the eyepiece stack 1100D includes polycarbonate (PC) with a nominal refractive index value of 1.59. Based on considerations of material availability, the material selection for the waveguide or optical component 1002C and 1010C can be polycarbonate (PC), but it should be noted that other materials and / or other nominal refractive index values can also be used.

[0357] Figure 11E shows a portion of a simplified schematic of an eyepiece stack in some embodiments. More specifically, 1100E shows a simplified schematic of an eyepiece stack having a diffraction structure 1004C on top of a first waveguide or optical component 1002C. 1100E also shows a second waveguide or optical component 1010C, and the first and second waveguides or optical components 1002C and 1010C sandwich a first intermediate layer 1006C with a nominal refractive index value of 1.31 and a second intermediate layer 1104E with a nominal refractive index value of 1.59, and these refractive index values are selected based on refractive index matching with the material selection of the waveguide or optical component 1002C and / or 1010C. The second diffraction structure 1004C1 can be embedded within the intermediate layer 1006C or between the intermediate layer 1006C and the waveguide or optical component 1002C.

[0358] In some embodiments, the nominal refractive index value of the diffraction structure 1004C and / or 1004C1 can be 1.65. In some embodiments, the waveguide or optical component 1002C and / or 1010C in the simplified schematic of the eyepiece stack 1100E includes polycarbonate (PC) with a nominal refractive index of 1.59. Based on considerations of material availability, the material selection for the waveguide or optical component 1002C and 1010C can be polycarbonate (PC), but it should be noted that other materials and / or other nominal refractive index values can also be used.

[0359] Figure 11F shows a portion of a simplified schematic of an eyepiece stack in some embodiments. More specifically, 1100F shows a simplified schematic of an eyepiece stack having a diffraction structure 1004C on top of a first waveguide or optical component 1002C. 1100E also shows a second waveguide or optical component 1010C, and the first and second waveguides or optical components 1002C and 1010C sandwich a first intermediate layer 1006C with a nominal refractive index value of 1.31 and a second intermediate layer 1102F with a nominal refractive index value of 1.59, and these refractive index values are selected based on refractive index matching with the material selection of the waveguide or optical component 1002C and / or 1010C.

[0360] The second diffraction structure 1004C1 can be embedded within the intermediate layer 1006C or between the intermediate layer 1006C and the waveguide or optical component 1002C. In some embodiments, the nominal refractive index value of the diffraction structure 1004C and / or 1004C1 can be 1.65. The diffraction structure 1004C1 can be pre-coated with titanium dioxide (TiO2) to improve optical efficiency. In some embodiments, the waveguide or optical component 1002C and / or 1010C in the simplified schematic diagram of the eyepiece stack 1100F includes polycarbonate (PC) with a nominal refractive index value of 1.59. Based on considerations of material availability, the material selection for the waveguide or optical components 1002C and 1010C can be polycarbonate (PC), but it should be noted that other materials and / or other nominal refractive index values can also be used.

[0361] FIG. 11G shows a portion of a simplified schematic diagram of an eyepiece stack in some embodiments. More specifically, 1100G shows a simplified schematic diagram of an eyepiece stack having a diffraction structure 1004C on top of a first waveguide or optical component 1002C. 1100G also shows a second waveguide or optical component 1010C, and the first and second waveguides or optical components 1002C and 1010C sandwich a first intermediate layer 1006C with a nominal refractive index value of 1.31 and a second intermediate layer 1102G with a nominal refractive index value of 1.59, and these refractive index values are selected based on refractive index matching with the material selection of the waveguide or optical component 1002C and / or 1010C.

[0362] The second diffraction structure 1004C1 can be embedded within the intermediate layer 1006C or between the intermediate layer 1006C and the waveguide or optical component 1002C. In these embodiments shown in FIG. 11G, the thickness of the first intermediate layer 1006C can be less than that of the first intermediate layer 1006C in FIG. 11E, such that the second diffraction structure 1004C1 extends into the second intermediate layer 1102G, as shown in the simplified schematic diagram in FIG. 11G. In some embodiments, the nominal refractive index value of the diffraction structure 1004C and / or 1004C1 can be 1.65.

[0363] In some embodiments, the waveguide or optical component 1002C and / or 1010C in the simplified schematic diagram of the eyepiece stack 1100E includes polycarbonate (PC) with a nominal refractive index value of 1.59. Based on considerations of material availability, the material selection for the waveguide or optical components 1002C and 1010C can be polycarbonate (PC), but it should be noted that other materials and / or other nominal refractive index values can also be used.

[0364] Figure 11H shows a portion of a simplified schematic diagram of an eyepiece stack in some embodiments. More specifically, 1100H shows a simplified schematic diagram of an eyepiece stack having a diffraction structure 1004C on top of a first waveguide or optical component 1002C. 1100G also shows a second waveguide or optical component 1010C, and the first and second waveguides or optical components 1002C and 1010C sandwich a second intermediate layer 1102G having a nominal refractive index value of 1.59, which is selected based on refractive index matching with the material selection of the waveguide or optical components 1002C and / or 1010C.

[0365] It should be noted that, compared with 1100G in Figure 11G, this exemplary eyepiece stack 1100H does not include a first intermediate layer 1006C that is also sandwiched between the first and second waveguides or optical components 1002C and 1010C as shown in Figure 11G. A second diffraction structure 1004C1 can be formed on the side of the waveguide or optical component 1002C opposite to the first diffraction structure 1004C. In some embodiments, the nominal refractive index value of the diffraction structure 1004C and / or 1004C1 can be 1.65. In some embodiments, the waveguide or optical component 1002C and / or 1010C in the simplified schematic diagram of the eyepiece stack 1100E includes polycarbonate (PC) having a nominal refractive index value of 1.59. Based on considerations of material availability, the material selection of the waveguide or optical components 1002C and 1010C can be polycarbonate (PC), but it should be noted that other materials and / or other nominal refractive index values can also be used.

[0366] Figure 12A shows two corresponding portions of two simplified schematic diagrams of an eyepiece stack in some embodiments. More specifically, 1200A shows a first simplified schematic diagram of an eyepiece stack having a diffraction structure 1004C on top of a waveguide or optical component 1002C with a nominal thickness of 300 μm. In some embodiments, the refractive index value of the diffraction structure 1004C is 1.65. In some embodiments, based on considerations of material availability, the waveguide or optical component 1002C in the simplified schematic diagram of the eyepiece stack 1200A includes polycarbonate (PC) having a nominal refractive index value of 1.59, but it should be noted that other materials and / or other nominal refractive index values can also be used. In some embodiments, Figure 12A also shows the optical result 1202A of the exemplary eyepiece stack 1200A.

[0367] Figure 12B shows two corresponding portions of two simplified schematic diagrams of an eyepiece stack in some embodiments. More specifically, 1200B shows a first simplified schematic diagram of an eyepiece stack (Control 1) having a diffraction structure 1004C on top of a waveguide or optical component 1002C with a nominal thickness of 370 μm. In some embodiments, the refractive index value of the diffraction structure 1004C is 1.65. In some embodiments, based on considerations of material availability, the waveguide or optical component 1002C in the simplified schematic diagram of the eyepiece stack 1200B includes polycarbonate (PC) with a nominal refractive index value of 1.59, but it should be noted that other materials and / or other nominal refractive index values can also be used. In some embodiments, Figure 12B also shows the optical result 1202B of the exemplary eyepiece stack 1200B.

[0368] Figure 12C shows two corresponding portions of two simplified schematic diagrams of an eyepiece stack in some embodiments. More specifically, 1200C shows a first simplified schematic diagram of an eyepiece stack having a diffraction structure 1004C on top of a waveguide or optical component 1002C with a nominal thickness of 380 μm. The waveguide or optical component 1002C can have a separate diffraction structure 1004C1 on the opposite side of the waveguide or optical component 1002C that implements the diffraction structure 1004C.

[0369] In some embodiments, the refractive index value of the diffraction structure 1004C and / or 1004C1 is 1.65. In some embodiments, based on considerations of material availability, the waveguide or optical component 1002C in the simplified schematic diagram of the eyepiece stack 1200C includes polycarbonate (PC) with a nominal refractive index value of 1.59, but it should be noted that other materials and / or other nominal refractive index values can also be used. In some embodiments, Figure 12C also shows the optical result 1202C of the exemplary eyepiece stack 1200C.

[0370] Figure 12D shows a portion of a simplified schematic diagram of an eyepiece stack in some embodiments. More specifically, 1200D shows a simplified schematic diagram of an eyepiece stack having a diffraction structure 1004C on top of a first waveguide or optical component 1002C with a nominal thickness of 380 μm. 1200D also shows a second waveguide or optical component 1010C with a nominal thickness of 370 μm, and the first and second waveguides or optical components 1002C and 1010C sandwich a first intermediate layer 1006C with a nominal refractive index value of 1.31 and a second intermediate layer 1104E with a nominal refractive index value of 1.59. One or both of the refractive index values of 1006C and 1104E are selected based on refractive index matching with the material selection of the waveguide or optical component 1002C and / or 1010C.

[0371] The second diffraction structure 1004C1 can be embedded within the intermediate layer 1006C or between the intermediate layer 1006C and the waveguide or optical component 1002C. In some embodiments, the nominal refractive index value of the diffraction structure 1004C and / or 1004C1 can be 1.65. In some embodiments, the waveguide or optical component 1002C and / or 1010C in the simplified schematic of the eyepiece stack 1200D includes polycarbonate (PC) with a nominal refractive index value of 1.59. Based on considerations of material availability, the material selection for the waveguide or optical components 1002C and 1010C can be polycarbonate (PC), but it should be noted that other materials and / or other nominal refractive index values can also be used. In some embodiments, FIG. 12D also shows the optical result 1202D of an exemplary eyepiece stack 1200D.

[0372] FIG. 12E shows a portion of a simplified schematic of an eyepiece stack in some embodiments. More specifically, 1200E shows a simplified schematic of an eyepiece stack having a diffraction structure 1004C on top of a first waveguide or optical component 1002C with a nominal thickness of 380 μm. 1200D also shows a second waveguide or optical component 1010C with a nominal thickness of 280 μm, and the first and second waveguide or optical components 1002C and 1010C sandwich a first intermediate layer 1006C with a nominal refractive index value of 1.31 and a second intermediate layer 1104E with a nominal refractive index value of 1.59. One or both of the refractive index values of 1006C and 1104E are selected based on refractive index matching with the material selection of the waveguide or optical component 1002C and / or 1010C.

[0373] The second diffraction structure 1004C1 can be embedded within the intermediate layer 1006C or between the intermediate layer 1006C and the waveguide or optical component 1002C. In some embodiments, the nominal refractive index value of the diffraction structure 1004C and / or 1004C1 can be 1.65. In some embodiments, the waveguide or optical component 1002C and / or 1010C in the simplified schematic of the eyepiece stack 1200E includes polycarbonate (PC) with a nominal refractive index value of 1.59. Based on considerations of material availability, the material selection for the waveguide or optical components 1002C and 1010C can be polycarbonate (PC), but it should be noted that other materials and / or other nominal refractive index values can also be used. In some embodiments, FIG. 12E also shows the optical result 1202E of an exemplary eyepiece stack 1200E.

[0374] Figure 13A shows two corresponding portions of two simplified schematic diagrams of an eyepiece stack in some embodiments. More specifically, 1300A shows a first simplified schematic diagram of an eyepiece stack having a diffraction structure 1010B on top of a waveguide or optical component 1008B with a nominal thickness of 500 μm. In some embodiments, the refractive index value of the diffraction structure 1010B is 1.65. In some embodiments, based on considerations of material availability, the waveguide or optical component 1008B in the simplified schematic diagram of the eyepiece stack 1300A includes polycarbonate (PC) with a nominal refractive index value of 1.59, but it should be noted that other materials and / or other nominal refractive index values can also be used. In some embodiments, Figure 13A also shows the optical result 1302A of the exemplary eyepiece stack 1300A.

[0375] Figure 13B shows a portion of a simplified schematic diagram of an eyepiece stack in some embodiments. More specifically, 1300B shows a simplified schematic diagram of an eyepiece stack having a diffraction structure 1004C on top of a first waveguide or optical component 1002C with a nominal thickness of 500 μm. The first waveguide or optical component 1002C can be inseparably connected to a second waveguide or optical component 1010C with a nominal thickness of 370 μm through two intermediate layers 1006C and 1008C. One of the purposes of including an intermediate layer 1006C with a nominal refractive index value of 1.31 and / or an intermediate layer 1008C with a nominal refractive index value of 1.59 in the exemplary eyepiece stack 1000C is to increase pupil replication or expansion, where the nominal refractive indices of these two intermediate layers are less than or equal to the refractive indices of the waveguide or optical components 1002C and 1010C.

[0376] In some embodiments, the nominal refractive index value of the diffraction structure 1004C is 1.65. In some embodiments, the first waveguide or optical component 1002C and / or the second waveguide or optical component 1010C in the simplified schematic diagram of the eyepiece stack 1000C include polycarbonate (PC) with a nominal refractive index value of 1.59, and the nominal thickness of the combined eyepiece stack having four layers 1002C, 1006C, 1008C, and 1010C is 900 μm. The selection of polycarbonate for 1002C and 1010C is based on considerations of material availability, but it should be noted that other materials and / or other nominal refractive index values can also be used. In some embodiments, Figure 13B also shows the optical result 1302B of the exemplary eyepiece stack 1300B.

[0377] Figure 14A shows two corresponding portions of two simplified schematic diagrams of an eyepiece stack in some embodiments. More specifically, 1400A shows a first simplified schematic diagram of an eyepiece stack having a diffraction structure 1402A on top of a waveguide or optical component 1002C with a nominal thickness of 370 μm. In some embodiments, the refractive index value of the diffraction structure 1402A is 1.59 or 1.65. In some embodiments, based on considerations of material availability, the waveguide or optical component 1002C in the simplified schematic diagram of the eyepiece stack 1400A includes polycarbonate (PC) with a nominal refractive index value of 1.59, but it should be noted that other materials and / or other nominal refractive index values can also be used. In some embodiments, Figure 14A also shows the optical result 1402A of the exemplary eyepiece stack 1400A.

[0378] Figure 14B shows two corresponding portions of two simplified schematic diagrams of an eyepiece stack in some embodiments. More specifically, 1400B shows a first simplified schematic diagram of an eyepiece stack having a diffraction structure 1402B on top of a waveguide or optical component 1002C with a nominal thickness of 380 μm. The waveguide or optical component 1002C can have a separate diffraction structure 1402B1 on the opposite side of the waveguide or optical component 1002C that implements the diffraction structure 1402B.

[0379] In some embodiments, the refractive index value of the diffraction structure 1402B and / or 1402B1 is 1.65. In some embodiments, based on considerations of material availability, the waveguide or optical component 1002C in the simplified schematic diagram of the eyepiece stack 1400B includes polycarbonate (PC) with a nominal refractive index value of 1.59, but it should be noted that other materials and / or other nominal refractive index values can also be used. In some embodiments, Figure 14B also shows the optical result 1402B of the exemplary eyepiece stack 1400B.

[0380] Figure 14C shows a portion of a simplified schematic diagram of an eyepiece stack in some embodiments. More specifically, 1400C shows a simplified schematic diagram of an eyepiece stack having a diffraction structure 1004C on top of a first waveguide or optical component 1002C with a nominal thickness of 380 μm. 1400C also shows a second waveguide or optical component 1010C with a nominal thickness of 370 μm, and the first and second waveguides or optical components 1002C and 1010C sandwich a first intermediate layer 1006C with a nominal refractive index value of 1.31 and a second intermediate layer 1104E with a nominal refractive index value of 1.59.

[0381] One or both of the refractive index values of 1006C and 1104E are selected based on refractive index matching with the material selection of waveguide or optical component 1002C and / or 1010C. The second diffraction structure 1004C1 can be embedded within the intermediate layer 1006C or between the intermediate layer 1006C and the waveguide or optical component 1002C. In some embodiments, the nominal refractive index value of the diffraction structure 1004C and / or 1004C1 can be 1.65.

[0382] In some embodiments, the waveguide or optical component 1002C and / or 1010C in the simplified schematic of the eyepiece stack 1200E includes polycarbonate (PC) with a nominal refractive index value of 1.59. Based on considerations of material availability, the material selection for the waveguide or optical component 1002C and 1010C can be polycarbonate (PC), but it should be noted that other materials and / or other nominal refractive index values can also be used. In some embodiments, FIG. 14C also shows the optical result 1402C of the exemplary eyepiece stack 1400C.

[0383] The waveguide substrate or at least one laminate for manufacturing the eyepiece described herein can include materials having a range of refractive indices, such as high refractive index glasses, like 1.7 SCHOTT SF5, 1.8 SF6, HOYA dense tantalum flint glass TAFD55 (2.01), TAFD65 (2.06), and crystal substrates, such as lithium tantalate LiTaO3, lithium niobate LiNbO3 (2.25), and silicon carbide (2.65).

[0384] In some embodiments, physical vapor deposition (PVD), such as evaporation or sputtering (with or without ion assistance, e.g., Ar / O2), or chemical vapor deposition (CVD), such as low-pressure PECVD, atmospheric-pressure PECVD, ALD, etc., can be used to apply an inorganic thin film coating on a blank or patterned surface. A fluorinated polymer thin film with a refractive index of 1.31 can also be coated, where poly[4,5-difluoro-2,2-bis(trifluoromethyl)-1,3-dioxolene-co-tetrafluoroethylene] is dissolved in Fluorinert TM FC-40 at a concentration of up to 2% (weight percentage). Lower refractive index thin films (e.g., refractive index between about 1.15 and 1.3) can be formulated into a single-layer or multi-layer colloidal film composition with a porous SiO2-polymer matrix composition using sol-gel technology. Such low refractive index coatings can be applied by methods including but not limited to spin coating, spraying / atomizing, inkjet, etc.

[0385] In the foregoing specification, the invention has been described with reference to specific embodiments of the invention. However, it is apparent that various modifications and changes can be made thereto without departing from the broader spirit and scope of the invention. For example, the above process flow is described with reference to a specific sequence of process actions. However, the sequence of many of the said process actions can be changed without affecting the scope or operation of the invention. Accordingly, the specification and drawings are to be regarded as illustrative rather than restrictive.

Claims

1. A system, comprising: an eyepiece, which comprises: a laminate; a monolithic vitreous optical element laminated to the first side or a part of the first side of the polymer laminate or a bi - vitreous optical element sandwiching the polymer laminate; a set of surface relief grating structures implemented on the second side or a part of the second side of the monolithic vitreous optical element; and a projector that projects a beam of one or more images at multiple different depths into a user's eye through the eyepiece.

2. The system according to claim 1, wherein, the laminate comprises a polymer layer or a non - polymer layer, and the polymer layer comprises a polycarbonate layer of the optical component, a polyethylene terephthalate layer of the optical component, or a cycloolefin polymer layer of the optical component, and the non - polymer layer comprises a glass layer of the optical component, a vitreous layer of the optical component, a lithium niobate (LiNbO3) layer of the optical component, or a silicon carbide (SiC) layer of the optical component.

3. The system according to claim 1, wherein, the laminate comprises a first layer of the optical component coated with a coating having a coating refractive index value, and the coating comprises a silicon carbide coating having the coating refractive index value of about 2.5 to 2.6, a titanium oxide coating having the coating refractive index value of about 2.2 to 2.5, a zirconium oxide coating having the coating refractive index value of about 2.1, a silicon nitride or silicon oxynitride coating having the coating refractive index value of about 1.8 to 2.0, a silicon oxide coating having the coating refractive index value of about 1.45, a magnesium fluoride coating having the coating refractive index value of about 1.38, or a polymer coating having the coating refractive index value between about 1.2 and 1.

6.

4. The system according to claim 1, wherein, the laminate comprises a multi - layer optical component, and the multi - layer comprises at least one of a first layer of an organic material, a second layer of an inorganic material, a third layer of a crystalline material, or a fourth layer of a birefringent material.

5. The system according to claim 4, wherein, the multi - layer optical component comprises a high refractive index value in the range of 1.7 to 2.

65.

6. The system according to claim 4, wherein, the multi - layer optical component comprises a low refractive index value less than or equal to 1.

7.

7. The system according to claim 1, wherein, the laminate comprises a bend having a curvature of 2000 mm to 200 mm.

8. The system according to claim 1, wherein, the laminate comprises a plurality of layers having a plurality of corresponding thicknesses, the plurality of corresponding thicknesses corresponding to one or more thickness variations, and the one or more thickness variations include a range of 0 to 100 nm, less than 200 nm, less than 300 nm, less than 800 nm, or less than 1000 nm, and the plurality of layers include at least one of a first optical component having a rectangular prism shape or a second optical component having a wedge shape.

9. The system according to claim 1, wherein, An input grating is implemented on the wedge-shaped optical component, and it includes a first thickness near the input grating and a second thickness smaller than the first thickness.

10. The system according to claim 1, wherein, the laminate includes two layers of optical components, and each of the two layers of optical components has a corresponding thickness greater than or equal to 10 micrometers.

11. The system according to claim 10, wherein, the laminate further includes an intermediate layer located between the two layers of optical components, wherein the intermediate layer has a thickness greater than or equal to 10 nanometers.

12. The system according to claim 1, wherein, the laminate includes a plurality of diffraction features providing a light guiding function, and the plurality of diffraction features include an embedded grating structure having cavities.

13. The system according to claim 12, wherein, the laminate includes a separate plurality of diffraction features located on the outer surface of the laminate.

14. The system according to claim 1, wherein, the laminate includes a plurality of diffraction features providing a light guiding function, and the plurality of diffraction features include an embedded grating structure without any cavities.

15. The system according to claim 14, wherein, the laminate includes a separate plurality of diffraction features located on the outer surface of the laminate.

16. A method of projecting virtual content onto the user's eye using the system according to any one of claims 1 to 15.

Images