Virtual Reality and Augmented Reality Systems and Methods
The system addresses the limitations of conventional AR/VR systems by using reflectors and variable focusing elements to create a comfortable and immersive experience that aligns with human visual perception, enhancing depth perception and reducing eye strain.
Patent Information
- Application Number
- JP2024015576
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Priority Date
- 2013-11-27
- Filing Date
- 2024-02-05
- Publication Date
- 2025-07-28
- Estimated Expiration
- 2034-11-27
AI Technical Summary
Conventional virtual and augmented reality systems fail to provide a comfortable and rich three-dimensional experience due to inconsistencies between vergence and accommodation, obstructed natural visual fields, and inadequate consideration of human perceptual systems, including retinal photoreceptor interactions and head and eye movements.
A system utilizing a light source, reflectors, and variable focusing elements to multiplex optical patterns and converge light onto the user's exit pupil, incorporating variable focusing elements and waveguides to adjust focus based on eye accommodation, enabling a comfortable and immersive AR/VR experience.
The system provides a comfortable and immersive AR/VR experience by aligning with human visual perception, allowing for dynamic focus adjustment and unobstructed viewing, enhancing depth perception and reducing eye strain.
Smart Images

Figure 0007714064000001 
Figure 0007714064000002 
Figure 0007714064000003
Abstract
Description
Technical Field
[0001] The present disclosure relates to virtual reality and augmented reality images and visualization systems.
Background Art
[0002] Modern computing and display technologies have facilitated the development of systems for so-called "virtual reality" or "augmented reality" experiences in which digitally reproduced images or portions thereof are presented to a user in a manner that appears or can be perceived as being real. Virtual reality, i.e., a "VR" scenario, typically involves the presentation of digital or virtual image information without transparency to other actual real-world visual inputs, and augmented reality, i.e., an "AR" scenario, typically involves the presentation of digital or virtual image information as an extension of the visualization of the actual world around the user. For example, referring to FIG. 1, an augmented reality scene (4) is depicted, and a user of AR technology sees a setting (6) such as a real-world park featuring a tangible platform (1120) against a background of people, trees, and buildings. In addition to these items, a user of AR technology also perceives that a robotic image (1110) standing on the real-world platform (1120) and an avatar character (2) like a flying cartoon that appears anthropomorphic like a honeybee are "visible", but these elements (2, 1110) do not exist in the real world. In conclusion, the human visual perception system is very complex, and it is difficult to generate VR or AR technology that promotes a comfortable, natural, and rich presentation of virtual image elements among other virtual or real-world image elements.
[0003] Referring to FIG. 2A, generally, a stereoscopic wearable glasses (8) type configuration is developed, which features two displays (10, 12) configured to display an image with the presentation of slightly different elements so that a three-dimensional perspective image can be perceived by the human visual system. Such a configuration has been found to be uncomfortable for many users due to the inconsistency between the vergence movement and the accommodation, which must be overcome to perceive the image in three dimensions. In fact, some users cannot tolerate the stereoscopic configuration. FIG. 2B shows another stereoscopic wearable glasses (14) type configuration, which features two forward-oriented cameras (16, 18) configured to capture an image for presenting an augmented reality to the user through the stereoscopic display. The positions of the cameras (16, 18) and the display generally block the natural visual field of the user when the glasses (14) are mounted on the user's head.
[0004] Referring to FIG. 2C, an augmented reality configuration (20) is shown that features a visualization module (26) coupled to an eyeglass frame (24) that also holds a conventional eyeglass lens (22). A user can view an at least partially unobstructed view of the real world using such a system, and has a small display (28) through which a digital image can be presented to one eye in an AR configuration for monocular AR presentation. FIG. 2D depicts a configuration characterized in that a visualization module (32) is coupled to a hat or helmet (30) and can be configured to present a monocular augmented digital image to the user through a small display (34). FIG. 2E illustrates another similar configuration where a frame (36) is attachable to a user's head in a manner similar to an eyeglass hinge, such that a visualization module (38) can be utilized to capture an image and also present a monocular augmented digital image to the user through a small display (40). Such a configuration is available, for example, from Google, Inc. (Mountain View, CA) under the trade name GoogleGlass™. None of these configurations are optimally suited to present a rich binocular three-dimensional augmented reality experience in a manner that would be comfortable and maximally useful to the user, because, in part, conventional systems do not address some of the fundamental aspects of the human perceptual system, including the retinal photoreceptor cells and its interaction with the brain for providing the perception of visualization to the user.
[0005] Referring to FIG. 3, a simplified cross-sectional view of a human eye is depicted, featuring the cornea (42), iris (44), lens, i.e., the “crystalline lens” (46), sclera (48), choroid layer (50), macula (52), retina (54), and the optic nerve path to the brain (56). The macula is the center of the retina and is used for viewing medium detail. At the center of the macula, there is a part of the retina called the “fovea,” which is used for viewing the finest detail and contains more photoreceptor cells (about 120 cones per degree of vision) than any other part of the retina. The human visual system is not a passive sensor type of system. That is, it is configured to actively scan the environment. In a manner somewhat similar to the use of a flatbed scanner to capture an image or the use of a finger to read Braille from paper, the photoreceptor cells of the eye do not respond uniformly to a constant state of stimulation but emit signals in response to changes in stimulation. Therefore, movement is required to present photoreceptor cell information to the brain (like the movement of a linear scanner array across a piece of paper in a flatbed scanner or the movement of a finger across a Braille word imprinted on paper). In fact, experiments using substances such as cobra venom, which are used to paralyze the eye muscles, have shown that a human subject will become blind if positioned while viewing a static scene with an eye that has been opened and paralyzed by the venom. In other words, in the absence of changes in stimulation, the photoreceptor cells do not provide input to the brain and blindness occurs. This is thought to be at least one reason why a normal human eye is observed to move back and forth, i.e., to make micro-movements, in a lateral movement called “microsaccades.”
[0006] As described above, the fovea of the retina contains the highest density of photoreceptor cells, and humans typically have the perception of having high-resolution visualization capabilities throughout their entire visual field. In reality, however, they generally have only a small high-resolution center that mechanically surveys much while maintaining a persistent memory of the high-resolution information most recently captured at the fovea. In a somewhat similar fashion, the eye's focal length control mechanism (the ciliary muscle, which is operably coupled to the lens in such a way that ciliary relaxation causes tension in the ciliary zonular fibers, flattening the lens for a more distant focal length, and ciliary contraction causes relaxation of the ciliary zonular fibers, enabling the lens to assume a more rounded geometry for a closer focal length) reciprocates by approximately 1 / 4 to 1 / 2 diopter in order to periodically induce a small amount of what is called "optical refractive blur" both proximal and distal to the target focal length. This is utilized by the brain's depth control circuitry as periodic negative feedback that helps to constantly correct the needle path and keep the retinal image of a stationary object approximately in focus.
[0007] The brain's visualization center also obtains useful perceptual information from the relative motion of both eyes and their components. The relative binocular divergence motion of both eyes (i.e., the rolling of the pupils towards or away from each other in order to converge the lines of sight of the eyes and fixate on an object) is closely associated with the focusing (or "accommodation") of the eye's lenses. Under normal conditions, changing the focus of the eye's lenses, i.e., accommodating the eyes and focusing on objects at different distances, will automatically produce a coordinated change in binocular divergence motion to the same distance under a relationship known as the "accommodation-binocular divergence reflex." Similarly, a change in binocular divergence motion will, under normal conditions, also induce a coordinated change in accommodation. Acting against this reflex is known to cause eye fatigue, headaches, or other forms of discomfort to the user, as in most conventional stereoscopic AR or VR configurations.
[0008] The storage of the eyes, and also the movement of the head, also have a significant impact on the visualization of objects. Humans move their heads to visualize the world around them. Often, in a very steady state, they reposition and reorient their heads with respect to the object of interest. Further, most people prefer to move their heads when their line of sight needs to move more than about 20 degrees from the center to focus on a particular object (i.e., people typically do not prefer to look at objects "from the corner of their eyes"). Humans also typically scan or move their heads in conjunction with sound, to improve audio signal capture and to utilize the geometry of the ears relative to the head. The human visual system obtains excellent depth cues from what is called "head motion parallax", which is related to the relative motion of objects at different distances as a function of both head movement and the vergence distance of the eyes (i.e., when a person moves their head laterally and maintains a fixed position with respect to an object, items further away from that object will move in the same direction as the head, and items in front of that object will move in the opposite direction of the head movement. These are very significant cues to the spatial location of objects in the environment for a person, and are perhaps as good as stereopsis). Head movement is also, of course, utilized to look around objects.
[0009] Furthermore, head and eye movements are coordinated with what is called the "vestibulo-ocular reflex," which stabilizes image information on the retina during head rotation and thus keeps object image information near the center of the retina. In response to head rotation, the eyes rotate reflexively and proportionally in the opposite direction to maintain a stable fixation on the object. As a result of this compensatory relationship, many humans can read a book while oscillating their head back and forth. (Interestingly, this is generally not the case when the book is turned at a constant speed with the head remaining mostly stationary. That is, the person is likely unable to read the turning book. The vestibulo-ocular reflex is one of the head and eye movement coordinations and is generally not developed for hand movements.) This paradigm can be important for augmented reality systems because the user's head movement can be relatively directly associated with eye movement, and the system will preferably be prepared to cooperate with this relationship.
[0010] In fact, assuming these various relationships, when installing digital content (e.g., 3-D content such as a virtual chandelier object presented to augment the real-world view of a room, or 2-D content such as a flat / virtual oil painting object presented to augment the real-world view of a room), design choices can be made to control the behavior of the object. For example, a 2-D oil painting object can be head-centered, in which case the object moves with the user's head (e.g., as in the GoogleGlass approach), or the object can be world-centered, in which case it can be presented as if it were part of the real-world coordinate system such that the user can move their head or eyes without moving the position of the object relative to the real world.
[0011] Therefore, when virtual content is placed in the augmented reality world presented using an augmented reality system, the object can be centered on the world (i.e., the virtual object remains at a fixed position within the real world such that the user can move their body, head, and eyes around it without changing its position relative to real-world objects surrounding it, such as real-world walls), centered on the body, i.e., the torso (in which case the virtual element can be fixed relative to the user's torso such that the user can move their head or eyes without moving the object, but is driven by the movement of the torso), centered on the head (in which case the displayed object (and / or the display itself) can be moved along with the movement of the head as described above with reference to Google Glass), or centered on the eyes, such as in the "foveated display" configuration described below (where the content is driven as a function of the position of the eyes), and should be presented.
[0012] In a world-centered configuration, it may be desirable to have inputs such as accurate head pose measurement, accurate representation and / or measurement of real-world objects and geometries around the user, dynamic rendering with short latency in the augmented reality display as a function of head pose, and generally short-latency display.
[0013] The systems and techniques described herein are configured to address these challenges in conjunction with the typical human visual configuration.
SUMMARY OF THE INVENTION
MEANS FOR SOLVING THE PROBLEM
[0014] Embodiments of the present invention are directed to devices, systems, and methods for facilitating virtual reality and / or augmented reality interactions for one or more users. In one aspect, a system for displaying virtual content is disclosed.
[0015] In one or more embodiments, the system comprises a light source for multiplexing one or more optical patterns associated with one or more frames of image data in a time-series manner, and an array of reflectors for receiving the one or more optical patterns and variably converging the light onto the exit pupil.
[0016] In one or more embodiments, the system comprises an image source for providing one or more frames of image data in a time-series manner, a light modulator configured to transmit light associated with one or more frames of image data, a substrate for directing image information towards a user's eye and storing a plurality of reflectors, a first reflector of the plurality of reflectors for reflecting light associated with a first frame of image data towards the user's eye at a first angle, and a second reflector of the plurality of reflectors for reflecting light associated with a second frame of image data towards the user's eye at a second angle.
[0017] In one or more embodiments, the angles of reflection of the plurality of reflectors may be variable. The reflectors may be switchable in one or more embodiments. The plurality of reflectors may be electro-optically active in one or more embodiments. The refractive indices of the plurality of reflectors may be varied to match the refractive index of the substrate in one or more embodiments. In an optional embodiment, the system may also include a high-frequency gating layer configured to be disposed between the substrate and the user's eye and having an aperture that is controllably movable. The aperture of the high-frequency gating layer may be moved in one or more embodiments in a manner such that image data selectively transmits only through light reflected through the aperture. One or more of the reflectors of the transmissive beam splitter substrate may be blocked by the high-frequency gating layer. The aperture may be an LCD aperture in one or more embodiments. The aperture may be a MEM array in one or more embodiments. The first angle may be the same as the second angle in one or more embodiments. The first angle may be different from the second angle in one or more embodiments.
[0018] In one or more embodiments, the system may further include a first lens for steering a collection of light rays through a node to the user's eye. The first lens may be configured to be disposed on the substrate and in front of the first reflector in one or more embodiments such that the collection of light rays exiting the reflector passes through the first lens before reaching the user's eye.
[0019] The system may further include a second lens in one or more embodiments that compensates for the first lens and may be configured to be disposed on the substrate on the side opposite the side on which the first lens is disposed, thereby providing a zero magnification.
[0020] The first reflector of the plurality of reflectors may be a curved reflective surface for gathering a set of light rays associated with image data to a single output point in one or more embodiments before being delivered to the user's eye. The curved reflector may be a parabolic reflector in one or more embodiments. The curved reflector may be an elliptical reflector in one or more embodiments.
[0021] In another embodiment, a method for displaying virtual content includes providing one or more light patterns associated with one or more frames of image data in a time-series manner, and reflecting one or more light patterns associated with one or more frames of image data onto an exit pupil via a transmissive beam splitter, the transmissive beam splitter having a plurality of reflectors and variably converging onto the exit pupil.
[0022] In one or more embodiments, the angles of reflection of the plurality of reflectors may be variable. The reflectors may be switchable in one or more embodiments. The plurality of reflectors may be electro-optically active in one or more embodiments. The refractive indices of the plurality of reflectors may be varied to match the refractive index of the substrate in one or more embodiments. In an optional embodiment, the system may also include a high-frequency gating layer configured to be disposed between the substrate and the user's eye and having an aperture that is controllably movable. The aperture of the high-frequency gating layer may be moved in one or more embodiments in a manner such that image data is selectively transmitted only through the light reflected through the aperture. One or more of the reflectors of the transmissive beam splitter substrate may be blocked by the high-frequency gating layer. The aperture may be an LCD aperture in one or more embodiments. The aperture may be a MEM array in one or more embodiments. The first angle may be the same as the second angle in one or more embodiments. The first angle may be different from the second angle in one or more embodiments.
[0023] In one or more embodiments, the system may further include a first lens for steering a collection of light rays through a node to the user's eye. The first lens may be configured to be disposed on the substrate and in front of the first reflector in one or more embodiments such that the collection of light rays exiting the reflector passes through the first lens before reaching the user's eye.
[0024] The system may further include a second lens in one or more embodiments to compensate for the first lens and may be configured to be disposed on the substrate on the side opposite to the side on which the first lens is disposed, thereby providing zero magnification.
[0025] In one or more embodiments, the first reflector of the plurality of reflectors may be a curved reflective surface for collimating a set of light rays associated with image data to a single output point before being delivered to the user's eye. In one or more embodiments, the curved reflector may be a parabolic reflector. In one or more embodiments, the curved reflector may be an elliptical reflector.
[0026] In one or more embodiments, the wavefront may be collimated. In one or more embodiments, the wavefront may be curved. In some embodiments, the collimated wavefront may be perceived as an infinite depth plane. In some embodiments, the curved wavefront may be perceived as a depth plane closer than optical infinity.
[0027] In another embodiment, a system for displaying virtual content to a user includes a light source for multiplexing one or more light patterns associated with one or more frames of image data in a time-series fashion, an array of reflectors for receiving the one or more light patterns, the array of reflectors being oriented at a particular angle, and a plurality of optical elements coupled to the array of reflectors for variably converging the light patterns onto an exit pupil.
[0028] In one or more embodiments, the array of reflectors may be separate from the optical elements in one or more embodiments. The array of reflectors may include plane mirrors in one or more embodiments. The optical elements may be microlenses coupled to the array of reflectors in one or more embodiments. One or more reflectors of the array of reflectors may be curved in one or more embodiments. The optical elements may be integrated within the array of reflectors. The plurality of optical elements may expand the exit pupil in one or more embodiments.
[0029] In one or more embodiments, the system may further include a first lens for steering a set of light rays through a node to the user's eye, the first lens being configured to be disposed on the substrate and in front of the first reflector such that the set of light rays emitted from the reflector passes through the first lens before reaching the user's eye.
[0030] In one or more embodiments, the system may further include a second lens for compensating for the first lens, the second lens being configured to be disposed on the substrate on the side opposite to the side on which the first lens is disposed, thereby providing a zero magnification. The plurality of reflectors may include wavelength-selective reflectors in one or more embodiments. The plurality of reflectors may include a semi-transparent mirror in one or more embodiments. The plurality of optical elements may include refractive lenses. The plurality of optical elements may include diffractive lenses in one or more embodiments. The curved reflector may include a wavelength-selective notch filter in one or more embodiments.
[0031] In another embodiment, a method for displaying virtual content to a user includes providing one or more light patterns associated with one or more frames of image data in a time-series manner, and reflecting one or more light patterns associated with one or more frames of image data to an exit pupil via a transmissive beam splitter, the transmissive beam splitter having a plurality of reflectors and being configured to variably converge on the exit pupil, and expanding the exit pupil through a plurality of optical elements coupled to the plurality of reflectors of the transmissive beam splitter.
[0032] In one or more embodiments, the array of reflectors may be separate from the optical elements. In one or more embodiments, the array of reflectors includes a plane mirror. The optical element may be a microlens coupled to the array of reflectors in one or more embodiments.
[0033] In another embodiment, a system for displaying virtual content to a user includes a light source for multiplexing one or more frames of image data and one or more optical patterns associated therewith in a time-series manner, a waveguide for receiving the one or more optical patterns and focusing the optical patterns onto a first focal point, and a variable focusing element (VFE) coupled to the waveguide for focusing at least a portion of the optical patterns onto a second focal point.
[0034] In one or more embodiments, the VFE is telecentric. In one or more embodiments, the VFE is non-telecentric. The system further includes, in one or more embodiments, a compensating lens so that the user's view of the external world is not distorted. In one or more embodiments, multiple frames are presented to the user at a high frequency such that the user perceives the frames as part of a single coherent scene, and the VFE varies the focus from a first frame to a second frame. In one or more embodiments, the light source is a scanning light display, and the VFE varies the focus in a per-row manner. In one or more embodiments, the light source is a scanning light display, and the VFE varies the focus in a per-pixel manner.
[0035] In one or more embodiments, the VFE is a diffractive lens. In one or more embodiments, the VFE is a refractive lens. In one or more embodiments, the VFE is a mirror. In one or more embodiments, the mirror is opaque. In one or more embodiments, the mirror is partially reflective. The system further includes, in one or more embodiments, a focusing adjustment module for tracking the focusing adjustment of the user's eye, and the VFE varies the focus of the optical pattern based at least in part on the focusing adjustment of the user's eye.
[0036] In yet another embodiment, a system for displaying virtual content to a user comprises a light source for multiplexing one or more optical patterns associated with one or more frames of image data in a time-series manner, a waveguide for receiving the one or more optical patterns and focusing the optical patterns at a first focal point, and a variable focusing element (VFE) coupled to the waveguide for focusing at least a portion of the optical patterns at a second focal point, the VFE being integrated within the waveguide.
[0037] In another embodiment, a system for displaying virtual content to a user comprises a light source for multiplexing one or more optical patterns associated with one or more frames of image data in a time-series manner, a waveguide for receiving the one or more optical patterns and focusing the optical patterns at a first focal point, and a variable focusing element (VFE) coupled to the waveguide for focusing at least a portion of the optical patterns at a second focal point, the VFE being separate from the waveguide.
[0038] In another aspect, a method for displaying virtual content to a user includes providing one or more optical patterns associated with one or more frames of image data, focusing the one or more optical patterns associated with one or more frames of image data at a first focal point through a waveguide, and modifying the first focal point of light and generating a wavefront at a second focal point through a variable focusing element (VFE).
[0039] In one or more embodiments, the VFE is separate from the waveguide. In one or more embodiments, the VFE is integrated within the waveguide. One or more frames of image data are provided in a time series manner in one or more embodiments. The VFE modifies the focus of one or more frames of image data on a per-frame basis in one or more embodiments. The VFE modifies the focus of one or more frames of image data on a per-pixel basis in one or more embodiments. The VFE modifies a first focus and generates a wavefront at a third focus, and the second focus is different from the third focus in one or more embodiments. The wavefront at the second focus is perceived by the user as originating from a particular depth plane in one or more embodiments.
[0040] In some embodiments, multiple frames are presented to the user at a high frequency such that the user perceives the frames as part of a single coherent scene, and the VFE varies the focus from a first frame to a second frame. The light source is a scanning light display in one or more embodiments, and the VFE varies the focus in a per-row manner.
[0041] In another embodiment, a system for displaying virtual content to a user includes a plurality of waveguides for receiving light rays associated with image data and transmitting the light rays towards the user's eyes, the plurality of waveguides being stacked in a direction facing the user's eyes, a first lens coupled to a first waveguide of the plurality of waveguides and modifying the light rays transmitted from the first waveguide, thereby delivering light rays having a first wavefront curvature, and a second lens coupled to a second waveguide of the plurality of waveguides and modifying the light rays transmitted from the second waveguide, thereby delivering light rays having a second wavefront curvature, wherein the first lens coupled to the first waveguide and the second lens coupled to the second waveguide are horizontally stacked in a direction facing the user's eyes.
[0042] In one or more embodiments, the first wavefront curvature is different from the second wavefront curvature. The system further includes, in one or more embodiments, a third waveguide of a plurality of waveguides for delivering collimated light to the user's eye such that the user perceives the image data as originating from an optically infinite plane. The waveguide is configured, in one or more embodiments, to transmit collimated light to a lens.
[0043] The system further includes, in one or more embodiments, a compensating lens layer for compensating the converging refractive power of lenses stacked in a direction facing the user's eye, the compensating lens layer being stacked farthest from the user's eye. The waveguide includes, in one or more embodiments, a plurality of reflectors configurable to reflect light rays incident in the waveguide toward the user's eye.
[0044] The waveguide is electroactive in one or more embodiments. The waveguide is switchable in one or more embodiments. Light rays having a first wavefront curvature and light rays having a second wavefront curvature are delivered simultaneously in one or more embodiments. Light rays having a first wavefront curvature and light rays having a second wavefront curvature are delivered sequentially in one or more embodiments. The second wavefront curvature corresponds to a boundary of the first wavefront curvature in one or more embodiments, thereby providing a focal length that allows the user to perform focusing adjustment. The system further includes, in one or more embodiments, a focusing adjustment module for tracking the focusing adjustment of the user's eye, and the VFE varies the focus of the light pattern, at least in part, based on the focusing adjustment of the user's eye.
[0045] In yet another embodiment, a system for displaying virtual content to a user includes a light source for multiplexing one or more optical patterns associated with one or more frames of image data in a time-series manner, and a plurality of waveguides for receiving the one or more optical patterns and converging the light into an exit pupil, the plurality of waveguides being stacked along the Z-axis so as to be away from the user's line of sight, and at least one optical element coupled to the stacked waveguides for correcting the focus of the light transmitted by the plurality of waveguides.
[0046] In one or more embodiments, the waveguides of the plurality of waveguides may include waveguides for distributing the projected light across the length of the waveguide and lenses for modifying the light in such a way that a wavefront curvature is created, the created wavefront curvature corresponding to a focal plane when viewed by the user.
[0047] In one or more embodiments, the waveguides of the plurality of waveguides include a diffractive optical element (DOE). In one or more embodiments, the DOE is switchable between an on state and an off state. In one or more embodiments, the waveguides of the plurality of waveguides include refractive lenses. In one or more embodiments, the waveguides of the plurality of waveguides include Fresnel zone plates. In one or more embodiments, the waveguides of the plurality of waveguides include substrate-guided optics (SGO) elements. In one or more embodiments, the waveguide is switchable between an on state and an off state. In one or more embodiments, the waveguide is static. In one or more embodiments, the first frame of image data and the second frame of image data are delivered to the user's eye simultaneously. In one or more embodiments, the first frame of image data and the second frame of image data are delivered to the user's eye sequentially.
[0048] In one or more embodiments, the system further comprises a plurality of angled reflectors for delivering light to the user's eye, and the first waveguide component and the second waveguide component direct light to one or more angled reflectors. In one or more embodiments, the system further comprises beam distribution waveguide optics, the beam distribution waveguide being coupled to the waveguide assembly, and the beam distribution waveguide optics being configured to spread the projected light across the waveguide assembly such that light rays input into the beam distribution waveguide optics are cloned and input into the waveguide components of the waveguide assembly.
[0049] In another embodiment, a system for presenting virtual content to a user comprises an image source for providing one or more frames of image data in a time series fashion, a light modulator for projecting light associated with one or more frames of image data, and a waveguide assembly for receiving the projected light and delivering the light towards the user's eye, the waveguide assembly comprising at least a first waveguide component configured to modify the light associated with a first frame of image data such that the light is perceived to originate from a first focal plane, and a second waveguide component configured to modify the light associated with a second frame of image data such that the light is perceived to originate from a second focal plane, the first waveguide component and the second waveguide component being stacked along a Z-axis in front of the user's eye.
[0050] In some embodiments, the waveguide components of the waveguide assembly comprise a waveguide for distributing the projected light across the length of the waveguide and a lens for modifying the light in such a manner that a wavefront curvature is created, the created wavefront curvature corresponding to the focal plane when viewed by the user. In one or more embodiments, the waveguide components of the waveguide assembly comprise a diffractive optical element (DOE).
[0051] In one or more embodiments, the DOE is switchable between an on state and an off state. The waveguide component of the waveguide assembly comprises a refractive lens in one or more embodiments. The waveguide component of the waveguide assembly comprises a Fresnel zone plate in one or more embodiments. The first frame of image data and the second frame of image data are delivered to the user's eye simultaneously in one or more embodiments. The first frame of image data and the second frame of image data are delivered to the user's eye sequentially in one or more embodiments.
[0052] The system further comprises a plurality of angled reflectors for delivering light to the user's eye in one or more embodiments, and the first waveguide component and the second waveguide component direct light to one or more angled reflectors. The system further comprises beam distribution waveguide optics, the beam distribution waveguide being coupled to the waveguide assembly, and the beam distribution waveguide optics being configured in one or more embodiments to spread the projected light across the waveguide assembly such that light rays input into the beam distribution waveguide optics are cloned and input into the waveguide components of the waveguide assembly.
[0053] The waveguide component of the waveguide assembly comprises a reflector configured to reflect the projected light towards the user's eye at a desired angle. The first waveguide component comprises a first reflector configured to reflect the projected light at a first angle in one or more embodiments, and the second waveguide component comprises a second reflector configured to reflect the projected light at a second angle. The first reflector is interleaved with the second reflector in one or more embodiments, thereby expanding the field of view of the image as it is viewed by the user.
[0054] In one or more embodiments, the reflector of the waveguide component is positioned in a manner that forms a continuous curved reflective surface across the waveguide assembly. The continuous curved reflective surface comprises a parabola in one or more embodiments. The continuous curved reflective surface comprises an ellipse in one or more embodiments.
[0055] In yet another embodiment, a method for displaying virtual content to a user includes delivering, through a first waveguide, a light ray associated with a first frame of image data to the user, the light ray having a first wavefront curvature, and delivering, through a second waveguide, a light ray associated with a second frame of image data to the user, the light ray having a second wavefront curvature, wherein the first waveguide and the second waveguide are stacked along the Z-axis facing the user's eyes.
[0056] The first wavefront curvature and the second wavefront curvature are delivered simultaneously in one or more embodiments. The first wavefront curvature and the second wavefront curvature are delivered sequentially in one or more embodiments. The first and second wavefront curvatures are perceived by the user as first and second depth planes in one or more embodiments. The first and second waveguides are coupled to one or more optical elements in one or more embodiments. The method may further include compensating, in one or more embodiments, for the effects of the one or more optical elements through a compensating lens.
[0057] The method may further include, in one or more embodiments, determining the focusing adjustment of the user's eyes and delivering the light ray through at least one of the first and second waveguides, at least partially based on the determined focusing adjustment.
[0058] In another embodiment, a method for displaying virtual content to a user includes determining the user's eye accommodation, and delivering, at least in part based on the determined accommodation, a light ray having a first wavefront curvature through a first waveguide of a stack of waveguides, the first wavefront curvature corresponding to the focal length of the determined accommodation; and delivering a light ray having a second wavefront curvature through a second waveguide of the stack of waveguides, the second wavefront curvature being associated with a predetermined boundary of the focal length of the determined accommodation.
[0059] The boundary is a positive boundary in one or more embodiments. The boundary is a negative boundary in one or more embodiments. The second waveguide increases the focal length that the user can accommodate to in one or more embodiments. The first waveguide is coupled to a variable focusing element (VFE) in one or more embodiments, and the VFE varies the focus at which the waveguide focuses the light ray. The focus is varied at least in part based on the determined accommodation of the user's eye in one or more embodiments. The first wavefront curvature and the second wavefront curvature are delivered simultaneously in one or more embodiments.
[0060] The first and second wavefront curvatures are perceived by the user as first and second depth planes in one or more embodiments. The waveguide is a diffractive optical element (DOE) in one or more embodiments. The waveguide is a substrate guided optics (SGO) in one or more embodiments. The first and second waveguides are switchable in one or more embodiments. The waveguide comprises one or more switchable elements in one or more embodiments.
[0061] In yet another embodiment, a system for displaying virtual content to a user includes an image source for providing one or more frames of image data in a time-series fashion, and a display assembly for projecting light rays associated with one or more frames of image data, the display assembly including a first display element corresponding to a first frame rate and a first bit depth, and a second display element corresponding to a second frame rate and a second bit depth, and a variable focusing element (VFE) configured to vary the focus of the projected light and transmit the light to the user's eye.
[0062] In one or more embodiments, the first frame rate is higher than the second frame rate, and the first bit depth is lower than the second bit depth. In one or more embodiments, the first display element is a DLP projection system. In one or more embodiments, the second display element is a liquid crystal display (LCD). In one or more embodiments, the first display element projects light onto a subset of the second display element such that the periphery of the LCD has a constant illumination. In one or more embodiments, only the light transmitted from the first display element is focused through the VFE.
[0063] In one or more embodiments, the VFE is optically conjugated to the exit pupil such that the focus of the projected light is varied without affecting the magnification of the image data. In one or more embodiments, the first display element is a DLP and the second display element is an LCD, the DLP having a low resolution and the LCD having a high resolution. In one or more embodiments, the intensity of the backlight is varied over time to equalize the luminance of the sub-images projected by the first display element, thereby increasing the frame rate of the first display element.
[0064] In one or more embodiments, the VFE can be configured to vary the focus of the projected light on a per-frame basis. The system further includes, in one or more embodiments, software for compensating the optical magnification associated with the operation of the VFE. The image source generates, in one or more embodiments, slices of a particular image that, when projected together or sequentially, generate an object of a three-dimensional volume. The DLP operates in binary mode in one or more embodiments. The DLP operates in grayscale mode in one or more embodiments.
[0065] In one or more embodiments, the VFE varies the projected light such that the first frame is perceived as originating from a first focal plane and the second frame is perceived as originating from a second focal plane, and the first focal plane is different from the second focal plane. The focal length associated with the focal plane is fixed in one or more embodiments. The focal length associated with the focal plane is variable in one or more embodiments.
[0066] In another embodiment, a method for displaying virtual content to a user includes providing one or more image slices, wherein the first and second image slices of the one or more image slices represent a three-dimensional volume; projecting light associated with the first image slice through a spatial light modulator; focusing the first image slice to a first focus through a variable focus element (VFE); delivering the first image slice having the first focus to the user; providing light associated with the second image slice; focusing the second image slice to a second focus through the VFE, wherein the first focus is different from the second focus; and delivering the second image slice having the second focus to the user.
[0067] The method may further include, in one or more embodiments, determining the user's eye accommodation, and the VFE may include, at least in part, focusing the projected light based on the determined accommodation. The image slices may be provided in a frame sequential manner in one or more embodiments. The first image slice and the second image slice may be delivered simultaneously in one or more embodiments. The first image slice and the second image slice may be delivered sequentially in one or more embodiments.
[0068] In yet another embodiment, a method for displaying virtual content to a user includes combining a first display element and a second display element, wherein the first display element corresponds to a high frame rate and a low bit depth, and the second display element corresponds to a low frame rate and a high bit depth, such that the combined display element corresponds to a high frame rate and a high bit depth; projecting light associated with one or more frames of image data through the combined display element; and switching the focus of the projected light through a variable focus element (VFE) on a per-frame basis such that a first image slice is projected at a first focus and a second image slice is projected at a second focus.
[0069] In another embodiment, a system for displaying virtual content to a user includes a plurality of optical guides that receive coherent light associated with one or more frames of image data and generate a converging wavefront; a phase modulator coupled to one or more of the plurality of optical guides and that induces a phase delay in the light projected by one or more of the plurality of optical guides; and a processor that controls the phase modulator in a manner such that the converging wavefront generated by the plurality of optical guides is varied.
[0070] The wavefronts generated by the optical waveguides of multiple optical waveguides are, in one or more embodiments, spherical wavefronts. The spherical wavefronts generated by at least two optical waveguides interfere constructively with each other in one or more embodiments. The spherical wavefronts generated by at least two optical waveguides interfere destructively with each other in one or more embodiments. The converging wavefront is, in one or more embodiments, a substantially planar wavefront.
[0071] The planar wavefront corresponds to the optically infinite depth plane. The converging wavefront is, in one or more embodiments, spherical. The spherical wavefront corresponds to a depth plane closer than the optically infinite distance in one or more embodiments. The inverse Fourier transform of the desired beam is input into the multi-core fiber in one or more embodiments such that the desired converging wavefront is generated.
[0072] In another aspect, a system for displaying virtual content to a user includes an image source for providing one or more frames of image data, and a multi-core assembly for projecting light associated with one or more frames of image data, the multi-core fibers of the plurality of multi-core fibers emitting light onto the wavefront such that the multi-core assembly generates a converging wavefront of the projected light, and a phase modulator for inducing a phase delay between the multi-core fibers in such a manner that the converging wavefront emitted by the multi-core assembly is varied, thereby varying the focal distance at which the user perceives one or more frames of image data.
[0073] In yet another aspect, a method for displaying virtual content to a user includes emitting light through a multi-core fiber, the multi-core fiber comprising a plurality of single-core fibers, the single-core fibers emitting spherical wavefronts; providing a converging wavefront from the light emitted from the plurality of single-core fibers; and inducing a phase delay between the single-core fibers of the multi-core fiber such that the converging wavefront generated by the multi-core fiber is varied, at least in part, based on the induced phase delay.
[0074] The converging wavefront is, in one or more embodiments, a plane wavefront. The plane wavefront corresponds to optical infinity in one or more embodiments. The converging wavefront is, in one or more embodiments, spherical. The spherical wavefront corresponds to a depth plane closer than optical infinity in one or more embodiments. The method further includes, in one or more embodiments, inputting an inverse Fourier transform of a desired wavefront into the multi-core fiber such that the converging wavefront corresponds to the desired wavefront.
[0075] In yet another embodiment, a system for displaying virtual content to a user includes an image source for providing one or more frames of image data, a multi-core assembly comprising a plurality of multi-core fibers for projecting light associated with one or more frames of image data, and an image injector for inputting an image into the multi-core assembly, the multi-core assembly being further configurable to output a Fourier transform by generating light associated with the image data into a desired wavefront and thereby enabling a user to perceive the image data at a desired focal distance by inputting an inverse Fourier transform of the desired wavefront into the multi-core assembly.
[0076] The desired wavefront is associated with a hologram in one or more embodiments. The inverse Fourier transform is an input for modulating the focus of one or more optical beams in one or more embodiments. The multi-core fibers of a plurality of multi-core fibers are multi-mode fibers in one or more embodiments. The multi-core fibers of a plurality of multi-core fibers are configured to propagate light along a plurality of paths along the fiber in one or more embodiments. The multi-core fiber is a single-core fiber in one or more embodiments. The multi-core fiber is a concentric-core fiber in one or more embodiments.
[0077] The image injector is configured to input a wavelet pattern into the multi-core assembly in one or more embodiments. The image injector is configured to input Zernike coefficients into the multi-core assembly in one or more embodiments. The system further includes a focus tracking module for determining the focus adjustment of the user's eye in one or more embodiments, and the image injector is configured to input the inverse Fourier transform of the wavefront corresponding to the determined focus adjustment of the user's eye.
[0078] In yet another embodiment, a method of displaying virtual content to a user includes determining the focus adjustment of the user's eye, the determined focus adjustment being associated with a focal length corresponding to the current state of the user's focus, projecting light associated with one or more frames of image data through a waveguide, varying the focus of the projected light based at least in part on the determined focus adjustment, and delivering the projected light to the user's eye such that the light is perceived by the user as originating from a focal length corresponding to the current state of the user's focus.
[0079] In one or more embodiments, the near - far adjustment is measured directly. In one or more embodiments, the near - far adjustment is measured indirectly. The near - far adjustment is measured through an infrared autorefractor. In one or more embodiments, the near - far adjustment is measured through eccentric photorefraction. The method further includes, in one or more embodiments, measuring the convergence level of both eyes of the user and estimating the near - far adjustment. The method further includes, in one or more embodiments, blurring one or more portions of one or more frames of the image data, at least in part, based on the determined near - far adjustment. The focus is varied between fixed depth planes in one or more embodiments. The method further includes, in one or more embodiments, a compensating lens for compensating for the optical effect of the waveguide.
[0080] In one or more embodiments, a method of displaying virtual content to a user includes determining the near - far adjustment of the user's eyes, wherein the determined near - far adjustment is associated with a focal length corresponding to the current state of the user's focus; projecting light associated with one or more frames of image data through a diffractive optical element (DOE); varying the focus of the projected light, at least in part, based on the determined near - far adjustment; and delivering the projected light to the user's eyes such that the light is perceived by the user as originating from a focal length corresponding to the current state of the user's focus.
[0081] In another embodiment, a method of presenting virtual content to a user includes determining the user's eye accommodation, the determined accommodation being associated with a focal length corresponding to the current state of the user's focus; projecting light associated with one or more frames of image data through freeform optics; varying the focus of the projected light at least in part based on the determined accommodation; and delivering the projected light to the user's eye such that the light is perceived by the user as originating from a focal length corresponding to the current state of the user's focus.
[0082] In another aspect, a method of presenting virtual content to a user includes determining the user's eye accommodation, the determined accommodation being associated with a focal length corresponding to the current state of the user's focus; projecting light associated with one or more frames of image data; varying the focus of the projected light at least in part based on the determined accommodation; and delivering the projected light to the user's eye such that the light is perceived by the user as originating from a focal length corresponding to the current state of the user's focus.
[0083] In one or more embodiments, the light is delivered to the user through a substrate waveguide optical assembly. In one or more embodiments, the light is delivered to the user through freeform optical elements. In one or more embodiments, the light is delivered to the user through a diffractive optical element (DOE). In one or more embodiments, the light is projected through a stack of waveguides, where a first waveguide of the stack outputs light at a particular wavefront, a second waveguide outputs a positive boundary wavefront relative to the particular wavefront, and a third waveguide is configured to output a negative boundary wavefront relative to the particular wavefront. The method further includes, in one or more embodiments, blurring a portion of one or more frames of image data in a manner such that the portion is out of focus when the projected light is delivered to the user's eye.
[0084] In yet another embodiment, a system for presenting virtual content to a user includes an image source for providing one or more frames of image data in a time series fashion, a light generator for providing light associated with one or more frames of image data, a focus adjustment tracking module for tracking the focus adjustment of the user's eyes, and a waveguide assembly for varying the focus of the light associated with one or more frames of image data, wherein different frames of image data are focused differently, at least in part, based on the tracked focus adjustment.
[0085] In another aspect, a system for presenting virtual content to a user includes a focus adjustment tracking module for determining the focus adjustment of the user's eyes, an image source for providing one or more frames of image data in a time series fashion, a light generator for projecting light associated with one or more frames of image data, a plurality of waveguides for receiving light rays associated with the image data and transmitting the light rays toward the user's eyes, the plurality of waveguides being stacked in a direction facing the user's eyes, and a variable focus element (VFE) for varying the focus of the transmitted light, at least in part, based on the determined focus adjustment of the user's eyes.
[0086] The waveguides of the plurality of waveguides are, in one or more embodiments, waveguide elements, wherein the focus of a first frame of image data transmitted from a first waveguide of the plurality of waveguides is different from the focus of a second frame of image data transmitted from a second waveguide of the plurality of waveguides. The first frame is, in one or more embodiments, a first layer of a 3D scene, and the second frame is a second layer of the 3D scene. The system further includes, in one or more embodiments, a blurring module for blurring a portion of one or more frames of image data in a manner such that the portion goes out of focus when viewed by the user.
[0087] The VFE is common to a plurality of waveguides in one or more embodiments. The VFE is associated with the waveguides of a plurality of waveguides in one or more embodiments. The VFE is coupled to the waveguides of a plurality of waveguides such that the VFE is interleaved between two waveguides of the plurality of waveguides in one or more embodiments. The VFE is embedded within the waveguides of a plurality of waveguides in one or more embodiments. The VFE is a diffractive optical element in one or more embodiments. The VFE is a refractive element in one or more embodiments.
[0088] The waveguide is electroactive in one or more embodiments. The waveguides of one or more than one plurality of waveguides are switched off in one or more embodiments. The waveguides of a plurality of waveguides correspond to a fixed focal plane in one or more embodiments. The system further comprises an exit pupil, and in one or more embodiments, the diameter of the exit pupil is only 0.5 mm. The light generator is a scanning fiber display. The system further comprises an array of exit pupils in one or more embodiments.
[0089] The system further comprises a plurality of light generators coupled to the exit pupil in one or more embodiments. The system further comprises an exit pupil expander in one or more embodiments. The exit pupil is switchable in one or more embodiments, at least in part, based on the determined accommodation of the user's eye.
[0090] In another aspect, the system includes a focus tracking module for determining the user's eye focus adjustment, a fiber scanning display for scanning a plurality of light beams associated with one or more frames of image data, wherein the light beams of the plurality of light beams are movable, and blurring software for rendering simulated optical refractive blur into one or more frames of the image data based at least in part on the determined focus adjustment of the user's eyes.
[0091] In one or more embodiments, the diameter of the light beam is only 2 mm. In one or more embodiments, the diameter of the light beam is only 0.5 mm. In one or more embodiments, the scanning light beam is replicated to create a plurality of exit pupils. In one or more embodiments, the scanning light beam is replicated to create a larger eye box. In one or more embodiments, the exit pupil is switchable.
[0092] In another embodiment, a method for displaying virtual content includes determining the focus adjustment of the user's eyes, scanning a plurality of light beams associated with one or more frames of image data through a fiber scanning display, wherein the diameter of the light beam is only 0.5 mm such that when viewed by the user, the frame of the image data appears in focus, and blurring at least a portion of one or more frames of the frame using blurring software based at least in part on the determined focus adjustment of the user's eyes.
[0093] In one or more embodiments, a plurality of exit pupils are created. In one or more embodiments, the light beam is generated by a single core fiber. In one or more embodiments, the light beam is replicated to create a plurality of exit pupils. In one or more embodiments, the exit pupil is switchable.
[0094] In another embodiment, a method for displaying virtual content to a user includes determining a position of the user's pupil relative to a beam of a light projector, the beam of the light projector corresponding to a sub-image of an image to be presented to the user, and advancing light corresponding to the sub-image into a portion of the user's pupil based on the determined position of the user's pupil.
[0095] The method further includes, in one or more embodiments, advancing light corresponding to another sub-image of an image to be presented to another portion of the user's pupil through another beam of the light projector. The method further includes, in one or more embodiments, mapping one or more beams of the light projector of the fiber scanning display to one or more portions of the user's pupil. The mapping is, in one or more embodiments, a 1:1 mapping.
[0096] The diameter of the light is, in one or more embodiments, only 0.5 mm. The beam of the light projector generates, in one or more embodiments, a converging wavefront. The beamlets generated by the light projector form, in one or more embodiments, a discretized converging wavefront. The beamlets approach, in one or more embodiments, parallel to the user's eye, and the eye deflects the beamlets and converges them to the same spot on the retina. The user's eye receives, in one or more embodiments, a super set of beamlets, and the beamlets correspond to a plurality of angles intersecting the pupil.
[0097] In another embodiment, a system for displaying virtual content to a user includes a light source for providing light associated with one or more frames of image data, and a light display assembly for receiving the light associated with one or more frames of image data, the light display assembly corresponding to a plurality of exit pupils that are spaced apart from each other, the plurality of exit pupils transmitting the light into the user's pupil.
[0098] In one or more embodiments, the plurality of exit pupils are arranged in a hexagonal lattice. In one or more embodiments, the plurality of exit pupils are arranged in a square lattice. In one or more embodiments, the plurality of exit pupils are arranged in a two-dimensional array. In one or more embodiments, the plurality of exit pupils are arranged in a three-dimensional array. In one or more embodiments, the plurality of exit pupils are arranged in a time-varying array.
[0099] In one or more embodiments, a method for presenting virtual content to a user includes clustering a plurality of light projectors to form exit pupils, projecting a first light pattern through a first exit pupil into a first portion of the user's pupil, and projecting a second light pattern through a second exit pupil into a second portion of the user's pupil, where the first light pattern and the second light pattern correspond to sub-images of an image to be presented to the user and the first light pattern is different from the second light pattern. The method further includes, in one or more embodiments, creating a discretized converging wavefront.
[0100] In yet another embodiment, a method for presenting virtual content to a user includes determining a location of the user's pupil relative to a light display assembly and calculating a focus for converging light onto the pupil based at least in part on an eyebox limited at least partially around the determined location of the pupil.
[0101] The diameter of the light is, in one or more embodiments, only 0.5 mm. The method further includes, in one or more embodiments, the step of creating a discretized converging wavefront. The method further includes, in one or more embodiments, the step of converging a plurality of discrete neighboring collimated light beams, at least in part, based on the center of the radius of curvature of the desired converging wavefront. The method further includes, in one or more embodiments, the step of determining the focusing adjustment of the user's eye, wherein the focus is calculated, at least in part, based on the determined focusing adjustment.
[0102] The method further includes, in one or more embodiments, the step of selecting the angular trajectories of the light of a plurality of beamlets to create defocused light beams. The plurality of beamlets represent, in one or more embodiments, the pixels of the image data to be presented to the user. The beamlets impinge on the eye at a plurality of incident angles, in one or more embodiments.
[0103] In yet another embodiment, a system for displaying virtual content to a user includes an image source for providing one or more portions of an image to be presented to the user and a plurality of micro-projectors for projecting light associated with one or more portions of the image, the micro-projectors being positioned in a manner facing the user's pupil, the micro-projectors of the plurality of micro-projectors being configured to project a set of light rays representing a portion of a sub-image, the set of light rays being projected onto a portion of the user's pupil, and the plurality of micro-projectors.
[0104] In one or more embodiments, the first part of the user's pupil receives light rays from a plurality of micro-projectors. The system further comprises, in one or more embodiments, a reflective surface for reflecting light from the plurality of micro-projectors onto one or more parts of the user's pupil. The reflective surface is positioned, in one or more embodiments, in such a way that the user can view the real world through the reflective surface. The diameter of the light is, in one or more embodiments, only 0.5 mm. The system further comprises, in one or more embodiments, a discretized converging wavefront.
[0105] In another embodiment, the system is an array of spatial light modulators (SLMs) for projecting light associated with one or more frames of image data, the array of SLMs being positioned, at least in part, based on the determined location of the user's pupil and generating a bright field when viewed by the user, and a processor for determining the location of the user's pupil.
[0106] In another aspect, a system for displaying virtual content to a user comprises an image source for providing one or more frames of image data, a first spatial light modulator (SLM) configured to selectively transmit light rays associated with one or more frames of image data, a second SLM positioned relative to the first SLM and also configured to selectively transmit light rays associated with one or more frames of image data, and a processor for controlling the first and second SLMs in such a way that a bright field is created when the transmitted light rays are viewed by the user.
[0107] The system further includes, in one or more embodiments, a focus tracking module for determining the user's focus adjustment of the eyes. The SLM is, in one or more embodiments, an LCD. The LCD is, in one or more embodiments, attenuated. The LCD is, in one or more embodiments, configured to rotate the polarization of the transmitted light. The SLM is, in one or more embodiments, a DMD. The DMD is, in one or more embodiments, coupled to one or more lenses. The SLM is, in one or more embodiments, a MEM array. The MEM array is, in one or more embodiments, an array of slide-type MEM shutters. The MEM array is, in one or more embodiments, a Pixtronics(R) MEM array.
[0108] In another embodiment, a system for displaying virtual content to a user includes a plurality of optical fibers for projecting light associated with one or more frames of image data to be presented to the user, the optical fibers of the plurality of optical fibers being coupled to a lens, the lens being configured to modify the diameter of the light beam projected by the scanning fiber, and the lens having a gradient refractive index.
[0109] The lens is, in one or more embodiments, a GRIN lens. The lens is, in one or more embodiments, configured to collimate the light beam. The system further includes, in one or more embodiments, an actuator coupled to the optical fibers of the plurality of optical fibers for scanning the fibers. The actuator is, in one or more embodiments, a piezoelectric actuator. The ends of the optical fibers are, in one or more embodiments, polished at an angle for creating a lens effect. The ends of the optical fibers are, in one or more embodiments, melted to create a lens effect.
[0110] A method for displaying virtual content includes, in one or more embodiments, projecting light associated with one or more frames of image data, the light being projected through a plurality of optical fibers; modifying the light projected through the plurality of optical fibers through a lens, the lens being coupled to the tips of the plurality of optical fibers; and delivering the modified light to the user.
[0111] In one or more embodiments, a system for displaying virtual content includes a plurality of fibers, a multi-core assembly for multiplexing light associated with one or more frames of image data, and a waveguide for receiving and transmitting a light pattern such that a first viewing zone receives only light associated with a first portion of the image and a second viewing zone receives only light associated with a second portion of the image, the first and second viewing zones being only 0.5 mm. The system further includes, in one or more embodiments, blurring software for blurring one or more portions of a frame of image data. The system further includes, in one or more embodiments, a focusing module for determining the focusing adjustment of the user's eyes. The waveguide projects light directly into the user's eyes without intermediate viewing optics in one or more embodiments.
[0112] In one or more embodiments, the system includes a plurality of fibers, a multi-core assembly for multiplexing light associated with one or more frames of image data, a waveguide for receiving and transmitting a light pattern such that a first viewing zone receives only light associated with a first portion of the image and a second viewing zone receives only light associated with a second portion of the image, the first and second viewing zones being only 0.5 mm, and an optical assembly coupled to the waveguide for modifying the light beams transmitted to the first and second viewing zones.
[0113] A plurality of fibers project light into the single waveguide array. The multi-core assembly is scanned in one or more embodiments. A time-varying bright field is generated in one or more embodiments. The optical assembly is a DOE element. The optical assembly is an LC layer in one or more embodiments.
[0114] The method, in one or more embodiments, comprises projecting light associated with one or more frames of image data through a multi-core assembly, the multi-core assembly comprising a plurality of optical fibers, and delivering the projected light through a waveguide such that a first portion of the user's pupil receives light associated with a first portion of the image and a second portion of the user's pupil receives light associated with a second portion of the image.
[0115] The diameters of the first and second portions are, in one or more embodiments, only 0.5 mm. A plurality of optical fibers project light into the single waveguide array in one or more embodiments. The multi-core assembly is scanned in one or more embodiments. The waveguide comprises a plurality of reflectors in one or more embodiments. The angle of the reflectors is variable in one or more embodiments. An optical assembly modifies the light delivered to the first and second viewing zones in one or more embodiments. The optical assembly is a DOE element. The optical assembly is freeform optics. The optical assembly is an LC layer in one or more embodiments.
[0116] On one side, the system includes an array of micro - projectors for projecting light associated with one or more frames of image data to be presented to the user. In one or more embodiments, the array of micro - projectors is positioned relative to the location of the user's pupil, and the light is projected into the user's pupil. The first and second light beams are superimposed in one or more embodiments. The first and second light beams are deflected in one or more embodiments based at least in part on the critical angle of the polished bundle fiber. The polished bundle fiber is used to increase the resolution of the display. The polished bundle fiber is used to create a bright field in one or more embodiments.
[0117] In another embodiment, the system is an array of micro - projectors for projecting light associated with one or more frames of image data to be presented to the user, wherein the array of micro - projectors is positioned relative to the location of the user's pupil, the light is projected into the user's pupil, and the system further includes a micro - projector and an optical element coupled to the array of micro - projectors for modifying the light projected into the user's pupil.
[0118] In yet another embodiment, the system includes a plurality of multi - core fibers for transmitting light beams, wherein the plurality of beams are coupled together, and a coupling element for bundling the plurality of multi - core fibers together. The bundle of multi - core fibers is polished at a critical angle with respect to the longitudinal axis of the fibers such that a first light beam transmitted from a first fiber of the bundle fiber has a first path length and a second light beam transmitted from a second fiber of the bundle fiber has a second path length, and the first path length is different from the second path length such that the first light beam is phase - shifted with respect to the second light beam. The system further includes the coupling element.
[0119] In one or more embodiments, the first and second light beams are superimposed. In one or more embodiments, the first and second light beams are deflected based at least in part on the critical angle of the polished bundle fiber. The polished bundle fiber is used in one or more embodiments to increase the resolution of the display. The polished bundle fiber is used in one or more embodiments to create a bright field.
[0120] In another embodiment, a system for displaying virtual content to a user includes an image source for providing one or more frames of image data, a plurality of optical fibers for transmitting a light beam associated with one or more frames of image data, and an optical element coupled to the plurality of optical fibers and configured to receive collimated light from the optical fibers and deliver the light beam to the user's eye. The light beam is delivered to the user's eye at a plurality of angles such that a first light beam is delivered to a portion of the user's eye at a first angle and a second light beam is delivered to the same portion of the user's eye at a second angle, where the first angle is different from the second angle. The optical element is a waveguide in one or more embodiments. The system further includes a phase modulator in one or more embodiments for modulating the transmission of light through the optical fibers.
[0121] In yet another embodiment, a method includes providing one or more frames of image data, transmitting a light beam associated with one or more frames of image data through a plurality of optical fibers, and delivering the light beam to the user's eye at a plurality of angles.
[0122] The method further includes, in one or more embodiments, modulating the phase delay of a plurality of optical fibers. The method further includes, in one or more embodiments, coupling an optical element to the plurality of optical fibers. The optical element is, in one or more embodiments, a waveguide. The optical element is freeform optics. The optical element is, in one or more embodiments, a DOE. The optical element is, in one or more embodiments, a waveguide.
[0123] In one or more embodiments, the virtual reality display system includes a plurality of optical fibers for generating an optical beam associated with one or more images to be presented to a user, and a plurality of phase modulators coupled to the plurality of optical fibers for modulating the optical beam, the plurality of phase modulators modulating the light in a manner that affects the wavefront resulting from the plurality of optical beams.
[0124] One or more of the optical fibers are deflected at one or more angles in one or more embodiments. The optical fibers of the plurality of optical fibers are coupled to a GRIN lens in one or more embodiments. The plurality of optical fibers are physically actuated to scan the optical fibers in one or more embodiments.
[0125] In yet another aspect, the method includes providing one or more frames of image data to be presented to a user, projecting light associated with one or more frames of image data through the plurality of optical fibers, and modulating the light projected by the plurality of optical fibers through the plurality of phase modulators in a manner that affects the coherent wavefront generated by the plurality of optical fibers.
[0126] Light projected by one or more optical fibers is deflected at one or more angles in one or more embodiments. One or more optical fibers are coupled to a GRIN lens in one or more embodiments. The method further includes, in one or more embodiments, scanning an optical light beam, and a plurality of optical fibers are physically actuated to scan the optical fibers.
[0127] In another aspect, a system for displaying virtual content includes an array of optical fibers for transmitting an optical beam associated with an image to be presented to a user, and a lens coupled to the array of optical fibers for deflecting a plurality of optical beams output by the array of optical fibers through a single node, the lens being physically attached to the optical fibers such that movement of the optical fibers moves the lens, and the single node being scanned.
[0128] The optical beams output by the array of optical fibers represent pixels of an image to be presented to the user in one or more embodiments. The lens is a GRIN lens in one or more embodiments. The array of optical fibers is used to display a bright field in one or more embodiments. Another set of optical beams output by another array of optical fibers represents another pixel of an image to be presented to the user in one or more embodiments. The plurality of arrays of optical fibers are combined to represent pixels of an image to be presented to the user in one or more embodiments. The array of optical fibers is configured to deliver an optical beam to a predetermined portion of a user's pupil in one or more embodiments. The output optical beam is divergent in one or more embodiments. The output optical beam is convergent in one or more embodiments.
[0129] In one or more embodiments, the numerical aperture of the output optical beam is increased for the optical beams transmitted by the individual optical fibers. The increase in the numerical aperture enables a higher resolution in one or more embodiments. In one or more embodiments, the array of optical fibers is angled in such a way that the path length of a first optical beam traveling through a first optical fiber is different from that of a second optical beam traveling through a second optical fiber, thereby enabling multiple focal lengths of the optical beams to be delivered to the user's eye.
[0130] In another aspect, a system for displaying virtual content to a user comprises an array of micro-projectors for projecting light associated with one or more frames of image data, wherein one or more of the micro-projectors of the array of micro-projectors are polished at an angle such that the projected light is deflected, the polished angle creating a path length difference between a first micro-projector and a second micro-projector of the array of micro-projectors with respect to an optical element, and an optical scanner for receiving the deflected optical beams and scanning them along at least one axis.
[0131] In yet another aspect, a system for providing at least one of a virtual or augmented reality experience to a user includes a frame, an array of microprojectors carried by the frame and positionable in front of at least one eye of the user when the frame is worn by the user, and a local controller communicatively coupled to the array of microprojectors for providing image information to the microprojectors, the local controller comprising at least one processor and at least one non-transitory processor-readable medium communicatively coupled to the at least one processor, the at least one non-transitory processor-readable medium storing at least one processor-executable instruction or data that, when executed by the at least one processor, causes the at least one processor to perform at least one of data processing, caching, and storing, provide the image information to the microprojectors, and generate at least one of a virtual or augmented reality visual experience for the user.
[0132] In one or more embodiments, the system further includes at least one reflector supported by the frame and positioned and oriented to direct light from the microprojectors toward at least one eye of the user when the frame is worn by the user. In one or more embodiments, the microprojectors comprise individual ones of a plurality of scanning fiber displays. In one or more embodiments, each of the scanning fiber displays has an individual collimating lens at its distal tip. In one or more embodiments, the individual collimating lenses are gradient index (GRIN) lenses.
[0133] Individual collimating lenses are, in one or more embodiments, curved lenses. Individual collimating lenses are, in one or more embodiments, fused to the distal tip of an individual scanning fiber display. The scanning fiber display has, in one or more embodiments, an individual diffractive lens at its distal tip. Each scanning fiber display has, in one or more embodiments, a diffuser at its distal tip.
[0134] The diffuser is, in one or more embodiments, etched into the individual distal tip. Each scanning fiber display has, in one or more embodiments, an individual lens at its distal tip, and the lens extends distally from the distal tip by a sufficient distance to vibrate freely in response to a stimulus. Each scanning fiber display has, in one or more embodiments, an individual reflector at its distal tip, and the reflector extends distally from the distal tip by a sufficient distance to vibrate freely in response to a stimulus. Each scanning fiber display includes, in one or more embodiments, an individual single-mode optical fiber.
[0135] Each scanning fiber display includes, in one or more embodiments, an individual mechanical transducer coupled to move at least the distal tip of the single-mode optical fiber. Each individual mechanical transducer is, in one or more embodiments, a piezoelectric actuator. Each single-mode optical fiber has, in one or more embodiments, a distal tip, and the distal tip has a hemispherical lens shape. Each single-mode optical fiber has a distal tip, and the distal tip has, in one or more embodiments, a refractive lens attached thereto.
[0136] In one or more embodiments, the system further comprises a transparent holder substrate that holds together a plurality of single-mode optical fibers. The transparent holder substrate has a refractive index that, in one or more embodiments, substantially matches the refractive index of the cladding of the single-mode optical fibers. The transparent holder substrate holds a plurality of single-mode optical fibers that are each angled toward a common spot in one or more embodiments.
[0137] In one or more embodiments, the system further comprises at least one mechanical transducer coupled to move in conjunction with the plurality of single-mode optical fibers. The at least one mechanical transducer vibrates the plurality of single-mode optical fibers at the mechanical resonance frequency of the single-mode optical fibers, where a portion of the at least one mechanical transducer is cantilever-supported from the transparent holder substrate in one or more embodiments. The microprojector comprises, in one or more embodiments, individual ones of a plurality of planar waveguides, and a portion of each of the planar waveguides extends cantilever-supported from the holder substrate. In one or more embodiments, the system further comprises at least one mechanical transducer coupled to move the plurality of planar waveguides in conjunction.
[0138] At least one mechanical transducer vibrates the holder substrate at the mechanical resonance frequency of the planar waveguide in one or more embodiments. The microprojector comprises, in one or more embodiments, individual ones of a plurality of piezoelectric actuators coupled to move individual ones of the planar waveguides relative to the holder substrate. Each planar waveguide defines, in one or more embodiments, a total internal reflection path along an individual length of the planar waveguide, and each planar waveguide comprises individual ones of a plurality of electronically switchable diffractive optical elements (DOEs) operable to propagate light outwardly from the individual total internal reflection paths. The array of microprojectors comprises, in one or more embodiments, an array of optical fibers each having a distal tip and at least one beveled edge. The at least one beveled edge is, in one or more embodiments, at the distal tip, and the distal tip is a polished distal tip.
[0139] Each optical fiber has, in one or more embodiments, a reflective surface at its individual distal tip. The distal tip has, in one or more embodiments, an output edge at the distal tip at a critical angle defined with respect to the longitudinal axis of the individual optical fiber. The defined critical angle is, in one or more embodiments, approximately 45 degrees with respect to the longitudinal axis of the individual optical fiber. The system further comprises, in one or more embodiments, a focusing lens within the optical path of light exiting the distal end of the optical fiber, and receives a plurality of beams of light, the beams being out of phase with each other. The system further comprises, in one or more embodiments, at least one transducer coupled to move at least one of the optical fibers within an X-Y Cartesian coordinate system and to move the light emitted by the at least one optical fiber within an X-Z Cartesian coordinate system. The at least one transducer is, in one or more embodiments, a first piezoelectric actuator that resonates the cantilevered portion of the optical fiber in a direction perpendicular to the direction in which the cantilevered portion extends.
[0140] In one or more embodiments, the optical fiber comprises a thin ribbon of the optical fiber. In one or more embodiments, at least one transducer is a second piezoelectric actuator that moves at least a cantilever-supported portion of the optical fiber longitudinally in a direction in which the cantilever-supported portion extends. In one or more embodiments, the microprojector includes at least one single-axis mirror operable to provide a slow scan along at least one longitudinal axis of the optical fiber. In one or more embodiments, the array of optical fibers comprises a multi-core fiber. The multi-core fiber includes a plurality of about seven sparsely positioned clusters within a single conduit, each cluster comprising three optical fibers, and each optical fiber, in one or more embodiments, carrying an individual one of three different colors of light.
[0141] In one or more embodiments, the multi-core fiber includes a plurality of about 19 sparsely positioned clusters within a single conduit, each cluster comprising three optical fibers, and each optical fiber carrying an individual one of three different colors of light and generating a triple structure of overlapping spots of three different colors. In one or more embodiments, the multi-core fiber includes at least one cluster within a single conduit, the clusters each comprising at least three optical fibers, and the optical fibers each carrying at least two different colors of light.
[0142] In one or more embodiments, the multi-core fiber includes at least one cluster within a single conduit, at least one cluster comprising four optical fibers, and each optical fiber carrying an individual one of four different colors of light, one of the four colors being infrared or near infrared. In one or more embodiments, the multi-core fiber further comprises at least one transducer that includes a plurality of cores within a tight bundle and is coupled to move the cores in a sparse spiral pattern. In one or more embodiments, at least one bevel edge is spaced inwardly from the distal tip. In one or more embodiments, at least one bevel edge is polished.
[0143] In one or more embodiments, the system further comprises at least one transducer configured to move at least one of the optical fibers within an X-Y Cartesian coordinate system and to move the light emitted by at least one optical fiber within an X-Z Cartesian coordinate system.
[0144] In one or more embodiments, the system further comprises a focusing lens within the optical path of light exiting from an edge of an optical fiber, and receives a plurality of beams of light, the beams being mutually out of phase. In one or more embodiments, the system further comprises a laser and at least one phase modulator optically coupling the output of the laser to some of the cores of a multi-core fiber to achieve mutual coherence.
[0145] In one or more embodiments, the system further comprises a microlens array optically coupled upstream of the input ends of individual ones of some of the cores of a multi-core fiber, and a prism array optically coupled between the plurality of collimating lenses and the input ends of the cores of the multi-core fiber to deflect light from the microlens array to the cores of the multi-core fiber.
[0146] In one or more embodiments, the system further comprises a microlens array optically coupled upstream of the input ends of individual ones of some of the cores of a multi-core fiber, and a shared focusing lens optically coupled between the microlens array and the input ends of the cores of the multi-core fiber to deflect light from the microlens array to the cores of the multi-core fiber.
[0147] In one or more embodiments, the array of micro - projectors further comprises at least one reflector, the at least one reflector being operable to generate a scanning pattern and being optically coupled to an array of optical fibers. In one or more embodiments, the at least one reflector is operable to generate at least one of a raster scanning pattern of a multi - focal beam, a Lissajous scanning pattern, or a spiral scanning pattern. In one or more embodiments, each core of the multi - core fiber addresses a separate portion of the image plane without overlap. In one or more embodiments, each core of the multi - core fiber addresses a separate portion of the image plane with substantial overlap.
[0148] In another embodiment, a system for displaying virtual content comprises an image source for providing one or more frames of image data to be presented to a user, and a fiber - scanning display, the fiber - scanning display comprising a plurality of fibers, the fiber - scanning display projecting light associated with one or more frames of image data, the plurality of fibers being scanned using an actuator, and a processor for controlling the fiber - scanning display in a manner such that a bright field is presented to the user.
[0149] In one or more embodiments, the actuator is shared among all the fibers of the fiber - scanning display. In one or more embodiments, each fiber has its individual actuator. In one or more embodiments, the plurality of fibers are mechanically coupled by a grid such that the plurality of fibers move together. In one or more embodiments, the grid is a graphene plane. In one or more embodiments, the grid is lightweight struts.
[0150] In another embodiment, a system for providing at least one of a virtual or augmented reality experience to a user includes a frame, a display system carried by the frame and positionable in front of at least one eye of the user when the frame is worn by the user, and a local controller communicatively coupled to the display system and providing image information to the display system, the local controller including at least one processor and at least one non-transitory processor-readable medium communicatively coupled to the at least one processor, the at least one non-transitory processor-readable medium storing at least one processor-executable instruction or data that, when executed by the at least one processor, causes the at least one processor to perform at least one of data processing, caching, and storing, provide the image information to the display, and generate at least one of a virtual or augmented reality visual experience for the user.
[0151] The display includes, in one or more embodiments, at least one wedge-shaped waveguide having at least two flat surfaces facing each other across the thickness of the first wedge-shaped waveguide and along which light incident at an angle defined in the wedge-shaped waveguide through an incident portion of the wedge-shaped waveguide propagates through total internal reflection, the wedge-shaped waveguide having a length, and the thickness of the wedge-shaped waveguide varying linearly along the length of the wedge-shaped waveguide. The wedge-shaped waveguide provides, in one or more embodiments, bimodal total internal reflection.
[0152] The system further includes, in one or more embodiments, at least two projectors optically coupled to the wedge-shaped waveguide at different individual locations along the incident portion of the wedge-shaped waveguide. The system further includes, in one or more embodiments, a first linear array of a plurality of projectors optically coupled to the wedge-shaped waveguide at different individual locations along the incident portion of the wedge-shaped waveguide.
[0153] In one or more embodiments, the projectors of the first linear array of projectors are scanning fiber displays. The system further includes, in one or more embodiments, a stack of a plurality of spatial light modulators optically coupled to the wedge-shaped waveguide along the input portion of the wedge-shaped waveguide. The system further includes, in one or more embodiments, a multi-core optical fiber optically coupled to the wedge-shaped waveguide at one or more locations along the input portion of the wedge-shaped waveguide.
[0154] In one or more embodiments, the projectors of the first linear array of projectors are optically coupled to the wedge-shaped waveguide, input light into the wedge-shaped waveguide at a first angle, and are optically coupled to the wedge-shaped waveguide at individual different locations along the input portion of the wedge-shaped waveguide. The system further includes a second linear array of a plurality of projectors, where the projectors of the second linear array of projectors are optically coupled to the wedge-shaped waveguide, input light into the wedge-shaped waveguide at a second angle, and the second angle is different from the first angle.
[0155] In one or more embodiments, the input portion is the longitudinal end of the wedge-shaped waveguide. In one or more embodiments, the input portion is the lateral edge of the wedge-shaped waveguide. In one or more embodiments, the input portion is one of the flat surfaces of the wedge-shaped waveguide. The system further includes, in one or more embodiments, at least one optical component optically coupled to the projector, changing the angle of the light received from the projector, and optically coupling the light to the wedge-shaped waveguide at an angle that achieves total internal reflection of the light within the wedge-shaped waveguide.
[0156] In another aspect, a system for presenting virtual content to a user is an array of micro-projectors for projecting an optical beam associated with one or more frames of image data to be presented to the user, the micro-projectors being configurable to be movable relative to one or more of the micro-projectors of the array of micro-projectors, a frame for storing the array of micro-projectors, and one or more of the micro-projectors of the array of micro-projectors being operably coupled to a processor that controls one or more optical beams transmitted from one or more of the projectors in a manner such that the one or more optical beams are modulated as a function of the position of one or more of the micro-projectors relative to the array of micro-projectors, thereby enabling the delivery of a bright-field image to the user.
[0157] The micro-projectors of the array of micro-projectors are coupled to a lens in one or more embodiments. The array of micro-projectors is arranged in a manner based on a desired resolution of an image to be presented to the user in one or more embodiments. The array of micro-projectors is arranged based on a desired field of view in one or more embodiments. The optical beams of the plurality of micro-projectors overlap in one or more embodiments. The system further comprises an actuator in one or more embodiments, the actuator being coupled to one or more of the micro-projectors and configurable to move one or more of the micro-projectors.
[0158] The actuator is coupled to a plurality of micro-projectors in one or more embodiments. The actuator is coupled to a single micro-projector in one or more embodiments. The micro-projectors of the array of micro-projectors are mechanically coupled to a grid in one or more embodiments.
[0159] In yet another embodiment, a contact lens that interfaces with the cornea of a user's eye for a virtual or augmented reality display comprises a partial hemispherical substrate and a selective filter. The selective filter is configured to selectively pass a light beam to the user's eye in one or more embodiments. The selective filter is a notch filter in one or more embodiments. The notch filter substantially blocks wavelengths at about 450 nm (peak blue) and substantially passes other wavelengths within the visible portion of the electromagnetic spectrum in one or more embodiments. The notch filter substantially blocks wavelengths at about 530 nm (green) and substantially passes other wavelengths within the visible portion of the electromagnetic spectrum in one or more embodiments. The notch filter substantially blocks wavelengths at about 650 nm and substantially passes other wavelengths within the visible portion of the electromagnetic spectrum in one or more embodiments.
[0160] The notch filter comprises a plurality of layers of dielectric material supported by the substrate in one or more embodiments. The filter has a pinhole aperture with a diameter of less than 1.5 mm in one or more embodiments. The pinhole aperture enables light beams of multiple wavelengths to pass through in one or more embodiments. The size of the pinhole is varied in one or more embodiments, at least in part, based on the desired depth of focus of the display. The contact lens further comprises multiple operating modes in one or more embodiments. The contact lens further comprises a multi-depth-of-focus display configuration for virtual content in one or more embodiments.
[0161] In one or more embodiments, the contact lens further comprises a focus adjustment tracking module for determining the focus adjustment of the user's eye. In one or more embodiments, the depth of focus of a particular display object is varied, at least in part, based on the determined focus adjustment. In one or more embodiments, an image is relayed through a waveguide, and the relayed image is associated with a particular depth of focus.
[0162] In another embodiment, a method for presenting virtual content to a user includes providing one or more frames of image data to be presented to the user, projecting light associated with the one or more frames of image data, and receiving the projected light through a partial hemispherical substrate coupled to the user's pupil and selectively filtering the light beam to the user's pupil.
[0163] In another embodiment, a system for presenting virtual content to a user includes a light projection system for projecting light associated with one or more frames of image data onto the user's eye, the light projection system configured to project light corresponding to a plurality of pixels associated with the image data, and a processor for modulating the depth of focus of the plurality of pixels presented to the user.
[0164] In one or more embodiments, the depth of focus is spatially modulated. In one or more embodiments, the depth of focus is modulated over time. The system further includes, in one or more embodiments, an image source for providing one or more frames of image data in a time-series fashion. In one or more embodiments, the depth of focus is modulated on a per-frame basis. The light projection system includes, in one or more embodiments, a plurality of optical fibers, and the depth of focus is modulated across the plurality of optical fibers such that a portion of the optical fibers is associated with a first depth of focus and another portion of the optical fibers is associated with a second depth of focus, the first depth of focus being different from the second depth of focus.
[0165] In one or more embodiments, the first display object of a particular frame is displayed through a first depth of focus, and the second display object of the particular frame is displayed through a second depth of focus, and the first depth of focus is different from the second depth of focus. In one or more embodiments, the first pixel of a particular frame is associated with the first depth of focus, and the second pixel of the particular frame is associated with the second depth of focus, and the first depth of focus is different from the second depth of focus. The system further includes, in one or more embodiments, a focus tracking module for determining the user's eye accommodation, and the depth of focus is modulated based at least in part on the determined accommodation.
[0166] In one or more embodiments, the light generation pattern associated with the light generation system is dynamically driven by the determined accommodation. The pattern is, in one or more embodiments, a scanning pattern of a plurality of optical fibers. The system further includes, in one or more embodiments, a blurring module for blurring one or more portions of the image data, and the blurring is created to smooth the transition between a first scanning pattern and a second scanning pattern or between a first resolution scanning pitch and a second resolution scanning pitch.
[0167] In another embodiment, a system for displaying virtual content to a user is a light projection system for projecting light associated with one or more frames of image data into the user's eye, the light projection system being configured to project light corresponding to a plurality of pixels associated with the image data, and a processor for modulating the size of the plurality of pixels displayed to the user.
[0168] In one or more embodiments, the light projection system is a fiber scanning display. In one or more embodiments, the projected light is displayed through a scanning pattern. In one or more embodiments, the processor modulates the size of a particular pixel, at least in part, based on the type of scanning pattern. In one or more embodiments, the size of one or more pixels may be modulated, at least in part, based on the distance between scanning lines of the scanning pattern. In one or more embodiments, the size of the first pixel is different from the size of the second pixel within the same frame.
[0169] In another aspect, a method for displaying virtual content to a user includes, in one or more embodiments, projecting light associated with one or more frames of image data, wherein one or more light beams of the projected light correspond to one or more pixels and the light is projected through a fiber scanning display, and modulating the size of one or more pixels to be displayed to the user.
[0170] In one or more embodiments, the size of a particular pixel varies, at least in part, based on the scanning pattern of the fiber scanning display. In one or more embodiments, the size of one or more pixels is modulated, at least in part, based on the distance between scanning lines of the scanning pattern. In one or more embodiments, the size of one or more pixels is variable.
[0171] In yet another embodiment, a system for displaying virtual content to a user is, in one or more embodiments, a display system that delivers light associated with one or more frames of image data, the display system comprising a display system that includes a plurality of pixels and scans light having a variable line pitch, a blurring module that performs variable blurring of one or more of the plurality of pixels and modifies the size of one or more of the pixels, and a processor for controlling the blurring module in a manner such that the pixel size varies, at least in part, based on the line pitch of the display system. The display system is, in one or more embodiments, a fiber scanning system. The pixel size is, in one or more embodiments, enlarged. The pixel size is, in one or more embodiments, reduced. The pitch lines are, in one or more embodiments, sparse. The pitch lines are, in one or more embodiments, high density.
[0172] In another aspect, a method for displaying virtual content to a user includes projecting light associated with one or more frames of image data to be presented to the user, selectively attenuating at least a portion of the projected light beam, at least in part, based on characteristics of the image data, and delivering the attenuated light beam to the user's eye.
[0173] The light beam is, in one or more embodiments, selectively attenuated, at least in part, based on the angle of incidence of the light beam. Different portions of the frame are, in one or more embodiments, attenuated to different amounts. The depth of focus of the attenuated light beam is, in one or more embodiments, varied.
[0174] In one or more embodiments, a system for displaying virtual content to a user includes an image source for providing one or more frames of image data, and a stack of two or more spatial light modulators (SLMs) positioned to deliver light associated with one or more frames of image data to the user, the SLMs spatially attenuating light from the external environment, and a processor for controlling the stack of SLMs in a manner such that the angle at which a light beam passes through one or more cells of the SLMs is modulated.
[0175] The system further includes a set of display optics positioned, in one or more embodiments, between the user's eye and the external environment. The SLMs of the stack of SLMs are cholesteric LCDs. At least one of the SLMs is a cholesteric LCD in one or more embodiments. The stack of SLMs is positioned, in one or more embodiments, such that the user can view the outside world through the stack of SLMs, and the SLMs are at least translucent.
[0176] The spatial light modulator array includes, in one or more embodiments, at least one of several liquid crystal arrays, several digital mirror device elements of a digital light processing system, several microelectromechanical systems (MEMS) arrays, or several MEMS shutters. The system further includes, in one or more embodiments, an occluder including at least one optical component, and the processor controls the at least one optical component of the occluder to generate a dark field representation of a dark virtual object.
[0177] In another aspect, a system for displaying virtual content includes an array of spatial light modulators, the array of spatial light modulators being configured to generate a light pattern and including at least two modulators, and a processor for controlling the array of spatial light modulators in such a manner that at least two of the spatial light modulators form a moiré pattern, the moiré pattern being a periodic spatial pattern that attenuates light at a period different from the period of the light pattern formed on the at least two spatial light modulators.
[0178] In one or more embodiments, the array of spatial light modulators includes at least two arrays of spatial light modulators that are optically coupled to each other and control the passage of light through the moiré effect. In one or more embodiments, each of the at least two arrays of spatial light modulators has an individual attenuation pattern. In one or more embodiments, each of the at least two arrays of spatial light modulators has an individual fine pitch sine wave pattern printed, etched, or otherwise engraved thereon or therein. In one or more embodiments, the at least two arrays of spatial light modulators are aligned with each other. In one or more embodiments, each of the at least two arrays of spatial light modulators has an individual attenuation pattern.
[0179] In yet another embodiment, a system for presenting virtual content to a user includes a light source, which is a spatial light modulator, for providing light associated with one or more frames of image data, and a pinhole array positioned relative to the spatial light modulator such that the pinholes of the pinhole array receive light from a plurality of cells of the spatial light modulator, wherein a first light beam passing through a pinhole corresponds to an angle different from a second light beam passing through the pinhole, and the cells of the spatial light modulator selectively attenuate light.
[0180] In one or more embodiments, the external environment is viewed through a pinhole array and an SLM, and the light beam is selectively attenuated, at least in part, based on the incident angle of the light beam. Light from different portions of the field of view is selectively attenuated in one or more embodiments. The system further includes, in one or more embodiments, a selective attenuation layer that is selectively operable to attenuate the transmission of light therethrough, the selective attenuation layer being optically in series with the pinhole layer.
[0181] The selective attenuation layer includes, in one or more embodiments, a liquid crystal array, a digital light projector system, or a spatial light modulator array having an individual attenuation pattern. The pinhole array is positioned, in one or more embodiments, at a distance of about 30 mm from the cornea of the user's eye, and the selective attenuation panel is positioned opposite the pinhole array as viewed from the eye. The pinhole array includes a plurality of pinholes, and the processor controls the SLM, in one or more embodiments, in such a manner that the light is attenuated as a function of the angle at which the light beam passes through the plurality of pinholes, thereby generating a focused bright field. The focused bright field causes occlusion, in one or more embodiments, at a desired focal distance.
[0182] In another embodiment, the system includes, in one or more embodiments, a light source that provides light associated with one or more frames of image data, the light source being a spatial light modulator, and a lens array positioned in a manner with respect to the spatial light modulator such that the lenses of the lens array receive light from a plurality of cells of the spatial light modulator. The first light beam received by the lens corresponds to a different angle than the second light beam received by the lens, and the cells of the spatial light modulator selectively attenuate the light.
[0183] In one or more embodiments, the external environment is viewed through a lens array and an SLM, and the light beam is selectively attenuated, at least in part, based on the incident angle of the light beam. Light from different portions of the field of view is selectively attenuated in one or more embodiments. The lens array comprises a plurality of lenses in one or more embodiments, and the processor controls the SLM in such a manner that the light is attenuated as a function of the angle at which the light beam is received by the plurality of lenses, thereby generating a focused bright field. The focused bright field causes occlusion at a desired focal distance in one or more embodiments.
[0184] In another embodiment, a system for displaying virtual content to a user comprises a light projector for projecting light associated with one or more frames of image data, at least one polarization-sensitive layer for receiving the light and rotating the polarization of the light, and an array of polarization modulators for modulating the polarization of the polarization-sensitive layer, wherein the state of the cells in the array determines the amount of light passing through the polarization-sensitive layer. The system is installed in an eye-proximal configuration in one or more embodiments. The polarization modulator is a liquid crystal array in one or more embodiments.
[0185] The system further comprises, in one or more embodiments, a parallax barrier for offsetting a polarizer such that different exit pupils have different paths through the polarizer. The polarizer is an xpol polarizer in one or more embodiments. The polarizer is a multiPol polarizer in one or more embodiments. The polarizer is a patterned polarizer in one or more embodiments. The light interacts with one or more MEM arrays in one or more embodiments.
[0186] In one or more embodiments, the system further comprises a spatial light modulator (SLM) for projecting light, the SLM being positioned between one or more optical elements corresponding to a zero magnification telescope. In one or more embodiments, the user views the external environment through the zero magnification telescope. In one or more embodiments, at least one SLM is positioned in the image plane within the zero magnification telescope. The system further comprises a digital micromirror device (DMD) corresponding to a transparent substrate in one or more embodiments.
[0187] In one or more embodiments, the system further comprises an occluder comprising at least one optical component, and the processor controls at least one optical component of the occluder to generate a dark field representation of a dark virtual object. In one or more embodiments, the system further comprises one or more liquid crystal displays (LCDs) that selectively attenuate a light beam. In one or more embodiments, the system further comprises one or more LCDs that act as polarization rotators. In one or more embodiments, the occluder is a louver MEM device.
[0188] In one or more embodiments, the louver MEM device is opaque and varies the angle of incidence on a pixel-by-pixel basis. In one or more embodiments, the occluder is a sliding panel MEM device that slides back and forth to modify the occluded area.
[0189] In another embodiment, a method for displaying virtual content includes projecting light associated with one or more frames of image data, rotating the polarization of the light through a polarization sensitive layer at a substrate that receives the projected light, and modulating the polarization of the light to selectively attenuate the light passing through a polarization layer.
[0190] In one or more embodiments, the polarization modulator is a liquid crystal array. The method further includes, in one or more embodiments, creating a parallax barrier for offsetting a polarizer such that different exit pupils have different paths through the polarizer. The polarizer is, in one or more embodiments, an xpol polarizer. The polarizer is, in one or more embodiments, a multiPol polarizer. The polarizer is, in one or more embodiments, a patterned polarizer.
[0191] In another embodiment, a system for displaying virtual content includes a light source for providing light associated with one or more frames of image data, the light source being a spatial light modulator, and an array of microelectromechanical (MEM) louvers, the MEM louvers being housed within a substantially transparent substrate, the MEM louvers being configurable to vary the angle at which light is delivered to a pixel, the angle of a first pixel delivered to a user being different from the angle of a second pixel delivered to the user.
[0192] In one or more embodiments, at least one optical component includes a first array of microelectromechanical systems (MEMS) louvers. The array of MEMS louvers includes, in one or more embodiments, a plurality of substantially opaque louvers carried by an optically transparent substrate. The array of microelectromechanical systems (MEMS) louvers has, in one or more embodiments, a louver pitch that is fine enough to selectively block light on a pixel-by-pixel basis. The system further includes, in one or more embodiments, at least one optical component of an occluder that includes a second array of MEMS louvers, the second array of MEMS louvers being in a stacked configuration with the first array of MEMS louvers.
[0193] In one or more embodiments, an array of MEMS louvers comprises a plurality of polarization louvers carried by an optically transparent substrate, and the individual polarization states of the louvers are selectively controllable. The louvers of the first and second arrays of the MEMS panel are, in one or more embodiments, polarizers. At least one optical component of the occluder comprises, in one or more embodiments, a first array of microelectromechanical systems (MEMS) panels mounted for movement within a frame.
[0194] The panels of the first array of the MEMS panel are, in one or more embodiments, slidably mounted for movement within the frame. The panels of the first array of the MEMS panel are, in one or more embodiments, pivotally mounted for movement within the frame. The panels of the first array of the MEMS panel are, in one or more embodiments, translationally and pivotally mounted for movement within the frame. The panels are, in one or more embodiments, movable to generate a moiré pattern. At least one optical component of the occluder further comprises, in one or more embodiments, a second array of MEMS panels mounted for movement within the frame, and the second array is in a stacked configuration with the first array. The panels of the first and second arrays of the MEMS panel are polarizers. At least one optical component of the occluder comprises, in one or more embodiments, a reflector array.
[0195] In another embodiment, the system comprises at least one waveguide for receiving light from an external environment and directing the light to one or more spatial light modulators, and the one or more spatial light modulators selectively attenuate light received at different portions of the user's field of view. The at least one waveguide comprises, in one or more embodiments, first and second waveguides, and the second waveguide is configured to deliver light exiting the SLM to the user's eye.
[0196] In another embodiment, the method includes receiving light from an external environment, directing the light to a selective attenuator, and selectively attenuating the light received at different portions of the user's field of view through the selective attenuator.
[0197] In one or more embodiments, at least one waveguide comprises first and second waveguides, and the second waveguide is configured to deliver light exiting the SLM to the user's eye. In one or more embodiments, the selective attenuator is a spatial light modulator. In one or more embodiments, the spatial light modulator is a DMD array. In one or more embodiments, the light is directed through one or more waveguides to one or more spatial light modulators. In one or more embodiments, the method further includes recombining the light to return it to the waveguide and partially emitting the light towards the user's eye. In one or more embodiments, the waveguide is oriented substantially perpendicular to the selective attenuator.
[0198] In another embodiment, a system for displaying virtual content to a user comprises a light source for providing light associated with one or more frames of image data, the light source comprising a plurality of microprojectors, and a waveguide configured to receive the light from the plurality of microprojectors and transmit the light to the user's eye.
[0199] In one or more embodiments, the microprojectors are installed within a linear array. In one or more embodiments, the microprojectors are installed within one edge of the waveguide. The microprojectors are installed within a plurality of edges of the waveguide. In one or more embodiments, the microprojectors are installed within a two-dimensional array. In one or more embodiments, the microprojectors are installed within a three-dimensional array. In one or more embodiments, the microprojectors are installed on a plurality of edges of a substrate. In one or more embodiments, the microprojectors are installed at a plurality of angles.
[0200] In another embodiment, a system for displaying virtual content includes an image source for providing one or more frames of image data, the image data including one or more virtual objects to be presented to a user, and a rendering engine for rendering one or more virtual objects in a manner such that an afterglow is perceived by the user around the one or more virtual objects.
[0201] The system further includes, in one or more embodiments, a light attenuator that equalizes the light intensity of the afterglow across the user's field of view.
[0202] In another embodiment, a method for displaying virtual content includes providing one or more frames of image data, the image data including one or more virtual objects to be presented to a user, and rendering one or more virtual objects in a manner such that an afterglow is perceived by the user around the one or more virtual objects, thereby facilitating the user's visual recognition of the virtual objects, the virtual objects being dark virtual objects.
[0203] The method further includes, in one or more embodiments, selectively attenuating light received from an external environment through a light attenuator that equalizes the light intensity of the afterglow across the user's field of view.
[0204] In another embodiment, a system for displaying virtual content, in one or more embodiments, includes a camera system for capturing a view of a real environment, and an optical see-through system for displaying one or more virtual objects superimposed over the view of the real environment, wherein the captured view is used to render one or more virtual objects presented to a user, and a light intensity module for modulating the light intensity of the view of the real environment based at least on a correlation between one or more real objects and one or more virtual objects such that a dark virtual object is visible in contrast to one or more real objects.
[0205] In one or more embodiments, the captured view is used to generate backlight around one or more virtual objects, and the backlight gradually fades across the space. The system further includes, in one or more embodiments, a light attenuator that equalizes the light intensity of the backlight across the user's field of view.
[0206] In yet another embodiment, a method of driving an augmented reality display system includes rendering a first virtual object at a location on a user's field of view, and rendering a visual emphasis at least spatially proximate to the first virtual object rendered with the visual emphasis substantially in parallel with the rendering of the first virtual object.
[0207] In one or more embodiments, the step of rendering the visual emphasis includes rendering the visual emphasis using an intensity gradient. In one or more embodiments, the step of rendering the visual emphasis includes rendering the visual emphasis using a blur proximate to a periphery of the visual emphasis.
[0208] The step of rendering a visual emphasis at least spatially proximate to the rendered first virtual object includes, in one or more embodiments, the step of rendering an afterglow visual effect spatially proximate to the rendered first virtual object. The step of rendering an afterglow visual effect spatially proximate to the rendered first virtual object includes, in one or more embodiments, the step of rendering the afterglow visual effect brighter than the rendered first virtual object.
[0209] The step of rendering the afterglow visual effect brighter than the rendered first virtual object responds, in one or more embodiments, to a determination that the rendered first virtual object is darker than a threshold level of darkness. The step of rendering the afterglow visual effect includes, in one or more embodiments, the step of rendering the afterglow visual effect on a focal plane separate from the rendered first virtual object within the perceived three-dimensional space. The step of rendering the afterglow visual effect includes, in one or more embodiments, the step of rendering the afterglow visual effect using an intensity gradient. The step of rendering the afterglow visual effect includes, in one or more embodiments, the step of rendering the afterglow visual effect using an intensity gradient that matches a dark afterglow resulting from occlusion applied to the rendering of the first virtual object and compensates for the dark field effect of the occlusion.
[0210] The step of rendering the afterglow visual effect includes, in one or more embodiments, the step of rendering the afterglow visual effect using blur in proximity to the periphery of the afterglow visual effect. The rendered first visual object has, in one or more embodiments, a non-circular periphery, and the rendered afterglow visual effect matches the non-circular periphery. The step of rendering a visual emphasis at least spatially proximate to the rendered first virtual object includes, in one or more embodiments, the step of rendering a visual effect on a focal plane separate from the rendered first virtual object within the perceived three-dimensional space. The step of rendering a visual effect on a focal plane separate from the rendered first virtual object within the perceived three-dimensional space includes, in one or more embodiments, the step of rendering the visual effect on a focal plane that is relatively spaced apart from the user with respect to the focal plane on which the rendered first virtual object is rendered.
[0211] In another embodiment, a system for displaying virtual content includes an image source for providing one or more frames of image data to be presented to a user, wherein the one or more frames of image data comprise at least one black virtual object, and a rendering engine for rendering the one or more frames of image data, the rendering engine rendering the black virtual object as a blue virtual object such that the black virtual object is visible to the user.
[0212] The step of rendering the first virtual object at a location on the user's field of view includes, in one or more embodiments, first changing any black color tone of the first virtual object to dark blue.
[0213] In yet another embodiment, a system for transmitting an optical beam for the display of virtual content includes at least one waveguide having a first end and a second end spaced from the first end, across the length of the at least one waveguide, and along its length, light incident at an angle defined for an individual waveguide propagates through total internal reflection; at least one edge reflector positioned adjacent to the first end of the at least one waveguide for optically reflecting and coupling light back to the first end of the at least one waveguide; and at least one edge reflector positioned adjacent to the second end of the at least one waveguide for optically reflecting and coupling light back to the second end of the at least one waveguide.
[0214] In one or more embodiments, the at least one waveguide has one or more lateral reflection and / or diffraction surfaces within the waveguide that redirect at least a portion of the light laterally outward from the waveguide. The lateral reflection and / or diffraction surfaces are, in one or more embodiments, low diffraction efficiency diffractive optical elements (DOEs). The at least one edge reflector positioned adjacent to the first end of the at least one waveguide comprises, in one or more embodiments, a plurality of reflectors positioned adjacent to the first end of the at least one waveguide.
[0215] The at least one edge reflector positioned adjacent to the second end of the at least one waveguide comprises, in one or more embodiments, a plurality of reflectors positioned adjacent to the second end of the at least one waveguide. In one or more embodiments, the at least one waveguide is a single waveguide.
[0216] In yet another embodiment, a system for transmitting an optical beam for the display of virtual content is a waveguide assembly comprising a plurality of planar waveguides, each planar waveguide having at least two flat parallel major surfaces facing each other across the thickness of the planar waveguide, a first end, and a second end facing the first end across the length of the waveguide, along which length light incident at an angle defined for an individual waveguide propagates via total internal reflection, and two flat major edges facing each other across the width of the waveguide, and the plurality of planar waveguides are in a stacked configuration along a first axis balanced with the thickness direction of the planar waveguides and along a second axis parallel to the width of the planar waveguides, forming a three-dimensional array of planar waveguides, and comprising a waveguide assembly.
[0217] In one or more embodiments, at least three planar waveguides are stacked in the direction of the first axis. In one or more embodiments, at least three planar waveguides are stacked in the direction of the second axis. In one or more embodiments, at least three planar waveguides are stacked in the direction of the second axis. In one or more embodiments, consecutive planar waveguides in the stack along the first axis are directly adjacent to each other, and consecutive planar waveguides in the stack along the second axis are directly adjacent to each other. The waveguide assembly further comprises, in one or more embodiments, a plurality of reflective layers carried on at least one surface of at least one of the planar waveguides.
[0218] The reflective layer includes a fully reflective metal coating. The reflective layer includes, in one or more embodiments, a wavelength-specific reflector. The reflective layer separates, in one or more embodiments, the planar waveguides in each consecutive pair of planar waveguides along at least one of the first or second axes. The reflective layer separates, in one or more embodiments, the planar waveguides in each consecutive pair of planar waveguides along both the first and second axes.
[0219] In some embodiments, each of several planar waveguides includes several lateral reflection and / or diffraction surfaces that redirect at least a portion of the light received by an individual planar waveguide laterally outward from the planar waveguide. In one or more embodiments, the lateral reflection and / or diffraction surfaces comprise diffractive optical elements that are confined within an individual planar waveguide between major faces of the individual planar waveguide. In one or more embodiments, the diffractive optical elements are selectively operable to vary the focal length.
[0220] In one or more embodiments, the first axis is a curved axis, and at least one of each of the major edges of the planar waveguides within at least one assembly in the waveguide assembly is oriented to be focused on a single line, and the single line is parallel to the length of the planar waveguide.
[0221] In one or more embodiments, a system for displaying virtual content to a user comprises an optical projector for projecting light associated with one or more frames of image data, the optical projector being a fiber scanning display, and a waveguide assembly for variably deflecting the light towards the user's eye, the waveguide being concave-curved towards the eye.
[0222] In one or more embodiments, the curved waveguide expands the field of view. In one or more embodiments, the curved waveguide efficiently directs light to the user's eye. In one or more embodiments, the curved waveguide comprises a time-varying grating, thereby creating an axis for scanning light for a fiber scanning display.
[0223] In another embodiment, a system for displaying virtual content to a user, in one or more embodiments, includes an entrance for receiving light, and a transmissive beam splitter substrate having a plurality of lateral reflection and / or diffraction surfaces angled with respect to the entrance and configured to redirect at least a portion of the light received at the entrance laterally outwardly from the transmissive beam splitter substrate toward the user's eye, the plurality of lateral reflection and / or diffraction surfaces including a plurality of lateral reflection and / or diffraction surfaces spaced along a longitudinal axis of the transmissive beam splitter substrate, each of the lateral reflection and / or diffraction surfaces being angled or angulable with respect to the entrance to redirect at least a portion of the light received at the entrance laterally outwardly along an optical path from the transmissive beam splitter substrate toward the user's eye; a light generation system for transmitting light to the transmissive beam splitter; and a local controller communicatively coupled to the display system and providing image information to the display system, the local controller comprising at least one processor and at least one non-transitory processor-readable medium communicatively coupled to the at least one processor, the at least one non-transitory processor-readable medium storing at least one processor-executable instruction or data that, when executed by the at least one processor, causes the at least one processor to perform at least one of processing, caching, and storing data, provide image information to the display, and generate at least one of a virtual or augmented reality visual experience for the user.
[0224] The lateral reflection and / or diffraction surface comprises, in one or more embodiments, at least one diffractive optical element (DOE). A collimated beam that is incident on the beam splitter at several defined angles is totally internally reflected along its length and intersects the DOE at one or more locations. The at least one diffractive optical element (DOE) comprises, in one or more embodiments, a first grating. The first grating is, in one or more embodiments, a first Bragg grating.
[0225] The DOE comprises, in one or more embodiments, a second grating. The first grating is on a first plane, the second grating is on a second plane, the second plane is spaced from the first plane such that the first and second gratings intersect to produce a moiré beat pattern. The first grating has, in one or more embodiments, a first pitch, the second grating has a second pitch, and the first pitch is the same as the second pitch. The first grating has, in one or more embodiments, a first pitch, the second grating has a second pitch, and the first pitch is different from the second pitch. The first grating pitch is controllable to vary over time, in one or more embodiments. The first grating is made of an elastic material and undergoes mechanical deformation, in one or more embodiments.
[0226] The first grating is carried by an elastic material that undergoes mechanical deformation in one or more embodiments. The first grating pitch is controllable to vary over time in one or more embodiments. The second grating pitch is controllable to vary over time in one or more embodiments. The first grating is an electroactive grating having at least one on state and one off state in one or more embodiments. The first grating comprises polymer dispersed liquid crystals in one or more embodiments, and a plurality of liquid crystal droplets of the polymer dispersed liquid crystals are controllably activated to change the refractive index of the first grating.
[0227] The first grating is a time-varying grating in one or more embodiments, and the local controller controls at least the first grating to expand the viewing field of the display. The first grating is a time-varying grating in one or more embodiments, and the local controller employs time-varying control of at least the first grating to correct chromatic aberration. The local controller drives at least the first grating in one or more embodiments to vary the location of the red sub-pixel of a pixel of an image relative to at least one of the blue or green sub-pixels of the corresponding pixel of the image. The local controller drives at least the first grating in one or more embodiments to laterally shift the emission pattern and fill in gaps within the outbound image pattern.
[0228] In one or more embodiments, at least one DOE element has a first circular symmetry term. In one or more embodiments, at least one DOE element has a first linear term, and the first linear term is summed with the first circular symmetry term. The circular symmetry term is controllable in one or more embodiments. In one or more embodiments, at least one DOE element has a second circular symmetry term. In one or more embodiments, at least one diffractive optical (DOE) element comprises a first DOE. The first DOE is a circular DOE in one or more embodiments.
[0229] The circular DOE is a time-varying DOE in one or more embodiments. The circular DOE is laminated to a waveguide for focal modulation in one or more embodiments. The diffraction pattern of the circular DOE is static in one or more embodiments. The diffraction pattern of the circular DOE is dynamic in one or more embodiments. The system comprises an additional circular DOE, and the additional circular DOE is positioned relative to the circular DOE such that in one or more embodiments, multiple focal levels are achieved through a small number of switchable DOEs.
[0230] In one or more embodiments, the system further comprises a matrix of switchable DOE elements. The matrix is utilized to expand the field of view in one or more embodiments. The matrix is utilized to expand the size of the exit pupil in one or more embodiments.
[0231] In one or more embodiments, a system for displaying virtual content to a user comprises an optical projection system for projecting an optical beam associated with one or more frames of image data, and a diffractive optical element (DOE) for receiving the projected optical beam and delivering the optical beam at a desired focus, the DOE being a circular DOE.
[0232] In one or more embodiments, the DOE can be extended along a single axis to adjust the angle of the linear DOE term. In one or more embodiments, the DOE comprises a membrane and at least one transducer operable to selectively vibrate the membrane using oscillatory motion in the Z-axis to provide Z-axis control and a change in focus over time. In one or more embodiments, the DOE is embedded within a stretchable medium such that the pitch of the DOE can be adjusted by physically stretching the medium. In one or more embodiments, the DOE is stretched in two axial directions, and the stretching of the DOE affects the focal length of the DOE. The system further comprises, in one or more embodiments, a plurality of circular DOEs, and the DOEs are stacked along the Z-axis. The circular DOEs are laminated on the front of the waveguide for focal modulation. In one or more embodiments, the DOE is static.
[0233] In one or more embodiments, a system for displaying virtual content to a user comprises a light projection system for projecting a light beam associated with one or more frames of image data, a first waveguide without any diffractive optical element (DOE) that propagates light received by the first waveguide through total internal reflection at several defined angles along at least a portion of the length of the first waveguide and provides the external light from the first waveguide as collimated light, a second waveguide with at least a first circularly symmetric diffractive optical element (DOE) optically coupled to receive the collimated light from the first waveguide, and a processor for controlling the grating of the DOE.
[0234] The first DOE is selectively controllable in one or more embodiments. The display comprises, in one or more embodiments, in addition to the first DOE, a plurality of additional DOEs, and the DOEs are arranged in a stack configuration. Each of the plurality of additional DOEs is selectively controllable in one or more embodiments. A local controller controls, in one or more embodiments, the first DOE and the plurality of additional DOEs to dynamically modulate the focus of light passing through the display. A processor selectively switches, in one or more embodiments, the first DOE and the plurality of additional DOEs respectively to achieve several focus levels, and the number of achievable focus levels exceeds the total number of DOEs in the stack.
[0235] Each of the DOEs in the stack has, in one or more embodiments, an individual refractive power, and the refractive powers of the DOEs in the stack are controllable relative to each other. The individual refractive power of at least one of the DOEs in the stack is, in one or more embodiments, twice that of at least one other of the DOEs in the stack. A processor selectively switches, in one or more embodiments, the first DOE and the plurality of additional DOEs respectively to modulate the individual linear and radial terms of the DOEs over time. The processor selectively switches, in one or more embodiments, the first DOE and the plurality of additional DOEs respectively on a frame sequential basis.
[0236] The stack of DOEs comprises a stack of polymer dispersed liquid crystal elements. In the absence of an applied voltage, the host medium refractive index coincides, in one or more embodiments, with that of the collection of dispersed molecules of the polymer dispersed liquid crystal element. The polymer dispersed liquid crystal element comprises, in one or more embodiments, lithium niobate molecules and several transparent indium tin oxide layer electrodes on both sides of the host medium, and the dispersed molecules of lithium niobate change the refractive index controllably to functionally form a diffraction pattern within the host medium.
[0237] In another embodiment, a method for displaying virtual content includes, in one or more embodiments, projecting light associated with one or more frames of image data to a user, receiving the light in a first waveguide without any diffractive optical elements and propagating the light through internal reflection, and receiving the collimated light in a second waveguide with at least a first circularly symmetric diffractive optical element (DOE) optically coupled to receive the collimated light from the first waveguide, wherein the grating of the circularly symmetric DOE is varied and the first and second waveguides are assembled within a stack of DOEs.
[0238] In one or more embodiments, an optical element for displaying virtual content to a user comprises at least one diffractive optical element (DOE) positioned to receive light, the at least one DOE comprising a first array of a plurality of separately addressable sections, each with at least one electrode for each separately addressable sub-section, each separately addressable sub-section responsive to at least one individual signal received via an individual at least one electrode and selectively switchable between at least a first state and a second state, the second state being different from the first state.
[0239] In one or more embodiments, the field of view is expanded by multiplexing adjacent addressable subsections. In one or more embodiments, the first state is an on state, and the second state is an off state. Each of the separately addressable subsections has, in one or more embodiments, a separate set of at least two indium tin oxide electrodes. In one or more embodiments, the first array of a plurality of separately addressable sections of at least one DOE is a one-dimensional array. In one or more embodiments, the first array of a plurality of separately addressable sections of at least one DOE is a two-dimensional array. The first array of separately addressable sections is, in one or more embodiments, a section of a first DOE that is present on a first planar layer.
[0240] In one or more embodiments, at least one DOE comprises at least a second DOE, the second DOE comprising a second array of a plurality of separately addressable sections, with at least one electrode per separately addressable subsection, each of the separately addressable subsections responding to at least one individual signal received via an individual at least one electrode and selectively switching between at least a first state and a second state, the second state being different from the first state, the second array of the DOE being present on a second planar layer, the second planar layer being in a stacked configuration with the first planar layer.
[0241] In one or more embodiments, at least one DOE includes at least a third DOE, the third DOE includes a third array of a plurality of separately addressable sections, with at least one electrode for each separately addressable sub-section, each separately addressable sub-section responds to at least one individual signal received via an individual at least one electrode, and selectively switches between at least a first state and a second state, the second state being different from the first state, the third array of the DOE is present on a third planar layer, and the third planar layer is in a stacked configuration with the first and second planar layers.
[0242] In one or more embodiments, the first array of separately addressable sections is embedded within a single planar waveguide. In one or more embodiments, the local controller controls the separately addressable sub-sections and selectively emits collimated light from the planar waveguide at a first time and divergent light from the planar waveguide at a second time, the second time being different from the first time. In one or more embodiments, the local controller controls the separately addressable sub-sections and selectively emits light in a first direction from the planar waveguide at a first time and light in a second direction from the planar waveguide at the first time, the second direction being different from the first direction.
[0243] In one or more embodiments, the local controller controls the separately addressable sub-sections and selectively scans light traversing a certain direction over time. In one or more embodiments, the local controller controls the separately addressable sub-sections and selectively focuses the light over time. In one or more embodiments, the local controller controls the separately addressable sub-sections and selectively varies the field of view of the exit pupil over time.
[0244] In one or more embodiments, the system includes a first freeform reflective and lens optical component for increasing the size of the field of view for a defined set of optical parameters, the first freeform reflective and lens optical component including a first curved surface, a second curved surface, and a third curved surface, the first curved surface being at least partially optically transmissive and refractive and imparting a focus change to light received by the first freeform reflective and lens optical component through the first curved surface, the second curved surface being at least partially reflective of light received by the second curved surface from the first curved surface toward the third curved surface and passing light received by the second curved surface from the third curved surface, the third curved surface being at least partially reflective of light from the first freeform reflective and lens optical component through the second curved surface.
[0245] The first curved surface of the first freeform reflective and lens optical component is, in one or more embodiments, an individual freeform curved surface. The first curved surface of the first freeform reflective and lens optical component adds, in one or more embodiments, an aspherical aberration to the light. The third curved surface of the first freeform reflective and lens optical component adds, in one or more embodiments, an inverse aspherical aberration that cancels the aspherical aberration added by the first curved surface of the first freeform reflective and lens optical component. The second curved surface of the first freeform reflective and lens optical component is, in one or more embodiments, an individual freeform curved surface. The second curved surface of the first freeform reflective and lens optical component reflects, in one or more embodiments, a defined angle of light to be reflected by total internal reflection toward the third curved surface.
[0246] In one or more embodiments, the system is a fiber-scanning display for projecting light associated with one or more frames of image data, the fiber-scanning display configured to deliver light to a first freeform optical element, and a first freeform reflective and lens optical component for increasing the size of the field of view for a defined set of optical parameters, the first freeform reflective and lens optical component comprising a first curved surface, a second curved surface, and a third curved surface, the first curved surface being at least partially optically transmissive and refractive, imparting a focus change to light received by the first freeform reflective and lens optical component through the first curved surface, the second curved surface being at least partially reflective of light received by the second curved surface from the first curved surface toward the third curved surface, passing light received by the second curved surface from the third curved surface, and the third curved surface being at least partially reflective of light from the first freeform reflective and lens optical component through the second curved surface.
[0247] Freeform optics is, in one or more embodiments, TIR freeform optics. Freeform optics has, in one or more embodiments, a non-uniform thickness. Freeform optics is, in one or more embodiments, wedge optics. Freeform optics is, in one or more embodiments, conical. Freeform optics corresponds to, in one or more embodiments, an arbitrary curve.
[0248] In one or more embodiments, the system includes an image source for providing one or more frames of image data to be presented to a user, a display system for providing light associated with one or more frames of image data, and a freeform optical element for modifying the provided light and delivering the light to the user, wherein the freeform optics includes a reflective coating, and the display system is configured to illuminate the freeform optical element with light such that the wavelength of the light matches the corresponding wavelength of the reflective coating.
[0249] One or more freeform optical elements are tiled relative to each other. In one or more embodiments, one or more freeform optical elements are tiled along the Z-axis.
[0250] In one or more embodiments, the system includes an image source for providing one or more frames of image data to be presented to a user, a display system for providing light associated with one or more frames of image data, the display system including a plurality of microdisplays, and a freeform optical element for modifying the provided light and delivering the light to the user.
[0251] One or more freeform optics are tiled relative to each other. The light projected by a plurality of microdisplays increases the field of view in one or more embodiments. The freeform optical element is configured such that only one color is delivered by a particular freeform optical element in one or more embodiments. The tiled freeform is a star shape in one or more embodiments. The tiled freeform optical element increases the size of the exit pupil in one or more embodiments. The system further includes, in one or more embodiments, another freeform optical element, and the freeform optical elements are stacked together in a manner that creates a uniform material thickness. The system further includes, in one or more embodiments, another freeform optical element, and the other optical elements are configured to capture light corresponding to the external environment.
[0252] The system further includes a DMD, and the DMD is configured to block one or more pixels in one or more embodiments. The system further includes one or more LCDs. The system further includes, in one or more embodiments, a contact lens substrate, and the freeform optics are coupled to the contact lens substrate. The plurality of microdisplays provide, in one or more embodiments, an array of small exit pupils that form a functional equivalent of a large exit pupil as an aggregate.
[0253] At least one image source includes, in one or more embodiments, at least a first monochromatic image source that provides a first color of light, at least a second monochromatic image source that provides a second color of light that is different from the first color, and at least a third monochromatic image source that provides a third color of light that is different from the first and second colors. The at least first monochromatic image source includes, in one or more embodiments, a first subgroup of scanning fibers, the at least second monochromatic image source includes a second subgroup of scanning fibers, and the at least third monochromatic image source includes a third subgroup of scanning fibers.
[0254] The system further comprises an occluder positioned within the optical path between the first freeform reflector and lens optical component and at least one reflector, the occluder being operable to selectively block light on a per-pixel basis. The first freeform reflector and lens optical component form at least a portion of a contact lens. The system further comprises, in one or more embodiments, a compensator lens optically coupled to a portion of the first freeform reflector and lens optical component.
[0255] In one or more embodiments, the system includes a first freeform reflective and lens optical component for increasing the size of the field of view for a defined set of optical parameters, the first freeform reflective and lens optical component comprising a first surface, a second surface, and a third surface, the first surface being at least partially optically transmissive to light received by the first freeform reflective and lens optical component through the first surface, the second surface being curved and at least partially reflecting light received from the first surface towards the third surface by the second surface and passing light received from the curved surface by the second surface, the third surface being curved and at least partially reflecting light from the first freeform reflective and lens optical component through the second surface, a first freeform reflective and lens optical component, and a second freeform reflective and lens optical component, the second freeform reflective and lens optical component comprising a first surface, a second surface, and a third surface, the first surface of the second freeform reflective and lens optical component being at least partially optically transmissive to light received by the second freeform reflective and lens optical component through the first surface, the second surface of the second freeform reflective and lens optical component being curved and at least partially reflecting light received from the first surface of the second freeform reflective and lens optical component towards the third surface of the second freeform reflective and lens optical component by the second surface and passing light received from the third surface of the second freeform reflective and lens optical component by the second surface, the third surface of the second freeform reflective and lens optical component being curved and at least partially reflecting light from the second freeform reflective and lens optical component through the second surface, the first and second freeform reflective and lens optical components being in a stacked configuration oriented oppositely along the Z-axis.
[0256] The second surface of the second freeform reflector and lens optical component is adjacent to the third surface of the first freeform reflector and lens optical component in one or more embodiments. In one or more embodiments, the second surface of the second freeform reflector and lens optical component is concave, the third surface of the first freeform reflector and lens optical component is convex, and the third surface of the first freeform reflector and lens optical component receives the second surface of the second freeform reflector and lens optical component in proximity. The first surface of the first freeform reflector and lens optical component is flat in one or more embodiments, the first surface of the second freeform reflector and lens optical component is flat, and at least a first projector optically coupled to the first freeform reflector and lens optical component via the first surface of the first freeform reflector and lens optical component, and at least a second projector optically coupled to the second freeform reflector and lens optical component via the first surface of the second freeform reflector and lens optical component.
[0257] The system further comprises at least one wavelength selective material carried by at least one of the first or second freeform reflector and lens optical components in one or more embodiments. The system further comprises at least a first wavelength selective material carried by the first freeform reflector and lens optical component and at least a second wavelength selective material carried by the second freeform reflector and lens optical component in one or more embodiments, the first wavelength selective material selects a first set of wavelengths, the second wavelength selective material selects a second set of wavelengths, and the second set of wavelengths is different from the first set of wavelengths.
[0258] The system further comprises at least a first polarizer carried by the first freeform reflector and lens optical component and at least a second polarizer carried by the second freeform reflector and lens optical component in one or more embodiments, the first polarizer having a polarization orientation different from that of the second polarizer.
[0259] The optical fiber core is, in one or more embodiments, within the same fiber cladding. The optical fiber core is, in one or more embodiments, within a separate fiber cladding. The focusing adjustment module tracks focusing adjustment, in one or more embodiments, by indirectly tracking the binocular divergence movement or fixation of the user's eyes. The partial mirror has, in one or more embodiments, a relatively high reflectivity with respect to other polarizations of the light provided by the light source and a relatively low reflectivity with respect to other polarization states of the light provided by the external environment. The plurality of partial mirrors comprises, in one or more embodiments, a dielectric coating. The plurality of mirrors has, in one or more embodiments, a relatively high reflectivity with respect to a waveguide for the wavelength of the light provided by the light source and a relatively low reflectivity with respect to other waveguides of the light provided by the external environment. The VFE is, in one or more embodiments, a deformable mirror, the surface shape of which can be varied over time. The VFE is, in one or more embodiments, an electrostatically actuated membrane mirror, the waveguide or additional transparent layer comprising one or more substantially transparent electrodes, and the voltage applied to one or more of the electrodes electrostatically deforms the membrane mirror. The light source is, in one or more embodiments, a scanning light display, and the VFE varies the focus on a line segment basis. The waveguide has, in one or more embodiments, an exit pupil expansion function, and the input light rays of the light are split and output coupled as a plurality of light rays exiting the waveguide at a plurality of locations. The image data is, in one or more embodiments, scaled and compensated by the processor according to the changing optical image magnification so that the image magnification appears to remain substantially fixed while the focus level is adjusted, prior to the waveguide receiving one or more light patterns.
[0260] In another embodiment, a system for displaying virtual content includes an image source for providing one or more frames of image data in a time series fashion, and a display assembly for projecting light rays associated with one or more frames of image data, the display assembly including a first display element corresponding to a first frame rate and a first bit depth, and a second display element corresponding to a second frame rate and a second bit depth, and a variable focus element (VFE) configured to vary the focus of the projected light and transmit the light to the user's eye.
[0261] In yet another embodiment, a system for displaying virtual content includes an array of optical fibers for transmitting light beams associated with an image to be presented to a user, and a lens coupled to the array of optical fibers and configured to deflect a plurality of light beams output by the array of optical fibers through a single node, the lens being physically attached to the optical fibers such that movement of the optical fibers causes movement of the lens and the single node is scanned.
[0262] In another embodiment, a virtual reality display system includes a plurality of optical fibers for generating light beams associated with one or more images to be presented to a user, and a plurality of phase modulators coupled to the plurality of optical fibers and configured to modulate the light beams, the plurality of phase modulators modulating the light in a manner that affects the wavefront resulting from the plurality of light beams.
[0263] In one embodiment, a system for displaying virtual content to a user includes a light projection system for projecting light associated with one or more frames of image data to the user's eye, the light projection system being configured to project light corresponding to a plurality of pixels associated with the image data, and a processor for modulating the size of the plurality of pixels to be displayed to the user.
[0264] In one embodiment, a system for displaying virtual content to a user includes an image source for providing one or more frames of image data, a multi-core assembly having a plurality of multi-core fibers for projecting light associated with one or more frames of image data, the multi-core fibers of the plurality of multi-core fibers emitting light into a wavefront such that the multi-core assembly generates a converging wavefront of the projected light, and a phase modulator for inducing a phase delay between the multi-core fibers in a manner such that the converging wavefront emitted by the multi-core assembly is varied, thereby varying the focal distance at which the user perceives one or more frames of image data.
[0265] In another embodiment, a system for displaying virtual content to a user includes an array of micro-projectors for projecting a light beam associated with one or more frames of image data to be presented to the user, the micro-projectors being configurable to be movable relative to one or more of the micro-projectors of the array of micro-projectors, a frame for housing the array of micro-projectors, and a processor operably coupled to one or more of the micro-projectors of the array of micro-projectors for controlling one or more light beams transmitted from one or more of the projectors such that the one or more light beams are modulated as a function of the position of one or more of the micro-projectors relative to the array of micro-projectors, thereby enabling the delivery of a bright-field image to the user.
[0266] Additional and other objects, features, and advantages of the present invention are set forth in the detailed description, figures, and claims. The present invention provides, for example, the following. (Item 1) A system for displaying virtual content, A light source for multiplexing one or more light patterns associated with one or more frames of image data in a time-series manner, an array of reflectors that receive the one or more light patterns and variably direct light toward an exit pupil, A system comprising: (Item 2) A system for displaying virtual content, an image source for providing one or more frames of image data in a time-series manner, a light modulator configured to transmit light associated with one or more frames of the image data, a substrate for directing image information toward a user's eye and storing a plurality of reflectors, a first reflector of the plurality of reflectors associated with a first frame of image data and configured to reflect transmitted light toward the user's eye at a first angle, a second reflector of the plurality of reflectors associated with a second frame of image data and configured to reflect transmitted light toward the user's eye at a second angle, A system comprising: (Item 3) The system according to item 1 or 2, wherein an angle of reflection of the plurality of reflectors is variable. (Item 4) The system according to item 1 or 2, wherein the reflector is switchable. (Item 5) The system according to item 1 or 2, wherein the plurality of reflectors are electro-optically active. (Item 6) The system according to item 2, wherein a refractive index of the plurality of reflectors is varied to match a refractive index of the substrate. (Item 7) The system according to item 1 or 2, further comprising a high-frequency gating layer configured to be installed between the substrate and the user's eye and having an aperture that is controllably movable. (Item 8) The aperture of the high-frequency gating layer is moved in a manner such that image data is selectively transmitted only through light reflected through the aperture, and one or more reflectors of the transmissive beam splitter substrate are blocked by the high-frequency gating layer, the system of item 7. (Item 9) The aperture is an LCD aperture, the system of item 7. (Item 10) The aperture is a MEM array, the system of item 7. (Item 11) The first angle is the same as the second angle, the system of item 2. (Item 12) The first angle is different from the second angle, the system of item 2. (Item 13) Further comprising a first lens for steering a set of light rays through a node to the user's eye, the first lens being configured to be installed on the substrate and in front of the first reflector such that a set of light rays emitted from the reflector passes through the first lens before reaching the user's eye, the system of item 2. (Item 14) Further comprising a second lens for compensating the first lens, the second lens being configured to be installed on the substrate on the side opposite to the side where the first lens is installed, thereby providing a zero magnification, the system of item 13. (Item 15) The first reflector of the plurality of reflectors is a curved reflecting surface for gathering a set of light rays associated with the image data to a single output point before being delivered to the user's eye, the system of item 2. (Item 16) The curved reflector is a parabolic reflector, the system of item 15. (Item 17) The curved reflector is an elliptical reflector, the system of item 15. (Item 18) A method for displaying virtual content to a user, comprising: providing one or more light patterns associated with one or more frames of image data in a time series pattern; reflecting one or more light patterns associated with one or more frames of the image data to an exit pupil via a transmissive beam splitter, the transmissive beam splitter having a plurality of reflectors and variably directing light toward the exit pupil; A method comprising: (Item 19) The method according to item 18, wherein the reflection angles of the plurality of reflectors are variable. (Item 20) The method according to item 18, wherein the reflector is switchable. (Item 21) The method according to item 18, wherein the plurality of reflectors are electro-optically active. (Item 22) The method according to item 18, wherein the refractive index of the plurality of reflectors is varied to match the refractive index of the substrate. (Item 23) The method according to item 18, further comprising installing a high-frequency gating layer between the transmissive beam splitter and the user's eye, the high-frequency gating layer having an aperture that is controllably movable. (Item 24) The method according to item 23, wherein the aperture of the high-frequency gating layer is moved in a manner such that light reflected through the aperture of the image data is selectively transmitted only therethrough, and one or more reflectors of the transmissive beam splitter substrate are blocked by the high-frequency gating layer. (Item 25) The method according to item 23, wherein the aperture is an LCD aperture. (Item 26) The method according to item 23, wherein the aperture is a MEM array. (Item 27) Directing, through the first lens, a set of light rays exiting the transmissive beam splitter through a node towards the user's eye, the first lens being configurable to be disposed between the transmissive beam splitter and the user's eye, the method according to item 18 further comprising the step of. (Item 28) Compensating for the effect of the first lens through a second lens, the second lens being configurable to be disposed on the substrate and on the side opposite to the side on which the first lens is disposed, the compensating lens providing a zero magnification of light from the external environment, the method according to item 27 further comprising the step of. (Item 29) The reflectors of the plurality of reflectors are curved reflecting surfaces for gathering a set of light rays associated with the image data to a single output point before being delivered to the user's eye, the method according to item 18. (Item 30) The curved reflector is a parabolic reflector, the method according to item 29. (Item 31) The curved reflector is an elliptical reflector, the method according to item 29. (Item 32) The plurality of reflectors of the transmissive beam splitter substrate relay a wavefront to the user's eye, the method according to item 18. (Item 33) The wavefront is a collimated wavefront, the method according to item 32. (Item 34) The wavefront is a curved wavefront, the method according to item 32. (Item 35) The collimated wavefront is perceived by the user as originating from an infinite depth plane, the method according to item 33. (Item 36) The curved wavefront is perceived by the user as originating from a specific depth plane, the method according to item 34. (Item 37) A system for displaying virtual content to a user, A light source for multiplexing one or more light patterns associated with one or more frames of image data in a time-series manner, An array of reflectors for receiving the one or more light patterns, the array of reflectors being oriented at a specific angle, A plurality of optical elements coupled to the array of reflectors for variably directing the light pattern towards an exit pupil, A system comprising the above. (Item 38) The system according to item 37, wherein the array of reflectors is separate from the optical elements. (Item 39) The system according to item 38, wherein the array of reflectors comprises plane mirrors. (Item 40) The system according to item 38, wherein the optical elements are microlenses coupled to the array of reflectors. (Item 41) The system according to item 37, wherein one or more reflectors of the array of reflectors are curved. (Item 42) The system according to item 37, wherein the optical elements are integrated into the array of reflectors. (Item 43) The system according to item 42, wherein the reflector is a parabolic reflector. (Item 44) The system according to item 42, wherein the reflector is an elliptical reflector. (Item 45) The system according to item 42, wherein the plurality of optical elements enlarge the exit pupil. (Item 46) The system according to item 37, further comprising a first lens for steering a collection of light rays through a nodal point towards the user's eye, the first lens being configured to be installed on the substrate and between the first reflector and the eye such that the collection of light rays exiting the reflector passes through the first lens before reaching the user's eye. (Item 47) The system according to item 46, further comprising a second lens for compensating the refractive power of the first lens, wherein the second lens can be configured to be installed on the substrate and on the side opposite to the side where the first lens is installed so that a user can visually recognize a substantially distortion-free view of the outside world through the lens stack. (Item 48) The system according to item 37, wherein the plurality of reflectors comprise wavelength-selective reflectors. (Item 49) The system according to item 37, wherein the plurality of reflectors comprise semi-transparent mirrors. (Item 50) The system according to item 37, wherein the plurality of optical elements comprise refractive lenses. (Item 51) The system according to item 37, wherein the plurality of optical elements comprise diffractive lenses. (Item 52) The system according to item 41, wherein the curved reflector comprises a wavelength-selective notch filter. (Item 53) A method for displaying virtual content to a user, comprising: providing one or more frames of image data and one or more optical patterns associated therewith in a time-series manner; reflecting one or more frames of the image data and one or more optical patterns associated therewith to an exit pupil via a transmissive beam splitter, the transmissive beam splitter having a plurality of reflectors and variably directing light toward the exit pupil; enlarging the exit pupil through a plurality of optical elements coupled to the plurality of reflectors of the transmissive beam splitter; The method including the above steps. (Item 54) The method according to item 53, wherein the array of reflectors is separate from the optical elements. (Item 55) The method according to item 53, wherein the array of reflectors comprises plane mirrors. (Item 56) The method according to item 53, wherein the optical element is a microlens coupled to the array of reflectors. (Item 57) The method according to item 53, wherein one or more reflectors of the array of reflectors are curved. (Item 58) The method according to item 53, wherein the optical element is integrated into the array of reflectors. (Item 59) The method according to item 58, wherein the reflector is a parabolic reflector. (Item 60) The method according to item 58, wherein the reflector is an elliptical reflector. (Item 61) The method according to item 53, further comprising a first lens for steering a set of light rays through a nodal point to the user's eye, wherein the first lens is configured to be installed on the substrate and between the first reflector and the eye such that the set of light rays emerging from the reflector passes through the first lens before reaching the user's eye. (Item 62) The method according to item 61, further comprising a second lens for compensating the refractive power of the first lens, wherein the second lens is configured to be installed on the substrate on the side opposite to the side where the first lens is installed such that a user can visually recognize a substantially distortion-free view of the external world through the lens stack. (Item 63) The method according to item 53, wherein the plurality of reflectors comprise wavelength-selective reflectors. (Item 64) The method according to item 53, wherein the plurality of reflectors comprise semi-transparent mirrors. (Item 65) The method according to item 53, wherein the plurality of optical elements comprise refractive lenses. (Item 66) The method according to item 53, wherein the plurality of optical elements comprise diffractive lenses. (Item 67) The method according to item 57, wherein the curved reflector comprises a wavelength-selective notch filter. (Item 68) A system for displaying virtual content to a user, a light source for multiplexing one or more frames of image data and one or more optical patterns associated therewith in a time-series manner, an optical waveguide for receiving the one or more optical patterns at a first focal level, a variable focusing element (VFE) coupled to the optical waveguide for bringing at least a portion of the optical pattern to a second focal level, A system comprising: (Item 69) The system according to item 68, wherein the VFE does not substantially change the image magnification while adjusting the focal level. (Item 70) The system according to item 68, wherein the VFE does not change the image magnification while adjusting the focal level. (Item 71) The system according to item 68, further comprising a second VFE for adjusting the wavefront of light from the outside world so that the user's view of the outside world is not substantially distorted as the first VFE varies the focus of the optical pattern. (Item 72) A plurality of frames are presented to the user at a high frequency such that the user perceives the frames as part of a single coherent scene, and the VFE varies the focus from a first frame to a second frame. The system according to item 68. (Item 73) The system according to item 68, wherein the light source is a scanning light display, and the VFE varies the focus in a per-row manner. (Item 74) The system according to item 68, wherein the light source is a scanning light display, and the VFE varies the focus in a per-pixel manner. (Item 75) The system according to item 68, wherein the VFE is a diffractive lens. (Item 76) The system according to item 68, wherein the VFE is a refractive lens. (Item 77) The VFE is the system according to item 68, which is a mirror. (Item 78) The mirror is the system according to item 77, which is opaque. (Item 79) The mirror is the system according to item 77, which is partially reflective. (Item 80) The system according to item 68, further comprising a focusing adjustment module for tracking the focusing adjustment of the user's eyes, and the VFE variably focuses the light pattern at least partially based on the focusing adjustment of the user's eyes. (Item 81) A system for displaying virtual content to a user, a light source for multiplexing one or more light patterns associated with one or more frames of image data in a time-series manner, an optical waveguide for receiving the one or more light patterns and directing the light pattern to a first focal point, a variable focusing element (VFE) coupled to the optical waveguide for directing at least a portion of the light pattern to a second focal point, the VFE being integrated into the optical waveguide, A system comprising. (Item 82) The VFE is the system according to item 81, which is telecentric. (Item 83) The VFE is the system according to item 81, which is non-telecentric. (Item 84) The system according to item 81, further comprising a compensation lens so that the user's view of the external world is not distorted. (Item 85) A plurality of frames are presented to the user at a high frequency such that the user perceives the frames as part of a single coherent scene, and the VFE varies the focus from a first frame to a second frame. The system according to item 81. (Item 86) The light source is a scanning light display, and the VFE varies the focus in a per-line mode. The system according to item 81. (Item 87) The light source is a scanning light display, and the VFE varies the focus in a per-pixel mode. The system according to item 81. (Item 88) The VFE is a diffractive lens. The system according to item 81. (Item 89) The VFE is a refractive lens. The system according to item 81. (Item 90) The VFE is a mirror. The system according to item 81. (Item 91) The mirror is opaque. The system according to item 90. (Item 92) The mirror is partially reflective. The system according to item 90. (Item 93) The system further includes a focusing adjustment module for tracking the focusing adjustment of the user's eye, and the VFE varies the focus of the light pattern at least partially based on the focusing adjustment of the user's eye. The system according to item 81. (Item 94) A system for displaying virtual content to a user, A light source for multiplexing one or more light patterns associated with one or more frames of image data in a time-series manner, An optical waveguide that receives the one or more light patterns and directs the light pattern to a first focus, A variable focusing element (VFE) coupled to the optical waveguide for directing at least a portion of the light pattern to a second focus, the VFE being separate from the optical waveguide, Comprising a system. (Item 95) The VFE is telecentric. The system according to item 94. (Item 96) The system according to item 94, wherein the VFE is non - telecentric. (Item 97) The system according to item 94, further comprising a compensation lens so that the user's view of the external world is not distorted. (Item 98) The system according to item 94, wherein a plurality of frames are presented to the user at a high frequency so that the user perceives the frame as part of a single coherent scene, and the VFE varies the focus from a first frame to a second frame. (Item 99) The system according to item 94, wherein the light source is a scanning light display, and the VFE varies the focus in a line - by - line manner. (Item 100) The system according to item 94, wherein the light source is a scanning light display, and the VFE varies the focus in a pixel - by - pixel manner. (Item 101) The system according to item 94, wherein the VFE is a diffractive lens. (Item 102) The system according to item 94, wherein the VFE is a refractive lens. (Item 103) The system according to item 94, wherein the VFE is a mirror. (Item 104) The system according to item 103, wherein the mirror is opaque. (Item 105) The system according to item 103, wherein the mirror is partially reflective. (Item 106) The system according to item 94, further comprising a focusing adjustment module for tracking the focusing adjustment of the user's eyes, and the VFE varies the focus of the light pattern at least partially based on the focusing adjustment of the user's eyes. (Item 107) A method for displaying virtual content to a user, providing one or more optical patterns associated with one or more frames of image data; converging one or more optical patterns associated with one or more frames of the image data to a first focus through an optical waveguide; modifying the first focus of the light through a variable focusing element (VFE) to generate a wavefront at a second focus; A method comprising: (Item 108) The method according to item 107, wherein the VFE is separate from the optical waveguide. (Item 109) The method according to item 107, wherein the VFE is integrated into the optical waveguide. (Item 110) The method according to item 107, wherein the one or more frames of the image data are provided in a time series format. (Item 111) The method according to item 110, wherein the VFE modifies the focus of one or more frames of the image data on a per-frame basis. (Item 112) The method according to item 110, wherein the VFE modifies the focus of one or more frames of the image data on a per-pixel basis. (Item 113) The method according to item 107, wherein the VFE modifies the first focus to generate a wavefront at a third focus, and the second focus is different from the third focus. (Item 114) The method according to item 107, wherein the wavefront at the second focus is perceived by the user as originating from a specific depth plane. (Item 115) The method according to item 107, wherein the VFE is telecentric. (Item 116) The method according to item 107, wherein the VFE is non-telecentric. (Item 117) The method according to item 107, further comprising a compensation lens so that the view of the user's external world is not distorted. (Item 118) The method according to item 107, wherein a plurality of frames are presented to the user at a high frequency such that the user perceives the frames as part of a single coherent scene, and the VFE varies the focus from a first frame to a second frame. (Item 119) The method according to item 107, wherein the light source is a scanning light display, and the VFE varies the focus in a line-by-line manner. (Item 120) The method according to item 107, wherein the VFE is a diffractive lens. (Item 121) The method according to item 107, wherein the VFE is a refractive lens. (Item 122) The method according to item 107, wherein the VFE is a mirror. (Item 123) The method according to item 107, wherein the mirror is opaque. (Item 123) The method according to item 107, wherein the mirror is partially reflective. (Item 124) The method according to item 107, further comprising a focusing adjustment module for tracking the focusing adjustment of the user's eyes, and the VFE varies the focus of the light pattern at least partially based on the focusing adjustment of the user's eyes. (Item 125) A system for displaying virtual content to a user, a plurality of waveguides for receiving light rays associated with image data and transmitting the light rays towards the user's eyes, the plurality of waveguides being stacked in a direction facing the user's eyes; a first lens coupled to a first waveguide of the plurality of waveguides and modifying the light rays transmitted from the first waveguide, thereby delivering light rays having a first wavefront curvature; A second lens coupled to a second waveguide of the plurality of waveguides, modifying a light beam transmitted from the second waveguide, thereby delivering a light beam having a second wavefront curvature, wherein the first lens coupled to the first waveguide and the second lens coupled to the second waveguide are horizontally stacked in a direction facing the user's eye; A system comprising. (Item 126) The system according to item 125, wherein the first wavefront curvature is different from the second wavefront curvature. (Item 127) The system according to item 125, further comprising a third waveguide of the plurality of waveguides for delivering collimated light to the user's eye such that the user perceives the image data as originating from an optically infinite plane. (Item 128) The system according to item 125, wherein the waveguide is configured to transmit collimated light to the lens. (Item 129) The system according to item 125, further comprising a compensating lens layer for compensating for the converging refractive power of the lenses stacked in a direction facing the user's eye, the compensating lens layer being stacked farthest from the user's eye. (Item 130) The system according to item 125, wherein the waveguide comprises a plurality of reflectors configured to reflect a light beam incident into the waveguide towards the user's eye. (Item 131) The system according to item 125, wherein the waveguide is electroactive. (Item 132) The system according to item 125, wherein the waveguide is switchable. (Item 133) The system according to item 125, wherein the light beam having the first wavefront curvature and the light beam having the second wavefront curvature are delivered simultaneously. (Item 134) The system according to item 125, wherein the light rays having the first wavefront curvature and the light rays having the second wavefront curvature are sequentially delivered. (Item 135) The system according to item 133, wherein the second wavefront curvature corresponds to the boundary of the first wavefront curvature, thereby providing a focal length that allows the user to perform focusing adjustment. (Item 136) The method according to item 125, further comprising a focusing adjustment module for tracking the focusing adjustment of the user's eye, wherein the VFE varies the focus of the light pattern at least partially based on the focusing adjustment of the user's eye. (Item 137) A system for displaying virtual content to a user, a light source for multiplexing one or more light patterns associated with one or more frames of image data, a plurality of waveguides for receiving the one or more light patterns and directing the light toward the exit pupil, the plurality of waveguides being stacked along the Z-axis, at least one optical element for correcting the focus of the light transmitted by the plurality of waveguides, comprising: a system. (Item 138) The system according to item 137, wherein the waveguides of the plurality of waveguides comprise waveguides for distributing the projected light across the length of the waveguide and optical elements for modifying the light in such a way that a wavefront curvature is created, the created wavefront curvature corresponding to the focal plane when viewed by the user. (Item 139) The system according to item 137, wherein the waveguides of the plurality of waveguides comprise diffractive optical elements (DOEs). (Item 140) The system according to item 137, wherein the DOE is switchable between an on state and an off state. (Item 141) The system according to item 137, wherein the at least one optical element comprises a refractive lens. (Item 142) The system according to item 137, wherein the at least one optical element comprises a Fresnel zone plate. (Item 143) The system according to item 137, wherein the waveguides of the plurality of waveguides comprise waveguide elements. (Item 144) The system according to item 143, wherein the waveguide is switchable between an on state and an off state. (Item 145) The system according to item 137, wherein the waveguide is static. (Item 146) The system according to item 137, wherein the first frame of the image data and the second frame of the image data are delivered to the user's eyes simultaneously. (Item 147) The system according to item 137, wherein the first frame of the image data and the second frame of the image data are delivered to the user's eyes sequentially. (Item 148) The system according to item 137, further comprising a plurality of angled reflectors for delivering light to the user's eyes, wherein the first waveguide component and the second waveguide component direct light to the one or more angled reflectors. (Item 149) The system according to item 137, further comprising beam distribution waveguide optics, wherein the beam distribution waveguide is coupled to the waveguide assembly, and the beam distribution waveguide optics is configured to spread the projected light across the waveguide assembly such that light rays input into the beam distribution waveguide optics are cloned and input into the waveguide components of the waveguide assembly. (Item 150) A system for displaying virtual content to a user, an image source for providing one or more frames of image data in a time series manner, A light modulator for projecting light associated with one or more frames of the image data A waveguide assembly for receiving the projected light and delivering the light towards the user's eye, the waveguide assembly being configurable to modify the light associated with a first frame of the image data such that the light is perceived as originating from a first focal plane, and a second waveguide component configurable to modify the light associated with a second frame of the image data such that the light is perceived as originating from a second focal plane, the first waveguide component and the second waveguide component being stacked along the Z-axis in front of the user's eye, the waveguide assembly A system comprising (Item 151) The waveguide components of the waveguide assembly comprise a waveguide for distributing the projected light across the length of the waveguide and a lens for modifying the light in such a way that a wavefront curvature is created, the created wavefront curvature corresponding to the focal plane when viewed by the user. The system according to item 150 (Item 152) The waveguide components of the waveguide assembly comprise a diffractive optical element (DOE). The system according to item 150 (Item 153) The DOE is switchable between an on state and an off state. The system according to item 150 (Item 154) The waveguide components of the waveguide assembly comprise refractive lenses. The system according to item 150 (Item 155) The waveguide components of the waveguide assembly comprise a Fresnel zone plate. The system according to item 150 (Item 156) The waveguide components of the waveguide assembly comprise a substrate guided optics (SGO) element. The system according to item 150 (Item 157) The waveguide of the system according to item 150 is switchable between an on state and an off state. (Item 158) The waveguide of the system according to item 150 is static. (Item 159) In the system according to item 150, the first frame of the image data and the second frame of the image data are delivered to the user's eyes simultaneously. (Item 160) In the system according to item 150, the first frame of the image data and the second frame of the image data are delivered to the user's eyes sequentially. (Item 161) The system according to item 150 further comprises a plurality of angled reflectors for delivering light to the user's eyes, and the first waveguide component and the second waveguide component direct light to the one or more angled reflectors. (Item 162) The system according to item 150 further comprises beam distribution waveguide optics, the beam distribution waveguide is coupled to the waveguide assembly, and the beam distribution waveguide optics is configured to diffuse the projected light across the waveguide assembly such that light rays input into the beam distribution waveguide optics are cloned and input into the waveguide components of the waveguide assembly. (Item 163) The waveguide component of the waveguide assembly of the system according to item 150 comprises a reflector that is configurable to reflect the projected light towards the user's eyes at a desired angle. (Item 164) The system according to item 150 comprises a first reflector, in which the first waveguide component is configured to reflect the projected light at a first angle, and a second reflector, in which the second waveguide component is configured to reflect the projected light at a second angle. (Item 165) The system according to item 150, wherein the first reflector is alternated with respect to the second reflector, thereby expanding the viewing field of the image as viewed by the user. (Item 166) The system according to item 150, wherein the reflector of the waveguide component is positioned in such a manner as to form a continuous curved reflecting surface across the waveguide assembly. (Item 167) The system according to item 166, wherein the continuous curved reflecting surface comprises a parabola. (Item 168) The system according to item 166, wherein the continuous curved reflecting surface comprises an ellipse. (Item 169) A method for displaying virtual content to a user, comprising: delivering, through a first waveguide, a light ray associated with a first frame of image data to the user, the light ray having a first wavefront curvature; delivering, through a second waveguide, a light ray associated with a second frame of the image data to the user, the light ray having a second wavefront curvature, and the first waveguide and the second waveguide being stacked along the Z-axis facing the user's eyes; The method as described above. (Item 170) The method according to item 169, wherein the first wavefront curvature and the second wavefront curvature are delivered simultaneously. (Item 171) The method according to item 169, wherein the first wavefront curvature and the second wavefront curvature are delivered sequentially. (Item 172) The method according to item 169, wherein the first and second wavefront curvatures are perceived by the user as first and second depth planes. (Item 173) The method according to item 169, wherein the first and second waveguides are coupled to one or more optical elements. (Item 174) The method according to item 172, further comprising the step of compensating for the effect of the one or more optical elements through a compensating lens. (Item 175) The step of determining the near and far accommodation of the user's eye, and The step of delivering light rays through at least one of the first and second waveguides, at least in part based on the determined near and far accommodation. The method according to item 169, further comprising. (Item 175) A method for displaying virtual content to a user, comprising: The step of determining the near and far accommodation of the user's eye, and The step of delivering light rays having a first wavefront curvature through a first waveguide of a stack of waveguides, at least in part based on the determined near and far accommodation, wherein the first wavefront curvature corresponds to the focal length of the determined near and far accommodation. The step of delivering light rays having a second wavefront curvature through a second waveguide of the stack of waveguides, wherein the second wavefront curvature is associated with a predetermined boundary of the focal length of the determined near and far accommodation. A method comprising. (Item 176) The method according to item 175, wherein the boundary is a positive boundary. (Item 177) The method according to item 175, wherein the boundary is a negative boundary. (Item 178) The method according to item 175, wherein the second waveguide increases the focal length that the user can accommodate near and far. (Item 179) The method according to item 175, wherein the first waveguide is coupled to a variable focusing element (VFE), and the VFE varies the focal point at which the waveguide focuses the light rays. (Item 180) The method according to item 179, wherein the focal point is varied at least in part based on the determined near and far accommodation of the user's eye. (Item 182) The method according to item 175, wherein the first wavefront curvature and the second wavefront curvature are delivered simultaneously. (Item 183) The method according to item 175, wherein the first and second wavefront curvatures are perceived by the user as first and second depth planes. (Item 184) The method according to item 175, wherein the waveguide is a diffractive optical element (DOE). (Item 185) The method according to item 175, wherein the waveguide is a substrate-guided optics (SGO). (Item 186) The method according to item 175, wherein the first and second waveguides are switchable. (Item 187) The method according to item 175, wherein the waveguide comprises one or more switchable elements. (Item 189) A system for displaying virtual content to a user, comprising: An image source for providing one or more frames of image data in a time series format; A display assembly for projecting light rays associated with one or more frames of the image data, the display assembly comprising a first display element corresponding to a first frame rate and a first bit depth, and a second display element corresponding to a second frame rate and a second bit depth; A variable focus element (VFE) configured to vary the focus of the projected light and transmit the light to the user's eyes; The system comprising. (Item 190) The system according to item 189, wherein the first frame rate is higher than the second frame rate and the first bit depth is lower than the second bit depth. (Item 191) The system according to item 189, wherein the first display element is a DLP projection system. (Item 192) The system according to item 189, wherein the second display element is a liquid crystal display (LCD). (Item 193) The system according to item 189, wherein the first display element projects light onto a subset of the second display element such that the periphery of the LCD has uniform illumination. (Item 194) The system according to item 193, wherein only the light transmitted from the first display element is focused through the VFE. (Item 195) The system according to item 189, wherein the VFE is optically conjugated to the exit pupil such that the focus of the projected light is varied without affecting the magnification of the image data. (Item 196) The system according to item 189, wherein the first display element is a DLP, the second display element is an LCD, the DLP has low resolution, and the LCD has high resolution. (Item 197) The system according to item 189, wherein the intensity of the backlight is varied over time to equalize the luminance of the sub-images projected by the first display element, thereby increasing the frame rate of the first display element. (Item 198) The system according to item 189, wherein the VFE is configurable to vary the focus of the projected light on a per-frame basis. (Item 199) The system according to item 189, further comprising software for compensating for the optical magnification associated with the operation of the VFE. (Item 200) The system according to item 189, wherein the image light sources, when projected together or sequentially, generate slices of a specific image that generate an object of a three-dimensional volume. (Item 201) The system according to item 189, wherein the DLP operates in binary mode. (Item 202) The DLP is the system according to item 189, which operates in a grayscale mode. (Item 203) The VFE is the system according to item 189, which varies the projected light such that a first frame is perceived to originate from a first focal plane and a second frame is perceived to originate from a second focal plane, and the first focal plane is different from the second focal plane. (Item 204) The focal length associated with the focal plane is fixed, for the system according to item 189. (Item 205) The focal length associated with the focal plane is variable, for the system according to item 189. (Item 206) A method for displaying virtual content to a user, comprising: providing one or more image slices, wherein a first and a second image slice of the one or more image slices represent a three-dimensional volume; projecting light associated with the first image slice through a spatial light modulator; focusing the first image slice to a first focus through a variable focusing element (VFE); delivering the first image slice having the first focus to the user; providing light associated with the second image slice; focusing the second image slice to a second focus through the VFE, wherein the first focus is different from the second focus; delivering the second image slice having the second focus to the user; A method comprising the above steps. (Item 207) The method according to item 206, further comprising determining a near / far adjustment of the user's eye, and the VFE at least partially focuses the projected light based on the determined near / far adjustment. (Item 208) The image slice is provided in a frame sequential manner, the method according to item 206. (Item 209) The first image slice and the second image slice are delivered simultaneously, the method according to item 206. (Item 210) The first image slice and the second image slice are delivered sequentially, the method according to item 206. (Item 211) A method for displaying virtual content to a user, Combining a first display element and a second display element, wherein the first display element corresponds to a high frame rate and a low bit depth, and the second display element corresponds to a low frame rate and a high bit depth, such that the combined display element corresponds to a high frame rate and a high bit depth; Projecting light associated with one or more frames of image data through the combined display element; Switching the focus of the projected light through a variable focus element (VFE) on a per-frame basis such that a first image slice is projected at a first focus and a second image slice is projected at a second focus; A method comprising. (Item 212) The first display element is a DLP, the method according to item 211. (Item 213) The second display element is an LCD, the method according to item 211. (Item 214) The first display element selectively illuminates a portion of the second display element, the method according to item 211. (Item 215) The VFE is a deformable membrane mirror, the method according to item 211. (Item 216) The VFE is optically conjugated to the exit pupil, the method according to item 211. (Item 217) The VFE is the method according to item 211 that is not optically conjugated to the exit pupil. (Item 218) The first and second image slices are the method according to item 211 that represent a three-dimensional virtual object. (Item 219) The DLP is the method according to item 212 that operates in binary mode. (Item 220) The DLP is the method according to item 212 that operates in grayscale mode. (Item 221) The grayscale is the method according to item 220 that gives the user's brain the perception that something exists adjacent to two depth planes. (Item 222) The display elements are the method according to item 211 that are combined for image modulation. (Item 223) The display elements are the method according to item 211 that are combined to create a high dynamic range display. (Item 224) The VFE is the method according to item 211 that switches focus between a predetermined number of fixed depth planes. (Item 225) Further including the step of determining the accommodation of the user's eyes, and the VFE is the method according to item 211 that switches focus at least partially based on the determined accommodation. (Item 226) A system for displaying virtual content to a user, A plurality of optical guides that receive coherent light associated with one or more frames of image data and generate a converging wavefront, A phase modulator coupled to one or more of the plurality of optical guides to induce a phase delay in the light projected by the one or more optical guides, A processor for controlling the phase modulator in such a manner that the converging wavefront generated by the plurality of optical guides is varied. A system comprising (Item 227) The system according to item 226, wherein the wavefront generated by the optical guides of the plurality of optical guides is a spherical wavefront. (Item 228) The system according to item 227, wherein the spherical wavefronts generated by at least two optical guides interfere constructively with each other. (Item 229) The system according to item 227, wherein the spherical wavefronts generated by the at least two optical guides interfere destructively with each other. (Item 230) The system according to item 226, wherein the converging wavefront is a substantially planar wavefront. (Item 231) The system according to item 230, wherein the planar wavefront corresponds to an optically infinite depth plane. (Item 232) The system according to item 226, wherein the converging wavefront is spherical. (Item 233) The system according to item 232, wherein the spherical wavefront corresponds to a depth plane closer than optically infinite. (Item 235) The system according to item 232, wherein an inverse Fourier transform of a desired beam is input into the multi-core fiber so that a desired converging wavefront is generated. (Item 236) A system for displaying virtual content to a user, An image light source for providing one or more frames of image data, A multi-core assembly comprising a plurality of multi-core fibers for projecting light associated with one or more frames of the image data, wherein the multi-core fibers of the plurality of multi-core fibers emit light to a wavefront such that the multi-core assembly generates a converging wavefront of the projected light; a multi-core assembly, A phase modulator for inducing a phase delay between the multi-core fibers in such a manner that the converging wavefront emitted by the multi-core assembly is varied, thereby varying the focal distance at which the user perceives one or more than one frame of the image data. A system comprising. (Item 237) The system according to item 236, wherein an inverse Fourier transform of a desired beam is input into the multi-core fiber so that a desired converging wavefront is generated. (Item 238) A method for displaying virtual content to a user, comprising: Emitting light through a multi-core fiber, the multi-core fiber comprising a plurality of single-core fibers, the single-core fibers emitting spherical wavefronts; Providing a converging wavefront from the light emitted from the plurality of single-core fibers; Inducing a phase delay between the single-core fibers of the multi-core fiber such that the converging wavefront generated by the multi-core fiber is varied, at least in part, based on the induced phase delay; A method comprising. (Item 239) The method according to item 238, wherein the converging wavefront is a plane wavefront. (Item 240) The method according to item 239, wherein the plane wavefront corresponds to optical infinity. (Item 241) The method according to item 238, wherein the converging wavefront is spherical. (Item 242) The method according to item 241, wherein the spherical wavefront corresponds to a depth plane closer than optical infinity. (Item 243) The method according to item 238, further comprising inputting an inverse Fourier transform of a desired wavefront into the multi-core fiber such that the converging wavefront corresponds to the desired wavefront. (Item 245) A system for displaying virtual content to a user, comprising: An image source for providing one or more frames of image data, A multi-core assembly comprising a plurality of multi-core fibers for projecting light associated with one or more frames of the image data, An image input for inputting an image into the multi-core assembly, wherein the multi-core assembly outputs the Fourier transform by generating light associated with the image data into the desired wavefront, thereby enabling the user to perceive the image data at a desired focal length, and is further configurable to input an inverse Fourier transform of the desired wavefront into the multi-core assembly, an input device, A system comprising. (Item 246) The system according to item 245, wherein the desired wavefront is associated with a hologram. (Item 247) The system according to item 245, wherein the inverse Fourier transform is an input for modulating the focus of the one or more light beams. (Item 248) The system according to item 245, wherein the multi-core fibers of the plurality of multi-core fibers are multi-mode fibers. (Item 249) The system according to item 245, wherein the multi-core fibers of the plurality of multi-core fibers are configured to propagate light along a plurality of paths along the fiber. (Item 250) The system according to item 245, wherein the multi-core fiber is a single-core fiber. (Item 251) The system according to item 245, wherein the multi-core fiber is a concentric-core fiber. (Item 252) The system according to item 245, wherein the image input is configured to input a wavelet pattern into the multi-core assembly. (Item 253) The image injector is configured to input Zernike coefficients into the multi-core assembly, the system according to item 245. (Item 254) The system according to item 245, further comprising a focus adjustment tracking module for determining the focus adjustment of the user's eyes, wherein the image injector is configured to input an inverse Fourier transform of a wavefront corresponding to the determined focus adjustment of the user's eyes. (Item 255) A method for displaying virtual content to a user, comprising the step of determining the focus adjustment of the user's eyes, wherein the determined focus adjustment is associated with a focal length corresponding to the current state of the user's focus, projecting light associated with one or more frames of image data through a waveguide, varying the focus of the projected light based at least in part on the determined focus adjustment, delivering the projected light to the user's eyes, and a method. (Item 256) The method according to item 255, wherein the focus adjustment is directly measured. (Item 257) The method according to item 255, wherein the focus adjustment is indirectly measured. (Item 258) The method according to item 256, wherein the focus adjustment is measured through an infrared autorefractor. (Item 259) The method according to item 256, wherein the focus adjustment is measured through eccentric photorefraction. (Item 260) The method according to item 257, further comprising the step of measuring the convergence level of both eyes of the user and estimating the focus adjustment. (Item 261) The method according to item 255, further comprising the step of blurring one or more frames of the image data or a portion thereof that is more than one, at least in part, based on the determined focusing adjustment. (Item 262) The method according to item 255, wherein the focus is varied between fixed depth planes. (Item 263) The method according to item 255, further comprising a compensating lens for compensating for the optical effect of the waveguide so that the external environment is perceived at zero magnification. (Item 264) A method for displaying virtual content to a user, comprising: determining the focusing adjustment of the user's eyes, wherein the determined focusing adjustment is associated with a focal length corresponding to the current state of the user's focus; projecting light associated with one or more frames of image data through a diffractive optical element (DOE); varying the focus of the projected light, at least in part, based on the determined focusing adjustment; delivering the projected light to the user's eyes; and. (Item 265) The method according to item 264, wherein the focusing adjustment is directly measured. (Item 266) The method according to item 264, wherein the focusing adjustment is indirectly measured. (Item 267) The method according to item 265, wherein the focusing adjustment is measured through an infrared autorefractor. (Item 268) The method according to item 265, wherein the focusing adjustment is measured through eccentric photorefraction. (Item 269) The method according to item 266, further comprising measuring the convergence level of both eyes of the user and estimating the focusing adjustment. (Item 270) The method according to item 264, further comprising the step of blurring one or more frames of the image data or a portion thereof that is greater than one, at least in part, based on the determined focusing adjustment. (Item 271) The method according to item 264, wherein the focus is varied between fixed depth planes. (Item 272) The method according to item 264, further comprising a compensating lens for compensating for the optical effect of the DOE so that the external environment is perceived at zero magnification. (Item 273) A method for displaying virtual content to a user, comprising: determining the focusing adjustment of the user's eyes, wherein the determined focusing adjustment is associated with a focal length corresponding to the current state of the user's focus; projecting light associated with one or more frames of image data through freeform optics; varying the focus of the projected light, at least in part, based on the determined focusing adjustment; delivering the projected light to the user's eyes; and a method. (Item 274) The method according to item 273, wherein the focusing adjustment is measured directly. (Item 275) The method according to item 273, wherein the focusing adjustment is measured indirectly. (Item 275) The method according to item 274, wherein the focusing adjustment is measured through an infrared autorefractor. (Item 276) The method according to item 274, wherein the focusing adjustment is measured through eccentric photorefraction. (Item 277) The method according to item 275, further comprising measuring the convergence level of both eyes of the user and estimating the focusing adjustment. (Item 278) The method according to item 273, further comprising the step of blurring one or more frames of the image data or one or more portions thereof, at least in part, based on the determined focusing adjustment. (Item 279) The method according to item 273, wherein the focus is varied between fixed depth planes. (Item 280) The method according to item 273, further comprising a compensation lens for compensating the optical effect of the freeform optics such that the external environment is perceived at zero magnification. (Item 281) A method for displaying virtual content to a user, comprising the step of determining the focusing adjustment of the user's eyes, wherein the determined focusing adjustment is associated with a focal length corresponding to the current state of the user's focus, the step of projecting light associated with one or more frames of image data, the step of varying the focus of the projected light, at least in part, based on the determined focusing adjustment, the step of delivering the projected light to the user's eyes such that the light is perceived by the user as originating from a focal length corresponding to the current state of the user's focus, and comprising. (Item 282) The method according to item 281, wherein the light is delivered to the user through a substrate waveguide optical assembly. (Item 283) The method according to item 281, wherein the light is delivered to the user through a freeform optical element. (Item 284) The method according to item 281, wherein the light is delivered to the user through a diffractive optical element (DOE). (Item 285) The light is projected through a stack of waveguides, wherein a first waveguide of the stack of waveguides outputs light with a specific wavefront, a second waveguide outputs a positive boundary wavefront with respect to the specific wavefront, and a third waveguide is configured to output a negative boundary wavefront with respect to the specific wavefront, the method according to item 281. (Item 286) The method according to item 281, further comprising the step of blurring one or more frames of the image data in a manner such that the portion is out of focus when the projected light is delivered to the user's eye. (Item 287) A system for displaying virtual content to a user, an image source for providing one or more frames of image data in a time-series manner, a light generator for providing light associated with one or more frames of the image data, a focus adjustment tracking module for tracking the focus adjustment of the user's eye, a waveguide assembly for varying the focus of light associated with one or more frames of the image data, wherein different frames of the image data are focused differently, at least in part, based on the tracked focus adjustment, the waveguide assembly, comprising a system. (Item 288) A system for displaying virtual content to a user, a focus adjustment tracking module for determining the focus adjustment of the user's eye, an image source for providing one or more frames of image data in a time-series manner, a light generator for projecting light associated with one or more frames of the image data, a plurality of waveguides for receiving light rays associated with the image data and transmitting the light rays towards the user's eye, the plurality of waveguides being stacked in a direction facing the user's eye, At least partially, a variable focusing element (VFE) for varying the focus of the transmitted light based on the determined focusing adjustment of the user's eyes, A system comprising. (Item 289) The waveguides of the plurality of waveguides are waveguide elements, and the focus of the first frame of image data transmitted from the first waveguide of the plurality of waveguides is different from the focus of the second frame of image data transmitted from the second waveguide of the plurality of waveguides. The system according to item 288. (Item 290) The first frame is the first layer of the 3D scene, and the second frame is the second layer of the 3D scene. The system according to item 288. (Item 291) The system according to item 288, further comprising a blurring module for blurring a part of one or more frames of the image data in such a manner that the part goes out of focus when viewed by the user. (Item 292) The VFE is common to the plurality of waveguides. The system according to item 288. (Item 293) The VFE is associated with the waveguides of the plurality of waveguides. The system according to item 288. (Item 294) The VFE is coupled to the waveguides of the plurality of waveguides such that the VFE is interleaved between two waveguides of the plurality of waveguides. The system according to item 288. (Item 295) The VFE is embedded in the waveguides of the plurality of waveguides. The system according to item 288. (Item 296) The VFE is a diffractive optical element. The system according to item 288. (Item 297) The VFE is a refractive element. The system according to item 288. (Item 298) The VFE is a reflective element. The system according to item 288. (Item 299) The waveguide is the system according to item 288 that is electroactive. (Item 300) One or more of the waveguides of the plurality of waveguides are switchable off, the system according to item 288. (Item 301) The waveguides of the plurality of waveguides correspond to a fixed focal plane, the system according to item 288. (Item 302) Further comprising an exit pupil, the diameter of the exit pupil being only 0.5 mm, the system according to item 288. (Item 303) The light generator is a scanning fiber display, the system according to item 288. (Item 304) The system according to item 302, further comprising an array of exit pupils. (Item 305) The system according to item 302, further comprising a plurality of light generators, the light generators being coupled to the exit pupil. (Item 306) The system according to item 288, further comprising an exit pupil expander. (Item 307) The exit pupil is switchable, at least in part, based on the determined focusing adjustment of the user's eye, the system according to item 302. (Item 308) A system comprising: A focusing adjustment tracking module for determining the focusing adjustment of the user's eye; A fiber scanning display for scanning a plurality of light beams associated with one or more frames of image data, the light beams of the plurality of light beams being movable; Blurring software for rendering simulated optical refractive blur into one or more frames of the image data, at least in part, based on the determined focusing adjustment of the user's eye; And the system. (Item 309) The system according to item 308, wherein the diameter of the light beam is only 2 mm. (Item 310) The system according to item 308, wherein the diameter of the light beam is only 0.5 mm. (Item 311) The system according to item 308, wherein the scanning light beam is replicated to create a plurality of exit pupils. (Item 312) The system according to item 308, wherein the scanning light beam is replicated to create a larger eye box. (Item 313) The system according to item 311, wherein the exit pupil is switchable. (Item 314) A method for displaying virtual content, comprising: determining the near - far adjustment of the user's eye; scanning, through a fiber - optic scanning display, one or more frames of image data associated with a plurality of light beams, wherein the diameter of the light beam is only 0.5 mm such that when viewed by the user, the frames of the image data appear in focus; using blurring software to at least partially blur one or more portions of the frame based on the determined near - far adjustment of the user's eye; A method comprising the above. (Item 315) The method according to item 314, wherein a plurality of exit pupils are created. (Item 316) The method according to item 314, wherein the light beam is generated by a single - core fiber. (Item 317) The method according to item 314, wherein the light beam is replicated to create a plurality of exit pupils. (Item 318) The method according to item 317, wherein the exit pupil is switchable. (Item 319) A method for displaying virtual content to a user, comprising: A step of determining the position of the user's pupil with respect to the beam of the optical projector, wherein the beam of the optical projector corresponds to a sub-image of an image to be presented to the user, the step; A step of advancing light corresponding to the sub-image into a part of the user's pupil based on the determined position of the user's pupil; A method comprising: (Item 320) The method according to item 319, further comprising a step of advancing light corresponding to another sub-image of the image to be presented to another part of the user's pupil through another beam of the optical projector. (Item 321) The method according to item 319, further comprising a step of mapping one or more beams of the optical projector of the fiber scanning display and one or more parts of the user's pupil. (Item 322) The method according to item 321, wherein the mapping is a 1:1 mapping. (Item 323) The method according to item 319, wherein the diameter of the light is only 0.5 mm. (Item 324) The method according to item 319, wherein the beam of the optical projector generates a converging wavefront. (Item 325) The method according to item 319, wherein the beamlets generated by the optical projector form a discretized converging wavefront. (Item 326) When the beamlet approaches parallel to the user's eye, the eye deflects the beamlet and converges it to the same spot on the retina. The method according to item 325. (Item 327) The method according to item 319, wherein the user's eye receives a superior set of beamlets, and the beamlets correspond to a plurality of angles intersecting the pupil. (Item 328) A system for displaying virtual content to a user, A light source for providing light associated with one or more frames of image data, A light display assembly for receiving light associated with one or more frames of the image data, the light display assembly corresponding to a plurality of exit pupils spaced apart from each other, the plurality of exit pupils transmitting light into the pupil of the user, a light display assembly, A system comprising. (Item 329) The system according to item 328, wherein the plurality of exit pupils are arranged in a hexagonal lattice. (Item 330) The system according to item 328, wherein the plurality of exit pupils are arranged in a square lattice. (Item 331) The system according to item 328, wherein the plurality of exit pupils are arranged in a two-dimensional array. (Item 332) The system according to item 328, wherein the plurality of exit pupils are arranged in a three-dimensional array. (Item 333) The system according to item 328, wherein the plurality of exit pupils are arranged in a time-varying array. (Item 334) A method for displaying virtual content to a user, Grouping a plurality of light projectors to form exit pupils, Propelling a first light pattern through a first exit pupil into a first portion of the pupil of the user, Propelling a second light pattern through a second exit pupil into a second portion of the pupil of the user, wherein the first light pattern and the second light pattern correspond to sub-images of an image to be presented to the user, and the first light pattern is different from the second light pattern. A method comprising. (Item 335) The method according to item 334, wherein the plurality of light projectors are arranged in a hexagonal lattice. (Item 336) The method according to item 334, wherein the plurality of light projectors are arranged in a square lattice. (Item 337) The method according to item 334, wherein the plurality of light projectors are arranged in a two-dimensional array. (Item 338) The method according to item 334, wherein the plurality of light projectors are arranged in a three-dimensional array. (Item 339) The method according to item 334, wherein the plurality of light projectors are arranged in a time-varying array. (Item 340) The method according to item 334, wherein a first portion of the user's pupil receives light only from the first exit pupil, and a second portion of the user's pupil receives light only from the second exit pupil. (Item 341) The method according to item 334, further comprising the step of creating a discretized converging wavefront. (Item 342) A method for displaying virtual content to a user, comprising: determining the location of the user's pupil with respect to the light display assembly; calculating a focus for directing light to the pupil based at least in part on a limited eye box around the determined location of the pupil; and a method. (Item 343) The method according to item 342, wherein the diameter of the light is only 0.5 mm. (Item 344) The method according to item 342, further comprising the step of creating a discretized converging wavefront. (Item 345) The method according to item 344, further comprising the step of aggregating a plurality of discrete adjacent collimated light beams based at least in part on the center of the radius of curvature of the desired converging wavefront. (Item 346) The method according to item 344, further comprising the step of determining the accommodation of the user's eye, wherein the focus is calculated based at least in part on the determined accommodation. (Item 347) The method according to item 346, further comprising the step of selecting the angular trajectories of the light of a plurality of beamlets to create an out-of-focus light beam. (Item 348) The plurality of beamlets represent pixels of the image data to be presented to the user, according to the method of item 342. (Item 349) The beamlets impinge on the eye at a plurality of incident angles, according to the method of item 348. (Item 350) A system for displaying virtual content to a user, An image light source for providing one or more portions of an image to be presented to the user, A plurality of micro-projectors for projecting light associated with one or more portions of the image, the micro-projectors being positioned in a manner facing the user's pupil, the micro-projectors of the plurality of micro-projectors being configured to project a set of light rays representing a portion of the lower image, the set of light rays being projected onto a portion of the user's pupil, a plurality of micro-projectors; A system comprising: (Item 351) The first portion of the user's pupil receives light rays from a plurality of micro-projectors, according to the system of item 350. (Item 352) The system according to item 350, further comprising a reflective surface for reflecting light from the plurality of micro-projectors onto one or more portions of the user's pupil. (Item 353) The reflective surface is positioned in such a manner that the user can view the real world through the reflective surface, according to the system of item 350. (Item 354) The diameter of the light is only 0.5 mm, according to the system of item 350. (Item 355) The system according to item 350, further comprising the step of creating a discretized converging wavefront. (Item 356) The system according to item 350, further comprising a step of focusing a plurality of discrete adjacent collimated light beams, at least in part, based on the center of the radius of curvature of a desired converging wavefront. (Item 357) The system according to item 350, further comprising a step of determining the near - far adjustment of the user's eye, wherein the focus is calculated, at least in part, based on the determined near - far adjustment. (Item 358) The system according to item 350, which selects the angular trajectories of the light of a plurality of beamlets to create out - of - focus light beams. (Item 359) The system according to item 350, wherein the plurality of beamlets represent pixels of image data to be presented to the user. (Item 360) The system according to item 351, wherein the beamlets impinge on the eye at a plurality of incident angles. (Item 361) A system comprising: A processor for determining the location of the user's pupil; An array of spatial light modulators (SLMs) for projecting light associated with one or more frames of image data, the array of SLMs being positioned, at least in part, based on the determined location of the user's pupil and generating a bright field when viewed by the user; A system comprising the above. (Item 362) A system for displaying virtual content to a user, comprising: An image source for providing one or more frames of image data; A first spatial light modulator (SLM) configured to selectively transmit light rays associated with one or more frames of the image data; A second SLM positioned relative to the first SLM and similarly configured to selectively transmit light rays associated with one or more frames of the image data, the second SLM; A processor for controlling the first and second SLMs in such a manner that a bright field is created when the transmitted light rays are visually recognized by the user; A system comprising: (Item 363) The system according to item 361 or 362, further comprising a focus tracking module for determining the focus adjustment of the user's eyes. (Item 364) The system according to item 361 or 362, wherein the SLM is an LCD. (Item 365) The system according to item 361 or 362, wherein the LCD is attenuated. (Item 366) The system according to item 361 or 362, wherein the LCD rotates the polarization of the transmitted light. (Item 367) The system according to item 361 or 362, wherein the SLM is a DMD. (Item 368) The system according to item 362, wherein the DMD is coupled to one or more lenses. (Item 369) The system according to item 361 or 362, wherein the SLM is a MEM array. (Item 370) The system according to item 369, wherein the MEM array comprises an array of slide-type MEM shutters. (Item 371) The system according to item 369, wherein the MEM array is a Pixtronics(R) MEM array. (Item 372) A system for displaying virtual content to a user, A system comprising a plurality of optical fibers for projecting light associated with one or more frames of image data to be presented to the user, the optical fiber cores of the plurality of optical fiber cores being coupled to a lens, the lens being configured to modify the diameter of the light beam projected by the scanning fiber, the lens having a gradient refractive index. (Item 373) The system according to item 372, wherein the lens is a GRIN lens. (Item 374) The system according to item 372, wherein the lens collimates the light beam. (Item 375) The system according to item 372, further comprising an actuator coupled to the optical fiber cores of the plurality of optical fiber cores for scanning the fibers. (Item 376) The system according to item 375, wherein the actuator is a piezoelectric actuator. (Item 377) The system according to item 372, wherein the ends of the optical fiber cores are polished at an angle to create a lens effect. (Item 378) The system according to item 372, wherein the ends of the optical fiber cores are melted to create a lens effect. (Item 379) A method for presenting virtual content to a user, comprising: projecting light associated with one or more frames of image data, the light being projected through a plurality of optical fiber cores; modifying the light projected through the plurality of optical fiber cores through a lens, the lens being coupled to the tips of the plurality of optical fiber cores; delivering the modified light to the user. A method comprising: (Item 380) The method according to item 379, wherein the lens is a GRIN lens. (Item 381) The lens is the method according to item 379, having a gradient refractive index. (Item 382) The lens is the method according to item 379, collimating the light beam projected by the optical fiber core. (Item 383) The lens is the method according to item 379, coupled to a plurality of optical fiber cores. (Item 384) The lens is the method according to item 379, coupled to a single optical fiber core. (Item 385) One or more optical fiber cores include a polished end to create a lens effect, the method according to item 379. (Item 386) One or more optical fiber cores are melted to create a lens effect, the method according to item 367. (Item 387) A system for displaying virtual content, comprising a multi-core assembly for multiplexing light associated with one or more frames of image data, having a plurality of fibers, a waveguide for receiving and transmitting the light pattern such that a first viewing zone receives only light associated with a first portion of the image and a second viewing zone receives only light associated with a second portion of the image, the first and second viewing zones being only 0.5 mm, and comprising a system. (Item 388) The system according to item 387, further comprising blurring software for blurring one or more portions of the frames of the image data. (Item 389) The system according to item 387, further comprising a focusing adjustment module for determining the focusing adjustment of the user's eyes. (Item 390) The waveguide projects light directly into the user's eye without intermediate visual optics, the system according to item 387. (Item 391) A system, Comprising a multi-core assembly for multiplexing light associated with one or more frames of image data, and A waveguide for receiving and transmitting the light pattern such that a first viewing zone receives only light associated with a first portion of the image and a second viewing zone receives only light associated with a second portion of the image, the first and second viewing zones being only 0.5 mm, the waveguide, An optical assembly coupled to the waveguide for modifying the light beams transmitted to the first and second viewing zones, and Comprising a system. (Item 392) The plurality of fibers project light into a single waveguide array, the system according to item 391. (Item 393) The multi-core assembly is scanned, the system according to item 391. (Item 394) A time-varying bright field is generated, the system according to item 391. (Item 395) The optical assembly is a DOE element, the system according to item 391. (Item 396) The optical assembly is an LC layer, the system according to item 391. (Item 397) A method, Projecting light associated with one or more frames of image data through a multi-core assembly, the multi-core assembly comprising a plurality of optical fiber cores, the step, Delivering the projected light through an optical waveguide such that a first portion of the user's pupil receives light associated with a first portion of the image and a second portion of the user's pupil receives light associated with a second portion of the image; A method comprising. (Item 398) The method of item 397, wherein the diameters of the first and second portions are only 0.5 mm. (Item 399) The method of item 397, wherein the plurality of optical fiber cores project light into an array of single optical waveguides. (Item 400) The method of item 397, wherein the multi-core assembly is scanned. (Item 401) The method of item 397, wherein the optical waveguide comprises a plurality of reflectors. (Item 402) The method of item 401, wherein the angle of the reflector is variable. (Item 403) The method of item 397, further comprising an assembly of optics for modifying the light delivered to the first and second viewing zones. (Item 404) The method of item 403, wherein the assembly of optics is a DOE element. (Item 405) The method of item 403, wherein the assembly of optics is freeform optics. (Item 406) The method of item 403, wherein the assembly of optics is an LC layer. (Item 407) A system comprising An array of micro-projectors for projecting light associated with one or more frames of image data to be presented to a user, wherein the array of micro-projectors is positioned relative to the location of the user's pupil and the light is projected into the user's pupil, the system comprising a micro-projector. (Item 408) The first and second light beams are superimposed, the fiber scanning display according to item 407. (Item 409) The first and second light beams are deflected at least partially based on the critical angle of the polished bundle of fibers, the fiber scanning display according to item 407. (Item 410) The polished bundle of fibers is used to increase the resolution of the display, the fiber scanning display according to item 407. (Item 411) The polished bundle of fibers is used to create a bright field, the fiber scanning display according to item 407. (Item 412) A system, An array of microprojectors for projecting light associated with one or more frames of image data to be presented to a user, the array of microprojectors being positioned relative to the location of the user's pupil, the light being projected into the user's pupil, a microprojector, An optical element coupled to the array of microprojectors for modifying the light projected into the user's pupil, Comprising a system. (Item 413) A system, A plurality of multi-core fibers for transmitting light beams, the plurality of beams being coupled together, a plurality of multi-core fibers, A coupling element for bundling the plurality of multi-core fibers together, the bundle of multi-core fibers being polished at a critical angle with respect to the longitudinal axis of the fibers such that a first light beam transmitted from a first fiber of the bundle of fibers has a first optical path length and a second light beam transmitted from a second fiber of the bundle of fibers has a second optical path length, the first optical path length being different from the second optical path length such that the first light beam is phase-shifted with respect to the second light beam, a coupling element, Comprising a system. (Item 414) The first and second light beams are superimposed, the system according to item 412 or 413. (Item 415) The first and second light beams are deflected at least in part based on the critical angle of the polished bundle fiber, the system according to item 412 or 413. (Item 416) The polished bundle fiber is used to increase the resolution of the display, the system according to item 412 or 413. (Item 417) The polished bundle fiber is used to create a bright field of view, the system according to item 412 or 413. (Item 418) A system for displaying virtual content to a user, An image source for providing one or more frames of image data, A plurality of optical fiber cores for transmitting an optical beam associated with one or more frames of the image data, An optical element coupled to the plurality of optical fiber cores, receiving collimated light from the optical fiber cores, and delivering the optical beam to the user's eye, the optical beam being delivered to the user's eye at a plurality of angles such that a first optical beam is delivered to a portion of the user's eye at a first angle and a second optical beam is delivered to the same portion of the user's eye at a second angle, the first angle being different from the second angle, the optical element; Comprising a system. (Item 419) The optical element is a waveguide, the system according to item 418. (Item 420) The system according to item 418, further comprising a phase modulator for modulating the transmission of light through the optical fiber core. (Item 421) A method, Providing one or more frames of image data, transmitting an optical beam associated with one or more frames of the image data through a plurality of optical fiber cores; delivering the optical beam to the user's eye at a plurality of angles; A method comprising: (Item 422) The method according to item 421, further comprising modulating the phase delay of the plurality of optical fiber cores. (Item 423) The method according to item 421, further comprising coupling an optical element to the plurality of optical fiber cores. (Item 424) The method according to item 423, wherein the optical element is a waveguide. (Item 425) The method according to item 423, wherein the optical element is a freeform optic. (Item 426) The method according to item 423, wherein the optical element is a DOE. (Item 427) The method according to item 423, wherein the optical element is an SGO. (Item 428) A virtual reality display system comprising: a plurality of optical fiber cores for generating an optical beam associated with one or more images to be presented to a user; a plurality of phase modulators coupled to the plurality of optical fiber cores for modulating the optical beam, the plurality of phase modulators modulating the light in a manner that affects the wavefront resulting from the plurality of optical beams; A system comprising: (Item 429) The virtual reality display system according to item 428, wherein one or more of the optical fiber cores are deflected at one or more angles. (Item 430) The virtual reality display system according to item 428, wherein the optical fibers of the plurality of optical fiber cores are coupled to GRIN lenses. (Item 431) The virtual reality display system according to item 428, wherein the plurality of optical fiber cores are physically actuated to scan the optical fiber cores. (Item 432) A method comprising: providing one or more frames of image data to be presented to a user; projecting light associated with one or more frames of the image data through a plurality of optical fiber cores; modulating the light projected by the plurality of optical fiber cores in a manner that affects the convergent wavefront generated by the plurality of optical fiber cores through a plurality of phase modulators; A method comprising: (Item 433) The method according to item 432, wherein the light projected by the one or more optical fiber cores is deflected at one or more angles. (Item 434) The method according to item 432, wherein one or more optical fiber cores are coupled to a GRIN lens. (Item 435) The method according to item 432, further comprising scanning the optical light beam, wherein the plurality of optical fiber cores are physically actuated to scan the optical fiber cores. (Item 436) A system for displaying virtual content, comprising: an array of optical fiber cores for transmitting an optical beam associated with an image to be presented to a user; a lens coupled to the array of optical fiber cores for deflecting a plurality of optical beams output by the array of optical fiber cores through a single node, the lens being physically attached to the optical fiber cores such that movement of the optical fiber cores moves the lens, the single node being scanned; A system comprising: (Item 437) The optical beam output by the array of the optical fiber cores is the system according to item 436, which represents the pixels of the image to be presented to the user. (Item 438) The lens is a GRIN lens, and it is the system according to item 436. (Item 439) The array of the optical fiber cores is the system according to item 436, which is used to display a bright field of view. (Item 440) Another set of optical beams output by another array of optical fiber cores is the system according to item 436, which represents another pixel of the image to be presented to the user. (Item 441) The arrays of multiple optical fiber cores are combined, and it is the system according to item 436, which represents the pixels of the image to be presented to the user. (Item 442) The array of the optical fiber cores is the system according to item 436, which is configured to deliver the optical beam to a predetermined portion of the pupil of the user. (Item 443) The output optical beam is divergent, and it is the system according to item 436. (Item 444) The output optical beam is convergent, and it is the system according to item 436. (Item 445) The numerical aperture of the output optical beam is increased with respect to the optical beam transmitted by the individual optical fiber cores, and it is the system according to item 436. (Item 446) The increase in the numerical aperture enables a higher resolution, and it is the system according to item 445. (Item 447) The array of the optical fiber cores is angled in such a manner that the optical path length of the first optical beam traveling through the first optical fiber is different from that of the second optical beam traveling through the second optical fiber, thereby enabling a plurality of focal lengths of the optical beam to be delivered to the eye of the user, and it is the system according to item 436. (Item 448) A system for displaying virtual content to a user, an array of optical fiber cores for projecting light associated with one or more frames of image data, wherein one or more of the optical fiber cores of the array of optical fiber cores are polished at an angle such that the projected light is deflected, the polished angle creating a path length difference between a first optical fiber core and a second optical fiber core of the array of optical fiber cores with respect to an optical element, an array of optical fiber cores, an optical scanner for receiving the deflected light beams and scanning them along at least one axis, A system comprising. (Item 449) A system for providing at least one of a virtual or augmented reality experience to a user, a frame, an array of micro-projectors carried by the frame and positionable in front of at least one eye of the user when the frame is worn by the user, a local controller communicatively coupled to the array of micro-projectors for providing image information to the micro-projectors, the local controller comprising at least one processor and at least one non-transitory processor-readable medium communicatively coupled to the at least one processor, the at least one non-transitory processor-readable medium storing at least one processor-executable instruction or data that, when executed by the at least one processor, causes the at least one processor to perform at least one of processing, caching, and storing data, provide the image information to the micro-projectors, and generate at least one of a virtual or augmented reality visual experience for the user, a local controller, A system comprising. (Item 450) The system according to item 449, further comprising at least one reflector that is supported by the frame and is positioned and oriented to direct light from the microprojector toward at least one eye of the user when the frame is worn by the user. (Item 451) The system according to item 449, wherein the microprojector comprises individual ones of a plurality of scanning fiber displays. (Item 452) The system according to item 449, wherein each of the scanning fiber displays has an individual collimating lens at its distal tip. (Item 453) The system according to item 449, wherein the individual collimating lens is a gradient refractive index (GRIN) lens. (Item 454) The system according to item 449, wherein the individual collimating lens is a curved lens. (Item 455) The system according to item 449, wherein the individual collimating lens is fused to the distal tip of the individual scanning fiber display. (Item 456) The system according to item 449, wherein the scanning fiber displays have individual diffractive lenses at their distal tips. (Item 457) The system according to item 449, wherein each of the scanning fiber displays has a diffuser at its distal tip. (Item 458) The system according to item 457, wherein the diffuser is etched into the individual distal tip. (Item 459) The system according to item 449, wherein each of the scanning fiber displays has an individual lens at its distal tip, and the lens extends from the distal tip by a sufficient distance to vibrate freely in response to a stimulus. (Item 460) Item 449. The system of item 449, wherein each of the scanning fiber displays has a respective reflector at its distal tip, the reflector extending from the distal tip a sufficient distance so as to be free to vibrate in response to a stimulus. (Item 461) Item 461. The system of item 460, wherein each scanning fiber display includes an individual single mode optical fiber. (Item 462) Item 461. The system of item 460, wherein each scanning fiber display includes a respective mechanical transducer coupled to move at least the distal tip of the single mode optical fiber. (Item 463) Item 463. The system of item 462, wherein each of the individual mechanical transducers is a piezoelectric actuator. (Item 464) Item 462. The system of item 461, wherein each of the single mode optical fiber cores has a distal tip, the distal tip having a hemispherical lens shape. (Item 465) Item 462. The system of item 461, wherein each of the single mode optical fiber cores has a distal tip, the distal tip having a refractive lens affixed thereto. (Item 466) Item 462. The system of item 461, further comprising a transparent holder substrate that holds the plurality of single-mode optical fiber cores together. (Item 467) Item 462. The system of item 461, wherein the transparent holder substrate has a refractive index that at least approximately matches the refractive index of the cladding of the single mode optical fiber core. (Item 468) Item 462. The system of item 461, wherein the transparent holder substrate holds a plurality of single mode optical fiber cores, each angled toward a common spot. (Item 469) Item 462. The system of item 461, further comprising at least one mechanical transducer coupled to move the plurality of single mode optical fiber cores in unison. (Item 470) Item 449, a system as described in Item 449, wherein the at least one mechanical transducer vibrates the plurality of single mode optical fiber cores at a mechanical resonant frequency of the single mode optical fiber core, a portion of which is cantilevered from the transparent holder substrate. (Item 471) Item 449, a system according to Item 449, wherein the microprojector comprises a plurality of individual planar waveguides, each of which has a portion extending cantilevered from a holder substrate. (Item 472) Item 472. The system of item 471, further comprising at least one mechanical transducer coupled to move the plurality of planar waveguides in unison. (Item 473) Item 473. The system of item 472, wherein the at least one mechanical transducer vibrates the holder substrate at a mechanical resonant frequency of the planar waveguide. (Item 474) Item 473. The system of item 472, wherein the microprojector comprises a respective one of a plurality of piezoelectric actuators coupled to move a respective one of the planar waveguides relative to the holder substrate. (Item 475) Item 473. The system of item 472, wherein each of the planar waveguides defines a total internal reflection path along a respective length of the planar waveguide, and the planar waveguide comprises a respective one of a plurality of electronically switchable diffractive optical elements (DOEs) operable to propagate light outward from the respective total internal reflection paths. (Item 476) Item 449. The system of item 449, wherein the array of microprojectors comprises an array of optical fiber cores, each having a distal tip and at least one beveled edge. (Item 477) Item 477. The system of item 476, wherein the at least one beveled edge is on the distal tip, and the distal tip is a polished distal tip. (Item 478) Item 478. The system of item 477, wherein each of the optical fiber cores has a reflective surface at its respective distal tip. (Item 479) The distal tip, having an output edge at the distal tip at a critical angle defined with respect to the longitudinal axis of the individual optical fiber, of the system according to item 478. (Item 480) The defined critical angle is about 45 degrees with respect to the longitudinal axis of the individual optical fiber, of the system according to item 479. (Item 481) A focusing lens in the optical path of light emerging from the distal end of the optical fiber core for receiving a plurality of beams of the light, the beams being out of phase with each other, further comprising a focusing lens, of the system according to item 449. (Item 482) The system according to item 449, further comprising at least one transducer coupled to move at least one of the optical fiber cores within an X-Y Cartesian coordinate system and to move the light emitted by the at least one optical fiber within an X-Z Cartesian coordinate system. (Item 483) The at least one transducer is a first piezoelectric actuator that resonates a cantilever-supported portion of the optical fiber core in a direction perpendicular to the direction in which the cantilever-supported portion extends, of the system according to item 449. (Item 484) The optical fiber core comprises a thin ribbon of the optical fiber core, of the system according to item 483. (Item 485) The at least one transducer is a second piezoelectric actuator that moves at least a cantilever-supported portion of the optical fiber core longitudinally in the direction in which the cantilever-supported portion extends, of the system according to item 482. (Item 486) The microprojector includes at least one single-axis mirror operable to provide a slow scan along the longitudinal axis of at least one of the optical fiber cores, of the system according to item 485. (Item 487) The array of optical fiber cores comprises a multi-core fiber, of the system according to item 449. (Item 488) The multi-core fiber according to item 487, which includes about seven plural sparsely positioned clusters in a single conduit, each cluster includes three optical fiber cores, and each optical fiber conveys individual ones of three different colors of light. (Item 489) The multi-core fiber according to item 487, which includes about nineteen plural sparsely positioned clusters in a single conduit, each cluster includes three optical fiber cores, each optical fiber conveys individual ones of three different colors of light, and generates a triple structure of overlapping spots of three different colors. (Item 490) The multi-core fiber according to item 487, which includes at least one cluster in a single conduit, each of the clusters includes at least three optical fiber cores, and each of the optical fiber cores conveys at least two different colors of light. (Item 491) The multi-core fiber according to item 490, which includes at least one cluster in a single conduit, the at least one cluster includes four optical fiber cores, each optical fiber conveys individual ones of four different colors of light, and one of the four colors is infrared or near-infrared. (Item 492) The multi-core fiber includes a plurality of cores in a tight bundle, and further includes at least one transducer coupled to move the cores in a sparse spiral pattern. The system according to item 490. (Item 493) The system according to item 476, wherein the at least one bevel edge is spaced inwardly from the distal tip. (Item 494) The system according to item 476, wherein the at least one bevel edge is polished. (Item 495) The system according to item 494, further comprising at least one transducer configured to move at least one of the optical fiber cores within an X-Y Cartesian coordinate system and to move the light emitted by the at least one optical fiber within an X-Z Cartesian coordinate system. (Item 496) The system according to item 493, further comprising a focusing lens in the optical path of light exiting from the bevel edge of the optical fiber core for receiving a plurality of beams of the light, wherein the beams are out of phase with each other. (Item 497) A laser, At least one phase modulator optically coupled to outputs of the laser to some of the cores of the multi-core fiber to achieve mutual coherence. The system according to item 483, further comprising the same. (Item 498) A microlens array optically coupled upstream of input ends of individual ones of some of the cores of the multi-core fiber, A prism array optically coupled between the plurality of collimating lenses and input ends of the cores of the multi-core fiber to deflect light from the microlens array to the cores of the multi-core fiber. The system according to item 497, further comprising the same. (Item 499) A microlens array optically coupled upstream of input ends of individual ones of some of the cores of the multi-core fiber, A shared focusing lens optically coupled between the microlens array and input ends of the cores of the multi-core fiber to deflect light from the microlens array to the cores of the multi-core fiber. The system according to item 498, further comprising the same. (Item 500) The system according to item 476, wherein the array of micro-projectors further comprises at least one reflector, and the at least one reflector is operable to generate a scanning pattern and to be optically coupled to the array of optical fiber cores. (Item 501) The system according to item 500, wherein the at least one reflector is operable to generate at least one of a raster scan pattern, a Lissajous scan pattern, or a spiral scan pattern of a multi-focus beam. (Item 502) The system according to item 476, wherein each core of the multi-core fiber addresses an individual portion of the image plane so as not to overlap. (Item 503) The system according to item 476, wherein each core of the multi-core fiber addresses an individual portion of the image plane so as to substantially overlap. (Item 504) A system for displaying virtual content, an image source for providing one or more frames of image data to be presented to a user, a fiber scan display, the fiber scan display comprising a plurality of fibers, projecting light associated with one or more frames of the image data, the plurality of fibers being scanned using an actuator, a fiber scan display, a processor for controlling the fiber scan display in such a manner that a bright field is presented to the user, comprising a system. (Item 505) The system according to item 504, wherein the actuator is shared among all the fibers of the fiber scan display. (Item 506) The system according to item 504, wherein each fiber has its own individual actuator. (Item 507) The system according to item 505, wherein the plurality of fibers are mechanically coupled by a grid such that the plurality of fibers move together. (Item 508) The system according to item 507, wherein the grid is a graphene plane. (Item 509) The system according to item 507, wherein the grid is a lightweight support column. (Item 510) A system for providing at least one of a virtual or augmented reality experience to a user, a frame, a display system carried by the frame and positionable in front of at least one eye of the user when the frame is worn by the user, a local controller communicatively coupled to the display system and providing image information to the display system, the local controller comprising at least one processor and at least one non-transitory processor-readable medium communicatively coupled to the at least one processor, the at least one non-transitory processor-readable medium storing at least one processor-executable instruction or data that, when executed by the at least one processor, causes the at least one processor to perform at least one of data processing, caching, and storage, provide the image information to the display, and generate at least one of a virtual or augmented reality visual experience for the user, a local controller; A system comprising. (Item 511) The display comprises at least one wedge-shaped waveguide having at least two flat surfaces facing each other across the thickness of the first wedge-shaped waveguide and along which light incident at an angle defined in the wedge-shaped waveguide through an incident portion of the wedge-shaped waveguide propagates through total internal reflection, the thickness of the wedge-shaped waveguide varying linearly along the length of the wedge-shaped waveguide, the system according to item 510. (Item 512) The wedge-shaped waveguide provides bimodal total internal reflection, the system according to item 511. (Item 513) The system according to item 510, further comprising at least two projectors optically coupled to the wedge-shaped waveguide at different individual locations along the incident portion of the wedge-shaped waveguide. (Item 514) The system according to item 510, further comprising a first linear array of a plurality of projectors optically coupled to the wedge-shaped waveguide at different individual locations along the incident portion of the wedge-shaped waveguide. (Item 515) The system according to item 514, wherein the projectors of the first linear array of the plurality of projectors are scanning fiber displays. (Item 516) The system according to item 510, further comprising a stack of a plurality of spatial light modulators optically coupled to the wedge-shaped waveguide along the incident portion of the wedge-shaped waveguide. (Item 517) The system according to item 510, further comprising a multi-core optical fiber optically coupled to the wedge-shaped waveguide at one or more locations along the incident portion of the wedge-shaped waveguide. (Item 518) The projectors of the first linear array of the projectors are optically coupled to the wedge-shaped waveguide and input light into the wedge-shaped waveguide at a first angle. The system according to item 510, further comprising a second linear array of a plurality of projectors optically coupled to the wedge-shaped waveguide at different individual locations along the incident portion of the wedge-shaped waveguide, wherein the projectors of the second linear array of the projectors are optically coupled to the wedge-shaped waveguide and input light into the wedge-shaped waveguide at a second angle, and the second angle is different from the first angle. (Item 519) The system according to item 510, wherein the incident portion is a longitudinal end of the wedge-shaped waveguide. (Item 520) The system according to item 510, wherein the incident portion is a lateral edge of the wedge-shaped waveguide. (Item 521) The system according to item 510, wherein the incident portion is one of the flat surfaces of the wedge-shaped waveguide. (Item 522) The system according to item 510, further comprising at least one optical component optically coupled to the projector, changing an angle of light received from the projector, and optically coupling the light to the wedge-shaped waveguide at an angle that achieves total internal reflection of the light within the wedge-shaped waveguide. (Item 523) A system for displaying virtual content to a user, an array of micro-projectors for projecting an optical beam associated with one or more frames of image data to be presented to the user, the array of micro-projectors being configurable to be movable with respect to one or more of the micro-projectors of the array of micro-projectors, a micro-projector, a frame for storing the array of micro-projectors, wherein the one or more optical beams are modulated as a function of the position of the one or more micro-projectors with respect to the array of micro-projectors, thereby enabling delivery of a bright-field image to the user, and operably coupled to one or more micro-projectors of the array of micro-projectors in a manner that enables delivery of a bright-field image to the user, and a processor for controlling the one or more optical beams transmitted from the one or more projectors, A system comprising. (Item 524) The system according to item 523, wherein the micro-projectors of the array of micro-projectors are coupled to lenses. (Item 525) The system according to item 523, wherein the array of micro-projectors is arranged in a manner based on a desired resolution of an image to be presented to the user. (Item 526) The system according to item 523, wherein the array of micro-projectors is arranged based on a desired field of view. (Item 527) The light beams of the plurality of micro - projectors overlap, the system according to item 523. (Item 528) The system according to item 523, further comprising an actuator, wherein the actuator is coupled to one or more micro - projectors and is configured to move the one or more micro - projectors. (Item 529) The system according to item 523, wherein the actuator is coupled to a plurality of micro - projectors. (Item 530) The system according to item 523, wherein the actuator is coupled to a single micro - projector. (Item 531) The system according to item 523, wherein the micro - projectors of the array of micro - projectors are mechanically coupled to a grid. (Item 532) The system according to item 531, wherein the grid is a graphene sheet. (Item 533) The system according to item 531, wherein the grid is a matrix of carbon nanotubes. (Item 534) The system according to item 523, wherein the plurality of micro - projectors are cut via a laser cutting device such that all of the plurality of micro - projectors have the same piece - holding support length. (Item 535) A contact lens that interfaces with the cornea of a user's eye for a virtual or augmented reality display, comprising a partially hemispherical substrate and a selective filter configured to selectively pass a light beam to the user's eye. (Item 536) The contact lens according to item 535, wherein the selective filter is a notch filter. (Item 537) The contact lens according to item 535, wherein the notch filter substantially blocks wavelengths at approximately 450 nm (peak blue) and substantially passes other wavelengths within the visible portion of the electromagnetic spectrum. (Item 538) The contact lens according to item 535, wherein the notch filter substantially blocks wavelengths at approximately 530 nm (green) and substantially passes other wavelengths within the visible portion of the electromagnetic spectrum. (Item 539) The contact lens according to item 535, wherein the notch filter substantially blocks wavelengths at approximately 650 nm and substantially passes other wavelengths within the visible portion of the electromagnetic spectrum. (Item 540) The contact lens according to item 539, wherein the notch filter comprises a plurality of layers of dielectric material supported by the substrate. (Item 541) The contact lens according to item 539, wherein the filter has a pinhole aperture with a diameter of less than 1.5 mm. (Item 542) The contact lens according to item 541, wherein the pinhole aperture allows light beams of multiple wavelengths to pass through. (Item 543) The contact lens according to item 539, wherein the size of the pinhole is varied at least in part based on the desired depth of focus of the display. (Item 544) The contact lens according to item 539, further comprising a plurality of operating modes. (Item 545) The contact lens according to item 539, further comprising the multi-depth-of-focus display configuration for the virtual content. (Item 546) The contact lens according to item 539, further comprising a focus tracking module for determining the near and far accommodation of the user's eye. (Item 547) The contact lens according to item 539, wherein the depth of focus of a specific display object is varied at least partially based on the determined focus adjustment. (Item 548) The contact lens according to item 539, wherein an image is relayed through an optical waveguide, and the relayed image is associated with a specific depth of focus. (Item 549) A method for displaying virtual content to a user, comprising: providing one or more frames of image data to be presented to the user; projecting light associated with the one or more frames of image data; receiving the projected light through a partial hemispherical substrate coupled to the user's pupil and selectively filtering the light beam to the user's pupil; and a method comprising: (Item 550) The method according to item 549, wherein the light is filtered through a notch filter. (Item 551) The method according to item 550, wherein the notch filter substantially blocks wavelengths at about 450 nm (peak blue) and substantially passes other wavelengths within the visible portion of the electromagnetic spectrum. (Item 552) The method according to item 550, wherein the notch filter substantially blocks wavelengths at about 530 nm (green) and substantially passes other wavelengths within the visible portion of the electromagnetic spectrum. (Item 553) The method according to item 550, wherein the notch filter substantially blocks wavelengths at about 650 nm and substantially passes other wavelengths within the visible portion of the electromagnetic spectrum. (Item 554) The method according to item 550, wherein the notch filter comprises a plurality of layers of dielectric material supported by the substrate. (Item 555) The method according to item 550, wherein the filter has a pinhole aperture with a diameter of less than 1.5 mm. (Item 556) The method according to item 555, wherein the pinhole opening enables light beams of a plurality of wavelengths to pass through. (Item 557) The method according to item 555, wherein the size of the pinhole is varied based at least in part on a desired depth of focus of the display. (Item 558) The method according to item 549, wherein the partial hemispherical substrate is a contact lens. (Item 559) A system for displaying virtual content to a user, A light projection system for projecting light associated with one or more frames of image data into the user's eye, the light projection system being configured to project light corresponding to a plurality of pixels associated with the image data, A processor for modulating a depth of focus of the plurality of pixels to be displayed to the user, A system comprising: (Item 560) The system according to item 559, wherein the depth of focus is spatially modulated. (Item 561) The system according to item 559, wherein the depth of focus is modulated over time. (Item 562) The system according to item 559, further comprising an image source for providing one or more frames of the image data in a time series manner. (Item 563) The system according to item 559, wherein the depth of focus is modulated on a per-frame basis. (Item 564) The light projection system comprises a plurality of optical fiber cores, and the depth of focus is modulated across the plurality of optical fiber cores such that a portion of the optical fiber cores is associated with a first depth of focus and another portion of the optical fiber cores is associated with a second depth of focus, the first depth of focus being different from the second depth of focus, the system according to item 559. (Item 565) The first display object of a specific frame is displayed through a first depth of focus, and the second display object of the specific frame is displayed through a second depth of focus, and the first depth of focus is different from the second depth of focus. The system according to item 559. (Item 566) The first pixel of a specific frame is associated with a first depth of focus, and the second pixel of the specific frame is associated with a second depth of focus, and the first depth of focus is different from the second depth of focus. The system according to item 559. (Item 567) The system according to item 559, further comprising a focus tracking module for determining the near - far adjustment of the user's eyes, and the depth of focus is modulated at least partially based on the determined near - far adjustment. (Item 568) The system according to item 567, wherein the light generation pattern associated with the light generation system is dynamically driven by the determined near - far adjustment. (Item 569) The system according to item 568, wherein the pattern is a scanning pattern of a plurality of optical fiber cores. (Item 570) The system according to item 559, further comprising a blurring module for blurring one or more portions of the image data, and the blurring is created to smooth the transition between a first scanning pattern and a second scanning pattern or between a first resolution scanning pitch and a second resolution scanning pitch. (Item 571) A system for displaying virtual content to a user, A light projection system for projecting light associated with one or more frames of image data onto the user's eyes, the light projection system being configured to project light corresponding to a plurality of pixels associated with the image data, and A processor for modulating the size of the plurality of pixels to be displayed to the user, A system comprising. (Item 572) The light projection system is the system according to Item 571, which is a fiber scanning display. (Item 573) In the system according to Item 572, the projected light is displayed through a scanning pattern. (Item 574) In the system according to Item 571, the processor modulates the size of specific pixels, at least partially based on the type of the scanning pattern. (Item 575) In the system according to Item 571, the size of the one or more pixels may be modulated, at least partially based on the distance between the scanning lines of the scanning pattern. (Item 576) In the system according to Item 571, the size of the first pixel is different from the size of the second pixel within the same frame. (Item 577) A method for displaying virtual content to a user, comprising: projecting light associated with one or more frames of image data, wherein one or more light beams of the projected light correspond to one or more pixels, and the light is projected through a fiber scanning display; modulating the size of the one or more pixels to be displayed to the user; The method includes the above steps. (Item 578) In the method according to Item 577, the size of specific pixels varies, at least partially based on the scanning pattern of the fiber scanning display. (Item 579) In the method according to Item 578, the size of the one or more pixels is modulated, at least partially based on the distance between the scanning lines of the scanning pattern. (Item 580) In the method according to Item 579, the size of the one or more pixels is variable. (Item 581) A system for displaying virtual content to a user, A display system that delivers light associated with one or more frames of image data, comprising a plurality of pixels and scanning light having a variable line pitch, A blurring module for performing variable blurring of one or more of the plurality of pixels and modifying the size of the one or more pixels, A processor for controlling the blurring module in a manner such that the pixel size varies, at least in part, based on the line pitch of the display system, A system comprising. (Item 582) The system according to item 581, wherein the display system is a fiber scanning system. (Item 583) The system according to item 581, wherein the pixel size is enlarged. (Item 584) The system according to item 581, wherein the pixel size is reduced. (Item 585) The system according to item 581, wherein the pitch lines are sparse. (Item 586) The system according to item 581, wherein the pitch lines are of high density. (Item 587) A method for displaying virtual content to a user, Projecting light associated with one or more frames of image data to be presented to the user using optical see-through viewing optics that enable the user to view the outside world through the viewing optics, Selectively attenuating at least a portion of the light from the outside world that will pass through the viewing optics on its way to the user's eye such that a portion of the light from the outside world passes through the viewing optics and reaches the user's eye, A method comprising. (Item 588) The method according to item 587, wherein the light beam is selectively attenuated at least partially based on the incident angle of the light beam. (Item 589) The method according to item 587, wherein different portions of the frame are attenuated to different amounts. (Item 590) The method according to item 587, wherein the focus level of the attenuated light beam is varied. (Item 591) A system for displaying virtual content to a user, comprising: An image source for providing one or more frames of image data; A stack of two or more spatial light modulators (SLMs) positioned to deliver light associated with one or more frames of the image data to the user, the SLMs spatially attenuating light from the external environment; A processor for controlling the stack of SLMs in a manner such that the angle at which a light beam passes through one or more cells of the SLMs is modulated; The system comprising the above. (Item 592) The system according to item 591, further comprising a set of display optics positioned between the user's eye and the external environment. (Item 593) The system according to item 591, wherein the SLMs of the stack of SLMs are cholesteric LCDs. (Item 594) The system according to item 591, wherein at least one of the SLMs is a cholesteric LCD. (Item 595) The system according to item 591, wherein the stack of SLMs is positioned such that the user can view the outside world through the stack of SLMs, and the SLMs are at least semi-transparent. (Item 596) The system according to item 591, wherein the spatial light modulator array comprises at least one of several liquid crystal arrays, several digital mirror device elements of a digital light processing system, several microelectromechanical systems (MEMS) arrays, or several MEMS shutters. (Item 597) The system according to item 591, further comprising an occluder comprising at least one optical component, wherein the processor controls at least one optical component of the occluder to generate a dark field representation of a dark virtual object. (Item 598) A system for displaying virtual content, an array of spatial light modulators, the array of spatial light modulators being configured to generate an optical pattern and comprising at least two modulators, a processor for controlling the array of spatial light modulators in such a manner that the at least two spatial light modulators form a moiré pattern, the moiré pattern being a periodic spatial pattern that attenuates light at a period different from the period of the optical pattern formed on the at least two spatial light modulators, A system comprising (Item 599) The system according to item 598, wherein the spatial light modulator array comprises at least two spatially light modulator arrays that are optically coupled to each other and control the passage of light through the moiré effect. (Item 600) The system according to item 599, wherein the at least two spatially light modulator arrays each have an individual attenuation pattern. (Item 601) The system according to item 598, wherein the at least two spatially light modulator arrays each have an individual fine pitch sine wave pattern printed, etched, or otherwise engraved thereon or therein. (Item 602) The system according to item 599, wherein the at least two spatially light modulator arrays are aligned with each other. (Item 603) The system according to item 599, wherein each of the at least two spatial light modulator arrays has an individual attenuation pattern. (Item 604) A system for displaying virtual content to a user, a light source for providing light associated with one or more frames of image data, the light source being a spatial light modulator, a pinhole array positioned in a manner relative to the spatial light modulator such that the pinholes of the pinhole array receive light from a plurality of cells of the spatial light modulator, wherein a first light beam passing through the pinholes corresponds to an angle different from that of a second light beam passing through the pinholes, and the cells of the spatial light modulator selectively attenuate light, the pinhole array; A system comprising: (Item 605) The system according to item 604, wherein the external environment is viewed through the pinhole array and the SLM, and the light beam is selectively attenuated at least in part based on the incident angle of the light beam. (Item 606) The system according to item 604, wherein light from different parts of the field of view is selectively attenuated. (Item 607) The system according to item 604, further comprising a selective attenuation layer selectively operable to attenuate the transmission of light therethrough, the selective attenuation layer being optically in series with the pinhole layer. (Item 608) The system according to item 607, wherein the selective attenuation layer comprises a liquid crystal array, a digital light projector system, or a spatial light modulator array having an individual attenuation pattern. (Item 609) The system according to item 604, wherein the pinhole array is disposed at a distance of about 30 mm from the cornea of the user's eye, and the selective attenuation panel is positioned opposite the pinhole array as viewed from the eye. (Item 610) The pinhole array comprises a plurality of pinholes, and the processor controls the SLM in such a way that light is attenuated as a function of the angle at which the light beam passes through the plurality of pinholes, thereby generating a focused bright field, the system according to item 604. (Item 611) The focused bright field causes occlusion at a desired focal length, the system according to item 610. (Item 612) A system comprising: A light source for providing light associated with one or more frames of image data, the light source being a spatial light modulator, and A lens array positioned in a manner relative to the spatial light modulator such that the lenses of the lens array receive light from a plurality of cells of the spatial light modulator, wherein the first light beam received by the lens corresponds to a different angle than the second light beam received by the lens, and the cells of the spatial light modulator selectively attenuate light, the lens array and Comprising the system. (Item 613) The external environment is viewed through the lens array and the SLM, and the light beam is selectively attenuated at least in part based on the incident angle of the light beam, the system according to item 612. (Item 614) Light from different parts of the field of view is selectively attenuated, the system according to item 612. (Item 615) The lens array comprises a plurality of lenses, and the processor controls the SLM in such a way that light is attenuated as a function of the angle at which the light beam is received by the plurality of lenses, thereby generating a focused bright field, the system according to item 612. (Item 616) The focused bright field causes occlusion at a desired focal length, the system according to item 615. (Item 617) A system for displaying virtual content to a user, A light projector for projecting light associated with one or more frames of image data, at least one polarization-sensitive layer for receiving the light and rotating the polarization of the light, an array of polarization modulators for modulating the polarization of the polarization-sensitive layer, wherein the state of cells in the array determines the amount of light passing through the polarization-sensitive layer, A system comprising: (Item 618) The system according to item 617, wherein the system is installed in an eye-proximity configuration. (Item 619) The system according to item 617, wherein the polarization modulator is a liquid crystal array. (Item 620) The system according to item 617, further comprising a parallax barrier for offsetting the polarizer such that different exit pupils have different paths through the polarizer. (Item 621) The system according to item 620, wherein the polarizer is an xpol polarizer. (Item 622) The system according to item 620, wherein the polarizer is a multiPol polarizer. (Item 623) The system according to item 620, wherein the polarizer is a patterned polarizer. (Item 624) The system according to item 617, wherein the light interacts with one or more MEM arrays. (Item 625) The system according to item 618, further comprising an SLM for projecting light, wherein the SLM is positioned between one or more optical elements, and the optical elements correspond to a zero-magnification telescope. (Item 626) The system according to item 625, wherein the user views the external environment through the zero-magnification telescope. (Item 627) The system according to item 625, wherein at least one SLM is positioned in the image plane within the zero magnification telescope. (Item 628) The system according to item 617, further comprising a DMD, wherein the DMD corresponds to a transparent substrate. (Item 629) The system according to item 628, further comprising an occluder comprising at least one optical component, wherein the processor controls at least one optical component of the occluder to generate a dark field representation of a dark virtual object. (Item 630) The system according to item 628, further comprising one or more LCDs, wherein the one or more LCDs selectively attenuate a light beam. (Item 631) The system according to item 617, further comprising one or more LCDs, wherein the one or more LCDs act as a polarization rotator. (Item 632) The system according to item 629, wherein the occluder is a louver MEM device. (Item 633) The system according to item 632, wherein the louver MEM device is opaque and the louver MEM device varies the incident angle on a pixel-by-pixel basis. (Item 634) The system according to item 632, wherein the occluder is a sliding panel MEM device, and the sliding panel MEM device slides back and forth to correct the occlusion area. (Item 635) A method for displaying virtual content, comprising: projecting light associated with one or more frames of image data; rotating the polarization of the light through a polarization sensitive layer on a substrate that receives the projected light; modulating the polarization of the light and selectively attenuating the light passing through the polarization layer. A method comprising the steps above. (Item 636) The method according to item 635, wherein the polarization modulator is a liquid crystal array. (Item 637) The method according to item 635, further comprising a parallax barrier for offsetting the polarizer so that different exit pupils have different paths through the polarizer. (Item 638) The method according to item 637, wherein the polarizer is an xpol polarizer. (Item 639) The method according to item 637, wherein the polarizer is a multiPol polarizer. (Item 640) The method according to item 637, wherein the polarizer is a patterned polarizer. (Item 641) The method according to item 617, wherein the light interacts with one or more MEM arrays. (Item 642) The method according to item 636, further comprising an SLM for projecting light, the SLM being positioned between one or more optical elements, the optical elements corresponding to a zero magnification telescope. (Item 643) The method according to item 642, wherein the user views the external environment through the zero magnification telescope. (Item 644) The method according to item 642, wherein at least one SLM is positioned in the image plane within the zero magnification telescope. (Item 645) The method according to item 635, further comprising a DMD, the DMD corresponding to a transparent substrate. (Item 646) The method according to item 635, further comprising an occluder comprising at least one optical component, the processor controlling at least one optical component of the occluder to generate a dark field representation of a dark virtual object. (Item 647) The method according to item 635, further comprising one or more LCDs, the one or more LCDs selectively attenuating a light beam. (Item 648) The method according to item 635, further comprising one or more LCDs, wherein the one or more LCDs serve as a polarization rotator. (Item 649) The method according to item 646, wherein the occluder is a louver MEM device. (Item 650) The method according to item 649, wherein the louver MEM device is opaque and the louver MEM device varies the incident angle on a pixel-by-pixel basis. (Item 651) The method according to item 646, wherein the occluder is a slide panel MEM device, and the slide panel MEM device slides back and forth to correct the occlusion area. (Item 652) A system for displaying virtual content, a light source for providing light associated with one or more frames of image data, the light source being a spatial light modulator, an array of microelectromechanical (MEM) louvers, the MEM louvers being housed in a substantially transparent substrate, the MEM louvers being configurable to vary the angle at which light is delivered to a pixel, the angle of a first pixel delivered to the user being different from that of a second pixel delivered to the user, comprising a system. (Item 653) The system according to item 652, wherein the at least one optical component comprises a first array of microelectromechanical system (MEMS) louvers. (Item 654) The system according to item 652, wherein the array of MEMS louvers comprises a plurality of substantially opaque louvers supported by an optically transparent substrate. (Item 655) The system according to item 652, wherein the array of microelectromechanical system (MEMS) louvers has a louver pitch fine enough to selectively block light on a pixel-by-pixel basis. (Item 656) At least one optical component of the occluder further comprises a second array of MEMS louvers, and the second array of MEMS louvers is in a stack configuration with the first array of MEMS louvers, the system according to item 652. (Item 657) The array of MEMS louvers comprises a plurality of polarization louvers carried by an optically transparent substrate, and the individual polarization state of each of the louvers is selectively controllable, the system according to item 652. (Item 658) The louvers of the first and second arrays of the MEMS panel are polarizers, the system according to item 652. (Item 659) At least one optical component of the occluder comprises a first array of microelectromechanical systems (MEMS) panels mounted for movement within a frame, the system according to item 652. (Item 660) The panels of the first array of the MEMS panel are slidably mounted for movement within the frame, the system according to item 625. (Item 661) The panels of the first array of the MEMS panel are pivotally mounted for movement within the frame, the system according to item 652. (Item 662) The panels of the first array of the MEMS panel are mounted to be translatable and pivotable for movement within the frame, t...
Claims
1. A system for displaying virtual content to a user across a real background, comprising: an image source for providing one or more frames of image data; a stack of two or more spatial light modulators (SLMs), the stack of two or more SLMs being positioned between the user's eye and the external environment and coupled to the image source so as to deliver to the user light containing image information of an image represented by the one or more frames of image data and to transmit light from the external environment to the user, each SLM of the stack being configured such that each of a plurality of positions on the SLM is capable of selectively transmitting or attenuating light from the external environment incident on that position; a processor for controlling the stack of SLMs such that an angle at which a light beam from the external environment passes through one or more cells of the SLM is modulated; and a system.
2. The system according to claim 1, further comprising a set of display optics, the set of display optics being positioned between the user's eye and the external environment.
3. The system according to claim 1, wherein the SLMs of the stack of SLMs are cholesteric LCDs.
4. The system according to claim 1, wherein at least one SLM of the stack of SLMs is a cholesteric LCD.
5. The system according to claim 1, wherein the stack of SLMs is positioned such that the user can view the outside world through the stack of SLMs.
6. The system according to claim 1, further comprising an occluder comprising at least one optical component, the processor controlling the at least one optical component of the occluder to generate a dark field representation of a dark virtual object.
7. The system according to claim 1, wherein the attenuation is based on one or more characteristics of the one or more frames of image data presented to the user.
8. The system according to claim 7, wherein the one or more characteristics include the luminance of the one or more frames of image data.
9. The system according to claim 1, wherein the one or more frames of image data include a dark virtual object.
Citation Information
Patent Citations
Three-dimensional display device
JP1991084516A
Head mounted display device
JP1996166559A
Method and device for displaying solid
JP1999296158A
Display device and stereoscopic display device
JP2000249974A
A compact image display system for glasses or other head-bone frames
JP2002539498A