Augmented reality imaging system

Abstract

An optical system for an augmented reality imaging system is disclosed. The optical system includes a light guiding device and a projection optics device. The light guiding device is configured to guide input light to propagate to an imaging plane, the input light including light representing an augmented image to be projected and input light representing a real image of an external scene. The projection optics device has a fixed field of view and multiple different focusing parameters at multiple different regions corresponding to multiple different viewing areas within the field of view. The projection optics device influences the propagation of at least one of the light representing the augmented image and the light representing the real image, such that for each of the multiple different regions, the interaction between a portion of the light representing the augmented image and a portion of the light representing the real image and the region of the projection optics device guides these portions of the augmented image light and the real image light to propagate along substantially the same output path as the focusing parameter corresponding to that region.

Description

Technical Field

[0001] This invention generally pertains to augmented reality technology and relates to an optical system and method for projecting light in an augmented reality system. In particular, the optical system may be incorporated within a see-through near-eye display or a head-mounted display (such as a helmet-mounted or eyeglass-mounted display) that has the ability to reflect the projected image and allows the use of see-through. Background Technology

[0002] A near-eye display is a wearable device that generates a displayed image in front of the user's field of vision. A near-eye display includes main components such as an image generator and an optical combiner. The image generator, for example, uses a spatial light modulator (SLM) or similar device to provide a digitally reproduced image. The SLM or similar device typically includes an array of pixels projected to infinity by a collimating lens and transmitted to the viewer's eye via reflective or partially reflective surfaces (or multiple surfaces). The reflective or partially reflective surfaces (or multiple surfaces) function as a combiner for both non-perspective and perspective applications. For augmented reality displays, the optical combiner combines light from the external environment with light from the image generator into a single presentation of visual data from the imaging optics and the eye.

[0003] Near-eye displays present image information to the viewer's viewing pupil (also known as "eyeboxes"). When the viewing pupil aligns with the viewer's eye pupil, a virtual image is generated within the viewer's field of vision. The near-eye display's connector or waveguide transmits the image information from a position outside the viewer's field of vision toward the viewer's eye.

[0004] Various examples of such waveguides suitable for use in augmented reality systems are described in the following patent publications co-assigned to the assignee of this application: US8098439; US7643214; US8000020; US7724442; US8004765; US7577326; US6829095; US2015138451; WO16075689; WO16103251; US9513481; US9551880; US9551874. In such waveguides, light carrying an enhanced image is guided by total internal reflection to a portion of a reflective surface, and then reflected from that portion of the reflective surface to the viewer. Summary of the Invention

[0005] There is a need in the art for a novel approach to configuring optical devices for use in augmented reality systems. It should be understood that in augmented reality systems, virtual images are augmented onto real-world images. Therefore, in augmented reality systems, the high-quality images used in perspective near-eye displays should simultaneously provide both real and virtual / augmented images across the entire field of view of the system, and should also provide images for real and virtual objects at different distances.

[0006] In order to provide viewing comfort for both intensified and real images, it is often necessary to modify either or both of them. It is known that electronically controlled dynamic lenses allow users to dynamically control the image focus.

[0007] The situation is different in so-called "static" augmented reality systems in near-eye displays (i.e., systems with fixed optical characteristics, such as field of view, optical power / focus parameters, and profiles), where the system has a fixed field of view. This invention improves the simultaneous appearance of both augmented and real images to the viewer by using a so-called static optical system, achieving the desired comfort. To achieve this, the optical system of this invention is configured such that the projected light portions representing the augmented and real images, respectively, propagate to the viewer's eye (image plane) along a common optical path for distant virtual and real objects and a common optical path for closer virtual and real objects. In this regard, it should be noted that although the focus variation in the upper and lower parts of the field of view of the optical system is used as an example below, the principle of the invention is not limited to this example, and the focus variation can be applied to any other part (or multiple parts) / block (or multiple blocks) throughout the system's field of view.

[0008] In most cases, augmented reality systems do not require any modification to the real image of the external scene; that is, distant and near objects are presented to the viewer as is. However, in some cases, the real image is projected in a manner similar to multifocal lens projection (such as a progressive lens), focusing both the augmented image and the external world (the real image) to infinity at the top of the FOV (field of view) and at infinity at the bottom of the FOV, where the real object is usually closer to the FOV. This requires modification of the light representing the projected real image.

[0009] In most cases, the desired enhancement of the virtual image on the real-world imagery is to be improved. This can be achieved by influencing / modifying the convergence (focus) of the light representing the projected enhanced image. The convergence of the light representing the enhanced image can be affected before this light interacts with the light-binding surface, thus leaving the real image light unaffected, where the light-binding surface is the output propagation path that combines the enhanced image light and the real image light.

[0010] In some cases, the system configuration requires that the projection of the enhanced image be affected directly in front of the user's eyes, specifically in the combined projection path of the enhanced image and the real image beam. Therefore, this effect needs to be compensated for for the presentation of the real image.

[0011] This invention provides a novel optical system (sometimes referred to as an image projector) for use in augmented reality systems. The image projector of this invention is configured with a fixed field of view (FOV) and a fixed profile of multiple optical properties within the FOV, which influences the light propagating therethrough, thereby producing a virtual focal plane that is tilted relative to the optical axis of the image projector.

[0012] According to certain embodiments of the present invention, an optical system for an augmented reality imaging system is provided, the optical system comprising:

[0013] A light guiding device configured to guide input light along a general propagation direction to an imaging plane, the input light comprising light representing an enhanced image to be projected and input light representing a real image of an external scene;

[0014] A projection optics device has a fixed field of view and multiple different focusing parameters in multiple different regions corresponding to multiple different viewing areas within the field of view. The projection optics device is used to influence the propagation of at least one of the lights representing an enhanced image, such that, for each of the multiple different regions, the interaction between that region and a portion of the light representing the enhanced image and a portion of the light representing the real image guides that portion of the light representing the enhanced image and the light representing the real image along substantially the same output path corresponding to the focusing parameter of that region, thereby providing multiple focused images in the imaging plane for those portions of the light representing the enhanced image and the light representing the real image.

[0015] It should be understood that when discussing augmented reality imaging systems such as near-eye displays or head-mounted displays, the term "imaging plane" actually refers to the so-called "eyebox." The latter is a spatial volume within which the imaging system forms an image that can be effectively viewed; this spatial volume represents the combination of exit pupil size and eye distance.

[0016] Generally, a light guiding device is used to define at least one light-binding surface in a plurality of optical paths representing input light for an enhanced image and input light for a real image. This light-binding surface is used to reflect one of these light sources and transmit the others toward the imaging plane. In this see-through near-eye augmented reality system, the light-binding surface reflects the enhanced image light and transmits the real image light. In some embodiments, the light guiding device includes a light-guiding optics (LOE) that is permeable to light from an external source and is used to guide light (enhanced image light) within it to or from a light output surface. For example, such an LOE can be used to guide light through it via total internal reflection from its plurality of inner principal surfaces and to output light from it by interacting with light from one or more partially reflective or diffracted surfaces, each of which serves as the aforementioned light-binding surface for guiding the enhanced image light and the real image light.

[0017] These multiple different viewing zones are defined by multiple regions of the projection optics, so that when using the optical system, as the user moves their pupil to observe objects at different distances, these regions are aligned (intersecting) with the user's line of sight at different angular positions. For example, the projection optics can define farsighted and nearsighted regions with different focusing parameters / optical power for distant and near objects (similar to a bifocal lens), or can have an optical power / focusing parameter profile similar to a progressive lens. Therefore, generally speaking, these regions with different focusing parameters can be implemented as multiple discrete regions spanning the field of view or continuously varying focal points.

[0018] In some embodiments, the projection optics includes an enhanced image projection unit positioned on the optical path of the input light representing the enhanced image as it propagates toward the light guiding device. In this case, the projection optics are designed to influence the propagation of light representing the projected enhanced image, but not the propagation of input light representing the real image of the scene.

[0019] The enhanced image projection unit may include at least one lens with multiple different focusing parameters.

[0020] In some other embodiments, the projection optics includes an enhanced image projection unit and a real image projection unit having the same field of view and separated along the optical path of the light emerging from the light guiding device. In other words, in this configuration, the projection optics influences both the enhanced image light and the real image light. Each of these projection units has multiple different focusing parameters, which can be implemented as multiple discrete regions across the field of view or as continuously varying focal points. The enhanced image projection unit and the real image projection unit are configured in a reverse symmetrical manner, whereby the multiple focusing parameters of the real image projection unit compensate for the multiple effects of the multiple different focusing parameters of the enhanced image projection unit. The enhanced image projection unit and the real image projection unit are located on opposite sides of the light guiding device (at a fixed position).

[0021] It should be understood that the enhanced image projection unit located at the output of the light guiding unit actually interacts with both the light representing the enhanced image and the light representing the real image (affecting their propagation). Therefore, for such embodiments, the term "enhanced image projection unit" is used only to distinguish it from the "real image projection unit," which interacts only with the light representing the real image; however, the configuration and function of the enhanced image projection unit should be properly understood and interpreted.

[0022] Each of these units may include at least one lens, wherein the lenses of these units have similar optical properties (multiple different focusing parameters) and are located in multiple substantially parallel separated planes along a common optical axis, but are oriented in an opposite symmetrical manner relative to the plane of the light guiding device. Therefore, these units exert opposite optical effects on the light passing through them.

[0023] In any of the above embodiments, the projection optical device includes at least one lens having one of the following configurations: a bifocal lens, a trifocal lens, a progressive zoom lens (a progressive lens); which may be implemented by one of the following: a refractive lens, a diffractive lens, a Fresnel lens, or a reflective surface.

[0024] In some other embodiments of the invention, the optical system includes a light guiding device and an optical projection device, wherein each of these units is a multi-unit component / device. More specifically, the light guiding device includes an array of at least two light guiding units, each light guiding unit being configured as described above to guide the enhanced image light toward a light output surface (light bonding surface) and transmit the real image light to interact with the light output surface; and the optical projection device includes an array of multiple light projection units. This configuration such that all these units, i.e., the multiple light guiding units and the multiple light projection units, are arranged in a separated relationship along a common axis, such that the real image light propagates sequentially through (interacts with) all these units. Moreover, each light guiding unit is sandwiched between two of the multiple light projection units.

[0025] In these multi-unit light guiding devices, each light guiding unit is selectively operated. More specifically, each light guiding unit can operate independently, either associated with its own enhanced image source or its owner (or at least a portion thereof) can be associated with a common image source used to selectively switch to guide the enhanced image light to one of the plurality of light guiding units.

[0026] Each optical projection unit is configured (e.g., having an optical profile) such that, depending on which of the plurality of optical guiding units operates during an imaging period, the individual optical projection unit (i.e., the optical projection unit that interacts with both the enhanced image light and the real image light) affects the light propagation through it, such that the interaction between the enhanced image light and the individual optical projection unit provides the desired effect (focal length change), but the interaction between the real image light and the individual optical projection unit during the real image light's passage through the system does not cause any focal length change.

[0027] The present invention also includes an augmented reality system comprising an augmented image source and the aforementioned optical system, the augmented image source generating input light representing an augmented image to be projected onto a viewer. The augmented image source may include an image generator and a collimation module such that the input light received by the light guiding device is collimated light representing the augmented image to be projected.

[0028] According to another broad aspect of the invention, an optical system for an augmented reality imaging system is provided, the optical system comprising:

[0029] An optical transmission waveguide is configured to receive input light representing an enhanced image to be projected, guide the input light representing the enhanced image, and couple the light out of the waveguide to propagate along an output path toward an imaging plane.

[0030] A projection optics device includes an image enhancement projection unit and a real image projection unit. Each unit has a fixed field of view and multiple different focusing parameters in multiple different regions corresponding to multiple different viewing areas within the field of view. The image enhancement projection unit and the real image projection unit are located in multiple separated planes that are substantially parallel along a common optical axis and located on multiple opposite sides of an optical transmission waveguide. The image enhancement projection unit and the real image projection unit are arranged in an oppositely symmetrical manner with respect to the waveguide system, such that the multiple different focusing parameters of the real image projection unit compensate for multiple effects of the multiple different focusing parameters of the image enhancement projection unit, and that the interaction between the light representing the enhanced image and the light representing the real image and each of the multiple different regions guides the light representing the enhanced image and the light representing the real image along substantially the same output path, thereby providing multiple focused images on the imaging plane for the light representing the enhanced image and the light representing the real image.

[0031] According to another broader aspect, the present invention provides an optical system for an augmented reality imaging system, the optical system comprising:

[0032] A light guiding device includes at least one light combining plate, the at least one light combining plate being used to guide input light representing an enhanced image to propagate along an output path in a predetermined direction and to guide input light representing a real image of a scene to propagate along the output path;

[0033] A projection optical device has a fixed field of view and multiple different focusing parameters in multiple different regions, which correspond to multiple different viewing areas within the field of view. The projection optical device includes an image enhancement projection unit that is positioned on the optical path of the input light representing the enhanced image as it propagates toward the light guiding device. This allows the user's line of sight to intersect the multiple different regions at different angles when using the optical system, thereby providing focused viewing of multiple objects at different distances.

[0034] Another aspect of the present invention provides an optical system for use in an augmented reality imaging system, the optical system comprising:

[0035] A light guiding device includes at least one light combining plate for guiding input light representing an enhanced image to propagate along an output path in a predetermined direction and for guiding input light representing a real image of a scene to propagate along the output path.

[0036] A projection optical device having a fixed field of view and multiple different focusing parameters in multiple different regions corresponding to multiple different viewing zones within the field of view, the optical device including a real image projection unit located on the optical path of the light representing the real image as the light representing the real image propagates toward the light guiding device, the light guiding device combining the light representing the real image with the light representing the enhanced image being projected and guiding them along a common path to the imaging plane.

[0037] According to another broader aspect of the invention, an optical system for use in an augmented reality imaging system is provided, the optical system comprising:

[0038] A light guiding device for guiding input light to propagate to an imaging plane, the input light comprising light representing an enhanced image to be projected and input light representing a real image of an external scene, wherein the light guiding device comprises an array of at least two light guiding units arranged in a spaced relationship along the optical axis of the system, the at least two light guiding units being configured to selectively involve one of them during imaging; and

[0039] A projection optics device has a fixed field of view and multiple different focusing parameters at multiple different regions corresponding to multiple different viewing zones within the field of view. The projection optics device includes multiple light projection units arranged in a spaced-apart relationship along the optical axis of the system, such that each of the multiple light guiding units is sandwiched between a pair of light projection units. Depending on a selected light guiding unit involved in the imaging process, one or more of the multiple light projection units are located on the optical path of the light representing the real image propagating toward the selected light guiding unit, and one or more of the other light projection units are located on the selected light guiding unit. The output of the guiding unit is located in the optical path of both the light representing the enhanced image and the light representing the real image. The plurality of light projection units are used to induce a compensating optical effect on the light representing the real image, such that the interaction between a portion of the light representing the enhanced image and one or more regions of the one or more light projection units induces a desired effect of focal length change on that portion of the light representing the enhanced image, and the interaction between a portion of the light representing the real image and one or more regions of the other projection units induces the compensating optical effect on that portion of the light representing the real image, thereby maintaining the focal length of that portion of the light representing the real image substantially unchanged.

[0040] The present invention also provides an optical system for use in an augmented reality imaging system, the optical system comprising:

[0041] A light guiding device for guiding input light to propagate to an imaging plane, the input light comprising light representing an enhanced image to be projected and input light representing a real image of an external scene;

[0042] A projection optics device has a fixed field of view and multiple different focusing parameters in multiple different regions corresponding to multiple different viewing areas within the field of view. The projection optics device includes a light projection unit located in an optical path in which the light representing the enhanced image and the light representing the real image are output from a light guiding device and propagate toward an imaging plane. The light projection unit has a predetermined optical power profile defining the multiple different focusing parameters, which are configured according to the optical power profile of the viewer's individual multifocal lens and are used to induce a compensating optical effect on the light representing the real image. This effect causes a focus change on the light in each of the multiple regions of the projection optics device, whereby the interaction between a portion of the light representing the enhanced image and the light representing the real image with that region, and this focus change compensates for the focus changes that are sequentially caused by the interaction of the light with the alignment area of ​​the multifocal lens. Attached Figure Description

[0043] To better understand the objectives disclosed herein and to illustrate how they can be practically implemented, embodiments will now be described by way of non-limiting examples with reference to the accompanying drawings, in which:

[0044] Figure 1 This is a brief illustration of the light propagation scheme in the waveguide structure used in a head-up display system;

[0045] Figure 2A and 2B Examples of enhanced image presentation effects are given in both conventional augmented reality systems and systems using the optical system of the present invention.

[0046] Figure 3A and 4A Two examples of augmented reality systems using optical systems from different embodiments of the present invention are illustrated with block diagrams.

[0047] Figure 3B and 4B Examples will be given in more detail. Figure 3A and 4A System configuration of the embodiment;

[0048] Figure 5 and 6 More specific examples are given below. Figure 4A The system configuration enhances the light propagation scheme affected by the image projection unit and the real image projection unit;

[0049] Figure 7 Example in Figure 4A The system configuration enhances the light propagation scheme affected by the image projection unit and the real image projection unit, wherein these units are implemented with bifocal lenses;

[0050] Figure 8 Example usage Figure 4A The optical system of the embodiment converges to the operation of the binocular display system;

[0051] Figure 9 Examples of FOV for asymmetrical eyeboxes;

[0052] Figure 10A Example Figure 4A The optical system of this embodiment is used in a progressive near-eye display designed for use in front of a personal progressive lens;

[0053] Figure 10B Another embodiment of the optical system of the present invention is illustrated for use in an augmented reality system designed for use in front of a personal progressive lens;

[0054] Figure 11 The configuration and operation of an optical system according to another embodiment of the present invention are illustrated in a schematic diagram, wherein the optical projection device may include only a real image projection unit;

[0055] Figure 12 More specific examples are shown in Figure 4A or Figure 11 The light propagation scheme generated by the real image projection unit in any embodiment of various binocular image convergence;

[0056] Figure 13 More specific examples are shown in Figure 4A or Figure 10A The effect produced by the projection optics in light propagation in the embodiments;

[0057] Figures 14A to 14C Examples of lens configurations in image enhancement and real image projection units; and

[0058] Figure 15 Another embodiment of the projection optics device of the present invention is illustrated in a schematic manner, wherein both the light guiding device and the light projection device are configured as multi-unit components. Detailed Implementation

[0059] This invention provides a novel optical system for augmented reality imaging systems, such as see-through near-eye displays or head-up display systems. In this context, reference is first made to… Figure 1 , Figure 1 The general configuration and operating principle of a known head-up display system using an optical system in the relevant field of this invention are briefly illustrated.

[0060] Figure 1 An example of a light propagation scheme in an optical system 100 is shown, which includes a light transmission waveguide 20 (such as a planar waveguide) configured as a light-guiding optical element (LOE) or substrate to guide light through it via total internal reflection (TIR). The waveguide 20 has a light input region 21 (which is aligned with the output of an image enhancement source 5 (which includes an image generator 4 and possibly a collimation module 6)) and light guiding interfaces 16 and 22 disposed within the waveguide in appropriate orientation.

[0061] As shown, multiple light waves 18, representing the enhanced image, output from the image enhancement source 5 and properly collimated, interact with the reflective interface 16 (which reflects these light waves), causing them to be trapped within the planar waveguide substrate 20 due to total internal reflection. After undergoing several reflections from the main lower and upper surfaces 26, 28 of the substrate 20, the trapped light waves reach the partially reflective surface (or multiple partially reflective surfaces) 22, where they couple light away from the waveguide and propagate along the general direction of propagation toward the pupil 25 of the viewer's eye 24.

[0062] As shown in the figure, it is known that using optical components such as lens 82 in optical device 100 can enhance image light L 增强 and real image light L 实像Focusing onto a specified focal plane and selectively correcting other aberrations of the viewer's eye, such as astigmatism. Such optical systems are described, for example, in publication WO 2016 / 103251, which has been assigned to the assignee of this application.

[0063] Now for reference Figure 2A and 2B Its general example illustrates that, regardless of whether a corrective lens 82 is used, it inevitably appears in traditional augmented reality systems such as Figure 1 The effects in system 100 shown. Figure 2A Examples are given above Figure 1 The virtual / enhanced image presented to the user / viewer in system 100. As can be seen, the image presented to the user (text in this example) is a "flat" image in the focal plane (or conjugate plane) defined by optical system 100. Therefore, in such a flat image, all letters (features) in the text have the same size and virtual distance because of the fixed predetermined optical power of the optical system (as defined by the collimation module).

[0064] Figure 2B This example illustrates augmented images of the same text, presented in different ways, as desired in some augmented reality applications. As can be seen, the same original flat image / text appears tilted relative to the system's optical axis. Therefore, the size of the letters varies in the virtual image, making letters (features) corresponding to nearby objects appear larger than those corresponding to distant objects. In this example, the size of the features varies gradually. In other words, larger letters in the augmented text image appear to appear at a virtual distance closer to the user, while smaller letters appear to appear at a virtual distance farther from the user, even though they are all actually the same size / size and angular orientation (relative to the line of sight) in the augmented image generated from the image source. Therefore, the document (augmented image) will be presented to the viewer in a tilted plane, i.e., not perpendicular to the optical axis defined by the augmented reality imaging system. The presentation of the augmented image is consistent with the focus and convergence distances, which will be explained further below.

[0065] As will be further explained below, the optical system of the present invention provides the ability to achieve Figure 2B The above-described enhanced image presentation / projection effects are illustrated but do not affect the presentation / projection of the real image of the scene. It should also be understood that, considering... Figure 2BIn specific, but not limiting, instances, the focal distance at which virtual objects appear can vary in the opposite direction: larger letters in an augmented text image appear to appear at a virtual distance farther from the user, while smaller letters appear to appear at a virtual distance closer to the user, even though they are all actually the same size and angular orientation (relative to the line of sight) in the augmented image produced by the image source; letters / features at closer and farther distances may have different sizes, but the resulting focal shift makes them appear to be the same size.

[0066] In general, the optical system of the present invention aims to improve both the enhanced image and the real image presented to the viewer. In this invention, this is achieved by configuring the optical system such that the projected light portions representing the enhanced image and the real image, respectively, propagate along a common optical path (or multiple common optical paths) to the viewer's eye (image plane). For example, the enhanced image and real image of a near object propagate along a common projection path (i.e., the same convergence / same focal distance), while the enhanced image and real image of a distant object propagate along the same projection path.

[0067] To achieve this objective, the optical system of the present invention includes additionally specially designed projection optics. In some embodiments of the invention, the projection optics are used to apply variations in optical power to the enhanced image, but avoid such variations in the projected real image. In some other embodiments, the projection optics are used to apply variations in optical power to both the enhanced image and the real image, such that the enhanced image is modified in the imaging plane while the real image is maintained. In another embodiment, the optical system of the present invention is used to affect only the light representing the real image. In this way, both the virtual image and the external world are focused to infinity in the far field of view (upper FOV) where the object is far away and to infinity in the near field of view (lower FOV) where the object is usually close.

[0068] refer to Figure 3A and 4A The diagram illustrates two embodiments of the imaging system 200 used in augmented reality applications employing the optical system 202 of the present invention. For ease of understanding, the same reference numerals are used in all instances to identify the same components.

[0069] Generally, augmented reality imaging system 200 includes such main components (functional and structural components) as an augmented image source 205, a light guide device 210, and a projection optics device 240, which can be configured and operated according to the present invention. A common feature of all configurations of system 200 is that the light guide device 210 is used to guide the input light L. 增强 and input light L 实像 The input light L propagates along a general direction to the imaging plane (i.e., to the viewer's eye). 增强The input light L represents the enhanced image to be projected. 实像 Represents a real image of the external scene. Such a light guiding device 210 may have any suitable configuration defining one or more beam-combining surfaces (such as partially reflective and / or diffracting surfaces), each surface used to reflect / diffuse enhanced image light L. 增强 And make real image light L 实像 It penetrates to reach the imaging plane.

[0070] The projection optical device 240 of the present invention has a fixed field of view (FOV) and multiple different focusing parameters at multiple different regions of the device, corresponding to multiple different viewing zones (at least a first viewing zone and a second viewing zone) within the FOV. Generally, such at least the first viewing zone and the second viewing zone are composed of at least a far-seeing zone and a near-seeing zone.

[0071] It should be understood that, for the purposes of this application, multiple different viewing zones are multiple physical regions of device 240, corresponding to multiple different focusing parameters in its field of view (FOV). These regions of device 240 are multiple areas where the viewer's line of sight intersects in different directions when the viewer moves their pupil to observe objects at different distances.

[0072] The 240 series projection optics are configured such that each focusing parameter (corresponding to each area) is optimized for enhancing image light. 增强 A focused image is provided in the imaging plane IP. The actual image of the scene, however, is not affected by the projection optics 240 and is therefore seen by the viewer based on their visual acuity. As will be further illustrated below, the viewer's visual acuity can be defined with or without their glasses or contact lenses. In other words, each focusing parameter of the device 240 and the corresponding area of ​​the device defines a different focus for the enhanced image. Essentially, the projection optics 240 is used to influence the light L representing the enhanced image. 增强 Therefore, for example, the images of distant and near objects in the enhanced image will be affected by the different focusing parameters (such as optical power) of the projection optics 240.

[0073] refer to Figure 3A In an embodiment, the projection optics 240 includes a light source L located at the self-enhancing image source 205 propagating toward the light guide device 210. 增强 The image enhancement projection unit 240A is located on the optical path OP1. Therefore, the projection optics 240 only projects the image enhancement light L. 增强 Before interacting with the light guide device 210, the image enhancement light L is affected. 增强 The propagation, but the real image of light L 实像 The propagation remains unchanged. Therefore, for example, as in... Figure 2B As illustrated, it can produce tilted enhanced images, but the actual scene will not be affected by device 202.

[0074] As described above, the projection optics 240 is configured to have multiple different focusing parameters across its field of view. These different focusing parameters are associated with multiple different viewing zones, which are multiple different areas of the projection optics 240. When the system is used (by a viewer), these multiple different areas of the projection optics 240 are aligned with different angular orientations of the user's line of sight when viewing objects at different distances.

[0075] Therefore, the collimated light L representing the enhanced image generated by image source 205 增强 The light interacts with (e.g., passes through) the intensifying image projection unit 240A at a specific area and undergoes individual focusing / convergence (defined by the focusing parameters of that specific area), then is reflected by a portion of the reflective surface (light-binding surface) of the light guiding device 210 toward the projection path CP and focused onto the imaging plane IP (the viewer's eye or eyebox). Simultaneously, the real image light L propagates along the path CP... 实像 It interacts with (e.g., through) a portion of the reflective surface of the light guide device 210 without being altered, and then continues to propagate along its original projection path CP and is focused onto the imaging plane IP (the viewer's eye).

[0076] It should be understood that, generally speaking, if the light portion L... 增强 With L 实像 If the propagation path corresponds to the same focal distance, then the light portion L 增强 With L 实像 The propagation path will be combined into the common output projection path CP. Therefore, in cases such as Figure 3A In the specific configuration of the projection optics device 240 illustrated only with the enhanced image projection unit 240A, the enhanced image light L 增强 The focal distance is affected at the interaction area with the image enhancement projection unit 240A and is appropriately modified. The operation of this image enhancement projection unit 240A will be described in the following reference. Figure 3B More specific explanation.

[0077] Generally, for all embodiments of the present invention, the projection optics 240 may include one or more lenses such as bifocal lenses, trifocal lenses, progressive zoom lenses, and / or any other optical device or component having multiple varying focusing parameters within its field of view. As the virtual object moves from the upper part to the lower part of the FOV of the projection optics, its focal distance changes, and the convergence of the enhanced image rays changes accordingly. Figure 4AIn this embodiment, the projection optics device 240 is a two-component device comprising an enhanced image projection unit 240B and a real image projection unit 240C. The enhanced image projection unit 240B and the real image projection unit 240C are respectively disposed on opposite sides of the light guiding device 210 along a common optical axis in a spatially separated parallel plane. Each of the enhanced image projection unit 240B and the real image projection unit 240C has the same fixed field of view (FOV). Relative to the imaging plane, the enhanced image projection unit 240B is disposed on the front side of the light guiding device 210, while the real image projection optics unit 240C is disposed on the rear side of the light guiding device 210. Therefore, the real image projection unit 240C is located at the real image plane. 实像 On the optical path, the image enhancement projection unit 240B is located on the real image light L. 实像 With enhanced image light L 增强 On the optical paths of both, the configuration of the light guide device 210 and the projection optical unit 240 is "static" in terms of fixed optical characteristics (i.e., field of view, optical power / focus profile across FOV).

[0078] As described above, the light guiding device 210 may have any suitable configuration, such as having at least one light-binding surface (partially reflective / diffractive surface) for guiding the enhanced image light and real image light incident thereon. For example, in Figure 4A In the embodiments, the light guiding device 210 is configured as an optically transparent light guiding optical assembly LOE, which has the function of guiding enhanced image light L through total internal reflection. 增强 The main internal surface of total internal reflection, and the surface used to reflect light L 增强 Reflected towards the projection path but to external light L 实像 It is transparent, thus making the real image L 实像 It penetrates at least a portion of the reflective surface that propagates toward the viewer.

[0079] For the enhanced image projection unit 240B (and the above reference) Figure 3A The requirements for the aforementioned unit 240A are consistent with those mentioned above. Figure 2A-2B The aforementioned "tilt" effect is related to the requirements. However, in the case where the enhanced image projection unit 240B is configured to enhance the image light L... 增强 In the configuration of the output path, this type of enhanced image projection unit 240B will inevitably also affect the real image light L. 实像 To this end, a real image projection unit 240C is provided to compensate for the shortcomings of the enhanced image projection unit 240B in real image light L. 实像 The effect on.

[0080] More specifically, the image enhancement projection unit 240B and the real image projection unit 240C have the same field of view (FOV). Each of the image enhancement projection unit 240B and the real image projection unit 240C is configured to have multiple different focus parameters corresponding to multiple different regions within its field of view, and units 240B and 240C are aligned in a reverse symmetrical manner with respect to a plane of the light guiding device 210. This means that the optical power profile (i.e., multiple different regions with multiple different focus parameters) across the FOV of the image enhancement projection unit 240B is aligned in a reverse symmetrical manner with the optical power profile of the real image projection unit 240C. This alignment results in the real image light L 实像 When propagating along its original direction, the real image light L 实像 The image passes through unit 240C and undergoes focus modification therein (if projection unit 240B applies a defocusing effect, then projection unit 240C applies a corresponding focusing effect), and then passes through real image light L. 实像 Propagation is achieved by applying effective (non-compensatory) focus modification to the enhanced image light L. 增强 The enhanced projection unit 240B compensates for the real image light L 实像 The focus is modified in unit 240C. Therefore, real image projection unit 240C is used here as a compensating optical unit to enhance the focus of image projection unit 240B in light L. 实像 The optical effects on it are invalid.

[0081] For example, real image and intensified image projection units 240B and 240C may include progressive lenses (with a continuously changing focal point across the FOV of the lens), which are aligned in the following opposite symmetrical manner: one of these lenses may be a progressive lens with continuously increasing optical power from the lower part of the lens, i.e., the lower part of the FOV (usually used to view near objects) to the upper part of the lens, i.e., the upper part of the FOV (usually used to view distant objects), and the other lenses with the same FOV are progressive lenses with continuously decreasing optical power from the lower part of the lens to the upper part of the lens.

[0082] For reference Figure 3B More specific examples Figure 3A Operation of system 200 in this embodiment. In this embodiment, the projection optics 240 includes only the enhanced image light L located towards the light guiding device. 增强 The image enhancement projection unit 240A is located on the optical path OP1. The input image enhancement light L from the image source 205... 增强Interacting with (e.g., through) a region of the enhanced image projection unit 240A, the enhanced image projection unit 240A has a specific fixed FOV and multiple different focusing parameters at its various different regions. In this non-limiting example, the enhanced image projection unit 240A includes a lens, such as a progressive lens, with a continuously varying focal length. As stated above, the principles of the invention are not limited to the use of a progressive lens, nor are they limited to any other configuration with a continuously varying focal length. Enhanced image light L 增强 The propagation convergence coefficient is modified through interaction with this region of the lens, and it is based on the focusing parameters at that region. The enhanced image light L, modified in this way and possessing this propagation convergence, is... 增强 The light incident on the light-guiding surface of the light-guiding device 210 guides the light to the user's eye (image plane). Thus, the interaction between the enhanced image light and each of the multiple different regions of the lens 240A with different focusing parameters provides the presentation of individual enhanced objects / features at different virtual distances from the image plane, representing virtual objects / features that are closer or farther from the viewer.

[0083] As shown in the figure, the enhanced image light L 增强 Different representations of virtual objects are provided through convergence modifications resulting from interaction with multiple different regions of lenses with different focusing parameters. In this example, such different representations are exemplified by the representation of near object NO and far object FO as observed by the user.

[0084] like Figure 3B As shown, the viewer sees enhanced image light from virtual objects FO and NO through the light guide 210 of the near-eye display 200. The enhanced image light passes through lens 240A, which changes the focus of the virtual image in different ways across the lens. The enhanced image light interacts with a portion of lens 240A with the lowest negative optical power, providing a virtual object presented as a distant object FO (e.g., at 6 meters). The enhanced image light interacts with a portion of unit 240A (e.g., a lens) with higher negative optical power, providing a virtual object presented as a near object NO (e.g., at 1 meter). The continuous focus changes of unit 240A cause the presentation of the virtual object to exhibit continuous distance variations along the virtual focal plane FP.

[0085] Considering instances of continuously varying focus in projection optics, a virtual focus plane FP is generated. In this context, it should be understood that, generally speaking, the virtual focus profile can be continuous or discontinuous across all embodiments of the invention; for example, it can be discontinuous for multiple discrete regions spanning multiple different focus parameters of the projection optics. In other words, the shape of the virtual focus profile corresponds to the focus / optical power profile spanning the FOV of the projection optics.

[0086] As shown in the figure, the real image light L propagates from a distant object RO (e.g., 6 meters away). 实像 The light enters the viewer's eye through the light-guiding device 210's light-binding surface. Therefore, in this example, the progressive lens 240A is only guided with the image-enhancing light L. 增强 In the optical path, but the light from the real [world] 实像 It will not be affected by the system's optical components.

[0087] It should be noted that, generally speaking, for all embodiments of the present invention, the application of the projection optics 240 in the system 200 can be achieved by modifying the optical components of the system, by using the internal guide device 240 (or one or more of its lenses), or by modifying the surface of the light guide device 210 (to produce minimal distortion to the "world"). Further explanation will follow.

[0088] Therefore, the projection optics device 240A provides that the enhanced image light portion corresponding to the near and far virtual objects is coupled and leaves the light guiding unit 210 along different projection paths CPN and CPF, and the different projection paths CPN and CPF are the common path of the real image light originating from the near and far real objects RO.

[0089] refer to Figure 4B Special examples Figure 4A An operational example of the system in this embodiment, wherein the projection optics unit 240 includes an enhanced image projection unit 240B and a real image projection unit 240C. The enhanced image projection unit 240B is located at the enhanced image light output from the light guiding device 210. 增强 With real light L 实像 On the optical paths of both. The light guiding device 210 can be an optical transmission waveguide, which passes through its main surface (e.g., Figure 1 The total internal reflection (as shown in the diagram) guides the enhanced image input light L. 增强 And enhances the image input light L through reflection from the partially reflective surface. 增强 Coupling is broken. This is to make the real image light L... 实像 The light penetrates the surface. The real image projection unit 240C is located at the real image light L. 实像 On the optical path.

[0090] In this particular, but not limiting, example, projection units 240B and 240C have the form of progressive lenses with opposite symmetry. As should be understood above, multiple projection units generally have opposite symmetric focal / optical power profiles across the same field of view, and these profiles may correspond to continuously varying focal points or multiple discrete regions with different focal points.

[0091] The viewer sees through the optical system 202 of the near-eye display system 200 and perceives light from virtual objects (in this example, distant and near objects FO and NO). To achieve this, an image projection unit 240B (such as a progressive lens) provides light L. 增强 and light L 实像 Interacting with the same area of ​​the lens induces separate convergence on both of these light portions. More specifically, the upper part of lens 240B (the upper part of the FOV) applies minimal negative optical power to the interacting light, so that each virtual image appears to originate from a distant object FO (e.g., 6 meters). The lower part of lens 240B (the lower part of the FOV) applies stronger negative optical power to the virtual image light, so that the virtual image appears to originate from a nearby object NO (e.g., 1 meter). Continuous focal changes of lens 240B produce continuous changes in the virtual focal plane FO. As described above, the shape of the virtual focal profile roughly corresponds to the focal / optical power profile spanning the FOV of the projection optics 240.

[0092] In this configuration, the real image light undergoes the same focal length changes (convergence changes) as the enhanced image light through the enhancement projection unit 240B. However, the real image light does not require these changes. Therefore, a compensated real image projection unit 240C, configured as described above, is provided. The real image-dependent progressive lens 240C is adjacent to and located on the opposite side of the light guide device 210, and its design gives it an optical power profile opposite to that of the lens 240B. In this way, the actual "world" objects are not affected by the system.

[0093] refer to Figure 5 and 6 More specifically, they are respectively subject to Figure 4A The light propagation scheme affected by the enhanced image projection unit and the real image projection unit in the system configuration.

[0094] like Figure 5 As shown, the waveguide of the light guiding device 210 outputs enhanced image light L for each of the two virtual images associated with objects NO and FO. 增强 A parallel beam of light. When this light passes through the image enhancement projection unit (in this example, the image enhancement projection unit is a progressively diverging lens 240B), the light experiences different amounts of divergence at different interactive positions / areas of the lens 240B. Therefore, the two virtual objects FO and NO appear to be located at different virtual distances. Thus, the enhanced image light modified in this way reaches the imaging plane, that is, the position in space where the viewer experiences the designed performance. It should be noted that points FO and NO are merely examples; the image enhancement projection unit 240B can produce a virtually continuous virtual focal plane or any other discrete focal profile (such as that of a bifocal lens). The orientation of the virtual focal profile can be non-vertical. It can also have a lateral orientation.

[0095] Figure 6 The optical scheme for displaying the propagation of real image light. Light rays from distant and near objects ROF and RON are incident on the real image projection unit 240C (zoom lens). Multiple different regions of lens 240C have multiple different focusing parameters. These different regions interact with the light rays associated with distant and near objects and apply different focus changes to these light rays, which then pass through waveguide 210. In this way, the real image light and enhanced image light of RON and ROF at a predetermined distance emitted from waveguide 210 are all collimated (focused to infinity) and thus correlated. Although not specifically shown in the figure, it should be understood that the real image and enhanced image light may then pass through lens 240B to produce a virtual imaging plane.

[0096] Figure 7 The operation of the optical system of the present invention using a bifocal configuration of a projection optics device 240 is illustrated. The projection optics device 240 includes an enhanced image projection unit (bifocal lens) 240B and a real image projection unit (opposite bifocal lens) 240C configured as described above. As shown, in this configuration, the focal profile FP has the form of discrete focal distance / position FPF and FPN to produce two separate and distinct virtual images. The upper part of the FOV generates the focal position FPF, while the lower part of the FOV generates the focal position FPN. Similarly, trifocal lenses and any other lenses with discrete focal values ​​can be used to produce corresponding discrete focal profiles.

[0097] Figure 8 The configuration of an optical system 202 for a binocular display system is illustrated in a self-explanatory manner. System 202 includes two similar units 202A and 202B. Each such unit is configured as described above. Figure 4A The configuration is as described in the embodiment. However, it should be understood that it can be used... Figure 3A Examples and references below may be used Figure 11 Another embodiment described above.

[0098] It should be understood that the projection optics 240 in units 202A and 202B are arranged in a reverse symmetrical manner with respect to the central line CL located between them and parallel to its optical axis. For each focusing parameter, the virtual objects generated by units 202A and 202B coincide in space. This is illustrated for virtual objects NO and FO. The gradual change in the focal distance of the virtual objects is accompanied by a continuous change in the convergence of the enhanced image light output by the enhanced image projection unit. It should be noted that in some cases, the convergence is designed (i.e., individual lenses are configured) to be less than the nominal value of the focal point to maintain leeway for different viewing distances.

[0099] Figure 9Examples of the shape / geometry of components of the optical system 202 in an augmented reality application are shown. As illustrated, the eyeboxes (for the left and right eyes) have opposite symmetrical shapes with respect to the central line CL, which lies between them and is perpendicular to their optical axis. Moreover, each of these optical components can have an asymmetrical shape because short-distance observation mostly uses a narrower FOV and the eyes tend to converge. The same principle applies to the monocular boxes for both eyes, as shown in the figure, where the FOV can be configured as a "portrait".

[0100] refer to Figure 10A This example illustrates the use of the optical system of the present invention in front of a personal progressive lens (known in the eyewear market) used by a viewer. In this embodiment, the personal progressive lens 50 is closer to the optical system 202, i.e., downstream of the optical system 202 relative to the light propagating to the user's eye. The system has... Figure 4A In this non-limiting example of the general configuration, the progressive lens 50 is positioned closer to the image enhancement projection unit 240B. Generally, the optical system of the present invention can be conveniently used by users of progressive glasses. In a binocular configuration, the convergence of the light rays enhancing the image can be determined according to the focal profile of the individual progressive lens 50. However, since progressive glasses introduce minimal or no convergence between the two eyes (thus creating accommodation-convergence inconsistency, especially at near distances), the convergence (modification) of the virtual image light rays induced according to the present invention can be set to minimal or no. Thus, the convergence of the virtual image light rays is set to produce accommodation-convergence consistency.

[0101] refer to Figure 10BThis schematically illustrates an optical system 202 of the present invention with a slightly different configuration, configured as an augmented reality system for use by a viewer with personal multifocal glasses 50. In this embodiment, system 202 includes a light guiding unit 210 and projection optics, the projection optics comprising only an enhanced image projection unit 240B located at the output of the light guiding unit 210. Such a configuration may be advantageous where viewers prefer to use near-eye displays without removing their glasses and where the virtual image and the “world” are focused to infinity across the field of view (FOV). This is because, in most cases, glasses also correct for aberrations. In this embodiment, the enhanced image projection unit (such as a multifocal lens) 240B is configured to counteract or disable the optical effects of the progressive focus (approximate focus variation) of the glasses 50. Therefore, the light projection unit 240B has a predetermined optical power profile (defining multiple different focusing parameters (across the FOV)) configured according to a predetermined optical power profile of the viewer’s personal multifocal lens, making it oppositely symmetrical with respect to the optical axis of the system. Therefore, for each of the multiple regions of unit 240B, the interaction between the enhanced image light and a portion of the real image light with this region will cause a focus change on the interactive light, and this focus change will compensate for the focus changes continuously caused by the interaction of the light with the alignment area of ​​the multifocal lens 50.

[0102] For reference Figure 11 This schematically illustrates an example of the configuration and operation of an optical system 202 according to a further embodiment of the present invention. In this embodiment, the system includes a light guiding device 210 and a projection optics device 240. The light guiding device 210 defines at least one light-binding surface / plate for reflecting / diffusing the enhanced image light and allowing the real image light to pass through. The projection optics device 240 may only include a real image projection unit 240C. As described above, in some cases, the desired real image projection is similar to the projection of a multifocal lens (such as a progressive lens), which focuses both the enhanced image and the external environment to infinity in the upper part of the FOV (where the object is far ROF) and the lower part of the FOV (where the object is typically near ROF). This requires modification of the light representing the projected real image. In this configuration, the viewer sees both a real image and a virtual image focused to infinity.

[0103] Figure 12 To exemplify more specifically Figure 11 The illustrated optical system of the present invention produces a light propagation scheme. It should be noted that variable compensation for real-image light convergence across the field of view (FOV) may be difficult to achieve in a progressive lens. Component RO represents a distant object imaged through the progressive lens. For the propagation path associated with each eye, the ray L... 实像(Solid lines) are parallel, but not between the eyes. Virtual images can be generated electronically to have the desired light pattern (represented by dashed lines). This is convenient when observing both real and virtual objects simultaneously. However, when observing only a virtual image, convergence to fit the adjustment represented by the dashed lines is more convenient.

[0104] Figure 13 The superior features of the optical system of the present invention are briefly illustrated. It should be understood that, although it is based on… Figure 4A and 4B The optical system configuration is illustrated above, but the above configuration applies to all systems. Figures 3A-3B The system configuration for version 11 and the following references Figure 15 The same applies to the example. As indicated by arrow 75, a viewer using a near-eye display system incorporating the optical system of the present invention is moving their head relative to the display system. Therefore, the virtual focal plane FP is the path shown by arrow 75. However, the virtual image can be electronically set to maintain spatial relative positioning and appear to move upwards and further away along the focal plane FP in direction 77. The system configuration allows the user to change the focus or virtual distance as needed. Alternatively, the user can move a virtual object upwards into the field of vision without moving their head. This will have the same result: the object will move upwards and away along the arrow. In essence, the viewer can use both of these methods to change the object distance and correlate it with the real object distance.

[0105] refer to Figures 14A to 14C This illustrates certain geometric features of projection optics such as progressive lenses (or multiple progressive lenses). The design of multifocal lenses (such as progressive lenses) is a known method. However, for the purposes of this application, multifocal lenses should preferably occupy the minimum volume of the optical system. The goal of minimizing volume can be achieved if the back surface 80 of the lens is designed to conform to the adjacent outer surface of the light guiding device (waveguide) 210. In most cases, it is a flat surface (such as...). Figures 14A-14B (As illustrated in the example). To achieve optimal optical performance, the opposite lens should also be adjacent and have a conformal back surface 82. It can be attached to waveguide 210, provided that this surface can maintain total internal reflection within the waveguide. Various examples of these features and manufacturing techniques that can achieve these features are described in WO 2016 / 103251, which is co-assigned to the assignee of this subsequent application, and in co-pending application PCT / 2016 / 050523. The above-mentioned documents are incorporated herein by reference with respect to this aspect of the invention.

[0106] According to the present invention, the shapes of surfaces 84 and 86 can be modified to produce the desired progressive optical power. These shapes can be designed based on a weighted average.

[0107] like Figure 14CAs shown, the surface of the lens facing the waveguide may not be planar. This can be illustrated in the figure for surface 82' of a lens among a plurality of lenses. However, it should be understood that this feature may be used for one or more lenses in any of the above embodiments.

[0108] Similar to the methods used for progressive lenses in eyeglasses, the optimization of the shape of the facing surface of these lenses can involve various parameters. This illustrates the basic method for deriving the outer surface of the lens. However, it should be understood that other known suitable methods can be used.

[0109] According to the basic method, the following parameters are used: r is the position on the lens surface; R is the position of the collimated object in real space on the virtual focusing plane FP; P is the height / position of the lens surface, which is designed to generate a wavefront (in most cases a plane wave) from the wavefront correlation point R from the waveguide and can be derived using optical simulation software; f is a weighted function that depends on various parameters such as the position of the eyebox 90 that constitutes the pupil (e.g., the light outside the eyebox is not important).

[0110] Therefore, the profile P(r) of lens surface 84 is averaged as:

[0111]

[0112] More complex iterations can be used to optimize lens surfaces such as surfaces 86 and 84. All surfaces / interfaces of the projection optics (such as surfaces 80, 82 (or 82'), 84, and 86) can also be optimized.

[0113] like Figure 14B As further illustrated, the optical lens used as the projection optical unit in the system of the present invention can be based on a Fresnel lens. As shown in the figure, surfaces 186 and 184 of such lenses have the same optical properties, as described above. Figure 14A Examples 86 and 84. As is known, using Fresnel lenses can provide less weight and smaller size for optical systems.

[0114] Figure 15 A projection optical device 240 configured according to another embodiment of the present invention is schematically illustrated. The configuration of the device 240 in this embodiment is generally similar to... Figure 4AThe embodiment includes a light guiding device 210 and an image projection device 240 located on the optical paths of both the enhanced image light and the real image light. However, in this example, both the light guiding device 210 and the image projection device 240 are configured as multi-unit devices / assemblies. More specifically, the light guiding device 210 includes an array (typically at least two light guiding units) – three such light guiding units 210a, 210b, and 210c are shown in this example; and the light projection device 240 includes an array of multiple light projection units – units 240B', 240B”, 240B”’, and 240C are shown in this embodiment. It should be understood that the light projection unit 240C is the only unit that interacts only with the real image light but not with the enhanced image light. Each light guiding unit in the array is configured as described above, i.e., to guide the enhanced image input light toward the light output surface (light bonding surface) but allow the real image light to pass through and interact with the light output surface. The multiple light guiding units and the multiple light projection units are arranged in a separated relationship along a common axis (the optical axis of the system). Each light guiding unit (typically at least one or at least some of all light guiding units) is sandwiched between two light projection units. As shown in the figure, light guiding unit 210a is located between light projection units 240C and 240B'; light guiding unit 210b is located between light projection units 240B' and 240B"; and light guiding unit 210c is located between light projection units 240B" and 240B"'.

[0115] Therefore, real-image light propagates sequentially through all these units (and interacts with them). As for the multiple light guiding units, each of them operates selectively. More specifically, each light guiding unit can operate independently: each light guiding unit can be associated with its own intensifying image source, in which case the multiple image sources can operate selectively in a one-to-one manner, or at least some or all of the multiple image sources can operate simultaneously. Alternatively, at least some or all of the multiple light guiding units can be associated with a common image source. In the latter case, the common image source can selectively switch between different operating modes to guide the intensifying image light to different one or more of the multiple light guiding units. During a specific imaging period, the selection of light guiding units and / or the desired image source can be performed sequentially (the system scans multiple light guiding units and injects appropriate intensifying images into each); and / or an eye-tracking-based system can be used (the system uses an eye-tracking device to identify where the viewer is looking (i.e., the direction of the gaze) and injects the image into a suitable waveguide, taking into account the virtual image focus in that area).

[0116] Each of the light projection units 210a, 210b, and 210c has an optical profile (with different focusing parameters across the FOV) such that, depending on the light guiding unit (or multiple light guiding units) selected for operation during imaging, each light projection unit (i.e., the light projection unit that interacts with both the enhanced image light and the real image light) affects the light propagation through the system. To achieve this, the optical profiles of the light projection units 240B', 240B”, 240B”', and 240C are configured such that the interaction between the enhanced image light and the individual light projection units provides a desired effect (focal length change), but the interaction between the real image light and the individual light projection units during its passage through the system does not cause any focal length change.

[0117] Therefore, in Figure 15 In this example, light guiding units (waveguides) 210a, 210b, and 210c together form a light guiding device 210, and light projection units 240B', 240B”, 240B”’, and 240C (lenses with different focusing parameters / optical power profiles spanning a fixed FOV) together form an optical projection device 240. The combination of certain units in the optical projection device 240 forming the aforementioned enhanced image projection device and real image projection device may differ during various imaging processes. Here, at least two of the multiple lenses are progressive lenses. Therefore, multiple virtual focal planes FPa, FPb, and FPc can be generated by multiple light projection units operating in an enhanced image projection unit and waveguide manner, and the real image projection unit (or multiple real image projection units) (lenses (or multiple lenses) such as 240C) compensates for aberrations in the real world. The orientation of the virtual focal planes FPa, FPb, and FPc can be arbitrarily modified according to the enhanced image affecting the progressive lenses 240B', 240B”, and 240B”’.

[0118] It should be understood that, Figure 15 In the configuration, the optical power profiles of all light projection units (lenses) are configured such that the optical effects (focus changes) of one or more of them are selectively compensated by one or more others, so that the lens (or multiple lenses) of the image enhancement projection unit and the lens of the real image projection unit during a specific period are configured to compensate for the real image light correction caused by the image enhancement projection unit.

[0119] More specifically, targeting Figure 15For example, lens 240C is used to apply compensation / opposite effects to the effects caused by lenses 240B', 240B”, and 240B”' (for the case of operating only waveguide 210a); lenses 240B' and 240C are used to compensate for the real image modification caused by lenses 240B” and 240B”' (such as operating only waveguide 210b), and lenses 240C, 240B', and 240B” are used to compensate for the effect of lens 240B”' (operating only waveguide 210C).

[0120] Therefore, this invention provides a novel configuration and operation solution for an optical system in augmented reality systems (such as see-through near-eye display systems). The technology of this invention enables the use of an optical system with a fixed field of view, but provides the desired focal length variation across the field of view of the augmented image light and / or real image light applied to and projected onto the imaging plane (eyebox).

Claims

1. An optical system for an augmented reality imaging system, the optical system comprising: A light guiding device including a transparent light transmission waveguide configured to guide light representing a collimated and enhanced image to be projected via total internal reflection, and to transmit light representing a real image of an external scene to the eyebox; and A projection optics device has a fixed profile with optical characteristics and multiple different optical powers in multiple different regions, each region corresponding to a multiple different viewing area within the field of view of the projection optics device. The projection optics device is designed to influence the propagation of at least one of light representing an enhanced image and light representing a real image. Thus, for each of the different regions, the interaction between a portion of the light representing the enhanced image and a portion of the light representing the real image with the region guides the portion of the light representing the enhanced image and the portion of the light representing the real image along substantially the same output propagation path corresponding to the optical power of the region. Thus, for the portion of the light representing the enhanced image and the portion of the light representing the real image of the external scene, multiple focused images are provided in the eyebox, wherein the multiple different viewing areas are defined by the multiple different regions of the projection optics device, such that when using the optical system, the user's line of sight intersects the multiple different regions upwards at multiple different angular positions. in, The projection optical device includes an image enhancement projection device and a real image projection device. Each of the image enhancement projection device and the real image projection device includes at least one respective projection unit and has a fixed profile with optical characteristics and a plurality of different optical powers at the plurality of different regions, the plurality of different regions corresponding to the plurality of different viewing zones within the field of view. The image enhancement projection device and the real image projection device are arranged along a common optical axis in a separated but oppositely symmetrical manner, such that the plurality of different optical powers of the real image projection device compensate for the plurality of effects of the plurality of different optical powers of the image enhancement projection device.

2. The optical system according to claim 1, wherein the plurality of different regions with different optical powers are a plurality of discrete regions arranged in a separated relationship within the field of view of the projection optical device.

3. The optical system of claim 1, wherein the projection optics has a continuously varying focal point across the field of view, thereby giving the plurality of different regions the plurality of different optical powers.

4. The optical system of claim 3, wherein the light guiding device comprises at least one plate having at least a partially reflective or diffractive surface and configured to reflect or diffract the light representing the enhanced image and transmit the light representing the real image toward the eyebox.

5. The optical system according to any one of claims 1 to 4, wherein the plurality of different optical powers are included in at least first and second optical powers in at least first and second regions of the projection optics, the at least first and second regions corresponding to at least far-viewing and near-viewing regions for observing distant and near objects.

6. The optical system according to any one of claims 1 to 4, wherein the projection optics is configured to influence the propagation of light passing through it such that a virtual focal plane is generated, the virtual focal plane being tilted relative to the optical axis of the optical system.

7. The optical system according to any one of claims 1 to 4, wherein the image enhancement projection device includes an image enhancement projection unit located on the optical path of the light representing the image enhancement as the light representing the image propagates toward the light guiding device.

8. The optical system of claim 7, wherein the image enhancement projection device is configured to influence the propagation of light representing the enhanced image being projected, while simultaneously influencing the propagation of light representing the real image of the external scene.

9. The optical system of claim 7, wherein the enhanced image projection unit comprises at least one lens having the plurality of different optical powers.

10. The optical system according to any one of claims 1-4, configured for use in an augmented reality system placed in front of an observer's personal multifocal lens, the projection optics comprising a light projection unit located on the optical path of light output from the light guiding device and propagating toward the eyebox, the light projection unit having a predetermined optical power profile defining the plurality of different optical powers, the plurality of different optical powers compensating for the optical power profile of the observer's personal multifocal lens.

11. The optical system of claim 1, wherein the image enhancement projection device and the real image projection device are disposed at fixed positions opposite to the light guiding device, such that the real image projection device is located on the optical path of the light representing the real image propagating toward the light guiding device, and the image enhancement projection device is located at the output of the light guiding device in the optical paths of both the light representing the enhanced image and the light representing the real image.

12. The optical system of claim 1, wherein each of the image enhancement projection device and the real image projection device comprises at least one lens having similar optical properties and located in a plurality of substantially parallel separated planes along the common optical axis, but configured in opposite symmetrical manner with respect to the plane of the light guiding device, thereby exerting opposite optical effects on the passing light.

13. The optical system according to claim 1, wherein: The light guiding device comprises an array of at least two light guiding units, the at least two light guiding units being arranged in a spaced-apart relationship along the optical axis of the optical system, the at least two light guiding units being operable to selectively involve one of them during imaging; and The projection optics device includes a plurality of optical projection units arranged in a spaced relationship along the optical axis of the optical system, such that each of the at least two light guiding units is located between the plurality of optical projection units, and depending on a selected light guiding unit involved during the imaging period, one or more of the plurality of optical projection units are located on the optical path of the light representing the real image propagating toward the selected light guiding unit, and another one or more of the plurality of optical projection units are located at the output of the selected light guiding unit and in the optical paths of both the light representing the enhanced image and the light representing the real image.

14. The optical system of claim 13, wherein each of the plurality of optical projection units comprises at least one lens having a predetermined optical power profile defining the plurality of different optical powers, and each of the plurality of optical projection units is configured such that the position of the selected light guiding unit defines one or more of the plurality of optical projection units that interact with the light representing the enhanced image and the light representing the real image, and defines one or more of the other optical projection units that interact only with the light representing the real image.

15. The optical system of claim 14, wherein the plurality of light projection units are configured to induce a compensating optical effect on the light representing the real image, such that the interaction of a portion of the light representing the enhanced image with one or more regions of one or more of the plurality of light projection units induces a desired effect of focal length change on the portion of the light representing the enhanced image, and the interaction of a portion of the light representing the real image with one or more regions of one or more of the other light projection units induces the compensating optical effect on the portion of the light representing the real image, thereby maintaining the focal length of the portion of the light representing the real image substantially unchanged.

16. The optical system according to any one of claims 1-4, wherein the real image projection device is located on the optical path of the light representing the real image propagating toward the light guiding device, the light guiding device combining the light representing the real image with the light projected representing the enhanced image.

17. The optical system according to any one of claims 1 to 4, wherein the projection optical device comprises at least one lens, the at least one lens having one of the following configurations: a bifocal lens, a trifocal lens, or a continuous zoom lens.

18. An augmented reality system comprising: at least one augmented image source for generating input light representing an augmented image to be projected onto a viewer; and an optical system according to any one of claims 1 to 17.

19. The augmented reality system of claim 18, wherein the augmented image source comprises an image generator and a collimation module, and the input light received by the light guiding device is collimated light representing the augmented image to be projected.

Images