Binocular alignment for virtual image display

Abstract

a first image source system disposed within the frame, the first image source system including a first display panel having a first plurality of light sources; and a second image source system disposed within the frame, the second image source system including a second display panel having a second plurality of light sources, wherein at least one processor and at least one non-transitory computer-readable memory are configured to: generate, via the first display engine, a first image using a first subset of the first plurality of light sources; receive a first input signal; generate, in response to the first input signal, a second image using a second subset of the first plurality of light sources; and generate, via the second display engine, a third image using the first subset of the second plurality of light sources.

Description

[Technical Field]

[0001] The present disclosure relates generally to electronic display devices worn by a viewer to form a virtual image, and more particularly to binocular alignment of images in a head-mounted display (HMD). [Background technology]

[0002] HMDs are being developed for a wide range of applications, including military, commercial, industrial, firefighting, and entertainment applications. In many of these applications, it is particularly valuable to create a virtual image that can be visually superimposed on a real-world image formed within the eye of the HMD user's field of view. An image light guide can deliver image-bearing light to the viewer to direct the virtual image toward the viewer's pupil and enable this superimposition function.

[0003] Image light guides and, for example, diffractive optical elements, can create virtual images focused at optical infinity by transmitting collimated, angle-coded light beams to the viewer's eyebox. However, the virtual image may also be focused at a finite distance, such as within a range of 1 m to 1.5 m. Using a near-field focused solution can enable viewers to enjoy the benefits of augmented reality imaging in applications where having real-world scene content at a closer distance is useful, such as manufacturing and warehousing applications.

[0004] A binocular HMD may include a projector system having, for example, a projector and image light guide for the left eye and a projector and image light guide for the right eye. While initial projector calibration and alignment may be set during manufacturing and / or assembly, variations in human anatomy, such as facial geometry and eye positioning (i.e., interpupillary distance), as well as mechanical modifications to the HUD's frame, can cause the generated images to be misaligned for the user. Misalignment can result in eye strain or the perception of double images. Double images occur when content delivered to the left and right eyes does not converge as a single object in space in the viewer's mind; instead, the content is perceived as two separate objects in space. Therefore, there is a need for binocular image calibration and alignment after a user receives a binocular HMD. Projector alignment can also be used to change binocular vergence, which can induce the sensation of a change in the depth of focus of at least a portion of the generated three-dimensional (3D) image. Summary of the Invention

[0005] The present disclosure provides systems and methods for generating a stereoscopic presentation of properly aligned virtual images in a near-eye display system through calibration and alignment performed at the level of hardware commands. In some embodiments, this alignment or calibration occurs at a point after the initial factory calibration of such a system. Reducing or eliminating virtual image misalignment and undesirable optical effects such as incorrect color matching, blurring, and optical noise can alleviate, for example, double images and eye fatigue (i.e., eye strain). Thus, the present disclosure is particularly directed to systems and methods for calibrating and / or modifying the alignment of image(s) generated by one or more projectors using a display projector and a graphical user interface (GUI) presented to a user on a HUD device to customize projector / image alignment.

[0006] In a first exemplary embodiment, the present disclosure provides a system for alignment of virtual images in a binocular augmented reality display system, the system including: a frame; a first image light guide and a second image light guide supported by the frame; a first image source system disposed within the frame, the first image source system including a first display panel having a first plurality of light sources; and a second image source system disposed within the frame, the second image source system including a second display panel having a second plurality of light sources. The at least one processor and the at least one non-transitory computer-readable memory are arranged to execute and store, respectively, a set of non-transitory computer-readable instructions when executed by the processor, the at least one processor and the at least one non-transitory computer-readable memory being configured to: generate, via the first image source system, a first image using a first subset of the first plurality of light sources; receive a first input signal and, in response to the first input signal, generate a second image using a second subset of the first plurality of light sources; and generate, via the image source system, a third image using the first subset of the second plurality of light sources. Here, an image generated by a first image source system is transmitted to a first eyebox by a first image light guide, and an image generated by a second image source system is transmitted to a second eyebox by a second image light guide, and the second image is stereoscopically aligned with the third image. [Brief explanation of the drawings]

[0007] The accompanying drawings are incorporated herein as part of this specification. The drawings described herein illustrate embodiments of the disclosed subject matter and illustrate selected principles and teachings of the present disclosure. However, the drawings do not illustrate every possible implementation of the disclosed subject matter and are not intended to limit the scope of the present disclosure in any way.

[0008] [Figure 1]FIG. 1 is a simplified cross-sectional view of an image light guide showing replication of an image-bearing beam along the propagation direction to expand one dimension of the eyebox, according to an exemplary embodiment of the disclosed subject matter.

[0009] [Figure 2A] FIG. 2A is a schematic perspective view of a binocular HMD operable to form a stereoscopic virtual image for a viewer, according to an exemplary embodiment of the subject matter of this disclosure.

[0010] [Figure 2B] FIG. 2B is a schematic perspective view of the binocular HMD according to FIG. 2A, with vertical misalignment between the virtual images for the left and right eyes.

[0011] [Figure 3] FIG. 3 is a left side view of the binocular HMD according to FIG. 2B.

[0012] [Figure 4A] FIG. 4A is a schematic diagram of a stereoscopic virtual image containing substantially aligned wireframe text.

[0013] [Figure 4B] FIG. 4B is a schematic diagram of a stereoscopic virtual image containing misaligned wireframe text.

[0014] [Figure 5A] FIG. 5A is a schematic perspective view of an image source system according to an exemplary embodiment of the disclosed subject matter.

[0015] [Figure 5B] FIG. 5B is a cross-sectional view of a portion of the image source system according to FIG. 5A.

[0016] [Figure 6A] FIG. 6A is a schematic diagram of a portion of the image source system according to FIG. 5A.

[0017] [Figure 6B]FIG. 6B is a schematic diagram of a portion of the image source system according to FIG. 5A.

[0018] [Figure 7A] FIG. 7A illustrates a graphical user interface for calibration of stereoscopic images according to an exemplary embodiment of the disclosed subject matter. [Figure 7B] FIG. 7B illustrates a graphical user interface for calibration of stereoscopic images according to an exemplary embodiment of the disclosed subject matter. [Figure 7C] FIG. 7C illustrates a graphical user interface for calibration of stereoscopic images according to an exemplary embodiment of the disclosed subject matter. [Figure 7D] FIG. 7D illustrates a graphical user interface for calibration of stereoscopic images according to an exemplary embodiment of the disclosed subject matter.

[0019] [Figure 8] FIG. 8 is a schematic perspective view of a binocular HMD operable to form a stereoscopic virtual image for a viewer, according to an exemplary embodiment of the subject matter of this disclosure. DETAILED DESCRIPTION OF THE INVENTION

[0020] It should be understood that the present invention may assume various alternative orientations and step arrangements unless expressly specified to the contrary. It should also be understood that the specific assemblies and systems illustrated in the accompanying drawings and described in the following specification are merely exemplary embodiments of the inventive concepts defined herein. Accordingly, specific dimensions, orientations, or other physical characteristics relating to the disclosed embodiments are not to be considered limiting unless expressly stated otherwise. Also, although not applicable, like elements in the various embodiments described herein may be generally referred to within this section of the specification using like reference numerals.

[0021] Those skilled in the relevant art will recognize that the elements and techniques described herein can be practiced without one or more of the specific details, or with other methods, components, materials, etc. In some instances, well-known structures, materials, or operations are not shown or described in detail to avoid obscuring certain aspects of the disclosure. Throughout this specification, references to "one embodiment" or "embodiments" mean that a particular feature, structure, or characteristic described in connection with an embodiment is included in at least one embodiment of the disclosure. Thus, appearances of the phrases "in one embodiment" or "in an embodiment" throughout this specification do not necessarily refer to the same embodiment. However, particular features, structures, or characteristics described may be combined in any suitable manner in one or more embodiments.

[0022] As used herein, terms such as "first," "second," etc. do not necessarily imply any order, sequence, or priority relationship, but are merely used to more clearly distinguish one element or set of elements from another, unless otherwise specified.

[0023] As used herein, the terms "viewer," "operator," "observer," and "user" are considered equivalent and refer to a person or machine wearing and / or using a near-eye display device to view images.

[0024] As used herein, the terms "coupling" and "coupler" in the optical context refer to a connection where light travels from one optical medium or device to another.

[0025] As used herein, the term "about" as applied to a value is intended to mean within the tolerance of the device used to generate the value, or in some examples, ±10%, or ±5%, or ±1%, unless expressly specified otherwise.

[0026] As used herein, the term "substantially" is intended to mean within the tolerances of the device used to generate the value, or in some examples, ±10%, or ±5%, or ±1%, unless expressly specified otherwise.

[0027] As used herein, the terms "optical infinity" and "infinity" correspond to their conventional use in cameras and imaging technology and refer to imaging using substantially collimated light such that the focal length is at least greater than about four meters (4 m).

[0028] As used herein, the term "beam expansion" is intended to mean the duplication of a beam through multiple encounters with optical elements to provide an exit pupil expansion in one or more directions. Similarly, as used herein, "expanding" a beam or a portion of a beam is intended to mean the duplication of a beam through multiple encounters with optical elements to provide an exit pupil expansion in one or more directions.

[0029] Optical systems such as HMDs can generate virtual image displays. Unlike methods for generating real images, virtual images are not generated on the display surface. That is, when a display surface is positioned at the perceived location of the virtual image, no image is generated on the surface. Displaying virtual images offers numerous unique advantages in augmented reality presentations. For example, the apparent size of the virtual image is not limited by the size or location of the display surface. Furthermore, the source object of the virtual image can be small; for example, a magnifying glass can provide a virtual image of the object. Compared to systems that project real images, creating a virtual image that appears to be at a distance can provide a more realistic viewing experience. Providing a virtual image also eliminates the need to correct for screen artifacts, which may be required when projecting a real image.

[0030] An image light guide may display a virtual image using image-bearing light from a light source, such as a projector. For example, a collimated, relative angle-encoded light beam from the projector is coupled into the planar waveguide by an input coupling, such as an in-coupling diffractive optical element, which can be attached to or formed on the surface of the planar waveguide or embedded within the waveguide. Such a diffractive optical element can be formed as a diffraction grating, a holographic optical element (HOE), or by other known methods. For example, a diffraction grating can be formed by a surface relief. After propagating along the waveguide, the diffracted light can be redirected out of the waveguide by a similar output coupling, such as an out-coupling diffractive optical element, which can be positioned to provide pupil dilation along at least one direction of the virtual image. Additionally, a rotation grating can be positioned on or within the waveguide to provide pupil dilation in the orthogonal direction of the virtual image. The image-bearing light output from the waveguide provides an expanded eyebox for the viewer.

[0031] FIG. 1 is a schematic diagram showing a simplified cross-sectional view of one conventional configuration of an image light guide system 10. The image light guide system 10 includes a planar image light guide 12, an incoupling diffractive optical element IDO, and an outcoupling diffractive optical element ODO. The image light guide 12 includes a transparent substrate S, which may be made of optical glass or plastic, for example, having plane-parallel front and back surfaces 14 and 16. In this example, the incoupling diffractive optical element IDO is shown as a transmission grating disposed on, within, or otherwise engaged with the front surface 14 of the image light guide 12. However, the incoupling diffractive optical element IDO may alternatively be a reflection grating or other type of diffractive optical element (such as a volume hologram or other holographic diffractive element) that diffracts an incident image-bearing light beam WI into the image light guide 12. The incoupling diffractive optical element IDO is located on or within the front surface 14 or back surface 16 of the image light guide 12, or otherwise engages the front surface 14 or back surface 16, and may be a combination of transmissive or reflective, depending on the direction from which the image-bearing light beam WI approaches the image light guide 12.

[0032] When used as part of a near-eye or HMD, the incoupling diffractive optical element IDO of a conventional image light guide system 10 couples an image-bearing light beam WI from an image source system 50 into the substrate S of the image light guide 12. Any real image or dimension of the image formed by the image source system 50 is first converted into an array of overlapping, angle-related, collimated beams that encode different locations within the virtual image for presentation to the incoupling diffractive optical element IDO. Typically, the light rays in each bundle forming one of the angle-related beams extend parallel, but the angle-related beams are relatively oblique to one another through an angle that may be defined by two angular dimensions corresponding to the linear dimensions of the image.

[0033] When the angle-related beam engages the incoupling diffractive optical element IDO, at least a portion of the image-bearing light beam WI is diffracted (typically by a first diffraction order) and thereby redirected by the incoupling diffractive optical element IDO into the planar image light guide 12 as an angularly encoded image-bearing light beam WG for further propagation along the length dimension x of the image light guide 12 by total internal reflection (TIR) ​​between the plane-parallel front and back surfaces 14, 16. Although diffracted into different combinations of angle-related beams along the boundaries established by the TIR, the image-bearing light beam WG preserves the image information in an angularly encoded form derivable from the parameters of the incoupling diffractive optical element IDO. The outcoupling diffractive optical element ODO receives the encoded image-bearing light beam WG and diffracts at least a portion of the image-bearing light beam WG from the image light guide 12 as an image-bearing light beam WO (typically also by a first diffraction order) toward a nearby spatial region referred to as the eyebox E, within which a transmitted virtual image can be seen by a viewer's eye or other optical component. The outcoupling diffractive optical element ODO may be designed symmetrically with respect to the incoupling diffractive optical element IDO to restore the original angular relationship of the image-bearing light beam WI from between the output angularly related beams of the image-bearing light beam WO. Additionally, in exemplary embodiments, the outcoupling diffractive optical element ODO may modify the angular relationship of the original field point positions to generate an output virtual image at a finite focusing distance.

[0034] However, to increase one dimension of overlap between the angle-related beams injected into the eyebox E (which defines the size of the area in which the virtual image can be seen), the outcoupling diffractive optical element ODO is positioned with the limited thickness T of the image light guide 12 to encounter the image-bearing light beam WG multiple times, diffracting only a portion of the image-bearing light beam WG at each encounter. The multiple encounters along the length of the outcoupling diffractive optical element ODO (e.g., in a first direction) have the effect of replicating the image-bearing light beam WG and expanding or widening at least one dimension of the eyebox E where the replicated beams overlap. The expanded eyebox E reduces the sensitivity to the position of the viewer's eye 5 for viewing the virtual image.

[0035] The outcoupling diffractive optical element ODO is shown as a transmissive diffraction grating disposed on or affixed to the front surface 14 of the image light guide 12. However, like the incoupling diffractive optical element IDO, the outcoupling diffractive optical element ODO may be located on, within, or otherwise engaged with the front surface 14 or back surface 16 of the image light guide 12 and may be a combination of transmissive and reflective types, depending on the direction in which the image-bearing light beam WG is intended to exit the image light guide 12. In addition, the outcoupling diffractive optical element ODO may be formed as another type of diffractive optical element, such as a volume hologram or other holographic diffractive element, which diffracts the image-bearing light beam WG propagating from the image light guide 12 as an image-bearing light beam WO propagating toward the eyebox E.

[0036] 2A, 2B, and 3 illustrate an HMD 100 operable to form a stereoscopic virtual image 102 for a viewer. The HMD 100 is configured to form a left-eye virtual image 102A and a right-eye virtual image 102B aligned with each other at a distance in front of the HMD 100 to provide the benefits of stereoscopic image presentation. In FIG. 2A, the left-eye image 102A and the right-eye image 102B are shown aligned for stereoscopic imaging. In FIGS. 2B and 3, the left-eye image 102A and the right-eye image 102B are shown misaligned (e.g., with an exaggerated vertical misalignment). In an exemplary embodiment, the HMD 100 includes a first image light guide system 10A and a second image light guide system 10B. The first image light guide system 10A is configured to transmit image-bearing light to a user's left eye, and the second image light guide system 10B is configured to transmit image-bearing light to the user's right eye. For example, the first image light guide system 10A and the second image light guide system 10B may include one or more image light guides, e.g., optical waveguides, having one or more regions containing liquid crystal material designed to diffract, incouple, rotate, or outcouple image-bearing light generated by a diffractive optical element, e.g., a surface relief grating, a holographic optical element (HOE), or the like, respectively, the image source system 50 (FIG. 1).

[0037] The HMD 100 is generally adjustable to be comfortably and effectively worn by viewers with different head sizes or other anatomical variations, including, but not limited to, variations in interpupillary distance, that affect how the HMD 100's display is attached to the viewer's head. Embodiments of the present disclosure accommodate reshaping of the HMD 100 to fit different viewers' head anatomies while maintaining the desired stereoscopic presentation for each viewer. While the HMD 100 is illustrated as a "smart glasses" system, it should be understood that the present disclosure applies equally to head-up displays (HUDs) having different orientations of the image light guides 10A, 10B, image source system 50, associated driving electronics, memory, and processor. For example, but not by way of limitation, the HMD 100 may be configured to resemble and / or be integrated with eyeglasses, ski goggles, swim goggles, and helmets.

[0038] In an exemplary embodiment, initial calibration and alignment of the left and right image source systems 50 is performed during manufacturing and / or assembly of the HMD 100. Referring now to FIGS. 4A and 4B , variations in human anatomy, such as facial geometry and eye positioning (i.e., interpupillary distance), as well as mechanical modifications to the frame of the HMD 100, can cause the images 102A, 102B transmitted to the eyebox E to be misaligned for stereoscopic viewing. FIG. 4B illustrates an example of misalignment, resulting in the perception of double images. For example, the images 102A, 102B shown in FIGS. 4A and 4B simulate substantially identical wireframe text generated by two image source systems 50. As shown in FIG. 4A , when the resulting images 102A, 102B are properly aligned, the user perceives a single object (e.g., image 102) viewed with both eyes. As shown in FIG. 4B, if the resulting images 102A, 102B are not aligned (horizontally, vertically, or via a combination of both), the user will perceive two independent objects (e.g., images 102A, 102B) in conflicting space.

[0039] 5A and 5B, in an exemplary embodiment, the image source system 50 is a self-luminous micro LED display projector that includes a self-luminous micro LED display panel 560. For example, as shown in FIG. 5B, which illustrates a cross-sectional view of a portion of the self-luminous micro LED display panel 560 shown schematically in FIG. 5A, the self-luminous micro LED display panel 560 includes a substrate 562, an electrode layer 564, a micro LED / OLED array 566, and a front layer 568. Each micro LED 566R, 566G, 566B is an individually addressable component of the self-luminous micro LED display panel 560. Each micro LED 566R, 566G, 566B corresponds to at least a portion of one or more pixels of the projected image. In an exemplary embodiment, the micro LED array 566 is configured to emit light as a function of power applied to each self-luminous light source. For example, the micro LED array 566 may roughly approximate the size and shape of the incoupling diffractive optical element IDO of the associated image light guide system 10A, 10B.

[0040] In an exemplary embodiment, the image source system 50 has more available micro LEDs 566 disposed on the substrate 562 than are typically used to create the image 102. For example, if the image source system 50 is designed to create and / or display images with a resolution of 640×480, the image source system 50 may have an array of 664×500 micro LEDs 566. Of course, the 640×480 resolution is only one example of a display resolution; other display resolutions are possible, such as 1024×768 or 1920×1080. Thus, during the generation of any given image, there will be a subset 570 of the micro LEDs 566 that are used to create the image 102 and a subset 572 of the micro LEDs 566 that are not used to create the image 102.

[0041] The virtual image 102 output from the HMD 100 includes overlapping image-bearing light beams into which the virtual image 102 is angularly encoded. The image-bearing light beams corresponding to matching points in the left-eye image 102A and the right-eye image 102B are aligned with one another or otherwise converge toward a common point in space in front of the HMD 100 to support the desired stereoscopic presentation. Thus, the HMD 100 is configured to maintain the desired angular relationship between the left-eye image 102A and the right-eye image 102B.

[0042] The number of micro LEDs 566 in the micro LED array 560 being significantly greater than the pixels utilized to generate the image 102 provides a margin of unused micro LEDs 566 in the subset 572. For example, when generating a 640×480 image on a display including 664×500 micro LEDs 566 using the exemplary resolution and configuration described above, there is a margin of 12 unused micro LEDs 566 to the left and right of the subset 570, and a margin of 10 unused micro LEDs 566 above and below the subset 570, assuming the generated image is centered within the array of micro LEDs 566. In an exemplary embodiment, the subset 570 of micro LEDs 566 is moved at least partially within the micro LED array 560 and initially into the marginal region of the unused micro LEDs 566 to change the angular relationship of the image-bearing light transmitted through the image light guide systems 10A, 10B, which can change the alignment of the images 102A, 102B transmitted to the eyebox E and viewed by the user. 6A and 6B, the subset 570 of micro LEDs 566 utilized to generate the image 102 may be shifted down on the micro LED array 560. As shown in FIG. 6B, the subset 570 of micro LEDs 566 may be shifted in the (-)y-axis direction by three micro LEDs 566 to calibrate the alignment of the image 102.

[0043] In other words, shifting the micro LEDs 566 energized by the right and / or left image source systems 50 to change the angular relationship of the images 102A, 102B transmitted through the image light guide systems 10A, 10B may be used to align the two images 102A, 102B in a manner suitable for a user. Of course, the number of horizontal and vertical pixels shown in Figures 6A-6B should not be construed as limiting in any way, and other pixel configurations are possible, as discussed above.

[0044] In exemplary embodiments, the shifting of the micro LEDs 566 energized by the image source system 50 occurs at the hardware level, rather than purely at the software level. For example, in some exemplary embodiments, the image source system 50 includes an on-board chip 52 that receives command signals from the processor of the HMD 100 when a user realigns the image 102 through a provided graphical user interface (GUI). Once the alignment step is performed and commands are sent to the on-board chips 52 configured on each left and right image source system 50, the micro LED array 560 generates the image 102 using only the newly selected subset 570. The alignment step may be performed any number of times utilizing the GUI, allowing for multiple users of the HMD 100 and / or variations of the HMD 100. Of course, the on-board chips 52 utilized by each image source system 50 may include a separate processor and non-transitory, computer-readable, and non-volatile memory configured to execute and store, respectively, sets of instructions related to the configuration of used and unused micro LEDs 566 in the array 560.

[0045] In an exemplary embodiment, the HMD 100 includes a processor and non-transitory computer-readable memory configured to execute and store a set of computer-readable instructions configured, when executed by the processor, to operate the HMD 100. The processor also includes a software suite configured to allow a user to recalibrate the alignment of the images 102A, 102B at the hardware level. When the user perceives that the images 102A, 102B are not aligned (e.g., they are presented as double images or the user is experiencing significant eye strain), the user may access a portion of the provided software suite to adjust the alignment of the images 102A, 102B. In an exemplary embodiment, the software suite includes a GUI as shown in FIGS. 7A-7D. FIG. 7A shows a left-eye reticle 600A in image 102A and a right-eye reticle 600B in image 102B, with the reticles 600A and 600B vertically aligned along an imaginary horizontal axis AA. Alignment point 602 is associated with the position of left-eye image 102A, and alignment point 604 is associated with the position of right-eye image 102B.

[0046] As shown in FIG. 7B , in an exemplary embodiment, when images 102A, 102B are not vertically aligned, the user perceives a double image of reticles 600A, 600B in the GUI. Using an input device 160, such as a touch-sensitive pad located on the temples of one or more temple arms of HMD 100 or an external device wirelessly connected to HMD 100 (e.g., a smartphone, tablet, personal computer, etc.), the user can gradually shift the positions of alignment points 602, 604 relative to left-eye reticle 600A and right-eye reticle 600B via user input device 160. For example, as shown in FIG. 7C , the user may gradually shift alignment point 602 upward relative to alignment point 604. Similarly, as shown in FIG. 7D , the user may gradually move alignment point 604 downward relative to alignment point 602. Naturally, the positions of both alignment points 602, 604 may be adjusted simultaneously or independently. By shifting alignment points 602, 604 relative to one another, images 102A, 102B can be aligned for stereoscopic viewing. Left-eye reticle 600A and right-eye reticle 600B provide visual indicators of the amount of adjustment for left and right images 102A, 102B. In one exemplary embodiment, user input is provided by a touch-sensitive pad or slide 60, which creates equal and opposite adjustments between left and right reticles 600A, 600B. For example, as a user drags a finger across the touch-sensitive pad, alignment point 602 is shifted down a certain amount, while alignment point 604 is simultaneously shifted up an equal amount. It should be appreciated that while the exemplary embodiments shown and described herein provide mechanisms for making alignment adjustments based on vertical misalignment between left-eye and right-eye images, similar adjustments can be made to alter horizontal image vergence.

[0047] As described above, by visually shifting the positions of the alignment points 602, 604 in the GUI, the software suite sends one or more commands to instruct the on-board chip 52 of each image source system 50 to shift the usable subset 570 of micro LEDs 566 up or down as a function of the movement of the alignment points 602, 604. Once the software suite GUI instructs the on-board chip 52 of each image source system 50 to change the usable subset 570 of micro LEDs 566, the usable subset 570 of micro LEDs 566 is maintained until the alignment is recalibrated via the software suite GUI. Advantageously, in an exemplary embodiment, the present disclosure provides alignment of the virtual images 102A, 102B at the hardware level, without requiring continuous calculation of pixel positions by the operating system (e.g., reducing processing to determine pixel trajectories). Additionally, through the hardware-level alignment described above, the HMD 100 uses less power than systems utilizing conventional alignment mechanisms because only a usable subset 570 of the micro LEDs 566 can be energized.

[0048] In one exemplary operation, a user of the HMD 100 positions the HMD 100 on their head / face. Each left and right image source system 50 is positioned to generate a respective first image and relay the respective first image to the user's eyes via the left and right image light guides 10A, 10B. If the user experiences eye strain caused by misalignment of the displayed virtual images and / or perceives double images formed by the virtual images, the user can utilize a GUI provided within the software suite of the HMD 100 to make incremental adjustments to the usable and unusable portions of the micro LED array 560. For example, the user may shift the usable subset of micro LEDs 566 up, down, left, and / or right for either the left or right image source system 50 until the eye strain and / or double images are improved. Each incremental change provided by the user via the user input 160 causes the processor of the HMD 100 to send one or more command signals to the on-board chips 52 of the left and / or right image source systems 50. The command signal operates to make a corresponding change to the drivable or usable area of ​​the micro LEDs 566 in the array 560 and is stored at the hardware and / or firmware level. Thus, after the command is received, one or more new images are created by the left and right image source systems 50 utilizing the new combination of micro LEDs 566 from the array 560. Of course, the new image may utilize one or more micro LEDs 566 previously designated as unused. Because the change to the usable area of ​​the array 560 is stored and achieved at the hardware and / or firmware level, the image processing requirements of the HMD 100 do not change as the usable area shifts. This differs from current alignment software in that any changes made to the position of the image in the HMD 100 are achieved via additional software commands that require adjustment for each frame presented to the user. The additional time / processing resources to constantly adjust for each subsequent frame can add up to a significant addition to the power and / or processing budget.The present system and method avoids additional processing requirements, thus saving power and processing power over conventional systems.

[0049] 8 , in an exemplary embodiment, an HMD 100 includes a frame 110 including a right-eye rim section 112, a right temple 114, and a nose bridge portion 116. Between the temple 114 and the nose bridge portion 116, the frame 110 includes a right opening configured to receive an image light guide 10B operable to form at least one image associated with one or more virtual objects in the viewer's right eye. The frame 110 also includes a left-eye rim section 118 connected to the nose bridge portion 116 and a left temple 120. Between the temple 120 and the nose bridge portion 116, the frame 110 includes a left opening configured to receive an image light guide 10A operable to form at least one image associated with one or more virtual objects in the viewer's left eye.

[0050] As described above, the HMD 100 may be configured as a binocular display system that forms images for both the right and left eyes of a viewer. In some embodiments, the frame 110 is made of a metal, plastic, or wood material (or any combination thereof) and is intended to be opaque, i.e., not transmit visible light. In some embodiments, the image light guides 10A, 10B are removably secured between the temples 114, 120 and the nose bridge portion 116, i.e., the image light guides 10A, 10B can be removed and / or replaced without the use of additional tools. It should further be appreciated that in one or more exemplary embodiments, the HMD 100 may include multiple stacked image light guides 10A, 10B. For example, one image light guide 10 of the stack may be configured to incouple and propagate light in a first wavelength range (e.g., light in the red portion of the visible spectrum), and another image light guide 10 of the stack may be configured to incouple and propagate light in a second wavelength range (e.g., light in the green and / or blue portions of the visible spectrum).

[0051] In an exemplary embodiment, nose bridge portion 116 is at least partially flexible and / or semi-rigid, facilitating a comfortable fit of HMD 100 to the facial geometry of a user. The at least partially flexible nature of nose bridge portion 116 allows for minor changes to be made to the geometry of frame 110 after manufacturing and initial calibration as a result of intentional or unintentional forces / stresses applied to frame 110. These minor changes to frame 110 resulting from changes to nose bridge portion 116 may result in misalignment of left-eye virtual image 102A and right-eye virtual image 102B, which may be corrected via the calibration systems and methods described above.

[0052] Conventional image light guides form a virtual image at optical infinity and transmit only collimated light to the eyebox E. In an exemplary embodiment, the HMD 100 is configured to form a stereoscopic virtual image that appears focused at a finite distance, such as within a range of 1 m to 1.5 m or 2 m. The use of a near-focused solution may enable a viewer to take advantage of augmented reality imaging in applications where it is useful to have real-world scene content at a close distance to the user. Altering binocular vergence, which may induce a sensation of a change in the depth of focus of at least a portion of the generated virtual image, may be achieved by moving a subset 570 of micro LEDs 566 horizontally within the micro LED array 560 and at least partially within a margin area of ​​initially unused micro LEDs 566 to change the angular relationship of the image-bearing light transmitted through the image light guide systems 10A, 10B and alter the alignment of the images 102A, 102B transmitted to the eyebox E and viewed by the user. This change in binocular convergence can be achieved using the software suite described above by gradually shifting the positions of alignment points 602, 604 horizontally relative to left eye reticle 600A and right eye reticle 600B using user input device 160.

[0053] One or more features of the embodiments described herein may be combined to create additional embodiments not shown. While various embodiments have been described in detail above, it should be understood that they are presented for illustrative purposes, and not for limiting purposes. It will be apparent to those skilled in the relevant art that the subject matter of the present disclosure may be embodied in other specific forms, variations, and modifications without departing from the scope, spirit, or essential characteristics thereof. The above-described embodiments are therefore to be considered in all respects as illustrative and not restrictive. The scope of the present invention is indicated by the appended claims, and all changes that come within the meaning and range of equivalents thereof are intended to be embraced therein.

Claims

1. 1. A binocular augmented reality display system, comprising: The frame and a first image light guide and a second image light guide supported by the frame; a first image source system disposed within the frame, the first image source system comprising a first display panel having a first plurality of light sources; a second image source system disposed within the frame, the second image source system comprising a second display panel having a second plurality of light sources; at least one processor and at least one non-transitory computer-readable memory, which, when executed by the processor, generating a first image using a first subset of the first plurality of light sources via the first image source system; receiving a first input signal and generating a second image using a second subset of the first plurality of light sources in response to the first input signal; the processor and memory are configured to execute and store, respectively, a set of non-transitory computer-readable instructions configured to generate a third image using a first subset of the second plurality of light sources via the second image source system; the image produced by the first image source system is transmitted to a first eyebox by the first image light guide, and the image produced by the second image source system is transmitted to a second eyebox by the second image light guide; A binocular augmented reality display system, wherein the second image is stereoscopically aligned with the third image.

2. 10. The binocular augmented reality display system of claim 1, further comprising: receiving a second input signal; and generating a fourth image using a second subset of the second plurality of light sources in response to the second input signal.

3. 2. The binocular augmented reality display system of claim 1, wherein a first usable area of ​​the first display panel operable to generate the first image is the same width and height as a second usable area of ​​the first display panel operable to generate the second image.

4. The binocular augmented reality display system of claim 1 , wherein the frame includes an at least partially flexible nose bridge portion.

5. The binocular augmented reality display system of claim 3 , wherein the first plurality of light sources includes a subset of light sources that are not utilized to generate the second image.

6. 10. The binocular augmented reality display system of claim 1, further comprising a user input located on, within, or proximate to the frame, wherein the first input signal is received via the user input.

7. 2. The binocular augmented reality display system of claim 1, wherein the first image is stereoscopically aligned with the third image at a first binocular convergence and the second image is stereoscopically aligned with the third image at a second binocular convergence.

8. 2. The binocular augmented reality display system of claim 1, wherein the at least one processor and the at least one non-transitory computer-readable memory are located on at least one on-board chip of the first image source system and / or the second image source system.

9. 10. The binocular augmented reality display system of claim 8, further comprising a second processor configured to receive signals from one or more user inputs and send signals to the at least one processor located on the at least one on-board chip.

10. the first image light guide and the second image light guide each an incoupling diffractive optical element formed along the image light guide, the incoupling diffractive optical element operable to diffract at least a portion of the image-bearing light beam into the image light guide in an angularly coded manner; 10. The binocular augmented reality display system of claim 1, comprising: an outcoupling diffractive optical element formed along the image light guide, the outcoupling diffractive optical element operable to direct at least a portion of the image-bearing light beam from the image light guide in an angularly decoded manner.

11. 10. The binocular augmented reality display system of claim 1, wherein the second subset of the first plurality of light sources is stored in the at least one non-transitory computer-readable memory, and the second subset of the first plurality of light sources is utilized to generate a subsequent image.

12. 1. A method for aligning images in a binocular augmented reality display system, comprising: providing a first image source system, the first image source system comprising a first display panel having a first plurality of light sources; providing a second image source system, the second image source system comprising a second display panel having a second plurality of light sources; providing at least one processor and at least one non-transitory computer-readable memory, the processor and memory configured to execute and store, respectively, a set of non-transitory computer-readable instructions; generating a first image using a first subset of the first plurality of light sources via the first image source system; generating a second image using a first subset of the second plurality of light sources via the second image source system, the second image being misaligned with the first image; receiving a first input signal and generating a third image using a second subset of the first plurality of light sources in response to the first input signal; generating the second image, wherein the second image is aligned with the third image.

13. 13. The method of claim 12, wherein the first image includes a first reticle and a first alignment point, the second image includes a second reticle and a second alignment point, the third image includes the first alignment point at a different position relative to the first reticle, and the second reticle in the second image and the first reticle in the third image are aligned along a virtual axis.

14. the first image includes a first reticle and a first alignment point, the second image includes a second reticle and a second alignment point, and the third image includes the first alignment point at a different location relative to the first reticle; generating a fourth image using a second subset of the second plurality of light sources in response to the first input signal, the fourth image including the second alignment point at a different location relative to the second reticle; The method of claim 12 , wherein the second reticle in the fourth image and the first reticle in the third image are aligned along a virtual axis.

15. The method of claim 14 , wherein the positions of a second reticle and the first reticle are adjusted simultaneously.

16. 13. The method of claim 12, further comprising a first image light guide and a second image light guide supported by a frame, wherein the first image source system and the second image source system are supported by the frame, the image generated by the first image source system being transmitted to a first eyebox by the first image light guide, and the image generated by the second image source system being transmitted to a second eyebox by the second image light guide.

Images