Near-eye display equipped with a rotating waveguide and a camera

Abstract

To provide an optical image light guide that is no obstructive-of-view in forming a virtual image that can be visually superimposed over a real-world image that lies in the field of view of an HMD user.SOLUTION: A near-eye display system includes an optics module and the optics module is coupled with an electronics module having a controller. The optics module includes a planar waveguide operable to display virtual images, and a camera operable to capture pictures and videos. The planar waveguide is coupled with the camera via the optics module, whereby a first view through the planar waveguide is oriented to be the same as a second view by the camera.SELECTED DRAWING: Figure 1A

Description

Technical Field

[0001] The present disclosure relates to near-eye display systems, head-mounted displays, etc., using a planar waveguide and a camera provided to rotate together.

Background Art

[0002] Head-mounted displays (HMDs) and virtual image near-eye displays have been developed for various applications such as military, commercial, industrial, firefighting, and entertainment. In many of these applications, it is valuable to form a virtual image that can be visually superimposed on the real-world image within the field of view of the HMD user. To direct the virtual image towards the viewer's pupil and enable the above superimposition function, an optical image light guide transmits image-carrying light to the viewer within a narrow space.

[0003] Conventional near-eye displays can be used to view virtual images, but at least partially obstruct the wearer's view of the environment. As described herein, a planar waveguide (e.g., an optical image light guide) can be used to view the virtual image presented to the wearer of a near-eye display system. This planar waveguide obstructs the field of view less than other near-eye display systems.

Summary of the Invention

[0004] The present disclosure provides a near-eye display system. In a first exemplary embodiment, the near-eye display system includes an optical module coupled to an electronic module having a controller. Here, the optical module includes a planar waveguide operable to display a virtual image and a camera operable to acquire photos and videos. The planar waveguide is coupled to the camera via the optical module, whereby a first view through the planar waveguide is oriented to be the same as a second view by the camera.

[0005] In a second exemplary embodiment, the near-eye display system includes a planar waveguide suitable for displaying a virtual image, at least one camera suitable for acquiring an image and / or video of the environment, and an optical module. This optical module houses the camera and mechanically fixes the waveguide to the module such that a part of the view passing through the planar waveguide becomes the same as a part of the view of the camera.

Brief Description of the Drawings

[0006] The accompanying drawings are incorporated as part of the specification. The drawings disclosed herein illustrate embodiments of the presently disclosed subject matter and exemplify selected principles and teachings of the present disclosure. However, the drawings do not illustrate all possible implementations of the presently disclosed subject matter and are not intended to limit the scope of the present disclosure in any way.

[0007]

Figure 1A

[0008]

Figure 1B

[0009]

Figure 2

[0010]

Figure 3

[0011]

Figure 4

[0012]

Figure 5

[0013]

Figure 6

[0014]

Figure 7

[0015]

Figure 8A

Figure 8B

[0016] It should be understood that the present invention may assume various alternative arrangements and step sequences unless explicitly specified otherwise. It should also be understood that the specific assemblies and systems shown in the drawings and described in the specification are merely exemplary embodiments of the concepts of the invention as defined herein. Accordingly, specific dimensions, directions, or other physical characteristics associated with the disclosed embodiments should not be considered limiting unless specifically stated. Also, like elements in the various embodiments described herein are referred to by like reference numerals. In this specification, terms such as "first," "second," etc., do not necessarily indicate an order or priority relationship unless specifically specified, and are merely used to more clearly distinguish one element or set of elements from another element or set of elements.

[0017] In the context of the present disclosure, the terms "viewer," "operator," "observer," and "user" are considered equivalent and refer to a person who wears and views an image using a display or viewing device.

[0018] As used herein, the term "set" refers to a non-empty set, as the concept of a collection of elements or members is widely understood in elementary mathematics. The term "subset" is used to refer to a non-empty proper subset, i.e., a subset that has one or more elements of a larger set, unless otherwise specified. In the case of a set S, the subset can include the complete set S. However, a "proper subset" of set S is strictly contained in set S and excludes at least one element of set S.

[0019] In the context of the present disclosure, the term "oblique" means an angle that is not an integer multiple of 90 degrees. For example, two lines, linear structures, or planes are considered oblique to each other when they diverge or converge from parallel at an angle greater than 0 degrees and less than 90 degrees, or when they form an angle greater than 0 degrees and less than 90 degrees from a right angle.

[0020] In the context of optics, the term "coupler" refers to an intermediate structure for facilitating the propagation of light from one optical medium or device to another optical medium or device.

[0021] Instead of real image projection, a virtual image display can be created in an optical system such as an HMD. In contrast to the method of forming a real image, a virtual image is not formed on the display surface. That is, if it is assumed that the display surface is placed at the perceived position of the virtual image, no image is formed on that surface. Virtual image displays have many advantages unique to augmented reality displays. For example, the apparent size of the virtual image is not limited by the size or position of the display surface. Furthermore, the source object of the virtual image can be made small. For example, a magnifying glass provides a virtual image of an object. By forming a virtual image that appears to be at a certain distance, a more realistic viewing experience can be provided compared to a system that projects a real image. By providing a virtual image, correction of screen artifacts required when projecting a real image becomes unnecessary.

[0022] To display a virtual image, an image light guide can use image-carrying light from a light source such as a projector. For example, a collimated and relatively angularly encoded light beam from a projector is coupled to a planar waveguide by an input coupling such as an input coupling diffractive optical element. This input coupling is attached to, formed on, or buried within the surface of the planar waveguide. Such diffractive optical elements can be formed by diffraction gratings, holographic optical elements (HOEs), or other known methods. For example, a diffraction grating can be formed by surface relief. The diffracted light propagates along the waveguide and then exits the waveguide by a similar output coupling (such as an output coupling diffractive optical element). This output coupling can be configured to provide pupil expansion along a one-dimensional virtual image. Further, a rotating grating can be disposed on / in the waveguide to provide pupil expansion in the orthogonal dimension of the virtual image. The image-carrying light exiting the waveguide provides an expanded eyebox to the viewer.

[0023] A wearer of a near-eye display using a planar waveguide views the environment through the planar waveguide and superimposes and views a virtual image or virtual video image generated by the near-eye display system on the environment. In some cases, there is also an advantage in allowing a camera to view the environment. The camera view (possibly using image analysis software) can be used to display environmental cues to the wearer of the near-eye display system. Therefore, it is important to align the camera view with the view of the person through the planar waveguide. For example, when the planar waveguide rotates for comfortable wearing of the near-eye display system, it is important to maintain the alignment of the camera view with the view of the person through the planar waveguide.

[0024] As shown in FIG. 1A, in one embodiment, the near-eye display system 12 includes an electronic module 14, an optical module 16, and a planar waveguide 18. The mount module 54 is configured to mechanically fix the electronic module 14 to the optical module 16 while allowing the optical module 16 to rotate relative to the electronic module 14 in at least one direction. As shown in FIG. 1A, when used by a person 28, the near-eye display system 12 is disposed near the person 28's right eye 34A, nose 30, and nasal bridge 32. As shown in FIG. 1B, in one embodiment, the near-eye display system 12 is disposed for the left eye 34B.

[0025] Continuing to refer to FIGS. 1A and 1B, in one embodiment, the near-eye display system 12 includes one or more buttons 40, 42, 44 for operating the near-eye display system. The buttons 40, 42, 44 are used, for example, to turn the near-eye display system 12 on and off, navigate the information displayed by the planar waveguide 18, select from a list of options presented to the person 28 by the planar waveguide 18, change the display characteristics (e.g., color, brightness) of the information displayed by the planar waveguide 18, take a photo with the incorporated camera 70 (see FIG. 3), or start and stop video recording with the camera 70, but are not limited to these uses.

[0026] In one embodiment, the electronic module 14 includes wireless communication means (e.g., Bluetooth and / or WiFi). The wireless communication means is, but not limited to, an integrated circuit and / or an integrated circuit chip operable to create a wireless local area network connection with one or more other electronic devices. The electronic module 14 also includes one or more batteries, or other power storage devices. The power storage device is, but not limited to, a lithium-ion battery (LIB) or the like. Further, the electronic module 14 includes one or more electronic ports 20 for connecting by wire to other electronic devices (e.g., an external power source, an external audio system, etc.). The electronic module 14 can further include a controller having a central processing unit (CPU). The controller is operable to execute stored computer code, send signals to sensors, and receive signals from sensors. The sensors include, but are not limited to, an inclination sensor (e.g., an inclinometer), an accelerometer, a temperature sensor, a gyroscope, and a global positioning system (GPS) receiver.

[0027] Referring to FIGS. 3, 7, 8A, and 8B, in one embodiment, the optical module 16 includes one or more built-in cameras 70 and one or more ports 72. One or more built-in cameras 70 are operable to view the environment through the ports 72. The optical module 16 can also include a camera flash light 74 operable to generate a flash for taking photos and videos, and / or a light source for illuminating an environment that at least partially surrounds the near-eye display system 12. Further, the optical module 16 includes an image display generator 76 operable to provide an image to be displayed to the person 28 via the planar waveguide 18. In one embodiment, the image display generator 76 is an image projector operable to generate the full range of an angularly encoded beam to generate a virtual image. In one embodiment, the port 72 at least partially houses the camera flash and / or the light source.

[0028] In one embodiment, the planar waveguide 18 is removable from the optical module 16. In another embodiment, the planar waveguide 18 is not removable from the optical module 16. Referring to FIGS. 1A and 2, the orientations of the planar waveguides 18 and the one or more built-in cameras 70 in the first position are indicated by the dashed line 60. The dashed line 60 is oriented perpendicular to the first and second planes of the planar waveguide 18.

[0029] The electronic module 14 is rotatably / pivotably connected to the mount module 54 by a pivot 50. In one embodiment, as shown in FIG. 2, the mount module 54 and the optical module 16 can rotate and / or pivot relative to the electronic module 14 about at least one axis. For example, the optical module 16 is operable to rotate about the z-axis of the pivot 50 (see FIG. 3). In this way, the planar waveguide 18 and the one or more built-in cameras 70 are rotated relative to the electronic device module 14. The orientations of the planar waveguide 18 and the one or more built-in cameras 70 in the second position are indicated by the dashed line 62. The dashed line 62 is a line perpendicular to the first and second planes of the planar waveguide 18. By comparing the dashed line 60 and the dashed line 62, the rotation angle α is defined.

[0030] The optical module 16 is rotatably / pivotably coupled to the mount module 54 by a pivot 52. The optical module 16 is coupled to the mount module 54 via the pivot 52. In one embodiment, as shown in FIGS. 3-6, the optical module 16 can rotate and / or pivot relative to the electronic module 14 and the mount module 54 about at least one axis. For example, the optical module 16 is operable to rotate about the y-axis of the pivot 52 (see FIGS. 4 and 5). The optical module 16 can rotate via the pivot 52 substantially perpendicular to the rotation axis of the pivot 50.

[0031] Pivots 50 and 52 provide means for enabling power, signals, and / or data to be transmitted and received between the optical module 16 and the controller of the near-eye display system 12 and various other modules. In one embodiment, pivots 50 and 52 have holes. Electrical connections (e.g., electrical wires) can pass through pivots 50, 52 at least partially through these holes. In this way, the electronic module 14 can be electrically connected to the mount module 54 and the optical module 16. The electrical connection between the electronic module 14 and the optical module 16 can be bidirectional. For example, signals and / or data from one or more built-in cameras 70 disposed at least partially within the optical module 16 can be transmitted to the electronic module 14.

[0032] One or more features of the embodiments described herein can be combined to create additional embodiments not shown in the figures. It should be understood that although various embodiments have been described in detail, these are presented by way of example and not limitation. It will be apparent to those skilled in the art that the disclosed subject matter can be embodied in other specific forms, variations, and modifications without departing from its scope, spirit, or essential characteristics. Accordingly, the above embodiments should be considered illustrative in all respects and not restrictive. The scope of the present invention is indicated by the appended claims, and all changes within the meaning and scope of the equivalents thereof are intended to be included therein.

Claims

1. an optical module having a projector operable to generate an angularly encoded light beam and a camera operable to capture an image of an environment, the optical module operable to transmit at least a portion of the light beam to an eyebox; an electronics module having a controller electrically connected to the optical module; a mount module disposed between the electronic module and the optical module; a first pivot disposed between the optical module and the electronic module; Equipped with the electronic module is coupled to the optical module via the mount module; the optical module is rotatable about a first axis relative to the electronic module; at least a portion of the optical module is rotatable relative to the electronic module about a second axis oriented transverse to the first axis; the electronic module having opposing first and second faces; At least a portion of the optical module extends in a first direction relative to the first surface and parallel to the second axis; A near-eye display system, wherein at least a portion of the optical module protrudes relative to the second surface in a second direction parallel to the second axis and opposite to the first direction.

2. The near-eye display system of claim 1 , further comprising a display, said display and said camera operable to rotate relative to said electronic module.

3. The near-eye display system of claim 2 , wherein the display has a first field of view and the camera has a second field of view.

4. The near-eye display system of claim 2 , wherein the display is operable to be positioned in a first position relative to the electronic module, and the display is operable to be positioned in a second position relative to the electronic module.

5. The near-eye display system of claim 1 , wherein the first axis is oriented perpendicular to the second axis.

6. The near-eye display system of claim 2 , wherein the display comprises a planar waveguide.

7. The near-eye display system of claim 1 , wherein the optical module comprises a light source operable to at least partially illuminate the environment.

8. The near-eye display system of claim 1 , wherein the electronic module comprises one or more buttons configured to operate the near-eye display system.

9. The near-eye display system of claim 8 , wherein the one or more buttons include a first button configured to control an on / off state of the near-eye display system and a second button configured to control the camera.

10. The near-eye display system of claim 1 , wherein the first surface is configured to be positioned adjacent to a user and at least a portion of the optical module is positioned adjacent to the second surface.

11. The near-eye display system of claim 1 , wherein the first axis comprises a vertical axis and the second axis comprises a horizontal axis.

12. The near-eye display system of claim 1 , wherein an electrical connection between the optical module and the electronic module is disposed through the first pivot.

Images