See-through computer display system having improved vision correction and increased content density

Abstract

To provide a see-through computer display system having a desirable vision correction and an improved content density.SOLUTION: The specification of the present application provides an example of an impact-resistive glass waveguide structure for a see-through head part equipment type computer display. In the embodiment, the structure includes a vision correction through an electrochromic and / or photochromic system and a content density control.SELECTED DRAWING: Figure 4

Description

[Technical Field]

[0001] (CROSS-REFERENCE TO RELATED APPLICATIONS) This application claims priority to U.S. Provisional Patent Application No. 62 / 661,720, filed April 24, 2018, the contents of which are incorporated herein by reference in their entirety.

[0002] (background) FIELD OF THE INVENTION The present invention relates to a see-through computer display system with vision correction and / or increased content density. [Background technology]

[0003] 2. Description of Related Art Head-mounted displays (HMDs), and especially HMDs that provide a see-through view of the environment, are expensive equipment. Presenting content in a see-through display can be a complex operation when attempting to ensure that the user experience is optimized. Improved systems and methods for presenting content in a see-through display are required to enhance the user experience. Summary of the Invention [Means for solving the problem]

[0004] (overview) Aspects of the present invention relate to methods and systems for a see-through computer display system with a waveguide, including vision correction and increased content density by reducing scene light.

[0005] These and other systems, methods, objects, features, and advantages of the present invention will be apparent to those skilled in the art from the following detailed description of the preferred embodiments and drawings. All documents mentioned herein are incorporated by reference in their entirety. The present specification also provides, for example, the following items: (Item 1) An optical stack, the optical stack comprising: A waveguide; a first protective layer disposed on a first side of the waveguide; a second protective layer disposed on a second side of the waveguide; a vision correction optic disposed on the first side of the waveguide; an electrochromic layer disposed on the second side of the waveguide; 1. An optical stack comprising: (Item 2) Item 10. The optical stack of item 1, wherein the first protective layer comprises polycarbonate. (Item 3) Item 10. The optical stack of item 1, wherein the first protective layer comprises a protective plate. (Item 4) Item 10. The optical stack of item 1, wherein the vision-correcting optic is positioned between the user's eye and the first protective layer. (Item 5) Item 10. The optical stack of item 1, wherein the vision-correcting optic comprises an elastomer. (Item 6) Item 10. The optical stack of item 1, wherein the vision-correcting optic is bonded to the first protective layer via surface adhesion. (Item 7) Item 10. The optical stack of item 1, wherein the first protective layer comprises the vision-correcting optic. (Item 8) a first air gap disposed between the waveguide and the first protective layer; a second air gap disposed between the waveguide and the second protective layer; Item 1. The optical stack of item 1, further comprising: (Item 9) Item 10. The optical stack of item 1, wherein the electrochromic layer is disposed between the waveguide and the second protective layer. (Item 10) Item 10. The optical stack of item 9, wherein the electrochromic layer is directly bonded to the second protective layer. (Item 11) Item 10. The optical stack of item 9, further comprising a substrate layer disposed between the electrochromic layer and the second protective layer, the electrochromic layer being directly bonded to the substrate layer. (Item 12) Item 10. The optical stack of item 1, wherein the waveguide, the first protective layer, and the second protective layer have substantially the same refractive index. (Item 13) Item 10. The optical stack of item 1, wherein the waveguide comprises a holographic surface. (Item 14) the optical stack is configured to present image light and scenery light to a user; the source of scenic light is disposed on the second side of the waveguide; the first side of the waveguide is configured to face the user; Item 1. The optical stack of item 1. (Item 15) Item 15. The optical stack of item 14, wherein presenting image light to the user comprises presenting the image light via total internal reflection of the waveguide. (Item 16) Item 15. The optical stack of item 14, further comprising a photochromic layer configured to adjust the amount of view light presented to the user based on the intensity level of the view light. (Item 17) Item 17. The optical stack of item 16, wherein the second protective layer comprises the photochromic layer. (Item 18) Item 17. The optical stack of item 16, wherein the photochromic layer is disposed on a first side of the second protective layer, the first side of the second protective layer facing the user. (Item 19) Item 17. The optical stack of item 16, wherein the photochromic layer is disposed on a second side of the second protective layer, the second side of the second protective layer facing away from the user. (Item 20) Item 15. The optical stack of item 14, wherein the electrochromic layer is configured to adjust the amount of scenic light presented to the user based on a control signal. (Item 21) 21. The optical stack of claim 20, wherein the control signals are provided by one or more processors in a wearable head device. (Item 22) Item 1, wherein the optical stack is coupled to a wearable head device. [Brief explanation of the drawings]

[0006] BRIEF DESCRIPTION OF THE DRAWINGS The embodiments are described with reference to the following drawings:

[0007] The same numbers may be used throughout to refer to like features and components shown in the figures.

[0008] [Figure 1] FIG. 1 illustrates a head-mounted computing ecosystem in accordance with the principles of the present invention.

[0009] [Figure 2] FIG. 2 illustrates a head-mounted system having an optical system according to the principles of the present invention.

[0010] [Figure 3] FIG. 3 illustrates an exemplary image transfer module in accordance with the principles of the present invention.

[0011] [Figure 4] FIG. 4 illustrates a waveguide construction with increased content density through visual correction and controlled scenic light transmission in accordance with the principles of the present invention.

[0012] Although the present invention has been described in connection with certain preferred embodiments, other embodiments can be understood by those skilled in the art and encompassed herein. DETAILED DESCRIPTION OF THE INVENTION

[0013] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT(S) Aspects of the present invention relate to head-mounted computing (HWC) systems. In some examples, the HWC relates to a system that mimics the appearance of head-mounted eyeglasses or sunglasses. The eyeglasses may be a fully developed computing platform, such as one that includes a computer display presented to the user's eyes in each of the eyeglasses' lenses. In embodiments, the lenses and displays may be configured to allow a person wearing the eyeglasses to simultaneously view digital images and the environment through the lenses, the digital images forming an overlapping image that the person perceives as a digitally augmented image of the environment, or augmented reality (AR).

[0014] HWCs involve more than simply placing a computing system on a person's head. The system may need to be designed as a lightweight, compact, and fully functional computer display, including, for example, a high-resolution digital display that provides a high-level appearance consisting of a see-through view of the displayed digital content and the surrounding environment. User interfaces and control systems suitable for HWC devices may be required to differ from those used for more traditional computers, such as laptops. For the most efficient HWC and associated systems, the glasses may be equipped with sensors to determine environmental conditions, geographic location, positioning relative to other points of interest, objects identified by imaging and movement by the user or other users in a connected group, and the like. The HWC may then change its operating mode to adapt to conditions, location, positioning, movement, and the like, in a manner commonly referred to as a context-aware HWC. The glasses may also need to be connected wirelessly or otherwise to other systems, either locally or through a network. Controlling the glasses may be achieved through the use of external devices, automatically through information collected by the context, through user gestures captured by glasses sensors, and the like. Each technology can be further refined depending on the software applications used in the glasses. Additionally, the glasses can be used to control or interface with external devices associated with the glasses.

[0015] Referring to FIG. 1 , a schematic diagram of an HWC system 100 is presented. As shown, the HWC system 100 includes an HWC 102, which in this example is configured as head-mounted glasses with sensors that enable the HWC 102 to perceive objects and conditions in an environment 114. In this example, the HWC 102 also receives and interprets control inputs, such as gestures and movements 116. The HWC 102 may communicate with an external user interface 104. The external user interface 104 may provide a physical user interface to capture control instructions from a user of the HWC 102 and the external user interface 104, and the HWC 102 may communicate bidirectionally to affect the user's commands and provide feedback to an external device 108. The HWC 102 may also communicate bidirectionally with an externally controlled or linked local device 108. For example, the external user interface 104 may be used in connection with the HWC 102 to control the externally controlled or linked local device 108. The externally controlled or coordinated local device 108 may provide feedback to the HWC 102, and a customized GUI may be presented at the HWC 102 based on the type of device or specifically the particular device 108. The HWC 102 may also interact with remote devices and information sources 112 through a network connection 110. Again, the external user interface 104 may be used in connection with the HWC 102 to control or otherwise interact with either the remote device 108 and information sources 112, similar to when the external user interface 104 is used to control or otherwise interact with the externally controlled or coordinated local device 108. Similarly, the HWC 102 may interpret gestures 116 (e.g., captured from forward-, downward-, upward-, or rear-facing sensors, such as camera(s), rangefinder, IR sensor, etc.) or environmental conditions sensed in the environment 114 to control either the local device 108 or the remote device 112.

[0016] Each of the major elements depicted in Figure 1 will now be described in more detail. However, these descriptions are intended to provide general guidance and should not be construed as limiting. Additional descriptions of each element may also be found further herein.

[0017] The HWC 102 is a computing platform intended to be worn on a person's head. The HWC 102 can take many different forms to suit many different functional requirements. In some situations, the HWC 102 is designed in the form of traditional eyeglasses. The eyeglasses may or may not have an active computer graphics display. If the HWC 102 has an integrated computer display, the display may be configured as a see-through display such that a digital image can be superimposed on the user's view of the environment 114. There are numerous see-through optical designs that can be used, including designs with reflective displays (e.g., LCoS, DLP), emissive displays (e.g., OLED, micro-LED), holographic surfaces, TIR waveguides, and the like. In embodiments, the illumination system used in conjunction with the display optics can be a solid-state illumination system, such as LED, OLED, quantum dot, quantum dot LED, etc. Additionally, the optical configuration can be monocular or binocular. It may also include vision-correcting optical components. In other embodiments, the HWC 102 may be in the form of a helmet with a see-through shield, sunglasses, safety glasses, goggles, a mask, a fire helmet with a see-through shield, a police helmet with a see-through shield, a military helmet with a see-through shield, applications customized for specific work tasks (e.g., inventory control, logistics, repair, maintenance, etc.), and the like.

[0018] The HWC 102 may also have a number of integrated computing facilities, such as an integrated processor, integrated power management, communication fabrics (e.g., cellular, WiFi, Bluetooth, local area connectivity, mesh connectivity, remote connectivity (client-server, etc.)), and the like. The HWC 102 may also have a number of position perception sensors, such as a GPS, electronic compass, altimeter, tilt sensor, IMU, and the like. The HWC 102 may also have other sensors, such as a camera, rangefinder, hyperspectral camera, Geiger counter, microphone, spectral radiation detector, temperature sensor, chemical sensor, biological sensor, humidity sensor, ultrasonic sensor, and the like.

[0019] The HWC 102 may also have integrated control technology. The integrated control technology may be context-based control, passive control, active control, user control, and the like. For example, the HWC 102 may have integrated sensors (e.g., cameras) that capture a user's hand or body gestures 116, such that an integrated processing system interprets the gestures and generates control commands for the HWC 102. In another example, the HWC 102 may have sensors, including accelerometers, gyros, and other inertial measurement devices, that detect movements (e.g., nods, head shakes, and the like), and an integrated processor may interpret the movements and generate responsive control commands. The HWC 102 may also automatically control itself based on measured or perceived environmental conditions. For example, if it is bright in the environment, the HWC 102 may increase the brightness or contrast of a displayed image. In an embodiment, the integrated control technology may be installed on the HWC 102 so that a user can directly interact with the HWC 102. For example, the HWC 102 may have a button(s), a touch-sensitive capacitive interface, and the like.

[0020] As described herein, the HWC 102 may communicate with an external user interface 104. The external user interface can take many different forms. For example, a mobile phone screen may be adapted to accept user input for control of an aspect of the HWC 102. The external user interface may be a dedicated UI such as a keyboard, touch surface, button(s), joystick, and the like. In embodiments, the external controller may be integrated within another device such as a ring, watch, bike, car, and the like. In each case, the external user interface 104 may include sensors (e.g., an IMU, accelerometer, compass, altimeter, and the like) to provide additional input for controlling the HWC 104.

[0021] As described herein, the HWC 102 may control or cooperate with other local devices 108. The external devices 108 may be audio devices, visual devices, automobiles, mobile phones, computers, and the like. For example, a local external device 108 may be another HWC 102, in which case information may be exchanged between the separate HWCs 108.

[0022] Just as an HWC 102 may control or cooperate with local devices 106, an HWC 102 may control or cooperate with remote devices 112, such as an HWC 102 that communicates with the remote devices 112 through a network 110. Also, the form of the remote devices 112 may have many forms. These forms include another HWC 102. For example, each HWC 102 may communicate its GPS location so that all HWCs 102 know where all of the HWCs 102 are located.

[0023] 2 illustrates a HWC 102 having an optical system including an image production module 202 and an image transmission optical module 204. While modules 202 and 204 are generally described as separate modules, it should be understood that this is exemplary only and that the present invention encompasses other physical configurations, such as when the two modules are combined into a single module or when the elements forming the two modules are configured into more than two modules. In an embodiment, image production module 202 includes a computer-controlled display (e.g., LCoS, DLP, OLED, micro-LED, etc.) and is positioned to transmit or project image light to image transmission optical module 204. In an embodiment, image transmission optical module 204 includes eye delivery optics configured to receive the image light and deliver the image light to the eye of a wearer of the HWC. The transmission optical module may include reflective, refractive, holographic, TIR, etc. surfaces. While optical modules 202 and 204 are illustrated on one side of the HWC such that image light can be delivered to one eye of the wearer, it should be noted that embodiments including two image light delivery systems, one for each eye, are envisioned by the present invention. It should also be noted that while image production module 202 is depicted above in FIG. 2 as image transmission module 204, the inventors envision other configurations. Images can be projected onto image transmission module 204 from the top, bottom, at a corner, from the back, from the front, etc. These configurations can be based on which optics are included within the module.

[0024] Figure 3 illustrates a particular type of image transmission module 204. Figure 3 illustrates a waveguide having an image light directing surface 302 for directing image light within the waveguide. There are many different types of waveguides with image light directing surfaces, such as holographic, single layer holographic, multi-layer holographic, thick film holographic, external surface holographic, prismatic, surface relief, active holographic, etc. To provide some examples of waveguides with directing surfaces, reference is made to https: / / uploadvr.com / waveguides-smartglasses / , which is incorporated herein by reference. 3 , image production module 202 projects image light into an area of ​​waveguide 302, which includes input surface 304 adapted to redirect the image light internally through total internal reflection (TIR) ​​to folding surface 308, which redirects the image light within waveguide 302 to output surface 310, which is adapted to redirect light exiting waveguide 302 toward a user's eye. In embodiments, the input and output surfaces are further designed to magnify the image light once it is redirected out of waveguide 302 to form a wide field of view for the user. Each of surfaces 304, 308, and 310 can be prismatic, holographic, active, passive, multi-layer, single-layer, internal to the waveguide, external to the waveguide, etc. 3 is merely exemplary in nature to help the reader understand that there are various types of waveguides with directing surfaces for managing image light. Further in this regard, it should be understood that while the illustrated configuration shows a particular arrangement and orientation of the image-producing modules, waveguides, and various surfaces, the inventors envision that other configurations that will work exist, and that the configuration will generally depend on the requirements of the finished product.

[0025] FIG. 4 illustrates a waveguide construction with visual correction and increased content density through controlled scenery light transmission in accordance with the principles of the present invention. The inventors have discovered that while waveguides are useful for smart glasses and have a very good form factor, they are fragile because they are made of glass. They are also expensive, so breaking a pair of glasses is not a good idea. Additionally, because they are glass, any damage can result in injury to the user's eyes. The embodiment illustrated in FIG. 4 rigidifies the waveguide so that it is less susceptible to damage and / or impact. Additionally, the embodiment of FIG. 4 provides a waveguide see-through augmented reality solution with correctable visual elements and increased content density due to the control of scenery lighting, which provides background lighting for the content provided through the waveguide.

[0026] The waveguide 302 in FIG. 4 is part of an assembly where other components are added as shown. As shown, several components are stacked together to form at least a portion of an example image transmission module 204. The stack includes a waveguide 302 having an inner protective layer (e.g., polycarbonate, a protective plate, etc.) 402 on the side of the stack that faces the user's eye 414. The stack also includes an outer protective layer (e.g., polycarbonate, a protective plate, etc.) 404 on the opposite side of the waveguide 302. In an embodiment, an air gap 412 is maintained on each side of the waveguide 302 to ensure proper operation of the waveguide. That is, the stack of optical elements includes an air gap on either side of the waveguide so that the total internal reflection nature of reflections inside the waveguide is not destroyed. The air gap 412 maintains a substantial refractive index difference between the material waveguide 302 and the transition to the next material.

[0027] The optical stack of FIG. 4 further includes a vision correcting optic 410 (e.g., a molded elastomer that adheres to the inner protective layer 402 via surface adhesion, a glass or plastic vision correcting optic that is adhered to the protective inner layer 402, etc.). The vision correcting optic is a means for correcting the user's vision in the same manner as other prescription lenses, but in this embodiment, it is mounted to the inner protective layer 402, thereby correcting not only the user's view of the surrounding environment but also the user's view of the content presented through the waveguide 302. In an embodiment, the vision correcting optic 410 is a molded elastomer that adheres to the inner protective layer 402 via surface adhesion. This allows for quick and easy application of the vision correcting optic 410 made specifically for the user. An ophthalmologist or other prescriber of corrective lenses may make and sell the corrective lenses, which may then be applied by the user by primarily applying the optic onto the outer surface of the inner protective layer 402. Of course, in situations where a prescriber is not required, the user may simply purchase corrective lenses and apply them to the inner protective layer 402 (e.g., "reader" optics for increased magnification). In embodiments, for the vision correcting optic 410 to function properly, it is important to have a vertical and flat waveguide 302 and / or inner protective layer 402 positioned in front of the user's eye that is vertical and flat (e.g., flat across at least the surface on which the vision correcting optic 410 is mounted). When the waveguide 302 is positioned substantially vertically, image light transmits from the waveguide toward the user's eye at substantially 90 degrees from the waveguide surface. This is because typical corrective optics 410 are optically designed to be viewed through them when positioned vertically. This avoids the need to create a very complex prescription for the vision correcting optic 410 to compensate for the angle at which the user is looking. In an alternative embodiment, if the waveguide 302 is at a non-vertical angle, the inner protective layer 402 may include an angle on its outer surface (i.e., the surface closest to the eye 414) or may be mounted at an angle relative to the waveguide 302 so that when the vision correction optic is mounted it is perpendicular to the user's eye 414.In embodiments, the inner protective layer 402 may include one or more markings or a template may be provided to assist the user in aligning the vision-correcting optic 410 .

[0028] In an embodiment, the inner protective layer 402 may itself include the optical correction portion. The inner protective layer may be formed from polycarbonate or other suitable material and may be molded to the user's needs. The optically corrected inner protective layer may then be attached to the waveguide 302 such that an air gap 412 is maintained. This eliminates the need for a separate material to be applied to the inner protective layer 402. Of course, this configuration may require a more involved manufacturing or user process to install the optically corrected inner protective layer 402.

[0029] As illustrated in FIG. 4 , in an embodiment, the stack may include an outer protective layer 404 positioned to provide an air gap 412 between the outer protective layer 404 and the waveguide 302 to maintain proper total internal reflection of the waveguide when delivering computer content to a user's eyes in a head-mounted see-through computer display. The stack may also include an electrochromic layer 408 that may be controlled by a processor in the head-mounted computer 102. The electrochromic layer may be computer controlled to rapidly reduce or increase the amount of scenery light reaching the waveguide 302. The scenery light primarily forms background light for the computer image presented within the waveguide 302 due to the see-through nature of the waveguide 302. If the outside of the waveguide 302 (i.e., the side opposite the user's eyes) has high transparency, the computer content presented within the waveguide 302 may be transparent and / or the content may require high brightness to overcome the scenery light. When the electrochromic layer 408 is activated to provide dimming of the scenery light, the computer content may appear less transparent and / or the brightness of the content may be reduced because there is not as much scenery light to overcome. In an embodiment, the electrochromic layer 408 is applied directly to the outer protective layer 404. In another embodiment, the electrochromic layer 408 is applied to an intermediate layer.

[0030] The inventors have discovered that significant difficulties exist when applying electrochromic surfaces to eyeglass formats. Electrochromic surfaces tend not to apply well to complex shapes containing compound radii, such as standard corrective eyeglasses or sunglasses lenses. Applying the surface to a single curve within the surface is somewhat easier. It is easiest and produces the best results when the electrochromic surface is applied to a flat surface. In embodiments, the air gap design described herein can be used with any shaped electrochromic surface.

[0031] In embodiments, the outer protective layer 404 may include photochromic material(s), which may provide automatic dimming of the scenery light based on the intensity of the scenery light. The photochromic layer may be provided in a separate layer on either side of the outer protective layer. Typically, the photochromic layer may be positioned further from the user's eyes than the electrochromic layer so that the electrochromic layer does not affect the performance of the photochromic layer.

[0032] In an embodiment, an anti-reflective coating may be applied to any or all of the surfaces of the optical stack illustrated with respect to FIG. 4 that are exposed to air in the final assembly to prevent diffuse reflections during use of the head-worn computer 102.

[0033] In embodiments, the inner protective layer 402 and the outer protective layer 408 can be applied to the waveguide 302 without leaving an air gap 412 by using a material for the protective layer that substantially matches the refractive index of the material used in the waveguide 302. By using an index-matching material, total internal reflection of the waveguide can use the outer surface of the protective layer. In such a configuration, an air gap can be provided between the inner protective layer 402 and the correction optic 410. Furthermore, in such a configuration, an air gap can be provided between the outer protective layer 404 and the electrochromic layer 408.

[0034] In an embodiment, the waveguide 302, or portions thereof, may be made of glass (eg, Gorilla Glass) that has been chemically treated to increase the strength of the waveguide.

[0035] In one embodiment, a head-mounted see-through computer display may include a glass waveguide having a first inner surface, the first inner surface having a flat area at least in a region where image light is projected from the glass waveguide toward a user's eye, the glass waveguide being further configured to transmit the image light therefrom at approximately 90 degrees relative to the first inner surface; a protective inner layer positioned between the glass waveguide and the user's eye, the protective inner layer being further positioned to provide a first air gap between the glass waveguide and the protective inner layer; and vision correction optics mounted to the protective inner layer and positioned between the protective inner layer and the user's eye. The glass waveguide may include at least one holographic surface. The at least one holographic surface may include multiple holographic surfaces. The glass waveguide may be positioned vertically in front of the user's eye. The protective inner layer may have an outer surface on which a vision-correcting optic is mounted, and the outer surface may be positioned vertically in front of a user's eye. The head-mounted see-through computer display may further include a protective outer layer positioned on the side of the waveguide opposite the protective inner layer, and the protective outer layer may be further positioned to provide a second air gap between the protective outer layer and the glass waveguide. The head-mounted see-through computer display may further include an electrochromic surface controlled by the processor to controllably prevent at least a portion of the scenic light from reaching the glass waveguide. The electrochromic surface may be positioned between the protective outer layer and the glass waveguide. The electrochromic surface may be applied to the protective outer layer, and the second air gap may be between the electrochromic surface and the glass waveguide. The protective outer layer may be photochromic. The vision-correcting optic may include an elastomeric optic that adheres to the protective inner layer by surface tension.

[0036] Although embodiments of the HWC have been described in language specific to features, systems, computer processes, and / or methods, the appended claims are not necessarily limited to the particular features, systems, computer processes, and / or methods described. Rather, the particular features, systems, computer processes, and / or methods are disclosed as non-limiting example implementations of the HWC. All documents referenced herein are incorporated by reference.

Claims

[Claim 1] Inventions relating to see-through computer display systems, etc.

Images