Mixed reality optical system using microphosphor and lens element arrays in curved waveguides

Abstract

The sunglasses-style head-mounted display (100) includes a curved waveguide (108) containing a dual reflective coating / film (304 / 308) and an array of light wavelength-converting phosphor pinhole-sized disks (314) covered with pinhole-sized microlenses (316) to present a wide FOV virtual image for AR / VR.

Description

[Technical field]

[0001] This application relates generally to a wide field of view (FOV) optical system for mixed reality, including augmented reality (AR) and / or virtual reality (VR), utilizing an array of pinhole-sized microlenses juxtaposed with an optical wavelength-converting phosphor microdisplay in a double-reflection curved waveguide. [Background technology]

[0002] As recognized herein, there is a need for future wide FOV VR and AR systems that look like sunglasses, are very thin, lightweight, form fitting, and curved to provide a wide FOV (particularly for VR). Summary of the Invention

[0003] As further recognized herein, current technology for achieving both AR / VR in very thin and lightweight form factors uses flat waveguide technology. This is because the (glass or plastic) waveguide requires the effect of total internal reflection (TIR) ​​to bounce the display image light within the waveguide, so as to expand the image from a narrow display area to a wide area directed to the user's eye, through a process called exit pupil expansion. TIR can only work in flat or near-flat waveguides, because in curved waveguides, light escapes the TIR requirement (bounces light that is incident at or below 42 degrees to the plane of the waveguide) and exits the waveguide incorrectly. Therefore, due to light losses, it is extremely difficult to make a curved waveguide-based optical system for VR / AR that is efficient enough to be effective.

[0004] To meet the above challenges, the system includes a UV display and a curved waveguide containing an array of light wavelength-converting phosphor pinhole-sized disks with double-sided UV reflective coatings / films and covered with pinhole-sized microlenses.

[0005] Thus, in an aspect, an assembly includes a curved waveguide, a first ultraviolet (UV) light reflective coating or film disposed on the waveguide, and a second UV light reflective coating or film disposed on the waveguide. At least one UV emitter is configured to emit UV light into the waveguide between the first UV light reflective coating and / or film and the second UV light reflective coating and / or film. At least one light wavelength conversion element, such as a phosphor disk, is in the waveguide and is disposed to receive UV light from the UV emitter reflected by the UV light reflective coating and / or film. The conversion element is configured to convert the UV light into visible light that propagates through one or both of the UV light reflective coatings and / or films and impinges on an eye of a wearer of the waveguide.

[0006] In an embodiment, the assembly is configured as sunglasses, with the waveguides coupled to the left and right temples such that when the assembly is worn by a wearer, the waveguides are disposed in front of the wearer's face.

[0007] At least one lens may be juxtaposed with the conversion element through which visible light emitted by the conversion element passes. A plurality of conversion elements may be disposed in the waveguide.

[0008] In an exemplary implementation, the UV light reflective coating and / or film allows visible light to pass through.

[0009] The conversion elements can be juxtaposed to the exterior surface of the waveguide, disposed in gaps in the UV reflective coating and / or film. Alternatively, the conversion elements can be juxtaposed to the interior surface of the waveguide, with no gaps in the UV reflective coating and / or film. The conversion elements can generally be positioned anywhere within the path of the UV light within the waveguide.

[0010] In some embodiments, a UV light path is defined between the UV light reflective coatings and / or films, and at least one UV sensor can be provided outside the UV light path for generating at least one signal upon detection of UV light, the signal being operable to cause the UV emitter to cease emitting UV light into the light path.

[0011] The UV emitter may include at least one UV display that emits light in one or more UV wavelength bands.

[0012] In another aspect, a device is configured to be worn on a person's head and includes at least one curved waveguide defining an ultraviolet (UV) light path through which UV light is restricted to pass. At least one UV emitter is optically coupled to the light path for emitting a desired virtual reality (VR) or augmented reality (AR) image into the light path. Also, at least one conversion element is disposed within the light path for receiving the UV light from the UV emitter. The conversion element is configured to propagate the UV light out of the light path and convert it to visible light that strikes the person's eye when the person is wearing the waveguide.

[0013] In another aspect, a device is configured to be worn on a person's head and includes at least one curved waveguide defining an ultraviolet (UV) light path through which UV light is restricted to pass. At least one UV emitter is optically coupled to the light path for emitting a desired virtual reality (VR) or augmented reality (AR) image into the light path. At least one UV sensor is outside the UV light path for generating at least one signal upon detection of UV light. The signal is operable to cause the UV emitter to stop emitting UV light into the light path.

[0014] In another aspect, a device is configured to be worn on a person's head and includes at least one curved waveguide defining an infrared (IR) light path in which IR light is restricted from passing by an IR reflective coating and / or film on at least one side of the waveguide. At least one IR emitter is provided and at least one IR sensor can be provided outside the IR light path for generating at least one signal upon detection of IR light. The signal is operable to cause the IR emitter to stop emitting IR light into the light path. The at least one IR emitter is optically coupled to the light path for emitting a requested virtual reality (VR) or augmented reality (AR) image into the light path. Also, at least one conversion element is disposed within the light path for receiving IR light from the IR emitter. The conversion element is configured to convert the IR light, when the person is wearing the waveguide, to visible light that propagates out of the light path through a micro-focusing lens and strikes the person's eye. The details of this application, both as to its structure and operation, can best be understood with reference to the accompanying drawings, in which like reference numbers refer to like parts: [Brief description of the drawings]

[0015] [Figure 1] 1 illustrates a curved sunglasses style display consistent with the present principles. [Diagram 2] FIG. 1 is a block diagram of an exemplary assembly consistent with present principles. [Diagram 3] 1 is a schematic diagram of a first embodiment of an exemplary waveguide configured as curved sunglasses, as viewed from above in a plan view looking down on the top of the waveguide. FIG. [Figure 4] FIG. 2 is a schematic diagram of a second embodiment of an exemplary waveguide configured as curved sunglasses, with the UV reflective coating removed for clarity, as if looking down from the top of the waveguide in a plan view. [Diagram 5]FIG. 11 is a schematic diagram of a third embodiment of an exemplary waveguide, as if looking down in plan from the top of the waveguide, configured as curved sunglasses, showing alternative locations for UV coatings and / or films, with phosphor elements removed for clarity. [Figure 5A] FIG. 11 is a schematic diagram of a fourth embodiment of an exemplary waveguide, configured as curved sunglasses, as if looking down on a portion of the waveguide from the top of the waveguide in a plan view, showing how the waveguide is constructed from three separate sections, with the UV coating and / or film highlighted as being inside the waveguide after assembly. [Figure 6] FIG. 11 is a schematic diagram of a fifth embodiment of an exemplary waveguide, configured as curved sunglasses, showing the alternating arrangement of phosphor elements, with UV coatings and / or films removed for clarity, as if looking down from the top of the waveguide in a plan view. [Figure 7] FIG. 1 is a schematic diagram of an exemplary waveguide, as viewed in plan view down from the top of the waveguide, configured as curved sunglasses illustrating UV or IR and visible light. [Figure 8] 1 is a block diagram of an exemplary system according to the present principles, and is a perspective view of an exemplary headset. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0016] The present disclosure generally relates to computer ecosystems, including aspects of consumer electronics (CE) device networks, such as, but not limited to, computer gaming networks. The systems herein may include server and client components that may be connected via a network such that data may be exchanged between the client and server components. The client components may include one or more computing devices, including gaming consoles, such as Sony PlayStation® or Microsoft, or Nintendo or other manufacturer gaming consoles, virtual reality (VR) headsets, augmented reality (AR) headsets, portable televisions (e.g., smart televisions, Internet-enabled televisions), portable computers, such as laptops and tablet computers, other mobile devices, including smartphones, as well as additional examples described below. These client devices may operate in a variety of operating environments. For example, some of the client computers may employ, as examples, a Linux operating system, a Microsoft operating system, or a Unix operating system, or an Apple or Google operating system, or a Berkeley Software Distribution or Berkeley Standard Distribution (BSD) OS, including variants of BSD. These operating environments may be used to run one or more browsing programs, such as browsers produced by Microsoft, Google, or Mozilla, or other browser programs that can access web sites hosted by the Internet servers described below. Additionally, operating environments according to present principles may be used to run one or more computer game programs.

[0017] Servers and / or gateways may be used that may include one or more processors that execute instructions that configure the server to receive and transmit data over a network such as the Internet. Alternatively, clients and servers may be connected via a local intranet or a virtual private network. The servers or controllers may be instantiated by game consoles such as the Sony PlayStation®, personal computers, etc.

[0018] Information may be exchanged between the clients and the servers over a network. For this purpose and for security, the servers and / or clients may include firewalls, load balancers, temporary storage, and proxies, as well as other network infrastructure for reliability and security. One or more servers may form an apparatus that implements a method for providing a secure community, such as an online social website or a gamer network, to network members.

[0019] The processor may be a single-chip or multi-chip processor capable of implementing logic through various wiring such as address lines, data lines, and control lines, and registers and shift registers.

[0020] Components included in one embodiment may be used in other embodiments in any suitable combination. For example, any of the various components described herein and / or illustrated in the drawings may be combined, interchanged, or excluded from other embodiments.

[0021] "A system having at least one of A, B, and C" (also "a system having at least one of A, B, or C" and "a system having at least one of A, B, C") includes systems having A only, B only, C only, A and B together, A and C together, B and C together, and / or A, B, and C together.

[0022] Referring now to FIG. 1, a sunglass-style assembly 100 includes a frame 102 configured to be worn on a person's head. The frame includes left and right temples 104, a nose bridge 106, and the frame holds at least one solid or hollow waveguide 108 that is curved in at least the horizontal plane when worn and may also be curved in the vertical plane. The waveguide 108 is configured as a single-lens sunglass lens and is translucent or transparent to visible light. The waveguide 108 may be glass or plastic and may be a prescription eyeglass lens in addition to the features described below. The waveguide 108 may be tinted in the manner of a sunglass lens in addition to the features described below. Alternatively, the waveguide may be incorporated into a non-sunglasses type head mounted display.

[0023] FIG. 2 illustrates that at least one UV light emitter 200, such as a UV display, is in-coupled into the waveguide 108 on one end of the waveguide. The UV display can be in-coupled into the waveguide at a section of the waveguide with a specially angled planar, curved, or freeform surface, and the UV display is attached directly to that section by optical adhesive. Optionally, in-coupling of UV light from the UV display can be performed by additional optical in-coupling methods, such as a coupling prism, a surface relief grating, or any suitable optical in-coupler that passes UV light from the UV display into the waveguide. The light emitted by the UV emitter 200 can be a desired virtual reality or augmented reality image under the control of at least one processor 202 that accesses at least one computer storage device 204 to carry out the principles discussed herein. The required images may be provided by a VR (or AR) image source 206, which may be on-board the assembly 100 along with the processor 202, or may be remote from the assembly 100 and in wireless communication with the processor 202 via a suitable wireless interface 210. At least one UV sensor 212 may be provided to detect UV light leaking from the waveguide 108 and to signal the processor 202 to disable the UV emitter 200 in response to UV light detected outside the waveguide 108.

[0024] Figure 3 illustrates a first embodiment of the waveguide 108 shown in Figures 1 and 2, and labeled 300 in Figure 3, configured as curved sunglasses, as if looking down on the top of the waveguide in a plan view. An exterior surface 302 of the waveguide 300 is covered with an ultraviolet (UV) reflective coating (and / or film) 304, and an interior surface 306 of the waveguide 300 is likewise covered with a UV coating and / or film 308.

[0025] The coatings / films 304, 308 reflect UV light from the UV emitter 310 back into the waveguide regardless of the angle of incidence of the light on the surface of the waveguide. Note that multiple UV emitters can be used as indicated by the dashed box 312. In effect, a UV light path is defined between the UV reflective coatings and / or films.

[0026] In this case, total internal reflection is not required and the system acts like a double mirror solution (similar to solar light tubes used in homes), but only for UV light. UV light is captured inside the waveguide 300 and allowed to reflect back into the waveguide at angles outside the TIR requirement (near or below 42 degrees relative to the plane of the waveguide at the point of interaction of the light with the waveguide surface).

[0027] It should also be noted that this UV-trapping waveguide also reflects extraneous UV light from passing through the waveguide, thus providing useful UV protection to the wearer in a manner similar to sunglasses with UV-reflecting lenses.

[0028] Visible light can pass through the UV coatings and / or films 304, 308, and waveguide 300 in the same manner that light passes through curved glass or plastic (same as traditional glass, sunglasses, etc.), providing an optical pass-through of real-world light in an optical see-through AR (OST-AR) use case.

[0029] The UV emitter 310 may be a UV light emitting diode (LED) display, a liquid crystal on silicon (LCOS) display with a UV light source, a UV laser light scanning display, or any other display technology capable of emitting UV light that can couple (in-couple) a UV-based image into one region of the curved waveguide.

[0030] Within the waveguide 300 is a UV-to-visible light conversion element 314 (in some embodiments, a disk-shaped element, preferably less than 2 mm in diameter). The UV-to-visible light conversion element 314 may be disposed in a small recess in the waveguide and glued to the waveguide during manufacturing. Alternatively, the UV-to-visible light conversion element may be disposed within a polymer film on the outer surface of the waveguide between the UV reflective coating and / or films 304 and 308. The UV-to-visible light conversion element 314 may be manufactured in several ways, including generally glued to the waveguide, bonded to the waveguide, glued to the waveguide, bonded to the waveguide, disposed within the waveguide, disposed on the waveguide, embedded in the waveguide, or deposited on the waveguide. The UV-to-visible light conversion element 314 may generate monochromatic visible light, or may be configured to generate red, green, and blue light, for example, by converting three different UV wavelengths to their respective visible colors.

[0031] In one embodiment, the elements 314 can be visible-emitting, UV-excited phosphors embedded in a polymer. Different layers of polymer with appropriate phosphors can be present to support different UV excitation wavelengths and different visible light emission wavelengths, which together can perform full color (red, green, blue) emission from the separate UV excitation wavelengths. These conversion elements 314 convert UV light to visible light through an excitation process, thus acting as a self-emissive display. The UV conversion elements 314 can be arranged in an evenly or unevenly spaced array. When using optical see-through AR (OST-AR), sufficient space is used between the conversion elements 314 to maintain a certain level of optical transparency for passing visible light so that the user can see the real world without any significant degradation of vision. Additionally, the spacing of the UV conversion elements can depend on maintaining a wide field of view in at least one axis based on the UV light array bouncing in the UV trapping waveguide. Thus, the size and arrangement of the UV conversion elements can be designed such that the UV light from the UV display can bounce in the UV reflective trapping waveguide and distribute the UV light image from the UV display to all the UV conversion elements.

[0032] In one embodiment, the phosphor disks are preferably no more than 2 mm in diameter, and it should be noted that because the waveguides are so close to the eye (less than 15 mm), the human visual system cannot see the conversion elements (such as phosphor disks) themselves, because they are smaller than the entrance diameter of the human eye's pupil and are blurred beyond recognition (due to accommodative retinal blur). It should further be noted that the phosphor light wavelength conversion elements can be any shape and size.

[0033] As shown in FIG. 3, on one side of each element 314 facing the user's eye is a microlens 316 made of glass, plastic, or polymer, or other suitable material with a diameter of approximately less than 2 mm, i.e., the same diameter as the disk 314, or slightly larger. Each microlens 316, which may only affect visible wavelengths and not UV wavelengths, focuses the visible light emitted by the respective conversion element 314 to generate a virtual image when viewed by a human eye approximately 10 mm to 15 mm away, in one embodiment. The curvature and design of the microlenses 316 can be such as to adjust the virtual image focal length that may be appropriate for AR / VR use. For example, the microlenses can generate a virtual image at infinity or greater than 5 meters in one use case, or greater than 2 meters in another use case.

[0034] It should be noted that instead of a single microlens, a microlens array (MLA) can be used to cover the diameter of the phosphor display, or other forms of light focusing technology can be used. In another case, a liquid crystal microlens array can be used to provide dynamic focusing of the visible light image emitted from the phosphor disk array. In such a system, the focus / accommodation distance of the AR or VR view can be dynamically adjusted to take into account where the user is looking based on eye tracking, and / or based on the content, and / or based on the user's glasses prescription, and combinations thereof.

[0035] When multiple UV emitters 310, 312 are used, they can be placed at the edge of the curved waveguide 300 to increase the FOV in one dimension (horizontal or vertical) or two dimensions (horizontal and vertical) as needed. Such a system can be used to create a form-fitting sunglasses style AR / VR system that can provide an FOV that matches human vision (roughly 270 degrees horizontal, 170 degrees vertical).

[0036] It should be understood that in Figure 3 and other embodiments, infrared (IR) light may be used instead of UV light. In such an embodiment, in Figure 3, the coatings / films 304, 308 are IR reflective and pass visible light, and the emitter 310 is an IR emitter. The light conversion element 314 converts the IR image to a visible light image.

[0037] 4 is a schematic diagram of a second embodiment of an exemplary waveguide 400 configured as curved sunglasses, with UV reflective coatings and / or films removed for clarity, as viewed from above the waveguide. Phosphor UV-to-visible conversion elements 402 with respective lenses 404 are used according to the principles described above, except that fewer and larger elements 402 are used in FIG. 4 compared to the size and number of conversion elements 314 shown in FIG. 3. The size and number of conversion elements used may depend on the incoupling angle of the UV image from the UV display, the desired FOV for the user's field of view, and / or whether the system is for optical see-through augmented reality (OST-AR) or virtual reality (VR) (among other factors).

[0038] FIG. 5 is a schematic diagram of a third embodiment of an exemplary waveguide 500 configured as a curved pair of sunglasses, with the phosphor elements removed for clarity, showing alternative locations for the UV coatings and / or films, as viewed from above the waveguide in a plan view. In FIG. 5, two UV films and / or coatings 502, 504 are applied within the interior of the waveguide 500. This may be accomplished by making the waveguide out of two sections, with the UV film and / or coating 502 applied to the farther (from the user's eye) and targeted inner surface of the first waveguide section, and the UV film and / or coating 504 applied to the closer (from the user's eye) and targeted inner surface of the second waveguide section. The two waveguide sections may be bonded together using any optical bonding technique that places the UV film and / or coating on the targeted surface within the interior of the waveguide. It should be noted that such embodiments can provide a final waveguide that is difficult to scratch off because the UV reflective film and / or coating is inside and protected by the plastic or glass waveguide.

[0039] FIG. 5A is a schematic diagram of a fourth embodiment of an exemplary waveguide configured as curved sunglasses, as viewed from above in a plan view, showing that the waveguide is composed of separate parts 510, 520, and 530. In FIG. 5A, at least one UV film and / or coating 502 is applied to the inner surface of the waveguide part 510, and at least one UV film and / or coating 504 is applied to part 530, such that these coatings / films are internal to the waveguide when parts 510, 520, and 530 are joined together during assembly. It is noted that such an embodiment can provide a final waveguide that is difficult to scratch off, since the UV reflective film and / or coating is internal to and protected by the plastic or glass waveguide. Parts 510, 520, and 530 can be manufactured using injection molding, 3D printing, and other manufacturing techniques for making plastic or glass optical parts. It should also be noted that a variety of manufacturing techniques can be used to apply the UV coatings and / or films 502 and 504 to the respective pieces 510 and 530, including but not limited to vacuum bonding with an optical adhesive of matching reflectivity (to the waveguide material), sputtering deposition, pulsed laser deposition, evaporative deposition, chemical vapor deposition, etc. It should further be appreciated that the light wavelength-converting phosphor element 512 shown in Figure 5A can be applied to the recesses of the waveguide piece 510 using a variety of manufacturing techniques, including but not limited to vapor deposition, liquid coating and curing, additive 3D printing, adhesive bonding, etc.

[0040] 5A, microlens elements 514 are juxtaposed with the phosphor elements 512. It should be noted that these microlens elements 512 can be bonded to the phosphor elements 512 using a variety of manufacturing techniques, including, but not limited to, additive 3D printing, and placement and fastening using optical bonding techniques.

[0041] 6 is a schematic diagram of a fifth embodiment of an exemplary waveguide 600 configured as curved sunglasses, with UV films and / or coatings removed for clarity, showing the alternating arrangement of conversion elements 602 on the inner surface 604 of the waveguide 600, as viewed from above in a plan view looking down on the top of the waveguide. The UV-to-visible light conversion elements herein may generally be disposed in any suitable location within the UV light path.

[0042] 7 is a schematic diagram of an exemplary waveguide 700 configured as curved sunglasses, such as any of the waveguides discussed herein, illustrating UV light 702 emanating from at least one UV emitter 704, being internally reflected within the waveguide, with some of the UV light impinging on a conversion element 706 (UV reflective films and / or coatings and lenses not shown), as viewed from above the waveguide. The conversion element 706 converts the UV light into a beam of visible light 708, which passes through UV films and / or coatings to impinge on the wearer's eye 710. As shown, the beams of visible light 708 can overlap with each other such that the wearer does not perceive a discontinuity in the visible image as the eye 710 rotates to see the entire field of view within the fovea.

[0043] The waveguides discussed herein may be made of solid plastic or glass, or they may be hollow, ie, with an air chamber between the inner and outer surfaces of the waveguide.

[0044] The above solution provides an architecture that allows optical and mechanical designers and engineers the flexibility to create curved form factors without designing around the efficiency limitations of total internal reflection in waveguides.

[0045] It should be appreciated that image light bouncing around in a curved UV trapping waveguide can cause significant distortion in the UV image (a composition of many pixel UV light rays) that falls on a particular phosphor disk. This results in a highly distorted and incomprehensible visible image being displayed to the user. The amount of distortion depends on the curvature and thickness of the waveguide, as well as the placement and angle of the phosphor disk and UV display (among other factors).

[0046] The present principles thus provide at least four techniques that can be used individually or collectively to address the above problems.

[0047] First, the UV image light emitted from the UV display can be pre-distorted prior to or during the process of incoupling into the waveguide. This can be accomplished using specifically designed passive optical elements such as freeform optical lenses, surface relief gratings, diffractive volume holograms, or through dynamic optical solutions such as phase liquid crystal on silicon (LCOS) spatial light modulators that contain phase holographic freeform lens images. Regardless of the optical technique, the UV light image can be pre-distorted to account for the distortion induced to the UV image light falling on each phosphor display.

[0048] Second, the phosphor display disk itself can be oriented (angled with respect to the waveguide surface facing the user), or can include some curvature (in one or both surface axes), or be a freeform surface to account for UV image distortion, so that visible light (after passing through the microlenses covering the phosphor display) is correct for the user's pupil to view the provided field of view.

[0049] Third, the microlenses covering the phosphor displays can have an asymmetric design or be completely freeform to account for distortions to the visible image displayed by each phosphor display. Note that the microlenses can also be diffraction-based lenses (surface relief gratings, volume holographic) and designed to correct for distortions from the phosphor displays.

[0050] Fourth, the curvature of the outer surface of the waveguide can be different from the curvature of the inner surface of the waveguide, which can be used to reduce distortion of the image before it is transduced by the phosphor element.

[0051] It should be understood that additional optical elements can be added (internal or external) to the curved waveguide to provide magnification of the UV or IR in-coupled image before it is converted by the phosphor element. This image magnification is generally referred to as exit pupil expansion and can be performed in one or two axes to increase the size of the image bouncing inside the double-reflection waveguide. The optical elements that facilitate the exit pupil expansion can be positioned after the in-coupling from the UV or IR emitter and before the UV or IR image hits the light conversion element. In one embodiment, the surfaces of the curved waveguide can include structures (such as surface relief gratings) used to perform exit pupil expansion in one or two axes and can be covered with reflective coatings or films to implement the double-reflection curved waveguide solutions described herein. As described in the description for FIG. 5A, these surfaces can be constructed to be internal to the waveguide when the waveguide is made from separate adjacent sections.

[0052] Further again, the exit pupil expansion function, double reflection, and image distortion correction may all be performed by the same structure on the (internal or external) surface of the waveguide in the light path from the light emitter to the light conversion element. It should be appreciated that such a system may thus utilize smaller light emitters for smaller in-coupling areas compared to the out-coupling areas that include the light conversion elements with their associated microlenses, which would facilitate a form-fitting sunglasses style assembly as described in the description of FIG.

[0053] The above waveguides can be perceptually completely transparent or semi-transparent, do not have to be electrically powered, and due to the use of two UV or IR reflective coatings and / or films, there is no need to consider total internal reflection.

[0054] Referring to FIG. 8, an exemplary system 10 is shown, which may include one or more of the exemplary devices described above and further below in accordance with the present principles. The first of the exemplary devices included in the system 10 is a consumer electronics (CE) device, such as an audio video device (AVD) 12, for example, but not limited to, an Internet-enabled TV with a TV tuner (equivalently, a set-top box that controls the TV). The AVD 12 may also alternatively be a computerized Internet-enabled ("smart") phone, a tablet computer, a notebook computer, a head-mounted device (HMD) and / or a headset, such as smart glasses or a VR headset, another wearable computerized device, a computerized Internet-enabled music player, a computerized Internet-enabled headphones, a computerized Internet-enabled implantable device, such as an implantable skin device. It should be understood that the AVD 12, regardless of what it is, is configured to implement the present principles (e.g., to communicate with other CE devices to implement the present principles, to execute the logic described herein, and to perform any other functions and / or operations described herein).

[0055] Thus, to realize such principles, AVD 12 may be established by some or all of the components shown. For example, AVD 12 may include one or more touch-enabled displays 14, which may be implemented by high definition or ultra-high definition "4K" or higher flat screens. Touch-enabled display 14 may include, for example, a capacitive or resistive touch-sensing layer having a grid of electrodes for touch sensing consistent with the present principles.

[0056] The AVD 12 may also include one or more speakers 16 for outputting audio in accordance with the present principles, and at least one additional input device 18, such as an audio receiver / microphone, for inputting audible commands to the AVD 12 to control the AVD 12. The example AVD 12 may also include one or more network interfaces 20 for communicating over at least one network 22, such as the Internet, a WAN, a LAN, etc., under the control of one or more processors 24. Thus, the interface 20 may be a Wi-Fi transceiver, which is an example of a wireless computer network interface, such as, but not limited to, a mesh network transceiver. It should be understood that the processor 24 controls the AVD 12 to implement the present principles, including other elements of the AVD 12 described herein, such as controlling the display 14 to present images thereon and receiving input therefrom. It should further be noted that the network interface 20 may be a wired or wireless modem or router, or a wireless telephone transceiver, or other suitable interface, such as the Wi-Fi transceiver discussed above.

[0057] In addition to the above, the AVD 12 may include one or more input and / or output ports 26, such as a High-Definition Multimedia Interface (HDMI) port or a Universal Serial Bus (USB) port for physically connecting to another CE device, and / or a headphone port for connecting headphones to the AVD 12 to present audio from the AVD 12 to a user through the headphones. For example, the input port 26 may be connected, via wire or wirelessly, to a cable or satellite source 26a of audio-video content. Thus, the source 26a may be a separate or integrated set-top box, or a satellite receiver. Alternatively, the source 26a may be a game console or disc player containing the content. The source 26a when implemented as a game console may include some or all of the components described below in connection with the CE device 48.

[0058] The AVD 12 may further include one or more computer memory / computer readable storage media 28, such as non-transitory disk-based or solid-state storage, possibly embodied within the AVD chassis as a standalone device or as a personal video recording device (PVR) or video disk player either inside or outside the AVD chassis for playing AV programs, or as a removable memory medium or server as described below. In some embodiments, the AVD 12 may also include a position or location receiver, such as, but not limited to, a cellular receiver, a GPS receiver, and / or an altimeter 30, configured to receive geographic location information from a satellite or cellular base station and provide that information to the processor 24 and / or in conjunction with the processor 24 to determine the altitude at which the AVD 12 is disposed. The component 30 may also be implemented by an inertial measurement unit (IMU), typically including a combination of accelerometers, gyroscopes, and magnetometers, or by event-based sensors to determine the location and orientation of the AVD 12 in three dimensions.

[0059] Continuing with the description of the AVD 12, in some embodiments, the AVD 12 may include one or more cameras 32, which may be thermal imaging cameras, digital cameras such as webcams, event-based sensors, and / or cameras integrated into the AVD 12 and controllable by the processor 24 to collect pictures / images and / or videos in accordance with present principles. The AVD 12 may also include a Bluetooth transceiver 34 and other near field communication (NFC) elements 36 for communicating with other devices using Bluetooth and / or NFC technologies, respectively. An exemplary NFC element may be a radio frequency identification (RFID) element.

[0060] Continuing further, the AVD 12 may include one or more auxiliary sensors 38 (e.g., pressure-sensitive sensors, motion sensors such as accelerometers, gyroscopes, cyclometers, or magnetic sensors, infrared (IR) sensors, optical sensors, speed and / or cadence sensors, event-based sensors, gesture sensors (e.g., for sensing gesture commands)) that provide input to the processor 24. For example, one or more of the auxiliary sensors 38 may include one or more pressure sensors forming a layer of the touch-enabled display 14 itself, which may be, without limitation, piezoelectric pressure sensors, capacitive pressure sensors, piezoresistive strain gauges, optical pressure sensors, electromagnetic pressure sensors, etc.

[0061] The AVD 12 may also include an over-the-air television broadcast port 40 for receiving OTA television broadcasts that provide input to the processor 24. In addition to the above, it is noted that the AVD 12 may also include an infrared (IR) transmitter and / or an IR receiver and / or an IR transceiver 42, such as an IR Data Association (IRDA) device. A battery (not shown) may be provided to power the AVD 12, and may also be a kinetic energy harvester that may convert kinetic energy into power to charge the battery and / or power the AVD 12. A graphics processing unit (GPU) 44 and a field programmable gate array 46 may be included. One or more haptic / vibration generators 47 may be provided to generate haptic signals that can be sensed by a person holding or in contact with the device. The haptic generator 47 may vibrate all or a portion of the AVD 12 using an electric motor connected to an off-center and / or off-balance weight via a rotatable shaft of the motor, such that the shaft can rotate under the control of the motor (which in turn may be controlled by a processor such as processor 24) to create simulations of vibrations of various frequencies and / or amplitudes, as well as forces in various directions.

[0062] In addition to the AVD 12, the system 10 may include one or more other CE device types. In one embodiment, the first CE device 48 may be a computer game console that can be used to send computer game audio and video to the AVD 12 via commands sent directly to the AVD 12 and / or through a server, as described below, while the second CE device 50 may include similar components as the first CE device 48. In the illustrated embodiment, the second CE device 50 may be configured as a computer game controller operated by a player or a head-mounted display (HMD) worn by a player. The HMD may include a head-up transparent or non-transparent display for presenting AR / MR or VR content, respectively. The HMD may implement a sunglasses style structure as illustrated herein.

[0063] In the illustrated embodiment, only two CE devices are shown, but it should be understood that a fewer or greater number of devices may be used. The devices herein may implement some or all of the components shown for AVD 12. Any of the components shown in the following figures may incorporate some or all of the components shown for AVD 12.

[0064] Referring now to the at least one server 52 mentioned above, it includes at least one server processor 54, at least one tangible computer-readable storage medium 56, such as disk-based or solid-state storage, and at least one network interface 58 that, under the control of the server processor 54, enables communication with the other illustrated devices over the network 22, and may indeed facilitate communication between the server and client devices in accordance with the present principles. It should be noted that the network interface 58 may be, for example, a wired or wireless modem or router, a Wi-Fi transceiver, or other suitable interface, such as a wireless telephone transceiver.

[0065] Thus, in some embodiments, server 52 may be an entire Internet server or server "farm," and may include and perform "cloud" functionality such that, for example, in an exemplary embodiment for a network gaming application, devices of system 10 may access the "cloud" environment via server 52. Alternatively, server 52 may be implemented by one or more game consoles or other computers in the same room or nearby as the other devices shown.

[0066] The components shown in the following figures may include some or all of the components shown in this specification. The user interfaces (UIs) described herein may be integrated and / or extended, and UI elements may be mixed and matched between UIs.

[0067] Although particular embodiments are shown and described in detail herein, it should be understood that the subject matter encompassed by the present invention is limited only by the scope of the claims.

Claims

1. 1. An assembly comprising: A curved waveguide; a first ultraviolet (UV) light reflective coating and / or film disposed on the waveguide; a second UV light reflective coating and / or film disposed on the waveguide; at least one UV emitter configured to emit UV light into the waveguide between the first UV light reflective coating and / or film and the second UV light reflective coating and / or film; at least one conversion element in the waveguide and arranged to receive UV light from the UV emitter, the conversion element configured to convert the UV light into visible light that propagates through one or both UV light reflective coatings and / or films and strikes an eye of a wearer of the waveguide.

2. 2. The assembly of claim 1, wherein the assembly is configured as sunglasses, and the waveguide is coupled to a left temple and a right temple such that the assembly is disposed in front of a wearer's face when worn by the wearer.

3. 10. The assembly of claim 1, comprising at least one lens juxtaposed with the conversion element through which visible light emitted by the conversion element is focused.

4. The assembly of claim 1 , comprising a plurality of conversion elements in the waveguide.

5. The assembly of claim 1 , wherein the UV light reflective coating and / or film passes visible light from outside the assembly.

6. The assembly of claim 1 , wherein the conversion element comprises a phosphor element.

7. The assembly of claim 1 , wherein the conversion element is juxtaposed with an outer surface of the waveguide.

8. The assembly of claim 1 , wherein the conversion element is juxtaposed with an inner surface of the waveguide.

9. 2. The assembly of claim 1, wherein a UV light path is defined between the UV light reflective coatings and / or films, and the assembly comprises at least one UV sensor outside the UV light path for generating at least one signal upon detection of UV light, the signal being operable to cause the UV emitter to stop emitting UV light into the light path.

10. The assembly of claim 1 , wherein the UV emitter comprises at least one UV display.

11. 1. An apparatus comprising: at least one curved waveguide configured to be worn on a person's head, the curved waveguide defining an infrared (IR) light passageway through which IR light is restricted from passing; at least one IR emitter optically coupled to the light path for emitting a requested virtual reality (VR) and / or augmented reality (AR) image into the light path; at least one conversion element in the light pathway for receiving IR light from the IR emitter, the conversion element configured to convert IR light to visible light that propagates out of the light pathway and strikes an eye of the person when the person is wearing the waveguide.

12. The apparatus of claim 11 , wherein the light path is defined between a first IR light reflective coating and / or film and a second IR light reflective coating and / or film disposed on the waveguide.

13. 12. The device of claim 11, wherein the device is configured as sunglasses and the waveguide is coupled to a left temple and a right temple such that the assembly is disposed in front of a wearer's face when worn by the wearer.

14. 12. The apparatus of claim 11, comprising at least one lens juxtaposed with the conversion element through which visible light emitted by the conversion element is focused.

15. The apparatus of claim 11 , comprising a plurality of conversion elements in the waveguide.

16. The apparatus of claim 12 , wherein the IR light reflective coating and / or film allows visible light to pass therethrough.

17. The apparatus of claim 11 , wherein the conversion element comprises a phosphor element.

18. The apparatus of claim 11 , wherein the conversion element is juxtaposed with an outer surface of the waveguide.

19. The apparatus of claim 11 , wherein the conversion element is juxtaposed with an inner surface of the waveguide.

20. 12. The apparatus of claim 11, comprising at least one IR sensor outside the IR light path for generating at least one signal upon detection of IR light, the signal operable to cause the IR emitter to cease emitting IR light into the light path.

21. An apparatus comprising: at least one curved waveguide configured to be worn on a person's head and defining an ultraviolet (UV) or infrared (IR) light passageway through which UV or IR light is restricted from passing; at least one UV or IR emitter optically coupled to the light path for emitting a desired image into the light path; and at least one UV or IR sensor outside the UV or IR light path for generating at least one signal upon detection of UV or IR light, the signal operable to cause the UV or IR emitter to stop emitting UV or IR light into the light path.

Images