Mixed reality optical system using microphosphor and lens element arrays in curved waveguides

Abstract

The sunglasses-style head-mounted display (100) includes a curved waveguide (108) containing a dual reflective coating / film (304 / 308) and an array of light wavelength-converting phosphor pinhole-sized disks (314) covered with pinhole-sized microlenses (316) to present a wide FOV virtual image for AR / VR.

Description

[Technical Field]

[0001] This application generally relates to a wide field of view (FOV) optical system for mixed reality, including augmented reality (AR) and / or virtual reality (VR), that utilizes an array of pinhole-sized microlenses juxtaposed with an optical wavelength-converting phosphor microdisplay within a double-reflecting curved waveguide. [Background technology]

[0002] As recognized herein, there is a need for future wide FOV VR and AR systems that look like sunglasses, are very thin, lightweight, form-fitting, and curved to provide a wide FOV (particularly for VR). Summary of the Invention

[0003] As further recognized herein, current technologies for achieving both AR / VR in very thin and lightweight form factors use flat waveguide technology. This is because waveguides (made of glass or plastic) require the effect of total internal reflection (TIR) ​​to bounce display image light within the waveguide, expanding the image from a narrow viewing area to a wide area directed toward the user's eye through a process called exit pupil expansion. TIR can only function in flat or near-flat waveguides, because in curved waveguides, light escapes the TIR requirement (bounces light incident at or below approximately 42 degrees relative to the plane of the waveguide) and exits the waveguide incorrectly. Therefore, due to optical losses, it is extremely difficult to create curved waveguide-based optical systems for VR / AR that are efficient enough to be effective.

[0004] To meet the above challenges, the system includes a UV display and a curved waveguide containing an array of light wavelength-converting phosphor pinhole-sized disks with double-sided UV reflective coatings / films and covered with pinhole-sized microlenses.

[0005] Thus, in one aspect, an assembly includes a curved waveguide, a first ultraviolet (UV) light-reflecting coating or film disposed on the waveguide, and a second UV light-reflecting coating or film disposed on the waveguide. At least one UV emitter is configured to emit UV light into the waveguide between the first and second UV light-reflecting coatings and / or films. At least one light wavelength-converting element, such as a phosphor disk, is in the waveguide and is configured to receive UV light from the UV emitter that is reflected by the UV light-reflecting coatings and / or films. The conversion element is configured to convert the UV light into visible light that propagates through one or both of the UV light-reflecting coatings and / or films and strikes the eye of a wearer of the waveguide.

[0006] In an embodiment, the assembly is configured as sunglasses, with the waveguides coupled to the left and right temples such that the assembly is disposed in front of the wearer's face when worn by the wearer.

[0007] At least one lens may be juxtaposed with the conversion element through which visible light emitted by the conversion element passes. A plurality of conversion elements may be arranged in the waveguide.

[0008] In an exemplary implementation, the UV light reflective coating and / or film allows visible light to pass through.

[0009] The conversion element can be juxtaposed to the outer surface of the waveguide, disposed in a gap in the UV-reflective coating and / or film. Alternatively, the conversion element can be juxtaposed to the inner surface of the waveguide, with no gap in the UV-reflective coating and / or film. The conversion element can generally be positioned anywhere within the path of the UV light within the waveguide.

[0010] In some embodiments, the UV light path is defined between a UV light reflective coating and / or film, and at least one UV sensor can be provided outside the UV light path for generating at least one signal upon detection of UV light, the signal being operable to cause the UV emitter to cease emitting UV light into the light path.

[0011] The UV emitter may include at least one UV display that emits light in one or more UV wavelength bands.

[0012] In another aspect, a device is configured to be worn on a person's head and includes at least one curved waveguide defining an ultraviolet (UV) light path through which UV light is restricted from passing. At least one UV emitter is optically coupled to the light path for emitting a desired virtual reality (VR) or augmented reality (AR) image into the light path. Also, at least one conversion element is disposed within the light path for receiving the UV light from the UV emitter. The conversion element is configured to convert the UV light, when worn by the person, to visible light that propagates out of the light path and strikes the person's eye.

[0013] In another aspect, a device is configured to be worn on a person's head and includes at least one curved waveguide defining an ultraviolet (UV) light path through which UV light is restricted from passing. At least one UV emitter is optically coupled to the light path for emitting a desired virtual reality (VR) or augmented reality (AR) image into the light path. At least one UV sensor is outside the UV light path for generating at least one signal upon detection of UV light. The signal is operable to cause the UV emitter to stop emitting UV light into the light path.

[0014] In another aspect, a device is configured to be worn on a person's head and includes at least one curved waveguide defining an infrared (IR) light path through which IR light is restricted by an IR-reflective coating and / or film on at least one side of the waveguide. At least one IR emitter is provided, and at least one IR sensor can be provided outside the IR light path for generating at least one signal upon detection of IR light. The signal is operable to cause the IR emitter to stop emitting IR light into the light path. The at least one IR emitter is optically coupled to the light path for emitting a desired virtual reality (VR) or augmented reality (AR) image into the light path. Also, at least one conversion element is disposed within the light path for receiving IR light from the IR emitter. The conversion element is configured to convert the IR light, when the person is wearing the waveguide, into visible light that propagates out of the light path through a micro-focusing lens and strikes the person's eye. The details of this application, both as to its structure and operation, can best be understood with reference to the accompanying drawings, in which like reference numerals refer to like parts: [Brief explanation of the drawings]

[0015] [Figure 1] 1 illustrates a curved sunglasses-style display consistent with the present principles. [Figure 2] FIG. 1 is a block diagram of an exemplary assembly consistent with the present principles. [Figure 3] 1 is a schematic diagram of a first embodiment of an exemplary waveguide configured as curved sunglasses, as viewed from above in a plan view looking down on the waveguide. FIG. [Figure 4] FIG. 1 is a schematic diagram of a second embodiment of an exemplary waveguide configured as curved sunglasses, with the UV reflective coating removed for clarity, as if looking down from above the waveguide in a plan view. [Figure 5]FIG. 10 is a schematic diagram of a third embodiment of an exemplary waveguide, as if looking down in plan view from the top of the waveguide, configured as curved sunglasses, showing alternative locations for UV coatings and / or films, with the phosphor elements removed for clarity. [Figure 5A] FIG. 10 is a schematic diagram of a fourth embodiment of an exemplary waveguide configured as curved sunglasses, as if looking down on a portion of the waveguide from the top of the waveguide in a plan view, showing how the waveguide is constructed from three separate sections, with the UV coating and / or film highlighted as being inside the waveguide after assembly. [Figure 6] FIG. 10 is a schematic diagram of a fifth embodiment of an exemplary waveguide, configured as curved sunglasses, as if looking down from above in a plan view, showing the alternating arrangement of phosphor elements, with UV coatings and / or films removed for clarity. [Figure 7] FIG. 1 is a schematic diagram of an exemplary waveguide, as viewed from above in a plan view, configured as curved sunglasses, illustrating UV or IR and visible light. [Figure 8] 1 is a block diagram of an exemplary system according to the present principles, including a perspective view of an exemplary headset; DETAILED DESCRIPTION OF THE INVENTION

[0016] The present disclosure generally relates to computer ecosystems, including aspects of consumer electronics (CE) device networks, such as, but not limited to, computer gaming networks. Systems herein may include server and client components that may be connected via a network such that data may be exchanged between the client and server components. The client components may include one or more computing devices, including game consoles such as Sony PlayStation® or Microsoft, Nintendo, or other game consoles; virtual reality (VR) headsets; augmented reality (AR) headsets; portable televisions (e.g., smart TVs, Internet-enabled televisions); portable computers such as laptops and tablet computers; and other mobile devices, including smartphones, as well as additional examples described below. These client devices may operate in a variety of operating environments. For example, some client computers may employ, by way of example, the Linux operating system, a Microsoft operating system, or a Unix operating system; an operating system manufactured by Apple or Google; or a Berkeley Software Distribution or Berkeley Standard Distribution (BSD) OS, including derivatives of BSD. These operating environments may be used to run one or more browsing programs, such as browsers made by Microsoft, Google, or Mozilla, or other browser programs that can access websites hosted by the Internet servers described below. Additionally, operating environments according to present principles may be used to run one or more computer game programs.

[0017] Servers and / or gateways may be used, which may include one or more processors that execute instructions that configure the server to receive and transmit data over a network such as the Internet. Alternatively, clients and servers may be connected via a local intranet or virtual private network. The server or controller may be instantiated by a game console such as a Sony PlayStation™, a personal computer, or the like.

[0018] Information may be exchanged between the client and the server over a network. For this purpose and for security, the server and / or client may include firewalls, load balancers, temporary storage, and proxies, as well as other network infrastructure for reliability and security. One or more servers may form an apparatus that implements a method for providing a secure community, such as an online social website or a gamer network, to network members.

[0019] The processor may be a single-chip or multi-chip processor capable of implementing logic through various wiring such as address lines, data lines, and control lines, and registers and shift registers.

[0020] Components included in one embodiment may be used in other embodiments in any suitable combination. For example, any of the various components described herein and / or shown in the drawings may be combined, interchanged, or excluded from other embodiments.

[0021] "A system having at least one of A, B, and C" (and similarly "a system having at least one of A, B, or C" and "a system having at least one of A, B, and C") includes systems having A only, B only, C only, A and B together, A and C together, B and C together, and / or A, B, and C together.

[0022] Referring now to FIG. 1 , a sunglass-style assembly 100 includes a frame 102 configured to be worn on a person's head. The frame includes left and right temples 104, 106, and a nose bridge 106. The frame holds at least one solid or hollow waveguide 108 that, when worn, is curved in at least the horizontal plane and may also be curved in the vertical plane. The waveguide 108 is configured as a single-lens sunglass lens and is translucent or transparent to visible light. The waveguide 108 may be glass or plastic and, in addition to the features described below, may be a prescription eyeglass lens. The waveguide 108 may be tinted in the manner of a sunglass lens, in addition to the features described below. Alternatively, the waveguide may be incorporated into a non-sunglasses-type head-mounted display.

[0023] 2 illustrates that at least one UV light emitter 200, such as a UV display, is in-coupled into the waveguide 108 on one end of the waveguide. The UV display can be in-coupled into the waveguide at a section of the waveguide having a specially angled, planar, curved, or freeform surface, with the UV display attached directly to that section by optical adhesive. Optionally, in-coupling of UV light from the UV display can be performed by additional optical in-coupling methods, such as a coupling prism, a surface relief grating, or any suitable optical in-coupler that passes UV light from the UV display into the waveguide. The light emitted by the UV emitter 200 can be a desired virtual reality or augmented reality image under the control of at least one processor 202 that accesses at least one computer storage device 204 to implement the principles discussed herein. The required images may be provided by a VR (or AR) image source 206, which may be on-board assembly 100 along with processor 202, or may be remote from assembly 100 and in wireless communication with processor 202 via a suitable wireless interface 210. At least one UV sensor 212 may be provided to detect UV light leaking from waveguide 108 and to signal processor 202 to disable UV emitter 200 in response to UV light detected outside waveguide 108.

[0024] Figure 3 illustrates a first embodiment of the waveguide 108 shown in Figures 1 and 2, and labeled 300 in Figure 3, configured as curved sunglasses, as if looking down on the top of the waveguide in a plan view. The exterior surface 302 of the waveguide 300 is coated with an ultraviolet (UV) reflective coating (and / or film) 304, and the interior surface 306 of the waveguide 300 is similarly coated with a UV coating and / or film 308.

[0025] The coatings / films 304, 308 reflect UV light from UV emitter 310 back into the waveguide regardless of the angle of incidence of the light on the surface of the waveguide. Note that multiple UV emitters can be used as indicated by dashed box 312. In effect, a UV light path is defined between the UV reflective coatings and / or films.

[0026] In this case, total internal reflection is not required and the system acts like a double mirror solution (similar to solar light tubes used in homes), but only for UV light. UV light is captured inside the waveguide 300 and can be reflected back into the waveguide at angles outside the TIR requirement (near or below 42 degrees relative to the plane of the waveguide at the point of interaction of the light with the waveguide surface).

[0027] It should also be noted that this UV-trapping waveguide also reflects extraneous UV light from passing through the waveguide, thus providing useful UV protection to the wearer in a manner similar to sunglasses with UV-reflecting lenses.

[0028] Visible light can pass through the UV coating and / or film 304, 308 and waveguide 300 in the same manner that light passes through curved glass or plastic (similar to conventional glass, sunglasses, etc.), providing optical pass-through of real-world light in optical see-through AR (OST-AR) use cases.

[0029] The UV emitter 310 may be a UV light emitting diode (LED) display, a liquid crystal on silicon (LCOS) display with a UV light source, a UV laser light scanning display, or any other display technology capable of emitting UV light that can couple (in-couple) a UV-based image into one region of the curved waveguide.

[0030] Within waveguide 300 is UV-to-visible light conversion element 314 (in some embodiments, a disk-shaped element, preferably less than 2 mm in diameter). The UV-to-visible light conversion element 314 may be disposed in a small recess in the waveguide and glued to the waveguide during fabrication. Alternatively, the UV-to-visible light conversion element may be disposed within a polymer film on the outer surface of the waveguide between UV reflective coatings and / or films 304 and 308. The UV-to-visible light conversion element 314 may generally be fabricated in several ways, including glued to the waveguide, bonded to the waveguide, glued to the waveguide, coupled to the waveguide, disposed within the waveguide, disposed on the waveguide, embedded in the waveguide, or deposited on the waveguide. The UV-to-visible light conversion element 314 may produce monochromatic visible light or may be configured to produce red, green, or blue light, for example, by converting three different UV wavelengths to their respective visible colors.

[0031] In one embodiment, the elements 314 can be visible-emitting, UV-excited phosphors embedded within a polymer. Different layers of polymer with appropriate phosphors can be present to support different UV excitation wavelengths and different visible light emission wavelengths, which together can achieve full-color (red, green, blue) emission from the distinct UV excitation wavelengths. These conversion elements 314 convert UV light to visible light through the excitation process, thus functioning as a self-emissive display. The UV conversion elements 314 can be arranged in an evenly or unevenly spaced array. When using optical see-through AR (OST-AR), sufficient space is used between the conversion elements 314 to maintain a certain level of optical transparency for passing visible light so that the user can see the real world without any significant degradation of vision. Additionally, the spacing of the UV conversion elements can depend on maintaining a wide field of view in at least one axis based on the UV light array bouncing within the UV trapping waveguide. Therefore, the size and placement of the UV conversion elements can be designed so that UV light from the UV display can bounce within the UV-reflecting trapping waveguide and distribute the UV light image from the UV display to all of the UV conversion elements.

[0032] In one embodiment, the phosphor disk is preferably no more than 2 mm in diameter, and it should be noted that because the waveguide is so close to the eye (less than 15 mm), the human visual system cannot see the conversion elements (such as phosphor disks) themselves, because they are smaller than the entrance diameter of the pupil of the human eye and would be blurred to the point of being imperceptible (due to accommodative retinal blur). It should further be noted that the phosphor light wavelength conversion elements can be any shape and size.

[0033] As shown in FIG. 3 , on one side of each element 314 facing the user's eye is a microlens 316 made of glass, plastic, polymer, or other suitable material approximately less than 2 mm in diameter, i.e., the same diameter as the disk 314 or slightly larger. Each microlens 316, which may affect only visible wavelengths and not UV wavelengths, focuses the visible light emitted by its respective conversion element 314 to generate a virtual image when viewed by the human eye at a distance of approximately 10 mm to 15 mm, in one embodiment. The curvature and design of the microlens 316 can be such that it adjusts the virtual image focal length as may be appropriate for AR / VR use. For example, the microlens may generate a virtual image at infinity or greater than 5 meters for some use cases, or greater than 2 meters for other use cases.

[0034] It should be noted that instead of a single microlens, a microlens array (MLA) could be used to cover the diameter of the phosphor display, or other forms of light focusing technology could be used. In another case, a liquid crystal microlens array could be used to provide dynamic focusing of the visible light image emitted from the phosphor disk array. In such a system, the focus / accommodation distance of the AR or VR view could be dynamically adjusted to take into account where the user is looking based on eye tracking, and / or based on the content, and / or based on the user's eyeglass prescription, and combinations thereof.

[0035] When multiple UV emitters 310, 312 are used, they can be placed at the edge of the curved waveguide 300 to increase the FOV in one dimension (horizontal or vertical) or two dimensions (horizontal and vertical) as needed. Such a system can be used to create a form-fitting sunglasses-style AR / VR system that can provide an FOV that matches human vision (roughly 270 degrees horizontally and 170 degrees vertically).

[0036] It should be understood that in Figure 3 and other embodiments, infrared (IR) light can be used instead of UV light. In such embodiments, in Figure 3, the coatings / films 304, 308 are IR reflective and pass visible light, and the emitter 310 is an IR emitter. The light conversion element 314 converts the IR image to a visible light image.

[0037] 4 is a schematic diagram of a second embodiment of an exemplary waveguide 400 configured as curved sunglasses, with UV-reflective coatings and / or films removed for clarity, as viewed from above. Phosphor UV-to-visible conversion elements 402 with respective lenses 404 are used according to the principles described above, except that fewer and larger elements 402 are used in FIG. 4 compared to the size and number of conversion elements 314 shown in FIG. 3. The size and number of conversion elements used may depend on (among other factors) the in-coupling angle of the UV image from the UV display, the desired FOV for the user's field of view, and / or whether the system is for optical see-through augmented reality (OST-AR) or virtual reality (VR).

[0038] FIG. 5 is a schematic diagram of a third embodiment of an exemplary waveguide 500 configured as curved sunglasses, with the phosphor elements removed for clarity, looking down from above the waveguide in a plan view, showing alternative locations for the UV coatings and / or films. In FIG. 5, two UV films and / or coatings 502, 504 are applied within the interior of the waveguide 500. This can be achieved by creating a waveguide from two sections, with the UV film and / or coating 502 applied to the farther (from the user's eye) and targeted inner surface of the first waveguide section, and the UV film and / or coating 504 applied to the closer (from the user's eye) and targeted inner surface of the second waveguide section. The two waveguide sections can be bonded together using any optical bonding technique that places the UV films and / or coatings on the targeted surfaces within the interior of the waveguide. It should be noted that such embodiments can provide a final waveguide that is difficult to scratch off because the UV reflective film and / or coating is inside and protected by the plastic or glass waveguide.

[0039] FIG. 5A is a schematic diagram of a fourth exemplary waveguide embodiment configured as curved sunglasses, as viewed from above in a plan view, showing that the waveguide is composed of separate sections 510, 520, and 530. In FIG. 5A, at least one UV film and / or coating 502 is applied to the interior surface of waveguide section 510, and at least one UV film and / or coating 504 is applied to section 530, such that these coatings / films are internal to the waveguide when sections 510, 520, and 530 are joined together during assembly. Note that such an embodiment can provide a final waveguide that is difficult to scratch off, since the UV-reflective film and / or coating is internal to and protected by the plastic or glass waveguide. Sections 510, 520, and 530 can be manufactured using injection molding, 3D printing, and other manufacturing techniques for making plastic or glass optical components. It should also be noted that a variety of manufacturing techniques can be used to apply the UV coatings and / or films 502 and 504 to the respective pieces 510 and 530, including, but not limited to, vacuum bonding with an optical adhesive of matching reflectivity (to the waveguide material), sputtering deposition, pulsed laser deposition, evaporative deposition, chemical vapor deposition, etc. It should further be appreciated that the light wavelength-converting phosphor element 512 shown in Figure 5A can be applied to the recesses in the waveguide piece 510 using a variety of manufacturing techniques, including, but not limited to, vapor deposition, liquid coating and curing, additive 3D printing, adhesive bonding, etc.

[0040] 5A, microlens elements 514 are juxtaposed with the phosphor elements 512. It should be noted that these microlens elements 512 can be bonded to the phosphor elements 512 using a variety of manufacturing techniques, including, but not limited to, additive 3D printing, and placement and fastening using optical bonding techniques.

[0041] 6 is a schematic diagram of a fifth embodiment of an exemplary waveguide 600 configured as curved sunglasses, with UV films and / or coatings removed for clarity, as viewed from above the waveguide, showing the staggered arrangement of conversion elements 602 on the inner surface 604 of the waveguide 600. The UV-to-visible light conversion elements herein may generally be disposed at any suitable location within the UV light path.

[0042] 7 is a schematic diagram, as viewed from above, of an exemplary waveguide 700 configured as curved sunglasses like any of the waveguides discussed herein, illustrating UV light 702 emitted from at least one UV emitter 704, being internally reflected within the waveguide, and some of the UV light impinging on a conversion element 706 (UV-reflective films and / or coatings and lenses not shown). The conversion element 706 converts the UV light into beams of visible light 708, which pass through UV films and / or coatings and impinge on the wearer's eye 710. As shown, the beams of visible light 708 can overlap with each other so that the wearer does not perceive discontinuities in the visible image as the eye 710 rotates to view the entire field of view within the fovea.

[0043] The waveguides discussed herein may be made of solid plastic or glass, or they may be hollow, ie, with an air chamber between the inner and outer surfaces of the waveguide.

[0044] The above solution provides an architecture that allows optical and mechanical designers and engineers the flexibility to create curved form factors without designing around the efficiency limitations of total internal reflection in waveguides.

[0045] It should be appreciated that image light bouncing within a curved UV trapping waveguide can cause significant distortion in the UV image (a composition of many pixel UV light rays) that falls on a particular phosphor disk. This results in a highly distorted and incomprehensible visible image being displayed to the user. The amount of distortion depends on the curvature and thickness of the waveguide, as well as the placement and angle of the phosphor disk and UV display (among other factors).

[0046] The present principles therefore provide at least four techniques that can be used individually or collectively to address the above problems.

[0047] First, the UV image light emitted from the UV display can be pre-distorted before or during the process of incoupling into the waveguide. This can be achieved using specifically designed passive optical elements such as freeform optical lenses, surface-relief gratings, and diffractive volume holograms, or through dynamic optical solutions such as phase liquid crystal-on-silicon (LCOS) spatial light modulators containing phase holographic freeform lens images. Regardless of the optical technique, the UV light image can be pre-distorted to account for the distortion induced in the UV image light falling on each phosphor display.

[0048] Second, the phosphor display disk itself can be oriented (angled relative to the user-facing waveguide surface), contain some curvature (in one or both surface axes), or be a freeform surface to account for UV image distortion, so that visible light (after passing through the microlenses covering the phosphor display) is correct for the user's pupil viewing the provided field of view.

[0049] Third, the microlenses covering the phosphor displays can have an asymmetric design or be completely freeform to account for distortions to the visible image displayed by each phosphor display. Note that the microlenses can also be diffraction-based lenses (surface relief gratings, volume holographic) and designed to correct for distortions from the phosphor displays.

[0050] Fourth, the curvature of the outer surface of the waveguide can be different from the curvature of the inner surface of the waveguide, which can be used to reduce distortion of the image before it is transduced by the phosphor element.

[0051] It should be understood that additional optical elements can be added (internally or externally) to the curved waveguide to provide magnification of the UV or IR in-coupled image before it is converted by the phosphor element. This image magnification, commonly referred to as exit pupil expansion, can be performed in one or two axes to increase the size of the image bouncing inside the double-reflection waveguide. Optical elements that facilitate exit pupil expansion can be positioned after the in-coupling from the UV or IR emitter and before the UV or IR image hits the light conversion element. In one embodiment, the surfaces of the curved waveguide can include structures (such as surface relief gratings) used to perform exit pupil expansion in one or two axes and can be covered with reflective coatings or films to implement the double-reflection curved waveguide solutions described herein. As described in the description of FIG. 5A, these surfaces can be constructed to be internal to the waveguide when the waveguide is made from separate adjacent sections.

[0052] Further again, the exit pupil expansion function, double reflection, and image distortion correction may all be performed by the same structure on the surface (internal or external) of the waveguide in the light path from the light emitter to the light conversion element. It should be appreciated that such a system may therefore utilize smaller light emitters with smaller in-coupling areas compared to the out-coupling areas including the light conversion elements with their associated microlenses, which would facilitate a form-fitting sunglasses-style assembly as described in the description of FIG.

[0053] The waveguides described above can be perceptually fully transparent or semi-transparent, may not be electrically powered, and due to the use of two UV or IR reflective coatings and / or films, total internal reflection does not need to be considered.

[0054] Referring to FIG. 8 , an exemplary system 10 is shown, which may include one or more of the exemplary devices described above and further below in accordance with the present principles. The first exemplary device included in system 10 is a consumer electronics (CE) device, such as, but not limited to, an audio-video device (AVD) 12, e.g., an Internet-enabled TV with a TV tuner (equivalently, a set-top box that controls the TV). AVD 12 may alternatively be a computerized Internet-enabled (“smart”) phone, a tablet computer, a notebook computer, a head-mounted device (HMD) and / or headset, such as smart glasses or a VR headset, another wearable computerized device, a computerized Internet-enabled music player, computerized Internet-enabled headphones, a computerized Internet-enabled implantable device, such as an implantable skin device, etc. It should be understood that AVD 12, regardless of its nature, is configured to implement the present principles (e.g., communicate with other CE devices to implement the present principles, execute the logic described herein, and perform any other functions and / or operations described herein).

[0055] Accordingly, to realize these principles, AVD 12 can be established by some or all of the components shown. For example, AVD 12 can include one or more touch-enabled displays 14, which can be implemented by high-definition or ultra-high-definition "4K" or higher flat screens. Touch-enabled display 14 can include, for example, a capacitive or resistive touch-sensing layer having a grid of electrodes for touch sensing consistent with the present principles.

[0056] The AVD 12 may also include one or more speakers 16 for outputting audio in accordance with the present principles and at least one additional input device 18, such as an audio receiver / microphone, for inputting audible commands to the AVD 12 to control it. The example AVD 12 may also include one or more network interfaces 20 for communicating over at least one network 22, such as the Internet, a WAN, or a LAN, under the control of one or more processors 24. Thus, the interface 20 may be a Wi-Fi transceiver, which is an example of a wireless computer network interface, such as, but not limited to, a mesh network transceiver. It should be understood that the processor 24 controls the AVD 12 to implement the present principles, including other elements of the AVD 12 described herein, such as controlling the display 14 to present images thereon and receiving input therefrom. It should further be noted that the network interface 20 may be a wired or wireless modem or router, or a wireless telephone transceiver, or other suitable interface, such as the Wi-Fi transceiver discussed above.

[0057] In addition to the above, AVD 12 may include one or more input and / or output ports 26, such as a High-Definition Multimedia Interface (HDMI®) port or a Universal Serial Bus (USB) port for physically connecting to another CE device, and / or a headphone port for connecting headphones to AVD 12 to present audio from AVD 12 to a user through the headphones. For example, input port 26 may be connected, via wire or wireless, to a cable or satellite source 26a of audio-video content. Thus, source 26a may be a separate or integrated set-top box or satellite receiver. Alternatively, source 26a may be a game console or disc player containing content. When implemented as a game console, source 26a may include some or all of the components described below in connection with CE device 48.

[0058] AVD 12 may further include one or more computer memory / computer-readable storage media 28, such as non-transitory disk-based or solid-state storage, possibly embodied within the AVD chassis as a standalone device, or as a personal video recording device (PVR) or video disc player either internal or external to the AVD chassis for playing AV programs, or as removable memory media or a server as described below. In some embodiments, AVD 12 may also include a position or location receiver, such as, but not limited to, a cellular receiver, a GPS receiver, and / or an altimeter 30, configured to receive geographic location information from a satellite or cellular tower and provide that information to processor 24 and / or to determine the altitude at which AVD 12 is disposed in conjunction with processor 24. Component 30 may also be implemented by an inertial measurement unit (IMU), typically including a combination of accelerometers, gyroscopes, and magnetometers, or by event-based sensors to determine the location and orientation of AVD 12 in three dimensions.

[0059] Continuing with the description of AVD 12, in some embodiments, AVD 12 may include one or more cameras 32, which may be thermal imaging cameras, digital cameras such as webcams, event-based sensors, and / or cameras integrated into AVD 12 and controllable by processor 24 to collect photos / images and / or video in accordance with present principles. AVD 12 may also include a Bluetooth® transceiver 34 and other near field communication (NFC) elements 36 for communicating with other devices using Bluetooth® and / or NFC technology, respectively. An exemplary NFC element can be a radio frequency identification (RFID) element.

[0060] Continuing further, AVD 12 may include one or more auxiliary sensors 38 (e.g., motion sensors such as pressure-sensitive sensors, accelerometers, gyroscopes, cyclometers, or magnetic sensors, infrared (IR) sensors, optical sensors, speed and / or cadence sensors, event-based sensors, gesture sensors (e.g., for sensing gesture commands)) that provide input to processor 24. For example, one or more of auxiliary sensors 38 may include one or more pressure sensors forming a layer of touch-enabled display 14 itself, and may be, without limitation, piezoelectric pressure sensors, capacitive pressure sensors, piezoresistive strain gauges, optical pressure sensors, electromagnetic pressure sensors, etc.

[0061] The AVD 12 may also include an over-the-air television broadcast port 40 for receiving OTA television broadcasts, which provides input to the processor 24. In addition to the above, it should be noted that the AVD 12 may also include an infrared (IR) transmitter and / or an IR receiver and / or an IR transceiver 42, such as an IR Data Association (IRDA) device. A battery (not shown) may be provided to power the AVD 12, and may also be a kinetic energy harvester that can convert kinetic energy into power to charge the battery and / or power the AVD 12. A graphics processing unit (GPU) 44 and a field programmable gate array 46 may be included. One or more haptic / vibration generators 47 may be provided to generate haptic signals that can be sensed by a person holding or interacting with the device. The haptic generator 47 may vibrate all or a portion of the AVD 12 using an electric motor connected to an off-center and / or off-balance weight via a rotatable shaft of the motor, such that the shaft can rotate under the control of the motor (which in turn may be controlled by a processor such as processor 24) to create simulations of vibrations of various frequencies and / or amplitudes, and forces in various directions.

[0062] In addition to AVD 12, system 10 may include one or more other CE device types. In one embodiment, first CE device 48 may be a computer game console that can be used to transmit computer game audio and video to AVD 12 via commands sent directly to AVD 12 and / or through a server, as described below, while second CE device 50 may include similar components as first CE device 48. In the illustrated embodiment, second CE device 50 may be configured as a computer game controller operated by a player or a head-mounted display (HMD) worn by a player. The HMD may include a head-up transparent or non-transparent display for presenting AR / MR content or VR content, respectively. The HMD may implement a sunglasses-style configuration as described herein.

[0063] In the illustrated example, only two CE devices are shown, but it should be understood that a fewer or greater number of devices may be used. The devices herein may implement some or all of the components shown for AVD 12. Any of the components shown in the following figures may incorporate some or all of the components shown for AVD 12.

[0064] Referring now to the aforementioned at least one server 52, it includes at least one server processor 54, at least one tangible computer-readable storage medium 56, such as disk-based or solid-state storage, and at least one network interface 58 that, under the control of the server processor 54, enables communication with other illustrated devices via the network 22, and may indeed facilitate communication between the server and client devices in accordance with the present principles. It should be noted that the network interface 58 may be, for example, a wired or wireless modem or router, a Wi-Fi transceiver, or other suitable interface, such as a wireless telephone transceiver.

[0065] Thus, in some embodiments, server 52 may be an entire internet server or server "farm," and may include and perform "cloud" functionality such that, in an exemplary embodiment for a network gaming application, devices of system 10 may access the "cloud" environment via server 52. Alternatively, server 52 may be implemented by one or more game consoles or other computers located in or near the same room as the other devices shown.

[0066] The components shown in the following figures may include some or all of the components shown herein. The user interfaces (UIs) described herein may be integrated and / or extended, and UI elements may be mixed and matched between UIs.

[0067] Although particular embodiments are shown and described in detail herein, it should be understood that the subject matter encompassed by the present invention is limited only by the claims.

Claims

1. 1. An assembly comprising: a curved waveguide; a first ultraviolet (UV) light reflective coating and / or film disposed on the curved waveguide; a second UV light reflective coating and / or film disposed on the curved waveguide; at least one UV emitter configured to emit UV light into the curved waveguide between the first UV light reflective coating and / or film and the second UV light reflective coating and / or film; and at least one conversion element in the curved waveguide arranged to receive UV light from the UV emitter, the conversion element configured to convert the UV light into visible light that propagates through one or both UV light reflective coatings and / or films and strikes an eye of a wearer of the curved waveguide.

2. 2. The assembly of claim 1, wherein the assembly is configured as sunglasses, and the curved waveguide is coupled to left and right temples such that the assembly is disposed in front of a wearer's face when worn by the wearer.

3. 10. The assembly of claim 1, comprising at least one lens juxtaposed with the conversion element through which visible light emitted by the conversion element is focused.

4. The assembly of claim 1 , comprising a plurality of transformation elements in the curved waveguide.

5. The assembly of claim 1 , wherein the UV light reflective coating and / or film allows visible light from outside the assembly to pass through.

6. The assembly of claim 1 , wherein the conversion element comprises a phosphor element.

7. the outer surface of the curved waveguide is coated with a UV reflective coating and / or film; the inner surface of the curved waveguide is also coated with a UV reflective coating and / or film; The assembly of claim 1 , wherein the conversion element is disposed between the UV-reflective coating and / or film covering the outer surface and the UV-reflective coating and / or film covering the inner surface.

8. The assembly of claim 1 , wherein the transduction element is disposed within the curved waveguide.

9. 2. The assembly of claim 1, wherein a UV light path is defined between the UV light reflective coatings and / or films, and the assembly comprises at least one UV sensor outside the UV light path for generating at least one signal upon detection of UV light, the signal operable to cause the UV emitter to stop emitting UV light into the UV light path.

10. The assembly of claim 1 , wherein the UV emitter comprises at least one UV display.

11. 1. An apparatus comprising: at least one curved waveguide configured to be worn on a person's head, the curved waveguide defining an infrared (IR) light path through which IR light is restricted to pass; at least one IR emitter optically coupled to the IR light path for emitting a requested virtual reality (VR) and / or augmented reality (AR) image into the IR light path; at least one conversion element in the IR light path for receiving IR light from the IR emitter, the conversion element configured to convert IR light to visible light that propagates out of the IR light path and strikes the person's eye when the person is wearing the curved waveguide.

12. 12. The device of claim 11, wherein the IR light path is defined between a first IR light reflective coating and / or film and a second IR light reflective coating and / or film disposed on the curved waveguide.

13. 12. The device of claim 11, wherein the device is configured as sunglasses and the curved waveguide is coupled to left and right temples such that the assembly is disposed in front of a wearer's face when worn by the wearer.

14. 12. The device of claim 11, comprising at least one lens juxtaposed with the conversion element through which visible light emitted by the conversion element is focused.

15. The device of claim 11 , comprising a plurality of transduction elements in the curved waveguide.

16. 13. The device of claim 12, wherein the IR light reflective coating and / or film allows visible light to pass through.

17. The device of claim 11 , wherein the conversion element comprises a phosphor element.

18. The device of claim 11 , wherein the transduction element is juxtaposed with an outer surface of the curved waveguide.

19. The device of claim 11 , wherein the transduction element is juxtaposed with an inner surface of the curved waveguide.

20. 12. The apparatus of claim 11, comprising at least one IR sensor outside the IR light path for generating at least one signal upon detection of IR light, the signal operable to cause the IR emitter to cease emitting IR light into the IR light path.

21. 1. An apparatus comprising: at least one curved waveguide configured to be worn on a person's head, the curved waveguide defining an optical path through which ultraviolet (UV) or infrared (IR) light is restricted from passing; at least one UV or IR emitter optically coupled to the light path for emitting a desired image into the light path; at least one UV or IR sensor disposed outside the light path for generating at least one signal upon detection of UV or IR light; at least one conversion element in the light path for receiving UV or IR light from the UV or IR emitter; Equipped with the signal is operable to cause the UV or IR emitter to cease emitting UV or IR light into the light path; The device, wherein the conversion element is configured to convert UV or IR light into visible light that strikes the person's eye.

Images