Organic solid crystal optical element

Abstract

An optical component includes a substrate and an optically anisotropic organic solid crystal material, the substrate having a pattern of recessed features formed therein, the optically anisotropic organic solid crystal material filling the recessed features and forming a plurality of embedded grating elements.

Description

Cross-reference to related applications

[0001] This application claims the benefit and priority of U.S. Provisional Patent Application Serial No. 63 / 601,361, filed on November 21, 2023. Technical Field

[0002] This disclosure relates to optical components, and more particularly to optical components for wearable devices, including virtual reality / augmented reality devices. Background Technology

[0003] Polymers and other organic materials can be incorporated into a wide variety of optical and electro-optical device architectures, including passive and active optics as well as electro-active devices. Lightweight and compliant polymer / organic solid layers can be incorporated into wearable devices such as smart glasses and are attractive candidates for emerging technologies, including virtual reality / augmented reality devices that require comfortable, adjustable shape factors.

[0004] For example, virtual reality (VR) and augmented reality (AR) glasses or headsets allow users to experience events, such as interacting with people in a computer-generated 3D world simulation, or viewing data overlaid on a real-world view. This overlaying of information onto a view can be achieved, for example, through an optical head-mounted display (OHMD) or by using embedded wireless glasses with a transparent heads-up display (HUD) or (AR) overlay. VR / AR glasses and headsets can be used for a variety of purposes. For example, governments can use such devices for military training, medical professionals can use them to simulate surgery, and engineers can use them as design visualization aids.

[0005] Organic solid crystal (OSC) materials with high refractive index and birefringence can be used in a variety of optical components, including surface relief gratings, metasurfaces, waveguides, beam splitters, photonic elements (such as photonic integrated circuits), and polarization selection elements. Summary of the Invention

[0006] According to a first aspect, an optical component is provided, comprising: a substrate having a pattern of recessed features formed therein; and an optically anisotropic organic solid crystal material filling the recessed features and forming a plurality of embedded grating elements.

[0007] In some embodiments, the organic solid crystal material filling each of the recessed features is configured as a single crystal.

[0008] In one embodiment, the organic solid crystal material has the following principal refractive indices: n1>1.8, n2>1.8, and n3>1.8.

[0009] In some embodiments, each of the plurality of embedded grating elements includes a substantially vertical sidewall.

[0010] In some embodiments, each of the plurality of embedded grating elements includes a sloping sidewall.

[0011] In some implementations, the plurality of embedded grating elements are configured as a one-dimensional array.

[0012] In some implementations, the plurality of embedded grating elements are configured as a two-dimensional array.

[0013] In some implementations, the plurality of embedded grating elements are configured to non-uniformly couple optical power into the associated diffraction orders.

[0014] In some embodiments, the optical component further includes a protective layer disposed above the top surface of the embedded grating element.

[0015] According to a second aspect, an optical component is provided, comprising: a substrate; and a plurality of raised grating elements disposed above a surface of the substrate, wherein the grating elements comprise an optically anisotropic organic solid crystal material.

[0016] In some implementations, the organic solid crystal material forming each of the grating elements is configured as a single crystal.

[0017] In some embodiments, the organic solid crystal material has the following principal refractive indices: n1>1.8, n2>1.8, and n3>1.8.

[0018] In some embodiments, each of the plurality of raised grating elements includes a substantially vertical sidewall.

[0019] In some embodiments, each of the plurality of raised grating elements includes an inclined sidewall.

[0020] In some implementations, the plurality of raised grating elements are configured as a one-dimensional array.

[0021] In some implementations, the plurality of raised grating elements are configured as a two-dimensional array.

[0022] In some implementations, the plurality of raised grating elements are configured to non-uniformly couple optical power into the associated diffraction orders.

[0023] In some implementations, a protective layer is provided above the top surface of the raised grating element.

[0024] According to a third aspect, a surface relief grating is provided, comprising: an array of grating elements, each of the grating elements comprising an optically anisotropic organic solid crystal material.

[0025] In some embodiments, the organic solid crystal material has the following principal refractive indices: n1>1.8, n2>1.8, and n3>1.8. Attached Figure Description

[0026] The accompanying drawings illustrate several exemplary embodiments and are part of the specification. Together with the following description, these drawings illustrate and explain various principles of this disclosure.

[0027] Figure 1 This is a schematic diagram of a tilted binary grating architecture shown according to some implementation schemes.

[0028] Figure 2 A stereoscopic view of a 1D periodic grating according to some implementation schemes.

[0029] Figure 3 A stereoscopic view of a 2D periodic grating according to some implementation schemes.

[0030] Figure 4 A method for forming a single-crystal organic grating according to some embodiments is shown.

[0031] Figure 5 This illustrates the formation of protective layers above the opposing main surfaces of organic solid crystal layers according to various implementation schemes.

[0032] Figure 6 Illustrations of example artificial reality systems according to some embodiments of this disclosure.

[0033] Figure 7 This is an illustration of an example artificial reality system with a handheld device according to some embodiments of the present disclosure.

[0034] Figure 8A This is a diagram illustrating example user interactions within an artificial reality system according to some embodiments of this disclosure.

[0035] Figure 8B This is a diagram illustrating example user interactions within an artificial reality system according to some embodiments of this disclosure.

[0036] Figure 9A This is a diagram illustrating example user interactions within an artificial reality system according to some embodiments of this disclosure.

[0037] Figure 9BThis is a diagram illustrating example user interactions within an artificial reality system according to some embodiments of this disclosure.

[0038] Figure 10 The illustration shows an example wrist-worn wearable device of an artificial reality system according to some embodiments of the present disclosure.

[0039] Figure 11 Illustrations of example wearable artificial reality systems according to some embodiments of this disclosure.

[0040] Figure 12 Illustrations of example artificial reality systems according to some embodiments of this disclosure.

[0041] Figure 13A Illustrations of example virtual reality systems according to some embodiments of this disclosure.

[0042] Figure 13B for Figure 13A The illustration shows another perspective view of the virtual reality system.

[0043] Figure 14 A block diagram illustrating the system components of an example artificial reality system and a virtual reality system is provided.

[0044] Throughout the accompanying drawings, the same reference numerals and descriptions indicate similar but not necessarily identical elements. While the exemplary embodiments described herein are readily adaptable to various modifications and alternatives, specific embodiments have been illustrated by way of example in the drawings and will be described in detail herein. However, the exemplary embodiments described herein are not intended to be limited to the specific forms disclosed. Rather, this disclosure covers all modifications, equivalents, and substitutions falling within the scope of the appended claims. Detailed Implementation

[0045] Polymers and other organic materials can be incorporated into a wide variety of optical and electro-optical device architectures, including passive and active optics as well as electro-active devices. Lightweight and compliant polymer / organic solid layers can be incorporated into wearable devices such as smart glasses and are attractive candidates for emerging technologies, including virtual reality / augmented reality devices that require comfortable, adjustable shape factors.

[0046] For example, virtual reality (VR) and augmented reality (AR) glasses or headsets allow users to experience events, such as interacting with people in a computer-generated 3D world simulation, or viewing data overlaid on a real-world view. Information can be overlaid onto the field of view, for example, through optical head-mounted displays (OHMDs) or by using embedded wireless glasses with a transparent head-up display (HUD) or augmented reality (AR) overlay. VR / AR glasses and headsets can be used for a variety of purposes. For example, governments can use such devices for military training, medical professionals can use them to simulate surgery, and engineers can use them as design visualization aids.

[0047] Organic solid crystal (OSC) materials with high refractive index and birefringence can be used in a variety of optical components, including surface relief gratings, metasurfaces, waveguides, beam splitters, photonic elements (such as photonic integrated circuits), and polarization selection elements.

[0048] Organic solid crystals with high refractive indices and birefringence have unique value in applications of diffractive optical elements, such as surface relief gratings. For example, surface relief gratings formed from highly anisotropic materials can provide high polarization selectivity. By utilizing the orientation of different refractive indices, gratings made from such materials can break diffraction order symmetry, which can be achieved in contrast structures using tilted gratings, but the fabrication of tilted gratings can be more challenging. Therefore, currently disclosed surface relief gratings can include binary (non-tilted) architectures, where the crystal orientation of the OSC layer is conducive to diffraction order selectivity.

[0049] This invention discloses a method for controlling the crystal orientation of organic solid crystal materials and related structures, thereby controlling their optical orientation. The method disclosed herein can be used to produce OSC elements with high fidelity and controllable orientation. Furthermore, due to van der Waals interactions, such materials may be prone to mechanical and thermal degradation, which could lead to unacceptable changes or failures in their optical response. Therefore, according to some embodiments, a protective layer can be formed above one or both main surfaces of the OSC layer. This protective layer can be configured to suppress structural changes and / or performance degradation.

[0050] One or more source materials can be used to form organic solid crystalline thin films, including multilayer films. Exemplary organic materials include various types of crystallizable organic semiconductors. Organic semiconductors can include small molecules, macromolecules, liquid crystals, organometallic compounds, oligomers, and polymers. Organic semiconductors can include p-type, n-type, or bipolar polycyclic aromatic hydrocarbons, such as anthracene, phenanthrene, polyenes, triazoles, toluene, thiophene, pyrene, pinene, fluorene, biphenyl, tert-phenyl, etc. Further exemplary small molecules include fullerenes, such as C60.

[0051] Exemplary compounds may include cyclic, linear, and / or branched structures, which may be saturated or unsaturated, and may additionally include heteroatoms and / or saturated or unsaturated heterocycles, such as furan, pyrrole, thiophene, pyridine, pyrimidine, piperidine, etc. Heteroatoms (e.g., dopants) may include fluorine, chlorine, nitrogen, oxygen, sulfur, phosphorus, and various metals. Suitable raw materials for depositing solid organic semiconductor materials may include pure organic compositions, melts, solutions, or suspensions containing one or more organic materials of this disclosure.

[0052] This material can provide functions including phase modulation, beam control, wavefront shaping and correction, optical communication, optical computing, holography, and more. Due to their optical and mechanical properties, organic solid-state crystals can realize high-performance devices and can be incorporated into passive or active optical devices (including AR / VR headsets) and can replace comparative material systems (such as polymers, inorganic materials, and liquid crystals). In some respects, organic solid-state crystals can possess optical properties comparable to inorganic crystals, exhibiting the processability and electrical response of liquid crystals.

[0053] Structurally, the disclosed organic materials can be glassy, ​​polycrystalline, or single-crystal. For example, organic solid crystals can include closely packed structures (e.g., organic molecules) that exhibit desired optical properties, such as high and tunable refractive indices and high birefringence. Anisotropic organic solid materials can include preferred molecular packing, i.e., preferred molecular orientations or arrangements. Exemplary devices can include one or more thin films of organic solid crystals with high refractive indices, which may further be characterized by a smooth outer surface.

[0054] High-refractive-index and high-birefractive-index organic semiconductor materials can be fabricated as freestanding articles or as thin films deposited and overlaid on a substrate. For example, epitaxial or non-epitaxy growth processes can be used to form organic solid-state crystal (OSC) layers on a suitable substrate or within a mold. Seed layers used to promote crystal nucleation and anti-nucleation layers configured to locally suppress nucleation can work together to promote the formation of a limited number of nuclei within a specified location, which in turn can promote the formation of larger organic solid-state crystals.

[0055] As used herein, the terms “epitaxy,” “epitaxical,” and / or “epitaxical growth and / or deposition” refer to the nucleation and growth of organic solid crystals on a deposition surface, where it is assumed that the growing organic solid crystal layer exhibits the same crystallization habit as the material of the deposition surface. For example, in epitaxial deposition, chemical reactants can be controlled, and system parameters can be set such that deposited atoms or molecules fall onto the deposition surface and maintain sufficient mobility via surface diffusion to orient themselves according to the crystallization orientation of the atoms or molecules on the deposition surface. Epitaxial processes can be homogeneous or heterogeneous.

[0056] The organic crystalline phase may have principal refractive indices (n1, n2, n3), wherein n1, n2, and n3 may vary independently from about 1.0 to about 4.0. According to a further embodiment, the organic solid crystal may be characterized by having a refractive index of at least about 1.8 (e.g., 1.8, 1.9, 2.0, 2.1, 2.2, 2.3, 2.4, 2.5, 2.6, or 2.7, including the range between any of the above values) along at least one direction (i.e., along one direction, along a pair of orthogonal directions, or along three mutually orthogonal directions).

[0057] In some embodiments, the organic crystalline phase may be isotropic (n1 = n2 = n3) or birefringent (where n1 ≠ n2 ≠ n3, or n1 ≠ n2 = n3, n1 = n2 ≠ n3, or n1 = n3 ≠ n2), and is characterized by a birefringence of at least about 0.05, for example at least about 0.1, at least about 0.2, at least about 0.3, at least about 0.4, or at least about 0.5, encompassing any of the foregoing values. (n). In some embodiments, the birefringent organic crystalline phase may be characterized by a birefringence of less than about 0.05, for example less than about 0.05, less than about 0.02, less than about 0.01, less than about 0.005, less than about 0.002, or less than about 0.001, including any of the foregoing values.

[0058] Organic solid-state crystalline thin films, including multilayer organic solid-state crystalline films, can be optically transparent and exhibit low volume haze. As used herein, for a given thickness, a "transparent" or "optically transparent" material or element can have a transmittance of at least about 80% in the visible spectrum, such as about 80, 90, 95, 97, 98, 99, or 99.5%, including the range between any of the foregoing values, and a volume haze of less than about 5%, such as about 0.1, 0.2, 0.4, 1, 2, or 4%, including the range between any of the foregoing values. Transparent materials typically exhibit very low optical absorption and minimal optical scattering.

[0059] As used herein, the terms “haze” and “sharpness” can refer to optical phenomena related to light propagation through a material and can be attributed to, for example, the refraction of light within the material, such as due to secondary phases or porosity, and / or the reflection of light from one or more surfaces of the material. It is understood that haze may be related to the amount of light subjected to wide-angle scattering (i.e., an angle greater than 2.5° with respect to the normal) and the corresponding loss of transmission contrast, while sharpness may be related to the amount of light subjected to narrow-angle scattering (i.e., an angle less than 2.5° with respect to the normal) and the resulting loss of optical sharpness or “perspective quality.”

[0060] As used herein, a grating is an optical element with a periodic structure configured to scatter or diffract light into multiple beams. The direction or diffraction angle of the diffracted light can depend on the wavelength of the light incident on the grating, the orientation of the incident light relative to the grating surface, the spacing between adjacent diffractive elements, and the optical properties of the grating material itself. For example, the grating element may include a metasurface. In some embodiments, the grating architecture may be tuned along one, two, or three dimensions. The optical element may include a single-layer or multi-layer OSC architecture.

[0061] Optical elements may include multiple raised optical anisotropic organic solid crystal (OSC) structures disposed above a substrate. For example, the raised structures may form a surface relief grating, and may be configured with a polar angle (θ) and an azimuth angle (φ), where 0 ≤ θ ≤ π and φ (0 ≤ φ ≤ π). The OSC material may be single-crystal or polycrystalline and may contain an amorphous organic phase. In some embodiments, the raised structures may contain a single-phase OSC material. In some embodiments, the raised structures may include a single-layer organic solid crystal or a multilayer OSC structure. Each OSC layer may be characterized by three principal refractive indices: n1, n2, and n3.

[0062] The substrate may comprise any suitable solid material, including glass (e.g., high-refractive-index glass), ceramics (e.g., LiNbO3, SiC, ZnS, etc.), polymers (e.g., high-refractive-index plastics), organic materials (e.g., organic solid crystals), and organometallic materials (e.g., MOFs). The substrate may be planar or non-planar.

[0063] Optical elements can be formed by depositing an entire layer of organic solid crystals over a substrate, followed by photolithography and etching to define a raised structure. In other embodiments, individual raised structures can be formed separately and then laminated or otherwise bonded to the substrate.

[0064] In some implementations, an undercoating layer can be provided between the OSC structure and the substrate. The undercoating layer can facilitate adhesion between the raised structure and the substrate, and may include, for example, polymers (e.g., photoresists), small molecules (e.g., silane-functionalized molecules), or inorganic materials (e.g., SiO₂). x TiO x HfO x AlO x SiN x (etc.), and combinations thereof. The thickness of the base coating can be in the range of about 1 nm to about 100 nm, for example 1 nm, 2 nm, 5 nm, 10 nm, 20 nm, 50 nm, or 100 nm, including any of the above values.

[0065] According to a further embodiment, the optical element may include an organic solid crystal layer and a protective layer disposed above at least one surface of the OSC layer. A protective layer may be deposited or laminated over the organic solid crystal layer. The protective layer may be configured to suppress mechanical or optical degradation of the OSC layer.

[0066] Consider using a variety of protective layer materials. For example, the protective layer can include organic materials such as small molecules, oligomers, polymers, and carbon-organic frameworks; and inorganic materials such as glass, silicone, siloxanes, ceramics, and metal oxides (e.g., TiO₂). x HfO x AlO x ); and organic-inorganic hybrid materials, including, for example, metal-organic frameworks, silicones and siloxanes.

[0067] The thickness of the protective layer can range from about 1 nm to about 1000 micrometers, such as 1 nm, 2 nm, 5 nm, 10 nm, 20 nm, 50 nm, 100 nm, 200 nm, 500 nm, 1 micrometer, 2 micrometer, 5 micrometer, 10 micrometer, 20 micrometer, 50 micrometer, 100 micrometer, 200 micrometer, 500 micrometer and 1000 micrometer, including any of the above values.

[0068] In some embodiments, an undercoating layer may be provided between the protective layer and the OSC layer. The undercoating layer can promote adhesion between the protective layer and the OSC layer. In some embodiments, the undercoating layer can be formed by vapor deposition (including chemical vapor deposition, physical vapor deposition, atomic layer deposition), or using other deposition techniques (such as spin coating or dip coating).

[0069] If necessary, the OSC layer can be surface-treated before forming the protective layer or the base coat. For example, surface treatment may include UV / ozone or oxygen plasma etching.

[0070] According to other embodiments, the formation of an optical element containing OSC material may include depositing OSC material over a substrate having a structured surface. For example, the structured surface may include trenches or vias. The size and specifications of such structures may be defined as 1D or 2D periodic or aperiodic gratings. Furthermore, the dimensions of the structure can be configured to facilitate the formation of single crystals therein. That is, the substrate surface may contain volumetric features defining the grating architecture while simultaneously promoting the formation of single-crystal organic material therein.

[0071] The following will refer to Figure 1-14 This section elaborates on the devices and methods related to the fabrication and use of organic solid-state crystal (OSC) optical elements. Figure 1 Related discussions include descriptions of binary surface relief gratings formed from optically anisotropic OSC materials. Figure 2 and Figure 3 Related discussions include descriptions of OSC-based one-dimensional and two-dimensional surface relief gratings. Figure 4 Related discussions include a description of methods for in-situ formation of single-crystal OSC grating architectures. (And...) Figure 5 Related discussions include descriptions of the formation of a protective layer over the organic solid crystal layer. (and) Figure 6-14 The related discussion relates to exemplary virtual reality and augmented reality devices, which may include one or more optical elements containing an OSC as disclosed herein.

[0072] See Figure 1 The image shown is a cross-sectional view of exemplary surface-embossed gratings configured to selectively couple power to one diffraction level rather than another. Figure 1 As shown in Figure A, a tilted grating formed of an optically isotropic medium can be used to break diffraction symmetry. Alternatively, as... Figure 1 As shown in B, diffraction-order selectivity can be achieved using a binary (non-tilted) grating formed from an optically anisotropic medium. See also Figure 1 C. The performance properties of isotropic and anisotropic gratings are shown in the attached table. Figure 2 and 3 An exemplary grating architecture is shown. Figure 2 Example 1D periodic grating is shown. Figure 3 Example 2D periodic grating is shown.

[0073] Figure 4 This paper demonstrates a method for fabricating optical elements (such as grating structures) using organic solid-state crystalline materials. See also... Figure 4 A, Method 400 includes providing a substrate 410 with a structured surface. For example, the structured surface may include a 1D or 2D recessed feature 412. Feature 412 may include trenches or vias defining a target grating architecture. See also Figure 4 Figure B illustrates that, during an intermediate stage of manufacturing, OSC precursor material 420 can be deposited within feature 412. Depending on the specific embodiment, feature 412 can be geometrically configured to confine the formation of polycrystalline organic solids. For example... Figure 4 The optical element shown in C may include an array of single-crystal OSC grating elements 422.

[0074] Turn Figure 5 The diagram shows a perspective view of an optical component 500, including a protected OSC layer. In the illustrated embodiment, a protective layer is disposed above each major surface of the OSC layer. Figure 5 An optional undercoat layer is provided between the OSC layer and each protective layer, as shown.

[0075] According to various embodiments, the optical element includes a surface-embossed grating formed of an organic solid-state crystal (OSC). The OSC can exhibit optical anisotropy, allowing polarization and diffraction-order selectivity to be achieved by appropriately orienting the crystal's refractive index. The OSC can be single-crystal or polycrystalline, and the surface-embossed grating can be configured as a 1D or 2D architecture, each structure having one or more OSC layers. The grating structure can be formed on a substrate using any suitable technique, including molding or deposition and etching processes.

[0076] According to a further embodiment, the optical element includes an organic solid-state crystal (OSC) layer and a protective layer covering at least one major surface of the OSC layer. The protective layer can be configured to inhibit degradation of the mechanical and / or optical properties of the OSC layer. The protective layer may include organic or inorganic materials, such as silicone or metal oxides. An undercoat layer may be disposed between the protective layer and the OSC layer and can be adjusted to promote adhesion between the protective layer and the OSC layer. Both the protective layer and the optional undercoat layer can be formed using lamination or other suitable deposition techniques.

[0077] Other embodiments involve methods for forming OSC structures (e.g., surface gratings). Polarization and diffraction-order selectivity of such organic materials can be achieved by appropriately orienting the refractive index of the organic semiconductor grating elements. Single-crystal OSC layers with controllable crystal orientations can be grown within grooves in a template. The template can be configured to form 1D or 2D OSC architectures therein, where the groove geometry facilitates the formation of single-crystal layers and inhibits the formation of polycrystalline organic solid crystals. Methods for depositing organic semiconductor layers on and within the template include vapor deposition and coating processes such as chemical vapor deposition, physical vapor deposition, electron beam deposition, and atomic layer deposition. Other example methods for forming OSC layers from solutions and / or melts include, but are not limited to, printing, dip coating, blade coating, and spin coating.

[0078] Exemplary Implementation Implementations of this disclosure may include various types of Artificial Reality (AR) systems or combinations thereof. AR can be any overlay of functional and / or sensorily detectable content presented by an AR system within a user's physical environment. In other words, AR is a form of reality that is modulated in some way before being presented to the user. AR can include and / or represent virtual reality (VR), augmented reality, mixed AR (MAR), or combinations and / or variations of these types of reality. Similarly, AR environments may include VR environments (including non-immersive, semi-immersive, and fully immersive VR environments), augmented reality environments (including marker-based augmented reality environments, markerless augmented reality environments, location-based augmented reality environments, and projection-based augmented reality environments), hybrid reality environments, and / or any other type or form of mixed or alternative reality environment.

[0079] AR content can include entirely computer-generated content or computer-generated content combined with captured (e.g., real-world) content. Artificial reality content can include video, audio, haptic feedback, or combinations thereof, any of which can be presented in a single channel or in multiple channels (e.g., stereoscopic video that produces a three-dimensional (3D) effect for the viewer). Furthermore, in some implementations, AR can also be associated with applications, products, accessories, services, or combinations thereof used for, for example, creating content in artificial reality and / or otherwise using artificial reality (e.g., to perform activities therein).

[0080] AR systems can be implemented in a variety of different sizes and configurations. Some AR systems can be designed to operate without a near-eye display (NED). Other AR systems may include an NED that can also provide visibility into the real world (e.g., Figure 13A and 13B (VR system 1300 in the text). While some AR devices may be self-contained systems, others may communicate and / or coordinate with external devices to provide an AR experience to the user. Examples of such external devices include handheld controllers, mobile devices, desktop computers, wearable devices, one or more other wearable devices, and / or any other suitable external system.

[0081] Figure 6-9B An example artificial-reality (AR) system based on some implementation schemes is shown. Figure 6The illustration shows a first example user interaction between a first AR system 600 and a wrist-worn wearable device 602, a head-worn wearable device (e.g., AR system 1200), and / or a handheld intermediary processing device (HIPD) 606. Figure 7 The second AR system 700 and a second example user interaction using a wrist wearable device 702, AR glasses 704 and / or HIPD 706 are shown. Figure 8A and 8B The third AR system 800 is shown interacting with a third example user 808 using a wrist wearable device 802, a head wearable device (e.g., a VR headset 850), and / or a HIPD 806. Figure 9A and 9B The interaction between a fourth AR system 900 and a fourth example user 908 using a wrist-worn wearable device 930, a VR headset microphone 920, and / or a haptic device 960 (e.g., wearable gloves) is shown.

[0082] The following is for reference. Figure 10 and Figure 11 Describes a wrist-worn wearable device 1000, which can be used in wrist-worn wearable devices 602, 702, 802, 930 and one or more components thereof; an AR system 1200 and a VR system 1300, which can be used in AR glasses 604, 704 or VR head-mounted displays 850, 920, respectively, with one or more components thereof referenced. Figure 12-14 Please describe it as follows.

[0083] See Figure 6 The wrist-worn wearable device 602, AR glasses 604, and / or HIPD 606 can be communicatively coupled via network 625 (e.g., cellular, near-field, Wi-Fi, personal area network, wireless LAN, etc.). Furthermore, the wrist-worn wearable device 602, AR glasses 604, and / or HIPD 606 can also be communicatively coupled via network 625 (e.g., cellular, near-field, Wi-Fi, personal area network, wireless LAN, etc.) to one or more servers 630, computers 640 (e.g., laptops, computers, etc.), mobile devices 650 (e.g., smartphones, tablets, etc.), and / or other electronic devices.

[0084] exist Figure 6In the illustration, user 608 is shown wearing a wrist-worn wearable device 602 and AR glasses 604, and has a HIPD 606 on their table. The wrist-worn wearable device 602, AR glasses 604, and HIPD 606 facilitate user interaction with the AR environment. Specifically, as shown in the first AR system 600, the wrist-worn wearable device 602, AR glasses 604, and / or HIPD 606 enable the presentation of one or more avatars 610, digital representations of contacts 612, and virtual objects 614. As discussed below, user 608 can interact with one or more avatars 610, digital representations of contacts 612, and virtual objects 614 via the wrist-worn wearable device 602, AR glasses 604, and / or HIPD 606.

[0085] User 608 can provide user input using any of the wrist wearable device 602, AR glasses 604, and / or HIPD 606. For example, user 608 can perform one or more gestures, which are provided by the wrist wearable device 602 (e.g., using one or more EMG sensors and / or IMUs, as referenced below). Figure 10 and 11 (as described). and / or AR glasses 604 (e.g., using one or more image sensors or cameras, as referenced below). Figure 12-1 (As described in 7) Detection to provide user input. Alternatively or additionally, user 608 may provide user input via one or more touch surfaces of the wrist wearable device 602, AR glasses 604, HIPD 606 and / or voice commands captured by the microphone of the wrist wearable device 602, AR glasses 604 and / or HIPD 606. In some embodiments, the wrist wearable device 602, AR glasses 604 and / or HIPD 606 includes a digital assistant to assist user 608 in providing user input (e.g., completing sequences of actions, suggesting different actions or instructions, providing reminders, confirming instructions, etc.). In some embodiments, user 608 may provide user input via one or more facial gestures and / or facial expressions. For example, the camera of the wrist wearable device 602, AR glasses 604 and / or HIPD 606 may track user 608's eyes to navigate the user interface.

[0086] The wrist-worn wearable device 602, AR glasses 604, and / or HIPD 606 can operate individually or in combination to allow user 608 to interact with the AR environment. In some embodiments, HIPD 606 is configured to serve as a central hub or control center for the wrist-worn wearable device 602, AR glasses 604, and / or another communication-coupled device. For example, user 608 can provide input to interact with the AR environment at any of the wrist-worn wearable device 602, AR glasses 604, and / or HIPD 606, and HIPD 606 can identify one or more backend and frontend tasks to perform the requested interaction and issue instructions to perform one or more backend and frontend tasks at the wrist-worn wearable device 602, AR glasses 604, and / or HIPD 606. In some embodiments, backend tasks are user-insensible background processing tasks (e.g., rendering content, decompressing, compressing, etc.), while frontend tasks are user-insensible user-facing tasks (e.g., presenting information to the user, providing feedback to the user, etc.). As described herein, HIPD 606 is capable of performing backend tasks and providing operational data corresponding to the performed backend tasks to wrist wearable device 602 and / or AR glasses 604, enabling wrist wearable device 602 and / or AR glasses 604 to perform frontend tasks. In this way, compared to wrist wearable device 602 and / or AR glasses 604, HIPD 606, with its greater computing resources and thermal headroom, performs computationally intensive tasks and reduces the computing resource utilization and / or power consumption of wrist wearable device 602 and / or AR glasses 604.

[0087] In the example shown in the first AR system 600, HIPD 606 identifies one or more backend and frontend tasks related to a user request initiating an AR video call represented by one or more other users (digital representations of clone 610 and contact 612), and issues instructions to perform one or more backend and frontend tasks. Specifically, HIPD 606 performs backend tasks for processing and / or rendering image data (and other data) related to the AR video call, and provides operational data related to the performed backend tasks to AR glasses 604, causing AR glasses 604 to perform frontend tasks for presenting the AR video call (e.g., presenting digital representations of clone 610 and contact 612).

[0088] In some implementations, HIPD 606 can be used as a focal point or anchor point for inducing information presentation. This allows user 608 to generally know where the information is presented. For example, as shown in the first AR system 600, digital representations of clone 610 and contact 612 are presented on HIPD 606. Specifically, HIPD 606 and AR glasses 604 work together to determine the location for presenting the digital representations of clone 610 and contact 612. In some implementations, information can be presented at a predetermined distance from HIPD 606 (e.g., within 5 meters). For example, as shown in the first AR system 600, virtual object 614 is presented on a table at a distance from HIPD 606. Similar to the example above, HIPD 606 and AR glasses 604 work together to determine the location for presenting virtual object 614. Alternatively, in some implementations, the presentation of information is not constrained by HIPD 606. More specifically, the digital representations of clone 610, contact 612, and virtual object 614 do not necessarily need to be presented within the predetermined distance of HIPD 606.

[0089] Coordinating user input provided at the wrist wearable device 602, AR glasses 604, and / or HIPD 606 enables the user to use any device to initiate, continue, and / or complete an operation. For example, user 608 can provide user input to AR glasses 604 to cause AR glasses 604 to display a virtual object 614, and when AR glasses 604 displays the virtual object 614, user 608 can provide one or more gestures via the wrist wearable device 602 to interact with and / or manipulate the virtual object 614.

[0090] Figure 7 The illustration shows a user 708 wearing a wrist-worn wearable device 702 and AR glasses 704, and holding a HIPD 706. In the second AR system 700, the wrist-worn wearable device 702, AR glasses 704, and / or HIPD 706 are used to receive and / or provide one or more messages to the user 708's contacts. Specifically, the wrist-worn wearable device 702, AR glasses 704, and / or HIPD 706 detect and coordinate one or more user inputs to initiate a messaging application and prepare a response to messages received via the messaging application.

[0091] In some embodiments, user 708 launches an application on wrist wearable device 702, AR glasses 704, and / or HIPD 706 via user input, causing the application to launch on at least one device. For example, in a second AR system 700, user 708 performs a gesture (represented by the messaging user interface 716) associated with an instruction to launch a messaging application. Wrist wearable device 702 detects the gesture and, based on determination that user 708 is wearing AR glasses 704, causes AR glasses 704 to present the messaging user interface 716 of the messaging application. AR glasses 704 is able to present the messaging user interface 716 to user 708 via its display (e.g., as shown in user 708's field of view 718). In some embodiments, the application is launched and executed on a device (e.g., wrist wearable device 702, AR glasses 704, and / or HIPD 706) that detects user input to launch the application, and that device provides other device operation data to cause the messaging application to be presented. For example, the wrist-worn wearable device 702 can detect user input to launch a messaging application, launch and run the messaging application, and provide operational data to the AR glasses 704 and / or HIPD 706 to enable the presentation of the messaging application. Alternatively, the application can be launched and executed on a device other than the one that detected the user input. For example, the wrist-worn wearable device 702 can detect gestures associated with launching the messaging application and enable the HIPD 706 to run the messaging application and coordinate its presentation.

[0092] Furthermore, user 708 can provide user input at the wrist wearable device 702, AR glasses 704, and / or HIPD 706 to continue and / or complete an operation initiated at another device. For example, after launching a messaging application via the wrist wearable device 702, and with the messaging user interface 716 presented at the AR glasses 704, user 708 can provide input at the HIPD 706 to prepare a response (e.g., indicated by a swipe gesture performed on the HIPD 706). Gestures performed by user 708 on the HIPD 706 can be provided and / or displayed on another device. For example, a swipe gesture performed on the HIPD 706 is displayed on the virtual keyboard of the messaging user interface 716 displayed by the AR glasses 704.

[0093] In some implementations, the wrist wearable device 702, AR glasses 704, HIPD 706, and / or any other communication-coupled device can present one or more notifications to the user 708. Notifications may indicate new messages, incoming calls, application updates, status updates, etc. The user 708 can select notifications via the wrist wearable device 702, AR glasses 704, and / or HIPD 706, and can display the application or action associated with the notification on at least one device. For example, the user 708 can receive a notification that a message has been received at the wrist wearable device 702, AR glasses 704, HIPD 706, and / or any other communication-coupled device, and can then provide user input at the wrist wearable device 702, AR glasses 704, and / or HIPD 706 to view the notification, and the device detecting the user input can cause the application associated with the notification to be launched and / or presented at the wrist wearable device 702, AR glasses 704, and / or HIPD 706.

[0094] While the examples above describe coordinated input for interacting with a messaging application, user input can be coordinated for interacting with any number of applications, including but not limited to gaming applications, social media applications, camera applications, web-based applications, financial applications, and so on. For example, AR glasses 704 can present game application data to user 708, while HIPD 706 can act as a controller, providing input for the game. Similarly, user 708 can use wrist wearable device 702 to activate the camera of AR glasses 704, and user 708 can use wrist wearable device 702, AR glasses 704, and / or HIPD 706 to manipulate image capture (e.g., zoom in or out, apply filters, etc.) and capture image data.

[0095] Users can interact with the devices disclosed herein in various ways. For example, such as Figure 8A and Figure 8B As shown, user 808 can interact with AR system 800 by wearing VR headset 850 while holding HIPD 806 and wearing wrist wearable device 802. In this example, AR system 800 allows the user to interact with game 810 by swiping their arm. One or more of VR headset 850, HIPD 806, and wrist wearable device 802 can detect this gesture and, in response, can display sword strikes in game 810. Similarly, in Figure 9A and Figure 9BIn this example, user 908 can interact with AR system 900 by wearing VR headset 920 while wearing haptic device 960 and wrist wearable device 930. In this example, AR system 900 allows the user to interact with game 910 by swiping their arm. One or more of VR headset 920, haptic device 960, and wrist wearable device 930 can detect this gesture and, in response, can display the incantation being cast in game 910.

[0096] Having discussed the example AR systems, we will now discuss in more detail the devices used to interact with such AR systems and other computing systems. For ease of reference, this document explains some of the devices and components that can be included in some or all of the example devices discussed below. Some types of components described below may be more suitable for a particular group of devices and less suitable for different groups of devices. However, subsequent references to components explained herein should be considered as included in the description provided.

[0097] In some of the implementations discussed below, example devices and systems, including electronic devices and systems, will be discussed. Such example devices and systems are not intended to be limiting, and those skilled in the art will understand that alternative devices and systems to the example devices and systems described herein can be used to perform the operations described herein and to construct the systems and devices described herein.

[0098] An electronic device can be a device that uses electrical energy to perform a specific function. An electronic device can be any physical object containing electronic components such as transistors, resistors, capacitors, diodes, and integrated circuits. Examples of electronic devices include smartphones, laptops, digital cameras, televisions, game consoles, and music players, as well as the example electronic devices discussed herein. As described herein, an intermediate electronic device can be a device located between two other electronic devices and / or subsets of components of one or more electronic devices and facilitating communication, data processing, and / or data transmission between the respective electronic devices and / or electronic components.

[0099] An integrated circuit (IC) can be an electronic device consisting of multiple interconnected electronic components, such as transistors, resistors, and capacitors. These components can be etched onto a small piece of semiconductor material, such as silicon. ICs can include analog ICs, digital ICs, mixed-signal ICs, and / or any other suitable type or form of IC. Examples of ICs include application-specific integrated circuits (ASICs), processing units, central processing units (CPUs), coprocessors, and accelerators.

[0100] Analog integrated circuits (such as sensors, power management circuits, and operational amplifiers) can process continuous signals and perform analog functions such as amplification, active filtering, demodulation, and mixing. Examples of analog integrated circuits include linear integrated circuits and radio frequency circuits.

[0101] Digital integrated circuits, which can be referred to as logic integrated circuits, may include microprocessors, microcontrollers, memory chips, interfaces, power management circuits, programmable devices, and / or any other suitable type or form of integrated circuit. In some implementations, examples of integrated circuits include a central processing unit (CPU). A processing unit (such as a CPU) can be an electronic component responsible for executing instructions and controlling the operation of an electronic device (e.g., a computer). Various types of processors can be used interchangeably with the embodiments described herein, or these processors may be specifically required. For example, a processor can be: (i) a general-purpose processor designed to perform a variety of tasks, such as running software applications, managing operating systems, and performing arithmetic and logical operations; (ii) a microcontroller designed for specific tasks, such as controlling electronic devices, sensors, and motors; (iii) an accelerator (such as a graphics processing unit (GPU)) designed to accelerate the creation and rendering of images, videos, and animations (e.g., virtual reality animations, such as 3D modeling); (iv) a field-programmable gate array (FPGA) capable of being programmed and reconfigured post-manufacturing and / or customized to perform specific tasks, such as signal processing, cryptography, and machine learning; and / or (v) a digital signal processor (DSP) designed to perform mathematical operations on signals such as audio, video, and radio waves. The various implementations described herein may use one or more processors of one or more electronic devices.

[0102] Memory generally refers to electronic components in a computer or electronic device that store data and instructions for processor access and operation. Examples of memory may include: (i) random access memory (RAM) configured to temporarily store data and instructions; (ii) read-only memory (ROM) configured to permanently and / or semi-permanently store data and instructions (e.g., one or more portions of system firmware and / or a bootloader); (iii) flash memory that stores data in an electronic device (e.g., a USB drive, a memory card, and / or a solid-state drive (SSD)); and / or (iv) cache memory configured to temporarily store frequently accessed data and instructions. As described herein, memory is capable of storing structured data (e.g., SQL databases, MongoDB databases, GraphQL data, JSON data, etc.). Other examples of data stored in memory may include: (i) profile data, which includes user account data, user settings, and / or other user data stored by the user; (ii) sensor data, which is detected by one or more sensors and / or otherwise acquired; (iii) media content data, which includes stored image data, audio data, documents, etc.; and (iv) application data, which may include data collected and / or otherwise acquired and stored during the use of the application, and / or any other type of data described herein.

[0103] A controller can be an electronic component that manages and coordinates the operation of other components within an electronic device (e.g., controlling inputs, processing data, and / or generating outputs). Examples of controllers can include: (i) microcontrollers, which are small, low-power controllers typically used in embedded systems and Internet of Things (IoT) devices; (ii) programmable logic controllers (PLCs), which can be configured for use in industrial automation systems to control and monitor manufacturing processes; (iii) system-on-a-chip (SoC) controllers, which integrate multiple components such as processors, memory, I / O interfaces, and other peripherals into a single chip; and / or, (iv) digital signal processors (DSPs).

[0104] The power system of an electronic device can be configured to convert input power into a form that can be used to operate the device. The power system can include various components such as: (i) a power source, which can be an alternating current (AC) adapter or a direct current (DC) adapter power source; (ii) a charger input, which can be configured to use wired and / or wireless connections (which can be part of a peripheral interface such as USB, micro USB interface, near-field magnetic coupling, magnetic induction and magnetic resonance charging, and / or radio frequency (RF) chargi, RF charging); (iii) a power management integrated circuit configured to distribute power to various components of the device and ensure that the device operates within safety limits (e.g., regulating voltage, controlling current flow, and / or managing heat dissipation); and / or, (iv) a battery configured to store power to provide usable power to components of one or more electronic devices.

[0105] Peripheral interfaces can be electronic components (e.g., electronic components of an electronic device) that allow the electronic device to communicate with other devices or peripheral devices and are capable of providing input and output of data and signals. Examples of peripheral interfaces can include: (i) a Universal Serial Bus (USB) and / or MicroUSB interface configured for connecting a device to an electronic device; (ii) a Bluetooth interface configured to allow devices to communicate with each other, including Bluetooth Low Energy (BLE); (iii) a Near Field Communication (NFC) interface configured as a short-range wireless interface for operations such as access control; (iv) a POGO pin, which can be a small spring-loaded pin configured to provide a charging interface; (v) a wireless charging interface; (vi) a GPS interface; (vii) a Wi-Fi interface for providing connectivity between a device and a wireless network; and / or, (viii) a sensor interface.

[0106] Sensors can be electronic components configured to detect physical and environmental changes and generate electrical signals (e.g., in electronic devices such as wearable devices and / or otherwise in electronic communication with electronic devices). Examples of sensors can include: (i) imaging sensors for collecting imaging data (e.g., including one or more cameras disposed on a corresponding electronic device); (ii) biopotential signal sensors; (iii) inertial measurement units (e.g., IMUs) for detecting changes in, for example, angular velocity, force, magnetic field, and / or acceleration; (iv) heart rate sensors for measuring a user's heart rate; (v) SpO2 sensors for measuring a user's blood oxygen saturation and / or other biometric data; (vi) capacitive sensors for detecting potential changes at a part of a user's body (e.g., sensor-skin interface); and / or, (vii) light sensors (e.g., time-of-flight sensors, infrared sensors, visible light sensors, etc.).

[0107] Biopotential signal sensing components can be devices used to measure electrical activity within the body (e.g., biopotential signal sensors). Some types of biopotential signal sensors include: (i) electroencephalography (ECG or EEG) sensors configured to measure electrical activity in the brain to diagnose neurological disorders; (ii) electrocardiography (EKG) sensors configured to measure electrical activity in the heart to diagnose heart problems; (iii) electromyography (EMG) sensors configured to measure electrical activity in muscles and diagnose neuromuscular disorders; and (iv) electrooculography (EOG) sensors configured to measure electrical activity in eye muscles to detect eye movements and diagnose eye disorders.

[0108] Applications stored in the memory of electronic devices (e.g., software) may include instructions stored in the memory. Examples of such applications include: (i) games, (ii) word processors, (iii) instant messaging applications, (iv) media streaming applications, (v) financial applications, (vi) calendars, (vii) clocks, and (viii) communication interface modules for enabling wired and / or wireless connections between different electronic devices (e.g., IEEE 1202.15.4, Wi-Fi, ZigBee, 6LoWPAN, Thread, Z-Wave, Bluetooth Smart, ISA100.11a, WirelessHART, or MiWi), custom or standard wired protocols (e.g., Ethernet or HomePlug), and / or any other suitable communication protocol.

[0109] A communication interface can be a mechanism that enables different systems or devices to exchange information and data with each other, including hardware, software, or a combination of hardware and software. For example, a communication interface can refer to a physical connector and / or port on a device that enables communication with other devices (e.g., USB, Ethernet, HDMI, Bluetooth). In some implementations, a communication interface can refer to a software layer that enables different software programs to communicate with each other (e.g., application programming interfaces (APIs), protocols such as HTTP and TCP / IP, etc.).

[0110] A graphics module can be a component or software module designed to handle graphics operations and / or processes, and can include hardware modules and / or software modules.

[0111] Non-transitory computer-readable storage media can be physical devices or storage media capable of storing electronic data in a non-transitory form (e.g., such that the data is permanently stored until it is intentionally deleted or modified).

[0112] Figure 10 and 11 An example wrist-worn wearable device 1000 and an example computer system 1100 are illustrated according to some embodiments. The wrist-worn wearable device 1000 is the subject of this document. Figure 6 An example of the wearable device 602 described herein, which should be understood as having the characteristics of the wrist wearable device 1000, and vice versa. Figure 11 The components of a wrist-worn wearable device 1000 are shown, which can be used individually or in combination, including combinations containing other electronic devices and / or electronic components.

[0113] As described below, Figure 10 A wearable strap 1010 and a watch body 1020 (or capsule) are shown coupled to form a wrist wearable device 1000. The wrist wearable device 1000 is capable of performing various functions and / or operations related to navigation via a user interface and selectively opening applications, as described above. Figures 6 to 9B The described functions and / or operations.

[0114] As will be described in more detail below, the operations performed by the wrist-worn wearable device 1000 may include: (i) presenting content to the user (e.g., displaying visual content via display 1005); (ii) detecting (e.g., sensing) user input (e.g., sensing touches on peripheral buttons 1023 and / or on the touchscreen of display 1005, gestures detected by sensors (e.g., bio-potential sensors); (iii) sensing biometric data (e.g., neuromuscular signals, heart rate, temperature, sleep, etc.) via one or more sensors 1013, sending messages (e.g., text, voice, video, etc.), capturing images via one or more imaging devices or cameras 1025, wireless communication (e.g., cellular, near-field, Wi-Fi, personal area network, etc.), location determination, financial transactions, providing haptic feedback, providing alarms, providing notifications, providing biometric authentication, providing health monitoring, providing sleep monitoring, etc.

[0115] The example functions described above can be performed independently within the watch body 1020, independently within the wearable strap 1010, and / or via electronic communication between the watch body 1020 and the wearable strap 1010. In some embodiments, when an AR environment is presented (e.g., via one of AR systems 600 to 900), the functions can be performed on the wrist-worn wearable device 1000. The wearable device described herein can also be used with other types of AR environments.

[0116] The wearable band 1010 can be configured to be worn by a user such that the inner surface of the wearable structure 1011 of the wearable band 1010 contacts the user's skin. In this example, when the user wears it, the sensor 1013 can contact the user's skin. In some embodiments, one or more of the sensors 1013 can sense biometric data, such as the user's heart rate, saturated oxygen level, temperature, sweat level, neuromuscular signals, or combinations thereof. One or more sensors 1013 can also sense data about the user's environment, including the user's motion, height, position, orientation, gait, acceleration, location, or combinations thereof. In some embodiments, one or more sensors 1013 can be configured to track the position and / or motion of the wearable band 1010. One or more sensors 1013 can include the above-defined and / or the following information about... Figure 10 Any of the sensors discussed.

[0117] One or more sensors 1013 can be distributed on the inner and / or outer surface of the wearable band 1010. In some embodiments, the one or more sensors 1013 are evenly spaced along the wearable band 1010. Alternatively, in some embodiments, the one or more sensors 1013 are positioned at different points along the wearable band 1010. Figure 10As shown, one or more sensors 1013 can be the same or different. For example, in some embodiments, one or more sensors 1013 can be shaped as a ball (e.g., sensor 1013a), ellipse, circle, square, rectangle (e.g., sensor 1013c), and / or any other shape that remains in contact with the user's skin (e.g., enabling accurate measurement of neuromuscular signals and / or other biometric data at the user's skin). In some embodiments, one or more sensors 1013 are aligned to form sensor pairs (e.g., for sensing neuromuscular signals based on differential sensing within each respective sensor). For example, sensor 1013b can be aligned with an adjacent sensor to form sensor pair 1014a, and sensor 1013d can be aligned with an adjacent sensor to form sensor pair 1014b. In some embodiments, the wearable band 1010 does not have sensor pairs. Alternatively, in some embodiments, the wearable band 1010 has a predetermined number of sensor pairs (one sensor pair, three sensor pairs, four sensor pairs, six sensor pairs, sixteen sensor pairs).

[0118] The wearable band 1010 can include any suitable number of sensors 1013. In some embodiments, the number and arrangement of sensors 1013 depend on the specific application using the wearable band 1010. For example, the wearable band 1010 can be configured as an armband, wristband, or chest band, and they can include multiple sensors 1013 with different numbers of sensors 1013, various types of single sensors with multiple sensors 1013, and different arrangements for each use case, such as medical use cases compared to gaming or general daily use cases.

[0119] According to some embodiments, the wearable band 1010 also includes an electrically grounding electrode and a shielding electrode. Similar to the sensor 1013, the electrically grounding electrode and the shielding electrode can be distributed on the inner surface of the wearable band 1010 such that they contact a portion of the user's skin. For example, the electrically grounding electrode and the shielding electrode can be located on the inner surface of the coupling mechanism 1016 or the inner surface of the wearable structure 1011. The electrically grounding electrode and the shielding electrode can be formed and / or use the same components as the sensor 1013. In some embodiments, the wearable band 1010 includes more than one electrically grounding electrode and more than one shielding electrode.

[0120] Sensor 1013 can be formed as part of the wearable structure 1011 of the wearable band 1010. In some embodiments, sensor 1013 is flush or substantially flush with the wearable structure 1011 such that it does not extend beyond the surface of the wearable structure 1011. Even when flush with the wearable structure 1011, sensor 1013 is still configured to contact the user's skin (e.g., via a skin contact surface). Alternatively, in some embodiments, sensor 1013 extends beyond the wearable structure 1011 by a predetermined distance (e.g., 0.1-2 mm) to contact and press into the user's skin. In some embodiments, sensor 1013 is coupled to an actuator (not shown) configured to adjust the extension height of sensor 1013 (e.g., distance from the surface of the wearable structure 1011) such that sensor 1013 contacts and presses into the user's skin. In some embodiments, the actuator can adjust the extension height from 0.01 mm to 1.2 mm. This allows users to customize the position of sensor 1013, thereby improving overall comfort when wearing the wearable wristband 1010, while still allowing sensor 1013 to contact the user's skin. In some implementations, sensor 1013 is indistinguishable from wearable structure 1011 when worn by the user.

[0121] The wearable structure 1011 can be formed of an elastic material, elastomer, etc., configured to be stretched and adjusted for wear by a user. In some embodiments, the wearable structure 1011 is a textile or woven fabric. As described above, the sensor 1013 can be formed as part of the wearable structure 1011. For example, the sensor 1013 can be molded into the wearable structure 1011, integrated into a woven fabric (e.g., the sensor 1013 can be sewn into the fabric and mimic the flexibility of the fabric, and can and / or can be constructed from a series of woven fabric threads).

[0122] Wearable structure 1011 may include interconnected sensors 1013, electronic circuits and / or other electronic components (hereinafter referred to as...) Figure 11 A flexible electronic connector (described) is encapsulated within a wearable band 1010. In some embodiments, the flexible electronic connector is configured to interconnect sensors 1013, electronic circuitry, and / or other electronic components of the wearable band 1010 with corresponding sensors and / or other electronic components of another electronic device (e.g., watch body 1020). The flexible electronic connector is configured to move with the wearable structure 1011 such that no stress or strain is applied to the electrical coupling of the components of the wearable band 1010 when the user adjusts the wearable structure 1011 (e.g., resizing, pulling, folding, etc.).

[0123] As described above, the wearable band 1010 is configured to be worn by a user. Specifically, the wearable band 1010 can be shaped or otherwise operated for wear by a user. For example, the wearable band 1010 can be shaped to have a generally circular shape, allowing it to be configured to be worn on a user's forearm or wrist. Alternatively, the wearable band 1010 can be designed to be worn on other parts of the user's body, such as the user's upper arm (e.g., around the biceps), forearm, chest, legs, etc. The wearable band 1010 may include a fastening device 1012 (e.g., a buckle, hook and loop, etc.) for securing the wearable band 1010 to the user's wrist or other body part. When the user wears the wearable band 1010, the sensor 1013 senses data (referred to as sensor data) from the user's skin. In some embodiments, the sensor 1013 of the wearable band 1010 acquires (e.g., senses and records) neuromuscular signals.

[0124] The sensed data (e.g., sensed neuromuscular signals) can be used to detect and / or determine a user's intention to perform certain motor actions. In some embodiments, sensor 1013 can sense and record neuromuscular signals from the user when the user performs muscle activation (e.g., movement, gesture, etc.). The detected and / or determined motor actions (e.g., phalanges (or fingers) movement, wrist movement, hand movement, and / or other muscle intentions) can be used to determine control instructions or control information (instructions to execute certain instructions after the sensed data) for causing the computing device to execute one or more input instructions. For example, the sensed neuromuscular signals can be used to control certain user interfaces displayed on the display 1005 of the wrist-worn wearable device 1000, and / or can be transmitted to a device responsible for rendering an artificial reality environment (e.g., a head-mounted wearable display) to perform actions in the associated artificial reality environment, such as controlling the movement of a virtual device displayed to the user. User-performed muscle activation can include static gestures (such as placing the user's palm down on a table), dynamic gestures (such as grasping a physical or virtual object), and covert gestures that are imperceptible to another person (such as slightly tightening a joint by co-contracting opposing muscles or using sub-muscle activation). User-performed muscle activation can also include symbolic gestures (e.g., gestures that map a gesture vocabulary based on a mapping of specified gestures to instructions to gestures of other gestures, interactions, or instructions).

[0125] The sensor data sensed by sensor 1013 can be used to provide users with enhanced interaction with physical objects (e.g., devices communicatively coupled to wearable strap 1010) and / or virtual objects in artificial reality applications generated by artificial reality systems (e.g., user interface objects displayed on display 1005, or another computing device (e.g., smartphone)).

[0126] In some embodiments, the wearable band 1010 includes one or more tactile devices 1146 (e.g., vibratory tactile actuators) configured to provide tactile feedback (e.g., skin and / or kinesthetic sensations) to the user's skin. Sensors 1013 and / or tactile devices 1146 (such as...) Figure 11 (As shown) can be configured to run in combination with multiple applications (including but not limited to health monitoring, social media, games, and artificial reality (e.g., applications associated with artificial reality)).

[0127] The wearable band 1010 may also include a coupling mechanism 1016 for detachably coupling a capsule (e.g., a computing unit) or a watch body 1020 (via a coupling surface of the watch body 1020) to the wearable band 1010. For example, the bracket or shape of the coupling mechanism 1016 may correspond to the shape of the watch body 1020 of the wrist wearable device 1000. Specifically, the coupling mechanism 1016 may be configured to receive a coupling surface near the bottom side of the watch body 1020 (e.g., opposite the front side of the watch body 1020 where the display 1005 is located), allowing a user to push the watch body 1020 down into the coupling mechanism 1016 to connect the watch body 1020 to the coupling mechanism 1016. In some embodiments, the coupling mechanism 1016 can be configured to receive the top side of the watch body 1020 (e.g., the side near the front of the watch body 1020 where the display 1005 is located), which is pushed upward into a bracket rather than downward into the coupling mechanism 1016. In some embodiments, the coupling mechanism 1016 is an integrated component of the wearable strap 1010, such that the wearable strap 1010 and the coupling mechanism 1016 are a single integral structure. In some embodiments, the coupling mechanism 1016 is of the type of frame or housing, which allows the coupling surface of the watch body 1020 to remain within or on the wearable strap 1010 coupling mechanism 1016 (e.g., bracket, tracker strap, support base, buckle, etc.).

[0128] The coupling mechanism 1016 allows the watch body 1020 to be detachably coupled to the wearable strap 1010 via friction engagement, magnetic coupling, rotation-based connectors, shear pin couplers, retaining springs, one or more magnets, clips, pins, hook-and-loop fasteners, or combinations thereof. The user can perform any type of movement to couple the watch body 1020 to and detach it from the wearable strap 1010. For example, the user can twist, slide, rotate, push, pull, or rotate the watch body 1020 relative to the wearable strap 1010 or a combination thereof to connect and detach it from the wearable strap 1010. Alternatively, as discussed below, in some embodiments, the watch body 1020 can be detached from the wearable strap 1010 via an actuated release mechanism 1029.

[0129] The wearable band 1010 can be coupled to the watch body 1020 to increase the functionality of the wearable band 1010 (e.g., converting the wearable band 1010 into a wrist wearable device 1000, adding additional computing units and / or batteries to increase the computing resources and / or battery life of the wearable band 1010, adding additional sensors to improve sensing data, etc.). As described above, the wearable band 1010 and the coupling mechanism 1016 are configured to operate independently of the watch body 1020 (e.g., to perform functions independently). For example, the coupling mechanism 1016 can include one or more sensors 1013 that contact the user's skin when the user wears the wearable band 1010, with or without the watch body 1020, and can provide sensor data for determining control commands.

[0130] Users can detach the watch body 1020 from the wearable strap 1010 to reduce the burden of the wrist wearable device 1000 on the user. In embodiments where the watch body 1020 is movable, it can be referred to as a movable structure, such that in these embodiments, the wrist wearable device 1000 includes a wearable portion (e.g., the wearable strap 1010) and a movable structure (e.g., the watch body 1020).

[0131] Turning to the watch body 1020, in some examples, the watch body 1020 can have a substantially rectangular or circular shape. The watch body 1020 is configured to be worn by a user on their wrist or another body part. More specifically, the size of the watch body 1020 is configured for easy carrying by the user, attachment to a portion of the user's clothing, and / or coupling to a wearable strap 1010 (forming a wrist wearable device 1000). As described above, the watch body 1020 can have a shape corresponding to the coupling mechanism 1016 of the wearable strap 1010. In some embodiments, the watch body 1020 includes a single release mechanism 1029 or multiple release mechanisms (e.g., two release mechanisms 1029 positioned on opposite sides of the watch body 1020, such as spring-loaded buttons) for detaching the watch body 1020 from the wearable strap 1010. The release mechanism 1029 can include, but is not limited to, buttons, knobs, plungers, handles, levers, fasteners, snap rings, dials, latches, or combinations thereof.

[0132] The user can activate the release mechanism 1029 by pushing, rotating, lifting, pressing, shifting, or performing other actions on it. Activation of the release mechanism 1029 releases (e.g., detaches) the watch body 1020 from the coupling mechanism 1016 of the wearable band 1010, allowing the user to use the watch body 1020 independently of the wearable band 1010, and vice versa. For example, detaching the watch body 1020 from the wearable band 1010 allows the user to capture images using the rear camera 1025b. Although the release mechanism 1029 is shown as being located at one corner of the watch body 1020, it can be positioned anywhere on the watch body 1020 for easy user activation. Furthermore, in some embodiments, the wearable band 1010 may also include a corresponding release mechanism for detaching the watch body 1020 from the coupling mechanism 1016. In some implementations, the release mechanism 1029 is optional and is capable of separating the body 1020 from the coupling mechanism 1016 as described above (e.g., via twisting, rotating, etc.).

[0133] The watch body 1020 may include one or more peripheral buttons 1023 and 1027 for performing various operations on the watch body 1020. For example, peripheral buttons 1023 and 1027 may be used to turn on or wake (e.g., transition from sleep to active state) the display screen 1005, unlock the watch body 1020, increase or decrease the volume, increase or decrease the brightness, interact with one or more applications, interact with one or more user interfaces, etc. Furthermore, or in some embodiments, the display screen 1005 may be used as a touchscreen, allowing the user to provide one or more inputs to interact with the watch body 1020.

[0134] In some embodiments, the watch body 1020 includes one or more sensors 1021. The sensors 1021 of the watch body 1020 may be the same as or different from the sensors 1013 of the wearable band 1010. The sensors 1021 of the watch body 1020 may be distributed on the inner and / or outer surfaces of the watch body 1020. In some embodiments, the sensors 1021 are configured to contact the user's skin when the user wears the watch body 1020. For example, the sensors 1021 may be placed on the underside of the watch body 1020, and the coupling mechanism 1016 may be a bracket with an opening that allows the underside of the watch body 1020 to directly contact the user's skin. Alternatively, in some embodiments, the watch body 1020 does not include sensors configured to contact the user's skin (e.g., sensors including those inside and / or outside the watch body 1020 configured to sense data about the watch body 1020 and the surrounding environment). In some embodiments, the sensors 1021 are configured to track the position and / or movement of the watch body 1020.

[0135] The watch body 1020 and the wearable band 1010 can share data using wired communication methods (e.g., Universal Asynchronous Receiver / Transmitter (UART), USB transceiver, etc.) and / or wireless communication methods (e.g., Near Field Communication, Bluetooth, etc.). For example, the watch body 1020 and the wearable band 1010 can share data sensed by sensors 1013 and 1021, as well as application and device-specific information (e.g., active and / or available applications, output devices (e.g., display, speaker, etc.), input devices (e.g., touchscreen, microphone, imaging sensor, etc.)).

[0136] In some embodiments, the watch body 1020 may include, but is not limited to, a front-facing camera 1025a and / or a rear-facing camera 1025b, sensors 1021 (e.g., biometric sensors, IMUs, heart rate sensors, oxygen saturation sensors, neuromuscular signal sensors, altimeter sensors, temperature sensors, bioimpedance sensors, pedometer sensors, optical sensors (e.g., imaging sensor 1163), touch sensors, sweat sensors, etc.). In some embodiments, the watch body 1020 may include one or more tactile devices 1176 (e.g., vibratory tactile actuators) configured to provide tactile feedback (e.g., skin and / or kinesthetic sensations, etc.) to the user. Sensors 1121 and / or tactile devices 1176 may also be configured to operate in conjunction with multiple applications, including, but not limited to, health monitoring applications, social media applications, gaming applications, and artificial reality applications (e.g., applications related to artificial reality).

[0137] As described above, the watch body 1020 and the wearable strap 1010, when coupled, can form a wrist wearable device 1000. When coupled, the watch body 1020 and the wearable strap 1010 can operate as a single device to perform the functions described herein (operation, detection, communication, etc.). In some embodiments, specific instructions may be provided to each device for performing one or more operations of the wrist wearable device 1000. For example, based on the determination that the watch body 1020 does not include a neuromuscular signal sensor, the wearable strap 1010 can include alternative instructions for performing the relevant instructions (e.g., providing sensed neuromuscular signal data to the watch body 1020 via different electronic devices). Operation of the wrist wearable device 1000 can be performed by the watch body 1020 alone or in combination with the wearable strap 1010 (e.g., via their respective processors and / or hardware components), or vice versa. In some implementations, the operation of the wrist wearable device 1000, the watch body 1020, and / or the wearable strap 1010 can be performed in conjunction with one or more processors and / or hardware components.

[0138] See below for reference Figure 11 As shown in the block diagram, the wearable bracelet 1010 and / or watch body 1020 may each contain independent resources required to perform independent functions. For example, the wearable bracelet 1010 and / or watch body 1020 may each include a power source (e.g., a battery), memory, data storage, processor (e.g., a central processing unit (CPU)), communication, light source, and / or input / output devices.

[0139] Figure 11 Block diagrams are shown of a computing system 1130 corresponding to a wearable strap 1010 and a computing system 1160 corresponding to a watch body 1020, according to some embodiments. According to some embodiments, the computing system 1000 of the wrist wearable device 1100 may include a combination of components of the wearable strap computing system 1130 and the watch body computing system 1160.

[0140] The watch body 1020 and / or wearable strap 1010 may include one or more components shown in the watch body computing system 1160. In some embodiments, a single integrated circuit may include all or most of the components of the watch body computing system 1160 contained in that single integrated circuit. Alternatively, in some embodiments, the components of the watch body computing system 1160 may be included in a plurality of communication-coupled integrated circuits. In some embodiments, the watch body computing system 1160 may be configured (e.g., via a wired or wireless connection) to be coupled to a wearable strap computing system 1130, which may allow the computing systems to share components, issue tasks, and / or perform other operations described herein (individually or as a single device).

[0141] The table computing system 1160 may include one or more processors 1179, controllers 1177, peripheral interfaces 1161, power systems 1195, and memory (e.g., memory 1180).

[0142] The power system 1195 may include a charger input 1196, a power-management integrated circuit (PMIC) 1197, and a battery 1198. In some embodiments, the watch body 1020 and the wearable band 1010 may have their own batteries (e.g., batteries 1198 and 1159) and may share power with each other. The watch body 1020 and the wearable band 1010 may receive charge using various technologies. In some embodiments, the watch body 1020 and the wearable band 1010 may use wired charging components (e.g., a power cord) to receive charge. Alternatively or additionally, the watch body 1020 and / or the wearable band 1010 may be configured for wireless charging. For example, a portable charging device may be designed to mate with portions of the watch body 1020 and / or the wearable band 1010 and wirelessly deliver available power to the battery 1198 of the watch body 1020 and / or the battery 1159 of the wearable band 1010. The watch body 1020 and the wearable band 1010 can have independent power systems (e.g., power systems 1195 and 1156, respectively) to enable each to operate independently. The watch body 1020 and the wearable band 1010 can also share power (e.g., one can charge the other) via their respective PMICs (e.g., PMICs 1197 and 1158) and charger inputs (e.g., 1157 and 1196), which can share power above the power and ground wires and / or above the wireless charging antenna.

[0143] In some embodiments, the peripheral interface 1161 may include one or more sensors 1121. Sensor 1121 may include one or more coupling sensors 1162 for detecting when the watch body 1020 is coupled to another electronic device (e.g., wearable band 1010). Sensor 1121 may include one or more imaging sensors 1163 (e.g., one or more cameras 1125 and / or individual imaging sensors 1163 (e.g., thermal imaging sensors)). In some embodiments, sensor 1121 may include one or more SpO2 sensors 1164. In some embodiments, sensor 1121 may include one or more biopotential signal sensors (e.g., EMG sensors 1165, which may be disposed within the user-facing watch body 1020 and / or wearable band 1010). In some embodiments, sensor 1121 may include one or more capacitive sensors 1166. In some embodiments, sensor 1121 may include one or more heart rate sensors 1167. In some embodiments, sensor 1121 may include one or more IMU sensors 1168. In some implementations, one or more IMU sensors 1168 can be configured to detect movement of the user's hand or other positions where the watch body 1020 is placed or held.

[0144] In some implementations, one or more sensors 1121 may provide an exemplary human-machine interface. For example, a neuromuscular sensor array (such as EMG sensor 1165) may be arranged circumferentially around wearable band 1010, wherein the inner surface of EMG sensor 1165 is configured to contact the user's skin. Any suitable number of neuromuscular sensors may be used (e.g., between 2 and 20 sensors). The number and arrangement of neuromuscular sensors may depend on the specific application using the wearable device. For example, wearable band 1010 may be used to generate control information for controlling augmented reality systems, robots, controlling vehicles, scrolling text, controlling virtual avatars, or any other suitable control task.

[0145] In some embodiments, neuromuscular sensors can be coupled together using flexible electronics incorporated into a wireless device, and the output of one or more sensing components can optionally be processed using hardware signal processing circuitry (e.g., to perform amplification, filtering, and / or correction). In other embodiments, at least some of the signal processing of the output of the sensing components can be performed in software (such as processor 1179). Therefore, signal processing of signals sampled by sensors can be performed by hardware, software, or any suitable combination of hardware and software, as the aspects of the techniques described herein are not limited to this aspect.

[0146] Neuromuscular signals can be processed in various ways. For example, the output of the EMG sensor 1165 can be provided to an analog front-end that can be configured to perform analog processing (e.g., amplification, noise reduction, filtering, etc.) on the recorded signal. The processed analog signal can then be provided to an analog-to-digital converter that can convert the analog signal into a digital signal that can be processed by one or more computer processors. Furthermore, although this example is discussed in the context of an interface with an EMG sensor, the embodiments described herein can also be implemented in wearable interfaces with other types of sensors, including, but not limited to, mechanomyography (MMG) sensors, sonomyography (SMG) sensors, and electrical impedance tomography (EIT) sensors.

[0147] In some embodiments, the peripheral interface 1161 includes a near-field communication (NFC) component 1169, a global-position system (GPS) component 1170, a long-term evolution (LTE) component 1171, and / or a Wi-Fi and / or Bluetooth communication component 1172. In some embodiments, the peripheral interface 1161 includes one or more buttons 1173 (e.g., Figure 10 The peripheral buttons 1023 and 1027 are used to perform the operation on the watch body 1020 when the user selects the operation. In some embodiments, the peripheral interface 1161 includes one or more indicators (such as light-emitting diodes (LEDs)) to provide the user with visual indicators (e.g., message reception, low battery, active microphone and / or camera, etc.).

[0148] The watch body 1020 may include at least one display 1005 for displaying a visual representation of information or data to a user, the visual representation including user interface elements and / or three-dimensional virtual objects. The display may also include a touchscreen for inputting user input, such as touch gestures, swipe gestures, etc. The watch body 1020 may include at least one speaker 1174 and at least one microphone 1175 for providing audio signals to and receiving audio input from the user. The user can provide user input through the microphone 1175 and can also receive audio output from the speaker 1174 as part of a tactile event provided by the haptic controller 1178. The watch body 1020 may include at least one camera 1125, which includes a front-facing camera 1125a and a rear-facing camera 1125b. The camera 1125 may include an ultra-wide-angle camera, a wide-angle camera, a fisheye camera, a spherical camera, a telephoto camera, a depth-sensing camera, or other types of cameras.

[0149] The watch body computing system 1160 may include one or more haptic controllers 1178 and associated components (e.g., haptic devices 1176) for providing haptic events (e.g., a vibrational sensation or audio output in response to an event at the watch body 1020) at the watch body 1020. The haptic controllers 1178 may communicate with one or more haptic devices 1176 (such as speakers including one or more speakers 1174 and / or other audio components and / or electroacoustic devices that convert energy into linear motion, such as motors, solenoids, electroactive polymers, piezoelectric actuators, electrostatic actuators) or other haptic output generating components (e.g., components that convert electrical signals into haptic outputs on the device). The haptic controllers 1178 may provide haptic events that can be sensed by a user of the watch body 1020. In some embodiments, one or more haptic controllers 1178 may receive input signals from an application of application 1182.

[0150] In some embodiments, the wearable band computing system 1130 and / or the watch body computing system 1160 may include a memory 1180, which may be controlled by one or more memory controllers of the controller 1177. In some embodiments, software components stored in the memory 1080 include one or more applications 1182 configured to perform operations at the watch body 1020. In some embodiments, the one or more applications 1182 may include games, word processors, messaging applications, calling applications, web browsers, social media applications, media streaming applications, financial applications, calendars, clocks, etc. In one embodiment, the software components stored in the memory 1180 include one or more communication interface modules 1183 as described above. In some embodiments, the software components stored in the memory 1180 include one or more graphics modules 1184 for rendering, encoding, and / or decoding audio and / or visual data, and one or more data management modules 1185 for collecting, organizing, and / or providing access to data 1187 stored in the memory 1180. In some implementations, one or more of the application 1182 and / or one or more modules are able to work together to perform various tasks at table body 1020.

[0151] In some implementations, the software components stored in memory 1180 may include one or more operating systems 1181 (e.g., a Linux-based operating system, an Android operating system, etc.). Memory 1180 may also include data 1187. Data 1187 may include configuration file data 1188A, sensor data 1189A, media content data 1190, and application data 1191.

[0152] It should be understood that the table body computing system 1160 is an example of a computing system within the table body 1020, and the table body 1020 is capable of having more or fewer components than those shown in the table body computing system 1160, of combining two or more components, and / or of having different configurations and / or component arrangements. The various components shown in the table body computing system 1160 are implemented in hardware, software, firmware, or a combination thereof, including one or more signal processing and / or application-specific integrated circuits.

[0153] Turning to wearable band computing system 1130, one or more components that can be included in wearable band 1010 are shown. Wearable band computing system 1130 is capable of including more or fewer components than those shown in body computing system 1160, is capable of combining two or more components, and / or can have different configurations and / or arrangements of some or all of the components. In some embodiments, all or most of the components of wearable band computing system 1130 are included in a single integrated circuit. Alternatively, in some embodiments, the components of wearable band computing system 1130 are included in multiple communication-coupled integrated circuits. As described above, in some embodiments, wearable band computing system 1130 is configured (e.g., via a wired or wireless connection) to couple with body computing system 1160, which allows the computing system to share components, issue tasks, and / or perform other operations described herein (individually or as a single device).

[0154] The wearable computing system 1130 is similar to the watch-based computing system 1160 and may include one or more processors 1149, one or more controllers 1147 (including one or more haptic controllers 1148), a peripheral interface 1131 (which may include one or more sensors 1113 and other peripheral devices), a power supply (e.g., a power system 1156), and a memory (e.g., a memory 1150) that includes an operating system (e.g., an operating system 1151), data (e.g., data 1154, including configuration file data 1188B, sensor data 1189B, etc.), and one or more modules (e.g., a communication interface module 1152, a data management module 1153, etc.).

[0155] One or more sensors 1113 may be similar to sensor 1121 of the body computing system 1160. For example, sensor 1113 may include one or more coupled sensors 1132, one or more SpO2 sensors 1134, one or more EMG sensors 1135, one or more capacitive sensors 1136, one or more heart rate sensors 1137, and one or more IMU sensors 1138.

[0156] Peripheral interface 1131 may also include other components similar to those included in peripheral interface 1161 of watch computing system 1160, including NFC component 1139, GPS component 1140, LTE component 1141, Wi-Fi and / or Bluetooth communication component 1142 and / or one or more haptic devices 1146, as described above with reference to peripheral interface 1161. In some embodiments, peripheral interface 1131 includes one or more buttons 1143, display 1133, speaker 1144, microphone 1145, and camera 1155. In some embodiments, peripheral interface 1131 includes one or more indicators (such as LEDs).

[0157] It should be understood that the wearable band computing system 1130 is an example of a computing system within the wearable band 1110, and the wearable band 1010 is capable of having more or fewer components, combining two or more components, and / or having different configurations and / or component arrangements than those shown in the wearable band computing system 1130. The various components shown in the wearable band computing system 1130 can be implemented in one or more combinations of hardware, software, or firmware, including one or more signal processing and / or application-specific integrated circuits.

[0158] about Figure 10 The wrist wearable device 1000 is an example of a wearable strap 1010 and a watch body 1020 coupled together; therefore, the wrist wearable device 1000 will be understood to include the components shown and described for the wearable strap computing system 1130 and the watch body computing system 1160. In some embodiments, the wrist wearable device 1000 has a separate architecture (e.g., a separate mechanical architecture, a separate electrical architecture, etc.) between the watch body 1020 and the wearable strap 1010. In other words, all the components shown in the wearable strap computing system 1130 and the watch body computing system 1160 can be accommodated or otherwise disposed in the combined wrist wearable device 1000, or disposed in separate components of the watch body 1020, the wearable strap 1010 and / or portions thereof (e.g., the coupling mechanism 1016 of the wearable strap 1010).

[0159] The aforementioned technology can be used with any device for sensing neuromuscular signals, but it can also be used with other types of wearable devices for sensing neuromuscular signals, such as body wearables or head wearables that may have neuromuscular sensors closer to the brain or spine.

[0160] In some implementations, the wrist wearable device 1000 can be used in conjunction with head wearable devices (e.g., AR system 1200 and VR system 1310) and / or HIPD as described below, and the wrist wearable device 1000 can also be configured to allow a user to control any aspect of the artificial reality (e.g., by controlling user interface objects in the artificial reality using EMG-based gestures and / or by allowing a user to interact with a touchscreen on the wrist wearable device). Having described exemplary wrist wearable devices in this way, attention now turns to exemplary head wearable devices, such as AR system 1200 and VR system 1300.

[0161] Figures 12 to 14 An exemplary artificial reality system that can be used as or combined with a wrist-worn wearable device 1000 is shown. In some embodiments, the AR system 1200 includes, for example... Figure 12 The illustrated glasses device 1202. In some embodiments, the VR system 1300 includes a head-mounted display (HMD) 1312, such as... Figure 13A and Figure 13B As shown. In some embodiments, AR system 1200 and VR system 1300 can include one or more simulation components (e.g., components for presenting an interactive artificial reality environment, such as processors, memory, and / or presentation devices, including one or more displays and / or one or more waveguides), some of which will be referenced Figure 14 The description will be more detailed. As described herein, a head-worn wearable device can include components of glasses device 1202 and / or head-worn display 1312. Some embodiments of the head-worn wearable device do not include any display, including any display described with respect to AR system 1200 and / or VR system 1300. Although exemplary artificial reality systems are described herein as AR system 1200 and VR system 1300 respectively, either or both of the exemplary AR systems described herein can be configured to present a fully immersive virtual reality scene presented in substantially all of the user's field of vision or a more subtle augmented reality scene presented in less than a portion of the user's field of vision.

[0162] Figure 12 An example visual depiction of AR system 1200 is shown, including eyewear device 1202 (which may also be described herein as augmented reality glasses and / or smart glasses). AR system 1200 is capable of including additional electronic components in electronic communications or otherwise configured for use in conjunction with eyewear device 1202. Figure 12(not shown) (such as wearable accessory devices and / or intermediate processing devices). In some embodiments, the wearable accessory devices and / or intermediate processing devices may be configured to couple with the eyeglasses device 1202 via a coupling mechanism that electronically communicates with the coupling sensor 1424. Figure 14 The coupling sensor 1424 can detect when the electronic device is physically or electronically coupled to the eyewear device 1202. In some embodiments, the eyewear device 1202 may be configured to connect to the housing 1490. Figure 14 This may include one or more additional coupling mechanisms for coupling with additional accessory devices. Figure 12 The components shown can be implemented in hardware, software, firmware, or a combination thereof, including one or more signal processing components and / or application-specific integrated circuits (ASICs).

[0163] The eyewear device 1202 includes a mechanical eyewear assembly, including a frame 1204 configured to hold one or more lenses (e.g., one or two lenses 1206-1 and 1206-2). Those skilled in the art will understand that the eyewear device 1202 can include additional mechanical components, such as hinges configured to allow partial folding and unfolding of the frame 1204 of the eyewear device 1202, a bridge configured to span the gap between lenses 1206-1 and 1206-2 and rest on the user's nose, a nose pad configured to rest on the bridge of the nose and provide support for the eyewear device 1202, headphones configured to rest on the user's ears and provide additional support for the eyewear device 1202, and leg arms configured to extend from the hinges to the headphones, etc. Those skilled in the art will further recognize that some examples of the AR system 1200 are capable of excluding any of the mechanical components described herein. For example, a smart contact lens configured to present an artificial reality to a user may not include any components of the eyewear device 1202.

[0164] The eyeglasses device 1202 includes electronic components, many of which will be described in more detail below. Figure 12 Exemplary electronic components are shown. These include acoustic sensors 1225-1, 1225-2, 1225-3, 1225-4, 1225-5, and 1225-6, which may be distributed over a large area of ​​the frame 1204 of the eyeglasses device 1202. The eyeglasses device 1202 also includes a left camera 1239A and a right camera 1239B located on different sides of the frame 1204. The eyeglasses device 1202 also includes a processor 1248 (or any other suitable type or form of integrated circuit) embedded in a portion of the frame 1204.

[0165] Figure 13A and Figure 13B A VR system 1300 according to some embodiments is illustrated, the VR system including a head-mounted display (HMD) 1312 (e.g., also referred to herein as an artificial reality head-mounted receiver, head-mounted device, VR head-mounted receiver, etc.). As described, some artificial reality systems (e.g., AR system 1200) can substantially replace a user's visual and / or other sensory perceptions of the real world with virtual experiences (e.g., AR systems 800 and 900), rather than blending artificial reality with actual reality.

[0166] The HMD 1312 includes a front body 1314 and a frame 1316 (e.g., a strap or band) shaped to fit around a user's head. In some embodiments, the front body 1314 and / or frame 1316 include one or more electronic components for facilitating the presentation and / or interaction with AR and / or VR systems (e.g., displays, IMUs, tracking transmitters, or detectors). In some embodiments, such as Figure 13B As shown, HMD 1312 includes an output audio transducer (e.g., audio transducer 1318). In some embodiments, one or more components (such as output audio transducer 1318 and frame 1316) can be configured to attach and detach (e.g., detachably attach) to HMD 1312 (e.g., part or all of frame 1316, and / or audio transducer 1318), as... Figure 13B As shown. In some embodiments, coupling the detachable component to the HMD 1312 enables the detachable component to initiate electronic communication with the HMD 1312.

[0167] Figure 13A and Figure 13B The VR system 1300 is also shown to include one or more cameras (such as left camera 1339A and right camera 1339B) that are capable of mimicking the left camera 1239A and right camera 1239B on the frame 1204 of the eyewear device 1202. In some embodiments, the VR system 1300 includes one or more additional cameras (e.g., cameras 1339C and 1339D) that can be configured to augment the image data acquired by the left camera 1339A and right camera 1339B by providing more information. For example, camera 1339C can be used to supply color information that cameras 1339A and 1339B cannot recognize. In some embodiments, one or more of cameras 1339A to 1339D can include optional IR-cutting filters configured to remove IR light received at the respective camera sensors.

[0168] Figure 14A computing system 1420 and an optional housing 1490 are shown, each illustrating components that can be included in the AR system 1200 and / or the VR system 1300. In some embodiments, depending on the actual constraints of the respective AR systems described, more or fewer components can be included in the optional housing 1490.

[0169] In some embodiments, computing system 1420 may include one or more peripheral device interfaces 1422A, and / or optional housing 1490 may include one or more peripheral device interfaces 1422B. Each of computing system 1420 and optional housing 1490 may also include one or more power systems 1442A and 1442B, one or more controllers 1446 (including one or more haptic controllers 1447), one or more processors 1448A and 1448B (as described above, including any examples provided), and memories 1450A and 1450B, all of which are capable of electronic communication with each other. For example, one or more processors 1448A and 1448B may be configured to execute instructions stored in memories 1450A and 1450B, which may cause one or more of the controllers 1446 to cause operations to be performed on one or more peripheral devices connected to peripheral interfaces 1422A and / or 1422B. In some embodiments, each described operation may be powered by power supplied by power systems 1442A and / or 1442B.

[0170] In some implementations, the peripheral device interface 22A is capable of including one or more devices configured as part of the computing system 20, some of which have been defined above and / or regarding Figure 10 and Figure 11 The wrist-worn wearable device shown is described. For example, the peripheral device interface 1422A can include one or more sensors 1423A. Some exemplary sensors 1423A include one or more coupled sensors 1424, one or more acoustic sensors 1425, one or more imaging sensors 1426, one or more EMG sensors 1427, one or more capacitive sensors 1428, one or more IMU sensors 1429, and / or any other type of sensor explained above or described with respect to any other embodiment discussed herein.

[0171] In some embodiments, peripheral interfaces 1422A and 1422B may include one or more additional peripheral devices, including one or more NFC devices 1430, one or more GPS devices 1431, one or more LTE devices 1432, one or more Wi-Fi and / or Bluetooth devices 1433, one or more buttons 1434 (e.g., including slide-on or other adjustable buttons), one or more displays 1435A and 1435B, one or more speakers 1436A and 1436B, one or more microphones 1437, one or more cameras 1438A and 1438B (e.g., including left camera 1439A and / or right camera 1439B), one or more haptic devices 1440, and / or any other type of peripheral device as defined above or described for any other embodiments discussed herein.

[0172] AR systems can include various types of visual feedback mechanisms (e.g., demonstration devices). For example, the display devices in AR system 1200 and / or VR system 1300 can include one or more liquid-crystal displays (LCDs), light-emitting diode (LED) displays, organic LED (OLED) displays, and / or any other suitable type of display. Artificial reality systems can include a single display (e.g., configured to be seen by both eyes) and / or can provide a separate display for each eye, allowing for additional flexibility for zoom adjustment and / or for correcting refractive errors associated with the user's vision. Some implementations of AR systems also include an optical subsystem with one or more lenses (e.g., conventional concave or convex lenses, Fresnel lenses, or adjustable liquid lenses) through which the user can view the display.

[0173] For example, corresponding displays 1435A and 1435B can be coupled to each of lenses 1206-1 and 1206-2 of the AR system 1200. Displays 1435A and 1435B can be coupled to each of lenses 1206-1 and 1206-2, which can act together or independently to present one or more images to a user. In some embodiments, the AR system 1200 includes a single display 1435A or 1435B (e.g., a near-eye display) or more than two displays 1435A and 1435B. In some embodiments, a first set of one or more displays 1435A and 1435B can be used to present an augmented reality environment, and a second set of one or more display devices 1435A and 1435B can be used to present a virtual reality environment. In some embodiments, one or more waveguides (e.g., as a means of delivering light from one or more displays 1435A and 1435B to the user's eyes) are used in conjunction with presenting artificial reality content to a user of the AR system 1200. In some embodiments, one or more waveguides are wholly or partially integrated into the eyewear device 1202. Additionally, or as an alternative to a display screen, some artificial reality systems include one or more projection systems. For example, the display device in AR system 1200 and / or VR system 1300 can include (e.g., using waveguides) a miniature LED projector (such as a transparent combiner lens that allows ambient light to pass through) that projects light into the display device. The display device is able to refract the projected light into the user's pupil and enable the user to simultaneously view both artificial reality content and the real world. Artificial reality systems can also be configured with any other suitable type or form of image projection system. In some embodiments, one or more waveguides are additionally or alternatively provided to one or more displays 1435A and 1435B.

[0174] The optional housing 1390 of the computing system 1420 and / or AR system 1400 or VR system 1200 may include some or all of the components of the power systems 1442A and 1442B. The power systems 1442A and 1442B may include one or more charger inputs 1443, one or more PMICs 1444 and / or one or more batteries 1445A and 1444B.

[0175] Memory 1450A and 1450B may include instructions and data, some or all of which may be stored within memory 1450A and 1450B as a non-transitory computer-readable storage medium. For example, memory 1450A and 1450B are capable of including one or more operating systems 1451, one or more application programs 1452, one or more communication interface applications 1453A and 1453B, one or more graphics applications 1454A and 1454B, one or more AR processing applications 1455A and 1455B, and / or any other type of data defined above or described with respect to any other embodiment discussed herein.

[0176] Memory 1450A and 1450B also include data 1460A and 1460B, which can be used in conjunction with one or more of the aforementioned applications. Data 1460A and 1460B can include profile data 1461, sensor data 1462A and 1462B, media content data 1463A, AR application data 1464A and 1464B, and / or any other type of data defined above or described with respect to any other embodiment discussed herein.

[0177] In some implementations, the controller 1446 of the glasses device 1202 can process information generated by sensors 1423A and / or 1423B on the glasses device 1202 and / or another electronic device within the AR system 1200. For example, the controller 1446 can process information from sound sensors 1225-1 and 1225-2. For each detected sound, the controller 1446 can perform direction of arrival (DOA) estimation to estimate the direction in which the detected sound arrives at the glasses device 1202 of the AR system 1200. When one or more sound sensors 1425 (e.g., sound sensors 1225-1, 1225-2) detect sound, the controller 1446 can populate the audio dataset with information (e.g., sensor data 1462A and 1462B).

[0178] In some embodiments, the physical electronic connector enables the transmission of information between the eyewear device 1202 and another electronic device and / or between the AR system 1200 or VR system 1300 and one or more processors 1248, 1448A, 1448B of the controller 1446. The information can be in the form of optical data, electrical data, wireless data, or any other transmissible data format. Moving the processing of information generated by the eyewear device 1202 to an intermediate processing device reduces weight and heat in the eyewear device, making it more comfortable and safer for the user. In some embodiments, an optional wearable accessory device (e.g., an electronic tie) is coupled to the eyewear device 1202 via one or more connectors. The connectors can be wired or wireless and can include electrical and / or non-electrical (e.g., structural) components. In some cases, the eyewear device 1202 and the wearable accessory device can operate independently without any wired or wireless connection between them.

[0179] In some cases, external devices such as intermediate processing devices (e.g., HIPD 606, 706, 806) are paired with glasses device 1202 (e.g., as part of AR system 1200) so that glasses device 1202 still achieves a similar size specification to glasses while providing sufficient battery and computing power for extended capabilities. Some or all of the battery power, computing resources, and / or additional features of AR system 1200 can be provided by the paired device or shared between the paired device and glasses device 1202, thereby reducing the overall weight, heat distribution, and size specification of glasses device 1202 while allowing glasses device 1202 to maintain its required functionality. For example, wearable accessory devices can allow components originally included on glasses device 1202 to be included in the wearable accessory device and / or intermediate processing device, thereby transferring the weight load from the user's head and neck to one or more other parts of the user's body. In some embodiments, the intermediate processing device has a large surface area on which heat diffuses and dissipates to the surrounding environment. Therefore, the intermediate processing device can allow for greater battery and computing power compared to glasses device 1202 alone. Because the weight carried in the wearable accessory device is less invasive to the user than the weight carried in the glasses device 1202, the user can tolerate wearing the lighter glasses device and carry or wear the paired device for a longer time than wearing the heavier glasses device alone, thus allowing the artificial reality environment to be more fully integrated into the user's daily activities.

[0180] AR systems can include various types of computer vision components and subsystems. For example, AR system 1200 and / or VR system 1300 can include one or more optical sensors (such as two-dimensional (2D) or three-dimensional (3D) cameras, time-of-flight depth sensors, structured light emitters and detectors, single-beam or scanning laser rangefinders, 3D LiDAR sensors, and / or any other suitable type or form of optical sensor). AR systems can process data from one or more of these sensors to identify the user's location and / or aspects of the user's real-world physical environment, including the locations of real-world objects within the real-world physical environment. In some embodiments, among various other functions, the methods described herein are used to map the real world, provide the user with context about the real-world environment, and / or generate digital twins (e.g., interactive virtual objects). For example, Figure 13A and Figure 13B A VR system 1300 with cameras 1339A to 1339D is shown. These cameras are capable of providing depth information for creating voxel fields and two-dimensional meshes to provide object information to the user to avoid collisions.

[0181] In some implementations, AR system 1200 and / or VR system 1300 can include a haptic feedback system that can be integrated into headwear, gloves, bodysuits, handheld controllers, environmental devices (e.g., chairs or mats), and / or any other type of device or system (such as wearable devices discussed herein). The haptic feedback system can provide various types of skin feedback, including vibration, force, traction, texture, and / or temperature. It can also provide various types of kinematic feedback, such as motion and compliance. Haptic feedback can be implemented using motors, piezoelectric actuators, fluid systems, and / or various other types of feedback mechanisms. The haptic feedback system can be implemented independently of other artificial reality devices, within other artificial reality devices, and / or in conjunction with other artificial reality devices.

[0182] In some embodiments of artificial reality systems such as AR system 1200 and / or VR system 1300, ambient light (e.g., a live feed of the surrounding environment that a user would typically see) is able to pass through the display element of the corresponding head-mounted wearable device that presents an aspect of the AR system. In some embodiments, ambient light is able to pass through a portion of the AR environment presented within the user's field of vision (e.g., a portion of the AR environment located within a designated boundary (e.g., a guard boundary) along with physical objects in the user's real-world environment, which is configured to be used by the user in the event of interaction with the AR environment). For example, visual user interface elements (e.g., notification user interface elements) are able to be presented on the head-mounted wearable device, and a certain amount of ambient light (e.g., 15%-50% of the ambient light) is able to pass through the user interface elements, enabling the user to distinguish at least a portion of the physical environment on which the user interface elements are displayed.

[0183] The process parameters and sequence of steps described and / or illustrated herein are given by way of example only and may be changed as needed. For example, while the steps illustrated and / or described herein may be illustrated or discussed in a specific order, these steps do not necessarily need to be performed in the order illustrated or discussed. The various exemplary methods described and / or illustrated herein may also omit one or more steps in the steps described or illustrated herein, or include additional steps in addition to the disclosed steps.

[0184] The foregoing description has been provided to enable others skilled in the art to best utilize the various aspects of the exemplary embodiments disclosed herein. This exemplary description is not intended to be exhaustive or limited to any precise form disclosed. Many modifications and variations are possible without departing from the spirit and scope of this disclosure. The embodiments disclosed herein should be considered illustrative rather than restrictive in all respects. Reference should be made to the appended claims and their equivalents in determining the scope of this disclosure.

[0185] Unless otherwise stated, the terms “connected to” and “coupled to” (and their derivatives) as used in the specification and claims shall be interpreted as allowing direct and indirect (i.e., via other elements or components) connections. Furthermore, the terms “a” or “an” as used in the specification and claims shall be interpreted as meaning “at least one”. Finally, for ease of use, the terms “comprising” and “having” (and their derivatives) as used in the specification and claims may be used interchangeably with the word “including” and have the same meaning.

[0186] It should be understood that when an element such as a layer or region is referred to as forming, depositing, or being disposed “on” or “above” another element, it may be located directly on at least a portion of the other element, or one or more intermediate elements may also be present. Conversely, when an element is referred to as being “directly on” or “directly above” another element, it may be located on at least a portion of the other element, and no intermediate elements are present.

[0187] As used herein, in some embodiments, the term "approximately" regarding a particular numerical value or range of values ​​may mean and include the numerical value as well as all values ​​within 10% of the numerical value. Thus, as an example, in some embodiments, referring to the numerical value "50" as "about 50" may include values ​​equal to 50 ± 5, i.e., values ​​in the range of 45 to 55.

[0188] As used herein, the term “substantially” in reference to a given parameter, property, or condition may mean and include, to a degree that a person skilled in the art would understand, conforms to a small degree of variation, such as, within acceptable manufacturing tolerances. As an example, depending on the specific parameter, property, or condition that substantially conforms, it may conform to at least approximately 90%, at least approximately 95%, or even at least approximately 99%.

[0189] While the transitional phrase “comprising” may be used to disclose multiple features, elements, or steps of a particular embodiment, it should be understood that alternative embodiments, including those that may be described using the transitional phrases “consisting of” or “substantially composed of”, are implicit. Thus, for example, implicit alternative embodiments comprising or including an anthracene-based organic solid crystal layer include embodiments where the organic solid crystal layer is substantially composed of anthracene and embodiments where the organic solid crystal layer is composed of anthracene.

Claims

1. An optical component, comprising: A substrate having a pattern of recessed features formed therein; as well as An optically anisotropic organic solid crystal material, wherein the optically anisotropic organic solid crystal material fills the recessed feature and forms a plurality of embedded grating elements.

2. The optical component of claim 1, wherein the organic solid crystal material filling each of the recessed features is configured as a single crystal.

3. The optical component according to claim 1 or 2, wherein the organic solid crystal material has the following principal refractive indices: n1>1.8, n2>1.8 and n3>1.

8.

4. The optical component according to any one of the preceding claims, wherein, Each of the plurality of embedded grating elements includes substantially vertical sidewalls; or Each of the plurality of embedded grating elements includes a sloping sidewall.

5. The optical component according to any one of the preceding claims, wherein, The plurality of embedded grating elements are configured as a one-dimensional array; or, the plurality of embedded grating elements are configured as a two-dimensional array.

6. The optical component according to any one of the preceding claims, wherein the plurality of embedded grating elements are configured to non-uniformly couple optical power into the associated diffraction orders.

7. The optical component according to any one of the preceding claims further includes a protective layer disposed above the top surface of the embedded grating element.

8. An optical component, comprising: substrate; as well as A plurality of raised grating elements are disposed above the surface of the substrate, wherein the grating elements comprise an optically anisotropic organic solid crystal material.

9. The optical component of claim 8, wherein the organic solid crystal material forming each of the grating elements is configured as a single crystal.

10. The optical component according to claim 8 or 9, wherein the organic solid crystal material has the following principal refractive indices: n1>1.8, n2>1.8 and n3>1.

8.

11. The optical component according to any one of claims 8 to 10, wherein, Each of the plurality of raised grating elements includes substantially vertical sidewalls; or Each of the plurality of raised grating elements includes an inclined sidewall.

12. The optical component according to any one of claims 8 to 11, wherein the plurality of raised grating elements are configured in a one-dimensional array; or in, The plurality of raised grating elements are configured into a two-dimensional array.

13. The optical component according to any one of claims 8 to 12, wherein the plurality of raised grating elements are configured to non-uniformly couple optical power into the associated diffraction orders.

14. The optical component according to any one of claims 8 to 13 further includes a protective layer disposed above the top surface of the raised grating element.

15. A surface-embossed grating, comprising: An array of grating elements, each of which comprises an optically anisotropic organic solid crystal material.

Images