Non-rectangular shaped battery for augmented reality devices and systems and methods of use thereof

Abstract

Non-rectangular shaped batteries for augmented reality devices and systems and methods of use thereof are provided. An exemplary augmented reality head-mounted device includes a frame portion, temple arm portions coupled with the frame portion, and a metal encapsulated battery cell having an outer surface defining a non-rectangular shape. The metal encapsulated battery cell is configured to be housed within the temple arm portion, and the non-rectangular shape of the outer surface follows an inner shape of the inner surface of the temple arm portion. The augmented reality head-mounted device also includes one or more artificial reality processing or rendering devices, where at least one artificial reality processing or rendering device of the one or more artificial reality processing or rendering devices is configured to receive power from the metal encapsulated battery unit.

Description

[0001] CROSS-REFERENCE TO RELATED APPLICATIONS

[0002] This application claims priority to U.S. Provisional Patent Application No. 63 / 520,916 filed on August 21, 2023, U.S. Provisional Patent Application No. 63 / 553,093 filed on February 13, 2024, and U.S. Non-Provisional Patent Application No. 18 / 677,757 filed on May 29, 2024, the entire contents of which are incorporated herein by reference. Technical Field

[0003] The present application generally relates to batteries (e.g., metal-packaged batteries) configured to be placed within an artificial reality (AR) headset (e.g., an augmented reality (AR) headset), and the metal-packaged batteries can be further configured to have a non-rectangular shape to conform to the internal shape of the artificial reality headset (e.g., a cavity in a temple arm or frame portion of the augmented reality headset). Background Art

[0004] Artificial reality head-mounted devices, especially augmented reality head-mounted devices, are shaped like traditional glasses, which makes the space for their internal components extremely limited. This space limitation makes it difficult for augmented reality head-mounted devices to have the space required to install battery cells that power the augmented reality head-mounted devices for a long time. Traditional augmented reality head-mounted devices attempt to solve this problem by making the augmented reality head-mounted devices much larger than traditional glasses to accommodate the batteries. These traditional batteries tend to be off-the-shelf components and also tend to have a rectangular profile, which determines the shape of the augmented reality head-mounted device (e.g., making the arms thick and square in nature, or making the lens holding portion very thick).

[0005] Therefore, there is a need to address one or more of the above challenges. A brief summary of solutions to the above problems is described below. Summary of the invention

[0006] The non-rectangular battery cells described herein address the above-described issues by allowing the battery cells to have a shape that conforms to the inner surface of the temple arms or the inner surface of the frame of the augmented reality head-mounted device. By being able to conform the battery to the inner shape of the frame or temple arms, the frame and temples can be designed to have a more traditional shape that mimics the size and shape of traditional sunglasses and / or corrective glasses. In addition, batteries having a non-rectangular shape also allow for an increase in the amount of battery storage located within the augmented device, which increases the period of use before requiring recharging.

[0007] According to some embodiments, an augmented reality head-mounted device includes a frame portion and a temple arm portion coupled to the frame portion. In some embodiments, the augmented reality head-mounted device includes an intermediate component of the augmented reality head-mounted device, which is used to hingeably couple the frame portion with the temple arm portion, so that the augmented reality head-mounted device is a three-piece structure including the frame portion, the temple arm portion and the intermediate component. The augmented reality head-mounted device also includes a metal-encapsulated battery cell having an outer surface defining a non-rectangular shape (for example, the metal package may include a steel, aluminum, alloy, magnesium package having an outer shape formed into a shape such as a trapezoidal shape, and the trapezoidal shape may also have a non-uniform thickness along its longest and / or shortest dimension). In some embodiments, the metal-encapsulated battery cell is configured to be housed in the temple arm portion, and the non-rectangular shape of the outer surface follows the internal shape of the inner surface of the temple arm portion. The augmented reality head-mounted device also includes one or more artificial reality processing or presentation devices, wherein at least one of the one or more artificial reality processing or presentation devices is configured to receive power from the metal-encapsulated battery cell. Examples of augmented reality presentation devices include micro-projectors that can be used to project images onto a waveguide structure of an augmented reality head-mounted device, speakers for transmitting audio to a user of the augmented reality head-mounted device, and / or other types of presentation devices configured to transmit audio, visual, and / or tactile effects associated with the augmented reality experience to the user of the augmented reality head-mounted device.

[0008] According to some embodiments, an artificial reality head mounted device includes a first portion (e.g., an AR head mounted device frame (e.g., Fig.11 The artificial reality head mounted device also includes a battery located within the second portion, the battery being configured to follow the first curvature along the first axis and to follow the second curvature along the second axis, such that the battery has a shape that is curved along both the first axis and the second axis (e.g., the battery has a shape that matches the space in the second arm so that the largest possible battery can be included in the second portion, thereby increasing operating time). For example, Fig.10 A battery cell is shown that follows a curvature along both the x-axis and the y-axis. The battery is bent along both the first axis and the second axis in a rest position (i.e., the battery is not temporarily bent, the battery remains in this position without bending forces applied to the battery). In some embodiments, the rest position means that the battery maintains its shape even when not placed in the void (e.g., the battery has a predefined bending state before being placed in the void, such as Fig. 9The battery is also configured to fill a void in the second portion (e.g., a portion of the second portion allocated for storing the battery). In some embodiments, the void is further defined by an electronic device located in the second portion (e.g., Fig.10 The battery is shown filling the first void. The battery is also configured to provide power to one or more artificial reality processing or presentation devices of the artificial reality head mounted device, wherein at least one of the one or more artificial reality processing or presentation devices (e.g., one or more processors, one or more projectors, one or more communication components, one or more cameras (e.g., image / video acquisition, environmental scanning), one or more microphones, etc.) is located in the void. For example, Fig.10 One or more artificial reality processing or presentation devices are shown positioned within the temple arm and may partially define a first void.

[0009] The features and advantages described in the specification are not necessarily all-inclusive, and in particular, certain additional features and advantages are obvious to those of ordinary skill in the art in view of the drawings, the specification and the claims. In addition, it should be noted that the language used in the specification is mainly selected for readability and instructional purposes.

[0010] Having summarized the above exemplary aspects, a brief description of the drawings will now be given. BRIEF DESCRIPTION OF THE DRAWINGS

[0011] For a better understanding of the various embodiments described, reference should be made to the following detailed description taken in conjunction with the accompanying drawings, in which like reference numerals refer to corresponding parts throughout the several views.

[0012] Figure 1 A metal packaged battery having a non-rectangular shape configured to be placed within an augmented reality head mounted device is shown in accordance with some embodiments.

[0013] Figure 2 The construction of a metal packaged battery having a non-rectangular shape is shown in accordance with some embodiments.

[0014] Figure 3A A metal packaged battery 300 is shown having a non-rectangular shape configured to be placed within a temple arm of an augmented reality head mounted device in accordance with some embodiments.

[0015] Figure 3B A metal packaged battery cell 308 is shown having a non-rectangular shape with at least one hemispherical surface configured to be placed within a temple arm of an augmented reality head mounted device in accordance with some embodiments.

[0016] Figure 4A to Figure 4D-2An exemplary artificial reality system is shown in accordance with some embodiments.

[0017] FIG. 5A to FIG. 5B An exemplary wrist wearable device is shown in accordance with some embodiments.

[0018] FIG. 6A to FIG. 6C An exemplary head wearable device is shown in accordance with some embodiments.

[0019] FIG. 7A to FIG. 7B An exemplary handheld intermediate processing device is shown in accordance with some embodiments.

[0020] FIG. 8A to FIG. 8C An exemplary smart textile-based garment is shown in accordance with some embodiments.

[0021] Fig. 9 A battery cell configured to bend along at least two axes is shown in accordance with some embodiments.

[0022] Fig.10 Three different views of a temple arm including a doubly-curved battery cell having an irregular shape are shown, according to some embodiments.

[0023] Fig.11 Three different views of an eyeglass frame including a battery cell that is bent along three axes to fit within a nose bridge of the eyeglass frame, according to some embodiments.

[0024] Fig.12 A battery construction is shown according to some embodiments that is configured to reduce the overall weight of the battery compared to traditional lithium-ion batteries (which rely on aluminum and copper foil in their construction).

[0025] Fig.13 According to some embodiments, the use of reference Fig.12 An exemplary curved battery cell with a lightweight current collector is described.

[0026] Fig.14 Lightweight hard case batteries without cell terraces and / or side folds to reduce weight and volumetric efficiency while providing balanced gravimetric energy density are shown according to some embodiments.

[0027] Fig.15 Several options for assembling battery cells without a cell platform and / or side folds are shown according to some embodiments.

[0028] Fig.16Alternative shapes that battery cells may have and the placement of terminals on battery cells of these alternative shapes are shown according to some embodiments.

[0029] Fig.17 An exemplary cross section of a battery having a hard case is shown according to some embodiments.

[0030] Fig.18A and Fig.18B A comparison is shown between a battery having a curved shape to accommodate one or more electronic components in a temple arm and a non-curved battery that does not accommodate one or more electronic components in the temple arm, according to some embodiments.

[0031] As a matter of practice, the various features shown in the drawings may not be drawn to scale. Therefore, for the sake of clarity, the sizes of the various features may be arbitrarily expanded or reduced. In addition, some of the drawings may not depict all of the components of a given system, method, or device. Finally, throughout the specification and drawings, the same reference numerals may be used to represent the same features. DETAILED DESCRIPTION

[0032] Numerous details are described herein to provide a thorough understanding of the exemplary embodiments shown in the accompanying drawings. However, some embodiments may be practiced without many of these specific details, and the scope of the claims is limited to only those features and aspects specifically recited in the claims. In addition, well-known processes, components, and materials are not necessarily described in detail to avoid obscuring the relevant aspects of the embodiments described herein.

[0033] Embodiments of the present disclosure may include various types of artificial reality systems or various embodiments of artificial reality systems, or may be implemented in combination with various types of artificial reality systems or various embodiments of artificial reality systems. As described herein, artificial reality (AR) is any superimposed functionality and / or sensory detectable presentation provided by an artificial reality system within a user's physical environment. Such artificial reality may include and / or represent virtual reality (VR), augmented reality, mixed artificial reality (MAR), or some combination and / or variation thereof. For example, a user may perform an air swipe gesture to skip a song by providing an application programming interface (API) for a song played at a home speaker, for example. The AR environment described herein includes, but is not limited to: a VR environment (including a non-immersive VR environment, a semi-immersive VR environment, and a fully immersive VR environment); an augmented reality environment (including a marker-based augmented reality environment, a markerless augmented reality environment, a location-based augmented reality environment, and a projection-based augmented reality environment); mixed reality; and other types of mixed reality environments.

[0034] Artificial reality content may include entirely generated content or generated content combined with captured (e.g., real-world) content. Artificial reality content may include video, audio, haptic events, or some combination thereof, any of which may be presented in a single channel or in multiple channels (e.g., stereoscopic video that produces a three-dimensional effect to the viewer). In addition, in some embodiments, artificial reality may also be associated with applications, products, accessories, services, or some combination thereof, which are used, for example, to create content in the artificial reality and / or otherwise be used in the artificial reality (e.g., to perform activities in the artificial reality).

[0035] As described herein, gestures may include air gestures, surface contact gestures, and / or other gestures that can be detected and determined based on the movement of a single hand (e.g., a single-handed gesture performed by a user's hand detected by one or more sensors of a wearable device (e.g., electromyography (EMG) and / or an inertial measurement unit (IMU) of a wrist wearable device) and / or detected via image data collected by an imaging device of the wearable device (e.g., a camera of a head wearable device)) and other gestures that can be detected and determined based on the combined movement of the user's hands. In some embodiments, air means that the user's hand does not contact a surface, object, or part of an electronic device (e.g., a head wearable device or other communicatively coupled device, such as a wrist wearable device). In other words, the gesture is performed in 3D space in an open space and does not contact a surface, object, or electronic device. More generally, surface contact gestures (contact at a surface, object, user body part, or electronic device) are also contemplated, in which contact (or intent to contact) is detected at a surface (e.g., a single or two-finger tap on a table, on a user's hand or another finger, on a user's lap, on a sofa, on a steering wheel, etc.). The different gestures disclosed herein can be detected using image data and / or sensor data (e.g., neuromuscular signals sensed by one or more biopotential sensors (e.g., EMG sensors) or other types of data from other sensors (such as proximity sensors, time-of-flight (ToF) sensors, sensors of inertial measurement units, etc.)) detected by a wearable device worn by a user and / or other electronic devices owned by the user (e.g., a smartphone, a laptop, an imaging device, an intermediate device, and / or other devices described herein).

[0036] The above artificial reality experience described above has been further improved by improving the battery capacity of the artificial reality headset. This article describes the details of these improved batteries.

[0037] Figure 1 A metal packaged battery having a non-rectangular shape configured to be placed within an augmented reality head mounted device is shown in accordance with some embodiments. Figure 1 An augmented reality head mounted device 100 is shown, which includes a frame portion 102, a first temple arm portion 104, and a second temple arm portion 106, each of which is hingedly coupled to the frame portion 102. In some embodiments, the frame portion 102 is coupled to the first temple arm portion 104 and the second temple arm portion 106 by an intermediate member (not shown).

[0038] The first temple arm portion 104 is shown as including a first metal-encapsulated battery cell 108 and a second metal-encapsulated battery cell 110 (e.g., a battery having a lithium-ion-based chemistry). The first temple arm portion 104 is further shown in a cross-sectional view 112, which also shows the first metal-encapsulated battery cell 108, the first metal-encapsulated battery cell 108 having an outer surface 114 defining a non-rectangular shape (e.g., a trapezoid), and the non-rectangular shape of the outer surface follows the inner shape of the inner surface 118 of the first temple arm portion 104. The first temple arm portion 104 also includes an artificial reality processing or presentation device 120 (e.g., an inertial measurement unit, a speaker, a microphone, a circuit board, an eye tracking camera, an externally facing camera, a privacy switch for turning the externally facing camera on or off, a Simultaneous Localisation And Mapping (SLAM) camera, etc.). In some embodiments, the artificial reality processing or presentation device 120 is configured to receive power from one or both of the first metal-encapsulated battery cell 108 and the second metal-encapsulated battery cell 110. In some embodiments, the artificial reality processing or presentation device 120 partially indicates the outer surface 114 of the first metal-packaged battery cell 108. In some embodiments, the first metal-packaged battery cell 108 is chamfered and / or curved (e.g., as shown along edge 122) to accommodate the artificial reality processing or presentation device 120 (e.g., microphone, speaker, etc.). In some embodiments, the second metal-packaged battery cell 110 has another non-rectangular shape, which is different from the non-rectangular shape described above with reference to the first metal-packaged battery cell 108, and the outer surface of the other non-rectangular shape follows another internal shape of another inner surface 124 (e.g., the portion of the temple arm that goes around behind the wearer's ear). In some embodiments, the placement of the first metal-packaged battery cell 108 and the second metal-packaged battery cell 110 is configured to balance the one or more artificial reality processing or presentation devices located in the frame portion 102, thereby improving the wearing experience.

[0039] In some embodiments, the second temple arm portion 106 includes metal-encapsulated battery cells and one or more artificial reality processing or presentation devices that are similar or identical to the metal-encapsulated battery cells and one or more artificial reality processing or presentation devices of the first temple arm portion. In some embodiments, the battery cells (e.g., third metal-encapsulated battery cells 109 and fourth metal-encapsulated battery cells 111) have different outer surfaces (e.g., non-rectangular, chamfered, curved, etc.) to accommodate the different internal shapes of the second temple arm portion 106 and / or one or more different artificial reality processing or presentation devices 113.

[0040] Figure 1Also shown in the exploded view 125 is the frame portion 102 including a first translucent lens 126 and a second translucent lens 128, wherein augmented reality can be projected onto the first translucent lens 126 and the second translucent lens 128 via one or more artificial reality processing or rendering devices 136 located within the frame portion 102. In some embodiments, the frame portion 102 can include another metal encapsulated battery cell 130 having another outer surface 132 defining a non-rectangular shape. The non-rectangular shape can be configured to fit within the nose bridge portion 134 of the frame portion and accommodate the first translucent lens 126 and the second translucent lens 128 and / or the one or more artificial reality processing or rendering devices 136.

[0041] Figure 2 The construction of a metal packaged battery having a non-rectangular shape is shown in accordance with some embodiments. Figure 2 An assembled metal package battery 200 having a non-rectangular shape is shown, and an exploded view 202 of the metal package battery 200 is also shown. As shown in the exploded view 202, the metal package battery 200 includes at least a top portion 204, which is extruded so that it has a void 206 and all faces except one open face are covered (e.g., the bottom face is open). The electrode stack 208 conforms to the shape of the void. In some embodiments, the electrodes that make up the electrode stack 208 are die-cut to match the void (i.e., to maximize the size of the electrode that can be placed in the void (e.g., allowing a 10% to 30% increase in energy density compared to a rolled battery cell in the same void). Figure 2 Also shown is the open face of top portion 204 being sealed by bottom portion 210 (e.g., a panel) which is laser welded (represented by laser weld seam 212) to top portion 204. The number of electrodes in the electrode stack is for illustrative purposes, although any number of electrodes that can fit in void 206 may be used.

[0042] Compared to metal packaged batteries that require flanges for laser welding, the top portion 204 and the bottom portion 210 do not have flanges when sealed, which reduces the footprint of the metal packaged battery 200. In some embodiments, the metal packaged battery has a wall thickness of 100 microns to 300 microns to allow the laser welding process to occur without the need for flanges for laser welding. In contrast, thinner walls do not have enough material for laser welding and require a flange, which increases the footprint of the battery cell. The volume increased by thicker walls exceeds the volume increased by thinner walls and flanges because the footprint is more important in small form factor devices (e.g., augmented reality head-mounted devices). Therefore, in the present application, having thicker walls and no flanges may increase the overall cell size by up to 20% compared to thinner walls and flanges. In some embodiments, the metal packaged battery includes different wall thicknesses so that the portion required for welding is thicker than other portions of the metal packaged battery.

[0043] Figure 2 Also shown is a mounting feature 214 (eg, a hook, a tab, a spring (eg, a leaf spring), a screw, etc.) configured to aid in mounting the metal encapsulated battery 200 to the temple arm.

[0044] Figure 3A A metal packaged battery 300 is shown having a non-rectangular shape configured to be placed within a temple arm of an augmented reality head mounted device in accordance with some embodiments. Figure 3A Three different views of a non-rectangular metal packaged battery cell are shown. A first view 302 shows a side view showing that the non-rectangular metal packaged battery cell 300 has a trapezoidal shape and is configured to be mounted within a temple arm. A second view 304 shows that the non-rectangular metal packaged battery cell 300 also has a thickness that tapers along its major axis, which increases the volume within the temple arm that the non-rectangular metal packaged battery cell 300 can occupy. In some embodiments, the tapering is achieved by changing the die cut (i.e., changing the size) of the electrodes when they are stacked. A third view 306 (i.e., a cross-sectional view) shows that, in some embodiments, the tapering can occur along multiple axes.

[0045] Figure 3B A metal packaged battery cell 308 is shown having a non-rectangular shape with at least one hemispherical surface configured to be placed within a temple arm of an augmented reality head mounted device in accordance with some embodiments. Figure 3BThree different views of the non-rectangular metal packaged battery cell 308 are shown. The first view 310 shows a side view showing the hemispherical surface 312 of the non-rectangular metal packaged battery cell 308. The second view 314 also shows that the hemispherical surface 312 of the non-rectangular metal packaged battery cell 308 also has a thickness that tapers along its major axis, which increases the volume within the temple arm that the non-rectangular metal packaged battery cell 308 can occupy. In some embodiments, the tapering is achieved by changing the die cut (i.e., changing the size) of the electrodes as they are stacked. The third view 316 (i.e., a cross-sectional view) further shows the hemispherical surface 312.

[0046] (A1) According to some embodiments, an augmented reality head-mounted device includes a frame portion and a temple arm portion coupled to the frame portion. In some embodiments, the augmented reality head-mounted device includes an intermediate component of the augmented reality head-mounted device, which is used to hingeably couple the frame portion with the temple arm portion, so that the augmented reality head-mounted device is a three-piece structure including the frame portion, the temple arm portion and the intermediate component. The augmented reality head-mounted device also includes a metal-encapsulated battery cell having an outer surface defining a non-rectangular shape (for example, the metal package may include a steel, aluminum, alloy, magnesium package having an outer shape formed into a shape such as a trapezoidal shape, and the trapezoidal shape may also have a non-uniform thickness along its longest and / or shortest dimension). In some embodiments, the metal-encapsulated battery cell is configured to be housed in the temple arm portion, and the non-rectangular shape of the outer surface follows the inner shape of the inner surface of the temple arm portion. The augmented reality head-mounted device also includes one or more artificial reality processing or presentation devices, wherein at least one of the one or more artificial reality processing or presentation devices is configured to receive power from the metal-encapsulated battery cell. Examples of augmented reality presentation devices include micro-projectors that can be used to project images onto a waveguide structure of an augmented reality headset, speakers for transmitting audio to a user of the augmented reality headset, and / or other types of presentation devices configured to transmit audio, visual, and / or haptic effects associated with an augmented reality experience to a user of the augmented reality headset. For example, Figure 1 An augmented reality head mounted device 100 is shown, which includes a frame portion 102 , a first temple arm portion 104 , and a first metal encapsulated battery unit 108 located within the first temple arm portion 104 .

[0047] (A2) In some embodiments of A1, the inner shape is a first inner shape of an inner surface of the temple arm portion, and the augmented reality head mounted device further includes another metal packaged battery unit (e.g., Figure 1A second metal-packaged battery cell 110 is shown, the other metal-packaged battery cell having another outer surface defining another non-rectangular shape. In some embodiments, the other metal-packaged battery cell is configured to be housed within the temple arm portion, and the other non-rectangular shape of the outer surface follows the second inner shape of the inner surface of the temple arm portion. In some embodiments, at least one of the one or more artificial reality processing or presentation devices is configured to receive power from the other metal-packaged battery cell. In some embodiments, the metal-packaged battery cell and the other metal-packaged battery cell are electrically coupled to each other (e.g., in series or in parallel). In some embodiments, the first inner shape and the second inner shape are different shapes, so that the corresponding outer surfaces of the metal-packaged battery cell and the other metal-packaged battery cell each have a corresponding non-rectangular shape that is also different (i.e., a first trapezoidal shape and a different trapezoidal shape, respectively, and other examples, such as a trapezoidal shape and a different shape having more than four sides, such as a pentagonal shape, may also be considered). One or more corresponding non-rectangular shapes may also have at least one curved edge or curved surface.

[0048] (A3) In some embodiments of A1 to A2, the augmented reality head-mounted device also includes another temple arm portion, which is different from the temple arm portion and is coupled to the frame portion. In some embodiments, the other metal-packaged battery cell has another outer surface defining another non-rectangular shape, wherein the other metal-packaged battery cell is configured to be accommodated in the other temple arm portion, and the other non-rectangular shape of the other outer surface follows the other inner shape of the other inner surface of the other temple arm portion. In some embodiments, the augmented reality head-mounted device includes at least one of the one or more artificial reality processing or presentation devices, and at least one of the one or more artificial reality processing or presentation devices is configured to receive power from the other metal-packaged battery cell. In some embodiments, the metal-packaged battery and other metal-packaged batteries are electrically coupled to each other (e.g., in series or in parallel). In some embodiments, the one or more artificial reality processing or presentation devices are configured to receive power from another metal-packaged battery cell, which is accommodated in the frame portion, so that the power from the other metal-packaged battery cell is routed from the other temple arm portion to the frame portion for powering these AR components. For example, Figure 1 The second temple arm portion 106 is shown configured to include a third metal encapsulated battery cell, a fourth metal encapsulated battery cell, and one or more different artificial reality processing or presentation devices 113.

[0049] (A4) In some embodiments of A3, at least one edge of the metal packaged battery cell has a chamfered edge, and the chamfered edge is configured to further conform to the inner shape of the inner surface of the temple arm portion (e.g., Figure 1 The first metal packaged battery cell 108 is shown chamfered along edge 122 ).

[0050] (A5) In some embodiments of A1 to A4, at least one edge of the metal packaged battery cell has a chamfered edge, and the chamfered edge is formed to accommodate at least one of the one or more artificial reality processing or presentation devices within the temple arm portion (e.g., Figure 1 The first metal packaged battery cell 108 is shown chamfered along edge 122 to accommodate an artificial reality processing or presentation device 120 ).

[0051] (A6) In some embodiments of A1 to A5, at least one of the one or more artificial reality processing or presentation devices is a speaker, and the chamfered edge of the metal-encapsulated battery cell is shaped and sized to allow the speaker (or microphone) to at least partially overlap the chamfered edge within the temple arm portion.

[0052] (A7) In some embodiments of A1 to A6, the frame portion includes at least two semi-transparent lenses configured to allow ambient light to pass through (e.g., at least two lenses allow direct viewing of the physical world (i.e., without displaying video feedback of the environment captured by a camera, such as in the case of VR head-mounted devices and certain types of mixed reality head-mounted devices that also support VR applications, so, in other words, an augmented reality head-mounted device is a head-mounted device that does not support VR applications but only supports augmenting the user's experience of the physical environment)). For example, Figure 1 Also shown in the exploded view 125 is that the frame portion 102 includes a first semi-transparent lens 126 and a second semi-transparent lens 128 .

[0053] (A8) In some embodiments of A1 to A7, the augmented reality head mounted device further comprises another metal packaged battery cell having another outer surface defining another non-rectangular shape. In some embodiments, the other metal packaged battery cell is configured to be housed within the frame portion, and the other non-rectangular shape of the other outer surface follows another inner shape of another inner surface of the frame portion. In some embodiments, at least one of the one or more artificial reality processing or presentation devices is configured to receive power from the other metal packaged battery cell.

[0054] (A9) In some embodiments of A1 to A8, the metal-packaged battery unit includes at least one mounting component configured to secure the metal-packaged battery unit to the temple arm portion, and the mounting component is one or more of the following: a hook, a tab, a (leaf) spring, and a screw. In some embodiments, a removable / replaceable adhesive is used to further secure the metal-packaged battery. In some embodiments, the metal-packaged battery unit is a structural component of the temple arm portion, which means that the metal-packaged battery increases the torsional stiffness of the temple arm portion. For example, Figure 2 A mounting feature 214 is shown that is configured to assist in mounting the metal encapsulated battery 200 to the temple arm.

[0055] (A10) In some embodiments of A1 to A9, the thickness of the metal packaged battery cell gradually becomes thinner along two axes. In other words, the metal packaged battery cell has a non-uniform thickness. For example, Figure 3A The metal packaged battery 300 is shown to be gradually thinned along at least two axes thereof.

[0056] (A11) In some embodiments of A1 to A10, the metal packaged battery cell includes a hemispherical surface. For example, Figure 3B Metal encapsulated battery 308 is shown having a hemispherical surface 312 .

[0057] (A12) In some embodiments of A1 to A11, the metal packaged battery cell is made of steel.

[0058] (A13) In some embodiments of A1 to A12, the metal packaged battery cell has a flangeless sealing configuration, thereby increasing the battery cell area of ​​the metal packaged battery cell that can be accommodated within the temple arm portion compared to battery cells using a flange-based configuration. For example, Figure 2 It is shown that when the top portion 204 is welded to the bottom portion 210, the assembled metal packaged battery 200 does not include a flange.

[0059] (A14) In some embodiments of A1 to A13, the metal packaged battery cell includes at least two metal shells that are laser welded together. For example, Figure 2 Shown is a top portion 204 that is laser welded to a bottom portion 210 along a laser weld seam 212 .

[0060] (A15) In some embodiments of A1 to A14, the metal packaged battery cell has a metal base wall thickness of 100 micrometers (μm) to 300 micrometers. For example, Figure 2It is shown that the wall thickness may be between 100 micrometers (μm) and 300 μm to accommodate laser welding. In some embodiments, the wall thickness may vary for each component being welded together (eg, the top portion may be 300 μm, the bottom portion may be 100 μm).

[0061] (A16) In some embodiments of A1 to A15, the metal packaged battery cell has a maximum cross-sectional dimension of at least 6 millimeters (mm) and a minimum cross-sectional dimension of at least 2.5 mm. In some embodiments, the minimum cross-sectional dimension is a width dimension, such as Figure 3A The width in is 2.5 mm; the maximum cross-sectional dimension is the thickness, e.g. Figure 3A The thickness is 6mm.

[0062] (A17) In some embodiments of A1 to A16, the metal packaged battery cell has a stacked electrode design, wherein the layers of the stacked electrode design are die cut. For example, Figure 2 An electrode stack 208 is shown conforming to the shape of the void.

[0063] (B1) According to some embodiments, one or more metal packaged battery cells are formed according to a metal packaged battery cell configured to be used with the augmented reality head mounted device of any one of A1 to A17.

[0064] (C1) According to some embodiments, a corresponding portion of the augmented reality head-mounted device (e.g., a frame portion or a temple arm portion) includes one or more metal-packaged battery cells, which are formed according to a metal-packaged battery cell configured to be used with any one of the augmented reality head-mounted devices A1 to A17.

[0065] (D1) According to some embodiments, a method of using an augmented reality head-mounted device of any one of A1 to A17.

[0066] (E1) According to some embodiments, a non-transitory computer-readable storage medium includes instructions for presenting an augmented reality experience using an augmented reality head mounted device of any one of A1 to A17.

[0067] (F1) According to some embodiments, an artificial reality head mounted device includes a first portion (e.g., an AR head mounted device frame (e.g., Fig.11The frame 1104 shown in )) and a second portion (e.g., a temple arm coupled to the AR head-mounted device frame), the second portion including a gap at least partially defined by a first curvature along a first axis and a second curvature along a second axis (e.g., intersecting the first axis). The artificial reality head-mounted device also includes a battery located within the second portion, the battery being configured to follow the first curvature along the first axis and to follow the second curvature along the second axis, such that the battery has a shape that is curved along both the first axis and the second axis (e.g., the battery has a shape that matches the space in the second arm so that the largest possible battery can be included in the second portion, thereby increasing operating time) (e.g., Fig.10 1004 is shown following a curvature along both the x-axis and the y-axis. The battery is bent along both the first axis and the second axis in a rest position (i.e., the battery is not temporarily bent, the battery remains in that position without bending forces applied to the battery). In some embodiments, the rest position means that the battery maintains its shape even when not placed in the void (e.g., the battery has a predefined bending state prior to being placed in the void, such as Fig. 9 The battery is also configured to fill a void in the second portion (e.g., a portion of the second portion allocated for storing the battery). In some embodiments, the void is also defined by an electronic device located in the second portion. For example, Fig.10 A battery cell 1004 is shown filling a first void 1006. The battery is also configured to provide power to one or more artificial reality processing or presentation devices of the artificial reality head mounted device, wherein at least one of the one or more artificial reality processing or presentation devices (e.g., one or more processors, one or more projectors, one or more communication components, one or more cameras (e.g., image / video acquisition, environmental scanning), one or more microphones, etc.) is located in the void. For example, Fig.10 One or more artificial reality processing or presentation devices 1016 are shown positioned within the temple arm and may partially define the first void 1006 and, therefore, the shape of the battery cell.

[0068] (F2) In some embodiments of F1, the first portion includes another gap, which is at least partially defined by a third curvature along a third axis and a fourth curvature along a fourth axis (e.g., intersecting the third axis). The artificial reality head-mounted device also includes another battery located within the first portion, the other battery being configured to follow the third curvature along the third axis and to follow the fourth curvature along the fourth axis, so that the other battery has a shape that is curved along both the third axis and the fourth axis. The other battery is bent along both the third axis and the fourth axis in a static position, and the other battery is configured to fill the other gap in the second portion. The other battery is further configured to power one or more artificial reality processing or presentation devices of the artificial reality head-mounted device. For example, Fig.10 Another battery 1008 is shown positioned within the second void 1010 of the temple arm 1002 and follows a different curvature than the curvature associated with the first void 1006 .

[0069] (F3) In some embodiments of F1 to F2, a battery is electrically coupled to another battery (e.g., Fig.10 A connector 1009 is shown coupling the battery cell 1004 to another battery cell 1008).

[0070] (F4) In some embodiments of F1 to F3, the second portion (e.g., Fig.11 The eyeglass frame shown in FIG. 1 includes another void at least partially defined by a first curvature along a first axis and a second curvature along a second axis. Another battery (e.g., Fig.11 The battery cell 1106 in the embodiment is located in the second portion, the other battery is configured to follow a first curvature along the first axis and to follow a second curvature along the second axis, so that the other battery has a shape that is curved along both the first axis and the second axis (e.g., Fig.11 1106 is shown bent along multiple axes). The other battery is bent along both the first axis and the second axis in a stationary position, and the other battery is configured to fill another void in the second portion (e.g., Fig.11 A battery cell 1106 is shown positioned within the nose bridge portion 1107. The other battery is further configured to power one or more artificial reality processing or presentation devices of the artificial reality head mounted device, wherein at least one of the one or more artificial reality processing or presentation devices is located in another void.

[0071] (F5) In some embodiments of F1 to F4, the artificial reality head-mounted device includes a third portion (e.g., a second temple arm that is mirrored with the first temple arm (e.g., the second portion)), the third portion including another gap at least partially defined by a third curvature along a third axis and a fourth curvature along a fourth axis. Another battery is located within the third portion, and the other battery is configured to follow the third curvature along the third axis and to follow the fourth curvature along the fourth axis, so that the other battery has a shape that is curved along both the third axis and the fourth axis. The other battery is bent along the third axis and the fourth axis in a static position, and the other battery is configured to fill the gap in the third portion. The other battery is configured to provide power to one or more artificial reality processing or presentation devices of the artificial reality head-mounted device. For example, Figure 1 It is shown that the batteries can be placed in both temple arms.

[0072] (F6) In some embodiments of F4, the second portion is a temple arm and the third portion is another temple arm.

[0073] (F7) In some embodiments of F4 to F6, the battery is electrically coupled to another battery.

[0074] (F8) In some embodiments of F1 to F7, the first part is a lens frame.

[0075] (F9) In some embodiments of F1 to F8, the second portion is a temple arm.

[0076] (F10) In some embodiments of F1 to F9, the battery has a lithium-ion based chemistry.

[0077] (F11) In some embodiments of F1 to F10, the battery is packaged in a metal container (e.g., a steel, aluminum, alloy, magnesium can container). For example, Figure 2 , Figure 3A and Figure 3B It is shown that the battery may be a metal package battery.

[0078] (F12) In some embodiments of F1 to F11, the edges (eg, corners) of the battery are chamfered to conform to the filling gap (eg, Fig. 9 It is shown that the cell may be chamfered along any edge, as shown in block 918).

[0079] (F13) In some embodiments of F12, another edge of the battery is chamfered to conform to the fill gap (e.g., Figure 1 and Fig.10 The battery is shown chamfered to accommodate one or more artificial reality processing or presentation devices).

[0080] (F14) In some embodiments of F1 to F13, the battery is a structural component of the artificial reality head-mounted device.

[0081] (F15) In some embodiments of F1 to F14, a portion of the battery has a trapezoidal shape configured to further conform to the gap (e.g., Fig.11 The battery cell 1106 is shown having a trapezoidal shape configured to conform to the shape of the void in the nose bridge portion 1107).

[0082] (F16) In some embodiments of F1 to F15, the battery is composed of stacked electrodes (e.g., Figure 2 shows a configuration to insert Figure 10 to Figure 11 Stacked battery cells (eg, metal packaged battery 200)) in the gap shown.

[0083] (F17) In some embodiments of F1 to F16, the first curvature corresponds to a first radius, and the second curvature corresponds to a second radius, and the first radius is different from the second radius (e.g., Fig. 9 The description indicates that curved profile 902 and curved profile 904 can have different radius curvatures).

[0084] (G1) According to some embodiments, a method of using an artificial reality head mounted device of any one of F1 to F17.

[0085] (H1) According to some embodiments, a non-transitory computer-readable storage medium includes instructions for presenting an artificial reality experience using an artificial reality head mounted device of any one of F1 to F17.

[0086] The above-mentioned devices, including systems, wrist wearable devices, head-mounted devices, and smart textile-based clothing, will be further described in detail below. The above-mentioned specific operations may occur due to specific hardware, which will be described in more detail below. The devices described below are not restrictive, and the features on these devices may be removed or additional features may be added to these devices. Different devices may include one or more similar hardware components. For the sake of brevity, similar devices and components are described below. Any differences between devices and components will be described in the corresponding sections below.

[0087] FIG. 4A to FIG. 8C Described herein are additional exemplary artificial reality devices and related accessories into which the above-described non-rectangular metal packaged battery cells may be incorporated.

[0088] As described herein, a processor (e.g., a central processing unit (CPU), a microcontroller unit (MCU), etc.) is an electronic component responsible for executing instructions and controlling the operation of an electronic device (e.g., a wrist wearable device 500, a head wearable device, a handheld intermediate processing device (HIPD) 700, a smart textile-based garment 800, or other computer system). Through the embodiments described herein, there are various types of processors that may be used interchangeably or may be particularly required. For example, the processor may be: (i) a general-purpose processor designed to perform a variety of tasks, such as running software applications, managing operating systems, and performing arithmetic and logic operations; (ii) a microcontroller designed for specific tasks, such as controlling electronic devices, sensors, and motors; (iii) a graphics processing unit (GPU) designed to accelerate the creation and rendering of images, videos, and animations (e.g., virtual reality animations such as three-dimensional modeling); (iv) a field-programmable gate array (FPGA) that can be programmed and reconfigured after manufacturing, and / or can be customized to perform specific tasks, such as signal processing, cryptography, and machine learning; (v) a digital signal processor (DSP) designed to perform mathematical operations on signals such as audio, video, and radio waves. Those skilled in the art will appreciate that one or more processors of one or more electronic devices may be used in the various embodiments described herein.

[0089] As described herein, a controller is an electronic component that manages and coordinates the operation of other components within an electronic device (e.g., controlling inputs, processing data, and / or generating outputs). Examples of controllers may include: (i) a microcontroller, which includes small, low-power controllers commonly used in embedded systems and Internet of Things (IoT) devices; (ii) a Programmable Logic Controller (PLC), which may be configured for use in industrial automation systems to control and monitor manufacturing processes; (iii) a System-on-a-Chip (SoC) controller, which integrates multiple components such as a processor, memory, I / O interfaces, and other peripherals into a single chip; and / or a DSP. As described herein, a graphics module is a component or software module designed to handle graphics operations and / or processes, and may include a hardware module and / or a software module.

[0090] As described herein, memory refers to an electronic component in a computer or electronic device that stores data and instructions for access and operation by a processor. The devices described herein may include volatile memory and non-volatile memory. Examples of memory may include: (i) random access memory (RAM) (e.g., dynamic random access memory (DRAM), static random access memory (SRAM), double rate RAM (DDR RAM) or other random access solid-state memory devices), which is configured to temporarily store data and instructions; (ii) read-only memory (ROM) (e.g., one or more parts of system firmware, and / or boot loader), which is configured to permanently store data and instructions; (iii) flash memory, magnetic disk storage devices, optical disk storage devices, other non-volatile solid-state storage devices, which can be configured to store data in electronic devices (e.g., USB drives, memory cards and / or solid-state drives (SSD)); and (iv) cache memory, which is configured to temporarily store frequently accessed data and instructions. As described herein, the memory may include structured data (e.g., a structured query language (SQL) database, a MongoDB database, GraphQL data, JSON data, etc.). Other examples of memory may include: (i) profile data, which includes user account data, user settings, and / or other user data stored by the user; (ii) sensor data detected by one or more sensors and / or otherwise obtained; (iii) media content data, which includes stored image data, audio data, documents, etc.; (iv) application data, which may include data collected and / or otherwise obtained and stored during use of the application; and / or any other type of data described herein.

[0091] As described herein, the power system of an electronic device is configured to convert input power into a form that can be used to operate the device. The power system can include various components, including: (i) a power source, which can be an alternating current (AC) adapter power source or a direct current (DC) adapter power source; (ii) a charger input, which can be configured to use a wired connection and / or a wireless connection (which can be part of a peripheral device interface, such as a universal serial bus (USB), a micro USB interface, near-field magnetic coupling, magnetic induction and magnetic resonance charging, and / or radio frequency (RF) charging); (iii) a power management integrated circuit, which is configured to distribute power to various components of the device and ensure that the device operates within safe limits (e.g., regulating voltage, controlling current, and / or managing heat dissipation); and / or (iv) a battery, which is configured to store power to provide usable power to one or more components of the electronic device.

[0092] As described herein, a peripheral device interface is an electronic component (e.g., an electronic component of an electronic device) that allows the electronic device to communicate with other devices or peripherals and can provide a means for inputting and outputting data and signals. Examples of peripheral device interfaces may include: (i) a universal serial bus (USB) interface and / or a micro USB interface configured to connect a device to an electronic device; (ii) a Bluetooth interface configured to allow devices to communicate with each other, including Bluetooth Low Energy (BLE); (iii) a near field communication (NFC) interface configured to be used for a short-range wireless interface for operations such as access control; (iv) a POGO pin, which may be a small spring-loaded pin configured to provide a charging interface; (v) a wireless charging interface; (vi) a global positioning system (GPS) interface; (vii) a WiFi interface used to provide a connection between a device and a wireless network; and (viii) a sensor interface.

[0093] As described herein, sensors are electronic components (e.g., located in and / or otherwise in electronic communication with an electronic device such as a wearable device) that are configured to detect physical and environmental changes and generate electrical signals. Examples of sensors may include: (i) an imaging sensor (e.g., including one or more cameras disposed on a corresponding electronic device) for collecting imaging data; (ii) a biopotential signal sensor; (iii) an inertial measurement unit (e.g., an Inertial Measurement Unit, IMU) for detecting changes in, for example, angular rate, force, magnetic field, and / or acceleration; (iv) a heart rate sensor for measuring a user's heart rate; (v) an SpO2 sensor for measuring a user's blood oxygen saturation and / or other biometric data; (vi) a capacitive sensor for detecting changes in electrical potential near a portion of a user's body (e.g., a sensor-skin interface) and / or other devices or objects; and (vii) an optical sensor (e.g., a time-of-flight sensor, an infrared light sensor, or a visible light sensor) and / or a sensor for sensing data from a user or the user's environment. As described herein, a biopotential signal sensing component is a device (e.g., a biopotential signal sensor) for measuring electrical activity in the body. Some types of biopotential signal sensors include: (i) an electroencephalography (EEG) sensor, which is configured to measure electrical activity in the brain to diagnose neurological diseases; (ii) an electrocardiography (ECG or EKG) sensor, which is configured to measure the electrical activity of the heart to diagnose heart problems; (iii) an electromyography (EMG) sensor, which is configured to measure the electrical activity of muscles and diagnose neuromuscular diseases; (iv) an electrooculography (EOG) sensor, which is configured to measure the electrical activity of eye muscles to detect eye movements and diagnose eye diseases.

[0094] As described herein, an application (e.g., software) stored in a memory of an electronic device includes instructions stored in the memory. Examples of such applications include: (i) games; (ii) word processors; (iii) messaging applications; (iv) media streaming applications; (v) financial applications; (vi) calendars; (vii) clocks; (viii) web browsers; (ix) social media applications; (x) camera applications; (xi) web-based applications; (xii) health applications; (xiii) artificial reality applications; and / or any other application that may be stored in the memory. An application may operate in conjunction with data and / or one or more components of a device or a communicatively coupled device to perform one or more operations and / or functions.

[0095] As described herein, the communication interface module may include hardware and / or software capable of communicating data using any of the following: various custom or standard wireless protocols (e.g., IEEE 802.15.4, Wi-Fi, ZigBee, 6LoWPAN, Thread, Z-Wave, Bluetooth Smart, ISA100.11a, WirelessHART, or MiWi), custom or standard wired protocols (e.g., Ethernet or HomePlug), and / or any other suitable communication protocol, including communication protocols that have not been developed as of the filing date of this application. A communication interface is a mechanism that enables different systems or devices to exchange information and data with each other, including hardware, software, or a combination of hardware and software. For example, a communication interface may refer to a physical connector and / or port on a device that is capable of communicating with other devices (e.g., USB, Ethernet, HDMI, Bluetooth). In some embodiments, a communication interface may refer to a software layer that enables different software programs to communicate with each other (e.g., an application programming interface (API), protocols such as HTTP and TCP / IP, etc.).

[0096] As described herein, a graphics module is a component or software module designed to handle graphics operations and / or processes and may include a hardware module and / or a software module.

[0097] As described herein, a non-transitory computer-readable storage medium is a physical device or storage medium that can be used to store electronic data in a non-transitory form (eg, such that the data is permanently stored until it is intentionally deleted or modified).

[0098] Example AR System

[0099] Figure 4A to Figure 4D-2 An exemplary artificial reality system is shown in accordance with some embodiments. Figure 4AA first AR system 400a and a first exemplary user interaction using a wrist wearable device 500 , a head wearable device (eg, an AR device 600 ), and / or a handheld intermediate processing device (HIPD) 700 are shown. Figure 4B A second AR system 400 b and a second exemplary user interaction using the wrist wearable device 500 , the AR device 600 , and / or the HIPD 700 are shown. Figure 4C-1 and Figure 4C-2 A third AR system 400 c and a third exemplary user interaction using a wrist wearable device 500 , a head wearable device (eg, a VR device 610 ), and / or a HIPD 700 are shown. Figure 4D-1 and Figure 4D-2 A fourth AR system 400d and a fourth exemplary user interaction using a wrist wearable device 500, a VR device 610, and / or a smart textile-based garment 800 (e.g., a wearable glove, a haptic glove) are shown. As will be understood by those skilled in the art after reading the description provided herein, the above exemplary AR systems (described in detail below) can perform various functions and / or operations.

[0100] References below FIG. 5A to FIG. 5B Describes a wrist wearable device 500 and one or more components thereof; FIG. 6A to FIG. 6C Describes a head wearable device and one or more components thereof; and the following references FIG. 7A to FIG. 7B Describes HIPD 700 and one or more of its components. FIG. 8A to FIG. 8C A smart textile-based garment 800 and one or more components thereof are described. The wrist wearable device 500, the head wearable device, and / or the HIPD 700 may be communicatively coupled via a network 425 (e.g., cellular, near field, Wi-Fi, a personal area network, a wireless local area network (wireless LAN), etc.). In addition, the wrist wearable device 500, the head wearable device, and / or the HIPD 700 may also be communicatively coupled to one or more servers 430, computers 440 (e.g., laptops, computers, etc.), mobile devices 450 (e.g., smartphones, tablets, etc.), and / or other electronic devices via a network 425 (e.g., cellular, near field, Wi-Fi, a personal area network, a wireless LAN, etc.). Similarly, the smart textile-based garment 800 may also be communicatively coupled to the wrist wearable device 500, the head wearable device, the HIPD 700, one or more servers 430, computers 440, mobile devices 450, and / or other electronic devices via a network 425 when in use.

[0101] Go to Figure 4A, showing a user 402 wearing a wrist wearable device 500 and an AR device 600, and placing a HIPD 700 on their desk. The wrist wearable device 500, the AR device 600, and the HIPD 700 facilitate the user's interaction with the AR environment. In particular, as shown in the first AR system 400a, the wrist wearable device 500, the AR device 600, and / or the HIPD 700 enable the presentation of one or more avatars 404, digital representations 406 of contacts, and virtual objects 408. As described below, the user 402 can interact with one or more avatars 404, digital representations 406 of contacts, and virtual objects 408 via the wrist wearable device 500, the AR device 600, and / or the HIPD 700.

[0102] The user 402 may provide user input using any of the following: the wrist wearable device 500, the AR device 600, and / or the HIPD 700. For example, the user 402 may perform one or more gestures detected by the wrist wearable device 500 (e.g., using the gestures described below with reference to FIG. 1 ) to provide user input. FIG. 5A to FIG. 5B One or more EMG sensors and / or IMUs described herein) and / or an AR device 600 (e.g., using the Figure 6A to Figure 6B-2 Alternatively or additionally, user 402 may provide user input through one or more touch surfaces of wrist wearable device 500, AR device 600, and / or HIPD 700, and / or voice commands collected by microphones of wrist wearable device 500, AR device 600, and / or HIPD 700. In some embodiments, wrist wearable device 500, AR device 600, and / or HIPD 700 include a digital assistant to help the user provide user input (e.g., complete a sequence of operations, suggest different operations or commands, provide reminders, confirm commands, etc.). In some embodiments, user 402 may provide user input through one or more facial gestures and / or facial expressions. For example, a camera of wrist wearable device 500, AR device 600, and / or HIPD 700 may track the eyes of user 402 to navigate through the user interface.

[0103] The wrist wearable device 500, the AR device 600, and / or the HIPD 700 may operate alone or in combination to allow the user 402 to interact with the AR environment. In some embodiments, the HIPD 700 is configured to operate as a central hub or control center for the wrist wearable device 500, the AR device 600, and / or another communication coupling device. For example, the user 402 may provide input to interact with the AR environment at any one of the wrist wearable device 500, the AR device 600, and / or the HIPD 700, and the HIPD 700 may identify one or more back-end tasks and front-end tasks to perform the requested interaction and distribute instructions to cause one or more back-end tasks and front-end tasks to be performed at the wrist wearable device 500, the AR device 600, and / or the HIPD 700. In some embodiments, the back-end tasks are background processing tasks that are not perceptible to the user (e.g., rendering content, decompression, compression, etc.), while the front-end tasks are user-oriented tasks that are perceptible to the user (e.g., presenting information to the user, providing feedback to the user, etc.). As described below with reference to FIG. 7A to FIG. 7B As described, the HIPD 700 can perform backend tasks and provide the wrist wearable device 500 and / or the AR device 600 with operation data corresponding to the performed backend tasks, so that the wrist wearable device 500 and / or the AR device 600 can perform frontend tasks. In this way, the HIPD 700, which has more computing resources and greater thermal headroom than the wrist wearable device 500 and / or the AR device 600, performs computing-intensive tasks and reduces the computer resource utilization and / or power usage of the wrist wearable device 500 and / or the AR device 600.

[0104] In the example shown in the first AR system 400a, the HIPD 700 identifies one or more back-end tasks and front-end tasks associated with a user request to initiate an AR video call with one or more other users (represented by avatars 404 and digital representations 406 of contacts), and distributes instructions to cause one or more back-end tasks and front-end tasks to be performed. In particular, the HIPD 700 performs back-end tasks for processing and / or rendering image data (and other data) associated with the AR video call, and provides the AR device 600 with operating data associated with the performed back-end tasks, so that the AR device 600 performs front-end tasks for presenting the AR video call (e.g., presenting the avatars 404 and digital representations 406 of contacts).

[0105] In some embodiments, the HIPD 700 can be operated as a focus or anchor point for information presentation. This allows the user 402 to know generally where the information is presented. For example, as shown in the first AR system 400a, the avatar 404 and the digital representation 406 of the contact are presented above the HIPD 700. In particular, the HIPD 700 and the AR device 600 are combined to operate to determine the location for presenting the avatar 404 and the digital representation 406 of the contact. In some embodiments, information can be presented at a predetermined distance (e.g., within 5 meters) from the HIPD 700. For example, as shown in the first AR system 400a, the virtual object 408 is presented on the table at a certain distance from the HIPD 700. Similar to the above example, the HIPD 700 and the AR device 600 can be combined to operate to determine the location for presenting the virtual object 408. Alternatively, in some embodiments, the presentation of information is not constrained by the HIPD 700. More specifically, the avatar 404, the digital representation 406 of the contact, and the virtual object 408 do not have to be presented within a predetermined distance of the HIPD 700.

[0106] User input provided at the wrist wearable device 500, the AR device 600, and / or the HIPD 700 is coordinated so that the user can use any device to start an operation, continue an operation, and / or complete an operation. For example, the user 402 can provide user input to the AR device 600 to cause the AR device 600 to present a virtual object 408, and when the virtual object 408 is presented by the AR device 600, the user 402 can provide one or more gestures through the wrist wearable device 500 to interact with and / or manipulate the virtual object 408.

[0107] Figure 4B The user 402 is shown wearing the wrist wearable device 500 and the AR device 600 and holding the HIPD 700. In the second AR system 400b, the wrist wearable device 500, the AR device 600, and / or the HIPD 700 are used to receive one or more messages and / or provide one or more messages to contacts of the user 402. In particular, the wrist wearable device 500, the AR device 600, and / or the HIPD 700 detect and coordinate one or more user inputs to launch a messaging application and prepare a response to a message received via the messaging application.

[0108] In some embodiments, the user 402 launches an application on the wrist wearable device 500, the AR device 600, and / or the HIPD 700 via a user input that causes the application to be launched on at least one device. For example, in the second AR system 400b, the user 402 performs a gesture associated with a command for launching a messaging application (represented by the messaging user interface 412); the wrist wearable device 500 detects the gesture; and based on determining that the user 402 is wearing the AR device 600, causes the AR device 600 to present the messaging user interface 412 of the messaging application. The AR device 600 can present the messaging user interface 412 to the user 402 through its display (e.g., as shown in the field of view 410 of the user 402). In some embodiments, the application is launched and runs on a device (e.g., the wrist wearable device 500, the AR device 600, and / or the HIPD 700) that detects the user input to launch the application, and the device provides another device running data to cause the messaging application to be presented. For example, the wrist wearable device 500 can detect a user input for launching a messaging application, launch and run the messaging application, and provide the running data to the AR device 600 and / or the HIPD 700 so that the messaging application is presented. Alternatively, the application can be launched and run on a device other than the device that detects the user input. For example, the wrist wearable device 500 can detect a gesture associated with launching a messaging application, and cause the HIPD 700 to run the messaging application and coordinate the presentation of the messaging application.

[0109] In addition, the user 402 can provide user input provided at the wrist wearable device 500, the AR device 600, and / or the HIPD 700 to continue and / or complete an operation initiated at another device. For example, after launching a messaging application via the wrist wearable device 500, and when the AR device 600 presents the messaging user interface 412, the user 402 can provide input at the HIPD 700 to prepare a response (e.g., as shown by a sliding gesture performed on the HIPD 700). The gesture of the user 402 performed on the HIPD 700 can be provided and / or displayed on another device. For example, the sliding gesture performed by the user 402 on the HIPD 700 is displayed on the virtual keyboard of the messaging user interface 412 displayed by the AR device 600.

[0110] In some embodiments, the wrist wearable device 500, the AR device 600, the HIPD 700, and / or other communication coupling devices may present one or more notifications to the user 402. The notification may be an indication of a new message, an incoming call, an application update, a status update, etc. The user 402 may select the notification via the wrist wearable device 500, the AR device 600, the HIPD 700, and cause an application or operation associated with the notification to be presented on at least one device. For example, the user 402 may receive a notification that a message is received at the wrist wearable device 500, the AR device 600, the HIPD 700, and / or other communication coupling devices, and provide user input at the wrist wearable device 500, the AR device 600, and / or the HIPD 700 to view the notification, and the device detecting the user input may cause the application associated with the notification to be launched and / or presented at the wrist wearable device 500, the AR device 600, and / or the HIPD 700.

[0111] Although the above example describes coordinated input for interacting with a messaging application, a person skilled in the art will understand upon reading this specification that user input can be coordinated to interact with any number of applications, including but not limited to gaming applications, social media applications, camera applications, web-based applications, financial applications, etc. For example, the AR device 600 can present gaming application data to the user 402, and the HIPD 700 can use a controller to provide input to the game. Similarly, the user 402 can use the wrist wearable device 500 to activate the camera of the AR device 600, and the user can use the wrist wearable device 500, the AR device 600, and / or the HIPD 700 to manipulate (e.g., zoom in or out, apply filters, etc.) image acquisition and collect image data.

[0112] Go to Figure 4C-1 and Figure 4C-2 , showing that the user 402 is wearing the wrist wearable device 500 and the VR device 610, and holding the HIPD 700. In the third AR system 400c, the wrist wearable device 500, the VR device 610, and / or the HIPD 700 are used to interact within an AR environment (e.g., a VR game or other AR application). When the VR device 610 presents a representation of a VR game (e.g., the first AR game environment 420) to the user 402, the wrist wearable device 500, the VR device 610, and / or the HIPD 700 detect and coordinate one or more user inputs to allow the user 402 to interact with the VR game.

[0113] In some embodiments, the user 402 may provide user input via the wrist wearable device 500, the VR device 610, and / or the HIPD 700, which may cause an action to be generated in the corresponding AR environment. Figure 4C-1 4) raises HIPD 700 in preparation for swinging in first AR game environment 420. VR device 610 causes the AR representation of user 422 to perform a similar action (e.g., raise a virtual object such as virtual sword 424) in response to user 402 raising HIPD 700. In some embodiments, each device uses respective sensor data and / or image data to detect user input and provide an accurate representation of the movement of user 402. For example, an image sensor such as IMU 758 of HIPD 700 (e.g., described below) may be used to detect user input. Fig. 7A and Figure 7B The simultaneous localization and mapping (SLAM) camera or other camera discussed in the previous section can be used to detect the position of the HIPD 700 relative to the body of the user 402, so that the virtual object can be properly positioned within the first AR game environment 420; the sensor data from the wrist wearable device 500 can be used to detect the speed at which the user 402 raises the HIPD 700, so that the AR representation of the user 422 and the virtual sword 424 is synchronized with the movement of the user 402; and the imaging sensor 626 ( FIG. 6A to FIG. 6C ) can be used to represent the body, boundary conditions, or real-world objects of the user 402 within the first AR game environment 420.

[0114] exist Figure 4C-2 In the embodiment of the present invention, the user 402 swings downward while holding the HIPD 700. The wrist wearable device 500, the VR device 610 and / or the HIPD 700 detect the downward swing of the user 402 and perform corresponding actions in the first AR game environment 420. In some embodiments, the data collected by each device is used to improve the user experience in the AR environment. For example, the sensor data of the wrist wearable device 500 can be used to determine the speed and / or force of performing the downward swing, and the image sensor of the HIPD 700 and / or the VR device 610 can be used to determine the position of the swing and how the swing should be represented in the first AR game environment 420, which can then be used as an input of an AR environment (e.g., a game mechanism), which can use the detected speed, force, position and / or various aspects of the action of the user 402 to classify the user's input (e.g., the user performs a light blow, a heavy blow, a critical attack, a flash, a miss, etc.) or calculate an output (e.g., the amount of damage).

[0115] Although the wrist wearable device 500, VR device 610, and / or HIPD 700 are described as detecting user input, in some embodiments, the user input is detected at a single device (where the single device is responsible for distributing signals to other devices to perform the user input). For example, the HIPD 700 can cause an application for generating the first AR game environment 420 to run, and provide the VR device 610 with corresponding data for causing the presentation of the first AR game environment 420, and detect the movement of the user 402 (when holding the HIPD 700) to cause the corresponding action to be performed within the first AR game environment 420. Additionally or alternatively, in some embodiments, the operating data (e.g., sensor data, image data, application data, device data, and / or other data) of one or more devices is provided to a single device (e.g., HIPD 700) to process the operating data and cause the corresponding device to perform an action associated with the processed operating data.

[0116] exist Figure 4D-1 and Figure 4D-2 , it is shown that the user 402 is wearing a wrist wearable device 500, a VR device 610, and a smart textile-based clothing 800. In the fourth AR system 400d, the wrist wearable device 500, the VR device 610, and / or the smart textile-based clothing 800 are used in an AR environment (e.g., the above reference Figure 4A to Figure 4C-2 When the VR device 610 presents a representation of a VR game (e.g., the second AR game environment 435) to the user 402, the wrist wearable device 500, the VR device 610, and / or the smart textile-based garment 800 detect and coordinate one or more user inputs to allow the user 402 to interact with the AR environment.

[0117] In some embodiments, the user 402 may provide user input via the wrist wearable device 500, the VR device 610, and / or the smart textile-based clothing 800, which may cause an action to be generated in the corresponding AR environment. Figure 4D-1 434). In some embodiments, each device uses respective sensor data and / or image data to detect user input and provide an accurate representation of user 402's movements.

[0118] exist Figure 4D-2 , the user 402 performs a throwing motion while wearing the smart textile-based garment 800. The wrist wearable device 500, the VR device 610, and / or the smart textile-based garment 800 detect the throwing motion of the user 402 and perform corresponding actions in the second AR game environment 435. As described above, the data collected by each device is used to improve the user experience within the AR environment. Although not shown, the smart textile-based garment 800 can be used in combination with the VR device 610 and / or the HIPD 700.

[0119] Having discussed exemplary AR systems, devices for interacting with such AR systems, and other computing systems in more general terms, they will now be discussed in more detail below. For ease of reference, some definitions of devices and components that may be included in some or all of the exemplary devices discussed below are defined herein. It will be appreciated by those skilled in the art that certain types of components described below may be more suitable for a particular set of devices and less suitable for a different set of devices. However, subsequent references to components defined herein should be deemed to be included in the definitions provided.

[0120] In some embodiments discussed below, exemplary devices and systems including electronic devices and systems will be discussed. Such exemplary devices and systems are not intended to be limiting, and those skilled in the art will appreciate that alternative devices and systems to the exemplary devices and systems described herein may be used to perform the operations described herein and to construct the systems and devices described herein.

[0121] As described herein, an electronic device is a device that uses electrical energy to perform a specific function. An electronic device can be any physical object that contains electronic components such as transistors, resistors, capacitors, diodes, and integrated circuits. Examples of electronic devices include smart phones, laptop computers, digital cameras, televisions, game consoles, and music players, as well as the exemplary electronic devices discussed herein. As described herein, an intermediate electronic device is a device that is located between two other electronic devices and / or a subset of components of one or more electronic devices and facilitates communication and / or data processing and / or data transmission between the corresponding electronic devices and / or electronic components.

[0122] Exemplary Wrist Wearable Device

[0123] Figure 5A and Figure 5B An exemplary wrist wearable device 500 is shown in accordance with some embodiments. Figure 5A Various components of wrist wearable device 500 are shown, which can be used alone or in combination, including combinations containing other electronic devices and / or electronic components.

[0124] Figure 5A Wearable band 510 and watch body 520 (or bladder) are shown coupled (as discussed below) to form wrist wearable device 500. Wrist wearable device 500 can perform various functions and / or operations associated with navigating through a user interface and selectively opening applications.

[0125] As will be described in more detail below, operations performed by the wrist wearable device 500 may include: (i) presenting content to the user (e.g., displaying visual content via the display 505); (ii) detecting (e.g., sensing) user input (e.g., sensing a touch on the peripheral button 523 and / or a touch at the touch screen of the display 505, a gesture detected by a sensor (e.g., a biopotential sensor)); (iii) sensing biometric data (e.g., neuromuscular signals, heart rate, temperature, sleep, etc.) via one or more sensors 513; messaging (e.g., text, voice, video, etc.); image acquisition via one or more imaging devices or cameras 525; wireless communications (e.g., cellular, near field, Wi-Fi, personal area network, etc.); location determination; financial transactions; providing tactile feedback; alerts; notifications; biometric authentication; health monitoring; sleep monitoring, etc.

[0126] The above exemplary functions may be performed independently in the watch body 520, independently in the wearable band 510, and / or via electronic communication between the watch body 520 and the wearable band 510. In some embodiments, when an AR environment is presented (e.g., via one of the AR systems 400a to 400d), the functions may be performed on the wrist wearable device 500. As will be understood by those skilled in the art upon reading the description provided herein, the novel wearable device described herein may be used with other types of AR environments.

[0127] The wearable band 510 can be configured to be worn by a user so that the inner (or inner side) surface of the wearable structure 511 of the wearable band 510 contacts the user's skin. When worn by the user, the sensor 513 contacts the user's skin. The sensor 513 can sense biometric data, such as the user's heart rate, saturated oxygen level, temperature, sweat level, neuromuscular signals, or a combination thereof. The sensor 513 can also sense data about the user's environment, including the user's movement, altitude, position, orientation, gait, acceleration, positioning, or a combination thereof. In some embodiments, the sensor 513 is configured to track the positioning and / or movement of the wearable band 510. One or more sensors 513 may include those defined above and / or described below. Figure 5B Any sensor discussed.

[0128] One or more sensors 513 may be distributed on the inner surface and / or outer surface of the wearable band 510. In some embodiments, one or more sensors 513 are evenly spaced along the wearable band 510. Alternatively, in some embodiments, one or more sensors 513 are positioned at different points along the wearable band 510. Figure 5A As shown, one or more sensors 513 may be the same or different. For example, in some embodiments, the shape of one or more sensors 513 may be determined as a sheet (e.g., sensor 513a), an ellipse, a circle, a square, an oblong (e.g., sensor 513c) and / or any other shape that maintains contact with the user's skin (e.g., so that neuromuscular signals and / or other biometric data can be accurately measured at the user's skin). In some embodiments, one or more sensors 513 are aligned to form a sensor pair (e.g., for sensing neuromuscular signals based on differential sensing within each corresponding sensor). For example, sensor 513b is aligned with an adjacent sensor to form sensor pair 514a, and sensor 513d is aligned with an adjacent sensor to form sensor pair 514b. In some embodiments, the wearable band 510 does not have a sensor pair. Alternatively, in some embodiments, the wearable band 510 has a predetermined number of sensors (a pair of sensors, three pairs of sensors, four pairs of sensors, six pairs of sensors, sixteen pairs of sensors, etc.).

[0129] The wearable band 510 may include any suitable number of sensors 513. In some embodiments, the number and arrangement of sensors 513 depends on the specific application in which the wearable band 510 is used. For example, a wearable band 510 configured as an armband, wristband, or chest band may include multiple sensors 513 with a different number of sensors 513 and a different arrangement for each use case (e.g., a medical use case compared to a gaming or general everyday use case).

[0130] According to some embodiments, the wearable band 510 also includes an electrical ground electrode and a shield electrode. As with the sensor 513, the electrical ground electrode and the shield electrode can be distributed on the inner surface of the wearable band 510 so that they contact a portion of the user's skin. For example, the electrical ground electrode and the shield electrode can be located on the inner surface of the coupling mechanism 516 or the inner surface of the wearable structure 511. The electrical ground electrode and the shield electrode can be formed as the sensor 513, and / or use the same components as the sensor 513. In some embodiments, the wearable band 510 includes more than one electrical ground electrode and more than one shield electrode.

[0131] The sensor 513 may be formed as part of the wearable structure 511 of the wearable band 510. In some embodiments, the sensor 513 is flush or substantially flush with the wearable structure 511 so that they do not extend beyond the surface of the wearable structure 511. In the case where the sensor 513 is flush with the wearable structure 511, the sensor 513 is still configured to contact the user's skin (e.g., through a skin contact surface). Alternatively, in some embodiments, the sensor 513 extends beyond the wearable structure 511 by a predetermined distance (e.g., 0.1 mm to 2 mm) to contact the user's skin and press against the user's skin. In some embodiments, the sensor 513 is coupled to an actuator (not shown) that is configured to adjust the extension height of the sensor 513 (e.g., the distance from the surface of the wearable structure 511) so that the sensor 513 contacts the user's skin and presses against the user's skin. In some embodiments, the actuator adjusts the extension height between 0.01 mm and 1.2 mm. This allows the user to customize the position of sensor 513 to improve the overall comfort when wearing wearable band 510 and still allow sensor 513 to contact the user's skin. In some embodiments, sensor 513 is indistinguishable from wearable structure 511 when worn by the user.

[0132] The wearable structure 511 can be formed of an elastic material, an elastomer, etc., and is configured to be stretched and adapted to be worn by a user. In some embodiments, the wearable structure 511 is a textile or a woven fabric. As described above, the sensor 513 can be formed as a part of the wearable structure 511. For example, the sensor 513 can be molded into the wearable structure 511 or integrated into the woven fabric (for example, the sensor 513 can be sewn into the fabric and simulate the flexibility of the fabric (for example, the sensor 513 can be composed of a series of woven fabric strands)).

[0133] The wearable structure 511 may include flexible electronic connectors that enclose the sensors 513, electronic circuits, and / or (hereinafter referred to as "sensors 513", "electronic circuits", and / or "electronic circuits") enclosed in the wearable band 510. Figure 5B In some embodiments, the flexible electronic connector is configured to interconnect the sensor 513, electronic circuits, and / or other electronic components of the wearable band 510 with corresponding sensors and / or other electronic components of another electronic device (e.g., watch body 520). The flexible electronic connector is configured to move with the wearable structure 511 so that adjustments (e.g., resizing, pulling, folding, etc.) of the wearable structure 511 by the user do not cause stress or strain on the electrical coupling of the components of the wearable band 510.

[0134] As described above, the wearable band 510 is configured to be worn by the user. In particular, the wearable band 510 can be shaped or otherwise manipulated to be worn by the user. For example, the wearable band 510 can be shaped to have a substantially circular shape so that the wearable band can be configured to be worn on the user's forearm or wrist. Alternatively, the wearable band 510 can be shaped to be worn on another body part of the user, such as the user's upper arm (e.g., around the biceps), forearm, chest, leg, etc. The wearable band 510 may include a retaining mechanism 512 (e.g., a buckle, hook and loop fastener, etc.) for fixing the wearable band 510 to the user's wrist or other body part. When the user wears the wearable band 510, the sensor 513 senses data from the user's skin (referred to as sensor data). In particular, the sensor 513 of the wearable band 510 obtains (e.g., senses and records) neuromuscular signals.

[0135] The sensed data (e.g., the sensed neuromuscular signals) can be used to detect and / or determine the intention of the user to perform certain motor actions. In particular, when the user performs muscle activation (e.g., motion, gesture, etc.), the sensor 513 senses and records the neuromuscular signals from the user. The detected and / or determined motor actions (e.g., phalanges (or fingers) movements, wrist movements, hand movements and / or other muscle intentions) can be used to determine the control commands or control information (instructions for executing certain commands after sensing the data) used to make the computing device execute one or more input commands. For example, the sensed neuromuscular signals can be used to control certain user interfaces displayed on the display 505 of the wrist wearable device 500, and / or can be transmitted to the device responsible for rendering the artificial reality environment (e.g., head-mounted display) to perform actions in the associated artificial reality environment, such as controlling the movement of the virtual device displayed to the user. Muscle activations performed by the user may include: static gestures, such as placing the user's palm down on a table; dynamic gestures, such as grasping a physical or virtual object; and covert gestures that are imperceptible to another person, such as slightly tensing a joint by co-contracting opposing muscles or using submuscular activation. Muscle activations performed by the user may include symbolic gestures (e.g., gestures mapped to other gestures, interactions, or commands based on a gesture vocabulary that specifies a mapping of gestures to commands).

[0136] Sensor data sensed by sensor 513 can be used to provide the user with enhanced interaction with physical objects (e.g., devices communicatively coupled to wearable band 510) and / or virtual objects in an artificial reality application generated by the artificial reality system (e.g., user interface objects presented on display 505 or another computing device (e.g., a smartphone)).

[0137] In some embodiments, the wearable band 510 includes one or more haptic devices 546 ( Figure 5B ; for example, a vibrotactile actuator), one or more haptic devices are configured to provide tactile feedback to the user's skin (e.g., skin and / or kinesthetic sensations, etc.). Sensor 513 and / or haptic device 546 can be configured to operate in conjunction with multiple applications, including but not limited to health monitoring, social media, gaming, and artificial reality (e.g., applications associated with artificial reality).

[0138] The wearable band 510 may also include a coupling mechanism 516 for removably coupling a bladder (e.g., a computing unit) or a watch body 520 (via a coupling surface of the watch body 520) to the wearable band 510 (e.g., a bracket or shape of the coupling mechanism may correspond to the shape of the watch body 520 of the wrist wearable device 500). In particular, the coupling mechanism 516 may be configured to receive the coupling surface near the bottom side of the watch body 520 (e.g., a side of the watch body 520 opposite to the front side where the display 505 is located), so that a user can push the watch body 520 downward into the coupling mechanism 516 to attach the watch body 520 to the coupling mechanism 516. In some embodiments, the coupling mechanism 516 may be configured to receive the top side of the watch body 520 (e.g., a side near the front side of the watch body 520 where the display 505 is located), which is pushed upward into the bracket instead of being pushed downward into the coupling mechanism 516. In some embodiments, coupling mechanism 516 is an integral component of wearable band 510, such that wearable band 510 and coupling mechanism 516 are a single unitary structure. In some embodiments, coupling mechanism 516 is a type of frame or shell, which allows the coupling surface of watch body 520 to remain inside or on coupling mechanism 516 (e.g., a bracket, tracker band, support base, buckle, etc.) of wearable band 510.

[0139] The coupling mechanism 516 may allow the watch body 520 to be removably coupled to the wearable band 510 by friction fit, magnetic coupling, a rotation-based connector, a shear pin coupling, a retaining spring, one or more magnets, a clip, a pin, a hook and loop fastener, or a combination thereof. The user may perform any type of motion to couple the watch body 520 to the wearable band 510 and detach the watch body 520 from the wearable band 510. For example, the user may twist, slide, turn, push, pull, or rotate the watch body 520 relative to the wearable band 510, or a combination thereof, to attach the watch body 520 to the wearable band 510 and detach the watch body 520 from the wearable band 510. Alternatively, as discussed below, in some embodiments, the watch body 520 may be detached from the wearable band 510 by actuating a release mechanism 529.

[0140] The wearable band 510 can be coupled to the watch body 520 to increase the functionality of the wearable band 510 (e.g., converting the wearable band 510 into a wrist wearable device 500, adding additional computing units and / or batteries to increase the computing resources and / or battery life of the wearable band 510, adding additional sensors to improve the sensed data, etc.). As described above, the wearable band 510 (and the coupling mechanism 516) are configured to operate independently of the watch body 520 (e.g., perform functions independently). For example, the coupling mechanism 516 may include one or more sensors 513 that contact the user's skin when the user wears the wearable band 510 and provide sensor data for determining control commands.

[0141] The user can remove the watch body 520 (or the bladder) from the wearable band 510 to reduce the burden on the user of the wrist wearable device 500. For embodiments in which the watch body 520 is detachable, the watch body 520 can be referred to as a detachable structure, so that in these embodiments, the wrist wearable device 500 includes a wearable portion (e.g., the wearable band 510) and a detachable structure (watch body 520).

[0142] Turning to the watch body 520, the watch body 520 may have a substantially rectangular or circular shape. The watch body 520 is configured to be worn by a user on their wrist or another body part. More specifically, the watch body 520 is sized to be easily carried by a user, attached to a portion of a user's clothing, and / or coupled to the wearable band 510 (forming a wrist wearable device 500). As described above, the watch body 520 may have a shape corresponding to the coupling mechanism 516 of the wearable band 510. In some embodiments, the watch body 520 includes a single release mechanism 529 or multiple release mechanisms (e.g., two release mechanisms 529 (such as spring-loaded buttons) located on opposite sides of the watch body 520) for separating the watch body 520 and the wearable band 510. The release mechanism 529 may include, but is not limited to, a button, a knob, a plunger, a handle, a lever, a fastener, a buckle, a dial, a latch, or a combination thereof.

[0143] The user can actuate the release mechanism 529 by pushing, turning, lifting, depressing, shifting the release mechanism 529, or performing other actions on the release mechanism 529. Actuating the release mechanism 529 can release (e.g., separate) the watch body 520 from the coupling mechanism 516 of the wearable band 510, thereby allowing the user to use the watch body 520 independently of the wearable band 510, and vice versa. For example, separating the watch body 520 from the wearable band 510 can allow the user to use the rear camera 525B to capture images. Although the release mechanism 529 is shown as being located at a corner of the watch body 520, the release mechanism 529 can be located at any position on the watch body 520 that is convenient for the user to actuate. In addition, in some embodiments, the wearable band 510 may also include a corresponding release mechanism for separating the watch body 520 from the coupling mechanism 516. In some embodiments, the release mechanism 529 is optional, and the watch body 520 can be separated from the coupling mechanism 516 as described above (e.g., by twisting, rotating, etc.).

[0144] The watch body 520 may include one or more peripheral buttons 523 and 527 for performing various operations at the watch body 520. For example, the peripheral buttons 523 and 527 may be used to turn on or wake up the display 505 (e.g., transition from a sleep state to an active state), unlock the watch body 520, increase or decrease the volume, increase or decrease the brightness, interact with one or more applications, interact with one or more user interfaces, etc. Additionally or alternatively, in some embodiments, the display 505 operates as a touch screen and allows a user to provide one or more inputs for interacting with the watch body 520.

[0145] In some embodiments, the watch body 520 includes one or more sensors 521. The sensors 521 of the watch body 520 may be the same as or different from the sensors 513 of the wearable band 510. The sensors 521 of the watch body 520 may be distributed on the inner surface and / or the outer surface of the watch body 520. In some embodiments, the sensors 521 are configured to contact the user's skin when the user wears the watch body 520. For example, the sensor 521 may be placed on the bottom side of the watch body 520, and the coupling mechanism 516 may be a bracket with an opening that allows the bottom side of the watch body 520 to directly contact the user's skin. Alternatively, in some embodiments, the watch body 520 does not include a sensor configured to contact the user's skin (e.g., including a sensor located inside and / or outside the watch body 520 configured to sense data of the watch body 520 and the surrounding environment of the watch body 520). In some embodiments, the sensor 513 is configured to track the position and / or movement of the watch body 520.

[0146] The watch body 520 and the wearable band 510 can share data using a wired communication method (e.g., a Universal Asynchronous Receiver / Transmitter (UART), a USB transceiver, etc.), and / or a wireless communication method (e.g., near field communication, Bluetooth, etc.). For example, the watch body 520 and the wearable band 510 can share data sensed by the sensors 513 and 521, as well as application and device specific information (e.g., active and / or available applications), output devices (e.g., displays, speakers, etc.), and input devices (e.g., touch screens, microphones, imaging sensors, etc.).

[0147] In some embodiments, the watch body 520 may include, but is not limited to, a front camera 525A and / or a rear camera 525B, sensors 521 (e.g., a biometric sensor, an IMU, a heart rate sensor, a saturated oxygen sensor, a neuromuscular signal sensor, an altimeter sensor, a temperature sensor, a bioimpedance sensor, a pedometer sensor, an optical sensor (e.g., an imaging sensor 563; Figure 5B ), touch sensor, sweat sensor, etc.). In some embodiments, the watch body 520 may include one or more haptic devices 576 (eg, haptic feedback (eg, skin and / or kinesthetic sensation, etc.) configured to provide tactile feedback to the user. Figure 5B ; vibrotactile actuator). Sensor 521 and / or haptic device 576 may also be configured to operate in conjunction with a plurality of applications, including, but not limited to, health monitoring applications, social media applications, gaming applications, and artificial reality applications (e.g., applications associated with artificial reality).

[0148] As described above, the watch body 520 and the wearable band 510 can form the wrist wearable device 500 when coupled. When coupled, the watch body 520 and the wearable band 510 operate as a single device to perform the functions (operation, detection, communication, etc.) described herein. In some embodiments, specific instructions for performing one or more operations of the wrist wearable device 500 are provided to each device. For example, based on determining that the watch body 520 does not include a neuromuscular signal sensor, the wearable band 510 may include alternative instructions for executing related instructions (e.g., providing sensed neuromuscular signal data to the watch body 520 through a different electronic device). The operation of the wrist wearable device 500 can be performed by the watch body 520 alone or in combination with the wearable band 510 (e.g., via corresponding processors and / or hardware components), or vice versa. In some embodiments, the operation of the wrist wearable device 500, the watch body 520, and / or the wearable band 510 can be combined with another communication coupling device (e.g., HIPD 700; FIG. 7A to FIG. 7B) to execute by one or more processors and / or hardware components.

[0149] As referenced below Figure 5B As described in the block diagram of FIG. 5 , the wearable band 510 and / or the body 520 may each include independent resources required to independently perform functions. For example, the wearable band 510 and / or the body 520 may each include a power source (e.g., a battery), a memory, a data storage device, a processor (e.g., a central processing unit (CPU)), a communication device, a light source, and / or an input / output device.

[0150] Figure 5B A block diagram of computing system 530 corresponding to wearable band 510 and computing system 560 corresponding to watch body 520 is shown according to some embodiments. According to some embodiments, the computing system of wrist wearable device 500 includes a combination of components of computing system 530 of wearable band and components of computing system 560 of watch body.

[0151] The watch body 520 and / or the wearable band 510 may include one or more components shown in the computing system 560 of the watch body. In some embodiments, a single integrated circuit includes all or most of the components included in the computing system 560 of the watch body in a single integrated circuit. Alternatively, in some embodiments, the components of the computing system 560 of the watch body are included in multiple integrated circuits that are communicatively coupled. In some embodiments, the computing system 560 of the watch body is configured to couple (e.g., via a wired connection or a wireless connection) with the computing system 530 of the wearable band, which allows the computing systems (separately or as a single device) to share components, distribute tasks, and / or perform other operations described herein.

[0152] The computing system 560 of the watch body may include one or more processors 579, a controller 577, a peripheral device interface 561, a power system 595, and memory (e.g., memory 580), each of which is defined above and described in more detail below.

[0153] The power system 595 may include a charging input 596, a power management integrated circuit (Power-Management Integrated). The wearable band 510 may have respective charging inputs (e.g., charging inputs 596 and 557), respective batteries (e.g., batteries 598 and 559), and may share power with each other (e.g., the watch body 520 may power and / or charge the wearable band 510, and vice versa). Although the watch body 520 and / or the wearable band 510 may include respective charging inputs, when the two devices are coupled, a single charging input may charge both devices. The watch body 520 and the wearable band 510 may be connected using various techniques. In some embodiments, the watch body 520 and the wearable band 510 can be charged using a wired charging component (e.g., a power cord). Alternatively or additionally, the watch body 520 and / or the wearable band 510 can be configured for wireless charging. For example, a portable charging device can be designed to match a portion of the watch body 520 and / or the wearable band 510 and wirelessly deliver available power to the battery of the watch body 520 and / or the wearable band 510. The watch body 520 and the wearable band 510 can have independent power systems (e.g., power systems 595 and 556) to enable each to operate independently. The watch body 520 and the wearable band 510 can also share power (e.g., one can charge the other) via their respective PMICs (e.g., PMICs 597 and 558), which can share power through power and ground conductors and / or through wireless charging antennas.

[0154] In some embodiments, the peripheral device interface 561 may include one or more sensors 521, many of which are defined above. The sensor 521 may include one or more coupling sensors 562 for detecting when the watch body 520 is coupled to another electronic device (e.g., the wearable band 510). The sensor 521 may include an imaging sensor 563 (one or more cameras 525 and / or a separate imaging sensor 563 (e.g., a thermal imaging sensor)). In some embodiments, the sensor 521 includes one or more SpO2 sensors 564. In some embodiments, the sensor 521 includes one or more biopotential signal sensors (e.g., an EMG sensor 565 that may be provided on a user-facing portion of the watch body 520 and / or the wearable band 510). In some embodiments, the sensor 521 may include one or more capacitive sensors 566. In some embodiments, the sensor 521 includes one or more heart rate sensors 567. In some embodiments, the sensor 521 includes one or more IMUs 568. In some embodiments, the one or more IMUs 568 may be configured to detect movement of a user's hand or other positions where the watch body 520 is placed or held.

[0155] In some embodiments, the peripheral device interface 561 includes a Near-Field Communication (NFC) component 569, a Global Positioning System (GPS) component 570, a Long-Term Evolution (LTE) component 571, and / or a Wi-Fi and / or Bluetooth communication (WiFi / BT) component 572. In some embodiments, the peripheral device interface 561 includes one or more buttons 573 (e.g., Figure 5A 520 ), which, when selected by the user, cause operations to be performed at the watch body 520. In some embodiments, the peripheral device interface 561 includes one or more indicators, such as light emitting diodes (LEDs), to provide visual indications to the user (e.g., a message received, low battery, an active microphone and / or camera, etc.).

[0156] The watch body 520 may include at least one display 505 for displaying visual representations of information or data to the user, including user interface elements and / or three-dimensional virtual objects. The display may also include a touch screen for inputting user inputs, such as touch gestures, sliding gestures, etc. The watch body 520 may include at least one speaker 574 and at least one microphone 575 for providing audio signals to the user and receiving audio inputs from the user. The user may provide user inputs through the microphone 575 and may also receive audio output from the speaker 574 as part of the tactile events provided by the tactile controller 578. The watch body 520 may include at least one camera 525, including a front camera 525A and a rear camera 525B. The camera 525 may include an ultra-wide-angle camera, a wide-angle camera, a fisheye camera, a spherical camera, a telephoto camera, a depth sensing camera, or other types of cameras.

[0157] The computing system 560 of the watch body may include one or more haptic controllers 578 and associated components (e.g., haptic devices 576) for providing haptic events at the watch body 520 (e.g., vibration sensations or audio outputs in response to events at the watch body 520). The haptic controller 578 may communicate with one or more haptic devices 576, such as electroacoustic devices including one of the one or more speakers 574 and / or other audio components that convert energy into linear motion and / or electromechanical devices (e.g., electromechanical devices such as motors, solenoids, electroactive polymers, piezoelectric actuators, electrostatic actuators), or other tactile output generating components (e.g., components that convert electrical signals into tactile outputs on the device). The haptic controller 578 may provide haptic events that can be sensed by a user of the watch body 520. In some embodiments, the one or more haptic controllers 578 may receive input signals from one of the plurality of applications 582.

[0158] In some embodiments, computing system 530 and / or computing system 560 may include memory 580, which may be controlled by one or more controllers 577 and / or a memory controller in one or more processors 579. In some embodiments, the software components stored in memory 580 include one or more applications 582 configured to perform operations at the watch body 520. In some embodiments, the one or more applications 582 include games, word processors, messaging applications, call applications, web browsers, social media applications, media streaming applications, financial applications, calendars, clocks, etc. In some embodiments, the software components stored in memory 580 include one or more communication interface modules 583 as defined above. In some embodiments, the software components stored in memory 580 include one or more graphics modules 584 for presenting, encoding and / or decoding audio and / or video data; and one or more data management modules 585 for collecting, organizing and / or providing access to data 587 stored in memory 580. In some embodiments, one or more applications 582 and / or one or more modules may work in conjunction with each other to perform various tasks at the watch body 520.

[0159] In some embodiments, the software components stored in the memory 580 may include one or more operating systems 581 (e.g., Linux-based operating systems, Android operating systems, etc.). The memory 580 may also include data 587. The data 587 may include profile data 588A, sensor data 589A, media content data 590, and application data 591.

[0160] It should be understood that the computing system 560 of the watch body is an example of a computing system within the watch body 520, and that the watch body 520 may have more or fewer components, combine two or more components, and / or have a different configuration and / or arrangement of components than those shown in the computing system 560 of the watch body. The various components shown in the computing system 560 of the watch body are implemented in hardware, software, firmware, or a combination thereof, including one or more signal processing and / or application specific integrated circuits.

[0161] Turning to the computing system 530 of the wearable band, one or more components that may be included in the wearable band 510 are shown. The computing system 530 of the wearable band may include more or fewer components than those shown in the computing system 560 of the watch body, combine two or more components, and / or have a different construction and / or arrangement of some or all components. In some embodiments, all or most of the components of the computing system 530 of the wearable band are included in a single integrated circuit. Alternatively, in some embodiments, the components of the computing system 530 of the wearable band are included in multiple integrated circuits that are communicatively coupled. As described above, in some embodiments, the computing system 530 of the wearable band is configured to be coupled to the computing system 560 of the watch body (e.g., via a wired connection or a wireless connection), which allows these computing systems (individually or as a single device) to share components, distribute tasks, and / or perform other operations described herein.

[0162] The computing system 530 of the wearable band, similar to the computing system 560 of the watch body, may include one or more processors 549, one or more controllers 547 (including one or more tactile controllers 548), a peripheral device interface 531 (which may include one or more sensors 513 and other peripherals), a power source (e.g., a power system 556), and a memory (e.g., a memory 550), which includes an operating system (e.g., an operating system 551), data (e.g., data 554 including profile data 588B, sensor data 589B), and one or more modules (e.g., a communication interface module 552, a data management module 553, etc.).

[0163] Based on the above definition, the one or more sensors 513 may be similar to the sensor 521 of the computing system 560. For example, the sensor 513 may include one or more coupling sensors 532, one or more SpO2 sensors 534, one or more EMG sensors 535, one or more capacitive sensors 536, one or more heart rate sensors 537, and one or more IMUs 538.

[0164] Peripheral device interface 531 may also include other components similar to those included in peripheral device interface 561 of computing system 560, including NFC component 539, GPS component 540, LTE component 541, Wi-Fi and / or Bluetooth communication (WiFi / BT) component 542, and / or one or more haptic devices 576 as described above with reference to peripheral device interface 561. In some embodiments, peripheral device interface 531 includes one or more buttons 543, display 533, speaker 544, microphone 545, and camera 555. In some embodiments, peripheral device interface 531 includes one or more indicators, such as LEDs.

[0165] It should be understood that the computing system 530 for the wearable band is an example of a computing system inside the wearable band 510, and the wearable band 510 may have more or fewer components, combine two or more components, and / or have a different configuration and / or arrangement of components than those shown in the computing system 530 for the wearable band. The various components shown in the computing system 530 for the wearable band may be implemented in one or a combination of hardware, software, and firmware including one or more signal processing and / or application specific integrated circuits.

[0166] about Figure 5A The wrist wearable device 500 is an example of a coupled wearable band 510 and a watch body 520, and therefore, the wrist wearable device 500 will be understood to include the components shown and described for the computing system 530 of the wearable band and the computing system 560 of the watch body. In some embodiments, the wrist wearable device 500 has a split structure (e.g., a split mechanical structure, a split electrical structure) between the watch body 520 and the wearable band 510. In other words, all the components shown in the computing system 530 of the wearable band and the computing system 560 of the watch body can be accommodated or otherwise provided in the combined wrist wearable device 500 (e.g., a watch), or in various components of the watch body 520, the wearable band 510, and / or a portion of the wearable band (e.g., the coupling mechanism 516 of the wearable band 510).

[0167] The above technology can be used with any device for sensing neuromuscular signals (including FIG. 5A to FIG. 5B The invention is intended for use with an arm wearable device, but may also be used with other types of wearable devices for sensing neuromuscular signals (e.g., a body wearable device or a head wearable device that may have neuromuscular sensors closer to the brain or spine).

[0168] In some embodiments, the wrist wearable device 500 can be used in conjunction with the head wearable devices described below (e.g., AR device 600 and VR device 610) and / or HIPD 700; and, the wrist wearable device 500 can also be configured to allow the user to control aspects of the artificial reality (e.g., by using EMG-based gestures to control user interface objects in the artificial reality and / or by allowing the user to interact with a touch screen on the wrist wearable device to similarly control aspects of the artificial reality). In some embodiments, the wrist wearable device 500 can also be used in conjunction with wearable clothing (e.g., as described below with reference to FIG. 1 ). FIG. 8A to FIG. 8C Having thus described an exemplary wrist wearable device, attention is now directed to exemplary head wearable devices, such as AR device 600 and VR device 610.

[0169] Exemplary head wearable device

[0170] FIG. 6A to FIG. 6C 6 shows an exemplary head wearable device according to some embodiments. The head wearable device may include, but is not limited to, an AR device 600 (e.g., an AR or smart eye-wearing device, such as smart glasses, smart monocles, smart contact lenses, etc.), a VR device 610 (e.g., a VR head-mounted device, a head-mounted display (HMD), etc.), or other eye-coupling devices. The AR device 600 and the VR device 610 are reference Figure 1 The examples of head wearable devices described herein are such that the head wearable device should be understood to have features of the AR device 600 and / or the VR device 610, and vice versa. The AR device 600 and the VR device 610 can perform various functions and / or operations associated with browsing through a user interface and selectively opening applications, as well as performing such functions and / or operations.

[0171] In some embodiments, an AR system (e.g., AR systems 400a to 400d; Figure 4A to Figure 4D-2 ) includes an AR device 600 (such as Fig. 6A ) and / or VR device 610 (as shown Figure 6B-1 to Figure 6B-2 In some embodiments, the AR device 600 and the VR device 610 may include one or more simulation components (e.g., components for presenting an interactive artificial reality environment, such as a processor, a memory, and / or a presentation device including one or more displays and / or one or more waveguides), some of which will be referred to as Figure 6C The head wearable device may use a display projector (eg, display projector components 607A and 607B) and / or a waveguide to project data representations to a user. Some embodiments of the head wearable device do not include a display.

[0172] Fig. 6A An exemplary visual depiction of an AR device 600 (e.g., which may also be described herein as augmented reality glasses and / or smart glasses) is shown. The AR device 600 may be used with Fig. 6A 600) (e.g., wearable accessory devices and / or intermediate processing devices in electronic communication or otherwise configured for use with the AR device 600). In some embodiments, the wearable accessory device and / or intermediate processing device may be configured to couple with the AR device 600 via a coupling mechanism in electrical communication with a coupling sensor 624, where the coupling sensor 624 may detect when the electronic device becomes physically or electronically coupled with the AR device 600. In some embodiments, the AR device 600 may be configured to couple with a housing (e.g., a portion of the frame 604 or the temple arm 605), which may include one or more additional coupling mechanisms configured to couple with additional accessory devices. Fig. 6A The components shown in may be implemented in hardware, software, firmware, or a combination thereof, including one or more signal processing components and / or application specific integrated circuits (ASICs).

[0173] The AR device 600 includes mechanical eyeglass components including a frame 604 configured to hold one or more lenses (e.g., one or two lenses 606-1 and 606-2). It will be appreciated by those of ordinary skill in the art that the AR device 600 may include additional mechanical components, such as hinges configured to allow portions of the frame 604 of the AR device 600 to fold and unfold, a beam configured to span the gap between the lenses 606-1 and 606-2 and rest on the user's nose, a nose pad configured to rest on the nose bridge and provide support for the AR device 600, a footcuff configured to rest on the user's ear and provide additional support for the AR device 600, a temple arm 605 configured to extend from a hinge to the footcuff of the AR device 600, and the like. It will be further appreciated by those of ordinary skill in the art that some examples of the AR device 600 may not include any of the mechanical components described herein. For example, a smart contact lens configured to present an artificial reality to a user may not include any of the components of the AR device 600.

[0174] Lenses 606-1 and 606-2 can be separate displays or display devices (e.g., waveguides for projecting representations). Lenses 606-1 and 606-2 can act together or independently to present an image or a series of images to a user. In some embodiments, lenses 606-1 and 606-2 can operate in conjunction with one or more display projector assemblies 607A and 607B to present image data to a user. Although AR device 600 includes two displays, embodiments of the present disclosure can be implemented in an AR device having a single near-eye display (NED) or more than two NEDs.

[0175] The AR device 600 includes electronic components, many of which are described below with respect to FIG. Figure 6C Describe in more detail. Fig. 6A 6 shows some exemplary electronic components, including sensors 623-1, 623-2, 623-3, 623-4, 623-5, and 623-6 that can be distributed along most of the frame 604 of the AR device 600. Figure 6C The AR device 600 also includes a left camera 639A and a right camera 639B located on different sides of the frame 604. And the eye-mounted device includes one or more processors 648A and 648B (e.g., an integrated microprocessor such as an ASIC) embedded in a portion of the frame 604.

[0176] Figure 6B-1 and Figure 6B-2 An exemplary visual depiction of a VR device 610 (e.g., a head mounted display (HMD) 612, also referred to herein as an artificial reality head mounted device, a head wearable device, a VR head mounted device, etc.) is shown. The HMD 612 includes a front body 614 and a frame 616 (e.g., a strap or band) shaped to fit around a user's head. In some embodiments, the front body 614 and / or the frame 616 include one or more electronic components for facilitating presentation and / or interaction with an AR and / or VR system (e.g., a display, a processor (e.g., processor 648A-1), an IMU, a tracking transmitter or detector, a sensor, etc.). In some embodiments, the HMD 612 includes an output audio transducer (e.g., an output audio transducer 618), such as Figure 6B-2 In some embodiments, Figure 6B-2As shown, one or more components such as one or more output audio transducers 618 and frame 616 (e.g., part or all of frame 616 and / or output audio transducer 618) can be configured to be attached and detached (e.g., detachably attached) from HMD 612. In some embodiments, coupling the detachable component to HMD 612 enables the detachable component to be in electronic communication with HMD 612. VR device 610 includes electronic components, many of which will be discussed below with respect to Figure 6C Describe in more detail.

[0177] Figure 6B-1 to Figure 6B-2 VR device 610 is also shown with one or more cameras, such as left camera 639A and right camera 639B, which can be similar to the left camera and right camera on frame 604 of AR device 600. In some embodiments, VR device 610 includes one or more additional cameras (e.g., cameras 639C and 639D), which can be configured to enhance the image data obtained by cameras 639A and 639B by providing more information. For example, camera 639C can be used to provide color information that cameras 639A and 639B cannot recognize. In some embodiments, one or more of cameras 639A to 639D can include an optional infrared (IR) cut filter that is configured to remove IR light received at the corresponding camera sensor.

[0178] The VR device 610 may include a housing 690 that stores one or more components of the VR device 610 and / or additional components of the VR device 610. The housing 690 may be a modular electronic device configured to couple with the VR device 610 (or AR device 600) and supplement and / or expand the capabilities of the VR device 610 (or AR device 600). For example, the housing 690 may include additional sensors, cameras, power supplies, processors (e.g., processor 648A-2), etc. that improve and / or increase the functionality of the VR device 610. Figure 6C Examples of different components included in housing 690 are described.

[0179] Alternatively or additionally, in some embodiments, the head wearable device such as the VR device 610 and / or the AR device 600 includes or is communicatively coupled to another external device (e.g., a paired device), the other external device being, for example, the HIPD 700 (hereinafter referred to as the HIPD 700). FIG. 7A to FIG. 7BDiscussion) and / or an optional neckband. The optional neckband can be coupled to the head wearable device via one or more connectors (e.g., a wired connector or a wireless connector). The head wearable device and the neckband can operate independently without any wired connection or wireless connection between them. In some embodiments, components of the head wearable device and components of the neckband can be located on one or more additional peripheral devices, a neckband, or some combination thereof that are paired with the head wearable device. In addition, the neckband is intended to represent any suitable type or form of paired device. Therefore, the following discussion of the neckband can also be applied to various other paired devices, such as smart watches, smart phones, wristbands, other wearable devices, handheld controllers, tablet computers, or laptop computers.

[0180] In some cases, pairing an external device such as an intermediate processing device (e.g., HIPD 700, an optional neckband, and / or a wearable accessory device) with a head wearable device (e.g., AR device 600 and / or VR device 610) enables the head wearable device to achieve a form factor similar to a pair of glasses and still provide sufficient battery power and computing power for expanded capabilities. Some or all of the battery power, computing resources, and / or additional features of the head wearable device can be provided by the paired device, or shared between the paired device and the head wearable device, thereby reducing the weight, thermal distribution, and form factor of the head wearable device as a whole, while still allowing the head wearable device to retain its desired functionality. For example, the intermediate processing device (e.g., HIPD 700) can allow components that were originally included in the head wearable device to be included in the intermediate processing device (and / or wearable device or accessory device), thereby shifting the weight load from the user's head and neck to one or more other parts of the user's body. In some embodiments, the intermediate processing device has a large surface area over which to diffuse and disperse heat to the surrounding environment. Thus, the intermediate processing device may allow for greater battery power and computing power than a standalone head wearable device. Because the weight carried in the intermediate processing device is less intrusive to the user than the weight carried in the head wearable device, the user may tolerate wearing a lighter eye-mounted device and carrying or wearing a paired device for longer periods of time than the user would tolerate wearing a heavier eye-mounted device alone, thereby enabling the user to more fully integrate the artificial reality environment into their daily activities.

[0181] In some embodiments, the intermediate processing device is communicatively coupled to the head wearable device and / or other devices. These other devices can provide certain functions (e.g., tracking, positioning, depth map construction, processing, storage, etc.) for the head wearable device. In some embodiments, the intermediate processing device includes a controller and a power supply. In some embodiments, the sensors of the intermediate processing device are configured to sense additional data that can be shared with the head wearable device in an electronic format (analog or digital).

[0182] The controller of the intermediate processing device processes information generated by the intermediate processing device and / or sensors on the head wearable device. An intermediate processing device such as HIPD 700 can process information generated by one or more of its sensors and / or information provided by other communication coupling devices. For example, the head wearable device may include an IMU, and the intermediate processing device (neckband and / or HIPD 700) can calculate all inertial and spatial operations from the IMU located on the head wearable device. Fig. 7A and Figure 7B Additional examples of processing performed by a communicatively coupled device such as HIPD 700 are provided.

[0183] The artificial reality system may include various types of visual feedback mechanisms. For example, the display device in the AR device 600 and / or the display device in the VR device 610 may include one or more liquid crystal displays (LCD), light emitting diodes (LED) displays, organic LED (OLED) displays, and / or any other suitable type of display screen. The artificial reality system may include a single display screen for both eyes, or a display screen may be provided for each eye, which may provide additional flexibility for zoom adjustment or correction of refractive errors associated with user vision. Some artificial reality systems also include an optical subsystem having one or more lenses (e.g., conventional concave or convex lenses, Fresnel lenses, or adjustable liquid lenses), through which the user can view the display screen. In addition to or instead of using a display screen, some artificial reality systems include one or more projection systems. For example, the display device in the AR device 600 and / or the display device in the VR device 610 may include a micro-LED projector (e.g., using a waveguide) that projects light into the display device, such as a transparent combiner lens that allows ambient light to pass through. The display device can refract the projected light toward the user's pupil, and can enable the user to view both the artificial reality content and the real world at the same time. The artificial reality system can also be configured with any other suitable type or form of image projection system. As described above, some AR systems can essentially replace one or more sensory perceptions of the user's real world with a virtual experience, rather than combining artificial reality with actual reality.

[0184] Although the exemplary head wearable devices are described herein as AR device 600 and VR device 610, respectively, either or both of the exemplary head wearable devices described herein may be configured to present a fully immersive VR scene presented in substantially all of the user's field of view, and additionally or alternatively, a more subtle augmented reality scene presented within a portion (less than all) of the user's field of view.

[0185] In some embodiments, the AR device 600 and / or the VR device 610 may include a tactile feedback system. The tactile feedback system can provide various types of skin feedback, including vibration, force, traction, shear, texture and / or temperature. The tactile feedback system can also provide various types of kinesthetic feedback, such as motion and compliance. Tactile feedback can be implemented using motors, piezoelectric actuators, fluid systems and / or various other types of feedback mechanisms. The tactile feedback system can be implemented independently of other artificial reality devices, implemented in other artificial reality devices, and / or with other artificial reality devices (e.g., wrist wearable devices that can be integrated into headwear, gloves, tights, handheld controllers, environmental devices (e.g., chairs or foot pads), and / or any other type of device or system (such as wrist wearable devices 500, HIPD 700, clothing based on smart textiles 800, etc.) and / or other devices described herein are implemented in combination.

[0186] Figure 6C A computing system 620 and an optional housing 690 are shown, each of which illustrates components that may be included in a head wearable device (e.g., AR device 600 and / or VR device 610). In some embodiments, more or fewer components may be included in the optional housing 690, depending on the practical constraints of the respective head wearable device described. Additionally or alternatively, the optional housing 690 may include additional components that expand and / or enhance the functionality of the head wearable device.

[0187] In some embodiments, computing system 620 and / or optional housing 690 may include one or more peripheral device interfaces 622A and 622B, one or more power systems 642A and 642B (including charging input 643, PMIC 644, and battery 645), one or more controllers 646A and 646B (including one or more haptic controllers 647), one or more processors 648A and 648B (as defined above, including any of those examples provided), and memory 650A and 650B, all of which may be in electronic communication with each other. For example, one or more processors 648A and / or 648B may be configured to execute instructions stored in memory 650A and / or 650B, which instructions may cause a controller in one or more controllers 646A and / or 646B to cause operations to be performed at one or more peripheral devices of peripheral device interfaces 622A and / or 622B. In some embodiments, each of the operations described may occur based on power provided by power systems 642A and / or 642B.

[0188] In some embodiments, peripheral device interface 622A may include one or more devices configured as part of computing system 620, many of which have been described above with respect to Figure 5A and Figure 5B The wrist wearable device shown is defined and / or described. For example, the peripheral device interface can include one or more sensors 623A. Some exemplary sensors include: one or more coupling sensors 624, one or more acoustic sensors 625, one or more imaging sensors 626, one or more EMG sensors 627, one or more capacitive sensors 628, and / or one or more IMUs 629. In some embodiments, the sensor 623A also includes a depth sensor 667, a light sensor 668, and / or any other type of sensor defined above or described with respect to any other embodiment discussed herein.

[0189] In some embodiments, the peripheral device interface may include one or more additional peripheral devices, including one or more NFC devices 630, one or more GPS devices 631, one or more LTE devices 632, one or more WiFi and / or Bluetooth (WiFi / BT) devices 633, one or more buttons 634 (e.g., including slidable or otherwise adjustable buttons), one or more displays 635A, one or more speakers 636A, one or more microphones 637A, one or more cameras 638A (e.g., including a first camera 639-1 to an nth camera 639-n similar to a left camera 639A and / or a right camera 639B), one or more tactile devices 640, and / or any other type of peripheral device defined above or described with respect to any other embodiments discussed herein.

[0190] The head wearable device may include various types of visual feedback mechanisms (e.g., presentation devices). For example, the display device in the AR device 600 and / or the display device in the VR device 610 may include one or more liquid crystal displays (LCDs), light emitting diode (LED) displays, organic LED (OLED) displays, micro-LEDs, and / or any other suitable type of display screen. The head wearable device may include a single display screen (e.g., configured to be viewed by both eyes), and / or a separate display screen may be provided for each eye, which may provide additional flexibility for zoom adjustment or correction of refractive errors associated with user vision. Some embodiments of the head wearable device also include an optical subsystem having one or more lenses (e.g., conventional concave or convex lenses, Fresnel lenses, or adjustable liquid lenses), through which the user can view the display screen. For example, each display 635A may be coupled to each of the lenses 606-1 and 606-2 of the AR device 600. The display 635A coupled to each of the lenses 606-1 and 606-2 may act together or independently to present an image or a series of images to the user. In some embodiments, the AR device 600 and / or VR device 610 includes a single display 635A (e.g., a near-eye display) or more than two displays 635A.

[0191] In some embodiments, the first group of one or more displays 635A can be used to present an augmented reality environment, and the second group of one or more display devices 635A can be used to present a virtual reality environment. In some embodiments, one or more waveguides are used in conjunction with presenting artificial reality content to a user of the AR device 600 and / or VR device 610 (e.g., as a means of delivering light from a display projector assembly and / or one or more displays 635A to the user's eyes). In some embodiments, one or more waveguides are fully or partially integrated into the AR device 600 and / or VR device 610. In addition to or instead of using a display screen, some artificial reality systems may include one or more projection systems. For example, a display device in the AR device 600 and / or a display device in the VR device 610 may include (e.g., using a waveguide) a micro-LED projector that projects light into the display device, such as a transparent combiner lens that allows ambient light to pass through. The display device can refract the projected light toward the user's pupil, and can enable the user to simultaneously view both artificial reality content and the real world. The head wearable device may also be configured with any other suitable type or form of image projection system. In some embodiments, one or more waveguides are provided to one or more displays 635A in addition or alternatively.

[0192] In some embodiments of the head wearable device, ambient light and / or a real-world real-time view (e.g., a real-time feed of the surrounding environment that a user would normally see) can pass through display elements of the corresponding head wearable device that presents aspects of the AR system. In some embodiments, the ambient light and / or the real-world real-time view can pass through a portion (not all) of the AR environment presented within the user's field of view (e.g., a portion of the AR environment is co-located with physical objects in the user's real-world environment, and the user's real-world environment is within a specified boundary (e.g., a guardian boundary) configured to be used by the user when interacting with the AR environment). For example, a visual user interface element (e.g., a notification user interface element) can be presented at the head wearable device, and a certain amount of ambient light and / or real-world real-time view (e.g., 15%-50% of the ambient light and / or real-world real-time view) can pass through the user interface element so that the user can distinguish at least a portion of the physical environment on which the user interface element is displayed.

[0193] The head wearable device may include one or more external displays 635A for presenting information to the user. For example, the external display 635A may be used to display the current battery level, network activity (e.g., connected, disconnected, etc.), current activity (e.g., playing games, talking, meeting, watching movies, etc.), and / or other relevant information. In some embodiments, the external display 635A may be used to communicate with other elements. For example, a user of the head wearable device may cause the external display 635A to present a do not disturb notification. The user may also use the external display 635A to share any information collected by one or more components of the peripheral device interface 622A and / or generated by the head wearable device (e.g., during the operation and / or execution of one or more applications).

[0194] The memory 650A may include instructions and / or data that may be executed by one or more processors 648A (and / or processor 648B of housing 690) and / or a memory controller of one or more controllers 646A (and / or controller 646B of housing 690). The memory 650A may include one or more operating systems 651, one or more applications 652, one or more communication interface modules 653A, one or more graphics modules 654A, one or more AR processing modules 655A, and / or any other type of module or component defined above or described with respect to any other embodiment discussed herein.

[0195] The data 660 stored in the memory 650A may be used in conjunction with one or more of the applications and / or programs discussed above. The data 660 may include profile data 661, sensor data 662, media content data 663, AR application data 664, and / or any other type of data defined above or described with respect to any other embodiment discussed herein.

[0196] In some embodiments, the controller 646A of the head wearable device processes information generated by the sensor 623A on the head wearable device and / or another component of the head wearable device and / or another component communicatively coupled to the head wearable device (e.g., a component of the housing 690, such as a component of the peripheral device interface 622B). For example, the controller 646A can process information from the acoustic sensor 625 and / or the imaging sensor 626. For each detected sound, the controller 646A can perform a Direction-Of-Arrival (DOA) estimate to estimate the direction from which the detected sound arrived at the head wearable device. When one or more acoustic sensors 625 detect a sound, the controller 646A can populate an audio data set with information (e.g., represented by sensor data 662).

[0197] In some embodiments, a physical electronic connector can transmit information between a head wearable device and another electronic device, and / or between one or more processors 648A and a controller 646A of a head wearable device. This information can be in the form of optical data, electrical data, wireless data, or any other transmittable data form. Moving the processing of information generated by the head wearable device to an intermediate processing device can reduce weight and heat in the eye-mounted device, making the eye-mounted device more comfortable and safer for the user. In some embodiments, an optional accessory device (e.g., an electronic neckband or HIPD 700) is coupled to the head wearable device via one or more connectors. The connector can be a wired connector or a wireless connector, and can include electronic components and / or non-electronic (e.g., structural) components. In some embodiments, the head wearable device and the accessory device can operate independently without any wired or wireless connection between them.

[0198] The head wearable device may include various types of computer vision components and subsystems. For example, the AR device 600 and / or the VR device 610 may include one or more optical sensors, such as a two-dimensional (2D) camera or a three-dimensional (3D) camera, a time-of-flight depth sensor, a single-beam or scanning laser rangefinder, a 3D laser radar (LiDAR) sensor, and / or any other suitable type or form of optical sensor. The head wearable device may process data from one or more of these sensors to identify the user's location and / or various aspects of the user's real-world physical environment, including the location of real-world objects in the real-world physical environment. In some embodiments, the methods described herein are used to map the real world, provide context to the user about the real-world environment, and / or generate interactive virtual objects (which may be replicas or digital twins of real-world objects that can be interacted with in an AR environment), as well as various other functions. For example, Figure 6B-1 and Figure 6B-2 A VR device 610 is shown having cameras 639A to 639D that can be used to provide depth information for creating a voxel field and a two-dimensional grid to provide object information to the user for collision avoidance.

[0199] The optional housing 690 may include components similar to those described above with respect to the computing system 620. For example, the optional housing 690 may include a corresponding peripheral device interface 622B, which includes more or fewer components than those described above with respect to the peripheral device interface 622A. As described above, the components of the optional housing 690 may be used to enhance and / or expand the functionality of the head wearable device. For example, the optional housing 690 may include corresponding sensors 623B, speakers 636B, displays 635B, microphones 637B, cameras 638B, and / or other components for collecting and / or presenting data. Similarly, the optional housing 690 may include one or more processors 648B, controllers 646B, and / or memories 650B (including corresponding communication interface modules 653B; one or more graphics modules 654B; one or more AR processing modules 655B, etc.), and one or more processors, controllers, and / or memories may be used alone and / or in combination with components of the computing system 620.

[0200] The above FIG. 6A to FIG. 6C The techniques described in the foregoing can be used with different head wearable devices. In some embodiments, the head wearable device (e.g., AR device 600 and / or VR device 610) can be used with a wrist wearable device 500 (or its components) and / or a smart textile-based garment 800 ( FIG. 8A to FIG. 8C) and one or more wearable devices and HIPD 700. Having thus described an example of a head wearable device, attention is now turned to an exemplary handheld intermediate processing device such as HIPD 700.

[0201] Exemplary Handheld Intermediate Processing Device

[0202] Fig. 7A and Figure 7B An exemplary handheld intermediate processing device (HIPD) 700 is shown in accordance with some embodiments. The HIPD 700 may perform various functions and / or operations associated with navigating through a user interface and selectively opening applications, etc., and performing such functions and / or operations.

[0203] Fig. 7A A top view 705 and a side view 725 of the HIPD 700 are shown. The HIPD 700 is configured to communicatively couple to one or more wearable devices (or other electronic devices) associated with a user. For example, the HIPD 700 is configured to communicatively couple to the user's wrist wearable device 500 (or components thereof, such as the watch body 520 and the wearable band 510), the AR device 600, and / or the VR device 610. The HIPD 700 can be configured to be held by the user (e.g., as a handheld controller), carried on the user's person (e.g., in their pocket, in their bag, etc.), placed near the user (e.g., placed on their desk when sitting at their desk, on a charging base, etc.), and / or placed at or within a predetermined distance from the wearable device or other electronic device (e.g., in some embodiments, the predetermined distance is the maximum distance at which the HIPD 700 can successfully communicatively couple to an electronic device such as a wearable device (e.g., 10 meters)).

[0204] HIPD 700 can perform various functions independently and / or in combination with one or more wearable devices (e.g., wrist wearable device 500, AR device 600, VR device 610, etc.). HIPD 700 is configured to increase and / or improve the functionality of communication coupling devices such as wearable devices. HIPD 700 is configured to perform one or more functions or operations associated with: interacting with the user interface and application of the communication coupling device, interacting with the AR environment, interacting with the VR environment, and / or operating as a human-machine interface controller. In addition, as will be described in more detail below, the functions and / or operations of HIPD 700 may include, but are not limited to, task offloading and / or handover; hot offloading and / or handover; 6 degrees of freedom (6DoF) ray casting and / or gaming (e.g., using imaging devices or cameras 714A and 714B, which may be used for simultaneous localization and mapping (SLAM) and / or for use with other image processing techniques); portable charging; messaging; image acquisition via one or more imaging devices or cameras (e.g., cameras 722A and 722B); sensing user input (e.g., sensing touch on multi-touch input surface 702); wireless communication and / or interconnection (e.g., cellular, near field, Wi-Fi, personal area network, etc.); location determination; financial transactions; providing tactile feedback; alarms; notifications; biometric authentication; health monitoring; sleep monitoring, etc. The above exemplary functions may be performed independently in HIPD 700 and / or in communication between HIPD 700 and another wearable device described herein. In some embodiments, functions may be performed in conjunction with an AR environment on the HIPD 700. As will be appreciated by those skilled in the art upon reading the description provided herein, the novel HIPD 700 described herein may be used with any type of suitable AR environment.

[0205] When the HIPD 700 is communicatively coupled with a wearable device and / or other electronic device, the HIPD 700 is configured to perform one or more operations initiated at the wearable device and / or other electronic device. In particular, one or more operations of the wearable device and / or other electronic device can be offloaded to the HIPD 700 for execution. The HIPD 700 performs one or more operations of the wearable device and / or other electronic device, and provides data corresponding to the completed operation to the wearable device and / or other electronic device. For example, a user can initiate a video stream using an AR device 600, and can offload back-end tasks (e.g., video rendering) associated with executing the video stream to the HIPD 700, which performs the back-end tasks and provides corresponding data to the AR device 600 to perform the remaining front-end tasks associated with the video stream (e.g., presenting rendered video data via a display of the AR device 600). In this way, a HIPD 700 with more computing resources and greater thermal headroom than a wearable device can perform computationally intensive tasks for the wearable device, thereby improving the performance of the operations performed by the wearable device.

[0206] HIPD 700 includes a multi-touch input surface 702 located on a first side (e.g., a front surface), and the multi-touch input surface is configured to detect one or more user inputs. In particular, the multi-touch input surface 702 can detect single-click input, multi-click input, sliding gesture and / or input, force-based and / or pressure-based touch input, maintained click, etc. The multi-touch input surface 702 is configured to detect capacitive touch input and / or force (and / or pressure) touch input. The multi-touch input surface 702 includes a first touch input surface 704 defined by a surface depression and a second touch input surface 706 defined by a substantially flat portion. The first touch input surface 704 can be arranged adjacent to the second touch input surface 706. In some embodiments, the first touch input surface 704 and the second touch input surface 706 can have different sizes, shapes, and / or cover different parts of the multi-touch input surface 702. For example, the first touch input surface 704 can be substantially circular, and the second touch input surface 706 can be substantially rectangular. In some embodiments, the surface depression of the multi-touch input surface 702 is configured to guide the user to handle the HIPD 700. In particular, the surface depression is configured so that the user holds the HIPD 700 vertically when holding the HIPD 700 in one hand (e.g., so that the imaging device or camera 714A and 714B being used is pointed at the ceiling or the sky). In addition, the surface depression is configured so that the user's thumb is located within the first touch input surface 704.

[0207] In some embodiments, different touch input surfaces include multiple touch input areas. For example, the second touch input surface 706 includes at least a first touch input area 708 located within the second touch input area 706 and a third touch input area 710 located within the first touch input area 708. In some embodiments, one or more of these touch input areas are optional and / or defined by the user (for example, the user can specify the touch input area based on their preferences). In some embodiments, each touch input surface and / or touch input area is associated with a predetermined command set. For example, the user input detected in the first touch input area 708 causes the HIPD 700 to execute a first command, while the user input detected in the second touch input area 706 causes the HIPD 700 to execute a second command different from the first command. In some embodiments, different touch input surfaces and / or touch input areas are configured to detect one or more types of user input. Different touch input surfaces and / or touch input areas can be configured to detect the same or different types of user input. For example, the first touch input region 708 may be configured to detect force touch input (eg, magnitude of a user's press) and capacitive touch input, and the second touch input region 706 may be configured to detect capacitive touch input.

[0208] The HIPD 700 includes one or more sensors 751 for sensing data used in performing one or more operations and / or functions. For example, the HIPD 700 may include an IMU that is used in conjunction with the cameras 714A, 714B for three-dimensional object manipulation (e.g., enlarging an object, moving an object, destroying an object, etc.) in an AR or VR environment. Non-limiting examples of the sensors 751 included in the HIPD 700 include light sensors, magnetometers, depth sensors, pressure sensors, and force sensors. Figure 7B Additional examples of sensor 751 are provided.

[0209] HIPD 700 may include one or more light indicators 712 that provide one or more notifications to the user. In some embodiments, the light indicator is an LED or other type of lighting device. The light indicator 712 can be used as a privacy light that notifies the user and / or other people near the user that the imaging device and / or microphone are active. In some embodiments, the light indicator is located near one or more touch input surfaces. For example, a light indicator can be placed around the first touch input surface 704. The light indicator can be illuminated in different colors and / or patterns to provide the user with one or more notifications and / or information about the device. For example, the light indicator located around the first touch input surface 704 can flash when the user receives a notification (e.g., a message), turn red when the HIPD 700 is out of power, operate as a progress bar (e.g., a light ring that turns off when a task is completed (e.g., 0% to 100%)), operate as a volume indicator, and the like.

[0210] In some embodiments, HIPD 700 includes one or more additional sensors located on another surface. Fig. 7A As shown, the HIPD 700 includes one or more sensors (e.g., sensor group 720) located on the edge of the HIPD 700. When the sensor group 720 is located on the edge of the HIPD 700, the sensor group 720 can be positioned at a predetermined tilt angle (e.g., 26 degrees), which allows the sensor group 720 to be tilted toward the user when placed on a table or other flat surface. Alternatively, in some embodiments, the sensor group 720 is located on the surface opposite to the multi-touch input surface 702 (e.g., the back). One or more sensors in the sensor group 720 will be discussed in detail below.

[0211] The side view 725 of HIPD 700 shows sensor group 720 and camera 714B. Sensor group 720 includes one or more cameras 722A and 722B, depth projector 724, ambient light sensor 728 and depth receiver 730. In some embodiments, sensor group 720 includes light indicator 726. Light indicator 726 can be used as a private indicator to let users and / or people around them know that the camera and / or microphone are active. Sensor group 720 is configured to capture the user's facial expressions so that the user can imitate a customized avatar (e.g., displaying emotions such as smiles, laughs, etc. on the avatar or the user's digital image). Sensor group 720 can be configured as a side stereo RGB system, a rear indirect time of flight (indirect Time-of-Flight, iToF) system or a rear stereo RGB system. As those skilled in the art will understand when reading the description provided herein, the novel HIPD 700 described herein can use different sensor group 720 structures and / or sensor group 720 placements.

[0212] In some embodiments, the HIPD 700 includes one or more haptic devices 771 ( Figure 7B ; e.g., a vibrotactile actuator). Sensor 751 and / or haptic device 771 may be configured to operate in conjunction with a plurality of applications and / or communicatively coupled devices, including but not limited to wearable devices, health monitoring applications, social media applications, gaming applications, and artificial reality applications (e.g., applications related to artificial reality).

[0213] HIPD 700 is configured to operate without a display. However, in an alternative embodiment, HIPD 700 may include a display 768 ( Figure 7B ). HIPD 700 may also include one or more optional peripheral buttons 767 ( Figure 7B ). For example, the peripheral button 767 can be used to turn the HIPD 700 on or off. In addition, the housing of the HIPD 700 can be formed of a polymer and / or an elastomer. The HIPD 700 can be configured to have a non-slip surface that allows the HIPD 700 to be placed on a surface without the user having to look after the HIPD 700. In other words, the HIPD 700 is designed so that it does not easily slip off the surface. In some embodiments, the HIPD 700 includes one or more magnets that couple the HIPD 700 to another surface. This allows the user to mount the HIPD 700 to different surfaces and provides the user with greater flexibility when using the HIPD 700.

[0214] As described above, the HIPD 700 may distribute and / or provide instructions for performing one or more tasks at the HIPD 700 and / or the communication coupling device. For example, the HIPD 700 may identify one or more back-end tasks to be performed by the HIPD 700, and one or more front-end tasks to be performed by the communication coupling device. Although the HIPD 700 is configured to offload and / or hand over tasks to the communication coupling device, the HIPD 700 may (e.g., via one or more processors, such as a central processing unit (CPU) 777; Figure 7B ) performs back-end tasks and front-end tasks. The HIPD 700 may be used, but is not limited to, to perform enhanced calls (e.g., receiving and / or sending 3D or 2.5D real-time volumetric calls, real-time digital human figure calls, and / or avatar calls), discreet messaging, 6DoF portrait / landscape games, AR / VR object manipulation, AR / VR content display (e.g., presenting content via a virtual display), and / or other AR / VR interactions. The HIPD 700 may perform the above operations alone or in combination with a wearable device (or other communicatively coupled electronic device).

[0215] Figure 7B A block diagram of a computing system 740 of a HIPD 700 according to some embodiments is shown. The HIPD 700 described in detail above may include one or more components shown in the computing system 740 of the HIPD. The HIPD 700 will be understood to include the components of the computing system 740 for the HIPD shown and described below. In some embodiments, all or most of the components of the computing system 740 of the HIPD are included in a single integrated circuit. Alternatively, in some embodiments, the components of the computing system 740 of the HIPD are included in multiple integrated circuits that are communicatively coupled.

[0216] The computing system 740 of the HIPD may include a processor (e.g., a CPU 777, a GPU, and / or a CPU with integrated graphics), a controller 775, a peripheral device interface 750 including one or more sensors 751 and other peripheral devices, a power source (e.g., a power system 795), and a memory (e.g., a memory 778), the memory including an operating system (e.g., an operating system 779), data (e.g., data 788), one or more applications (e.g., an application 780), and one or more modules (e.g., a communication interface module 781, a graphics module 782, a task and processing management module 783, an interoperability module 784, an AR processing module 785, a data management module 786, etc.). The computing system 740 of the HIPD also includes a power system 795, which includes a charging input / output terminal 796, a PMIC 797, and a battery 798, all of which are defined above.

[0217] In some embodiments, the peripheral device interface 750 may include one or more sensors 751. The sensor 751 may include the same Figure 5B For example, sensors 751 may include imaging sensors 754, (optional) EMG sensors 756, IMUs 758, and capacitive sensors 760. In some embodiments, sensors 751 may include one or more pressure sensors 752 for sensing pressure data, an altimeter 753 for sensing the height of HIPD 700, a magnetometer 755 for sensing magnetic fields, a depth sensor 757 (or a time-of-flight sensor) for determining the difference between a camera and an image object, a position sensor 759 (e.g., a flexible position sensor) for sensing a relative displacement or change in position of a portion of HIPD 700, a force sensor 761 for sensing a force applied to a portion of HIPD 700, and a light sensor 762 for detecting the amount of illumination (e.g., an ambient light sensor). Sensors 751 may include Figure 7B One or more sensors not shown.

[0218] Reference to above Figure 5B Similar to the peripheral devices described above, the peripheral device interface 750 may also include an NFC component 763, a GPS component 764, an LTE component 765, a Wi-Fi and / or Bluetooth communication (WiFi / BT) component 766, a speaker 769, a tactile device 771, and a microphone 773. Fig. 7A As described above, HIPD 700 may optionally include a display 768 and / or one or more buttons 767. Peripheral device interface 750 may also include one or more cameras 770, a touch surface 772, and / or one or more light emitters 774. Fig. 7AThe multi-touch input surface 702 described is an example of a touch surface 772. The light emitter 774 may be one or more LEDs, lasers, etc., and the light emitter 774 may be used to project or present information to a user. For example, the light emitter 774 may include the light emitter 774 described above. Fig. 7A The light indicators 712 and 726 described above. Fig. 7A The cameras 714A, 714B and 722A, 722B described in the figure may include one or more wide-angle cameras, fisheye cameras, spherical cameras, compound eye cameras (e.g., stereo cameras and multi-cameras), depth cameras, RGB cameras, ToF cameras, RGB-D cameras (depth cameras and ToF cameras) and / or other available cameras. Camera 770 can be used for SLAM; 6DoF ray casting, gaming, object manipulation and / or other rendering; facial recognition and facial expression recognition, etc.

[0219] Similar to the above reference Figure 5B 1. With reference to the depicted computing system 560 of the body and computing system 530 of the wearable band, the computing system 740 of the HIPD may include one or more haptic controllers 776 and associated components (eg, haptic devices 771) for providing haptic events at the HIPD 700.

[0220] The memory 778 may include high-speed random access memory and / or non-volatile memory, such as one or more disk storage devices, flash memory devices or other non-volatile solid-state storage devices. The access of other components of the HIPD 700 (e.g., one or more processors and the peripheral device interface 750) to the memory 778 may be controlled by the memory controller of the controller 775.

[0221] In some embodiments, the software components stored in the memory 778 include one or more operating systems 779, one or more application programs 780, one or more communication interface modules 781, one or more graphics modules 782, and one or more data management modules 786, which are similar to those described above with reference to FIG. Figure 5B Describes the software component.

[0222] In some embodiments, the software components stored in the memory 778 include a task and process management module 783 for identifying one or more front-end and back-end tasks associated with an operation performed by a user, executing one or more front-end and / or back-end tasks, and / or providing instructions to one or more communication-coupled devices that cause the execution of one or more front-end and / or back-end tasks. In some embodiments, the task and process management module 783 uses data 788 (e.g., device data 790) to distribute one or more front-end and / or back-end tasks based on the computing resources, available power, thermal headroom, ongoing operations, and / or other factors of the communication-coupled devices. For example, the task and process management module 783 can cause the execution of one or more back-end tasks (operations performed at the communication-coupled AR device 600) at the HIPD 700 based on determining that the operation is utilizing a predetermined amount (e.g., at least 70%) of the computing resources available at the AR device 600.

[0223] In some embodiments, the software components stored in the memory 778 include an interoperability module 784 for exchanging and utilizing information received and / or provided to different communication coupling devices. The interoperability module 784 allows different systems, devices, and / or applications to connect and communicate in a coordinated manner without user input. In some embodiments, the software components stored in the memory 778 include an AR processing module 785, which is configured to process signals based on at least sensor data used in an AR and / or VR environment. For example, the AR processing module 785 can be used for 3D object manipulation, gesture recognition, facial recognition, and facial expression recognition, etc.

[0224] The memory 778 may also include data 788, which includes structured data. In some embodiments, the data 788 may include profile data 789, device data 790 (including device data of one or more devices communicatively coupled to the HIPD 700, such as device type, hardware, software, configuration, etc.), sensor data 791, media content data 792, and application data 793.

[0225] It should be understood that the computing system 740 of the HIPD is an example of a computing system within the HIPD 700, and that the HIPD 700 may have more or fewer components, combine two or more components, and / or have a different configuration and / or arrangement of components than those shown in the computing system 740 of the HIPD. The various components shown in the computing system 740 of the HIPD are implemented in hardware, software, firmware, or a combination thereof, including one or more signal processing and / or application specific integrated circuits.

[0226] The above FIG. 7A to FIG. 7BThe techniques described in the can be used with any device used as a human-machine interface controller. In some embodiments, the HIPD 700 can be used in conjunction with one or more wearable devices such as head wearable devices (e.g., AR device 600 and VR device 610) and / or wrist wearable device 500 (or its components). In some embodiments, the HIPD 700 can also be used in conjunction with wearable clothing, such as smart textile-based clothing 800 ( FIG. 8A to FIG. 8C ). Having thus described an exemplary HIPD 700, attention is now turned to an exemplary feedback device, such as a smart textile-based garment 800.

[0227] Exemplary smart textile-based clothing

[0228] Fig. 8A and Figure 8B An exemplary smart textile-based garment according to some embodiments is shown. Smart textile-based garment 800 (e.g., wearable gloves, shirts, headbands, wristbands, socks, etc.) is configured to be communicatively coupled to one or more electronic devices, such as wrist wearable devices 500, head wearable devices, HIPD 700, laptop computers, tablet computers, and / or other computing devices. Smart textile-based garment 800 can perform various functions and / or operations associated with browsing through a user interface and selectively opening applications, as well as performing these functions and / or operations.

[0229] The smart textile-based garment 800 may be an AR system (e.g., Figure 4D-1 and Figure 4D-2 The smart textile-based garment 800 is also configured to provide feedback (e.g., tactile feedback or other haptic feedback) to the user based on the user's interaction with the computing system (e.g., navigation of a user interface, operation of an application (e.g., game vibrations, media responsive haptics), device notifications, etc.) and / or the user's interaction within the AR environment. In some embodiments, the smart textile-based garment 800 receives instructions from a communication coupling device (e.g., a wrist wearable device 500, a head wearable device, and a HIPD 700, etc.) to cause execution of a feedback response. Alternatively or additionally, in some embodiments, the smart textile-based garment 800 determines one or more feedback responses to provide to the user. The smart textile-based garment 800 may provide feedback to the user based on one or more of its sensors (e.g., sensor 851; Figure 8C ) or communication-coupled sensors (e.g., sensors of the wrist wearable device 500, the head mountable device, the HIPD 700, and / or other computing devices) to determine one or more feedback responses.

[0230] Non-limiting examples of feedback determined by the smart textile-based garment 800 and / or the communication coupling device include visual feedback, audio feedback, tactile (e.g., tactile, kinesthetic, etc.) feedback, thermal or temperature feedback, and / or other sensory perceptible feedback. The smart textile-based garment 800 may include a corresponding feedback device (e.g., a tactile device or tactile component 862 or other feedback device or component) to provide feedback responses to the user. Similarly, the smart textile-based garment 800 may be communicatively coupled with another device (and / or a feedback device of another device) to coordinate the feedback provided to the user. For example, the VR device 610 may present an AR environment to the user, and when the user interacts with an object (e.g., a virtual cup) within the AR environment, the smart textile-based garment 800 provides a corresponding response to the user. In particular, the smart textile-based garment 800 may provide tactile feedback that prevents one or more fingers of the user (or at least hinders / resists their movement) from bending beyond a specific point to simulate the feeling of touching a hard cup and / or provide thermal feedback that simulates the feeling of a cold or hot drink.

[0231] Additionally or alternatively, in some embodiments, the smart textile-based garment 800 is configured to operate as a controller that is configured to perform one or more functions or operations associated with: interacting with a user interface and application of a communicatively coupled device, interacting with an AR environment, interacting with a VR environment, and / or operating as a human-machine interface controller, and performing such functions and / or operations.

[0232] Fig. 8A One or more haptic components 862 (e.g., first through fourth haptic components 862-1 through 862-4) are shown on a portion of the smart textile-based garment 800 adjacent to the palm side of the user's hand. Figure 8BAn additional tactile component (e.g., a fifth tactile component 862-5) is shown on a portion of the back of the hand of the user's hand adjacent to the smart textile-based garment 800. In some embodiments, the tactile component 862 includes a mechanism that provides resistance when at least each tactile component 862 is converted from a first state (e.g., a first pressurized state (e.g., at atmospheric pressure or when deflated)) to a second state (e.g., a second pressurized state (e.g., inflated to a threshold pressure)). In other words, the described tactile component 862 can be converted between the first pressurized state and the second pressurized state to provide tactile feedback to the user. The structure of the tactile component 862 can be integrated into various devices configured to contact or approach the user's skin, including but not limited to devices such as glove-worn devices, body-worn clothing devices, head-mounted devices, and the like. Each of these tactile components 862 can be included in a garment component 804 of the smart textile-based garment 800 or physically coupled to the garment component. For example, each of haptic components 862-1, 862-2, 862-3, ... 862-N is physically coupled to garment component 804 and is configured to contact corresponding phalanges of the user's thumb and other fingers.

[0233] Due to the ever-changing nature of artificial reality, during a single use, the haptic component 862 may need to transition between multiple states hundreds or possibly thousands of times. Therefore, the haptic component 862 described herein is durable and is designed to quickly transition between states. To provide some background, in a first pressurized state, the haptic component 862 does not hinder the free movement of a part of the wearer's body. For example, one or more haptic components 862 incorporated into the glove are made of a flexible material (e.g., an electrostatic zipper actuator) that does not hinder the free movement of the wearer's hand and fingers. The haptic component 862 is configured to conform to the shape of a part of the wearer's body when in the first pressurized state. However, once in a second pressurized state, the haptic component 862 can be configured to limit and / or hinder the free movement of the part of the wearer's body (e.g., an appendage of the user's hand). For example, when the haptic component 862 is in the second pressurized state, the corresponding haptic component 862 (or multiple corresponding haptic components) can limit the movement of the wearer's fingers (e.g., prevent the fingers from curling or stretching). Additionally, once in the second pressurized state, the haptic components 862 can take on different shapes, with some haptic components 862 being configured to take on a planar, rigid shape (e.g., being flat and rigid) and some other haptic components 862 being configured to at least partially bend or flex.

[0234] Smart textile-based garment 800 may be an AR system (e.g., Figure 4A to Figure 4D-2For example, the user may wear a pair of gloves (e.g., the first type of smart textile-based clothing 800), a tactile component (e.g., the first type of smart textile-based clothing 800), and a wrist wearable device 600. FIG. 5A to FIG. 5B ), wearing a headband (e.g., a second type of smart textile-based garment 800), holding the HIPD 700, etc. As described above, the tactile component 862 is configured to provide tactile simulation to the wearer of the smart textile-based garment 800. The garment component 804 of each smart textile-based garment 800 can be one of various clothing items (e.g., gloves, socks, shirts, pants, etc.). Therefore, a user can wear multiple smart textile-based garments 800, each of which is configured to provide tactile stimulation to various parts of the body wearing the smart textile-based garment 800. Although the smart textile-based garment 800 is described as a separate device, in some embodiments, the smart textile-based garment 800 can be combined with other wearable devices described herein. For example, the smart textile-based garment 800 can form a part of the VR device 610 (e.g., a headband portion).

[0235] Figure 8C A block diagram of a computing system 840 of a haptic assembly 862 according to some embodiments is shown. The computing system 840 may include one or more peripheral device interfaces 850, one or more power systems 895 (including a charging input 896, a PMIC 897, and a battery 898), one or more controllers 875 (including one or more haptic controllers 876), one or more processors 877 (as described above, including any of those examples provided), and a memory 878, which may all be in electronic communication with each other. For example, the one or more processors 877 may be configured to execute instructions stored in the memory 878, which may cause a controller in the one or more controllers 875 to perform operations at one or more peripheral devices of the peripheral device interface 850. In some embodiments, each of the operations described may occur based on power provided by the power system 895.

[0236] In some embodiments, peripheral device interface 850 may include one or more devices configured as part of computing system 840, many of which have been defined and / or described above. FIG. 5A to FIG. 7BThe wrist wearable device shown is described. For example, the peripheral device interface 850 may include one or more sensors 851, such as one or more pressure sensors 852, one or more EMG sensors 856, one or more IMUs 858, one or more position sensors 859, one or more capacitive sensors 860, one or more force sensors 861; and / or any other type of sensor defined above or described with respect to any other embodiment discussed herein. In some embodiments, the peripheral device interface 850 may include one or more additional peripherals, the one or more additional peripherals including one or more WiFi and / or Bluetooth (WiFi / BT) devices 868; an LTE component 869; a GPS component 870; a microphone 871; one or more tactile components 862; one or more support structures 863 (the support structure may include one or more bladders 864); one or more manifolds 865; one or more pressure changing devices 867; one or more displays 872; one or more buttons 873; one or more speakers 874; and / or any other type of peripheral defined above or described with respect to any other embodiment discussed herein. In some embodiments, the computing system 840 includes more than Figure 8C More or fewer components than those shown.

[0237] In some embodiments, each haptic component 862 includes a support structure 863 and at least one bladder 864. The bladder 864 (e.g., a membrane) is a sealed inflatable bag made of a durable and puncture-resistant material (e.g., a thermoplastic polyurethane (TPU) or a flexible polymer, etc.). The bladder 864 contains a medium (e.g., a fluid such as air, an inert gas, or even a liquid) that can be added to or removed from the bladder 864 to change the pressure (e.g., fluid pressure) within the bladder 864. The support structure 863 is made of a material that is stronger and harder than the material of the bladder 864. The corresponding support structure 863 coupled to the corresponding bladder 864 is configured to strengthen the corresponding bladder 864 when the corresponding bladder changes shape and size due to changes in the pressure (e.g., fluid pressure) within the bladder. The exemplary haptic component 862 above is non-limiting. The tactile component 862 may include an eccentric rotating mass (ERM), a linear resonant actuator (LRA), a voice coil motor (VCM), a piezoelectric tactile actuator, a thermoelectric device, a solenoid actuator, an ultrasonic transducer, a thermistor heater, a Peltier device, and / or other devices configured to produce a perceptible response.

[0238] The smart textile-based garment 800 also includes a haptic controller 876 and a pressure changing device 867. Alternatively, in some embodiments, the computing system 840 is communicatively coupled to the haptic controller 876 and / or the pressure changing device 867 (e.g., electronically communicates with one or more processors 877 of the computing system 840). The haptic controller 876 is configured to control the operation of the pressure changing device 867, and thereby control the operation of the smart textile-based garment 800. For example, the haptic controller 876 sends one or more signals to the pressure changing device 867 to activate the pressure changing device 867 (e.g., turn it on and off). The one or more signals may specify a desired pressure (e.g., pounds per square inch) to be output by the pressure changing device 867. The generation of the one or more signals and thereby the pressure output by the pressure changing device 867 may be based on information collected by the sensor 851 of the smart textile-based garment 800 and / or other communicatively coupled devices. For example, the haptic controller 876 may provide one or more signals based on the collected sensor data to cause the pressure changing device 867 to increase the pressure (e.g., fluid pressure) within the first haptic component 862 at a first time, and provide one or more additional signals to the pressure changing device 867 based on the additional sensor data to cause the pressure changing device 867 to further increase the pressure within the second haptic component 862 at a second time after the first time. In addition, the haptic controller 876 may provide one or more signals to cause the pressure changing device 867 to inflate one or more bladders 864 in a first portion (e.g., a first finger) of the smart textile-based garment 800, while one or more bladders 864 in a second portion (e.g., a second finger) of the smart textile-based garment 800 remain unchanged. In addition, the haptic controller 876 may provide one or more signals to cause the pressure changing device 867 to inflate one or more bladders 864 in the first smart textile-based garment 800 to a first pressure, and to inflate one or more other bladders 864 in the first smart textile-based garment 800 to a second pressure different from the first pressure. Depending on the number of smart textile-based garments 800 served by the pressure varying device 867 and the number of bladders in the smart textile-based garment, many different inflation configurations may be achieved via one or more signals, and the above examples are not meant to be limiting.

[0239] The smart textile-based garment 800 may include an optional manifold 865 between the pressure changing device 867, the haptic component 862, and / or other parts of the smart textile-based garment 800. The manifold 865 may include one or more valves (not shown) that pneumatically couple each haptic component 862 to the pressure changing device 867 via a pipe. In some embodiments, the manifold 865 communicates with a controller 875, and the controller 875 controls one or more valves of the manifold 865 (e.g., the controller generates one or more control signals). The manifold 865 is configured to switchably couple the pressure changing device 867 to one or more haptic components 862 of the smart textile-based garment 800. In some embodiments, one or more smart textile-based garments 800 or other haptic devices may be coupled in a network of haptic devices, and the manifold 865 may distribute the fluid between the coupled smart textile-based garments 800.

[0240] In some embodiments, the smart textile-based garment 800 may include multiple pressure changing devices 867, wherein each pressure changing device 867 is directly pneumatically coupled to a single (or multiple) haptic component 862, rather than using a manifold 865 to pneumatically couple the pressure changing device 867 to the haptic component 862. In some embodiments, the pressure changing device 867 and the optional manifold 865 can be configured as a part of one or more of these smart textile-based garments 800 (not shown), while in other embodiments, the pressure changing device 867 and the optional manifold 865 can be configured outside the smart textile-based garment 800. In some embodiments, a single pressure changing device 867 can be shared by multiple smart textile-based garments 800 or other haptic devices. In some embodiments, the pressure changing device 867 is a pneumatic device, a hydraulic device, a pneumatic hydraulic device, or some other device capable of adding and removing a medium (e.g., a fluid, a liquid, a gas) from one or more haptic components 862.

[0241] The memory 878 includes instructions and data, some or all of which may be stored as non-transitory computer-readable storage media within the memory 878. For example, the memory 878 may include one or more operating systems 879, one or more communication interface modules 881, one or more interoperability modules 884, one or more AR processing modules 885, one or more data management modules 886, and / or the above-defined or related FIG. 5A to FIG. 7B Any other type of data described.

[0242] The memory 878 also includes data 888 that can be used in conjunction with one or more of the applications discussed above. The data 888 may include: device data 890, sensor data 891, and / or data defined above or related to FIG. 5A to FIG. 7B Any other type of data described.

[0243] FIG. 8A to FIG. 8C The different components of the computing system 840 (and the smart textile-based garment 800) shown in FIG. 8 may be coupled via wired connections (eg, via a bus). Alternatively, FIG. 8A to FIG. 8C One or more of the devices shown in FIG. 5 may be wirelessly connected (eg, via short-range communication signals).

[0244] Fig. 9 A battery cell 900 (ie, a non-rectangular battery cell) configured to be dual-bent (eg, bent along at least two axes) is shown in accordance with some embodiments. Fig. 9 A battery cell is shown having a curvature along the x-axis, indicated by curved profile 902 , and also showing another curvature along the z-axis, indicated by curved profile 904 . Fig. 9 Also shown is a cross-sectional view 906 showing how the battery cell is internally bent at the curved profile 902, as shown by the curved cathode 908, the curved aluminum foil separator 910, the curved separator 912, the copper foil separator 914, and the curved anode 916. As shown in the cross-sectional view 907, the internal components are also bent along the curved profile 904 along the z-axis.

[0245] These types of battery cells configured to bend along multiple axes are useful for maximizing space in non-standard form factors, such as temple arms in eyeglass frames of augmented reality headsets, and virtual reality headsets that include a rear module located at the back of the wearer's head (e.g., a module configured to store batteries and balance the headset). For example, temple arms naturally have multiple curvatures to conform to the shape of a user's head (i.e., a dome and / or hemisphere shape), so a battery that can conform to this dual-curved surface maximizes internal space while allowing the temple arms to maintain a traditional eyeglass shape.

[0246] In some embodiments, Fig. 9 It is also shown that the battery cell 900 can have the same curvature profile in both the x-axis and the z-axis (e.g., represented by the radius “R x ” and “R z” is equal to radius “R”). In some embodiments, curved profile 902 is different from curved profile 904, thereby allowing different radius curvatures according to the axis. In some embodiments, the curvature along one axis follows multiple radii. For example, a larger radius may be required for most of the temple arm, while a smaller radius may be required around the end of the temple arm so that the temple arm curves around the wearer's ear.

[0247] Fig. 9 It is also shown that in addition to having a curved profile along multiple axes, the battery cell 900 can also have a shape other than a rectangle. A non-comprehensive list of exemplary battery cell shapes is provided in box 918, which includes a rectangular shape 920, a rounded rectangle 922, an oval shape or a circular shape 924, and a hexagonal shape 926. In addition to these shapes, each edge of the battery cell can also be chamfered to conform to the shape of the component (e.g., the temple arm) into which the battery is being inserted. In some embodiments, some edges can be chamfered and some edges are not chamfered.

[0248] Fig.10 Three different views of a temple arm including a double-curved battery cell having an irregular shape are shown, according to some embodiments. Fig.10 A first transparent view 1000 is shown showing a temple arm 1002 including a battery cell 1004 that is bent along both the x-axis and the y-axis to fill a first void 1006 of the temple arm. The first transparent view 1000 also shows that the temple arm 1002 also includes another battery cell 1008 that is bent along both the x-axis and the y-axis to fill a second void 1010, and the first void 1006 and the second void 1010 have different irregular shapes (e.g., shapes determined in part by the average head contour of a wearer).

[0249] Fig.10 It is also shown that in some embodiments, the battery cell 1004 and another battery cell 1008 are electrically coupled to each other (e.g., as shown by connector 1009) (e.g., in series or in parallel) to produce a desired power output. In some embodiments, the battery cell and another battery cell can be electrically coupled to all other battery cells located within the augmented reality head mounted device.

[0250] Fig.10Also shown is a second transparent view 1012 showing the temple arm 1002, which includes a battery cell 1004 that is bent along both the x-axis and the y-axis and has an irregular shape to fill the first void 1006 of the temple arm. The second transparent view 1012 also shows that the temple arm 1002 also includes another battery cell 1008 that is bent along both the x-axis and the y-axis and has an irregular shape to fill the second void 1010, and the first void 1006 and the second void 1010 have different shapes. Therefore, the battery cell in this example is bent along the x-axis and the y-axis and has an irregular shape. In some embodiments, the battery is bent along the x-axis, the y-axis, and the z-axis.

[0251] Fig.10 A third transparent perspective view 1014 is shown, which also shows that the battery cell 1004 and another battery cell 1008 are bent along the x-axis and the y-axis and have irregular shapes. Fig.10 It is shown that the cells can be bent along two axes and that the cells have an irregular shape, but the cells need not be bent along only the x-axis and the y-axis and can be bent along only one axis or along three axes depending on the application (i.e., the shape of the void). In some embodiments, the irregular shape of the battery and the bending of the cells along two axes are sufficient to fit the battery in a void of any shape.

[0252] Fig.10 One or more artificial reality processing or presentation devices 1016 are also shown positioned within the temple arms and may partially define the first void 1006 and / or the second void 1010 .

[0253] Fig.11 Three different views of an eyeglass frame including a battery cell that is doubly curved (eg, curved along two axes) (and has an irregular shape to fit within a nose bridge portion of an eyeglass frame) are shown in accordance with some embodiments. Fig.11 A first transparent view 1102 is shown showing that the eyeglass frame 1104 includes a battery cell 1106 that is bent along both the x-axis and the y-axis to fit within a nose bridge portion 1107 of the eyeglass frame 1104 .

[0254] Fig.11 A second transparent cross-sectional view 1108 is shown, which shows that the battery cell 1106 is bent along both the y-axis and the z-axis to further fit in the nose bridge portion 1107 of the eyeglass frame 1104. Fig.11 A third transparent perspective view 1110 is shown, which further shows that the battery cell 1106 is bent along the x-axis, y-axis, and z-axis. Fig.11The battery cells 1106 are shown as being bendable along three axes, but other battery cells need not be bendable along all three axes and may be bendable along only one axis or along two axes depending on the application. In some embodiments, the battery cells 1106 are electrically coupled in series or in parallel to Fig.10 The batteries shown are arranged to produce the desired electrical output.

[0255] refer to Figures 9 to 11 The batteries described are considered reference Figures 1 to 3B The battery variants described are therefore referred to Figures 1 to 3B Any of the features described can be applied to Figures 9 to 11 and vice versa.

[0256] Fig.12 A battery construction is shown according to some embodiments, which is configured to reduce the overall weight of the battery compared to traditional lithium-ion batteries (which rely on aluminum and copper foil in their construction).

[0257] Fig.12 A cross-sectional view 1202 of a conventional solid metal current collector based lithium ion battery, which typically uses copper foil as an anode and aluminum foil as an anode, is shown in section 1200. While effective, these materials can account for 10% to 15% of the total weight of the battery cell. The high weight is not ideal in wearable devices, which must be lightweight for increased user comfort. As shown, the solid metal current collector 1203 is surrounded by electrolyte / electrode material 1205.

[0258] Section 1204 shows a cross-sectional view 1206 of the first lightweight battery that replaces the traditional solid-state metal current collector-based lithium-ion battery. As shown, the cross-sectional view 1206 shows a current collector 1207 (surrounded by a dotted line) using a non-metallic core, which is lighter than a solid metal current collector. In some embodiments, the non-metallic core is a polymer / composite film core 1208. In some embodiments, the non-metallic core can be a continuous film material, a porous material (e.g., a woven material), etc. In some embodiments, the non-metallic composite film core 1208 can be constructed in the form of a sheet or roll of polypropylene (Polypropylene, PP), polyethylene (Polyethylene, PE), polyethylene terephthalate (Polyethylene Terephthalate, PET), polyether ether ketone (Polyether Ether Ketone, PEEK), polyaryl ether ketone (Polyaryl Ether Ketone, PEAK), polyimide (Polyimide, PI), etc. In some embodiments, the non-metallic core has metal layers 1209A and 1209B placed at the top and bottom, respectively, to act as the anode and cathode of the battery cell. In some embodiments, the metal layer can be selected from one or more of aluminum, copper, nickel and / or titanium. In some embodiments, the metal layer can be attached to the non-metallic core by lamination, coating, chemical vapor deposition (CVD), physical vapor deposition (PVD) and / or sputtering deposition. The non-metallic core and the layered laminated / coated metal composite current collector have a thickness comparable to that of a traditional solid metal current collector. In addition, however, due to the low density of the polymer, the overall weight is smaller than that of a solid metal current collector. In some embodiments, the non-metallic core and the layered laminated / coated metal composite current collector have good mechanical properties and better corrosion resistance compared to a solid metal current collector. In addition, section 1204 shows that the current collector 1207 is surrounded by electrode material 1211.

[0259] Fig.12 Section 1210 of shows a first cross-section of a 3D porous metal current collector 1214 (e.g., a mesh, perforated foil, expanded foil / film, foam, fabric, etc.) with an electrolyte / electrode material 1215 on one or both sides of the porous metal current collector 1214. Section 1210 shows a second lightweight battery that replaces a lithium-ion battery based on a traditional solid metal current collector. Section 1216 shows a second cross-section of a continuous 3D porous metal current collector shown in section 1210 with controlled cell size and metal wall width and thickness. Compared with a solid metal current collector, this current collector can reduce the weight of the current collector, increase the electrode mass loading, and design void space in the current collector.

[0260] Fig.13 According to some embodiments, the use of reference Fig.12 An exemplary curved battery cell with a lightweight current collector is described. In some embodiments, these lightweight alternative current collectors are in the form of rolls, and curved battery cells can be fabricated by stacking, laminating, or winding such current collectors in a zigzag pattern. Fig.13 A first curved battery cell 1300 is shown that is curved along a first axis and is constructed using either a conventional current collector 1302 , a current collector using a lightweight non-metallic core current collector 1304 , or a lightweight 3D porous metal current collector 1306 . Fig.13 A second curved battery cell 1308 is also shown, which is bent along a second axis different from the first axis and is constructed using either a conventional current collector 1302, a current collector using a lightweight non-metal core current collector 1304, or a lightweight 3D porous metal current collector 1306. In some embodiments, the curved battery cell is configured to bend along at least two axes and still employs the lightweight current collector described herein. In some embodiments, the cathode may use a first type of current collector that is different from an anode that uses a second type of current collector (e.g., the first current collector is a lightweight non-metal core current collector and the second current collector is a 3D porous metal current collector). In some embodiments, the battery cell is constructed using a stacking or winding method. Therefore, these lightweight current collectors can reduce inactive mass and can improve filling efficiency, thereby obtaining a higher battery cell energy density. The thickness of the battery based on the described lightweight current collector can be comparable to that of a traditional solid metal current collector, but is lighter in weight because the density of the polymer is lower than that of the metal. In addition, the lightweight current collector provides improved mechanical properties and corrosion resistance compared to solid metal current collectors. In some embodiments, the porosity in the 3D porous metal current collector can enable high electrode mass loading, which improves the absolute battery cell capacity / energy while maintaining low resistance and good ion diffusion rate.

[0261] Fig.14 Lightweight hard case batteries are shown according to some embodiments that do not have cell platforms and / or side folds to reduce weight and volumetric efficiency while providing balanced gravimetric energy density. Fig.14 An exemplary non-curved battery cell 1400 is shown that does not include a cell platform and / or side folds, which saves the dead volume typically occupied by the side folds along with the adhesive or tape and the platform / head space. Fig.14A curved battery cell 1402 is shown that is curved along a first axis and does not include a cell platform and / or side folds. Having a curved battery without a cell platform and / or side folds further improves volumetric efficiency by allowing the battery cell to better conform to the electronic device in which it is located. Fig.14 Another curved battery cell 1404 is further shown that is curved along a second axis, and the other battery does not include a cell platform and / or side folds. In some embodiments, the battery cell without a platform and / or side folds can be bent along multiple axes (e.g., along both the first axis and the second axis). In some embodiments, the steel case battery can be used as a structural component of an electronic device (i.e., to provide structural rigidity to the temple arm of a pair of glasses, thereby reducing the amount of material required to achieve the desired structural rigidity of the temple arm).

[0262] Fig.15 Several options for assembling battery cells without a cell platform and / or side folds are shown according to some embodiments. Fig.15 The construction of a first hard shell 1500 for a battery cell is shown. The first exemplary construction is manufactured using a tubular (e.g., a hollow extruded member) hard shell 1502 that is sealed with two side pieces 1504A and 1504B (e.g., end caps). In order to manufacture a battery cell without a cell platform and / or side folds, the two side pieces 1504A and 1504B are coupled to the tubular hard shell 1502 by laser welding. Laser welding reduces the need for a cell platform and / or side folds. In some embodiments, the two side pieces may include terminals and / or filling holes. The second hard shell 1506 and the third hard shell 1508 are manufactured using only two pieces, compared to the three pieces described with reference to the first hard shell 1500.

[0263] The second hard shell is made by laser welding a first piece 1510 similar to a shallow can structure (e.g., a cubic structure with a missing surface or a cylindrical structure with a missing end piece, etc.) to a second piece 1512 (e.g., the sealing cap is a cap substantially the same as the maximum surface dimension of the first piece). The third hard shell is made by laser welding a first piece 1514 similar to a deep-narrow can structure (e.g., a cubic structure with a missing surface or a cylindrical structure with a missing end piece, etc.) to a second piece 1516 (e.g., the sealing cap is a cap substantially the same as the minimum surface dimension of the first piece). In some embodiments, the first piece can be sealed by a sealing cap substantially the same as the second minimum surface dimension of the first piece. In some embodiments, the sealing cap can also have terminals and / or filling holes.

[0264] Fig.16 Alternative shapes that battery cells may have and the placement of terminals on battery cells of these alternative shapes are shown according to some embodiments. Fig.16A conventionally shaped cubic shaped battery cell 1602, a narrow battery cell 1604, and a thin battery cell 1606 are shown. These alternative designs are ideal in applications with non-conventional shapes (e.g., temple arms for smart glasses or extended reality glasses, other wearable devices, etc.). In some embodiments, for a micro battery cell for augmented reality glasses, smart glasses, wearable devices, or wrist devices, the battery dimensions may range from 5 mm to 40 mm in width, 10 mm to 70 mm in length, and 1 mm to 10 mm in thickness. In some embodiments, for a virtual reality head mounted device, the battery cell dimensions may range from 30 mm to 110 mm in width, 50 mm to 150 mm in length, and 1 mm to 10 mm in thickness. The above exemplary ranges are not limiting, and other ranges may produce thinner, longer, and / or wider battery cells.

[0265] Fig.17 An exemplary cross section of a battery 1700 having a hard case is shown according to some embodiments. Fig.17 A manufactured battery cell 1702 having a stacked configuration or a jellyroll configuration is shown. The battery cell 1702 is enclosed in a hard shell (e.g., a metal can) 1704, and in some embodiments, the battery cell 1702 fills 70% to 95% of the internal volume of the hard shell 1704. In some embodiments, when the size of the hard shell is larger, the battery cell can fill up to 99% of the internal volume of the hard shell, that is, for larger batteries, a volumetric efficiency in percentage form can be achieved. In some embodiments, the battery cell can fill 70% to 95% of the internal volume of the hard shell. The battery cell 1702 is coupled to a positive terminal 1706 and a negative terminal 1708.

[0266] Positive terminal 1706 is attached to hard shell 1704 through spacer 1710 and resistor 1712. In some embodiments, positive terminal 1706 also includes resistor 1712 and / or replaces resistor 1712 with a sealing gasket. Positive terminal 1706 is coupled to battery cell 1702 through cathode tab 1714.

[0267] Negative terminal 1708 is also attached to hard case 1704 via spacer 1716 and sealing gasket 1718. In some embodiments, negative terminal 1708 also includes sealing gasket 1718 and / or replaces sealing gasket 1718 with a resistor. Negative terminal 1708 is coupled to battery cell 1702 via anode tab 1720. Fig.17 The hard shell 1704 is also shown to include a fill hole 1722 for filling the battery with electrolyte.

[0268] In some embodiments, the positive terminal 1706 is attached to the hard case through a resistor 1712 and the negative terminal 1708 is coupled to the hard case through a sealing gasket. This difference in attachment components is very important for lightweight batteries with aluminum because corrosion may form on the aluminum can. Therefore, this avoids the formation of Li-Al alloy (Li+) due to the low potential relative to lithium (Li) (about 0.3V relative to Li+ / Li). x Al y ) of the aluminum (Al) can. Therefore, the hard shell is connected to the positive terminal through a resistive washer, which has the dual functions of sealing and corrosion prevention. In some embodiments, a resistor is connected in series to prevent accidental contact between the aluminum can and the anode component (i.e., anode, copper foil, etc.).

[0269] Fig.18A and Fig.18B A battery having a curved shape to accommodate one or more electronic components in a temple arm is shown according to some embodiments (e.g., Fig.18B ) and a non-flexible battery that does not accommodate one or more electronic components in the temple arm (e.g. Fig.18A ) between them.

[0270] Fig.18A A temple arm 1800 is shown that includes a conventional non-curved battery 1802 (e.g., a cubic battery cell) that sacrifices overall storage capacity to fit one or more electronic components (e.g., a microphone 1804) located within the frame arm. When a non-curved battery is used in a temple arm 1800 having a curved shape, a void 1805 may be formed. Having a void 1805 is not an efficient use of packaging and results in a shorter run time of the head mounted device because the maximum storage capacity of the battery is less than the maximum storage capacity of a battery that can fit into the void 1805.

[0271] and Fig.18A compared to, Fig.18B A temple arm 1806 is shown that includes a curved battery 1808 that is designed to maximize the available space within the temple arm 1806 (e.g., by filling the reference Fig.18A In some embodiments, the curved battery 1808 is configured to fill the gap 1810 (indicated by the dashed line 1817) and accommodate the placement of the microphone 1812. Although the microphone 1812 is shown, the curved battery 1808 can be configured to accommodate other electronic components or surfaces of the temple arm other than those shown in the figure. Fig.18B It is also shown that the temple arm can be configured with a button 1814 for controlling at least one aspect of the pair of smart glasses.

[0272] Any data collection performed by the devices described herein and / or any device configured to perform the various embodiments described above with reference to any of the diagrams or to cause the performance of these embodiments (hereinafter referred to as "devices") is performed with the user's consent in a manner that complies with all applicable privacy regulations. The user can choose to allow the device to collect data, or can choose to limit or deny the device from collecting data. The user can opt in or out of any data collection at any time. In addition, the user can choose to request deletion of any collected data.

[0273] It will be understood that although the terms “first”, “second”, etc. may be used herein to describe various elements, these elements should not be limited by these terms. These terms are only used to distinguish one element from another element.

[0274] The terms used herein are only used to describe specific embodiments and are not intended to limit the claims. As used in the description of the embodiments and the appended claims, the singular forms "a", "an" and "the" are also intended to include plural forms, unless the context clearly indicates otherwise. It will also be understood that the term "and / or" used herein refers to and includes any and all possible combinations of one or more items in the associated listed items. It will also be understood that the terms "include" and / or "comprising" when used in this specification specify the presence of stated features, integers, steps, operations, elements and / or parts, but do not exclude the presence or addition of one or more other features, integers, steps, operations, elements, parts and / or combinations thereof.

[0275] As used herein, the term "if" may be interpreted to mean "when" or "upon" or "in response to determining" or "upon determining" or "in response to detecting" the stated antecedent is true, depending on the context. Similarly, the phrase "if it is determined that [the stated antecedent is true]" or "if [the stated antecedent is true]" or "when [the stated antecedent is true]" may be interpreted to mean "upon determining" or "in response to determining" or "upon determining" or "upon detecting" or "in response to detecting" the stated antecedent is true, depending on the context.

[0276] For the purpose of illustration, the foregoing description has been described with reference to specific embodiments. However, the illustrative discussion above is not intended to be exhaustive or to limit the claims to the precise forms disclosed. In view of the above teachings, many modifications and variations are possible. The embodiments are chosen and described in order to best explain the principles of operation and practical application, thereby enabling others skilled in the art to realize.

Claims

1. An augmented reality head mounted device, the augmented reality head mounted device comprising: Framework part; a temple arm portion coupled to the frame portion; A metal packaged battery cell having an exterior surface defining a non-rectangular shape, wherein: The metal encapsulated battery unit is configured to be housed within the temple arm portion, and The non-rectangular shape of the outer surface follows the inner shape of the inner surface of the temple arm portion; and One or more artificial reality processing or presentation devices, wherein at least one of the one or more artificial reality processing or presentation devices is configured to receive power from the metal encapsulated battery cell.

2. The augmented reality head mounted device according to claim 1, wherein: The interior shape is a first interior shape of the inner surface of the temple arm portion, and the augmented reality head mounted device further comprises: Another metal packaged battery cell having another outer surface defining another non-rectangular shape, wherein: The further metal encapsulated battery unit is configured to be received within the temple arm portion, and The another non-rectangular shape of the another outer surface follows a second inner shape of the inner surface of the temple arm portion; and At least one of the one or more artificial reality processing or presentation devices is configured to receive power from the other metal encapsulated battery cell.

3. The augmented reality head mounted device according to claim 1, further comprising: another temple arm portion, the other temple arm portion being distinct from the temple arm portion and coupled to the frame portion; Another metal packaged battery cell having another outer surface defining another non-rectangular shape, wherein: The other metal encapsulated battery unit is configured to be received within the other temple arm portion, and The another non-rectangular shape of the another outer surface follows the another inner shape of the another inner surface of the another temple arm portion; and At least one of the one or more artificial reality processing or presentation devices is configured to receive power from the other metal encapsulated battery cell.

4. The augmented reality head mounted device according to claim 1, wherein: At least one edge of the metal encapsulated battery cell has a chamfered edge, wherein the chamfered edge is configured to further conform to the interior shape of the inner surface of the temple arm portion.

5. The augmented reality head mounted device according to claim 1, wherein: At least one edge of the metal encapsulated battery cell has a chamfered edge, wherein the chamfered edge is shaped to accommodate at least one of the one or more artificial reality processing or presentation devices within the temple arm portion.

6. The augmented reality head mounted device according to claim 5, wherein: At least one of the one or more artificial reality processing or presentation devices is a speaker, and the chamfered edge of the metal-encapsulated battery cell is shaped and sized to allow the speaker to at least partially overlap the chamfered edge within the temple arm portion.

7. The augmented reality head mounted device according to claim 1, wherein: The frame portion includes at least two translucent lenses configured to allow ambient light to pass therethrough.

8. The augmented reality head mounted device according to claim 1, further comprising: Another metal packaged battery cell having another outer surface defining another non-rectangular shape, wherein: The other metal packaged battery cell is configured to be received within the frame portion, and The other non-rectangular shape of the other outer surface follows the other inner shape of the other inner surface of the frame portion; and At least one of the one or more artificial reality processing or presentation devices is configured to receive power from the other metal encapsulated battery cell.

9. The augmented reality head mounted device according to claim 1, wherein: The metal encapsulated battery unit includes at least one mounting feature configured to secure the metal encapsulated battery unit to the temple arm portion, wherein the mounting feature is one or more of: a hook, a tab, a spring, and a screw.

10. The augmented reality head mounted device according to claim 1, wherein: The thickness of the metal packaged battery cell gradually decreases along two axes.

11. The augmented reality head mounted device according to claim 1, wherein: The metal packaged battery cell includes a hemispherical surface.

12. The augmented reality head mounted device according to claim 1, wherein: The metal encapsulated battery cell is made of steel.

13. The augmented reality head mounted device according to claim 1, wherein: The metal packaged battery cell has a flangeless sealed configuration, thereby increasing the battery cell area of ​​the metal packaged battery cell that can be accommodated within the temple arm portion as compared to battery cells using a flange-based configuration.

14. The augmented reality head mounted device according to claim 13, wherein: The metal packaged battery cell includes at least two metal shells that are laser welded together.

15. The augmented reality head mounted device according to claim 1, wherein: The metal packaged battery cell has a metal base wall thickness of 100 microns to 300 microns.

16. The augmented reality head mounted device according to claim 1, wherein: The metal encapsulated battery cell has a maximum cross-sectional dimension of at least 6 mm and a minimum cross-sectional dimension of at least 2.5 mm.

17. The augmented reality head mounted device according to claim 1, wherein: The metal packaged battery cell has a stacked electrode design, wherein the layers of the stacked electrode design are die cut.

18. A metal packaged battery cell, comprising: an outer surface defining a non-rectangular shape, wherein: The metal encapsulated battery unit is configured to be received within the temple arm portion, and The non-rectangular shape of the outer surface follows the inner shape of the inner surface of the temple arm portion; and The metal-encapsulated battery cell is configured to be coupled to one or more artificial reality processing or presentation devices, wherein at least one of the one or more artificial reality processing or presentation devices is configured to receive power from the metal-encapsulated battery cell.

19. A temple arm for an augmented reality head mounted device, the temple arm comprising: A metal packaged battery cell having an exterior surface defining a non-rectangular shape, wherein: The metal encapsulated battery unit is configured to be housed within the temple arm portion, and The non-rectangular shape of the outer surface follows the inner shape of the inner surface of the temple arm portion; and One or more artificial reality processing or presentation devices, wherein at least one of the one or more artificial reality processing or presentation devices is configured to receive power from the metal encapsulated battery cell.

Images