Parallax sensor for closed loop active dimming control and system and method of use thereof

Abstract

Parallax sensors for closed loop active dimming control and systems and methods of use thereof are provided. The invention discloses an active dimming control method for augmented reality glasses. The method includes, while a user wears augmented reality glasses, acquiring a first set of light information measured via a first sensor on the augmented reality glasses, the first sensor positioned to receive light after the light passes through a dimmable element of the augmented reality glasses. The method also includes obtaining a second set of light information measured via a second sensor on the augmented reality glasses, the second sensor positioned to receive light that has not passed through the dimmable element of the augmented reality glasses. The method further includes electronically adjusting a dimming level of the dimmable element based on a comparison between the first set of light information and the second set of light information.

Description

[0001] Related Applications

[0002] This application claims priority to U.S. Provisional Application No. 63 / 582,814, filed on September 14, 2023, entitled “Disparity Sensor For Closed-Loop Active Dimming Control, And Systems And Methods Of Use Thereof,” and U.S. Non-Provisional Application No. 18 / 803,141, filed on August 13, 2024, both of which are incorporated herein by reference in their entirety. Technical Field

[0003] This generally relates to artificial reality glasses, including, but not limited to, techniques for dynamically adjusting the brightness level of the artificial reality glasses based on a comparison of external light received by a sensor integrated with the artificial reality glasses and the current display brightness. Background Art

[0004] Users of artificial reality glasses face the challenge of having lenses and displays that dim appropriately based on an environment that is constantly changing due to environmental factors such as sunlight, temperature, and / or environmental changes (e.g., a user moving between an outdoor environment and an indoor environment). Current technology includes passive dimming lenses that face dramatic variability due to temperature and inconsistent environmental factors. For example, temperature-dependent passive dimming technology can have up to 25% variability. Variability in passive dimming technology creates inconsistent dimming practices and can be very frustrating to users because the dimming technology may cause the lenses to dim when they should not. Therefore, there is a need for more accurate lens dimming technology that appropriately dims the lenses of artificial reality glasses under appropriate conditions.

[0005] Therefore, there is a need to address one or more of the challenges identified above. A brief overview of solutions to the above mentioned problems is described below. Summary of the invention

[0006] The methods, systems, and devices described herein provide active dimming technology for lenses of head wearable devices. The active dimming technology disclosed herein improves the visibility of artificial reality content presented to the user via the display of the head wearable device. In addition, the active dimming technology disclosed herein improves user comfort by dimming the lenses of the head wearable device to a suitable level under different environments and / or environmental conditions. The methods, systems, and devices described herein provide a cost-effective, low-power, and lightweight solution for active dimming control. In addition, the methods, systems, and devices are configured to operate as a closed-loop solution without the dedicated hardware required for existing closed-loop dimming technologies (existing closed-loop dimming technologies may require calibrated light sources and sensors, or charge level measurement circuits).

[0007] An example method for active dimming control of augmented reality glasses when a user is wearing the augmented reality glasses is provided. The method includes: obtaining first light information measured via a first sensor, the first sensor being positioned to receive the light after the light passes through a dimmable element of the augmented reality glasses; and obtaining second light information measured via a second sensor, the second sensor being positioned to receive light that has not yet passed through the dimmable element of the augmented reality glasses. The method also includes: actively (electronically) adjusting the dimming level of the dimmable element based on a comparison between the first light information and the second light information.

[0008] The features and advantages described in the specification are not necessarily all inclusive, and in particular, certain additional features and advantages will be apparent to one of ordinary skill in the art in view of the drawings, the specification and the claims. In addition, it should be noted that the terms used in this specification are selected primarily for readability and guidance purposes.

[0009] Having summarized the above example aspects, a brief description of the drawings will now be presented. BRIEF DESCRIPTION OF THE DRAWINGS

[0010] For a better understanding of the various embodiments described, reference should be made to the following detailed description taken in conjunction with the following drawings, in which like reference numerals refer to corresponding parts throughout the figures.

[0011] Figure 1A and Figure 1B At least two lenses of a head wearable device configured for active dimming are shown according to some embodiments.

[0012] FIG. 2A to FIG. 2D Shown are lenses of a head wearable device that dim independently of each other, according to some embodiments.

[0013] FIG. 3A to FIG. 3COne or more sensors are shown integrated with or coupled to artificial reality glasses according to some embodiments.

[0014] Figure 4 Example methods for determining a dimming level of a lens based on sensor data acquired by a parallax sensor and / or image data collected by an imaging sensor are shown in accordance with some embodiments.

[0015] Figure 5 A flow chart of an active dimming control method for augmented reality glasses according to some embodiments is shown.

[0016] Fig. 6A and Figure 6B An example artificial reality system is shown in accordance with some embodiments.

[0017] Fig. 7A and Figure 7B An example wrist wearable device is shown in accordance with some embodiments.

[0018] FIG. 8A to FIG. 8C An example head wearable device is shown in accordance with some embodiments.

[0019] Fig. 9A and Fig. 9B An example handheld intermediate processing device is shown in accordance with some embodiments.

[0020] As a matter of practice, the various features shown in the drawings may not be drawn to scale. Accordingly, the dimensions of the various features may be arbitrarily expanded or reduced for clarity. In addition, some of the drawings may not depict all of the components of a given system, method, or device. Finally, similar reference numerals may be used throughout the specification and drawings to represent similar features. DETAILED DESCRIPTION

[0021] Numerous details are described herein to provide a thorough understanding of the example embodiments shown in the various figures. However, some embodiments may be practiced without many of these specific details, and the scope of the claims is limited only by those features and aspects specifically recited in the claims. In addition, it is not necessary to describe well-known processes, components, and materials in full detail to avoid obscuring the relevant aspects of the embodiments described herein.

[0022] The various embodiments of the present disclosure may include several types or embodiments of artificial reality systems, or may be implemented in combination with several types or embodiments of artificial reality systems. As described herein, artificial reality (AR) is a presentation provided by an artificial reality system within the user's physical environment, any superimposed functionality and / or sensory detectable. Such artificial reality may include and / or represent virtual reality (VR), augmented reality, mixed artificial reality (MAR), or some combination of these and / or a variation of one of these. For example, a user may perform an air swipe gesture to skip a song through a song providing an application programming interface (API): the song providing API provides playback at, for example, a home speaker. As described herein, AR environments include, but are not limited to: VR environments (including non-immersive, semi-immersive, and fully immersive VR environments); augmented reality environments (including marker-based augmented reality environments, markerless augmented reality environments, location-based augmented reality environments, and projection-based augmented reality environments); mixed reality environments; and other types of mixed reality environments.

[0023] Artificial reality content may include fully generated content or generated content combined with collected (e.g., real-world) content. Artificial reality content may include video, audio, tactile events, or some combination thereof, any of which may be presented in a single channel or in multiple channels (e.g., stereoscopic video that gives the viewer a three-dimensional effect). In addition, in some embodiments, artificial reality may also be associated with an application, product, accessory, service, or some combination thereof, which is used, for example, to create content in artificial reality and / or otherwise used in artificial reality (e.g., to perform activities in artificial reality).

[0024] As described herein, gestures may include air gestures, surface contact gestures, and / or other gestures that may be detected and determined based on movement of a single hand (e.g., a single hand gesture performed using a user's hand, the single hand gesture being detected by one or more sensors of a wearable device (e.g., an electromyography (EMG) and / or an inertial measurement unit (IMU) of a wrist wearable device), and / or detected via image data collected by an imaging device of the wearable device (e.g., a camera of a head wearable device)) or a combination of movements of the user's hands. In some embodiments, air means that the user's hand is not in contact with a surface, object, or portion of an electronic device (e.g., a head wearable device or other communication-coupled device, such as a wrist wearable device), in other words, the gesture is performed in an open space in 3D space without contacting a surface, object, or electronic device. More generally, surface contact gestures (contact at a surface, an object, a body part of a user, or an electronic device) are also contemplated, in which contact (or an attempt to contact) is detected at a surface (e.g., a single or double-finger tap on a table, on a user's hand or another finger, on a user's leg, a sofa, a steering wheel). The different gestures disclosed herein may be detected using image data and / or sensor data (e.g., neuromuscular signals sensed by one or more biopotential sensors (e.g., EMG sensors) or other types of data from other sensors (e.g., proximity sensors, time-of-flight sensors, sensors of an inertial measurement unit, etc.), which are detected by a wearable device worn by a user and / or other electronic devices owned by the user (e.g., a smartphone, a laptop computer, an imaging device, an intermediate device, and / or other devices described herein).

[0025] The systems and methods disclosed herein provide techniques for active dimming control of augmented reality glasses. The active dimming control techniques disclosed herein actively dim one or more lenses of a head wearable device to improve the presentation of AR content to the user. The systems and methods disclosed herein can use one or more sensors and / or imaging sensors of a head wearable device to detect the current dimming level of a lens and / or the adjustment that should be made to the current dimming level of the lens. The systems and methods disclosed herein provide a cost-effective, low-power, and lightweight solution for active dimming control. Other details about the active dimming control techniques are provided below.

[0026] Figure 1A and Figure 1BAt least two lenses of a head wearable device configured to perform active dimming according to some embodiments are shown. The at least two lenses (e.g., the first lens 118 and / or the second lens 116 (as viewed by the user 110 wearing the head wearable device 114) can be actively dimmed substantially simultaneously based on sensor data (e.g., ambient light data). For example, Figure 1A and Figure 1B As shown, when the user 110 walks from outdoors to indoors, the head wearable device 114 worn by the user 110 actively adjusts the dimming level of the first lens 118 and / or the second lens 116. By actively controlling the dimming level of the first lens 118 and / or the second lens 116, the head wearable device 114 makes it easier for the user 110 to view the presented AR content 112. The head wearable device 114 can present the AR content 112 to the user 110 via the first lens 118 and / or the second lens 116. More specifically, the head wearable device 114 can cause the first lens 118, the second lens 116, or both to present the AR content 112. For example, as Figure 1A As shown, the head wearable device 114 presents AR content 112 to the user via the first lens 118. The first lens 118 and / or the second lens 116 may present the same AR content 112 or different AR content 112.

[0027] Each of the at least two lenses can be formed via a plurality of layers, wherein at least one layer includes an adjustable light element. For example, the first lens 118 can include at least a first layer 150b (the first layer 150b includes a first integrated adjustable light element), and the second lens 116 can include at least another first layer 150a (the other first layer 150a includes another first integrated adjustable light element). The head wearable device 114 can control each corresponding first layer to dynamically adjust the dimming level of each lens based on sensor data acquired by one or more sensors as described below. In some embodiments, the head wearable device 114 automatically adjusts the dimming level of each lens based on the acquired sensor data. Alternatively or additionally, in some embodiments, the user can manually adjust the dimming level of each lens (e.g., the first lens 118 and the second lens 116). The corresponding integrated adjustable light elements of the first layer 150b and the other first layer 150a can be adjusted individually or substantially simultaneously. As described below with reference to Figure 3CAs described in detail, each plurality of layers may also include: a second layer 322 (e.g., a waveguide or other display), which is configured to present AR content 112; and a third layer 320, which is configured to include a lens layer (e.g., a conventional concave lens or convex lens, a Fresnel lens, or an adjustable liquid lens), an additional display (e.g., an additional waveguide), an additional adjustable light element, or other integrated components.

[0028] Sensor data for determining respective dimming levels of the first lens 118 and / or the second lens 116 is obtained via one or more sensors of the head wearable device 114. In some embodiments, the one or more sensors include a parallax sensor 316 ( FIG. 3A to FIG. 3C ), the parallax sensor 316 is configured to compare light from each lens (e.g., light that contacts or passes through the corresponding lens). Specifically, the parallax sensor 316 is configured to measure light that passes through the first layer 150 and contacts at least the second layer and / or the third layer of the lens. Alternatively or additionally, in some embodiments, the parallax sensor 316 is configured to compare ambient light (e.g., light measured before passing through a portion of the lens) with light measured after passing through a portion of the lens (e.g., light that passes through at least the first layer 150, and / or contacts at least the second layer and / or the third layer of the lens). In some embodiments, the parallax sensor 316 is integrated into the circuitry of the head wearable device 114 or coupled to a portion of the head wearable device 114. The head wearable device 114 may include a single parallax sensor 316 or multiple parallax sensors 316 (e.g., one parallax sensor 316 for each lens). The one or more sensors may also include the following references FIG. 8A to FIG. 8C The one or more light sensors 868, IMU 829, and / or any other sensors described herein. In some embodiments, one or more sensors are associated with the corresponding lenses. For example, the head wearable device 114 may include a first ambient light sensor associated with the first lens 118, and a second ambient light sensor associated with the second lens 116. Alternatively, in some embodiments, a single sensor may be associated with both lenses. For example, a single ambient light sensor may be associated with the first lens 118 and the second lens 116. As described below with reference to FIG. 3A to FIG. 3C as well as FIG. 8A to FIG. 8C As discussed, the one or more sensors may be coupled to, or integrated into, a frame of the head wearable device 114 .

[0029] The head wearable device 114 also includes one or more imaging sensors, such as a front-facing camera, for collecting real-world image data. In some embodiments, the front-facing camera 152 is located near each lens. For example, the first front-facing camera 152b can be positioned to collect real-world image data adjacent to the first lens 118, and the second front-facing camera 152a can be positioned to collect real-world image data adjacent to the second lens 116. In some embodiments, the image data collected by the first front-facing camera 152b and the second front-facing camera 152a are used to determine the dimming level of each of the first lens 118 and / or the second lens 116. For example, the image data collected by the first front-facing camera 152b can be compared with the sensor data of the first lens 118 obtained from the parallax sensor 316, and the dimming level of the first lens can be determined based on the comparison (as discussed in detail below).

[0030] Back to Figure 1A , when the user 110 goes outside, the strong light from the sun causes the head wearable device 114, the first lens 118 and / or the second lens 116 to darken (e.g., causing the tinting of the lens to darken so that the lens becomes darker and the light passing through the lens is attenuated). In some embodiments, the dimming level of each of the first lens 118 and the second lens 116 is based on the brightness of the real-world environment. For example, as shown in Chart 124-1 (which shows the percentage of dimming levels of the first lens 118 and the second lens 116 as the brightness of the real-world environment changes at a first time point (t1), on a sunny day (e.g., between 32,000 lux and 100,000 lux, as described below), the first lens 118 and the second lens 116 have a dimming level of approximately 80% (e.g., causing 80% of the light passing through the first lens 118 and the second lens 116 to be attenuated). The chart 124-1 also includes a circular mark 122 indicating the current dimming level of the first lens 118, and a star mark 126 indicating the current dimming level of the second lens 116. As shown in the chart 124-1, the first lens 118 and the second lens 116 are set to the same dimming level.

[0031] In some embodiments, the brightness of the real-world environment is determined based on sensor data collected by one or more sensors (e.g., light sensor 868, such as an ambient light sensor) of the head wearable device 114. For example, the ambient light sensor can detect the amount of lux (a standard unit of illumination of ambient light) in a particular environment. In some embodiments, the amount of lux is used to determine the brightness of the real-world environment. For example, a very bright to bright real-world environment can be between 32,000 lux and 100,000 lux, an outdoor real-world environment with ample daylight can be between 10,000 lux and 25,000 lux, an office real-world environment can be between 320 lux and 500 lux, and a bedroom real-world environment can be between 60 lux and 100 lux.

[0032] Alternatively or additionally, in some embodiments, the brightness of the real-world environment is determined based on image data collected by one or more imaging sensors (e.g., front cameras 152b and 152a). For example, the image data can be processed (e.g., pixel analysis) to detect changes in brightness within a portion of the image data. In some embodiments, an ambient light sensor can detect the amount of nits (a unit of brightness / illuminance) in a particular environment. Nit is a unit of measurement for quantifying brightness by measuring the amount of light emitted or reflected. Higher nit values ​​indicate a brighter screen, allowing better visibility in a well-lit environment or under direct sunlight. For example, a very bright to bright real-world environment can be between 10,600 nits and 33,400 nits, an outdoor real-world environment with ample daylight can be between 3,300 nits and 8,400 nits, an office real-world environment can be between 100 nits and 170 nits, and a bedroom real-world environment can be between 20 nits and 35 nits. The above examples are non-limiting and may vary depending on the real-world environment, user-defined settings, and / or settings of the head wearable device 114.

[0033] The transmission level (e.g., dimming level) of each of the first lens 118 and the second lens 116 is determined based on the percentage of light measured passing through the respective portions of the first lens 118 and the second lens 116. For example, in some embodiments, the parallax sensor 316 can measure the amount of light passing through the first layer 150b of the first lens 118 and contacting the second layer 322b and / or the third layer 320b of the first lens 118. Alternatively or additionally, in some embodiments, the transmission level of each of the first lens 118 and the second lens 116 is determined based on a comparison of ambient light measured by the parallax sensor 316 and / or one or more light sensors 868 with the light passing through the respective lens measured by the parallax sensor 316. For example, the light sensor 868 can measure the ambient light at 5000 nits, while the parallax sensor 316 can measure the light passing through the lens at 1000 nits, which is consistent with a transmission level that attenuates 80% of the incident light. As described above, in some embodiments, the transmission level of each of the first lens 118 and the second lens 116 is determined based on a comparison of image data acquired by one or more imaging sensors and sensor data acquired by the parallax sensor 316. For example, the image data acquired by the front cameras 152b and 152a can be used to determine the current brightness of the real-world environment of the user 110, while the sensor data acquired by the parallax sensor 316 can be used to measure the light passing through each lens, and the image data and the sensor data can be used to determine the transmission level of each of the first lens 118 and the second lens 116. The above example techniques for determining the transmission level of the lens are non-limiting. The different techniques disclosed herein can determine the transmission level of the lens using only the sensor data acquired from the parallax sensor 316 or the data acquired from the parallax sensor 316 and other components (e.g., light sensor 868 and / or imaging sensor).

[0034] The dimming level of the first lens 118 and the second lens 116 can vary from a maximum dimming level (e.g., such that there is a visible light transmittance of 0% to 5%, where the visible light transmittance is the amount of light that passes through the lens to the user's eyes) to a minimum dimming level (e.g., such that there is a visible light transmittance of 80% or more). At the maximum dimming level, the first lens 118 and the second lens 116 have a darkened tint and can be opaque or substantially opaque; and at the minimum dimming level, the first lens 118 and the second lens 116 have little tint and can be transparent or substantially transparent. When the lenses transition from the maximum dimming level to the minimum dimming level, the tint and opacity of the first lens 118 and the second lens 116 decrease and / or reduce based on the current dimming level, and vice versa.

[0035] The head wearable device 114 can adjust the corresponding dimming levels of the first lens 118 and the second lens 116 to obtain or maintain the corresponding predetermined visible light transmittance or the corresponding predetermined light attenuation of each lens. In some embodiments, the head wearable device 114 adjusts the corresponding dimming levels of the first lens 118 and the second lens 116 to improve the visibility and / or presentation of the displayed AR content 112. For example, on a sunny day, the head wearable device 114 can reduce the real-world ambient brightness to improve the visibility of the presented AR content 112. The head wearable device 114 improves the visibility and / or presentation of the displayed AR content 112 by adjusting the additional contrast (C) of the lens, which is based on the relationship between the display brightness (D), the real-world ambient brightness (W) and / or the lens transmittance (T). In some embodiments, the relationship between different variables of the lens additional contrast (C) is defined by the following formula:

[0036]

[0037] The head wearable device 114 adjusts the dimming level and / or additional contrast of the lens by providing one or more electrical signals to the dimmable elements of the first layer 150 of the lens. More specifically, the head wearable device 114 adjusts the voltage applied to the corresponding lens to adjust the dimming level and / or additional contrast of the corresponding lens. The head wearable device 114 can adjust the corresponding voltages provided to the first lens 118 and the second lens 116 so that the first lens 118 and the second lens 116 have or maintain a corresponding predetermined dimming level and / or a corresponding additional contrast. Additionally or alternatively, in some embodiments, the head wearable device 114 can adjust the corresponding voltages provided to the first lens 118 and the second lens 116 so that the first lens 118 and the second lens 116 have or maintain a corresponding predetermined visible light transmittance or a corresponding predetermined light attenuation. The head wearable device 114 can provide electrical signals and / or voltages to the dimmable elements of the first layer 150 of the lens via a circuit coupled to at least the first layer 150. In some embodiments, the head wearable device 114 can provide an electrical signal and / or voltage to the dimmable element of the lens via a circuit coupled to the lens and / or a parallax sensor 316 electrically coupled to the dimmable element.

[0038] like Figure 1BAs shown, when the user 110 walks to a less bright real-world environment, the dimming level of the first lens 118 and / or the second lens 116 decreases. As the dimming level of the first lens 118 and / or the second lens 116 decreases, the corresponding tinting in the first lens 118 and / or the second lens 116 becomes lighter, so that the first lens 118 and / or the second lens 116 are transparent or substantially transparent. For example, as shown in chart 124-2 (which shows the percentage of dimming level of the first lens 118 and the second lens 116 as the brightness of the real-world environment changes at a second time point (t2), when indoors (e.g., a well-lit room with an ambient light measurement of about 150 lux), as shown by the circular mark 122 and the star mark 126, the first lens 118 and the second lens 116 have a dimming level of about 5% to 10% (i.e., 5% to 10% of the light passing through the first lens 118 and the second lens 116 is attenuated).

[0039] As described above, the head wearable device 114 can automatically adjust the dimming elements of the first lens 118 and / or the second lens 116 to control the amount of light reaching the eyes of the user 110 (e.g., maintaining a predetermined visible light transmittance) and / or improve the visibility of the presented AR content 112 (e.g., maintaining a predetermined additional contrast). Each dimming element can be independently controlled to compensate for other transmission or display brightness asymmetries in the system (e.g., the head wearable device 114). Alternatively or additionally, in some embodiments, in response to a trigger condition indicating that the dimming level needs to be adjusted, the corresponding dimming levels of the first lens 118 and the second lens 116 are adjusted. In some embodiments, the trigger condition includes a predetermined additional contrast. For example, based on determining that the additional contrast of the head wearable device 114 drops below a threshold amount, the trigger condition is detected and the dimming level of the first lens 118 and / or the second lens 116 is adjusted. In some embodiments, the trigger condition includes one or more of the following: a predetermined time of day (e.g., morning, afternoon, evening, night); a predetermined location (e.g., indoors, outdoors, office, bedroom); a predetermined dimming level (e.g., 80%, 50%, 20%, light attenuation); and / or a predetermined type of AR content (e.g., game application, media content, article). For example, the head wearable device 114 detects the presence of a trigger condition (e.g., presenting a predetermined type of AR content) in response to receiving a user's instruction to present a movie via its display, and automatically adjusts the dimming elements of the first lens 118 and / or the second lens 116.

[0040] although Figure 1A and Figure 1B The first lens 118 and the second lens 116 are shown to have the same dimming level, but as shown below with reference to FIG. 2A to FIG. 2DAs discussed, each lens may have a respective dimming level. More specifically, the first lens 118 may have a first dimming level, and the second lens 116 may have a second dimming level that is different from the first dimming level. As further described below, the respective dimming levels of the first lens 118 and / or the second lens 116 are affected by the AR content 112 presented on the respective lens.

[0041] FIG. 2A to FIG. 2D The lenses of the head wearable device according to some embodiments are shown to be dimmed independently of each other. Specifically, FIG. 2A to FIG. 2D The change in the respective dimming levels of the first lens 118 and the second lens 116 of the head wearable device 114 as the time changes and the sun moves to different positions is shown. In some embodiments, the head wearable device 114 can cause the first lens 118, the second lens 116, or both to present the AR content 112.

[0042] exist Figure 2A , a user 110 wearing a head wearable device 114 is sitting outdoors at a first point in time (e.g., time 1), and the head wearable device presents AR content 112 via at least one lens (e.g., the first lens 118). At the first point in time, the sun is partially covered by clouds, resulting in a partially sunny day, wherein an equal amount of light contacts the first lens 118 and the second lens 116. Since both the first lens 118 and the second lens 116 are exposed to the same amount of light, the head wearable device 114 adjusts the dimming of the first lens 118 and the second lens 116 so that the two lenses have the same dimming level (e.g., approximately 30%). The dimming levels of the first lens 118 and the second lens 116 are shown in chart 224-1, which includes a circular mark 222 for the first lens 118 and a star mark 226 for the second lens 116.

[0043] exist Figure 2B , user 110 is shown sitting outdoors at a second time point (e.g., time 2). At the second time point, the clouds have dissipated, and the sun shines directly on a portion of user 110. Specifically, a first amount of sunlight partially blocked by the tree contacts a first lens 118 of head wearable device 114, while a second amount of sunlight greater than the first amount contacts a second lens 116 of head wearable device 114. Head wearable device 114 is configured to receive light from user 110 via parallax sensor 316 ( FIG. 3A to FIG. 3C) detects the different amounts of sunlight contacting the first lens 118 and the second lens 116, and adjusts the dimming levels of each of the first lens 118 and the second lens 116 accordingly. For example, as shown in chart 224-2, the head wearable device 114 increases the dimming level of the first lens 118 to approximately 40% to 45% (as shown by the circular mark 222), and increases the dimming level of the second lens 116 to approximately 80% (as shown by the star mark 226). Because the tree provides additional coverage for the first lens 118 to block the sun, the head wearable device 114 does not have to increase the dimming level of the first lens 118 as much as the second lens 116. Although the second lens 116 is dimmed to a higher level than the first lens 118, the user 110 perceives that their field of view has uniform dimming. In other words, although the first lens 118 and the second lens 116 are at different dimming levels, the user 110 perceives that the two lenses have the same dimming level. As described above with reference to Figure 1A and Figure 1B As described, based on sensor data (eg, from the parallax sensor 316 ), image data, and / or other data, the first lens 118 and the second lens may be dimmed substantially simultaneously or independently of one another.

[0044] Figure 2C The user is shown sitting outdoors at a third time point (e.g., time 3). At the third time point, the head wearable device 114 adjusts the additional contrast of the first lens 118 to improve the visibility of the presented AR content 112. Figure 1A and Figure 1B As described in , the additional contrast of the lens is based on one or more of: display brightness; real-world ambient brightness; and / or lens transmittance (or dimming level). Figure 2C In order to improve the visibility of the presented AR content 112, the head wearable device increases the brightness of the display of the head wearable device 114, which can be part of the first lens 118. For example, as shown below with reference FIG. 3A to FIG. 3C As described, the display may be a waveguide that is part of or integrated into the second layer 320a of the first lens 118. As shown in the display brightness bar 227, the display brightness at the third time point increases from the first point 228 to the second point 229. The maximum brightness and minimum brightness of the display of the head wearable device 114 are based on the type of display used and / or device settings. FIG. 3A to FIG. 3C Example maximum brightness parameters and minimum brightness parameters are discussed.

[0045] like Figure 2CAs further shown, along with increasing the brightness of the display, as shown by the positions of the circular mark 222 and the star mark 226 on the chart 224-3, the head wearable device 114 reduces the dimming level of the first lens 118 (e.g., from about 40% to 45% to 30%). By dimming the first lens 118, the head wearable device 114 makes the presented AR content 112 easier to see. In addition, the head wearable device 114 can adjust the dimming level of the first lens 118 to further change the additional contrast of the first lens 118. In some embodiments, the head wearable device 114 can adjust a single variable (e.g., display brightness) or multiple variables (e.g., display brightness and dimming level) to obtain or maintain a predetermined additional contrast. In some embodiments, if the head wearable device 114 cannot obtain or maintain a specific additional contrast by changing the display brightness and / or lens transmittance, the head wearable device 114 can present a suggestion to the user for adjusting the brightness of the real-world environment. For example, if the adjustment of the display brightness and / or lens transmittance cannot obtain or maintain the determined additional contrast for the current environmental conditions (e.g., sunny day), the head wearable device 114 can present a prompt that advises the user to change position (e.g., "Please move to a darker area"). Alternatively, as shown below with reference to Figure 2D As discussed, the head wearable device 114 may cause the AR content 112 to be presented via the second lens 116 in response to determining that the head wearable device 114 is unable to present the AR content 112 via the first lens 118 .

[0046] exist Figure 2D , the user is sitting outdoors at a fourth time point (e.g., time 4). At the fourth time point, the sun changes position so that the sunlight shines directly on the first lens 118, and a portion of the tree blocks a portion of the sunlight from contacting the second lens 116. In response to determining that a predetermined additional contrast of the first lens 118 cannot be obtained or maintained and / or a predetermined dimming level cannot be obtained, the head wearable device 114 stops presenting the AR content 112 on the first lens 118 and presents the AR content 112 on the second lens 116. Along with presenting the AR content 112 on the second lens 116, the head wearable device 114 may also adjust the dimming level and / or additional contrast of the second lens 116 to improve the visibility of the AR content 112. For example, as shown in chart 224-4, the first lens 118 is dimmed to approximately 80% (e.g., as shown by the circular mark 222) and the second lens 116 is dimmed to approximately 30% (e.g., as shown by the star mark 226). Although not shown, as described above with reference to Figures 1A to 2C As described, the head wearable device 114 can also adjust the additional contrast of the second lens 116.

[0047] In some embodiments, the head wearable device 114 can selectively cause the AR content 112 to be presented in the first lens 118, the second lens 116, or both. In some embodiments, the selection of a particular lens is based on environmental conditions, energy consumption, and / or the quality of the AR content 112. For example, the head wearable device 114 can choose to present the AR content 112 to present the AR content 112 via the lens that is exposed to the least amount of sunlight, the lens that requires the least amount of dimming, the lens that requires the least amount of voltage, and / or other factors. Although Figures 1A to 2D The AR content 112 is shown presented via a single lens, but those skilled in the art will recognize after reading the description provided herein that the head wearable device 114 can present the AR content 112 via two lenses.

[0048] The above examples are non-limiting. For example, the disparity sensor 316 may be used in conjunction with a dedicated dimming control loop (e.g., including a calibrated light source and sensor, or a charge level measurement circuit). In another embodiment, an eye tracking camera may be used in addition to the disparity sensor 316 to provide the following reference: Figure 8C The dimming control module 856 discussed measures the brightness of the world. In yet another embodiment, two or more front-facing imaging sensors, and / or two or more sensors, can be used to determine the dimming state, wherein at least one front-facing imaging sensor and / or at least one sensor is associated with the dimming control module 856, and at least one front-facing imaging sensor and / or at least one sensor provides raw data. The imaging sensor may include a simultaneous localization and mapping (SLAM) camera, a red-green-blue (RGB) camera, and / or other cameras. The sensor may include an ambient light sensor (dedicated to world brightness monitoring or for privacy indicator brightness adjustment and / or anti-tampering). In an additional embodiment, only the parallax sensor 316 is used to directly measure the light ratio of the environment to the display to provide a single feedback signal to the active dimming system without the need for a front sensor signal.

[0049] FIG. 3A to FIG. 3C One or more sensors integrated with or coupled to artificial reality glasses according to some embodiments are shown. Artificial reality glasses 300 are head wearable devices 114 ( Figures 1A to 2D ) embodiments. Figure 3AA first view 310 (e.g., a view facing outward) of the artificial reality glasses 300 is shown. The artificial reality glasses 300 include a frame 315 coupled to the first lens 118 and the second lens 116. One or more sensors 304, 306, and / or 308 are integrated into or coupled to a portion of the frame 315. For example, as shown in the first view 310, the first ambient light sensor 308, the first front camera 152b, the second ambient light sensor 304, and the second front camera 152a are integrated into or coupled to a front portion (e.g., exterior) of the frame 315. As shown in Figures 1A to 2D As discussed in , corresponding light information can be detected via one or more sensors of the artificial reality glasses 300 and used to determine the corresponding dimming level of the first lens 118 and / or the second lens 116. FIG. 8A to FIG. 8C Additional sensors included in the head wearable device 114 (eg, artificial reality glasses 300) are discussed.

[0050] Figure 3B A second view 330 (e.g., an interior view or the portion in contact with the face) of the artificial reality glasses 300 is shown. The artificial reality glasses 300 may include additional sensors integrated into or coupled to the interior of the frame 315. For example, a first parallax sensor 316b and a second parallax sensor 316a are coupled to or integrated into the interior of the frame 315. Although the second view 330 shows two parallax sensors, in some embodiments, the artificial reality glasses 300 may include a single parallax sensor. In some embodiments, the parallax sensor 316 is provided in a circuit (e.g., Figure 8C The artificial reality glasses 300 may also include a first eye tracking camera 317 and a second eye tracking camera 318. The first eye tracking camera 317 and the second eye tracking camera 318 may be positioned so that they are aimed at the user's eyes (to directly track the user's eye movements) or at the first lens 118 and the second lens 116 (to indirectly track the user's eye movements via reflections from the first lens 118 and the second lens 116). FIG. 8A to FIG. 8C As described, head wearable devices such as artificial reality glasses 300 may also include microphones, speakers, IMUs, and / or other devices and / or sensors.

[0051] Figure 3C 1 shows a first lens 118 and a second lens 116 of artificial reality glasses 300 according to some embodiments. The first lens 118 and the second lens 116 can be formed via multiple layers. The multiple layers can include at least two layers. For example, Figure 3CAs shown, the multiple layers of the first lens 118 include a first layer 150b, a second layer 322b, and a third layer 320b. The multiple layers of the first lens 118 and the multiple layers of the second lens 116 can be the same or different. For example, the second lens 116 also includes a corresponding first layer 150a, a second layer 322a, and a third layer 320a.

[0052] In some embodiments, the first layer 150 (e.g., the first layer 150b and / or another first layer 150a) may include an adjustable light element that is configured to control the transmittance of the corresponding lens. Specifically, the adjustable light element is configured to receive one or more electrical signals that change the transmittance level of the first layer 150 (e.g., to adjust the amount of light reaching the second layer 322 and / or the user's eyes). These electrical signals may include one or more electrical properties, such as voltage, amplitude, frequency, etc. The electrical signal is provided to the first layer 150 and / or the adjustable light element via the circuit of the artificial reality glasses 300, a power supply electrically coupled to the first layer 150 and / or the adjustable light element, and / or other components of the head wearable device. The adjustable light element can be formed of a thermochromic material, a photochromic material, or an electrochromic material. In some embodiments, the adjustable light element is formed of liquid crystal. Alternatively, in some embodiments, the adjustable light element is mechanical.

[0053] In some embodiments, the second layer 322 includes or integrates a waveguide. The waveguide is configured to receive one or more optical signals via a display or projector so that a representation of image data is presented to a user. Specifically, the second layer 322 is configured to receive image data (e.g., via one or more optical signals) so that AR content (e.g., AR content 112, Figures 1A to 2D ). Alternatively, as shown below FIG. 8A to FIG. 8C As discussed in detail, the lens may include other types of displays. The second layer 322 may be illuminated at different brightness levels. As a non-limiting example, the minimum brightness of the display of the head wearable device 114 may be approximately 10 nits, and the maximum brightness of the display of the head wearable device 114 may be approximately 5000 nits. As described above, the head wearable device may adjust the brightness of the display (e.g., the second layer 322) to adjust the additional contrast of the lens.

[0054] In some embodiments, the third layer 320 includes or integrates additional waveguides, adjustable light elements, and other integrated components to further assist in presenting the AR content 112. For example, the third layer 320 may include additional waveguides to increase display brightness or present additional AR content 112. In some embodiments, the third layer 320 provides additional elements for measuring light as it passes through the lens. For example, an imaging sensor (e.g., an eye tracking camera) aligned with the third layer 320 can be used to measure the light as it passes through at least the first layer 150 and / or the second layer 322. In addition, the third layer 320 can be used to track the user's eye movements. For example, the eye tracking camera can capture reflections of the user's eye movements from the third layer 320, and can use the reflections of the user's eye movements captured in the image data to track the user's eye movements.

[0055] Figure 4 An example method for determining a dimming level of a lens based on sensor data acquired by a parallax sensor and / or image data collected by an imaging sensor according to some embodiments is shown. The operations (e.g., steps) of method 400 may be performed by a head wearable device 114 (e.g., Figures 1A to 3C as well as FIG. 8A to FIG. 8C ) is executed by one or more processors (e.g., a central processing unit and / or a microcontroller unit (MCU)). Figure 4 At least some of the operations shown in the examples may be stored in a computer memory or computer readable storage medium (e.g., a storage device, a random access memory (RAM), and / or a memory (e.g., memories 850A and 850B; Figure 8C Each operation of method 400 may be performed by a single device (e.g., head wearable device 114) alone, or in combination with another communication coupling device (e.g., wrist wearable device 700, handheld intermediate processing device 900, server 630, computer 640, mobile device 650, or the following references). FIG. 6A to FIG. 9B The method of the present invention is performed by one or more processors and / or hardware components of other devices described herein, and / or instructions stored in a memory or computer-readable medium of other devices that are communicatively coupled to the head wearable device 114. In some embodiments, the various operations of the various methods described herein are interchangeable and / or optional, and the corresponding operations of the various methods are performed by any of the aforementioned devices, systems, or combinations of devices and / or systems. For convenience, the method operations will be described below as being performed by specific components or specific devices, but in all embodiments, it should not be interpreted as limiting the execution of the operations to specific devices.

[0056] The method 400 includes one or more parallax sensors 316 ( FIG. 3A to FIG. 3C ) and / or the front camera 152 (e.g., Figures 1A to 3C ) is performed at a head wearable device 114 of the head wearable device 114. The method 400 includes determining (410) background subtraction of a real-world signal (e.g., ambient light or received light) based on sensor data acquired by the disparity sensor 316. More specifically, the background subtraction includes determining an amount of light removed by a lens (e.g., the first lens 118 and / or the second lens 116) of the head wearable device 114. The method 400 also includes determining (420) an average subtraction value corresponding to a region of interest. In some embodiments, the region of interest is based on a user's field of view. For example, in some embodiments, the region of interest is a pixel (of a sensor (e.g., a disparity sensor)), or a field of view of a user and / or a sensor (e.g., a disparity sensor). In some embodiments, the head wearable device 114 can determine more than one region of interest. For example, a first region of interest can be a portion of a pixel of a disparity sensor that includes the presented AR content, or a portion of a field of view of a disparity sensor that includes the presented AR content, and a second region of interest can be a central 20 degree field of view of the disparity sensor that is dimmed to make the AR content more visible. Alternatively, in some embodiments, the region of interest is a portion of the lens that presents AR content. For example, eye tracking can be used to determine a portion of the lens that the user is focusing on, and the portion of the lens that the user is focusing on can be the region of interest. For example, a first region of interest can be a portion of the lens that presents AR content, and a second region of interest can be a surrounding portion of the lens that is dimmed to make the AR content more visible. Method 400 includes converting (430) the average subtraction value to nits (or other comparable units). For example, the average subtraction value measured in lux is converted to nits by dividing it by pi (π).

[0057] The method 400 also includes collecting (440) real-world image data via the front camera. The method 400 includes determining (450) an average pixel value corresponding to the region of interest. The region of interest can be based on a specific lens of the head wearable device 114. For example, the first lens 118 ( Figures 1A to 3C) can be associated with the first front camera 152b so that image data collected by the first front camera 152b can be used to determine a region of interest corresponding to the first lens 118. In some embodiments, the region of interest can be based on an area or location of interest to which the user is concerned. For example, the front camera can be configured to collect image data of a user's field of view, and the region of interest is selected based on the image data. In some embodiments, the region of interest determined based on the image data is the same as or different from the region of interest described above at operation (420). Method 400 includes converting (460) the average pixel value to nits (or other comparable units). Specifically, an image processing technique is performed on the average pixel value corresponding to the region of interest (e.g., a portion of the image data) to convert the average pixel value to nits.

[0058] The method 400 also includes comparing (470) the converted average subtracted value (based on the sensor data collected by the parallax sensor 316) with the converted average pixel value (based on the image data collected by the front camera) to determine the dimming transmission level (T%). Figure 4 As shown, the converted average subtracted value is divided by the converted average pixel value to determine the current dimming transmission level. The method 400 also includes using (480) the current dimming transmission level to adjust the display brightness and / or active dimming voltage of the lens. Figures 1A to 3C As described, adjustments to the display brightness and / or active dimming voltage (which corresponds to dimming level adjustments) result in additional contrast changes.

[0059] (A1) Figure 5 A flowchart of an active dimming control method 500 for augmented reality glasses according to some embodiments is shown. Figure 4 As described, each operation (eg, each step) of method 500 may be performed by one or more processors of the head wearable device 114 . Figure 5At least some of the operations shown in correspond to instructions stored in a computer memory or a computer-readable storage medium. The operations of method 500 may be performed by a single device (e.g., head wearable device 114) alone, or in combination with one or more processors and / or hardware components of another communication-coupled device, and / or instructions stored in a memory or computer-readable medium of another device that is communication-coupled to the head wearable device 114. In some embodiments, the various operations of the methods described herein are interchangeable and / or optional, and the corresponding operations of the methods are performed by any of the aforementioned devices, systems, or combinations of devices and / or systems. For convenience, the method operations will be described below as being performed by specific components or specific devices, but in all embodiments should not be interpreted as limiting the execution of the operations to specific devices.

[0060] The method 500 is performed by the augmented reality glasses (e.g., an embodiment of the head wearable device 114) when the user wears (502) the augmented reality glasses. The method 500 includes obtaining (504) first light information measured via a first sensor, the first sensor being positioned to receive the light after the light passes through the adjustable light element of the augmented reality glasses. For example, the parallax sensor 316 ( Figures 1A to 3C ) measures light after passing through a portion of the lens. The lens may be formed of multiple layers including a first layer that includes an adjustable light element. The parallax sensor 316 may detect light after the light passes through at least the first layer 150. In some embodiments, the parallax sensor 316 measures light that contacts the second layer 322 or the third layer 320 of the multiple layers forming the lens. Figures 1A to 4 Various examples of acquiring the first light information via a parallax sensor are provided.

[0061] The method 500 includes acquiring (506) second light information measured via a second sensor positioned to receive light that has not passed through the adjustable light element of the augmented reality glasses. For example, an imaging sensor associated with the lens, such as a front-facing camera 152 (aligned with or positioned adjacent to the lens), captures image data of the real world environment and / or ambient lighting before the light passes through the lens of the augmented reality glasses. Figures 1A to 3C ). In some embodiments, a corresponding imaging sensor is associated with each lens. Alternatively, in some embodiments, a single imaging sensor is configured to provide light information for each lens. Figures 1A to 4 Various examples of acquiring the second light information via the front camera 152 are provided.

[0062] The method 500 also includes actively (eg, electronically) adjusting (508) a dimming level of the dimmable element based on the comparison between the first light information and the second light information. Figures 1A to 4 As described, the dimming level of each lens can be increased or decreased based on the AR content being presented, environmental conditions, or other factors.

[0063] (A2) In some embodiments of A1, the augmented reality glasses include an adjustable light element positioned farther away from the user than the display presentation element of the augmented reality glasses. Figure 3C As shown, the dimming element can be part of a first layer of the lens adjacent to the outer portion of the augmented reality glasses.

[0064] (A3) In some embodiments of either A1 or A2, the dimming level is further based on comparing one or both of the first light information and the second light information with third light information measured via a third sensor. Figures 1A to 2D As described, the head wearable device 114 can include one or more light sensors 868 (eg, ambient light sensors) configured to detect real-world signals (eg, ambient light or other external conditions).

[0065] (A4) In some embodiments of A3, the dimming level is further based on comparing two or more of the first light information, the second light information, and the third light information with fourth light information measured via a fourth sensor.

[0066] (A4.5) In some embodiments of A4, the fourth sensor is an eye tracking camera. The fourth sensor may include an eye tracking camera configured to measure light of the external environment passing through a portion of the lens. For example, the eye tracking camera may measure light passing through a dimming module (e.g., first layer 150; e.g., FIG. 3A to FIG. 3C ). In some embodiments, the eye tracking camera is positioned so that it is aimed at the lens and directly observes the dimming module (e.g., first layer 150; e.g., FIG. 3A to FIG. 3C ). Alternatively, in some embodiments, the eye tracking camera is positioned so that it is aimed at the user's eyes and acquires data for determining how much ambient light passes through the lenses and reaches the user's eyes. Depending on the field of view of the eye tracking camera, the eye tracking camera can also be configured to acquire data for determining the difference in brightness between light that reaches the user's face after passing through the lenses and light that passes through the frame or surrounding body of the head wearable device 114.

[0067] (A5) In some embodiments of any one of A1 to A4.5, the dimmable element is a first dimmable element associated with a first lens of the augmented reality glasses for a first eye of the user, and the augmented reality glasses also include a second dimmable element associated with a second lens of the augmented reality glasses for a second eye of the user. Actively adjusting the dimming level of the dimmable element includes actively adjusting the dimming level of only the first dimmable element. Figures 1A to 3C Examples of first dimming elements and / or second dimming elements are provided.

[0068] (A6) In some embodiments of A5, actively adjusting the dimming level of the dimmable element includes actively adjusting the dimming level of the second dimmable element after actively adjusting the dimming level of the first dimmable element. Figures 1A to 2D Example adjustments to the first dimming element and / or the second dimming element are provided.

[0069] (A7) In some embodiments of A6, the first dimmable element is adjusted to a first dimming level, and the second dimmable element is adjusted to a second dimming level different from the first dimming level. Figures 1A to 2D Example adjustments to the first dimming element and / or the second dimming element are provided.

[0070] (A8) In some embodiments of either A6 or A7, method 500 further includes: prior to actively adjusting the dimming level, determining that a dimming level adjustment of the first dimmable light element is required to allow correct viewing of the artificial reality content based on determining that the artificial reality content is being presented via the first lens. Actively adjusting the dimming level of the first dimmable light element is performed in response to determining that a dimming level adjustment of the first dimmable light element is required to allow correct viewing of the artificial reality content. Figures 1A to 2D Example adjustments of corresponding additional contrast of the first dimming element and / or the second dimming element are provided.

[0071] (A9) In some embodiments of A8, method 500 further includes: before actively adjusting the corresponding dimming level of the second dimmable light element, determining that the dimming level of the second dimmable light element needs to be adjusted to allow the artificial reality content to be properly viewed based on determining that the artificial reality content is being presented via the second lens. Actively adjusting the dimming level of the second dimmable light element is performed in response to determining that the dimming level of the second dimmable light element needs to be adjusted to allow the artificial reality content to be properly viewed. Figures 1A to 2D Example adjustments of corresponding additional contrast of the first dimming element and / or the second dimming element are provided.

[0072] (A10) In some embodiments of either A8 or A9, method 500 further includes, along with actively adjusting the dimmable light element, adjusting a respective brightness level for displaying a user interface element in front of each of the first dimmable light element and / or the second dimmable light element. Figures 1A to 2D Example adjustments of corresponding additional contrast of the first dimming element and / or the second dimming element are provided.

[0073] (A11) In some embodiments of any one of A8 to A10, actively adjusting includes electronically adjusting the first dimmable element and the second dimmable element to the same dimming level.

[0074] (A12) In some embodiments of any one of A1 to A9, the dimmable element includes (i) a first dimmable element associated with a first lens of the augmented reality glasses for a first eye of a user, and (ii) a second dimmable element associated with a second lens of the augmented reality glasses for a second eye of the user, and active adjustment occurs substantially simultaneously for both the first dimmable element and the second dimmable element.

[0075] (A13) In some embodiments of any one of A1 to A12, the first sensor is a parallax sensor configured to output first light information by comparing light from one or more waveguides.

[0076] (A14) In some embodiments of any one of A1 to A13, the first light information measured by the first sensor takes into account background subtraction of a real-world signal.

[0077] (A15) In some embodiments of any one of A1 to A14, the second sensor located in front of the dimmable element of the augmented reality glasses is an imaging sensor.

[0078] (A16) In some embodiments of any one of A1 to A15, the tunable light element is a photochromic-based element, an electrochromic-based element, a thermochromic-based element, and / or a mechanical-based element. FIG. 3A to FIG. 3C Dimming elements are discussed.

[0079] (A17) In some embodiments of any one of A1 to A16, actively adjusting the dimming level occurs in response to detecting a trigger condition, the trigger condition indicating that the dimming level of the dimmable element needs to be adjusted. Figures 1A to 2D Provides examples of trigger conditions.

[0080] (A18) In some embodiments of A17, the trigger condition is determined to be met when the additional contrast of the augmented reality glasses drops below a threshold amount.

[0081] (B1) According to some embodiments, a system includes one or more wrist wearable devices, artificial reality head-mounted viewers (headsets) and / or handheld intermediate processing devices, and the system is configured to perform operations corresponding to any one of A1 to A18.

[0082] (C1) According to some embodiments, a non-transitory computer-readable storage medium includes instructions that, when executed by a computing device (e.g., head wearable device 114) that communicates with a head wearable device 114, causes the computing device to perform operations corresponding to any one of A1 to A18.

[0083] (D1) An intermediate device configured to coordinate operations of a head wearable device and a wrist wearable device, the intermediate device configured to transmit information between the head wearable device and the wrist wearable device in combination with the method of any one of A1 to A18.

[0084] (E1) According to some embodiments, a non-transitory computer-readable storage medium includes instructions that, when executed by one or more processors (e.g., processor 848A and / or processor 848B) of a head wearable device (e.g., head wearable device 114), cause the head wearable device to perform one or more operations. These operations include: when a user (e.g., user 110) wears augmented reality glasses (e.g., head wearable device 114): (i) obtaining first light information measured by a first sensor (e.g., one or more sensors including a parallax sensor 316 of the head wearable device 114), the first sensor being positioned to receive the light after the light passes through a dimmable element of the augmented reality glasses (e.g., a first lens 118 including at least a first layer 150b, the first layer 150b including a first integrated dimmable element); (ii) obtaining second light information measured by a second sensor (e.g., a front camera 152), the second sensor being positioned to receive light that has not yet passed through the dimmable element of the augmented reality glasses; and (iii) actively adjusting the dimming level of the dimmable element based on a comparison between the first light information and the second light information. For example, as Figures 1A to 4 As described in , the dimming level of each lens can be changed based on the content presented on the first lens and / or the second lens and the environmental conditions. For example, when the user 110 is inside a dark building, the first lens 118 and / or the second lens 116 do not need to be dimmed so that the user 110 can still see through the lenses and view the presented AR content.

[0085] (E2) In some embodiments of E1, the dimmable element is a first dimmable element associated with a first lens of the augmented reality glasses for a first eye of the user, the augmented reality glasses further include a second dimmable element associated with a second lens of the augmented reality glasses for a second eye of the user, and the active adjustment includes electronically adjusting the dimming level of only the first dimmable element. Figures 1A to 3C Examples of first dimming elements and / or second dimming elements are provided.

[0086] (E3) In some embodiments of either E1 or E2, actively adjusting includes electronically adjusting the first dimmable element to a first dimming level and electronically adjusting the second dimmable element to a second dimming level different from the first dimming level. Figures 1A to 2D Example adjustments to the first dimming element and / or the second dimming element are provided.

[0087] (E4) In some embodiments of any one of E1 to E3, the instructions, when executed by the head wearable device, also cause the head wearable device to determine, before actively adjusting the dimming level, that the dimming level of the first dimmable light element needs to be adjusted to allow the artificial reality content (e.g., AR content 112) to be correctly viewed based on determining that artificial reality content is being presented via the first lens. The active adjustment of the dimming level of the first dimmable light element is performed in response to determining that the dimming level of the first dimmable light element needs to be adjusted to allow the AR content to be correctly viewed. The above reference Figures 1A to 2D Example adjustments of corresponding additional contrast of the first dimming element and / or the second dimming element are provided.

[0088] (E5) In some embodiments of any one of E1 to E4, the dimmable element includes (i) a first dimmable element associated with a first lens of the augmented reality glasses for a first eye of a user, and (ii) a second dimmable element associated with a second lens of the augmented reality glasses for a second eye of the user, and active adjustment occurs substantially simultaneously for both the first dimmable element and the second dimmable element. Figures 1A to 4 A plurality of dimmable light elements in the head wearable device 114 are shown.

[0089] (E6) In some embodiments of any one of E1 to E5, actively adjusting the dimming level occurs in response to detecting a trigger condition, the trigger condition indicating that the dimming level of the dimmable element needs to be adjusted. For example, Figure 1A and Figure 1B Describes the requirements for the triggering conditions.

[0090] (E7) In some embodiments of any one of E1 to E6, the trigger condition is determined to be satisfied when the additional contrast of the augmented reality glasses (e.g., the AR eye 300) drops below a threshold amount. Figure 1A Additional contrast is discussed further in .

[0091] (E8) In some embodiments of any one of E1 to E7, the augmented reality glasses (e.g., AR glasses 300) include an adjustable light element positioned farther from the user than a display presentation element of the augmented reality glasses (e.g., AR glasses 300). For example, Figure 3C The dimming element is shown as part of a first layer of an outer portion of the lens adjacent to the head wearable device 114.

[0092] (E9) In some embodiments of any one of E1 to E8, the first sensor is a parallax sensor configured to output first light information by comparing light from one or more waveguides. FIG. 3A to FIG. 3C Features of the parallax sensor 316 are discussed in .

[0093] (F1) According to some embodiments, a head wearable device includes one or more sensors (e.g., one or more sensors of the head wearable device 114, including the parallax sensor 316), one or more imaging devices (e.g., the front camera 152), two lenses (e.g., the first lens 118 and / or the second lens 116), a memory including instructions for performing one or more operations (e.g., the memory 850A and / or the memory 850B), and one or more processors (e.g., the processor 848A and / or the processor 848B) configured to execute the instructions so as to perform one or more operations. The operations include: when a user (e.g., user 110) wears augmented reality glasses (e.g., head wearable device 114), obtaining first light information measured by a first sensor among one or more sensors, the first sensor being positioned to receive the light after the light passes through an adjustable light element of the augmented reality glasses; obtaining second light information measured by a second sensor among the one or more sensors (e.g., front camera 152), the second sensor being positioned to receive light that has not yet passed through the adjustable light element of the augmented reality glasses; and actively adjusting the dimming level of the adjustable light element based on a comparison between the first light information and the second light information.

[0094] (F2) In some embodiments of F1, the dimmable element is a first dimmable element associated with a first lens of the augmented reality glasses for a first eye of the user, the augmented reality glasses further include a second dimmable element associated with a second lens of the augmented reality glasses for a second eye of the user, and the active adjustment includes electronically adjusting the dimming level of only the first dimmable element. Figures 1A to 3C Examples of first dimming elements and / or second dimming elements are provided.

[0095] The above-mentioned devices are described in more detail below, including wrist wearable devices, head-mounted view devices, systems, and haptic feedback devices. The above-mentioned specific operations may occur as a result of specific hardware; such hardware is described in more detail below. The devices described below are not restrictive, and features on these devices may be removed or additional features may be added to these devices.

[0096] The above-mentioned devices, including systems, wrist wearable devices, head-mounted viewer devices, and smart textile-based apparel, are described in more detail below. The above-mentioned specific operations may occur as a result of specific hardware; such hardware is described in more detail below. The devices described below are not restrictive, and features on these devices may be removed or additional features may be added to these devices. Different devices may include one or more similar hardware components. For the sake of brevity, similar devices and components are described below. Any differences between the devices and components are described in their respective sections below.

[0097] As described herein, a processor (e.g., a central processing unit (CPU), a microcontroller unit (MCU)) is responsible for executing instructions and controlling an electronic device (e.g., a wrist wearable device 700, a head wearable device 114 ( Figures 1A to 5), handheld intermediate processing device (HIPD) 900, electronic components for the operation of smart textile-based clothing (e.g., wearable gloves, not shown), or other computer systems. There are several types of processors that can be used interchangeably or can be specifically required by the various embodiments described herein. For example, the processor may be: (i) a general-purpose processor designed to perform a wide range of tasks, such as running software applications, managing operating systems, and performing arithmetic and logical operations; (ii) a microcontroller designed for specific tasks, such as controlling electronic devices, sensors, and motors; (iii) a graphics processing unit (GPU) designed to accelerate the creation and rendering of images, videos, and animations (e.g., virtual reality animations, such as three-dimensional modeling); (iv) a field-programmable gate array (FPGA) that can be programmed and reconfigured after manufacturing, and / or can be customized to perform specific tasks, such as signal processing, encryption, and machine learning; and (v) a digital signal processor (DSP) designed to perform mathematical operations on signals (e.g., audio, video, and radio waves). It will be appreciated by those skilled in the art that one or more processors of one or more electronic devices may be used in the various embodiments described herein.

[0098] As described herein, a controller is an electronic component that manages and coordinates the operation of other components within an electronic device (e.g., controlling inputs, processing data, and / or generating outputs). Examples of controllers may include: (i) a microcontroller, which includes small, low-power controllers commonly used in embedded systems and Internet of Things (IoT) devices; (ii) a programmable logic controller (PLC), which may be configured for use in industrial automation systems to control and monitor manufacturing processes; (iii) a system-on-a-chip (SoC) controller, which integrates multiple components such as a processor, memory, input / output (I / O) interfaces, and other peripherals into a single chip; and / or a DSP. As described herein, a graphics module is a component or software module designed to handle graphics operations and / or graphics processes, and the graphics module may include a hardware module and / or a software module.

[0099] As described herein, memory refers to an electronic component in a computer or electronic device that stores data and instructions for access and manipulation by a processor. The devices described herein may include volatile memory and non-volatile memory. Examples of memory may include: (i) random access memory (RAM) configured to temporarily store data and instructions, such as dynamic random access memory (DRAM), static random access memory (SRAM), double data rate random access memory (DDR RAM) or other random access solid-state storage devices; (ii) read-only memory (ROM) configured to permanently store data and instructions (e.g., one or more parts in system firmware and / or in a boot loader); (iii) flash memory, magnetic disk storage devices, optical disk storage devices, other non-volatile solid-state storage devices that can be configured to store data in electronic devices, such as universal serial bus (USB) drives, memory cards and / or solid-state drives (SSD); and (iv) cache memory configured to temporarily store frequently accessed data and instructions. As described herein, the memory may include structured data (e.g., a structured query language (SQL) database, a MongoDB database, GraphQL data, JSON data). Other examples of memory may include: (i) profile data, which includes user account data, user settings, and / or other user data stored by the user; (ii) sensor data detected by one or more sensors and / or otherwise acquired; (iii) media content data, which includes stored image data, audio data, and documents, etc.; and (iv) application data, which may include data collected and / or otherwise acquired and stored during use of the application; and / or any other type of data described herein.

[0100] As described herein, a power system of an electronic device is configured to convert input power into a form that can be used to operate the device. The power system can include various components, including: (i) a power source, which can be an alternating current (AC) adapter power source or a direct current (DC) adapter power source; (ii) a charger input, which can be configured to use a wired connection and / or a wireless connection (the charger input can be part of a peripheral interface, such as a USB, a micro USB interface, near-field magnetic coupling, magnetic induction and magnetic resonance charging, and / or radio frequency (RF) charging); (iii) a power management integrated circuit, which is configured to distribute power to various components of the device and ensure that the device operates within safe limits (e.g., regulating voltage, controlling current and / or managing heat dissipation); and / or (iv) a battery, which is configured to store power to provide usable power to one or more components of the electronic device.

[0101] As described herein, a peripheral interface is an electronic component (e.g., an electronic component of an electronic device) that allows the electronic device to communicate with other devices or peripherals and can provide a means for inputting and outputting data and signals. Examples of peripheral interfaces may include: (i) a universal serial bus (USB) interface and / or a micro USB interface configured to connect a device to an electronic device; (ii) a Bluetooth interface configured to allow multiple devices to communicate with each other, including Bluetooth Low Energy (BLE); (iii) a near-field communication (NFC) interface configured as a short-range wireless interface for operations such as access control; (iv) a pogo pin, which can be a small, spring-loaded pin configured to provide a charging interface; (v) a wireless charging interface; (vi) a global positioning system (GPS) interface; (vii) a Wi-Fi interface used to provide a connection between a device and a wireless network; and (viii) a sensor interface.

[0102] As described herein, a sensor is an electronic component configured to detect physical changes and environmental changes and generate an electrical signal (e.g., an electronic component in an electronic device (e.g., a wearable device) and / or an electronic component that otherwise communicates electronically with an electronic device). Examples of sensors may include: (i) an imaging sensor for collecting imaging data (e.g., including one or more cameras disposed on a corresponding electronic device); (ii) a biopotential signal sensor; (iii) an inertial measurement unit (e.g., an IMU) for detecting, for example, angular velocity, force, magnetic field, and / or acceleration changes; (iv) a heart rate sensor for measuring a user's heart rate; (v) a blood oxygen saturation (SpO2) sensor for measuring a user's blood oxygen saturation and / or other biometric data; (vi) a capacitive sensor for detecting a change in electrical potential at a portion of a user's body (e.g., a sensor-skin interface) and / or the proximity of other devices or objects; (vii) an optical sensor (e.g., a time-of-flight sensor, an infrared light sensor, a visible light sensor); and / or a sensor for sensing data from a user or the user's environment. As described herein, a biopotential signal sensing component is a device (e.g., a biopotential signal sensor) for measuring electrical activity within the body. Some types of biopotential signal sensors include: (i) an electroencephalography (EEG) sensor configured to measure electrical activity in the brain to diagnose neurological diseases; (ii) an electrocardiography (ECG or EKG) sensor configured to measure the electrical activity of the heart to diagnose heart problems; (iii) an electromyography (EMG) sensor configured to measure the electrical activity of muscles and diagnose neuromuscular disorders; and (iv) an electrooculography (EOG) sensor configured to measure the electrical activity of eye muscles to detect eye movements and diagnose eye disorders.

[0103] As described herein, an application (e.g., software) stored in a memory of an electronic device includes instructions stored in the memory. Examples of such applications include: (i) games; (ii) word processors; (iii) messaging applications; (iv) media streaming applications; (v) financial applications; (vi) calendars; (vii) clocks; (viii) web browsers; (ix) social media applications; (x) camera applications; (xi) web-based applications; (xii) health applications; (xiii) artificial reality applications; and / or any other application that may be stored in the memory. An application may operate in conjunction with data and / or one or more components of a device or multiple communicatively coupled devices to perform one or more operations and / or functions.

[0104] As described herein, the communication interface module may include hardware and / or software capable of communicating data using any of the following protocols: a custom wireless protocol or a standard wireless protocol (e.g., IEEE 802.15.4, Wi-Fi, ZigBee, 6LoWPAN, Thread, Z-Wave, Bluetooth Smart, ISA100.11a, WirelessHART, or MiWi); a custom wired protocol or a standard wired protocol (e.g., Ethernet or HomePlug); and / or any other suitable communication protocol (including communication protocols that have not been developed as of the filing date of this document). A communication interface is a mechanism that enables different systems or devices to exchange information and data with each other, and includes hardware, software, or a combination of both hardware and software. For example, a communication interface may refer to a physical connector and / or port on a device that enables communication with other devices (e.g., USB, Ethernet, High Definition Multimedia Interface (HDMI), Bluetooth). In some embodiments, a communication interface may refer to a software layer (e.g., an application programming interface (API), protocols such as Hypertext Transfer Protocol (HTTP) and Transmission Control Protocol / Internet Protocol (TCP / IP)) that enables different software programs to communicate with each other.

[0105] As described herein, a graphics module is a component or software module designed to process graphics operations and / or graphics processes, and the graphics module may include a hardware module and / or a software module.

[0106] As described herein, a non-transitory computer-readable storage medium is a physical device or storage medium that can be used to store electronic data in a non-transitory form (eg, such that the data is permanently stored until the data is intentionally deleted or modified).

[0107] Example AR System

[0108] Fig. 6A and Figure 6B An example artificial reality system is shown in accordance with some embodiments. Fig. 6A A first AR system 600a and a first example user interaction are shown, wherein the first example user interaction uses a wrist wearable device 700, a head wearable device 114 ( Figures 1A to 5 , such as AR device 800 and VR device 810) and / or handheld intermediary processing device (HIPD) 900. Figure 6BA second AR system 600b and a second example user interaction are shown, the second example user interaction using the wrist wearable device 700, the AR device 800 and / or the HIPD 900. As will be appreciated by those skilled in the art upon reading the description provided herein, the above example AR system (described in detail below) can perform the above reference Figures 1A to 5 Various functions and / or operations are described.

[0109] The following references Fig. 7A and Figure 7B Describes a wrist wearable device 700 and one or more of its components; the following reference FIG. 8A to FIG. 8C A head wearable device and one or more components thereof are described; and the following reference is made to Fig. 9A and Fig. 9B HIPD 900 and one or more components thereof are described. Although not shown, smart textile-based apparel can be used with any device disclosed herein. The wrist wearable device 700, the head wearable device, and / or the HIPD 900 can be communicatively coupled via a network 625 (e.g., cellular, near-field, Wi-Fi, a personal area network, a wireless local area network (LAN)). In addition, the wrist wearable device 700, the head wearable device, and / or the HIPD 900 can also be communicatively coupled to one or more servers 630, computers 640 (e.g., laptops, computers), mobile devices 650 (e.g., smartphones, tablets), and / or other electronic devices via a network 625 (e.g., cellular, near-field, Wi-Fi, a personal area network, a wireless LAN).

[0110] Go to Fig. 6A , showing a user 602 wearing a wrist wearable device 700 and an AR device 800, and the user places a HIPD 900 on his desk. The wrist wearable device 700, the AR device 800, and the HIPD 900 facilitate the user's interaction with the AR environment. Specifically, as shown in the first AR system 600a, the wrist wearable device 700, the AR device 800, and / or the HIPD 900 enable the presentation of one or more avatars 604, digital representations 606 of contacts, and virtual objects 608. As discussed below, the user 602 can interact with one or more avatars 604, digital representations 606 of contacts, and virtual objects 608 via the wrist wearable device 700, the AR device 800, and / or the HIPD 900.

[0111] The user 602 may provide user input using any of the wrist wearable device 700, the AR device 800, and / or the HIPD 900. For example, the user 602 may perform one or more gestures to provide user input, which are performed by the wrist wearable device 700 (e.g., using the following reference Fig. 7A and Figure 7B One or more EMG sensors and / or IMUs described herein) and / or detected by the AR device 800 (e.g., using the following reference Fig. 8A and Figure 8B-1 as well as Figure 8B-2 Alternatively or additionally, user 602 may provide user input via one or more touch surfaces of wrist wearable device 700, AR device 800, and / or HIPD 900, and / or voice commands collected by microphones of wrist wearable device 700, AR device 800, and / or HIPD 900. In some embodiments, wrist wearable device 700, AR device 800, and / or HIPD 900 include a digital assistant for helping the user provide user input (e.g., completing a series of operations, recommending different operations or commands, providing reminders, confirming commands). In some embodiments, user 602 may provide user input via one or more facial gestures and / or facial expressions. For example, a camera of wrist wearable device 700, AR device 800, and / or HIPD 900 may track the eyes of user 602 for navigating the user interface.

[0112] The wrist wearable device 700, the AR device 800, and / or the HIPD 900 may operate alone or in combination to allow the user 602 to interact with the AR environment. In some embodiments, the HIPD 900 is configured to operate as a central hub or control center for the wrist wearable device 700, the AR device 800, and / or another communicatively coupled device. For example, the user 602 may provide input for interacting with the AR environment at any of the wrist wearable device 700, the AR device 800, and / or the HIPD 900, and the HIPD 900 may identify one or more back-end tasks and front-end tasks to perform the requested interaction, and distribute instructions to perform the one or more back-end tasks and front-end tasks at the wrist wearable device 700, the AR device 800, and / or the HIPD 900. In some embodiments, the back-end tasks are background processing tasks that are not perceptible to the user (e.g., rendering content, decompression, compression), while the front-end tasks are user-oriented tasks that are perceptible to the user (e.g., presenting information to the user, providing feedback to the user). As described below with reference to Fig. 9A and Fig. 9BAs described, the HIPD 900 can perform backend tasks and provide operation data corresponding to the performed backend tasks to the wrist wearable device 700 and / or the AR device 800, so that the wrist wearable device 700 and / or the AR device 800 can perform frontend tasks. In this way, the HIPD 900 (which has more computing resources and greater thermal headroom than the wrist wearable device 700 and / or the AR device 800) performs computing-intensive tasks and reduces the computer resource utilization and / or power usage of the wrist wearable device 700 and / or the AR device 800.

[0113] In the example shown in the first AR system 600a, the HIPD 900 identifies one or more back-end tasks and front-end tasks associated with a user request to initiate an AR video call with one or more other users (represented by avatars 604 and digital representations 606 of contacts), and distributes instructions to cause the execution of the one or more back-end tasks and front-end tasks. Specifically, the HIPD 900 executes a back-end task for processing and / or rendering image data (and other data) associated with the AR video call, and provides the AR device 800 with operation data associated with the executed back-end task, so that the AR device 800 executes a front-end task for presenting the AR video call (e.g., presenting the avatar 604 and the digital representation 606 of the contact).

[0114] In some embodiments, the HIPD 900 can be operated as a focus or anchor point for information presentation. This allows the user 602 to know generally where the information is presented. For example, as shown in the first AR system 600a, the avatar 604 and the digital representation 606 of the contact are presented above the HIPD 900. Specifically, the HIPD 900 and the AR device 800 are combined to operate to determine the location for presenting the avatar 604 and the digital representation 606 of the contact. In some embodiments, information can be presented at a predetermined distance (e.g., within five meters) from the HIPD 900. For example, as shown in the first AR system 600a, the virtual object 608 is presented on the table at a certain distance from the HIPD 900. Similar to the above example, the HIPD 900 and the AR device 800 can be combined to operate to determine the location for presenting the virtual object 608. Alternatively, in some embodiments, the presentation of information is not constrained by the HIPD 900. More specifically, the avatar 604, the digital representation 606 of the contact, and the virtual object 608 do not have to be presented within a predetermined distance of the HIPD 900.

[0115] User input provided at the wrist wearable device 700, the AR device 800, and / or the HIPD 900 is coordinated so that the user can use any device to initiate, continue, and / or complete an operation. For example, the user 602 can provide user input to the AR device 800 to cause the AR device 800 to present a virtual object 608, and when the AR device 800 presents the virtual object 608, the user 602 can provide one or more gestures via the wrist wearable device 700 to interact with and / or manipulate the virtual object 608.

[0116] Figure 6B A user 602 is shown wearing a wrist wearable device 700 and an AR device 800, and holding a HIPD 900. In a second AR system 600b, the wrist wearable device 700, the AR device 800, and / or the HIPD 900 are used to receive one or more messages and / or provide one or more messages to contacts of the user 602. Specifically, the wrist wearable device 700, the AR device 800, and / or the HIPD 900 detect and coordinate one or more user inputs to launch a messaging application, and prepare a response to a received message via the messaging application.

[0117] In some embodiments, the user 602 launches an application on the wrist wearable device 700, the AR device 800, and / or the HIPD 900 via user input, which causes the application to be launched on at least one device. For example, in the second AR system 600b, the user 602 performs a gesture associated with a command for launching a messaging application (represented by the messaging user interface 612); the wrist wearable device 700 detects the gesture; and the wrist wearable device 700, based on determining that the user 602 is wearing the AR device 800, causes the AR device 800 to present the messaging user interface 612 of the messaging application. The AR device 800 can present the messaging user interface 612 to the user 602 via its display (e.g., as shown in the field of view 610 of the user 602). In some embodiments, the application is launched and runs on the device (e.g., the wrist wearable device 700, the AR device 800, and / or the HIPD 900) that detects the user input for launching the application, and the device provides operational data to another device to cause the messaging application to be presented. For example, the wrist wearable device 700 can detect user input for launching a messaging application; launch and run the messaging application; and provide operational data to the AR device 800 and / or the HIPD 900 to cause the messaging application to be presented. Alternatively, the application can be launched and run on a device different from the device that detects the user input. For example, the wrist wearable device 700 can detect a gesture associated with launching a messaging application, and can cause the HIPD 900 to run the messaging application and coordinate the presentation of the messaging application.

[0118] In addition, the user 602 can provide user input provided at the wrist wearable device 700, the AR device 800, and / or the HIPD 900 to continue and / or complete an operation initiated at another device. For example, after launching a messaging application via the wrist wearable device 700 and when the AR device 800 presents the messaging user interface 612, the user 602 can provide input at the HIPD 900 to prepare a response (i.e., as shown by a sliding gesture performed on the HIPD 900). The gesture performed by the user 602 on the HIPD 900 can be provided and / or displayed on another device. For example, the sliding gesture performed by the user 602 on the HIPD 900 is displayed on the virtual keyboard of the messaging user interface 612 displayed by the AR device 800.

[0119] In some embodiments, the wrist wearable device 700, the AR device 800, the HIPD 900, and / or other communicatively coupled devices may present one or more notifications to the user 602. The notification may be an indication of a new message, an incoming call, an application update, a status update, etc. The user 602 may select a notification via the wrist wearable device 700, the AR device 800, or the HIPD 900, and cause an application or operation associated with the notification to be presented on at least one device. For example, the user 602 may receive a notification that a message has been received at the wrist wearable device 700, the AR device 800, the HIPD 900, and / or other communicatively coupled devices, and provide user input at the wrist wearable device 700, the AR device 800, and / or the HIPD 900 to view the notification, and the device detecting the user input may cause an application associated with the notification to be launched and / or presented at the wrist wearable device 700, the AR device 800, and / or the HIPD 900.

[0120] Although the above example describes coordinated input for interacting with a messaging application, a person skilled in the art will recognize upon reading this description that user input can be coordinated to interact with any number of applications, including but not limited to gaming applications, social media applications, camera applications, web-based applications, and financial applications, etc. For example, the AR device 800 can present gaming application data to the user 602, and the HIPD 900 can use a controller to provide input to the game. Similarly, the user 602 can use the wrist wearable device 700 to activate the camera of the AR device 800, and the user can use the wrist wearable device 700, the AR device 800, and / or the HIPD 900 to manipulate image acquisition (e.g., zoom in or out, or apply filters) and acquire image data.

[0121] Having discussed example AR systems, devices for interacting with such AR systems, and other computing systems in a relatively general manner, they will now be discussed in more detail below. For ease of reference, some definitions of devices and components are defined herein as follows: these devices and components may be included in some or all of the multiple example devices discussed below. Those skilled in the art will recognize that certain types of components described below may be more suitable for a particular set of devices and less suitable for a different set of devices. However, subsequent references to the components defined herein should be deemed to be covered by the definitions provided.

[0122] In some embodiments discussed below, multiple example devices and systems including electronic devices and systems will be discussed. Such example devices and systems are not intended to be limiting, and those skilled in the art will appreciate that alternative devices and systems to the example devices and systems described herein may be used to perform the operations and construct the systems and devices described herein.

[0123] As described herein, an electronic device is a device that uses electrical energy to perform a specific function. The electronic device can be any physical object containing electronic components (e.g., transistors, resistors, capacitors, diodes, and integrated circuits). Examples of electronic devices include smart phones, laptop computers, digital cameras, televisions, game consoles, and music players, as well as examples of electronic devices discussed herein. As described herein, an intermediate electronic device is such a device: the device is located between two other electronic devices and / or between a subset of multiple components of one or more electronic devices, and facilitates communication, and / or data processing, and / or data transmission between corresponding electronic devices and / or electronic components.

[0124] Example wrist wearable device

[0125] Fig. 7A and Figure 7B An example wrist wearable device 700 is shown in accordance with some embodiments. The wrist wearable device 700 is a device described herein with reference to Figures 4 to 6B Examples of wearable devices are described. Fig. 7A Various components of wrist wearable device 700 are shown, which can be used alone or in combination, including combinations that include other electronic devices and / or electronic components.

[0126] As discussed below, Fig. 7A Wearable band 710 and watch body 720 (or capsule) are shown coupled to form wrist wearable device 700. Wrist wearable device 700 can perform various functions and / or operations associated with navigating in a user interface and selectively launching applications, as well as the above referenced Figures 1A to 5 Describes the functionality and / or operation.

[0127] As will be described in more detail below, operations performed by the wrist wearable device 700 may include: (i) presenting content to a user (e.g., displaying visual content via the display 705); (ii) detecting (e.g., sensing) user input (e.g., sensing a touch on a peripheral button 723 and / or a touch at a touch screen of the display 705, sensing a gesture detected by a sensor (e.g., a biopotential sensor)); (iii) sensing biometric data (e.g., neuromuscular signals, heart rate, temperature, sleep) via one or more sensors 713; messaging (e.g., text, voice, video); image acquisition via one or more imaging devices or cameras 725; wireless communications (e.g., cellular, near field, Wi-Fi, personal area network); location determination; financial transactions; providing tactile feedback; alarms; notifications; biometric authentication; health monitoring; sleep monitoring, etc.

[0128] The above example functions can be performed independently in the watch body 720, independently in the wearable band 710, and / or via electronic communication between the watch body 720 and the wearable band 710. In some embodiments, when an AR environment is presented (i.e., via one of the AR systems 600a and 600b), the functions can be performed on the wrist wearable device 700. As will be appreciated by those skilled in the art upon reading the description provided herein, the novel wearable device described herein can be used with other types of AR environments.

[0129] The wearable band 710 can be configured to be worn by a user so that the inner (or inner side) surface of the wearable structure 711 of the wearable band 710 contacts the user's skin. The sensor 713 contacts the user's skin when worn by the user. The sensor 713 can sense biometric data, such as the user's heart rate, saturated oxygen level, temperature, sweat level, neuromuscular signals, or a combination thereof. The sensor 713 can also sense data about the user's environment, including the user's movement, altitude, location, orientation, gait, acceleration, position, or a combination thereof. In some embodiments, the sensor 713 is configured to track the position and / or movement of the wearable band 710. One or more sensors 713 may include those defined above and / or the following regarding Figure 7B Any sensor of the plurality of sensors discussed.

[0130] One or more sensors 713 may be distributed on the inner surface and / or outer surface of the wearable band 710. In some embodiments, one or more sensors 713 are evenly spaced along the wearable band 710. Alternatively, in some embodiments, one or more sensors 713 are located at different points along the wearable band 710. Fig. 7AAs shown, one or more sensors 713 may be the same or different. For example, in some embodiments, one or more sensors 713 may be pill-shaped (e.g., sensor 713a), oval, circular, square, elliptical (e.g., sensor 713c), and / or any other shape that maintains contact with the user's skin (so that neuromuscular signals and / or other biometric data can be accurately measured at the user's skin). In some embodiments, one or more sensors 713 are aligned to form a sensor pair (e.g., for sensing neuromuscular signals based on differential sensing within each corresponding sensor). For example, sensor 713b is aligned with an adjacent sensor to form sensor pair 714a, and sensor 713d is aligned with an adjacent sensor to form sensor pair 714b. In some embodiments, the wearable band 710 does not have a sensor pair. Alternatively, in some embodiments, the wearable band 710 has a predetermined number of sensor pairs (e.g., one sensor pair, three sensor pairs, four sensor pairs, six sensor pairs, sixteen sensor pairs).

[0131] The wearable band 710 may include any suitable number of sensors 713. In some embodiments, the number and arrangement of sensors 713 depends on the specific application in which the wearable band 710 is used. For example, a wearable band 710 configured as an armband, wristband, or chest band may include multiple sensors 713, wherein each use case (e.g., a medical use case versus a gaming use case or an everyday use case) has a different number of sensors 713 and a different arrangement.

[0132] According to some embodiments, the wearable band 710 also includes an electrical ground electrode and a shield electrode. Similar to the sensor 713, the electrical ground electrode and the shield electrode can be distributed on the inner surface of the wearable band 710 so that they contact a portion of the user's skin. For example, the electrical ground electrode and the shield electrode can be located at the inner surface of the coupling mechanism 716 or at the inner surface of the wearable structure 711. The electrical ground electrode and the shield electrode can be formed by the same components as the sensor 713 and / or use the same components as the sensor 713. In some embodiments, the wearable band 710 includes more than one electrical ground electrode and more than one shield electrode.

[0133] The sensor 713 can be formed as part of the wearable structure 711 of the wearable band 710. In some embodiments, the sensor 713 is flush or substantially flush with the wearable structure 711 so that the sensors do not extend beyond the surface of the wearable structure 711. Despite being flush with the wearable structure 711, the sensor 713 is still configured to contact the user's skin (e.g., via a skin contact surface). Alternatively, in some embodiments, the sensor 713 extends beyond the wearable structure 711 by a predetermined distance (e.g., 0.1 millimeters (mm) to 2 mm) to contact and press into the user's skin. In some embodiments, the sensor 713 is coupled to an actuator (not shown) that is configured to adjust the extension height of the sensor 713 (e.g., the distance from the surface of the wearable structure 711) so that the sensor 713 contacts and presses into the user's skin. In some embodiments, the actuator adjusts the extension height between 0.01 mm and 1.2 mm. This allows the user to customize the position of the sensor 713 to improve the overall comfort of the wearable band 710 when being worn, while still allowing the sensor 713 to contact the user's skin. In some embodiments, the sensor 713 is not distinguishable from the wearable structure 711 when being worn by the user.

[0134] The wearable structure 711 can be formed of elastic materials, elastomers, etc., which are configured to be stretched and suitable for being worn by a user. In some embodiments, the wearable structure 711 is a textile or a woven fabric. As described above, the sensor 713 can be formed as a part of the wearable structure 711. For example, the sensor 713 can be molded into the wearable structure 711 or integrated into the woven fabric (for example, the sensor 713 can be sewn into the fabric and simulate the flexibility of the fabric (for example, the sensor 713 can be composed of a series of woven fabric lines)).

[0135] The wearable structure 711 may include sensors 713, electronic circuits, and / or other electronic components to be included in the wearable band 710 (hereinafter referred to as Figure 7B In some embodiments, the flexible electronic connector is configured to interconnect the sensor 713, electronic circuits, and / or other electronic components of the wearable band 710 with corresponding sensors and / or other electronic components of another electronic device (e.g., watch body 720). The flexible electronic connector is configured to move with the wearable structure 711 so that adjustments (e.g., resizing, pulling, folding) of the wearable structure 711 by the user do not cause stress or strain on the electrical coupling of the components of the wearable band 710.

[0136] As described above, the wearable band 710 is configured to be worn by a user. Specifically, the wearable band 710 can be shaped or otherwise manipulated to be worn by a user. For example, the wearable band 710 can be shaped to have a generally circular shape so that the wearable band can be configured to be worn on the user's lower arm or wrist. Alternatively, the wearable band 710 can be shaped to be worn on another body part of the user (e.g., the user's upper arm (e.g., around the biceps), forearm, chest, leg, etc.). The wearable band 710 may include a retaining mechanism 712 (e.g., a buckle, hook and loop fastener) that is used to secure the wearable band 710 to the user's wrist or other body part. When the wearable band 710 is worn by the user, the sensor 713 senses data from the user's skin (referred to as sensor data). In particular, the sensor 713 of the wearable band 710 acquires (e.g., senses and records) neuromuscular signals.

[0137] The sensed data (e.g., sensed neuromuscular signals) can be used to detect and / or determine the user's intention to perform certain motor actions. In particular, when the user performs muscle activation (movement, gestures, etc.), the sensor 713 senses and records neuromuscular signals from the user. The detected and / or determined motor actions (e.g., phalangeal movements (i.e., finger movements), wrist movements, hand movements, and / or other muscle intentions) can be used to determine control commands or control information (instructions for executing certain commands after sensing data) for causing the computing device to execute one or more input commands. For example, the sensed neuromuscular signals can be used to control certain user interfaces displayed on the display 705 of the wrist wearable device 700, and / or can be sent to a device (e.g., a head-mounted display) responsible for rendering an artificial reality environment so as to perform actions in the associated artificial reality environment (e.g., to control the movement of a virtual device displayed to the user). The muscle activations performed by the user may include static gestures, such as placing the user's palm down on a table; dynamic gestures, such as grasping a physical or virtual object; and covert gestures that are imperceptible to another person, such as slightly tensing a joint by co-contracting opposing muscles or using submuscular activation. The muscle activations performed by the user may include symbolic gestures (e.g., gestures that are mapped to other gestures, interactions, or commands, such as based on a gesture vocabulary that specifies a mapping of gestures to commands).

[0138] The sensor data sensed by sensor 713 can be used to provide the user with enhanced interaction with physical objects (e.g., devices communicatively coupled to wearable band 710) and / or virtual objects generated by the artificial reality system in an artificial reality application (e.g., user interface objects presented on display 705 or another computing device (e.g., a smartphone)).

[0139] In some embodiments, the wearable band 710 includes one or more haptic devices 746 (eg, vibrotactile actuators) such as Figure 7B ), the one or more haptic devices are configured to provide tactile feedback (e.g., skin sensation and / or kinesthetic perception) to the user's skin. Sensor 713 and / or haptic device 746 can be configured to operate in conjunction with multiple applications, including but not limited to health monitoring, social media, games, and artificial reality (e.g., applications associated with artificial reality).

[0140] The wearable band 710 may also include a coupling mechanism 716 (e.g., a bracket or shape of the coupling mechanism may correspond to the shape of the watch body 720 of the wrist wearable device 700) for removably coupling the capsule (e.g., computing unit) or the watch body 720 to the wearable band 710 (via a coupling surface of the watch body 720). In particular, the coupling mechanism 716 may be configured to receive a coupling surface of the watch body 720 near a bottom side (e.g., a side opposite to the front side of the watch body 720 where the display 705 is located) so that a user can push the watch body 720 downward into the coupling mechanism 716 to attach the watch body 720 to the coupling mechanism 716. In some embodiments, the coupling mechanism 716 may be configured to receive a top side of the watch body 720 (e.g., a side near the front side where the display 705 of the watch body 720 is located) that is pushed upward into the bracket instead of being pushed downward into the coupling mechanism 716. In some embodiments, the coupling mechanism 716 is an integral component of the wearable band 710, such that the wearable band 710 and the coupling mechanism 716 are a single unified structure. In some embodiments, the coupling mechanism 716 is a type of frame or housing that allows the coupling surface of the watch body 720 to be retained within or on the coupling mechanism 716 (e.g., a cradle, tracking band, support base, buckle) of the wearable band 710.

[0141] The coupling mechanism 716 can allow the watch body 720 to be removably coupled to the wearable band 710 by friction fit, magnetic coupling, a rotation-based connector, a scissor pin coupling, a retaining spring, one or more magnets, a clip, a pin, a hook and loop fastener, or a combination thereof. The user can perform any type of action to couple the watch body 720 to the wearable band 710 and detach the watch body 720 from the wearable band 710. For example, the user can twist, slide, turn, push, pull, or rotate (or a combination thereof) the watch body 720 relative to the wearable band 710 to attach the watch body 720 to the wearable band 710 and detach the watch body 720 from the wearable band 710. Alternatively, as discussed below, in some embodiments, the watch body 720 can be detached from the wearable band 710 by actuation of the release mechanism 729.

[0142] The wearable band 710 can be coupled to the watch body 720 to increase the functionality of the wearable band 710 (e.g., converting the wearable band 710 into a wrist wearable device 700, adding additional computing units and / or batteries to increase the computing resources and / or battery life of the wearable band 710, adding additional sensors to improve the sensed data). As described above, the wearable band 710 (and the coupling mechanism 716) are configured to operate independently of the watch body 720 (e.g., perform functions independently of the watch body). For example, the coupling mechanism 716 may include one or more sensors 713 that contact the user's skin when the user wears the wearable band 710 and provide sensor data for determining control commands.

[0143] The user can remove the watch body 720 (or the capsule) from the wearable band 710 to reduce the burden on the user of the wrist wearable device 700. For embodiments in which the watch body 720 is detachable, the watch body 720 can be referred to as a detachable structure, so that in these embodiments, the wrist wearable device 700 includes a wearable portion (e.g., the wearable band 710) and a detachable structure (watch body 720).

[0144] Turning to the watch body 720, the watch body 720 may have a generally rectangular or circular shape. The watch body 720 is configured to be worn by a user on a wrist or another body part. More specifically, the watch body 720 is sized to be easily carried by a user, easily attached to a portion of a user's clothing, and / or easily coupled to the wearable band 710 (thereby forming a wrist wearable device 700). As described above, the watch body 720 may have a shape corresponding to the coupling mechanism 716 of the wearable band 710. In some embodiments, the watch body 720 includes a single release mechanism 729 or multiple release mechanisms (e.g., two release mechanisms 729 positioned on opposite sides of the watch body 720, such as spring-loaded buttons) to separate the watch body 720 from the wearable band 710. The release mechanism 729 may include, but is not limited to, a button, a knob, a plug, a handle, a lever, a fastener, a buckle, a dial, a latch, or a combination thereof.

[0145] The user can actuate the release mechanism 729 by pushing, turning, lifting, pressing, moving the release mechanism 729, or performing other actions on the release mechanism 729. Actuation of the release mechanism 729 can release (e.g., separate) the watch body 720 from the coupling mechanism 716 of the wearable band 710, thereby allowing the user to use the watch body 720 independently of the wearable band 710, and vice versa. For example, separating the watch body 720 from the wearable band 710 can allow the user to use the rear camera 725B to capture images. Although it is shown as being positioned at a corner of the watch body 720, the release mechanism 729 can be positioned at any position on the watch body 720 that is convenient for user actuation. In addition, in some embodiments, the wearable band 710 may include a corresponding release mechanism for separating the watch body 720 from the coupling mechanism 716. In some embodiments, the release mechanism 729 is optional, and as described above, the watch body 720 can be separated from the coupling mechanism 716 (via twisting, rotation).

[0146] The watch body 720 may include one or more peripheral buttons 723 and 727 for performing various operations at the watch body 720. For example, the peripheral buttons 723 and 727 may be used to turn on or wake up the display 705 (e.g., to transition the display 705 from a sleep state to an active state), unlock the watch body 720, increase or decrease the volume, increase or decrease the brightness, interact with one or more applications, interact with one or more user interfaces, etc. Additionally or alternatively, in some embodiments, the display 705 acts as a touch screen and allows a user to provide one or more inputs for interacting with the watch body 720.

[0147] In some embodiments, the watch body 720 includes one or more sensors 721. The sensors 721 of the watch body 720 may be the same as or different from the sensors 713 of the wearable band 710. The sensors 721 of the watch body 720 may be distributed on the inner surface and / or outer surface of the watch body 720. In some embodiments, the sensors 721 are configured to contact the user's skin when the user wears the watch body 720. For example, the sensor 721 may be placed on the bottom side of the watch body 720, and the coupling mechanism 716 may be a bracket with an opening that allows the bottom side of the watch body 720 to directly contact the user's skin. Alternatively, in some embodiments, the watch body 720 does not include a sensor configured to contact the user's skin (e.g., includes sensors inside and / or outside the watch body 720 that are configured to sense data of the watch body 720 and data of the surrounding environment of the watch body 720). In some embodiments, the sensors 721 are configured to track the position and / or movement of the watch body 720.

[0148] The watch body 720 and the wearable band 710 can share data using a wired communication method (e.g., a universal asynchronous receiver / transmitter (UART), a USB transceiver) and / or a wireless communication method (e.g., near field communication, Bluetooth). For example, the watch body 720 and the wearable band 710 can share data sensed by sensors 713 and 721, as well as application-specific and device-specific information (e.g., active and / or available applications), output devices (e.g., displays, speakers), and input devices (e.g., touch screens, microphones, imaging sensors).

[0149] In some embodiments, the watch body 720 may include, but is not limited to, a front camera 725A and / or a rear camera 725B, sensors 721 (e.g., biometric sensors, IMUs, heart rate sensors, saturated oxygen sensors, neuromuscular signal sensors, altimeter sensors, temperature sensors, bioimpedance sensors, pedometer sensors, optical sensors (e.g., imaging sensors 763; Figure 7B ), touch sensor, sweat sensor). In some embodiments, the watch body 720 may include one or more tactile devices 776 ( Figure 7B ; vibrotactile actuator), the one or more haptic devices 776 are configured to provide tactile feedback (e.g., skin sensation and / or kinesthetic perception) to the user. The sensor 721 and / or the haptic device 776 may also be configured to operate in conjunction with a plurality of applications, including but not limited to health monitoring applications, social media applications, gaming applications, and artificial reality applications (e.g., applications associated with artificial reality).

[0150] As described above, the watch body 720 and the wearable band 710 can form the wrist wearable device 700 when coupled. The watch body 720 and the wearable band 710 act as a single device when coupled to perform the functions (operation, detection, communication, etc.) described herein. In some embodiments, each device is provided with specific instructions for performing one or more operations of the wrist wearable device 700. For example, based on determining that the watch body 720 does not include a neuromuscular signal sensor, the wearable band 710 may include alternative instructions for executing the associated instructions (e.g., providing the sensed neuromuscular signal data to the watch body 720 via a different electronic device). The various operations of the wrist wearable device 700 can be performed by the watch body 720 alone or by the watch body in combination with the wearable band 710 (e.g., via corresponding processors and / or hardware components), or vice versa. In some embodiments, the various operations of the wrist wearable device 700, the watch body 720, and / or the wearable band 710 can be communicated with another communicatively coupled device (e.g., HIPD 900; Fig. 9A and Fig. 9B) is executed in combination with one or more processors and / or hardware components.

[0151] As the following reference Figure 7B As described in the block diagram of FIG. 7 , the wearable band 710 and / or the body 720 may each include independent resources required to independently perform functions. For example, the wearable band 710 and / or the body 720 may each include a power source (e.g., a battery), a memory, a data storage device, a processor (e.g., a central processing unit (CPU)), a communication, a light source, and / or an input / output device.

[0152] Figure 7B A block diagram of a computing system 730 corresponding to a wearable band 710 and a computing system 760 corresponding to a watch body 720 is shown according to some embodiments. According to some embodiments, the computing system of wrist wearable device 700 includes a combination of components of the wearable band computing system 730 and components of the watch body computing system 760.

[0153] The watch body 720 and / or the wearable band 710 may include one or more components shown in the watch body computing system 760. In some embodiments, a single integrated circuit includes all or most of the components of the watch body computing system 760, which are included in a single integrated circuit. Alternatively, in some embodiments, the components of the watch body computing system 760 are included in multiple integrated circuits that are communicatively coupled. In some embodiments, the watch body computing system 760 is configured to be coupled to the wearable band computing system 730 (e.g., via a wired connection or a wireless connection), which allows the two computing systems to share components, distribute tasks, and / or perform other operations described herein (separately or as a single device).

[0154] The meter body computing system 760 may include one or more processors 779, a controller 777, a peripheral interface 761, a power system 795, and a memory (eg, memory 780), each of which is defined above and described in more detail below.

[0155] The power system 795 may include a charger input 796, a power management integrated circuit (PMIC) 797, and a battery 798, each of which is defined above. In some embodiments, the body 720 and the wearable band 710 may have respective charger inputs (e.g., charger inputs 796 and 757), respective batteries (e.g., batteries 798 and 759), and may share power with each other (e.g., the body 720 may power and / or charge the wearable band 710, and vice versa). Although the body 720 and / or the wearable band 710 may include respective charger inputs, a single charger input may charge the two devices when the two devices are coupled. The body 720 and the wearable band 710 may receive a charge using various techniques. In some embodiments, the body 720 and the wearable band 710 may receive a charge using a wired charging component (e.g., a power cord). Alternatively or additionally, the body 720 and / or the wearable band 710 may be configured for wireless charging. For example, the portable charging device can be designed to match a portion of the watch body 720 and / or a portion of the wearable band 710 and wirelessly transmit available power to the battery of the watch body 720 and / or the battery of the wearable band 710. The watch body 720 and the wearable band 710 can have independent power systems (e.g., power systems 795 and 756) to enable each to operate independently. The watch body 720 and the wearable band 710 can also share power (e.g., one can charge the other) via their respective PMICs (e.g., PMICs 797 and 758), which can share power through power conductors and ground conductors and / or through wireless charging antennas.

[0156] In some embodiments, the peripheral interface 761 may include one or more sensors 721, many of which are defined above. The sensor 721 may include one or more coupling sensors 762, which are used to detect when the watch body 720 is coupled to another electronic device (e.g., the wearable band 710). The sensor 721 may include an imaging sensor 763 (one or more of the cameras 725 and / or a separate imaging sensor 763 (e.g., a thermal imaging sensor)). In some embodiments, the sensor 721 includes one or more SpO2 sensors 764. In some embodiments, the sensor 721 includes one or more biopotential signal sensors (e.g., an EMG sensor 765, which may be disposed on a user-facing portion of the watch body 720 and / or the wearable band 710). In some embodiments, the sensor 721 includes one or more capacitive sensors 766. In some embodiments, the sensor 721 includes one or more heart rate sensors 767. In some embodiments, the sensor 721 includes one or more IMU sensors 768. In some embodiments, one or more IMU sensors 768 may be configured to detect movement of a user's hand, or movement of other locations where the watch body 720 is placed or held).

[0157] In some embodiments, the peripheral interface 761 includes a near field communication (NFC) component 769, a global-position system (GPS) component 770, a long-term evolution (LTE) component 771, and / or a Wi-Fi and / or Bluetooth communication component 772. In some embodiments, the peripheral interface 761 includes one or more buttons 773 (e.g., Fig. 7A The peripheral interface 761 may include peripheral buttons 723 and 727 in the watch body 720, which, when selected by the user, cause an operation to be performed at the watch body 720. In some embodiments, the peripheral interface 761 includes one or more indicators (e.g., light-emitting diodes (LEDs)) to provide visual indicators to the user (e.g., received messages, low battery, active microphone and / or camera).

[0158] The watch body 720 may include at least one display 705 for displaying a visual representation of information or data to the user, the visual representation including user interface elements and / or three-dimensional virtual objects. The display may also include a touch screen for inputting user input (e.g., touch gestures and sliding gestures, etc.). The watch body 720 may include at least one speaker 774 and at least one microphone 775 for providing audio signals to the user and receiving audio input from the user. The user may provide user input through the microphone 775, and may also receive audio output from the speaker 774 as part of the tactile event provided by the tactile controller 778. The watch body 720 may include at least one camera 725, the at least one camera 725 including a front camera 725A and a rear camera 725B. The camera 725 may include an ultra-wide-angle camera, a wide-angle camera, a fisheye camera, a spherical camera, a telephoto camera, a depth sensing camera, or other types of cameras.

[0159] The watch body computing system 760 may include one or more haptic controllers 778 and associated components (e.g., haptic devices 776) for providing haptic events at the watch body 720 (e.g., vibration sensations or audio outputs in response to events at the watch body 720). The haptic controller 778 may communicate with one or more haptic devices 776 (e.g., electroacoustic devices) including one or more speakers 774 and / or other audio components and / or electromechanical devices that convert energy into linear motion (e.g., motors, electromagnetic coils, electroactive polymers, piezoelectric actuators, electrostatic actuators, or other haptic output generating components (e.g., components that convert electrical signals into haptic outputs on the device)). The haptic controller 778 may provide haptic events that can be felt by a user of the watch body 720. In some embodiments, the one or more haptic controllers 778 may receive input signals from an application in the applications 782.

[0160] In some embodiments, the computing system 760 may include a memory 780, which may be controlled by one or more controllers 777 and / or a memory controller of one or more processors 779. In some embodiments, the software components stored in the memory 780 include one or more applications 782 configured to perform operations at the watch body 720. In some embodiments, the one or more applications 782 include games, word processors, messaging applications, call applications, web browsers, social media applications, media streaming applications, financial applications, calendars and clocks, etc. In some embodiments, the software components stored in the memory 780 include one or more communication interface modules 783 as defined above. In some embodiments, the software components stored in the memory 780 include: one or more graphics modules 784 for rendering, encoding and / or decoding audio data and / or video data; and one or more data management modules 785 for collecting, organizing and / or providing access to data 787 stored in the memory 780. In some embodiments, the software components stored in the memory 780 include a dimming control module 786A, which is configured to perform the above referenced Figures 1A to 5 In some embodiments, one or more applications and / or one or more modules in application 782 can work in conjunction with each other to perform various tasks at watch body 720.

[0161] In some embodiments, the software components stored in the memory 780 may include one or more operating systems 781 (e.g., a Linux-based operating system, an Android operating system, etc.). The memory 780 may also include data 787. The data 787 may include profile data 788A, sensor data 789A, media content data 790, application data 791, and dimming control data 792A, which is stored in the same manner as described above. Figures 1A to 5 The data related to the execution of each function described, such as one or more trigger conditions, device information (e.g., device brightness), a predetermined dimming level, a predetermined additional contrast, and / or the above reference Figures 1A to 5 Other data described.

[0162] It should be appreciated that watch body computing system 760 is an example of a computing system within watch body 720, and that watch body 720 may have more components or fewer components, may combine two or more components, and / or may have a different configuration and / or arrangement of the components than those shown in watch body computing system 760. The various components shown in watch body computing system 760 are implemented in hardware, software, firmware, or a combination thereof, including one or more signal processing circuits and / or application-specific integrated circuits (ASICs).

[0163] Turning to the wearable band computing system 730, one or more components that may be included in the wearable band 710 are shown. The wearable band computing system 730 may include more components or fewer components than those shown in the body computing system 760, may combine two or more components, and / or may have a different configuration and / or arrangement of some or all of these components. In some embodiments, all or most of the multiple components of the wearable band computing system 730 are included in a single integrated circuit. Alternatively, in some embodiments, the multiple components of the wearable band computing system 730 are included in multiple integrated circuits that are communicatively coupled. As described above, in some embodiments, the wearable band computing system 730 is configured to be coupled to the body computing system 760 (via a wired connection or a wireless connection), which allows the two computing systems to share components, distribute tasks, and / or perform other operations described herein (separately or as a single device).

[0164] Similar to the body computing system 760, the wearable band computing system 730 may include: one or more processors 749; one or more controllers 747 (including one or more tactile controllers 748); a peripheral interface 731, which may include one or more sensors 713 and other peripherals; a power source (e.g., a power system 756); and a memory (e.g., a memory 750), which includes an operating system (e.g., an operating system 751), data (e.g., data 754, which includes profile data 788B, sensor data 789B, dimming control data 792B) and one or more modules (e.g., a communication interface module 752, a data management module 753, a dimming control module 786B).

[0165] In view of the above definition, the one or more sensors 713 can be similar to the sensor 721 of the computing system 760. For example, the sensor 713 can include one or more coupling sensors 732, one or more SpO2 sensors 734, one or more EMG sensors 735, one or more capacitive sensors 736, one or more heart rate sensors 737, and one or more IMU sensors 738.

[0166] Peripheral interface 731 may also include other components similar to those included in peripheral interface 761 of computing system 760, as described above with reference to peripheral interface 761, including NFC component 739, GPS component 740, LTE component 741, Wi-Fi and / or Bluetooth communication component 742, and / or one or more haptic devices 746. In some embodiments, peripheral interface 731 includes one or more buttons 743, display 733, speaker 744, microphone 745, and camera 755. In some embodiments, peripheral interface 731 includes one or more indicators, such as LEDs.

[0167] It should be appreciated that the wearable band computing system 730 is an example of a computing system within the wearable band 710, and that the wearable band 710 may have more components or fewer components than those shown in the wearable band computing system 730, may combine two or more components, and / or may have a different configuration and / or arrangement of the components. The various components shown in the wearable band computing system 730 may be implemented in hardware, software, firmware, or a combination thereof (including one or more signal processing circuits and / or application specific integrated circuits).

[0168] refer to Fig. 7A The wrist wearable device 700 is an example of a wearable band 710 and a watch body 720 coupled, and thus the wrist wearable device 700 will be understood to include the components shown and described for the wearable band computing system 730 and the watch body computing system 760. In some embodiments, the wrist wearable device 700 has a split architecture (e.g., a split mechanical architecture or a split electronic architecture) between the watch body 720 and the wearable band 710. In other words, all of the components shown in the wearable band computing system 730 and the watch body computing system 760 can be housed or otherwise arranged in the combined wrist wearable device 700, or can be housed or otherwise arranged in a single component in the watch body 720, the wearable band 710, and / or portions thereof (e.g., the coupling mechanism 716 of the wearable band 710).

[0169] The above technology can be used with any device for sensing neuromuscular signals (including Fig. 7A and Figure 7BThe invention is intended for use with arm wearables in the context of neuromuscular control, but may also be used with other types of wearable devices for sensing neuromuscular signals, such as body wearables or head wearables that may have neuromuscular sensors closer to the brain or spine.

[0170] In some embodiments, the wrist wearable device 700 can be used in conjunction with the head wearable devices described below (e.g., AR device 800 and VR device 810) and / or HIPD 900; the wrist wearable device 700 can also be configured to allow the user to control aspects of the artificial reality (e.g., by using EMG-based gestures to control user interface objects in the artificial reality, and / or by allowing the user to interact with a touch screen on the wrist wearable device to also control aspects of the artificial reality). Having described example wrist wearable devices in this manner, attention is now turned to example head wearable devices, such as AR device 800 and VR device 810.

[0171] Example head wearable device

[0172] FIG. 8A to FIG. 8C An example head wearable device according to some embodiments is shown. The head wearable device may include, but is not limited to, an AR device 800 (e.g., an AR eyewear device or a smart eyewear device, such as smart glasses, smart monocles, smart contact lenses), a VR device 810 (e.g., a VR head-mounted viewer, a head-mounted display (HMD)), or other visually coupled devices. The AR device 800 and the VR device 810 are referenced herein. Figures 1A to 5 The example of the head wearable device 114 described above is such that the head wearable device should be understood to have features of the AR device 800 and / or the VR device 810, and vice versa. The AR device 800 and the VR device 810 can perform various functions and / or operations associated with navigating in the user interface and selectively launching applications, as well as the above referenced Figures 1A to 5 Describes the functionality and / or operation.

[0173] In some embodiments, an AR system (e.g., AR systems 600a-600b; FIG. 6A to FIG. 6B ) includes an AR device 800 (such as Fig. 8A ) and / or VR device 810 (as shown Figure 8B-1 and Figure 8B-2 In some embodiments, the AR device 800 and the VR device 810 may include one or more similar components (e.g., components for presenting an interactive artificial reality environment, such as a processor, a memory, and / or a presentation device, the presentation device including one or more displays and / or one or more waveguides), referring to Figure 8CSome of these components are described in more detail. The head wearable device may use a display projector (e.g., display projector components 807A and 807B) and / or a waveguide for projecting a representation of data to a user. Some embodiments of the head wearable device do not include a display.

[0174] Fig. 8A An example visual depiction of an AR device 800 (e.g., the AR device 800 may also be described herein as augmented reality glasses and / or smart glasses) is shown. The AR device 800 may be used with Fig. 8A 800, which are in electronic communication with or otherwise configured to be used in conjunction with the AR device 800. In some embodiments, the wearable accessory device and / or the intermediate processing device may be configured to communicate with the AR device 800 via a coupled sensor 824 (e.g., Figure 8C In some embodiments, the AR device 800 may be coupled to the AR device 800 by a coupling mechanism for electronic communication with the AR device 800 (as shown), wherein the coupling sensor 824 may detect when the electronic device is physically or electronically coupled to the AR device 800. In some embodiments, the AR device 800 may be configured to couple to a housing (e.g., a portion of the frame 804 or a portion of the temple 805), which may include one or more additional coupling mechanisms configured to couple to additional accessory devices. Fig. 8A The components shown in the EMBODIMENTS 2000 may be implemented in hardware, software, firmware, or a combination thereof, including one or more signal processing components and / or application specific integrated circuits (ASICs).

[0175] The AR device 800 includes mechanical eyeglass components, which include a frame 804 configured to hold one or more lenses (e.g., one or both of lenses 806-1 and 806-2). It will be appreciated by those of ordinary skill in the art that the AR device 800 may include additional mechanical components, such as a hinge configured to allow a portion of the frame 804 of the AR device 800 to be folded and unfolded, a bridge configured to span the gap between the lens 806-1 and the lens 806-2 and rest on the user's nose, a nose pad configured to rest on the bridge of the nose and provide support for the AR device 800, an earpiece configured to rest on the user's ear and provide additional support for the AR device 800, and a temple 805 configured to extend from the hinge of the AR device 800 to the earpiece, etc. It will also be appreciated by those of ordinary skill in the art that some examples of the AR device 800 may not include the mechanical components described herein. For example, a smart contact lens configured to present an artificial reality to a user may not include any components of the AR device 800.

[0176] Lenses 806-1 and 806-2 can be separate displays or display devices (e.g., waveguides for projected representations). Lenses 806-1 and 806-2 can work together or independently to present an image or a series of images to a user. In some embodiments, lenses 806-1 and 806-2 can operate in conjunction with one or more display projector components 807A and 807B to present image data to a user. Although AR device 800 includes two displays, embodiments of the present disclosure can be implemented in an AR device with a single near-eye display (NED) or more than two NEDs.

[0177] The AR device 800 includes a number of electronic components, many of which will be described below with reference to FIG. Figure 8C Describe in more detail. Fig. 8A Some example electronic components are shown in FIG. 8 , which include sensors 823 - 1 , 823 - 2 , 823 - 3 , 823 - 4 , 823 - 5 , and 823 - 6 , which may be distributed along a majority of the frame 804 of the AR device 800 . Figure 8C Different types of sensors are described. The AR device 800 also includes a left camera 839A and a right camera 839B located on different sides of the frame 804. And the eyewear device includes one or more processors 848A-1 and 848A-2 (e.g., an integrated microprocessor such as an ASIC) embedded in a portion of the frame 804.

[0178] Figure 8B-1 and Figure 8B-2 An example visual depiction of a VR device 810 (e.g., a head-mounted display (HMD) 812, also referred to herein as an artificial reality head-mounted viewer, a head wearable device, or a VR head-mounted viewer) is shown. The HMD 812 includes a front body 814 and a frame 816 (e.g., a strip or band) shaped to fit the user's head. In some embodiments, the front body 814 and / or the frame 816 include one or more electronic components (a display, a processor (e.g., processor 848A-1), an IMU, a tracking transmitter or detector, and sensors, etc.) that are used to facilitate the presentation of an AR system and / or a VR system, and / or interaction with an AR system and / or a VR system. In some embodiments, as Figure 8B-2 As shown, HMD 812 includes an output audio transducer (e.g., audio transducer 818). In some embodiments, as Figure 8B-2As shown, one or more components (e.g., one or more output audio transducers 818 and frame 816) (e.g., part or all of frame 816 and / or output audio transducer 818) can be configured to be attached to and detached from HMD 812 (e.g., it is detachably attached to HMD 812). In some embodiments, coupling the detachable component to HMD 812 causes the detachable component to enter electronic communication with HMD 812. VR device 810 includes electronic components, many of which will be described below with reference to Figure 8C Describe in more detail.

[0179] Figure 8B-1 and Figure 8B-2 Also shown are one or more cameras of the VR device 810, such as a left camera 839A and a right camera 839B, which can be similar to the left camera and the right camera on the frame 804 of the AR device 800. In some embodiments, the VR device 810 includes one or more additional cameras (e.g., cameras 839C and 839D), which can be configured to enhance the image data acquired by the cameras 839A and 839B by providing more information. For example, camera 839C can be used to provide color information that is not recognized by cameras 839A and 839B. In some embodiments, one or more of the cameras 839A to 839D can include an optional infrared (IR) cut filter that is configured to remove IR light received at the corresponding camera sensor.

[0180] The VR device 810 may include a housing 890 that stores one or more components of the VR device 810 and / or additional components of the VR device 810. The housing 890 may be a modular electronic device that is configured to couple with the VR device 810 (or the AR device 800) and to supplement and / or expand the capabilities of the VR device 810 (or the AR device 800). For example, the housing 890 may include additional sensors, cameras, power supplies, and processors (e.g., processor 848A-2), etc., to improve and / or increase the functionality of the VR device 810. The following references Figure 8C Examples of different components included in housing 890 are described.

[0181] Alternatively or additionally, in some embodiments, the head wearable device (e.g., VR device 810 and / or AR device 800) includes another external device (e.g., a pairing device) or is communicatively coupled to another external device, such as (hereinafter referred to as Fig. 9A and Fig. 9BThe HIPD 900 and / or the optional neckband discussed herein may be coupled to the head wearable device via one or more connectors (e.g., a wired connector or a wireless connector). The head wearable device and the neckband may operate independently without any wired or wireless connection between them. In some embodiments, the components of the head wearable device and the components of the neckband are located on one or more additional peripheral devices that are paired with the head wearable device, the neckband, or some combination thereof. In addition, the neckband is intended to represent any suitable type or form of paired device. Therefore, the following discussion of the neckband may also apply to various other paired devices, such as smart watches, smart phones, wristbands, other wearable devices, handheld controllers, tablet computers, or laptop computers.

[0182] In some cases, pairing an external device, such as an intermediate processing device (e.g., HIPD 900, an optional neckband, and / or a wearable accessory device) with a head wearable device (e.g., AR device 800 and / or VR device 810) enables the head wearable device to achieve a form factor similar to a pair of glasses while still providing sufficient battery power and computing power for the expanded capabilities. Some or all of the battery power, computing resources, and / or additional features of the head wearable device can be provided by the paired device, or shared between the paired device and the head wearable device, thereby reducing the weight, heat profile, and form factor of the head wearable device overall while allowing the head wearable device to maintain its desired functionality. For example, an intermediate processing device (e.g., HIPD 900) can allow components that are otherwise included in the head wearable device to be included in the intermediate processing device (and / or wearable device or accessory device), thereby shifting the weight load from the user's head and neck to one or more other parts of the user's body. In some embodiments, the intermediate processing device has a large surface area to diffuse and disperse heat to the surrounding environment through the large surface area. Thus, the intermediate processing device may allow for greater battery capacity and computing power than would otherwise be feasible on a separate head wearable device. Because the weight carried in the intermediate processing device may be less intrusive to the user than the weight carried in the head wearable device, the user may be able to tolerate wearing a lighter eyewear device and carrying or wearing a paired device for longer periods of time than if the user were wearing a heavier separate eyewear device, thereby enabling the artificial reality environment to be more fully integrated into the user's daily activities.

[0183] In some embodiments, the intermediate processing device is communicatively coupled to the head wearable device and / or communicatively coupled to other devices. These other devices can provide certain functions (e.g., tracking, positioning, depth map construction, processing, storage) to the head wearable device. In some embodiments, the intermediate processing device includes a controller and a power supply. In some embodiments, the sensor of the intermediate processing device is configured to sense additional data, which can be shared with the head wearable device in an electronic format (analog or digital).

[0184] The controller of the intermediate processing device processes information generated by sensors on the intermediate processing device and / or on the head wearable device. The intermediate processing device (e.g., HIPD 900) can process information generated by one or more of its multiple sensors and / or information provided by other communicatively coupled devices. For example, the head wearable device may include an IMU, and the intermediate processing device (neckband and / or HIPD 900) can calculate all inertial calculations and spatial calculations based on the IMU located on the head wearable device. The following reference Fig. 9A and Fig. 9B Additional examples of processing performed by a communicatively coupled device (eg, HIPD 900 ) are provided.

[0185] The artificial reality system may include various types of visual feedback mechanisms. For example, the display device in the AR device 800 and / or the VR device 810 may include one or more liquid crystal displays (LCD), one or more light emitting diode (LED) displays, one or more organic LED (OLED) displays, and / or any other suitable type of display screen. The artificial reality system may include a single display screen for both eyes or may provide a separate display screen for each eye, which may allow additional flexibility for zoom adjustment or for correcting refractive errors associated with the user's vision. Some artificial reality systems also include an optical subsystem having one or more lenses (e.g., conventional concave or convex lenses, Fresnel lenses, or adjustable liquid lenses) through which the user can view the display screen. In addition to or instead of using a display screen, some artificial reality systems include one or more projection systems. For example, the display device in the AR device 800 and / or the VR device 810 may include a micro LED projector (e.g., using a waveguide) that projects light to the display device, such as a transparent combination lens that allows ambient light to penetrate. The display device may refract the projected light to the user's pupil, and may enable the user to view both the artificial reality content and the real world simultaneously. The artificial reality system may also be configured with any other suitable type or form of image projection system. As noted, some artificial reality systems may not mix artificial reality with real reality, but rather substantially replace one or more of the user's multiple sensory perceptions of the real world with a virtual experience.

[0186] Although multiple example head wearable devices are described herein as AR device 800 and VR device 810, respectively, any or both of the multiple example head wearable devices described herein can be configured to present a fully immersive VR scene in substantially all of the user's field of view, in addition to or in lieu of a more subtle augmented reality scene presented within a portion of the user's field of view (less than the full field of view).

[0187] In some embodiments, the AR device 800 and / or the VR device 810 may include a tactile feedback system. The tactile feedback system can provide several types of skin feedback, including vibration, force, traction, shear stress, texture and / or temperature. The tactile feedback system can also provide several types of kinesthetic feedback, such as motion and compliance. Tactile feedback can be implemented using motors, piezoelectric actuators, fluid systems and / or various other types of feedback mechanisms. The tactile feedback system can be implemented independently of other artificial reality devices, implemented in other artificial reality devices, and / or combined with other artificial reality devices (e.g., wrist wearable devices that can be incorporated into headwear, gloves, jumpsuits; handheld controllers; environmental devices (e.g., chairs or carpets); and / or any other type of device or system, such as wrist wearable devices 700, HIPD 900, or smart textile-based clothing) and / or other devices described herein.

[0188] Figure 8C A computing system 820 and an optional housing 890 are shown, each of which shows components that may be included in a head wearable device (e.g., AR device 800 and / or VR device 810). In some embodiments, more components or fewer components may be included in the optional housing 890, depending on the practical constraints of the respective head wearable device being described. Additionally or alternatively, the optional housing 890 may include additional components to expand and / or enhance the functionality of the head wearable device.

[0189] In some embodiments, computing system 820 and / or optional housing 890 may include one or more peripheral interfaces 822A and 822B, one or more power systems 842A and 842B (including charger input 843, PMIC 844, and battery 845), one or more controllers 846A and 846B (including one or more haptic controllers 847), one or more processors 848A and 848B (as defined above, including any of the multiple examples provided), and memory 850A and 850B, all of which may be in electronic communication with each other. For example, one or more processors 848A and / or 848B may be configured to execute instructions stored in memory 850A and / or 850B, which may cause one of the one or more controllers 846A and / or 846B to cause multiple operations to be performed at one or more peripheral devices of peripheral interfaces 822A and / or 822B. In some embodiments, each of the operations described may be performed based on power provided by power systems 842A and / or 842B.

[0190] In some embodiments, the peripheral interface 822A may include one or more devices configured as part of the computing system 820, many of which have been defined and / or referenced above. Fig. 7A and Figure 7B 823A. For example, the peripheral interface may include one or more sensors 823A. Some example sensors include one or more coupling sensors 824, one or more acoustic sensors 825, one or more imaging sensors 826, one or more EMG sensors 827, one or more capacitive sensors 828, and / or one or more IMUs 829. In some embodiments, the sensor 823A also includes: a depth sensor 867; an optical sensor 868; and / or any other type of sensor defined above or described with reference to any other embodiment discussed herein.

[0191] In some embodiments, the peripheral interface may include one or more additional peripheral devices, including: one or more NFC devices 830; one or more GPS devices 831; one or more LTE devices 832; one or more Wi-Fi and / or Bluetooth devices 833; one or more buttons 834 (e.g., including slidable or otherwise adjustable buttons); one or more displays 835A; one or more speakers 836A; one or more microphones 837A; one or more cameras 838A (e.g., including a first camera 839-1 to an nth camera 839-n, which are similar to the left camera 839A and / or the right camera 839B); one or more tactile devices 840; and / or any other type of peripheral device defined above or described with reference to any other embodiments discussed herein.

[0192] The head wearable device may include various types of visual feedback mechanisms (e.g., presentation devices). For example, the display device in the AR device 800 and / or the VR device 810 may include one or more liquid crystal displays (LCDs), one or more light emitting diode (LED) displays, one or more organic LED (OLED) displays, one or more micro-LEDs, and / or any other suitable type of display screen. The head wearable device may include a single display screen (e.g., configured to be viewed by both eyes), and / or a separate display screen may be provided for each eye, which may allow for additional flexibility for zoom adjustment and / or for correcting refractive errors associated with the user's vision. Some embodiments of the head wearable device also include an optical subsystem having one or more lenses (e.g., conventional concave or convex lenses, Fresnel lenses, or adjustable liquid lenses) through which the user can view the display screen. For example, a corresponding display 835A may be coupled to each of the lens 806-1 and the lens 806-2 of the AR device 800. The display 835A coupled to each of the lens 806-1 and the lens 806-2 may work in conjunction or independently to present an image or a series of images to the user. In some embodiments, the AR device 800 and / or VR device 810 will include a single display 835A (e.g., a near-eye display) or more than two displays 835A.

[0193] In some embodiments, one or more displays 835A of the first group may be used to present an augmented reality environment, and one or more display devices 835A of the second group may be used to present a virtual reality environment. In some embodiments, one or more waveguides are used in conjunction with presenting artificial reality content to a user of an AR device 800 and / or a VR device 810 (e.g., as a means of transmitting light from a display projector assembly and / or one or more displays 835A to the user's eyes). In some embodiments, one or more waveguides are fully or partially integrated into an AR device 800 and / or a VR device 810. In addition to or in lieu of a display screen, some artificial reality systems include one or more projection systems. For example, a display device in an AR device 800 and / or a VR device 810 may include a micro LED projector that projects light to a display device (e.g., using a waveguide), such as a transparent combination lens that allows ambient light to penetrate. The display device may refract the projected light to the user's pupil, and may enable the user to simultaneously view both artificial reality content and the real world. The head wearable device may also be configured with any other suitable type or form of image projection system. In some embodiments, in addition to or in lieu of one or more displays 835A, one or more waveguides are provided.

[0194] In some embodiments of the head wearable device, ambient light and / or a real-world real-time view (e.g., a real-time feed of the surrounding environment that a user would normally see) can be made to penetrate through display elements of the corresponding head wearable device that is presenting aspects of the AR system. In some embodiments, ambient light and / or a real-world real-time view can be made to penetrate a portion (less than the entire AR environment) of the AR environment presented within the user's field of view (e.g., a portion of the AR environment that is co-located with physical objects in the user's real-world environment that are within a specified boundary (e.g., a guard boundary) that is configured to be used by the user when they are interacting with the AR environment). For example, a visual user interface element (e.g., a notification user interface element) can be presented at the head wearable device, and a certain amount of ambient light and / or a real-world real-time view (e.g., 15% to 50% of the ambient light and / or real-world real-time view) can be made to penetrate the user interface element so that the user can distinguish at least a portion of the physical environment on which the user interface element is displayed.

[0195] The head wearable device may include one or more external displays 835A for presenting information to the user. For example, the external display 835A may be used to display the current battery level, network activity (e.g., connected, disconnected), current activity (e.g., playing games, talking, in a meeting, watching a movie), and / or other relevant information. In some embodiments, the external display 835A may be used to communicate with other people. For example, a user of the head wearable device may cause the external display 835A to present a "Do Not Disturb" notification. The user may also use the external display 835A to share any information collected by one or more components of the peripheral interface 822A and / or generated by the head wearable device (e.g., during the operation and / or execution of one or more applications).

[0196] The memory 850A may include instructions and / or data that can be executed by one or more processors 848A (and / or processors 848B of the housing 890) and / or a storage controller of one or more controllers 846A (and / or controllers 846B of the housing 890). The memory 850A may include: one or more operating systems 851; one or more applications 852; one or more communication interface modules 853A; one or more graphics modules 854A; one or more AR processing modules 855A; one or more dimming control modules 856, which are configured to perform the above reference Figures 1A to 5 The various functions described; and / or any other type of module or component defined above or described with reference to any other embodiment discussed herein.

[0197] The data 860 stored in the memory 850A may be used in conjunction with one or more of the applications and / or programs discussed above. The data 860 may include: profile data 861; sensor data 862; media content data 863; AR application data 864; dimming control data 865, which is used to store the above-referenced data. Figures 1A to 5 The data related to the execution of each function described, such as one or more trigger conditions, device information (e.g., device brightness), a predetermined dimming level, a predetermined additional contrast, and / or the above reference Figures 1A to 5 other data described; and / or any other type of data defined above or described with reference to any other embodiments discussed herein.

[0198] In some embodiments, the controller 846A of the head wearable device processes information generated by the sensor 823A on the head wearable device, and / or another component of the head wearable device, and / or another component communicatively coupled to the head wearable device (e.g., a component of the housing 890, such as a component of the peripheral interface 822B). For example, the controller 846A can process information from the acoustic sensor 825 and / or the image sensor 826. For each detected sound, the controller 846A can perform a direction of arrival (DOA) estimation to estimate the direction from which the detected sound arrived at the head wearable device. When one or more of the plurality of acoustic sensors 825 detects a sound, the controller 846A can populate an audio data set with information (e.g., represented by the sensor data 862).

[0199] In some embodiments, a physical electronic connector can transmit information between a head wearable device and another electronic device, and / or transmit information between one or more processors 848A and a controller 846A of a head wearable device. The information can be in the form of: optical data form; electrical data form; wireless data form; or any other transmittable data form. Moving the processing of information generated by the head wearable device to an intermediate processing device can reduce the weight and heat of the eyewear device, making it more comfortable and safer for the user. In some embodiments, an optional accessory device (e.g., an electronic neckband or HIPD 900) is coupled to the head wearable device via one or more connectors. Each connector can be a wired connector or a wireless connector, and can include electronic components and / or non-electronic (e.g., structural) components. In some embodiments, the head wearable device and the accessory device can operate independently without any wired or wireless connection between them.

[0200] The head wearable device may include several types of computer vision components and subsystems. For example, the AR device 800 and / or the VR device 810 may include one or more optical sensors, such as a two-dimensional (2D) camera or a three-dimensional (3D) camera, a time-of-flight depth sensor, a single-beam rangefinder or a scanning laser rangefinder, a 3D laser radar (LiDAR) sensor, and / or any other suitable type or form of optical sensor. The head wearable device may process data from one or more of these sensors to identify the user's location and / or multiple aspects of the user's real-world physical environment (including the location of real-world objects in the real-world physical environment). In some embodiments, the methods described herein are used to map the real world to provide the user with context about the real-world environment, and / or to generate interactive virtual objects (which may be copies or digital twins of real-world objects that can interact with the AR environment) and various other functions. For example, Figure 8B-1 and Figure 8B-2 A VR device 810 is shown having cameras 839A to 839D that can be used to provide depth information for creating a voxel field and a two-dimensional grid to provide object information to the user for collision avoidance.

[0201] The optional housing 890 may include components similar to those described above with reference to the computing system 820. For example, the optional housing 890 may include a corresponding peripheral interface 822B, which includes more components or fewer components than those described above with reference to the peripheral interface 822A. As described above, the components of the optional housing 890 can be used to enhance and / or expand the functionality of the head wearable device. For example, the optional housing 890 may include corresponding sensors 823B, speakers 836B, displays 835B, microphones 837B, cameras 838B, and / or other components for collecting and / or presenting data. Similarly, the optional housing 890 may include one or more processors 848B, controllers 846B, and / or memory 850B (including corresponding communication interface modules 853B; one or more graphics modules 854B; one or more AR processing modules 855B; one or more dimming control modules 856; dimming control data 865, etc.), which may be used alone and / or in combination with components of the computing system 820.

[0202] Above FIG. 8A to FIG. 8CThe techniques described in the can be used with different head wearable devices. In some embodiments, the head wearable device (e.g., AR device 800 and / or VR device 810) can be used in conjunction with one or more wearable devices, such as wrist wearable device 700 (or its components) and HIPD 900. Having described the example head wearable device in this manner, attention is now turned to the example handheld intermediate processing device, such as HIPD 900.

[0203] Sample Handheld Intermediate Processing Device

[0204] Fig. 9A and Fig. 9B An example handheld intermediate processing device (HIPD) 900 is shown according to some embodiments. HIPD 900 is a device described herein with reference to Fig. 6A and Figure 6B HIPD 900 may perform various functions and / or operations associated with navigating in a user interface and selectively launching applications, as well as the above referenced Figures 1A to 5 Describes the functionality and / or operation.

[0205] Fig. 9A A top view 905 and a side view 925 of the HIPD 900 are shown. The HIPD 900 is configured to be communicatively coupled to one or more wearable devices (or other electronic devices) associated with the user. For example, the HIPD 900 is configured to be communicatively coupled to the user's wrist wearable device 700 (or its components, such as the watch body 720 and the wearable band 710), the AR device 800, and / or the VR device 810. The HIPD 900 can be configured to be held by the user (e.g., as a handheld controller), carried by the user (e.g., in his pocket, in his bag), placed near the user (e.g., on his desk when the user is sitting at a desk, on a charging base), and / or placed at or within a predetermined distance from the wearable device or other electronic device (wherein, in some embodiments, the predetermined distance is the maximum distance (e.g., 10 meters) at which the HIPD 900 can successfully communicate with the electronic device (e.g., wearable device)).

[0206] HIPD 900 can perform various functions independently and / or in combination with one or more wearable devices (e.g., wrist wearable device 700, AR device 800, VR device 810). HIPD 900 is configured to increase and / or improve the functionality of a communication-coupled device (e.g., a wearable device). HIPD 900 is configured to perform one or more functions or operations associated with: interacting with a user interface and application of a communication-coupled device, interacting with an AR environment, interacting with a VR environment, and / or acting as a human-machine interface controller, as well as the above references. Figures 1A to 5 The functions and / or operations described. In addition, as will be described in more detail below, the functions and / or operations of the HIPD 900 may include, but are not limited to: task transfer and / or transmission; heat transfer and / or transmission; 6 degrees of freedom (6DoF) ray casting and / or gaming (e.g., using imaging devices or cameras 914A and 914B, which can be used for simultaneous localization and mapping (SLAM) and / or used with other image processing techniques); portable charging; messaging; image acquisition via one or more imaging devices or cameras (e.g., cameras 922A and 922B); sensing user input (e.g., sensing touch on the multi-touch input surface 902); wireless communication and / or interconnection (e.g., cellular, near field, Wi-Fi, personal area network); location determination; financial transactions; providing tactile feedback; alarms; notifications; biometric authentication; health monitoring; sleep monitoring, etc. The above example functions may be performed independently in the HIPD 900 and / or in communication between the HIPD 900 and another wearable device described herein. In some embodiments, the functions may be performed in conjunction with an AR environment on the HIPD 900. As will be appreciated by those skilled in the art upon reading the various descriptions provided herein, the novel HIPD 900 described herein may be used with any type of suitable AR environment.

[0207] When the HIPD 900 is communicatively coupled with the wearable device and / or other electronic device, the HIPD 900 is configured to perform one or more operations initiated at the wearable device and / or the other electronic device. In particular, one or more operations of the wearable device and / or other electronic device can be transferred to the HIPD 900 for execution. The HIPD 900 performs one or more operations of the wearable device and / or other electronic device, and provides data corresponding to the completed operations to the wearable device and / or the other electronic device. For example, a user can initiate a video stream using an AR device 800, and a back-end task (e.g., video rendering) associated with executing the video stream can be transferred to the HIPD 900, which performs the back-end task and provides the corresponding data to the AR device 800 to perform the remaining front-end tasks associated with the video stream (e.g., presenting the rendered video data via the display of the AR device 800). In this way, the HIPD 900, which has more computing resources and greater thermal margin than the wearable device, can perform computationally intensive tasks for the wearable device, thereby improving the performance of the operations performed by the wearable device.

[0208] HIPD 900 includes a multi-touch input surface 902 on a first side (e.g., a front surface), which is configured to detect one or more user inputs. In particular, the multi-touch input surface 902 can detect single-click input, multi-tap input, sliding gestures and / or inputs, force-based and / or pressure-based touch inputs and press-and-hold clicks, etc. The multi-touch input surface 902 is configured to detect capacitive touch inputs and / or force (and / or pressure) touch inputs. The multi-touch input surface 902 includes a first touch input surface 904 defined by a surface depression and a second touch input surface 906 defined by a substantially flat portion. The first touch input surface 904 can be arranged adjacent to the second touch input surface 906. In some embodiments, the first touch input surface 904 and the second touch input surface 906 can be different sizes, shapes, and / or can cover different parts of the multi-touch input surface 902. For example, the first touch input surface 904 can be substantially circular, and the second touch input surface 906 is substantially rectangular. In some embodiments, the surface depression of the multi-touch input surface 902 is configured to guide the user's manipulation of the HIPD 900. In particular, the surface depression is configured to allow the user to hold the HIPD 900 upright when holding the HIPD 900 in one hand (e.g., such that the imaging device or cameras 914A and 914B are pointed toward the ceiling or the sky). In addition, the surface depression is configured to allow the user's thumb to be located within the first touch input surface 904.

[0209] In some embodiments, different touch input surfaces include multiple touch input areas. For example, the second touch input surface 906 includes at least a first touch input area 908 in the second touch input area 906 and a third touch input area 910 in the first touch input area 908. In some embodiments, one or more touch input areas in the multiple touch input areas are optional and / or user-defined (for example, the user can specify the touch input area based on his preference). In some embodiments, each touch input surface and / or touch input area is associated with a predetermined set of commands. For example, the user input detected in the first touch input area 908 causes the HIPD 900 to execute a first command, and the user input detected in the second touch input area 906 causes the HIPD 900 to execute a second command different from the first command. In some embodiments, different touch input surfaces and / or touch input areas are configured to detect one or more types of user input. Different touch input surfaces and / or touch input areas can be configured to detect the same type or different types of user input. For example, the first touch input region 908 may be configured to detect force touch input (eg, the magnitude of a user's press) and capacitive touch input, and the second touch input region 906 may be configured to detect capacitive touch input.

[0210] HIPD 900 includes one or more sensors 951 (e.g. Fig. 9B As shown in FIG. 1 ), the one or more sensors 951 are used to sense data used when performing one or more operations and / or functions. For example, the HIPD 900 may include an IMU sensor that is used in conjunction with the camera 914 to perform three-dimensional object manipulation (e.g., enlarging, moving, destroying an object) in an AR environment or a VR environment. Non-limiting examples of the sensors 951 included in the HIPD 900 include light sensors, magnetometers, depth sensors, pressure sensors, and force sensors. Fig. 9B Additional examples of sensor 951 are provided.

[0211] HIPD 900 may include one or more light indicators 912 to provide one or more notifications to the user. In some embodiments, the light indicator is an LED or other type of lighting device. The light indicator 912 can act as a privacy light to notify the user and / or other people near the user: the imaging device and / or microphone are active. In some embodiments, the light indicator is positioned near one or more touch input surfaces. For example, the light indicator can be positioned around the first touch input surface 904. The light indicator can be illuminated in a variety of colors and / or patterns to provide the user with one or more notifications and / or information about the device. For example, the light indicator positioned around the first touch input surface 904 can flash when the user receives a notification (e.g., a message), turn red when the HIPD 900 loses power, act as a progress bar (e.g., a halo that closes (0% to 100%) when the task is completed), or act as a volume indicator.

[0212] In some embodiments, HIPD 900 includes one or more additional sensors on another surface. Fig. 9A As shown, the HIPD 900 includes a set of one or more sensors (e.g., sensor group 920) on the edge of the HIPD 900. When the sensor group 920 is positioned on the edge of the HIPD 900, it can be positioned at a predetermined tilt angle (e.g., 26 degrees), which allows the sensor group 920 to be tilted toward the user when placed on a table or other flat surface. Alternatively, in some embodiments, the sensor group 920 is positioned on a surface (e.g., the back) opposite to the multi-touch input surface 902. One or more sensors in the sensor group 920 are discussed in detail below.

[0213] The side view 925 of HIPD 800 shows sensor group 920 and camera 914B. Sensor group 920 includes one or more cameras 922A and 922B, a depth projector 924, an ambient light sensor 928, and a depth receiver 930. In some embodiments, sensor group 920 includes a light indicator 926. Light indicator 926 can act as a privacy indicator to let the user and / or people around the user know that the camera and / or microphone are active. Sensor group 920 is configured to collect the user's facial expressions so that the user can manipulate a customized avatar (e.g., display emotions (e.g., smile, or laugh) on the user's avatar or digital representation). Sensor group 920 can be configured as a stereo red-green-blue (RGB) system on the side, an indirect time-of-flight (iToF) system at the rear, or a stereo RGB system at the rear. As those skilled in the art will recognize when reading the description provided herein, the novel HIPD 900 described herein can use different sensor group 920 configurations and / or sensor group 920 arrangements.

[0214] In some embodiments, the HIPD 900 includes one or more haptic devices 971 ( Fig. 9B ; for example, a vibrotactile actuator), the one or more tactile devices being configured to provide tactile feedback (e.g., kinesthetic perception). Sensor 951 and / or tactile device 971 can be configured to operate in conjunction with a plurality of applications and / or communicatively coupled devices, including but not limited to wearable devices, health monitoring applications, social media applications, gaming applications, and artificial reality applications (e.g., applications associated with artificial reality).

[0215] HIPD 900 is configured to operate without a display. However, in an alternative embodiment, HIPD 900 may include a display 968 ( Fig. 9B ). The HIPD 900 may also be provided with one or more optional peripheral buttons 967 ( Fig. 9B ). For example, the peripheral button 967 can be used to turn the HIPD 900 on or off. In addition, the housing of the HIPD 900 can be formed of a polymer and / or an elastomer. The HIPD 900 can be configured to have an anti-slip surface to allow the HIPD 900 to be placed on a surface without the user having to look after the HIPD 900. In other words, the HIPD 900 is designed so that it does not easily slide off a surface. In some embodiments, the HIPD 900 includes one or more magnets that are used to couple the HIPD 900 to another surface. This allows the user to place the HIPD 900 on different surfaces and provides the user with greater flexibility in using the HIPD 900.

[0216] As described above, the HIPD 900 may distribute and / or provide instructions for performing one or more tasks at the HIPD 900 and / or the communicatively coupled devices. For example, the HIPD 900 may identify one or more back-end tasks to be performed by the HIPD 900 and one or more front-end tasks to be performed by the communicatively coupled devices. Although the HIPD 900 is configured to transfer and / or transmit tasks of the communicatively coupled devices, the HIPD 900 may (e.g., via one or more processors, such as the CPU 977( Fig. 9B )) performs both back-end tasks and front-end tasks. HIPD 900 can be used, but is not limited to, to perform: enhanced calls (receiving and / or sending 3D or 2.5D real-time volumetric calls, real-time digital human representation calls and / or avatar calls), unobtrusive messaging, 6DoF portrait / landscape games, AR / VR object manipulation, AR / VR content display (e.g., presenting content via a virtual display), and / or other AR / VR interactions. HIPD 900 can perform the above operations alone or in combination with a wearable device (or other communicatively coupled electronic device).

[0217] Fig. 9B A block diagram of a computing system 940 of a HIPD 900 according to some embodiments is shown. The HIPD 900 described in detail above may include one or more components shown in the HIPD computing system 940. The HIPD 900 will be understood to include the components shown and described below for the HIPD computing system 940. In some embodiments, all or most of the multiple components of the HIPD computing system 940 are included in a single integrated circuit. Alternatively, in some embodiments, the multiple components of the HIPD computing system 940 are included in multiple integrated circuits that are communicatively coupled.

[0218] The HIPD computing system 940 may include: a processor (e.g., a CPU 977, a GPU, and / or a CPU with integrated graphics); a controller 975; a peripheral interface 950, which includes one or more sensors 951 and other peripherals; a power source (e.g., a power system 995); and a memory (e.g., a memory 978), which includes an operating system (e.g., an operating system 979), data (e.g., data 988), one or more applications (e.g., applications 980), and one or more modules (e.g., a communication interface module 981, a graphics module 982, a task and processing management module 983, an interoperability module 984, an AR processing module 985, a data management module 986, or a dimming control module 987). The HIPD computing system 940 also includes a power system 995, which includes a charger input and output 996, a PMIC 997, and a battery 998, all of which are defined above.

[0219] In some embodiments, the peripheral interface 950 may include one or more sensors 951. The sensor 951 may include the same Figure 7B Sensors similar to those described above. For example, sensors 951 may include imaging sensors 954, (optional) EMG sensors 956, IMU sensors 958, and capacitive sensors 960. In some embodiments, sensors 951 may include: one or more pressure sensors 952 for sensing pressure data; an altimeter 953 for sensing the height of the HIPD 900; a magnetometer 955 for sensing magnetic fields; a depth sensor 957 (or time of flight sensor) for determining the difference between the camera and an object in the image; a position sensor 959 (e.g., a flexible position sensor) for sensing relative displacement or position change of a portion of the HIPD 900; a force sensor 961 for sensing a force applied to a portion of the HIPD 900; and a light sensor 962 (e.g., an ambient light sensor) for detecting the amount of light emitted. Sensors 951 may include Fig. 9B One or more sensors not shown.

[0220] With the above reference Figure 7B Similar to the peripheral devices described above, the peripheral interface 950 may also include an NFC component 963, a GPS component 964, an LTE component 965, a Wi-Fi and / or Bluetooth communication component 966, a speaker 969, a haptic device 971, and a microphone 973. Fig. 9AAs described, the HIPD 900 may optionally include a display 968 and / or one or more buttons 967. The peripheral interface 950 may also include one or more cameras 970, a touch surface 972, and / or one or more light emitters 974. Fig. 9A The multi-touch input surface 902 depicted is an example of a touch surface 972. The light emitter 974 may be one or more LEDs, lasers, etc., and may be used to project or present information to a user. For example, the light emitter 974 may include the above referenced Fig. 9A The light indicators 912 and 926 described above. The camera 970 (e.g., Fig. 9A The cameras 914A, 914B, and 922 described in the figure may include one or more wide-angle cameras, fisheye cameras, spherical cameras, compound eye cameras (e.g., stereo and multi-cameras), depth cameras, RGB cameras, ToF cameras, RGB-D cameras (depth and ToF cameras), and / or other available cameras. Camera 970 may be used for: SLAM; 6DoF ray casting, gaming, object manipulation and / or other rendering; facial recognition and facial expression recognition, etc.

[0221] With the above reference Figure 7B Similar to the described body computing system 760 and wearable band computing system 730 , the HIPD computing system 940 may include one or more haptic controllers 976 and associated components (e.g., haptic device 971 ) for providing haptic events at the HIPD 900 .

[0222] The memory 978 may include high-speed random access memory and / or non-volatile memory, such as one or more disk storage devices, flash memory devices or other non-volatile solid-state storage devices. The access of other components of the HIPD 900 (such as one or more processors and the peripheral interface 950) to the memory 978 may be controlled by a storage controller in the controller 975.

[0223] In some embodiments, the above reference Figure 7B Similar to the software components described above, the software components stored in the memory 978 include one or more operating systems 979, one or more applications 980, one or more communication interface modules 981, one or more graphics modules 982, or one or more data management modules 986. The software components stored in the memory 978 may also include a dimming control module 987, which is configured to perform the above reference Figures 1A to 5 The functions described.

[0224] In some embodiments, the software components stored in the memory 978 include a task and process management module 983, which is used to: identify one or more front-end tasks and back-end tasks associated with the operation performed by the user; execute one or more front-end tasks and / or back-end tasks; and / or provide instructions to one or more communication-coupled devices to perform the one or more front-end tasks and / or back-end tasks. In some embodiments, the task and process management module 983 uses data 988 (e.g., device data 990) to distribute one or more front-end tasks and / or back-end tasks based on the following items: computing resources, available power, thermal headroom, ongoing operations, and / or other factors of the communication-coupled devices. For example, the task and process management module 983 can cause one or more back-end tasks (of the operation performed at the communication-coupled AR device 800) to be performed at the HIPD 900 based on determining that the operation is utilizing a predetermined amount (e.g., at least 70%) of computing resources available at the AR device 800.

[0225] In some embodiments, the software components stored in the memory 978 include an interoperability module 984 for exchanging and utilizing information received and / or provided to different communication coupled devices. The interoperability module 984 allows different systems, devices, and / or applications to connect and communicate in a coordinated manner without user input. In some embodiments, the software components stored in the memory 978 include an AR processing module 985, which is configured to process signals based at least on sensor data for use in an AR and / or VR environment. For example, the AR processing module 985 can be used for 3D object manipulation, gesture recognition, facial recognition, and facial expression recognition, etc.

[0226] The memory 978 may also include data 988, which includes structured data. In some embodiments, the data 988 may include: profile data 989; device data 990 (including device data of one or more devices communicatively coupled to the HIPD 900, such as device type, hardware, software, or configuration); sensor data 991; media content data 992; application data 993; and dimming control data 994, which stores the same information as the above referenced data. Figures 1A to 5 Data related to the execution of the functions described.

[0227] It should be appreciated that HIPD computing system 940 is an example of a computing system within HIPD 900, and that HIPD 900 may have more components or fewer components, may combine two or more components, and / or may have a different configuration and / or arrangement of components than those shown in HIPD computing system 940. The various components shown in HIPD computing system 940 are implemented in hardware, software, firmware, or a combination thereof, including one or more signal processing circuits and / or application specific integrated circuits.

[0228] Above Fig. 9A and Fig. 9B The various techniques described in the can be used with any device used as a human-machine interface controller. In some embodiments, the HIPD 900 can be used in conjunction with one or more wearable devices, such as head wearable devices (e.g., AR device 800 and VR device 810) and / or wrist wearable device 700 (or its components).

[0229] Any data collection performed by the various devices described herein and / or any device configured to perform or cause the performance of the various embodiments described above with reference to any of the figures (hereinafter referred to as a "device") is performed with the user's consent and in a manner that complies with all applicable privacy laws. The user is provided with the option to allow the device to collect data and the option to limit or deny the device from collecting data. The user can choose to enable or disable any data collection at any time. In addition, the user is provided with the option to request deletion of any collected data.

[0230] It will be understood that, although the terms "first," "second," etc. may be used herein to describe various elements, these elements should not be limited by these terms. These terms are only used to distinguish one element from another.

[0231] The terms used herein are only for the purpose of describing specific embodiments, and are not intended to limit the claims. As used in the description of each embodiment and the appended claims, unless the context clearly indicates otherwise, the singular forms "one", "an" and "the" are intended to also include plural forms. It will also be understood that the term "and / or" used herein refers to and encompasses any and all possible combinations of one or more items in the associated listed items. It will also be understood that the terms "include" and / or "comprise" when used in this specification specify the presence of stated features, unity, steps, operations, elements and / or parts, but do not exclude the presence or addition of one or more other features, unity, steps, operations, elements, parts and / or their combinations.

[0232] As used herein, the term “if” may be interpreted to mean, depending on the context: “when the stated conditional precedent is true”; or “upon” the stated conditional precedent is true; or “in response to determining” the stated conditional precedent is true; or “upon determining” the stated conditional precedent is true; or “in response to detecting” the stated conditional precedent is true. Similarly, depending on the context, the phrase “if it is determined that [the stated conditional precedent is true]” or “if [the stated conditional precedent is true]” or “when [the stated conditional precedent is true]” may be interpreted to mean: “upon determining” the stated conditional precedent is true; or “upon determining” the stated conditional precedent is true; or “upon detecting” the stated conditional precedent is true; or “in response to detecting” the stated conditional precedent is true.

[0233] For purposes of explanation, the foregoing description has been described with reference to specific embodiments. However, the above illustrative discussion is not intended to be exhaustive or to limit the claims to the precise forms disclosed. In view of the above teachings, many modifications and variations are possible. The various embodiments are selected and described in order to best explain the principles of operation and practical application, thereby enabling others skilled in the art to realize.

Claims

1. A non-transitory computer-readable storage medium, the non-transitory computer-readable storage medium comprising instructions, which, when executed by one or more processors of a head wearable device, cause the head wearable device to execute: When the user is wearing augmented reality glasses: Acquire first light information measured via a first sensor, wherein the first sensor is positioned to receive the light after the light passes through a dimmable light element of the augmented reality glasses; Acquiring second light information measured via a second sensor, the second sensor being positioned to receive light that has not passed through the dimmable element of the augmented reality glasses; and Based on a comparison between the first light information and the second light information, a dimming level of the dimmable element is actively adjusted.

2. The non-transitory computer-readable storage medium of claim 1, wherein: The dimmable light element is a first dimmable light element associated with a first lens of the augmented reality glasses for a first eye of the user; The augmented reality glasses also include a second dimmable element associated with a second lens of the augmented reality glasses for a second eye of the user; and Active regulation includes electronically regulating the dimming level of the first dimmable element only.

3. The non-transitory computer-readable storage medium of claim 2, wherein: Actively adjusting includes electronically adjusting the first dimmable element to a first dimming level and electronically adjusting the second dimmable element to a second dimming level different from the first dimming level.

4. The non-transitory computer-readable storage medium of claim 2, wherein: When the instruction is executed by the head wearable device, the head wearable device also causes the head wearable device to: Before actively adjusting the dimming level: Based on determining that artificial reality content is being presented via the first lens, determining that a dimming level adjustment of the first dimmable light element is required to visually present the artificial reality content at the first lens; Wherein, actively adjusting the dimming level of the first dimmable light element is performed in response to determining that the dimming level of the first dimmable light element needs to be adjusted to visually present the artificial reality content at the first lens.

5. The non-transitory computer-readable storage medium of claim 1, wherein: The dimmable light element includes a first dimmable light element associated with a first lens of the augmented reality glasses for a first eye of the user, and a second dimmable light element associated with a second lens of the augmented reality glasses for a second eye of the user, and active adjustment occurs substantially simultaneously for both the first dimmable light element and the second dimmable light element.

6. The non-transitory computer-readable storage medium of claim 1, wherein: Actively adjusting the dimming level occurs in response to detecting a trigger condition indicating a need to adjust the dimming level of the dimmable element.

7. The non-transitory computer-readable storage medium of claim 6, wherein: When the additional contrast of the augmented reality glasses drops below a threshold amount, it is determined that the trigger condition is met.

8. The non-transitory computer-readable storage medium of claim 1, wherein: The augmented reality glasses include an adjustable light element positioned further away from the user than a display presentation element of the augmented reality glasses.

9. The non-transitory computer-readable storage medium of claim 1, wherein: The first sensor is a parallax sensor configured to output the first light information by comparing light from one or more waveguides.

10. An active dimming control method for augmented reality glasses, the method comprising: When the user wears the augmented reality glasses: Acquire first light information measured via a first sensor, wherein the first sensor is positioned to receive the light after the light passes through a dimmable light element of the augmented reality glasses; Acquire second light information measured via a second sensor, the second sensor being positioned to receive light that has not passed through the dimmable element of the augmented reality glasses; as well as Based on a comparison between the first light information and the second light information, a dimming level of the dimmable element is actively adjusted.

11. The method according to claim 10, wherein: The dimmable light element is a first dimmable light element associated with a first lens of the augmented reality glasses for a first eye of the user; The augmented reality glasses also include a second dimmable element associated with a second lens of the augmented reality glasses for a second eye of the user; and Active regulation includes adjusting the dimming level of the first dimmable element only electronically.

12. The method according to claim 11, wherein: Actively adjusting includes electronically adjusting the first dimmable element to a first dimming level and electronically adjusting the second dimmable element to a second dimming level different from the first dimming level.

13. The method according to claim 11, further comprising: Before actively adjusting the dimming level, determining, based on determining that artificial reality content is being presented via the first lens, that a dimming level adjustment of the first dimmable element is required to allow proper viewing of the artificial reality content; Wherein, actively adjusting the dimming level of the first dimmable light element is performed in response to determining that the dimming level of the first dimmable light element needs to be adjusted to allow correct viewing of the artificial reality content.

14. The method of claim 10, wherein: The dimmable light element includes a first dimmable light element associated with a first lens of the augmented reality glasses for a first eye of the user, and a second dimmable light element associated with a second lens of the augmented reality glasses for a second eye of the user, and active adjustment occurs substantially simultaneously for both the first dimmable light element and the second dimmable light element.

15. The method according to claim 10, wherein: Actively adjusting the dimming level occurs in response to detecting a trigger condition indicating a need to adjust the dimming level of the dimmable element.

16. The method according to claim 15, wherein: When the additional contrast of the augmented reality glasses drops below a threshold amount, it is determined that the trigger condition is met.

17. The method of claim 10, wherein: The augmented reality glasses include an adjustable light element positioned further away from the user than a display presentation element of the augmented reality glasses.

18. The method according to claim 10, wherein: The first sensor is a parallax sensor configured to output the first light information by comparing light from one or more waveguides.

19. A head wearable device comprising: one or more sensors; one or more imaging devices; Two lenses; a memory including instructions for performing one or more operations; as well as One or more processors configured to execute the instructions to cause execution of: When the user is wearing augmented reality glasses: Acquire first light information measured via a first sensor of the one or more sensors, the first sensor being positioned to receive the light after the light passes through a dimmable light element of the augmented reality glasses; acquiring second light information measured by a second sensor of the one or more sensors, the second sensor being positioned to receive light that has not passed through the dimmable element of the augmented reality glasses; as well as Based on a comparison between the first light information and the second light information, a dimming level of the dimmable element is actively adjusted.

20. The head wearable device according to claim 19, wherein: The dimmable light element is a first dimmable light element associated with a first lens of the augmented reality glasses for a first eye of the user; The augmented reality glasses also include a second dimmable element associated with a second lens of the augmented reality glasses for a second eye of the user; and Active regulation includes electronically regulating the dimming level of the first dimmable element only.

Images