Joint assembly for an extended reality headset, and systems and methods of use thereof

Abstract

An extended reality head-mounted device with a connector assembly is described, the connector assembly including a first ring, a second ring, and a concentric ring. The first ring is a rigid ring connected to an arm of the extended reality head-mounted device. The second ring is a rigid ring connected to the body of the extended reality head-mounted device. The connecting ring is a flexible ring that couples the first ring to the second ring and allows the arm and the body to move relative to each other in at least two degrees of freedom.

Description

Cross-references to related applications

[0001] This application claims priority to U.S. Provisional Application No. 63 / 561,268, filed March 4, 2024, the entire contents of which are incorporated herein by reference; and also claims the benefit and priority to U.S. Non-Provisional Patent Application No. 19 / 054,650, filed February 14, 2025. Technical Field

[0002] This disclosure generally relates to extended reality headsets (e.g., virtual reality headsets and / or augmented reality headsets), including techniques for proprioceptive strips relative to the extended reality headset to enable the extended reality headset to comfortably fit on different wearers with various head sizes and facial structures. Background Technology

[0003] Extended reality (AR) headsets allow users to fully immerse themselves in AR environments, contributing to richer and more engaging user experiences. However, a drawback of existing AR wearables is that users with below-average or above-average head sizes may experience discomfort due to the headset's inability to fit properly. Discomfort while wearing an AR headset can diminish a user's immersion in the AR environment and limit the time they spend within it.

[0004] Technologies exist to adapt extended reality headsets to users with different head sizes, but these technologies cannot ensure a comfortable fit for the user. Therefore, more precise technologies are needed.

[0005] Therefore, it is necessary to address one or more of the challenges mentioned above. An overview of solutions to these problems is described below. Summary of the Invention

[0006] The device described herein enables users of extended reality headsets to engage with extended reality environments in an immersive and interactive manner by minimizing discomfort during the wearing of wearable devices. The use of a joint assembly including flexible components to connect the main body of the extended reality wearable device to its arm allows for a greater range of motion between the main body and the arm. This greater range of motion (e.g., movement in multiple degrees of freedom) allows the extended reality headset to adopt a wider range of orientations to accommodate a wider range of head sizes and shapes.

[0007] According to the present invention, an augmented reality head-mounted device is provided, the augmented reality head-mounted device including a connector assembly comprising: a first ring connected to an arm of the augmented reality head-mounted device; a second ring connected to a body of the augmented reality head-mounted device; and a connecting ring coupling the first ring to the second ring. The connecting ring comprises a flexible material such that the first ring and the second ring can remain coupled and move relative to each other. The connecting ring is configured to be movable relative to the body of the augmented reality head-mounted device along a first degree of freedom of the arm of the augmented reality head-mounted device, and the connecting ring is also configured to be movable relative to the body of the augmented reality head-mounted device along a second degree of freedom of the arm of the augmented reality head-mounted device, wherein the first degree of freedom is different from the second degree of freedom.

[0008] According to the present invention, a hinge for an extended reality head-mounted device is also provided, the hinge including a connector assembly comprising: a first ring connected to an arm of the extended reality head-mounted device; a second ring connected to a body of the extended reality head-mounted device; and a connecting ring coupling the first ring to the second ring. The connecting ring comprises a flexible material such that the first ring and the second ring can remain coupled and move relative to each other; is configured to be movable relative to the body of the extended reality head-mounted device along a first degree of freedom of the arm of the extended reality head-mounted device; and is configured to be movable along a second degree of freedom of the arm of the extended reality head-mounted device, wherein the first degree of freedom is different from the second degree of freedom.

[0009] According to the present invention, an extended reality system is also provided, the extended reality system including an extended reality head-mounted device, the extended reality head-mounted device including a connector assembly, the connector assembly including: a first ring connected to an arm of the extended reality head-mounted device; a second ring connected to a body of the extended reality head-mounted device; and a connecting ring coupling the first ring to the second ring, wherein the connecting ring: includes a flexible material such that the first ring and the second ring can remain coupled and move relative to each other; is configured to be movable relative to the body of the extended reality head-mounted device along a first degree of freedom of the arm of the extended reality head-mounted device; and is configured to be movable relative to the body of the extended reality head-mounted device along a second degree of freedom of the arm of the extended reality head-mounted device, wherein the first degree of freedom is different from the second degree of freedom.

[0010] Optionally, the connector assembly is configured to have a first orientation when worn on a head of a first size, the first orientation including a first measurement along a first degree of freedom and a first measurement along a second degree of freedom.

[0011] Optionally, the connector assembly is also configured to have a second orientation when worn on a second-sized head that is different in size from the first-sized head. The second orientation includes a second measurement along the first degree of freedom and a second measurement along the second degree of freedom.

[0012] Optionally, the first ring and the second ring are made of a first material that is harder than the second material of the connecting ring, so that the second material can be compressed and stretched when worn by the wearer.

[0013] Alternatively, the connecting ring may be made of rubber.

[0014] Optionally, the first and second rings are made of plastic.

[0015] Optionally, the first degree of freedom allows for motion up to 90 degrees, and the second degree of freedom allows for motion up to 90 degrees.

[0016] Optionally, the connector assembly is configured to allow the extended reality headset to be worn by a person with a head size at least in the 5th to 95th percentile.

[0017] The features and advantages described in the specification are not necessarily all-encompassing; in particular, certain additional features and advantages will be apparent to those skilled in the art from the drawings, specification, and claims. Furthermore, it should be noted that the language used in the specification has been chosen primarily for readability and instruction purposes.

[0018] Having outlined the examples above, a brief description of the accompanying figures will now be given. Attached Figure Description

[0019] To better understand the various embodiments described, reference should be made to the following detailed description in conjunction with the accompanying drawings, in which the same reference numerals refer to corresponding parts throughout the drawings.

[0020] Figure 1A and Figure 1B An extended reality head-mounted device according to some embodiments is shown, wherein the connector assembly of the extended reality head-mounted device is positioned to fit wearers with head sizes at the fifth percentile and ninety-fifth percentile, respectively.

[0021] Figure 2A and Figure 2B An extended reality head-mounted device with arms that rotate clockwise and counterclockwise respectively, according to some embodiments, is shown.

[0022] Figure 3 The structure of a connector assembly according to some embodiments is shown.

[0023] Figure 4A , Figure 4B-1 and Figure 4B-2An example artificial reality system according to some embodiments is shown.

[0024] Figure 5A , Figure 5B-1 , Figure 5B-2 and Figure 5C An example head-mounted wearable device according to some embodiments is shown.

[0025] By convention, the various features shown in the accompanying drawings may not be drawn to scale. Therefore, for clarity, the dimensions of the various features may be arbitrarily enlarged or reduced. Furthermore, some of these drawings may not depict all parts of a given system, method, or apparatus. Finally, the same reference numerals may be used to denote the same features throughout the specification and the drawings. Detailed Implementation

[0026] Numerous details are described herein to provide a thorough understanding of the exemplary embodiments illustrated in the accompanying drawings. However, some embodiments may be practiced without many of these specific details, and the scope of the claims is limited to the features and aspects specifically recited in the claims. Furthermore, well-known processes, components, and materials need not be described exhaustively to avoid obscuring relevant aspects of the embodiments described herein.

[0027] Embodiments of this disclosure may include various types of artificial reality systems or various embodiments of artificial reality systems, or combinations thereof. As described herein, artificial reality (AR) is any overlay of functionality and / or sensory-detectable presentation provided by an artificial reality system within a user's physical environment. Such artificial reality may include and / or represent virtual reality (VR), augmented reality, mixed artificial reality (MAR), or some combination and / or variation thereof. For example, a user may perform an air swipe gesture to skip a song via an API provided, for example, at a home speaker. AR environments described herein include, but are not limited to: VR environments (including non-immersive VR environments, semi-immersive VR environments, and fully immersive VR environments); augmented reality environments (including marker-based augmented reality environments, markerless augmented reality environments, location-based augmented reality environments, and projection-based augmented reality environments); mixed reality; and other types of mixed reality environments.

[0028] Artificial reality content can include entirely generated content or generated content combined with acquired (e.g., real-world) content. Artificial reality content can include video, audio, haptic events, or some combination thereof, any one of which can be presented in a single channel or multiple channels (e.g., stereoscopic video that produces a three-dimensional effect for the viewer). Furthermore, in some embodiments, artificial reality can also be associated with applications, products, accessories, services, or some combination thereof for purposes such as creating content in artificial reality and / or otherwise using it in artificial reality (e.g., performing activities in artificial reality).

[0029] As described herein, gestures can include air gestures, surface contact gestures, and / or other gestures that can be detected and determined based on the movement of a single hand (e.g., single-handed gestures performed by the user's hand detected by one or more sensors of a wearable device (e.g., electromyography (EMG) and / or inertial measurement unit (IMU) of a wrist wearable device) and / or detected via image data acquired through imaging devices of a wearable device (e.g., a camera of a head wearable device) and other gestures that can be detected and determined based on a combination of movements of the user's two hands. In some embodiments, "air" means that the user's hand does not contact a surface, object, or part of an electronic device (e.g., a head wearable device or other communication-coupled device, such as a wrist wearable device); in other words, the gesture is performed in open space in 3D space and does not contact a surface, object, or electronic device. More generally, surface contact gestures (contacts on surfaces, objects, user body parts, or electronic devices) are also conceivable, in which contact (or the intention to contact) is detected at the surface (e.g., a single or two-finger tap on a table, on the user's hand or another finger, on the user's leg, on a sofa, on a steering wheel, etc.). The various gestures disclosed herein can be detected using image data and / or sensor data (e.g., neuromuscular signals sensed by one or more biopotential sensors (e.g., EMG sensors) or other types of data from other sensors (such as proximity sensors, time-of-flight (ToF) sensors, sensors of inertial measurement units, etc.) detected by wearable devices worn by the user and / or other electronic devices owned by the user (e.g., smartphones, laptops, imaging devices, intermediate devices, and / or other devices described herein)).

[0030] The devices described herein include extended reality headsets for extended reality systems (e.g., augmented reality systems and / or virtual reality systems), and connectors and / or hinges that connect the arms of the extended reality headset to the body of the extended reality headset. The connector (also referred to as a connector assembly) includes a concentric ring design in which two rigid rings connecting the arms and body of the extended reality headset are connected by flexible rings. The flexible connecting rings allow the arms and body of the extended reality headset to move relative to each other. This relative movement allows the extended reality headset to fit on a user's head in different orientations, accommodating different head shapes and sizes. The connectors described herein have a compact design that allows the extended reality headset to fit a wider range of head sizes and shapes.

[0031] Figure 1A An extended reality head-mounted device 100 according to some embodiments is shown, wherein a connector assembly 102 of the extended reality head-mounted device 100 is positioned to fit a wearer with a head size in the fifth percentile. The extended reality (e.g., virtual reality or augmented reality) head-mounted device 100 (also referred to as a head-wearing device or a device worn on the head) includes a connector assembly 102 that connects an arm 104 (also referred to as a temple arm or strap) of the extended reality head-mounted device 100 to the body 106 of the extended reality head-mounted device 100.

[0032] When wearers with different head sizes wear the extended reality head-mounted device 100, the connector assembly 102 has different orientations because it allows the arm 104 and the main body 106 to move in multiple degrees of freedom to comfortably fit the wearer's head. For example, as Figure 1A As shown, for a wearer with a head size in the fifth percentile, arm 104 pivots inward toward the wearer's head to accommodate a smaller head. Arm 104 can achieve this first degree of freedom (also known as yaw motion) because the connector assembly 102 is configured to movably couple arm 104 to body 106.

[0033] Figure 1B An extended reality head-mounted device 100 according to some embodiments is shown, wherein the connector assembly 102 of the extended reality head-mounted device 100 is positioned to fit a wearer with a head size at the 95th percentile. In this orientation of the connector assembly 102, the arm 104 pivots outward away from the wearer's head to fit a larger head. Similar to... Figure 1A The orientation shown is an example of a deflection movement that can be achieved by the connector assembly 102.

[0034] Although Figure 1A and Figure 1BThe illustration is designed to accommodate users with head sizes at the 5th and 95th percentiles; however, it is conceivable that the extended reality headset could accommodate any head size between the 5th and 95th percentiles. Furthermore, due to the stepless adjustment characteristic of the connector assembly (e.g., due to its elastic structure), the connector assembly can be adjusted to a preferred position for any user wearing the headset.

[0035] Figure 2A An augmented reality head-mounted device 200A with a clockwise rotating arm 204A is shown according to some embodiments. The augmented reality head-mounted device 200A includes a connector assembly 202A that connects the arm 204A of the augmented reality head-mounted device 200A to the body 206A of the augmented reality head-mounted device 200A. (As...) Figure 2A As shown, when the extended reality head-mounted device 200A is worn by wearers with different head sizes, the connector assembly 202A has different orientations. This is because the connector assembly 202A allows the arm 204A and the main body 206A to move in multiple degrees of freedom to comfortably fit the wearer's head. Figure 2A As shown, arm 204A can rotate (e.g., to a lower position relative to the wearer's ears and body 206A) to adapt to the wearer's head shape or head size. Arm 204A can achieve this second degree of freedom (also known as pitch motion) because the connector assembly 202A is configured to movably couple arm 204A to body 206A.

[0036] Figure 2B An extended reality head-mounted device 200B (with some embodiments) is shown. Figure 2A The extended reality head-mounted device 200A shown is equivalent to this one, in which arm 204B rotates counterclockwise. Figure 2B It was demonstrated that arm 204B can also rotate counterclockwise (e.g., to a higher position relative to the wearer's ears and body 206B) to accommodate a wider range of head shapes and sizes. Similar to... Figure 2A The orientation shown is an example of the pitch movement that can be achieved by the connector assembly 202B.

[0037] Figure 3 The structure of a connector assembly 302 according to some embodiments is shown. The connector assembly 302 corresponds to... Figure 1A and Figure 1B The connector assembly 102 and Figure 2A and Figure 2BThe connector assembly 302 may include three main components: a first ring 308 connected to an arm 304 of the augmented reality headset 300, a second ring 310 connected to a body 306 of the augmented reality headset 300, and a connecting ring 312 coupling the first ring 308 to the second ring 310. In some embodiments, the first ring 308 is a central projection coupled to the arm 304 to form a neck or torque ring. In some embodiments, the second ring 310 is an outer ring coupled to the body 306 and surrounding the central projection. In some embodiments, the connecting ring 312 is a concentric flexible portion. In some embodiments, the second ring 310 and the connecting ring 312 are integrally manufactured on the augmented reality headset 300. In some embodiments, the connector assembly 302 is secured to the body 306 of the augmented reality headset 300 by fastening the second ring 310 (e.g., by using screws) to the inner wall of the body 306.

[0038] The first ring 308 and the second ring 310 are made of a first material, and the connecting ring 312 is made of a second material. The first material is harder than the second material. In some embodiments, the first material is plastic. In some embodiments, the first ring 308 and the second ring 312 are made of different materials. The second material is a flexible material that can be compressed and stretched when the wearer wears the extended reality head-mounted device 300. In some embodiments, the flexible material is rubber. The rubber material provides some resistance to the force that moves it and is elastic to return to its original position when the wearer removes the extended reality head-mounted device 300.

[0039] The flexible material of the connecting ring 312 allows the first ring 308 to move relative to the second ring 310 while remaining coupled to the second ring 310. Similarly, the flexible material of the connecting ring 312 allows the second ring 310 to move relative to the first ring 308 while remaining coupled to the first ring 308. In other words, the arm 304 can move relative to the body 306 and vice versa, because the connecting ring 312 bends, compresses, and / or stretches when the arm 304 and the body 306 move. In some embodiments, due to the flexibility of the connecting ring 312, the first ring 308 and the second ring 310 can move independently of each other while still being connected.

[0040] In some embodiments, the dimensions of the connecting ring 312 are related to the amount of flexibility provided by the connecting ring. For example, a connecting ring 312 with a large thickness (e.g., a thickness exceeding 5 mm at its maximum width along the cross-section of the connecting ring 312) allows for greater relative movement between the arm 304 and the body 306 compared to a connecting ring 312 with a small thickness. Similarly, a connecting ring 312 with a small width has less flexibility compared to a connecting ring 312 with a large width, thus allowing for less relative movement between the arm 304 and the body 306.

[0041] Due to the flexibility of the connecting ring 312, the arm 304 can move relative to the body 306 along at least two different degrees of freedom (and vice versa). In some embodiments, the first degree of freedom is a deflection motion (e.g., Figure 1A and Figure 1B (As shown). The main body 306 rests on the wearer's face, and the flexibility of the connecting ring 312 allows the arm 304 to rotate toward or away from the wearer's head, depending on the wearer's head shape or size. In some embodiments, the second degree of freedom is pitch motion (e.g., Figure 2A and Figure 2B (As shown). The main body 306 rests on the wearer's face, and the flexibility of the connecting ring allows the arm 304 to rotate up and down relative to the wearer's ears to accommodate different head shapes and sizes. In some embodiments, the connector assembly 302 allows simultaneous movement in at least two degrees of freedom. In some embodiments, the connector assembly 302 allows movement in a third degree of freedom. In some embodiments, the third degree of freedom is rolling motion.

[0042] The concentric ring design of the connector assembly 302 provides a wider range of orientations for the arm 304 of the augmented reality headset 300 than conventional connectors for eyeglasses, goggles, and / or headsets. This wider range of orientations allows wearers with a wider range of head sizes (e.g., wearers with head sizes in the 5th and 95th percentiles) to experience the same level of comfort when wearing the augmented reality headset 300 as wearers with more average head sizes. Furthermore, the concentric ring design of the connector assembly 302 achieves this wider range of orientations in a compact design, which (compared to an augmented reality headset 300 with a conventional connector) does not significantly increase the weight or size of the augmented reality headset 300. The concentric ring design of the connector assembly 302 also minimizes the size and number of parts of the connector assembly 302. In some embodiments, the connector assembly is manufactured using a dual injection molding process.

[0043] (A1) According to some embodiments, the augmented reality head-mounted device includes a connector assembly comprising a first ring (made of a rigid material, such as plastic (e.g., ABS, polycarbonate, etc.)) which is connected to an arm of the augmented reality head-mounted device (e.g., Figure 3 The first ring 308 is shown connected to the arm 304. The connector assembly also includes a second ring (made of a rigid material, such as the same plastic material as the first ring or a different plastic material), which is connected to the body of the extended reality head-mounted device (e.g., Figure 3 The second ring 310 can be connected to the body 306. The connector assembly also includes a connecting ring that couples the first ring to the second ring (e.g., Figure 3The diagram shows a connecting ring 312 coupling a first ring 308 to a second ring 310. The connecting ring includes a flexible material (e.g., rubber) such that the first and second rings can remain coupled and move relative to each other, and the connecting ring is configured to be able to move relative to the body of the augmented reality headset along a first degree of freedom of the arm of the augmented reality headset (e.g., as shown). Figure 1A and Figure 1B The deflection motion shown), and the connecting ring is configured to allow movement relative to the body of the augmented reality headset along the second degree of freedom of the arm of the augmented reality headset (e.g., pitch motion, such as...). Figure 2A and Figure 2B (As shown). In some embodiments, the first degree of freedom is different from the second degree of freedom.

[0044] (A2) In some embodiments of A1, the connector assembly is configured to be worn on a head of the first size (e.g., Figure 1A The fifth percentile head shown has a first orientation. In some embodiments, the first orientation includes a first measurement along a first degree of freedom (e.g., Figure 1A This illustrates the arm 104 pivoting inward toward the wearer's head to properly fit a smaller head, and the first measurement along the second degree of freedom (e.g., Figure 2A This shows the arm 204 rotated to a lower position relative to the wearer's ears and body 206. The connector assembly is also configured to be worn on a second-sized head (e.g., a head of a different size than the first size). Figure 1B The second orientation is shown at the 95th percentile head. In some embodiments, the second orientation includes a second measurement along the first degree of freedom (e.g., Figure 1B This illustrates the arm 104 pivoting outwards away from the wearer's head to properly fit a larger head, and a second measurement along the second degree of freedom (e.g., Figure 2B This shows the arm 204 rotating to a higher position relative to the wearer's ears and body 206.

[0045] (A3) In some embodiments of any of A1 to A2, the first ring and the second ring are made of a first material that is harder than the second material of the connecting ring, such that the second material can be compressed and stretched when worn by the wearer (e.g., Figures 1A to 2B It shows that arms 104 and 204 can move in at least two degrees of freedom to fit properly onto the wearer's head.

[0046] (A4) In some embodiments of any of A1 to A3, the connecting ring is made of rubber.

[0047] (A5) In some embodiments of any of A1 to A4, the first ring and the second ring are made of plastic.

[0048] (B1) According to some embodiments, a hinge for an augmented reality head-mounted device, wherein the augmented reality head-mounted device is configured according to any one of A1 to A5.

[0049] (C1) According to some embodiments, an extended reality system includes an extended reality head-mounted device, wherein the extended reality head-mounted device is configured according to any one of A1 to A5.

[0050] The devices described above, including systems, wrist-worn devices, head-mounted devices, and textile-based smart clothing, will be described in further detail below. The specific operations described above may occur due to specific hardware, which will be described in more detail below. The devices described below are not limiting, and features on these devices may be removed or additional features may be added to them. Different devices may include one or more similar hardware components. For the sake of brevity, similar devices and components are described below. Any differences between devices and components will be described in the corresponding sections below.

[0051] As described herein, a processor (e.g., a central processing unit (CPU) or a microcontroller unit (MCU)) is an electronic component responsible for executing instructions and controlling the operation of an electronic device. Various types of processors exist that are interchangeable or specifically required by the embodiments described herein. For example, a processor can be: (i) a general-purpose processor designed to perform a variety of tasks, such as running software applications, managing operating systems, and performing arithmetic and logical operations; (ii) a microcontroller designed for specific tasks, such as controlling electronic devices, sensors, and motors; (iii) a graphics processing unit (GPU) designed to accelerate the creation and rendering of images, videos, and animations (e.g., virtual reality animations such as 3D modeling); (iv) a field-programmable gate array (FPGA) that can be programmed and reconfigured after manufacturing and / or customized to perform specific tasks, such as signal processing, cryptography, and machine learning; and (v) a digital signal processor (DSP) designed to perform mathematical operations on signals such as audio, video, and radio waves. Those skilled in the art will understand that one or more processors of one or more electronic devices can be used in the various embodiments described herein.

[0052] As described herein, a controller is an electronic component that manages and coordinates the operation of other components within an electronic device (e.g., controlling inputs, processing data, and / or generating outputs). Examples of controllers may include: (i) microcontrollers, which include small, low-power controllers typically used in embedded systems and Internet of Things (IoT) devices; (ii) programmable logic controllers (PLCs), which can be configured for use in industrial automation systems to control and monitor manufacturing processes; (iii) system-on-a-chip (SoC) controllers, which integrate multiple components such as processors, memory, I / O interfaces, and other peripherals onto a single chip; and / or DSPs. As described herein, a graphics module is a component or software module designed to handle graphics operations and / or processes, and may include hardware and / or software modules.

[0053] As described herein, memory refers to electronic components in a computer or electronic device that store data and instructions for access and operation by a processor. Devices described herein may include volatile memory and non-volatile memory. Examples of memory may include: (i) random access memory (RAM) (e.g., dynamic random access memory (DRAM), static random access memory (SRAM), double-rate RAM (DDR RAM), or other random access solid-state memory devices) configured to temporarily store data and instructions; (ii) read-only memory (ROM) configured to permanently store data and instructions (e.g., one or more portions of system firmware, and / or boot loader); (iii) flash memory, disk storage devices, optical disc storage devices, or other non-volatile solid-state storage devices (e.g., universal serial bus (USB) drives, memory cards, and / or solid-state drives (SSDs)) which may be configured to store data in electronic devices; and (iv) cache memory configured to temporarily store frequently accessed data and instructions. As described herein, storage may include structured data (e.g., Structured Query Language (SQL) databases, MongoDB databases, GraphQL data, or JSON data). Other examples of storage may include: (i) data data, including user account data, user settings, and / or other user data stored by the user; (ii) sensor data detected by one or more sensors and / or otherwise acquired; (iii) media content data, including stored image data, audio data, documents, etc.; (iv) application data, which may include data collected and / or otherwise acquired and stored during use of the application; and / or any other types of data described herein.

[0054] As described herein, the power system of an electronic device is configured to convert input power into a form usable for operating the device. The power system may include various components, including: (i) a power source, which may be an alternating current (AC) adapter power source or a direct current (DC) adapter power source; (ii) a charger input, which may be configured to use wired and / or wireless connections (which may be part of a peripheral device interface, such as USB, micro-USB, near-field magnetic coupling, magnetic induction and magnetic resonance charging, and / or radio frequency (RF) charging); (iii) a power management integrated circuit configured to distribute power to various components of the device and ensure that the device operates within safety limits (e.g., regulating voltage, controlling current, and / or managing heat dissipation); and / or (iv) a battery configured to store power to provide usable power to components of one or more electronic devices.

[0055] As described herein, a peripheral device interface is an electronic component (e.g., an electronic component of an electronic device) that allows the electronic device to communicate with other devices or peripheral devices and can provide means for inputting and outputting data and signals. Examples of peripheral device interfaces may include: (i) a USB interface and / or a micro USB interface configured to connect a device to an electronic device; (ii) a Bluetooth interface configured to allow devices to communicate with each other, including Bluetooth Low Energy (BLE); (iii) a near field communication (NFC) interface configured for short-range wireless operations such as access control; (iv) POGO pins, which may be small spring-loaded pins configured to provide a charging interface; (v) a wireless charging interface; (vi) a global positioning system (GPS) interface; (vii) a Wi-Fi interface for providing connectivity between a device and a wireless network; and (viii) a sensor interface.

[0056] As described herein, a sensor is an electronic component (e.g., located in and / or otherwise communicating electronically with an electronic device such as a wearable device) configured to detect physical and environmental changes and generate electrical signals. Examples of sensors may include: (i) imaging sensors (e.g., including one or more cameras disposed on a corresponding electronic device) for collecting imaging data; (ii) biopotential signal sensors; (iii) inertial measurement units (e.g., multiple IMUs) for detecting changes in, for example, angular rate, force, magnetic field, and / or acceleration; (iv) heart rate sensors for measuring a user's heart rate; (v) SpO2 sensors for measuring a user's blood oxygen saturation and / or other biometric data; (vi) capacitive sensors for detecting potential changes near a part of the user's body (e.g., a sensor-skin interface) and / or other devices or objects; and (vii) light sensors (e.g., ToF sensors, infrared sensors, or visible light sensors) and / or sensors for sensing data from the user or the user's environment. As described herein, biopotential signal sensing components are devices used to measure electrical activity within the body (e.g., biopotential signal sensors). Some types of biopotential signal sensors include: (i) electroencephalography (EEG) sensors configured to measure electrical activity in the brain to diagnose neurological disorders; (ii) electrocardiography (ECG or EKG) sensors configured to measure electrical activity in the heart to diagnose heart problems; (iii) electromyography (EMG) sensors configured to measure electrical activity in muscles and diagnose neuromuscular diseases; and (iv) electrooculography (EOG) sensors configured to measure electrical activity in the eye muscles to detect eye movements and diagnose eye diseases.

[0057] As described herein, applications (e.g., software) stored in the memory of an electronic device include instructions stored in the memory. Examples of such applications include: (i) games; (ii) word processors; (iii) messaging applications; (iv) media streaming applications; (v) financial applications; (vi) calendars; (vii) clocks; (viii) web browsers; (ix) social media applications; (x) camera applications; (xi) web-based applications; (xii) health applications; (xiii) artificial reality (AR) applications; and / or any other applications that may be stored in memory. Applications may operate in conjunction with one or more components of a data and / or device or communication-coupled device to perform one or more operations and / or functions.

[0058] As described herein, a communication interface module may include hardware and / or software capable of data communication using any of the following: various custom or standard wireless protocols (e.g., IEEE 802.15.4, Wi-Fi, ZigBee, 6LoWPAN, Thread, Z-Wave, Bluetooth Smart, ISA100.11a, WirelessHART, or MiWi), custom or standard wired protocols (e.g., Ethernet or HomePlug), and / or any other suitable communication protocol, including those not yet developed as of the filing date of this application. A communication interface is a mechanism that enables different systems or devices to exchange information and data with each other, including hardware, software, or a combination of hardware and software. For example, a communication interface may refer to a physical connector and / or port on a device that enables communication with other devices (e.g., USB, Ethernet, HDMI, Bluetooth). In some embodiments, a communication interface may refer to a software layer that enables different software programs to communicate with each other (e.g., an application programming interface (API), such as protocols like HTTP and TCP / IP).

[0059] As described herein, a graphics module is a component or software module designed to handle graphics operations and / or processes, and may include hardware modules and / or software modules.

[0060] As described herein, a nontransitory computer-readable storage medium is a physical device or storage medium that can be used to store electronic data in a nontransitory form (e.g., such that data is permanently stored until it is intentionally deleted or modified).

[0061] Example AR System Figure 4A , Figure 4B-1 and Figure 4B-2An example artificial reality system according to some embodiments is shown. Figure 4A The first example user interaction is shown using a first AR system 400a and a head-mounted wearable device (e.g., AR device 500). Figure 4B-1 and Figure 4B-2 A third AR system 400c and a third example user interaction using a head-mounted wearable device (e.g., a virtual reality (VR) device 510) are illustrated. As those skilled in the art will understand upon reading the description provided herein, the above-described example AR system (described in detail below) can perform the actions described above with reference to Figures 1 to 12. Figure 3 The various functions and / or operations described.

[0062] Go to Figure 4A The image shows a user 402 wearing an AR device 500. The AR device 500 facilitates interaction between the user and the AR environment. Specifically, as shown in the first AR system 400a, the AR device 500 enables the presentation of one or more avatars 404, digital representations of contacts 406, and virtual objects 408. As described below, the user 402 can interact with one or more avatars 404, digital representations of contacts 406, and virtual objects 408 via the AR device 500.

[0063] User 402 can use AR device 500 to provide user input. For example, user 402 can perform one or more gestures detected by AR device 500 (e.g., using reference below) to provide user input. Figure 5A This refers to one or more image sensors or cameras as depicted in Figure 5B. In some embodiments, the AR device 500 includes a digital assistant to help the user provide user input (e.g., completing a sequence of actions, suggesting different actions or commands, providing reminders, confirming commands, etc.). In some embodiments, the user 402 can provide user input through one or more facial gestures and / or facial expressions. For example, the camera of the AR device 500 can track the user 402's eyes to navigate through the user interface.

[0064] Go to Figure 4B-1 and Figure 4B-2 The image shows user 402 wearing VR device 510. In the third AR system 400c, VR device 510 is used for interaction within an AR environment (e.g., a VR game or other AR application). When VR device 510 presents a representation of a VR game (e.g., a first AR game environment 420) to user 402, VR device 510 detects and coordinates one or more user inputs to allow user 402 to interact with the VR game.

[0065] In some embodiments, user 402 can provide user input via VR device 510, which causes an action to occur in the corresponding AR environment. For example, a third AR system 400c (such as...) Figure 4B-1 In the example shown, user 402 raises his or her arm in preparation to swing it in the first AR game environment 420. VR device 510 responds to user 402 raising his or her arm, causing the AR representation of user 422 to perform a similar action (e.g., raising a virtual object such as virtual sword 424). In some embodiments, each device uses its own sensor data and / or image data to detect user input and provide an accurate representation of user 402's movement. For example, sensor data from VR device 510 can be used to detect the speed at which user 402 raises his or her arm, causing the AR representations of user 422 and virtual sword 424 to synchronize with user 402's movement; and the imaging sensor 526 of VR device 510 (… Figures 5A to 5C () can be used to represent the body, boundary conditions, or real-world objects of the user 402 within the first AR game environment 420.

[0066] exist Figure 4B-2 In the first AR game environment 420, user 402 performs a downward swing. VR device 510 detects the downward swing and executes the corresponding action. In some embodiments, data collected by each device is used to improve the user experience within the AR environment. For example, sensor data from VR device 510 can be used to determine the speed and / or force of the downward swing, and image sensors from VR device 510 can be used to determine the location of the swing and how the swing should be represented in the first AR game environment 420, which can then be used as input to the AR environment (e.g., a game mechanic) that can use the detected speed, force, location, and / or aspects of user 402's action to classify or calculate outputs (e.g., damage amount) the user's input (e.g., a light strike, a heavy strike, a critical strike, a blitzkrieg, a miss, etc.).

[0067] The example AR systems, devices for interacting with such AR systems, and other computing systems have already been discussed more generally, and will now be discussed in more detail below. For ease of reference, this document defines some of the devices and components that may be included in some or all of the example devices discussed below. It will be understood by those skilled in the art that certain types of components described below may be more suitable for a particular set of devices and less suitable for a different set of devices. However, subsequent references to components defined herein should be considered as included in the provided definitions.

[0068] In some embodiments discussed below, example devices and systems, including electronic devices and systems, will be discussed. Such example devices and systems are not intended to be limiting, and those skilled in the art will understand that alternative devices and systems to the example devices and systems described herein can be used to perform the operations described herein and to construct the systems and devices described herein.

[0069] As described herein, an electronic device is a device that uses electrical energy to perform a specific function. An electronic device can be any physical object containing electronic components such as transistors, resistors, capacitors, diodes, and integrated circuits. Examples of electronic devices include smartphones, laptops, digital cameras, televisions, game consoles, and music players, as well as the example electronic devices discussed herein. As described herein, an intermediate electronic device is a device situated between subsets of components of two other electronic devices and / or one or more electronic devices, facilitating communication and / or data processing and / or data transmission between the respective electronic devices and / or electronic components.

[0070] Example of a head-mounted wearable device Figure 5A , Figure 5B-1 , Figure 5B-2 and Figure 5C An example head-mounted wearable device according to some embodiments is illustrated. The head-mounted wearable device may include, but is not limited to, an AR device 510 (e.g., an AR or smart eye-wearing device, such as smart glasses, smart monocles, smart contact lenses, etc.), a VR device 510 (e.g., a VR headset, head-mounted display (HMD), etc.), or other eye-coupling devices. AR device 500 and VR device 510 are illustrated with reference to Figures 1 to 510 herein. Figure 3 The examples of head-mounted wearable devices 100, 200, and 300 described are such that the head-mounted wearable devices should be understood as having the characteristics of AR device 500 and / or VR device 510, and vice versa. AR device 500 and VR device 510 can perform various functions and / or operations associated with browsing and selectively opening applications through a user interface, as well as those described above with reference to Figures 1 to 300. Figure 3 The described functions and / or operations.

[0071] In some embodiments, the AR system (e.g., AR system 400a to 400d); Figure 4A (To Figure 4D-2) includes AR devices 500 (such as...) Figure 5A (as shown) and / or VR device 510 (such as Figures 5B-1 to 5B-2As shown). In some embodiments, AR device 500 and VR device 510 may include one or more simulation components (e.g., components for presenting an interactive artificial reality environment, such as a processor, memory, and / or a presentation device including one or more displays and / or one or more waveguides), some of which will refer to Figure 5C For a more detailed description, the head-mounted wearable device may use a display projector (e.g., display projector components 507A and 507B) and / or a waveguide to project data representations to a user. Some embodiments of the head-mounted wearable device do not include a display.

[0072] Figure 5A An example visual description of an AR device 500 (e.g., which may also be described herein as augmented reality glasses and / or smart glasses) is shown. The AR device 500 can be used with... Figure 5A Additional electronic components (e.g., wearable accessory devices and / or intermediate processing devices configured for use with AR device 500, either electronically or otherwise) not shown in the diagram, work together. In some embodiments, the wearable accessory device and / or intermediate processing device may be configured to be coupled to AR device 500 via a coupling mechanism in electrical communication with coupling sensor 524, wherein coupling sensor 524 can detect when the electronic device becomes physically or electronically coupled to AR device 500. In some embodiments, AR device 500 may be configured to be coupled to a housing (e.g., a frame 504 or a portion of temple arm 505), which may include one or more additional coupling mechanisms configured to be coupled to the additional accessory device. Figure 5A The components shown may be implemented in hardware, software, firmware, or a combination thereof, including one or more signal processing components and / or application-specific integrated circuits (ASICs).

[0073] AR device 500 includes mechanical eyewear components, including a frame 504 configured to hold one or more lenses (e.g., one or two lenses 506-1 and 506-2). Those skilled in the art will understand that AR device 500 may include additional mechanical components, such as hinges configured to allow multiple portions of frame 504 of AR device 500 to fold and unfold, a bridge configured to span the gap between lenses 506-1 and 506-2 and rest against the user's nose, a nose pad configured to rest on the nose bridge and provide support for AR device 500, temple tips configured to rest on the user's ears and provide additional support for AR device 500, temple arms 505 configured to extend from the hinges to the temple tips of AR device 500, etc. Those skilled in the art will further understand that some examples of AR device 500 may not include any of the mechanical components described herein. For example, smart contact lenses configured to present artificial reality to a user may not include any components of AR device 500.

[0074] Lenses 506-1 and 506-2 can be separate displays or display devices (e.g., waveguides for projecting representations). Lenses 506-1 and 506-2 can act together or independently to present an image or a series of images to a user. In some embodiments, lenses 506-1 and 506-2 can operate in conjunction with one or more display projector assemblies 507A and 507B to present image data to a user. Although AR device 500 includes two displays, embodiments of this disclosure can be implemented in AR devices having a single near-eye display (NED) or more than two NEDs.

[0075] AR device 500 includes electronic components, many of which will be discussed below. Figure 5C To describe in more detail. Figure 5A Some example electronic components are shown, including sensors 523-1, 523-2, 523-3, 523-4, 523-5, and 523-6 that can be distributed along most of the frame 504 of the AR device 500. See below for reference. Figure 5C The AR device 500 also includes a left camera 539A and a right camera 539B located on different sides of the frame 504. The eye-wearing device also includes one or more processors 548A and 548B (e.g., integrated microprocessors, such as ASICs) embedded in a portion of the frame 504.

[0076] Figure 5B-1 and Figure 5B-2An example visual description of a VR device 510 (e.g., a head-mounted display (HMD) 512, also referred to herein as an artificial reality head-mounted device, head-wearable device, VR head-mounted device, etc.) is shown. The HMD 512 includes a front body 514 and a frame 516 (e.g., a strip or band) shaped to fit around a user's head. In some embodiments, the front body 514 and / or frame 516 include one or more electronic components for facilitating the presentation and / or interaction with AR and / or VR systems (e.g., displays, processors (e.g., processor 548A-1), IMUs, tracking transmitters or detectors, sensors, etc.). In some embodiments, the HMD 512 includes an output audio transducer (e.g., an output audio transducer 518-1, such as...) Figure 5B-2 As shown. In some embodiments, as Figure 5B-2 As shown, one or more components, such as one or more output audio converters 518-1 and frame 516 (e.g., a portion or all of frame 516 and / or output audio converters 518-1), can be configured to attach and detach (e.g., detachably attach) to HMD 512. In some embodiments, coupling a detachable component to HMD 512 enables the detachable component to communicate electronically with HMD 512. VR device 510 includes electronic components, many of which will be discussed below. Figure 5C To describe in more detail.

[0077] Figures 5B-1 to 5B-2 The VR device 510 is also shown to have one or more cameras, such as left camera 539A and right camera 539B, which may resemble the left and right cameras on frame 504 of AR device 500. In some embodiments, the VR device 510 includes one or more additional cameras (e.g., cameras 539C and 539D), which may be configured to enhance the image data obtained by cameras 539A and 539B by providing more information. For example, camera 539C may be used to provide color information that cameras 539A and 539B cannot recognize. In some embodiments, one or more of cameras 539A to 539D may include an optional infrared (IR) cutoff filter configured to remove IR light received at the respective camera sensor.

[0078] VR device 510 may include a housing 590 that stores one or more components of VR device 510 and / or additional components of VR device 510. Housing 590 may be a modular electronic device configured to couple with VR device 510 (or AR device 500) and supplement and / or extend the capabilities of VR device 510 (or AR device 500). For example, housing 590 may include additional sensors, cameras, power supplies, processors (e.g., processor 548A-2), etc., to improve and / or increase the functionality of VR device 510. References below... Figure 5C Examples of the different components included in housing 590 are described.

[0079] Alternatively or additionally, in some embodiments, head-worn devices such as VR device 510 and / or AR device 500 include or are communicatively coupled to another external device (e.g., a pairing device), such as an optional neckband. The optional neckband can be coupled to the head-worn device via one or more connectors (e.g., wired or wireless connectors). The head-worn device and the neckband can operate independently without any wired or wireless connection between them. In some embodiments, components of the head-worn device and components of the neckband can be located on one or more additional peripheral devices, neckbands, or some combination thereof paired with the head-worn device. Furthermore, the term "neckband" is intended to represent any suitable type or form of pairing device. Therefore, the following discussion of neckbands can also be applied to a variety of other pairing devices, such as smartwatches, smartphones, wristbands, other wearable devices, handheld controllers, tablet computers, or laptops.

[0080] In some cases, pairing an external device, such as a mid-processing device (e.g., an optional neckband and / or wearable accessory device), with a head-worn device (e.g., AR device 500 and / or VR device 510) allows the head-worn device to achieve glasses-like form factors while still providing sufficient battery power and computing power for extended capabilities. Some or all of the head-worn device's battery power, computing resources, and / or additional features can be provided by the paired device or shared between the paired device and the head-worn device, thus reducing the overall weight, heat distribution, and form factor of the head-worn device while still allowing it to retain its desired functionality. For example, a mid-processing device can allow components originally included in the head-worn device to be included in the mid-processing device (and / or the wearable device or accessory device), thereby transferring weight loads from the user's head and neck to one or more other parts of the user's body. In some embodiments, the mid-processing device has a large surface area on which heat is diffused and distributed to the surrounding environment. Therefore, a mid-processing device can allow for greater battery power and computing power compared to a standalone head-worn device. Because the weight carried in the intermediate processing device is less invasive to the user than the weight carried in the head-mounted wearable device, users can tolerate wearing a lighter eye-mounted device and carrying or wearing the paired device for a longer period of time compared to tolerating wearing a heavier eye-mounted device alone. This allows users to more fully integrate the artificial reality environment into their daily activities.

[0081] In some embodiments, the intermediate processing device is communicatively coupled to the head-mounted wearable device and / or other devices. These other devices may provide certain functions to the head-mounted wearable device (e.g., tracking, positioning, depth map construction, processing, storage, etc.). In some embodiments, the intermediate processing device includes a controller and a power supply. In some embodiments, the sensors of the intermediate processing device are configured to sense additional data that can be shared with the head-mounted wearable device in an electronic format (analog or digital).

[0082] The controller of the intermediate processing device processes information generated by the intermediate processing device and / or sensors on the head-mounted wearable device. The intermediate processing device may process information generated by one or more of its sensors and / or information provided by other communication-coupled devices. For example, the head-mounted wearable device may include an IMU, and the intermediate processing device (e.g., a neckband) may perform all inertial and spatial calculations from the IMU located on the head-mounted wearable device.

[0083] Artificial reality systems can include various types of visual feedback mechanisms. For example, the display device in AR device 500 and / or VR device 510 can include one or more liquid-crystal displays (LCDs), light-emitting diode (LED) displays, organic LED (OLED) displays, and / or any other suitable type of display. Artificial reality systems can include a single display for each eye, or can provide one display for each eye, which can provide additional flexibility for zoom adjustment or correction of refractive errors associated with the user's vision. Some artificial reality systems also include an optical subsystem with one or more lenses (e.g., conventional concave or convex lenses, Fresnel lenses, or adjustable liquid lenses) through which the user views the display. In addition to using displays, or instead of using displays, some artificial reality systems include one or more projection systems. For example, the display device in AR device 500 and / or VR device 510 can include (e.g., using waveguides) miniature LED projectors that project light into the display device, such as transparent combiner lenses that allow ambient light to pass through. Display devices can refract projected light toward the user's pupils, allowing the user to simultaneously view both artificial reality content and the real world. Artificial reality systems can also be configured with any other suitable type or form of image projection system. As mentioned above, some AR systems essentially replace one or more of the user's sensory perceptions of the real world with virtual experiences, rather than combining artificial reality with actual reality.

[0084] Although this document describes the example head-worn devices as AR device 500 and VR device 510 respectively, any one or both of the example head-worn devices described herein can be configured to present a fully immersive VR scene in substantially all of the user's field of view, or additionally or alternatively, a more subtle augmented reality scene in a portion (less than all) of the user's field of view.

[0085] In some embodiments, AR device 500 and / or VR device 510 may include a haptic feedback system. The haptic feedback system can provide various types of skin feedback, including vibration, force, traction, shear, texture, and / or temperature. The haptic feedback system can also provide various types of kinematic feedback, such as motion and compliance. Haptic feedback can be implemented using motors, piezoelectric actuators, fluid systems, and / or various other types of feedback mechanisms. The haptic feedback system can be implemented independently of other artificial reality devices, within other artificial reality devices, and / or in conjunction with other artificial reality devices (e.g., wrist-worn devices that can be integrated into headwear, gloves, bodysuits, handheld controllers, environmental devices (e.g., chairs or footrests), and / or any other type of device or system (such as wrist-worn devices, handheld intermediate processing devices, textile-based smart clothing, etc.)) and / or other devices described herein.

[0086] Figure 5C A computing system 520 and an optional housing 590 are shown, each illustrating components that can be included in a head-mounted wearable device (e.g., AR device 500 and / or VR device 510). In some embodiments, the optional housing 590 may include more or fewer components depending on the actual constraints of the respective head-mounted wearable device described. Additionally or alternatively, the optional housing 590 may include additional components that extend and / or enhance the functionality of the head-mounted wearable device.

[0087] In some embodiments, the computing system 520 and / or optional housing 590 may include one or more peripheral device interfaces 522A and 522B, one or more power systems 542A and 542B (including a charging input 543, a PMIC 544, and a battery 545), one or more controllers 546A and 546B (including one or more haptic controllers 547), one or more processors 548A and 548B (as defined above, including any of the examples provided), and memories 550A and 550B, all of which can communicate electronically with each other. For example, one or more processors 548A and / or 548B may be configured to execute instructions stored in memories 550A and / or 550B, which may cause controllers in one or more controllers 546A and / or 546B to perform operations at one or more peripheral devices of the peripheral device interfaces 522A and / or 522B. In some embodiments, each of the described operations may occur based on power supplied by the power systems 542A and / or 542B.

[0088] In some embodiments, the peripheral device interface 522A may include one or more devices configured as part of the computing system 520. For example, the peripheral device interface may include one or more sensors 523A. Some example sensors include: one or more coupled sensors 524, one or more acoustic sensors 525, one or more imaging sensors 526, one or more EMG sensors 527, one or more capacitive sensors 528, and / or one or more IMUs 529. In some embodiments, these sensors 523A may also include a depth sensor 567, a light sensor 568, and / or any other type of sensor as defined above or described with respect to any other embodiments discussed herein.

[0089] In some embodiments, the peripheral device interface may include one or more additional peripheral devices, including one or more NFC devices 530, one or more GPS devices 531, one or more LTE devices 532, one or more WiFi and / or Bluetooth (BT) devices 533, one or more buttons 534 (e.g., including slide-able or otherwise adjustable buttons), one or more displays 535A, one or more speakers 536A, one or more microphones 537A, one or more cameras 538A (e.g., including first cameras 539-1 to nth cameras 539-n similar to left camera 539A and / or right camera 539B), one or more haptic devices 540, and / or any other type of peripheral device as defined above or described with respect to any other embodiments discussed herein.

[0090] Head-mounted wearable devices can include various types of visual feedback mechanisms (e.g., presentation devices). For example, the display devices in AR device 500 and / or VR device 510 can include one or more liquid crystal displays (LCDs), light-emitting diode (LED) displays, organic LED (OLED) displays, micro-LEDs, and / or any other suitable type of display. Head-mounted wearable devices can include (e.g., configured to be viewed by both eyes) a single display, and / or can provide a separate display for each eye, which can provide additional flexibility for zoom adjustment or correction of refractive errors associated with the user's vision. Some embodiments of head-mounted wearable devices also include an optical subsystem having one or more lenses (e.g., conventional concave or convex lenses, Fresnel lenses, or adjustable liquid lenses) through which the user views the display. For example, each display 535A can be coupled to each of lenses 506-1 and 506-2 of AR device 500. Displays 535A coupled to each of lenses 506-1 and 506-2 can act together or independently to present an image or a series of images to the user. In some embodiments, AR device 500 and / or VR device 510 include a single display 535A (e.g., a near-eye display) or more than two displays 535A.

[0091] In some embodiments, a first set of one or more displays 535A may be used to present an augmented reality environment, and a second set of one or more display devices 535A may be used to present a virtual reality environment. In some embodiments, one or more waveguides are used in conjunction with presenting artificial reality content to a user of the AR device 500 and / or VR device 510 (e.g., as a means of delivering light from a display projector assembly and / or one or more displays 535A to the user's eyes). In some embodiments, one or more waveguides are wholly or partially integrated into the AR device 500 and / or VR device 510. In addition to using displays, or instead of using displays, some artificial reality systems may include one or more projection systems. For example, the display devices in the AR device 500 and / or VR device 510 may include (e.g., using waveguides) miniature LED projectors that project light into the display devices, such as transparent combiner lenses that allow ambient light to pass through. The display devices may refract the projected light toward the user's pupil, allowing the user to simultaneously view both artificial reality content and the real world. Head-mounted wearable devices may also be configured with any other suitable type or form of image projection system. In some embodiments, one or more waveguides are additionally or alternatively provided to one or more displays 535A.

[0092] In some embodiments of the head-mounted wearable device, ambient light and / or a real-time view of the real world (e.g., a real-time feed of the user's surroundings) can pass through the display elements of the respective head-mounted wearable device that present aspects of the AR system. In some embodiments, ambient light and / or a real-time view of the real world can pass through a portion (not all) of the AR environment presented within the user's field of view (e.g., a portion of the AR environment is located in the same location as physical objects in the user's real-world environment, which is within a designated boundary (e.g., a guardian boundary) configured for use by the user when interacting with the AR environment). For example, visual user interface elements (e.g., notification user interface elements) can be presented on the head-mounted wearable device, and a certain amount of ambient light and / or a real-time view (e.g., 15%-50% of the ambient light and / or real-time view) can pass through the user interface elements, allowing the user to distinguish at least a portion of the physical environment on which the user interface elements are displayed.

[0093] The head-mounted wearable device may include one or more external displays 535A for presenting information to a user. For example, the external display 535A may be used to display current battery level, network activity (e.g., connected, disconnected, etc.), current activity (e.g., playing games, making calls, attending meetings, watching movies, etc.), and / or other relevant information. In some embodiments, the external display 535A may be used to communicate with other elements. For example, a user of the head-mounted wearable device may cause the external display 535A to display a Do Not Disturb notification. The user may also use the external display 535A to share any information acquired by one or more components of the peripheral device interface 522A and / or generated by the head-mounted wearable device (e.g., during the operation and / or execution of one or more applications).

[0094] Memory 550A may include instructions and / or data executable by a memory controller of one or more processors 548A (and / or processor 548B of housing 590) and / or one or more controllers 546A (and / or controller 546B of housing 590). Memory 550A may include one or more operating systems 551, one or more applications 552, one or more communication interface modules 553A, one or more graphics modules 554A, one or more AR processing modules 555A, and / or any other type of module or component defined above or described with respect to any other embodiments discussed herein.

[0095] The data 560 stored in memory 550A can be used in conjunction with one or more of the applications and / or programs discussed above. Data 560 may include data 561, sensor data 562, media content data 563, AR application data 564, and / or any other types of data defined above or described with respect to any other embodiments discussed herein.

[0096] In some embodiments, the controller 546A of the head-worn device processes information generated by sensors 523A on the head-worn device and / or another component of the head-worn device and / or another component communicatively coupled to the head-worn device (e.g., a component of housing 590, such as a component of peripheral interface 522B). For example, the controller 546A may process information from acoustic sensors 525 and / or imaging sensors 526. For each detected sound, the controller 546A may perform direction-of-arrival (DOA) estimation to estimate the direction in which the detected sound arrives at the head-worn device. When one or more acoustic sensors 525 detect sound, the controller 546A may populate the audio dataset with information (e.g., represented by sensor data 562).

[0097] In some embodiments, physical electronic connectors can transmit information between the head-worn device and another electronic device, and / or between one or more processors 548A and controllers 546A within the head-worn device. This information can be in the form of optical data, electrical data, wireless data, or any other transmissible data format. Moving the processing of information generated by the head-worn device to an intermediate processing device can reduce weight and heat in the eyewear device, making it more comfortable and safer for the user. In some embodiments, optional accessory devices (e.g., electronic neckbands) are coupled to the head-worn device via one or more connectors. Connectors can be wired or wireless and can include electronic components and / or non-electronic (e.g., structural) components. In some embodiments, the head-worn device and accessory devices can operate independently without any wired or wireless connection between them.

[0098] Head-mounted wearable devices can include various types of computer vision components and subsystems. For example, AR device 500 and / or VR device 510 can include one or more optical sensors, such as two-dimensional (2D) cameras or three-dimensional (3D) cameras, time-of-flight depth sensors, single-beam or scanning laser rangefinders, 3D LiDAR sensors, and / or any other suitable type or form of optical sensor. The head-mounted wearable device can process data from one or more of these sensors to identify the user's location and / or aspects of the user's real-world physical environment, including the location of real-world objects within the real-world physical environment. In some embodiments, the methods described herein are used to map the real world, provide the user with context about the real-world environment, and / or generate interactive virtual objects (which may be replicas or digital twins of real-world objects that can be interacted with in an AR environment), and various other functions. For example, Figure 5B-1 and Figure 5B-2 A VR device 510 with cameras 539A to 539D is shown. These cameras can be used to provide depth information for creating voxel fields and two-dimensional meshes to provide the user with object information to avoid collisions.

[0099] Optional housing 590 may include components similar to those described above with respect to computing system 520. For example, optional housing 590 may include a corresponding peripheral interface 522B, which includes more or fewer components than those described above with respect to peripheral interface 522A. As mentioned above, the components of optional housing 590 may be used to enhance and / or expand the functionality of the head-mounted wearable device. For example, optional housing 590 may include corresponding sensors 523B, speakers 536B, displays 535B, microphones 537B, cameras 538B, and / or other components for acquiring and / or presenting data. Similarly, optional housing 590 may include one or more processors 548B, controllers 546B, and / or memory 550B (including corresponding communication interface modules 553B; one or more graphics modules 554B; one or more AR processing modules 555B, etc.), and the one or more processors, controllers, and / or memory may be used individually and / or in combination with the components of computing system 520.

[0100] The above text is in Figures 5A to 5C The techniques described herein can be used with various head-mounted wearable devices. In some embodiments, the head-mounted wearable device (e.g., AR device 500 and / or VR device 510) can be used in conjunction with one or more wearable devices such as wrist-mounted wearable devices (or components thereof) and / or textile-based smart clothing, as well as a handheld intermediate processing device.

[0101] Any data collection performed by the devices described herein and / or any device configured to perform the different embodiments described above with reference to any of the illustrations (hereinafter referred to as "devices") is conducted in a manner that complies with all applicable privacy regulations and with the user's consent. Users may choose to allow the devices to collect data, or to restrict or refuse data collection by the devices. Users can opt in or out of any data collection at any time. Furthermore, users may choose to request the deletion of any collected data.

[0102] It will be understood that although the terms “first,” “second,” etc., may be used in this document to describe various elements, these elements should not be limited by these terms. These terms are only used to distinguish one element from another.

[0103] The terminology used herein is for the purpose of describing particular embodiments only and is not intended to limit the claims. As used in the description of the embodiments and the appended claims, the singular forms “a,” “an,” and “the” are also intended to include the plural forms unless the context clearly indicates otherwise. It will also be understood that the term “and / or” as used herein refers to and includes any and all possible combinations of one or more of the associated listed items. It will also be understood that, as used in this specification, the terms “comprising” and / or “including” specify the presence of the stated features, integers, steps, operations, elements, and / or components, but do not exclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and / or groups thereof.

[0104] As used herein, the term "if" can be interpreted, depending on the context, as meaning "when" or "once" or "in response to determination" or "according to determination" or "in response to detection" when the stated prerequisite is true. Similarly, depending on the context, the phrases "if determination [the stated prerequisite is true]" or "if [the stated prerequisite is true]" or "when [the stated prerequisite is true]" can be interpreted as meaning "once determination" or "in response to determination" or "according to determination" or "once detection" or "in response to detection" when the stated prerequisite is true.

[0105] For illustrative purposes, the foregoing description has been illustrated with reference to specific embodiments. However, the illustrative discussion above is not intended to be exhaustive or to limit the claims to the precise forms disclosed. Many modifications and variations are possible in light of the above teachings. The embodiments were chosen and described in order to best explain the principles of operation and practical application, thereby enabling others skilled in the art to implement them.

Claims

1. An augmented reality head-mounted device, the augmented reality head-mounted device comprising: Connector assembly, the connector assembly comprising: The first ring is connected to the arm of the extended reality head-mounted device; A second ring connected to the main body of the extended reality headset; and The first ring is coupled to the connecting ring of the second ring, wherein... The connecting ring comprises a flexible material, enabling the first ring and the second ring to remain coupled and move relative to each other. The connecting ring is configured to move relative to the body of the extended reality headset along a first degree of freedom of the arm of the extended reality headset, and The connecting ring is configured to move relative to the body of the extended reality headset along a second degree of freedom of the arm of the extended reality headset, wherein the first degree of freedom is different from the second degree of freedom.

2. The extended reality head-mounted device according to claim 1, wherein, The connector assembly is configured as follows: When worn on a head of the first size, it has a first orientation, wherein the first orientation includes a first measurement along the first degree of freedom and a first measurement along the second degree of freedom; and When worn on a second-sized head that is different from the first-sized head, it has a second orientation, wherein the second orientation includes a second measurement along the first degree of freedom and a second measurement along the second degree of freedom.

3. The extended reality head-mounted device according to claim 1, wherein, The first ring and the second ring are made of a first material that is harder than the second material of the connecting ring, so that the second material can be compressed and stretched when worn by the wearer.

4. The extended reality head-mounted device according to claim 1, wherein, The connecting ring is made of rubber.

5. The extended reality head-mounted device according to claim 1, wherein, The first ring and the second ring are made of plastic.

6. The extended reality head-mounted device according to claim 1, wherein, The first degree of freedom allows for motion up to 90 degrees, and the second degree of freedom allows for a range of motion up to 90 degrees.

7. The extended reality head-mounted device according to claim 1, wherein, The connector assembly is configured to allow the extended reality headset to be worn by a person with a head size at least in the 5th to 95th percentile.

8. A hinge for an extended reality head-mounted device, the hinge comprising: Connector assembly, the connector assembly comprising: The first ring is connected to the arm of the extended reality head-mounted device; A second ring connected to the main body of the extended reality headset; and The first ring is coupled to the connecting ring of the second ring, wherein... The connecting ring comprises a flexible material, enabling the first ring and the second ring to remain coupled and move relative to each other. The connecting ring is configured to move relative to the body of the extended reality headset along a first degree of freedom of the arm of the extended reality headset, and The connecting ring is configured to move relative to the body of the extended reality headset along a second degree of freedom of the arm of the extended reality headset, wherein the first degree of freedom is different from the second degree of freedom.

9. The hinge for an extended reality head-mounted device according to claim 8, wherein the connector assembly is configured to: When worn on a head of the first size, it has a first orientation, wherein, The first orientation includes a first measurement along the first degree of freedom and a first measurement along the second degree of freedom; and When worn on a second-sized head that is different from the first-sized head, it has a second orientation, wherein the second orientation includes a second measurement along the first degree of freedom and a second measurement along the second degree of freedom.

10. The hinge for an extended reality head-mounted device according to claim 8, wherein, The first ring and the second ring are made of a first material that is harder than the second material of the connecting ring, so that the second material can be compressed and stretched when worn by the wearer.

11. The hinge for an extended reality head-mounted device according to claim 8, wherein, The connecting ring is made of rubber.

12. The hinge for an extended reality head-mounted device according to claim 8, wherein, The first ring and the second ring are made of plastic.

13. The hinge for an extended reality head-mounted device according to claim 8, wherein, The first degree of freedom allows for motion up to 90 degrees, and the second degree of freedom allows for a range of motion up to 90 degrees.

14. The hinge of the extended reality head-mounted device according to claim 8, wherein, The connector assembly is configured to allow the extended reality headset to be worn by a person with a head size at least in the 5th to 95th percentile.

15. An extended reality system, the extended reality system comprising an extended reality head-mounted device according to claims 1 to 7.

Images