Wearable ring device and user interface processing

Abstract

Systems, methods, and non-transitory media for using a wearable ring device for extended reality (XR) functionality are provided. An exemplary wearable device may include a structure defining a receptive space configured to receive a finger associated with a user, the structure including a first surface configured to contact the finger received through the receptive space, one or more sensors integrated into the structure, the one or more sensors configured to detect a rotation of at least a portion of the structure about a longitudinal axis of the receptive space, and a wireless transmitter configured to transmit data based on the rotation to an electronic device.

Description

[Technical field]

[0001]

[0001] The present disclosure generally relates to a wearable device for interacting with a user interface. For example, aspects of the present disclosure relate to using a wearable ring device to interact with a user interface, such as an extended reality (XR) interface on an electronic device and an XR device. [Background technology]

[0002]

[0002] Extended reality (e.g., augmented reality, virtual reality, etc.) devices such as smart glasses and head-mounted displays (HMDs) typically implement cameras and various sensors to track the position of the extended reality (XR) device and other objects in a physical environment. The XR reality device can use the tracking information to provide a realistic XR experience to a user of the XR device. For example, the XR device can enable a user to experience or interact with an immersive virtual environment or content. To provide a realistic XR experience, the XR technology can integrate virtual content with the physical world, which may involve matching the relative pose and movement of objects and devices. The XR technology can use the tracking information to calculate the relative pose of a map of the device, object, and / or real-world environment, match the relative position and movement of the device, object, and / or real-world environment, and anchor the content in a convincing manner to the real-world environment. The relative pose information can be used to match the virtual content with the user's perceived actions and the spatiotemporal state of the device, object, and real-world environment. Summary of the Invention

[0003]

[0003] Systems and techniques for a wearable ring device for enhanced user experience and interaction and processing with a user interface are described herein. According to at least one example, a method is provided for using a wearable ring device for input functions and / or interaction with a user interface. The method can include detecting a rotation of at least a portion of a wearable device, the wearable device including a structure defining a reception space, the reception space being configured to receive a finger associated with a user, the structure including a first surface configured to contact the finger received through the reception space, about a longitudinal axis of a reception space associated with the wearable device via one or more sensors on the wearable device, and transmitting data based on the detected rotation to an electronic device via a wireless transmitter of the wearable device.

[0004] According to at least one example, a non-transitory computer-readable medium for using a wearable ring device for input functions and / or interaction with a user interface is provided. The non-transitory computer-readable medium can include instructions that, when executed by one or more processing devices, cause the one or more processing devices to detect, via one or more sensors on the wearable device, a rotation of at least a portion of the wearable device, the wearable device including a structure defining a receptive space, the receptive space configured to receive a finger associated with a user, the structure including a first surface configured to contact the finger received through the receptive space, about a longitudinal axis of a receptive space associated with the wearable device, and transmit data based on the detected rotation to an electronic device via a wireless transmitter of the wearable device.

[0005] According to at least one example, an apparatus is provided that uses a wearable device for input functions and / or interaction with a user interface. An example apparatus can include a wearable device comprising: a structure defining a reception space configured to receive a finger associated with a user, the structure including a first surface configured to contact the finger received through the reception space; one or more sensors integrated into the structure, the one or more sensors configured to detect a rotation of at least a portion of the structure about a longitudinal axis of the reception space; and a wireless transmitter configured to transmit data based on the detected rotation to an electronic device.

[0006] According to at least one example, another apparatus is provided that uses a wearable device for input functions and / or interaction with a user interface. An example apparatus can include a wearable device including a structure defining a reception space, the reception space configured to receive a finger associated with a user, the structure including a first surface configured to contact the received finger via the reception space, the wearable device including means for detecting a rotation of at least a portion of the wearable device about a longitudinal axis of the reception space associated with the wearable device, and transmitting data based on the detected rotation to an electronic device.

[0007]

[0007] In some aspects, the methods, non-transitory computer readable media, and devices described above can adjust a state of the wearable device when at least a portion of the structure is rotated a particular amount, where adjusting the state includes turning on one or more components of the wearable device from an off state or switching one or more components from a low power mode to a high power mode.

[0008] In some examples, the data can include an extended reality (XR) input associated with an XR application at the electronic device. In some examples, transmitting the data can include transmitting the XR input.

[0009] In some examples, the data includes one or more rotational measurements. In some cases, the one or more rotational measurements include at least one of a rotational angle, a rotational velocity, and a rotational acceleration.

[0010] In some examples, the one or more sensors are configured to detect at least one of a touch signal corresponding to one or more fingers contacting the second surface of the structure, an orientation of the structure, and a position of the structure relative to the one or more objects. In some cases, the data includes at least one of a magnitude of the touch signal, an orientation of the structure, a position of the structure relative to the one or more objects, and a distance between the structure and at least one of an electronic device directly or indirectly coupled to the wearable device and a hand distinct from the individual hand of the fingers.

[0011]

[0011] In some aspects, the methods, non-transitory computer readable media, and apparatus described above can transmit one or more measurements from one or more sensors to an electronic device via a wireless transmitter, the one or more measurements corresponding to an additional orientation of an individual hand of the fingers, and the XR input is based on at least one of the additional orientation of the individual hand and the rotation and orientation of the structure.

[0012] In some examples, detecting a rotation of at least a portion of the structure about the longitudinal axis of the receiving space further includes measuring at least one of a first rotation of a first portion of the structure about the longitudinal axis of the receiving space and a second rotation of a second portion of the structure about the longitudinal axis of the receiving space, in some examples, the second rotation is in an opposite direction to the first rotation.

[0013]

[0013] In some cases, the data corresponds to XR input to an XR application on the electronic device, the XR input including at least one of scrolling virtual content rendered by the electronic device, scaling an object rendered by the electronic device, rotating an object rendered by the electronic device, moving an object rendered by the electronic device, defining a virtual plane within an environment rendered by the electronic device, and placing a virtual object rendered by the electronic device on one or more virtual planes in the environment rendered by the electronic device.

[0014] In some cases, the data corresponds to an XR input to an XR application on the electronic device, and the data includes one or more measurements from one or more sensors. In some examples, the one or more measurements can include at least one of a touch signal corresponding to one or more fingers touching a second surface of the structure, an orientation of the structure, a rotation, a hand movement associated with the fingers, and a position of the structure relative to one or more objects.

[0015] In some cases, the XR input is based on one or more characteristics associated with one or more measurements in the data. In some examples, the one or more characteristics can include at least one of a magnitude of rotation, a direction of rotation, a speed of rotation, and a length of time of pressure applied to one or more portions of the structure, where the one or more characteristics are identified by the one or more measurements.

[0016]

[0016] In some examples, the XR input is based on one or more characteristics associated with the touch signal, the one or more characteristics including at least one of a magnitude of pressure from one or more fingers contacting the second surface of the structure, a motion associated with the one or more fingers when contacting the second surface of the structure, a direction of the motion, a length of contact time between the one or more fingers and the second surface, and a contact pattern of the one or more fingers on the second surface of the structure, and the one or more characteristics are identified by one or more measurements.

[0017] In some cases, the XR input can include modifying a virtual element along multiple dimensions in space, the virtual element including at least one of a virtual object rendered by the electronic device, a virtual plane in an environment rendered by the electronic device, and an environment rendered by the electronic device. In some examples, the adjustment of a first dimension of the multiple dimensions is defined by at least one of an angular change associated with a rotation, a rotational velocity, and a rotational acceleration, and the adjustment of a second dimension of the multiple dimensions is defined by one or more measurements, the one or more measurements including at least one of a touch signal corresponding to one or more fingers contacting a second surface of the structure, an orientation of the structure, and a position of the structure relative to the one or more objects.

[0018]

[0018] In some examples, the one or more measurements include a motion measurement corresponding to a hand movement associated with a finger, and the XR input corresponds to a request to measure a distance in physical space, the distance being defined by the hand movement.

[0019] In some examples, the wearable device includes a wearable ring. In some cases, the wearable device includes a wearable ring including an outer ring and an inner ring, the inner ring defining a receiving space, and the one or more sensors are configured to detect at least one of an angular change, a rotational velocity, and a rotational acceleration of the outer ring about a longitudinal axis of the receiving space.

[0020] In some examples, the electronic device includes a mobile device. In some cases, the mobile device includes one of a head mounted display, a mobile phone, a portable computer, or a smart watch. In some examples, the one or more sensors include at least one of a position sensor, an accelerometer, a gyroscope, a pressure sensor, an audio sensor, a touch sensor, and an inertial measurement unit.

[0021] In some aspects, the devices described above may include one or more sensors. In some aspects, the devices described above may include a wearable ring. In some aspects, the devices described above may include a mobile device. In some examples, the devices may include a hand controller, a mobile phone, a wearable device, a display device, a mobile computer, a head-mounted device, and / or a camera.

[0022]

[0022] This Summary is not intended to identify key or essential features of the claimed subject matter, nor is it intended to be used independently to determine the scope of the claimed subject matter, which subject matter should be understood by reference to the entire specification of this patent, any or all drawings, and appropriate portions of each claim.

[0023]

[0023] The above, together with other features and embodiments, will become more apparent with reference to the following specification, claims, and accompanying drawings. [Brief description of the drawings]

[0024]

[0024] In order to explain the manner in which the various advantages and features of the present disclosure may be obtained, a more detailed description of the principles described above will be presented with reference to specific embodiments thereof as shown in the accompanying drawings. With the understanding that these drawings represent only exemplary embodiments of the present disclosure and should not be considered as limiting its scope, the principles herein will be described and explained with additional specificity and detail using the drawings. [Figure 1]

[0025] FIG. 1 illustrates an example of an extended reality system and ring device used for extended reality experiences and capabilities, according to some examples of the present disclosure. [Figure 2A]

[0026] FIG. 2 illustrates an example of a ring device, according to some examples of the present disclosure. [Figure 2B] FIG. 2 illustrates an example of a ring device, according to some examples of the present disclosure. [Figure 2C]

[0027] FIG. 2 illustrates an example of a ring device worn on a user's finger interacting with an extended reality system, according to some examples of the present disclosure. [Figure 3A]

[0028] FIG. 2 illustrates an example configuration of a ring device according to some examples of the present disclosure. [Figure 3B]

[0029] A diagram showing an example of a use case for using the exemplary ring device shown in FIG. 3A, according to some examples of the present disclosure. [Figure 4A]

[0030] A diagram illustrating an example of a use case for providing extended reality input using a ring device, according to some examples of the present disclosure. [Figure 4B] A diagram illustrating an example of a use case for providing extended reality input using a ring device, according to some examples of the present disclosure. [Figure 4C]A diagram illustrating an example of a use case for providing extended reality input using a ring device, according to some examples of the present disclosure. [Figure 4D] A diagram illustrating an example of a use case for providing extended reality input using a ring device, according to some examples of the present disclosure. [Diagram 5]

[0031] FIG. 1 illustrates an example of a user providing extended reality input by moving and / or positioning a hand and / or fingers wearing a ring device, according to some examples of the present disclosure. [Figure 6]

[0032] 1 is a flowchart illustrating an example of a process for using a ring device to enhance extended reality capabilities, according to some examples of the present disclosure. [Figure 7]

[0033] FIG. 2 illustrates an example of a computing device architecture, according to some examples of the present disclosure. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0025]

[0034] Specific aspects and embodiments of the present disclosure are provided below. As will be apparent to those skilled in the art, some of these aspects and embodiments may be applied independently, and some of them may be applied in combination. In the following description, for the purpose of explanation, specific details are set forth to provide a thorough understanding of the embodiments of the present application. However, it will be apparent that various embodiments can be practiced without these specific details. The figures and descriptions are not intended to be limiting.

[0026]

[0035] The following description provides only exemplary embodiments and is not intended to limit the scope, applicability, or configuration of the present disclosure. Rather, the following description of exemplary embodiments provides those skilled in the art with an enabling description for implementing the exemplary embodiments. It should be understood that various changes may be made in the function and arrangement of elements without departing from the spirit and scope of the present application as set forth in the appended claims.

[0027]

[0036] As mentioned above, extended reality (e.g., augmented reality, virtual reality, etc.) devices such as smart glasses and head-mounted displays (HMDs) typically implement cameras and various sensors to track the position of the extended reality (XR) device and other objects in a physical environment. The XR reality device can use such tracking information to provide a realistic XR experience to a user of the XR device. For example, the XR device can enable a user to experience or interact with an immersive virtual environment or content. To provide a realistic XR experience, the XR technology can integrate the virtual content with the physical world, which may involve matching the relative pose and movement of the objects and the device. The XR technology can use the tracking information to calculate the relative pose of the device, object, and / or map of the real-world environment, match the relative position and movement of the device, object, and / or real-world environment, and anchor the content in a convincing / realistic manner to the real-world environment. The relative pose information can be used to match the virtual content with the user's perceived actions and the spatiotemporal state of the device, object, and real-world environment.

[0028]

[0037] In some cases, an XR device may be paired with a controller that a user can use to select and interact with content rendered by the XR device during an XR experience. To enable realistic interaction with the rendered content using the controller, the XR device may use cameras and other sensors on the XR device to track the pose and movement of the controller, and use the pose and movement of the controller to match the state of the controller with the user's perceived actions and the spatiotemporal state of the rendered content and other objects in the environment. However, controller-based XR systems often require a significant amount of power and computational resources to implement, which can adversely affect the performance and battery life of the XR device used with the controller. Furthermore, the use of the controller may not be intuitive for the user and can often be difficult to use. For example, the controller may be difficult to use when the user of the controller is in a certain position, such as lying down or reclining. The controller may also be difficult to use in space-constrained environments, such as airplanes, crowded areas, etc.

[0029]

[0038] In many cases, the controller used with the XR device may also pose privacy concerns. For example, a person or computer with visibility to the user of the controller may analyze the user's movements and interactions with the controller to recognize the user's interactions with the content rendered by the XR device during the XR experience as well as related information, potentially compromising the privacy of the user's information. In some examples, an artificial intelligence (AI) interpreter or system may be used to process a record of the user's interactions and identify information provided by the user through the rendered XR interface. The AI ​​interpreter or system may recognize information provided by the user through the XR interface. Thus, when a user is participating in an XR experience using a controller associated with an XR device, the user may expose inputs and related information, such as user selections, personal identification numbers (PINs), gestures, etc., to other users. A user may want to protect the privacy of interactions with the XR interface rendered by the XR device even if the other users are not also participating in the same XR experience as the user or may not be able to see the XR interface.

[0030]

[0039] In some aspects, systems, apparatus, processes (also referred to as methods), and computer-readable media (collectively referred to herein as "systems and techniques") are described herein using a wearable device / accessory that interfaces / interacts with an electronic device (e.g., an XR device, a mobile device, a television, a smart wearable device, an electronic device with a user interface, or any other electronic device) to provide enhanced user interfaces, inputs, and / or XR experiences and functionality. In some examples, the wearable accessory can be used with an XR device to safely and intuitively provide XR inputs to interact with XR content. The wearable accessory can include one or more sensors to assist with tracking, gesture detection, and / or content interaction functions, among others.

[0031]

[0040] In some cases, the wearable accessory may be a ring or ring structure that can be worn on a user's finger or hand. The user may use the ring or ring structure during an XR experience to provide one or more types of input to the XR device providing the XR experience. The XR device may detect different input modes that may be translated (e.g., interpreted, mapped, etc.) into specific inputs and / or functions. For example, a user may wear a ring on a particular finger and rotate the ring about the longitudinal axis of the user's finger to scroll through content, manipulate rendered content, manipulate the XR environment, select content, generate measurements in the physical world, etc. As described herein, the longitudinal axis is generally parallel to a receiving space (e.g., lumen) of the wearable accessory that provides a longitudinal access opening for the finger and at least a portion of the finger on which the wearable accessory is worn. The lateral axis is perpendicular to the longitudinal axis, and the transverse axis extends perpendicular to both the longitudinal axis and the lateral axis. A longitudinal direction is a direction substantially parallel to the longitudinal axis, a lateral direction is a direction substantially parallel to the lateral axis, and a transverse direction is a direction substantially parallel to the transverse axis.

[0032]

[0041] Other exemplary ways in which a user may use the ring to provide input to an XR device may include tapping the ring with a finger other than the finger on which the ring is worn, squeezing the ring with one or more fingers adjacent to the finger on which the ring is worn, rotating or swiping the ring with a finger such as the thumb, rotating or swiping the ring with one or more fingers adjacent to the finger on which the ring is worn, and / or otherwise physically interacting with the ring. In some cases, a user may use the motion of the finger and / or hand on which the ring is worn to provide one or more types of input to the XR device based on tracked motion of the finger and / or hand. In some examples, the ring may include one or more sensors for detecting such motion and / or interaction with the ring. The ring may include a wireless interface for transmitting measurements corresponding to detected inputs to the XR device.

[0033]

[0042] In some cases, different input modes using the ring can correspond to and / or be translated (e.g., interpreted as) different types of XR input. For example, a user can rotate the ring about the longitudinal axis of the finger on which the ring is worn and / or rotate a rotatable portion of the ring relative to another portion of the ring about the longitudinal axis of the ring to scroll content, fast-forward or rewind a sequence of a video or any other content, move rendered content (e.g., rotate the content), navigate content, etc. As another example, a user can, among other things, tap or swipe the ring to perform selections, move the finger on which the ring is worn (and / or the hand on which the finger on which the ring is worn) to provide gestures to manipulate XR content and / or environment, define planes, create XR space and / or content, etc. In general, depending on the configuration of the ring (e.g., size, shape, etc.) and how the user uses the ring (e.g., worn on a finger, wrist, etc.), the user's interaction with the ring may be more unobtrusive, less noticeable, and / or otherwise more difficult to detect / notify than the user's interaction with a different controller device. Thus, the privacy and associated data of XR input provided via the ring on the user's finger may be better protected from people and other devices in the environment. Furthermore, the user may easily and conveniently provide input using the ring, even when the user is in an area with limited space, lying down, and / or in a position where it would otherwise be difficult to move the controller to generate input.

[0034]

[0043] In some cases, the ring can reduce power consumption and resource usage in the XR device. For example, the ring can offload certain operations, such as hand tracking and / or other tracking operations, from the XR device, allowing the XR device to reduce power consumption and resource usage, such as sensor, camera, and / or computational resource usage. In some examples, when tracking operations are offloaded from the XR device to the ring, the XR device can turn off or reduce its power mode of one or more tracking resources, such as cameras and / or other sensors, that the XR device would otherwise use to track the user's hands and / or other objects.

[0035]

[0044] The ring may include one or more sensors for tracking and detecting activities, such as, for example, motions, inputs, etc. For example, the ring may include a rotary encoder for tracking rotation and / or swiping of the ring (and / or portions thereof) for one or more types of inputs. An inertial measurement unit (IMU) in the ring may integrate multi-axis, accelerometer, gyroscope, and / or other sensors (e.g., magnetometer, etc.) to provide the XR device with an estimate of the hand's pose in physical space. One or more sensors in the ring, such as an ultrasonic transmitter / transducer and / or microphone, may be used for hand ranging. In some examples, one or more ultrasonic transmitters / transducers and / or microphones may help determine whether a user's hands are closer or farther apart from each other, whether any of the user's hands are closer to one or more other objects, etc. In some examples, a barometric pressure sensor in the ring may be used to determine relative altitude changes and interpret selection events. The ring may transmit measurements from one or more sensors to the XR device, which may translate the sensor measurements into user inputs. The ring can provide new user experience (UX) capabilities that allow easier and more intuitive actions by the user and enable different types of actions based on sensor input.

[0036]

[0045] In some examples, the ring can enable scrolling and other actions through one or more interactions with the ring. For example, in some cases, the ring can include an outer ring and an inner ring. The outer ring can spin around and / or relative to the inner ring. The ring can include a rotary encoder that detects the magnitude of the rotation. The ring can transmit the magnitude of the rotation to an XR device, which can convert the magnitude of the rotation into an input, such as a scroll amount. In some cases, the entire ring can spin around a user's finger (or a portion of the user's finger), and an IMU in the ring can detect the spinning motion to determine an input, such as a scroll amount. In some cases, the ring can include a touch sensor that provides touch sensing in one or more regions of the ring and / or across the surface of the ring to detect touch inputs, such as selections, scroll amounts, etc. In some examples, the touch sensor can be located on the outside of the ring, making the ring asymmetric. The touch area can be similar to a small touch pad and can be used with different fingers to provide input. For example, the touch area can be similar to a small touch pad that can be used with a thumb when the ring is on an index finder.

[0037]

[0046] The ring can include various power saving features. For example, in some cases, the ring can save power by shutting down after an XR application on the XR device is stopped and / or terminated. As another example, the ring can remain off or in a low power mode and turn on or switch to a high power mode based on one or more user interactions / inputs. For example, the ring can remain off or in a low power mode and turn on or switch to a high power mode when the ring is rotated a certain amount.

[0038]

[0047] The ring can provide privacy benefits, as described above, as well as other benefits. For example, with the ring, the user does not need to wave any hand or finger in the air to generate input (although they can). As another example, the ring can provide tracking functionality and conserve power on the XR device by allowing the XR device to turn off or power down resources on the XR device, such as cameras, tracking sensors, etc. In some cases, the ring can include a processor or chip that provides various functions and can interact with a processor and / or chip on the XR device.

[0039]

[0048] The technology will be described in the following disclosure as follows: The description begins with a description of an example system and technique for providing enhanced XR functionality / experiences using a ring device, as shown in Figures 1-5. This will then be followed by a description of an example process for using a ring device for XR functionality, as shown in Figure 6. The description concludes with a description of an example computing device architecture, including example hardware components suitable for performing XR and related operations, as shown in Figure 7. The disclosure now turns its attention to Figure 1.

[0040]

[0049] 1 is a diagram illustrating an example of an XR system 100 and a ring device 150 for XR experiences and functions, according to some examples of the present disclosure. The XR system 100 and the ring device 150 can be communicatively coupled to provide various XR functions. The XR system 100 and the ring device 150 can include separate devices used as described herein for XR experiences and functions. In some examples, the XR system 100 can implement one or more XR applications, such as, for example, but not limited to, a video game application, a robotic application, an autonomous driving or navigation application, a productivity application, and / or any other XR application.

[0041]

[0050] In some examples, the XR system 100 may include electronic devices configured to provide one or more functions, such as XR functions, gaming functions, autonomous driving or navigation functions, computer vision functions, robotic functions, etc., using information about the relative orientation of the XR system 100 and / or the ring device 150. For example, in some cases, the XR system 100 may be an XR device (e.g., a head-mounted display, a head-up display device, smart glasses, a smart television system, etc.) and the ring device 150 may generate inputs used to interact with the XR system 100 and / or content provided by the XR system 100.

[0042]

[0051] In one exemplary example shown in FIG. 1, the XR system 100 can include one or more image sensors, such as image sensor 102 and image sensor 104, other sensors 106, and one or more computational components 110. The other sensors 106 can include, for example, but not limited to, an inertial measurement unit (IMU), a gyroscope separate from the gyroscope in the IMU, an accelerometer separate from the accelerometer of the IMU, a magnetometer separate from the magnetometer of the IMU, a radar, a light detection and ranging (LIDAR) sensor, an audio sensor, a position sensor, a pressure sensor, and / or any other sensor. In some examples, the XR system 100 can include additional sensors and / or components, such as, for example, a light emitting diode (LED) device, a storage device, a cache, a communication interface, a display, a memory device, etc. An exemplary architecture and exemplary hardware components that can be implemented by the XR system 100 are further described below with respect to FIG. 7.

[0043]

[0052] Further, in one illustrative example shown in FIG. 1, ring device 150 includes an IMU 152, a position sensor 154 (e.g., a position / rotation encoder and / or any other type of position / rotation sensor), a pressure sensor 156 (e.g., an air pressure sensor and / or any other pressure sensor), and a touch sensor 158 (or tactile sensor). The sensor devices shown in FIG. 1 are non-limiting examples provided for illustrative purposes. In other examples, ring device 150 may include more or less sensors than those shown in FIG. 1. Further, in some cases, ring device 150 may include other types of sensors, such as, for example, audio sensors, light sensors, image sensors, etc.

[0044]

[0053] It should be noted that the components shown in FIG. 1 with respect to XR system 100 and ring device 150 are merely illustrative examples provided for purposes of explanation, and that in other examples, XR system 100 and / or ring device 150 may include more or less components than those shown in FIG.

[0045]

[0054] The XR system 100 may be part of or implemented by a single computing device or multiple computing devices. In some examples, the XR system 100 may be part of an electronic device or devices, such as a camera system (e.g., digital camera, IP camera, video camera, security camera, etc.), a telephone system (e.g., smartphone, cellular phone, conferencing system, etc.), a laptop or notebook computer, a tablet computer, a set-top box, a smart television, a display device, a game console, an XR device such as an HMD, a drone, an in-vehicle computer, an IoT (Internet of Things) device, a smart wearable device, or any other suitable electronic device or devices. In some implementations, the image sensor 102, the image sensor 104, one or more other sensors 106, and / or one or more computational components 110 may be part of the same computing device.

[0046]

[0055] For example, in some cases, image sensor 102, image sensor 104, one or more other sensors 106, and / or one or more computational components 110 may be integrated into a camera system, a smartphone, a laptop, a tablet computer, a smart wearable device, an XR device such as an HMD, an IoT device, a gaming system, and / or any other computing device. However, in other implementations, image sensor 102, image sensor 104, one or more other sensors 106, and / or one or more computational components 110 may be part of or implemented by two or more separate computing devices.

[0047]

[0056] The one or more computing components 110 of the XR system 100 may include, for example, but not limited to, a central processing unit (CPU) 112, a graphics processing unit (GPU) 114, a digital signal processor (DSP) 116, and / or an image signal processor (ISP) 118. In some examples, the XR system 100 may include other types of processors, such as, for example, a computer vision (CV) processor, a neural network processor (NNP), an application specific integrated circuit (ASIC), a field programmable gate array (FPGA), etc. The XR system 100 may use the one or more computing components 110 to perform various computing operations, such as, for example, extended reality operations (e.g., tracking, localization, pose estimation, mapping, content fixation, content rendering, etc.), image / video processing, graphics rendering, machine learning, data processing, modeling, calculations, and / or any other operations.

[0048]

[0057] In some cases, one or more of the computing components 110 may include other electronic circuitry or hardware, computer software, firmware, or any combination thereof for performing any of the various operations described herein. In some examples, one or more of the computing components 110 may include more or fewer computing components than those shown in Figure 1. Additionally, CPU 112, GPU 114, DSP 116, and ISP 118 are merely illustrative examples of computing components provided for purposes of explanation.

[0049]

[0058] Image sensor 102 and image sensor 104 may include any image and / or video sensor or capture device, such as a digital camera sensor, a video camera sensor, a smartphone camera sensor, an image / video capture device on an electronic device such as a television or computer, a camera, etc. In some cases, image sensor 102 and / or image sensor 104 may be part of a camera or computing device, such as a digital camera, a video camera, an IP camera, a smartphone, a smart television, a gaming system, etc. Additionally, in some cases, image sensor 102 and / or image sensor 104 may include multiple image sensors, such as rear and front sensor devices, and may be part of a dual camera or other multi-camera assembly (e.g., including two cameras, three cameras, four cameras, or other number of cameras).

[0050]

[0059] In some examples, image sensor 102 and / or image sensor 104 can capture image data, generate frames based on the image data, and / or provide image data or frames to one or more computing components 110 for processing. A frame can include a video frame of a video sequence or a still image. A frame can include a pixel array representing a scene. For example, a frame can be a Red-Green-Blue (RGB) frame with red, green, and blue color components per pixel, a Luminance, Red Difference, Blue Difference (YCbCr) frame with one Luminance component and two Chrominance (Color) components (Red Difference and Blue Difference) per pixel, or any other suitable type of color or monochrome image.

[0051]

[0060] In some examples, one or more of the computational components 110 can perform XR processing operations based on data from image sensor 102, image sensor 104, one or more other sensors 106, and / or ring device 150. For example, in some cases, one or more of the computational components 110 can perform tracking, localization, pose estimation, mapping, content fixation, content rendering, image processing, modeling, content generation, and / or other operations based on data from image sensor 102, image sensor 104, one or more other sensors 106, and / or ring device 150.

[0052]

[0061] In some examples, the one or more computing components 110 can implement one or more algorithms for tracking and estimating the relative pose of the ring device 150 and the XR system 100. In some cases, the one or more computing components 110 can receive image data captured by the image sensor 102 and / or the image sensor 104 and perform pose estimation based on the received image data to calculate the relative pose of the ring device 150 and the XR system 100. In some cases, the one or more computing components 110 can implement one or more computer vision models for calculating the relative pose of the ring device 150 and the XR system 100.

[0053]

[0062] In some cases, the one or more other sensors 106 can detect acceleration by the XR system 100 and generate acceleration measurements based on the detected acceleration. In some cases, the one or more other sensors 106 can additionally or alternatively detect and measure the orientation and angular velocity of the XR system 100. For example, the one or more other sensors 106 can measure the pitch, roll, and yaw of the XR system 100. In some examples, the XR system 100 can calculate a relative attitude of the XR system 100 using measurements obtained by the one or more other sensors 106.

[0054]

[0063] As further described herein, the ring device 150 can detect inputs to the XR system 100 using the IMU 152, the position sensor 154, the pressure sensor 156, and / or the touch sensor 158. The ring device 150 can detect one or more input modes, such as, for example, but not limited to, applying a force (e.g., tapping, squeezing, pressing, rubbing, swiping, touching, etc.) to one or more portions of the ring device 150, rotating and / or swiping one or more portions of the ring device 150, etc. The ring device 150 can provide the one or more detected inputs to the XR system 100 to modify the content, operation, and / or behavior of the XR system 100.

[0055]

[0064] In some cases, the ring device 150 can calculate the magnitude of the input and provide the magnitude of the input to the XR system 100 as part of the provided input. For example, the ring device 150 can calculate the magnitude of a force and / or rotation applied to the ring device 150 and provide the magnitude of the force and / or rotation as an input to the XR system 100. The XR system 100 can use the magnitude information to determine the type of input (e.g., single click, double click, selection, scrolling, gesture, object resize, control input, setting input, etc.) and / or the magnitude of the input (e.g., scrolling, object resize, amount of environment / object manipulation, etc.).

[0056]

[0065] In some examples, the ring device 150 and / or the XR system 100 can use measurements obtained by the IMU 152, the position sensor 154, and / or the pressure sensor 156 to calculate (and / or assist in calculating) the position and / or relative attitude of the ring device 150. In some cases, the IMU 152 can detect an orientation, a velocity (e.g., rotational velocity, linear velocity, etc.), and / or an acceleration (e.g., angular velocity / acceleration, linear acceleration, etc.) by the ring device 150 and generate an orientation, velocity, and / or acceleration measurement based on the detected orientation, velocity, and / or acceleration. For example, in some cases, a gyroscope of the IMU 152 can detect and measure a rotational velocity / acceleration by the ring device 150 (and / or a portion of the ring device 150). In some examples, the IMU 152 can additionally or alternatively detect and measure a linear velocity and / or acceleration by the ring device 150. In some examples, the IMU 152 can additionally or alternatively detect and measure an orientation of the ring device 150. In some cases, the IMU 152 may additionally or alternatively detect and measure the orientation and angular velocity of the ring device 150. For example, the IMU 152 may measure the pitch, roll, and yaw of the ring device 150.

[0057]

[0066] In some examples, the position sensor 154 can calculate the position of the ring device 150 with respect to rotational angles, linear motion, and three-dimensional (3D) space. For example, the position sensor 154 can detect the rotation and / or spin of the ring device 150. The pressure sensor 156 can detect pressure, such as air pressure, and can determine relative pressure changes. In some examples, measurements from the pressure sensor 156 can be used as inputs to interpret content selection events. The touch sensor 158 can measure physical forces or interactions with the ring device 150, which can be interpreted as inputs to the XR system 100, as further described herein.

[0058]

[0067] The ring device 150 may include one or more wireless communication interfaces (not shown) for communicating with the XR system 100. The one or more wireless communication interfaces may implement any wireless protocol and / or technology, such as, for example, a short-range wireless technology (e.g., Bluetooth®, etc.), for communicating with the XR system 100. The ring device 150 may use the one or more wireless communication interfaces to transmit sensor measurements and / or other XR inputs to the XR system 100, as further described herein.

[0059]

[0068] Although the XR system 100 and the ring device 150 are shown as including certain components, one skilled in the art will understand that the XR system 100 and the ring device 150 may include more or less components than those shown in Figure 1. For example, the XR system 100 and / or the ring device 150 may also optionally include one or more other memory devices (e.g., RAM, ROM, cache, etc.), one or more network interfaces (e.g., wired and / or wireless communication interfaces, etc.), one or more display devices, cache, storage devices, and / or other hardware or processing devices not shown in Figure 1. Illustrative examples of computing devices and hardware components that may be implemented with the XR system 100 and / or the ring device 150 are described below with respect to Figure 7.

[0060]

[0069] 2A illustrates an example of a ring device 150. A user can use the ring device 150 to interact with the XR system 100 and provide various types of XR input as further described herein. In some examples, the ring device 150 can collect sensor measurements to track a position and / or orientation of the ring device 150 in 3D space. In some examples, the position and / or orientation can be tracked relative to the position and / or orientation of the XR system 100 in 3D space.

[0061]

[0070] In this example, the ring device 150 includes a structure 200 (or body) having a receiving space 210 providing a longitudinal access opening disposed on the underside of the structure 200 to allow entry of at least a user's finger, a first surface 212 (or inner surface) that can provide an engagement surface for a finger inserted through the receiving space 210 to wear the ring device 150, and a second surface 214 (or outer surface). The structure 200 can also include one or more sensors and / or electronic components as described herein. In this example, the structure 200 includes a touchpad 204 for receiving touch input, a display 206 for displaying information from the ring device 150 and / or the XR system 100, and a sensor 208. In some examples, the sensor 208 can include and / or be the same as the IMU 152, the position sensor 154, the pressure sensor 156, and / or the touch sensor 158 shown in FIG. 1. In other examples, sensors 208 can include one or more sensors and / or devices not shown in Figure 1, such as one or more cameras, light sensors, audio sensors, lights, etc. In some cases, ring device 150 can include a touch-sensitive or pressure-sensitive surface and / or surface portion for measuring touch input.

[0062]

[0071] The receiving space 210 may be configured to receive a user's finger. For example, as described above, the receiving space 210 may include a longitudinal access opening disposed on an underside of the structure 200 to allow for entry of at least a user's finger. The first surface 212 may provide an engagement or retention surface for the user's finger. The first surface 212 may be contoured and / or shaped to support / retain the user's finger within the receiving space 210 and inhibit or prevent movement of the finger in longitudinal, lateral, and / or transverse axes / directions relative to the receiving space 210.

[0063]

[0072] The longitudinal axis is generally parallel to the receiving space 210 and to at least a portion of the finger wearing the ring device 150 (e.g., the finger held by the first surface 212 of the structure 200). The lateral axis is perpendicular to the longitudinal axis, and the transverse axis extends perpendicular to both the longitudinal and lateral axes. The longitudinal direction is a direction substantially parallel to the longitudinal axis, the lateral direction is a direction substantially parallel to the lateral axis, and the transverse direction is a direction substantially parallel to the transverse axis.

[0064]

[0073] The second surface 214 may include an exterior surface of the structure 200. The exterior surface may include a top or upper surface of the structure 200. In some examples, a user wearing the ring device 150 on a finger may interact with the second surface 214 (e.g., using a finger different from the finger wearing the ring device 150 and / or using any other object) to provide an input that is measured by sensors / components on the structure 200 (e.g., touchpad 204, display 206, sensor 208). For example, the user may apply a force to a portion of the second surface 214 to provide an input that is measured by sensors / components on the structure 200. In some examples, the user may touch, tap, squeeze, and / or apply pressure to the second surface 214 to provide an input (e.g., touch input, tap input, squeeze / pressure input, etc.) that may be detected and measured by the touchpad 204, display 206, and / or sensor 208. In some examples, a user may provide a spin or swipe force on second surface 214 to generate an input (e.g., a spin input, a swipe input, etc.) that can be detected and measured by touchpad 204, display 206, and / or sensor 208. In some cases, second surface 214 may include a touch-sensitive or pressure-sensitive surface and / or surface portion for measuring the touch input.

[0065]

[0074] In some cases, the receiving space 210 and / or the first surface 212 may be contoured and / or shaped to inhibit or prevent the structure 200 from rotating or spinning about the longitudinal axis of the user's finger and the receiving space 210 when the user applies a spin or swipe force to the second surface 214. The touchpad 204, the display 206, and / or the sensor 208 may detect and measure the spin or swipe force (e.g., direction, magnitude, etc.) even if the structure 200 does not move or rotate (or the movement or rotation of the structure 200 is substantially inhibited) in response to the spin or swipe force. In other cases, the receiving space 210 and / or the first surface 212 may be contoured and / or shaped to allow the structure 200 to at least partially rotate / spin about the longitudinal axis of the user's finger and the receiving space 210 when the user applies a spin or swipe force to the second surface 214. The touchpad 204, display 206, and / or sensor 208 can detect and measure the angular change, angular velocity, and / or angular acceleration of the structure 200 resulting from a spin or swipe force.

[0066]

[0075] In some examples, the ring device 150 can generate sensor measurements (e.g., via the touchpad 204 and / or the sensor 208) and provide the sensor measurements to an electronic device (e.g., the XR system 100, a mobile device, a television, a set-top box, any device with a user interface, and / or any other electronic device) as inputs to an application on the electronic device. The sensor measurements can include measured interactions with the structure 200 and / or the second surface 214 (e.g., applied force / pressure, etc.), attitude information about the structure 200, measured motion (e.g., rotation, velocity, acceleration, etc.), etc. The electronic device can interpret the sensor measurements as inputs to an application on the electronic device. In some examples, the ring device 150 can generate sensor measurements and convert (e.g., process, interpret, map, etc.) the sensor measurements into inputs for an application running on the electronic device (e.g., the XR system 100). Ring device 150 may convert sensor measurements into inputs for a particular application using one or more processing devices of ring device 150, such as application specific integrated circuits incorporated into structure 200. Ring device 150 may provide inputs to an electronic device for processing by a particular application on the electronic device.

[0067]

[0076] In some cases, the touchpad 204 and / or the sensor 208 can be used to generate a virtual spin and / or rotation input by using one or more fingers to provide a force, such as a spin or swipe force. In some examples, the touchpad 204 and / or the sensor 208 can be used to generate a virtual spin and / or rotation input by using one or more fingers to move the ring device 150 about the longitudinal axis of the receptive space 210. In some cases, the ring device 150 and / or a portion of the ring device 150 can rotate relative to the finger wearing the ring device 150 in response to a rotational force or gesture. In some examples, the sensor 208 can be used to provide a spin and / or rotation input based on a measured movement of the ring device 150 about the longitudinal axis of the receptive space 210 and relative to the finger wearing the ring device 150.

[0068]

[0077] In some examples, the ring device 150 can emit light using the display 206 and / or any light emitting device (not shown) for detection by a camera-equipped electronic device, such as the XR system 100. For example, the ring device 150 can emit light for detection by the electronic device. The electronic device can detect the light using one or more cameras and can use the light to determine a motion of the ring device 150, such as rotation. In some examples, the ring device 150 can emit light in response to a motion (e.g., rotation, etc.) above a threshold and / or a pre-set interaction with the ring device 150 (e.g., with the second surface 214).

[0069]

[0078] 2B illustrates another example of a ring device 150. In this example, the ring device 150 includes a structure 220 (or body) having a receiving space 210 providing a longitudinal access opening disposed on the underside of the structure 220 to allow entry of at least a user's finger, an engagement surface 222 that can engage a finger inserted through the receiving space 210 to wear the ring device 150, a top surface 224, and a contact surface 226. The structure 220 can also include one or more sensors and / or electronic components as described herein. In some examples, the sensor 208 can include and / or be the same as the IMU 152, the position sensor 154, the pressure sensor 156, and / or the touch sensor 158 shown in FIG. 1. In other examples, the sensor 208 can include one or more sensors and / or devices not shown in FIG. 1, such as one or more cameras, optical sensors, audio sensors, lights, etc.

[0070]

[0079] The receiving space 210 may be configured to receive a user's finger. For example, as previously described, the receiving space 210 may include a longitudinal access opening disposed on an underside of the structure 220 to allow for at least entry of a user's finger. The engagement surface 222 may provide a surface for engaging or retaining a user's finger. The engagement surface 222 may be contoured and / or shaped to support / retain a user's finger within the receiving space 210 and inhibit or prevent movement of the finger in longitudinal, lateral, and / or transverse axes / directions relative to the receiving space 210.

[0071]

[0080] The top surface 224 can include a top surface or partially an outer surface portion of the structure 220. The contact surface 226 can include another top surface or an outer surface portion of the structure 220. In some examples, the contact surface 226 (and / or a portion thereof) can be at least partially on top of and / or adjacent to the top surface 224. In some cases, the contact surface 226 can be rotatably coupled to a portion of the top surface 224. In some examples, the contact surface 226 can rotate about a longitudinal axis of the receiving space 210 and the top surface 224. For example, the contact surface 226 can rotate laterally from the longitudinal axis of the receiving space 210 relative to the top surface 224. The sensor 208 can measure the rotation (e.g., angular change, angular velocity, angular acceleration, etc.) and provide the measured rotation as an input to the electronic device or convert the measured rotation into an input to the electronic device. In some cases, contact surface 226 may include a touch-sensitive or pressure-sensitive surface and / or surface portion for measuring touch input.

[0072]

[0081] In some examples, a user wearing the ring device 150 on a finger can interact with the contact surface 226 (e.g., using a finger different from the finger wearing the ring device 150 and / or using any other object) to provide an input that is measured by the sensor 208 on the structure 220. For example, the user can apply a force to a portion of the contact surface 226 to provide an input that is measured by the sensor 208 on the structure 220. In some examples, the user can touch, tap, squeeze, and / or pressure the contact surface 226 to provide an input that can be detected and measured by the sensor 208 (e.g., touch input, tap input, squeeze / pressure input, etc.). In some examples, the user can provide a spin or swipe force on the contact surface 226 to generate an input that can be detected and measured by the sensor 208 (e.g., spin input, swipe input, etc.). In some examples, the user can rotate the contact surface 226 relative to the top surface 224 (and about the longitudinal axis of the receptive space 210) to generate a rotation-based input. Sensors 208 on structure 220 can measure one or more characteristics of the rotation (e.g., angular change, angular velocity, angular rotation, etc.), which can be used as inputs and / or to generate inputs.

[0073]

[0082] In some cases, the receiving space 210 and / or the engagement surface 222 may be contoured and / or shaped to inhibit or prevent the structure 220 from rotating or spinning about the longitudinal axis of the user's finger and the receiving space 210 when the user applies a spin or swipe force to the top surface 224. The sensor 208 may detect and measure the spin or swipe force (e.g., direction, magnitude, etc.) even if the structure 220 does not move or rotate (or the movement or rotation of the structure 220 is substantially inhibited) in response to the spin or swipe force. In other cases, the receiving space 210 and / or the engagement surface 222 may be contoured and / or shaped to allow the structure 220 and / or the contact surface 226 to at least partially rotate / spin about the longitudinal axis of the user's finger and the receiving space 210 when the user applies a spin or swipe force to the contact surface 226. The sensor 208 can detect and measure the angular change, angular velocity, and / or angular acceleration of the structure 220 and / or contact surface 226 resulting from a spin or swipe force.

[0074]

[0083] In some examples, the ring device 150 can generate sensor measurements (e.g., via the sensors 208) and provide the sensor measurements to an electronic device (e.g., the XR system 100, a mobile device, a television, a set-top box, any device with a user interface, and / or any other electronic device) as inputs to an application on the electronic device. The sensor measurements can include measured interactions with the structure 220 and / or the contact surface 226 (e.g., applied force / pressure, etc.), attitude information about the structure 220, measured motion (e.g., rotation, velocity, acceleration, etc.), etc. The electronic device can interpret the sensor measurements as inputs to an application on the electronic device. In some examples, the ring device 150 can generate sensor measurements and convert (e.g., process, interpret, map, etc.) the sensor measurements into inputs for an application running on the electronic device (e.g., the XR system 100). The ring device 150 can convert the sensor measurements into inputs for a particular application using one or more processing devices of the ring device 150, such as application specific integrated circuits embedded in the structure 220. The ring device 150 can provide input to the electronic device for processing by a particular application on the electronic device.

[0075]

[0084] In some cases, the sensor 208 can be used to generate a virtual spin and / or rotation input by providing a force, such as a spin or swipe force, using one or more fingers. In some examples, the sensor 208 can be used to generate a virtual spin and / or rotation input by using one or more fingers to move the ring device 150 or the contact surface 226 about the longitudinal axis of the receiving space 210. In some cases, the ring device 150 and / or the contact surface 226 can be rotated relative to the finger wearing the ring device 150 in response to a rotational force or gesture. In some examples, the sensor 208 can be used to provide a spin and / or rotation input based on a measured movement of the ring device 150 or the contact surface 226 about the longitudinal axis of the receiving space 210 and relative to the finger wearing the ring device 150.

[0076]

[0085] In some examples, the ring device 150 can emit light using a light emitting device (not shown) for detection by a camera-equipped electronic device, such as the XR system 100. For example, the ring device 150 can emit light for detection by the electronic device. The electronic device can detect the light using one or more cameras and can use the light to determine a motion of the ring device 150, such as rotation. In some examples, the ring device 150 can emit light in response to a motion (e.g., rotation, etc.) above a threshold and / or a pre-set interaction with the ring device 150 (e.g., with the contact surface 226).

[0077]

[0086] 2C shows an example of a ring device 150 worn on a finger 240 of a user interacting with the XR system 100. In this example, the ring device 150 is used to interact with the XR system 100 (e.g., to provide input, etc.). However, the XR system 100 is shown as a non-limiting example for illustrative purposes. In other examples, the ring device 150 may be used to interact with other electronic devices (e.g., mobile devices, televisions, smart wearable devices, any electronic device with a user interface, etc.).

[0078]

[0087] A user can interact with the XR system 100 using the ring device 150 to provide various types of XR input as further described herein. In some examples, the ring device 150 can collect sensor measurements to track a position and / or orientation of the ring device 150 in 3D space. In some examples, the position and / or orientation can be tracked relative to the position and / or orientation of the XR system 100 in 3D space.

[0079]

[0088] 2, the ring device 150 includes a touchpad 204 for receiving touch input, a display 206 for displaying information from the ring device 150 and / or the XR system 100, and a sensor 208. In some examples, the sensor 208 can include and / or be the same as the IMU 152, the position sensor 154, the pressure sensor 156, and / or the touch sensor 158 shown in FIG. 1. In other examples, the sensor 208 can include one or more sensors and / or devices not shown in FIG. 1, such as one or more cameras, light sensors, gyroscopes separate from the gyroscopes of the IMU, accelerometers separate from the accelerometers of the IMU, magnetometers separate from the magnetometers of the IMU, audio sensors, lights or light emitting devices, transmitters, ultrasonic transmitters / transducers, etc. In some cases, the ring device 150 can include a touch-sensitive or pressure-sensitive surface and / or surface portion for measuring touch input.

[0080]

[0089] In some cases, the touchpad 204 and / or the sensor 208 can be used to generate one or more measurements based on detected movements of the ring device 150, interactions with the ring device 150 (e.g., force / pressure / touch / rotation / etc.), detected attitudes of the ring device 150, etc. In some cases, the ring device 150 can send such measurements to the XR system 100 as inputs to the XR system 100 (e.g., inputs to an XR application on the XR system 100). In some cases, the ring device 150 can convert / interpret the one or more measurements into one or more inputs on a user interface and / or an XR application on the XR system 100 (e.g., via an ASIC or any other processing device) and send the one or more inputs to the XR system 100. In some cases, the touchpad 204 and / or the sensor 208 can be used to generate a virtual spin and / or rotation input by providing a force, such as a spin or swipe force, using one or more fingers. In some examples, the touch pad 204 and / or the sensor 208 can be used to generate a virtual spin and / or rotation input by using one or more fingers to move the ring device 150 about a longitudinal axis of the ring lumen (e.g., the receptive space 210) while the ring device 150 remains substantially fixed relative to the finger 240. In some cases, the ring device 150 and / or a portion of the ring device 150 can rotate relative to the finger 240 in response to a rotational force or gesture. In some examples, the sensor 208 can be used to provide a spin and / or rotation input by moving the ring device 150 about a longitudinal axis of the ring lumen relative to the finger 240.

[0081]

[0090] The XR system 100 can render content, interfaces, and / or controls to a user wearing the XR system 100. The user can use the ring device 150 to wirelessly interact with the content, interfaces, and / or controls to provide various types of input, such as selections, object / environment manipulation, navigational input (scrolling, motions, etc.), gestures, etc. Non-limiting examples of interactions with content, interfaces, and / or controls rendered by the XR system 100 using the ring device 150 can include item scrolling in a list and / or inventory of any type of options, text scrolling in objects and / or rendered content items (e.g., browsers, documents, interfaces, etc.), navigation to different locations and / or pages, data entry (e.g., text and / or numeric entry, etc.), object and / or environment manipulation (e.g., object and / or environment rotation, translation, positioning, and / or scaling), selection events, virtual space creation and / or manipulation, content scrolling, multimedia control (e.g., start, stop, pause, etc.), physical world measurement, tracking and / or location input and / or calibration, etc.

[0082]

[0091] Ring device 150 can provide privacy with respect to input, interaction, and / or associated data. For example, input can be provided via ring device 150 unobtrusively and / or hidden from the view of nearby devices and / or persons to avoid detection and / or recognition. Additionally, input can be provided via ring device 150 while in a space-constrained environment (e.g., a small space), while lying down, and / or while a user is otherwise unable (and / or has difficulty providing) input that requires additional and / or greater range of body (e.g., hand, arm, etc.) motion. For example, a user can provide input via ring device 150 without waving hand(s) and / or finger(s) in the air and / or away from the user's body. Additionally, in many cases, input provided via ring device 150 can be easier and / or more intuitive. For example, the input gestures can mimic the type of input provided to the XR system 100 (e.g., rotating the ring device 150 to scroll, tapping the ring device 150 to select, etc.). In some cases, the ring device 150 can conserve power on the XR system 100 by powering down or turning off (or providing information used to power down or turn off) tracking sensors on the XR system 100, such as image sensors.

[0083]

[0092] FIG. 3A illustrates an exemplary configuration 300 of the ring device 150. In this example, the ring device 150 includes an inner ring portion 310 (e.g., the upper surface 224 shown in FIG. 2B) and an outer ring portion 312 (e.g., the contact surface 226 shown in FIG. 2B). The inner ring portion 310 can receive / engage a user's finger 302, as shown in FIG. 3A. In some examples, the outer ring portion 312 (and / or a portion thereof) may be at least partially on top of and / or adjacent to the top of the inner ring portion 310. In some cases, the outer ring portion 312 (and / or a portion thereof) can encompass (and / or rotate) a greater distance along a lateral axis from the longitudinal axis of the lumen of the ring device 150 and at least a portion of the finger 302. In some examples, the inner ring portion 310 and the outer ring portion 312 can be asymmetric. In some cases, the outer ring portion 312 can be rotatably coupled to a portion of the upper surface 224. The outer ring portion 312 can spin / rotate relative to the inner ring portion 310 and about the longitudinal axis of the lumen of the ring device 150. The outer ring portion 312 can spin / rotate relative to the inner ring portion 310 in response to a force applied to the outer ring portion 312, such as a swipe force.

[0084]

[0093] In some examples, the outer ring portion 312 can rotate completely (e.g., 360 degrees) relative to the inner ring portion 310 and about the longitudinal axis of the lumen of the ring device 150. In other examples, the outer ring portion 312 can rotate partially (e.g., less than 360 degrees) relative to the inner ring portion 310 about the longitudinal axis of the lumen of the ring device 150. In some cases, the amount of rotation can depend on the amount (e.g., magnitude and / or continuity) of the rotational force / pressure applied to the outer ring portion 312. For example, a user can apply a larger amount of force / pressure to the outer ring portion 312 to increase the amount of rotation performed by the outer ring portion 312. As another example, a user can apply a smaller amount but a continuous force / pressure to the outer ring portion 312 to increase the amount of rotation. Similarly, a user can decrease the amount of rotation by decreasing the amount (e.g., magnitude and / or continuity) of the force / pressure applied to the outer ring portion 312.

[0085]

[0094] As the outer ring portion 312 rotates, a position sensor (e.g., position sensor 154) on the ring device 150 can determine relative motion between the inner ring portion 310 and the outer ring portion 312. The position sensor can determine the magnitude of rotation, the direction of rotation, and / or the speed of rotation. The ring device 150 can provide the rotation information to the XR system 100, which can convert (e.g., interpret) the rotation information into a particular XR input. In some cases, the XR input can correspond to detection of relative motion. In some cases, the XR input can be based on more granular motion information, such as the magnitude of rotation, the direction of rotation, and / or the speed of rotation, as described above. For example, different directions of rotation can be converted (e.g., interpreted) into different XR inputs or types of XR inputs. By way of example, rotation in one direction can be converted (interpreted as) scrolling in a particular direction, and rotation in a different direction can be converted into scrolling in a different direction. In some cases, rotation in one direction may be translated into (e.g., interpreted as) a type of XR input, such as scrolling, and rotation in another direction may be translated into a different type of XR input, such as a selection event, a different navigation event, etc.

[0086]

[0095] As another example, different rotation magnitudes (e.g., degrees) and / or velocities can be translated into different XR inputs and / or different types of XR inputs. To illustrate, rotations with a threshold magnitude and / or velocity can be translated into autoscroll or smooth scroll events, and rotations with a magnitude and / or velocity below the threshold can be translated (e.g., interpreted, mapped, etc.) into a particular magnitude of scroll. In some cases, rotations with a threshold magnitude and / or velocity can be translated into a particular type of XR input, such as scroll, and rotations with a magnitude and / or velocity below the threshold can be translated into a different type of XR input, such as a selection event.

[0087]

[0096] In some implementations, the XR system 100 can maintain definitions of rotation events and / or parameters that the XR system 100 can use to translate rotation events into XR inputs. For example, the XR system 100 can map one or more magnitudes, speeds, and / or directions of rotation to one or more XR inputs and / or types of XR inputs. The XR system 100 can use such mappings to translate rotation information received from the ring device 150 into a particular XR input. In some cases, the XR system 100 can map a particular magnitude and / or speed, or a particular range of magnitudes and / or speeds, to a particular XR input and / or type of XR input.

[0088]

[0097] In some examples, a user can rotate the outer ring portion 312 relative to the inner ring portion 310 using a finger. For example, referring to FIG. 3B, a user can rotate the outer ring portion 312 using a different finger 304 while the ring device 150 is worn on the finger 302. In the example shown in FIG. 3B, the different finger 304 is the thumb of the same hand as the finger 302 on which the ring device 150 is worn. However, a user can rotate the outer ring portion 312 with any finger or combination of fingers on the same or different hand as the finger 302 on which the ring device 150 is worn. In some cases, a user can rotate the outer ring portion 312 without using a different finger. For example, in some cases, a user can rotate the outer ring portion 312 by swiping the outer ring portion 312 on a surface (e.g., a leg, a sofa, a seat / chair, a table, a floor, etc.) or by pressing the ring device 150 onto the surface while moving the finger 302 along the surface. To illustrate, a user can press the ring device 150 against the user's leg and move the finger 302 a particular amount along the leg to rotate the outer ring portion 312 a particular amount.

[0089]

[0098] In some cases, the entire ring device 150 can be rotated about the longitudinal axis of the lumen of the ring device relative to the finger on which the ring device 150 is worn. For example, in some cases, the ring device 150 can be rotated relative to the finger and a position sensor can detect the rotation (and / or the magnitude, speed, and / or direction) of the ring device 150. The ring device 150 can also be configured to detect input based on one or more other types of motion, force, and / or interaction. FIGS. 4A-4D show example use cases for providing input using the ring device 150.

[0090]

[0099] FIG. 4A illustrates an exemplary use case 400 for providing input to the XR system 100 via the ring device 150. In this example, a user can tap the surface of the ring device 150 to provide input to the XR system 100. For example, a user can wear the ring device 150 on a finger 402 and tap the surface of the ring device 150 using a different finger 404. The different finger 404 in this example is the thumb of the same hand as the finger 402 on which the ring device 150 is worn. However, a user can tap the surface of the ring device 150 with any finger or combination of fingers on the same or different hand as the finger 402 on which the ring device 150 is worn. In some cases, a user can also tap the surface of the ring device 150 using a different object or surface such as a leg (e.g., by tapping the ring device 150 against a leg), a sofa, a seat / chair, a table, a floor, etc.

[0091]

[0100] A position sensor (e.g., position sensor 154) on ring device 150 can detect the tap and / or one or more characteristics of the tap, such as the strength or length of time of the tap. Ring device 150 can provide information about the tap to XR system 100, which can convert the tap information into XR input.

[0092]

[0101] In some cases, a tap (and / or a characteristic of the tap, such as strength or length of time) can be mapped to one or more XR inputs. For example, a tap, the strength of the tap, and / or the length of time of the tap can be mapped to an XR input event, an input function in a virtual user interface, or the like. In some cases, a different strength of the tap and / or a different length of time of the tap can be mapped to different XR inputs and / or XR input types. For example, a tap of a threshold magnitude can be mapped to an XR input, such as a double click, and a tap of a magnitude below the threshold can be mapped to a different XR input, such as a single click. As another example, a tap where the length of time of the force applied to the surface of the ring device 150 is below a threshold can be mapped to an XR input, and a longer tap where the length of time of the force applied to the surface of the ring device 150 exceeds a threshold can be mapped to a different XR input. In some cases, one or more patterns of taps can be translated into one or more XR inputs. For example, a particular sequence of taps can be mapped to one or more XR inputs, and a different sequence of taps can be mapped to one or more different XR inputs. 4B illustrates another exemplary use case 420 for providing input to the XR system 100 via the ring device 150. In this example, a user wears the ring device 150 on a finger 402 and provides input by squeezing the ring device 150 with an adjacent finger 406 and an adjacent finger 408. A touch sensor (e.g., touch sensor 158) on the ring device 150 can detect the squeeze and / or determine the magnitude and / or length of time of the squeeze. The ring device 150 can provide the squeeze information to the XR system 100, which can convert the squeeze information into XR input.

[0093]

[0102] In some examples, a compression, a magnitude of compression, and / or a length of time of compression can be mapped to one or more XR inputs. In some cases, different magnitudes of compression and / or different lengths of time can be mapped to different XR inputs and / or XR input types. For example, a long compression (e.g., above a threshold amount of time) can be mapped to a particular XR input, such as a double click, and a shorter compression (e.g., below a threshold amount of time) can be mapped to a different XR input, such as a single click. As another example, a stronger compression (e.g., above a threshold amount of force / pressure) can be mapped to a particular XR input, and a weaker compression (e.g., below a threshold amount of force / pressure) can be mapped to a different XR input.

[0094]

[0103] FIG. 4C illustrates an exemplary use case 440 in which the ring device 150 is rotated with respect to the finger 402 on which the ring device 150 is worn and about the longitudinal axis of the lumen (e.g., the receiving space 210) of the ring device 150. In this example, the ring device 150 does not include an outer ring portion and an inner ring portion as shown in FIG. 3A and FIG. 3B. The user can use a different finger 410 to rotate the entire ring device 150 around at least a portion of the finger 402 on which the ring device 150 is worn and about the longitudinal axis of the lumen of the ring device 150. In some examples, the user can rotate the ring device 150 about the longitudinal axis of the lumen laterally from the longitudinal axis of the lumen. The different finger 410 in this example is the thumb of the same hand as the finger 402 on which the ring device 150 is worn. However, the user may rotate the ring device 150 with any finger or combination of fingers on the same or different hand as the finger 402 on which the ring device 150 is worn.

[0095]

[0104] As different fingers 410 rotate ring device 150, position sensors on ring device 150 (e.g., position sensor 154) can determine the magnitude, speed, and / or direction of rotation of ring device 150 about the longitudinal axis of the lumen of ring device 150. Ring device 150 can provide such rotational information to XR system 100, which can convert the rotational information into specific XR inputs as previously described.

[0096]

[0105] FIG. 4D illustrates an exemplary use case 460 for rotating the ring device 150 using adjacent fingers. In this example, a user can rotate the ring device 150 with respect to the finger 402 on which the ring device 150 is worn and about the longitudinal axis of the lumen of the ring device 150 using adjacent fingers 406 and / or adjacent fingers 408. For example, a user can rotate the ring device 150 about the longitudinal axis of the lumen and laterally from the longitudinal axis. A user can rotate or swipe the ring device 150 in a particular direction using adjacent fingers 406 and / or adjacent fingers 408. A position sensor on the ring device 150 can detect the rotation and provide the rotation information to the XR system 100. The XR system 100 can convert the rotation information into one or more XR inputs. The XR system 100 can use one or more definitions that map XR inputs to rotation events, as described above.

[0097]

[0106] In some examples, the ring device 150, which may be shown in Figures 4A-4D, may be used to provide other inputs and / or data in addition to and / or instead of the XR inputs corresponding to the use cases 400, 420, 440, and 460 described above. For example, the ring device 150 may emit or flash light to provide specific information to the XR system 100. The XR system 100 may detect the light / flashing using one or more image sensors and use the light / flashing as an input and / or to supplement other inputs. In some examples, the XR system 100 may use the detected light / flashing to track / estimate the position and / or motion (e.g., rotation) of the ring device 150. In other examples, the XR system 100 may interpret and / or convert the detected light / blink into commands to perform certain actions such as adjusting the state of one or more components of the XR system 100 (e.g., power mode of one or more components (switch on, switch off, increase power mode, decrease power mode, etc.), processing performed by the XR system 100, etc.), triggering an action by the XR system 100 (e.g., rendering an object and / or interface, starting or stopping an action, pressing or activating a button on the XR system 100, etc.), processing input to a user interface in the XR system 100, and supplementing input based on an interaction with the ring device 150 (e.g., force / pressure, etc.).

[0098]

[0107] In other examples, the ring device 150 can detect audio, such as speech or voice input (e.g., via one or more audio sensors) and provide the audio to the XR system 100 and / or input instructions generated from the audio. The XR system 100 can use the audio from the ring device 150 to perform certain actions in the XR system 100, as described above. In some cases, the ring device 150 can be used to generate any other type of input to the XR system 100. For example, in some cases, the ring device 150 can be used to generate hand gestures (e.g., clenching a fist, flattening a palm, pointing fingers / hands, hand movements, hand signals, etc.). The hand gestures can be determined by one or more sensors on the XR system 100 and can be used to perform certain actions in the XR system 100, as described above. In some examples, the determination of the hand gestures can be aided by data from one or more sensors on the ring device 150, such as an IMU, a pressure sensor, etc.

[0099]

[0108] 5 illustrates an example of a user 502 providing XR inputs by moving and / or positioning a hand 506 and / or fingers 504 wearing a ring device 150. The user 502 can move the hand 506 and / or fingers 504 in any direction in 3D space to generate one or more XR inputs via the ring device 150. The movement and / or position of the hand 506 and / or fingers 504 can be translated into one or more XR inputs. In some cases, the movement of the hand 506 and / or fingers 504 can be translated into one or more XR inputs based on the direction of the movement, the magnitude of the movement, the speed of the movement, the pattern and / or sequence of the movement, the gesture associated with the movement, and / or any other characteristic of the movement.

[0100]

[0109] As previously described, the ring device 150 can implement sensors (e.g., IMU 152, position sensor 154, pressure sensor 156) that can measure characteristics of movement. For example, sensors on the ring device 150 can estimate the orientation of the fingers 504 and / or hand 506 in 3D space, the movement of the ring device 150, gestures associated with the fingers 504 and / or hand 506, the position of the fingers 504 and / or hand 506, etc. This information can be translated into one or more XR inputs. In some cases, this information can be translated into manipulation of a virtual environment, interface, and / or object(s) presented by the XR system 100.

[0101]

[0110] For example, in some cases, sensor information from the ring device 150 can be used to track the hand 506 of the user 502. The hand tracking can be used to detect hand gestures and trigger object manipulation events. The ring device 150 can provide the sensor information to the XR system 100, which can translate the sensor information into object manipulations such as moving an object, rotating an object, resizing an object, setting a plane associated with the object and / or the environment.

[0102]

[0111] As another example, a sensor in the ring device 150 can detect motion information (e.g., change in speed, acceleration, etc.) and provide the motion information to the XR system 100. The motion reflected in the motion information (e.g., change in speed, acceleration, etc.) can trigger a certain event. The XR system 100 can translate the motion information and implement the triggered event. To illustrate, if the user 502 moves the hand 506 with a speed and / or acceleration above a threshold, the movement of the hand 506 can be translated into an event, such as, for example, placing an object on a plane in the 3D space and / or virtual environment. As another example, a sensor in the ring device 150 can detect the orientation of the ring device 150 and provide the orientation information to the XR system 100 with or without other information, such as rotation information (e.g., rotation speed, rotation acceleration, rotation angle, etc.). The orientation reflected in the orientation information can trigger a certain event (e.g., with or without other information, such as rotation information). The XR system 100 can translate the orientation information (with or without other information, such as rotation information) and implement the trigger event.

[0103]

[0112] In some examples, the ring device 150 can use one or more sensors, such as an ultrasonic transmitter / transducer and / or a microphone, for ranging of the hand 506. The ranging of the hand 506 can be used to determine one or more XR inputs. For example, in some cases, the ranging information can be used to resize an object with a particular pinch gesture (e.g., one or more pinch gestures that are gestures that grab one or more edges of the object). In some cases, the ranging information (and / or other hand tracking information) associated with one or more ring devices can be used to implement a resize event based on a particular gesture. For example, instead of finding and pinching a corner of an object, the user 502 can perform a symbol gesture with the user's hand to "resize". In some examples, the symbol gesture can include one or more hand movements or gestures that mimic actions used to resize an object, mimic actions to define one or more boundaries / dimensions of an object, or match a pre-configured action or gesture for resizing an object. In some examples, the distance measurements between the ring devices on each hand can then be used to affect the resizing of that object.

[0104]

[0113] The ring device 150 may also be used to measure distances in an environment even when the ring device 150 is outside the field of view (FOV) of the XR system 100 or when the lighting level in the environment is too low for the XR system 100 to adequately detect the ring device 150. For example, the user 502 may put down the hand 506 with the ring device 150 to trigger the ring device 150 to measure one or more distances in the physical world in an XR application, such as an XR tape measure application. In some examples, the one or more distances to be measured may be defined by a movement of the hand 506 with the ring device 150. For example, the user 502 may move the hand 506 with the ring device 150 from a first position to a second position to define the distance to be measured and / or to initiate and end the distance measurement. In some cases, ring device 150 can use sensors such as one or more ultrasonic transmitters / transducers and / or microphones to determine whether the user's hands are closer or farther apart, whether any of the user's hands are proximate to one or more objects, etc.

[0105]

[0114] In some examples, the ring device can use a pressure sensor, such as an air pressure sensor, to determine relative changes in the position of the hand 506. The XR system 100 can interpret such changes and / or positions into XR inputs, such as selection events.

[0106]

[0115] In some cases, the ring device 150 can use one or more sensors to obtain hand tracking information, and the XR system 100 can use the hand tracking information to track the hand and / or estimate the hand position even if the hand is outside the FOV of the XR system 100 and / or the lighting is too dim for the image sensor in the XR system 100 to detect the hand. For example, if a user's hand moves from top to bottom while outside the FOV of the XR system 100, the XR system 100 can still obtain an estimate of such movement. In some cases, the XR system 100 can perform a synthetic animation that represents such movement even if such movement occurs outside the FOV of the XR system 100.

[0107]

[0116] In some examples, the XR system 100 can determine the XR input based on a combination of motion / position information from the ring device 150 and interactions with the ring device 150. For example, the ring device 150 can send sensor measurements of hand position and rotation (e.g., angle, rotation velocity, and / or rotation acceleration) of the ring device 150 to the XR system 100. The XR system 100 can use a combination of hand position and rotation (e.g., angle, rotation velocity, and / or rotation acceleration) of the ring device 150 to enable vertical and horizontal adjustment of virtual objects and / or environments. To illustrate, a user can generate a plane in space using a hand with the ring device 150. The user can then adjust the height and depth of that plane by a spin or scroll action of the ring device 150. The hand orientation (e.g., vertical and / or horizontal) reported by the ring device 150 can determine which component (e.g., height or depth) the user is modifying.

[0108]

[0117] As another example, a user can set up a virtual space, such as a virtual office, by "setting" a fixed plane based on the position of the hand measured based on sensor data from the ring device 150. The user can scroll through different content elements and place one or more content elements (e.g., a TV screen, a weather widget, a TV monitor, a game, etc.) on one or more fixed planes. The user can also use the ring device 150 to provide content scrolling and multimedia control (e.g., start, stop, pause, etc.). For example, if the user has a media application, such as a music application or a video application, the user can start, stop, pause, rewind, fast forward, and / or otherwise control content playback on the media application without moving the user's hand. The user can instead control the media application by interacting with the ring device 150, such as by applying pressure to the ring device 150, rotating the ring device 150, etc.

[0109]

[0118] FIG. 6 is a flow chart illustrating an example process 600 for using a ring device (e.g., ring device 150) to enhance user interface, input, and / or XR functionality. In block 602, the process 600 can include detecting, by the wearable device (e.g., ring device 150), movement of the wearable device and / or a force applied to a surface(s) of the wearable device. In some examples, the wearable device can include a structure defining a reception space or lumen (e.g., reception space 210) configured to receive a finger associated with a user. In some examples, the structure can include a first surface configured to contact a finger received through the reception space. In some examples, the reception space can include a longitudinal access opening for receiving the finger, and the first surface can be contoured or shaped to inhibit or prevent movement of the finger along a longitudinal, lateral, and / or transverse direction.

[0110]

[0119] At block 604, process 600 may include determining, by the wearable device, one or more measurements of a movement of the wearable device and / or a force applied to a surface(s) of the wearable device from one or more sensors on the wearable device. In some examples, the one or more sensors are integrated into a structure associated with the wearable device. In some examples, the one or more measurements may include a rotation of at least a portion of the wearable device about a longitudinal axis of a receptive space associated with the wearable device. In some cases, the one or more sensors may be configured to detect a rotation of at least a portion of the wearable device about a longitudinal axis of the receptive space. In some cases, the one or more measurements can include a first rotation measurement (e.g., angular change, angular / rotational velocity, angular / rotational acceleration, etc.) associated with a first rotation of the structure about a longitudinal axis of the receiving space of the wearable device, and / or a second rotation measurement (e.g., angular change, angular / rotational velocity, angular / rotational acceleration, etc.) associated with a second rotation of a portion of the structure about the longitudinal axis of the receiving space. The first rotation and the second rotation can be with respect to a finger in contact with the first surface of the wearable device.

[0111]

[0120] At block 606, the process 600 may include transmitting, by the wearable device, data associated with the one or more measurements via a wireless transmitter to an electronic device (e.g., the XR system 100). In some examples, the wearable device may transmit the one or more measurements of the movement to the electronic device. The one or more measurements may be representative of and / or correspond to an XR input at the electronic device.

[0112]

[0121] In some aspects, the process 600 can include transmitting, by the wearable device, an XR input associated with an XR application on the electronic device to the electronic device. In some examples, the XR input can be based on one or more measurements from one or more sensors. For example, the XR input can include a first rotational acceleration and / or a second rotational acceleration.

[0113]

[0122] In some examples, the one or more measures of motion include one or more rotational measures, the one or more rotational measures including at least one of a rotational angle, a rotational velocity, and / or a rotational acceleration.

[0114]

[0123] In some examples, the one or more sensors are configured to detect at least one of a touch signal corresponding to one or more fingers contacting the second surface of the structure, an orientation of the structure, and / or a position of the structure relative to one or more objects. In some cases, the data can include at least one of a magnitude of the touch signal, an orientation of the structure, a position of the structure relative to the one or more objects, and / or a distance between the structure and at least one of an electronic device directly or indirectly coupled to the wearable device and / or a hand distinct from the individual hand of the fingers.

[0115]

[0124] In some aspects, the one or more sensors may be configured to detect touch signals corresponding to one or more fingers touching different surfaces of the structure, an orientation of the structure, and / or a position of the structure relative to one or more objects. In some cases, the one or more measurements may include a magnitude of the touch signal, an orientation of the structure, a position of the structure relative to one or more objects, and / or a distance between the structure and a hand different from the individual hand of the electronic device and / or the finger. In some examples, the one or more measurements correspond to an additional orientation of the individual hand of the finger, and the XR input is based on at least one of the additional orientation of the individual hand and the rotation and / or orientation of the structure.

[0116]

[0125] In some examples, detecting the movement can include detecting a rotation of at least a portion of the structure about a longitudinal axis of the receiving space, and measuring at least one of a first rotation of a first portion of the structure (e.g., the top surface 224) about the longitudinal axis of the receiving space and a second rotation of a second portion of the structure (e.g., the contact surface 226) about the longitudinal axis of the receiving space. In some examples, the second rotation is in an opposite direction to the first rotation.

[0117]

[0126] In some aspects, the process 600 can include transmitting, by the wearable device, one or more additional measurements from the one or more sensors to the electronic device. In some cases, the one or more additional measurements correspond to an additional orientation of the individual hand of the fingers. In some examples, the XR input is based on at least one of the additional orientation of the individual hand and the first rotation, the second rotation, and / or the orientation of the structure.

[0118]

[0127] In some cases, the XR input can include scrolling virtual content rendered by the electronic device, scaling an object rendered by the electronic device, rotating an object rendered by the electronic device, moving an object rendered by the electronic device, defining a virtual plane in an environment rendered by the electronic device, and / or placing a virtual object rendered by the electronic device on one or more virtual planes in an environment rendered by the electronic device. In some cases, the XR input can be based on touch signals corresponding to one or more fingers contacting the second surface of the structure (e.g., second surface 214, contact surface 226), an orientation of the structure, a rotation of the wearable device, a hand movement associated with the fingers, and / or a position of the structure relative to one or more objects.

[0119]

[0128] In some examples, the XR input can be based on one or more characteristics associated with one or more measurements. In some cases, the one or more characteristics can include a magnitude of rotation of the wearable device, a direction of rotation, a speed of rotation, and / or a length of time of pressure applied to one or more portions of the structure. The one or more characteristics can be identified by the one or more measurements.

[0120]

[0129] In some cases, the XR input can be based on one or more characteristics associated with the touch signal. The one or more characteristics can include a magnitude of pressure from one or more fingers contacting the second surface of the structure, a motion associated with the one or more fingers while contacting the second surface of the structure, a direction of the motion, a length of contact time between the one or more fingers and the second surface, and / or a pattern of contact by the one or more fingers on the second surface of the structure. The one or more characteristics can be identified by one or more measurements. In some examples, the pattern of contact can include a sequence of contacts by the one or more fingers on the second surface.

[0121]

[0130] In some cases, the XR input can include modifying a virtual element along multiple dimensions in space. In some examples, the virtual element can include a virtual object rendered by the electronic device, a virtual plane in an environment rendered by the electronic device, and / or an environment rendered by the electronic device. In some examples, the adjustment of a first dimension of the multiple dimensions is defined by at least one of an angular change, a rotational velocity, and / or a rotational acceleration associated with a rotation of the wearable device. In some examples, the adjustment of a second dimension of the multiple dimensions is defined by one or more distinct measurements in the one or more measurements. In some cases, the one or more distinct measurements in the one or more measurements can include touch signals corresponding to one or more fingers contacting a second surface of the structure, an orientation of the structure, and / or a position of the structure relative to the one or more objects.

[0122]

[0131] In some cases, the one or more measurements may include a motion measurement corresponding to a movement of a hand associated with a finger. In some examples, the XR input may correspond to a request to measure a distance in physical space. The distance may be defined by the movement of the hand. For example, the distance may be defined by a first position of the hand before or during the hand movement and a second position of the hand after or during the hand movement.

[0123]

[0132] In some cases, the wearable device can reduce power consumption and resource usage in the electronic device. For example, the wearable device can offload certain operations, such as hand tracking and / or other tracking operations, from the electronic device, allowing the electronic device to reduce power consumption and resource usage, such as sensor, camera, and / or computational resource usage. In some examples, when tracking operations are offloaded from the electronic device to the wearable device, the electronic device can turn off or reduce its power mode of one or more tracking resources, such as cameras and / or other sensors, that the electronic device would otherwise use to track a user's hands and / or other objects.

[0124]

[0133] In some examples, the wearable device may include various power saving features. For example, in some cases, the wearable device may conserve power by shutting down after an XR application on the electronic device is stopped and / or terminated. As another example, the wearable device may remain off or in a low power mode and turn on or switch to a high power mode based on one or more user interactions / inputs. For example, the wearable device may remain off or in a low power mode and turn on or switch to a high power mode when the wearable device is rotated a certain amount.

[0125]

[0134] In some cases, the wearable device may include a wearable ring. In some cases, the one or more sensors may include a position sensor, an accelerometer, a gyroscope, a magnetometer, a pressure sensor, an audio sensor, a touch sensor, and / or an inertial measurement unit.

[0126]

[0135] In some examples, the process 600 may be performed by one or more computing devices or apparatuses. In one illustrative example, the process 600 may be performed by one or more computing devices having the XR system 100 and / or ring device 150 shown in FIG. 1 and / or the computing device architecture 700 shown in FIG. 7. In some cases, such a computing device or apparatus may include a processor, microprocessor, microcomputer, or other components of a device configured to perform the steps of the process 600. In some examples, such a computing device or apparatus may include one or more sensors configured to capture image data and / or other sensor measurements. For example, the computing device may include a smartphone, a head-mounted display, a mobile device, or other suitable device. In some examples, such a computing device or apparatus may include a camera configured to capture one or more images or videos. In some cases, such a computing device may include a display for displaying the images. In some examples, the one or more sensors and / or the camera are separate from the computing device, in which case the computing device receives the sensed data. Such a computing device may further include a network interface configured to communicate data.

[0127]

[0136] The components of a computing device may be implemented in a circuit configuration. For example, the components may include and / or be implemented using electronic circuitry or other electronic hardware, which may include one or more programmable electronic circuits (e.g., a microprocessor, a graphics processing unit (GPU), a digital signal processor (DSP), a central processing unit (CPU), and / or other suitable electronic circuitry), and / or may include and / or be implemented using computer software, firmware, or any combination thereof to perform various operations described herein. The computing device may further include a display (as an example of an output device or in addition to an output device), a network interface configured to communicate and / or receive data, any combination thereof, and / or other components. The network interface may be configured to communicate and / or receive Internet Protocol (IP)-based data or other types of data.

[0128]

[0137] Process 600 is illustrated as a logical flow diagram, whose operations represent sequences of operations that may be implemented in hardware, computer instructions, or a combination thereof. In the context of computer instructions, the operations represent computer-executable instructions stored on one or more computer-readable storage media that, when executed by one or more processors, perform the described operations. Generally, computer-executable instructions include routines, programs, objects, components, data structures, etc. that perform particular functions or implement particular data types. The order in which the operations are described is not intended to be construed as a limitation, and any number of the described operations may be combined in any order and / or in parallel to implement a process.

[0129]

[0138] Additionally, process 600 may be executed under the control of one or more computer systems configured with executable instructions and may be implemented as code (e.g., executable instructions, one or more computer programs, or one or more applications) that collectively execute on one or more processors, by hardware, or a combination thereof. As mentioned above, the code may be stored on a computer-readable or machine-readable storage medium, for example, in the form of a computer program comprising a number of instructions executable by one or more processors. The computer-readable or machine-readable storage medium may be non-transitory.

[0130]

[0139] 7 illustrates an exemplary computing device architecture 700 of an exemplary computing device that may implement various techniques described herein. For example, the computing device architecture 700 may implement at least some portions of the XR system 100 illustrated in FIG. 1. The components of the computing device architecture 700 are shown in electrical communication with each other using a connection 705, such as a bus. The exemplary computing device architecture 700 includes a processing unit (CPU or processor) 710 and a computing device connection 705 that couples various computing device components to the processor 710, including a computing device memory 715, such as a read only memory (ROM) 720 and a random access memory (RAM) 725.

[0131]

[0140] The computing device architecture 700 may include a cache of high-speed memory that is directly connected to the processor 710, near the processor 710, or integrated as part of the processor 710. The computing device architecture 700 may copy data from the memory 715 and / or the storage device 730 to the cache 712 for faster access by the processor 710. In this manner, the cache may provide a performance boost that avoids delays to the processor 710 while waiting for data. These and other modules may control or be configured to control the processor 710 to perform various actions. Other computing device memories 715 may also be available. The memory 715 may include multiple different types of memory with different performance characteristics. The processor 710 may include any general-purpose processor and hardware or software services stored in the storage device 730 that are configured to control the processor 710 and special-purpose processors with software instructions built into the processor design. The processor 710 may be a self-contained system that includes multiple cores or processors, buses, memory controllers, caches, etc. Multi-core processors may be symmetric or asymmetric.

[0132]

[0141] To enable user interaction with the computing device architecture 700, the input device 745 can represent any number of input mechanisms, such as a microphone for speech, a touch-sensitive screen for gesture or graphical input, a keyboard, a mouse, motion input, speech, etc. The output device 775 can also be one or more of several output mechanisms known to those skilled in the art, such as a display, projector, television, speaker device, etc. In some cases, a multimodal computing device may enable a user to provide multiple types of input to communicate with the computing device architecture 700. The communication interface 740 can generally govern and manage user input and computing device output. There is no constraint to operate on any particular hardware configuration, and therefore the basic functions herein may be easily substituted with improved hardware or firmware configurations as they are developed.

[0133]

[0142] The storage device 730 is a non-volatile memory and may be a hard disk or other type of computer readable medium capable of storing data accessible by a computer, such as a magnetic cassette, a flash memory card, a solid state memory device, a digital versatile disk, a cartridge, a random access memory (RAM) 725, a read only memory (ROM) 720, and hybrids thereof. The storage device 730 may include software, code, firmware, etc. for controlling the processor 710. Other hardware or software modules are contemplated. The storage device 730 may be connected to the computing device connection 705. In one aspect, a hardware module that performs a particular function may include software components stored in a computer readable medium that connects with the necessary hardware components, such as the processor 710, the connection 705, the output device 775, etc., to perform the function.

[0134]

[0143] The term "computer-readable medium" includes, but is not limited to, portable or non-portable storage devices, optical storage devices, and various other media that can store, store, or transport instructions and / or data. Computer-readable media may include non-transitory media on which data is stored and does not include carrier waves and / or transitory electronic signals propagating over wireless or wired connections. Examples of non-transitory media may include, but are not limited to, magnetic disks or tapes, optical storage media such as compact disks (CDs) or digital versatile disks (DVDs), flash memory, memory, or memory devices. Computer-readable media may have code and / or machine-executable instructions stored on the computer-readable medium, which may represent a procedure, a function, a subprogram, a program, a routine, a subroutine, a module, a software package, a class, or any combination of instructions, data structures, or program statements. A code segment may be coupled to another code segment or a hardware circuit by passing and / or receiving information, data, arguments, parameters, or memory contents. Information, arguments, parameters, data, etc. may be passed, forwarded, or transmitted via any suitable means including memory sharing, message passing, token passing, network transmission, etc.

[0135]

[0144] In some embodiments, computer readable storage devices, media, and memories may include cables or wireless signals containing bit streams, etc. However, when mentioned, non-transitory computer readable storage media specifically excludes media such as energy, carrier signals, electromagnetic waves, and the signals themselves.

[0136]

[0145] Specific details are provided in the above description to provide a thorough understanding of the embodiments and examples provided herein. However, it will be understood by those skilled in the art that the embodiments may be practiced without these specific details. For clarity of explanation, in some cases, the present technology may be presented as including individual functional blocks comprising devices, device components, and steps or routines in a method embodied in software or a combination of hardware and software. Additional components may be used other than the components shown in the figures and / or described herein. For example, circuits, systems, networks, processes, and other components may be shown as components in block diagram form so as not to obscure the embodiments in unnecessary detail. In other cases, well-known circuits, processes, algorithms, structures, and techniques may be shown without unnecessary detail so as to avoid obscuring the embodiments.

[0137]

[0146] Individual embodiments may be described above as a process or method that is depicted as a flowchart, a flow diagram, a data flow diagram, a structure diagram, or a block diagram. Although the flowcharts may describe operations as a sequential process, many of the operations may be performed in parallel or simultaneously. In addition, the order of steps may be rearranged. A process terminates when its operations are completed, but may have additional steps not included in the diagram. A process may correspond to a method, a function, a procedure, a subroutine, a subprogram, etc. When a process corresponds to a function, its termination may correspond to a return of the function to the calling function or to the main function.

[0138]

[0147] The processes and methods according to the examples described above may be implemented using computer executable instructions stored or otherwise available from a computer readable medium. Such instructions may include, for example, instructions and data that cause a general purpose computer, a special purpose computer, or a processing device to perform a particular function or group of functions, or otherwise configure a general purpose computer, a special purpose computer, or a processing device to perform a particular function or group of functions. Portions of the computer resources used may be accessible over a network. The computer executable instructions may be, for example, binary, intermediate format instructions such as assembly language, firmware, source code, etc. Examples of computer readable media that may be used to store instructions, information used, and / or information created during the methods according to the described examples include magnetic or optical disks, flash memory, USB devices provided with non-volatile memory, networked storage devices, etc.

[0139]

[0148] Devices implementing the processes and methods according to these disclosures may include hardware, software, firmware, middleware, microcode, hardware description languages, or any combination thereof, and may take any of a variety of form factors. When implemented in software, firmware, middleware, or microcode, the program code or code segments (e.g., computer program product) to perform the necessary tasks may be stored in a computer-readable or machine-readable medium. A processor may perform the necessary tasks. Typical examples of form factors include laptops, smartphones, mobile phones, tablet devices or other small form factor personal computers, personal digital assistants, rack-mounted devices, standalone devices, and the like. The functionality described herein may also be embodied in a peripheral device or an add-in card. Such functionality may also be implemented on a circuit board among different chips, or on different processes executing in a single device, as further examples.

[0140]

[0149] The instructions, media for carrying such instructions, computing resources for executing such instructions, and other structures for supporting such computing resources are exemplary means for providing the functionality described in this disclosure.

[0141]

[0150] In the above description, aspects of the present application are described with reference to specific embodiments thereof, but those skilled in the art will recognize that the present application is not limited thereto. Thus, while exemplary embodiments of the present application have been described in detail herein, it should be understood that the inventive concepts may be embodied and employed in various other ways, and that the appended claims are intended to be construed to include such variations, except as limited by the prior art. The various features and aspects of the present application described above may be used individually or jointly. Moreover, the embodiments may be utilized in any number of environments and applications other than those described herein without departing from the broader spirit and scope of the present specification. Thus, the present specification and drawings should be regarded as illustrative and not restrictive. For purposes of illustration, the methods have been described in a particular order. It should be understood that in alternative embodiments, the methods may be performed in an order different from that described.

[0142]

[0151] Those skilled in the art will understand that the less than ("<") and greater than (">") symbols or terminology used herein may be replaced with the less than or equal to ("≦") and greater than or equal to ("≧") symbols, respectively, without departing from the scope of the present specification.

[0143]

[0152] When a component is described as being "configured to" perform a particular operation, such configuration may be achieved, for example, by designing electronic circuitry or other hardware to perform the operation, by programming a programmable electronic circuitry (e.g., a microprocessor or other suitable electronic circuitry) to perform the operation, or any combination thereof.

[0144]

[0153] The phrase "coupled to" refers to any component that is physically connected, either directly or indirectly, to another component and / or that is in communication, either directly or indirectly, with another component (e.g., connected to the other component via a wired or wireless connection and / or other suitable communication interface).

[0145]

[0154] Claim language or other language in this disclosure reciting "at least one of" a set and / or "one or more" of a set indicates that one member of the set or multiple members of the set (in any combination) satisfy the claim. For example, claim language reciting "at least one of A and B" or "at least one of A or B" means A, B, or A and B. In another example, claim language reciting "at least one of A, B, and C" or "at least one of A, B, or C" means A, B, C, or A and B, or A and C, or B and C, or A and B and C. The language "at least one of" a set and / or "one or more" of a set does not limit the set to the items listed in the set. For example, claim language reciting "at least one of A and B" or "at least one of A or B" can mean A, B, or A and B, and can additionally include unrecited items in the set of A and B.

[0146]

[0155] The various exemplary logic blocks, modules, circuits, and algorithm steps described with respect to the examples disclosed herein may be implemented as electronic hardware, computer software, firmware, or a combination thereof. To clearly illustrate this interchangeability of hardware and software, various exemplary components, blocks, modules, circuits, and steps have been described above generally in terms of their functionality. Whether such functionality is implemented as hardware or software depends on the particular application and design constraints imposed on the overall system. Those skilled in the art may implement the described functionality in varying ways for each particular application, and such implementation decisions should not be interpreted as causing a departure from the scope of the present application.

[0147]

[0156] The techniques described herein may also be implemented in electronic hardware, computer software, firmware, or any combination thereof. Such techniques may be implemented in any of a variety of devices, such as a general purpose computer, a wireless communication device handset, or an integrated circuit device having multiple uses, including applications in wireless communication device handsets and other devices. Any features described as modules or components may be implemented together in an integrated logic device, or separately as discrete but interoperable logic devices. If implemented in software, the techniques may be realized at least in part by a computer-readable data storage medium including program code including instructions that, when executed, perform one or more of the methods, algorithms, and / or operations described above. The computer-readable data storage medium may form part of a computer program product, which may include packaging materials. The computer-readable medium may comprise a memory or data storage medium, such as random access memory (RAM), such as synchronous dynamic random access memory (SDRAM), read-only memory (ROM), non-volatile random access memory (NVRAM), electrically erasable programmable read-only memory (EEPROM®), FLASH® memory, magnetic or optical data storage medium, etc. The techniques may additionally or alternatively be realized at least in part by a computer-readable communications medium, such as a propagated signal or wave, that carries or communicates program code in the form of instructions or data structures and that can be accessed, read, and / or executed by a computer.

[0148]

[0157] The program code may be executed by a processor, which may include one or more processors, such as one or more digital signal processors (DSPs), general-purpose microprocessors, application specific integrated circuits (ASICs), field programmable logic arrays (FPGAs), or other equivalent integrated or discrete logic circuitry. Such a processor may be configured to perform any of the techniques described in this disclosure. A general-purpose processor may be a microprocessor, but alternatively, the processor may be any conventional processor, controller, microcontroller, or state machine. A processor may also be implemented as a combination of computing devices, such as a combination of a DSP and a microprocessor, multiple microprocessors, one or more microprocessors in conjunction with a DSP core, or any other such configuration. Thus, the term "processor" as used herein may refer to any of the above structures, any combination of the above structures, or any other structure or apparatus suitable for implementing the techniques described herein.

[0149]

[0158] Illustrative examples of the present disclosure include the following:

[0159] Aspect 1. A wearable device comprising: a structure defining a reception space configured to receive a finger associated with a user, the structure including a first surface configured to contact the finger received through the reception space; one or more sensors integrated into the structure, the one or more sensors configured to detect rotation of at least a portion of the structure about a longitudinal axis of the reception space; and a wireless transmitter configured to transmit data based on the detected rotation to an electronic device.

[0150]

[0160] Aspect 2. The wearable device of aspect 1, wherein the data includes an XR input associated with an extended reality application at the electronic device, and to transmit the data, the wearable device is configured to transmit the XR input to the electronic device via the wireless transmitter.

[0151]

[0161]

[0023] Aspect 3. The wearable device of aspect 1 or 2, wherein the data includes one or more rotational measurements, the one or more rotational measurements including at least one of a rotational angle, a rotational velocity, and a rotational acceleration.

[0152]

[0162] Aspect 4. The wearable device of Aspect 2, wherein the one or more sensors are configured to detect at least one of a touch signal corresponding to one or more fingers contacting a second surface of the structure, an orientation of the structure, and a position of the structure relative to one or more objects, and the data includes at least one of a magnitude of the touch signal, an orientation of the structure, a position of the structure relative to the one or more objects, and a distance between the structure and at least one of an electronic device directly or indirectly coupled to the wearable device and a hand different from the individual hand of the fingers.

[0153]

[0163] Aspect 5. The wearable device of aspect 2 or 4, wherein the wearable device is configured to transmit one or more measurements from the one or more sensors to the electronic device via a wireless transmitter, the one or more measurements corresponding to an additional orientation of the individual hand of the fingers, and the XR input is based on at least one of the additional orientation of the individual hand and a rotation and orientation of the structure.

[0154]

[0164] Aspect 6. The wearable device of any of Aspects 1-5, wherein to detect a rotation of at least a portion of the structure about the longitudinal axis of the receiving space, the one or more sensors are configured to measure at least one of a first rotation of a first portion of the structure about the longitudinal axis of the receiving space and a second rotation of a second portion of the structure about the longitudinal axis of the receiving space.

[0155]

[0165]

[0023] Example 7. The wearable device of example 6, wherein the second rotation is in an opposite direction to the first rotation.

[0156]

[0166] Aspect 8. The wearable device of any of aspects 1-7, wherein the data corresponds to an XR input to an XR application at the electronic device, and the XR input includes at least one of scrolling virtual content rendered by the electronic device, scaling an object rendered by the electronic device, rotating an object rendered by the electronic device, moving an object rendered by the electronic device, defining a virtual plane in an environment rendered by the electronic device, and placing a virtual object rendered by the electronic device in one or more virtual planes in an environment rendered by the electronic device.

[0157]

[0167] Example 9. The wearable device of any of Examples 1-8, wherein the data corresponds to an XR input to an XR application at the electronic device, the data including one or more measurements from the one or more sensors, the one or more measurements including at least one of a touch signal corresponding to one or more fingers contacting a second surface of the structure, an orientation of the structure, a rotation, a hand movement associated with the fingers, and a position of the structure relative to the one or more objects.

[0158]

[0168]

[0023] Aspect 10. The wearable device of aspect 8 or 9, wherein the XR input is based on one or more characteristics associated with one or more measurements in the data, the one or more characteristics including at least one of a magnitude of rotation, a direction of rotation, a speed of rotation, and a length of time of pressure applied to one or more portions of the structure, the one or more characteristics being identified by the one or more measurements.

[0159]

[0169]

[0023] Aspect 11. The wearable device of any of aspects 8-10, wherein the XR input is based on one or more characteristics associated with the touch signal, the one or more characteristics including at least one of a magnitude of pressure from one or more fingers contacting the second surface of the structure, a motion associated with the one or more fingers while contacting the second surface of the structure, a direction of the motion, a length of contact time between the one or more fingers and the second surface, and a contact pattern by the one or more fingers on the second surface of the structure, wherein the one or more characteristics are identified by one or more measurements.

[0160]

[0170] Aspect 12. The wearable device of any of aspects 1-11, wherein the XR input includes modifying a virtual element along a plurality of dimensions in space, the virtual element including at least one of a virtual object rendered by the electronic device, a virtual plane in an environment rendered by the electronic device, and an environment rendered by the electronic device.

[0161]

[0171] Aspect 13. The wearable device of aspect 12, wherein the adjustment of a first dimension of the plurality of dimensions is defined by at least one of an angular change associated with the rotation, a rotational velocity, and a rotational acceleration, and the adjustment of a second dimension of the plurality of dimensions is defined by one or more measurements, the one or more measurements including at least one of a touch signal corresponding to one or more fingers contacting a second surface of the structure, an orientation of the structure, and a position of the structure relative to the one or more objects.

[0162]

[0172] Example 14. A wearable device as described in any of examples 8 to 13, wherein the one or more measurements include a motion measurement corresponding to a hand movement associated with a finger, and the XR input corresponds to a request to measure a distance in physical space, the distance being defined by the hand movement.

[0163]

[0173] Aspect 15. The wearable device according to any one of aspects 1 to 14, wherein the wearable device includes a wearable ring.

[0164]

[0174]

[0023] Aspect 16. The wearable device of any of aspects 1-15, wherein the wearable device includes a wearable ring including an outer ring and an inner ring, the inner ring defining a receptive space, and the one or more sensors configured to detect at least one of an angular change, a rotational velocity, and a rotational acceleration of the outer ring about a longitudinal axis of the receptive space.

[0165]

[0175] Aspect 17. The wearable device of any of aspects 1-16, wherein the wearable device is configured to turn on from an off state or switch from a low power mode to a high power mode when at least a portion of the structure is rotated a particular amount.

[0166]

[0176] Embodiment 18. The wearable device of any of embodiments 1-17, wherein the electronic device comprises a mobile device.

[0167]

[0177] Aspect 19. The wearable device of aspect 18, wherein the mobile device comprises one of a head mounted display, a mobile phone, a portable computer, or a smart watch.

[0168]

[0178] Aspect 20. A wearable device as described in any of aspects 1-19, wherein the one or more sensors include at least one of a position sensor, an accelerometer, a gyroscope, a pressure sensor, an audio sensor, a touch sensor, and a magnetometer.

[0169]

[0179] Aspect 21. A method comprising: detecting a rotation of at least a portion of a wearable device, the wearable device comprising a structure defining a reception space, the reception space configured to receive a finger associated with a user, the structure including a first surface configured to contact the finger received through the reception space, about a longitudinal axis of a reception space associated with the wearable device via one or more sensors on the wearable device; and transmitting data based on the detected rotation to an electronic device via a wireless transmitter of the wearable device.

[0170]

[0180]

[0023] Aspect 22. The method of aspect 21, wherein the data includes an XR input associated with an extended reality application at the electronic device, and to transmit the data, the wearable device is configured to transmit the XR input to the electronic device via the wireless transmitter.

[0171]

[0181]

[0023] Aspect 23. The method of aspect 21 or 22, wherein the data includes one or more rotational measurements, the one or more rotational measurements including at least one of a rotational angle, a rotational velocity, and a rotational acceleration.

[0172]

[0182] Example 24. The method of any of Examples 21-23, wherein the one or more sensors are configured to detect at least one of a touch signal corresponding to one or more fingers contacting a second surface of the structure, an orientation of the structure, and a position of the structure relative to the one or more objects, and the data includes at least one of a magnitude of the touch signal, an orientation of the structure, a position of the structure relative to the one or more objects, and a distance between the structure and at least one of an electronic device directly or indirectly coupled to the wearable device and a hand that is different from the individual hand of the fingers.

[0173]

[0183] Example 25. The method of any of examples 22-24, further comprising transmitting one or more measurements from the one or more sensors to an electronic device via a wireless transmitter, wherein the one or more measurements correspond to an additional orientation of an individual hand of the fingers, and the XR input is based on at least one of the additional orientation of the individual hand and a rotation and orientation of the structure.

[0174]

[0184]

[0023] Embodiment 26. The method of any of embodiments 21-25, wherein detecting a rotation of at least a portion of the structure about the longitudinal axis of the receiving space further comprises measuring at least one of a first rotation of a first portion of the structure about the longitudinal axis of the receiving space and a second rotation of a second portion of the structure about the longitudinal axis of the receiving space.

[0175]

[0185] Embodiment 27. The method of embodiment 26, wherein the second rotation is in an opposite direction to the first rotation.

[0176]

[0186] Aspect 28. The method of any of aspects 21-27, wherein the data corresponds to an XR input to an XR application at the electronic device, and the XR input includes at least one of scrolling virtual content rendered by the electronic device, scaling an object rendered by the electronic device, rotating an object rendered by the electronic device, moving an object rendered by the electronic device, defining a virtual plane in an environment rendered by the electronic device, and placing a virtual object rendered by the electronic device on one or more virtual planes in an environment rendered by the electronic device.

[0177]

[0187]

[0023] Example 29. The method of any of examples 21-28, wherein the data corresponds to an XR input to an XR application at the electronic device, the data includes one or more measurements from one or more sensors, the one or more measurements including at least one of a touch signal corresponding to one or more fingers contacting a second surface of the structure, an orientation of the structure, a rotation, a hand movement associated with the fingers, and a position of the structure relative to the one or more objects.

[0178]

[0188]

[0031] Aspect 30. The method of aspect 28 or 29, wherein the XR input is based on one or more characteristics associated with one or more measurements in the data, the one or more characteristics including at least one of a magnitude of rotation, a direction of rotation, a speed of rotation, and a length of time of pressure applied to one or more portions of the structure, the one or more characteristics being identified by the one or more measurements.

[0179]

[0189]

[0023] Aspect 31. The method of any of aspects 28-30, wherein the XR input is based on one or more characteristics associated with the touch signal, the one or more characteristics including at least one of a magnitude of pressure from one or more fingers contacting the second surface of the structure, a motion associated with the one or more fingers while contacting the second surface of the structure, a direction of the motion, a length of contact time between the one or more fingers and the second surface, and a contact pattern by the one or more fingers on the second surface of the structure, wherein the one or more characteristics are identified by one or more measurements.

[0180]

[0190] Aspect 32. The method of any of aspects 28-31, wherein the XR input includes modifying a virtual element along multiple dimensions in space, the virtual element including at least one of a virtual object rendered by the electronic device, a virtual plane in an environment rendered by the electronic device, and an environment rendered by the electronic device.

[0181]

[0191] Aspect 33. The method of aspect 32, wherein the adjustment of a first dimension of the plurality of dimensions is defined by at least one of an angular change associated with the rotation, a rotational velocity, and a rotational acceleration, and the adjustment of a second dimension of the plurality of dimensions is defined by one or more measurements, the one or more measurements including at least one of a touch signal corresponding to one or more fingers contacting a second surface of the structure, an orientation of the structure, and a position of the structure relative to the one or more objects.

[0182]

[0192]

[0036] Example 34. The method of any of examples 28-33, wherein the one or more measurements include a motion measurement corresponding to a hand movement associated with a finger, and the XR input corresponds to a request to measure a distance in physical space, the distance being defined by the hand movement.

[0183]

[0193]

[0023] Embodiment 35. The method of any of embodiments 21-34, wherein the wearable device comprises a wearable ring.

[0184]

[0194]

[0023] Aspect 36. The method of any of aspects 21-35, wherein the wearable device includes a wearable ring including an outer ring and an inner ring, the inner ring defining a receiving space, and the one or more sensors configured to detect at least one of an angular change, a rotational velocity, and a rotational acceleration of the outer ring about a longitudinal axis of the receiving space.

[0185]

[0195]

[0037] Example 37. The method of any of Examples 21-36, further comprising adjusting a state of the wearable device when at least a portion of the structure is rotated a particular amount, wherein adjusting the state comprises turning on one or more components of the electronic device from an off state or switching one or more components from a low power mode to a high power mode.

[0186]

[0196]

[0023] Embodiment 38. The method of any of embodiments 21-37, wherein the electronic device comprises a mobile device.

[0187]

[0197] Aspect 39. The method of aspect 38, wherein the mobile device comprises one of a head mounted display, a mobile phone, a portable computer, or a smart watch.

[0188]

[0198]

[0036] Example 40. The method of any of examples 21-39, wherein the one or more sensors include at least one of a position sensor, an accelerometer, a gyroscope, a pressure sensor, a sound sensor, a touch sensor, and a magnetometer.

[0189]

[0199] Aspect 41. A non-transitory computer-readable medium having instructions stored thereon that, when executed by one or more processing devices, cause the one or more processing devices to perform a method according to any of aspects 21-40.

[0190]

[0200] Example 42. A wearable device comprising means for performing the method according to any of examples 21 to 40.

[0191]

[0201] Aspect 43. An apparatus comprising: a memory; and one or more processors coupled to the memory, wherein the one or more processors are configured to receive data from a wearable device corresponding to a rotation of at least a portion of the wearable device comprising a structure defining a receptive space about a longitudinal axis of a receptive space associated with the wearable device, determine an input based on the data, the input including at least one of a user interface input associated with a user interface on the device and an extended reality (XR) input associated with an XR application on the device, and control at least one of an operation of the user interface and the XR application based on the input.

[0192]

[0202]

[0046] Example 44. The apparatus of example 43, wherein the receiving space is configured to receive a finger associated with a user, and the structure includes a surface configured to contact the received finger via the receiving space.

[0193]

[0203]

[0036] Example 45. The apparatus of example 43 or 44, wherein the wearable device comprises a ring.

[0194]

[0204]

[0036] Embodiment 46. The apparatus of any of embodiments 43-45, wherein the data includes one or more rotational measurements, the one or more rotational measurements including at least one of a rotational angle, a rotational velocity, and a rotational acceleration.

[0195]

[0205]

[0036] Aspect 47. The device of any of aspects 43-46, wherein the data corresponds to a touch signal associated with one or more fingers in contact with a surface of the wearable device, an orientation of the wearable device, and a position of the wearable device relative to one or more objects, the data including at least one of a magnitude of the touch signal, an orientation of the wearable device, a position of the wearable device relative to the one or more objects, and a distance between the wearable device and at least one of a hand that is different from the individual hand of the device and the fingers.

[0196]

[0206]

[0036] Aspect 48. The apparatus of aspect 47, wherein the data includes one or more measurements from one or more sensors on the wearable device, the one or more measurements corresponding to an additional orientation of the individual hand of the fingers, and the XR input is based on at least one of the additional orientation of the individual hand and a rotation and orientation of the structure.

[0197]

[0207]

[0036] Example 49. The apparatus of any of Examples 43-48, wherein the rotation of at least a portion of the wearable device includes at least one of a first rotation of a first portion of the wearable device about a longitudinal axis of the receiving space, and a second rotation of a second portion of the wearable device about a longitudinal axis of the receiving space.

[0198]

[0208] Embodiment 50. The apparatus of embodiment 49, wherein the second rotation is in an opposite direction to the first rotation.

[0199]

[0209]

[0023] Aspect 51. The device of any of aspects 43-50, wherein the XR input includes at least one of: scrolling virtual content rendered by the device, scaling objects rendered by the device, rotating objects rendered by the device, moving objects rendered by the device, defining a virtual plane in an environment rendered by the device, and placing virtual objects rendered by the device on one or more virtual planes in the environment rendered by the device.

[0200]

[0210] Aspect 52. The device of any of aspects 43-51, wherein to control at least one of the operation of a user interface and an XR application, the one or more processors are configured to scroll virtual content rendered by the device, scale objects rendered by the device, rotate objects rendered by the device, move objects rendered by the device, define a virtual plane in an environment rendered by the device, and / or position virtual objects rendered by the device on one or more virtual planes in the environment rendered by the device.

[0201]

[0211]

[0023] Example 53. The apparatus of any of examples 43-52, wherein the data includes one or more measurements from the one or more sensors, the one or more measurements including at least one of a touch signal corresponding to one or more fingers contacting a surface of the wearable device, an orientation of the wearable device, a rotation, a hand movement associated with the fingers, and a position of the wearable device relative to the one or more objects.

[0202]

[0212]

[0023] Embodiment 54. The apparatus of any of embodiments 43-53, wherein the XR input is based on one or more characteristics associated with one or more measurements in the data, the one or more characteristics including at least one of a magnitude of rotation, a direction of rotation, a speed of rotation, and a length of time of pressure applied to one or more portions of the wearable device, the one or more characteristics being identified by the one or more measurements.

[0203]

[0213]

[0023] Aspect 55. The apparatus of any of aspects 43-54, wherein the XR input is based on one or more characteristics associated with the touch signal, the one or more characteristics including at least one of a magnitude of pressure from one or more fingers contacting a surface of the wearable device, a motion associated with the one or more fingers while contacting the surface of the wearable device, a direction of the motion, a length of time of contact between the one or more fingers and the surface, and a contact pattern of the one or more fingers on the surface of the wearable device, wherein the one or more characteristics are identified by one or more measurements.

[0204]

[0214] Aspect 56. A device described in any of aspects 43 to 55, wherein the one or more processors are configured to modify virtual elements along multiple dimensions in space based on the XR input, the virtual elements including at least one of a virtual object rendered by the device, a virtual plane in an environment rendered by the device, and an environment rendered by the device.

[0205]

[0215]

[0023] Aspect 57. The apparatus of aspect 56, wherein the adjustment of a first dimension of the plurality of dimensions is defined by at least one of an angular change associated with the rotation, a rotational velocity, and a rotational acceleration, and the adjustment of a second dimension of the plurality of dimensions is defined by one or more measurements, the one or more measurements including at least one of a touch signal corresponding to one or more fingers contacting a second surface of the wearable device, an orientation of the wearable device, and a position of the wearable device relative to one or more objects.

[0206]

[0216]

[0023] Example 58. The apparatus of any of examples 43-57, wherein the data includes motion measurements corresponding to hand movements associated with the fingers, and the XR input corresponds to a request to measure a distance in physical space, the distance being defined by the hand movements.

[0207]

[0217]

[0046] Aspect 59. The apparatus of aspect 58, wherein the one or more processors are configured to measure distance in physical space based on XR input.

[0208]

[0218]

[0023] Example 60. The apparatus of any of examples 43-59, wherein the wearable device includes a wearable ring including one or more sensors, an outer ring, and an inner ring, the inner ring defining a receptive space, and the one or more sensors configured to detect at least one of an angular change, a rotational velocity, and a rotational acceleration of the outer ring about a longitudinal axis of the receptive space.

[0209]

[0219] Example 61. The apparatus of any of examples 43-60, wherein the one or more processors are configured to turn on one or more components of the apparatus from an off state or switch one or more components from a low power mode to a high power mode based on the data.

[0210]

[0220] Embodiment 62. The apparatus of any of embodiments 43-61, wherein the apparatus comprises a mobile device.

[0211]

[0221] Aspect 63. The apparatus of aspect 62, wherein the mobile device comprises one of a head mounted display, a mobile phone, a portable computer, or a smart watch.

[0212]

[0222] Aspect 64. A method including receiving, by an electronic device, data from a wearable device corresponding to a rotation of at least a portion of the wearable device, the wearable device comprising a structure defining a receptive space, about a longitudinal axis of a receptive space associated with the wearable device, determining an input based on the data, the input including at least one of a user interface input associated with a user interface at the electronic device and an extended reality (XR) input associated with an XR application at the electronic device, and controlling at least one of an operation of the user interface and the XR application based on the input.

[0213]

[0223]

[0023] Aspect 65. The method of aspect 64, wherein the receiving space is configured to receive a finger associated with the user, and the structure includes a surface configured to contact the received finger through the receiving space.

[0214]

[0224]

[0023] Example 66. The method of example 64 or 65, wherein the wearable device comprises a ring.

[0215]

[0225]

[0023] Embodiment 67. The method of any of embodiments 64-66, wherein the data includes one or more rotational measurements, the one or more rotational measurements including at least one of a rotational angle, a rotational velocity, and a rotational acceleration.

[0216]

[0226]

[0023] Aspect 68. The method of any of aspects 64-67, wherein the data corresponds to a touch signal associated with one or more fingers in contact with a surface of the wearable device, an orientation of the wearable device, and a position of the wearable device relative to one or more objects, and the data includes at least one of a magnitude of the touch signal, an orientation of the wearable device, a position of the wearable device relative to the one or more objects, and a distance between the wearable device and at least one of a hand that is different from the individual hand of the electronic device and the fingers.

[0217]

[0227] Aspect 69. The method of aspect 68, wherein the data includes one or more measurements from one or more sensors on the wearable device, the one or more measurements corresponding to an additional orientation of the individual hand of the fingers, and the XR input is based on at least one of the additional orientation of the individual hand and a rotation and orientation of the structure.

[0218]

[0228]

[0036] Example 70. The method of any of Examples 64-69, wherein the rotation of at least a portion of the wearable device includes at least one of a first rotation of a first portion of the wearable device about a longitudinal axis of the receiving space, and a second rotation of a second portion of the wearable device about a longitudinal axis of the receiving space.

[0219]

[0229] Embodiment 71. The method of embodiment 70, wherein the second rotation is in an opposite direction to the first rotation.

[0220]

[0230] Aspect 72. The method of any of aspects 64-71, wherein the XR input includes at least one of scrolling virtual content rendered by the electronic device, scaling an object rendered by the electronic device, rotating an object rendered by the electronic device, moving an object rendered by the electronic device, defining a virtual plane in an environment rendered by the electronic device, and placing a virtual object rendered by the electronic device on one or more virtual planes in the environment rendered by the electronic device.

[0221]

[0231] Aspect 73. The method of any of aspects 64-72, wherein controlling at least one of the operation of the user interface and the XR application includes scrolling virtual content rendered by the electronic device, scaling objects rendered by the electronic device, rotating objects rendered by the electronic device, moving objects rendered by the electronic device, defining a virtual plane in an environment rendered by the electronic device, and / or placing virtual objects rendered by the electronic device in one or more virtual planes in the environment rendered by the electronic device.

[0222]

[0232]

[0023] Example 74. The method of any of examples 64-73, wherein the data includes one or more measurements from one or more sensors, the one or more measurements including at least one of a touch signal corresponding to one or more fingers touching a surface of the wearable device, an orientation of the wearable device, a rotation, a hand movement associated with the fingers, and a position of the wearable device relative to one or more objects.

[0223]

[0233]

[0023] Embodiment 75. The method of any of embodiments 64-74, wherein the XR input is based on one or more characteristics associated with one or more measurements in the data, the one or more characteristics including at least one of a magnitude of rotation, a direction of rotation, a speed of rotation, and a length of time of pressure applied to one or more portions of the wearable device, the one or more characteristics being identified by the one or more measurements.

[0224]

[0234]

[0023] Aspect 76. The method of any of aspects 64-75, wherein the XR input is based on one or more characteristics associated with the touch signal, the one or more characteristics including at least one of a magnitude of pressure from one or more fingers contacting a surface of the wearable device, a motion associated with the one or more fingers while contacting the surface of the wearable device, a direction of the motion, a length of time of contact between the one or more fingers and the surface, and a contact pattern of the one or more fingers on the surface of the wearable device, wherein the one or more characteristics are identified by one or more measurements.

[0225]

[0235]

[0023] Aspect 77. The method of any of aspects 64-76, further comprising modifying virtual elements along multiple dimensions in space based on the XR input, the virtual elements comprising at least one of a virtual object rendered by the electronic device, a virtual plane in an environment rendered by the electronic device, and an environment rendered by the electronic device.

[0226]

[0236] Aspect 78. The method of aspect 77, wherein the adjustment of a first dimension of the plurality of dimensions is defined by at least one of an angular change associated with the rotation, a rotational velocity, and a rotational acceleration, and the adjustment of a second dimension of the plurality of dimensions is defined by one or more measurements, the one or more measurements including at least one of a touch signal corresponding to one or more fingers contacting a second surface of the wearable device, an orientation of the wearable device, and a position of the wearable device relative to one or more objects.

[0227]

[0237]

[0023] Example 79. The method of any of examples 64-78, wherein the data includes motion measurements corresponding to hand movements associated with the fingers, and the XR input corresponds to a request to measure a distance in physical space, the distance being defined by the hand movements.

[0228]

[0238]

[0023] Aspect 80. The method of aspect 79, further comprising measuring a distance in a physical space based on the XR input.

[0229]

[0239]

[0023] Example 81. The method of any of examples 64-80, wherein the wearable device includes a wearable ring including one or more sensors, an outer ring, and an inner ring, the inner ring defining a receptive space, and the one or more sensors configured to detect at least one of an angular change, a rotational velocity, and a rotational acceleration of the outer ring about a longitudinal axis of the receptive space.

[0230]

[0240]

[0036] Example 82. The method of any of examples 64-81, further comprising turning on one or more components of the electronic device from an off state or switching one or more components from a low power mode to a high power mode based on the data.

[0231]

[0241]

[0036] Embodiment 83. The method of any of embodiments 64-82, wherein the electronic device comprises a mobile device.

[0232]

[0242]

[0023] Aspect 84. The method of aspect 83, wherein the mobile device comprises one of a head mounted display, a mobile phone, a portable computer, or a smart watch.

[0233]

[0243] Embodiment 85. An apparatus comprising means for carrying out the method according to any of embodiments 64 to 84.

[0234]

[0244] Aspect 86. A non-transitory computer-readable medium having instructions stored thereon that, when executed by one or more processors, cause the one or more processors to perform a method according to any of aspects 64-84.

Claims

1. A wearable device for communicating with an extended reality (XR) system, comprising: a structure defining a receiving space configured to receive a finger associated with a user, the structure including a first surface configured to contact the finger received through the receiving space; one or more sensors integrated into the structure, the one or more sensors being configured to detect a rotation of at least a portion of the structure about a longitudinal axis of the receiving space; a wireless transmitter configured to transmit data based on the detected rotation to the XR system; Equipped with the data comprises an XR input associated with an XR application in the XR system; To transmit the data, the wearable device is configured to transmit the XR input to the XR system via the wireless transmitter; The wearable device, wherein the data comprises one or more rotational measurements, the one or more rotational measurements comprising at least one of a rotational angle, a rotational velocity, and a rotational acceleration.

2. the one or more sensors are configured to detect at least one of a touch signal corresponding to one or more fingers contacting a second surface of the structure, an orientation of the structure, and a position of the structure relative to one or more objects, and the data comprises at least one of a magnitude of the touch signal, the orientation of the structure, the position of the structure relative to the one or more objects, and a distance between the structure and at least one of the XR system directly or indirectly coupled to the wearable device and a hand different from the individual hand of the fingers; Optionally, the wearable device further comprises:

2. The wearable device of claim 1, configured to transmit one or more measurements from the one or more sensors to the XR system via the wireless transmitter, the one or more measurements corresponding to an additional orientation of the individual hand of the fingers, and the XR input based on at least one of the additional orientation of the individual hand and the rotation and the orientation of the structure.

3. To detect the rotation of at least a portion of the structure about the longitudinal axis of the receiving space, the one or more sensors are configured to measure at least one of a first rotation of a first portion of the structure about the longitudinal axis of the receiving space and a second rotation of a second portion of the structure about the longitudinal axis of the receiving space; The wearable device of claim 1 , optionally wherein the second rotation is in an opposite direction to the first rotation.

4. 2. The wearable device of claim 1, wherein the data corresponds to an XR input to an XR application in the XR system, the XR input comprising at least one of: scrolling virtual content rendered by the XR system, scaling an object rendered by the XR system, rotating the object rendered by the XR system, moving the object rendered by the XR system, defining a virtual plane in an environment rendered by the XR system, and placing a virtual object rendered by the XR system on one or more virtual planes in the environment rendered by the XR system.

5. 2. The wearable device of claim 1, wherein the data corresponds to an XR input to an XR application in the XR system, the data comprising one or more measurements from the one or more sensors, the one or more measurements comprising at least one of a touch signal corresponding to one or more fingers contacting a second surface of the structure, an orientation of the structure, the rotation, a hand movement associated with the fingers, and a position of the structure relative to one or more objects.

6. 6. The wearable device of claim 5, wherein the XR input is based on one or more characteristics associated with the one or more measurements in the data, the one or more characteristics comprising at least one of a magnitude of the rotation, a direction of the rotation, a speed of the rotation, and a length of time of pressure applied to one or more portions of the structure, the one or more characteristics being identified by the one or more measurements.

7. 6. The wearable device of claim 5, wherein the XR input is based on one or more characteristics associated with the touch signal, the one or more characteristics comprising at least one of a magnitude of pressure from the one or more fingers contacting the second surface of the structure, a motion associated with the one or more fingers when contacting the second surface of the structure, a direction of the motion, a length of contact time between the one or more fingers and the second surface, and a contact pattern by the one or more fingers on the second surface of the structure, the one or more characteristics being identified by the one or more measurements.

8. the XR input comprises modifying a virtual element along a plurality of dimensions in space, the virtual element comprising at least one of a virtual object rendered by the XR system, a virtual plane in an environment rendered by the XR system, and the environment rendered by the XR system; Optionally, an adjustment in a first dimension of the plurality of dimensions is defined by at least one of an angular change, a rotational velocity, and a rotational acceleration associated with the rotation, and an adjustment in a second dimension of the plurality of dimensions is defined by the one or more measurements, the one or more measurements comprising at least one of a touch signal corresponding to one or more fingers contacting a second surface of the structure, an orientation of the structure, and a position of the structure relative to one or more objects. The wearable device of claim 5 .

9. 6. The wearable device of claim 5, wherein the one or more measurements comprise a motion measurement corresponding to the movement of the hand associated with the finger, and the XR input corresponds to a request to measure a distance in physical space, the distance being defined by the movement of the hand.

10. the wearable device comprises a wearable ring; 2. The wearable device of claim 1, optionally wherein the wearable ring comprises an outer ring and an inner ring, the inner ring defining the receiving space, and the one or more sensors are configured to detect at least one of an angular change, a rotational velocity, and a rotational acceleration of the outer ring about the longitudinal axis of the receiving space.

11. The wearable device of claim 1 , wherein the wearable device is configured to turn on from an off state or switch from a low power mode to a high power mode when the at least a portion of the structure is rotated a particular amount.

12. the XR system comprises a mobile device; 10. The wearable device of claim 1, wherein the mobile device comprises one of a head mounted display, a mobile phone, a portable computer, or a smart watch.

13. 10. The wearable device of claim 1, wherein the one or more sensors comprise at least one of a position sensor, an accelerometer, a gyroscope, a pressure sensor, an audio sensor, a touch sensor, and a magnetometer.

14. A method for communicating with an extended reality (XR) system, comprising: a wearable device comprising a structure defining a reception space configured to receive a finger associated with a user, the structure comprising a first surface configured to contact the finger received through the reception space; detecting a rotation of at least a portion of a wearable device about a longitudinal axis of the reception space associated with the wearable device via one or more sensors on the wearable device; transmitting data based on the detected rotation to the XR system via a wireless transmitter of the wearable device; Equipped with the data comprises an XR input associated with an XR application in the XR system; To transmit the data, the wearable device is configured to transmit the XR input to the XR system via the wireless transmitter; The method, wherein the data comprises one or more rotational measurements, the one or more rotational measurements comprising at least one of a rotational angle, a rotational velocity, and a rotational acceleration.

15. A non-transitory computer-readable medium having instructions stored thereon, the instructions, when executed by one or more processing devices for communicating with an extended reality (XR) system, causing the one or more processing devices to: A wearable device comprising a structure defining a reception space configured to receive a finger associated with a user, the structure comprising a first surface configured to contact the finger received through the reception space, and detecting, via one or more sensors on the wearable device, a rotation of at least a portion of the wearable device about a longitudinal axis of the reception space associated with the wearable device; transmitting data based on the detected rotation to the XR system via a wireless transmitter of the wearable device; the data comprises an XR input associated with an XR application in the XR system; To transmit the data, the wearable device is configured to transmit the XR input to the XR system via the wireless transmitter; the data comprises one or more rotational measurements, the one or more rotational measurements comprising at least one of a rotational angle, a rotational velocity, and a rotational acceleration; Non-transitory computer-readable medium.

Images