Wearable electronic device for inducing transient sensory events as user feedback

Abstract

A wearable electronic device includes an electrode array for transcutaneously stimulating a sensory nerve that innervates a body region distal to where the wearable electronic device is worn. The transcutaneous stimulation is configured to induce a current or voltage that induces a sensory impression in an area innervated by the sensory nerve, rather than at the stimulated sensory nerve itself. In one embodiment, the wearable electronic device takes the form of a ring worn on the proximal phalanx of the index finger. In this configuration, the wearable electronic device can stimulate a portion of a branch of the median nerve that extends through the index finger. While stimulating the median nerve, a user wearing the ring can sense pressure applied to the user's fingertip.

Description

[0001] CROSS-REFERENCE TO RELATED APPLICATIONS

[0002] This Patent Cooperation Treaty patent application claims priority to U.S. non-provisional patent application No. 17 / 838,116, filed on June 10, 2022, entitled “Wearable Electronic Device for Inducing Transient Sensory Events as User Feedback,” the contents of which are incorporated herein by reference in their entirety. Technical Field

[0003] The embodiments described herein relate to systems and methods for providing sensory feedback to users of electronic devices, and in particular, to wearable and / or implantable electronic devices (or combinations thereof) configured for transcutaneous electrical stimulation or direct electrical stimulation of sensory nerves, thereby inducing brief referred sensations (transient sensory events) at the site of the perceived sensory impression that is separate from the location where the wearable or implanted electronic device is worn. Background Art

[0004] Mechanical feedback provided by conventional haptic elements (e.g., eccentrically weighted motors or linear actuators) can enhance virtual reality or augmented reality experiences. Consequently, many conventional virtual reality controllers, game controllers, and wearable gaming devices (e.g., haptic gloves, head-mounted displays, haptic suits) include one or more haptic elements.

[0005] However, conventional mechanical tactile feedback provided by conventional haptic elements is coarse and does not induce a natural feel. Furthermore, many conventional controls and wearable gaming devices severely limit the natural range of motion, have complex electrical and mechanical structures, are often expensive to purchase and maintain, are difficult to store, and are complex to configure and operate. Furthermore, many conventional wearable gaming devices are bulky and visually obtrusive (e.g., haptic gloves), and may not be suitable for simulating a convincing augmented reality experience. Summary of the Invention

[0006] Embodiments described herein take the form of a wearable electronic device. The wearable electronic device may include a housing defining an outer surface configured to conform to the contours of a user's skin surface. The wearable electronic device may also include an electrode array extending at least partially through the outer surface to contact the skin surface.

[0007] The wearable electronic device may further include a memory resource storing at least one executable asset; and a processing resource operatively coupled to the memory resource and configured to cooperate with the memory resource to access the at least one executable asset to instantiate a software instance.

[0008] Once instantiated, the software can be configured to, but is not limited to: select a sensory impression site (e.g., the site at which a sensory event should be perceived by the wearer of the wearable electronic device (referred to as a "user")); select a sensory impression modality (e.g., pressure, temperature, vibration or other time-varying mechanical effect, texture, etc.); query a data store using the sensory impression site and the sensory impression modality to retrieve a stimulation profile having a magnitude and polarity of an electric current such that a current is induced in a sensory nerve of the user to induce a sensory impression corresponding to the sensory impression modality at the sensory impression site; query a data store (which may be the same or a different data store) using the stimulation profile to retrieve a calibration profile having information related to the position of the sensory nerve relative to the position of electrodes of an electrode array (e.g., worn by the user); create a stimulation plan using the stimulation profile and the calibration profile, the stimulation plan having parameters defining at least one signal to be applied to a selected pair of electrodes of the electrode array to induce a current having a magnitude and polarity defined by the stimulation profile at the sensory nerve; and execute the stimulation plan by generating at least one signal and applying the at least one signal to the selected pair of electrodes.

[0009] Due to this configuration, the wearable electronic device can (as needed or in response to an input or triggering event) induce a specific current within a specific region of a specific sensory nerve of the user, thereby stimulating the nerve in a manner that induces a sensory impression elsewhere in the user's body. For example, the wearable electronic device can take the form of a ring. In this example, the ring can stimulate a portion of a finger nerve that in turn innervates the fingertip of the index or middle finger. By stimulating the median nerve in a specific manner with a specific current, the user can perceive a sensory impression at the user's fingertip.

[0010] In other non-limiting terms, the wearable electronic device can be configured to stimulate the median nerve in a manner that simulates sensory signals transmitted from the fingertip via the median nerve to the brain in response to the fingertip pressing an object. By simulating the median nerve in the same manner, the brain can experience a "transient synesthesia event" that perceives sensory input to the portion of the user's finger distal to the wearable electronic device. More simply, by percutaneously stimulating the user's median nerve at one or more locations (e.g., the user's wrist, palm, dorsal, or other locations), an erroneous sensory impression (e.g., a transient sensory / synesthesia event) that is perceived as originating from the fingertip can be induced. As used herein, the terms "synesthesia" and "synesthetic" refer to sensory impressions or inductions generated in another part of the body in response to stimulation of another part of the body. For example, stimulating the proximal phalanx of a finger to induce a sensation in the distal phalanx or middle phalanx of the same finger.

[0011] Related and additional embodiments include configurations in which the housing has an annular shape and the wearable electronic device is configured to be worn on a finger of a user. In one example, the finger may be the index or middle finger, and the sensory nerve may be the median nerve. In other cases, other finger nerves associated with other fingers may be used.

[0012] Related and additional embodiments include configurations in which the wearable electronic device may be configured to be worn on a user's wrist (eg, within a cuff or bracelet).

[0013] Some embodiments include configurations in which a first electrode of the electrode array can be formed from a first metal or metal alloy and a second electrode of the electrode array can be formed from a second metal or metal alloy.In some configurations, the first and second metals can be different.

[0014] Embodiments may include configurations in which the software instance is configured to modify the magnitude of the current based on a user-specified configuration file. More specifically, the current envelope may be set such that any induced current does not exceed a user-specified maximum value. The user-specified value may be set by the user.

[0015] Certain embodiments include configurations in which the software instance is configured to receive signals from a separate electronic device to provide feedback to a user as an induced or induced sensory or perceptual perception. The separate electronic device may contain a virtual computing environment (e.g., a virtual reality gaming environment) and / or may be configured to cooperate with the virtual computing environment.

[0016] Some embodiments described herein take the form of a method for providing sensory feedback to a user of a wearable electronic device, the method comprising, for example, the following operations: receiving an instruction to provide sensory feedback to the user; selecting a sensory impression site based at least in part on the instruction; receiving a stimulation profile based on the sensory impression site, the stimulation profile having characteristics of an electric current that, when the electric current is transcutaneously induced in a sensory nerve of the user by operation of two or more electrodes in contact with the user's skin, induces a sensory impression of pressure at the sensory impression site; receiving a calibration profile having information related to the position of the sensory nerve relative to the position of the two or more electrodes; generating a stimulation plan using the stimulation profile and the calibration profile, the stimulation plan having parameters defining at least one signal to be applied to the two or more electrodes to induce a current (or potential gradient) at the sensory nerve; and executing the stimulation plan by generating at least one signal and applying the at least one signal to the two or more electrodes.

[0017] Some embodiments described herein take the form of a method for providing sensory feedback in response to the occurrence of an event in a virtual reality environment using a wearable electronic device positioned on a sensory nerve innervating a hand of a user, the method operating by: receiving a signal from the virtual reality environment, the signal corresponding to the event; generating a stimulation plan having parameters defining at least one electrical signal to be applied to two or more electrodes in contact with the user's skin to induce an electrical potential at the sensory nerve, the current being selected to induce a sensory impression at the user's fingertips; and executing the stimulation plan in response to the event.

[0018] Certain embodiments include configurations in which the induced current has a pulse width, duty cycle, pulse magnitude, frequency, and polarity selected to induce a sensory impression.

[0019] Some embodiments described herein take the form of a wearable electronic device comprising a first adjustable ring defining a first inner surface and comprising a first electrode protruding from the first inner surface and configured to contact a first finger of a user. The wearable device may also comprise a second adjustable ring defining a second inner surface and comprising a second electrode protruding from the second inner surface and configured to contact a second finger of the user. The wearable device may have a harness positioned on the user's hand, the harness comprising circuitry operatively coupled to the first and second electrodes, and a harness cover positioned over the flexible circuit. In some examples, the wearable device comprises a chamber coupled to the harness and positioned on the wrist, housing a battery, contact structures, and circuitry operatively coupled to the circuitry and configured to be communicatively coupled to a memory resource and a processing resource. In some cases, the processing resource collaborates with the memory resource to access at least one executable asset to instantiate a software instance configured to perform stimulation of at least the first electrode, wherein the stimulation induces a sensory impression in an area of ​​the first finger distal to the first electrode.

[0020] Certain embodiments include configurations in which the first adjustable ring defines a first tab and a second tab, each extending from an outer surface of the first adjustable ring opposite the first inner surface. In some examples, the ring has a default configuration and a worn configuration. In the default configuration, the diameter of the first adjustable ring may be a first length, and in the worn configuration, the diameter of the first adjustable ring may be a second length greater than the first length. The adjustable ring may have a portion of its wall overlapping the second portion of the wall of the first adjustable ring. In some cases, the first adjustable ring may define a first tab and a second tab, each extending from an outer surface of the first adjustable ring opposite the first inner surface, and the outer surface defining a channel configured to secure the position of the first tab relative to the second tab.

[0021] Some embodiments include a configuration in which the contact structure is an anode configured to contact the user's skin, and the anode defines a current return path from the first and second electrodes, respectively. As another example, a first connector can couple a first adjustable finger loop to a flexible circuit, and a second connector can couple a second adjustable finger loop to the flexible circuit. The strap cover can additionally comprise a flexible fabric, and the chamber can be coupled to a flexible band configured to wrap around a wrist.

[0022] Some embodiments described herein take the form of a wearable electronic device having at least two adjustable rings configured to be worn on respective fingers of a user, each of the adjustable rings comprising a respective electrode array. The electrode array may define a portion of an inner surface of each of the at least two adjustable rings and be configured to contact the user's finger. The device may further comprise: a strap having a flexible circuit operatively connecting each electrode array to a stimulation pad and a battery; a stimulation pad operatively coupled to the flexible circuit and configured to communicatively couple to a memory resource and a processing resource, the processing resource configured to cooperate with the memory resource to access at least one executable asset to instantiate a software instance configured to perform stimulation of each respective electrode array, the stimulation inducing a sensory impression in an area of ​​the respective finger distal to the respective electrode array; and a housing coupled to the flexible circuit and configured to house the stimulation pad and the battery.

[0023] In some examples, each electrode of the electrode array defines a cylindrical profile. In some cases, at least two of the adjustable rings include a wire extending around the circumference of each of the at least two adjustable rings, and each of the at least two adjustable rings includes an adjustment tab configured to adjust the size of each adjustable ring. In some configurations, the sensory impression in the area of ​​the corresponding finger is the user's fingertip. In addition, the software instance can be configured to receive a signal from a separate electronic device, the signal can include instructions to induce a sensory impression, the sensory impression including a sensory impression morphology and a sensory impression area. In some cases, the separate electronic device includes a virtual computing environment.

[0024] Certain embodiments include configurations wherein the sensory impression modality is selected from the group consisting of: a pressure impression; a temperature impression; a texture impression; or a time-varying mechanical impression.

[0025] Some embodiments described herein take the form of a wearable device comprising a first adjustable ring, a second adjustable ring, a flexible circuit, a battery, a communication module, and an anode. The first adjustable ring may have a first electrode array configured to contact a first finger of a user. The second adjustable ring may have a second electrode array configured to contact a second finger of the user, different from the first finger. The flexible circuit may be operably coupled to each of the first and second electrode arrays and may extend from a portion of the user's hand to the user's wrist. In some cases, the communication module may be operably coupled to the flexible circuit and the battery, and the communication module may be communicatively coupled to a memory resource and a processing resource. The processing resource may be configured to collaborate with the memory resource to access at least one executable asset to instantiate a software instance configured to perform stimulation of the first and second electrode arrays, wherein the stimulation induces a sensory impression in an area of ​​the corresponding finger distal to the corresponding electrode array. In some examples, the anode may be configured to contact the user's wrist and secured via an adjustable strap.

[0026] According to some embodiments, a first electrode of the first electrode array can be formed from a first metal, and a second electrode of the electrode array can be formed from a second metal. Furthermore, in other examples, the lace cover can clamp the flexible circuit, the lace cover comprising a knitted material. In some cases, a first connector electrically couples the first adjustable finger loop to the flexible circuit, and a sheath couples to the first adjustable finger loop and the lace cover and covers the first connector.

[0027] Certain embodiments include configurations in which the flexible circuit is mechanically coupled to a housing configured to be worn on a wrist of a user, the housing defining an opening, and the anode extending through the opening of the housing.

[0028] As another example, the first electrode array may have a pair of electrodes along the height of the first adjustable ring, and each pair of electrodes may be separated from an adjacent pair of electrodes by an angle between 35 degrees and 65 degrees. BRIEF DESCRIPTION OF THE DRAWINGS

[0029] Reference will now be made to the representative embodiments illustrated in the accompanying drawings. It should be understood that the following description is not intended to limit the present disclosure to the one included embodiment. On the contrary, the disclosure provided herein is intended to cover alternatives, modifications, and equivalents that may be included within the spirit and scope of the described embodiments and as defined by the appended claims.

[0030] Figure 1 Operation of a sensory feedback system as described herein is depicted.

[0031] Figure 2 Depicted is a simplified system diagram of a sensory feedback system as described herein.

[0032] Figure 3 Depicted is a simplified system diagram of a wearable electronic device configured to provide sensory feedback to a wearer.

[0033] Figure 4A Depicted is an example finger-ring wearable electronic device comprising an electrode array for transcutaneous digital nerve stimulation, thereby inducing a tactile sensation (induced transient synesthesia event) with the site of perceived sensory impression separated by a distance from the wearable electronic device.

[0034] Figure 4B Another example finger-ring wearable electronic device including an electrode array for transcutaneous digital nerve stimulation is depicted.

[0035] Figure 4C Depicts the observation along line AA Figure 4B Electrode arrays for wearable electronic devices.

[0036] Figure 4D Depicted are electrode arrays that may be used by, for example, the wearable electronic devices described herein.

[0037] Figure 4E Another electrode array that may be used by a wearable electronic device such as described herein is depicted.

[0038] Figure 4F Another electrode array that may be used by a wearable electronic device such as described herein is depicted.

[0039] Figure 4G Another electrode array that may be used by a wearable electronic device such as described herein is depicted.

[0040] Figure 4H An example finger-ring wearable electronic device comprising an electrode array for transcutaneous digital nerve stimulation is depicted.

[0041] Figure 4I Depicted as a detailed view along area BB Figure 4H Electrode arrays for wearable electronic devices.

[0042] Figure 4J Depicts the Figure 4I 1 is a cross-sectional view of an electrode array, as viewed along line CC, that can be used by, for example, the wearable electronic devices described herein.

[0043] Figure 4K Depicts the Figure 4I 1 is a cross-sectional view of an electrode array, as viewed along line CC, that can be used by, for example, the wearable electronic devices described herein.

[0044] Figure 4L Depicts the Figure 4I1 is a cross-sectional view of an electrode array, as viewed along line CC, that can be used by, for example, the wearable electronic devices described herein.

[0045] Figure 4M Depicts the Figure 4I 1 is a cross-sectional view of an electrode array, as viewed along line CC, that can be used by, for example, the wearable electronic devices described herein.

[0046] Figure 4N Depicts the Figure 4I 1 is a cross-sectional view of an electrode array, as viewed along line CC, that can be used by, for example, the wearable electronic devices described herein.

[0047] Figure 4O Depicts the Figure 4I 1 is a cross-sectional view of an electrode array, as viewed along line CC, that can be used by, for example, the wearable electronic devices described herein.

[0048] Figure 4P Depicts the Figure 4I 1 is a cross-sectional view of an electrode array, as viewed along line CC, that can be used by, for example, the wearable electronic devices described herein.

[0049] Figure 5 Depicted is a portable electronic device executing an instance of a software application configured to communicatively couple to and calibrate a wearable electronic device as described herein.

[0050] Figure 6 Depicted is a portable electronic device executing an instance of a software application configured to communicatively couple to and calibrate a wearable electronic device as described herein.

[0051] Figure 7A Depicted is an example cuff-shaped wearable electronic device containing an electrode array for transcutaneous digital nerve stimulation, thereby inducing an induced transient synesthesia event having a perceived sensory impression site different from the stimulation site.

[0052] Figure 7B An example glove-shaped wearable electronic device in a palm-down position is depicted, the wearable electronic device including an electrode array for transcutaneously stimulating various locations of a user's hand, thereby inducing an induced transient synesthesia event having a perceived sensory impression location different from the stimulation location.

[0053] Figure 7C Depicts the palm facing up Figure 7B wearable electronic devices.

[0054] Figure 7D A wearable electronic device having a headband shape as described herein is depicted.

[0055] Figure 7E An example strap-shaped wearable electronic device in a palm-down position is depicted, the wearable electronic device including a finger ring having an electrode array for transcutaneously stimulating the base of a finger, thereby inducing an induced transient synesthesia event having a perceived sensory impression location different from the stimulation site.

[0056] Figure 7F Depicted is a front view of an example strap-shaped wearable electronic device including a chamber configured to be worn on a user's lower arm and / or wrist.

[0057] Figure 7G An example band-shaped wearable electronic device is depicted in a palm-down position, the wearable electronic device including a finger ring having an electrode array for transcutaneously stimulating the base of a finger, thereby inducing an induced transient synesthesia event having a perceived sensory impression location different from the stimulation site.

[0058] Figure 8A Depicted is an adjustable finger-ring wearable electronic device comprising an electrode array for transcutaneous stimulation of digital nerves, thereby inducing a tactile sensation (induced transient synesthesia event) with the site of perceived sensory impression separated by a distance from the wearable electronic device.

[0059] Figures 8B-8C Depicts Figure 8A Side and front views of the adjustable finger ring.

[0060] Figures 9A-9B Depicted is a portable electronic device executing an instance of a software application configured to communicatively couple to and calibrate a wearable electronic device as described herein.

[0061] Figure 10A Depicted is a finger-implanted electronic device comprising an electrode array for direct sensory nerve stimulation, thereby inducing an induced transient synesthesia event having a perceived sensory impression site different from the stimulation site.

[0062] Figure 10B A wrist implantable electronic device is depicted that includes an electrode array for direct sensory nerve stimulation, with or without being communicatively coupled to a wearable electronic device, such as described above, thereby inducing an induced transient synesthesia event having a perceived sensory impression site different from the implant site.

[0063] Figure 11 Depicted is a portable electronic device executing an instance of a software application configured to operate with a wearable electronic device as described herein to provide haptic feedback.

[0064] Figure 12 is a flow chart depicting example operations of a method for creating a stimulation plan to perform a user-specific transient synesthetic event.

[0065] Figure 13 is a flow chart depicting example operations of a method for inducing a specific transient synesthetic event in a user.

[0066] Figure 14 is a flow chart depicting example operations of a method of calibrating a wearable electronic device as described herein.

[0067] Figure 15 is a flow chart depicting example operations of a method of calibrating stimulation provided by a wearable electronic device as described herein.

[0068] Figure 16 is a flow chart depicting example operations for a method of inducing disorientation utilizing a wearable electronic device as described herein.

[0069] Figure 17 is a flow chart depicting example operations of a method for operating a wearable electronic device based on events occurring in a virtual environment.

[0070] Figure 18 is a flow chart depicting example operations of a method of operating a wearable electronic device as described herein.

[0071] Figure 19 is a flow chart depicting example operations of a method of providing tactile feedback to a user of a portable electronic device.

[0072] The use of the same or similar reference numbers in different drawings indicates similar, related, or identical items.

[0073] The use of cross-hatching or shading in the drawings is generally used to clarify boundaries between adjacent elements and also to aid in the legibility of the drawings. Therefore, the presence or absence of cross-hatching or shading does not convey or indicate a preference or requirement for a particular material, material property, element proportions, element dimensions, commonality of similar illustrated elements, or any other feature, attribute, or characteristic of any element shown in the drawings.

[0074] In addition, it should be understood that the (relative or absolute) proportions and sizes of the various features and elements (and collections and groupings thereof) and the boundaries, separations and positional relationships therebetween provided in the accompanying drawings are merely for the purpose of facilitating understanding of the various embodiments described herein and, therefore, may not necessarily be presented or illustrated to scale and are not intended to indicate any preference or requirement for the illustrated embodiments to the exclusion of the embodiments described with reference thereto. DETAILED DESCRIPTION

[0075] Embodiments described herein relate to methods for providing sensory feedback to a user of an electronic device or computing system. Specifically, many embodiments described herein include a wearable electronic device or accessory that includes an electrode array that, in many examples, is positioned to surround a sensory nerve within a first body part that innervates a second body part distal to the first body part.

[0076] Due to this configuration and relative positioning of the wearable electronic device and the sensory nerves, applying a specific electrical signal (having a specific voltage, amplitude, pulse width, duty cycle, etc.) to a specific set of electrodes in the array can induce a current difference or potential difference between the sensory nerves, thereby locally enhancing the membrane potential of the nerves, thereby inducing a depolarization that mimics an afferent signal from a distal region innervated by the sensory nerves. More specifically, the induced electrical signal stimulates a sensory nerve in a first body region in a manner substantially similar to how an afferent signal originating from a second body region stimulates the same nerve.

[0077] Due to this configuration, use of the wearable electronic device can induce sensory impressions that are perceived to occur at a site separate from the wearable electronic device.

[0078] The embodiments described herein utilize this construction to enhance the experience of operating an electronic device, receiving feedback and / or notifications from an electronic device (e.g., a cellular phone, a laptop computer, etc.), improving immersion in a virtual reality or augmented reality environment, or providing real-time sensory feedback to an operator of a remote device such as a robotic arm or a prosthetic device in many applications.

[0079] In simpler, non-limiting terms, the embodiments described herein are configured to induce action potentials at sensory nerves by applying transcutaneously applied electrical signals (or, in some cases where stimulation electronics are implanted, direct stimulation), thereby producing a sensory impression that is perceived to occur in another part of the body. Thus, as described herein, the operation of briefly stimulating one body part to induce a sensory impression that is perceived to originate from another body part is referred to as a "transient synesthetic event" or an "induced transient synesthetic event." As mentioned above, as used herein, the terms "synesthesia" and "synesthetic" refer to a sensory impression or induction generated in response to stimulation of one part of the body in another different part of the body. For example, the proximal phalanx of a finger is stimulated to induce a sensation in the distal phalanx or middle phalanx of the same finger. In another example, the superficial nerves in the wrist are stimulated to induce a sensation in the palm, fingers, or nail bed.

[0080] More broadly, many of the embodiments described herein refer to stimulating a portion of a common nerve to induce sensations that are perceived as originating from mechanoreceptors distal to the common nerve portion.

[0081] The sensations induced by stimulation as described herein may vary from embodiment to embodiment or stimulation to stimulation. By modifying the position, frequency, pulse width, pulse amplitude, current, voltage and / or other characteristics of the signal or signal combination applied at the electrodes of the electrode array as described herein, different sensations can be induced at different perceived sensory impression sites. Thus, as described herein, the phrase "sensory impression modality" refers to a type of sensory impression induced in a user (e.g., a sense of pressure, a sense of paresthesia, a sense of vibration, a sense of temperature change, etc.), while the phrase "sensory impression site" refers to the location at which the user perceives the specific sensory impression to be induced. Similarly, a "stimulation site" refers to the site at which specific sensory nerve stimulation occurs (whether transcutaneous stimulation or direct stimulation, or a combination of the two).

[0082] For example, in an embodiment, a wearable electronic device worn on the proximal phalanx of a right index finger may be configured to generate a first set of signals (which may vary over time) via its electrode array to stimulate branches and / or cross sections of the median nerve passing through the proximal phalanx, thereby inducing a paresthesia at the tip of the user's right index finger. In this example, the stimulation site is the proximal phalanx, the sensory impression site is the fingertip (e.g., the distal phalanx), and the sensory impression modality is a paresthesia.

[0083] In another embodiment, a wearable electronic device worn on the proximal phalanx of the right index finger can be used to generate a second set of signals via its electrode array to stimulate branches and / or cross-sections of the median nerve passing through the proximal phalanx, thereby inducing a temperature change sensation at the tip of the user's right index finger. In this example, the stimulation site is again the proximal phalanx, and the sensory impression site is again the fingertip (e.g., the distal phalanx), but in this example, the sensory impression modality is a thermal sensation.

[0084] In another embodiment, a wearable electronic device worn on the proximal phalanx of the right index finger can be used to generate a third set of signals via its electrode array to stimulate branches and / or cross-sections of the median nerve passing through the proximal phalanx, thereby inducing a pressure sensation at the tip of the user's right index finger. In this example, the stimulation site is again the proximal phalanx, and the sensory impression site is again the fingertip (e.g., the distal phalanx), but in this example, the sensory impression modality is a pressure sensation.

[0085] In another embodiment, a wearable electronic device worn on the proximal phalanx of the right index finger can be used to generate a fourth set of signals via its electrode array to stimulate branches and / or cross-sections of the median nerve passing through the proximal phalanx, thereby inducing a pressure sensation in the middle phalanx of the user's index finger. In this example, the stimulation site is again the proximal phalanx, the sensory impression site is the middle phalanx, and the sensory impression modality is a pressure sensation.

[0086] In another embodiment, a wearable electronic device worn on the right wrist can be configured to generate a sixth set of signals via its electrode array to stimulate branches and / or cross-sections of the ulnar nerve, thereby inducing a vibration sensation in the user's pinky finger. In this example, the stimulation site is the user's wrist, the sensory impression site is the user's pinky finger, and the sensory impression modality is a vibration sensation. In some embodiments, the vibration sensation can be induced by pulse-controlling a set of signals that originally induce a pressure sensation.

[0087] Following these aforementioned embodiments, different sensory impression modalities and sensory impression locations of the user may be stimulated simultaneously. For example, heat impressions may be multiplexed with pressure sensations at the same or different impression locations to induce a combined sensory impression.

[0088] In other cases, the sensory impression location may move or shift during stimulation such that the user perceives the sensory impression pattern as moving (eg, a pressure sensation starting at the user's fingertips and being pulled toward the user's palm).

[0089] In yet other examples, different sensory impression modalities and different sensory impression locations may be stimulated in a specific order or pattern to induce an overall higher-order tactile effect.

[0090] In some further examples, transcutaneous motor nerve stimulation can be provided in conjunction with sensory nerve stimulation as described herein to both cause the user's body to move and induce a sensation therein. For example, flexion or extension can be induced in a finger, and a pressure sensation can be induced at the fingertip. This combination of motor and sensory nerve stimulation can induce the sensation of a physical object touching the user's finger and causing the user's finger to deflect by a certain amount.

[0091] Additionally, in some embodiments, both direct stimulation and transcutaneous stimulation can be used collaboratively to induce specific sensory impressions. For example, a sensory nerve stimulation implant can be configured to be communicatively coupled to a wearable electronic device located above the implant (e.g., in one example, to inductively power the implant) or worn elsewhere. In these configurations, the implant and the wearable electronic device can be used collaboratively to provide rich feedback (motor or sensory, or a combination thereof) to the user.

[0092] More generally and broadly, the operation of a wearable electronic device as described herein for stimulating one body part to induce sensory impressions perceived as originating from another body part can be described as “recruiting” neural action from sensory nerves to induce “referred stimulation” of nerves innervated by the recruited nerves.

[0093] As an example, a wearable electronic device as described herein can be in the form of a finger ring. One or more concentric electrode rings can be defined along the inner, skin-contacting surface of the ring. After the wearable electronic device is placed on the proximal phalanx of the index or middle finger, at least a portion of the finger nerve (which innervates the fingertip; the median nerve) passes through the central portion of the ring.

[0094] More specifically, in this example, the median nerve passes through a circumferentially distributed array of electrodes. By applying specific electrical signals to specifically selected pairs or groups of these electrodes, the median nerve can be stimulated in a manner such as described above, causing the wearer of the ring to perceive that the fingertips of their index or middle fingers are interacting with a physical object. This artificial sensory impression can be perceived by the wearer as a familiar somatosensory experience, such as that of pressure, temperature, texture, etc. In this way, the wearable electronic device recruits the median nerve to provide a referred sensation at the fingertips. In other words, in this way, the wearable electronic device induces a transient synesthesia event, causing the user to perceive that their fingertips are interacting with a physical object.

[0095] More generally and broadly, and in simpler, non-limiting terms, the embodiments described herein relate to electronic devices that induce haptic experiences for users of those electronic devices without requiring any part of the electronic device to physically contact the location where the haptic experience is perceived to originate.

[0096] For example, in one embodiment, a wearable electronic device as described herein can be implemented as a wrist-worn cuff with an electrode array disposed over and / or around superficial nerves innervating the hand (e.g., radial nerve, ulnar nerve, median nerve). By applying specific electrical signals (user-specific in many embodiments) to specific sensory nerves, any number of suitable synesthesia-inducing experiences can be induced.

[0097] For example, the wearable electronic device may induce a first pressure sensation on the palm side of the user's thumb and a second pressure sensation on the palm side of the user's index finger, which may cause the user to perceive that a physical object is being grasped between the thumb and index finger.

[0098] In another example, a wearable electronic device can induce both thermal and pressure perception at the tip of an index finger. This can cause the user to perceive that they are touching a hot object. In this example, the electrical signals associated with stimulating the recruited nerves to induce thermal perception can be multiplexed with the electrical signals associated with stimulating the recruited nerves to induce pressure perception.

[0099] In yet other examples, a wearable electronic device may induce a rough texture perception, which may cause the user to perceive that the user is physically touching an object with a rough texture.

[0100] These foregoing examples are not exhaustive of the sensory experiences that can be induced or otherwise induced by wearable electronic devices as described herein. It will be appreciated that by appropriately stimulating the recruited nerves, any combination of sensory impressions can be induced. Specifically, the sensory impression modality (e.g., the type of sensation to be simulated) and the sensory impression location (e.g., the location from which a particular sensation should be perceived as originating) can be changed and controlled by modifying the stimulation parameters.

[0101] It should also be understood that the wearable electronic device described herein can be used for a number of suitable purposes. For example, the wearable electronic device can be directly or indirectly communicatively coupled to an event stream of a virtual reality environment such that whenever a virtual character controlled by the motion of a user of the virtual reality system interacts with a virtual object, the wearable electronic device can stimulate one or more nerves in the user's hand to induce the user to perceive that the user is physically touching and interacting with the virtual object.

[0102] In such examples, one or more wearable electronic devices may be configured to stimulate sensory nerves in a number of ways, for example, to produce sensory impressions of temperature, texture, pressure, etc. In some cases, the sensory impression of weight may be simulated by increasing the sense of pressure on the underside of an object relative to the upper side of the object.

[0103] In other cases, the virtual reality environment can be configured to directly signal a wearable electronic device as described herein, in much the same way that a conventional virtual reality environment signals a conventional haptic or tactile device. In such examples, an event stream can be transmitted from a computing device associated with the virtual reality environment, the event stream containing structured data objects defining one or more physical interactions between a game character and a game object (or other game player). For example, a game character can carry tools or equipment that can have different physical properties that can be used to inform one or more haptic responses or induce one or more transient synesthesia events. In some cases, haptic feedback or output information can be encoded within an audio or visual data stream.

[0104] In some embodiments, a wearable electronic device as described herein can be configured to parse or otherwise extract an event stream of a game (whether virtual reality, augmented reality, or other type) in order to infer when one or more transient synesthesia events should be induced for the user. In some cases, the induced sensory impression can be triggered directly in response to an audio or visual signal. For example, a trained machine learning algorithm can determine whether a user's virtual hand is in contact with a virtual object based on a video stream. In response to this determination, a sensory impression can be induced in one or more fingers of the user as described herein. In another example, sound can be used to infer that a sensory impression should be induced. Many configurations and / or triggering events (whether direct, indirect, or implied) that initiate sensory impressions as described herein are possible.

[0105] In yet other examples, the wearable electronic devices described herein can be configured to provide sensory experiences unrelated to gaming. For example, in some embodiments, the wearable electronic devices described herein can be configured to detect sensory input and stimulate sensory nerves, as described above. In these embodiments, for example, two different wearable electronic devices can be coupled to each other directly or indirectly to simulate physical contact over a long distance. For example, family members can effectively experience holding hands at a distance. In other examples, gestures or actions of one user can be recorded and later replayed for another user.

[0106] For example, a parent, grandparent, or friend could record a loving gesture for a child, grandchild, or friend, such as drawing a heart on the palm of the recipient's hand or squeezing part of the recipient's hand or tapping in a specific, personally meaningful pattern, which could later be replayed and re-experienced by the child, grandchild, or friend as needed (perhaps after the parent, grandparent, or friend has passed away).

[0107] In yet other embodiments, the wearable electronic device described herein can be used as a notification device or a tactile feedback device. For example, the wearable electronic device can be configured to be communicatively coupled to a personal electronic device, such as a cell phone. In these configurations, the cell phone can utilize the wearable electronic device to notify the user of an event, such as an incoming call. In one example, the wearable electronic device can be configured to induce the perception of a tap on the back of a user's hand if the user is currently on a phone call or video conference.

[0108] In yet other embodiments, wearable electronic devices can be used to enhance the experience of interacting with physical objects. For example, a wearable electronic device as described herein can give the user the feeling of pressing a physical key when pressing a fixed flat touch screen.

[0109] In other examples, the wearable electronic device can be configured to assist with direction finding. For example, the wearable electronic device can be configured to allow the user to feel a tap on the right hand if the user intends to turn right, and to feel a tap on the left hand if the user intends to turn left.

[0110] In another example, direction finding can be combined with a thermal sensation experience. For example, if the user is oriented in the incorrect direction, the user may experience a cool sensation on the index finger, while if the user is oriented in the correct direction, the user may experience a warm sensation on the index finger.

[0111] These foregoing example embodiments are not exhaustive of all use cases for the devices, architectures, and systems described herein; it should be understood that many configurations and uses are possible. For example, in some cases, sensory impressions as described herein can be presented alongside traditional media, such as music, movies, art, or live performances. In such cases, different sensory impression modalities and / or different sensory impression locations can be selected to enhance and / or intensify the experience of using the traditional media.

[0112] For example, the ring shape is just one example shape. Other shapes include, but are not limited to: a glove; a glovelet; a strap worn on the hand and including an adjustable ring; a multi-finger ring; a band connected to a ring on a knuckle; a wrist-worn device; an implantable device; a cuff device; an ankle cuff device; and the like. These shapes may include other components, such as a housing, circuitry, a battery, and stimulation pads, that are configured to induce a sensory impression at a distal body part. Generally and broadly, it should be understood that the wearable electronic devices described herein can be suitably configured to couple to any body part via any suitable sensory nerve to induce a sensory impression at another body part distal to (and innervated by) the sensory nerve.

[0113] In some examples, a wearable electronic device as described herein can be positioned behind a user's ear to interact with the vestibular system. In these examples, stimulation of sensory nerves may cause disorientation and / or a sense of imbalance. Such embodiments can be used to enhance the experience of watching suspenseful or horror-type movies or games. In some examples, such embodiments described herein can also be used to enhance proprioception (e.g., in some cases, used in conjunction with a motor nerve stimulation system to induce specific flexion or extension and / or to prevent or resist voluntary flexion or extension).

[0114] To simplify the description, many of the embodiments below refer to a finger-ring wearable electronic device configured for use with a virtual computing environment, particularly a virtual reality environment. However, it should be understood that this is merely one example embodiment; the embodiments described herein can be appropriately modified for a number of use cases.

[0115] Additional embodiments described herein relate to in-situ calibration of a wearable electronic device as described herein. Specifically, they relate to determining the relative position of electrodes relative to the relative position of sensory nerves. In many embodiments, such a calibration process can be facilitated by a portable electronic device (e.g., a cellular phone) communicatively coupled to the wearable electronic device as described herein. In these configurations, the wearable electronic device can be configured to select several pairs or groups of electrodes and apply a predetermined electrical signal across these electrodes.

[0116] The wearable electronic device may continue to select another pair or group of electrodes to apply the same or different electrical signals after a threshold period of time has passed. As the wearable electronic device progresses past different pairs of electrodes, the portable electronic device may render a graphical user interface that requests feedback from the user when the user experiences a specific sensory impression modality at a specific sensory impression location. For example, the portable electronic device may render a graphical user interface with a feedback element or affordance that requests the user to interact with the affordance when experiencing a specific sensation.

[0117] In this way, once the user interacts with the affordance, the wearable electronic device can determine that the most recently executed signal properly stimulated the target sensory nerve. Using this information, the wearable electronic device and / or portable electronic device can create a "calibration profile." The calibration profile can store information related to which specific electrode pairs or groups and / or which specific electrical signal characteristics (e.g., amplitude, frequency, duty cycle, pulse width, etc.) induce a correct response in the user.

[0118] The calibration profile may vary from user to user. The calibration profile may also change each time the user wears the wearable electronic device because the relative positioning of the electrodes and the target sensory nerves may change from time to time. Thus, in many configurations, the calibration profile may be periodically updated by the user and / or periodically requested by the wearable or portable electronic device. In many cases, the calibration profile is stored in a database or other data storage area so that the wearable electronic device can access the appropriate calibration each time the wearable electronic device is used to induce a sensory experience in the user.

[0119] In some cases, the wearable electronic device may also include one or more stimulation profiles, which include information describing one or more signals that induce a specific sensation at a specific location on a specific user. In simpler terms, a stimulation profile for a specific modality and a specific location (e.g., a pressure sensation at a fingertip) may include information about a desired current or potential to be induced in or with a specific target sensory nerve.

[0120] In this way, a specific stimulation profile includes information describing what specific stimulation should occur to induce a specific sensory effect, and a calibration profile includes information describing how to induce a specific signal on or within a specific sensory nerve given a specific user and a specific orientation in which the wearable electronic device is worn at a specific time.

[0121] More generally and broadly, by combining the information contained in stimulation profiles (as described herein) and calibration profiles (as described herein), a wearable electronic device as described herein can generate and / or provide any number of sensory experiences for a particular user.

[0122] It should be appreciated that the foregoing architectures (including implementations with calibration profiles and stimulation profiles) are merely examples; these data items should not be construed as limitations on the manner in which the embodiments described herein may be implemented.

[0123] References below Figure 1-19 These foregoing and other embodiments are discussed. However, those skilled in the art will readily appreciate that the detailed description given herein with respect to these drawings is for explanation only and should not be construed as limiting.

[0124] Figure 1 The operation of the sensory feedback system as described herein is depicted.As with other embodiments described herein, the sensory feedback system 100 can utilize one or more wearable electronic devices configured to induce a transient synesthetic event to provide a sensory experience to a user.

[0125] The sensory feedback system 100 in this example can include an electronic device 102. The electronic device 102 can be any suitable electronic device or computing resource; in the illustrated embodiment, the electronic device 102 is a desktop computing device that includes a housing 104 that surrounds and supports a display 106 that is configured to render a graphical user interface 108 within an active display area of ​​the display 106.

[0126] More specifically, in many embodiments, the electronic device 102 can be implemented as a computing device that includes processing resources, memory resources, communication (e.g., networking) resources, and / or one or more displays and input devices. In such examples, the electronic device 102 can be configured to utilize the processing resources to access one or more executable assets of the memory resources in order to instantiate software configured to render one or more graphical user interface elements in the graphical user interface 108.

[0127] For example, the software instantiated by the electronic device 102 may be a virtual reality or gaming environment configured to render one or more three-dimensional objects within the graphical user interface 108. This is merely one example; any suitable user interface may be rendered within the graphical user interface 108. Other possible devices include virtual reality headsets, augmented reality headsets, pass-through camera mixed reality headsets and heads-up displays, holograms, projected visual entertainment systems, mobile platforms, handheld gaming devices, and the like. Additionally, as mentioned above, in some cases, the wearable devices described herein may be configured to operate in conjunction with real or traditional physical or virtual media (e.g., art paintings / sculptures, live performances, sporting events, and the like).

[0128] For embodiments where the graphical user interface 108 is configured to render a virtual environment, one or more objects may be rendered and manipulated by a user wearing one or more wearable electronic devices as described herein.

[0129] For example, in some embodiments, graphical user interface 108 may be configured to render three-dimensional object 110 and three-dimensional object 112. In the illustrated embodiment, these objects are solid objects, but it should be understood that this simplified example is non-limiting.

[0130] In this example, user 114 may interact with electronic device 102 via motion tracking (not shown; those skilled in the art will appreciate that many systems for motion tracking may be adapted to track the position of a user and / or the position of a body part of the user (e.g., left hand 114L or right hand 114R) in space). In these examples, a motion tracking system incorporated into electronic device 102 or implemented as a separate electronic device or system may be configured to track the position of right hand 114R and left hand 114L of user 114. In such examples, the motion of the user's hand may be translated by electronic device 102 into movement of one or both of one or more objects rendered in graphical user interface 108. For example, the motion of right hand 114R may affect the position or orientation of three-dimensional object 110 in graphical user interface 108. Similarly, the motion of left hand 114L may affect the position or orientation of three-dimensional object 112 in graphical user interface 108.

[0131] Additionally, user 114 may utilize one or more wearable electronic devices, such as those described herein, to enhance the experience of manipulating three-dimensional objects in graphical user interface 108. As described above, the wearable electronic devices worn by the user may be configured to stimulate sensory nerves of user 114 to induce or evoke referred sensations in other locations of the user's hands or fingers.

[0132] For example, the user 114 may wear the wearable electronic device 116 on the proximal phalanx of the index finger of the right hand 114R. Due to this wearing position, the wearable electronic device 116 at least partially surrounds the cross-section (and length) of a portion of the median nerve of the user 114. As known to those skilled in the art, the median nerve within the index finger innervates the distal portion of the index finger, including the palmar side of the fingertip (e.g., the face of the index finger). Due to this configuration, the wearable electronic device 116 can utilize one or more electrodes (configured to operate with an appropriate stimulation profile and calibration profile, such as those described herein) to stimulate the median nerve (the recruited nerve) so as to induce in the fingertip 118 a sensory impression 120 originating from a sensory impression site at the fingertip 118 of the right hand 114R of the user 114.

[0133] In simpler terms, the wearable electronic device 116 worn on the proximal phalanx of the index finger is used to induce a sensory impression in the user 114 at the user's fingertip that is separated by a distance from the wearable electronic device 116. In this way, the wearable electronic device 116 induces a transient synesthesia event in the right hand 114R of the user 114.

[0134] In addition, user 114 may also wear the wearable electronic device 122 on the proximal phalanx of the middle finger of the left hand 114L. Due to this wearing position, as described above, the wearable electronic device 122 at least partially surrounds the cross-section (and length) of different portions / branches of the median nerve of user 114. As known to those skilled in the art, the median nerve within the middle finger innervates the distal portion of the middle finger, including the palm side of the middle fingertip. Due to this configuration, like the electronic device 116, the wearable electronic device 122 can utilize one or more electrodes (configured to operate with an appropriate stimulation profile and calibration profile, such as described herein, which are different from the calibration profile and stimulation profile of the wearable electronic device 116) to stimulate this branch / portion of the median nerve (the recruited nerve) so as to induce in the fingertip 124 a sensory impression 126 originating from a sensory impression site at the fingertip 124 of the left hand 114L of user 114.

[0135] In simpler terms, the wearable electronic device 122 worn on the proximal phalanx of the middle finger is used to induce a sensory impression in the user 114 at the user's fingertip that is separated by a distance from the wearable electronic device 122. In this way, the wearable electronic device 122 induces a transient synesthesia event in the right hand 114R of the user 114.

[0136] The wearable electronic devices 116 , 122 may operate in conjunction (e.g., synchronize) with software executing on the electronic device 102 such that transient synesthetic events induced in the fingertips of the right hand 114R and the left hand 114L may be provided along with interaction with the tracked motion of the three-dimensional objects 110 , 112 .

[0137] More specifically, when user 114 moves the index finger of right hand 114R toward the virtual surface of three-dimensional object 110, the motion tracking system can signal wearable electronic device 116 to induce a pressure sensation in the index finger of the user's right hand. In this way, and due to this induced sensory impression, user 114 can perceive that the user is physically touching the virtual surface of three-dimensional object 110 at touch location 128. Similarly, when user 114 moves the middle finger of left hand 114L toward the virtual surface of three-dimensional object 112, the motion tracking system can signal wearable electronic device 122 to induce a pressure sensation, temperature sensation, texture sensation, or time-varying sensation in the middle finger of the user's left hand. In this way, and due to this induced sensory impression, user 114 can perceive that the user is physically touching the virtual surface of three-dimensional object 112 at touch location 130.

[0138] Figure 1 The foregoing embodiments and their various alternatives and variations are generally presented for purposes of explanation and to facilitate understanding of various configurations and constructions of, for example, sensory impression systems or sensory feedback systems described herein. However, it will be apparent to those skilled in the art that some of the specific details presented herein may not be required in order to practice certain described embodiments or their equivalents.

[0139] Therefore, it should be understood that the foregoing and following descriptions of specific embodiments are presented for the limited purpose of illustration and description. These descriptions are not intended to be exhaustive or to limit the disclosure to the precise form described herein. On the contrary, it will be apparent to those skilled in the art that many modifications and variations are possible in light of the above teachings.

[0140] More specifically, it will be appreciated that wearable electronic devices as described herein may cooperate with any suitable electronic devices or systems of electronic devices to enhance interactions with those electronic devices using sensory impressions. Wearable electronic devices can be used for, but are not limited to: enhancing the sensory experience of playing video games; the sensory experience of navigating in a virtual reality or augmented reality environment; providing sensory feedback to surgeons performing robotic-assisted surgery; providing sensory feedback between people separated by a distance; providing sensory feedback to people with disabilities, such as providing guidance feedback to a person with impaired vision; providing sensory feedback triggered by events at the electronic device (such as receiving an incoming call or new message); providing physical feedback to a user of a planar input surface (e.g., simulating a button press or keystroke); providing sensory feedback to guide the user's finger position when playing a musical instrument; providing sensory feedback to a user when operating machinery such as a motor vehicle; providing sensory feedback to wake a person who has fallen asleep; providing sensory feedback to operators of prosthetic limbs; providing sensory feedback among multiple wearers so that multiple users experience similar or identical sensory impressions simultaneously; improving the experience of online or remote shopping so that users can feel or otherwise interact with a product before purchasing it; providing sensory feedback as an authentication mechanism (e.g., a user can identify which finger or body part among many fingers or body parts is stimulated); and the like.

[0141] In some configurations, a wearable electronic device as described herein can be configured to induce discomfort, imbalance, or disorientation for entertainment or training purposes. For example, a wearable electronic device as described herein can be positioned near a user's vestibular system (e.g., behind the user's ear) and can be configured to stimulate the vestibular system to induce a perception of imbalance, nausea, vertigo, or disorientation in the user.

[0142] In yet other examples, the systems described herein can also be used to assist individuals suffering from unwanted, involuntary efferent signals (e.g., tremors, etc.). In these examples, the wearable electronic device can be configured to induce an electrical signal that cancels out the unintended or unwanted efferent signal. In other cases, the wearable electronic device can be configured to induce an electrical signal that cancels out the unintended incoming signal, thereby in response inducing one or more unwanted efferent signals.

[0143] In further embodiments, virtual objects that a user can interact with may be visually emphasized in some manner, such as with a shimmer, a particular color, blurred or frosted edges, or another visual or audio indication.

[0144] These foregoing examples are not exhaustive; a wearable electronic device as described herein may be configured to operate in a number of suitable ways and may be configured to operate in conjunction with and / or in place of any number of haptic notification or haptic feedback systems.

[0145] Figure 2 Depicted is a simplified system diagram of a sensory feedback system or sensory impression system as described herein. The system 200 operates through the collaboration of a wearable electronic device, a user's personal electronic device, and a virtual computing / gaming environment.

[0146] Specifically, system 200 includes a virtual environment 202 communicatively coupled to a client device 204. Virtual environment 202 may be defined, at least in part, by an environment engine 206 (also referred to in some cases as a physics engine or game engine) and a haptic data stream source 208.

[0147] The client device 204 (which may or may not be a wearable electronic device) is in turn communicatively coupled to a wearable electronic device configured to induce / induce a referred sensation through transcutaneous sensory nerve stimulation, as described herein. To simplify the description, the embodiments below refer to a configuration in which the client device 204 is a non-wearable electronic device (e.g., a cellular phone) configured to communicate with the wearable electronic device wirelessly or via a wired connection. To further simplify the description, a wearable or implantable device (or a combined system comprising at least one wearable device and at least one implantable device) configured to induce a referred sensation through transcutaneous or direct stimulation as described herein is referred to as an "RSTS" device. In the illustrated embodiment, the client device 204 is communicatively coupled to an RSTS device 210, which, like the other embodiments described herein, includes an electrode array, processing resources, memory resources, etc., so as to induce sensory impressions by stimulating recruited nerves (e.g., the median nerve of the user's hand). Generally speaking, these resources are identified as resources 212 in the diagram.

[0148] System 200 may be a gaming system configured to present a virtual reality environment, an augmented reality environment, or a two-dimensional rendered virtual environment (e.g., a metaverse, a game universe, etc.). Specifically, game actions may be calculated by environment engine 206 in response to one or more inputs provided by client device 204, which may be communicatively coupled to one or more input devices, such as a game controller or a motion tracking system. When game content is updated or calculated by environment engine 206, information describing the environment may be transmitted to client device 204 as environment information 214. Client device 204 may use environment information 214 to update a graphical user interface, a rendered game environment, etc.

[0149] In some cases, the environment engine 206 can determine that the game character physically interacts with an object rendered in the same environment or another game character. For example, the game character can hold a tool or weapon, can operate a virtual machine, etc. In response to this event, the environment engine 206 can signal the tactile data stream source 208 to generate one or more tactile signals 216 to send to the client device 204. In response, the client device 204 can provide one or more tactile outputs to the user of the client device, including but not limited to sensory impressions. More specifically, the client device 204 can be configured to utilize sensory impression signals 218 to signal the RSTS device 210 in response to receiving the tactile signals 216.

[0150] In more simple and non-limiting terms, system 200 may be configured to convert haptic signals transmitted along with or separately from gaming information generated by a gaming engine into sensory feedback perceptible by a wearer of an RSTS device, as described herein.

[0151] For example, the game environment can include one or more virtual objects. When the game character holds the object in the virtual environment, a tactile signal can be generated and transmitted to the client device 204. In a conventional game environment, the tactile signal can generate vibration tactile feedback (for example, the game controller can vibrate to indicate that the game character has successfully interacted with the virtual object) in response. In contrast, for the embodiments described herein, the client device 204 can convert the tactile signal received from the game environment (for example, the virtual environment 202) into a sensory signal, which, when received by the RSTS device 210, can make the wearer experience a more realistic sensory experience. For example, in response to the game character holding the object, a pressure sensory impression can be induced at each of the ten fingertips of the user, thereby inducing the impression that the user himself is physically holding the virtual object.

[0152] In these examples, client device 204 can be configured to select one or more sensory impression modalities and one or more sensory impression locations using structured information in haptic signal 216. For example, haptic signal 216 can be structured data in JSON format, such as:

[0153] {

[0154] "event_id":7f61e0f4-b475-4563-9ed9-95eb7e546e73,

[0155] "timestamp":"July 19,2019,21:44.365478UTC"

[0156] "hand_right:{

[0157] "index_tip": "0.5g",

[0158] "middle_tip": "0.2g",

[0159] "ring_tip": "0.2g",

[0160] "little_tip":"0.2g"

[0161] },

[0162] "hand_left:{

[0163] "index_tip": "0g",

[0164] "middle_tip": "0g",

[0165] "ring_tip": "0g",

[0166] "little_tip":"0g"

[0167] }

[0168] In this example, the haptic event may correspond to the game character lightly grasping an object with the character's right hand. Specifically, the example event, the sensory impression of sub-gram pressure, is induced at each fingertip of the right hand, but no pressure event is induced on the left hand.

[0169] In other examples, more detailed sensory information can be provided within haptic signal 216. For example:

[0170] {

[0171] "event_id":d0dfd5ad-926b-4483-b679-lb2c6a0ff689,

[0172] "timestamp":"July 19,2019,21:44.5566879UTC"

[0173] "hand_right:{

[0174] "index":{

[0175] "phalanx_proximal":{[

[0176] "modality":"pressure","value":"0.5g",

[0177] “duration”: “0.2s”

[0178] },

[0179] {

[0180] “modality”:“temperature”,“value”:“-3deg”,

[0181] “duration”:“0.2s”

[0182] }],

[0183] “phalanx medial”:{[

[0184] “modality”:“pressure”,“value”:“0.2g”,

[0185] “duration”:“0.2s”

[0186] },

[0187] {

[0188] “modality”:“temperature”,“value”:“-3deg”,

[0189] “duration”:“0.2s”

[0190] }],

[0191] “phalanx_distal”:{[

[0192] “modality”:“pressure”,“value”:“2g”,

[0193] “duration”:“0.2s”

[0194] },

[0195] {

[0196] “modality”:“temperature”,“value”:“-3deg”,

[0197] “duration”:“0.2s”

[0198] }]

[0199] }

[0200] }

[0201] }

[0202] In this example, the haptic event could correspond to the game character pulling the trigger of a weapon with their right index finger. In this example, in addition to the lower temperature (perceived temperature difference of minus three degrees), pressure could also be felt along the entire palm side of the right index finger, which could simulate the feeling of holding metal.

[0203] Figure 2 These aforementioned embodiments and their various alternatives and variations are generally presented for purposes of explanation and to facilitate understanding of various configurations and constructions of sensory impression systems or sensory feedback systems, such as those described herein, when used in conjunction with a gaming environment to enrich the gaming experience. However, it will be apparent to those skilled in the art that some of the specific details set forth herein may not be required in order to practice certain described embodiments or their equivalents.

[0204] Therefore, it should be understood that the foregoing and following descriptions of specific embodiments are presented for the limited purpose of illustration and description. These descriptions are not intended to be exhaustive or to limit the disclosure to the precise form described herein. On the contrary, it will be apparent to those skilled in the art that many modifications and variations are possible in light of the above teachings.

[0205] For example, it should be appreciated that the client device 204 and the virtual environment 202 can each be embodied in a number of ways. Specifically, the client device 204 can be a computing device such as a laptop computer, a game console, a desktop computing device, or the like. In many configurations, the client device 204 is configured to instantiate software that is, in turn, configured to connect to both the RSTS device 210 and the virtual environment 202. For example, as with other embodiments described herein, the client device 204 can include processing resources 204a and memory resources 204b that are configured to collaborate to instantiate a software instance (or more than one software instance) that is configured to connect to and / or utilize one or more API endpoints of the virtual environment 202 and the RSTS device 210.

[0206] Client device 204 may also include one or more output systems, generally identified as output resources 204 c, such as a display, tactile elements, speakers, etc. In some examples, the display of output resources 204 c may be configured to render a graphical user interface that renders at least a portion of the gaming environment defined by environment engine 206. The display may be a flat display, a curved display, a projected display, a head-mounted display, or any other suitable display.

[0207] Output resources 204 c may also include one or more tactile output systems, such as vibrotactile actuators. These conventional tactile outputs may be provided in conjunction with the outputs provided by RSTS device 210 .

[0208] Output resources 204 c may also include one or more audio output devices configured to provide audio generated by or within the virtual environment defined by environment engine 206 .

[0209] In some embodiments, the audio signal and / or visual signal in the environmental information 214 can be provided synchronously with the tactile signal 216. In other words, the sound and visual picture accompanied by a specific tactile effect can be rendered or otherwise generated for the user at the same time. In other embodiments, the tactile output can be provided before the corresponding audio-visual output. For example, the sensory impression provided by the RSTS device can lead the corresponding audio-visual effect for a shorter period of time (e.g., 100ms). The time period during which the audio-visual effect is delayed can enhance the realism of participating in the virtual environment because, as known to those skilled in the art, somatosensory signals generally lead the audio-visual signals (e.g., a person can feel the contact before perceiving the sound associated with the contact with the object).

[0210] Similar to client device 204, haptic data stream source 208 and environment engine 206 can also be implemented in whole or in part in software. Specifically, both systems can utilize processing and memory resources (identified as resources 206a and resources 208a) to instantiate software instances configured for different purposes.

[0211] These foregoing examples are not exhaustive; the system as described herein can also be configured in several suitable ways. For example, the RSTS device 210 and the client device 204 can communicate via a local wireless protocol such as Bluetooth or Wi-Fi or ultra-wideband. In other cases, the RSTS device 210 and the client device 204 can communicate via one or more networks, which may include the open Internet. In such examples, user-specific thresholds (as described herein) defining the limits or maximum / minimum thresholds of the stimulation can ensure that any interference with the instructions sent over the network will not cause pain or other unpleasant experiences to the user.

[0212] In some cases, virtual environment 202 can communicate with one or both of device 204 and RSTS device 210 via a network, which can be a private network, a cellular network, a Wi-Fi network, an intranet, or can include the open internet. In many embodiments, authentication and authorization operations can be performed so that stimulation of the user by RSTS device 210 cannot be accidentally triggered or otherwise intercepted / interfered with.

[0213] Figure 3 A simplified system diagram of a wearable electronic device configured to provide sensory feedback to a wearer is depicted. The wearable electronic device 300 may be, for example, a Figure 2The RSTS device 302.

[0214] The RSTS device 302 includes a housing 304 that surrounds and supports the internal components of the RSTS device 302. As mentioned with respect to other embodiments described herein, the RSTS device 302, and in particular the housing 304 of the RSTS device 302, can take several suitable shapes. In many cases, the housing 304 takes a shape configured to conform to the contour of a portion of a limb or finger of a user so as to at least partially enclose a portion or cross-section of sensory nerves within the limb or finger that can be recruited to provide referred sensation as described herein. Example shapes that the RSTS device 302 can take include, but are not limited to, a finger ring, a wristband, a neckband, an ankle strap, a sleeve, a partial sleeve, a glove, a mitten, a fingerless glove, a toe ring, an ear hook, and the like.

[0215] As with many of the embodiments described herein, the housing 304 of the RSTS device 302 may enclose and support one or more circuits configured to perform, coordinate, or otherwise perform or cause to be performed one or more operations or functions of the RSTS device 302. In the illustrated embodiment, the RSTS device 302 includes processing resources 306 and memory resources 308.

[0216] As described elsewhere herein, processing resources 306 and memory resources 308 may cooperate to instantiate software configured to communicate with other electronic devices (eg, personal cell phones, gaming consoles, etc.) and configured to stimulate recruited nerves.

[0217] In many embodiments, although not explicitly required, a power source 310 may also be included in the housing 304 to power the various components of the RSTS device 302. The power source 310 may be a battery, a Peltier element, a piezoelectric element, a solar cell array, a tethered connection to another electronic device or power source, an inductive or resonant wireless power transfer system, or any other suitable power source.

[0218] RSTS device 302 also includes one or more communication systems 312 for communicating with other electronic devices and / or for receiving signals indicating that a sensory impression should be induced. Example communication systems that may be included in communication system 312 include, but are not limited to: Bluetooth; Wi-Fi; cellular (e.g., 5G NR); 433 MHz radio; software-defined radio; infrared communication system; acoustic communication system; etc.

[0219] The RSTS device 302 also includes an electrode array 314. The electrode array 314 can be disposed on or through the outer surface of the housing 304. The electrode array 314 is oriented to engage and / or contact the surface of the user's skin. For example, in a ring shape, the outer surface through which the electrode array 314 extends to contact the user's skin is the inner diameter of the ring. Similarly, in a wristband embodiment, the outer surface through which the electrode array 314 extends to contact the user's skin is the inner surface of the wristband.

[0220] Electrode array 314 can include many different individual electrodes, each of which can be configured to function as an anode (negative signal terminal) or a cathode (positive signal terminal). In some cases, multiple electrodes can function as anodes relative to a single cathode. In other cases, multiple electrodes can function as cathodes relative to multiple anodes; any suitable electrode combination can be selected.

[0221] Electrode array 314 can be arranged in a repeating pattern, with any number of individual electrical elements comprising the repeating pattern. In some examples, electrode array 314 includes electrodes that are all formed of the same material (e.g., a conductive material, such as a metal or metal alloy) and are formed into the same shape (e.g., a square or a straight line). In other cases, different electrodes can be formed of different metals or alloys and / or formed into different shapes. Some electrodes of electrode array 314 can have a different surface area than other electrodes and can be formed of different materials.

[0222] In many embodiments, the electrode array 314 can be formed from a biocompatible metal material, such as gold. In some cases, metals that may trigger allergic reactions in some users (e.g., nickel, silver, etc.) can be avoided. In some cases, metal alloys can be selected specifically for oxidation resistance. Example electrode materials and alloys include, but are not limited to: copper alloys; gold alloys (e.g., AgNW, AgCl); tungsten alloys (e.g., CuNW); titanium alloys; and the like.

[0223] In some configurations, electrode array 314 comprises rigid electrodes. In other cases, electrode array 314 comprises flexible and / or polymeric electrodes. In some cases, electrode array 314 can extend beyond the outer surface of housing 304 to ensure contact with the user's skin.

[0224] These foregoing examples are not exhaustive; many electrode configurations are possible.

[0225] RSTS device 302 may also optionally include one or more sensors 316 and / or one or more displays 318. In some cases, display 318 may be an indicator or status light, while in other cases, a two-dimensional display (e.g., OLED, e-paper, LCD, etc.) may be used or included.

[0226] In some embodiments, the RSTS device 302 may include sensors such as temperature sensors, impedance sensors, humidity sensors, conductivity sensors, gyroscopes, accelerometers, and the like. Outputs from these sensors (among the sensors 316) may be used to notify or update a stimulation profile and / or calibration profile as described herein. In other cases, the output from the sensor 316 may be utilized by the processor or processing resource 306 to trigger a calibration or recalibration process or operation. For example, body impedance measurement may be used to notify a stimulation envelope that may be updated in real time and / or modified over time. For example, the user's skin impedance and / or body impedance may change within a day; in such cases, the output from the impedance sensor or sensing system may notify whether to increase or decrease the magnitude of the stimulation (as an example variable characteristic; other characteristics may also be modified or replaced in other embodiments) to provide a consistent sensory impression experience given different stimulation conditions.

[0227] Figure 3 The foregoing embodiments and their various alternatives and variations are generally presented for purposes of explanation and to facilitate understanding of various configurations and constructions of wearable electronic devices implemented as RSTS devices, such as those described herein. However, it will be apparent to those skilled in the art that some of the specific details set forth herein may not be required in order to practice certain described embodiments or their equivalents.

[0228] Therefore, it should be understood that the foregoing and following descriptions of specific embodiments are presented for the limited purpose of illustration and description. These descriptions are not intended to be exhaustive or to limit the disclosure to the precise form described herein. On the contrary, it will be apparent to those skilled in the art that many modifications and variations are possible in light of the above teachings.

[0229] For example, as mentioned above, a wearable electronic device as described herein can be configured to take a number of different shapes and can include one or more electrode arrays arranged in different manners.

[0230] For example, Figure 4AAn example finger-shaped wearable electronic device (identified as wearable electronic device 400a) is depicted that includes an electrode array for transcutaneously stimulating the median nerve or the ulnar nerve, thereby inducing a tactile sensation (induced transient synesthesia event) with the perceived sensory impression site separated by a distance from the wearable electronic device.

[0231] Specifically, the wearable electronic device 400a includes a housing 402 having a loop or ring shape and is configured to be worn on a user's phalanges. Typically, the wearable electronic device 400a is configured to be worn on the proximal phalanges, but this is not required in all embodiments.

[0232] The housing 402 may have a rigid or flexible shape. In some embodiments, the body may include one or more rigid portions and one or more flexible portions. In some embodiments, the body may be made of an elastic material so as to maintain contact with the user's fingers (e.g., when worn, the housing 402 is in a tensioned state). In other cases, the housing 402 may have a flexible inner surface and a rigid outer surface. For example, the inner surface of the housing 402 may be made of an elastic material or a polymer, with one or more protrusions contacting the user's skin, while the outer surface of the housing 402 may be covered with a rigid material such as metal. Many configurations are contemplated. In some embodiments, the housing 402 may be adjusted to different inner or outer diameters.

[0233] In some embodiments, housing 402 may have a circular shape, while in other embodiments, a polygonal shape may be used. In some cases, housing 402 defines a single hole for inserting a user's finger, while in other embodiments, more than one hole may be positioned adjacent to each other to define a multi-finger wearable electronic device.

[0234] The housing 402 of the wearable electronic device 400a may include multiple exterior surfaces, such as exterior surface 404 and exterior surface 406. Exterior surface 404 is along the outer periphery of the wearable electronic device 400a, and exterior surface 406 is along the inner periphery of the wearable electronic device 400a.

[0235] The wearable electronic device 400a also includes an electrode array 408 comprising two or more individual electrodes. In the illustrated embodiment, a set of three electrodes is shown, but it will be appreciated that this electrode arrangement may be repeated radially along the outer surface 406.

[0236] Electrode array 408 can be formed into any suitable shape and arranged in any suitable pattern. In some cases, each electrode of electrode array 408 has a linear shape, while in other cases, different shapes are contemplated. In some cases, the electrodes of electrode array 408 form a repeating or checkerboard pattern along outer surface 406.

[0237] Figure 4B Another example ring-shaped wearable electronic device is depicted that includes an electrode array for transcutaneous median nerve stimulation. Figure 4A As with the illustrated embodiment, the wearable electronic device 400b includes a housing 402 having a loop or ring shape configured to be worn on a phalanx of a user (eg, the proximal phalanx of the index or middle finger).

[0238] As with other embodiments, the housing 402 of the wearable electronic device 400b may include multiple exterior surfaces, such as exterior surface 404 and exterior surface 406. Exterior surface 404 is along the outer periphery of the wearable electronic device 400a, and exterior surface 406 is along the inner periphery of the wearable electronic device 400a.

[0239] The wearable electronic device 400b further includes an electrode array 408, which includes two or more individual electrodes, such as electrodes 408a, 408b. In the illustrated embodiment, a circumferentially distributed electrode array is shown, but it should be understood that this is merely an example.

[0240] As with other embodiments described herein, electrode array 408 can be formed into any suitable shape and arranged in any suitable pattern. In some cases, each electrode of electrode array 408 has a linear shape, while in other cases, different shapes are contemplated. In some cases, the electrodes of electrode array 408 form a repeating or checkerboard pattern along outer surface 406.

[0241] In addition, as mentioned above, different electrodes can be used for different purposes at different times, which is determined by the processor of the wearable electronic device 400b. Figure 4C Depicts the observation along line AA Figure 4B Electrode arrays for wearable electronic devices.

[0242] In this example, a first electrode 410 extending through the outer surface 406 can serve as a cathode, while a second electrode and a third electrode (e.g., electrodes 412a, 412b) can serve as anodes. In simpler terms, for a particular stimulation signal, a positive voltage signal can be applied to the first electrode 410, and electrodes 412a, 412b can be coupled to the system ground, serving as a return path for the current. In this example, the other electrodes of the system can be floating, disconnected from both the system ground and the signal source.

[0243] In another example, the first electrode 410 extending through the outer surface 406 can serve as an anode, while the electrodes 412a, 412b can serve as cathodes. In simpler terms, for a particular stimulation signal, one or more positive voltage signals can be applied to the electrodes 412a, 412b, while the first electrode 410 is coupled to the system ground, serving as a return path for the current.

[0244] These examples are not exhaustive; it will be appreciated that any number of electrodes may be defined for use as cathodes or anodes given the particular signal or stimulation requirements of a particular embodiment.

[0245] Additionally, as mentioned above, in some cases, different electrodes may be formed from different materials. Figure 4D Describes the Figure 4B In this example embodiment, the electrodes 416a, 416b extending through the outer surface 406 may be formed of different materials, such as a copper alloy or a gold alloy.

[0246] In yet other embodiments, a circumferential distribution of multiple electrodes may be used. Figure 4E Another electrode array that can be used by, for example, the wearable electronic device 400e described herein is depicted. This electrode array includes two rows of individual electrodes, a first row including electrodes 418 and a second row including electrodes 418. In this example, the two rows are aligned relative to each other, but this is not required. For example, Figure 4F Another electrode array that can be used by, for example, the wearable electronic device 400f described herein is depicted. In this example, two rows of electrodes can be offset relative to each other. For example, a first row of electrodes comprising electrodes 422 can be offset relative to a second row of electrodes comprising electrodes 424.

[0247] In still other embodiments, different electrode shapes may be suitable. Figure 4F Another electrode array that may be used, for example, by the wearable electronic device 400g described herein is depicted. In this example, circular electrodes such as electrode 426 may be used.

[0248] Figure 4H An example ring for a finger is depicted, which may be a standalone wearable device or may be incorporated into another wearable device (e.g., a strap containing a ring for each finger or for several fingers). Figures 4A-4B As explained, the finger ring may include an electrode array for transcutaneous median nerve stimulation. Specifically, the finger ring 400h includes a housing 428 having a loop or ring shape configured to be worn on a user's phalanges.

[0249] In some embodiments (not shown), the ring is adjustable. For example, the ring may include a spiral, a spring, an expandable material, a ratchet mechanism, or any other mechanism and / or geometry that allows the ring to conform to the size of the user's finger. In this configuration, the adjustability of the ring allows the user to wear the ring on most or all of their fingers. Similarly, the ring may be adjustable so that it can be worn by a wide range of users with varying hand sizes. Due to its adjustability, the ring can be configured to fit snugly but comfortably on the user's finger. This adjustable feature can ensure that the user maintains continuous contact with the skin while wearing the ring. For example, during hand movement, the ring can adjust to accommodate the movement while maintaining contact between the electrode array and the user's skin. This continuous contact improves the user's feel and experience of the wearable device and prevents interruptions in the feel and / or experience caused by the electrodes lifting away from the user's skin.

[0250] As described above, in some embodiments, the finger ring 400h includes an electrode array 430 comprising two or more electrodes, such as electrodes 430a, 430b, and 430c. In the illustrated embodiment, a circumferentially distributed electrode array is shown, but it should be understood that this is merely an example. The electrode array may include two electrodes along the height (e.g., along the width) of the inner surface 432 of the finger ring.

[0251] The housing 428 of the wearable electronic device 400h can include an inner surface 432 and an outer surface 434. The outer surface can include recessed portions and / or raised portions (not shown) to facilitate adjusting the ring to fit the user's finger. For example, the ring can include a series of channels that provide discrete locations for the tabs, thereby providing discrete ring sizes.

[0252] Inner surface 432 can define a series of openings for electrodes. In some embodiments, the electrodes can define a flush surface relative to the inner surface. In other embodiments, the electrodes can protrude from the inner surface.

[0253] Figure 4I Shown is a detailed view of an electrode array. In some embodiments, each pair of electrodes (e.g., 430a and 430c) is distributed with equal spacing along the inner surface of the ring. In other embodiments, as depicted in the figure, the pair of electrodes is positioned in a cluster (e.g., cluster 436), and the spacing between adjacent clusters may be larger than the spacing between electrodes within the cluster. As mentioned above, different electrodes or different electrode clusters can be used for different purposes at different times. For example, each row of electrodes can be used as a cathode-anode pair.

[0254] Figures 4J-4P An example elevation view taken along line CC is shown. Figure 4JAn embodiment of a finger ring 400j is shown. In this example, the electrode 438 defines a dome-shaped profile. According to some embodiments, the electrode can also act as a biasing member to stabilize the finger ring relative to the finger. While the depicted embodiment shows the electrode as protruding from the inner surface, in other embodiments, the top of the dome can be substantially flush with the inner surface. While a dome-shaped structure is shown, other shapes are contemplated.

[0255] like Figure 4K As depicted, in some embodiments of the ring 400k, each electrode 442 can define a bridge structure. For example, each electrode can have two ends that contact the surface, while the center portion of the electrode is suspended relative to the inner surface. In this embodiment, the electrodes can be more flexible, thereby making the user more comfortable when wearing the device, ring, and / or strap.

[0256] Figure 4L An embodiment of a finger ring 4001 is depicted. In this embodiment, the electrodes 442 have a capped shape, wherein each side of the cap has straight or substantially vertical sides. The top of the cap may be rounded to increase comfort and / or to increase the surface area between the user's skin and the electrodes.

[0257] Figure 4M Another embodiment of a finger ring 400m is depicted. Here, electrode 444 can define a flat surface configured to contact the user's skin. In this example, the electrode may be simpler to manufacture. While the edges of the electrodes are shown as straight, in some examples, the edges may define rounded corners, chamfers, or any other transitions known to those skilled in the art.

[0258] Figure 4N is an embodiment of the ring 400n, wherein the electrode 446 defines an inclined surface relative to the inner surface and a flat surface substantially parallel to the inner surface. Figure 4O As depicted, the electrode 448 may include rounded sides with substantially parallel surfaces. As yet another variation of the ring 400p, such as Figure 4P As depicted, the electrodes can define vertical sides and include flat and sloped surfaces. In the depicted embodiment, the electrodes can be pressed against the user's skin to increase the surface area between the skin and the electrodes while maintaining a comfortable fit with the user.

[0259] Figures 4A-4P The foregoing embodiments and their various alternatives and variations are generally presented for purposes of explanation and to facilitate understanding of various configurations of electrode arrays for wearable electronic devices, such as those described herein. However, it will be apparent to those skilled in the art that some of the specific details presented herein may not be required in order to practice certain described embodiments or their equivalents.

[0260] Therefore, it should be understood that the foregoing and following descriptions of specific embodiments are presented for the limited purpose of illustration and description. These descriptions are not intended to be exhaustive or to limit the disclosure to the precise form described herein. On the contrary, it will be apparent to those skilled in the art that many modifications and variations are possible in light of the above teachings.

[0261] For example, as mentioned above, independent of the electrode layout, it may be necessary to calibrate the wearable electronic device from time to time in order to inform the stimulation plan based on current information describing the relative position of specific electrodes relative to specific portions of specific sensory nerves in the user's body. In simpler terms, because the positioning of the wearable electronic device may change from one wear to another or change throughout the day, it may be necessary to periodically recalibrate the device. Specifically, as mentioned above, it may be useful to periodically update one or more stimulation profiles and / or one or more calibration profiles.

[0262] As used herein, the phrase "stimulation profile" refers to a data structure that stores values ​​or parameters corresponding to what type of stimulation a user perceives (e.g., current magnitude, polarity, pulse width, frequency, etc.) to induce a specific sensation at a specific location. In other words, the parameters describing the stimulation of a nerve to induce a pressure sensation at the tip of the index finger are different from the parameters describing the stimulation of a nerve to induce a temperature sensation at the same location (e.g., in this example, different modalities result in different stimulation parameters and different stimulation profiles). Similarly, the parameters describing the stimulation of a nerve to induce a pressure sensation at the tip of the middle finger are also different; in this example, different sensory impression locations require different stimulation parameters.

[0263] Similarly, as used herein, the phrase “calibration profile” refers to a data structure that stores values ​​or parameters corresponding to how to produce a specific stimulus (e.g., as defined by a stimulation profile, given a selected sensory impression modality and sensory impression location) given a specific orientation of a given wearable electronic device at a specific time.

[0264] In simpler and non-limiting terms, a stimulation profile may define what signal to induce to induce a specific sensory impression (both modality and location), and a calibration profile may define how to induce a specific signal given a specific positioning of the wearable electronic device.

[0265] A "stimulation plan" as described herein, combining information from both the stimulation profile and the latest calibration profile, can be used to provide a specific sensory impression modality that is perceived as originating from a specific location.

[0266] Additionally, it will be appreciated that different wearable electronic devices may be adapted to induce sensory impressions in different ways; a cuff shape may be capable of stimulating recruited nerves that innervate any portion of a given hand, while a finger-ring device may be capable of stimulating recruited nerves that innervate only a portion of an associated finger. Different embodiments are also configured to be calibrated according to different workflows.

[0267] Figure 5 A portable electronic device executing an instance of a software application is depicted, the portable electronic device being configured to communicatively couple to and calibrate a wearable electronic device as described herein. Figure 5 The described operations may inform the creation or updating of calibration profiles and / or stimulation profiles as described herein.

[0268] Portable electronic device 500 is implemented as a cellular phone, but this is just one example electronic device. Other examples include laptop devices, desktop devices, wearable devices (e.g., smart watches, head-mounted displays, etc.), and the like.

[0269] Portable electronic device 500 includes a housing 502 for enclosing and supporting the components of portable electronic device 500. In many examples, housing 502 encloses processing and memory resources and a display, such as display 504.

[0270] As with other embodiments described herein, processor resources and memory resources may cooperate to instantiate a software application, which in turn may render a graphical user interface 506 using the display 504 .

[0271] The portable electronic device 500 and / or software application (which may be referred to herein as a "client application" or "front end") can be configured to be communicatively coupled with a wearable electronic device as described herein. In some cases, although not required, the portable electronic device 500 is configured to be communicatively coupled to the ring electronic device via Bluetooth or ultra-wideband communication protocols. These are merely examples; other embodiments may utilize other communication systems.

[0272] The portable electronic device 500 and / or the client application can also be configured to be communicatively coupled to one or more third-party systems, collectively referred to as a host service. The host service can be a backend instance of one or more software platforms associated with providing sensory impressions via, for example, the wearable electronic devices described herein. In other cases, the backend platform can be associated with one or more virtual computing environments or virtual gaming environments.

[0273] In some cases, the portable electronic device 500 may receive information in a structured data format from a backend system to initiate a calibration operation for the wearable electronic device. In other cases, the portable electronic device 500 may receive information in a structured data format from the wearable electronic device itself to initiate a calibration operation for the wearable electronic device. In yet other embodiments, the portable electronic device 500 may periodically (e.g., daily, hourly, on a schedule, etc.) initiate a calibration operation for the wearable electronic device.

[0274] Figure 5 Graphical user interface 506 is depicted as rendering an example user interface that may be rendered during a calibration operation of a wearable electronic device as described herein. Graphical user interface 506 may include information 508 presented to the user that provides instructions for facilitating calibration of the wearable electronic device.

[0275] In some cases, the graphical user interface 508 may also include a virtual body part 510 (e.g., a hand) to intuitively indicate to the user where to wear the wearable electronic device 512. The graphical user interface 506 may also intuitively indicate a test site 514 to inform the user where sensory feedback is desired.

[0276] During the calibration operation, the wearable electronic device may iteratively select electrode pairs or groups and apply predetermined test signals across these electrode pairs. In many examples, these test signals may have limited magnitudes so as not to inadvertently trigger a pain response in the user.

[0277] The wearable electronic device can gradually change which stimulations are provided through which electrodes. When the user experiences sensations at the test site 514, the user can indicate to the client application that the stimulation has successfully occurred by interacting with the affordance 516.

[0278] Once the user indicates that they have experienced the desired sensation, further refinement of the applied signal can be performed. For example, the wearable electronic device can modify one or more characteristics of the test signal to induce the desired sensory impression. Such characteristics include modifying the frequency, duty cycle, magnitude, anode / cathode distribution between different electrodes, stimulation duration, and so on.

[0279] In response to each "refine" operation, the user can interact with the affordance 516 (or another graphical user interface element) to indicate to the client application that the sensory experience is being perceived in a different way. For example, in some cases, the graphical user interface 506 may include a button to indicate that the current stimulus is more localized than the previous stimulus. Another button may be included to indicate that the current stimulus is less localized than the previous stimulus. Another button may be included to indicate that the current stimulus induces a sensation of heat, pressure, texture, or another modality. Another button may be included to indicate whether a particular stimulus is a painful or near-painful experience. In such examples, the wearable electronic device and / or the client application may define one or more absolute thresholds for a particular user based on the user's perception. In these examples, any stimulus provided by the wearable electronic device will be below the user's pain threshold regardless of modality, location, or calibration.

[0280] In some cases, reference Figure 5 The illustrated embodiments describe operations that may be used to develop or update a calibration profile. Once a calibration profile has been established (e.g., more generally, once the approximate location of the sensory nerve to be stimulated has been determined), the wearable electronic device may proceed to generate a stimulation profile, e.g. Figure 6 shown.

[0281] Figure 6 A portable electronic device executing an instance of a software application is depicted, the portable electronic device being configured to communicatively couple to and calibrate a wearable electronic device as described herein. Figure 5 Same, Figure 6 System 600 includes a portable electronic device 602, which includes a display 604 on which a graphical user interface 606 is rendered. This graphical user interface 606 may include instructions 608 and a visualization portion 610 that inform the user how / where to wear the wearable electronic device, where to induce a sensory impression, and what form the sensory impression takes. In response to experiencing an indicated sensation at the indicated location (in the illustration, a pressing sensation at the tip of the left middle finger), the user 614 may press an affordance 612 to indicate to the device that the identified sensation is being experienced.

[0282] Specifically, as mentioned above, during calibration, the wearable electronic device 616 can iterate through one or more combinations of signals and cathode / anode pairs or groups selected from one or more electrodes 618. The wearable electronic device 616 can pause for a period of time between each test stimulus to provide the user 614 with an opportunity to interact with the client application rendering the graphical user interface 606 to indicate whether a particular sensory impression 620 has been experienced.

[0283] As with other embodiments described herein, once user 614 indicates that the desired sensation has been experienced, further refinement of the signal applied via electrode 618 can be performed. For example, wearable electronic device 616 can modify one or more characteristics of the test signal to induce the desired sensory impression having the desired sensory impression modality and the desired sensory impression location. As mentioned above, such characteristics include modifying the frequency, duty cycle, magnitude, anode / cathode distribution between different electrodes, stimulation duration, and the like.

[0284] In response to each refinement operation, as in other embodiments, user 614 can interact with affordance 612 (or another graphical user interface element rendered in graphical user interface 606) to indicate to the client application that the sensory experience is perceived in a different manner. In other cases, the client application can be configured to monitor acoustic signals and / or can be configured for speech recognition or speech-to-text conversion. In these examples, the user can indicate "yes" or "no" or similar feedback by sound to indicate to the client application whether the expected sensory impression was experienced.

[0285] In other cases, the graphical user interface 606 may include multiple buttons to indicate different attributes of the sensory experience felt by the user 614. For example, the graphical user interface 606 may include a button to indicate that the current stimulus is more localized than the previous stimulus. Another button may be included to indicate that the current stimulus is less localized than the previous stimulus. Another button may be included to indicate that the current stimulus induces a sensation of heat, pressure, texture, or another modality. Another button may be included to indicate whether a particular stimulus is painful or a near-painful experience. In such examples, the wearable electronic device and / or the client application may define one or more absolute thresholds for a particular user based on the user's perception. In these examples, any stimulus provided by the wearable electronic device will be below the user's pain threshold, regardless of modality, location, or calibration.

[0286] Figure 5-6 These aforementioned embodiments and their various alternatives and variations are generally presented for purposes of explanation and to facilitate understanding of various configurations of electronic devices that may be used to assist in field calibration of wearable electronic devices, such as those described herein. However, it will be apparent to those skilled in the art that some of the specific details set forth herein may not be required in order to practice certain described embodiments or their equivalents.

[0287] Therefore, it should be understood that the foregoing and following descriptions of specific embodiments are presented for the limited purpose of illustration and description. These descriptions are not intended to be exhaustive or to limit the disclosure to the precise form described herein. On the contrary, it will be apparent to those skilled in the art that many modifications and variations are possible in light of the above teachings.

[0288] For example, although reference Figure 5-6 The wearable electronic device is in the form of a ring, but this is not required in all embodiments. For example, Figure 7A An example cuff-shaped device is depicted, namely a wearable electronic device 700a in which a housing 704 is worn by a user 702 on the wrist of the user 702. The wearable electronic device 700a includes an electrode array 706 for transcutaneously stimulating the median nerve or the ulnar nerve, thereby inducing (as an example) a first induced transient synesthesia event 708 in the user's thumb 710 or (as an example) a second induced transient synesthesia event 712 in the user's index finger.

[0289] In another example embodiment, the wearable electronic device may take the form of a glove. Figure 7B Depicted as being implemented in a palm-down position (in Figure 7C 714 ). As with other embodiments, the wearable electronic device 700b can be worn as a glove 714 on the hand of the user 702 and can include one or more electrode arrays, each of which can be configured to stimulate a different recruited total nerve, nerve branch, or nerve group. The example electrode arrays depicted in the figure include electrode arrays 716, 718, 720, and 722. These arrays can operate independently or collaboratively to induce sensory impressions at one or more locations (e.g., sensory impression locations 724, 726, 728, and 730) using one or more modalities.

[0290] In yet other embodiments, for example Figure 7D As shown, the wearable electronic device described herein can be in the form of a head-mounted device, such as a virtual reality headset, an augmented reality headset, a head-mounted display, a head-up display, glasses, headphones, earbuds, ear hooks, or the like. Figure 7D Headband shown.

[0291] In this example embodiment 700c, user 702 wears headband 732 in a manner that positions a set of electrodes 734 near the user's vestibular system. In these examples, the user's vestibular system can be stimulated to induce a sense of imbalance, disorientation, or other similar sensations. As an example, such an embodiment can be used for training purposes. It should be understood that in other embodiments, other wearable electronic devices can be used with electrode arrays arranged in other relative positions; Figures 7A-7D The examples presented are merely examples.

[0292] The wearable electronic device may be in the form of a strap 700e worn on the user's hand, such as Figure 7E The strap 700e may include adjustable rings or loops 736a, 736b, 736c, 736d, and 736e configured to be worn on each finger of a user. While the figures show a strap with a ring for each finger, in some embodiments, the strap may include any number of rings configured to be worn on selected fingers or a single finger. The rings 736a-e may include electrode arrays, as described above with respect to Figures 4A-4P The ring may include adjustment tabs so that the user can widen and / or narrow the ring for comfort, to increase the contact area between the finger and the electrodes, to facilitate removal of the ring, etc.

[0293] As depicted, the finger rings can be coupled to the lace cover 738. In some embodiments, the connector 737 (e.g., from the pinky to the body of the lace) can be a flexible connector so that the user can adjust the position and orientation of each finger ring. For example, as depicted with respect to the pinky, the adjustable tabs can rest toward the palm surface. As depicted with respect to the thumb, the tabs can rest on the side of the thumb. In some examples, each adjustable tab can rest on the dorsal surface. Regardless of the orientation of the tabs, as depicted with respect to the thumb, the user can adjust the position and orientation of each finger ring. Figures 4A-4P As depicted, each ring and its electrode array can operate independently or collaboratively to induce a sensory impression at one or more locations using one or more modalities. In some examples, in a worn position, the electrode contacts can be scanned to find those that meet comfort and / or sensory criteria.

[0294] In some examples, the lace cover 738 is positioned on a portion of the back of the hand and can extend toward the wrist. The lace cover 738 can be made of a soft, flexible material. For example, the lace cover 738 can be made of cotton, nylon, polyester, spandex, Tencel, silk, or any other fabric or fabric combination, as may be known to those skilled in the art. In some embodiments, the lace cover 738 can accommodate a flexible circuit (not shown). The flexible circuit routes power to each of the finger rings 736a-e. The flexible circuit can be protected by the fabric of the lace. In addition, the flexible circuit provides rigidity to the lace so that the lace can maintain its overall structure.

[0295] In addition, the strap can include a housing or chamber 740. In some embodiments, the housing or chamber 740 houses a battery, an anode, a stimulation plate, and / or a communication module. Similarly, the housing or chamber 740 can include an electromyography (EMG) sensor and / or other sensors configured to detect physiological parameters from the user. In addition, the housing or chamber 740 is mechanically coupled to the flexible circuit. The housing or chamber 740 can be configured to be worn on a portion of the lower arm and / or wrist. In this configuration, the weight of the housing or chamber and the components housed therein is located outside the hand. In this configuration, the hand maintains mobility without significantly increasing weight.

[0296] In some examples, the battery can be friction-fitted within the housing or chamber 740. For example, the housing can define a generally trapezoidal shape to frictionally fit the battery and prevent it from moving. In some embodiments, the housing can include indicators for power, volume, and other buttons. For example, the indicator can be an LED indicator (e.g., which shows the charge level of the battery), a button, etc.

[0297] As another example, the housing can include two shells that can be coupled via fasteners, rivets, glue, tabs, or any other mechanical connector. In some embodiments, the flexible circuit is coupled to the first shell of the housing or chamber. In this configuration, movement of the strap is less likely to dislodge the flexible circuit from the stimulation pads, battery, and / or other circuitry within the chamber or housing 740.

[0298] Figure 7F Shown along Figure 7E AA of the wearable strap. The housing or chamber 740 of the strap includes an opening (not shown). The anode 744 is at least partially contained within the housing or chamber 740 and extends through the opening. The anode is configured to contact the user's skin. For example, the anode 744 may contact a portion of the lower arm, wrist, and / or hand. Although the anode 744 is presented, the housing or chamber 740 may be an electrode, a contact structure, or any other module that contacts the user's skin and is configured to provide and / or draw current. Although one anode 744 is shown, in other embodiments, the housing or chamber 740 may include multiple openings for more than one anode, electrode, and / or contact structure.

[0299] As depicted in the figure, the wearable device includes an adjustable strap 742. The adjustable strap 742 can be wrapped around the lower arm and secure the strap and chamber 740 to the user. In some embodiments, the adjustable position accommodates most arm sizes. The adjustable strap 742 can be made of any suitable material. For example, the adjustable strap can be an elastic material and include Velcro to secure the strap to the strap itself. In some examples, the adjustable strap includes a buckle wrapped around the adjustable strap 742. The adjustable strap 742 is configured to maintain continuous contact between the anode 744 and the skin. In this configuration, the user can move comfortably without lifting the anode 744 from the wrist.

[0300] Generally, the user's palm (not shown) is free, which helps extend the wear time of the strap. In addition, the user can interact with the physical environment (e.g., objects) and the virtual environment while wearing the device. For example, the user's experience can be enhanced by combining the sensation of physical and virtual objects. In other examples, the user can experience the physical and virtual environments independently. Another advantage is that the location of the strap on the back of the hand can extend the durability of the strap because this part of the back of the hand moves less than the palm.

[0301] Wearable electronic devices can also be in the form of a 700g design, such as Figure 7G Similar to the above Figure 7E , the strap design 700g embodiment includes finger loops 746a-e with adjustable tabs. The finger loops are connected to the strap 748 via connector 747. Although connector 747 is shown as being located on the back of the hand, in some embodiments, the connector can be located on the palm. Connector 747 can include a fabric sheath to protect the wires, or it can take the form of a plastic tab that extends from the finger loop to the strap.

[0302] In addition, band design 700g can include a chamber 750 that houses electronic components, including a battery. Chamber 750 can also include an anode (not shown) that extends from the chamber toward the user and is configured to contact the user's skin. Chamber 740 can be secured to a strap 752 that wraps around the user's lower arm and / or wrist.

[0303] In some embodiments, band design 700g can include an additional strap (not shown) that couples strap 752 to band 748. The additional strap can include circuitry (e.g., a flex circuit) that operably couples the ring to a battery and / or other circuitry located within the chamber. This embodiment can allow for greater adjustability of the wearable device around the knuckle.

[0304] In example embodiments 700e and 700g, a user wears a strap and / or band design so that an electrode array is positioned on each of the user's fingers. Specifically, the user may wear the ring on the proximal phalanx of a finger. In these examples, the signal sent to one or each finger may be used to induce a sensation of touching an object, a thermal sensation (e.g., feeling the warmth from a fireplace), or other tactile sensations, such as squeezing an object, popping bubbles, feeling texture, etc., at the distal or middle phalanx of the same finger. It will be appreciated that in other embodiments, other wearable electronic devices may be used with electrode arrays positioned in other relative positions; Figures 7E-7F The examples presented in are merely examples. For embodiments where the electrode array can induce sensations at many different locations, a multi-location calibration operation may be performed, e.g. Figures 9A-9B shown.

[0305] Figures 8A-8C Depicted is shown as Figures 7E-7F An embodiment of a ring shape as part of a wearable device. Figure 8A As shown, the ring 800 may include a shell 802 that defines the thickness of the ring's wall, an outer surface 804, and an inner surface 806. The inner surface 806 may include an electrode array, such as electrodes 808a and 808b. Figures 4A-4P As discussed, the electrode sizes and arrangements may include two electrodes per row (eg, 808a and 808b). However, other arrangements and patterns are contemplated.

[0306] Finger ring 800 may include wires 810 coupling each electrode 808 to the flexible circuit. Wires 810 may be distributed along the circumference of finger ring 800. As known to those skilled in the art, wires 810 may be exposed or unexposed.

[0307] like Figure 8A and 8B As shown, the housing 802 may define a spiral shape with an overlap region 812. The spiral shape allows the user to adjust the size (e.g., diameter) of the ring to increase comfort. For example, the user can tighten or loosen the ring. In some embodiments, the ring includes tabs, such as tabs 814a and 814b. The user can pinch tabs 814a and 814b to loosen the ring (e.g., reduce the size of the overlap region). In this configuration, the user can quickly remove the ring. In an unworn position, such as shown in the figure, the ring may default to its narrowest configuration. In this example, the ring in the worn position widens from its default position, thereby creating a spring effect (e.g., the ring is biased toward the default position), allowing the ring to fit snugly but comfortably. In other embodiments, the ring 800 includes a ratchet mechanism that provides discrete ring sizes.

[0308] In some cases, each pair of electrodes 808 may be separated by a certain angle, depending on the user's intended ring size. For example, in smaller rings, the electrodes may be separated by an angle exceeding 40 degrees. In other examples, for larger rings, the separation between the electrodes may be between 20 and 60 degrees. However, other angles are contemplated.

[0309] Figure 8C A side view of finger ring 800 is shown. As shown, the tabs can have different widths. Specifically, tab 814b can span a width d1 and bridge opposite sides of the finger ring within the shorter width d2 of the housing. Tab 814a can define the end of the housing wall at the shorter width d2. In this configuration, in the fully extended position (e.g., tabs 814a and 814b are pinched and in contact), the tabs act as stops, preventing the finger ring from extending beyond its diameter. This configuration can also protect the material and wire from excessive deformation. In some embodiments, tab 814a is configured to move along a track path 816.

[0310] As described above, the finger ring 800 can include a wire 810 positioned around the circumference of the finger ring 800. For example, the wire can be positioned below the tab 814b according to the track path 816. The finger ring 800 can include a joint 818 that secures the wire in place at the transition from the connector (e.g., connector 737) to the finger ring. The joint 818 can also secure a sheath from the connector to the finger ring.

[0311] Figures 9A-9B Depicted is a portable electronic device executing an instance of a software application configured to communicatively couple to and calibrate a wearable electronic device as described herein. Figures 9A-9B The system 900 includes a portable electronic device 902 including a display 904 on which a graphical user interface 906 is rendered.

[0312] This graphical user interface 906 may include instructions and a visualization portion 908 that informs the user how / where to wear the wearable electronic device, where to expect sensory impressions to be induced (e.g., Figure 9B Compared to different locations, e.g. Figure 9A In response to experiencing the indicated sensation at the indicated location, the user can press affordance 910 to indicate to the device that the identified sensation is experienced.

[0313] Specifically, as mentioned above, during calibration, the wearable electronic device may iterate through one or more combinations of signals selected from one or more electrodes and cathode / anode pairs or groups. The wearable electronic device may pause for a period of time between each test stimulus to provide the user with an opportunity to interact with the client application rendering the graphical user interface 906 to indicate whether a particular sensory impression has been experienced.

[0314] As with other embodiments described herein, once the user indicates that they have experienced the desired sensation, further refinement of the signal applied via the electrodes can be performed. For example, the wearable electronic device can modify one or more characteristics of the test signal to induce the desired sensory impression having the desired sensory impression modality and the desired sensory impression location. As mentioned above, such characteristics include modifying the frequency, duty cycle, magnitude, anode / cathode distribution between different electrodes, stimulation duration, and the like.

[0315] In response to each refinement operation, as in other embodiments, the user can interact with affordance 910 (or another graphical user interface element rendered in graphical user interface 906) to indicate to the client application that the sensory experience is perceived in a different manner. In other cases, the client application can be configured to monitor acoustic signals and / or can be configured for speech recognition or speech-to-text conversion. In these examples, the user can indicate "yes" or "no" or similar feedback by sound to indicate to the client application whether the expected sensory impression was experienced.

[0316] In other cases, graphical user interface 906 may include multiple buttons to indicate different attributes of the sensory experience felt by the user. For example, graphical user interface 906 may include a button to indicate that the current stimulus is more localized than the previous stimulus. It may include another button to indicate that the current stimulus is less localized than the previous stimulus.

[0317] Another button may be included to indicate whether the current stimulus evokes a sensation of heat, pressure, texture, or another modality. Another button may be included to indicate whether a particular stimulus is painful or near-painful. In such examples, the wearable electronic device and / or client application may define one or more absolute thresholds for a particular user based on the user's perception. In these examples, any stimulus provided by the wearable electronic device will be below the user's pain threshold, regardless of modality, location, or calibration.

[0318] Figures 7A-9BThese aforementioned embodiments and their various alternatives and variations are generally presented for purposes of explanation and to facilitate understanding of various graphical user interfaces that can assist, for example, in field calibration of wearable electronic devices as described herein, and in particular, can assist, for example, in creating or updating stimulation plans, calibration profiles, and / or stimulation profiles as described herein. However, it will be apparent to those skilled in the art that some of the specific details set forth herein may not be required in order to practice certain described embodiments or their equivalents.

[0319] Therefore, it should be understood that the foregoing and following descriptions of specific embodiments are presented for the limited purpose of illustration and description. These descriptions are not intended to be exhaustive or to limit the disclosure to the precise form described herein. On the contrary, it will be apparent to those skilled in the art that many modifications and variations are possible in light of the above teachings.

[0320] For example, it should be understood that the client device or portable electronic device executing the software application described herein may not be limited to cellular phone implementations. For example, in some cases, calibration may be performed in a virtual environment using, as an example, a virtual reality headset or a heads-up display.

[0321] For example, it should be further understood that not all embodiments require transcutaneous stimulation. As an example, an implantable electronic device can be configured to perform operations to stimulate recruited nerves, similar to the transcutaneous embodiments described herein. For example, Figure 10A An embodiment 1000a is depicted in which an index finger 1002 serves as the implantation site for an implantable electronic device 1004 .

[0322] As with other embodiments described herein, implantable electronic device 1004 includes an electrode array for directly stimulating the median nerve, thereby inducing an induced transient synesthesia event with a perceived sensory impression site different from the implantation site.

[0323] As another example, Figure 10B An embodiment 1000b is depicted in which a wrist implanted electronic device 1006 includes an electrode array for directly stimulating the median nerve, thereby inducing an induced transient synesthesia event having a perceived sensory impression location different from the implantation site.

[0324] Figures 10A-10B These aforementioned embodiments and their various alternatives and variations are generally presented for purposes of explanation and to facilitate understanding of certain implantable embodiments described herein (which may include, for example, reference to Figure 3However, it will be apparent to one skilled in the art that some of the specific details set forth herein may not be required in order to practice certain described embodiments or their equivalents.

[0325] Therefore, it should be understood that the foregoing and following descriptions of specific embodiments are presented for the limited purpose of illustration and description. These descriptions are not intended to be exhaustive or to limit the disclosure to the precise form described herein. On the contrary, it will be apparent to those skilled in the art that many modifications and variations are possible in light of the above teachings.

[0326] For example, in some cases, a wearable device as described herein can be used as or in conjunction with an input device for an electronic device, such as a cellular phone or laptop device as described herein.

[0327] For example, Figure 11 Depicted is a portable electronic device executing an instance of a software application configured to operate with a wearable electronic device as described herein to provide haptic feedback.

[0328] System 1100 includes a portable electronic device 1102 and a user 1104. In this example, user 1104 wears a wearable electronic device 1106 on their wrist to induce a sensory experience associated with manipulating a virtual object (e.g., a virtual knob 1108) in space. For example, a first sensory experience 1110a perceived at a sensory impression site on the user's index finger and a second sensory experience 1110b perceived at a sensory impression site on the user's thumb can each simulate a mechanical detent. In other words, when user 1104 rotates virtual knob 1108 in direction 1112, a "click" sensation can be imparted to both the index finger and thumb to simulate the sensation of rotating a mechanical knob.

[0329] Additionally, as user 1104 rotates virtual adjuster 1108 , the changing angular position of virtual adjuster 1108 may be used to inform changes to elements displayed in a graphical user interface rendered by display 1114 of portable electronic device 1106 , particularly within graphical user interface 1116 .

[0330] The rotation gesture performed by user 1104 may be used as input to modify the position of a list of items 1118, to change the position of a volume or brightness slider 1120, or for any other suitable purpose.

[0331] Figure 11The foregoing embodiments and their various alternatives and variations are generally presented for purposes of explanation and to facilitate understanding of certain use cases of wearable electronic devices, such as those described herein. However, it will be apparent to those skilled in the art that some of the specific details presented herein may not be required in order to practice certain described embodiments or their equivalents.

[0332] Therefore, it should be understood that the foregoing and following descriptions of specific embodiments are presented for the limited purpose of illustration and description. These descriptions are not intended to be exhaustive or to limit the disclosure to the precise form described herein. On the contrary, it will be apparent to those skilled in the art that many modifications and variations are possible in light of the above teachings.

[0333] For example, additional embodiments described herein relate to methods of providing tactile feedback, methods of inducing transient synesthetic events, and the like.

[0334] Figure 12 1 is a flow chart depicting example operations of a method for creating a stimulation plan to perform a user-specific transient synesthetic event. Method 1200 can be performed by any suitable combination of hardware or software, such as those described herein. Specifically, portions of method 1200 can be performed by a portable electronic device, and other portions of method 1200 can be performed by a wearable electronic device as described herein.

[0335] Method 1200 includes operation 1202, in which data describing or including information describing an object or surface interaction event is received. The data may be generated by a virtual gaming environment, a portable electronic device, or any other suitable electronic device.

[0336] At operation 1204, one or more sensory impression locations and one or more sensory impression modalities may be determined. The location may be relative to a specific finger or body part of the user, and the modality may be pressure, temperature, texture, etc. In many cases, combinations of different locations and combinations of different modalities may be time-multiplexed or otherwise presented simultaneously to stimulate a rich and complex sensory experience.

[0337] At operation 1206, a stimulation plan can be created based on the selected morphology and the selected site. In some cases, the stimulation plan can be created by selecting one or more stimulation profiles generated in a calibration operation from a data store, such as described above. The data store can be part of the wearable electronic device or part of the portable electronic device. In some cases, the data store can be provided by a remote third-party service. More specifically, a specific target site and a specific target morphology at that site can be used to query the data store to return a specific stimulation profile. In some cases, the data store can be a lookup table or a structured database.

[0338] Stimulation plans can also be created or modified based on calibration profiles generated during a calibration operation, such as described herein. As with stimulation profiles, calibration profiles can be obtained by querying a database or data store local or remote to the wearable electronic device.

[0339] Method 1200 further includes operation 1208, wherein the stimulation plan is modified by a user-specific threshold. As an example, the stimulation plan can be modified by scaling the amplitude of the stimulation by a scalar value specific to the user. In other cases, the stimulation plan can be encapsulated or clipped so as not to exceed a specific value. For example, a user with low pain tolerance and / or high somatosensory sensitivity may have the stimulation plan clipped to a specific maximum amplitude value.

[0340] Figure 13 1300 is a flow chart depicting example operations of a method for inducing a specific transient synesthetic event in a user. Method 1300 can be performed by any suitable combination of hardware or software, such as those described herein. Specifically, portions of method 1300 can be performed by a portable electronic device, and other portions of method 1300 can be performed by a wearable electronic device as described herein.

[0341] Method 1300 includes operation 1302, wherein a user-specific (and orientation-specific) stimulation plan is provided. Next, at operation 1304, parameters associated with the stimulation plan, including amplitude, frequency, pulse frequency, pulse width, duty cycle, and / or current steering, can be determined or obtained from a database or lookup table. Next, at operation 1306, method 1300 continues by selecting at least one pair of electrodes and assigning cathode and anode responsibilities to each electrode. Additionally, method 1300 determines which signal parameters to apply to the selected electrodes. Finally, at operation 1308, the stimulation plan can be executed.

[0342] Figure 14 1400 is a flow chart depicting example operations of a method for calibrating a wearable electronic device as described herein. Method 1400 can be performed by any suitable combination of hardware or software, such as those described herein. Specifically, portions of method 1400 can be performed by a portable electronic device, and other portions of method 1400 can be performed by a wearable electronic device as described herein.

[0343] Method 1400 involves creating a calibration profile as described herein. Specifically, method 1400 includes operation 1402, in which an electronic device, such as a wearable electronic device or a portable electronic device in communication with the wearable electronic device, enters a calibration mode in which a calibration profile can be created.

[0344] Next, at operation 1404, the wearable electronic device may iterate through one or more patterns of cathode and anode assignments and may select signals to be applied to these pairs. In some examples, the wearable electronic device may iterate through one or more stimulation profiles, such as those described herein, changing cathode or anode assignments to determine the relative position of a particular electrode with respect to a sensory nerve. In these examples, in addition to electrode pairs or groupings, one or more calibration routines may also iterate through stimulation parameters, such as pulse width, pulse frequency, and pulse amplitude.

[0345] In other cases, cathodes and anodes may be assigned in pairs, and in other cases, more than one cathode may be used with one or more anodes. In other words, the positive terminal of a signal generator within a wearable electronic device as described herein may be coupled to a cathode or a group of cathodes distributed at different locations within an electrode array, and the negative terminal of the same signal generator may be coupled to one or more other electrodes that serve as their anodes.

[0346] The signal generator described herein can be implemented in several ways. In some cases, the signal generator can be implemented at least partially in software. In other cases, the signal generator can include a digital-to-analog converter, a shift register (which can be used to iterate through the sampling points of an analog waveform fed as input to a DAC), a direct digital synthesizer, or any other suitable digital-to-analog signal conversion topology. In some cases, the signal generator described herein can be configured to output a square wave or a triangle wave having a frequency, duty cycle, amplitude, phase, or other characteristics that can be digitally set or controlled by a wearable electronic device as described herein.

[0347] Once the plurality of signals generated by the signal generator are applied to the designated set of electrodes (different anode or cathode assignments are assigned for different signals), method 1400 can proceed to receive input from the wearer of the electronic device that a referred sensation has been perceived. As with other embodiments described herein, this input can be provided by the user by interacting with an affordance rendered in, for example, a graphical user interface of a portable electronic device in communication with the wearable electronic device.

[0348] In some examples, a trained machine learning model and / or sensor input can be used to determine which signals to apply, which electrodes to designate as anodes or cathodes, or which signal parameters should be increased, decreased, or otherwise modified.

[0349] For example, in some cases, over time, a wearable electronic device as described herein may determine that certain signals applied to particular electrodes do not induce desired sensations in a particular user or group of users. In these examples, a machine learning model may be trained using a previous calibration and / or stimulation profile or calibration profiles. More specifically, a dataset including labels "sensory impressions received" or "sensory impressions not received" for different calibration parameters may be used to train a machine learning model across a single user or across multiple users. In these examples, patterns may emerge that inform which signals are likely to induce sensations for particular users, particular demographics, particular environments (e.g., temperature, humidity, geographic location, etc.), and the like.

[0350] In such examples, operation 1404 may be informed, at least in part, by operation of a trained machine learning model.

[0351] In this way, method 1400 can be utilized to determine which electrodes can be used, and with which anode / cathode assignments, to stimulate sensory nerves of a particular user given a particular orientation of the wearable electronic device.

[0352] Figure 15 15 is a flow chart depicting example operations of a method for calibrating stimulation provided by a wearable electronic device as described herein. Method 1500 can be performed by any suitable combination of hardware or software, such as those described herein. Specifically, portions of method 1500 can be performed by a portable electronic device, and other portions of method 1500 can be performed by a wearable electronic device as described herein.

[0353] Method 1500 involves creating a stimulation profile as described herein. Specifically, method 1500 includes operation 1502, in which an electronic device, such as a wearable electronic device or a portable electronic device in communication with the wearable electronic device, enters a calibration mode in which a stimulation profile can be created.

[0354] Next, at operation 1504, the wearable electronic device may iterate through different signals (given a particular calibration profile that associates electrode locations with locations where sensory nerves are to be stimulated). Additionally, these iterated signals may be assigned to different cathodes and anodes. In other words, as described above, the positive terminal of a signal generator within a wearable electronic device as described herein may be coupled to a cathode or a set of cathodes distributed at different locations within an electrode array, and the negative terminal of the same signal generator may be coupled to one or more other electrodes that serve as its anode.

[0355] Thereafter, at operation 1506, input may be received from the user indicating that a particular sensory impression has been perceived.

[0356] In this way, method 1500 can be utilized to determine what type of stimulation of a particular user's sensory nerves induces which sensory modalities at which sensory sites. As with other embodiments, method 1500 can be performed at least in part by a trained machine learning model, or can be performed while utilizing output from a trained machine learning model.

[0357] Figure 16 1600 is a flow chart depicting example operations for a method of inducing disorientation using a wearable electronic device as described herein. Method 1600 can be performed by any suitable combination of hardware or software, such as those described herein. Specifically, portions of method 1600 can be performed by a portable electronic device, and other portions of method 1600 can be performed by a wearable electronic device as described herein.

[0358] Method 1600 includes operation 1602, in which a wearable electronic device is calibrated for a user's vestibular system. For example, the device can be positioned behind the user's ear, adjacent to the user's mastoid process. Thereafter, at operation 1604, a command can be received at the wearable electronic device (or another device) to stimulate the user's vestibular system to induce disorientation, nausea, or a sense of imbalance. This operation can be performed for training purposes, to enhance the discomfort associated with an entertainment experience, to induce or enhance a sense of dizziness or balance, etc. At operation 1604, the stimulation program can be executed by the wearable electronic device.

[0359] Figure 17 1700 is a flow chart depicting example operations of a method for operating a wearable electronic device based on events occurring in a virtual environment. Method 1700 can be performed by any suitable combination of hardware or software, such as those described herein. Specifically, portions of method 1700 can be performed by a portable electronic device, and other portions of method 1700 can be performed by a wearable electronic device as described herein.

[0360] Method 1700 relates to using a wearable electronic device as described herein in a virtual gaming environment. Method 1700 includes operation 1702, in which streaming data is received from a game engine. The streaming data may include information linking audiovisual stimulation with tactile or sensory effects to be induced by the wearable electronic device as described herein. Next, at operation 1704, the sensory / tactile effects may be desynchronized (stimulated out of phase) with the audiovisual effects such that the sensory effects are performed (at operation 1706) before the audiovisual effects (e.g., on the order of hundreds of milliseconds) to more accurately simulate the timing difference between the user's audiovisual response and the same user's somatosensory response.

[0361] In some cases, the delay between the induced sensory impression as described herein and the audiovisual stimulation rendered in the virtual environment may be user-specific and / or virtual environment-specific. For example, in some cases, visual stimulation can be presented closer to the induced sensory impression in time (for example, a high-speed game or a fast reaction time game, such as a racing game). In other cases, audio / visual stimulation can be presented in a specific perceived spatial position corresponding to the sensory impression position (for example, by utilizing the phase delay between the left ear channel and the right ear channel and / or by applying a head-related transfer function to an incoming audio signal). For example, before rendering the visual rendering effect of a small insect on the user's virtual hand and generating the insect sound that seems to originate from the virtual insect rendered on the back of the hand of the user's virtual hand in space, the back of the hand of the user's hand can be stimulated with a sense of pressure. In this example, the user can sense touch before audiovisual feedback confirms to the user that the virtual insect has landed on the user's virtual hand.

[0362] Figure 18 1800 is a flow chart depicting example operations of a method of operating a wearable electronic device as described herein. Method 1800 can be performed by any suitable combination of hardware or software, such as those described herein. Specifically, portions of method 1800 can be performed by a portable electronic device, and other portions of method 1800 can be performed by a wearable electronic device as described herein.

[0363] Method 1800 involves using a wearable electronic device as described herein for a physical device, such as a surgical robot, a robotic device, or a mechanical prosthesis. The method can operate in a loop, comprising operation 1802, wherein an object or surface interaction is detected at the device. In some cases, the sensing system of the device can be configured to detect the texture, pressure, and / or temperature of the object or surface being held with which the device interacts. Next, at operation 1804, the characteristics detected at operation 1802 can be induced as sensory impressions, such as those described above. In many cases, as described above, these sensory impressions can be user-specific (e.g., custom calibration profiles, custom stimulation profiles, custom stimulation plans, custom envelopes, custom clips, etc.).

[0364] Figure 19 1900 is a flow chart depicting example operations of a method for providing tactile feedback to a user of a portable electronic device. Method 1900 can be performed by any suitable combination of hardware or software, such as those described herein. Specifically, portions of method 1900 can be performed by a portable electronic device, and other portions of method 1900 can be performed by a wearable electronic device as described herein.

[0365] Method 1900 involves using a wearable electronic device as described herein with an electronic device, such as a cellular phone. The method includes operation 1902, wherein a notification is received at the portable electronic device. The notification may correspond to receiving an incoming call, a new message, an event detected by a specific application, etc.

[0366] In response to a notification received at the electronic device, at operation 1904, a stimulation program may be executed by the wearable electronic device to induce a sensory impression, thereby notifying the user of an event at the portable electronic device. For example, in response to receiving an email on the user's mobile phone, the user may perceive two taps on the back of their left hand. In another example, in response to receiving a message from a specific sender, the user may perceive circles drawn on the palm of their right hand.

[0367] These examples are not exhaustive; as those skilled in the art will appreciate, many more examples are possible.

[0368] As used herein, the phrase "at least one of" preceding a series of items, using the terms "and" or "or" to separate any one of the items, modifies the list as a whole, rather than modifying each member of the list. The phrase "at least one of" does not require selection of at least one of each item listed; in fact, the phrase allows for a meaning that includes at least one of any items, and / or at least one of any combination of items, and / or at least one of each item. For example, the phrase "at least one of A, B, and C" or "at least one of A, B, or C" each refers to only A, only B, or only C; any combination of A, B, and C; and / or one or more of each of A, B, and C. Similarly, it should be understood that the order of elements presented with respect to conjunctive or disjunctive lists provided herein should not be construed to limit the disclosure to only the order provided.

[0369] It should be understood that although many embodiments are disclosed above, the operations and steps proposed with respect to the methods and techniques described herein are intended to be exemplary and therefore not exhaustive. It should also be understood that alternative step orders or fewer or additional operations may be required or desired for certain embodiments.

[0370] Although the above disclosure is described with respect to various exemplary embodiments and implementations, it should be understood that the applicability of the various features, aspects, and functionalities described in one or more of the individual embodiments is not limited to the specific embodiment described therewith, but rather may be applied alone or in various combinations to one or more of some embodiments of the present invention, whether or not such embodiments are described and whether or not such features are present as part of the described embodiments. Accordingly, the breadth and scope of the present invention should not be limited by any of the above exemplary embodiments, but rather be defined by the claims set forth herein.

[0371] In addition, it should be understood that organizations and / or entities responsible for accessing, aggregating, verifying, analyzing, disclosing, transmitting, storing, or other uses of private data, such as those described herein, will preferably adhere to published and industry-established privacy, data, and network security policies and practices. For example, it should be understood that data and / or information obtained from remote or local data sources may only be accessed and aggregated for lawful, agreed-upon, and reasonable purposes with the informed consent of the subjects of the data and / or information.

[0372] As used herein, the term "processing resource" refers to any physical and / or virtual electronic device or machine component suitable for performing or causing one or more arithmetic or logical operations to be performed on digital data, or a collection or group of interconnected and / or communicatively coupled physical and / or virtual electronic devices or machine components.

[0373] Example processing resources contemplated herein include, but are not limited to: single-core or multi-core processors; single-threaded or multi-threaded processors; specially configured coprocessors (e.g., graphics processing units, motion processing units, sensor processing units, etc.); volatile or non-volatile memory; application-specific integrated circuits; field-programmable gate arrays; input / output devices and their systems and components (e.g., keyboards, mice, touchpads, general-purpose human interface devices, cameras, microphones, speakers, etc.); networking devices and their systems and components (e.g., routers, switches, firewalls, packet shapers, content filters, network interface controllers or cards, access points, modems, etc.); embedded devices and their systems and components (e.g., systems on chips, IoT devices, etc.); devices, etc.); industrial control or automation devices and their systems and components (e.g., programmable logic controllers, programmable relays, supervisory control and data acquisition controllers, discrete controllers, etc.); vehicle or aviation control device systems and their components (e.g., navigation devices, safety devices or controllers, security devices, etc.); corporate or commercial infrastructure devices or appliances (e.g., private branch exchange devices, Internet protocol call hosts and controllers, end-user terminals, etc.); personal electronic devices and their systems and components (e.g., cellular phones, tablet computers, desktop computers, laptop computers, wearable devices); personal electronic devices and their accessories (e.g., peripheral input devices, wearable devices, implantable devices, medical devices, etc.); etc. It should be understood that the foregoing examples are not exhaustive.

[0374] More generally, as used herein, the term "processor" refers to any software and / or hardware-implemented data processing device or circuitry that is physically and / or structurally configured to instantiate one or more classes or objects that are specifically configured to perform specific transformations on data, including operations represented as code and / or instructions contained in a program storable in and accessible from memory. The term is intended to encompass a single processor or processing unit, multiple processors, multiple processing units, analog or digital circuitry, or other suitably configured computing element or combination of elements.

[0375] Similarly, as used herein, the term "memory" refers to any software and / or hardware implemented data storage device or circuitry that is physically and / or structurally configured to store digital information, whether structured or unstructured.

[0376] In addition, the foregoing examples and descriptions of instances of specially configured software, whether accessible via an application programming interface (API) as a request-response service, an event-driven service, or configured as a self-contained data processing service, are understood to be non-exhaustive. In other words, those skilled in the art will appreciate that the various functions and operations of the systems described herein, for example, can be implemented in a number of suitable ways, using any number of suitable libraries, frameworks, first or third-party APIs, local or remote databases (whether relational, NoSQL or other architectures or combinations thereof), programming languages, software design techniques (e.g., procedural, asynchronous, event-driven, etc. or any combination thereof), etc. to develop. The various functions described herein can be implemented in the same manner (as an example, using a general-purpose language and / or design) or in different ways. In many embodiments, the functions of the systems described herein are implemented as discrete microservices that can be containerized or executed / instantiated using discrete virtual machines, responding only to authenticated API requests from other microservices of the same system. Similarly, each microservice can be configured to provide data output and receive data input across an encrypted data channel. In some cases, each microservice can be configured to store its own data in a dedicated encrypted database; in other cases, microservices can store encrypted data in a common database; whether such data is stored in a table shared by multiple microservices or whether microservices can utilize independent and separate tables / schemas can vary from embodiment to embodiment. Given these described architectures and other equivalent architectures, it should be understood that systems such as those described herein can be implemented in a number of suitable ways. To simplify the description, many of the embodiments below are described with reference to an embodiment in which discrete functions of the system are implemented as discrete microservices. It should be understood that this is merely one possible embodiment.

Claims

1. A wearable electronic device for stimulating referred sensations, the wearable electronic device comprising: a housing defining an outer surface configured to conform to a skin surface contour of a user; an electrode array extending at least partially through the outer surface to contact the skin surface; a memory resource storing at least one executable asset; as well as a processing resource operatively coupled to the memory resource and configured to cooperate with the memory resource to access the at least one executable asset to instantiate a software instance, the software instance being configured to: determining a sensory impression site at which a sensation is to be induced, the sensory impression site being distal to a stimulation site above a sensory nerve of the user, the sensory nerve innervating the sensory impression site; determining a sensory impression modality corresponding to a type of sensation to be induced for the user at the sensory impression location; querying a first data store with the sensory impression site and the sensory impression modality to retrieve a stimulation profile including a magnitude and polarity of an electric current such that inducing the electric current in the sensory nerve causes an afferent signal that induces a sensory impression localized to the sensory impression site, the sensory impression corresponding to the sensory impression modality; querying a second data storage area with the stimulation profile to retrieve a calibration profile, the calibration profile comprising information related to positions of electrodes of the electrode array relative to the user when the user wears the wearable electronic device; querying a third data storage area to obtain a user-specific profile, the user-specific profile including thresholds defining limits for the magnitude of the current of the stimulation profile; creating a stimulation plan using the stimulation profile, the user-specific profile, and the calibration profile, the stimulation plan including parameters defining at least one signal to be applied to a selected pair of electrodes of the electrode array to induce a current having the magnitude and polarity defined by the stimulation profile at the sensory nerve to induce the afferent signal; and The stimulation program is executed by generating the at least one signal and applying the at least one signal to the selected pair of electrodes. 2 . The wearable electronic device of claim 1 , wherein the housing has a ring shape, and the wearable electronic device is configured to be worn on a finger of the user. 3 . The wearable electronic device according to claim 2 , wherein the finger is an index finger or a middle finger, and the sensory nerve is a median nerve. The wearable electronic device according to claim 2 , wherein the sensory impression site is a fingertip of the user. The wearable electronic device according to claim 1 , wherein the wearable electronic device is configured to be worn on a wrist of the user. 6 . The wearable electronic device of claim 1 , wherein a first electrode of the electrode array is formed of a first metal, and a second electrode of the electrode array is formed of a second metal. The wearable electronic device of claim 1 , wherein the user-specific profile includes a maximum current that can be induced.

8. The wearable electronic device of claim 1 , wherein the software instance is configured to receive a signal from a separate electronic device, the signal comprising instructions to induce a sensory impression in the user, the sensory impression comprising the sensory impression modality and the sensory impression location.

9. The wearable electronic device of claim 8, wherein the separate electronic device comprises a virtual computing environment.

10. The wearable electronic device according to claim 1, wherein the sensory impression modality is selected from: impression of pressure; Temperature impression; Texture impression; or Time-varying mechanical impression.

Images