Wearable electronic device for inducing temporary sensory events as user feedback

Abstract

The wearable electronic device includes an electrode array for transcutaneous stimulation of a sensory nerve that innervates a body part distal to the location where the wearable electronic device is worn. The transcutaneous stimulation is configured to induce a current or voltage that elicits a sensory impression in the area innervated by the sensory nerve, rather than in the stimulated sensory nerve itself. In one implementation, the wearable electronic device takes the form of a finger ring worn on the proximal phalanx of the index finger. In this configuration, the wearable electronic device can stimulate a portion of a branch of the median nerve that extends through the index finger. When the median nerve is stimulated, the user wearing the finger ring can perceive the pressure applied to the user's fingertip.

Description

Technical Field

[0001] Cross - Reference to Related Applications This Patent Cooperation Treaty patent application claims priority to U.S. Non - Provisional Patent Application No. 17 / 838,116, filed on June 10, 2022, entitled "Wearable Electronic Device for Inducing Transient Sensory Events as User Feedback", the content of which is hereby incorporated by reference in its entirety.

[0002] The embodiments described herein relate to systems and methods for providing sensory feedback to a user of an electronic device, and more particularly, to wearable and / or implantable electronic devices (or combinations thereof) configured for transcutaneous or direct electrical stimulation of sensory nerves, thereby evoking a transient reference sensation (transient sensory event) at a perceived sensory impression site remote from the location of the wearable or implantable electronic device.

Background Art

[0003] Mechanical feedback provided by conventional tactile elements, such as eccentric weighted motors or linear actuators, can enhance virtual reality or augmented reality experiences. As a result, many conventional virtual reality controllers, game controllers, and wearable gaming devices (e.g., tactile gloves, head - mounted displays, tactile body suits) incorporate one or more tactile elements.

[0004] However, the conventional mechanical tactile feedback provided by conventional tactile elements is coarse and does not evoke a natural feeling. Further, many conventional control devices and wearable gaming devices significantly limit the natural range of motion, are electrically and mechanically complex, are often costly to purchase and maintain, difficult to store, and have complex configurations and operations. Further, many conventional wearable gaming devices are bulky and visually obstructive (e.g., tactile gloves) and may not be suitable for simulating a convincing augmented reality experience. SUMMARY OF THE INVENTION

[0005] Embodiments described herein take the form of wearable electronic devices. A wearable electronic device can include a housing that defines an outer surface configured to follow the contours of the user's skin surface. A wearable electronic device can also include an electrode array that extends at least partially through the outer surface so as to contact the skin surface.

[0006] A wearable electronic device can further include memory resources that store at least one executable asset and processing resources operably coupled to the memory resources and configured to cooperate with the memory resources to access the at least one executable asset and instantiate an instance of software.

[0007] Once instantiated, the software selects, without limitation, a sensory impression site (e.g., the site where the wearer of a wearable electronic device, referred to as the "user", should perceive sensory events that occur), selects a sensory impression modality (e.g., pressure, temperature, vibration, or other time-varying mechanical effects, texture, etc.), queries a data store using the sensory impression site and the sensory impression modality to retrieve a stimulation profile having a magnitude and polarity of an electric current that, when applied to the user's sensory nerves, elicits a sensory impression corresponding to the sensory impression modality at the sensory impression site, queries a data store (which may be the same or a different data store) using the stimulation profile to retrieve a calibration profile having information regarding the position of the sensory nerves relative to the positions of the electrodes of an electrode array (e.g., worn by the user), creates a stimulation plan using the stimulation profile and the calibration profile, the stimulation plan having parameters that define at least one signal for applying, across selected electrode pairs of the electrode array, an electric current having a magnitude and polarity defined by the stimulation profile to induce in the sensory nerves, generates the at least one signal, and is configured to execute the stimulation plan by applying the at least one signal across the selected electrode pairs.

[0008] As a result of this configuration, the wearable electronic device can induce a specific electric current on demand or in response to an input or trigger within a specific region of a specific sensory nerve of the user, thereby stimulating the nerve to evoke a sensory impression occurring at another location on the user's body. For example, the wearable electronic device can take the form factor of a finger ring. In this example, the ring can stimulate a portion of the finger nerve that then innervates the fingertips of the index or middle finger. By stimulating the median nerve in a specific manner using a specific electric current, the user can perceive a sensory impression at the user's fingertips.

[0009] In another non-limiting representation, the wearable electronic device can be configured to stimulate the median nerve in a way that mimics the sensory signals carried from the fingertip to the brain via the median nerve in response to the fingertip pressing on an object. By simulating the median nerve in the same way, the brain can experience a "temporary synesthesia event" in which it perceives sensory input to a part of the user's finger that is distal to the wearable electronic device. More simply, by transcutaneously stimulating the user's median nerve at one or more locations (e.g., the user's wrist, palm side, dorsal side, or other locations), an erroneous sensory impression (e.g., a temporary sensation / synesthesia event) that is perceived as originating from the fingertip can be evoked. As used herein, the terms "synesthesia" and "synesthetic" refer to a sensory impression or evocation generated in one part of the body in response to stimulation of another part of the body. For example, stimulating the proximal phalanx of a finger evokes a sensation in the distal or middle phalanx of the same finger.

[0010] Related and additional embodiments include configurations in which the housing has an annular shape and the wearable electronic device is configured to be worn on the user's finger. In one example, the finger may be the index finger or the middle finger, and the sensory nerve may be the median nerve. In other cases, other digital nerves associated with other fingers can be used.

[0011] Related and additional embodiments include configurations in which the wearable electronic device can be configured to be worn on the user's wrist, such as within a cuff or bracelet.

[0012] Some embodiments include configurations in which a first electrode of an array of electrodes can be formed from a first metal or metal alloy, and a second electrode of the array of electrodes can be formed from a second metal or metal alloy. The first and second metals may be different in some structures.

[0013] Embodiments may include a configuration in which an instance of software is configured to modify the magnitude of a current based on a user-specific profile. More specifically, the envelope of the current can be set so that the induced current does not exceed a user-specific maximum value. The user-specific value can be set by the user.

[0014] Certain embodiments include a configuration in which an instance of software is configured to receive a signal from a separate electronic device and provide feedback to the user as a evoked or induced sensation or perception. The separate electronic device may include, and / or be configured to operate with, a virtual computing environment such as a virtual reality gaming environment.

[0015] Some embodiments described herein take the form of a method for providing sensory feedback to a user of a wearable electronic device. The method includes receiving an instruction to provide sensory feedback to the user, selecting a sensory impression site at least partially based on the instruction, and based on the sensory impression site, receiving a stimulation profile having characteristics of a current that, when transcutaneously induced in the user's sensory nerves by the operation of two or more electrodes in contact with the user's skin, evokes a pressure sensory impression at the sensory impression site, receiving a calibration profile having information associating the position of the sensory nerves with the positions of the two or more electrodes, using the stimulation profile and the calibration profile to generate a stimulation plan having parameters defining at least one signal to be applied across the two or more electrodes to induce a current (or potential gradient) in the sensory nerves, generating the at least one signal, and executing the stimulation plan by applying the at least one signal across the two or more electrodes, and the like.

[0016] Some embodiments described herein take the form of a method of providing sensory feedback using a wearable electronic device positioned over a sensory nerve innervating a user's hand in response to the occurrence of an event in a virtual reality environment, the method operations including receiving, from the virtual reality environment, a signal corresponding to the event, and generating a stimulation schedule having parameters defining at least one electrical signal for application across two or more electrodes in contact with the user's skin to induce a potential in the sensory nerve, the current being selected to evoke a sensory impression at the user's fingertips, and executing the stimulation schedule in response to the event.

[0017] Certain embodiments include a configuration in which the induced current has a pulse width, duty cycle, pulse amplitude, frequency, and polarity selected to evoke a sensory impression.

[0018] Some embodiments described herein take the form of a wearable electronic device that includes a first adjustable ring defining a first inner surface and having a first electrode that projects from the first inner surface and is configured to contact a first finger of a user. The wearable device may also include a second adjustable ring that defines a second inner surface and has a second electrode that projects from the second inner surface and is configured to contact a second finger of the user. The wearable device may have a harness positioned on the user's hand that includes a circuit operably coupled to the first and second electrodes, and a harness cover positioned on a flexible circuit. In some examples, the wearable device has a chamber coupled to the harness and positioned on the wrist that houses a battery, a contact structure, and an electrical circuit operably coupled to the circuit and configured to communicatively couple to memory resources and processing resources. In some cases, the processing resources cooperate with the memory resources to instantiate an instance of software configured to access at least one executable asset and perform a stimulation on at least the first electrode, the stimulation evoking a sensory impression in a region of the first finger distal to the first electrode.

[0019] Certain embodiments include a configuration in which the first adjustable ring defines a first tab and a second tab, and the first and second tabs each extend from an outer surface of the first adjustable ring opposite the first inner surface. In some examples, the ring has a default configuration and a worn configuration. In the default configuration, the diameter of the first adjustable ring may be a first length, and in the worn configuration, the diameter of the first adjustable ring is a second length greater than the first length. The adjustable ring may have a portion of its wall that overlaps a second portion of the wall of the first adjustable ring. In some cases, the first adjustable ring may define a first tab and a second tab, and the first and second tabs each extend from an outer surface of the first adjustable ring opposite the first inner surface, and the outer surface defines a channel configured to fix the position of the first tab relative to the second tab.

[0020] Some embodiments include a configuration where the contact structure is an anode configured to contact the user's skin, and the anode defines a current feedback path from each of the first and second electrodes. As another example, the first connector can couple a first adjustable ring to the flexible circuit, and the second connector can couple a second adjustable ring to the flexible circuit. The harness cover may further include a flexible fabric, and the chamber may be coupled to a flexible band configured to wrap around the wrist.

[0021] Some embodiments described herein take the form of a wearable electronic device having at least two adjustable rings configured to be worn on each of the user's fingers, and each adjustable ring may include an array of electrodes. The array of electrodes can define a portion of the inner surface of each of the at least two adjustable rings and is configured to contact the user's finger. The device also includes a harness having a flexible circuit operably connecting each array of electrodes to a stimulation board and a battery, and a stimulation board operably coupled to the flexible circuit and configured to communicatively couple to memory resources and processing resources, where the processing resources are configured to cooperate with the memory resources to instantiate an instance of software configured to access at least one executable asset and perform a stimulation on each respective array of electrodes, the stimulation being configured to evoke a sensory impression in a region of each finger distal to each respective array of electrodes, and a housing coupled to the flexible circuit and configured to house the stimulation board and the battery.

[0022] In certain examples, each electrode of the array of electrodes defines a cylindrical profile. In some cases, at least two adjustable rings include wires that extend around the outer circumference of each adjustable ring of the at least two adjustable rings, and each adjustable ring of the at least two adjustable rings includes adjustment tabs configured to adjust the size of each adjustable ring. In a particular configuration, the sensory impression in each finger region is the user's fingertip. Also, an instance of software may be configured to receive signals from a separate electronic device, and the signals may include instructions to evoke a sensory impression that includes a sensory impression modality and a sensory impression region. In some cases, the separate electronic device includes a virtual computing environment.

[0023] Certain embodiments include a configuration in which the sensory impression modality is selected from a pressure sensory impression, a temperature sensory impression, a texture sensory impression, or a time-varying mechanical sensory impression.

[0024] Some embodiments described herein take the form of a wearable device having a first adjustable ring, a second adjustable ring, a flexible circuit, a battery, a communication module, and an anode. The first adjustable ring may have a first array of electrodes configured to contact a first finger of a user. The second adjustable ring may have a second array of electrodes configured to contact a second finger of the user, different from the first finger. The flexible circuit may be operably coupled to each of the first and second arrays of electrodes and may extend from a part of the user's hand to the user's wrist. In some cases, the communication module is operably coupled to the flexible circuit and the battery, and the communication module is communicatively coupled to memory resources and processing resources. The processing resources, in cooperation with the memory resources, can be configured to instantiate an instance of software configured to access at least one executable asset and perform a stimulation on the first and second electrode arrays, the stimulation evoking a sensory impression in a region of each finger distal to the respective electrode array. In some examples, the anode is configured to contact the user's wrist and may be secured via an adjustable strap.

[0025] According to some embodiments, the first electrode of the first array of electrodes may be formed from a first metal, and the second electrode of the array of electrodes may be formed from a second metal. Further, in other examples, the harness cover may sandwich the flexible circuit, and the harness cover includes a knit material. In some cases, the first connector electrically couples the first adjustable ring to the flexible circuit, and the sheath is coupled to the first adjustable ring and the harness cover and covers the first connector.

[0026] Certain embodiments include a configuration in which the flexible circuit is mechanically coupled to a housing configured to be worn on the user's wrist, the housing defines an opening, and the anode extends through the opening of the housing.

[0027] As another example, the first electrode array may have a pair of electrodes along the height of the first adjustable ring, and each pair of electrodes may be separated from an adjacent pair of electrodes at an angle of 35 degrees to 65 degrees.

[0028] Here, reference is made to the exemplary embodiments shown in the accompanying drawings. It should be understood that the following description is not intended to limit the present disclosure to one included embodiment. On the contrary, the disclosure provided herein is intended to cover alternatives, modifications, and equivalents as may be included within the spirit and scope of the described embodiments and as defined by the appended claims.

Brief Description of the Drawings

[0029]

Figure 1

Figure 2

Figure 3

Figure 4A

Figure 4B

Figure 4C

Figure 4D

Figure 4E

Figure 4F

Figure 4G

Figure 4H

Figure 4I

Figure 4J

Figure 4K

Figure 4L

Figure 4M

Figure 4N

Figure 4O

Figure 4P

Figure 5

Figure 6

Figure 7A

Figure 7B

Figure 7C

Figure 7D

Figure 7E

Figure 7F

Figure 7G

Figure 8A

Figure 8B

Figure 8C

Figure 9A

Figure 9B

Figure 10A

Figure 10B

Figure 11

Figure 12

Figure 13

Figure 14

Figure 15

Figure 16

Figure 17

Figure 18

Figure 19

[0030] The use of the same or similar reference numerals in different figures indicates similar, related, or identical items.

[0031] The use of cross-hatching or shading in the accompanying drawings is generally provided to clarify the boundaries between adjacent elements and to facilitate the readability of the drawings. Thus, the presence or absence of cross-hatching or shading does not indicate or convey any preference or requirement for a particular material, material property, ratio of elements, dimensions of elements, commonality of elements shown, or any other feature, attribute, or property of any element shown in the accompanying drawings.

[0032] In addition, the ratios and dimensions (either relative or absolute) of various features and elements (and their assemblies and groupings), as well as the boundaries, separations, and positional relationships presented therebetween, are provided in the accompanying drawings solely to facilitate the understanding of the various embodiments described herein. Thus, they are not necessarily presented or illustrated to scale and are not intended to indicate any preference or requirement for the embodiments described with reference thereto, excluding the embodiments illustrated.

Best Mode for Carrying Out the Invention

[0033] The embodiments described herein relate to a method for providing sensory feedback to a user of an electronic device or computing system. In particular, many of the embodiments described herein, in many examples, include a wearable electronic device or accessory that includes an array of electrodes disposed to surround a sensory nerve within a first body part that innervates a second body part distal to the first body part.

[0034] As a result of this configuration of the wearable electronic device and the sensory nerve and their relative positioning, the application of a particular electrical signal (having a particular voltage, amplitude, pulse width, duty cycle, etc.) to a particular set of electrodes of the array can induce a current or potential difference across the sensory nerve so as to locally increase the membrane potential of the nerve, thereby inducing a depolarization that mimics afferent signaling from the distal region innervated by the sensory nerve. More specifically, the induced electrical signal stimulates the sensory nerve of the first body part in substantially the same manner as the same nerve is stimulated by an afferent signal originating from a second body part.

[0035] As a result of this configuration, the use of the wearable electronic device can evoke a sensory impression that is perceived to be occurring at a site separated from the wearable electronic device.

[0036] The embodiments described herein utilize this configuration to, among other applications, enhance the experience of operating an electronic device, receive feedback and / or notifications from an electronic device (e.g., a mobile phone, a laptop computer, etc.), improve the sense of immersion within a virtual reality or augmented reality environment, or provide real-time sensory feedback to an operator of a remote device such as a robotic arm or an artificial device.

[0037] In a more simplistic and non-limiting expression, the embodiments described herein are configured to induce action potentials in sensory nerves that result in a sensory impression perceived as occurring in another part of the body by the application of an electrically applied signal (or, in the case where a stimulating electronic device is implanted, direct stimulation). Thus, as described herein, the act of temporarily stimulating one body part to evoke a sensory impression perceived as originating from another body part is referred to as a "temporary synesthesia event" or an "induced temporary synesthesia event". As described above, when used herein, the terms "synesthesia" and "synesthetic" refer to a sensory impression or evocation generated in one part of the body in response to the stimulation of a different part of the body. For example, stimulating the proximal phalanx of a finger to evoke a sensation in the distal or middle phalanx of the same finger. In another example, stimulating the superficial nerve of the wrist to evoke a sensation in the palm, fingers, or nail bed.

[0038] More broadly, many of the embodiments described herein refer to the stimulation of a section of a peripheral nerve to induce a sensation perceived as originating from a mechanoreceptor distal to that section of the peripheral nerve.

[0039] The sensations evoked by the stimulation as described herein can vary from embodiment to embodiment or from stimulation to stimulation. By modifying the position, frequency, pulse width, pulse amplitude, current, voltage, and / or other characteristics of the signal or combination of signals applied to the electrodes of the electrode array as described herein, different sensations can be evoked at different perceived sensory impression sites. Thus, as described herein, the phrase "sensory impression modality" refers to the type of sensory impression evoked in the user (e.g., pressure sensation, paresthesia, vibration sensation, temperature change sensation, etc.), and the phrase "sensory impression site" refers to the location where the user perceives the specific sensory impression evoked. Similarly, the "stimulation site" refers to the site where the stimulation of a specific sensory nerve (either transcutaneous or direct or any combination thereof) occurs.

[0040] For example, in one embodiment, a wearable electronic device attached to the proximal phalanx of the right index finger is used to generate a first set of signals (which can change over time) via its electrode array to stimulate a branch and / or cross-section of the median nerve passing through the proximal phalanx so as to evoke a paresthesia at the fingertip of the user's right index finger. In this example, the stimulation site is the proximal phalanx, the sensory impression site is the fingertip (e.g., the distal phalanx), and the sensory impression modality is paresthesia.

[0041] In another embodiment, a wearable electronic device attached to the proximal phalanx of the right index finger is used to generate a second set of signals via its electrode array to stimulate a branch and / or cross-section of the median nerve passing through the proximal phalanx so as to evoke a temperature change sensation at the fingertip of the user's right index finger. In this example, the stimulation site is still the proximal phalanx, and the sensory impression site is still the fingertip (e.g., the distal phalanx), but in this example, the sensory impression modality is a thermal sensation.

[0042] In another embodiment, a wearable electronic device attached to the proximal phalanx of the right index finger is used to generate a third set of signals via its electrode array to stimulate a branch and / or cross-section of the median nerve passing through the proximal phalanx so as to evoke a pressure sensation at the fingertip of the user's right index finger. In this example, the stimulation site is still the proximal phalanx, and the sensory impression site is still the fingertip (e.g., the distal phalanx), but in this example, the sensory impression modality is a pressure sensation.

[0043] In another embodiment, a wearable electronic device attached to the proximal phalanx of the right index finger is used to generate a fourth set of signals via its electrode array to stimulate a branch and / or cross-section of the median nerve passing through the proximal phalanx so as to evoke a pressure sensation at the middle phalanx of the user's index finger. In this example, the stimulation site is still the proximal phalanx, the sensory impression site is the middle phalanx, and the sensory impression modality is a pressure sensation.

[0044] In another embodiment, a wearable electronic device worn on the wrist of the right arm can be used to generate a sixth set of signals via its electrode array to stimulate branches and / or sections of the ulnar nerve to evoke a vibration sensation in the user's little finger. In this example, the stimulation site is the user's wrist, the sensory impression site is the user's little finger, and the sensory impression modality is vibration sensation. In some embodiments, the vibration sensation can be evoked by pulsing a set of signals that would otherwise evoke a pressure sensation.

[0045] In addition to these aforementioned embodiments, different sensory impression modalities and sensory impression sites can be stimulated simultaneously in the user, for example a thermal impression can be multiplexed with a pressure sensation at the same or different impression sites to evoke a combined sensory impression.

[0046] In other cases, the sensory impression site may move or shift during stimulation such that the user perceives that the sensory impression modality is moving (e.g., a pressure sensation beginning at the user's fingertip and drawing toward the user's palm).

[0047] In yet another example, different sensory impression modalities and different sensory impression sites may be stimulated in a particular sequence or pattern to induce an overall higher order tactile effect.

[0048] In some further examples, transcutaneous motor nerve stimulation can be provided in parallel with sensory nerve stimulation to simultaneously move the user's body and evoke sensations within it, as described herein. For example, a flexion or extension can be induced in a finger in parallel with a pressure sensation on the fingertip. This combination of motor nerve stimulation and sensory nerve stimulation can evoke the sensation of the presence of a physical object touching the user's finger and deflecting the user's finger by a certain amount.

[0049] Furthermore, in some embodiments, both direct and transcutaneous stimulation can be used in concert to evoke a particular sensory impression. For example, a sensory nerve stimulation implant can be communicatively coupled to a wearable electronic device positioned over the implant (e.g., in one example, inductively powered thereto) or worn elsewhere. In these configurations, the implanted device and the wearable electronic device can operate in concert to provide the user with rich feedback (either movement or sensation or a combination thereof).

[0050] More generally and broadly, the operation of a wearable electronic device as described herein to stimulate one body part to evoke a sensory impression perceived as arising from another body part can be described as “mobilizing” neural action from sensory nerves and inducing a “reference stimulation” of nerves innervated by the mobilized nerves.

[0051] As an example, a wearable electronic device as described herein can take the form factor of a finger ring. One or more concentric rings of electrodes can be defined along the inner skin contact surface of the finger ring. When the wearable electronic device is placed on the proximal phalanx of the index or middle finger, at least a portion of the digital nerve (which innervates the fingertip; the median nerve) passes through the central portion of the ring.

[0052] More specifically, in this example, the median nerve passes through an array of circumferentially distributed electrodes. By applying specific electrical signals across specifically selected pairs or groups of these electrodes, the median nerve can be stimulated as described above in a manner that causes the wearer of the ring to perceive that the fingertips of the index finger or middle finger are interacting with a physical object. This artificial sensory impression can be perceived by the wearer as a familiar somatosensory experience such as experiences of pressure, temperature, texture, etc. In this way, the wearable electronic device recruits the median nerve to provide a reference sensation at the fingertips. In other words, in this way, the wearable electronic device induces a temporary synesthetic event that causes the user to perceive that the user's fingertips are interacting with a physical object.

[0053] More generally and broadly, in a more simple and non-limiting expression, the embodiments described herein relate to electronic devices that induce a somatosensory experience in a user of those electronic devices without requiring any part of the electronic device to physically contact a site where a somatosensory experience is perceived to occur.

[0054] For example, in one embodiment, a wearable electronic device as described herein may be implemented as a wrist-mounted cuff with an electrode array disposed over and / or around a superficial nerve that innervates the hand (e.g., radial, ulnar, median). By applying specific electrical signals (user-specific in many embodiments) to specific sensory nerves, any number of suitable induced synesthetic experiences can be evoked.

[0055] For example, the wearable electronic device can induce a first perception of pressure on the palm side of the user's thumb and a second perception of pressure on the palm side of the user's index finger. This can cause the user to perceive that a physical object is being gripped between the thumb and the index finger.

[0056] In another example, the wearable electronic device can induce the perception of heat and pressure at the fingertip of the index finger. This can let the user perceive that they are touching a hot object. In this example, the electrical signaling associated with stimulating the nerves mobilized to induce the perception of heat can be multiplexed with the electrical signaling associated with stimulating the nerves mobilized to induce the perception of pressure.

[0057] In yet another example, the wearable electronic device may induce the perception of a rough texture. This can let the user perceive that they are physically touching an object with a rough texture.

[0058] These aforementioned examples do not cover all the sensory experiences that can be evoked by wearable electronic devices as described herein or in some other way. It can be understood that by appropriately stimulating the mobilized nerves, any combination of sensory impressions can be induced. In particular, the modality of the sensory impression (e.g., the type of sensation being simulated) and the site of the sensory impression (e.g., the location where a particular sensation should be perceived as occurring) can be changed and controlled by modifying the stimulation parameters.

[0059] It will also be understood that the wearable electronic devices described herein can be used for a plurality of suitable purposes. For example, the wearable electronic device can be communicatively coupled directly or indirectly to the event stream of a virtual reality environment such that whenever a virtual character controlled by the movements of a user of a virtual reality system interacts with a virtual object, the wearable electronic device can stimulate one or more nerves in the user's hand to evoke in the user the sensation of physically touching and interacting with the virtual object.

[0060] In such an example, one or more wearable electronic devices may be configured to operate to stimulate sensory nerves in a plurality of ways to create sensory impressions such as, for example, temperature, texture, pressure, etc. In some cases, a sense of weight can be simulated by increasing the sensation of pressure on the lower side of an object relative to the upper side of the object.

[0061] In other cases, a virtual reality environment may be configured to send signals directly to the wearable electronic devices as described herein in substantially the same way that a conventional virtual reality environment sends signals to a conventional tactile or haptic device. In such an example, an event stream can be sent from a computing device associated with the virtual reality environment, the event stream including a structured data object that defines one or more physical interactions between a game character and a game object (or another game player). For example, the game character may carry a tool or weapon that can have different physical properties that can be used to notify the induction of one or more tactile responses or one or more temporary synesthetic events. In some cases, the tactile feedback or output information may be encoded within an audio or visual stream of data.

[0062] In some embodiments, a wearable electronic device as described herein may be configured to analyze or otherwise extract an event stream of a game (virtual reality, augmented reality, or otherwise) to infer when one or more transient synesthetic events should be induced for a user. In some cases, the evoked sensory impressions may be triggered in direct response to an audio or visual signal. For example, a trained machine learning algorithm can determine from a video stream whether a user's virtual hand contacts a virtual object. In response to such a determination, a sensory impression can be evoked in one or more of the user's fingers, as described herein. In another example, sound can be used to infer that a sensory impression should be evoked. Many configurations and / or triggers (directly, indirectly, or by implication) for initiating sensory impressions as described herein are possible.

[0063] In yet other examples, the wearable electronic devices described herein can be configured to provide sensory experiences not related to gaming. For example, in some embodiments, the wearable electronic devices described herein can be configured to detect sensory input and stimulate sensory nerves as described above. In these embodiments, for example, two different wearable electronic devices can be coupled to each other directly or indirectly to simulate physical contact over a long distance. For example, family members may be able to effectively experience holding hands at a distance. In other examples, a user's gesture or action can be recorded and later played back for another user.

[0064] For example, a parent, grandparent, or friend may be able to record affectionate gestures such as tracing a heart shape on the palm of the recipient's hand, squeezing a part of the recipient's hand, or tapping in a particular personally meaningful pattern for a child, grandchild, or friend, which can later be played back and re-experienced on demand by the child, grandchild, or friend, potentially after the parent, grandparent, or friend has passed.

[0065] In still other embodiments, the wearable electronic device described herein can be utilized as a notification device or a tactile feedback device. For example, the wearable electronic device can be configured to communicatively couple to a personal electronic device such as a mobile phone. In these configurations, the mobile phone can utilize the wearable electronic device to notify the user of events such as incoming calls. In one example, the wearable electronic device can be configured to cause a perception of a light tapping on the back of the user's hand when the user is receiving a call or a video conference call.

[0066] In still other embodiments, the wearable electronic device can be used to enhance the experience of interacting with physical objects. For example, a wearable electronic device as described herein can provide a sensation of pressing a physical key when the user presses a stationary flat touch screen.

[0067] In another example, the wearable electronic device can be configured to assist with direction finding. For example, the wearable electronic device can be configured to cause the user to perceive a tap on the right hand when the user intends to turn right and a tap on the left hand when the user intends to turn left.

[0068] In another example, direction finding can be provided using a thermal sensory experience. For example, the user can experience a cold sensation on the index finger when the user is oriented in the wrong direction, but the user can experience a warm sensation on the index finger when the user is oriented in the correct direction.

[0069] These foregoing exemplary embodiments do not cover all use cases of the devices, architectures, and systems described herein, and it can be understood that many configurations and uses are possible. For example, in some cases, the sensory impressions as described herein can be presented along with conventional media such as music, movies, artworks, or live performances. In such cases, different sensory impression modalities and / or different sensory impression sites can be selected to enhance and / or complement the experience of consuming the conventional media.

[0070] For example, the form factor of a finger ring is merely an example of a form factor. Other form factors include, but are not limited to, gloves, glovelets, harnesses worn on the hand and including adjustable rings, multi-finger rings, bands on finger joints connected to rings, wrist-worn devices, implanted devices, sleeve devices, ankle cuff devices, etc. These form factors can include other components such as a housing, circuitry, battery, and stimulation board configured to induce a sensory impression on a distal body part. Generally, broadly, it should be understood that wearable electronic devices as described herein can be suitably configured to couple to any body part via any suitable sensory nerve and induce a sensory impression in another body part distal to (and thereby innervated by) it.

[0071] In some examples, wearable electronic devices as described herein can be positioned behind the user's ear to interact with the vestibular system. In these examples, stimulation of the sensory nerve can cause a sense of disorientation and / or balance. Such embodiments can be used to supplement the experience of watching a video or playing a game in the suspense or horror genre. In some examples, such embodiments described herein can also be used to enhance proprioception (e.g., in some cases, operate in parallel with a motor nerve stimulation system to induce a specific flexion or extension and / or prevent or impede a spontaneous flexion or extension).

[0072] For simplicity of explanation, many of the following embodiments refer to finger ring form factor wearable electronic devices configured for use with a virtual computing environment, particularly a virtual reality environment. However, this is merely one exemplary implementation, and it is understood that the embodiments described herein may be suitably modified for a plurality of use cases.

[0073] Further embodiments described herein relate to field calibration of the wearable electronic devices described herein. In particular, it relates to determining the relative position of the electrodes with respect to the relative position of the sensory nerves. In many embodiments, such a calibration process may be facilitated by a portable electronic device, such as a mobile phone, communicatively coupled to a wearable electronic device as described herein. In these configurations, the wearable electronic device can be configured to select a pair or set of electrodes and apply a predetermined electrical signal across these electrodes.

[0074] After a threshold period has elapsed, the wearable electronic device can proceed to select another pair or set of electrodes to apply the same or a different electrical signal. While the wearable electronic device progresses through different pairings of electrodes, the portable electronic device can render a graphical user interface that requests feedback from the user when the user experiences a particular sensory impression modality at a particular sensory impression site. For example, the portable electronic device may render a graphical user interface having feedback elements or affordances that require the user to interact with an affordance when experiencing a particular sensation.

[0075] In this way, when the user interacts with the affordance, the wearable electronic device may determine that the most recently executed signal transmission has appropriately stimulated the target sensory nerve. Using this information, the wearable electronic device and / or the portable electronic device can create a "calibration profile." The calibration profile can store information about which specific electrode pair or set of electrodes and / or which specific electrical signal characteristics (e.g., amplitude, frequency, duty cycle, pulse width, etc.) evoked a correct response in the user.

[0076] The calibration profile can vary from user to user. The calibration profile can also change each time the user wears the wearable electronic device because the relative position between the electrode and the target sensory nerve can change over time. Thus, in many configurations, the calibration profile can be updated periodically by the user and / or required to be updated periodically by the wearable electronic device or the portable electronic device. In many cases, the calibration profile is stored in a database or other data store so that the wearable electronic device can access the appropriate calibration each time the wearable electronic device is operated to evoke a sensory experience for the user.

[0077] In some cases, the wearable electronic device may also include one or more stimulation profiles that contain information describing one or more signals that induce a particular sensation at a particular site for a particular user. Put more simply, a simulation profile for a particular modality and a particular site (e.g., pressure sensation at the fingertip) can include information about the current or potential that needs to be induced within or with a particular target sensory nerve.

[0078] In this way, a particular simulation profile includes information on which particular stimuli should be generated to induce a particular sensory effect, and a calibration profile includes information on how to induce a particular signal across or within particular sensory nerves, given a particular orientation in which a particular user and wearable electronic device are worn at a particular time.

[0079] More generally and broadly, by combining the information contained in a stimulus profile (as described herein) and a calibration profile (as described herein), a wearable electronic device as described herein can generate and / or provide any number of sensory experiences to a particular user.

[0080] It should be understood that the foregoing architecture, including implementations with calibration profiles and stimulus profiles, is merely exemplary, and these data items should not be construed as limiting the manner in which the embodiments described herein may be implemented.

[0081] These and other embodiments are discussed below with reference to FIGS. 1-19. However, those skilled in the art will readily understand that the detailed descriptions provided herein with respect to these figures are for illustrative purposes only and should not be construed as limiting.

[0082] FIG. 1 shows the operation of the sensory feedback system described herein. The sensory feedback system 100 can utilize one or more wearable electronic devices configured to induce transient synthetic events and provide sensory experiences to a user, similar to other embodiments described herein.

[0083] The sensory feedback system 100 in this example can include an electronic device 102. The electronic device 102 can be any suitable electronic device or computing resource. In the illustrated embodiment, the electronic device 102 is a desktop computing device that includes a housing 104 that encloses and supports a display 106 configured to render a graphical user interface 108 within an active display area of the display 106.

[0084] More specifically, in many embodiments, the electronic device 102 can be implemented as a computing device that includes processing resources, memory resources, communication (e.g., networking) resources, and / or one or more displays and input devices. In such an example, the electronic device 102 can be configured to utilize processing resources to access one or more executable assets from memory resources in order to instantiate software configured to render one or more graphical user interface elements within the graphical user interface 108.

[0085] For example, the software instantiated by the electronic device 102 can be a virtual reality or gaming environment configured to render one or more three-dimensional objects within the graphical user interface 108. This is merely an example, and any suitable user interface can be rendered within the graphical user interface 108. Other possible devices include virtual reality headsets, augmented reality headsets, pass-through camera mixed reality headsets and head-up displays, holograms, projection-based visual entertainment systems, mobile platforms, handheld gaming devices, and the like. Further, as described above, in some cases, the wearable devices described herein can be configured to operate with actual or conventional physical or virtual media such as artistic paintings / sculptures, live performances, sports events, and the like.

[0086] In an embodiment where the graphical user interface 108 is configured to render a virtual environment, one or more objects may be rendered and manipulated by a user wearing one or more wearable electronic devices as described herein.

[0087] For example, in some embodiments, the graphical user interface 108 may be configured to render a three-dimensional object 110 and a three-dimensional object 112. In the illustrated embodiment, these objects are cube objects, but it should be understood that this simplified example is non-limiting.

[0088] In this example, the user 114 can interact with the electronic device 102 via motion tracking (not shown. One of ordinary skill in the art can understand that many systems for motion tracking may be suitable for tracking the position of the user and / or the position within the space of the user's body parts such as the left hand 114L or the right hand 114R). In these examples, a motion tracking system, either incorporated into the electronic device 102 or implemented as a separate electronic device or system, may be configured to track the positions of the user 114's right hand 114R and left hand 114L. In such an example, the movement of the user's hand can be converted by the electronic device 102 into the movement of one or both of the one or more objects rendered within the graphical user interface 108. For example, the movement of the right hand 114R may affect the position or orientation of the three-dimensional object 110 in the graphical user interface 108. Similarly, the movement of the left hand 114L may affect the position or orientation of the three-dimensional object 112 within the graphical user interface 108.

[0089] In addition, user 114 may use one or more wearable electronic devices as described herein to enhance the experience of manipulating three-dimensional objects within the graphical user interface 108. The wearable electronic device worn by the user may be configured to stimulate the sensory nerves of user 114 so as to evoke or induce a sense of reference at other locations within the user's hand or fingers, as described above.

[0090] For example, user 114 may wear the wearable electronic device 116 on the proximal phalanx of the index finger of the right hand 114R. As a result of this wearing position, the wearable electronic device 116 at least partially surrounds a cross-section (and length) of a portion of the median nerve of user 114. As is known to those skilled in the art, the median nerve within the index finger innervates the distal portion of the index finger, including the palmar side of the fingertip (e.g., the index finger pad). As a result of this configuration, the wearable electronic device 116 may utilize one or more electrodes (configured to operate with an appropriate stimulation profile and calibration profile as described herein) to stimulate the median nerve (the mobilized nerve) so as to evoke the sensory impression 120 that occurs at the sensory impression site at the fingertip 118 of the right hand 114R of user 114 at the fingertip 118.

[0091] Put more simply, the wearable electronic device 116 worn on the proximal phalanx of the index finger is operated to evoke a sensory impression in user 114 at the user's fingertip, which is a distance away from the wearable electronic device 116. In this way, the wearable electronic device 116 induces a temporary synesthetic event in the right hand 114R of user 114.

[0092] In addition, user 114 can also wear the wearable electronic device 122 on the middle phalanx of the left hand 114L. As a result of this wearing position, as described above, the wearable electronic device 122 at least partially surrounds cross-sections (and lengths) of different parts / branches of the median nerve of user 114. As is known to those skilled in the art, the median nerve in the middle finger innervates the distal part of the middle finger, including the palm side of its fingertip. As a result of this configuration, similar to the electronic device 116, the wearable electronic device 122 utilizes one or more electrodes (configured to operate with appropriate stimulation profiles and calibration profiles as described herein, which are different from the calibration profile and stimulation profile of the wearable electronic device 116) to stimulate this branch / part of the median nerve (the mobilized nerve) to evoke a sensory impression 126 generated at the sensory impression site of the fingertip 124 of the left hand 114L of user 114 on the fingertip 124.

[0093] Put more simply, the wearable electronic device 122 worn on the middle phalanx is operated to evoke a sensory impression in user 114 at the user's fingertip that is distant from the wearable electronic device 122. In this way, the wearable electronic device 122 induces a temporary synesthetic event in the right hand 114R of user 114.

[0094] The wearable electronic devices 116, 122 can operate in cooperation with (e.g., synchronously with) the software executed on the electronic device 102, thereby providing the induced temporary synesthetic events in the right and left fingertips 114R and 114L along with the motion-tracked interactions with the three-dimensional objects 110, 112.

[0095] More specifically, when the user 114 moves the index finger of the right hand 114R towards the virtual surface of the three-dimensional object 110, the motion tracking system can send a signal to the wearable electronic device 116 so as to induce a pressure sensation on the index finger of the user's right hand. In this way, and as a result of this induced sensory impression, the user 114 may perceive that the user is physically touching the virtual surface of the three-dimensional object 110 at the touch position 128. Similarly, when the user 114 moves the middle finger of the left hand 114L towards the virtual surface of the three-dimensional object 112, the motion tracking system can send a signal to the wearable electronic device 122 so as to induce a pressure sensation, a temperature sensation, a texture sensation, or a time-varying sensation on the middle finger of the user's left hand. In this way, and as a result of this induced sensory impression, the user 114 may perceive that the user is physically touching the virtual surface of the three-dimensional object 112 at the touch position 130.

[0096] These foregoing embodiments shown in FIG. 1 and their various alternatives and variations thereof are generally presented for illustrative purposes and to facilitate understanding of the various configurations and structures of a sensory impression system or a sensory feedback system as described herein. However, it will be apparent to those skilled in the art that some of the specific details presented herein may not be required to practice a particular described embodiment or its equivalents.

[0097] Accordingly, it is understood that the foregoing and following descriptions of specific embodiments are presented for purposes of illustration and limited description. These descriptions are not intended to be exhaustive or to limit the disclosure to the exact forms described herein. On the contrary, it will be apparent to those skilled in the art that many modifications and variations are possible in light of the above teachings.

[0098] More specifically, it can be understood that the wearable electronic devices described herein can cooperate with any suitable electronic device or system of electronic devices to complement the interaction with those electronic devices with sensory impressions. The wearable electronic devices can, but are not limited to, improve the sensory experience of playing video games, improve the sensory experience of navigating virtual reality or augmented reality environments, provide sensory feedback to a surgeon performing robot-assisted surgery, provide sensory feedback between people at a distance, provide sensory feedback to people with different abilities such as guidance feedback to visually impaired people, provide sensory feedback triggered by events in electronic devices such as incoming calls or receipt of new messages, provide physical feedback to users of a flat input surface (e.g., simulate button presses or keystrokes), provide sensory feedback to guide the position of a user's fingers when playing a musical instrument, provide sensory feedback to a user when operating a machine such as an automobile, provide sensory feedback to wake a sleeping person, provide sensory feedback to an operator of a prosthetic limb, provide sensory feedback between multiple wearers to enable multiple users to simultaneously experience similar or identical sensory impressions, enable a user to feel a product before purchase or otherwise interact with the product to improve the online or remote shopping experience, and provide sensory feedback as an authentication mechanism (e.g., a user can identify which of multiple fingers or body parts were stimulated).

[0099] In some configurations, the wearable electronic devices described herein can be configured to induce discomfort, imbalance, or disorientation for entertainment or training purposes. For example, the wearable electronic devices described herein can be positioned near a user's vestibular system (e.g., behind the user's ear) and configured to stimulate the vestibular system to cause the user to experience a sense of imbalance, nausea, dizziness, or disorientation.

[0100] In yet other examples, a system as described herein may also be used to assist a person with unwanted involuntary efferent signaling (e.g., tremors and the like). In these examples, the wearable electronic device may be configured to induce an electrical signaling that counteracts an unintentional or unwanted efferent signaling. In other cases, the wearable electronic device may be configured to induce an electrical signaling that cancels an unintentional afferent signaling that elicits one or more unwanted efferent signals in response.

[0101] In further embodiments, virtual objects that can be interacted with by a user may be visually emphasized in some way, such as by glowing, a particular color, edge blurring or fading, or another visual or audio indication.

[0102] These foregoing examples are not exhaustive, and the wearable electronic devices described herein can be configured to operate in a plurality of suitable ways and may be configured to operate with and / or instead of many haptic notification or haptic feedback systems.

[0103] FIG. 2 shows a simplified system diagram of a sensory feedback system or sensory impression system as described herein. System 200 operates through the cooperation of a wearable electronic device, a user's personal electronic device, and a virtual computing / game environment.

[0104] Specifically, system 200 includes a virtual environment 202 communicatively coupled to a client device 204. Virtual environment 202 can be at least partially defined by an environment engine 206 (sometimes also referred to as a physics engine or a game engine) and a haptic data stream source 208.

[0105] The client device 204 (which may or may not be a wearable electronic device) is communicatively coupled to a wearable electronic device configured to evoke / induce a reference sensation by percutaneous stimulation of a sensory nerve, as described herein. For simplicity of explanation, the following embodiments refer to a configuration in which the client device 204 is a non-wearable electronic device such as a mobile phone configured to communicate wirelessly or via a wired connection with a wearable electronic device. For even greater simplicity of explanation, a wearable or implantable device (or a combined system including at least one wearable device and at least one implantable device) as described herein, configured to evoke a reference sensation by percutaneous or direct stimulation, is referred to as an "RSTS" device. In the illustrated embodiment, the client device 204 is communicatively coupled to an RSTS device 210 that includes an electrode array, processing resources, memory resources, etc., to induce a sensory impression by stimulating a mobilized nerve such as the median nerve of the user's hand, similar to other embodiments described herein. Collectively, these resources are identified in the figure as resources 212.

[0106] The system 200 can be a game system configured to present a virtual reality environment, an augmented reality environment, or a virtual environment rendered in two dimensions (e.g., a metaverse, a game universe, etc.). In particular, game actions can be computed by the environment engine 206 in response to one or more inputs provided by the client device 204, which can be communicatively coupled to one or more input devices such as a game controller or a motion tracking system. When game content is updated or computed by the environment engine 206, information describing the environment can be transmitted to the client device 204 as environment information 214. The client device 204 can consume the environment information 214 to update a graphical user interface, a rendered game environment, etc.

[0107] In certain situations, the environmental engine 206 can determine that a game character physically interacts with an object rendered within the same environment or another game character. For example, a game character may hold a tool or weapon, operate a virtual machine, or perform similar actions. In response to such an event, the environmental engine 206 can signal the haptic data stream source 208 to generate one or more haptic signals 216 to the client device 204. In response, the client device 204 can provide one or more haptic outputs, including but not limited to, sensory impressions, to the user of the client device. More specifically, the client device 204 can be configured to signal the RSTS device 210 using the sensory impression signal 218 in response to receiving the haptic signal 216.

[0108] In a more simplistic and non-limiting representation, the system 200 can be configured to convert haptic signaling transmitted with or separate from game information generated by a game engine, as described herein, into sensory feedback perceivable by a wearer of an RSTS device.

[0109] For example, the game environment may include one or more virtual objects. When a game character grasps an object within the virtual environment, a haptic signal may be generated and transmitted to the client device 204. In a conventional game environment, the haptic signal can be made to generate vibrotactile feedback in response (e.g., a game controller can vibrate to indicate that the game character has interacted normally with a virtual object). In contrast, in the embodiments described herein, the client device 204 may convert the haptic signal transmission received from the game environment (e.g., the virtual environment 202) into a sensory signal transmission that can cause the wearer to experience a realistic sensory experience when received by the RSTS device 210. For example, in response to a game character grasping an object, a sensory impression of pressure can be induced on each of the user's ten fingertips, evoking the impression that the user is physically grasping the virtual object himself.

[0110] In these examples, the client device 204 can be configured to utilize the structured information within the haptic signal 216 to select one or more sensory impression modalities and one or more sensory impression sites. For example, the haptic signal 216 can be structured data in the following JSON format. { “event_id”:7f61e0f4-b475-4563-9ed9-95eb7e546e73, “timestamp”:“July 19,2019,21:44.365478 UTC” “hand_right:{ “index_tip”:“0.5g”, “middle_tip”:“0.2g”, “ring_tip”:“0.2g”, “little_tip”:“0.2g” }, “hand_left:{ “index_tip”:“0g”, “middle_tip”:“0g”, “ring_tip”:“0g”, “little_tip”:“0g” }

[0111] In this example, the tactile event may correspond to the game character lightly grasping an object with the character's right hand. In particular, in this exemplary event, a pressure sensation impression of less than one gram is instructed to be evoked at each fingertip of the right hand, but no pressure event is instructed to be evoked with the left hand.

[0112] In other examples, more detailed sensory information may be provided within the tactile signal 216. For example { “event_id”:d0dfd5ad-926b-4483-b679-1b2c6a0ff689, “timestamp”:“July 19,2019,21:44.5566879 UTC” “hand_right:{ “index”:{ “phalanx_proximal”:{ “modality”:“pressure”, “value”:“0.5g”, “duration”:“0.2s” }, { “modality”:“temperature”, “value”:“-3deg”, “duration”:“0.2s” }], “phalanx_medial”:{ “modality”:“pressure”, “value”:“0.2g”, “duration”:“0.2s” }, { “modality”:“temperature”, “value”:“-3deg”, “duration”:“0.2s” [[ID=0}]}, "phalanx_distal":{ "modality":"pressure", "value":"2g", "duration":"0.2s" } { "modality":"temperature", "value":"-3deg", "duration":"0.2s" }] } } }

[0113] In this example, the tactile event may correspond to a game character pulling the trigger of a weapon with the index finger of the right hand. In this example, in addition to the lower temperature (-3 degree perceptual temperature delta), pressure can be felt along the entire palm side of the index finger of the right hand, which can simulate the feeling of gripping a metal.

[0114] These foregoing embodiments shown in FIG. 2, as well as their various alternatives and their variations, are generally presented for purposes of explanation and to facilitate understanding of the various configurations and structures of a sensory impression system or a sensory feedback system as described herein when used with a game environment to enrich the game experience. However, it will be apparent to those skilled in the art that some of the specific details presented herein may not be necessary to practice a particular described embodiment or its equivalents.

[0115] Accordingly, it is understood that the foregoing and following descriptions of specific embodiments are presented for purposes of illustration and limited explanation. These descriptions are not intended to be exhaustive or to limit the disclosure to the exact forms described herein. On the contrary, it will be apparent to those skilled in the art that many modifications and variations are possible in light of the above teachings.

[0116] For example, it can be understood that the client device 204 and the virtual environment 202 can each be embodied in a plurality of ways. In particular, the client device 204 may be a computing device such as a laptop, a game console, a desktop computing device, etc. In many configurations, the client device 204 is configured to instantiate software, and the software is configured to interface with both the RSTS device 210 and the virtual environment 202. For example, similar to other embodiments described herein, the client device 204 may include processing resources 204a and memory resources 204b configured to cooperate to instantiate an instance (or two or more instances) of software configured to interface with and / or utilize one or more API endpoints of the virtual environment 202 and the RSTS device 210.

[0117] The client device 204 can also include one or more output systems, such as a display, a tactile element, a speaker, etc., collectively identified as output resources 204c. In some examples, the display of the output resources 204c can be configured to render a graphical user interface that renders at least a portion of the game environment defined by the environment engine 206. The display can be a flat panel display, a curved display, a projection display, a head-mounted display, or any other suitable display.

[0118] The output resources 204c can also include one or more tactile output systems, such as a vibration haptic actuator. These conventional tactile outputs can be provided in cooperation with the outputs provided by the RSTS device 210.

[0119] The output resources 204c can also include one or more audio output devices configured to provide audio generated by or within the virtual environment defined by the environment engine 206.

[0120] In some embodiments, the audio and / or visual signals within the environmental information 214 may be provided in synchronization with the tactile signal 216. In other words, the sounds and scenes associated with a particular tactile effect may be rendered simultaneously to the user or generated in some other way. In other embodiments, the tactile output may be provided before the corresponding audiovisual output. For example, the sensory impressions provided by the RSTS device can bring about the corresponding audiovisual effects for only a short period, such as 100 ms. This period during which the audiovisual effect is delayed can enhance the sense of reality of participating in the virtual environment, as is known to those skilled in the art, because somatosensory signaling often precedes audiovisual signaling (e.g., a person may feel contact with an object before perceiving the sound associated with that contact).

[0121] Similar to the client device 204, the tactile data stream source 208 and the environment engine 206 may also be implemented, in whole or in part, in software. In particular, both systems can utilize processing and memory resources (identified as resources 206a and resources 208a) to instantiate instances configured for different purposes of the software.

[0122] These foregoing examples are not exhaustive, and the systems described herein can be configured in a plurality of suitable ways. For example, the RSTS device 210 and the client device 204 can communicate via a local wireless protocol such as Bluetooth or Wi-Fi or ultra-wideband radio. In other cases, the RSTS device 210 and the client device 204 can communicate via one or more networks that may include the open Internet. In such examples, user-specific thresholds that define limits or maximum / minimum thresholds for stimuli (such as those described herein) can ensure that any interference with commands transmitted over the network does not cause pain or other unpleasant experiences to the user.

[0123] In some cases, the virtual environment 202 can communicate with one or both of the device 204 and the RSTS device 210 via a network that can be a private network, a cellular network, a Wi-Fi network, an intranet, or a network that can include the open Internet. In many embodiments, the authentication and authorization operations can be performed such that the user's stimulation by the RSTS device 210 cannot be accidentally triggered or otherwise eavesdropped on / interfered with.

[0124] FIG. 3 shows a simplified system diagram of a wearable electronic device configured to provide sensory feedback to a wearer. The wearable electronic device 300 can be an RSTS device 302 as described with reference to FIG. 2.

[0125] The RSTS device 302 includes a housing 304 that encloses and supports the internal components of the RSTS device 302. As described with respect to other embodiments herein, the RSTS device 302, and in particular the housing 304 of the RSTS device 302, can take on a plurality of suitable form factors. In many cases, the housing 304 is configured to conform to a portion of a user's limb or finger such that it at least partially surrounds a portion or cross-section of a sensory nerve within the limb or finger that can be recruited to provide a reference sensation as described herein. Exemplary form factors that the RSTS device 302 can take include, but are not limited to, finger rings, wrist cuffs, neck cuffs, ankle cuffs, sleeves, partial sleeves, gloves, glovelets, fingerless gloves, toe rings, ear hooks, and the like.

[0126] Similar to many of the embodiments described herein, the housing 304 of the RSTS device 302 can enclose and support one or more electrical circuits configured to perform, regulate, or otherwise execute or cause to be executed one or more operations or functions of the RSTS device 302. In the illustrated embodiment, the RSTS device 302 includes processing resources 306 and memory resources 308.

[0127] The processing resource 306 and the memory resource 308 can cooperate to instantiate software configured to communicate with other electronic devices (e.g., personal mobile phones, game consoles, and the like) and configured to stimulate the mobilized nerves, as described elsewhere herein.

[0128] In many embodiments, although not explicitly required, the power source 310 may also be included in the housing 304 to provide power to the various elements of the RSTS device 302. The power source 310 can be a battery, a Peltier element, a piezoelectric element, a solar array, a tether connection to another electronic device or power source, an inductive or resonant wireless power transfer system, or any other suitable power source.

[0129] The RSTS device 302 also includes one or more communication systems 312 for communicating with other electronic devices and / or for receiving signals indicating that a sensory impression should be evoked. Exemplary communication systems that may be included in the communication system 312 include, but are not limited to, Bluetooth, Wi-Fi, cellular (e.g., 5G NR), 433Mhz wireless, software-defined radio, infrared communication systems, acoustic communication systems, and the like.

[0130] The RSTS device 302 also includes an electrode array 314. The electrode array 314 can be disposed on or through the outer surface of the housing 304. The electrode array 314 is oriented to interface with and / or contact the surface of the user's skin. For example, in a ring form factor, the outer surface through which the electrode array 314 extends to contact the user's skin is the inner diameter of the ring. Similarly, in an embodiment of a wrist cuff, the outer surface through which the electrode array 314 extends to contact the user's skin is the inner surface of the cuff.

[0131] The electrode array 314 can include many different individual electrodes, each of which can be configured to operate as an anode (negative signal terminal) or a cathode (positive signal terminal). In some cases, multiple electrodes may function as anodes with respect to a single cathode. In other cases, multiple electrodes can function as cathodes with respect to some anodes, and any suitable combination of electrodes can be selected.

[0132] The electrode array 314 can be arranged in a repeating pattern having any number of individual electrodes that make it up. In some examples, the electrode array 314 is formed from all the same material (e.g., a conductive material such as a metal or metal alloy) and includes electrodes formed in the same shape, such as a square or a linear shape. In some cases, different electrodes may be formed from different metals or alloys and / or in different shapes. Some of the electrodes of the electrode array 314 can have a different surface area than other electrodes and may be formed from different materials.

[0133] In many embodiments, the electrode array 314 may be formed from a biocompatible metal material such as gold. In some cases, metals that are likely to cause an allergic reaction in some users (e.g., nickel, silver, etc.) can be avoided. In some cases, metal alloys may be selected, particularly for their oxidation resistance. Examples of electrode materials and alloys include, but are not limited to, copper alloys, gold alloys (e.g., AgNW, AgCl), tungsten alloys (e.g., CuNW), titanium alloys, and the like.

[0134] In some configurations, the electrode array 314 includes rigid electrodes. In other cases, the electrode array 314 includes flexible electrodes and / or polymeric electrodes. In some cases, the electrode array 314 may extend upwardly from the outer surface of the housing 304 to ensure contact with the user's skin.

[0135] These foregoing examples are not exhaustive, and many electrode configurations are possible.

[0136] The RSTS device 302 may also optionally include one or more sensors 316 and / or one or more displays 318. In some cases, the display 318 may be an indicator or status light, while in other cases a two-dimensional display (e.g., OLED, ePaper, LCD, etc.) may be used or included.

[0137] In some embodiments, the RSTS device 302 can include sensors such as temperature sensors, impedance sensors, humidity sensors, conductivity sensors, gyroscopes, accelerometers, etc. Output from these sensors (among the sensors 316) can be used to inform or update the stimulation profile and / or calibration profile as described herein. In other cases, output from the sensors 316 can be utilized by the processor or processing resources 306 to trigger a calibration or recalibration process or operation. For example, body impedance measurements can be used to inform the envelope of the stimulation, which can be updated in real time and / or modified over time. For example, the user's skin impedance and / or body impedance can change over the course of a day, and in such cases, output from an impedance sensor or sensing system can inform whether the magnitude of the stimulation should be increased or decreased to provide a consistent sensory impression experience given the varying stimulation conditions (as an example, a variable characteristic; in other embodiments, other characteristics can be modified as well or instead).

[0138] These foregoing embodiments and various alternatives and variations thereof as illustrated in Figure 3 are generally presented for purposes of explanation and to facilitate understanding of various configurations and structures of wearable electronic devices implemented as RSTS devices as described herein. However, it will be apparent to one skilled in the art that some of the specific details presented herein may not be required to practice a particular described embodiment or its equivalents.

[0139] Accordingly, it is understood that the foregoing and following descriptions of specific embodiments are presented for purposes of illustration and limited description. These descriptions are not intended to be exhaustive or to limit the disclosure to the exact forms described herein. On the contrary, it will be apparent to those skilled in the art that many modifications and variations are possible in light of the above teachings.

[0140] For example, as described above, the wearable electronic devices described herein can be configured to take on a plurality of different form factors and may include one or more electrode arrays arranged in different ways.

[0141] For example, FIG. 4A shows an exemplary finger ring form factor wearable electronic device (identified as wearable electronic device 400a) that includes an electrode array for percutaneous stimulation of the median or ulnar nerve, thereby inducing a tactile sensation (an induced temporary synesthetic event) having a perceived sensory impression site separated from the wearable electronic device by a certain distance.

[0142] Specifically, the wearable electronic device 400a includes a housing 402 having an annular or ring shape configured to be worn on a user's phalanx. In a typical situation, the wearable electronic device 400a is configured to be worn on the proximal phalanx, but this is not required in all embodiments.

[0143] The housing 402 can have a rigid or flexible shape. In some embodiments, the body may include one or more rigid portions and one or more flexible portions. In some embodiments, the body may be made of an elastic material so as to maintain contact with the user's finger (e.g., when worn, the housing 402 is under tension). In other cases, the housing 402 can have a flexible inner surface and a rigid outer surface. For example, the inner surface of the housing 402 can be made of an elastic material or polymer having one or more protrusions that contact the user's skin, and the outer surface of the housing 402 can be capped with a rigid material such as metal. Many configurations are possible. In some embodiments, the housing 402 may be adjustable to different inner or outer diameters.

[0144] In some embodiments, the housing 402 can have a rounded shape, while in other embodiments, a polygonal shape may be used. In some cases, the housing 402 defines a single opening for inserting the user's finger, while in other embodiments, two or more openings can be positioned adjacent to each other to define a wearable electronic device for multiple fingers.

[0145] The housing 402 of the wearable electronic device 400a can include a plurality of outer surfaces such as an outer surface 404 and an outer surface 406. The outer surface 404 follows the outer perimeter of the wearable electronic device 400a, and the outer surface 406 follows the inner perimeter of the wearable electronic device 400a.

[0146] The wearable electronic device 400a also includes an electrode array 408 that includes two or more individual electrodes. In the illustrated embodiment, a set of three electrodes is shown, but it can be understood that this arrangement of electrodes can be repeated radially along the outer surface 406.

[0147] The electrode array 408 can be formed in any suitable shape and arranged in any suitable pattern. In some cases, each electrode of the electrode array 408 has a linear shape, while in other cases, different shapes are contemplated. In some cases, the electrodes of the electrode array 408 form a repeating or checkerboard pattern along the outer surface 406.

[0148] FIG. 4B shows another exemplary finger ring form factor wearable electronic device that includes an electrode array for percutaneous median nerve stimulation. In particular, similar to the embodiment shown in FIG. 4A, the wearable electronic device 400b includes a housing 402 having an annular or ring shape configured to be worn on a user's phalangeal bone, such as the proximal phalanx of the index finger or middle finger.

[0149] Similar to other embodiments, the housing 402 of the wearable electronic device 400b can include a plurality of outer surfaces, such as outer surface 404 and outer surface 406. The outer surface 404 follows the outer perimeter of the wearable electronic device 400a, and the outer surface 406 follows the inner perimeter of the wearable electronic device 400a.

[0150] The wearable electronic device 400b also includes an electrode array 408 that includes two or more individual electrodes, such as electrodes 408a, 408b. In the illustrated embodiment, an array distributed circumferentially of the electrodes is shown, but it is understood that this is merely an example.

[0151] Similar to other embodiments described herein, the electrode array 408 can be formed in any suitable shape and arranged in any suitable pattern. In some cases, each electrode of the electrode array 408 has a linear shape, while in other cases, different shapes are contemplated. In some cases, the electrodes of the electrode array 408 form a repeating or checkerboard pattern along the outer surface 406.

[0152] Furthermore, as described above, different electrodes can serve different purposes at different times as determined by the processor of the wearable electronic device 400b. For example, FIG. 4C shows an electrode array of the wearable electronic device of FIG. 4B as viewed along line A-A.

[0153] In this example, a first electrode 410 extending through the outer surface 406 can operate as a cathode, and the second and third electrodes (e.g., electrodes 412a, 412b) can operate as anodes. In a more simplistic representation, for a particular stimulation signal, a positive voltage signal can be applied to the first electrode 410, and the electrodes 412a, 412b can be coupled to system ground to function as a return path for current. In this example, the other electrodes of the system may be floating, disconnected from both system ground and the signal source.

[0154] In another example, the first electrode 410 extending through the outer surface 406 can be made to operate as an anode, and the electrodes 412a, 412b can be made to operate as cathodes. In a more simplistic representation, for a particular stimulation signal, one or more positive voltage signals can be applied to the electrodes 412a, 412b, while the first electrode 410 is coupled to system ground and functions as a return path for current.

[0155] These examples are not exhaustive, and it can be understood that any number of electrodes can be defined to operate as cathodes or anodes subject to the specific signal transmission or stimulation requirements for a particular embodiment.

[0156] Furthermore, as described above, different electrodes may in some cases be formed from different materials. FIG. 4D shows an electrode array that can be used by a wearable electronic device 400d, such as the wearable electronic device 400b of FIG. 4B. In this exemplary embodiment, the electrodes 416a, 416b extending through the outer surface 406 may be formed from different materials such as copper alloy or gold alloy.

[0157] In yet other embodiments, multiple circumferential distributions of electrodes can be used. FIG. 4E shows another electrode array that can be used by a wearable electronic device 400e as described herein. This electrode array includes two separate columns of electrodes, with the first column including electrodes 418 and the second column including electrodes 418. In this example, the two columns are aligned with respect to each other, but this is not essential. For example, FIG. 4F shows another electrode array that can be used by a wearable electronic device 400f as described herein. In this example, the two columns of electrodes can be offset from each other. For example, the first column of electrodes including electrodes 422 can be offset with respect to the second column of electrodes including electrodes 424.

[0158] In yet other embodiments, different electrode shapes may be appropriate. FIG. 4F shows another electrode array that can be used by a wearable electronic device 400g as described herein. In this example, circular electrodes such as electrode 426 can be used.

[0159] FIG. 4H shows an exemplary ring for a finger that can be a stand-alone wearable device or incorporated into another wearable device such as a harness including rings for each finger or multiple fingers. As described with respect to FIGS. 4A - 4B, the ring can include an electrode array for transcutaneous median nerve stimulation. In particular, ring 400h includes a housing 428 having an annular or ring shape configured to be worn on a user's phalanx.

[0160] In some embodiments (not shown), the ring is adjustable. For example, the ring may include a helix, a spring, an expandable material, a ratchet mechanism, or any other mechanism and / or geometry that allows the ring to conform to the size of the user's finger. In this configuration, the adjustment feature of the ring enables the user to wear the ring on most or any finger. Similarly, the ring may be adjustable to be worn by most users having various hand sizes. Due to its adjustment feature, the ring may be configured to fit snugly but comfortably on the user's finger. This adjustable feature can ensure consistent contact with the skin while the user is wearing the ring. For example, during hand movement, the ring can adjust to adapt to the movement while maintaining contact between the electrode array and the user's skin. This consistent contact improves the user's sensation and experience with the wearable device and prevents sensory and / or experiential disruptions caused by the lifting off of the electrodes from the user's skin.

[0161] As described above, in some embodiments, the ring 400h includes an electrode array 430 that includes two or more electrodes such as electrodes 430a, 430b, and 430c. In the illustrated embodiment, an array distributed circumferentially of the electrodes is shown, but it is understood that this is merely an example. The electrode array may include two electrodes along the height (e.g., along the width) of the inner surface 432 of the ring.

[0162] The housing 428 of the wearable electronic device 400h can include an inner surface 432 and an outer surface 434. The outer surface can include depressions and / or protrusions (not shown) that facilitate adjustment of the ring to the user's finger. For example, the ring may include a series of channels that provide distinct positions for tabs and thereby distinct ring sizes.

[0163] The inner surface 432 can define a series of openings for the electrodes. In some embodiments, the electrodes may define a coplanar plane with the inner surface. In other embodiments, the electrodes may protrude from the inner surface.

[0164] Figure 4I shows a detailed view of the electrode array. In some embodiments, each pair of electrodes (e.g., 430a and 430c) is distributed at equal intervals along the inner surface of the ring. In other embodiments, as shown in the figure, pairs of electrodes are positioned within clusters (e.g., cluster 436), and adjacent clusters may have a greater separation than the electrodes within the cluster. As described above, different electrodes or different clusters of electrodes can serve different purposes at different times. For example, each column of electrodes can operate as a cathode - anode pair.

[0165] Figures 4J - 4P show exemplary front views along line C - C. Figure 4J shows one embodiment 400j of the ring. In this example, the electrode 438 defines a domed contour. According to some embodiments, the electrode may also act as a biasing member to stabilize the ring relative to the finger. The illustrated embodiment shows the electrode protruding from the inner surface, but in other embodiments, the top of the dome may be substantially flush with the inner surface. Although a dome - shaped structure is shown, other shapes are envisioned.

[0166] As shown in Figure 4K, in some embodiments of the ring 400k, each electrode 442 can define a bridge structure. For example, each electrode can have two ends that contact the surface, and the central portion of the electrode is suspended relative to the inner surface. In this embodiment, the electrode may be more flexible, thereby providing additional comfort to the user when wearing the device, ring, and / or harness.

[0167] Figure 4L shows one embodiment of the ring 400l. In this embodiment, the electrode 442 has a cap shape where each side of the cap has straight or substantially vertical sides. The top of the cap may be rounded to add comfort and / or increase the surface area between the user's skin and the electrode.

[0168] Figure 4M shows another embodiment of the ring 400m. Here, the electrode 444 can define a flat surface configured to contact the user's skin. In this example, the electrode can be manufactured more easily. Although the edges of the electrode are shown straight, in some examples, the edges may define a fillet, chamfer, or any other transition such as may be known to those skilled in the art.

[0169] Figure 4N is an embodiment of the ring 400n, where the electrode 446 defines an inclined surface with respect to the inner surface and a flat surface substantially parallel to the inner surface. Similarly, as shown in Figure 4O, the electrode 448 can include a rounded side surface having substantially parallel surfaces. As yet another variant of the ring 400p, as shown in Figure 4P, the electrode can define a vertical side surface and include a flat inclined surface. In the embodiments shown, the electrode can press against the user's skin so as to increase the surface area between the skin and the electrode while maintaining a comfortable fit for the user.

[0170] These foregoing embodiments shown in Figures 4A - 4P, as well as their various alternatives and variations thereof, are generally presented for illustrative purposes and to facilitate understanding of the various configurations of the electrode arrays of wearable electronic devices as described herein. However, it will be apparent to those skilled in the art that some of the specific details presented herein may not be required to practice the particular described embodiments or their equivalents.

[0171] Accordingly, it is understood that the foregoing and following descriptions of specific embodiments are presented for purposes of illustration and limited description. These descriptions are not intended to be exhaustive or to limit the disclosure to the exact forms described herein. On the contrary, it will be apparent to those skilled in the art that many modifications and variations are possible in light of the above teachings.

[0172] For example, as described above, regardless of the electrode layout, a wearable electronic device may sometimes need to be calibrated to notify a stimulation plan based on current information that describes the relative position of a particular electrode with respect to a particular part of a particular sensory nerve within the user's body. Put more simply, since the positioning of the wearable electronic device can vary from wear to wear or throughout the day, it may be necessary to periodically recalibrate the device. In particular, as described above, it may be useful to periodically update one or more stimulation profiles and / or one or more calibration profiles.

[0173] As used herein, the phrase "stimulation profile" refers to a data structure that stores values or parameters corresponding to what type of stimulation (e.g., current magnitude, polarity, pulse width, frequency, etc.) will be perceived by the user to evoke a particular sensation at a particular site. In other words, the parameters that describe the stimulation of a nerve to evoke a pressure sensation at the fingertip of the index finger are different from the parameters that describe the stimulation of a nerve to evoke a temperature sensation at the same site (e.g., in this example, different modalities result in different stimulation parameters and different stimulation profiles). Similarly, the parameters that describe the stimulation of a nerve to evoke a pressure sensation at the middle fingertip are also different, and in this example, different sites of sensory impression require different stimulation parameters.

[0174] Similarly, as used herein, the phrase "calibration profile" refers to a data structure that stores values or parameters corresponding to how to generate a particular stimulation (e.g., given a particular orientation of the wearable electronic device at a particular time, given a selected sensory impression modality and site of sensory impression, as defined by a stimulation profile).

[0175] In a more simplistic and non-limiting representation, a stimulus profile can define which signals to evoke in order to induce a particular sensory impression (both modality and location), and a calibration profile can define how to evoke a particular signal taking into account the specific positioning of the wearable electronic device.

[0176] A "stimulation plan" as described herein can be used to combine information from both a stimulus profile and an up-to-date calibration profile to provide a particular sensory impression modality that is perceived to originate from a particular location.

[0177] Furthermore, different wearable electronic devices may be suitable for inducing sensory impressions in different ways, and while a cuff form factor may be able to stimulate the mobilized nerves innervating any part of a given hand, it will be understood that a ring device may only be able to stimulate the mobilized nerves innervating a portion of the associated finger. Different embodiments are also configured to calibrate according to different workflows.

[0178] FIG. 5 shows a portable electronic device that communicatively couples to and executes an instance of a software application configured to calibrate a wearable electronic device, as described herein. The operations described with reference to FIG. 5 can notify of the creation or update of a calibration profile and / or a stimulus profile, as described herein.

[0179] The portable electronic device 500 is implemented as a mobile phone, but this is merely one exemplary electronic device. Other examples include laptop devices, desktop devices, wearable devices (e.g., smartwatches, head-mounted displays, etc.).

[0180] The portable electronic device 500 includes a housing 502 that encloses and supports the components of the portable electronic device 500. In many examples, the housing 502 encloses processing resources and memory resources, as well as a display such as display 504.

[0181] Similar to other embodiments described herein, the processor resources and memory resources can cooperate to instantiate a software application that can render a graphical user interface 506 using the display 504.

[0182] The portable electronic device 500 and / or the software application (which may be referred to herein as a "client application" or "front end") can be configured to communicatively couple with a wearable electronic device as described herein. In some cases, although not required, the portable electronic device 500 is configured to communicatively couple to a ring form factor device via Bluetooth or an ultra-wideband communication protocol. These are merely examples, and other embodiments can utilize other communication systems.

[0183] The portable electronic device 500 and / or the client application can also be configured to communicatively couple to one or more third-party systems, collectively referred to as host services. The host services may be a back-end instance of one or more software platforms associated with providing sensory impressions via a wearable electronic device as described herein. In other cases, the back-end platform may be associated with one or more virtual computing environments or virtual gaming environments.

[0184] In some cases, the portable electronic device 500 can receive information in a structured data format from a backend system to initiate a calibration operation for the wearable electronic device. In other cases, the portable electronic device 500 can receive information in a structured data format from the wearable electronic device itself to initiate a calibration operation for the wearable electronic device. In still further embodiments, the portable electronic device 500 can initiate a calibration operation for the wearable electronic device periodically (e.g., daily, hourly, according to a schedule, etc.).

[0185] FIG. 5 shows a graphical user interface 506 as rendering an exemplary user interface that can be rendered during a calibration operation of a wearable electronic device as described herein. The graphical user interface 506 can include information 508 presented to the user that provides instructions for proceeding with the calibration of the wearable electronic device.

[0186] In some cases, the graphical user interface 508 can also include a virtual body part 510, such as a hand, to visually show the user where to wear the wearable electronic device 512. The graphical user interface 506 can also visually show a test site 514 that notifies the user of the location where sensory feedback is expected to occur.

[0187] During the calibration operation, the wearable electronic device can repeatedly select pairs or sets of electrodes and apply a predetermined test signal across those pairs. In many examples, these test signals can have a limited magnitude so as not to trigger an involuntary painful response in the user.

[0188] A wearable electronic device can gradually change which stimulus is provided via which electrode. When the user experiences a sensation at the test site 514, the user can indicate to the client application that the stimulus was successful by interacting with the affordance 516.

[0189] When the user indicates that the intended sensation has been experienced, further refinement of the applied signal can be performed. For example, the wearable electronic device can modify one or more characteristics of the test signal that evoked the intended sensory impression. Such characteristics include changing the frequency, duty cycle, magnitude, anode / cathode assignment between different electrodes, duration of the stimulus, and the like.

[0190] In response to each "refinement" operation, the user can interact with the affordance 516 or another graphical user interface element to indicate to the client application that the perceptual experience is perceived in a different way. For example, in some cases, the graphical user interface 506 may include buttons to indicate that the most recent stimulus is more localized than the previous stimulus. Another button may be included to indicate that the most recent stimulus is not more localized than the previous stimulus. Another button may be included to indicate that the most recent stimulus evoked a temperature sensation, pressure sensation, texture sensation, or another modality. Another button may be included to indicate whether a particular stimulus was painful or approaching a painful experience. In such an illustration, the wearable electronic device and / or the client application can define one or more absolute thresholds for a particular user based on the user's perception. In these examples, any stimulus provided by the wearable electronic device will be below the user's pain threshold, regardless of modality, location, or calibration.

[0191] In some cases, the operations described with reference to the embodiment shown in FIG. 5 may be used to develop or update a calibration profile. Once the calibration profile is established (e.g., more generally, once the approximate location of the sensory nerve to be stimulated is determined), the wearable electronic device can proceed to generate a stimulation profile as shown in FIG. 6.

[0192] FIG. 6 shows a portable electronic device that runs an instance of a software application communicatively coupled to and configured to calibrate a wearable electronic device, as described herein. Similar to FIG. 5, the system 600 of FIG. 6 includes a portable electronic device 602 that includes a display 604 on which a graphical user interface 606 is rendered. This graphical user interface 606 can include instructions 608 and visualizations 610 that inform the user how / where to wear the wearable electronic device, where to expect the evoked sensory impression, and what modality that sensory impression will take. In response to experiencing the shown sensation (in the figure, a pressing sensation at the fingertip of the left middle finger) at the shown site, the affordance 612 can be pressed by the user 614 to indicate to the device that the identified sensation has been experienced.

[0193] Specifically, as described above, during calibration, the wearable electronic device 616 can iterate through one or more combinations of a signal and a cathode / anode pair or set selected from one or more of the electrodes 618. The wearable electronic device 616 can pause during the time period between each test stimulus to give the user 614 an opportunity to interact with a client application that renders the graphical user interface 606 to indicate whether a particular sensory impression 620 has been experienced.

[0194] Similar to other embodiments described in this specification, when user 614 indicates that the intended sensation has been experienced, further refinement of the signal applied via electrode 618 can be performed. For example, wearable electronic device 616 can modify one or more characteristics of a test signal that evoked an intended sensory impression having an intended sensory impression modality and an intended sensory impression site. As described above, such characteristics include changing the frequency, duty cycle, magnitude, anode / cathode assignment between different electrodes, stimulus duration, and the like.

[0195] In response to each refinement operation, similar to other embodiments, user 614 can interact with affordance 612, or another graphical user interface element rendered within graphical user interface 606, to indicate to the client application that the sensory experience is perceived in a different way. In other cases, the client application can be configured to monitor an acoustic signal and / or can be configured for speech recognition or text-to-speech conversion. In these examples, the user can audibly indicate "yes" or "no" or similar feedback to indicate to the client application whether the intended sensory impression has been experienced.

[0196] In other cases, the graphical user interface 606 may include a plurality of buttons for indicating different attributes of the sensory experience felt by the user 614. For example, the graphical user interface 606 may include a button for indicating that the most recent stimulus is more localized than a previous stimulus. Another button may be included to indicate that the most recent stimulus is not more localized than a previous stimulus. Another button may be included to indicate that the most recent stimulus evoked a temperature sensation, a pressure sensation, a texture sensation, or another modality. Another button may be included to indicate whether a particular stimulus was painful or approaching a painful experience. In such an example, the wearable electronic device and / or the client application can define one or more absolute thresholds for a particular user based on the user's perception. In these examples, any stimulus provided by the wearable electronic device will be below the user's pain threshold, regardless of modality, location, or calibration.

[0197] These foregoing embodiments shown in FIGS. 5-6, as well as their various alternatives and variations thereof, are generally presented for illustrative purposes and to facilitate understanding of the various configurations of electronic devices that can be used to assist in field calibration of wearable electronic devices as described herein. However, it will be apparent to those skilled in the art that some of the specific details presented herein may not be required to practice a particular described embodiment or its equivalents.

[0198] Accordingly, it is understood that the foregoing and following descriptions of specific embodiments are presented for purposes of illustration and limited description. These descriptions are not intended to be exhaustive or to limit the disclosure to the exact forms described herein. On the contrary, it will be apparent to those skilled in the art that many modifications and variations are possible in light of the above teachings.

[0199] For example, the wearable electronic device described with reference to FIGS. 5-6 takes a ring form factor, but this is not required in all embodiments. For example, FIG. 7A shows an exemplary cuff form factor device, i.e., a wearable electronic device 700a worn by user 702 within a housing 704 on the user 702's wrist. Wearable electronic device 700a includes an electrode array 706 for transcutaneous stimulation of the median or ulnar nerve, thereby (as an example) evoking a first induced temporary synesthetic event 708 at the user's thumb 710 or a second induced temporary synesthetic event 712 at the user's index finger.

[0200] In another exemplary embodiment, the wearable electronic device can take the form of a glove. FIG. 7B shows an exemplary glove form factor implemented as a wearable electronic device 700b in a palm-down position (shown in a palm-up position in FIG. 7C). As with other embodiments, wearable electronic device 700b can be worn as a glove 714 on the user 702's hand and can include one or more electrode arrays, each of which can be configured to stimulate different mobilized nerves, branches, or groups. The exemplary electrode arrays shown in the figure include electrode arrays 716, 178, 720, and 722. These arrays can operate independently or in concert to evoke sensory impressions at one or more sites in one or more modalities such as sensory impression sites 724, 726, 728, and 730.

[0201] In yet another embodiment, such as shown in FIG. 7D, the wearable electronic device as described herein can take a head-mounted form factor such as a virtual reality headset, augmented reality headset, head-mounted display, head-up display, glasses, earphones, earbuds, earhooks, or a headband such as shown in FIG. 7D.

[0202] In this exemplary embodiment 700c, the user 702 wears the headband 732 so as to place the set of electrodes 734 near the user's vestibular system. In these examples, the user's vestibular system can be stimulated to evoke a sense of balance, disorientation, or other similar sensations. Such an implementation can be used, for example, for training purposes. In other embodiments, other wearable electronic devices having electrode arrays arranged at other relative positions can be used, and it will be understood that the examples presented in FIGS. 7A-7D are merely examples.

[0203] The wearable electronic device can take the form of a harness 700e worn on the user's hand, as shown in FIG. 7E. The harness 700e can include adjustable rings or rings 736a, 736b, 736c, 736d, and 736e, which are configured to be worn on each of the user's fingers. The figure shows a harness with rings for each finger, but in some embodiments, the harness may include any number of rings configured to be worn over a selected finger or a single finger. Rings 736a-e can include an array of electrodes, as described with respect to FIGS. 4A-4P above. The rings can include adjustment tabs that allow the user to expand and / or narrow the ring loop for comfort, increase the contact area between the finger and the electrodes, and easily remove the ring.

[0204] As shown in the figure, the ring can be coupled to the harness cover 738. In some embodiments, for example, the connection portion 737 that connects from the little finger to the body of the harness may be a flexible connection portion to allow the user to adjust the position and orientation of each ring. For example, as shown with respect to the little finger, the adjustable tab may seat towards the palm surface of the hand. As shown with respect to the thumb, the tab may seat on the side surface of the thumb. In some examples, each adjustable tab may seat covering the back surface. As shown in FIGS. 4A - 4P, regardless of the orientation of the tab, each ring and the electrode array of the ring can be operated independently or in cooperation to induce a sensory impression at one or more sites in one or more modalities. In some examples, at the wearing position, the electrode contacts can be scanned to find contacts that meet comfort and / or sensory criteria.

[0205] In some examples, the harness cover 738 can be positioned over a portion of the back of the hand and extend towards the wrist. The harness cover 738 can be made of a soft, flexible material. For example, the harness cover 738 can be made of cotton, nylon, polyester, spandex, tencel, silk, or any other fabric or combination of fabrics, as may be known to those skilled in the art. In some embodiments, the harness cover 738 can accommodate a flexible circuit (not shown). The flexible circuit that transmits power to each of the rings 736a - e can be protected by the fabric of the harness. Additionally, the flexible circuit provides rigidity to the harness and allows the harness to maintain its general structure.

[0206] Furthermore, the harness can include a housing or chamber 740. In some embodiments, the housing or chamber 740 houses a battery, an anode, a stimulation board, and / or a communication module. Similarly, the housing or chamber 740 can include an electromyogram (EMG) sensor and / or other sensors configured to detect physiological parameters from a user. Further, the housing or chamber 740 is mechanically coupled to a flexible circuit. The housing or chamber 740 may be configured to be worn on a portion of the forearm and / or wrist. In this configuration, the weight of the housing or chamber and the components housed within the housing or chamber are positioned on the outside of the hand. This is a configuration where the hand maintains mobility without significant additional weight.

[0207] In some examples, the battery may be friction fit within the housing or chamber 740. For example, the housing may define a generally trapezoidal shape to frictionally engage the battery and prevent its movement. In some embodiments, the housing may include indicators for power, volume, and other buttons. For example, the indicator may be an LED indicator (e.g., indicating the charge level of the battery), a button, or the like.

[0208] As another example, the housing can include two shells that can be coupled via fasteners, rivets, adhesives, tabs, or any other mechanical connection. In some embodiments, the flexible circuit is coupled to a first shell of the housing or chamber. In this configuration, movement of the harness is less likely to remove the flexible circuit from the stimulation board, battery, and / or other electrical circuits within the chamber or housing 740.

[0209] Figure 7F shows a front view of the wearable harness along line A-A of Figure 7E. The harness housing or chamber 740 includes an opening (not shown). The anode 744 is at least partially housed within the housing or chamber 740 and extends through the opening. The anode is configured to contact the user's skin. For example, the anode 744 can contact the lower arm, wrist, and / or a portion of the hand. Although the anode 744 is presented, the housing or chamber 740 can be any other module configured to contact the user's skin and provide and / or draw current, such as an electrode, contact structure, or the like. Although one anode 744 is shown, in other embodiments, the housing or chamber 740 can include multiple openings for two or more anodes, electrodes, and / or contact structures.

[0210] As shown in the figure, the wearable device includes an adjustable strap 742. The adjustable strap 742 can wrap around the lower arm and secure the harness and chamber 740 to the user. In some embodiments, the adjustable position accommodates most sizes of arms. The adjustable strap 742 can be made from any suitable material. For example, the adjustable strap can be an elastic material and can include Velcro for securing the strap to itself. In some examples, the adjustable strap includes a buckle that loops around the adjustable strap 742. The adjustable strap 742 is configured to maintain consistent contact of the anode 744 with the skin. In this configuration, the user can move comfortably without lifting the anode 744 from the wrist.

[0211] In general, the user's palm (not shown) is free, which helps for long - term wearing of the harness. Additionally, the user may interact with the physical environment (e.g., objects) and the virtual environment while wearing the device. For example, the user's experience can be enhanced by combining the sensations of physical and virtual objects. In other examples, the user may experience the physical and virtual environments independently. As another advantage, the position of the harness on the back of the hand has less movement in this part of the hand compared to the palm, so the durability of the harness can be extended.

[0212] The wearable electronic device may also take the form of a band design 700g as shown in FIG. 7G. Similar to FIG. 7E above, embodiments of the band design 700g include rings 746a - e with adjustable tabs. The rings are connected to the band 748 via connection parts 747. Although the connection parts 747 are shown on the back of the hand, in some embodiments, the connection parts may be positioned on the palm. The connection parts 747 may include a cloth sheath that protects the wires or may take the form of a plastic tab extending from the ring to the band.

[0213] Additionally, the band design 700g may include a chamber 750 that houses electronic components including a battery. The chamber 750 may also include an anode (not shown) that extends from the chamber towards the user and is configured to contact the user's skin. The chamber 740 may be fixed to a strap 752 that wraps around the user's lower arm and / or wrist.

[0214] In some embodiments, the band design 700g can include an additional band (not shown) that couples the strap 752 to the band 748. The additional band can include a circuit (e.g., a flex circuit) that operably couples the rings to a battery and / or other electrical circuits positioned within the chamber. This embodiment can enable further adjustability of the wearable device on the knuckles.

[0215] In exemplary embodiments 700e and 700g, the user wears a harness and / or band design such that an array of electrodes is disposed on each of the user's fingers. Specifically, the user can wear a ring on the proximal phalanx of the finger. In these examples, signals to one or each of the fingers are used to evoke the sensation of touching an object, a thermal sensation (e.g., feeling warmth from a furnace), or other tactile sensations, such as grasping an object, popping a bubble, feeling a texture, etc. at the distal or middle phalanx of the same finger. In other embodiments, other wearable electronic devices having electrode arrays disposed at other relative positions can be used, and it will be understood that the examples presented in FIGS. 7E - 7F are merely examples. In embodiments where the electrode array can evoke sensations at many different sites, a multi-site calibration operation can be performed as shown in FIGS. 9A - 9B.

[0216] FIGS. 8A - 8C show an embodiment of a ring form factor shown as part of the wearable device of FIGS. 7E - 7F. As shown in FIG. 8A, the ring 800 can include a housing 802 that defines the thickness of the ring wall, an outer surface 804, and an inner surface 806. The inner surface 806 can include an array of electrodes, such as electrodes 808a and 808b. As discussed with respect to FIGS. 4A - 4P, the electrode size and arrangement can include two electrodes per row (e.g., 808a and 808b). However, other arrangements and patterns are also envisioned.

[0217] The ring 800 can include wires 810 that couple each of the electrodes 808 to a flexible circuit. The wires 810 can be distributed along the circumference of the ring 800. The wires 810 can be exposed or unexposed, as is known to those skilled in the art.

[0218] As shown in FIGS. 8A and 8B, housing 802 may define a helical shape with an overlapping region 812. The helical shape allows a user to adjust the size (e.g., diameter) of the ring to add comfort. For example, the user may tighten or widen the ring. In some embodiments, the ring includes tabs such as tabs 814a and 814b. Tabs 814a and 814b may be pinched by a user to widen the ring (e.g., shorten the size of the overlapping region). In this configuration, the user can quickly remove the ring. In the un-worn position as shown in the figure, the ring may be in its narrowest configuration by default. In this example, the ring in the worn position is widened from its default position, thereby creating a spring effect (e.g., the ring is biased towards its default position) that allows the ring to fit snugly but comfortably. In other embodiments, ring 800 includes a ratchet mechanism that provides individual ring sizes.

[0219] In some cases, each pair of electrodes 808 may be separated by an angle depending on the intended finger ring size of the user. For example, in a smaller ring, the electrodes may be separated by an angle greater than 40 degrees. In other examples, for a larger ring, the separation between the electrodes may be between 20 and 60 degrees. However, other angles are envisioned.

[0220] FIG. 8C shows a side view of ring 800. As shown in the figure, the tabs may have different widths. Specifically, tab 814b extends over width d1 and can bridge both sides of the ring over the shorter width d2 of the housing. Tab 814a can define the end of the housing wall with the shorter width d2. In this configuration, in the fully extended position (e.g., tabs 814a and 814b are pinched and in contact), the tabs function as a stopper to prevent the ring from extending beyond its diameter. This configuration can also protect the material and wires from excessive deformation. In some embodiments, tab 814a is configured to move along rail path 816.

[0221] As described above, the ring 800 can include a wire 810 positioned around the circumference of the ring 800. For example, the wire may be positioned under the tab 814b under the rail path 816. The ring 800 can include a junction 818 that secures the wire in place between the connection (e.g., connection 737) and the transition to the ring. The junction 818 may also secure the sheath from the connection to the ring.

[0222] Figures 9A - 9B show a portable electronic device that executes an instance of a software application configured to communicatively couple to a wearable electronic device and calibrate the wearable electronic device, as described herein. The system 900 of Figures 9A - 9B includes a portable electronic device 902 that includes a display 904 on which a graphical user interface 906 is rendered.

[0223] This graphical user interface 906 can include instructions and visualizations 908 that inform the user of how / where to wear the wearable electronic device, locations (different sites as shown in Figure 9A compared to Figure 9B) where a sensory impression is expected to be evoked, and what modality that sensory impression will take. Depending on experiencing the sensation shown at the site shown, an affordance 910 can be pressed by the user to indicate to the device that the identified sensation has been experienced.

[0224] Specifically, as described above, during calibration, the wearable electronic device can iterate through one or more combinations of a signal and a cathode / anode pair or set selected from one or more electrodes. The wearable electronic device can pause during the time period between each test stimulus to give the user an opportunity to interact with a client application that renders the graphical user interface 906 to indicate whether a particular sensory impression has been experienced.

[0225] As with other embodiments described herein, further refinement of the signal applied via the electrodes can be performed when the user indicates that the intended sensation has been experienced. For example, a wearable electronic device can modify one or more characteristics of a test signal that evoked an intended sensory impression having an intended sensory impression modality and an intended sensory impression site. As described above, such characteristics include changing the frequency, duty cycle, magnitude, anode / cathode assignment between different electrodes, stimulus duration, and the like.

[0226] In response to each refinement operation, as with other embodiments, the user can interact with the affordance 910, or another graphical user interface element rendered within the graphical user interface 906, to indicate to the client application that the perceptual experience is perceived in a different way. In other cases, the client application can be configured to monitor an acoustic signal and / or can be configured for speech recognition or text-to-speech conversion. In these examples, the user can audibly indicate "yes" or "no" or similar feedback to indicate to the client application whether the intended sensory impression has been experienced.

[0227] In other cases, the graphical user interface 906 can include a plurality of buttons for indicating different attributes of the sensory experience felt by the user. For example, the graphical user interface 906 can include a button for indicating that the most recent stimulus is more localized than a previous stimulus. Another button may be included to indicate that the most recent stimulus is not more localized than a previous stimulus.

[0228] Another button may be included to indicate that a recent stimulus evoked a temperature sensation, a pressure sensation, a texture sensation, or another modality. Another button may be included to indicate whether a particular stimulus was painful or approaching a painful experience. In such examples, the wearable electronic device and / or client application may define one or more absolute thresholds for a particular user based on the user's perception. In these examples, any stimulus provided by the wearable electronic device will be below the user's pain threshold, regardless of modality, site, or calibration.

[0229] These foregoing embodiments and various alternatives and variations thereof illustrated in Figures 7A-9B are generally presented for purposes of explanation and to facilitate understanding of various graphical user interfaces that can assist in field calibration of a wearable electronic device as described herein, and in particular, in creating or updating a stimulation regimen, calibration profile, and / or stimulation profile as described herein. However, it will be apparent to one skilled in the art that some of the specific details presented herein may not be required to practice a particular described embodiment or its equivalents.

[0230] Thus, it is to be understood that the foregoing and following descriptions of specific embodiments have been presented for limited purposes of illustration and description. They are not intended to be exhaustive or to limit the disclosure to the precise forms described herein. On the contrary, many modifications and variations will be apparent to those skilled in the art in light of the above teachings.

[0231] For example, it should be understood that client devices or portable electronic devices running software applications described herein may not be limited to cellular phone implementations, For example, in some cases, calibration may be performed in a virtual environment with the aid of a virtual reality headset or heads-up display, as one example.

[0232] It can be further understood that, for example, transcutaneous stimulation is not necessary in all embodiments. As an example, an implantable electronic device may be configured to perform an operation of stimulating the recruited nerve, similar to the transcutaneous embodiments described herein. For example, FIG. 10A shows an embodiment 1000a in which the index finger 1002 functions as an implantation site for the implantable electronic device 1004.

[0233] Similar to other embodiments described herein, the implantable electronic device 1004 includes an electrode array for direct stimulation of the median nerve, thereby evoking an induced temporary synesthetic event having a perceived sensory impression site different from the implantation site.

[0234] As another example, FIG. 10B shows an embodiment 1000b in which an implantable electronic device 1006 implanted in the wrist includes an electrode array for direct stimulation of the median nerve, thereby evoking an induced temporary synesthetic event having a perceived sensory impression site different from the implantation site.

[0235] These foregoing embodiments shown in FIGS. 10A - 10B, as well as their various alternatives and modifications thereof, are presented generally for purposes of illustration and to facilitate understanding of implantable embodiments (which may include one or more features as described with reference to FIG. 3) as described herein. However, it will be apparent to those skilled in the art that some of the specific details presented herein may not be required to practice a particular described embodiment or its equivalents.

[0236] Accordingly, it is understood that the foregoing and following descriptions of specific embodiments are presented for purposes of illustration and limited description. These descriptions are not intended to be exhaustive or to limit the present disclosure to the exact forms described herein. On the contrary, it will be apparent to those skilled in the art that many modifications and variations are possible in light of the above teachings.

[0237] For example, in some cases, the wearable device described herein can be used as an input device for an electronic device such as a mobile phone or a laptop device described herein, or in conjunction with an input device.

[0238] For example, FIG. 11 shows a portable electronic device that executes an instance of a software application configured to operate with the wearable electronic device described herein to provide tactile feedback.

[0239] System 1100 includes portable electronic device 1102 and user 1104. User 1104 wears wearable electronic device 1106 on the user's wrist to evoke a sensory experience associated with manipulating virtual objects such as virtual dial 1108 in space. For example, a first sensory experience 1110a perceived at the sensory impression site of the user's index finger and a second sensory experience 1110b perceived at the sensory impression site of the user's index finger can each mimic a mechanical detent. In other words, when user 1104 rotates virtual dial 1108 in direction 1112, a "click" sensation can be imparted to both the finger and the thumb to mimic the sensation of rotating a mechanical dial.

[0240] Furthermore, when user 1104 rotates virtual dial 1108, the changing angular position of virtual dial 1108 can be used to notify changes to the graphical user interface rendered by display 1114 of portable electronic device 1106, particularly to the elements displayed within graphical user interface 1116.

[0241] The rotation action performed by user 1104 can be used as input for modifying the position of a list of items 1118, changing the position of a volume or brightness slider 1120, or for any other suitable purpose.

[0242] These foregoing embodiments shown in FIG. 11, as well as various alternatives and variations thereof, are generally presented for purposes of illustration and to facilitate understanding of specific use cases for wearable electronic devices as described herein. However, it will be apparent to those skilled in the art that some of the specific details presented herein may not be required to practice the specific described embodiments or their equivalents.

[0243] Accordingly, it is understood that the foregoing and following descriptions of specific embodiments are presented for purposes of illustration and limited description. These descriptions are not intended to be exhaustive or to limit the disclosure to the exact forms described herein. On the contrary, it will be apparent to those skilled in the art that many modifications and variations are possible in light of the above teachings.

[0244] For example, further embodiments described herein relate to methods for providing tactile feedback, methods for inducing temporary synesthetic events, and the like.

[0245] FIG. 12 is a flowchart showing exemplary operations of a method for creating a stimulation plan for performing user-specific temporary synesthetic events. Method 1200 can be executed by any suitable combination of hardware or software as described herein. In particular, some parts of method 1200 may be executed by a portable electronic device, and other parts of method 1200 may be executed by a wearable electronic device as described herein.

[0246] Method 1200 includes an operation 1202 in which data is received that describes or includes information describing an object or surface interaction event. This data can be generated by a virtual game environment, a portable electronic device, or any other suitable electronic device.

[0247] In operation 1204, one or more sensory impression sites and one or more sensory impression modalities can be determined. The site may be associated with a particular finger or body part of the user, and the modality may be pressure, temperature, texture, etc. In many cases, combinations of different sites and combinations of different modalities can be time multiplexed together or presented simultaneously in other ways to stimulate rich and complex sensory experiences.

[0248] In operation 1206, a simulation plan can be created based on the selected modality and the selected site. In some cases, the simulation plan may be created by selecting one or more stimulus profiles generated in a calibration operation as described above from a data store. The data store may be part of a wearable electronic device or part of a portable electronic device. In some cases, the data store may be provided by a remote third - party service. More specifically, using a particular target site and a particular target modality at that site, the data store can be queried to return a particular stimulus profile. In some cases, the data store may be a lookup table or a structured database.

[0249] The stimulation plan can also be created or modified based on the calibration profile generated in the calibration operation, as described herein. Similar to the stimulus profile, the calibration profile can be obtained by querying a local or remote database or data store for the wearable electronic device.

[0250] Method 1200 further includes operation 1208 where the stimulation plan is modified by a user-specific threshold. The stimulation plan may, for example, be modified by scaling the amplitude of the stimulation by a scalar value specific to the user. In other cases, the stimulation plan may be enveloped or clipped so as not to exceed a certain value. For example, a user with low pain tolerance and / or high somatosensory sensitivity can have a stimulation plan that is clipped to a specific maximum amplitude value.

[0251] Figure 13 is a flowchart showing exemplary operations of a method for inducing a user-specific synesthetic event. Method 1300 can be executed by any suitable combination of hardware and software as described herein. In particular, a portion of method 1300 may be executed by a portable electronic device, and other portions of method 1300 may be executed by a wearable electronic device as described herein.

[0252] Method 1300 includes operation 1302 of generating a user-specific (and orientation-specific) stimulation plan. Next, in operation 1304, parameters associated with that stimulation plan, including amplitude, frequency, pulse frequency, pulse width, duty cycle, and / or current steering, can be determined or obtained from a database or look-up table. Next, in operation 1306, method 1300 proceeds to select at least one pair of electrodes and assign the responsibilities of cathode and anode to each electrode. In addition, method 1300 determines which signal parameters to apply to the selected electrodes. Finally, in operation 1308, the stimulation plan can be executed.

[0253] FIG. 14 is a flowchart showing an exemplary operation of a method for calibrating a wearable electronic device as described herein. Method 1400 can be executed by any suitable combination of hardware or software as described herein. In particular, some parts of method 1400 may be executed by a portable electronic device, and other parts of method 1400 may be executed by a wearable electronic device as described herein.

[0254] Method 1400 relates to the creation of a calibration profile as described herein. In particular, method 1400 includes an operation 1402 in which an electronic device, such as a wearable electronic device or a portable electronic device communicating with the wearable electronic device, enters a calibration mode in which it can create a calibration profile.

[0255] Next, in operation 1404, the wearable electronic device can iterate through one or more patterns of cathode and anode assignments and select signals to apply to those pair rings. In some examples, the wearable electronic device can iterate through one or more stimulation profiles as described herein and change the cathode or anode assignments to determine the relative position of a particular electrode with respect to the sensory nerve. In these examples, one or more calibration routines can also iterate through stimulation parameters such as pulse width, pulse frequency, pulse amplitude, etc. in addition to electrode pair rings or groupings.

[0256] In other cases, the cathodes and anodes can be assigned in pairs, and in other cases, two or more cathodes can be used with one or more anodes. In other words, the positive terminal of a signal generator within a wearable electronic device as described herein can be coupled to cathodes or groups of cathodes dispersed at different positions within the electrode array, and the negative terminal of the same signal generator can be coupled to one or more other electrodes that function as its anodes.

[0257] A signal generator as described herein can be implemented in a plurality of ways. In some cases, the signal generator can be implemented at least in part in software. In other cases, the signal generator can include a digital-to-analog converter, a shift register (operable to iterate through sample points of an analog waveform supplied as an input to the DAC), a direct digital synthesizer, or any other suitable digital-to-analog signal conversion topology. In some cases, the signal generator described herein may be configured to output a square wave or a triangular wave having a frequency, duty cycle, amplitude, phase, or other characteristic that can be digitally set or controlled by the wearable electronic device described herein.

[0258] When a plurality of signals generated by the signal generator are applied to a specified set of electrodes (to which different anode or cathode assignments are assigned for different signals), method 1400 can proceed to receive from the wearer of the electronic device an input that a reference sensation has been perceived. Similar to other embodiments described herein, this input can be provided by the user, for example, by interacting with an affordance rendered within a graphical user interface of a portable electronic device that communicates with the wearable electronic device.

[0259] In some examples, a trained machine learning model and / or sensor input can be used to determine which signal to apply, which electrode to assign as an anode or cathode, or whether to increase, decrease, or otherwise modify which signal parameter.

[0260] For example, in some cases, over time, the wearable electronic device described herein can determine that some signals applied to a particular electrode do not evoke a desired sensation in a particular user or group of users. In these examples, the machine learning model can be trained using previous calibration and / or stimulation profiles or calibration profiles. More specifically, the machine learning model can be trained across a single user or multiple users using a dataset that includes labels for "sensation impression received" or "sensation impression not received" for different calibration parameters. In these examples, patterns can emerge that inform which signals are likely to evoke sensations for a particular user, a particular demographic, a particular environment (e.g., temperature, humidity, geographical location, etc.).

[0261] In such examples, operation 1404 can be at least partially informed by the operation of the trained machine learning model.

[0262] In this way, method 1400 can be utilized to determine which electrodes can be used with which anode / cathode assignments to stimulate the sensory nerves of a particular user given a particular orientation of the wearable electronic device.

[0263] FIG. 15 is a flowchart illustrating exemplary operations of a method for calibrating a stimulation provided by a wearable electronic device described herein. Method 1500 can be performed by any suitable combination of hardware and / or software as described herein. In particular, a portion of method 1500 may be performed by a portable electronic device, and other portions of method 1500 may be performed by a wearable electronic device as described herein.

[0264] Method 1500 relates to the creation of the stimulation profiles described herein. In particular, method 1500 includes an operation 1502 in which an electronic device, such as a wearable electronic device or a portable electronic device communicating with a wearable electronic device, enters a calibration mode in which the stimulation profile can be created.

[0265] Next, in operation 1504, the wearable electronic device can iterate through different signals (given a particular calibration profile that associates electrode positions with the positions of the sensory nerves for stimulation). Additionally, these iterated signals can be assigned to different cathodes and anodes. In other words, as described above, the positive terminal of the signal generator within the wearable electronic device described herein can be coupled to cathodes or groups of cathodes dispersed at different positions within the electrode array, and the negative terminal of the same signal generator can be coupled to one or more other electrodes that function as its anode.

[0266] Thereafter, in operation 1506, an input indicating that a particular sensory impression has been perceived can be received from the user.

[0267] In this way, method 1500 can be utilized to determine which type of stimulation of a particular user's sensory nerves evokes which sensory modality at which sensory site. Similar to other embodiments, method 1500 can be at least partially executed by a trained machine learning model or can be executed while leveraging the output from a trained machine learning model.

[0268] FIG. 16 is a flowchart showing exemplary operations of a method of inducing agnosia using a wearable electronic device as described herein. Method 1600 can be executed by any suitable combination of hardware or software as described herein. In particular, a portion of method 1600 may be executed by a portable electronic device, and other portions of method 1600 may be executed by a wearable electronic device as described herein.

[0269] Method 1600 includes an operation 1602 in which a wearable electronic device is calibrated with respect to the user's vestibular system. For example, the device may be positioned behind the user's ear adjacent to the mastoid process. Thereafter, in operation 1604, a command to stimulate the user's vestibular system to induce vertigo, nausea, or a sense of balance may be received in the wearable electronic device (or another device). This operation may be performed for training purposes, to enhance the discomfort associated with an entertainment experience, to induce or increase a sense of dizziness or balance, etc. In operation 1604, the stimulation program may be executed by the wearable electronic device.

[0270] FIG. 17 is a flowchart showing exemplary operations of a method of operating a wearable electronic device based on events occurring in a virtual environment. Method 1700 can be executed by any suitable combination of hardware or software as described herein. In particular, a portion of method 1700 may be executed by a portable electronic device, and another portion of method 1700 may be executed by a wearable electronic device as described herein.

[0271] Method 1700 relates to using the wearable electronic device described herein in a virtual game environment. Method 1700 includes an operation 1702 of receiving stream data from a game engine. The stream data may include information linking visual and auditory stimuli to tactile or sensory effects evoked by the wearable electronic device as described herein. Next, in operation 1704, the sensory / tactile effects may be desynchronized from the (stimulated out-of-phase) visual effects such that the sensory effects are executed (in operation 1706) prior to the visual effects (e.g., on the order of hundreds of milliseconds) to more accurately simulate the timing difference between the user's visual response and the user's somatosensory response to the same.

[0272] In some cases, the delay separating the evoked sensory impression as described herein from the audiovisual stimuli rendered in the virtual environment may be user-specific and / or virtual environment-specific. For example, in some cases, the visual stimuli may be presented closer in time to the evoked sensory impression (e.g., a high-speed game such as a racing game or a high-speed reaction time game). In other cases, the auditory / visual stimuli may be presented at a particular perceived spatial location corresponding to the sensory impression site (e.g., by leveraging the phase delay between the left ear channel and the right ear channel and / or by applying a head-related transfer function to the incoming audio signal). For example, before the auditory sound of an insect that appears to spatially emanate from a virtual insect rendered on the back of the user's virtual hand is generated while the visual rendering of the small insect is rendered on the user's virtual hand, the back of the user's hand can be stimulated with a pressure sensation. In this illustration, the user may perceive the touch before the audiovisual feedback confirms to the user that the virtual bug has landed on the user's virtual hand.

[0273] FIG. 18 is a flowchart showing an exemplary operation of a method of operating a wearable electronic device described herein. Method 1800 can be executed by any suitable combination of hardware or software as described herein. In particular, a portion of method 1800 may be executed by a portable electronic device, and other portions of method 1800 may be executed by a wearable electronic device as described herein.

[0274] Method 1800 relates to using a wearable electronic device as described herein in conjunction with a physical device such as a surgical robot, robotic device, or mechanical prosthesis. The method can operate in a loop and includes operation 1802 where an interaction with an object or surface is detected by the device. Optionally, the sensing system of the device may be configured to detect the texture, pressure, and / or temperature of the grasped object or the surface with which the device interacts. Next, in operation 1804, the characteristics detected in operation 1802 can be evoked as a sensory impression as described above. In many cases, these sensory impressions can be user-specific as described above (e.g., custom calibration profile, custom stimulation profile, custom stimulation plan, custom envelope, custom clipping, etc.).

[0275] FIG. 18 is a flowchart illustrating exemplary operations of a method for providing tactile feedback to a user of a portable electronic device. Method 1800 can be executed by any suitable combination of hardware or software as described herein. In particular, a portion of method 1800 may be executed by a portable electronic device, and other portions of method 1800 may be executed by a wearable electronic device as described herein.

[0276] Method 1800 relates to using the wearable electronic device described herein in conjunction with an electronic device such as a mobile phone. The method includes operation 1802 where a notification is received by the portable electronic device. The notification can correspond to the reception of an incoming call, new message, event detected by a particular application, etc.

[0277] In response to a notification received in an electronic device, in operation 1804, a stimulation plan can be executed by a wearable electronic device to induce a sensory impression for notifying a user of an event in a portable electronic device. For example, the user can perceive two taps on the dorsal side of the left hand in response to receiving an email on the user's mobile phone. In another example, the user can perceive a circular trace on the palm of the user's right hand in response to receiving a message from a specific sender.

[0278] These examples are not exhaustive, and as will be understood by those skilled in the art, many are possible.

[0279] As used herein, the phrase "at least one of" preceding a series of items modifies the list as a whole, rather than each member of the list, together with the term "and" or "or" used to separate any of the items. The phrase "at least one of" does not require a selection of at least one of each of the listed items; rather, this phrase enables the meaning of including at least one of any of the items, and / or at least one of any combination of the items, and / or at least one of each of the items. By way of example, the phrases "at least one of A, B, and C" or "at least one of A, B, or C" each refer to only A, only B, or only C, any combination of A, B, and C, and / or one or more of each of A, B, and C. Similarly, it can be understood that the order of elements presented for a sequential or alternative list provided herein should not be construed as limiting the disclosure to only that order provided.

[0280] Although many embodiments have been disclosed above, it should be understood that the operations and steps presented with respect to the methods and techniques described herein are exemplary and, therefore, not exhaustive. Further, it can be understood that in certain embodiments, alternative step orders or fewer or additional operations may be required or desired.

[0281] The above disclosure has been described with respect to various exemplary embodiments and implementations, but the various features, aspects, and functions described in one or more of the individual embodiments are not limited in their applicability to the specific embodiments in which they are described. Instead, regardless of whether such embodiments are described and regardless of whether such features are presented as part of the embodiments in which they are described, they can be applied, alone or in various combinations, to one or more of some embodiments of the present invention. Therefore, the breadth and scope of the present invention should not be limited by any of the above exemplary embodiments, but instead are defined by the claims presented herein.

[0282] In addition, it should be understood that organizations and / or entities responsible for access, aggregation, verification, analysis, disclosure, transfer, storage, or other use of private data as described herein will preferably comply with publicly available and industry-established privacy, data, and network security policies and practices. For example, it should be understood that data and / or information obtained from remote or local data sources should be accessed and aggregated only for legitimate, agreed upon, and reasonable uses, based only on the informed consent of the subjects of such data and / or information.

[0283] As used in the specification, the term "processing resource" refers to any physical and / or virtual electronic device or mechanical component, or set or group of physical and / or virtual electronic devices or mechanical components interconnected and / or communicatively coupled, suitable for performing or causing to be performed one or more arithmetic or logical operations on digital data.

[0284] Exemplary processing resources contemplated herein include, without limitation, single or multi-core processors, single or multi-threaded processors, coprocessors configured for a particular purpose (e.g., graphics processing unit, motion processing unit, sensor processing unit, etc.), volatile or non-volatile memory, application specific integrated circuits, field programmable gate arrays, input / output devices and systems and their components (e.g., keyboard, mouse, trackpad, general purpose human interface device, video camera, microphone, speaker, etc.), networking devices and systems and their components (e.g., router, switch, firewall, packet shaper, content filter, network interface controller or card, access point, modem, etc.), embedded devices and systems and their components (e.g., system on chip, internet of things device, etc.), industrial control or automation devices and systems and their components (e.g., programmable logic controller, programmable relay, supervisory control and data acquisition controller, individual controller, etc.), vehicle or aviation control device systems and their components (e.g., navigation device, safety device or controller, security device, etc.), enterprise or business infrastructure devices or appliances (e.g., in-building switch device, voice over internet protocol host and controller, end-user terminal, etc.), personal electronic devices and systems and their components (e.g., mobile phone, tablet computer, desktop computer, laptop computer, wearable device), personal electronic devices and their accessories (e.g., peripheral input device, wearable device, embedded device, medical device, etc.), etc. It can be understood that the foregoing examples are not exhaustive.

[0285] More generally, as described herein, the term "processor" refers to any software and / or hardware implemented data processing device or circuit that is physically and / or structurally configured to instantiate one or more classes or objects dedicated to performing a specific transformation of data that includes operations represented as code and / or instructions included in a program that can be stored in and accessed from memory. This term is meant to encompass a single processor or processing unit, multiple processors, multiple processing units, analog or digital circuitry, or other suitably configured computing elements or combinations of elements.

[0286] Similarly, as described herein, the term "memory" refers to any software and / or hardware implemented data storage device or circuit that is physically and / or structurally configured to store digital information, whether structured or unstructured.

[0287] Furthermore, the foregoing examples and descriptions of instances of purpose-configured software, whether accessible via an application programming interface (API) as a request-response service, an event-driven service, or configured as a self-contained data processing service, are understood not to be exhaustive. In other words, one of ordinary skill in the art can understand that the various functions and operations of the systems described herein can be implemented in any number of suitable ways using any number of suitable libraries, frameworks, first-party or third-party APIs, local or remote databases (relational, NoSQL, or any other architecture, or any combination thereof), programming languages, software design techniques (e.g., procedural, asynchronous, event-driven, etc., or any combination thereof), and the like. The various functions described herein can be implemented in the same way (e.g., using a common language and / or design) or in different ways. In many embodiments, the functions of the systems described herein can be implemented as individual microservices that are containerized or executed / instantiated using individual virtual machines that respond only to authenticated API requests from other microservices of the same system. Similarly, each microservice can be configured to provide data output and receive data input via an encrypted data channel. In some cases, each microservice may be configured to store its own data in a dedicated encrypted database, while in other cases, a microservice can store encrypted data in a common database, and whether such data is stored in a table shared by multiple microservices or a microservice can utilize a separate independent table / schema can vary from embodiment to embodiment. As a result of these described architectures and other equivalent architectures, it can be understood that the systems described herein can be implemented in any number of suitable ways. For the sake of simplicity of explanation, many of the following embodiments are described with reference to implementations where the individual functions of the system are implemented as individual microservices.It is understood that this is merely one possible implementation form.

Claims

1. A wearable electronic device comprising: a housing defining an outer surface configured to conform to the contour of a user's skin surface; an electrode array extending at least partially through the outer surface to contact the skin surface; a memory resource storing at least one executable asset; a processing resource operably coupled to the memory resource and configured to cooperate with the memory resource to access the at least one executable asset and instantiate an instance of software, the software being configured to: determine a sensory impression site; determine a sensory impression modality; query a first data store using the sensory impression site and modality to retrieve a stimulation profile including the magnitude and polarity of a current that, when applied to the user's sensory nerves at the sensory impression site, elicits a sensory impression corresponding to the sensory impression modality; query a second data store using the stimulation profile to retrieve a calibration profile including information associating the positions of the electrodes of the electrode array with the user when the wearable electronic device is worn by the user; query a third data store to obtain a user-specific profile including a threshold defining a limit for the magnitude of the current of the stimulation profile; create a stimulation plan using the stimulation profile, the user-specific profile, and the calibration profile, the stimulation plan including parameters defining at least one signal for inducing, across a selected pair of electrodes of the electrode array, a current having the magnitude and polarity defined by the stimulation profile; generate the at least one signal and apply the at least one signal across the selected pair of electrodes to execute the stimulation plan.

2. The wearable electronic device of claim 1, wherein the housing has an annular shape and the wearable electronic device is configured to be worn on a finger of the user.

3. The wearable electronic device of claim 2, wherein the finger is an index finger or a middle finger and the sensory nerve is the median nerve.

4. The wearable electronic device according to claim 2, wherein the sensory impression site is the fingertip of the user.

5. The wearable electronic device according to claim 1, wherein the wearable electronic device is configured to be worn on the user's wrist.

6. The wearable electronic device according to claim 1, wherein the first electrode of the electrode array is formed of a first metal, and the second electrode of the electrode array is formed of a second metal.

7. The wearable electronic device according to claim 1, wherein the user-specific profile includes a maximum current that can be induced.

8. The instance of the software is configured to receive a signal from a separate electronic device, the signal includes instructions to evoke a sensory impression for the user, and the sensory impression includes the sensory impression modality and the sensory impression site. The wearable electronic device according to claim 1.

9. The wearable electronic device according to claim 8, wherein the separate electronic device includes a virtual computing environment.

10. The sensory impression modality is pressure sensory impression, temperature sensory impression texture sensory impression, or selected from time-varying mechanical sensory impressions. The wearable electronic device according to claim 1.

11. A method of evoking a tactile sensation in a user of a wearable electronic device, the method comprising: receiving instructions to provide sensory feedback to the user; selecting a sensory impression site at least partially based on the instructions; receiving, based on the sensory impression site, a stimulation profile, the stimulation profile including the characteristics of a current that, when transcutaneously induced in the user's major sensory nerves by the operation of two or more electrodes in contact with the user's skin, evokes a pressure sensory impression at the sensory impression site distal to the major sensory nerves; modifying the stimulation profile based on a user-specific threshold; receiving a calibration profile including information associated with the positions of the two or more electrodes relative to the user. Generating a stimulation plan using the modified stimulation profile and the calibration profile, the stimulation plan including parameters defining at least one signal to be applied across the two or more electrodes to induce the current in the sensory nerve. Executing the stimulation plan by generating the at least one signal and applying it across the two or more electrodes. A method comprising these steps. **Claim 12** The method according to claim 11, provided by a virtual computing environment. **Claim 13** The method according to claim 12, wherein the virtual computing environment includes a virtual reality environment. **Claim 14** The method according to claim 12, wherein the wearable electronic device is worn on the user's hand such that the two or more electrodes contact the user's skin. **Claim 15** The method according to claim 12, wherein the site of the sensory impression is distal to the wearable electronic device. **Claim 16** A method of providing feedback using a wearable electronic device positioned over a section of the major sensory nerve innervating the user's hand in response to the occurrence of an event in a virtual reality environment. The method includes: Receiving, from the virtual reality environment, a signal corresponding to the event. Generating a stimulation plan including parameters defining at least one user-specific electrical signal to be applied across two or more electrodes in contact with the user's skin to induce a current in the major sensory nerve, the at least one user-specific electrical signal being selected to evoke a sensory impression at the user's fingertip distal to the section of the major sensory nerve. Executing the stimulation plan in response to the event. A method comprising these steps. **Claim 17** The method according to claim 16, wherein the current has a pulse width, duty cycle, pulse amplitude, frequency, and polarity selected to evoke the sensory impression. **Claim 18** The method according to claim 16, wherein the wearable electronic device is a wrist cuff and the sensory nerve is the superficial radial nerve, median nerve, or ulnar nerve of the user's wrist. **Claim 19** The method according to claim 16, wherein the sensory impression is selected by the user. **Claim 20** The method according to claim 16, wherein the sensory impression is at least partially defined by the event.

Images