Smart ring

JP2024164228AInactive Publication Date: 2024-11-26ARKH INC
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
JP2024146414
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Priority Date
2020-03-16
Filing Date
2024-08-28
Publication Date
2024-11-26
Estimated Expiration
Not applicable · inactive patent

Smart Images

  • Figure 2024164228000001_ABST
    Figure 2024164228000001_ABST
Patent Text Reader

Abstract

To provide an appropriate smart ring.SOLUTION: A smart ring is provided. The smart ring includes a ring body configured to be put on a finger of a user. The smart ring includes a capacitive touch sensor coupled to the ring body. The capacitive touch sensor is configured to receive touch input from the user and convert the touch input into an input signal. The smart ring includes a processor coupled to the capacitive touch sensor. The processor is configured to receive the input signal from the capacitive touch sensor and use the input signal to generate a transmission signal. The smart ring further includes a communication interface coupled to the processor. The communication interface is configured to transmit the transmission signal to another device.SELECTED DRAWING: Figure 1
Need to check novelty before this filing date? Find Prior Art

Description

[Background technology]

[0001] (CROSS REFERENCE TO RELATED APPLICATIONS) This application claims priority to U.S. Provisional Patent Application No. 62 / 905,239, filed September 24, 2019, and U.S. Provisional Patent Application No. 62 / 990,059, filed March 16, 2020, both of which are incorporated by reference in their entireties herein.

[0002] The present disclosure generally relates to systems and methods for sensory augmentation via a smart ring.

[0003] Frequently, humans want to communicate with others or machines at a distance. However, typical sensory data provided to humans by machine-human interfaces occupies one of the five senses, particularly hearing or vision, and distracts that sense from other inputs. Furthermore, individuals with disabilities, such as hearing or vision impairments, have difficulty interacting with such machine-human interfaces. Existing machine-human interfaces are often not suitable for high-distraction environments, environments that force silence, or environments where the user must actively monitor the real-world surroundings rather than the electronic device.

[0004] In addition, existing smart accessory devices such as watches or wrist-worn devices are not suitable for detecting the movement of a user's hand due to the inability to detect finger movement, and other approaches using watches or wrist-worn devices are also not suitable for communicating information using tactile stimulation for anatomical reasons related to the lack of nerves or specific nerves close enough to the skin in the wrist area. Summary of the Invention [Means for solving the problem]

[0005] A smart ring is provided. The smart ring includes a ring body configured to be worn on a finger of a user. The smart ring includes a capacitive touch sensor coupled to the ring body. The capacitive touch sensor is configured to receive touch input from a user and convert the touch input into an input signal. The smart ring includes a processor coupled to the capacitive touch sensor. The processor is configured to receive the input signal from the capacitive touch sensor and generate a transmission signal using the input signal. The smart ring further includes a communication interface coupled to the processor. The communication interface is configured to transmit the transmission signal to another device.

[0006] In some aspects of the smart ring, the touch input is a deep tap, and the processor is further configured to distinguish between the deep tap and a single tap and a double tap.

[0007] In some aspects of the smart ring, the capacitive touch sensor is further configured to identify a user's fingerprint and transmit the user fingerprint data to the processor. In some of these aspects, the user fingerprint data is used to unlock the ring.

[0008] In some aspects of the smart ring, the smart ring further includes a position sensor coupled to the ring body, the position sensor configured to obtain position data and transmit the position data to the processor, the processor configured to use the position data to generate a second transmission signal, and the communication interface configured to transmit the second transmission signal to another device.

[0009] In some aspects of the smart ring, the position data includes a three-dimensional position change in a Cartesian coordinate system.

[0010] In some aspects of the smart ring, the ring further includes a biometric sensor coupled to the ring body. The biometric sensor is configured to obtain biometric data about the user and transmit the biometric data to the processor. The processor is configured to generate a second transmission signal using the biometric data, and the communication interface is configured to transmit the second transmission signal to another device.

[0011] In some aspects of the smart ring, the smart ring additionally includes a microphone coupled to the ring body. The microphone is configured to receive voice data from a user and transmit the voice data to a processor. The processor is configured to generate a second transmission signal using the voice data. The communication interface is configured to transmit the second transmission signal to another device.

[0012] In some aspects of the smart ring, the smart ring further includes a memory coupled to the processor, the memory including an access identifier (ID), and the communication interface including a near field communication (NFC) interface configured to communicate the access ID to a security reader external to the smart ring.

[0013] In some aspects of the smart ring, the smart ring further includes a tactile stimulator coupled to the processor. The communication interface is configured to receive data, and the processor is configured to provide a drive signal to the tactile stimulator based on the data. The tactile stimulator is configured to receive the drive signal and communicate the data to the user via the tactile stimulation.

[0014] In some aspects of the smart ring, the tactile stimulus is a vibration.

[0015] In some aspects of the smart ring, the smart ring further includes an optical sensor coupled to the processor and oriented outwardly from the smart ring such that when the smart ring is worn by a user, the optical sensor is oriented toward the end of a finger. The optical sensor is configured to detect an item that the user is pointing at, and the processor is further configured to transmit an indication of the item to another device.

[0016] Another smart ring is provided. The smart ring includes a ring body configured to be worn on a finger of a user. The smart ring further includes a tactile stimulator coupled to the ring body, the tactile stimulator configured to generate pressure on the skin of the user or transmit electrical impulses. The smart ring further includes a communication interface coupled to the ring body and configured to receive data. The smart ring further includes a processor coupled to the tactile stimulator and the communication interface. The processor is configured to provide a drive signal to the tactile stimulator based on the data, and the tactile stimulator is configured to receive the drive signal from the processor and communicate the data to the user via the tactile stimulation.

[0017] In some aspects of the smart ring, the communication interface wirelessly receives data from a wireless device or hub.

[0018] In some aspects of the smart ring, a plurality of tactile stimulators are spaced circumferentially around an interior surface of the ring body, and a drive signal is configured to individually activate each of the tactile stimulators in a series of unique combinations, each unique combination representing a phonetic character in the alphabet.

[0019] In some aspects of the smart ring, the smart ring further includes a touch sensor coupled to the ring body and configured to receive input from a user, and the communication interface is further configured to wirelessly transmit the input to a wireless device or hub.

[0020] In some aspects of the smart ring, the smart ring further includes an optical sensor coupled to the processor and oriented outwardly from the smart ring such that when the smart ring is worn by a user, the optical sensor is oriented toward the end of a finger. The optical sensor is configured to detect an item that the user is pointing at, and the processor is further configured to transmit an indication of the item to another device.

[0021] A method is provided, the method including using a smart ring worn on a user's finger to obtain location data of the smart ring, the location data including the location of the smart ring and any position changes of the smart ring, the method further including transmitting the location data to another device.

[0022] In some aspects of the method, the position data identifies movements of the user's hands, and the position data transmitted to the other device directs actions on the other device.

[0023] In some aspects of the method, the movement is pointing and the smart ring includes an optical sensor oriented outward from the smart ring toward the end of the finger, the optical sensor configured to detect an item at which the user is pointing, and the method further includes transmitting an indication of the item to another device.

[0024] In some aspects of the method, the movement is a swipe and the smart ring includes an optical sensor oriented outwardly from the smart ring toward the end of the finger, the optical sensor configured to detect an item that the user is swiping, and the method further includes transmitting an indication of the item to another device.

[0025] In some aspects, an apparatus is provided. The apparatus includes means for forming a ring body. The means for forming the ring body is configured to be worn on a finger of a user. The apparatus further includes means for capacitive touch sensing coupled to the means for forming the ring body. The means for capacitive touch sensing is configured to receive touch input from a user and convert the touch input into an input signal. The apparatus comprises means for processing coupled to the means for capacitive touch sensing. The means for processing is configured to receive an input signal from the means for capacitive touch sensing and generate a transmission signal using the input signal. The apparatus further includes means for communication coupled to the processor and configured to transmit the transmission signal to another device.

[0026] In some aspects of the apparatus, the touch input is a deep tap, and the means for processing is further configured to distinguish between the deep tap and a single tap and a double tap.

[0027] In some aspects of the device, the means for capacitive touch sensing is further configured to identify a fingerprint of a user and transmit the user fingerprint data to the means for processing. In some embodiments, the user fingerprint data is used to unlock the device.

[0028] In some aspects of the apparatus, the apparatus further includes a means for sensing a position coupled to the means for forming a body of the ring. The means for sensing a position is configured to obtain position data and transmit the position data to the means for processing. The means for processing is configured to generate a second transmission signal using the position data, and the means for communicating is configured to transmit the second transmission signal to another device.

[0029] In some aspects of the apparatus, the position data includes three-dimensional position change in a Cartesian coordinate system.

[0030] In some aspects of the apparatus, the apparatus further includes a means for biometric sensing coupled to the means for forming the body of the ring. The means for biometric sensing is configured to obtain biometric data about the user and transmit the biometric data to the means for processing. The means for processing is configured to generate a second transmission signal using the biometric data, and the means for communicating is configured to transmit the second transmission signal to another device.

[0031] In some aspects of the device, the device further includes a means for converting sound into an electrical signal coupled to the means for forming the body of the ring. The means for converting sound into an electrical signal is configured to receive voice data from a user and transmit the voice data to the means for processing. The means for processing is configured to generate a second transmission signal using the voice data, and the means for communicating is configured to transmit the second transmission signal to another device.

[0032] In some aspects of the apparatus, the apparatus further includes a means for storing information coupled to the means for processing, the means for communicating comprising a near field communication (NFC) interface configured to communicate the access ID to a security reader external to the ring.

[0033] In some aspects of the device, the device further includes a means for tactile stimulation coupled to the means for processing. The means for communication is configured to receive data and the means for processing is configured to provide a drive signal to the means for tactile stimulation based on the data. The means for tactile stimulation is configured to receive the drive signal and communicate the data to the user via the tactile stimulation.

[0034] In some aspects of the device, the tactile stimulus is a vibration.

[0035] In some aspects of the device, the device further includes a means for optical sensing coupled to the means for processing and oriented outwardly from the device when the device is worn by a user such that the means for optical sensing is oriented toward an end of a finger, the means for optical sensing configured to detect an item at which the user is pointing, and the means for processing further configured to transmit an indication of the item to another device.

[0036] In some aspects, an apparatus is provided. The apparatus includes a means for forming a body of a ring configured to be worn on a finger of a user. The apparatus further includes a means for tactile stimulation coupled to the means for forming the body of the ring. The means for tactile stimulation is configured to generate pressure on the skin of the user or transmit an electrical impulse. The apparatus further includes a means for communication coupled to the means for forming the body of the ring and configured to receive data. The apparatus further includes a means for processing coupled to the means for tactile stimulation and the means for communication. The means for processing is configured to provide a drive signal to the means for tactile stimulation based on the data, and the means for tactile stimulation is configured to receive the drive signal from the processor and communicate the data to the user via the tactile stimulation.

[0037] In some aspects of the apparatus, the means for communicating wirelessly receives data from the wireless device or the extended control server.

[0038] In some aspects of the device, a plurality of means for tactile stimulation are spaced circumferentially around an interior surface of the means for forming a body of the ring, and the drive signal is configured to individually activate each of the means for tactile stimulation in a series of unique combinations, hi some embodiments, each unique combination represents a phonetic letter in the alphabet.

[0039] In some aspects of the device, the device further includes a touch sensor coupled to the means for forming the body of the ring and configured to receive input from a user, and the means for communication is further configured to wirelessly transmit the input to a wireless device or hub.

[0040] In some aspects of the device, the device further includes a means for optical sensing coupled to the means for processing and oriented outwardly from the device when the device is worn by a user such that the means for optical sensing is oriented toward an end of a finger, the means for optical sensing configured to detect an item at which the user is pointing, and the means for processing further configured to transmit an indication of the item to another device. The present specification also provides, for example, the following: (Item 1) A smart ring, a ring body configured to be worn on a finger of a user; a capacitive touch sensor coupled to the ring body, the capacitive touch sensor configured to receive touch input from the user and convert the touch input into an input signal; a processor coupled to the capacitive touch sensor, the processor configured to receive an input signal from the capacitive touch sensor and generate a transmission signal using the input signal; a communication interface coupled to the processor, the communication interface configured to transmit the transmission signal to another device; A smart ring equipped with (Item 2) 2. The smart ring of item 1, wherein the touch input is a deep tap, and the processor is further configured to distinguish between the deep tap and a single tap and a double tap. (Item 3) 3. The smart ring of any of items 1 or 2, wherein the capacitive touch sensor is further configured to identify a fingerprint of the user and transmit user fingerprint data to the processor, the user fingerprint data being used to unlock the ring. (Item 4) A smart ring as described in any of items 1-3, further comprising a position sensor coupled to the ring body, the position sensor configured to acquire position data and transmit the position data to the processor, the processor configured to use the position data to generate a second transmission signal, and the communication interface configured to transmit the second transmission signal to the other device. (Item 5) 5. The smart ring of item 4, wherein the position data includes three-dimensional position change in a Cartesian coordinate system. (Item 6) A smart ring as described in any of items 1-5, further comprising a biometric sensor coupled to the ring body, the biometric sensor configured to acquire biometric data regarding the user and transmit the biometric data to the processor, the processor configured to use the biometric data to generate a second transmission signal, and the communication interface configured to transmit the second transmission signal to the other device. (Item 7) A smart ring as described in any of items 1-6, further comprising a microphone coupled to the ring body, the microphone configured to receive voice data from the user and transmit the voice data to the processor, the processor configured to generate a second transmission signal using the voice data, and the communication interface configured to transmit the second transmission signal to the other device. (Item 8) A smart ring as described in any of items 1-7, further comprising a memory coupled to the processor and comprising an access identifier (ID), and the communication interface comprising a near field communication (NFC) interface configured to communicate the access ID to a security reader external to the ring. (Item 9) A smart ring as described in any of items 1-8, further comprising a tactile stimulator coupled to the processor, wherein the communication interface is configured to receive data, the processor is configured to provide a drive signal to the tactile stimulator based on the data, and the tactile stimulator is configured to receive the drive signal and communicate the data to the user via tactile stimulation. (Item 10) 10. The smart ring of item 9, wherein the tactile stimulus is vibration. (Item 11) A smart ring as described in any of items 1-10, further comprising an optical sensor coupled to the processor and oriented outward from the ring such that when the ring is worn by the user, the optical sensor is oriented toward the end of the finger, the optical sensor configured to detect an item pointed at by the user, and the processor further configured to send an indication of the item to the other device. (Item 12) A smart ring, a ring body configured to be worn on a finger of a user; a tactile stimulator coupled to the ring body, the tactile stimulator configured to generate pressure on the user's skin or deliver electrical impulses; a communication interface coupled to the ring body and configured to receive data; and a processor coupled to the tactile stimulator and the communication interface, the processor configured to provide a drive signal to the tactile stimulator based on the data; Equipped with The tactile stimulator is configured to receive the drive signal from the processor and communicate the data to the user via tactile stimulation. (Item 13) Item 13. The smart ring of item 12, wherein the communication interface wirelessly receives the data from a wireless device or an extended control server. (Item 14) 14. A smart ring as described in any of items 12-13, wherein a plurality of the tactile stimulators are spaced around an inner surface of the ring body, and the drive signal is configured to individually activate each of the tactile stimulators in a series of unique combinations, each unique combination representing a phonetic character in an alphabet. (Item 15) A smart ring as described in any of items 12-14, further comprising a touch sensor coupled to the ring body and configured to receive input from the user, and the communication interface is further configured to wirelessly transmit the input to a wireless device or hub. (Item 16) 16. A smart ring as described in any of items 12-15, further comprising an optical sensor coupled to the processor and oriented outward from the ring such that when the ring is worn by the user, the optical sensor is oriented toward the end of the finger, the optical sensor configured to detect an item pointed at by the user, and the processor further configured to send an indication of the item to the other device. (Item 17) 1. A method comprising: Using a smart ring worn on a user's finger, acquiring position data of the smart ring, the position data including a position of the smart ring and any position changes of the ring; transmitting said location data to another device; A method comprising: (Item 18) 20. The method of claim 17, wherein the position data identifies a movement of the user's hand and the position data transmitted to the other device directs an action on the other device. (Item 19) Item 19. The method of item 18, wherein the movement is pointing, the smart ring comprises an optical sensor oriented outward from the ring toward the end of the finger, the optical sensor configured to detect an item the user is pointing at, and the method further includes sending an indication of the item to the other device. (Item 20) Item 19. The method of item 18, wherein the movement is a swipe, the smart ring comprises an optical sensor oriented outward from the ring toward the end of the finger, the optical sensor configured to detect an item the user is swiping, and the method further includes sending an indication of the item to the other device. [Brief description of the drawings]

[0041] For a more complete understanding of various embodiments of the present disclosure, and the advantages thereof, reference is now made to the following brief description, taken in conjunction with the accompanying drawings and detailed description, in which like reference numerals represent like parts.

[0042] [Figure 1] FIG. 1 illustrates an example of a sensory augmentation platform for communicating using tactile stimulation, according to various embodiments.

[0043] [Figure 2A] FIG. 2A illustrates an example block diagram of a smart ring, in accordance with various embodiments.

[0044] [Figure 2B] FIG. 2B illustrates an example block diagram of a smart ring, in accordance with various embodiments.

[0045] [Diagram 3] FIG. 3 illustrates an example depiction of layers of skin and human nerves, according to various embodiments.

[0046] [Figure 4A] FIG. 4A shows an example of a smart ring that includes a tactile stimulator, such as the smart ring of FIGS. 1 and 2A and 2B, according to various embodiments.

[0047] [Figure 4B] 4B-4F depict example schemes for communicating multi-ideographic English words to a user by activating different tactile stimulators of the smart ring of FIG. 4A, according to various embodiments. [Figure 4C] 4B-4F depict example schemes for communicating multi-ideographic English words to a user by activating different tactile stimulators of the smart ring of FIG. 4A, according to various embodiments. [Figure 4D] 4B-4F depict example schemes for communicating multi-ideographic English words to a user by activating different tactile stimulators of the smart ring of FIG. 4A, according to various embodiments. [Figure 4E]4B-4F depict example schemes for communicating multi-ideographic English words to a user by activating different tactile stimulators of the smart ring of FIG. 4A, according to various embodiments. [Figure 4F] 4B-4F depict example schemes for communicating multi-ideographic English words to a user by activating different tactile stimulators of the smart ring of FIG. 4A, according to various embodiments.

[0048] [Diagram 5] FIG. 5 illustrates an example of a smart ring including an exemplary tactile stimulator, according to various embodiments.

[0049] [Figure 6] FIG. 6 illustrates an example visual device operable in association with a smart ring to provide visual information, according to various embodiments.

[0050] [Figure 7] FIG. 7 illustrates a flowchart of an exemplary method of sensory enhancement, according to various embodiments.

[0051] [Figure 8] FIG. 8 illustrates a usage scenario that combines aspects of the sensory augmentation platform of FIG. 1 in accordance with various embodiments.

[0052] [Figure 9] FIG. 9 illustrates a flowchart of an exemplary method of sensory enhancement using one or more rings, such as one or more of the rings of FIGS. 1, 2A, 2B, 4A-F, or 5.

[0053] [Figure 10] FIG. 10 illustrates a flowchart of an exemplary method of sensory enhancement using one or more rings, such as one or more of the rings of FIGS. 1, 2A, 2B, 4A-F, or 5.

[0054] [Figure 11] FIG. 11 illustrates a flowchart of an exemplary method of sensory enhancement using one or more rings, such as one or more of the rings of FIGS. 1, 2A, 2B, 4A-F, or 5. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0055] Detailed Description The present disclosure will generally be described in detail with reference to the embodiments illustrated in the drawings. However, other embodiments may be used and / or other changes may be made without departing from the spirit or scope of the present disclosure. The illustrative embodiments described in the detailed description are not meant to be limitations of the subject matter presented herein.

[0056] Reference will now be made to the exemplary embodiments illustrated in the drawings, and specific language will be used to describe the same, it being understood that no limitation of the scope of the invention is thereby intended. Alterations and further modifications of the features shown and / or described herein, and additional applications of the principles of the embodiments as illustrated herein, which will occur to those skilled in the art in light of this disclosure, are to be considered within the scope of the invention.

[0057] Some embodiments include a sensory augmentation device or system configured to communicate information to a user using haptic sensations, such as tactile sensations, electrical stimulation, and / or pressure sensations. The user may learn to associate meanings with tactile sensations, thereby facilitating communication between the device and the user. Some embodiments of the systems, devices, and / or methods disclosed herein may provide sequences of such sensations in parallel and / or successively over time. Moreover, a user may be easily trained to recognize such sequences of sensations as corresponding to meanings. In various embodiments, a wearable headpiece, such as a pair of glasses with a built-in visual image projector, may be worn and visual images may be projected to correspond to different tactile stimuli. The user may thus be trained to understand the meaning of different tactile stimuli by being shown the associated visual images. The user may also receive training through the use of a smartphone application, or computer program, or an online training portal. For example, a computer application or other program may be loaded onto the computer and a screen display may correspond to different tactile stimuli. Additionally, augmented reality, virtual reality, and other such immersive environments may be created by a combination of visual and tactile stimuli. Still further, bone conduction headphones or other auditory stimulation devices may be incorporated into a pair of glasses to further provide auditory stimulation in conjunction with the tactile stimulation. In this manner, visual, sound, and tactile sensory stimuli may be combined to communicate information or simulate visual, auditory, and sensory experiences.

[0058] A number of exemplary use cases are considered. In one exemplary embodiment, an application is installed on a handheld computing device, such as a smartphone. The application may connect the smartphone to a sensory augmentation device and provide tactile stimulation. For example, text messages, alarms, and other alerts that would generate visual or audible alerts on the handheld computing device may generate tactile alerts via the systems, devices, and methods disclosed herein. The application may also be launched on a desktop or laptop computing device. The application may connect a computer to a sensory augmentation device and provide tactile stimulation. For example, training scenarios, games, and other visual displays on a computer may correspond to tactile alerts. In this manner, a user may be trained to understand the meaning of different alerts through scenario-based training episodes and the like within an immersive electronic training environment.

[0059] Additionally, multiple sensory augmentation devices may provide tactile information to multiple body areas. For example, multiple finger rings, toe rings, bracelets, and / or other devices may also be used. Different devices may serve different communication roles. For example, a ring may be placed on each of a first finger and a second finger. In response to receiving a message, both rings may stimulate the corresponding finger to indicate the presence of an alert, and then one ring may provide a tactile stimulation and communicate the nature or origin of the alert, and another ring may provide a tactile stimulation and communicate the content of the alert.

[0060] Such systems, devices, and methods for communicating via tactile stimulation may also include aspects for receiving user input. For example, the ring that provides the tactile stimulation may also include a touch sensor that receives the input. For example, human input to the sensory augmentation devices, systems, and / or methods may include swipes, taps, multi-taps, deep taps, voice dictation, movement, or gesture tracking (e.g., via gyroscope, piezoelectric, optical, or other sensors).

[0061] Users can thus easily translate conversations with foreign language speakers, receive navigation instructions, understand from mapping devices, control devices, learn languages, control gaming systems, immerse themselves in virtual reality environments, and conduct financial transactions without having to be visually or auditorily engaged, among other uses, without looking at the device or being otherwise visually distracted.

[0062] 1, an embodiment of a sensory augmentation platform 100 is disclosed that includes one or more smart rings 112 of a first user and one or more smart rings 112 of another user or users. The sensory augmentation platform 100 may include a sensory augmentation system 110 of the user, an augmentation control server 124 (e.g., a spatially located computing device, also referred to herein as a hub or smart hub), and one or more sensory augmentation systems 110 of other users. Each of the sensory augmentation systems 110 may include one or more smart rings 112, a computing device 120 (e.g., a smartphone), and / or a visual device 26. In some embodiments, the sensory augmentation platform 100 is configured to communicate human-readable data to the user via tactile stimulation using the one or more smart rings 112. In various instances, the sensory augmentation platform 100 is also configured to receive input from the user via various devices or sensors, which will be discussed more fully herein.

[0063] In some embodiments, one or more smart rings 112 are wearable devices configured to deliver tactile stimuli to a user's finger or fingers to communicate human-readable messages or other information through the tactile stimuli.

[0064] Each of the one or more smart rings 112 may include a tactile stimulator 114 (e.g., a vibrator, an electrode, and / or a piezoelectric stimulator) configured to provide a tactile stimulus to a user or users of the one or more smart rings 112 based on data corresponding to information to be communicated to the user, as described in more detail below with reference to FIGS. 2A and 2B. In essence, the one or more smart rings 112 cause the tactile stimulator 114 to provide a tactile stimulus such that the user of the smart ring 112 feels the tactile stimulus at different places or locations on the body (e.g., multiple locations on a finger), the locations corresponding to different information. For example, the tactile stimulus may be felt at different locations around the finger proximate to the inner ring of the ring, including the tactile stimulator 114. By registering different clock positions of the tactile stimulus, the user may sense different messages.

[0065] Similarly, the user may feel different sensations resulting from the tactile stimulation, with different characteristics of the sensation corresponding to different information. For example, the tactile stimulation may provide different sensations of hardness, softness, pressure, vibration, and / or any other mechanical or non-mechanical sensory (e.g., electrical) input, as well as different combinations thereof. The different sensations may correspond to different information communicated to the user, and may be combined with the stimulation perceived to be in different locations, thereby communicating still further various information.

[0066] The one or more smart rings 112 may additionally include one or more network interfaces 127 to facilitate communication between the one or more smart rings 112 and other devices, such as the computing device 120 and the extended control server 124. The network interfaces 127 may include the network interface 116 and / or the body area network interface 118.

[0067] The network interface 116 may comprise an electronic modem (e.g., a radio frequency (RF) transceiver) or other communication device. For example, the network interface 116 may be or may include a first transceiver configured to connect one or more smart rings 112 to a network 122 (e.g., the Internet), may include a second transceiver configured to connect another smart ring 112 to other components of the sensory augmentation platform 100, or may be or may include both a first transceiver and a second transceiver. In some embodiments, the network interface 116 may comprise a Bluetooth, Wi-Fi, WiMAX, 802.11x, Zigbee, cellular, or any other interface operable to communicatively couple one or more smart rings 112 to the network 122 and / or to communicatively couple one or more smart rings 112 to one or more other components or devices within the sensory augmentation platform 100.

[0068] The body area network interface 118 may provide Bluetooth or other connections to communicatively couple one or more aspects (e.g., components) of the smart ring 112 to one or more other aspects (e.g., components) of the smart ring 112, to communicatively couple each of the one or more smart rings 112 to one or more other smart rings 112, and / or to another device. The body area network interface 118 may provide Bluetooth, Wi-Fi, WiMAX, 802.11x, Zigbee, cellular, or other electrical, optical, acoustic, or other operable connections between each side of the one or more smart rings 112 and another smart ring (or another device). The body area network interface 118 may receive inputs from and provide outputs to the other sides of the one or more smart rings 112. One such aspect may include the network interface 116. In some embodiments, the body area network interface 118 is omitted and the network interface 116 also performs the functionality of the body area network interface 118.

[0069] During operation, the smart ring 112 may electronically communicate with the network 122. The smart ring 112 may also communicate with other smart rings 112 via the network 122. For example, multiple individuals may wear smart rings 112, which may be connected to the network 122. Individuals may send / receive messages to each other's smart rings 112. Furthermore, a user may wear multiple smart rings 112, such as smart rings 112a and 112b. In some embodiments, a user's multiple smart rings 112 may communicate with the user's smartphone via a local network or a virtual local area network, such as via a local Bluetooth® connection, while in further instances, a user's multiple smart rings 112 may both connect to the network 122 and communicate with each other via the network 122. Thus, one or more smart rings 112 shown in FIG. 1 may be associated with different individuals, and / or multiple smart rings 112 shown in FIG. 1 may be utilized by the same individual while the smart rings 112 are communicatively coupled to each other.

[0070] In various embodiments, during operation, one or more smart rings 112 may be in electronic communication with the extended control server 124 via the network 122. In various instances, the extended control server 124 provides data to one or more of the smart rings 112 corresponding to a message for communication to a user via tactile stimulation. For example, the extended control server 124 may provide data 41a or 41b, described below with reference to FIGS. 2A and 2B, to one or more of the smart rings 112. Additionally, in various instances, the extended control server 124 receives data, such as transmission signal 44a or 44b of FIG. 2, relating to a user, such as via a data input side of one or more smart rings 112, for processing related to the message and / or for communication to another user of the further smart ring 112.

[0071] Each of the one or more smart rings 112 may be configured to communicate with the extended control server 124, which may be configured to allow or deny automatic forwarding of messages to different smart rings 112. In this manner, each of the one or more smart rings 112 may transmit information, receive information, and interact with other smart rings of the one or more smart rings 112, as desired. In various embodiments, a user may wear two of the one or more smart rings 112, or wear a smart ring 112 with multiple worn components to stimulate multiple parts of the user's body. For example, the one or more smart rings 112 may include a ring worn on each hand. The extended control server 124 may coordinate the provision of messages to multiple smart rings 112 to be delivered to the user in a time-coordinated manner. In a further instance, the user's local device coordinates the provision of messages to multiple smart rings 112 to be delivered to the user in a time-coordinated manner. For example, one or more of the one or more smart rings 112 may provide such coordination.

[0072] The sensory augmentation platform 110 may include a visual device 26. The visual device 26 is configured to generate visual images for the user to view. For example, the visual device 26 may comprise a head-up display on a pair of worn glasses. In a further instance, the visual device 26 is a computing device 120 or a television screen. In various instances, text, pictures, images, or other visual indications are provided to the user by the one or more smart rings 112, such as to provide mapping, augmented reality, or other visual services. Furthermore, since the user may not be familiar with the meaning of different tactile stimuli, a representative image may accompany each stimulus. Also, in various training scenarios, the one or more smart rings 112 may connect directly to a computing device, such as a computer or smartphone, via the network interface 116 or the body area network interface 118. The computer or smartphone may launch a training application, such as a game, a scenario-based training program, a tutorial, or other application, whereby the user is trained to interact with the one or more smart rings 112. For example, one or more smart rings 112 may be configured to provide tactile stimuli to a finger representing a variety of different ideograms or words while displaying images of the associated ideograms or words on the visual device 26.

[0073] The computing device 120 may be a smartphone, a tablet, a wearable computer, a portable computer such as a laptop, or any other computing device 120, as desired. In various embodiments, the computing device 120 is an integrated processor of the smart ring 112. In various embodiments, during operation, one or more smart rings 112 directly connect to the computing device 120. In various embodiments, the computing device 120 is operably connected to one or more smart rings 112 and one or more of the visual device 26 by wireless technology. For example, the visual device 26 may be a wearable pair of glasses with a computer therein.

[0074] In some embodiments, the computing device 120 provides processing power and memory for the one or more smart rings 112. For example, the one or more smart rings 112 may be small and / or power efficient such that processing tasks are offloaded to connected devices such as the computing device 120. In this manner, the battery life of the one or more smart rings 112 may be improved and the form factor may be small for the one or more smart rings 112.

[0075] The processing power provided by the computing device 120 may be used for various purposes. For example, data may be structured and rearranged as suitable for provision to the smart ring 112. For example, a user may desire to read a text message from a friend via an electrical stimulation signal provided to the finger by the smart ring 112 worn on the user's finger. The computing device 120 may process the text message ideogram-by-idea or word-by-word to generate symbols or other data corresponding to the message for delivery via tactile stimulation. The symbols or other data may then be provided by the computing device 120 in sequence to the smart ring 112 or in parallel to a plurality of one or more smart rings 112. Additionally, the computing device 120 may set the rate of delivery of the stimulation (e.g., timing as described below with reference to FIG. 2) depending, for example, on the user's proficiency in interpreting electrotactile messages. Additionally, as noted above, any human-perceptible information desired to be communicated in addition to text may be converted into a corresponding electrical stimulation. For example, sounds, ideograms and other representative ideograms, scents, graphics, and / or the like may be associated with a particular sense or set of senses that can be communicated via electrical stimulation.

[0076] Referring to Fig. 2A, an example of a smart ring 212a is disclosed. The smart ring 212a of Fig. 2A may correspond to the smart ring 112a of Fig. 1. The smart ring 212a may be configured to be worn on a first portion of a user's body. For example, the first smart ring 212a may be configured to be worn on a first index finger of a user.

[0077] The smart ring 212a may include a ring body 211a, one or more tactile stimulators 214a coupled to the ring body 211a, a communication interface 227a coupled to the ring body 211a, and a processor 218a, one or more tactile stimulators 214a, and a communication interface 227a coupled to the ring body 211a.

[0078] The ring body 211a is a wearable loop configured to fit around and / or be worn by a user's finger. For example, the ring body 211a may be configured to fit around and / or be worn by a user's index finger or other finger. In some examples, the ring body 211a is rigid and formed from one or more rigid materials, such as metal, rigid plastic, or a combination thereof, and may include a coating. In some examples, the ring body 211a is formed from titanium or ceramic zirconia. In some examples, the ring body 211a includes a diamond-like carbon coating. In other examples, the ring body 211a is semi-rigid and formed from a semi-rigid material. In some examples, the ring body 211a may form a complete loop. Alternatively, in other examples, the ring body 211a may form a partial loop. In various embodiments, the outer surface, the inner surface, or both may be substantially round and smooth to increase user comfort when wearing the smart ring 212a.

[0079] The one or more tactile stimulators 214a are any type of stimulator configured to provide tactile stimulation (e.g., vibration, electrical impulses, and / or pressure) to the user's body (in response to one or more drive signals 48a from the processor 218a). For example, the one or more tactile stimulators 214a may be or include a vibrator, a piezoelectric configured to exert pressure on the user's finger, an electrode configured to provide electrical stimulation to the user's finger, or a combination thereof. In some examples, the one or more tactile stimulators 214a include multiple tactile stimulators 214a. In some examples where the one or more tactile stimulators 214a include multiple tactile stimulators 214a, the number of the one or more tactile stimulators 214a is greater than two. For example, the number of the one or more tactile stimulators 214a may be in the range of 4 to 12 tactile stimulators.

[0080] In some examples where the tactile stimulator 214a includes multiple tactile stimulators 214a, the processor 218a may be configured to provide multiple ones of the one or more drive signals 48a, where each of the multiple drive signals 48a may correspond to a separate tactile stimulator 214a of the multiple tactile stimulators 214a. In these examples, each of the tactile stimulators 214a is configured and coupled to the processor 218a such that the tactile stimulator 214a is configured to receive a corresponding drive signal of the multiple drive signals 48a. As a result, in these examples, each of the tactile stimulators 214a is independently excitable such that different combinations of the tactile stimulators 214a may be excited.

[0081] The tactile stimulator 214a is configured such that during operation of the smart ring 212a, the user may be able to feel tactile stimulation from the tactile stimulator 214a at various locations on the user's body on which the smart ring 212a is worn. The locations (or combinations) of the tactile stimulation may correspond to different information. For example, the tactile stimulation may be felt at different locations around a finger proximate to the inner ring of the smart ring 212a. By registering different locations of the tactile stimulation, the user may detect different messages (e.g., message content or message type).

[0082] Additionally or alternatively, the user may be able to detect different messages by registering different feels or sensations in response to the tactile stimulation. For example, as described in further detail below, the tactile stimulator 214a may include electrodes 244a configured to apply a stimulation waveform or signal configured to induce sensations in one or more nerves of the user, and sensations associated with the different nerves may be sensed by the user as different feels or sensations. By registering different feels or sensations in response to the tactile stimulation, the user may detect different messages.

[0083] Additionally or alternatively, the user may be able to detect different messages by registering characteristics of the tactile stimulation, such as duration, pulsing, and / or intensity. For example, as described in further detail below, the tactile stimulator 214a may include a vibration stimulator 242a, and the smart ring 212a may be configured to apply tactile stimulation at different durations, pulses, and / or intensities. By registering different characteristics of the tactile stimulation, the user may detect different messages.

[0084] The tactile stimulator 214a may include a vibration stimulator 242a (e.g., when the tactile stimulation includes vibration), an electrode 244a (e.g., when the tactile stimulation includes electrical impulses), and / or a piezoelectric stimulator 246a (e.g., when the tactile stimulation includes pressure).

[0085] Each vibration stimulator 244a may include an actuator (e.g., a motor) and a vibrating element configured to provide vibrations when activated in response to a drive signal from the processor 218a and configured to contact the skin of a user of the smart ring 212a when the user wears the smart ring 212a. Each piezoelectric stimulator 246a is configured to deform (e.g., expand or contract) and generate pressure on the user's skin when activated in response to one or more drive signals 48a from the processor 218a when the user wears the smart ring 212a.

[0086] Each of the electrodes 244a is configured to deliver an electrical impulse to the skin of a user of the smart ring 212a when the user wears the smart ring 212a, when actuated in response to one or more drive signals 48a from the processor 218a. In various embodiments, the plurality of electrodes 244a comprises a current source and one of the electrodes 244a comprises a current sink. In further embodiments, the plurality of electrodes 244a comprises a current sink. In various embodiments, a single electrode of the electrodes 244a comprises a current source and the plurality of electrodes 244a comprises a current sink. In further embodiments, the plurality of electrodes 244a comprises a current source. The electrodes 244a may be configured to deliver electrical stimulation based on characteristics of the one or more drive signals 48a from the processor 218a. For example, the characteristics of the one or more drive signals 48a may correspond to a voltage, current, waveform (e.g., defining a pulse length, a waveform shape such as a square wave, a triangle wave, a sine wave, a varying waveform, a direct current (DC), a duty cycle, etc.), and / or frequency, and the electrodes 244a may be configured to deliver electrical stimulation having a stimulation waveform based on the voltage, current, waveform, and / or frequency of the one or more drive signals 48a. Furthermore, the electrodes 244a may be configurable such that the role of the electrodes 244a as an anode or a cathode may be changed and the polarity of the electrical signal may be changed over time. Furthermore, the electrodes 244a may be configured such that different electrical signals may be delivered and combined in parallel or in sequences. Still further, the electrodes 244a may be spaced apart and different electrodes 244a may be excited with different electrical signals (different stimulation waveforms). In addition, the electrodes 244a are configured such that they may be selectively driven such that the spatial sense (e.g., the perceived origin of the electrical stimulus) in addition to the properties of the sensation itself may be altered to communicate different messages. The electrodes 244a may be configured such that an electrical signal may be passed between the electrodes 244a. Further, multiple electrical signals may be passed between or through the electrodes 244a.

[0087] The electrodes 244a, when driven by one or more drive signals 48a, are configured to deliver electrical stimulation to one or more nerves or types of nerves that can be electrically stimulated to induce a sensation, such as a sensation of mechanical or electrical stimulation. The human body contains a variety of different nerves. Many such nerves are capable of detecting mechanical or electrical stimulation. It has further been determined that many such nerves can be electrically stimulated to induce a sensation, including a sensation of mechanical stimulation. The various nerves may be classified. For example, different stimuli may be perceived by different nerves. By stimulating different nerves, different sensations may be evoked. Furthermore, different nerves perceive stimuli in different spatial relationships, and therefore different nerves may be stimulated to communicate different messages as well.

[0088] For example, FIG. 3 illustrates four exemplary types of nerves (Meissner's corpuscles 12, Merkel cells 14, Ruffini endings 16, and Pacinian corpuscles 18) to which one or more of the electrodes 244a may be configured to deliver electrical stimulation during operation of the smart ring 212a. With reference to FIG. 3, human skin may have a stratum corneum 4 covering the epidermis 6. Various nerves reside within the epidermis 6. Further, the epidermis 6 may cover the dermis 8. Various nerves may also be located within the dermis 8. For context, two sweat ducts 10 are shown as well. In various instances, the Merkel cells 14 are activated by static pressure. In various instances, the Meissner's corpuscles 12 are activated by time-varying vibrations, as are the Pacinian corpuscles 18. It should be understood that in various instances, the Ruffini endings 16 and the Pacinian corpuscles 18 may have different resonant frequencies. For example, the Ruffini endings 16 may resonate at 120 Hertz (Hz) and the Pacinian corpuscles 18 at 250 Hz. Additionally, myelinated nerves may consist of insulated nerves covered by a myelin sheath with gaps spaced at the nodes of Ranvier.

[0089] Different properties of different neural aspects may be exploited by different types of electrical stimulation such that stimulation, having both time-variant, mode-variant (e.g., type of nerve activated), place-variant, intensity-variant, and sequence-variant and / or other pathway-variant properties, may communicate large ideographic character sets and vast amounts of human-readable information. Thus, by stimulating different nerves with different electrical signals having different waveforms, amplitudes, currents, and the like, it is possible to induce different sensations. For example, Merkel cell 14 receptors may encode pressure through their firing frequency. Thus, by stimulating Merkel cell 14 receptors with a variety of different electrical impulses of different frequencies, it may also be possible to induce the sensation of hard object touch and / or soft object touch. For further examples, Meissner's corpuscles 12 may be stimulated to induce a stable vibration sensation. Additionally, stimulation of Pacinian corpuscles 18 may facilitate the occurrence of place-shifted stimulation, meaning that the perceived stimulation is perceived to be in a different location where the electrodes apply the electrical stimulation. Thus, every perceptible aspect of a tactile stimulus can be evoked in addition to a unique non-tactile stimulus.

[0090] Returning to FIG. 2A, the electrodes 244a may be configured such that different combinations of electrodes 244a may be selectively excited in different patterns with different voltage, current, waveform, frequency, and / or the like signals such that different sensations may be perceived by the user and thus translated into different messages by the user's nervous system. For example, a long pulse followed by a short pulse followed by a long pulse followed by a short pulse again may correspond to the phonetic letter "C," while a short pulse followed by a long pulse may correspond to the phonetic letter "A." More complex symbolic representations are possible due to the many possible combinations of pulse lengths, which electrodes or multiple electrodes 244a are stimulated, which combinations of electrodes 244a are stimulated, the voltage, current waveform, and / or frequency of each stimulus, both in sequence and in parallel, and / or the like.

[0091] The communications interface 227a may correspond to the network interface 127 described above with reference to Figure 1. In some embodiments, the communications interface 227a includes the network interface 116 of Figure 1, the body area network interface 118 of Figure 1, or any combination thereof.

[0092] The communication interface 227a is configured to receive data 41a corresponding to information to be communicated to a user. The information to be communicated to a user may include text, images (e.g., screen content of the computing device 120 of FIG. 1), graphics, memes, phonemes, calculations, sounds, ideograms, alerts, and / or any other information capable of being received through other human senses. As an example, the communication interface 227a may be configured to receive data 41a from the computing device 120 of FIG. 1, the enhanced control server 124 of FIG. 1, or both.

[0093] In some embodiments, data 41a may include or represent information to be communicated to a user. For example, the information to be communicated to a user may include text and data 41a may include or represent text.

[0094] Alternatively, or in addition, the data 41a may be based on, but may not include or indicate, the information to be communicated to the user. In these examples, the data 41a may indicate, identify, and / or instruct when and / or how the smart ring 212a should activate the tactile stimulator 214a to communicate the information to be communicated to the user. For example, the computing device 120 of FIG. 1 and / or the enhanced control server 124 of FIG. 1 may determine information corresponding to one or more drive signals 48a that the smart ring 212a should provide to one or more of the tactile stimulators 214a, the timing at which the smart ring 212a should apply the one or more drive signals 48a, the particular stimulators of the tactile stimulators 214a that the smart ring 212a should drive at any given time, the strength of the one or more drive signals 48a, the duration of the one or more drive signals 48a, and / or the sequence in which particular simulators should be driven in order for the particular stimulators to communicate the information to be communicated to the user using the tactile stimulator 214a based on the information to be communicated to the user. In these examples, data 41a may include data indicating, identifying, and / or including instructions for causing smart ring 212a to drive one or more of tactile stimulators 214a in accordance with information corresponding to one or more drive signals 48a, timing, particular tactile stimulators, intensity, duration, and / or sequence to communicate information to be communicated to a user.

[0095] For example, the tactile stimulator 214a may include a vibration stimulator 242a, and the data 41a may indicate signal characteristics, timing (e.g., intervals between vibrations corresponding to different pieces of information), the particular vibration stimulators 243a to activate, the voltage, duration, and / or the sequence in which the particular vibration stimulators 243a should be activated to communicate information to be communicated to a user. For example, the data 41a may indicate a first particular vibration stimulator 51a to be driven at a first time using one or more drive signals 48a and may indicate a second particular vibration stimulator 53a to be driven at a second time using drive signal 48a, where the second particular vibration stimulator 53a may be different from the first particular vibration stimulator 51a.

[0096] As another example, the tactile stimulator 214a may include electrodes 244a, and the data 41a may indicate signal characteristics (e.g., pulse duration, voltage), the particular electrodes 245a to activate at any given time, the timing, and the sequence in which the particular electrodes 245a should be activated to communicate information to a user. For example, the data 41a may indicate a first particular electrode 55a to be driven at a first time using one or more drive signals 48a, and may indicate a second particular electrode 57a to be driven at a second time using one or more drive signals 48a, where the second particular electrode 57a may be different from the first particular electrode 55a.

[0097] As another example, the tactile stimulator 214a may include a piezoelectric stimulator 246a, and the data 41a may indicate signal characteristics (e.g., pulse duration, voltage), the particular piezoelectric stimulator 247a to be activated at any given time, and the sequence in which the particular piezoelectric stimulator 247a should be activated to communicate information to a user. For example, the data 41a may indicate a first particular piezoelectric stimulator 59a to be driven at a first time using one or more drive signals 48a, and may indicate a second particular piezoelectric stimulator 61a to be driven at a second time using one or more drive signals 48a, where the second particular piezoelectric stimulator 61a may be different from the first particular piezoelectric stimulator 59a.

[0098] The processor 218a is configured to receive the data 41a and generate and provide one or more drive signals 48a (e.g., control signals, drive instructions) to the one or more tactile stimulators 214a based on the data 41a. The processor 218a may be an internal computing device, processor, and memory, or any other programmable electronic device or circuitry configured to receive the data 41a and transmit the drive signals 48a to the one or more tactile stimulators 214a. The drive signals 48a are configured to drive or activate the tactile stimulators 214a and communicate information to be communicated to the user. In some examples, the tactile stimulator 214a includes multiple tactile stimulators 214a, as discussed above. In these examples, the processor 218a may be configured to provide multiple drive signals 48a, each of which may correspond to a separate tactile stimulator 214a of the multiple tactile stimulators 214a. In these examples, each tactile stimulator 214a is configured and coupled to a processor 218a such that the tactile stimulator 214a is configured to receive a corresponding drive signal 48a of the plurality of drive signals 48a. As a result, in these examples, each tactile stimulator 214a is independently excitable such that different combinations of the tactile stimulators 214a can be excited.

[0099] In some embodiments, the data 41a may include or indicate information to be communicated to the user, as discussed above. In these embodiments, the processor 218a may be configured to convert the data 41a and determine which tactile stimulators 214a to drive and when and / or how the smart ring 212a should drive the tactile stimulators 214a in order to communicate the information to be communicated to the user. For example, the processor 218a may determine the characteristics of the drive signal 48a that the smart ring 212a should provide to one or more of the tactile stimulators 214a, the timing at which the smart ring 212a should apply the drive signal 48a, the duration of the drive signal 48a, the strength of the drive signal 48a, and / or the particular tactile stimulator 214a that the smart ring 212a should drive at any given time based on the information to be communicated to the user contained or indicated in the data 41a. In these examples, following determining the characteristics, timing, duration, intensity, and / or the particular tactile stimulator 214a of the drive signal 48a, the processor 218a generates the drive signal 48a to drive the particular tactile stimulator 214a in accordance with the determined characteristics, timing, duration, and intensity.

[0100] In some embodiments where the data 41a includes or indicates information to be communicated to the user, the information to be communicated to the user includes text. In some of these embodiments, the processor 218a is configured to process the data 41a and generate the drive signals 48a to drive different tactile stimulators 214a for different ideograms of the text. For example, each ideogram of the alphabet (e.g., the English alphabet) may correspond to a different pattern of activated tactile stimulators 214a, and the processor 218a may be configured to generate the drive signals 48a based on the phonetic characters in the text and the patterns corresponding to the phonetic characters in the text, to drive particular tactile stimulators of the tactile stimulators 214a in a sequence that corresponds to a sequence of phonetic characters in the text and according to a pattern that corresponds to the phonetic characters in the text. In some embodiments, the pattern of tactile stimulators that correspond to ideograms in the alphabet may be based on or correspond to a vertex or other index point on the represented ideogram.

[0101] In one example, the drive signal 48a is configured to drive one or more first tactile stimulators of the one or more tactile stimulators 214a to communicate a first ideogram of the text. In this example, the drive signal 48a is also configured to drive one or more second tactile stimulators of the one or more tactile stimulators 214a to communicate a second ideogram of the text. In this example, the one or more second tactile stimulators include at least one tactile stimulator that the one or more first tactile stimulators do not include.

[0102] To illustrate, the information to be communicated to the user may include the word "Apple" and the data 41a may include the word "Apple" or may otherwise indicate that the word "Apple" is to be communicated to the user. In this example, the processor 218a may be configured to determine the characteristics, timing, and / or specific tactile stimulator 214a of the drive signal 48a based on receiving the word "Apple" contained within or otherwise indicated by the data 41a, as described below with reference to FIGS. 4A-4F. In this example, the processor 218a then generates the drive signal 48a according to the characteristics, timing, and / or specific tactile stimulator 214a, as determined according to the data 41a and described below with reference to FIGS. 4A-6F, that indicate or identify the word "Apple" and provides the drive signal 48a to the specific tactile stimulator 214a according to the timing, as described below with reference to FIGS. 4A-6F.

[0103] Returning to FIG. 2A , the data 41a may indicate, identify, and / or instruct which tactile stimulators 214a to activate and when and / or how the smart ring 212a should activate the tactile stimulators 214a to communicate the information to be communicated to the user. In these examples, the data 41a may include data indicating, identifying, and / or including instructions for the sensory augmentation system 212a to activate one or more of the tactile stimulators 214a according to the characteristics, timing, duration, intensity, and / or specific tactile stimulators 214a of the drive signal 48a indicated or identified by the data 41a to communicate the information to be communicated to the user. In these examples, the processor 218a processes the data 41a to obtain the characteristics, timing, duration, intensity, and / or specific tactile stimulators 214a indicated, identified, and / or instructed by the data 41a.

[0104] To illustrate, the information to be communicated to the user may include the word "Apple" and the data 41a may identify or indicate the characteristics, timing, duration, intensity, and particular tactile stimulator 214a of the drive signal 48a, described below with reference to Figures 4A-4F. In this example, the processor 218a may be configured to process the data 41a to obtain the characteristics, timing, duration, intensity, and / or particular tactile stimulator 214a indicated by the data 41a and described below with reference to Figures 4A-4F, generate the drive signal 48a, described below with reference to Figures 4A-4F, and drive the particular tactile stimulator 214a using the drive signal 48a according to the timing, described below with reference to Figures 4A-4F.

[0105] In some examples, the tactile stimulator 214a will typically require a higher voltage electrical waveform than many microprocessors generate, so in various embodiments the processor 218a includes and / or uses an H-bridge, or a buck / boost converter, or one or more capacitors for discharging, or one or more transformers, coils, and / or the like, to generate the drive signal 48a.

[0106] The smart ring 212a may include a power source 280a. The power source 280a comprises a source of electrical energy. The power source 280a may be a battery or a supercapacitor. The power source 280a may include a charger, such as to harvest a user's RF energy, body heat, motion, and / or the like. The power source 280a may include an inductive charger, such as to facilitate recharging the battery or supercapacitor by exposure to an electromagnetic field. The power source 280a may be coupled to the processor 218a and configured to enable the processor 218a to drive the one or more tactile stimulators 214a with sufficient energy to activate the one or more tactile stimulators 214a.

[0107] In some examples, smart ring 212a may additionally include effector 281a. Effector 281a may comprise a visual indicator, such as a light source, or an electronically controlled display or pattern provided by a liquid crystal display (LCD), electronic ink, and / or any type of human perceptible indicator, as desired. Effector 281a may further comprise a non-human readable mechanism, such as a near field communication (NFC) device, configured to effect financial transactions and / or any other functionality, as desired. In some embodiments, effector 281a may be combined with touch sensor 52a.

[0108] In some embodiments, the smart ring 212a additionally or alternatively includes one or more user sensors 50a coupled to the ring body 211a and configured to detect an input 62a from a user of the smart ring 212a. The one or more user sensors 50a are configured to convert the input 62a into an input signal 42a and provide the input signal 42a to the processor 218a. The one or more user sensors 50a include a touch sensor 52a, one or more position sensors 54a, a microphone 56a, one or more biometric sensors 58a, an optical sensor 59a, a magnetic sensor 61a, or any combination thereof. The one or more user sensors 50a may be coupled to an exterior and / or interior side of the ring body 211a and / or may be built into the ring body 211a. For example, the touch sensor 52a may include one or more touch sensors 52a disposed on an exterior annular surface of the ring body 211a. As another example, the position sensor 54a may include one or more position sensors 54a coupled to or embedded within the ring body 211a. As another example, the microphone 56a may be coupled to an exterior annular surface of the ring body 211a. As another example, the biometric sensor 58a may include one or more biometric sensors disposed on an interior surface of the ring body 211a.

[0109] The touch sensor 52a may be any type of sensor configured to detect touch input from a user. For example, the touch sensor 52a may be a capacitive touch sensor. In embodiments where one or more user sensors 50a include the touch sensor 52a, the input 62a from the user of the smart ring 212a includes a touch input. In these embodiments, the input signal 42a includes the location, number, and / or duration of the touch input. In some embodiments, the touch input 62a includes one of a single tap, a double tap, or a deep tap. The touch sensor 52a may be configured such that different locations on the touch sensor 52a correspond to separate information inputs, such as human-readable message elements or control commands. In some embodiments, the user may stimulate the touch sensor 52a by forming a hand with the smart ring 212a into a fist, using the fingers of another hand to touch the outer annular surface of the smart ring 212a, or the like.

[0110] For example, the touch sensor 52a may be configured such that different locations on the touch sensor 52a correspond to distinct human-readable message elements, and a user may provide touch input at a location on the touch sensor 52a that corresponds to a human-readable message element that the user desires to include in a message (e.g., a Short Message Service (SMS) message). For example, a user may desire to communicate a text message formed from text ideograms, and may provide touch input on the touch sensor 52a at a location that corresponds to the text ideogram. The smart ring 212a may thus be configured to receive, via touch input, the human-readable message element of the message that the user desires to communicate.

[0111] As another example, the touch sensor 52a may be configured such that different locations on the touch sensor 52a correspond to distinct control instructions for controlling the smart ring 212a or another device, and a user may provide touch input at a location on the touch sensor 52a that corresponds to the control action the user desires to effect. To illustrate, a user may desire to disable communications using the ring and may provide touch input on the touch sensor 52a at a location on the touch sensor 52a that corresponds to disabling communications on the smart ring 212a. As another example, a user may desire to disable a tactile stimulator on the smart ring 212a and the user may provide touch input on the touch sensor 52a at a location on the touch sensor 52a that corresponds to disabling the tactile stimulator 214a. As another example, the smart ring 212a may act as a remote control device and change channels on a television. In this example, different locations on the touch sensor 52a may correspond to distinct control commands for controlling a television, and a user may provide touch input at a location on the touch sensor 52a that corresponds to changing a channel on the television. The smart ring 212a may thus be configured to receive, via touch input, a control command for controlling the smart ring 212a or another device.

[0112] In some embodiments, the touch sensor 52a is further configured to identify a user's fingerprint and transmit the user fingerprint data to the processor 218a. In some embodiments, the user fingerprint data is used to power on, power off, or unlock the smart ring 212a.

[0113] In some embodiments, touch sensor 52a additionally or alternatively includes a capacitive touch screen that may display messages to the user.

[0114] The position sensor 54a may be any type of sensor configured to obtain position data. For example, the position sensor 54a may be or include one or more accelerometers, gyroscopes, or a combination thereof. The position sensor 54a may be configured to detect motion in six degrees of freedom. For example, the position sensor 54a may include an accelerometer that may calculate the movement of the ring in three dimensions of a Cartesian coordinate system as well as the rotation (e.g., roll, pitch, and yaw) about any of the Cartesian coordinate axes. The position sensor may also include a global positioning system (GPS), wireless (e.g., WiFi or cellular) triangulation, or any other means to determine the position. In an embodiment in which the one or more user sensors 50a include the position sensor 54a, the input 62a from the user of the smart ring 212a includes motion or position information (e.g., position data) of the smart ring 212a (and correspondingly, motion or position information of the user of the smart ring 212a) from one or more accelerometers and / or gyroscopes. In these examples, input signal 42a may include or indicate motion, corresponding to motion or position information, hi these examples, input signal 42a may include a three-dimensional position change in a Cartesian coordinate system.

[0115] In some implementations, the input 62a includes user motion information corresponding to human-readable message elements or control commands for the smart ring 212a or another device. For example, different motions may correspond to distinct human-readable message elements, and the position sensor 54a may be configured to detect the different motions. To illustrate, for example, different hand motions corresponding to sign language may correspond to distinct words, and the position sensor 54a may be configured to detect the motions corresponding to the different hand motions. The smart ring 212a may thus be configured to receive, via motion detection, the human-readable message elements of a message that the user wishes to communicate.

[0116] As another example, different hand movements may correspond to distinct control commands. To illustrate, a shaking or vibrating hand movement may correspond to ignoring an incoming message, and a position sensor may be configured to detect the shaking hand movement. The smart ring 212a may thus be configured to receive control commands for controlling the smart ring 212a or another device via the movement detection.

[0117] The microphone 56a may be configured to detect sound. In embodiments in which the one or more user sensors 50a include a microphone 56a, the input 62a from the user of the smart ring 212a includes voice input. In these embodiments, the input signal 42a includes or indicates voice data corresponding to the voice input. The voice input may correspond to human-readable message elements that the user wants to include in a message. Alternatively, or in addition, the voice input may correspond to control commands for controlling the smart ring 212a or another device.

[0118] The biometric sensor 58a may be any sensor configured to detect biometric data of a user, such as temperature, heart rate, blood pressure, oxygen level, sweat level, respiration rate, step count, or any combination thereof. In embodiments in which the one or more user sensors 50a include the biometric sensor 58a, the input 62a comprises the biometric data of the user. In these embodiments, the input signal 42a includes or is indicative of the biometric data.

[0119] The optical sensor 59a is oriented outward from the ring such that when the smart ring 212a is worn by a user, the optical sensor 59a is oriented toward the end of the finger. The optical sensor 59a may include a light source, a measurement device, a camera, and / or a sensor (e.g., a light detector configured to receive a predetermined wavelength range (e.g., the visual spectrum). The sensor of the optical sensor 59a is configured to sense and measure light received at the optical sensor 59a (e.g., light transmitted by a light source and reflected by an item, or light transmitted onto an item by a light source). The optical sensor 59a is configured to provide information corresponding to the measured light to the processor 218a as an input signal 42a.

[0120] The magnetic sensor 61a is configured to detect the presence of other nearby smart rings.

[0121] In an embodiment where the smart ring 212a includes one or more user sensors 50a, the processor 218a is additionally or alternatively configured to receive the input signal 42a from the one or more user sensors 50a and generate one or more transmission signals 44a based on the input signal 42a. The processor may be configured to generate one or more transmission signals 44a based on the input signal 42a by packaging the input signal 42a for transmission to a second device, such as the computing device 120 of FIG. 1 or the extended control server 124 of FIG. 1. In an embodiment where the one or more user sensors 50a include an optical sensor 59a, the processor 218a is additionally or alternatively configured to generate one or more transmission signals 44a to include information corresponding to the measured light. The processor 218a is configured to provide the one or more transmission signals 44a to the communication interface 227a. The communication interface 227a is configured to receive one or more transmission signals 44a from the processor 218a and transmit the one or more transmission signals 44a to the second device. The communication interface 227a may transmit the one or more transmission signals 44a to the second device using the human body interface 116 of FIG. 1, the network interface 118 of FIG. 1, or both.

[0122] Ring 212a may additionally include one or more external ports (eg, one or more micro USB ports, etc.) for charging and wired communication.

[0123] In some examples, the smart ring 212a may additionally or alternatively be configured to enable access to a second device. In these examples, the communication interface 227a may additionally or alternatively be configured to receive data 72a indicative of a near-field frequency associated with an access permission to access the second device. The second device may be any device that is accessed (e.g., unlocked, started) by or using a key (e.g., a radio frequency (RFID) key) (or includes a function that is accessed by or using the key). For example, the second device may include an automated door lock. As another example, the second device may include a vehicle or a vehicle engine. The data 72a may be received from the key or another device.

[0124] In an embodiment in which the smart ring 212a is configured to enable access to a second device, the processor 218a is configured to obtain a near-field frequency based on the data 72a by processing the data 72a. The smart ring 212a may further be configured to enable access to the second device by transmitting a signal 63a corresponding to the near-field frequency using the communication interface 227a. When the smart ring 212a is within a threshold distance of the second device, transmitting the signal 63a corresponding to the near-field frequency enables access to the second device. For example, when the smart ring 212a is within a threshold distance from a vehicle, transmitting a signal corresponding to the near-field frequency may enable a user to start the vehicle by pressing a start button on the vehicle without a vehicle key being within the threshold distance from the vehicle.

[0125] In some embodiments, the smart ring 212a further includes a memory 283a coupled to the processor 218a and including an access identifier (ID) 285a. In these embodiments, the communication interface comprises a near field communication (NFC) interface configured to communicate the access ID 285a to a security reader external to the smart ring 212a.

[0126] 2B illustrates an example of a smart ring 212b. The smart ring 212b may correspond to any of the one or more smart rings 112 of FIG. 1. For example, the smart ring 212b may correspond to the smart ring 112b of FIG. 1. The smart ring 212b may be configured to be worn on a second portion of the user's body (e.g., a different finger than the finger on which the smart ring 212a of FIG. 2A is worn). The smart ring 212b may comprise a ring body 211b, a tactile stimulator 214b coupled to the ring body 211b, a communication interface 227b coupled to the ring body 211b, a processor 218b coupled to the ring body 211b, the tactile stimulator 214b coupled to the processor 218b, a memory 283b coupled to the processor 218b, one or more user sensors 50b coupled to the processor 218b, and a communication interface 227b coupled to the processor 218b.

[0127] Ring body 211b may be configured as described above with reference to ring body 211a, tactile stimulator 214b may be configured as described above with reference to tactile stimulator 214a, communications interface 227b may be configured to perform any of the functions described above with reference to communications interface 227a, and processor 218b may be configured to perform any of the functions described above with reference to processor 218b.

[0128] The smart ring 212b may be configured to receive data 41b. The data 41b may correspond to the data 41a. The processor 218a may be configured to process the data 41b and generate one or more drive signals 48b corresponding to the one or more drive signals 48a described above with reference to the smart ring 212a. The processor 218a may be configured to provide the one or more drive signals 48b to drive the one or more tactile stimulators 214b as described above with reference to the processor 218a and one or more tactile stimulators 214a of the smart ring 212a.

[0129] In some examples, the data 41b additionally or alternatively includes data indicating that the smart ring 212a is about to communicate the information described above with reference to the smart ring 212a (e.g., communication is imminent) and / or indicating the type of information (e.g., text message). In these examples, the processor 218b may be configured to process the data 41b, generate the drive signal 48b, and provide the drive signal 48b to the tactile stimulator 214b to communicate that the smart ring 212a is about to communicate the information described above with reference to the smart ring 212a (e.g., communication is imminent) and / or indicate the type of information (e.g., text message). Thus, the smart ring 212a may be configured to communicate the contents of the message, and the smart ring 212b may be configured to communicate that the smart ring 212a is about to receive the contents of the message and to communicate the type of message.

[0130] The one or more user sensors 50b correspond to or function as described above with reference to the one or more user sensors 50a. For example, smart ring 212b may additionally include touch sensor 52b, position sensor 54b, microphone 56b, biometric sensor 58b, optical sensor 59b, and / or magnetic sensor 61b, which correspond to touch sensor 52a, position sensor 54a, microphone 56a, biometric sensor 58a, optical sensor 59a, and / or magnetic sensor 61a, respectively, described above with reference to smart ring 212a.

[0131] The smart ring 212b additionally or alternatively includes an effector 281b coupled to the processor 218b and a power source 280b coupled to the processor 218b. The effector 281b may be configured as described above with reference to the effector 281a of FIG. 2A, and the power source 280b may be configured as described above with reference to the power source 280a. The smart ring 212 may be configured to receive an input 62b as described above with reference to the input 62a of FIG. 2A. The one or more user sensors 50b may be configured to generate an input signal 42b as described above with reference to the input signal 42a of FIG. 2A. The smart ring 212b may be configured to receive a signal 63b as described above with reference to the signal 63a of FIG. 2A. The smart ring 212b may additionally or alternatively be configured to receive data 72b as described above with reference to the data 72a of FIG. 2A.

[0132] 4A-4F, FIG. 4A illustrates example rings 412a and 412b including examples of tactile stimulators 414a and 414b, and FIG. 4B-4F illustrates an example sequence of tactile stimulators 414a that may be activated by ring 412a. Rings 412a and 412b in FIG. 4A may correspond to one or more smart rings 112 in FIG. 1 and / or smart rings 212a and 212b in FIG. 2A and 2B. Tactile stimulators 414a and 414b in FIG. 4A may correspond to tactile stimulators 214a or 214b illustrated in FIG. 2A and 2B. Tactile stimulators 414a and 414b are evenly spaced around the inner annulus of the ring body of rings 412a and 412b. In some embodiments, two rings may be used such that the two rings 412a and 412b are controlled in tandem. For example, one ring 412a may communicate to a user the nature and characteristics of the content of a current or impending communication by the other ring 412b. For example, one ring 412b may communicate to a user that an incoming text message has been received, while the other ring 412a may simultaneously or immediately communicate the contents of the text message.

[0133] The tactile stimulators 414a and 414b may comprise twelve tactile stimulators. In further instances, any number of tactile stimulators 414a and 414b may be selected. The tactile stimulators 414a and 414b may correspond to different locations around the ring body. For ease of viewing, only reference numbers 414a and 414b are shown in association with some of the twelve tactile stimulators 414a and 414b illustrated in FIGS. 4A-4F.

[0134] In various instances, an English word is desired to be communicated to the user. For example, the word "Apple" is desired to be communicated. Although the tactile stimulator 414a may communicate a symbol, phoneme, or any other communicable means capable of being represented by tactile stimulation, in this non-limiting example, individual ideograms are communicated in a sequence to make up a word. For example, FIG. 4B shows three tactile stimulators being excited. The tactile stimulators correspond to vertices or other index points on the ideogram being represented. For example, for the ideogram A, the tactile stimulators 414a at positions 0, 7, and 5 may be excited. The numbers associated with the tactile stimulators correspond to their clock positions in this example, and thus the tactile stimulators 414a at the 12, 5, and 7 o'clock positions are activated, corresponding to the three ends of the ideogram "A." At a second time, a different set of tactile stimulators 414a may be activated to correspond to a second phonetic character in the word "Apple."

[0135] 4A and 4C, the tactile stimulators 414a at positions 5 and 0 remain activated, the tactile stimulator 414a at position 7 is momentarily pulsed off and then turned back on, and the tactile stimulator at position 11 is activated. Thus, it should be appreciated that while the next phonetic character "P" is presented, the tactile stimulator 414a associated with the first phonetic character "A" remains activated in some embodiments to facilitate memorization of the preceding ideographic character by the user.

[0136] 4A and 4D, note that a second phonetic character "P" is desired to be shown. However, in order to show two identical ideographic characters in succession, an additional temporal aspect is implemented. Specifically, the tactile stimulator 414a corresponding to the phonetic character "P" is pulsed off and then turned on again to represent the second sequential instance of the ideographic character. The tactile stimulator 414a previously associated with the phonetic character "A" and not associated with the phonetic character "P" may remain active and not pulsed.

[0137] 4A and 4E, the following phonetic character "L" is communicated. The tactile stimulators 414a at positions 11 and 7 are pulsed off and back on so that these tactile stimulators 414a are also associated with the phonetic character "P," and the tactile stimulator 414a at position 5 is activated. The tactile stimulator 414a at position 0 remains activated and unchanged.

[0138] 4A and 4F, the final phonetic character "E" is communicated. The tactile stimulators 414a at positions 3, 1, 11, 7, and 5 are all associated with the phonetic character "E." The tactile stimulators 414a at positions 11, 7, and 5 are pulsed off and back on, the tactile stimulators 414a at positions 3 and 1 are activated, and the tactile stimulator 414 at position 0 remains activated and unchanged.

[0139] In various embodiments, each phonetic character, ideogram, phoneme, or other symbol is associated with an equal duration period ("moment"). Each moment may be long enough to allow the user to identify the ideogram, phoneme, or other symbol being communicated. Thus, the moment length may be shortened as the user gains proficiency. In various embodiments, following the final phonetic character or other symbolically represented set of information of a word, all tactile stimulators 414 are deactivated for a single moment, signaling the end of the word or other symbolically represented set of information. Referring to FIG. 4F, following the passage of one moment for the final phonetic character "E", each tactile stimulator 414a may be deactivated for one moment, signaling the end of the word prior to the start of the presentation of the subsequent user-readable stimulus.

[0140] Figure 5 illustrates an example of a smart ring 512. The smart ring 512 may correspond to the smart ring 112 of Figure 1, the smart ring 212a of Figure 2A, the smart ring 212b of Figure 2B, or the smart ring 412 of Figure 4A. The smart ring 512 includes a tactile stimulator 514. The tactile stimulator 514 may correspond to the tactile stimulator 114 of Figure 1 or the tactile stimulator 214a or 214b of Figures 2A or 2B.

[0141] 1 and 6, in various embodiments, the sensory augmentation system 110 includes one or more visual devices 26, as described above with reference to FIG 1. In various embodiments, the one or more visual devices 26 may be configured to project an image that corresponds in meaning to the tactile stimuli provided by the smart ring 112.

[0142] The visual device 26 may provide additional functionality. For example, the visual device 26 may provide any visual input that corresponds to or is complementary to the tactile input. The visual device 26 may also provide non-associated input. For example, in various instances, the visual device 26 may provide an augmented reality experience. The visual device 26 may provide an overlaid texture onto the user's surroundings. For example, the visual device 26 may provide a projection of an image that corresponds to a texture that overlays a perceived real-world item. For example, a smooth surface may be made to appear as a rough surface by the visual device 26 when viewed by a user of the visual device 26. The visual device 26 may be configured to provide various visual augmented reality experiences, complementing or augmenting the tactile stimuli provided by the smart ring 112, and further communicating relevant information to the user.

[0143] Referring to FIG. 7, a method 700 of sensory augmentation is provided. The method may include providing a wireless transmission corresponding to the text by a computing device (block 702). The method may include receiving the wireless transmission by a first electrotactile stimulator (block 704). The method may further include generating a first instruction by a signal generation and sensing processor of the first electrotactile stimulator to an electrode driver, the first instruction corresponding to a first stimulation waveform representing the text (block 706). The method may include generating a first stimulation waveform by the electrode driver in response to the first instruction (block 708), and providing an electrical stimulus to the human body by an electrode array driven by the electrode driver, the electrical stimulus corresponding to the text (block 710). In various embodiments, the method further includes projecting an image corresponding to the text by a pair of glasses having a built-in image projector (block 712).

[0144] With reference to FIG. 8 and additionally with reference to FIGS. 1-7, a usage scenario 800 is illustrated that employs multiple aspects of the sensory augmentation platform 100 of FIG. 1. In various embodiments, the visual device 26 may further comprise a sensor 814. The sensor 814 may comprise any sensor configured to sense at least one of the absolute or relative location of the smart ring 828. For example, the sensor 814 of the visual device 26 may comprise a camera configured to visually identify the location of the smart ring 828. The sensor 814 may comprise a depth or distance sensor, for example, an ultrasonic sensor. The sensor 814 may comprise an electromagnetic sensor and may sense the non-human visible spectrum. The sensor 814 may comprise any sensor configured to determine spatial information relative to the user's surrounding environment. Furthermore, such sensed information may be implemented to facilitate identification of the absolute or relative location of the user, the user's head, the user's hands, the user's smart ring 828, and other objects. In still further instances, the visual device 26 does not include the sensor 814, and inertial, gyroscope, or other sensors included within the smart ring 828 provide such data, e.g., data representing the absolute or relative location of the smart ring 828. In either case, the sensory augmentation platform 100 is capable of determining at least one of the relative or absolute location of the smart ring 828. Additionally, in either case, the sensory augmentation platform 100 is capable of determining at least one of the relative or absolute location of objects within the user's surrounding environment.

[0145] Additionally or alternatively, the smart ring 828 may include one or more user sensors, such as one or more user sensors 50a and 50b, described above with reference to the smart rings 212a and 212b of FIGs. 2A and 2B. In some of these embodiments, position / optical sensors on the ring may determine or be used to determine the ring position, gestures, and what the user is pointing at. For example, the optical sensors on the rings 212a and 212b of FIGs. 2A and 2B may be configured to measure light and transmit one or more transmission signals 44a including information indicative of the measured light to a computing / wireless device (such as the enhanced control server 124 of FIG. 1), as described above. The extended control server 124 of Figure 1 may be a spatially located computing device configured to use information indicative of measured light from each of the rings 212a and 212b of Figures 2A and 2B, other information (e.g., motion information from motion sensors in the rings 212a and 212b), or both information indicative of measured light and other information, and to determine the spatial positions of the rings 212a and 212b using a triangulation algorithm. The extended control server 124 may determine whether one or more of the rings 212a and 212b are pointed at a device (e.g., a television) based on the determined spatial positions of one or more of the rings 212a and 212b and known labeled spatial data points corresponding to the device (e.g., a television). When the extended control server 124 determines that one or more of the rings 212a and 212b are directed to a device (e.g., a television), the extended control server 124 may treat data corresponding to an input (e.g., input 62a of FIG. 2A ) (e.g., data corresponding to one or more transmission signals 44a corresponding to position and / or touch sensors 54a, 52a of FIG. 2A ) as control commands for controlling the device (e.g., a television).Once the extended control server 125 determines that the data is to be treated as a control command for a device (e.g., a television), the extended control server 124 processes the data and determines the control command to which the input 62a corresponds. For example, the input 62a may correspond to a touch input at a particular location on the touch sensor 52a of the ring 52a, the extended control server 124 may receive one or more transmission signals 44a indicating the particular location, and the extended control server 124 may determine that the particular location corresponds to increasing the volume on the device (e.g., a television). The extended control server 124 may then send a command to the device (e.g., a television) to cause the television to increase the volume. Additionally or alternatively, the orientation information may be displayed on the device screen, so that the ring acts as a virtual pen, further turning a non-touchscreen device into a touchscreen device. Additionally or alternatively, as described above with reference to the smart rings 212a and 212b of FIGS. 2A and 2B, the smart ring 828 may be configured to detect swipes or other touch input and communicate the touch input to another device.

[0146] As a result, the sensory augmentation platform 100 can ascertain the movement of the hand by the user wearing the device on a finger or otherwise ascertain the positioning of the smart ring 828 by the user. Thus, the sensory augmentation platform 100 of FIG. 1 may be configured to determine that the user is pointing, gesturing, or otherwise providing relevant information input through the movement of the smart ring 828. In various instances, the user may point the hand with the smart ring 828 toward a device desired to be controlled or otherwise interacted with via the sensory augmentation platform 100. For example, the user may point at the television 801 to turn the television on or off, or may gesture up and down or left and right to control the channel and / or volume of the television 801. Additionally, the user may point or otherwise gesture to control or query regarding the status of a number of devices. For example, the user may point or otherwise gesture to control a gaming system 804, a smart home hub 802, an electronic lock 803, and / or the like. In various instances, the visual device 26 displays augmented reality data corresponding to the status of the television 801, the gaming system 804, the smart home hub 802, and / or the electronic lock 803. In further instances, an application running on the handheld computing device 120 may depict similar status information and / or allow control of the depicted devices. The visual device 26 may provide a television status indication 805 indicating that the television 801 is on and a gaming system indication 808 indicating that the gaming system 804 is off. Additionally, a lock status indication 809 may be depicted to allow easy determination of the locked or unlocked status of the electronic lock 803.

[0147] Additionally, the control aspects for the devices may include both visual depictions via the visual device 26 and machine-human interaction via the smart ring 828. For example, the smart home hub 802 may be shown playing music (806) and an option to skip a song is shown (807). The user may point to or otherwise interact with a point in space, such interaction detectable by the sensor 814 and / or by the smart ring 828, which corresponds to the point in space overlaid by projected text on the visual device 26 and offering an option to skip (807). In response to the user pointing or touching such a point in space, the sensory augmentation system 100 may interact with the smart home hub 802 and instruct it to take a responsive action, such as skipping the song being played.

[0148] Thus, with the understanding of the teachings herein above and with reference to Figures 1-8, various use cases are possible. For example, as mentioned, one or more sensors 814 on one or more visual devices 26 facilitate the generation of a three-dimensional model of what the user is seeing. Furthermore, the smart ring 828 may be communicatively coupled to or otherwise logically associated with the visual device 26, directly or indirectly. As a result, a simulated reality may be modeled. The modeled simulated reality may comprise a three-dimensional representation of the user's surroundings and the movement of the user and / or the user's smart ring 828 within the surroundings. In various embodiments, this modeled simulated reality may be electronically combined with further modeled simulated realities of further smart rings 828 and / or further users of the visual device 26.

[0149] As a result, not only may a user interact with aspects of the surrounding environment via the visual device 26 and / or smart ring 828, but the user may also interact with aspects of a different user's surrounding environment via the visual device 26 and / or smart ring 828. For example, the visual device 26 may project images corresponding to the surrounding environment of a different user, or a simulated surrounding environment that is virtual in nature, thereby facilitating interaction with a virtual reality. For example, an architect and a client may each wear a visual device 26 and one or more smart rings 828. The architect may invite the client to enter a simulated surrounding environment that includes an electronic model of a proposed building designed by the architect, or may invite the client to interact with simulated items, such as building plans and / or the like, projected on the visual device 26.

[0150] A user may interact with a simulated environment or a different user's environment through gestures or inputs measured by the smart ring 828 using one or more user sensors 50a or 50b described above with reference to FIG. 2. Furthermore, once such an environment has been mapped by the visual device 26, the user may continue to interact with the environment through the smart ring 828 even without wearing the visual device 26. For example, the smart ring 828 may include one or more user sensors 50a or 50b to determine its location in the environment, or may connect to one or more sensors of the handheld computing device 120. For example, a user may point at a television 801 and turn it on or off even without the visual device 26 to depict the status 805 of the television 801. It should thus be understood that the smart ring 828 includes the various user sensors 50a or 50b of FIGS. 2A and 2B, and the visual device 26 may include the various sensors 814. The sensors 814 may include accelerometers, gyroscopes, GPS, compasses, LIDAR, sonar, radar, and / or the like. Additionally, a separate illuminator device may be utilized to paint constellations or patterns, including patterns of light invisible to humans, on the environment, which may be sensed by the sensors 814 to ascertain spatial information regarding a location, such as the location of the smart ring 828 within the environment.

[0151] Thus, the sensory augmentation platform 100 may sense the user's surrounding environment, generate a three-dimensional model of the environment, and enable interaction with the model via a tactile stimulator, such as the tactile stimulator 114 of FIG. 1. The model may be shared with other users and projected onto other visual devices 26 so that other users may utilize their own smart rings 828 to remotely interact with the model. Additionally, a user may generate a unique user profile so that the motion of the user and the user's smart ring 828 may be specifically, accurately, and precisely tailored to the user's biology and personal attributes. For example, a user may move their finger, which has a smart ring 828, through the full range of motion of the user's arm and plot the extreme boundaries of potential motion. Such motion may be plotted against the location of the visual device 26, which may be worn on the user's head. In this manner, both the visual device 26 and the smart ring 828 are calibrated for use by a specific user, and such calibration may be stored within a unique user profile.

[0152] Although the computing device 120 is discussed as having an extended control server 124, in various instances, one or more additional computing devices 120, referred to as local network nodes, may be provided. A local network node may comprise a location-specific processing module located within a specific physical facility. In further instances, the local network node may be a logical instance that runs remotely within the extended control server 124 and is accessible over a network, etc. A local network node may be associated with a location, a user, an account, and / or a combination thereof. In various embodiments, access to the local network node requires a recurring subscription payment. In various instances, a three-dimensional model of the environment may be processed and / or stored within the local network node. In this manner, the processor and memory included on the smart ring 828 and / or the visual device 26 may be improved.

[0153] Additionally, the local network node may be implemented to facilitate additional features of the three-dimensional model of the environment. For example, a user may create a home area, map the home area, assign locations to controllable devices within the home area, and automatically gain access to control the controllable devices upon entering the home area. For example, a local network node may be associated with a living room and facilitate control of a television by pointing in the direction of the television with the smart ring 828. Similarly, the local network node may facilitate control of a "virtual whiteboard" whereby a user may draw in space on an empty wall of the room or load textures onto the surface, and the drawings and textures are stored and rendered by the local network node at runtime.

[0154] In yet a further use case, a store may implement a local network node. The store may map products, such as by walking around a room with the visual device 26 and / or with the smart ring 828, and store this mapping in the local network node. A customer may then enter the store, pick up an item, and make a purchase by allowing the visual device 26 and / or smart ring 828 to determine a selection of objects associated with the local network node, and may facilitate the purchase of the item by interacting with the smart ring 828. Thus, it should be understood that the local network node may be locked to one or more users, or may allow connection by new users, such as customers, who enter a geographic area associated with the perimeter of the store.

[0155] Still further, the local network node may facilitate prompting of alerts of police, fire, rescue services, and other resources, as desired. For example, the local network node may facilitate calling the police in association with detecting a pattern of user behavior by the visual device 26 or smart ring 828 corresponding to a fall by a specific elderly user, but not when the fall corresponds to a user who is a gymnast. Alternatively, the local network node may facilitate calling the police in association with detecting a pattern of user behavior by the visual device 26 or smart ring 828 of any user corresponding to a fall and then a specific elapsed delay from the fall, or in association with the user pointing and / or gesturing a specific panic button or equivalent.

[0156] Still further, additional plug-in services, whether on a need-based or subscription-based basis, may be implemented. For example, a user may automatically activate a GPS mapping plug-in upon connection to a local network node associated with the automobile, thereby facilitating the provision of turn-by-turn instructions through tactile stimulation or visual indication upon entry into the vehicle, without placing on the smart ring 828 or visual device 26 the memory and computational burden associated with GPS mapping when not in the vehicle.

[0157] FIG. 9 illustrates a method 900 implemented by a smart ring described herein. For example, the method 900 may be implemented using the smart ring 112 of FIG. 1, 212a or 212b of FIG. 2A and 2B, 412a or 412b of FIG. 4A, or 512 of FIG. 5. The method 900 includes, at 910, detecting movement information on a finger of a user of the device using one or more sensors of the smart ring. For example, the movement information may correspond to the information 62a of FIG. 2A, and the one or more user sensors may correspond to the position sensor 54a. The method 900 further includes, at 912, transmitting data to a second device based on the movement information. For example, the data may correspond to one or more transmission signals 44a provided by the processor 218a and transmitted by the communication interface 227a. In some aspects of the method 900, the device comprises a ring. In some aspects of method 900, the one or more user sensors comprise a position sensor (such as position sensor 54a of FIG. 2A ), and the movement information corresponds to human-readable message elements or control instructions for the apparatus or another device, as described above with reference to FIG. 2A .

[0158] FIG. 10 illustrates a method 1000 implemented by a smart ring described herein. For example, the method 1000 may be implemented using the smart ring 112 of FIG. 1, 212a or 212b of FIG. 2A and 2B, 412a or 412b of FIG. 4A, or 512 of FIG. 5. The method 1000 includes, at 1010, receiving data indicating a near-field frequency associated with an access permission to access a second device. For example, the data may correspond to data 72a of FIG. 2 and may be received by the network interface 227a of FIG. 2 as described above with reference to FIG. 2A. The method 1000 further includes, at 1012, enabling access to the second device by transmitting a signal corresponding to the near-field frequency. For example, the signal corresponding to the near-field frequency may correspond to signal 63a, described above with reference to FIG. 2. In some aspects of method 1000, the device comprises an automated lock or vehicle, and accessing the device includes unlocking the automated lock or starting the vehicle, as described above with reference to FIG. 2A.

[0159] FIG. 11 illustrates a method 1100 implemented by a smart ring described herein. For example, method 1100 may be implemented using smart ring 112 of FIG. 1, 212a or 212b of FIGS. 2A and 2B, 412a or 412b of FIG. 4A, or 512 of FIG. 5. Method 1100 includes, at 1110, using a ring worn on a user's finger to obtain position data of the ring, the position data including the position of the ring and any positional changes of the ring. Method 1100 further includes, at 1112, transmitting the position data to another device. In some aspects of the method 1100, the position data identifies a movement of the user's hand, and the position data transmitted to the other device indicates an action on the other device. In some aspects of the method 1100, the movement is pointing, and the ring includes an optical sensor oriented outward from the ring toward the end of the finger. In some of these examples, the optical sensor is configured to detect an item the user is pointing at, and method 1100 further includes transmitting an indication of the item to another device. In some aspects of method 1100, the movement is a swipe and the ring comprises an optical sensor oriented outward from the ring toward the end of the finger. In some examples, the optical sensor is configured to detect an item the user is swiping at, and method 1100 further includes transmitting an indication of the item to another device.

[0160] In some aspects, an apparatus is provided. In some examples, the apparatus may correspond to smart ring 212a or 212b of FIG. 2A or 2B. The apparatus includes means for forming a ring body. The means for forming a ring body is configured to be worn on a finger of a user. In some examples, the means for forming a ring body corresponds to ring body 211a or 211b of FIG. 2A or 2B. The apparatus further includes means for capacitive touch sensing coupled to the means for forming a ring body. The means for capacitive touch sensing is configured to receive touch input from a user and convert the touch input into an input signal. The means for capacitive touch sensing may correspond to touch sensor 52a or 52b of FIG. 2A and 2B. The apparatus includes means for processing coupled to the means for capacitive touch sensing. The means for processing may correspond to processor 218a or 218b of FIG. 2A and 2B. The means for processing is configured to receive an input signal from the means for capacitive touch sensing and generate a transmission signal using the input signal. The apparatus further includes a means for communication, coupled to the processor and configured to transmit a transmission signal to another device. The means for communication may correspond to the communication interface 227a or 227b of FIG. 2A or 2B.

[0161] In some aspects of the apparatus, the touch input is a deep tap, and the means for processing is further configured to distinguish between the deep tap and a single tap and a double tap.

[0162] In some aspects of the device, the means for capacitive touch sensing is further configured to identify a fingerprint of a user and transmit the user fingerprint data to the means for processing. In some embodiments, the user fingerprint data is used to unlock the device.

[0163] In some aspects of the device, the device further includes a means for sensing a position coupled to the means for forming the body of the ring. The means for sensing a position is configured to obtain position data and transmit the position data to the means for processing. The means for sensing a position may correspond to the position sensor 54a or 54b of FIG. 2A or 2B. The means for processing is configured to generate a second transmission signal using the position data, and the means for communicating is configured to transmit the second transmission signal to another device.

[0164] In some aspects of the apparatus, the position data includes three-dimensional position change in a Cartesian coordinate system.

[0165] In some aspects of the device, the device further includes a means for biometric sensing coupled to the means for forming the body of the ring. The means for biometric sensing is configured to obtain biometric data about the user and transmit the biometric data to the means for processing. The means for biometric sensing may correspond to biometric sensor 59a or 59b of FIG. 2A or 2B. The means for processing is configured to generate a second transmission signal using the biometric data, and the means for communication is configured to transmit the second transmission signal to another device.

[0166] In some aspects of the device, the device further includes a means for converting sound into an electrical signal coupled to the means for forming the body of the ring. The means for converting sound into an electrical signal is configured to receive voice data from a user and transmit the voice data to the means for processing. The means for processing is configured to generate a second transmission signal using the voice data, and the means for communicating is configured to transmit the second transmission signal to another device.

[0167] In some aspects of the device, the device further includes a means for storing information coupled to the means for processing, the means for storing information comprising an access identifier (ID). The means for storing information may correspond to memory 283a or 283b, and the access ID may correspond to access ID 285a or 285b of Figures 2A or 2B. The means for communicating comprises a near field communication (NFC) interface configured to communicate the access ID to a security reader external to the ring.

[0168] In some aspects of the device, the device further includes a means for tactile stimulation coupled to the means for processing. The means for tactile stimulation may correspond to one or more of the tactile stimulators 214a or 214b of FIG. 2A or 2B. The means for communication is configured to receive data, and the means for processing is configured to provide a drive signal to the means for tactile stimulation based on the data. The means for tactile stimulation is configured to receive the drive signal and communicate the data to the user via the tactile stimulation.

[0169] In some aspects of the device, the tactile stimulus is a vibration.

[0170] In some aspects of the device, the device further includes a means for optical sensing coupled to the means for processing and oriented outwardly from the device when the device is worn by a user such that the means for optical sensing is oriented toward the end of a finger. The means for optical sensing may correspond to optical sensor 59a or 59b of Figures 2A or 2B. The means for optical sensing is configured to detect an item at which a user is pointing, and the means for processing is further configured to transmit an indication of the item to another device.

[0171] In some aspects, an apparatus is provided. The apparatus includes a means for forming a body of a ring configured to be worn on a finger of a user. The means for forming a body of a ring may correspond to the ring body 211a or 211b of FIG. 2A or 2B. The apparatus further includes a means for tactile stimulation coupled to the means for forming a body of a ring. The means for tactile stimulation is configured to generate pressure on the skin of the user or transmit an electrical impulse. The means for tactile stimulation may correspond to one or more tactile stimulators 214a or 214b of FIG. 2A or 2B. The apparatus further includes a means for communication coupled to the means for forming a body of a ring and configured to receive data. The means for communication may correspond to the communication interface 227a or 227b of FIG. 2A or 2B. The apparatus further includes a means for processing coupled to the means for tactile stimulation and the means for communication. The means for processing may correspond to the processor 218a or 218b of FIG. 2A or 2B. The means for processing is configured to provide a drive signal to the means for tactile stimulation based on the data, and the means for tactile stimulation is configured to receive the drive signal from the processor and communicate the data to the user via the tactile stimulation.

[0172] In some aspects of the apparatus, the means for communicating wirelessly receives data from the wireless device or the extended control server.

[0173] In some aspects of the device, a plurality of means for tactile stimulation are spaced circumferentially around an interior surface of the means for forming a body of the ring, and the drive signal is configured to individually activate each of the means for tactile stimulation in a series of unique combinations, hi some embodiments, each unique combination represents a phonetic letter in the alphabet.

[0174] In some aspects of the device, the device further includes a means for sensing touch coupled to the means for forming a body of the ring and configured to receive input from a user, and the means for communicating is further configured to wirelessly transmit the input to a wireless device or hub. In some examples, the means for sensing touch corresponds to touch sensor 52a or 52b of FIG. 2A or 2B.

[0175] In some aspects of the device, the device further includes a means for optical sensing coupled to the means for processing and oriented outwardly from the device when the device is worn by a user such that the means for optical sensing is oriented toward the end of a finger. In some embodiments, the means for optical sensing corresponds to optical sensor 59a or 59b of Figures 2A or 2B. The means for optical sensing is configured to detect an item at which a user is pointing, and the means for processing is further configured to transmit an indication of the item to another device.

[0176] Having discussed aspects of the systems and methods provided herein, general features related to electronic communications are further outlined below. As used herein, the term "network," as it relates to a network that may constitute at least a portion of the network 122 illustrated in FIG. 1, includes any cloud, cloud computing system, or electronic communications system or method incorporating hardware and / or software components. Communications between the parties may be accomplished through any suitable communications channel, such as, for example, a telephone network, an extranet, an intranet, the Internet, interaction point devices (point-of-sale devices, personal digital assistants (e.g., iPhone, Palm Pilot, Blackberry), cellular phones, kiosks, etc.), online communications, satellite communications, offline communications, wireless communications, transponder communications, local area networks (LANs), wide area networks (WANs), virtual private networks (VPNs), networked or linked devices, keyboards, mice, and / or any suitable communications or data entry modalities. Additionally, although the system is frequently described herein as being implemented with a Transmission Control Protocol / Internet Protocol (TCP / IP) communications protocol, the system may also be implemented using Internetwork Packet Exchange (IPX), Appletalk, IP-6, Network Basic Input / Output System (NetBIOS), Open Systems Interconnection (OSI), any tunneling protocol (e.g., Internet Protocol Security (IPsec), Secure Shell (SSH)), or any number of existing or future protocols. If the network is in the nature of a public network, such as the Internet, it may be advantageous to assume that the network is unsecured and exposed to eavesdroppers.Specific information relating to protocols, standards, and application software utilized in connection with the Internet is generally known to those skilled in the art and thus need not be detailed herein. See, for example, DILIP NAIK, INTERNET STANDARDS AND PROTOCOLS (1998), JAVA® 2 COMPLETE (multiple authors) (Sybex 1999), DEBORAH RAY AND ERICRAY, MASTERING HTML 4.0 (1997), as well as LOSHIN, TCP / IP CLEARLY EXPLAINED (1997) and DAVID GOURLEY AND BRIAN TOTTY, HTTP, THE DEFINITIVE GUIDE (2002), the contents of which are incorporated herein by reference.

[0177] The network may be insecure. Thus, communications over the network may utilize data encryption. Encryption may be performed by any of the techniques currently available or that may become available in the art, such as Twofish, Rivest-Shamir-Adleman (RSA), El Gamal, Schorr Signature, Digital Signature Algorithm (DSA), Pretty Good Privacy (PGP), Public Key Infrastructure (PKI), GNU Privacy Guard (GPG or GnuPG), and symmetric and asymmetric cryptography schemes.

[0178] Any communication, transmission, and / or channel discussed herein may include any system or method for delivering content (e.g., data, information, metadata, etc.) and / or the content itself. The content may be presented in any form or medium, and in various embodiments, the content may be capable of being delivered and / or presented electronically. For example, a channel may comprise a website or device (e.g., Facebook, Youtube®, AppleTV®, Pandora®, Xbox®, Sony® PlayStation®), a Uniform Resource Locator ("URL"), a document (e.g., Microsoft Word® document, Microsoft Excel® document, Adobe.pdf document, etc.), an "e-book", an "e-magazine", an application or micro-application (as described herein), SMS or other type of text message, email, Facebook, twitter, multimedia messaging service (MMS), and / or other type of communication technology. In various embodiments, a channel may be hosted or provided by a data partner. In various embodiments, the distribution channels may comprise at least one of a merchant website, a social media website, an affiliate or partner website, an external vendor, a mobile device communication, a social media network, and / or a location-based service. The distribution channels may include at least one of a merchant website, a social media site, an affiliate or partner website, an external vendor, and a mobile device communication. Examples of social media sites include Facebook®, Foursquare®, Twitter®, MySpace®, LinkedIn®, and the like. Examples of affiliate or partner websites include American Express®, Visa®, Google®, and the like.Further examples of mobile device communication include texting, email, and mobile applications for smart phones.

[0179] In various embodiments, the methods described herein are implemented using various specific machines described herein. The methods described herein may be implemented using the specific machines described below and those developed hereafter, in any suitable combination as would be readily understood by one of ordinary skill in the art. Furthermore, as will be apparent from this disclosure, the methods described herein may result in various transformations of an article.

[0180] For the sake of brevity, conventional data networking, application development, and other functional aspects of the system (and its individually operating components) may not be described in detail herein. Furthermore, the connecting lines shown in the various figures contained herein are intended to represent example functional relationships and / or physical couplings between the various elements. It should be noted that many alternative or additional functional relationships or physical connections may exist in a practical system.

[0181] The various system components discussed herein may include one or more of the following: a host server or other computing system including a processor for processing digital data; a memory coupled to the processor for storing digital data; an input digitizer coupled to the processor for inputting digital data; an application program stored in the memory and accessible by the processor to direct processing of the digital data by the processor; a display device coupled to the processor and memory for displaying information derived from the digital data processed by the processor; and a number of databases. The various databases used herein may include client data, vendor data, utility company data, agency data, regulatory agency data, and / or equivalent data useful in the operation of the system. As one skilled in the art would appreciate, a user computer may include an operating system (e.g., Windows NT, Windows 95 / 98 / 2000, Windows XP, Windows Vista, Windows 7, OS2, UNIX, Linux, Solaris, MacOS, etc.) as well as various conventional support software and drivers typically associated with a computer.

[0182] The system or any portion or function thereof may be implemented using hardware, software, or a combination thereof, and may be implemented in one or more computer systems or other processing systems. However, the operations performed by the embodiments are often referred to in terms such as determining or selecting, which are typically associated with mental operations performed by a human operator. Such capability of a human operator is not necessary, possible, or desirable in most cases in any of the operations described herein. Rather, the operations may be machine operations that are not merely performable by human activity.

[0183] Indeed, in various embodiments, the embodiments are directed to one or more computer systems capable of performing the functionality described herein. The computer system includes one or more processors. The processors are connected to a communications infrastructure (e.g., a communications bus, a crossover bar, or a network). Various software embodiments are described in terms of this exemplary computer system. After perusing this description, it will be apparent to one of ordinary skill in the art how to implement various embodiments using other computer systems and / or architectures. The computer system may include a display interface that automatically transfers graphic, text, and other data from the communications infrastructure (or from a frame buffer, not shown) for display on a display unit.

[0184] The computer system also includes a main memory, such as, for example, random access memory (RAM), and may also include a secondary memory. The secondary memory may include, for example, a hard disk drive and / or a removable storage drive, representing a floppy disk drive, magnetic tape drive, optical disk drive, etc. The removable storage drive reads from and / or writes to a removable storage unit in a well-known manner. The removable storage unit represents a floppy disk, magnetic tape, optical disk, etc., which is read from and written to by the removable storage drive. As will be appreciated, the removable storage unit includes a computer usable storage medium having computer software and / or data stored therein.

[0185] In various embodiments, secondary memory may include other similar devices for allowing computer programs or other instructions to be loaded into a computer system. Such devices may include, for example, removable storage units and interfaces. Examples of such may include program cartridges and cartridge interfaces (such as those found in video game devices), removable memory chips (such as erasable programmable read-only memories (EPROMs) or programmable read-only memories (PROMs)) and associated sockets, and other removable storage units and interfaces that allow software and data to be automatically transferred from removable storage units to a computer system.

[0186] The computer system may also include a communications interface. The communications interface allows software and data to be automatically transferred between the computer system and external devices. Examples of communications interfaces may include modems, network interfaces (such as Ethernet cards), communications ports, Personal Computer Memory Card International Association (PCMCIA) slots and cards, and the like. The software and data communications transferred through the communications interface are in the form of signals, which may be electronic, electromagnetic, optical, or other signals capable of being received by the communications interface. These signals are provided to the communications interface over a communications path (e.g., channel). The channels carry the signals and may be implemented using wires, cables, optical fibers, telephone lines, cellular links, radio frequency (RF) links, wireless, and other communications channels.

[0187] The terms "computer program medium" and "computer usable medium" and "computer readable medium" are generally used to refer to media such as a removable storage drive and a hard disk installed in a hard disk drive. These computer program products provide software to a computer system.

[0188] Computer programs (also referred to as computer control logic) are stored in the main memory and / or the secondary memory. Computer programs may also be received via a communications interface. Such computer programs, when executed, enable the computer system to perform features as discussed herein. In particular, the computer programs, when executed, enable the processor to perform features of the various embodiments. Thus, such computer programs represent controllers of the computer system.

[0189] In various embodiments, the software may be stored in a computer program product and loaded into a computer system using a removable storage drive, a hard disk drive, or a communications interface. The control logic (software), when executed by a processor, causes the processor to perform the functions of the various embodiments as described herein. In various embodiments, hardware components, such as application specific integrated circuits (ASICs), are implemented. Implementation of hardware state machines will be apparent to those skilled in the art to perform the functions described herein.

[0190] The various system components may be coupled independently, separately, or collectively, preferably via data links, to a network, which typically includes, for example, a connection to an Internet Service Provider (ISP) via a local loop, as used in conjunction with standard modem communications, cable modems, Dish Networks®, Integrated Services Digital Network (ISDN), Digital Subscriber Line (DSL), or various wireless communication methods (see, for example, GILBERT HELD, UNDERSTANDING DATA COMMUNICATIONS (1996), incorporated herein by reference). It should be noted that the network may be implemented as other types of networks, such as an interactive television (ITV) network. Additionally, the present system contemplates the use, sale, or distribution of any goods, services, or information over any network having similar functionality as described herein.

[0191] "Cloud" or "cloud computing" includes a model that enables opportunistic, on-demand network access to a shared pool of configurable computing resources (e.g., networks, servers, storage, applications, and services) that can be rapidly provisioned and released with minimal management effort or service provider interaction. Cloud computing may also include location-independent computing, whereby shared servers provide resources, software, and data to computers and other devices on-demand. For more information regarding cloud computing, see the NIST (National Institute of Standards and Technology) definition of cloud computing at http: / / nvlpubs.nist.gov / nistpubs / Legacy / SP / nistspecialpublication800-145.pdf (last visited: August 2019), which is incorporated herein by reference in its entirety.

[0192] As used herein, "transmission" may include sending electronic data from one system component to another via a network connection. Additionally, as used herein, "data" may include encompassing information such as commands, queries, files, data for storage, and the like, in digital or any other form.

[0193] The computers discussed herein may provide a suitable website or other Internet-based graphical user interface that is accessible by a user. In one embodiment, Microsoft Internet Information Server (IIS), Microsoft Transaction Server (MTS), and Microsoft SQL Server are used in conjunction with a Microsoft operating system, Microsoft NT web server software, a Microsoft SQL Server database system, and a Microsoft Commerce server. In addition, components such as Access or Microsoft SQL Server, Oracle, Sybase, Informix MySQL, Interbase, etc. may be used to provide an Active Data Object (ADO) compliant database management system. In one embodiment, an Apache web server is used in conjunction with a Linux operating system, a MySQL database, and the Perl, PHP, and / or Python programming languages.

[0194] Any of the communication, input, storage, database, or display discussed herein may be facilitated through a website, having a web page. The term "web page" as used herein is not meant to limit the types of documents and applications that may be used to interact with a user. For example, a typical website may include standard HyperText Markup Language (HTML) documents as well as various forms, Java applets, JavaScript, Active Server Pages (ASP), Common Gateway Interface Script (CGI), Extensible Markup Language (XML), Dynamic HTML, Cascading Style Sheets (CSS), AJAX (Asynchronous JavaScript and XML), helper applications, plug-ins, and the like. The server may include a web service that receives a request from a web server, the request including a URL (http: / / yahoo.com / stockquotes / ge) and an IP address (123.56.789.234). The web server retrieves the appropriate web page and sends the data or application for the web page to the IP address. A web service is an application that can interact with other applications over a communication medium such as the Internet. Web services are typically based on standards or protocols such as XML, Simple Object Access Protocol (SOAP), AJAX, Web Services Description Language (WSDL), and Universal Description, Discovery, and Integration (UDDI). Web service methods are well known in the art and are covered in many standard texts. See, for example, ALEX NGHIEM, IT WEB SERVICES: A ROADMAP FOR THE ENTERPRISE (2003), which is incorporated herein by reference.

[0195] Practitioners will also appreciate that there are several ways to display data within a browser-based document. Data may be represented as standard text or within fixed lists, scrollable lists, drop-down lists, editable text fields, fixed text fields, pop-up windows, and the like. Similarly, there are several ways available to modify data within a web page, such as, for example, free text entry using a keyboard, selection of menu items, check boxes, option boxes, and the like.

[0196] The present system and method may be described herein in terms of functional block components, screenshots, options, and various processing steps. It should be understood that such functional blocks may be realized by any number of hardware and / or software components configured to perform the specified functions. For example, the present system may employ various integrated circuit components, such as memory elements, processing elements, logic elements, look-up tables, and the like, which may perform various functions under the control of one or more microprocessors or other control devices. Similarly, the software elements of the present system may be implemented using any programming or scripting language, such as C, C++, C#, Java, JavaScript, VBScript, Micromedia Cold Fusion, COBOL, Microsoft Active Server Pages, assembly, PERL, PHP, awk, Python, Visual Basic, SQL Stored Procedure, PL / SQL, any UNIX shell script, and Extensible Markup Language (XML), and the various algorithms are implemented using any combination of data structures, objects, processes, routines, or other programming elements. Additionally, it should be noted that the system may employ any number of conventional techniques for data transmission, signaling, data processing, network control, and the like. Still further, the system may be used to detect or prevent security issues with client-side scripting languages ​​such as JavaScript, VBScript, or the like.For a basic introduction to cryptography and network security, please see any of the following references: (1) “Applied Cryptography: Protocols, Algorithms, and Source Code In C,” by Bruce Schneier, published by John Wiley & Sons (second edition, 1995); (2) “Java® Cryptography” by Jonathan Knudson, published by O'Reilly & Associates (1998); (3) “Cryptography & Network Security: Principles & Practice” by William Stallings, published by Prentice Hall, all of which are incorporated herein by reference.

[0197] As will be appreciated by those skilled in the art, the system may be embodied as a customization of an existing system, an add-on product, a processing device running upgraded software, a standalone system, a distributed system, a method, a data processing system, a device for data processing, and / or a computer program product. Thus, any part of the system or modules may take the form of a processing device running code, an Internet-based embodiment, an entirely hardware embodiment, or an embodiment combining Internet, software, and hardware aspects. Furthermore, the system may take the form of a computer program product on a computer-readable storage medium having computer-readable program code means embodied in the storage medium. Any suitable computer-readable storage medium may be utilized, including hard disks, CD-ROMs, optical storage devices, magnetic storage devices, and / or the like.

[0198] The present system and method are described herein with reference to screenshots, block diagrams, and flowchart illustrations of methods, apparatus (e.g., the present system), and computer program products according to various embodiments. It will be understood that each functional block of the block diagrams and flowchart illustrations, and combinations of functional blocks in the block diagrams and flowchart illustrations, respectively, can be implemented by computer program instructions.

[0199] These computer program instructions may be loaded onto a computer or other programmable data processing apparatus such that the instructions, executed on the computer, generate means for implementing the functions defined in the flowchart blocks or blocks, to produce a machine. These computer program instructions may also be stored in a computer readable memory, where the instructions stored in the computer readable memory may direct the computer or other programmable data processing apparatus to function in a particular manner to produce an article of manufacture, including instruction means, which implement the functions defined in the flowchart blocks or blocks. The computer program instructions may also be loaded onto a computer or other programmable data processing apparatus such that the instructions, executed on the computer or other programmable apparatus, provide steps for implementing the functions defined in the flowchart blocks or blocks, causing a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process.

[0200] Thus, the functional blocks of the block diagrams and flowchart diagrams support combinations of means for performing the specified functions, combinations of steps for performing the specified functions, and program instruction means for performing the specified functions. It should also be understood that each functional block of the block diagrams and flowchart diagrams, and combinations of functional blocks in the block diagrams and flowchart diagrams, can be implemented by any special purpose hardware-based computer system that performs the specified functions or steps or suitable combinations of special purpose hardware and computer instructions. Furthermore, the process flow illustrations and descriptions may be made with reference to user windows, web pages, websites, web forms, prompts, and the like. Practitioners will understand that the illustrated steps described herein may comprise any number of configurations, including the use of windows, web pages, web forms, pop-up windows, prompts, and the like. Furthermore, it should be understood that multiple steps as shown and described may be combined into a single web page and / or window, but have been expanded for simplicity. In other cases, steps shown and described as a single process step may be separated into multiple web pages and / or windows, but have been combined for convenience.

[0201] The term "non-transient" should be understood to exclude only propagating ephemeral signals per se from the scope of the claims, and does not disclaim all standard computer-readable media other than propagating ephemeral signals per se. In other words, the meaning of the terms "non-transient computer-readable medium" and "non-transient computer-readable storage medium" should be interpreted to exclude only those types of ephemeral computer-readable media that In Re Nuijten found to fall outside the scope of patentable subject matter under 35 U.S.C. § 101.

[0202] Systems, methods, and computer program products are provided. In the detailed description herein, references to "various embodiments," "one embodiment," "an embodiment," "an exemplary embodiment," and the like indicate that the described embodiment may include a particular feature, structure, or characteristic, but not all embodiments necessarily include the particular feature, structure, or characteristic. Moreover, such phrases do not necessarily refer to the same embodiment. Furthermore, when a particular feature, structure, or characteristic is described in relation to an embodiment, it is contemplated within the knowledge of a person skilled in the art that such feature, structure, or characteristic will be affected in relation to other embodiments, whether or not explicitly described. After perusal of the description, it will be apparent to a person skilled in the art how to implement the present disclosure in alternative embodiments.

[0203] Benefits, other advantages, and solutions to problems are described herein with respect to specific embodiments. However, benefits, advantages, solutions to problems, and any elements that may cause or make any benefit, advantage, or solution more pronounced are not to be construed as important, required, or essential features or elements of the present disclosure. The scope of the present disclosure is therefore limited only by the appended claims, in which reference to an element in the singular is intended to mean "one or more" rather than "one and only one" unless expressly so stated. Furthermore, when phrases similar to "at least one of A, B, and C" or "at least one of A, B, or C" are used in the claims or specification, the phrases are intended to be interpreted to mean that only A may be present in an embodiment, only B may be present in an embodiment, only C may be present in an embodiment, or any combination of elements A, B, and C may be present in a single embodiment, e.g., A and B, A and C, B and C, or A and B and C. It is contemplated that the present disclosure, including methods, may be embodied as computer program instructions on a tangible computer-readable medium, such as a magnetic or optical memory or a magnetic or optical disk. All structural, chemical, and functional equivalents of the elements described in the above exemplary embodiments that are known to those skilled in the art are expressly incorporated herein by reference and are intended to be encompassed by the present claims. Moreover, a device or method for addressing every problem sought to be solved by the present disclosure is not necessarily encompassed by the present claims.

[0204] Furthermore, no element, component, or method step in this disclosure is intended to be construed as conferred upon the public, regardless of whether the element, component, or method step is expressly recited in the claims. No claim element herein is to be construed under the provisions of 35 U.S.C. 112(f) unless the element is expressly recited using the phrase "means for." As used herein, the terms "comprises," "comprising," or any other variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements may include other elements not expressly recited or inherent to such process, method, article, or apparatus, rather than including only those elements.

[0205] The foregoing method descriptions and process flow diagrams are provided merely as illustrative examples and are not intended to require or imply that the steps of the various embodiments must be performed in the order presented. The steps in the foregoing embodiments may be performed in any order. Words such as "then," "next," and the like are not intended to limit the order of the steps; these words are merely used to guide the reader through the method description. Although the process flow diagrams may describe operations as sequential processes, many of the operations can be performed in parallel or simultaneously. In addition, the order of operations may be rearranged. A process may correspond to a method, a function, a procedure, a subroutine, a subprogram, and the like. When a process corresponds to a function, its termination may correspond to a return of the function to the calling function or the main function.

[0206] The various illustrative logic blocks, modules, circuits, and algorithm steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware, computer software, or a combination of both. To clearly illustrate this interchangeability of hardware and software, the various illustrative components, blocks, modules, circuits, and steps are described above generally in terms of their functionality. Whether such functionality is implemented as hardware or software depends on the particular application and design constraints imposed on the overall system. Those skilled in the art may implement the described functionality in various ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present invention.

[0207] An embodiment implemented in computer software may be implemented in software, firmware, middleware, microcode, hardware description language, or the like, or any combination thereof. A code segment or machine-executable instruction may represent a procedure, a function, a subprogram, a program, a routine, a subroutine, a module, a software package, a class, or any combination of instructions, data structures, or program statements. A code segment may be coupled to another code segment or a hardware circuit by passing and / or receiving information, data, arguments, parameters, or memory contents. Information, arguments, parameters, data, etc. may be passed, forwarded, or transmitted via any suitable means including memory sharing, message passing, token passing, network transmission, etc.

[0208] The actual software code or specialized control hardware used to implement these systems and methods is not a limitation of the present invention. Thus, the operation and behavior of the present systems and methods have been described without reference to specific software code, with the understanding that software and control hardware can be designed to implement the present systems and methods based on the description herein.

[0209] When implemented in software, the functions may be stored as one or more instructions or code on a non-transitory computer-readable or processor-readable storage medium. The steps of a method or algorithm disclosed herein may be embodied in a processor-executable software module, which may reside on a computer-readable or processor-readable storage medium. Non-transitory computer-readable or processor-readable media include both computer storage media and tangible storage media that facilitate the automatic transfer of a computer program from one place to another. Non-transitory processor-readable storage media may be any available medium that can be accessed by a computer. By way of example, and not limitation, such non-transitory processor-readable media may comprise RAM, ROM, EEPROM, CD-ROM, or other optical disk storage, magnetic disk storage, or other magnetic storage devices, or any other tangible storage medium that can be used to store desired program code in the form of instructions or data structures and that can be accessed by a computer or processor. Disk and disc as used herein include compact discs (CDs), laser discs, optical discs, digital versatile discs (DVDs), floppy disks, and Blu-ray discs, where disks typically reproduce data magnetically, while discs reproduce data optically with lasers. Combinations of the above should also be included within the scope of computer-readable media. In addition, operations of a method or algorithm may reside on a non-transitory processor-readable medium and / or computer-readable medium as one or any combination or set of code and / or instructions, which may be incorporated into a computer program product.

[0210] The preceding description of the disclosed embodiments is provided to enable any person skilled in the art to make or use the present invention. Various modifications of these embodiments will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other embodiments without departing from the spirit or scope of the present invention. Thus, the present invention is not intended to be limited to the embodiments shown herein, but is to be accorded the widest scope consistent with the following claims and the principles and novel features disclosed herein.

[0211] While various aspects and embodiments have been disclosed, other aspects and embodiments are contemplated. The various aspects and embodiments disclosed are for purposes of illustration and are not intended to be limiting, with a true scope and spirit being indicated by the following claims.

Claims

[Claim 1] The invention described in this specification.