Tactile stimulation system and method
By introducing control circuits into the tactile stimulation system, the information is demonstrated on the tactile stimulation interface according to the user's customized demonstration mode, solving the problem that existing systems are difficult to customize the demonstration mode, and improving the efficiency of information provision and user experience.
Patent Information
- Application Number
- CN201980071251.X
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Priority Date
- 2019-01-15
- Filing Date
- 2019-04-20
- Publication Date
- 2025-03-07
- Estimated Expiration
- 2039-04-20
AI Technical Summary
The existing tactile stimulation system is difficult to customize the presentation mode for users, resulting in difficulties for users to learn and interpret complex presentation modes, and the system is not efficient when providing information.
By introducing control circuits into the haptic stimulation system, information is demonstrated on the haptic stimulation interface according to the user's customized demonstration mode. The control circuit can map letters, words, sound visual waveforms and other information to the stimulation component pattern, providing different demonstration mode options.
It realizes customizing demonstration modes for users, improves the efficiency of users to learn and interpret complex demonstration modes, enhances the efficiency of the system when providing information, saves users' time and power, and extends the battery life of the device.
Smart Images

Figure CN112955852B_ABST
Abstract
Description
[0001] This application claims priority to U.S. patent application No. 62 / 792,642, filed on January 15, 2019, entitled “Tactile Stimulation System and Method,” the entire contents of which are incorporated herein by reference. Technical Field
[0002] The present disclosure generally relates to haptic simulation technology. Background Art
[0003] One type of tactile stimulation, called tactile simulation, stimulates receptors in the skin. There are many different types of receptors in the skin, adapted for different senses of touch. Meissner's corpuscles in the skin are used to sense low-frequency vibrations. Merkel's cells in the skin are used to sense pressure. Ruffini's corpuscles in the skin are used to sense shear deformation. Pacinian's corpuscles in the skin are used to sense high-frequency vibrations. Summary of the invention
[0004] According to one aspect of the present disclosure, a tactile stimulation system is provided, including a tactile stimulation interface, which includes a stimulation element pattern for stimulating receptors in the user's skin. The tactile stimulation system also includes a control circuit for demonstrating information on the tactile stimulation interface according to a demonstration mode customized for the user. Demonstrating information on the tactile stimulation interface according to a demonstration mode customized for the user allows the user to gradually learn to interpret more complex demonstration modes on the tactile stimulation interface. Therefore, users who have not used the tactile stimulation interface can benefit from it immediately. Moreover, the user can gradually learn to interpret more complex demonstration modes on the tactile stimulation interface according to their own progress. In addition, by customizing the demonstration mode for the user, the tactile stimulation interface can provide information to the user more efficiently. Therefore, the embodiment provides technical improvements to the operation of the tactile stimulation interface.
[0005] Optionally, in any of the aforementioned aspects, the control circuit is also used to customize the demonstration mode based on user input.
[0006] Optionally, in any of the aforementioned aspects, information is presented on the tactile stimulation interface according to the presentation mode, and the control circuit is further used to: map the symbolic representation of letters to the stimulation element pattern, in response to the presentation mode being the first mode; and map the symbolic representation of words to the stimulation element pattern, in response to the presentation mode being the second mode. Providing different presentation mode options allows the user to select a presentation mode that presents information more effectively, which not only saves the user's time, but also saves power and / or extends the battery life of the tactile stimulation system.
[0007] Optionally, in any of the aforementioned aspects, information is demonstrated on the tactile stimulation interface according to a demonstration mode, and the control circuit is also used to: map the sound-visual waveform representation of letters to the stimulation element pattern in response to the demonstration mode being a first mode; and map the sound-visual waveform representation of words to the stimulation element pattern in response to the demonstration mode being a second mode.
[0008] Optionally, in any of the aforementioned aspects, information is demonstrated on the tactile stimulation interface according to a demonstration mode, and the control circuit is also used to: map the symbolic representation of the digital information to the stimulation element pattern in response to the demonstration mode being a first mode; and map the sound and visual waveform representation of the digital information to the stimulation element pattern in response to the demonstration mode being a second mode.
[0009] Optionally, in any of the aforementioned aspects, information is demonstrated on the tactile stimulation interface according to a demonstration mode, and the control circuit is also used to: spatially map the image to the stimulation element pattern to respond to the demonstration mode as a first mode; and temporally map the image to the stimulation element pattern to respond to the demonstration mode as a second mode.
[0010] Optionally, in any of the aforementioned aspects, the tactile stimulation system further comprises a user interface for receiving a user's selection of the complexity of the demonstration information in the tactile stimulation system. The control circuit is used to select a demonstration mode based on the complexity.
[0011] Optionally, in any of the aforementioned aspects, the tactile stimulation system is further used to increase the complexity of the information presented in the tactile stimulation system in response to the user adapting to the tactile stimulation system.
[0012] Optionally, in any of the aforementioned aspects, the tactile stimulation system further comprises a wireless communication interface for receiving information to be presented on the tactile stimulation system. The control circuit is further configured to map digital data received at the wireless communication interface to a stimulation element pattern so as to present the information on the tactile stimulation interface.
[0013] Optionally, in any of the aforementioned aspects, the tactile stimulation system further comprises a wireless communication device. The wireless communication device is used to provide digital data to the wireless communication interface. Some users may not be able to use, for example, a visual display or an audio display of the wireless communication device. The embodiment solves this technical problem by presenting information on the wireless communication device to the user.
[0014] Optionally, in any of the aforementioned aspects, the tactile stimulation system further comprises an annular component for wearing on a person's finger. The annular component has an inner ring surface and an outer ring surface. The annular shape solves the technical problem of how to effectively interact with the user's senses, while also being convenient for the user. This annular shape is not cumbersome, but is very convenient for the user to wear.
[0015] Optionally, in any of the aforementioned aspects, the stimulation element pattern is used to stimulate receptors in the skin through the inner ring surface. The annular component has an inner ring surface and an outer ring surface. Although the inner ring surface has limited contact with the user's skin surface, due to the sensitivity of the receptors in the user's finger skin, information can be effectively transmitted to the user.
[0016] Optionally, in any of the aforementioned aspects, the pattern of stimulation elements is used to stimulate receptors in the skin through the outer ring surface.
[0017] Optionally, in any of the preceding aspects, the pattern of stimulation elements comprises a pattern of electrodes for stimulating receptors in the skin.
[0018] Optionally, in any of the aforementioned aspects, the stimulation element pattern comprises a pattern of electromechanical transducers for stimulating receptors in the skin through mechanical vibrations of each electromechanical transducer.
[0019] Optionally, in any of the aforementioned aspects, the stimulation element pattern includes an electroacoustic transducer pattern for stimulating receptors in the skin through mechanical vibrations of the electroacoustic transducer.
[0020] Optionally, in any of the aforementioned aspects, the stimulation element pattern comprises an electrothermal transducer pattern for stimulating receptors in the skin by the temperature of each electrothermal transducer.
[0021] Optionally, in any of the aforementioned aspects, the tactile stimulation system further comprises a component for wrapping around a person's wrist.
[0022] Optionally, in any of the aforementioned aspects, the tactile stimulation system further comprises a component for wrapping around a person's neck.
[0023] Optionally, in any of the preceding aspects, the stimulation element pattern is located in a substantially flat surface.
[0024] Optionally, in any of the preceding aspects, the stimulation element pattern is located in a curved surface.
[0025] Optionally, in any of the aforementioned aspects, the information includes text. In addition, the control circuit is also used to characterize the text with a shape, and the shape is physically mapped to the text to customize the presentation mode for the user.
[0026] Optionally, in any of the aforementioned aspects, the information includes sound. In addition, the control circuit is further used to convert the sound into a visual representation of the sound so as to customize the demonstration mode for the user and the control circuit is further used to demonstrate the visual representation of the sound on the tactile stimulation interface.
[0027] According to another aspect of the present disclosure, a method for tactilely presenting information to a user is provided. The method includes customizing a presentation mode for a user of a tactile stimulation interface, the tactile stimulation interface including a stimulation element pattern; and stimulating receptors in the user's skin through the stimulation element pattern to present information according to the presentation mode.
[0028] According to another aspect of the present disclosure, a non-transitory computer-readable medium is provided, storing computer-readable instructions for providing tactile communication, which, when executed by one or more processors, causes the one or more processors to: access information to be presented on a tactile stimulation interface, the tactile stimulation interface comprising a pattern of stimulation elements for stimulating receptors in the user's skin; customize a presentation mode for the user; and cause the information to be presented on the tactile stimulation interface according to the presentation mode.
[0029] According to another aspect of the present disclosure, a wireless communication device is provided, comprising: a non-temporary memory storage containing instructions; and one or more processors communicating with the non-temporary memory storage, wherein the one or more processors execute the instructions to: access information to be presented on a tactile stimulation interface, the tactile stimulation interface comprising a pattern of stimulation elements for stimulating receptors in a user's skin; and cause the information to be presented on the tactile stimulation interface according to a user-customized presentation mode.
[0030] According to one aspect of the present disclosure, there is provided a tactile stimulation device, comprising: a tactile stimulation interface including a pattern of stimulation elements for stimulating receptors in a user's skin; and a receiver for receiving information for presentation on the tactile stimulation interface.
[0031] Optionally, in any of the aforementioned aspects, the tactile stimulation system further comprises a controller for outputting a data signal based on the received information; and a digital-to-analog converter for converting the data signal into an analog signal to drive the stimulation element pattern.
[0032] This summary is provided to introduce some concepts in a concise form, which will be further described in the detailed description below. This summary is not intended to identify the key features or essential features of the claimed subject matter, nor is it intended to help determine the scope of the claimed subject matter. The claimed subject matter is not limited to implementations that solve any or all of the disadvantages pointed out in the background technology. BRIEF DESCRIPTION OF THE DRAWINGS
[0033] The various aspects of the disclosure are illustrated by way of example and not limitation in the accompanying drawings, in which like references indicate similar elements.
[0034] Figure 1 A wireless network for data communication is shown.
[0035] Figure 2 An embodiment of a tactile stimulation system is shown.
[0036] Figure 3 An example of a base station is shown.
[0037] Figure 4 An embodiment of a tactile stimulation device is depicted.
[0038] Figure 5 An embodiment of presenting information in a presentation mode called "symbolic representation of letters" in a tactile stimulation interface is depicted.
[0039] Figure 6 An embodiment of presenting information in a presentation mode called "symbolic representation of words" in a tactile stimulation interface is depicted.
[0040] Figure 7 An embodiment of presenting information in a presentation mode called "sound-visual waveform representation of letters" in a tactile stimulation interface is depicted.
[0041] Figure 8 Embodiments of a presentation mode for presenting information on a tactile stimulation interface are depicted.
[0042] Fig. 9 is a flow chart of an embodiment of a process for presenting information on a tactile stimulation interface.
[0043] Fig.10 is a flow chart of an embodiment of a process for presenting information on a tactile stimulation interface.
[0044] Fig.11 is a flow chart of an embodiment of a process for presenting information on a tactile stimulation interface.
[0045] Fig.12 is a flow diagram of an embodiment of a process for a user to select a presentation mode.
[0046] Fig.13 is a flow diagram of an embodiment of a process for letting a user select a presentation mode complexity.
[0047] Fig.14 is a flow chart of an embodiment of a process for a tactile stimulation interface to present information in different presentation modes.
[0048] Fig.15 is a flow chart of an embodiment of a process for a tactile stimulation interface to present information in different presentation modes.
[0049] Fig.16 is a flow chart of an embodiment of a process for a tactile stimulation interface to present information in different presentation modes.
[0050] Fig.17is a flow chart of an embodiment of a process for a tactile stimulation interface to present information in different presentation modes.
[0051] Fig.18 is a flow chart of an embodiment of a process for a tactile stimulation interface to present information in different presentation modes.
[0052] Fig.19 Another embodiment of a presentation mode for presenting information on a tactile stimulation interface is depicted.
[0053] Figures 20A-20F An example of a time presentation mode is shown.
[0054] Fig.21 is a flow chart of an embodiment of a process for a tactile stimulation interface to present information in a temporal presentation mode.
[0055] Fig. 22 is a flow chart of an embodiment of a process for a tactile stimulation interface to present information in a spatial presentation mode or a temporal presentation mode.
[0056] Fig.23 An embodiment of a tactile stimulation device having a ring-like shape is depicted.
[0057] Fig.24 An embodiment is depicted in which the stimulation element pattern is located on a curved surface.
[0058] Fig.25 Another embodiment is depicted where the stimulation element pattern is located on a curved surface. DETAILED DESCRIPTION
[0059] The present disclosure, which generally relates to tactile stimulation systems and methods, will now be described in conjunction with the accompanying drawings.
[0060] Providing viable tactile stimulation systems is challenging due to the lack of neuroscientific understanding of how the human brain adapts to learning to use tactile stimulation systems. For example, it is difficult to predict the optimal presentation mode for presenting information in a tactile stimulation interface of a system. Furthermore, the optimal presentation mode may vary from person to person. Presenting information in a simple presentation mode can make it easier for a person to interpret the information. An example of a very simple presentation mode is a binary notification, such as a buzzing sound indicating on or off. However, simple presentation modes have certain limitations in the amount and / or quality of information that can be presented. For example, a binary notification can be used to notify a user that a message has been received, but does not explain anything about the content of the message. On the other hand, complex presentation modes can be used to convey more information. For example, a tactile stimulation interface can present one word at a time so that the user can read through the entire message. An example of such a one-word-at-a-time presentation is to determine the sound-visual waveform representation of the word and then map the visual waveform representation to the tactile stimulation interface. However, more complex presentations in a tactile stimulation interface may be difficult for a person to understand. The selection of an appropriate presentation mode depends largely on the experience level of the person using the tactile stimulation interface. The selection of an appropriate presentation mode depends largely on the experience level of the person using the tactile stimulation interface.
[0061] The technology provided herein is to demonstrate information on a tactile stimulation interface according to a demonstration mode customized for a user. Customizing the demonstration mode for a user provides a feasible method for allowing a user to adapt to the tactile stimulation interface. In one embodiment, the tactile stimulation interface uses tactile stimulation to stimulate receptors in human skin. Demonstration mode refers to a mode or method for demonstrating information on a tactile stimulation interface. Demonstration mode examples include but are not limited to: symbolic representation of letters, symbolic representation of words, sound and visual waveform representation of letters, sound and visual waveform representation of words, spatial representation of images, and temporal representation of images. Demonstrating information on a tactile stimulation interface according to a demonstration mode customized for a user allows users to gradually learn to interpret more complex demonstration modes on the tactile stimulation interface. Therefore, even users who have no experience in using a tactile stimulation interface can immediately gain something from it. Moreover, users can gradually learn to interpret more complex demonstration modes in a tactile stimulation interface according to their own progress. In addition, by customizing the demonstration mode for users, the tactile stimulation interface can indeed provide information to users more efficiently. Therefore, the embodiment provides technical improvements to the operation of the tactile stimulation interface.
[0062] In one embodiment, the tactile stimulation device is paired with a wireless communication device such as a cellular phone. The tactile stimulation device can be used to demonstrate information from the wireless communication device. In one embodiment, the wireless communication device provides digital information to the tactile stimulation device. The wireless communication device typically includes a screen for displaying visual information and a speaker (or headphone jack) for playing audio information. Some wireless devices can be configured to vibrate when, for example, a phone call is received. However, it is very challenging to provide a feasible tactile stimulation system to demonstrate text, visual and / or audio information from a wireless communication device (or other information sources demonstrated in a tactile stimulation interface). And some users may not be able to use the visual display or audio display of the wireless communication device, etc. Therefore, the present embodiment solves this technical problem by demonstrating the information on the wireless device to the user.
[0063] It should be understood that the embodiments of the present disclosure can be implemented in a variety of different forms, and the interpretation of the scope of the claims is not limited to the embodiments described herein. Specifically, these embodiments are provided to make the present disclosure sufficient and comprehensive, and to fully convey the concepts of the embodiments of the present invention to those skilled in the art. The present disclosure is intended to cover all modifications, equivalents and alternatives that fall within the spirit and scope of the present disclosure as defined by the appended claims. In addition, in the detailed description of the embodiments of the present disclosure below, a large number of specific details are proposed in order to thoroughly understand the present disclosure. However, it should be understood by those of ordinary skill in the art that the embodiments of the present disclosure can be implemented without these specific details.
[0064] Figure 1 A wireless network for data communication is shown. The communication system 100 includes, for example, user equipment 110A, 110B, and 110C, radio access networks (RAN) 120A and 120B, a core network 130, a public switched telephone network (PSTN) 140, the Internet 150, and other networks 160. Other or alternative networks include private and public data packet networks, including corporate intranets. The figures show some components or elements, and these components or elements can be included in the system 100.
[0065] In one embodiment, the wireless network may be a fifth generation (5G) network having at least one 5G base station, the base station communicating with the communication device using orthogonal multi-frequency multiplexing (OFDM) and / or non-OFDM, and a transmission time interval (TTI) of less than 1 millisecond (e.g., 100 or 200 microseconds). In general, the base station may also be any of an eNB and a 5G BS (gNB). In addition, the network may also include a network server for processing information received from the communication device via at least one eNB or gNB.
[0066] System 100 enables multiple wireless users to transmit or receive data and other content. System 100 can implement single or multiple access methods such as, but not limited to, code division multiple access (CDMA), time division multiple access (TDMA), frequency division multiple access (FDMA), orthogonal FDMA (OFDMA), or single carrier FDMA (SC-FDMA).
[0067] User equipment (UE) 110A, 110B, and 110C, which may be referred to as UE 110, respectively, or collectively as UEs 110, are used to operate or communicate in system 100. For example, UE 110 may be used to transmit and / or receive wireless signals or wired signals. Each UE 110 represents any suitable end-user device and may include, for example (or may be referred to as) user equipment / device, wireless transmit / receive unit (UE), mobile station, fixed or mobile subscriber unit, pager, cellular phone, personal digital assistant (PDA), smart phone, laptop, computer, touch pad, wireless sensor, wearable device, or consumer electronic device.
[0068] In the above embodiment, RANs 120A, 120B include one or more base stations (BSs) 170A, 170B, respectively. RANs 120A and 120B may be referred to as RAN 120, respectively, or collectively as RANs 120. Similarly, base stations (BSs) 170A and 170B may be referred to as base stations (BS) 170, respectively, or collectively as base stations (BSs) 170. Each of BSs 170 is used to wirelessly connect to one or more UEs 110 to access core network 130, PSTN 140, Internet 150, and / or other networks 160. For example, the base stations (BSs) 170 may include one or more of a number of well-known devices, such as a base transceiver station (BTS), a Node-B (NodeB), an evolved NodeB (eNB), a next-generation (fifth generation) (5G) NodeB (gNB), a Home NodeB, a Home eNodeB, a site controller, an access point (AP), or a wireless router, or a server, router, switch, or other processing entity having a wired or wireless network.
[0069] In one embodiment, BS 170A forms part of RAN 120A, where RAN 120A may include one or more other BSs 170, elements and / or devices. Similarly, BS 170B forms part of RAN 120B, where RAN 120B may include one or more other BSs 170, elements and / or devices. Each of BSs 170 transmits and / or receives wireless signals within a specific geographic area or region, which are sometimes referred to as "cells". In some embodiments, multiple-input multiple-output (MIMO) technology with multiple transceivers may be used in each cell.
[0070] BSs 170 communicate with one or more UEs 110 over wireless communication links via one or more air interfaces (not shown). The air interfaces may use any suitable radio access technology.
[0071] It is contemplated that the system 100 may use multi-channel access capabilities, including schemes such as BSs 170 and UEs 110 for implementing the Long Term Evolution wireless communication standard (LTE), LTE Advanced (LTE-A), and / or LTE Multimedia Broadcast Multicast Service (MBMS). In other embodiments, the base station 170 and the user equipment 110A-110C are used to implement UMTS, HSPA, or HSPA+ standards and protocols. Of course, a variety of other access schemes and wireless protocols may also be used.
[0072] The RANs 120 communicate with the core network 130 to provide voice, data, applications, Voice over Internet Protocol (VoIP), or other services to the UEs 110. It should be understood that the RANs 120 and / or the core network 130 may communicate directly or indirectly with one or more other RANs (not shown). The core network 130 may also serve as a gateway access to other networks such as the PSTN 140, the Internet 150, and other networks 160. In addition, some or all of the UEs 110 may have the capability to communicate with different wireless networks over different wireless links using different wireless technologies and / or protocols.
[0073] RANs 120 may also include mm and / or microwave access points (APs). APs may be part of BSs 170 or may be located remote from BSs 170. APs may include, but are not limited to, connection points (mmWCPs) or BSs 170 capable of mmW communications (such as mmW base stations). mmWAPs may transmit and receive signals in a frequency range such as 24 GHz to 100 GHz, but are not required to operate throughout the frequency range. As used herein, the term base station refers to a base station and / or a wireless access point.
[0074] although Figure 1 An example of a communication system is shown, but it is also possible to Figure 1 Various changes may be made. For example, the communication system 100 may include a number of user equipment, base stations, networks, or other components of any suitable configuration. It should also be understood that the term user equipment may refer to any type of wireless device that communicates with a radio network node in a cellular or mobile communication system. Non-limiting examples of user equipment are target devices, device-to-device (D2D) user equipment, machine-type user equipment or user equipment capable of machine-to-machine (M2M) communication, laptops, PDAs, iPads, tablet computers, mobile terminals, smart phones, laptop embedded equipment (LEE), laptop mounted equipment (LME), and USB dongles.
[0075] In one embodiment, UE 110 is wirelessly connected to tactile stimulation device 240. In one embodiment, UE 110 sends information (such as digital data) to tactile stimulation device 240 via the wireless connection. The information is presented in tactile stimulation interface 250 according to a user-customized presentation mode of UE 110. A method is provided for user-customized presentation mode so that the user can adapt to tactile stimulation device 240. In one embodiment, a tactile stimulation system includes tactile stimulation device 240 and UE 110. In one embodiment, the tactile stimulation system includes tactile stimulation device 240 but does not include UE 110.
[0076] Figure 2 An embodiment of a tactile stimulation system that may be implemented is shown. In this embodiment, the tactile stimulation system includes a tactile stimulation device and UE110. In another embodiment, the tactile stimulation system includes a tactile stimulation device 240 but does not include UE110. UE110 can be, for example, a mobile phone, but in other examples it can also be other devices, such as a desktop computer, a laptop computer, a tablet computer, a handheld computing device, an automotive computing device, and / or other computing devices. As shown in the figure, the exemplary UE110 shows at least one transmitter 202, at least one receiver 204, a memory 206, at least one processor 208, and at least one input / output device 212. The processor 208 can implement a variety of processing operations of the UE110. For example, the processor 208 can perform signal encoding, data processing, power control, input / output processing, or any other function that enables the UE110 to operate in the system 100 ( Figure 1 ). Processor 208 may include any suitable processing or computing device for performing one or more operations. For example, processor 208 may include a microprocessor, a microcontroller, a digital signal processor, a field programmable gate array, or an application specific integrated circuit. In one embodiment, memory 206 is a non-transitory memory. In one embodiment, memory 206 is a non-transitory computer readable medium.
[0077] The transmitter 202 may be used to modulate data or other content for transmission by at least one antenna 210. The transmitter 202 may also be used to amplify, filter, and frequency convert RF signals before sending the signals to the antenna 210 for transmission. The transmitter 202 may include any suitable structure for generating signals for wireless transmission.
[0078] Receiver 204 can be used to demodulate data or other content received through at least one antenna 210. Receiver 204 can also amplify, filter and frequency convert RF signals received through antenna 210. In some embodiments, receiver 204 is an RF signal receiver. Receiver 204 may include any suitable structure for processing signals received wirelessly. Antenna 210 may include any suitable structure for transmitting and / or receiving wireless signals. The same antenna 210 can both transmit and receive RF signals, or different antennas 210 can be used to transmit and receive signals.
[0079] It should be understood that one or more transmitters 202 may be used in UE 110, one or more receivers 204 may be used in UE 110, and one or more antennas 210 may be used in UE 110. Although at least one transmitter 202 and at least one receiver 204 are shown as separate blocks or components, they may be combined into a transceiver. Figure 2 204. In one embodiment, at least one transmitter 202 is used to communicate with a tactile stimulation device 240. In one embodiment, at least one receiver 204 is used to communicate with a tactile stimulation device 240. In one embodiment, such a transmitter and / or receiver includes a wireless communication interface for communicating with the tactile stimulation device 240.
[0080] UE110 also includes one or more input / output devices 212. Input / output devices 212 are used to interact with users. Each input / output device 212 includes any suitable structure for providing information to the user or receiving information from the user, such as a speaker, microphone, keyboard, keyboard, display or touch screen. Note that some users may have difficulty using one or more of the structures to receive information. For example, some users may not be able to see or read the visual display on UE110. For another example, some users cannot hear the speakers on UE110. An embodiment of the tactile stimulation device 240 can enable a user to obtain such information from UE110.
[0081] In addition, the UE 110 includes at least one memory 206. The memory 206 stores instructions and data used, generated or collected by the UE 110. For example, the memory 206 can store software or firmware instructions executed by the processor 208 and data for reducing or eliminating incoming signal interference. Each memory 206 includes any suitable volatile and / or non-volatile memory and retrieval means. Any suitable memory type can be used, such as a random access memory (RAM), a read-only memory (ROM), a hard disk, an optical disk, a subscriber identity module (SIM) card, a memory stick, a secure digital (SD) memory card, etc.
[0082] UE 110 is wirelessly connected to tactile stimulation device 240. Tactile stimulation device 240 includes tactile stimulation interface 250 (also more simply referred to as "stimulation interface"), receiver 260, controller 270, and digital / analog (D / A) converter 275. Receiver 260 may include a wireless receiver for wireless communication with UE 110. Receiver 260 may communicate using a variety of wireless communication protocols, including but not limited to IEEE (Institute of Electrical and Electronics Engineers) 802.11 protocol or IEEE802.15 protocol. In one embodiment, receiver 260 uses Communicate. Optionally, the tactile stimulation device 240 may include a transmitter that can communicate using a variety of wireless communication protocols. In one embodiment, the user can select which information is transmitted by the UE 110 to the tactile stimulation device 240. As the user becomes more comfortable using the tactile stimulation device 240, the user may request to send more detailed information. For example, the user may select a reminder after receiving an email, email keywords, the entire email, etc.
[0083] In one embodiment, the stimulation interface 250 is used to stimulate receptors in human skin. The receptors may include, but are not limited to, Meissner's corpuscles, Merkel's cells, Ruffini's corpuscles, and Pacinian's corpuscles. The stimulation interface 250 does not need to stimulate all of these types of receptors. In one embodiment, the stimulation interface 250 stimulates a portion of one or more types of receptors (such as Meissner's corpuscles, Merkel's cells, Ruffini's corpuscles, and / or Pacinian's corpuscles). In one embodiment, the stimulation interface 250 has a pattern of stimulation elements. The stimulation interface 250 can use electrical signals (such as voltage, current, etc.), temperature (such as cold, heat), and / or mechanical motion (such as mechanical vibration) to stimulate receptors in human skin, but is not limited to stimulating receptors in human skin with these technologies. The user can learn to interpret the stimulation of the receptors in the skin to obtain information. For example, the user can use the tactile stimulation device 240 to "read" an email message received at the UE 110. Here, the term “read” in quotation marks emphasizes that such “reading” is not a typical reading scenario, such as a user visually reading from a display screen such as on UE 110 .
[0084] The controller 270 is used to control the operation of the tactile stimulation device 240. In one embodiment, the controller 270 is used to control the transmission of data from the UE 110 through the receiver 260. In one embodiment, the data transmission from the UE 110 to the tactile stimulation device 240 is unidirectional. In one embodiment, the data transmission from the UE 110 to the tactile stimulation device 240 is bidirectional. Therefore, the tactile stimulation device 240 can report configuration information, status, etc. to the UE 110.
[0085] In one embodiment, the controller 270 is used to control the data presentation in the stimulation interface 250. In one embodiment, the control process includes selecting a presentation mode. The D / A converter 275 is used to convert a digital signal into an analog signal. In one embodiment, the controller 270 processes a first digital signal from the UE 110 and provides a second digital signal to the D / A converter 275. Based on the second digital signal from the controller 270, the D / A converter 275 outputs an analog signal to drive the stimulation interface 250. Because the controller 270 can implement functions such as selecting a presentation mode and / or generating a suitable digital signal for configuring the stimulation interface 250, the first and second digital signals may be different. In one embodiment, the UE 110 implements these functions, wherein the first and second digital signals may be the same.
[0086] The controller 270 may be implemented in hardware, software, or a combination of hardware and software. The hardware control circuit elements used to implement the controller 270 may include, but are not limited to, field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chips (SOCs), complex programmable control circuit devices (CPLDs), special purpose computers, etc. In one embodiment, the controller 270 is implemented using software (stored on a storage device) that programs one or more processors. Therefore, the controller 270 may include a storage device and a processor.
[0087] The controller 270 is an embodiment of a control circuit that is used to present information on the tactile stimulation interface 250 according to a demonstration mode customized for a user. In one embodiment, the controller 270 cooperates with the UE 110 to present information on the stimulation interface 250. For example, by executing instructions stored in the memory 206 on the processor 208, the UE 110 can select the demonstration mode and send digital data to the receiver 260. Therefore, in one embodiment, the combination of the controller 270, the processor 208, and the memory 206 can be referred to as a control circuit that is used to present information on the tactile stimulation interface 250 according to the demonstration mode customized for the user.
[0088] In some embodiments, tactile stimulation device 240 is battery powered. In some embodiments, UE 110 is also battery powered. As shown below, some demonstration modes can more effectively demonstrate information to users. A more effective demonstration mode for demonstrating information to users can save the power consumed by tactile stimulation device 240 and / or UE 110. Therefore, a more effective demonstration mode for demonstrating information to users can extend the battery life of tactile stimulation device 240 and / or UE 110.
[0089] Figure 3 An example BS170 is shown that can implement the methods and teachings according to the present disclosure. As shown, BS170 includes at least one processor 308, at least one transmitter 302, at least one receiver 304, one or more antennas 310 and at least one memory 306. Processor 308 can implement multiple processing operations of BS170, such as signal encoding, data processing, power control, input / output processing or any other function. Each processor 308 includes any suitable processing or computing device for performing one or more operations. Each processor 308 may include such as a microprocessor, a microcontroller, a digital signal processor, a field programmable gate array or an application-specific integrated circuit. In one embodiment, memory 306 is a non-temporary memory.
[0090] Each transmitter 302 includes any suitable structure to generate signals for wireless transmission to one or more UEs 110 or other devices. Each receiver 304 includes any suitable structure for processing signals wirelessly received by one or more UEs 110 or other devices. Although at least one transmitter 302 and at least one receiver 304 are shown as separate blocks or components in the figure, they can be combined into a transceiver. Each antenna 310 includes any suitable structure for transmitting and / or receiving wireless signals. Although the same antenna 310 is shown here as being coupled to both the transmitter 302 and the receiver 304, one or more antennas 310 can be coupled to the transmitter 302, and one or more separate antennas 310 can be coupled to the receiver 304. Each memory 306 includes any suitable volatile and / or non-volatile memory and retrieval device.
[0091] Figure 4 An embodiment of a tactile stimulation device 240 is depicted. The stimulation interface 250 includes a pattern of tactile stimulation elements 410 (also more simply referred to as "stimulation elements"). In one embodiment, the pattern of stimulation elements 410 is used to stimulate receptors in human skin (e.g., Meissner's corpuscles, Merkel's cells, Ruffini's corpuscles, and / or Pacinian corpuscles). In one embodiment, each stimulation element 410 is independently controllable. Figure 4 The pattern in the figure is only an example, and the stimulation element 410 may also have other various configurations. In this example, the pattern of the stimulation element 410 is 6*6, and there are 36 stimulation elements 410 in total. The number of stimulation elements 410 may vary according to the embodiment. Figure 4 In the example of FIG. 4 , the stimulation elements 410 have six rows and six columns. It is not required that the number of rows and columns be equal. Figure 4 In the example of FIG. 4 , the spacing of the stimulation elements 410 is equal; however, the spacing is not required to be equal, and the pattern is not required to be arranged in rows and columns. In one embodiment, the pattern includes an array of stimulation elements 410. The term "array" is used to refer to a systematic arrangement of similar objects such as stimulation elements 410.
[0092] Figure 4 In the embodiment, the cross-sectional shape of each stimulation element 410 is a square, but the stimulation elements 410 may have other cross-sectional shapes.
[0093] In one embodiment, each stimulation element 410 includes an electrode that can be biased to a desired voltage. Therefore, in one embodiment, the stimulation interface 250 includes an electrode pattern for stimulating receptors in the user's skin. In one embodiment, some stimulation elements 410 are referred to as activation electrodes and other stimulation elements 410 are referred to as ground electrodes. In one embodiment, there are one or more ground electrodes. By biasing the activation electrodes and the ground electrodes to a suitable voltage so that they are at a common voltage, current can be caused to flow from the activation electrodes through the user's skin to the one or more ground electrodes. The current flowing through the user's skin can be an ionic current. In one embodiment, if it is desired not to activate the particular activation electrode, the activation electrode can be biased to a common voltage.
[0094] In one embodiment, each stimulation element 410 includes an electromechanical converter. Thus, in one embodiment, the stimulation interface 250 includes a pattern of electromechanical transducers for stimulating receptors in the user's skin. Electromechanical transducers are capable of converting electrical energy into mechanical energy. The mechanical energy can be in the form of mechanical vibrations. For example, the electromechanical transducers can be controlled by electrical signals (such as current or voltage) to cause mechanical vibrations of the stimulation elements 410. In one embodiment, the pattern of stimulation elements 410 including electromechanical transducers is used to stimulate receptors in human skin through mechanical vibrations of the electromechanical transducers.
[0095] In one embodiment, each stimulation element 410 comprises an electroacoustic transducer. Thus, in one embodiment, the stimulation interface 250 comprises a pattern of electroacoustic transducers for stimulating receptors in the skin of a user. Electroacoustic transducers are capable of converting electrical energy into acoustic energy. The acoustic energy can be in the form of sound waves. For example, the electroacoustic transducer can be controlled by an electrical signal (such as a current or voltage) to generate sound waves. In one embodiment, each electroacoustic transducer comprises an audio speaker. In one embodiment, the pattern of stimulation elements 410 comprising electroacoustic transducers is used to stimulate receptors in human skin through mechanical vibrations of the electroacoustic transducers.
[0096] The diameter of the electroacoustic transducer can be between about 0.5 mm and 2 mm. However, an electroacoustic transducer having a diameter less than 0.5 mm or greater than 2 mm can also be used as the stimulation element 410. In one embodiment, the electroacoustic transducer is driven to generate sound waves in the frequency range of 10 Hz to 10 kHz. However, the electroacoustic transducer can be driven to generate sound waves below 10 Hz or greater than 10 kHz.
[0097] In one embodiment, each stimulation element 410 comprises an electrothermal transducer. Thus, in one embodiment, the stimulation interface 250 comprises a pattern of electrothermal transducers configured to stimulate receptors in the skin of a user. The electrothermal transducer is capable of converting electrical energy into thermal energy. For example, the electrothermal transducer can be controlled by an electrical signal (such as a current or voltage) to generate thermal energy. In one embodiment, each electrothermal transducer comprises a resistor. In one embodiment, each electrothermal transducer comprises a diode. In one embodiment, the pattern of stimulation elements 410 comprised of electrothermal sensors is used to stimulate receptors in human skin through the relative temperature of the electrothermal sensors.
[0098] In one embodiment, each stimulation element 410 itself can stimulate receptors in human skin. For example, each stimulation element can include a motor transducer controlled by an electrical signal (such as current or voltage) to produce mechanical vibrations. In one embodiment, two or more stimulation elements 410 cooperate with each other to stimulate receptors in human skin. For example, each stimulation element can include an electrode so that current flows from the point of contact of the user's skin with the activation electrode, through the user's skin, and to the point of contact of the user's skin with the ground electrode. Note that in one embodiment, the current referred to in the user's skin is an ionic current.
[0099] The stimulation element 410 can be controlled to present information in various presentation modes. Presenting information in the tactile stimulation interface according to the presentation mode customized for the user allows the user to gradually learn to interpret more complex presentation modes on the tactile stimulation interface. Therefore, even users who have no experience in using the tactile stimulation interface can immediately gain something from it. Moreover, the user can gradually learn to interpret more complex presentation modes in the tactile stimulation interface according to his or her own progress.
[0100] One presentation mode herein is referred to as "spatial representation". In one embodiment of spatial representation, the entire pattern of stimulation elements 410 can be used simultaneously, with some elements being active and some being inactive. One presentation mode herein is referred to as "temporal representation". In one embodiment of temporal representation, a column of stimulation elements 410 can be used at a first point in time, with some elements 410 in the column being active and some being inactive. All other columns can be inactive at the first point in time. At a second point in time, a second column of the pattern of stimulation nodes 410 can be used in a similar manner. Other columns of the pattern of stimulation elements 410 can continue to be temporally represented at other sequential points in time. Another embodiment of temporal representation scrolls through rows of the pattern of stimulation elements 410 in a similar manner.
[0101] The format of the information provided to the tactile stimulation device 240 by the UE 110 can vary according to the embodiment. For example, the information can be "raw data", such as text data or even image data. In this case, the tactile stimulation device 240 is used to determine how to map the "raw data" to the pattern of the tactile stimulation element 410. However, the UE 110 can provide information in a more accurate format. For example, the UE 110 can understand the pattern configuration of the stimulation element 410. In this case, the UE 110 can indicate what kind of content the tactile stimulation device 240 should demonstrate in each stimulation element 410.
[0102] Figure 5 An embodiment of presenting information in a "symbolic representation of a letter" presentation mode of the tactile stimulation interface 250 is depicted. The tactile stimulation interface 250 is presenting the letter "A" in the English alphabet. In this example, the representation of the tactile stimulation interface 250 includes the visual appearance of the letter "A" in the English alphabet. This concept can be applied to letters in other languages.
[0103] Figure 6 An embodiment of presenting information in a "symbolic representation of a word" presentation mode of the tactile stimulation interface 250 is depicted. The tactile stimulation interface 250 is presenting the word "love" composed of English letters. In this example, the representation in the tactile stimulation interface 250 includes the visual appearance of a heart symbol, and in this instance, it is a symbolic representation of the word "love". Note that the tactile stimulation interface 250 is able to present entire words rather than individual letters, enabling the tactile stimulation interface 250 to present information to the user more effectively. For example, an email can be presented to the user in less time. However, in some cases, the user is unable to interpret more complex texts. In other words, the user may be able to better interpret the letters of the alphabet. An embodiment allows the user to select a presentation mode, which allows the user to decide which mode is best for him or her. In addition, it should be noted that certain presentation modes that take less time can not only save the user's time, but also extend the battery life in the UE 110 and / or the tactile stimulation device 240.
[0104] Figure 5 and Figure 6 The concepts in the text can be applied to characters or symbols written in other languages. Therefore, one embodiment includes a demonstration mode as described herein, namely "a symbolic representation of a written text in a language". For example, in one embodiment, the demonstration mode is a symbolic representation of Chinese characters. Here, Chinese characters refer to any known characters that have been invented for writing Chinese.
[0105] Figure 7An embodiment of presenting information in a "sound visual waveform representation of letters" presentation mode of the tactile stimulation interface 250 is depicted. The sound waveform of a letter in spoken language can be intuitively represented as a "sound visual waveform". In one example, the sound visual waveform can be depicted by the relationship between sound intensity and time. For example, each letter of the English alphabet has a unique sound visual waveform representation shape. Figure 6 2 shows how the visual waveform of the sound is mapped to the tactile stimulation interface 250 using an xy axis. The y axis corresponds to the sound intensity and the x axis corresponds to time. In one embodiment, the entire visual waveform representation of the sound is simultaneously presented on the tactile stimulation interface 250. In one embodiment, the visual waveform representation of the sound is gradually presented in the x direction on the tactile stimulation interface 250 over time.
[0106] Figure 8 An embodiment of a presentation mode for presenting information in a tactile stimulation interface 250 is depicted. This presentation mode is referred to herein as a "sound-visual waveform representation of a word". The sound-visual waveform representation in spoken language can be expressed as a "sound-visual waveform". In one example, the sound-visual waveform can be described by the relationship between sound intensity and time. For example, different words in English have their own unique sound-visual waveform shapes. Figure 8 2 shows how the visual waveform of the sound is mapped to the tactile stimulation interface 250 using an xy axis. The y axis corresponds to the sound intensity and the x axis corresponds to time. In one embodiment, the entire visual waveform of the sound is simultaneously presented on the tactile stimulation interface 250. In one embodiment, the visual waveform of the sound is gradually presented in the x-axis direction on the tactile stimulation interface 250 over time.
[0107] and Figure 5 and Figure 6 Similar to the example in Figure 7 and Figure 8 Embodiments of the present invention allow the user to select a presentation mode, which allows the user to decide which mode is best for him or her. For example, the tactile stimulation interface 250 can present an entire word (e.g., Figure 8 ), rather than individual letters (such as Figure 7 ), so that the tactile stimulation interface 250 can more effectively present information to the user. For example, an email can be presented to the user in a shorter time. However, in some cases, due to too many words, the user may not be able to interpret the sound and visual waveform representation of the words (such as Figure 8 ). In other words, the user may be able to better interpret the sound-visual waveform representations of the letters of the alphabet. Embodiments may allow the user to select a presentation mode, which may allow the user to decide which mode is best for them. In addition, it should be noted that certain presentation modes that take less time may not only save the user's time, but also extend the battery life in the UE 110 and / or the tactile stimulation device 240.
[0108] Fig. 9 Flow chart of an embodiment of a process 900 for presenting information on a tactile stimulation interface 250. Process 900 may be used to tactilely present information to a user. In other words, process 900 may be used to tactilely communicate information to a user. In one embodiment, the information is any digital data on UE 110. For example, the information may be text content, image content, and / or audio content, but is not limited thereto. In process 900, the information provided by UE 110 to tactile stimulation device 240 is in a precise format to be presented in a pattern of tactile stimulation element 410.
[0109] Step 902 includes UE110 converting digital data into a format that is demonstrated in the pattern of tactile stimulation elements 410 in tactile stimulation device 240. The format depends on the pattern configuration of stimulation elements 410. It may be necessary to convert the digital data into the format to adapt to the pattern configuration of tactile stimulation elements 410. For example, the digital data may be text data, wherein UE110 can determine which tactile stimulation elements 410 should be activated to demonstrate specific characters (text) in tactile stimulation elements 410. In one embodiment, step 902 includes determining a signal for each element in tactile stimulation elements 410. In one embodiment, step 902 includes determining whether each stimulation element 410 should be in an activated state or an inactivated state. Numerous examples of step 902 are discussed herein.
[0110] In one embodiment, UE110 also determines a demonstration mode for the user. The demonstration mode refers to a mode or manner of demonstrating information in the tactile stimulation interface 250. The demonstration mode can be independent of the pattern configuration of the stimulation element 410. In the case where UE110 determines the demonstration mode, UE110 formats the information to respond to the demonstration mode. For example, in one embodiment, UE110 can map a symbolic representation of a letter to a pattern of the stimulation element 410 to respond to the demonstration mode as a first mode, and map a sound visual waveform representation of a letter to a pattern of the stimulation element to respond to the demonstration mode as a second mode.
[0111] Step 904 includes the wireless communication device sending the formatted information to the tactile stimulation device 240. In one embodiment, the information is sent via a wireless communication link.
[0112] Step 906 includes the tactile stimulation device 240 presenting the formatted information in the pattern of the tactile stimulation elements 410. For example, the tactile stimulation device 240 may be as shown in the attached Figure 5-8In one embodiment, after the tactile stimulation device 240 is driven to demonstrate one piece of information, the tactile stimulation device 240 is driven to demonstrate another piece of information in response to user feedback. For example, after demonstrating "A", the system waits for user feedback (such as removing the finger from the tactile stimulation interface 250) before demonstrating the letter "C" on the tactile stimulation interface 250. In one embodiment, after the tactile stimulation device 240 is driven to demonstrate one piece of information, the tactile stimulation device 240 can be driven to demonstrate another piece of information without any explicit feedback from the user. For example, Figure 5 As shown, the tactile stimulation device 240 may be driven to present the letter "A" and then, after a predetermined time, the letter "C" without any feedback from the user.
[0113] Fig.10 1 is a flow chart of an embodiment of a process 1000 for presenting information on a tactile stimulation interface 250. In one embodiment, the information is any digital data on the UE 110. For example, the information can be text content, image content, audio content, but is not limited thereto. In the process 1000, the UE 110 provides the information to the tactile stimulation device 240 in a raw format.
[0114] Step 1002 includes the wireless communication device transmitting digital data to the tactile stimulation device 240. The format of the digital data may vary depending on the implementation. For example, text data may be transmitted by transmitting ASCII characters. Image data may be transmitted in any format, including but not limited to JPEG (Joint Photographic Experts Group), GIF (Graphics Interchange Format), PNG (Portable Network Graphics), TIFF (Tagged Image File Format), BMP (Microsoft Bitmap), etc. Audio data may be transmitted in any format, including but not limited to WAV (Waveform Audio File), AIFF (Audio Interchange File Format), MP3, AAC (Advanced Audio Coding), WMA (Microsoft Audio Format), etc.
[0115] Step 1004 includes the tactile stimulation device 240 converting the information into a format suitable for the pattern of tactile stimulation elements 410. Step 1004 is similar to step 902 of process 900. The format depends on the pattern configuration of the stimulation elements 410. In one embodiment, step 1004 includes determining a signal for each element in the tactile stimulation elements 410. In one embodiment, step 1004 includes determining whether each stimulation element 410 should be in an activated state or an inactivated state.
[0116] In one embodiment, the tactile stimulation device 240 also determines a demonstration mode for the user. In one embodiment, the UE 110 notifies the tactile stimulation device 240 of the demonstration mode. In either case, in one embodiment, the tactile stimulation device 240 can format the information after the known demonstration mode. For example, in one embodiment, the tactile stimulation device 240 can map the symbolic representation of letters to the pattern of the stimulation element 410 in response to the demonstration mode as a first mode, and map the sound visual waveform representation of the letters to the pattern of the stimulation element in response to the demonstration mode as a second mode.
[0117] Step 1006 includes the tactile stimulation device 240 presenting the formatted information in the pattern of tactile stimulation elements 410. Step 1006 is similar to step 906 of process 900.
[0118] Fig.11 11 is a flow chart of an embodiment of a process for presenting information on a tactile stimulation interface 250. The process 1100 can be used to help a user become acclimated to the tactile stimulation interface 250.
[0119] Step 1102 includes customizing a presentation mode for a user of the tactile stimulation interface 250. One technique for customizing a presentation mode for a user is to allow the user to select how the information is formatted. For example, the user can select whether the information is presented in a symbolic format (e.g., letters of the alphabet) or as a visual representation of the sound waveform of the letter or word. Another example is to allow the user to select whether the information is presented in a spatial representation or a temporal representation.
[0120] Step 1104 includes stimulating receptors in the user's skin with the tactile stimulation interface 250 to present information according to the presentation mode.
[0121] Fig.12 and 13 Further details are provided according to an embodiment of customizing a presentation mode for a user. Fig.12 A technique is described that allows a user to select a presentation mode by specifying the presentation mode. Fig.13 A technique is described that allows a user to select a presentation mode by specifying the complexity of the presentation mode.
[0122] See now Fig.12, is a flow chart of a process 1200 that allows a user to select a presentation mode. Step 1202 includes providing an interface for a user to select a presentation mode for presenting information in a tactile stimulation device 240. The presentation mode can be used to present all content to the user on the tactile stimulation interface 250, or it can be used to present a portion of the content. In one embodiment, the user interface is presented in a display screen of a UE 110 (such as a wireless communication device, a cellular phone, etc.). The interface allows the user to select presentation modes such as symbolic representations of letters, symbolic representations of words, sound-visual waveform representations of letters, sound-visual waveform representations of words, spatial representations of images, and / or temporal representations of images. These presentation modes are not necessarily mutually exclusive. For example, a user can select a spatial mode or a temporal mode with another of these modes. In one embodiment, the user is asked to select a presentation mode from a set of presentation modes. The set of presentation modes does not necessarily include all possible presentation modes. For example, the set of presentation modes may not include spatial and temporal modes. In one embodiment, the interface allows the user to select different presentation modes according to different types of content. For example, the user can select different presentation modes for email and browsing the Internet. For another example, users can select different presentation modes for email and voice mail.
[0123] Step 1204 includes receiving a selection in the interface. In one embodiment, the selection specifies at least one presentation mode.
[0124] Step 1206 includes setting a demonstration mode in response to a user selection. As noted above, the demonstration mode can be used to demonstrate all content to the user on the tactile stimulation interface 250, or it can be used to demonstrate a portion of the content.
[0125] See now Fig.13 , a flowchart of an embodiment of a process 1300 for selecting the complexity of a presentation mode for a user. Step 1302 includes providing an interface for a user to select a complexity level of a presentation mode for presenting information in a tactile stimulation device 240. The presentation mode can be used to present all content to a user in a tactile stimulation interface 250, or it can be used to present a portion of the content. In one embodiment, the user interface is presented in a screen of a wireless communication device (such as a cellular phone). In one embodiment, the interface allows a user to select a complexity based on a numerical range. For example, a user can be allowed to select a value between a range (such as 1 to 10). In one embodiment, the user interface has a bar (or other element) that can be moved (such as slid) by a user to select the complexity of the presentation mode. The user interface does not necessarily specify a presentation mode.
[0126] Step 1304 includes receiving a selection in the interface. In one embodiment, the selection specifies a value without specifically specifying a demonstration mode. In one embodiment, the selection is specified with terms such as "novice", "intermediate" and "advanced".
[0127] Step 1306 includes setting the presentation mode in response to the user selection. This may include determining the presentation mode of the selection received in step 1304.
[0128] Fig.14 Flowchart of an embodiment of a process 1400 for demonstrating information in different demonstration modes for a tactile stimulation interface 250. Step 1402 includes receiving a demonstration mode selected by a user. In one embodiment, UE 110 shows an interface for the user to select a demonstration mode. In one embodiment, the user selects between the following demonstration modes: binary, symbol, and waveform. Here, the binary demonstration mode refers to one of two states demonstrated by the elements 410 in the tactile stimulation interface 250. In one embodiment, all elements 410 are activated in the first state and inactivated in the second state. However, it is not necessary for all elements 410 to be activated in the first state, because even less than a portion of all elements 410 can also be used to indicate the first state. The symbol representation mode may include, but is not limited to, symbol representations of letters, symbol representations of words, and symbol representations of text for language writing. The waveform demonstration mode may include, but is not limited to, sound-visual waveform representations of letters and sound-visual waveform representations of words.
[0129] Step 1404 includes selecting a presentation mode based on a user selection. In one embodiment, step 1404 is performed by UE 110 . Fig.14 It is shown that one of three paths is taken depending on the presentation mode. In response to the presentation mode being a binary presentation mode, step 1406 is performed. In step 1406, a binary indication is presented in the pattern of the stimulation element 410. As described above, the process includes using the element 410 to indicate a first state or a second state.
[0130] In response to the presentation mode being the symbol presentation mode, steps 1408 and 1410 are performed. Steps 1408-1410 describe presenting information in symbolic form. The information may be letters, words consisting of two or more letters, text written in a language, etc. Step 1408 includes mapping the symbols for the information to the pattern of the stimulation element 410. See Figure 5 , one example is mapping the letter "A" to the stimulation element 410. Figure 6, an example is mapping a heart symbol to the stimulation element 410 to represent the word "love". In one embodiment, step 1408 includes accessing a predetermined mapping from words, such as for language writing, to patterns of the stimulation element 410. Step 1410 includes presenting the symbol in the pattern of the stimulation element 410. In one embodiment, step 1408 is performed by the UE 110, and step 1410 is performed by the tactile stimulation device 240. In one embodiment, both steps 1408 and 1410 are performed by the tactile stimulation device 240.
[0131] In response to the presentation mode being the waveform presentation mode, steps 1412 and 1414 are performed. Steps 1412-1414 describe presenting information in the waveform presentation mode. The information may be the sound of letters, the sound of words in any language, but is not limited thereto. Step 1412 includes mapping the waveform representation of the sound to the pattern of the stimulation element 410. See Figure 7 , an example is mapping the sound-visual waveform representation of the letter "A" to the stimulus element 410. Figure 8 , an example is mapping the sound-visual waveform representation of the word "love" to the stimulation element 410. In one embodiment, step 1412 includes accessing a predetermined mapping. For example, there may be a predetermined mapping of the sound-visual waveform representation of each letter of the alphabet to the stimulation element 410. In one embodiment, step 1412 includes mapping from the audio clip to the stimulation element 410. Step 1414 includes demonstrating the visual waveform representation in a pattern of the stimulation element 410. In one embodiment, step 1412 is performed by UE 110, and step 1414 is performed by the tactile stimulation device 240. In one embodiment, both steps 1412 and 1414 are performed by the tactile stimulation device 240.
[0132] Fig.15 Flowchart of an embodiment of a process 1500 for presenting information in different presentation modes for a tactile stimulation device 240. Step 1502 includes receiving a user-selected level of complexity for a presentation mode. In one embodiment, the UE 110 displays an interface for the user to select the level of complexity for the presentation mode. In one embodiment, the user selects between the following presentation mode complexities: novice, intermediate, advanced. Other options may be selected, for example: low, medium, high. The selection may be on a sliding value, such as a number between 1 and 10.
[0133] Step 1504 includes selecting a presentation mode based on a user selection. In one embodiment, step 1504 is performed by UE 110. As in process 1400, an example is that the presentation mode is binary. In this case, binary may be the lowest complexity, symbol may be medium complexity, and waveform may be the highest complexity. However, this is only an example.
[0134] Fig.15 It is shown that one of three paths is taken depending on the presentation mode. In response to the user selecting the low (or novice) mode, the information is presented in the presentation mode of the lowest complexity in step 1506. In response to the user selecting the medium (or intermediate) mode, the information is presented in the presentation mode of medium complexity in step 1508. In response to the user selecting the high (or advanced) mode, the information is presented in the presentation mode of the highest complexity in step 1510.
[0135] In one embodiment of the process 1500, the UE 110 selects a presentation mode, formats the data so that it is suitable for presentation on the pattern of stimulation elements 410, and sends the formatted data to the tactile stimulation device 240. In one embodiment of the process 1500, the UE 110 selects a presentation mode, notifies the tactile stimulation device 240 of the presentation mode, sends the raw data to the tactile stimulation device 240, and the tactile stimulation device 240 formats the raw data for proper presentation on the pattern of stimulation elements 410.
[0136] Fig.16 Flow diagram of an embodiment of a process 1600 for presenting information in different presentation modes for the tactile stimulation interface 250 . Fig.16 is an embodiment of process 1500. Step 1602 includes receiving a user-selected level of complexity for a demonstration mode. In one embodiment, UE 110 displays an interface for the user to select the level of complexity for the demonstration mode. In one embodiment, the user selects between the following levels of complexity for the demonstration mode: novice, intermediate, advanced. Other options may be selected, for example: low, medium, high. The selection may be on a sliding scale, such as a number between 1 and 10.
[0137] Step 1604 includes selecting a presentation mode based on a user selection. In one embodiment, step 1604 is performed by UE 110. In this embodiment, the presentation modes are binary, symbol, and waveform. In this embodiment, binary may be the lowest complexity, symbol may be the medium complexity, and waveform may be the highest complexity. Fig.16 It is shown that one of three paths is taken according to the demonstration mode. In response to the user selecting the low (or novice) mode, the information is demonstrated in the binary demonstration mode in step 1606. Step 1606 may be similar to step 1406 and therefore will not be described in detail. In response to the user selecting the medium (or intermediate) mode, the information is demonstrated in the symbolic demonstration mode in steps 1608-1610. Steps 1608-1610 may be similar to steps 1408-1410 and therefore will not be described in detail. In response to the user selecting the high (or advanced) mode, the information is demonstrated in the waveform demonstration mode in steps 1612-1614. Steps 1612-1614 may be similar to steps 1412-1414 and therefore will not be described in detail.
[0138] Fig.17 Flowchart of an embodiment of a process 1700 for presenting information in different presentation modes for a tactile stimulation interface 250. Step 1702 includes receiving a presentation mode selected by a user. In one embodiment, UE 110 displays an interface for the user to select a presentation mode. In one embodiment, the user selects between the following presentation modes: symbol, letter waveform, and word waveform. The symbol representation mode may include, but is not limited to, symbol representation of letters, symbol representation of words, and symbol representation of text for language writing. The letter waveform presentation mode includes an audio-visual waveform representation of letters. The word waveform presentation mode includes an audio-visual waveform representation of words.
[0139] Step 1704 includes selecting a presentation mode based on a user selection. In one embodiment, step 1704 is performed by UE 110 . Fig.17 It is shown that one of three paths is taken depending on the presentation mode. In response to the presentation mode being the symbol presentation mode, steps 1706 and 1708 are performed. Steps 1706-1708 describe presenting information in symbolic form. The information may be letters, words consisting of two or more letters, or text for language writing. Step 1760 includes mapping the information symbols onto the stimulation element pattern. See Figure 5 , one example is mapping the letter "A" to the stimulation element 410. Figure 6 , an example is mapping a heart symbol to the stimulation element 410 to represent the word "love". In one embodiment, step 1706 includes accessing a predetermined mapping from words used for language writing to patterns of the stimulation element 410. Step 1708 includes presenting the symbol with the pattern of the stimulation element 410. In one embodiment, step 1706 is performed by the UE 110, and step 1708 is performed by the tactile stimulation device 240. In one embodiment, both steps 1706 and 1708 are performed by the tactile stimulation device 240.
[0140] In response to the presentation mode being the letter waveform presentation mode, steps 1710 and 1712 are performed. Steps 1712-1714 describe the sound waveform of the letter presented in the pattern of the stimulation element 410. Step 1710 includes mapping the waveform representation of the sound to the pattern of the stimulation element 410. Figure 7, an example is mapping the sound-visual waveform representation of the letter "A" to the stimulation element 410. In one embodiment, step 1710 includes accessing a predetermined mapping. For example, the sound-visual waveform representation of each letter in the alphabet has a predetermined mapping to the stimulation element 410. The mapping process can start with a text representation of the letter, and use the predetermined mapping of the sound-visual waveform representation of the letter to determine how to activate the stimulation element 410. This is an example of converting text into a non-text image representing the text. In one embodiment, step 1710 includes mapping from an audio clip to a stimulation element 410. When mapping an audio clip to a stimulation element 410, it is not necessarily necessary to have a predetermined mapping of the sound-visual waveform representation of each letter in the alphabet to the stimulation element 410. Step 1712 includes demonstrating the visual waveform representation with a pattern of the stimulation element 410. In one embodiment, step 1710 is performed by UE110, and step 1712 is performed by the tactile stimulation device 240. In one embodiment, both steps 1710 and 1712 are performed by the tactile stimulation device 240.
[0141] In response to the presentation mode being the word waveform presentation mode, steps 1714 and 1716 are performed. Steps 1714-1716 describe presenting the sound waveform of the word in the pattern of the stimulation element 410. Step 1714 includes mapping the sound waveform representation of the word to the pattern of the stimulation element 410. See Figure 8 , an example is mapping the sound-visual waveform representation of the word "love" to the stimulation element 410. In one embodiment, step 1714 includes accessing a predetermined mapping. For example, the visual waveform representation of the word has a predetermined mapping to the stimulation element 410. In one embodiment, step 1714 includes mapping from the audio clip to the stimulation element 410. Step 1716 includes demonstrating the sound-visual waveform representation of the word in a pattern of the stimulation element 410. In one embodiment, step 1714 is performed by UE 110, and step 1716 is performed by the tactile stimulation device 240. In one embodiment, both steps 1714 and 1716 are performed by the tactile stimulation device 240.
[0142] Note that in terms of presenting information to users, Fig.17 Some presentation modes may be more effective than others. In some cases, a visual waveform representation of a word may be more effective than a visual waveform representation of a letter. This may not only allow the user to select a presentation mode to save the user's time, but also allow the user to select a presentation mode to save power and extend the battery life of the tactile stimulation device 240 and / or the UE 110.
[0143] Fig.18Flowchart of an embodiment of a process 1800 for presenting information in different presentation modes for a tactile stimulation interface 250. Step 1802 includes receiving a presentation mode selected by a user. In one embodiment, the UE 110 displays an interface for the user to select a presentation mode. In one embodiment, the user selects between the following presentation modes: low complexity, medium complexity, and high complexity.
[0144] Step 1804 includes selecting a presentation mode based on a user selection. In one embodiment, step 1804 is performed by UE 110 . Fig.18 It is shown that one of three paths is taken depending on the presentation mode. In response to the user selecting low complexity, steps 1806-1808 are performed. Steps 1806-1808 describe presenting information in symbolic form. The information can be letters, words made up of two or more letters, or words used in language writing. Step 1806 includes mapping the symbols of the information to patterns of the stimulation elements 410. See Figure 5 , one example is mapping the letter "A" to the stimulation element 410. Figure 6 , an example is mapping a heart symbol to the stimulation element 410 to represent the word "love". In one embodiment, step 1806 includes accessing a predetermined mapping from words used for language writing to patterns of the stimulation element 410. Step 1808 includes presenting the symbol with the pattern of the stimulation element 410. In one embodiment, step 1806 is performed by the UE 110, and step 1808 is performed by the tactile stimulation device 240. In one embodiment, both steps 1806 and 1808 are performed by the tactile stimulation device 240.
[0145] In response to the user selecting the medium complexity presentation mode, steps 1810 and 1812 are performed. Steps 1812-1814 describe the presentation of the sound waveform of the letter in the pattern of the stimulation element 410. Step 1810 includes mapping the waveform representation of the sound to the pattern of the stimulation element 410. Figure 7 , an example is mapping the sound-visual waveform representation of the letter "A" to the stimulation element 410. In one embodiment, step 1810 includes accessing a predetermined mapping. For example, there may be a predetermined mapping of the sound-visual waveform representation of each letter of the alphabet to the stimulation element 410. In one embodiment, step 1810 includes mapping from the audio clip to the stimulation element 410. Step 1812 includes presenting the visual waveform representation in a pattern of the stimulation element 410. In one embodiment, step 1810 is performed by UE 110, and step 1812 is performed by the tactile stimulation device 240. In one embodiment, both steps 1810 and 1812 are performed by the tactile stimulation device 240.
[0146] In response to the user selecting the high complexity presentation mode, steps 1814 and 1816 are performed. Steps 1814-1816 describe presenting the sound waveform of the word in the pattern of the stimulation element 410. Step 1814 includes mapping the sound waveform representation of the word to the pattern of the stimulation element 410. See Figure 8 , an example is mapping the sound-visual waveform representation of the word "love" to the stimulation element 410. In one embodiment, step 1814 includes accessing a predetermined mapping. For example, the visual waveform representation of the word has a predetermined mapping to the stimulation element 410. In one embodiment, step 1814 includes mapping from the audio clip to the stimulation element 410. Step 1816 includes demonstrating the sound-visual waveform representation of the word in a pattern of the stimulation element 410. In one embodiment, step 1814 is performed by UE 110, and step 1816 is performed by the tactile stimulation device 240. In one embodiment, both steps 1814 and 1816 are performed by the tactile stimulation device 240.
[0147] Note that when presenting information to users, Fig.17 Some presentation modes may be more effective than others. In some cases, a visual waveform representation of a word may be more effective than a visual waveform representation of a letter. This may not only allow the user to select a presentation mode to save the user's time, but also allow the user to select a presentation mode to save power and extend the battery life of the tactile stimulation device 240 and / or the UE 110.
[0148] Fig.19 Another embodiment of a presentation mode for presenting information on the tactile stimulation interface 250 is shown. Fig.19 Depicts a demonstration mode referred to as a spatial demonstration mode in this embodiment. In this example, image 1902 represents an electrocardiogram of a common heartbeat waveform. As is well known, a heartbeat waveform includes a P wave, a QRS wave, and a T wave. In one embodiment, image 1902 includes digital data. Image 1902 can have any type of format, including but not limited to JPEG, GIF, PNG, TIFF, BMP, etc.
[0149] In one embodiment, the image 1902 is mapped to the stimulation element 410. The mapping need not be accurate to scale. Fig.19 In the example of FIG. 1 , the Q wave is roughly mapped to the second column (from the left) of the stimulation elements 410, the QRS complex is roughly mapped to the third to fifth columns, and the T wave is roughly mapped to the sixth column. In the "spatial presentation mode", the entire image 1902 is simultaneously presented in the pattern of stimulation elements 410. In other words, all activated (indicated in black) stimulation elements are activated at the same time.
[0150] In the "temporal presentation mode", only one selected area of the stimulation element 410 is used at a time. For example, only one column of the pattern of the stimulation element 410 is used to present the image 1902 at a time. Figures 20A-20F An example of a time presentation mode is shown. Fig.19 The image 1902 is presented in the time presentation mode. FIG. 20A to FIG. 20F , each of which shows the pattern of the stimulation element 410 at a different point in time. In this example, only one column of the pattern of the stimulation element 410 is used at a time.
[0151] Fig.21 Flow chart of an embodiment of a process 2100 for presenting information in a temporal presentation mode for a tactile stimulation interface 250. Step 2102 includes accessing information to be presented on the stimulation interface 250. The information may be analog data or digital data. The information may include text data, visual data, and / or audio data. Fig.19 Image 1902 in will be used as an example of the information to be demonstrated.
[0152] Step 2104 includes determining what content to present in each area of the stimulation interface 250. Fig.19 , step 2104 may include determining how to map the image 1902 to the stimulation interface 250 .
[0153] Step 2106 includes selecting an area of the stimulation interface 250. In one embodiment, a column is selected. However, the area is not required to be a column. In one embodiment, the area is a row of the stimulation interface 410.
[0154] Step 2108 includes presenting a portion of image 1902 in the selected area. Fig. 20A , a portion of the image 1902 is presented on the stimulation interface 250 .
[0155] Step 2110 determines whether there are more regions of the stimulation interface 250 that have not yet been presented with a partial image. If so, control passes to step 2106 to select another region of the stimulation interface 250. In some embodiments, the region is adjacent to the previous region. For example, adjacent columns (or rows). In this example, the process proceeds in Figures 20A to 20F Shown in.
[0156] Fig. 22 A flow chart of an embodiment of a process 2200 of presenting information in a spatial presentation mode or a temporal presentation mode by the stimulation interface 250 is shown. This is an embodiment of customizing the presentation mode for the user. Step 2202 includes receiving a user selection. In one embodiment, the UE 110 presents an interface for the user to select between the spatial presentation mode and the temporal presentation mode.
[0157] Step 2204 includes selecting a presentation mode based on a user selection. In one embodiment, step 2204 is performed by UE 110 . Fig. 22 It is shown that one of three paths is taken depending on the presentation mode. In response to the user selecting the spatial mode, the information is presented in the spatial presentation mode in steps 2206-2208. Step 2206 includes mapping the image to the columns in the pattern of stimulation elements 410. Step 2208 includes presenting the image spatially in the stimulation interface 250. The description of the example of steps 2206-2208 corresponds to Fig.19 .
[0158] In response to the user selecting the time mode, information is presented in the time presentation mode in steps 2210-2212. Step 2210 includes mapping the image to the columns in the pattern of the stimulation element 410. Step 2212 includes temporally presenting the image in the stimulation interface 250. The description of the example of steps 2210-2212 corresponds to Figures 20A-20F and Fig.21 .
[0159] One technical problem to be overcome for a tactile stimulation device is to provide an appearance that can effectively stimulate the user's senses and is very convenient to use. The tactile stimulation device 240 can have a variety of appearances. Figure 23-25 The components of the tactile stimulation device 240 are not completely shown in the figure. Figure 23-25 , to better focus on the appearance. Fig.23 An embodiment in which the tactile stimulation device 240 has a ring-shaped shape is shown. In one embodiment, the tactile stimulation device 240 has a ring member 2302, which is used to be worn on a person's finger. The ring member 2302 is physically attached to the stimulation interface 250. The stimulation element 410 is exposed on the upper surface of the stimulation interface 250 so that the user can place a finger (different from the finger surrounded by the ring member 2302) on the upper surface of the stimulation interface 250, wherein the stimulation element 410 can stimulate receptors in the user's skin.
[0160] The surface of the stimulation interface 250 can have a variety of shapes. In one embodiment, the surface of the stimulation interface 250 is substantially flat. Fig.23 An embodiment is shown in which the surface of the stimulation interface 250 is substantially flat. Thus, in an embodiment, the pattern of stimulation elements 410 is located in a substantially flat surface.
[0161] In one embodiment, the pattern of stimulation elements 410 is located in a curved surface. Fig.24An embodiment is shown in which the stimulation element pattern 410 is located on a curved surface. Additionally, in this embodiment, the stimulation elements 410 are located on the outer annular surface 2312 of the annular member. Thus, the pattern of stimulation elements 410 is used to stimulate receptors in the skin via the outer annular surface 2312. The inner annular surface 2314 is also depicted.
[0162] Fig.25 Another embodiment is shown in which the pattern of stimulation elements 410 is located on a curved surface. In this embodiment, the stimulation elements 410 are located on the inner annular surface 2314 of the ring member. Thus, the pattern of stimulation elements 410 is used to stimulate receptors in the skin via the inner annular surface 2314. Thus, the stimulation elements 410 can stimulate receptors in the finger on which the ring member 2302 is worn.
[0163] Such as Fig.23 , 24 or Fig.25 The ring shape in the solves the technical problem of how to effectively interact with the user's senses. Fig.23 , 24 or Fig.25 The ring shape in the device not only solves the technical problem of how to effectively interact with the user's senses, but also facilitates use. This ring shape is not cumbersome, but very convenient for users to wear. Although the ring shape has limited surface contact with the user's skin, information can be effectively transmitted to the user due to the sensitivity of the user's finger skin receptors.
[0164] The tactile stimulation device 240 can have a variety of other shapes. In one embodiment, the tactile stimulation device 240 includes a component for surrounding a person's wrist. In addition, the tactile stimulation interface 250 can be configured to be adjacent to a person's wrist. Therefore, the stimulation element 410 can stimulate the receptors of the wrist of the person wearing the tactile stimulation device 240. Fig.25 The illustrated form factor may be configured to wrap around a person's wrist.
[0165] In one embodiment, the tactile stimulation device 240 includes a component for wrapping around a person's neck. In addition, the tactile stimulation interface 250 can be configured to be adjacent to a person's neck. Therefore, the stimulation element 410 can stimulate receptors on the user's neck.
[0166] In one embodiment, the tactile stimulation device 240 is configured to be worn as a headband. In addition, the tactile stimulation interface 250 can be configured to be adjacent to the skin of the forehead. Therefore, the stimulation element 410 can stimulate the receptors of the user's forehead.
[0167] In one embodiment, the tactile stimulation device 240 is configured to wrap around the user's forearm. Therefore, the tactile stimulation interface 250 can be configured to be adjacent to the forearm. Therefore, the stimulation element 410 can stimulate the receptors of the user's forearm.
[0168] In the "temporal presentation mode," only a selected area of the stimulation element 410 is used at a time. For example, only one column of the pattern of stimulation elements 410 is used to present the image 1902 at a time. Figures 20A-20F An example of a time presentation mode is shown. Fig.19 The image 1902 is presented in the time presentation mode. FIG. 20A to FIG. 20F , each of which shows a pattern of stimulation elements 410 at a different point in time. In this example, only one column of the pattern of stimulation elements 410 is used at a time.
[0169] Fig.21 Flow chart of an embodiment of a process 2100 for presenting information in a temporal presentation mode for a tactile stimulation interface 250. Step 2102 includes accessing information to be presented on the stimulation interface 250. The information may be analog data or digital data. The information may include text data, visual data, and / or audio data. Fig.19 The image 1902 in will be used as an example to demonstrate the information.
[0170] Step 2104 includes determining what content to present in each area of the stimulation interface 250. Fig.19 , step 2104 may include determining how to map the image 1902 to the stimulation interface 250 .
[0171] Step 2106 includes selecting an area of the stimulation interface 250. In one embodiment, a column is selected. However, the area is not required to be a column. In one embodiment, the area is a row of the stimulation interface 410.
[0172] Step 2108 includes presenting a portion of image 1902 in the selected area. Fig. 20A , a portion of the image 1902 is presented on the stimulation interface 250 .
[0173] Step 2110 determines whether there are more regions of the stimulation interface 250 that have not yet been presented with a partial image. If so, control passes to step 2106 to select another region of the stimulation interface 250. In some embodiments, the region is adjacent to the previous region. For example, adjacent columns (or rows). In this example, the process proceeds in Figures 20A to 20F Shown in.
[0174] Fig. 22 A flow chart of an embodiment of a process 2200 of presenting information in a spatial presentation mode or a temporal presentation mode by a tactile stimulation interface 250 is shown. This is an embodiment of customizing a presentation mode for a user. Step 2202 includes receiving a user selection. In one embodiment, UE 110 presents an interface for a user to select between a spatial presentation mode and a temporal presentation mode.
[0175] Step 2204 includes selecting a presentation mode based on a user selection. In one embodiment, step 2204 is performed by UE 110 . Fig. 22 It is shown that one of three paths is taken depending on the presentation mode. In response to the user selecting the spatial mode, the information is presented in the spatial presentation mode in steps 2206-2208. Step 2206 includes mapping the image to the columns in the pattern of stimulation elements 410. Step 2208 includes presenting the image spatially in the stimulation interface 250. The description of the example of steps 2206-2208 corresponds to Fig.19 .
[0176] In response to the user selecting the time mode, information is presented in the time presentation mode in steps 2210-2212. Step 2210 includes mapping the image to the columns in the pattern of the stimulation element 410. Step 2212 includes presenting the image in time in the stimulation interface 250. The description of the example of steps 2210-2212 corresponds to Figures 20A-20F and Fig.21 .
[0177] One technical problem to be overcome for a tactile stimulation device is to provide an appearance that can effectively stimulate the user's senses and is very convenient to use. The tactile stimulation device 240 can have a variety of appearances. Figure 23-25 The components of the tactile stimulation device 240 are not completely shown in the figure. Figure 23-25 , to better focus on the appearance. Fig.23 An embodiment in which the tactile stimulation device 240 has a ring-shaped shape is shown. In one embodiment, the tactile stimulation device 240 has a ring-shaped member 2302, which is used to be worn on a person's finger. The ring-shaped member 2302 is physically attached to the stimulation interface 250. The stimulation element 410 is exposed on the upper surface of the stimulation interface 250, so that the user can place a finger (different from the finger surrounded by the ring-shaped member 2302) on the upper surface of the stimulation interface 250, wherein the stimulation element 410 can stimulate receptors in the user's skin.
[0178] The surface of the stimulation interface 250 can have a variety of shapes. In one embodiment, the surface of the stimulation interface 250 is substantially flat. Fig.23 An embodiment is shown in which the surface of the stimulation interface 250 is substantially flat. Thus, in an embodiment, the pattern of stimulation elements 410 is located in a substantially flat surface.
[0179] In one embodiment, the pattern of stimulation elements 410 is located in a curved surface. Fig.24An embodiment is shown in which the stimulation element pattern 410 is located on a curved surface. Additionally, in this embodiment, the stimulation elements 410 are located on the outer circumferential surface 2312 of the annular member. Thus, the pattern of stimulation elements 410 is used to stimulate receptors in the skin via the outer circumferential surface 2312. The inner circumferential surface 2314 is also depicted.
[0180] Fig.25 Another embodiment is shown in which the pattern of stimulation elements 410 is located on a curved surface. In this embodiment, the stimulation elements 410 are located on the inner ring surface 2314 of the ring member. Thus, the pattern of stimulation elements 410 is used to stimulate receptors in the skin via the inner ring surface 2314. Thus, the stimulation elements 410 can stimulate receptors in the finger wearing the ring member 2302.
[0181] Such as Fig.23 , 24 or Fig.25 The ring shape in the solves the technical problem of how to effectively interact with the user's senses. Fig.23 , 24 or Fig.25 The ring shape in the device not only solves the technical problem of how to effectively interact with the user's senses, but also facilitates use. This ring shape is not cumbersome, but very convenient for users to wear. Although the ring shape has limited surface contact with the user's skin, information can be effectively transmitted to the user due to the sensitivity of the user's finger skin receptors.
[0182] The tactile stimulation device 240 can have a variety of other shapes. In one embodiment, the tactile stimulation device 240 includes a component for surrounding a person's wrist. In addition, the tactile stimulation interface 250 can be configured to be adjacent to a person's wrist. Therefore, the stimulation element 410 can stimulate the receptors of the wrist of the person wearing the tactile stimulation device 240. Fig.25 The illustrated form factor may be configured to wrap around a person's wrist.
[0183] In one embodiment, the tactile stimulation device 240 includes a component for wrapping around a person's neck. In addition, the tactile stimulation interface 250 can be configured to be adjacent to the skin of a person's neck. Therefore, the stimulation element 410 can stimulate receptors on the user's neck.
[0184] In one embodiment, the tactile stimulation device 240 is configured to be worn as a headband. In addition, the tactile stimulation interface 250 can be configured to be adjacent to the skin of the forehead. Therefore, the stimulation element 410 can stimulate the receptors of the user's forehead.
[0185] In one embodiment, the tactile stimulation device 240 is configured to wrap around the user's forearm. Therefore, the tactile stimulation interface 250 can be configured to be adjacent to the forearm. Therefore, the stimulation element 410 can stimulate the receptors of the user's forearm.
[0186] Stimulation element 410 can stimulate other parts of the body except fingers, wrists, forearms, forehead and neck. In general, stimulation element 410 can stimulate receptors in the skin on any part of the body.
[0187] In one embodiment, the user uses two or more tactile stimulation interfaces 250 at the same time. For example, if the tactile stimulation device 240 has a ring-shaped shape, the user can wear two or more ring-shaped devices. Therefore, the tactile stimulation interface 250 can be used to stimulate receptors in different fingers of the user respectively. In one embodiment, different information is sent to different tactile stimulation interfaces 250 so that the user receives different sensations from each tactile stimulation interface 250. For example, different fingers of the user can receive different information from UE110. In one embodiment, different demonstration modes can be used for different tactile stimulation interfaces 250. For example, a spatial demonstration mode can be used in the first tactile stimulation interface 250, and a time demonstration mode can be used in the second tactile stimulation interface 250.
[0188] The technology described herein can be implemented using hardware, software, or a combination of hardware and software. The software used is stored on one or more processor-readable storage devices described above to program one or more processors to perform the functions described herein. The processor-readable storage device may include computer-readable media, such as volatile and non-volatile media, removable and non-removable media. As an example and not limitation, the computer-readable medium may include computer-readable storage media and communication media. The computer-readable storage medium may be implemented by any method or technology to store information such as computer-readable instructions, data structures, program modules, or other data. Computer-readable storage media are examples of non-temporary computer-readable media. Examples of computer-readable storage media include RAM, ROM, EEPROM, flash memory or other storage technology, CD-ROM, digital versatile disk (DVD) or other optical disk storage, cassette, tape, disk storage or other magnetic storage device, or any other medium that can be used to store the required information and can be accessed by a computer. Computer-readable media do not include propagation, modulation, or transient signals.
[0189] Communication media typically embodies computer readable instructions, data structures, program modules or other data in a propagated, modulated or transient data signal such as a carrier wave or other transport mechanism, and includes any information delivery media. The term "modulated data signal" refers to a signal that has one or more of its characteristics set or changed in a manner that encodes information as a signal. By way of example and not limitation, communication media include wired media such as a wired network or direct wired connection, and wireless media such as RF and other wireless media. Any combination of the above is also included within the scope of computer readable media.
[0190] In alternative embodiments, some or all of the software may be replaced by dedicated hardware control circuit components. Hardware control circuit elements used to implement controller 270 may include, but are not limited to, field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chips (SOCs), complex programmable control circuit devices (CPLDs), special purpose computers, etc. In one embodiment, controller 270 is implemented using software (stored on a storage device) that programs one or more processors. One or more processors may communicate with one or more computer-readable media / storage devices, peripheral devices, and / or communication interfaces.
[0191] It should be understood that this theme can be embodied in many different forms, and its interpretation should not be limited to the embodiments described herein. Specifically, these embodiments are provided to make this theme sufficient and comprehensive, and fully convey this disclosure to those skilled in the art. In fact, this theme is intended to cover all modifications, equivalents and alternatives within the spirit and scope of this theme as defined by the appended claims. In addition, in the detailed description of this theme below, many specific details are set forth in order to thoroughly understand this theme. However, it should be understood by those of ordinary skill in the art that this theme can be implemented without these specific details.
[0192] Various aspects of the present disclosure are described herein according to the flowcharts and / or block diagrams of the methods, devices (systems) and computer program products of the embodiments of the present disclosure. It should be understood that each frame of the flowchart illustration and / or block diagram and the combination of frames in the flowchart illustration and / or block diagram can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer or other programmable data processing device to generate a machine, so that the instructions executed by the processor of the computer or other programmable instruction execution device create a mechanism to implement the functions / actions specified in the flowchart and / or block diagram.
[0193] The description of the present disclosure is intended to illustrate and describe, and is not intended to be exhaustive or to limit the present disclosure to the disclosed form. Various modifications and variations should be apparent to those of ordinary skill in the art without departing from the scope and spirit of the present disclosure. The various aspects of the present disclosure selected and described herein are intended to best explain the principles and practical applications of the present disclosure and to enable other persons of ordinary skill in the art to understand the present disclosure and make various modifications to suit the intended specific use.
[0194] For the purposes of this document, each process associated with the disclosed technology can be performed continuously and by one or more computing devices. Each step in the process can be performed by the same or different computing devices used in other steps, and each step does not necessarily have to be performed by a single computing device.
[0195] Although the invention has been described in language specific to structural features and / or acts, it is to be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or acts described above. Rather, the specific features and acts described above are disclosed as example forms of implementing the claims.
Claims
1. A tactile stimulation system, characterized in that: include: a tactile stimulation interface comprising a pattern of stimulation elements for stimulating receptors in the user's skin; as well as A control circuit, used for demonstrating information on the tactile stimulation interface according to a demonstration mode customized for a user, wherein the demonstration mode includes: a binary demonstration mode, a symbol demonstration mode and a waveform demonstration mode; A user interface for receiving a user's selection of the complexity of the demonstration information in the tactile stimulation system; Wherein, the control circuit is further used to select the demonstration mode based on the complexity.
2. The tactile stimulation system according to claim 1, characterized in that: in, The control circuit is also used for: The presentation mode is customized based on user input.
3. The tactile stimulation system according to claim 1 or 2, characterized in that: in, Demonstrating the information on the tactile stimulation interface according to the demonstration mode, the control circuit is further used for: mapping a symbolic representation of a letter to the stimulation element pattern in response to the presentation mode being a first mode; as well as A symbolic representation of a word is mapped to the stimulation element pattern in response to the presentation mode being a second mode.
4. The tactile stimulation system according to claim 1 or 2, characterized in that: in, Demonstrating the information on the tactile stimulation interface according to the demonstration mode, the control circuit is further used for: mapping the sound-visual waveform representation of the letter to the stimulus element pattern in response to the presentation mode being a first mode; as well as The sound-visual waveform representation of the word is mapped to the stimulation element pattern in response to the presentation mode being a second mode.
5. The tactile stimulation system according to claim 1 or 2, characterized in that: in, Demonstrating the information on the tactile stimulation interface according to the demonstration mode, the control circuit is further used for: mapping the symbolic representation of the digital information to the stimulation element pattern in response to the presentation mode being a first mode; as well as The sound-visual waveform representation of the digital information is mapped to the stimulation element pattern in response to the presentation mode being a second mode.
6. The tactile stimulation system according to claim 1 or 2, characterized in that: in, Demonstrating the information on the tactile stimulation interface according to the demonstration mode, the control circuit is further used for: mapping a symbolic representation of a word used in language writing to the stimulation element pattern in response to the presentation mode being a first mode; as well as The sound-visual waveform representation of the written language is mapped to the stimulation element pattern in response to the pattern being a second pattern.
7. The tactile stimulation system according to claim 1 or 2, characterized in that: in, Demonstrating the information on the tactile stimulation interface according to the demonstration mode, the control circuit is further used for: spatially mapping an image onto the stimulation element pattern in response to the presentation mode being a first mode; as well as An image is mapped to the stimulation element pattern in time in response to the presentation mode being a second mode.
8. The tactile stimulation system according to claim 1 or 2, characterized in that: in, The control circuit is also used for: The complexity of information presented in the tactile stimulation system is increased in response to the user adapting to the tactile stimulation system.
9. The tactile stimulation system according to claim 1 or 2, characterized in that: Also includes: A wireless communication interface for receiving information to be presented at the tactile stimulation system, wherein the control circuit is further configured to map digital data received at the wireless communication interface to the stimulation element pattern so as to present the information on the tactile stimulation interface.
10. The tactile stimulation system according to claim 9, characterized in that: Also includes: A wireless communication device, wherein the wireless communication device is configured to provide the digital data to the wireless communication interface.
11. The tactile stimulation system according to claim 1 or 2, characterized in that: Also included is a ring-shaped component for being worn on a person's finger, the ring-shaped component having an inner ring surface and an outer ring surface.
12. The tactile stimulation system according to claim 11, characterized in that: in, The pattern of stimulation elements is used to stimulate receptors in the skin through the inner ring surface.
13. The tactile stimulation system according to claim 11 or 12, characterized in that: in, The pattern of stimulating elements is used to stimulate receptors in the skin through the outer ring surface.
14. The tactile stimulation system according to claim 1 or 2, characterized in that: in, The pattern of stimulation elements includes a pattern of electrodes for stimulating receptors in the skin.
15. The tactile stimulation system according to claim 1 or 2, characterized in that: in, The pattern of stimulation elements comprises a pattern of electromechanical transducers for stimulating receptors in the skin by mechanical vibration of each of the electromechanical transducers.
16. The tactile stimulation system according to claim 1 or 2, characterized in that: in, The stimulation element pattern comprises an electroacoustic transducer pattern for stimulating receptors in the skin by mechanical vibrations of the electroacoustic transducers.
17. The tactile stimulation system according to claim 1 or 2, characterized in that: in, The stimulation element pattern comprises an electrothermal transducer pattern for stimulating receptors in the skin by the temperature of each of the electrothermal transducers.
18. The tactile stimulation system according to claim 1 or 2, characterized in that: Also included are components for wrapping around a person's wrist.
19. The tactile stimulation system according to claim 1 or 2, characterized in that: Also included are components for wrapping around a person's neck.
20. The tactile stimulation system according to claim 1 or 2, characterized in that: in, The pattern of stimulation elements is located in a substantially flat surface.
21. The tactile stimulation system according to claim 1 or 2, characterized in that: in, The stimulation element pattern is located in a curved surface.
22. The tactile stimulation system according to claim 1 or 2, characterized in that: in, The information includes text; and The control circuitry is further configured to characterize the text with a shape that is physically mapped to the text to customize the presentation mode for the user.
23. The tactile stimulation system according to claim 1 or 2, characterized in that: in, The information includes text; and The control circuit is further configured to convert the text into a non-text image to represent the text so as to customize the presentation mode for the user.
24. The tactile stimulation system according to claim 1 or 2, characterized in that: in, The information includes sound; and The control circuit is also used to convert the sound into a visual representation of the sound to customize the presentation mode for the user; as well as The control circuit is also used to present a visual representation of the sound on the tactile stimulation interface.
25. A method for tactilely presenting information to a user, characterized in that The method comprises: Customizing a demonstration mode for a user of a tactile stimulation interface, the demonstration mode stimulation interface comprising a stimulation element pattern, wherein the demonstration mode comprises: a binary demonstration mode, a symbolic demonstration mode, and a waveform demonstration mode; and receiving a user's selection of the complexity of the demonstration information in the tactile stimulation system; selecting the demonstration mode according to the complexity; Receptors in the user's skin are stimulated by the pattern of stimulation elements to present information according to the presentation mode.
26. The method according to claim 25, characterized in that Also includes: Receive user input selecting the demonstration mode.
27. The method according to claim 25 or 26, characterized in that in, Customizing the demonstration mode for the user includes: mapping a symbolic representation of a letter to the stimulation element pattern in response to the presentation mode being a first mode; and A symbolic representation of a word is mapped to the stimulation element pattern in response to the presentation mode being a second mode.
28. The method according to claim 25 or 26, characterized in that in, Customizing the demonstration mode for the user includes: mapping the sound-visual waveform representation of the letter to the stimulus element pattern in response to the presentation mode being a first mode; and The sound-visual waveform representation of the word is mapped to the stimulation element pattern in response to the presentation mode being a second mode.
29. The method according to claim 25 or 26, characterized in that in, Customizing the demonstration mode for the user includes: spatially mapping an image onto the stimulation element pattern in response to the presentation mode being a first mode; and An image is mapped in time to the columns of the stimulation element pattern in response to the presentation mode being a first mode.
30. The method according to claim 25 or 26, characterized in that in, Customizing the demonstration mode for the user includes: The complexity of information presented in the tactile stimulation system is increased in response to the user adapting to the tactile stimulation system.
31. A non-transitory computer readable medium, characterized in that storing computer readable instructions for providing tactile communication, which when executed by one or more processors cause the one or more processors to: accessing information to be presented on a tactile stimulation interface comprising a pattern of stimulation elements for stimulating receptors in the skin of a user; Customizing a demonstration mode for a user, wherein the demonstration mode includes: a binary demonstration mode, a symbolic demonstration mode, and a waveform demonstration mode; and receiving a complexity of the presentation information selected by the user in the tactile stimulation system; Selecting the demonstration mode according to complexity; The information is demonstrated on the tactile stimulation interface according to the demonstration mode.
32. The non-transitory computer readable medium of claim 31, wherein: in, When the computer readable instructions are executed by one or more processors, the one or more processors: Receive user input selecting the demonstration mode.
33. The non-transitory computer readable medium according to claim 31 or 32, wherein: in, The computer readable instructions, when executed by one or more processors, cause the one or more processors to customize the presentation mode for a user, causing the one or more processors to: mapping a symbolic representation of a letter to the stimulation element pattern in response to the presentation mode being a first mode; as well as A symbolic representation of a word is mapped to the stimulation element pattern in response to the presentation mode being a second mode.
34. The non-transitory computer readable medium of claim 31 or 32, wherein: in, The computer readable instructions, when executed by one or more processors, cause the one or more processors to customize the presentation mode for a user, causing the one or more processors to: mapping the sound-visual waveform representation of the letter to the stimulus element pattern in response to the presentation mode being a first mode; as well as The sound-visual waveform representation of the word is mapped to the stimulation element pattern in response to the presentation mode being a second mode.
35. The non-transitory computer readable medium of claim 31 or 32, wherein: in, The computer readable instructions, when executed by one or more processors, cause the one or more processors to customize the presentation mode for a user, causing the one or more processors to: spatially mapping an image onto the stimulation element pattern in response to the presentation mode being a first mode; as well as In time, images are mapped to the columns of the stimulation element pattern in response to the presentation mode being a second mode.
36. The non-transitory computer readable medium of claim 31 or 32, wherein: in, When the computer readable instructions are executed by one or more processors, the one or more processors: A user's selection of the complexity of information presented in the tactile stimulation system is received, wherein the control circuit is used to select the presentation mode according to the complexity.
37. The non-transitory computer readable medium of claim 31 or 32, wherein: in, When the computer readable instructions are executed by one or more processors, the one or more processors: The information is sent to the tactile stimulation interface via wireless communication.
38. A wireless communication device, characterized in that: include: Non-transitory memory storage containing instructions; as well as one or more processors in communication with the non-transitory memory storage, wherein the one or more processors execute the instructions to: accessing information to be presented on a tactile stimulation interface comprising a pattern of stimulation elements for stimulating receptors in the skin of a user; and receiving a complexity of the presentation information selected by the user in the tactile stimulation system; Selecting a demonstration mode according to the complexity, wherein the demonstration mode includes: a binary demonstration mode, a symbolic demonstration mode, and a waveform demonstration mode; The information is demonstrated on the tactile stimulation interface according to the demonstration mode customized by the user.
39. The wireless communication device according to claim 38, characterized in that Also includes: A wireless communication interface is used for wireless communication with the tactile stimulation interface.
40. The wireless communication device according to claim 39, wherein: in, The one or more processors execute the instructions to: The information is sent to the tactile stimulation interface via a wireless communication interface.
41. The wireless communication device according to any one of claims 38 to 40, characterized in that: in, The wireless communication device comprises a cellular telephone.
42. The wireless communication device according to any one of claims 38 to 40, characterized in that: in, The one or more processors execute the instructions to: The information is formatted for the stimulation element pattern.
Citation Information
Patent Citations
Tactile interface system for electronic data display system
US6278441B1
Tactile communication device and method
WO1997016035A1