Haptic device manager and system

Abstract

Various methods and systems for haptic device managers and haptic device systems are disclosed herein. One aspect of the present application provides a haptic device manager comprising: a low power wireless transmitter; an input device; a display; and a controller configured to: receive a haptic sequence via an input device; receiving, via the input device, a wireless bandwidth of the low-power wireless transmitter; determining a timing message and a transmission frequency; determining a start delay; transmitting the haptic sequence and the timing message to the haptic device based on the transmission frequency; and after the first transmission of the haptic sequence and the timing message by the wireless transmitter, displaying a visual representation of the haptic sequence for initiating the initiation delay.

Description

TECHNICAL FIELD

[0001] The present disclosure relates to haptic device managers and synchronized haptic device systems. More particularly, the present disclosure is directed to haptic device managers and synchronized haptic device systems for outputting haptic musical beats for multiple haptic devices. BACKGROUND

[0002] A variety of activities involve synchronizing physical movements or actions. Periodic signals, generally referred to as beats, can be used to assist participants in synchronizing their movements or actions.

[0003] For example, when a performer plays an instrument or sings, the performer can need assistance in maintaining their performance level with the musical beat. Such assistance can aid the performer during practice or during a performance.

[0004] When multiple musicians perform together, the need for assistance in maintaining with the musical beat can be exacerbated. For example, multiple musicians in an orchestra can need assistance in maintaining the rhythm of their performance with a common musical beat, thereby synchronizing their performances.

[0005] Beaters can be used to communicate musical beats to musicians. Most conventional beaters are either standalone devices or software applications running on mobile devices (e.g., smartphones). In either case, beaters typically communicate beats via audio signals.

[0006] Audio signals that communicate musical beats are limited in the number of performers that receive the audio signals. Given the saturated audio environment of many musical performances, a single audio signal can only be heard by a limited number of performers.

[0007] Furthermore, because of the desire to avoid having audio signals that communicate musical beats be heard during musical performances, audio signals are generally undesirable during musical performances.

[0008] There is a general desire for improved beaters. Furthermore, there is a general desire for improved beaters that can communicate musical beats to multiple musical performers without being heard during musical performances.

[0009] The above examples of the related art and their associated limitations have been presented in the purpose of illustration and not limitation. Other limitations of the related art will become apparent to those of skill in the art upon reading this description and studying the drawings. SUMMARY

[0010] Additional aspects and example embodiments are described in the drawings and / or the following description.

[0011] One aspect of the present disclosure provides a wearable metronome, the wearable metronome comprising: a wearable enclosure; an antenna mounted on the wearable enclosure; a haptic module mounted within the wearable enclosure; and a wearable controller mounted within the wearable enclosure and configured to: receive a signal from a central controller via the antenna and control the haptic module to output a beat. In addition to the exemplary aspects and embodiments described above, further aspects and embodiments will become apparent from a review of the following detailed description.

[0012] One aspect of the present disclosure provides a haptic device manager for synchronizing a display output with a plurality of haptic outputs of a corresponding plurality of haptic devices, the haptic device manager comprising: a low-power wireless transmitter; an input device; a display; and a controller configured to: receive a haptic sequence via the input device; receive a wireless bandwidth of the low-power wireless transmitter via the input device; determine a timing message and a transmission frequency based on the haptic sequence; determine an initiation delay based on the wireless bandwidth and the timing message; transmit the haptic sequence and the timing message to the haptic devices based on the transmission frequency via the wireless transmitter; and display a visual representation of the haptic sequence initiated by the initiation delay via the display after a first transmission of the haptic sequence and the timing message by the wireless transmitter.

[0013] In some embodiments, receiving the haptic sequence via the input device comprises: displaying a plurality of haptic sequences via the display; and receiving a selected one of the plurality of haptic sequences via the input device; and transmitting the haptic sequence to the haptic devices via the wireless transmitter comprises: transmitting a haptic sequence identifier to the haptic devices via the wireless transmitter, wherein the haptic sequence identifier corresponds to the selected one of the plurality of haptic sequences.

[0014] In some embodiments, the haptic sequence comprises a repeating musical measure having a plurality of beats, the timing message comprises one of the plurality of beats, and the timing frequency corresponds to a frequency of the musical measure.

[0015] In some embodiments, determining the timing message and the transmission frequency comprises: determining the timing message and the transmission frequency based on a maximum difference between the visual representation of the haptic sequence and the plurality of haptic outputs of the corresponding plurality of haptic devices.

[0016] In some embodiments, determining the initiation delay comprises: determining a packet size based on the haptic sequence and the timing message; determining a bit rate based on the wireless bandwidth; and determining the initiation delay based on the packet size and the bit rate.

[0017] In some embodiments, the low-power wireless transmitter comprises a wireless transmitter with an output power of 30 decibel-milliwatts (dBm) or less and a frequency band of between 902 megahertz (MHz) and 928 MHz.

[0018] In some embodiments, the haptic device manager further includes a haptic output device, and the controller is further configured to, after the first transmission of the haptic sequence and the timing message by the wireless transmitter, output, via the haptic output device, the haptic sequence that initiates the initiation delay.

[0019] In some embodiments, the input device includes a twelve-key keypad; the display includes a thin-film transistor liquid crystal display (TFT LCD) type display; and the haptic device manager further includes a rechargeable battery power source that powers the input device, the display, the controller, and the low-power wireless transmitter.

[0020] One aspect of the present application provides a synchronized haptic device system, the synchronized haptic device system including a haptic device manager and a plurality of haptic devices, wherein: the haptic device manager includes a haptic device manager as otherwise described herein; each of the haptic devices includes: a low-power wireless receiver; a haptic output device; and a controller configured to: receive, from the low-power wireless transmitter of the haptic device manager, a haptic sequence and a timing message, and control the haptic output device based on the haptic sequence and the timing message.

[0021] In some embodiments, the haptic sequence includes a repeating musical measure having a plurality of beats, the timing message includes one of the plurality of beats, and the timing frequency corresponds to a frequency of the musical measure; and the controller of each of the haptic devices is configured to: repeatedly output, via the haptic output device, the plurality of beats in the musical measure; and synchronize the one of the plurality of beats to the timing message.

[0022] In some embodiments, the haptic sequence includes a repeating musical measure having a plurality of beats; receiving the haptic sequence via the input device includes: displaying, via the display, a plurality of musical measures; and receiving, via the input device, a selected one of the plurality of musical measures; transmitting the haptic sequence to the haptic devices via the wireless transmitter includes: transmitting, via the wireless transmitter, a musical measure identifier to the haptic devices, wherein the musical measure identifier corresponds to the selected one of the plurality of musical measures; and the controller of each of the haptic devices is further configured to: generate the selected one of the plurality of musical measures from the musical measure identifier; repeatedly output, via the haptic output device, a plurality of beats in the selected one of the plurality of musical measures; and synchronize the one of the plurality of beats to the timing message.

[0023] In some embodiments, each of the haptic devices includes a crystal oscillator having a crystal output frequency, and the controller of each of the haptic devices is further configured to tune the crystal output frequency by adjusting a capacitance of a capacitor connected to the crystal oscillator.

[0024] In some embodiments, the low-power wireless receiver includes a wireless receiver having a sensitivity of at least -138 decibels-milliwatts (dBm).

[0025] In some embodiments, the haptic device includes a wrist-wearable haptic device, and the output of the haptic output device includes a vibration.

[0026] One aspect of the present disclosure provides a method of synchronizing a display output of a haptic device manager with a plurality of haptic outputs of a corresponding plurality of haptic devices, the method comprising: receiving, via an input device of the haptic device manager, a haptic sequence; receiving, via the input device of the haptic device manager, a wireless bandwidth of a low-power wireless transmitter of the haptic device manager; determining, via a controller of the haptic device manager, a timing message and a transmission frequency based on the haptic sequence; determining, via the controller of the haptic device manager, a start delay based on the wireless bandwidth and the timing message; transmitting, via the low-power wireless transmitter of the haptic device manager, the haptic sequence and the timing message to the haptic devices based on the transmission frequency; and displaying, via a display of the haptic device manager, a visual representation of the haptic sequence starting the start delay after a first transmission of the haptic sequence and the timing message by the wireless transmitter.

[0027] In some embodiments, receiving, via the input device of the haptic device manager, the haptic sequence includes: displaying, via a display of the haptic device manager, a plurality of haptic sequences; and receiving, via the input device of the haptic device manager, a selected one of the plurality of haptic sequences; and transmitting, via the low-power wireless transmitter of the haptic device manager, the haptic sequence and the timing message to the haptic devices according to the transmission schedule includes: transmitting, via the low-power wireless transmitter of the haptic device manager, a haptic sequence identifier to the haptic devices, wherein the haptic sequence identifier corresponds to the selected one of the plurality of haptic sequences.

[0028] In some embodiments, the haptic sequence includes a repeating musical measure having a plurality of beats, the timing message includes one of the plurality of beats, and the timing frequency corresponds to a frequency of the musical measure.

[0029] In some embodiments, determining the start delay includes: determining, via the controller of the haptic device manager, a packet size based on the haptic sequence and the timing message; determining, via the controller of the haptic device manager, a bit rate based on the wireless bandwidth; and determining, via the controller of the haptic device manager, the start delay based on the packet size and the bit rate.

[0030] Some embodiments also include receiving, via a low-power wireless receiver of each of the haptic devices, the haptic sequence and the timing message; and outputting, via a haptic output device of each of the haptic devices, the haptic sequence synchronized to the timing message.

[0031] In some embodiments, the haptic sequence includes a repeating musical measure having a plurality of beats; the timing message includes one of the plurality of beats; transmitting the haptic sequence to the haptic device includes transmitting a musical measure identifier to the haptic device, wherein the musical measure identifier corresponds to the musical measure; and outputting the haptic sequence synchronized to the timing message includes generating the musical measure according to the musical measure identifier; outputting the plurality of beats of the musical measure; and synchronizing one of the plurality of beats of the musical measure to the timing message. BRIEF DESCRIPTION OF DRAWINGS

[0032] The accompanying drawings illustrate non-limiting example embodiments of the application.

[0033] Figure 1 is a schematic diagram of a haptic device manager and a plurality of haptic devices according to example embodiments of the application.

[0034] Figure 2 is a block diagram of a method for synchronizing display output of a haptic device manager with a plurality of haptic outputs of a corresponding plurality of haptic devices according to example embodiments of the application.

[0035] Figure 3A is a schematic diagram of a button controller according to example embodiments of the application.

[0036] Figure 3B is a schematic diagram of a battery charger according to example embodiments of the application.

[0037] Figures 4A-4C is a schematic diagram of a haptic device manager according to example embodiments of the application.

[0038] Figures 5A-5C is a schematic diagram of a haptic device according to example embodiments of the application. DETAILED DESCRIPTION

[0039] In the following description, specific details are set forth to provide a thorough understanding of the application. However, the application can be practiced without these details. In other instances, well-known elements have not been shown or described in order to avoid obscuring the application. Accordingly, the specification and drawings are to be regarded in an illustrative, rather than a restrictive, sense.

[0040] This document discloses various methods, systems, and apparatuses for synchronizing haptic devices. Some embodiments include a haptic device manager for synchronizing display output with multiple haptic outputs of corresponding plurality of haptic devices. Some embodiments include a haptic device synchronization system comprising a haptic device manager and a plurality of haptic devices. Some embodiments include a method for synchronizing the display output of the haptic device manager with the multiple haptic outputs of corresponding plurality of haptic devices.

[0041] Haptic devices, including wearable haptic devices (e.g., wrist-worn haptic devices), can be used to convey various sequences via their haptic outputs. For example, haptic devices can be used to convey musical sequences (e.g., musical beats). In some embodiments, a haptic device may include a haptic actuator for generating physical vibrations, and the musical beats are conveyed through the physical vibrations generated by the haptic actuator. Examples of haptic actuators include eccentric rotating mass (ERM) motors, linear resonant actuators (LRAs), and audio speakers.

[0042] In situations where multiple participants intend to synchronize their activities (e.g., multiple musicians intending to synchronize their musical performances), participants can use multiple timing devices to assist in synchronizing their activities. Using multiple timing devices requires a mechanism to ensure that the timing devices themselves are synchronized so that each participant synchronizes their activities to the same sequence. One or more embodiments of the present invention provide a haptic device manager for synchronizing the display output of the haptic device manager with multiple haptic outputs of corresponding haptic devices.

[0043] The number of haptic devices required by a participant group is directly proportional to the size of the group. Therefore, for larger participant groups, low-cost haptic devices are needed to ensure cost-effectiveness for the group. However, many components suitable for wearable devices (e.g., displays, input devices, and wireless modules commonly used in wearable devices) significantly increase the cost of such devices. In particular, wireless transmitters, receivers, and antennas used in wearable devices can significantly increase their cost. The power requirements of typical wireless transmitters, receivers, and antennas used in wearable devices necessitate expensive power supplies, such as high-capacity and high-power batteries. Therefore, typical wearable haptic devices may be too expensive for specific group applications (e.g., a group of recreational musicians).

[0044] One or more embodiments of the present invention provide a synchronized haptic device system, the synchronized haptic device system comprising a haptic device manager and a plurality of haptic devices, wherein the haptic device manager and the haptic devices communicate via a low power communication protocol using one or both of a low power wireless transmitter and a low power wireless receiver. Such low power wireless transmitters and receivers can be more cost effective than other wireless transmitters and receivers and have reduced power requirements compared to other wireless transmitters and receivers, thereby allowing such haptic devices to use more cost effective power sources.

[0045] Low power wireless communication protocols (e.g., LoRa TM Communication protocols) can have reduced power requirements compared to other wireless communication protocols. However, the lower the power requirements of a wireless communication protocol, generally the lower the bandwidth of the wireless communication protocol. As such, one or more embodiments of the present invention provide a synchronized haptic device system, wherein the haptic device manager communicates with the plurality of haptic devices using a limited bandwidth. In some embodiments, the bandwidth can be limited such that a complete sequence (e.g., a complete musical beat) cannot be transmitted via the wireless communication protocol. In such embodiments, the synchronized haptic device system only transmits the required sequence or portion of the musical beat to synchronize the sequence or musical beat between the haptic device manager and the plurality of haptic devices.

[0046] Figure 1 is a schematic diagram of a haptic device manager 10 and a plurality of haptic devices 12A, 12B, 12C, 12N (collectively referred to as haptic devices 12), wherein the haptic device manager 10 synchronizes a display output 22 of a haptic device manager display 14 with a plurality of haptic outputs of the haptic devices 12. Figure 1 The haptic devices 12A, 12B, 12C, 12N are depicted to represent that the haptic devices 12 can comprise “N” independent haptic devices.

[0047] The haptic device manager 10 comprises a low power wireless transmitter 16, an input device 18, a display 14, and a controller 20. The controller 20 is configured to: • receive a haptic sequence via the input device 18; • receive a wireless bandwidth of the low power wireless transmitter 16 via the input device 18; • determine a timing message and a transmission frequency based on the haptic sequence; • determine a start delay based on the wireless bandwidth and the timing message; • transmit the haptic sequence and the timing message to the haptic devices 12 based on the transmission frequency via the wireless transmitter 16; and • after the first transmission of the haptic sequence and the timing message by the wireless transmitter, displaying, via the display 14, a visual representation 22 of the haptic sequence initiating the initiation delay.

[0048] In some embodiments, receiving the haptic sequence via the input device 18 includes displaying a plurality of haptic sequences via the display 14 and receiving a selected one of the plurality of haptic sequences via the input device 18. In such embodiments, transmitting the haptic sequence to the haptic device 12 via the wireless transmitter 16 includes transmitting a haptic sequence identifier to the haptic device via the wireless transmitter 16, where the haptic sequence identifier corresponds to the selected one of the plurality of haptic sequences.

[0049] In some embodiments, the haptic sequence includes a repeating musical measure having a plurality of beats, the timing message includes one of the plurality of beats, and the timing frequency corresponds to a frequency of the musical measure. For example, the haptic sequence can be a repeating 4 / 4 musical measure and the timing message can include a first beat of the 4 / 4 musical measure. In another example, the haptic sequence can be a 3 / 4 musical measure and the timing message can include a first beat of the 3 / 4 musical measure.

[0050] In some embodiments, determining the timing message and the transmission frequency includes determining the timing message and the transmission frequency based on a maximum difference between the visual representation of the haptic sequence and a plurality of haptic outputs of the respective plurality of haptic devices 12. In some embodiments, the maximum difference can be 100 milliseconds (ms), 20 ms, or 10 ms.

[0051] The haptic device manager 10 can determine the initiation delay based on the haptic sequence and the timing message. For example, determining the initiation delay can include determining a packet size based on the haptic sequence and the timing message, determining a bit rate based on a wireless bandwidth, and determining the initiation delay based on the packet size and the bit rate.

[0052] The low-power wireless transmitter 16 can include a wireless transmitter having an output power of up to 30 decibel-milliwatts (dBm). In some embodiments, the low-power wireless transmitter 16 has a frequency between 902 megahertz (MHz) and 928 MHz.

[0053] The haptic device manager 10 can include a haptic output device, and the controller 20 can be further configured to output, via the haptic output device, the haptic sequence initiating the initiation delay after the first transmission of the haptic sequence and the timing message. In such embodiments, the haptic device manager 10 provides haptic output that is synchronized with the haptic output of the haptic device 12.

[0054] In one or more embodiments of the haptic device manager 10: • the input device 18 comprises a twelve-key keypad; • the display 14 comprises a thin-film transistor liquid crystal display (TFT LCD) type display; and / or • the haptic device manager 10 further comprises a rechargeable battery power supply, and the power supply powers the input device 18, the display 14, the controller 20, and the low-power wireless transmitter 16.

[0055] Some embodiments of the present application can provide a haptic device system comprising a haptic device manager 10 and a plurality of haptic devices 12. Each of the haptic devices 12 can comprise a low-power wireless receiver, a haptic output device, and a controller. The controller of each of the haptic devices 12 can be configured to: receive a haptic sequence and a timing message from the low-power wireless transmitter 16 of the haptic device manager 10, and control the haptic output device based on the haptic sequence and the timing message.

[0056] In the case where the haptic sequence comprises a repeating musical measure having a plurality of beats and the timing message comprises one of the plurality of beats, each of the controllers of the haptic devices 12 can be configured to: repeatedly output the plurality of beats of the musical measure via the haptic output device, and synchronize one of the plurality of beats to the timing message.

[0057] In some embodiments, each of the haptic devices 12 comprises a crystal oscillator having a crystal output frequency, and the controller of each of the haptic devices 12 is further configured to tune the crystal output frequency by adjusting a capacitance of a capacitor connected to the crystal oscillator.

[0058] The haptic devices 12 can comprise wrist-wearable haptic devices, and the output of the haptic output device can comprise a vibration.

[0059] Figure 2 is a block diagram of a method 200 for synchronizing display output of a haptic device manager with a plurality of haptic outputs of a corresponding plurality of haptic devices. The method 200 comprises: • step 202: receiving a haptic sequence via an input device of the haptic device manager; • step 204: receiving a wireless bandwidth of a low-power wireless transmitter of the haptic device manager via the input device of the haptic device manager; • step 206: determining a timing message and a transmission frequency based on the haptic sequence via a controller of the haptic device manager; • step 208: determining a start-up delay based on the wireless bandwidth and the timing message in groups via the controller of the haptic device manager; • Step 210: transmitting, via the low-power wireless transmitter of the haptic device manager, the haptic sequence and the timing message to the haptic device based on a transmission frequency; and • Step 212: displaying, via the display of the haptic device manager, a visual representation of the haptic sequence initiating the initiation delay after the first transmission of the haptic sequence and the timing message by the wireless transmitter.

[0060] In some embodiments of the method 200, step 202 includes displaying, via the display of the haptic device manager, a plurality of haptic sequences and receiving, via the input device of the haptic device manager, a selected one of the plurality of haptic sequences. In these embodiments, step 210 can include transmitting, via the low-power wireless transmitter of the haptic device manager, a haptic sequence identifier to the haptic device, wherein the haptic sequence identifier corresponds to the selected one of the plurality of haptic sequences.

[0061] While several example aspects and embodiments have been discussed above, one of skill in the art will recognize certain modifications, permutations, additions, and subcombinations thereof. It is intended that the following appended claims be construed to include all such modifications, permutations, additions, and subcombinations as fall within the true spirit and scope of the claims.

[0062] Some embodiments Figure 3A , Figure 3B , Figures 4A-4C , Figure 5A and Figure 5B are schematic illustrations of one or more features of one or more embodiments of the present invention.

[0063] Figure 3A is a schematic illustration of a button controller circuit 300 according to an example embodiment of the present invention. The button controller circuit 300 allows the circuit to be turned off by a microcontroller. The circuit includes a switch (Ql) and a keeper (Q4). Pressing of the button activates the switch Ql, and the keeper Q4 will maintain the activated state of the switch Ql after Ql has been activated. To deactivate the switch Ql, the microcontroller can send a signal to deactivate the keeper Q4 through PB_KILL. Thus, the circuit can be activated by pressing the button, and deactivated by the microcontroller. Alternatively, for example, if the microcontroller stops responding, a long press (more than 10 seconds) on the button will turn off the circuit.

[0064] Some embodiments can include the use of one or more LoRa TMRF system of the transceiver (SX1261). Chirp modulation can be used to increase receiver sensitivity (e.g., up to -138 dBm (decibel-milliwatt)). This sensitivity can be used for non-line-of-sight reception within the system and is low cost. Additional components of the RF system can include only an antenna and a filter, thereby further reducing the cost and form factor of the system. A chip antenna can be used to further reduce the form factor.

[0065] In embodiments that include a crystal oscillator, the accuracy of the crystal can determine the minimum bandwidth of the system. The crystal capacitance load can be tuned by the system software, and the tuning of the frequency of the crystal oscillator can be performed by the system.

[0066] Some embodiments can include LED indicators, where the LED indicators can indicate one or more of: • Power on / off blink.

[0067] • Test mode reception indicator.

[0068] • Frame power indicator. When the hold button is held, the blink can indicate entering a power frame, and releasing the button will shut down the device.

[0069] • Pairing mode. Dimmed LED can show frequency scan for pairing.

[0070] • Battery charging. During battery charging, it will indicate charging in progress with light.

[0071] Figure 3B is a schematic diagram of a battery charger circuit 302 according to an example embodiment of the present invention. The battery charger circuit 302 includes an ION charger chip. The battery charger circuit 302 can automatically stop charging when the battery is fully charged. The device must be on to see charging in progress on the LED. After charging is complete, the device will automatically shut down. A resistor (R21) on pin 2 of the charger will set the maximum charging current. The charging connection can be a USB-C type.

[0072] In embodiments where the haptic output is vibration, the vibration can be used to indicate the beat, and / or to indicate the power switch. The vibration for the tack and bell can be set on the main settings. The vibration can be updated according to each received data packet or timed message.

[0073] Various embodiments of the present invention can provide one or more of: • a wearable metronome; • a CPU controller; • a wireless receiver; • a power source; • a display, e.g., LED indicators; • a haptic module, e.g. a vibration device (e.g. a motor coupled to an unbalanced mass); and • a central controller, e.g. a smartphone running a software application.

[0074] Some embodiments of the present application can include one or more of the following hardware components: • CPU: STM32F030CCT6 (256K Flash, 32K SRAM) • US915 band (902...928 MHz) only transmission • CSS (Chirp Spread Spectrum) • Transmission power: up to 30 dBm • Serial flash for settings • Audio, vibration and buzzer output • Small keypad with 12 tactile switches • TFT LCD 2.4" 320x240 with SPI interface Hardware components: • Keypad: the keys can be tactile switches and are scanned by the hardware in a 10ms loop. 10 keys for configuration file settings. 2 keys for start / stop and sync.

[0075] • RF module: the RF module can be an E22900M30S which contains a SX1261 chip with a power amplifier providing up to 30 dBm output power. The RF module contains a module-on- ufl connector for an antenna which can be used as an antenna connector. The RF module can be operated with a 5V power supply and is controlled through a SPI interface. The RF module can be used in LoRa TM mode.

[0076] • Power: power can be provided in two stages after the battery. One stage is a boost to 5V which provides the board independent of the battery voltage and one stage is a buck to provide CPU power. The boost to 5V efficiency is more than 90% and it will be used for the RF module. The buck LDO can have 66% efficiency to provide 3.3V for the CPU and the LCD. The battery charger can include a TP4056 which stops charging automatically after a full charge. The charging process can be done with the device switch on or off. If the device is on, the charging can never stop (because of the continuous consumption). The charging current (speed) can be controlled by R34.

[0077] • Display: an LCD with the following specifications can be used: Color TFT display with ILI9341 controller, SPI interface, 16-bit color resolution (RGB565), backlight controlled by software dimming.

[0078] • Other ports: There can be an audio Aux output, which provides a line out for an external power amplifier. This output can be used to play the ding and bell sounds.

[0079] Figures 4A-4C is a schematic diagram of a haptic device manager 404 according to example embodiments of the application. The haptic device manager 404 includes a rotary encoder 406, a serial debugger 408, an AUX filter 410, a serial flash 412, a boost power regulator 414, an optional buzzer 416, a vibration output 418, a battery charger 420, and an LCD interface 422.

[0080] Figures 5A-5C is a schematic diagram of a haptic device 502 according to example embodiments of the application. The haptic device 502 includes an RF module 504, a button controller 506, a vibration output 508, and a battery charger 510.

[0081] Some embodiments of the application can include the following software features: • Main configuration page: The page can be accessed during power up by pressing and holding the rotary knob and simultaneously. To change an entry, the rotary knob will scroll through the entries. A press of the rotary knob will select the entry for change, while rotating the rotary knob will change the value. Another press on the rotary knob will fix the entry, and a final hold of the rotary knob will save all values by showing the save progress.

[0082] • Audio enable: Setting this entry to "1" will enable the audio to output the ding and bell sounds.

[0083] • Pre-beat enable: Setting this entry to "1" will produce a pre-beat played before the first bell. The number of pre-beats is the same as the beat setting.

[0084] • LCD backlight: This entry changes the LCD backlight. The result can be seen in real time on the color bar at the bottom of the screen.

[0085] • Screen timeout: Setting this entry to a non-zero value will produce a screen backlight dimming to minimum (not completely dark) when no input from the user is sensed.

[0086] • Wrist timeout: This parameter is sent to the wristband. If no activity is in progress for the defined timeout, the wristband will then turn off.

[0087] • RF channel: This is the operating frequency. The resolution is 0.5 MHz.

[0088] • Tx power: This is the SX1261 chip output power before the power amplifier. The maximum value will result in a 30 dBm output.

[0089] • Spread: The spread factor controls the chirp rate. This results in increased range but increased transmission time.

[0090] • Bandwidth: It is the bandwidth used for communication. Higher bandwidth reduces transmission time but reduces range. Low bandwidth requires better crystal accuracy on the wristband.

[0091] • Missed Chimes: It determines how many chimes will result in a transmission on the master.

[0092] • Missed Chimes: It determines how many expected chimes must be tolerated in the wristband without stopping the beat.

[0093] • Chime and Ding Duration: This entry can change the vibration duration on the wristband.

[0094] • Reset to Factory: By setting this entry to 1, all entries will be reset to factory settings. The entry will automatically reset to "0".

[0095] • Pairing: On the band, holding the button for 5 seconds will start the pairing mode. Pairing starts with 100 ms led blink and then scans all channels. The LED light will start from lowest to highest to show the start and end of band scan. The scan will continue until the master frequency is found, then the led will turn on for one second and the parameters will be saved and then the LED will turn off. On the master side, only a click on the sync button is enough (more if all wristbands are not paired). Each sync will send 4 seconds of sync data packets (every 50 ms).

[0096] One or more embodiments of the invention can include one or more of the following features: • Power up: By pressing the key, the wristband will turn on. The LED will light up and a 100 ms vibration will indicate that the device is on. If no data packets are received, the device will turn off after a 120 seconds timeout. Before turning off, the LED blinks and a 100 ms vibration will be emitted. If the button is pressed for 2 seconds, a short blink (20 ms) will indicate that the device can turn off if the button is released immediately. If the button is held down, it will enter the pairing state after 5 seconds (total). If the button is held down, the device will power off after 14 seconds (emergency power off). After pairing and before the off time, there is a test mode.

[0097] • Timeout: The master has two timeouts: o Screen timeout: Configurable in the configuration page. After the configured number of seconds, the LCD backlight is dimmed to minimum.

[0098] o Edit timeout. Removed from the configuration page. Exit edit mode after 30 seconds.

[0099] If no reception occurs, the device will shut down after 120 seconds. If the device is in pairing mode, the timeout will be doubled. If the device is connected to a charger, the shutdown timeout will be disabled for the user to see the charging LED. After a full charge, the device will shut down. To see the charging LED, the user can manually turn on the device. If the device receives a data packet (play, stop), the device timeout will be updated to the master settings.

[0100] • Runtime parameter editing: On the master, holding the knob for 2 seconds will activate the selection mode. Turning the knob in this mode will change the selection. Pressing the knob on any entry will activate the edit mode for that entry. In edit mode, turning the knob will change the parameter value. Pressing the knob in edit mode will activate the selection mode again. To exit edit mode, the knob must be held for 2 seconds. The selected entry will be shown with two small arrows around the parameter name. Editing parameters can be done during play mode. In this way, the results will take effect immediately.

[0101] • Profile settings: In Laster, any settings can be saved to one of the 10 profiles. The settings on the screen can be saved by holding the profile key for 2 seconds. To recall any profile, the key of the profile must be pressed. The active profile will be shown on the top information bar. During editing parameters, the profile number will appear on top if the parameter matches any profile setting. On power up, profile 0 will be activated.

[0102] • Audio output: If the device is enabled in the configuration, the device will play the ding and bell sounds. The output will require an amplifier to play on a speaker. The volume is fixed.

[0103] By using LoRa as the RF mode, the system can suffer long delays in transmission. Such delays can prevent sending beats one after the other, and / or create a visual delay between sending and receiving. To compensate for the delay effects, the communication between the controller / master and the device / slave can be enhanced by one or more of the following ways.

[0104] Send only bell: This will help to send less data packets and increase the interval between data packets. In this mode, the wristband must play the beats by itself. Therefore, the master sends enough information to the wristband for automatic beat playing. In this way, the master data packets are only for synchronization and beat information.

[0105] Delayed GUI: A second problem with long data packets is the visual delay between the master screen showing the beat and the wristband sending the vibration. To solve this delay, the visual update can be delayed by the transmission time needed to receive the transmission by the wristband. Thus, the delay will be in the start button reaction instead.

[0106] The firmware can predict the delay based on the configuration and delay the master display accordingly so that the master display and the slave output appear to be synchronized in terms of the beat. This means that the delay will be forced to the start point. This means that when the master play button is pressed, the play of the beat will start after the transmission delay. The wrist beat starts at the end of the data packet plus a safety margin to compensate for the clock difference between the master and the wristband.

[0107] Because of the low data rate, the master cannot send all the beats. It only sends the chimes, the start and the end. The receiver can also not receive all the data packets. This can happen even at close range. Therefore, in the master, there is the possibility to send all the chimes or to discard 1, 2 or 3 chimes each time. In this way, the wrist plays all the beats by itself and uses the received chimes to synchronize the clock. This can bring up to 8 missed chimes. After that, the wrist stops the beat.

[0108] Test key: Because the wrist plays the beat by itself, it is difficult to check the received data packets at the range edge. If the user presses the keys 6 and 10, the test flag is sent to the wrist and the wrist will blink at each received data packet. When the master is powered off, the flag will be cleared.

[0109] Wrist crystal tuning: The master frequency is tuned using a TCXO. A normal crystal is used on the wrist. The capacitance can be configured in the firmware. The accuracy of the frequency will increase the sensitivity in a larger bandwidth. In a low bandwidth, it can cause no reception. To measure the frequency, the user has to hold the wrist button after the pairing starts until more than 3 seconds. In this state, the wrist will send 5 times at 915 MHz frequency and the frequency can be seen on the spectrum or the RTLS SDR. If the frequency is not accurate, the byte in the binary file (or in the source file) can be changed for tuning the capacitance. It needs to be reprogrammed for the new value.

[0110] Master antenna: The E22 module has a board uFL connector. This connector has the best performance if a wipe antenna is connected to it. A PCB antenna can also be connected to it. External antennas are considered to be on the master board through an SMA connector. Here are the results of the test on these antennas Some embodiments of the invention can provide an apparatus for synchronizing beats output by a plurality of wearable beaters. The apparatus can comprise one or more of: • a firmware delay predictor configured to introduce a delay to a start of a beat, wherein the delay accommodates synchronization of the beat across the plurality of wearable beaters; • a communication protocol configured to accommodate a low wireless data rate, wherein the communication protocol can only send chimes, a start time and an end time; and • a method for tuning timing of two or more wearable beaters.

[0111] Some embodiments of the present invention can provide a wearable device that generates a beat detectable to the individual wearing the device. For example, the device may include a wrist-worn device that vibrates according to the beat. This device can be used in one or more of the following applications: • Used by musicians in bands, orchestras, choirs, etc., to synchronize their performances with those of other musicians; • Used by dancers performing a dance to synchronize their movements with those of other dancers; • Used by performers with impaired hearing or vision to assist in maintaining rhythm with additional visual and / or auditory beats; • For use by participants in sports activities (e.g., sports, yoga, fitness, rowing, synchronized swimming, marching, military marching drills, military training, etc.); • For patient use, for rhythmic rehabilitation targeting sensory deprivation; • For use by members of the audience watching the fireworks display; •wait.

[0112] Explanation of terms As used in this article, a ringtone can be called a timed message, and vice versa. As used further in this article, a haptic device can be called a wristband, and vice versa.

[0113] Various embodiments and features of the present invention may be described as “synchronous,” “synchronized,” or by their synonyms. As used herein, “synchronous,” “synchronized,” and their synonyms may mean a difference less than that perceptible to the average human participating in the activity, or a difference less than that required for acceptable performance of the activity. For example, the maximum difference between the outputs of haptic devices 12 used by performers in a musical performance may be the maximum difference between notes played from two different sources that is imperceptible to listeners from two different sources. This imperceptible maximum difference may be 100 ms, 30 ms, or 10 ms. In another example, the maximum difference between haptic devices 12 used by performers in a dance performance may be the maximum difference between the physical movements of two different dance performers that is imperceptible to audience members.

[0114] Unless the context otherwise explicitly requires it, this applies throughout the specification and claims: • The terms “comprise” and “comprising” should be understood in terms of inclusion, as opposed to exclusion or exhaustion; that is, they should be understood in terms of “including but not limited to”. • "Connected," "coupled," or any variant thereof, means any connection or coupling, whether direct or indirect, between two or more elements; the coupling or connection between the elements can be physical, logical, or a combination thereof; • "Herein," "above," "below," and like terms are used herein to describe the specification as a whole, not any particular portion thereof; • "Or" as used with respect to a list of two or more items means any of the items in the list, each of the items in the list, and any combination of the items in the list; • The singular forms "a," "an," and "the" also include any plural referents unless the context clearly dictates otherwise.

[0115] Directional words (e.g., "vertical," "lateral," "horizontal," "upward," "downward," "forward," "backward," "inward," "outward," "perpendicular," "transverse," "left," "right," "front," "back," "top," "bottom," "under," "over," "below," "above," "beneath," etc.) are used in this description and any appended claims (if any) depending on the particular orientation of the device being described and shown. The subject matter described herein can assume various alternative orientations. Accordingly, these directional terms are not strictly defined and should not be narrowly interpreted.

[0116] Also, while elements can be shown to perform their functions in a particular order, the elements can also perform their functions in different orders or simultaneously. Accordingly, the following claims are intended to cover all such variations that fall within the scope of the claims' intended interpretation.

[0117] In some embodiments, the present application can be implemented in software. For greater clarity, "software" includes any instructions executed on a processor, and can include (but is not limited to) firmware, resident software, microcode, and the like. Processing hardware and software, both, can be centralized or distributed (or a combination thereof), in whole or in part, as known to those skilled in the art. For example, the software and other modules can be accessible via local memory, via a network, via a browser or other application, or via other means suitable for the intended purpose, in a distributed computing context.

[0118] Where a component (e.g. a software module, processor, assembly, device, circuit, etc.) is referred to above, unless otherwise indicated, reference thereto is to be interpreted to include any of the component as an equivalent of the component (i.e., functionally equivalent, structurally equivalent, and / or compositionally equivalent), including structural equivalents, equivalents in structure and function, and / or compositionally equivalent components.

[0119] Specific examples of systems, methods, and apparatuses have been described herein for purposes of illustration. These are only examples. The technology provided herein can be applied to systems other than the example systems described above. Many alterations, modifications, additions, omissions, and permutations are possible within the scope of the application. The inventor contemplates that the technology provided herein can be implemented in a variety of specific forms, and that the specific form disclosed is merely exemplary. The inventor also envisions that the technology provided herein can be carried out in other ways not expressly described or shown herein. Any and all modifications, variations or improvements not described or shown herein are considered to be within the scope of the inventor's contribution to the art. The inventor also envisions that the technology provided herein can be carried out in other ways not expressly described or shown herein. Any and all modifications, variations or improvements not described or shown herein are considered to be within the scope of the inventor's contribution to the art.

[0120] Various features are described as being present in "some embodiments." Such features are not mandatory and can not be present in all embodiments. Embodiments of the application can include zero, any, or any combination of two or more of such features. This is limited only to the extent that a particular feature from such a set of incompatible features would not be structurally possible to one of ordinary skill in the art to construct an embodiment of the practice of the application that combines such incompatible features. Thus, a description of "some embodiments" having feature A and "some embodiments" having feature B should be interpreted as an explicit indication that embodiments combining features A and B are also contemplated (unless the description specifically indicates to the contrary or features A and B are fundamentally incompatible).

[0121] Accordingly, the accompanying claims and incorporated claims are intended to be construed to include all such modifications, permutations, additions, omissions, and sub-combinations as fall within the true spirit and scope of the present application. The scope of the claims should not be limited by the preferred embodiments set forth in the examples, but should be given the broadest interpretation consistent with the description as a whole.

Claims

1. A haptic device manager for synchronizing display output with a plurality of haptic outputs of a corresponding plurality of haptic devices, the haptic device manager comprising: a low power wireless transmitter; an input device; a display; and a controller configured to: receive a haptic sequence via the input device; receive a wireless bandwidth of the low power wireless transmitter via the input device; determine a timing message and a transmission frequency based on the haptic sequence; determine a start delay based on the wireless bandwidth and the timing message; transmit the haptic sequence and the timing message to the haptic devices via the wireless transmitter based on the transmission frequency; and display a visual representation of the haptic sequence starting the start delay via the display after a first transmission of the haptic sequence and the timing message by the wireless transmitter.

2. The haptic device manager of claim 1, wherein: receiving the haptic sequence via the input device comprises: displaying a plurality of haptic sequences via the display; and receiving a selected one of the plurality of haptic sequences via the input device; and transmitting the haptic sequence to the haptic devices via the wireless transmitter comprises: transmitting a haptic sequence identifier to the haptic devices via the wireless transmitter, wherein the haptic sequence identifier corresponds to the selected one of the plurality of haptic sequences. the haptic sequence comprises a repeating musical measure having a plurality of beats, the timing message comprises one of the plurality of beats, and a timing frequency corresponds to a frequency of the musical measure. determining the timing message and the transmission frequency comprises determining the timing message and the transmission frequency based on a maximum difference between the visual representation of the haptic sequence and the plurality of haptic outputs of the corresponding plurality of haptic devices.

3. The haptic device manager of claim 1, wherein, determining the start delay comprises:

4. The haptic device manager of claim 1, wherein, determining a packet size based on the haptic sequence and the timing message; 5. The haptic device manager of claim 1, wherein, determining a bit rate based on the wireless bandwidth; and determining the start delay based on the packet size and the bit rate. the low power wireless transmitter comprises a wireless transmitter having an output power of 30 decibel-milliwatts or less and a frequency band of between 902 MHz and 928 MHz. the haptic device manager further comprises a haptic output device, and the controller is further configured to output the haptic sequence starting the start delay via the haptic output device after the first transmission of the haptic sequence and the timing message by the wireless transmitter.

6. The haptic device manager of claim 1, wherein, 8. The haptic device manager of claim 1, wherein:

7. The haptic device manager of claim 1, wherein, the input device comprises a twelve-key keypad; the display comprises a thin film transistor liquid crystal display type display; and the haptic device manager further comprises a rechargeable battery power source, and the power source powers the input device, display, controller, and low power wireless transmitter.

9. A synchronized haptic device system comprising a haptic device manager and a plurality of haptic devices, wherein: ​ ​ The haptic device manager comprises the haptic device manager of claim 1; Each of the haptic devices comprises: a low-power wireless receiver; a haptic output device; and a controller configured to receive the haptic sequence and the timing message from the low-power wireless transmitter of the haptic device manager and control the haptic output device based on the haptic sequence and the timing message.

10. The synchronized haptic system of claim 9, wherein: the haptic sequence comprises a repeating musical measure having a plurality of beats, the timing message comprises one beat of the plurality of beats, and a timing frequency corresponds to a frequency of the musical measure; and the controller of each of the haptic devices is configured to: repeatedly output the plurality of beats of the musical measure via the haptic output device; and synchronize one beat of the plurality of beats to the timing message.

11. The synchronized haptic system of claim 9, wherein: the haptic sequence comprises a repeating musical measure having a plurality of beats; receiving the haptic sequence via the input device comprises: displaying a plurality of musical measures via the display; and receiving a selected one of the plurality of musical measures via the input device; transmitting the haptic sequence to the haptic devices via the wireless transmitter comprises: transmitting a musical measure identifier to the haptic devices via the wireless transmitter, wherein the musical measure identifier corresponds to the selected one of the plurality of musical measures; and the controller of each of the haptic devices is further configured to: generate the selected one of the plurality of musical measures from the musical measure identifier; repeatedly output the plurality of beats of the selected one of the plurality of musical measures via the haptic output device; and synchronize one beat of the plurality of beats to the timing message.

12. The synchronous haptic system of claim 9, wherein, Each of the haptic devices comprises a crystal oscillator having a crystal output frequency, and the controller of each of the haptic devices is further configured to tune the crystal output frequency by adjusting a capacitance of a capacitor connected to the crystal oscillator.

13. The synchronous haptic system of claim 9, wherein, The low-power wireless receiver comprises a wireless receiver having a sensitivity of at least -138 decibels-milliwatts.

14. The synchronous haptic system of claim 9, wherein, The haptic devices comprise wrist-wearable haptic devices, and the output of the haptic output device comprises a vibration.

15. A method of synchronizing display output of a haptic device manager with a plurality of haptic outputs of a corresponding plurality of haptic devices, the method comprising: receiving a haptic sequence via an input device of the haptic device manager; receiving a wireless bandwidth of a low-power wireless transmitter of the haptic device manager via the input device of the haptic device manager; determining a timing message and a transmission frequency based on the haptic sequence via a controller of the haptic device manager; transmitting the haptic sequence to the haptic devices via the low-power wireless transmitter of the haptic device manager; and synchronizing the display output of the haptic device manager with the plurality of haptic outputs of the corresponding plurality of haptic devices based on the timing message and the transmission frequency. determining, via the controller of the haptic device manager, a start delay based on the wireless bandwidth and the grouped timing messages; transmitting, via the low-power wireless transmitter of the haptic device manager, the haptic sequence and the timing messages to the haptic devices based on the transmission frequency; and displaying, via a display of the haptic device manager, a visual representation of the haptic sequence initiating the start delay after the first transmission of the haptic sequence and the timing messages by the wireless transmitter.

16. The method of claim 15, wherein: receiving, via the input device of the haptic device manager, the haptic sequence comprises: displaying, via the display of the haptic device manager, a plurality of haptic sequences; and receiving, via the input device of the haptic device manager, a selected one of the plurality of haptic sequences; and transmitting, via the low-power wireless transmitter of the haptic device manager, the haptic sequence and the timing messages to the haptic devices according to a transmission schedule comprises: transmitting, via the low-power wireless transmitter of the haptic device manager, a haptic sequence identifier to the haptic devices, wherein the haptic sequence identifier corresponds to the selected one of the plurality of haptic sequences.

17. The method of claim 15, wherein, the haptic sequence comprises a repeating musical measure having a plurality of beats, the timing message comprises one of the plurality of beats, and a timing frequency corresponds to a frequency of the musical measure.

18. The method of claim 15, wherein, determining the start delay comprises: determining, via the controller of the haptic device manager, a packet size based on the haptic sequence and the timing message; determining, via the controller of the haptic device manager, a bit rate based on the wireless bandwidth; and determining, via the controller of the haptic device manager, the start delay based on the packet size and the bit rate.

19. The method of claim 15, further comprising: receiving, via a low-power wireless receiver of each of the haptic devices, the haptic sequence and the timing message; outputting, via a haptic output device of each of the haptic devices, the haptic sequence synchronized to the timing message.

20. The method of claim 19, wherein: the haptic sequence comprises a repeating musical measure having a plurality of beats; the timing message comprises one of the plurality of beats; transmitting the haptic sequence to the haptic devices comprises transmitting a musical measure identifier to the haptic devices, wherein the musical measure identifier corresponds to the musical measure; and outputting the haptic sequence synchronized to the timing message comprises: generating the musical measure according to the musical measure identifier; outputting the plurality of beats of the musical measure; and synchronizing one of the plurality of beats of the musical measure to the timing message.

Images