Method and system for providing enhanced audio perception of music or speech or sound through tactile stimulation

By synchronously generating tactile stimulation that matches the audio signal, modulating it and applying it to specific parts of the user's body, the problem of insufficient tactile perception in the existing technology is solved, and a more satisfactory perceptual experience of music or voice audio is achieved.

CN113490982BActive Publication Date: 2025-09-09I&G TECH S A S DI AMADIO GIANCARLO & C
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202080014411.X
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Priority Date
2019-02-14
Filing Date
2020-02-11
Publication Date
2025-09-09
Estimated Expiration
2040-02-11

AI Technical Summary

Technical Problem

Existing technologies are unable to effectively enhance the perception of music or speech audio through tactile stimulation, especially in video game systems, where tactile perception serves only as an additional channel rather than an enhancement.

Method used

By synchronously generating tactile stimulation that matches the audio signal, including vibration and pressure waves, modulating and applying them to specific parts of the user's body, the collaborative perception of hearing and touch is enhanced.

Benefits of technology

A more satisfying perceptual experience of music or voice audio is achieved, and the overall perceptual quality is improved through the synergy of tactile stimulation and auditory stimulation.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN113490982B_ABST
    Figure CN113490982B_ABST
Patent Text Reader

Abstract

A method for providing enhanced music, speech, or sound audio perception through tactile stimulation is described. The method comprises the following steps: receiving a signal (S, SE) representing the music, speech, or sound audio; simultaneously generating one or more tactile stimuli (ST); and then modulating the one or more tactile stimuli (ST) based on the aforementioned received signal (S or SE) to generate one or more modulated tactile stimuli STM. The method then envisages applying the aforementioned one or more modulated tactile stimuli (STM) to a listener together with acoustic diffusion of the music, speech, or sound audio, so that the listener can enjoy the music, speech, or sound audio through both auditory stimulation and tactile stimulation. Furthermore, a corresponding system 1 for providing enhanced music, speech, or sound audio perception through tactile stimulation is described, which is capable of implementing the aforementioned method.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention generally relates to the technical field of sound diffusion for enhancing perception through tactile stimulation.

[0002] In particular, the present invention relates to a method and system for providing enhanced perception of music or speech or sound audio through tactile stimulation, and a method and system for providing tactile effects of music or speech or sound audio. Background Art

[0003] Many systems and methods are known for improving sound diffusion using enhanced perception.

[0004] However, the known solutions solve the technical problem of improving the perceived sound quality and ultimately always involve an improvement in the perception of auditory stimulation.

[0005] Some methods and systems are known that have also been expanded to include other sensory stimulation, such as in video game systems that enable the audio and visual perception of content (e.g., a video game) to be accompanied by tactile vibrations delivered to the user (e.g., via a glove). In this case, the tactile perception is added to the audio and visual perception, and does not enhance the audio perception as such, but simply adds a separate sensory channel.

[0006] However, considering sound diffusion in the proper sense, ie the diffusion and / or reproduction and / or listening of music, songs or speech audio, there is no known solution that would enrich this perception with tactile stimulation, and thus the need to provide such a solution has arisen. Summary of the Invention

[0007] In view of the above, the object of the present invention is to provide a method for providing enhanced audio perception of music or speech or sound by means of tactile stimulation, which makes it possible to at least partially overcome the disadvantages described above with reference to the prior art and responds to the needs mentioned above, which are particularly evident in the technical field under consideration.

[0008] The object is achieved by the method of the present application.

[0009] Further embodiments of the method are defined by the present application.

[0010] The subject matter of the invention also relates to a method for providing haptic effects of music or speech or sound audio. Said method is defined in the present application.

[0011] The subject of the invention also relates to a system for providing enhanced audio perception of music or speech or sound by means of tactile stimulation. Said system is defined in the present application.

[0012] Further embodiments of the system are defined by the present application.

[0013] Finally, the subject matter of the present invention relates to a system for providing haptic effects for music or speech or sound audio. BRIEF DESCRIPTION OF THE DRAWINGS

[0014] Additional features and advantages of the method according to the invention will emerge from the following description of a preferred embodiment, given by way of illustration and not by way of limitation, with reference to the accompanying drawings, in which:

[0015] - Figure 1 shows a simplified block diagram of an embodiment of a system according to the present invention for providing enhanced audio perception of music or speech or sound through tactile stimulation;

[0016] - Figure 2 and Figure 3 A simplified block diagram showing a further embodiment of the system is shown;

[0017] - Figure 4 An implementation example of the system according to the present invention is shown;

[0018] - Figure 5 Another example of implementation and application of the system according to the present invention is shown. DETAILED DESCRIPTION

[0019] The present invention takes into account the pressure waves and acoustic vibrations generated by any audio, which is largely musical, where the pressure waves and acoustic vibrations are completely synchronized with the original audio generated; the present invention transmits the pressure waves and acoustic vibrations to the human tactile system through mechanical or electronic devices so that they can be intercepted and perceived.

[0020] In other words, as will be described below, each sound event is considered to be a generator of the audible sound portion of vibrations and pressure variations.

[0021] refer to Figure 1-5 , a method for providing enhanced audio perception of music or speech or sound through tactile stimulation is described.

[0022] The method includes the following steps: receiving a signal representing the aforementioned music or voice or sound audio (represented as S or SE in the figure); at the same time, generating one or more tactile stimuli ST; and then modulating the one or more tactile stimuli ST based on the aforementioned received signal (S or SE) to generate one or more modulated tactile stimuli STM.

[0023] The method envisages then applying the aforementioned one or more modulated tactile stimuli STM together with the acoustic diffusion of the music or speech or sound audio to the listener so that the listener can enjoy the music or speech or sound audio both through auditory stimulation and through tactile stimulation.

[0024] The application of the modulated tactile stimulation STM occurs together with the sound diffusion of the musical audio in the sense that the application of the modulated tactile stimulation and the sound diffusion are simultaneous or substantially simultaneous (on a time scale comparable to the perception time of human senses). In this way, in fact, the auditory stimulation and the tactile stimulation cooperate in an overall perception that is enhanced and more satisfying to the user.

[0025] In the present solution, the correlation between auditory and tactile stimulation is ensured by the aforementioned simultaneity and the fact that the tactile stimulation is appropriately modulated in a manner that is closely related to the signal representing the auditory stimulation perceived by the user (as described above).

[0026] In all embodiments of the invention, the method of the invention can be applied where the audio is of any type, but in particular (in the preferred field of application) where the music or speech or sound audio provided for enhanced perception comprises human speech and / or sound and / or musical works and / or songs expressed in words or singing.

[0027] According to one embodiment of the method, the aforementioned tactile stimulation ST comprises a vibration perceptible by touch.

[0028] According to a choice of implementation, the aforementioned tactile stimulation comprises mechanical vibration; in this case, the step of generating one or more tactile stimulations comprises generating vibrations and / or mechanical waves by a vibration source and / or a mechanical wave source.

[0029] According to another embodiment, the aforementioned tactile stimulation includes pressure waves and / or acoustic vibrations; in this case, the step of generating one or more tactile stimulations includes generating pressure waves and / or acoustic vibrations by a pressure wave source and / or acoustic vibration source.

[0030] According to an embodiment of the method, the applying step comprises applying the generated vibrations to one or more parts of the listener's body after the generated vibrations have been modulated.

[0031] In this case, according to one option of embodiment, the modulating step includes modulating one or more tactile stimuli by a frequency suitable for a specific part of the listener's body, and the applying step includes applying the generated vibration to the specific part of the listener's body that is sensitive to the frequency after the generated vibration has been modulated.

[0032] According to one example of application of the method, the specific part of the listener's body to which the modulated vibration is applied includes a part of the tactile system and / or the skeletal system and / or the muscular system and / or the brain system.

[0033] In particular, according to a possible choice of embodiment, the specific part of the listener's body to which the modulated vibration is applied includes a part of the tactile system, which belongs to the group including: Ruffinicorpuscle, and / or Meissner corpuscle, and / or Pacinian corpuscle, and / or Merkel corpuscle, and / or free nerve fibers suitable for detecting tactile and / or pressure and / or stretch signals.

[0034] In this regard, the method provides wide flexibility in selecting the frequencies applied to preselected parts of the body based on the sensitivity of those parts of the body.

[0035] According to various options of implementation of the method, it is possible to remodulate the auditory frequencies to the optimal tactile frequencies.

[0036] For example, in the case of Pacinian corpuscles, tactile frequencies can range from 100 Hz to 500 Hz. In fact, Pacinian corpuscles are the most sensitive of the tactile receptors, capable of detecting pressure on the skin on the order of one micron; their sensitivity is greatest at 200 Hz, but they can also detect frequencies up to 500 Hz.

[0037] According to another example, in the case of Merkel's corpuscles, the tactile frequency can be from 5 Hz to 60 Hz. In fact, Merkel's corpuscles detect very low-frequency pressure stimuli.

[0038] According to one embodiment of the method, multiple tactile stimuli (modulated to respective optimal frequencies) may be applied simultaneously to different parts of the body.

[0039] According to one embodiment, the method may be applied in an environment where sound signals are diffused through electronic devices.

[0040] In this case, the aforementioned received signal is an electrical or electronic signal SE from a receiving instrument A, which is suitable for receiving music or voice audio transmitted in electronic form and converting it into electrical or electronic form, thereby transforming it into the "received electrical or electronic signal" (SE) defined above.

[0041] Furthermore, in this embodiment, the method comprises the further step of generating and diffusing an acoustic (i.e. sound) signal SA corresponding to the aforementioned music or speech audio, so that the acoustic (sound) signal SA is perceived by the listener while applying the aforementioned one or more modulated tactile stimuli STM.

[0042] According to a possible choice of implementation, the aforementioned receiving device A includes a radio or TV or telephone or computer or iPod or a receiving device associated with a speaker or an audio playback device associated with the projection of a video game or a movie.

[0043] According to another embodiment, the method can also be applied in the context of a sound signal SS coming from an audio or acoustic source and which is perceived directly by the listener without the mediation of an electronic device.

[0044] In this case, the receiving step comprises detecting the sound signal SS and generating a corresponding electric or electronic signal SE representing the detected sound signal SS.

[0045] In all the previously mentioned cases, in the method the individual reaches a point where there is an electrical or electronic signal SE representing a sound signal diffused and perceived by the user.

[0046] According to one embodiment option, the method comprises, before the modulation step, an additional step of processing said electric or electronic signal SE to obtain a drive signal SP. In this case, the modulation step comprises modulating said one or more tactile stimuli ST by means of the drive signal SP.

[0047] It can be easily understood that the fact of using an electric or electronic signal SE as the basis for generating the drive signal SP for the modulated tactile stimulation ST provides a wide range of possibilities for processing said signal, which are known per se, in order to optimize the timing of the tactile stimulation with advantageous flexibility and thus maximize its effect.

[0048] According to several possible variant embodiments, the aforementioned step of processing the electric or electronic signal SE comprises, by operating in the frequency domain and / or the time domain: frequency filtering the electric or electronic signal, and / or shifting the spectrum of the electric or electronic signal around a desired center frequency, and / or changing or distorting the spectrum according to predefined criteria.

[0049] It should be observed that in various options of implementation of the method, the tactile stimulation is modulated in a manner that is somewhat dependent on or coordinated with the sound, but in many respects it can be independent of the sound itself (e.g., with respect to intensity, amplification, or other aspects).

[0050] A corresponding method included in the present invention for providing haptic effects for music or speech or sound audio while listening to said music or speech or sound audio will now be described.

[0051] The method includes the following steps: receiving a signal (S or SE) representing the aforementioned music or speech or sound audio; then acoustically diffusing the music or speech or sound audio; simultaneously generating one or more tactile stimuli ST, and modulating the one or more tactile stimuli ST based on the aforementioned received signal to generate one or more modulated tactile stimuli STM.

[0052] Finally, the method envisages applying said one or more modulated tactile stimuli STM to the listener simultaneously with the acoustically diffuse step, so as to allow a tactile effect of the music or speech or sound audio associated with the received signal.

[0053] A system 1 for providing haptic effects for music or speech or sound audio will now be described.

[0054] The system 1 comprises a receiving device 2 , a device for generating tactile stimuli 3 , a modulation device 4 and a tactile stimulus applying device 5 .

[0055] The receiving means 2 are configured to receive a signal (S or SE) representing the aforementioned music or speech or voice audio.

[0056] The means 3 for generating tactile stimuli is configured to generate one or more tactile stimuli ST.

[0057] The modulation device 4 is configured to modulate the aforementioned one or more tactile stimuli ST based on the received signal (S or SE) in order to generate one or more modulated tactile stimuli STM.

[0058] The tactile stimulation applying device 5 is configured to apply the aforementioned one or more modulated tactile stimulations ST to the listener so as to enable a tactile effect of the music or speech or sound audio associated with the received signal.

[0059] According to one embodiment of the system, the means 3 for generating tactile stimulation comprise one or more vibration generators and / or mechanical wave generators.

[0060] According to another embodiment of the system, the means for generating tactile stimulation 3 comprises one or more vibration generators and / or sound wave generators.

[0061] According to one embodiment of the system, the tactile stimulus applying means 5 comprises a vibration device 5 operatively connected to the modulation means 4 so as to receive the generated tactile stimulus ST and / or vibration. The vibration device 5 is configured to be placed in contact with one or more parts of the listener's body to apply the modulated tactile stimulus STM and / or vibration.

[0062] According to several possible variant embodiments, the vibration device 5 is made of a sponge-like material, or another material suitable for transmitting vibrations.

[0063] According to one embodiment option, the modulation means 4 comprise an electronic modulator known per se, which is configured to modulate the electrical signal to be modulated with an electrical modulation signal or an electrical drive signal.

[0064] According to one embodiment of the system, the modulation device 4 is configured to modulate one or more tactile stimuli by a frequency suitable for a specific part of the listener's body, and the tactile stimulus applying device 5 is configured to apply the generated vibration to the specific part of the listener's body after the generated vibration has been modulated.

[0065] According to one embodiment option, the specific part of the listener's body to which the modulated vibration is applied includes a part of the tactile system and / or the skeletal system and / or the muscular system and / or the brain system.

[0066] According to various application examples, the specific part of the listener's body to which the modulated vibration is applied includes a part of the tactile system, which belongs to the group including: Roffini's corpuscles, and / or Meissner's corpuscles, and / or Pacinian's corpuscles, and / or Merkel's corpuscles, and / or free nerve fibers suitable for detecting tactile and / or pressure and / or stretch signals.

[0067] According to one embodiment ( Figure 2 As shown), the system further comprises a sound detection and conversion device 6, which is configured to detect the sound signal SS and generate a corresponding electric signal or electronic signal SE representing the detected sound signal SS.

[0068] According to one embodiment of the system, the receiving means 2 comprise a receiving device 20 operatively connectable to a receiving apparatus A suitable for receiving music or speech audio transmitted in electronic form and converting it into an electrical or electronic signal SE.

[0069] In this case, the receiving device 20 is configured to receive the aforementioned electric or electronic signal SE, and the system 1 further comprises sound diffusing means 9 adapted to diffuse the acoustic signal SA corresponding to said music or speech audio. Figure 3A first option is shown in which the sound diffusing device 9 is included in the receiving instrument A, and a further (alternative or additional) option is further shown by a dotted line, in which the sound diffusing device 9 is exclusively provided within the system 1 and is separate from the receiving instrument A.

[0070] According to several variant embodiments, the aforementioned receiving device A comprises a radio or a TV or a telephone or a computer or an iPod or a receiving device associated with a loudspeaker or with an audio playback device associated with the projection of a video game or a movie.

[0071] According to one embodiment, the system 1 further comprises a wireless communication device 7 , which is configured to connect the aforementioned receiving apparatus 20 and the aforementioned receiving instrument A.

[0072] According to one embodiment option, the aforementioned wireless communication device 7 comprises a transceiver based on short-range and / or Bluetooth and / or BLE wireless technology.

[0073] According to other options of embodiment, the communication connection within the system (and in particular the connection between the receiving device 20 and the receiving apparatus A) can be effected by means of cables or by means of any other connection technology known per se which is suitable for the purpose.

[0074] According to one embodiment, the system 1 further comprises electronic signal processing means 8 configured to process the aforementioned electric or electronic signal SE in order to obtain the drive signal SP.

[0075] According to various possible options of implementation, the electronic signal processing device 8 is configured to: perform frequency filtering on the electrical signal or electronic signal, and / or shift the spectrum of the electrical signal or electronic signal around a desired center frequency, and / or change or distort the spectrum according to predefined criteria by operating in the frequency domain and / or time domain.

[0076] According to one embodiment, the modulation means 4 comprises a modulator 4 configured to modulate the tactile stimulus by means of a drive signal.

[0077] A system for providing enhanced perception of music or speech or sound audio by tactile stimulation will now be described, said system comprising the system 1 for providing tactile effects for music or speech or sound audio according to any one of the above embodiments.

[0078] In the system 1 , the sound diffusing device 9 and the tactile stimulation applying device 5 are configured to diffuse the acoustic signal SA and apply one or more modulated tactile stimulations STM on the listener, respectively, in a time-dependent manner.

[0079] According to an embodiment of the system, the sound diffusing device 9 and the tactile stimulus applying device 5 are configured to diffuse the acoustic signal and apply one or more modulated tactile stimuli, respectively, in a simultaneous manner.

[0080] With reference to the embodiments of the system, various options are possible.

[0081] For example, reference Figure 1 , the aforementioned receiving device 2, the device for generating tactile stimuli 3, the modulation device 4 and the tactile stimulation applying device 5 can be integrated (functionally and / or mechanically) into a single device.

[0082] Alternatively, refer to Figure 2 , the receiving device 20, the processing device 8, the modulator 4 and the source 3 of tactile stimulation or vibration can be integrated with each other in the form of a housing 30 (similar to a small speaker housing), and the housing 30 is then mechanically coupled to the tactile stimulation applying device 5 so as to provide a modulated tactile stimulation to be applied to the body part.

[0083] exist Figure 4 In the illustrated exemplary embodiment, the housing 30 and the tactile stimulus applying means 5 are shown in the form of a ring or collar made of a sponge-like material that fits around the neck of the listener.

[0084] exist Figure 5 The example application shown shows the following: system 1 (housing 30 and collar 5) worn on the listener's neck, while the receiving instrument A is also provided with a wireless transmitter 7 for communicating with a receiving device of system 1 (implemented via a mobile phone or smartphone 40).

[0085] According to a variant embodiment not shown, the aforementioned connection is made via a cable.

[0086] In another embodiment option not shown, the aforementioned receiving device 2, the device for generating tactile stimulation 3, the modulation device 4 and the tactile stimulation applying device 5 can be integrated (functionally and / or mechanically) into a single device (which has a basically cylindrical shape) or a construction having a handle and a movable part (consisting of a film or another vibrating element suitable for being placed in contact with a body part (such as the forehead)).

[0087] As can be observed, the objects of the invention are fully achieved by the system and method described above, by means of their functional and structural features.

[0088] In particular, the method and system allow a listener to enjoy a significantly enhanced, more satisfying perception of music or speech or sound audio, wherein both auditory stimulation and tactile stimulation, generated and modulated in a manner related to the tactile stimulation and appropriately applied to various possible parts of the body, contribute to the significantly enhanced, more satisfying perception.

[0089] Viewed from another perspective, the above-described systems and methods make it possible to provide haptic effects of music or speech or sound audio that are closely related to auditory perception.

[0090] Those skilled in the art may make modifications and adjustments to the embodiments of the above-described systems and methods, and replace elements with other functionally equivalent elements, without departing from the scope of the appended claims. Each feature described as belonging to a possible embodiment can be implemented independently of the other described embodiments.

Claims

1. A method for providing enhanced audio perception of music or speech or sound through tactile stimulation, wherein: The tactile stimulation includes pressure waves and acoustic vibrations that are fully synchronized with the audio, and the method includes the following steps: receiving a signal (SS) representing said music or speech or sound audio, wherein the received signal is a sound signal (SS) from an audio or sound source directly perceived by a listener, And wherein, the receiving step includes: detecting the sound signal (SS) and generating a corresponding electric or electronic signal (S, SE) representing the detected sound signal (SS); generating one or more tactile stimuli (ST) by generating pressure waves and acoustic vibrations via a pressure wave source and an acoustic vibration source, wherein the pressure waves and acoustic vibrations are fully synchronized with the audio; modulating the one or more tactile stimuli (ST) based on the electrical or electronic signal (S, SE) to generate one or more modulated tactile stimuli (STM); applying the one or more modulated tactile stimuli (STMs) together with acoustic diffusion of the music or speech or sound audio to a listener so that the listener can enjoy the music or speech or sound audio both through auditory stimulation and through tactile stimulation; wherein the electrical or electronic signal (S, SE) comes from a receiving device (A), which is suitable for receiving music audio transmitted in electronic form and converting it into the received electrical or electronic signal (S, SE), And wherein the method comprises the further step of generating and diffusing an acoustic signal (SA) corresponding to the music audio such that the acoustic signal (SA) is perceived by the listener while applying the one or more modulated tactile stimuli (STM).

2. The method according to claim 1, wherein The tactile stimulation includes vibrations that can be sensed by touch.

3. The method according to claim 2, wherein: The tactile stimulation comprises mechanical vibrations, and wherein the step of generating one or more tactile stimulations comprises generating vibration waves and / or mechanical waves by a vibration source and / or a mechanical wave source.

4. The method according to claim 3, wherein: The applying step includes applying the generated vibrations to one or more parts of the listener's body after the generated vibrations have been modulated.

5. The method according to claim 4, wherein The modulating step includes modulating one or more tactile stimuli by a frequency suitable for a specific part of the listener's body, and the applying step includes applying the generated vibration to the specific part of the listener's body sensitive to the frequency after the generated vibration has been modulated.

6. The method according to claim 5, wherein: The specific part of the listener's body to which the modulated vibration is applied includes a part of the tactile system and / or the skeletal system and / or the muscular system and / or the brain system.

7. The method according to claim 6, wherein: The specific part of the listener's body to which the modulated vibration is applied comprises a part of the tactile system belonging to the group consisting of: Roffini's corpuscles, and / or Meissner's corpuscles, and / or Pacinian's corpuscles, and / or Merkel's corpuscles, and / or free nerve fibers suitable for detecting touch and / or pressure and / or stretch signals.

8. Method according to claim 1, comprising, before the modulation step, an additional step of processing the electric or electronic signal (SE) to obtain a drive signal (SP), And among them, The modulating step comprises modulating said one or more tactile stimuli (ST) by said drive signal (SP).

9. The method according to claim 8, wherein The processing steps include operating in the frequency domain and / or the time domain to: performing frequency filtering on the electric or electronic signal, and / or shifting the spectrum of the electrical or electronic signal around a desired center frequency, and / or changing or distorting the spectrum according to predefined criteria.

10. The method according to claim 1, wherein The music or speech or sound audio includes human speech expressed in words or songs.

11. The method according to claim 1, wherein The music or speech or voice audio comprises sounds and / or musical compositions and / or songs, and the tactile stimulation comprises vibrations of a mechanical or acoustic type.

12. A method for providing a haptic effect of music, speech, or sound audio while listening to the music, speech, or sound audio, the method comprising the steps of: receiving a signal representative of said music or speech or sound audio, wherein the received signal is a sound signal (SS) from an audio or sound source directly perceived by a listener, and wherein the receiving step comprises detecting said sound signal (SS) and generating a corresponding electric or electronic signal (S, SE) representative of the detected sound signal (SS); acoustically diffuse said music or speech or sound audio; generating one or more tactile stimuli (ST), wherein the tactile stimuli include pressure waves and acoustic vibrations fully synchronized with the audio; modulating the one or more tactile stimuli (ST) based on the electrical or electronic signal (S, SE) to generate one or more modulated tactile stimuli (STM); Simultaneously with said step of acoustic diffusion, applying said one or more modulated tactile stimuli (STM) to a listener so as to allow a tactile effect of said music or speech or voice audio associated with said received signal; wherein the electrical or electronic signal (S, SE) comes from a receiving device (A), which is suitable for receiving music audio transmitted in electronic form and converting it into the received electrical or electronic signal (S, SE), And wherein the method comprises the further step of generating and diffusing an acoustic signal (SA) corresponding to the music audio such that the acoustic signal (SA) is perceived by the listener while applying the one or more modulated tactile stimuli (STM).

13. A system (1) for providing haptic effects of music or speech or sound audio, comprising: Receiving means (2) configured to receive a signal (SS) representing said music or speech or voice audio; a device (3) for generating tactile stimuli, configured to generate one or more tactile stimuli (ST), wherein the tactile stimuli include pressure waves and acoustic vibrations, the pressure waves and acoustic vibrations being fully synchronized with the audio; wherein the means (3) for generating tactile stimulation comprises one or more vibration generators and / or mechanical wave generators and / or sound wave generators; Sound detection and conversion means (6) configured to detect said sound signal (SS) and to generate a corresponding electric or electronic signal (S, SE) representative of the detected sound signal; a modulation device (4) configured to modulate the one or more tactile stimuli (ST) based on the electric or electronic signal (S, SE) to generate one or more modulated tactile stimuli (STM); tactile stimulus applying means (5) configured to apply said one or more modulated tactile stimuli (STM) to a listener so as to allow a tactile achievement of said music or speech or sound audio associated with the received signal; The receiving device (2) comprises a receiving apparatus (20) operatively connected to a receiving instrument (A), wherein the receiving instrument (A) is adapted to receive music audio transmitted in electronic form and convert it into an electrical signal or an electronic signal (SE), wherein the receiving apparatus (20) is configured to receive the electrical signal or the electronic signal (SE), And wherein, the system (1) further comprises a sound diffusion device (9), which is suitable for diffusing the acoustic signal (SA) corresponding to the music audio so that the acoustic signal (SA) is perceived by the listener while applying the one or more modulated tactile stimuli (STM).

14. The system according to claim 13, wherein: The tactile stimulation applying means (5) comprises a vibration device (5) which is sponge-like or made of another material suitable for transmitting vibrations, the vibration device (5) being operatively connected to the modulation means (4) to receive the generated modulated tactile stimulation (STM) and / or vibrations, Wherein, the vibration device (5) is configured to be placed in contact with one or more parts of the listener's body to apply the modulated tactile stimulation (STM) and / or vibration.

15. System (1) according to any one of claims 13-14, wherein The modulation means (4) is configured to modulate one or more tactile stimuli (ST) by a frequency suitable for a specific part of the listener's body, Furthermore, the tactile stimulation applying device (5) is configured to apply the generated vibration to the specific part of the listener's body after the generated vibration has been modulated.

16. The system (1) according to claim 13, wherein The receiving device (A) comprises a radio or a TV or a telephone or a computer or an iPod or a receiving device associated with a speaker or an audio playback device associated with the projection of a video game or a movie.

17. The system (1) according to any one of claims 13 or 16, further comprising a wireless communication device (7) configured to connect the receiving apparatus (20) and the receiving instrument (A).

18. The system (1) according to claim 13, further comprising electronic signal processing means (8) configured to process the electrical or electronic signal (SE) to obtain a drive signal (SP) for driving the modulation means (4), And among them, The modulation device (4) comprises a modulator (4) configured to modulate the one or more tactile stimuli (ST) by means of the drive signal (SP).

19. The system (1) according to claim 18, wherein The electronic signal processing device (8) is configured to: perform frequency filtering on the electric or electronic signal (SE), and / or shift the spectrum of the electric or electronic signal around a desired center frequency, and / or change or distort the spectrum according to predefined criteria by operating in the frequency domain and / or time domain.

20. A system for providing the perception of music or speech or sound audio enriched by tactile stimulation, wherein the tactile stimulation comprises pressure waves and acoustic vibrations fully synchronized with the audio, the system comprising a system for providing tactile effects of music or speech or sound audio (1) according to claim 13, wherein, The sound diffusing device (9) and the tactile stimulation applying device (5) are configured to diffuse the acoustic signal (SA) and apply one or more modulated tactile stimulations (STM) on a listener, respectively, in a time-dependent manner.

21. The system of claim 20, wherein: The sound diffusing device (9) and the tactile stimulus applying device (5) are configured to diffuse the acoustic signal (SA) and apply one or more modulated tactile stimuli (STM), respectively, in a simultaneous manner.

Citation Information

Patent Citations

  • Transmitting information to a user's body

    US20050132290A1

  • Method and apparatus for generating haptic signal with auditory saliency estimation

    US9640047B2