Vibration signal generating device, program, and vibration device driving system

Abstract

To provide a vibration signal generating device and the like that can respond to changes in tempo and rhythm of music and allow a user to experience the change.SOLUTION: A vibration signal generating device 30 that generates a vibration signal according to the chord progression of a song being played back includes an analysis unit 31 that analyzes the components of a song from the audio data of the song, and a generation unit 32 that generates a vibration signal using a vibration wave that gradually attenuates according to a time constant that changes according to the tempo included in the components of the song.SELECTED DRAWING: Figure 1

Description

Technical Field

[0001] The present invention relates to a vibration signal generation device that generates a vibration signal according to music reproduced by an audio device, and the like.

Background Art

[0002] For example, Patent Document 1 describes a technique of vibrating a vibration device incorporated in a seat of a moving body such as a vehicle according to music being reproduced by an audio device, and allowing a user to experience it. According to the technique described in Patent Document 1, entertainment can be enhanced by allowing the user to experience vibration as a stimulus while corresponding to the music being reproduced.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] However, according to the technique described in Patent Document 1, a vibration signal is generated using the chord (harmony) progression of music, but changes in the tempo (speed of the music progression) and rhythm of the music are not considered in the generation of the vibration signal. Therefore, it was not sufficient to make the user experience the music while corresponding to the music being reproduced.

[0005] The present invention has been made to solve the above-described problems, and an object thereof is to provide a vibration signal generation device and the like that can also respond to changes in the tempo and rhythm of music and allow the user to experience them.

[0006] Other objects of the present invention will become apparent to those skilled in the art by referring to the aspects and best embodiments exemplified below, as well as the accompanying drawings.

Means for Solving the Problems

[0007] The following exemplifies aspects according to the present invention in order to facilitate understanding of the outline of the present invention.

[0008] A first aspect is a vibration signal generation device that generates a vibration signal according to the chord progression of a music piece being played, including an analysis unit that analyzes the components of the music piece from the audio data of the music piece, and a generation unit that generates the vibration signal using a vibration wave that gradually decays according to a time constant that changes according to the tempo included in the components of the music piece.

[0009] In the first aspect, since the generation unit generates a vibration signal using a vibration wave that gradually decays according to a time constant that changes according to the tempo included in the components of the music piece analyzed from the audio data by the analysis unit, a vibration signal corresponding to the change in the tempo of the music (music) can be generated. Therefore, the user can more naturally experience the vibration according to the chord progression. Here, the "tempo" indicates the length of a beat (a regular beat that can be felt by the rhythm), and on a musical score, for example, as shown in FIG. 3, it is indicated by a speed symbol (♪ = 108) shown in the upper left of the musical score or a numerical value (BPM: beat per minute) representing the number of quarter notes in one minute.

[0010] Also, the "damped wave" refers to a sinusoidal wave that decays exponentially, where the amplitude of the vibration decreases with time and finally becomes zero. An ideal damped wave is a wave that decays exponentially, that is, a sinusoidal wave whose peak amplitude decreases from the initial maximum value towards zero at an exponential rate. The damped wave is represented, for example, by the generation formula (mathematical formula (1)) described later, where τ is the time constant (unit: second), which is the time when the peak amplitude decays to 1 / e = 0.378 of the initial value.

[0011] In a second aspect subordinate to the first aspect, a beat adjustment unit may be further provided, which attaches strong beats and weak beats within one measure according to the beats included in the musical composition elements output from the analysis unit, and adjusts the output level of the vibration signal according to the attached strong beats and weak beats when the chord included in the musical composition elements within the one measure changes.

[0012] In the second aspect, the adjustment unit attaches strong beats (strong) and weak beats (weak) within one measure according to the beats included in the musical composition elements output from the analysis unit (see, for example, FIGS. 4(a) and 4(b)). When the chord included in the musical composition elements within one measure changes, the output level of the vibration signal is adjusted according to the attached strong beats and weak beats. Therefore, by adding strength and weakness to the vibration signal within one measure, the affinity between the reproduced music and the vibration can be enhanced. Accordingly, the user can more naturally experience the vibration.

[0013] Here, the "beat" is the basic unit that forms the rhythm of music, which is a collection of a certain number of beats and consists of a combination of strong beats and weak beats. For example, if the tempo mark described at the upper left of the musical score is "♪ = 60", it means the tempo at which 60 quarter notes enter in one minute, indicating that one beat is 1 second. Also, "one measure" refers to the box divided by beats for easy reading of the musical score. A measure has a length that allows a plurality of notes to be placed, and generally, its length is determined by the beats. For example, in 4 / 4 time, it means that 4 quarter notes are in one measure for 4 beats.

[0014] In a third aspect subordinate to the first aspect, a beat adjustment unit may be further provided, which adjusts the output level of the vibration signal according to the crescendo and diminuendo signs indicating the gradually changing strength of the vibration in the target section included in the musical composition elements output from the analysis unit.

[0015] In the third aspect, the adjustment unit adjusts the output level of the vibration signal according to the dynamics (e.g., a crescendo in which the intensity of the vibration gradually increases in the target section (e.g., as shown in FIG. 5(a), the volume gradually increases from the soft piano (p) to the loud forte (f)), or a diminuendo in which the intensity of the vibration gradually decreases in the target section (e.g., as shown in FIG. 5(b), the volume gradually decreases from the loud forte (f) to the soft piano (p)) included in the musical elements of the music output from the analysis unit, and generates a vibration signal that matches the dynamics of the reproduced music, so that the user can experience vibrations that match the excitement of the music.

[0016] The fourth aspect is a program for a vibration signal generation device that generates a vibration signal according to the chord progression of the music being played, causing a processor included in the vibration signal generation device to execute a process of analyzing musical elements from the audio data of the music, and a process of generating the vibration signal using a vibration wave that gradually decays according to a time constant that changes according to the tempo included in the musical elements of the music.

[0017] In the fourth aspect, for example, the processor included in the vibration signal generation device executes a program recorded in an externally attached or built-in memory of the vibration signal generation device, so that the vibration signal generation device can generate a vibration signal using a vibration wave that gradually decays according to a time constant that changes according to the tempo included in the musical elements of the music analyzed from the audio data. Therefore, a vibration signal corresponding to the change in the tempo of the music can also be generated, and the user can more naturally experience the vibrations generated by the chord progression.

[0018] The fifth aspect is a vibration device drive system that generates a vibration signal according to the chord progression of a sound source and drives a vibration device, including the sound source, a vibration signal generation device that analyzes musical elements from the audio data of the sound source and generates the vibration signal using a vibration wave that gradually decays according to a time constant that changes according to the tempo included in the musical elements of the music, and the vibration device driven by the vibration signal generated by the vibration signal generation device.

[0019] In the fifth aspect, the vibration signal generation device analyzes the musical components from the audio data of the sound source, and uses a vibration wave that gradually decays according to a time constant that changes according to the tempo included in the musical components of the music to generate the vibration signal and drive the vibration device. Therefore, a vibration signal corresponding to the change in the tempo of the music can be generated, and thus, the user can more naturally experience the vibration according to the chord progression.

Brief Description of the Drawings

[0020]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Embodiments for Carrying Out the Invention

[0021] The best embodiments described below are used for easily understanding the present invention. Therefore, those skilled in the art should note that the present invention is not unduly limited by the embodiments described below (hereinafter referred to as the present embodiments).

[0022] (Configuration of Embodiment) FIG. 1 is a block diagram showing the configuration of a vibration device drive system 100 to which the vibration signal generation device 30 of the present embodiment is applied.

[0023] As shown in FIG. 1, the vibration device drive system 100 generates a vibration signal according to the chord progression of the sound source 10 and drives the vibration device 20. For example, it is assumed to be used in a seat of a moving body (see Patent Document 1), a chair used in facilities such as a movie theater, a theater, a concert hall, or a gaming chair for individuals.

[0024] The vibration device drive system 100 includes a sound source 10 such as a CD or an audio file, and a vibration signal generation device 30 that analyzes the components of the music from the audio data of the sound source 10 and generates a vibration signal using a vibration wave that gradually decays according to a time constant that changes according to the tempo included in the components of the music, and a vibration device 20 such as a speaker built into a seat of a moving body, which is driven by the vibration signal generated by the vibration signal generation device 30.

[0025] The vibration signal generation device of the present embodiment is a vibration signal generation device 30 that generates a vibration signal according to the chord progression of a music during playback of a sound source, and includes at least an analysis unit 31 that analyzes the components of the music from the audio data of the music, and a generation unit 32 that generates a vibration signal using a vibration wave that gradually decays according to a time constant that changes according to the tempo included in the components of the music.

[0026] The analysis unit 31 recognizes, for example, the chord progression, beat position, and music structure such as A melody / sabi in the music from the audio data of the music. It estimates the beat (sound repeated at regular intervals) position from the audio data obtained by playing back the sound source 10, and analyzes the components of the music such as "chord", "tempo", "meter", and "dynamics" from the feature amount data and outputs them to the generation unit 32. The analysis unit 31 can analyze the components of the music by machine learning using a high-precision analysis model.

[0027] The generation unit 32 generates a vibration signal using a vibration wave that gradually decays according to a time constant that changes according to the tempo included in the components of the music, and supplies it to the output unit 34. The generation unit 32 outputs a damped wave that matches the "tempo" of the music analyzed by the analysis unit 31. At this time, the time constant of the damped wave is variable according to the tempo. For example, when the generation unit 32 generates a vibration signal according to the music exemplified in the musical score of FIG. 3, since a tempo mark "♪=108" (the speed at which 108 quarter notes enter in one minute) indicating the speed is shown in the upper left of the musical score, the time of a quarter note is 60 seconds / 108 = approximately 0.56 seconds, and the first chord "D" outputs a vibration signal that decays in about 2.24 seconds for 8 eighth notes (equivalent to 4 quarter notes). The generation formula of the damped wave used for this purpose is shown in the following formula (1).

[0028] [Number]

[0029] Here, t is time (unit: second), Vp is the peak amplitude of the wave, ω = 2πf is the angular frequency of the amplitude (unit: radian per second), f is the vibration frequency (unit: hertz), α = 1 / τ is the decay rate of the vibration wave, and τ is the time constant of the vibration wave (unit: second), that is, the time when the peak amplitude decays to 1 / e = 0.378 of the initial value.

[0030] The vibration signal generation device 30 may further include an adjustment unit 33 that attaches strong beats and weak beats within one measure according to the beats included in the components of the music output from the analysis unit 31, and adjusts the output level of the vibration signal according to the attached strong beats and weak beats when the chords included in the components of the music change within one measure. The adjustment unit 33 can also adjust the output level of the vibration signal according to the crescendo / decrescendo, which gradually indicates the intensity of the vibration, included in the components of the music output from the analysis unit 31 in the target section.

[0031] The output unit 34 can output the vibration signal generated by the generation unit 32 and the vibration signal according to the output level generated by the adjustment unit 33 to the vibration device 20 only when the power of the vibration device 20 is ON.

[0032] Note that, in order to perform the above-described control, the vibration signal generation device 30 of the present embodiment is equipped with, for example, a processor with a built-in memory (ROM / RAM) or an externally attached memory. The processor reads and sequentially executes the program recorded in the memory to analyze the components of the music from the audio data of the music, and realizes the function of generating a vibration signal using a vibration wave that gradually decays according to a time constant that changes according to the tempo included in the components of the music. Further, at least a part of the above-described functions can also be realized by hardware such as an FPGA (Field Programmable Gate Array) or a logic circuit, without relying on the processor.

[0033] (Operation of the Embodiment) FIG. 2 is a flowchart showing the processing procedure of the vibration signal generation device 30 of the present embodiment. FIGS. 3 to 5 are diagrams cited to explain the operation of the vibration signal generation device 30 of the present embodiment. FIG. 3 shows an example of the musical score of the music to be played. FIG. 4(a) shows the case of 4 / 4 time signature regarding the strength and weakness of the vibration within one measure, FIG. 4(b) shows the case of 3 / 4 time signature, FIG. 5(a) shows the case of a crescendo in which the strength of the vibration gradually increases in the target section, and FIG. 5(b) shows the case of a decrescendo in which the strength of the vibration gradually decreases in the target section.

[0034] Hereinafter, the operation of the vibration signal generation device 30 of the present embodiment shown in FIG. 1 will be described in detail with reference to FIGS. 2 to 5.

[0035] In FIG. 2, the vibration signal generation device 30 of the present embodiment first sets the value "0" to a counter i that monitors "measures" which are processing units (step ST101), and instructs the sound source 10 to play a music piece (step ST102). Note that the counter i used here is a software counter set in the program of the vibration signal generation device 30, and the counting is executed by a built-in processor. Subsequently, the analysis unit 31 updates (+1) the value (i) of the counter i (step ST103), acquires audio data for one measure from the played sound source 10, and analyzes its components (step ST104). As described above, the component analysis is executed based on machine learning using a high-precision analysis model, and the components of the music piece such as "chord", "tempo", "beat", and "dynamics" obtained by the analysis are transferred to the generation unit 32.

[0036] Based on the components of the music piece analyzed by the analysis unit 31, the generation unit 32 generates a vibration signal using a damped wave according to the above-described formula (1) (step ST105). For example, if the analyzed chord is "D", the harmony is "re + fa# + la", and when converted to frequencies, it becomes 36.708 Hz + 46.249 Hz + 55 Hz. The sine waves of these three frequencies become the base vibration frequencies, and attenuation corresponding to the "tempo" can be performed on this vibration signal. The generation unit 32 outputs a damped wave adjusted to the "tempo" of the music piece analyzed by the analysis unit 31. At this time, the time constant of the damped wave is variable according to the "tempo".

[0037] For example, when the generation unit 32 generates a vibration signal according to a music piece shown as an example in FIG. 3, since a tempo mark "♪ = 108" indicating the speed is shown at the upper left of the musical score using a note of one beat length, the time of a quarter note is 60 seconds / 108 = approximately 0.56 seconds, and the first chord "D" outputs a vibration that decays in about 2.24 seconds for 8 eighth notes (4 quarter notes). The generation formula of the damped wave used for this purpose is shown by the above-described formula (1), where τ is the time constant of the damped wave (unit: second).

[0038] In addition to the "tempo" analyzed by the analysis unit 31, the generation unit 32 can also perform adjustments based on "beat" and "dynamics". That is, according to the beats included in the musical composition elements output from the analysis unit 31, strong beats and weak beats are assigned within one measure (for example, refer to FIG. 4). When the chords included in the musical composition elements within one measure change, the output level of the vibration signal is adjusted according to the assigned strong beats and weak beats (step ST106).

[0039] In step ST106, the adjustment unit 33 can further adjust the output level of the vibration signal according to the dynamics marks indicating the gradually changing intensity of vibration in the target section included in the musical composition elements output from the analysis unit 31. For example, for a crescendo where the intensity of vibration gradually increases in the target section (for example, as shown in FIG. 5(a), the volume is gradually increased from the soft piano (p) to the loud forte (f)), or for a diminuendo where the intensity of vibration gradually decreases in the target section (for example, as shown in FIG. 5(b), the volume is gradually decreased from the loud forte (f) to the soft piano (p)), the output level of the vibration signal can be adjusted accordingly.

[0040] Note that the analysis unit 31 executes the above-described analysis in units of one measure until the value of the counter i indicates "n" (for all the measures constituting the music), and outputs the result to the generation unit 32. The generation unit 32 generates a vibration signal each time according to the analysis result and transfers it to the output unit 34. When the value "n" of the counter i indicates the total number of measures (step ST107 "YES"), the output unit 34 outputs the vibration signal generated by the generation unit 32 and the vibration signal adjusted by the adjustment unit 33 to the vibration device 20 (step ST108). When the counter i is less than the total number of measures "n" (step ST107 "NO"), the analysis unit 31, the generation unit 32, and the adjustment unit 33 repeatedly execute the processing after step ST103.

[0041] (Effects of the Embodiment) As described above, the vibration signal generation device 30 of the present embodiment is, for example, as shown in FIG. 1, a vibration signal generation device 30 that generates a vibration signal according to the chord progression of the music being played. And the vibration signal generation device 30 has an analysis unit 31 that analyzes the components of the music from the audio data of the music, and a generation unit 32 that generates a vibration signal using a vibration wave that gradually decays according to a time constant that changes according to the tempo included in the components of the music.

[0042] In the vibration signal generation device 30 of the present embodiment, since the generation unit 32 generates a vibration signal using a vibration wave that gradually decays according to a time constant that changes according to the tempo included in the components of the music analyzed from the audio data by the analysis unit 31, it is possible to generate a vibration signal corresponding to the change in the tempo of the music (music). Therefore, the user can more naturally experience the vibration according to the chord progression. Here, the "damped wave" refers to a sinusoidal wave that decays exponentially, where the amplitude of the vibration decreases with time and finally becomes zero. An ideal damped wave is a wave that decreases exponentially, that is, a sinusoidal wave whose peak amplitude decreases from the initial maximum value towards zero at an exponential rate. For example, it is represented by the above-mentioned formula (1), where τ is the time constant (in seconds), that is, the time when the peak amplitude decays to 1 / e = 0.378 of the initial value.

[0043] Also, in the vibration signal generation device 30 of the present embodiment, the adjustment unit 33 attaches strong beats (strong) and weak beats (weak) within one measure according to the beat included in the components of the music output from the analysis unit 31 (see, for example, FIGS. 4(a) and (b)). When the chord included in the components of the music changes within one measure, the output level of the vibration signal is adjusted according to the attached strong beats and weak beats. Therefore, by adding strength and weakness to the vibration signal within one measure, the affinity between the played music and the vibration can be enhanced, so that the user can more naturally experience the vibration.

[0044] In addition, in the vibration signal generation device 30 of the present embodiment, the adjustment unit 33 adjusts the output level of the vibration signal according to the dynamics (for example, a crescendo in which the intensity of vibration gradually increases in a target section (for example, as shown in FIG. 5(a), the volume is gradually increased from a soft piano (p) to a forte (f)), or a diminuendo in which the intensity of vibration gradually decreases in a target section (for example, as shown in FIG. 5(b), the volume is gradually decreased from a forte (f) to a soft piano (p))) included in the components of the music output from the analysis unit 31. Therefore, by generating a vibration signal according to the dynamics of the reproduced music, the user can experience vibrations in accordance with the excitement of the music.

[0045] In addition, the program of the present embodiment is a program for a vibration signal generation device 30 that generates a vibration signal according to the chord progression of the music being played. And that program causes a processor included in the vibration signal generation device 30 to execute, for example, a process of analyzing the components of the music from the audio data of the music (steps ST101 to ST104) as shown in FIG. 2, and a process of generating a vibration signal using a vibration wave that gradually decays according to a time constant that changes according to the tempo included in the components of the music (step ST105).

[0046] In the program of the present embodiment, the processor included in the vibration signal generation device 30 executes the program recorded in a memory externally attached or built into the vibration signal generation device, whereby the vibration signal generation device 30 can generate a vibration signal using a vibration wave that gradually decays according to a time constant that changes according to the tempo included in the components of the music analyzed from the audio data. Therefore, a vibration signal corresponding to the change in the tempo of the music can also be generated, and the user can more naturally experience the vibrations generated by the chord progression.

[0047] Also, as shown in FIG. 1 for example, the vibration device drive system of the present embodiment is a vibration device drive system 100 that generates a vibration signal according to the chord progression of a sound source 10 and drives a vibration device 20. The vibration signal drive system 100 includes a sound source 10, and a vibration signal generation device 30 that analyzes the components of a music piece from the audio data of the sound source 10 and generates a vibration signal using a vibration wave that gradually decays according to a time constant that changes according to the tempo included in the components of the music piece, and a vibration device 20 that is driven by the vibration signal generated by the vibration signal generation device 30.

[0048] In the vibration device drive system 100 of the present embodiment, the vibration signal generation device 30 analyzes the components of a music piece from the audio data of the sound source 10 and generates a vibration signal using a vibration wave that gradually decays according to a time constant that changes according to the tempo included in the components of the music piece, and drives the vibration device 20. Therefore, it is possible to generate a vibration signal corresponding to the change in the tempo of the music piece, and thus, it is possible to provide a vibration device drive system 100 that can make the user feel the vibration according to the chord progression more naturally.

[0049] Note that although the vibration device drive system 100 of the present embodiment has been described as one in which the vibration signal generation device 30 analyzes the components of a music piece from the audio data of the sound source 10 and generates a vibration signal using a vibration wave that gradually decays according to a time constant that changes according to the tempo included in the components of the music piece and drives the vibration device 20, by combining it with a "score acquisition device" that recognizes the performance content of a music piece based on the sound source 10 (CD or audio file) and automatically generates a musical score, the components of the music piece analyzed by the vibration signal generation device 30 (analysis unit 31) can be synchronized with the sound source 10, and the user can feel the vibration according to the chord progression more naturally in real time. The mechanism of the "score acquisition device" that recognizes the performance content of a music piece based on a CD or audio file and automatically generates a musical score is described in detail, for example, in Japanese Patent No. 6735100.

[0050] The present invention is not limited to the above-described exemplary embodiments, and those skilled in the art will be able to easily modify the above-described exemplary embodiments to the extent included in the scope of the claims.

Explanation of Signs

[0051] 10 ··· Sound source, 20 ··· Vibration device, 30 ··· Vibration signal generation device, 31 ··· Analysis unit, 32 ··· Generation unit, 33 ··· Adjustment unit, 34 ··· Output unit

Claims

1. A vibration signal generation device that generates a vibration signal according to the chord progression of a music piece being played, comprising: an analysis unit that analyzes the components of the music piece from the audio data of the music piece; a generation unit that generates the vibration signal using a vibration wave that gradually decays according to a time constant that changes according to the tempo included in the components of the music piece. A vibration signal generation device having the above.

2. The vibration signal generation device according to claim 1, further comprising an adjustment unit that attaches strong beats and weak beats within one measure according to the beats included in the components of the music piece output from the analysis unit, and adjusts the output level of the vibration signal according to the attached strong beats and weak beats when the chord included in the components of the music piece changes within the one measure.

3. The vibration signal generation device according to claim 1, further comprising an adjustment unit that adjusts the output level of the vibration signal according to the forte-piano markings indicating the strength of vibration gradually in a target section included in the components of the music piece output from the analysis unit.

4. A program for a vibration signal generation device that generates a vibration signal according to the chord progression of a music piece being played, the program causing a processor included in the vibration signal generation device to: perform a process of analyzing the components of the music piece from the audio data of the music piece; perform a process of generating the vibration signal using a vibration wave that gradually decays according to a time constant that changes according to the tempo included in the components of the music piece.

5. A vibration device drive system that generates a vibration signal according to the chord progression of a sound source and drives a vibration device, comprising: the sound source; a vibration signal generation device that analyzes the components of a music piece from the audio data of the sound source and generates the vibration signal using a vibration wave that gradually decays according to a time constant that changes according to the tempo included in the components of the music piece; the vibration device driven by the vibration signal generated by the vibration signal generation device. A vibration device drive system having the above. ​

Images