Method for generating vibration feedback signal, electronic device and storage medium

Abstract

The present invention provides a method for generating a vibration feedback signal, an electronic device, and a storage medium. [Solution] A method for generating a vibration feedback signal includes: generating an audio energy fluctuation trend curve (horizontal axis is the number of frames, vertical axis is the energy fluctuation value) according to audio data; comparing the energy fluctuation value in the energy fluctuation trend curve with a preset energy fluctuation threshold; dividing the audio into a plurality of audio segments according to a comparison result (indicating a tempo change trend corresponding to each audio segment); matching a corresponding vibration feedback signal to each audio segment according to the tempo change trend corresponding to each audio segment; and performing a splicing process on all the vibration feedback signals to obtain a target vibration feedback signal. In this application, the target vibration feedback signal obtained by splicing the vibration feedback signal finally matched to each audio segment is compatible with the tempo change trend of the entire audio, effectively improving the matching rationality between the audio and the vibration feedback signal.

Description

[Technical field]

[0001] The present application relates to the technical field of haptic feedback, and in particular to a method for generating a vibration feedback signal, an electronic device and a storage medium. [Background technology]

[0002] With the development of science and technology and the progress of the times, vibration feedback has been applied to consumer electronic devices such as mobile phones, tablet PCs, game pads, and smart watches, and its application scenarios have evolved from the initial simple vibration presentation to combination with audio, games, videos, etc. For example, different vibration effects can be provided in response to different trigger commands input by the user during a game (e.g., click, long press, slide, etc.), and vibration effects of different strengths can be provided in response to the audio playback during audio playback, bringing users an immersive sensory experience.

[0003] In the prior art, in order to perform vibration feedback of audio, it is necessary to generate a corresponding vibration feedback signal in advance, and the vibration feedback signal is finally input to a vibration feedback device of an electronic device, and the vibration feedback device performs synchronous vibration according to the vibration feedback signal during audio playback, so as to obtain the expected vibration effect. However, currently, most audio realizes vibration feedback by the same vibration feedback signal, and it is difficult to rationally match different types of audio (mainly different tempo speeds) with the same vibration feedback signal. This shows that the matching rationality between audio and vibration feedback signal is poor, and different types of audio cannot give users a completely new sensory experience, and at the same time, it also supports that the vibration effect corresponding to the vibration feedback signal is too monolithic and not rich.

[0004] Therefore, there is a need to improve the method for generating the vibration feedback signal. Summary of the Invention [Problem to be solved by the invention]

[0005] SUMMARY OF THE PRESENT EMBODIMENTS The present invention aims to provide a method for generating a vibration feedback signal, an electronic device and a storage medium for solving the problem of poor matching rationality between audio and a vibration feedback signal in the prior art. [Means for solving the problem]

[0006] In order to solve the above technical problems, in a first aspect of an embodiment of the present application, a method for generating a vibration feedback signal is provided, which includes: generating an audio energy fluctuation trend curve based on audio data, where the energy fluctuation trend curve has a horizontal axis representing a frame number and a vertical axis representing an energy fluctuation value; comparing the energy fluctuation value in the energy fluctuation trend curve with a predetermined energy fluctuation threshold; dividing the audio into a plurality of audio segments based on a comparison result, where the comparison result indicates a tempo change trend corresponding to each audio segment; matching a corresponding vibration feedback signal to each audio segment according to the tempo change trend corresponding to each audio segment; and performing a splicing process on all vibration feedback signals to obtain a target vibration feedback signal.

[0007] In a second aspect of the present embodiment, an electronic device is provided, comprising a memory and at least one processor, wherein the memory is adapted to store at least one program, and the at least one program, when executed by the at least one processor, causes the at least one processor to perform the method for generating a vibration feedback signal as described in the first aspect of the present embodiment.

[0008] In a third aspect of the present application, a computer readable storage medium is provided having executable instructions stored thereon that, when executed, perform the method of generating a vibration feedback signal as described in the first aspect of the present application. Effect of the Invention

[0009] As can be seen from the above description, compared with the prior art, the beneficial effects of the present application are as follows:

[0010] First, generate an audio energy fluctuation trend curve according to audio data, compare the energy fluctuation value in the energy fluctuation trend curve with a preset energy fluctuation threshold, then divide the audio into multiple audio segments according to the comparison result, where the comparison result indicates the tempo change trend corresponding to each audio segment, and finally match a corresponding vibration feedback signal to each audio segment according to the tempo change trend corresponding to each audio segment, splice all the vibration feedback signals to obtain a target vibration feedback signal, and the vibration feedback device in the electronic device can synchronously vibrate according to the target vibration feedback signal during audio playback to achieve a corresponding vibration effect. As can be seen, in the present application, the comparison result of the energy fluctuation value in the energy fluctuation trend curve with the preset energy fluctuation threshold indicates the tempo change trend of the audio, and divides the audio into multiple audio segments according to the tempo change trend of the audio, but for audio segments with different tempo change trends, the vibration feedback signals finally matched thereto are different, that is, the vibration feedback signals finally matched thereto have different vibration effects. This indicates that the target vibration feedback signal obtained by splicing the vibration feedback signal finally matched to each audio segment conforms to the tempo change trend of the entire audio, and effectively improves the matching rationality between the audio and the vibration feedback signal. In addition, different types of audio have different tempo change trends, and in this application, for different types of audio, the corresponding target vibration feedback signals have different vibration effects on the premise of conforming to the respective tempo change trends, which not only improves the richness of the vibration feedback signal, but also allows different types of audio to bring users a completely new sensory experience. [Brief description of the drawings]

[0011] In order to more clearly describe the technical solutions in the prior art or embodiments of the present application, the drawings necessary for describing the prior art or embodiments of the present application are briefly described below. Obviously, the drawings described below are only some embodiments of the present application, not all embodiments, and those skilled in the art can obtain other drawings based on these drawings without making inventive efforts. [Figure 1] FIG. 1 is a flow chart of a method for generating a vibration feedback signal provided by an embodiment of the present application. [Diagram 2] FIG. 2 is a schematic diagram of an energy fluctuation trend curve before correction provided by an embodiment of the present application. [Diagram 3] FIG. 3 is a schematic diagram of an energy accumulation curve provided by an embodiment of the present application. [Figure 4] FIG. 4 is a schematic diagram of the energy curves provided by the examples of the present application. [Diagram 5] FIG. 5 is a schematic diagram of the modified energy variation trend curve provided by the embodiment of the present application. [Figure 6] FIG. 6 is a flow chart of the audio segment partition provided by an embodiment of the present application. [Figure 7] FIG. 7 shows a process from generation to utilization of a vibration feedback signal provided by an embodiment of the present application. [Figure 8] FIG. 8 is a module block diagram of an electronic device provided by an embodiment of the present application. [Figure 9] FIG. 9 is a module block diagram of a computer-readable storage medium provided by an embodiment of the present application. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0012] In order to make the objectives, technical solutions and advantages of the present application clearer and easier to understand, the present application will be described clearly and completely in the following in combination with the embodiments of the present application and corresponding drawings. Herein, the same or similar reference numerals throughout represent the same or similar elements or elements having the same or similar functions. It should be understood that the various embodiments of the present application described below are only used to describe the present application and are not used to limit the present application, that is, other embodiments obtained by those skilled in the art without creative labor based on the various embodiments of the present application fall within the scope of protection of the present application. In addition, the technical features of the various embodiments of the present application described below may be combined with each other as long as there is no conflict between them.

[0013] Referring to FIG. 1, FIG. 1 is a flow chart of a vibration feedback signal generating method provided by an embodiment of the present application, the vibration feedback signal generating method including the following steps 101 to 105.

[0014] Step 101: generating an audio energy variation trend curve according to audio data.

[0015] In the embodiment of the present application, in order to generate a vibration feedback signal conforming to the tempo change trend of the audio, it is necessary to obtain audio data of the audio and generate an audio energy fluctuation trend curve according to the obtained audio data. The schematic diagram of the energy fluctuation trend curve can be referred to in FIG. 2. The horizontal axis is the frame number, and the vertical axis is the energy fluctuation value, which establishes a corresponding relationship between the audio energy fluctuation value and the frame number, that is, shows the dynamic change of the audio energy according to the frame number. In addition, due to a series of standardization operations (e.g., logarithmization, rectification, difference, etc.) when performing energy analysis of the mel spectrogram on the audio data, the directly generated energy fluctuation trend curve is likely to have a certain deviation, so the energy fluctuation trend curve needs to be corrected. FIG. 2 only shows a schematic diagram of the energy fluctuation trend curve before correction, and the specific correction process will be described in detail below.

[0016] Step 102: Comparing the energy fluctuation value in the energy fluctuation trend curve with a preset energy fluctuation threshold value.

[0017] In the embodiment of the present application, after generating an energy fluctuation trend curve of the audio, the energy fluctuation value in the energy fluctuation trend curve is compared with a preset energy fluctuation threshold, that is, in order to subsequently divide the audio according to the comparison result, it is necessary to compare the magnitude of the energy fluctuation value in the energy fluctuation trend curve with the preset energy fluctuation threshold.

[0018] Step 103: Dividing the audio into multiple audio segments according to the comparison result.

[0019] In the embodiment of the present application, it is necessary to compare the energy fluctuation value in the energy fluctuation trend curve with a preset energy fluctuation threshold, and then divide the audio into a plurality of audio segments according to the comparison result. In this case, the energy fluctuation trend curve is first divided into a plurality of mutually connected regions according to the comparison result, and then the audio can be divided into a plurality of chronologically consecutive audio segments (there is a one-to-one correspondence between the plurality of mutually connected regions and the plurality of chronologically consecutive audio segments) based on the plurality of mutually connected regions. Note that the comparison result substantially indicates the tempo change tendency corresponding to each audio segment. If the energy fluctuation trend curve is divided into region A and region B according to the comparison result, and the comparison result shows that each energy fluctuation value in region A is equal to or greater than the preset energy fluctuation threshold, and each energy fluctuation value in region B is smaller than the preset energy fluctuation threshold, the audio is divided into audio segment a corresponding to region A and audio segment b corresponding to region B, and the tempo change in audio segment a is noticeable (i.e., the tempo change is fast), and the tempo change in audio segment b is not noticeable (i.e., the tempo change is slow). This means that if the energy variation value is greater than or equal to a pre-set energy variation threshold, the tempo change of the audio segment is noticeable, and if the energy variation value is less than the pre-set energy variation threshold, the tempo change of the audio segment is not noticeable.

[0020] Step 104: Matching a corresponding vibration feedback signal to each audio segment according to a tempo change tendency corresponding to each audio segment.

[0021] In the embodiment of the present application, the audio is divided into a plurality of audio segments that are consecutive in time series according to the comparison result, and then the corresponding vibration feedback signal needs to be matched to each audio segment according to the tempo change tendency corresponding to each audio segment. In addition, following the example shown in step 103, since the tempo change of the audio segment a is prominent, a vibration feedback signal with a short interval and high frequency needs to be matched to the audio segment a, while the tempo change of the audio segment b is not prominent, a vibration feedback signal with a long interval and low frequency needs to be matched to the audio segment b. Preferably, a signal library including a plurality of types of vibration feedback signals is created in advance, and each vibration feedback signal in the signal library corresponds to a different tempo change tendency. In such a case, it is only necessary to match the corresponding vibration feedback signal from the signal library to each audio segment according to the tempo change tendency corresponding to each audio segment, and it is not necessary to newly design a vibration feedback signal that fits each tempo change tendency for each audio segment.

[0022] Step 105: performing splicing on all vibration feedback signals to obtain a target vibration feedback signal.

[0023] In the embodiment of the present application, the audio is divided into a plurality of audio segments, but the audio is continuous during playback, i.e., no breakpoint occurs between any two adjacent audio segments. This is also the reason why the divided audio segments are continuous in time series. Therefore, it is necessary to match the corresponding vibration feedback signal to each audio segment according to the tempo change tendency corresponding to each audio segment, and then splice all the vibration feedback signals to obtain a complete and continuous target vibration feedback signal, and then the target vibration feedback signal can be input into a vibration feedback device in an electronic device, so that the vibration feedback device can synchronously vibrate according to the target vibration feedback signal during audio playback to obtain a corresponding vibration effect.

[0024] As can be understood, the preset energy variation threshold is not limited to one. When there are n (n is a positive integer greater than 1) preset energy variation thresholds, the n preset energy variation thresholds can constitute n + 1 threshold ranges. Assuming that the preset energy variation thresholds include three, namely x, y, and z, and x < y < z, four threshold ranges can be constituted, which are respectively less than x, greater than or equal to x and less than y, greater than or equal to y and less than z, and greater than or equal to z. In such a case, the energy variation tendency curve can be divided into at least four connected regions according to the threshold range where the energy variation value in the energy variation tendency curve is located, and the energy variation values in the four divided regions are respectively within the four threshold ranges. In this case, the audio is also divided into at least four temporally continuous audio segments, and the four divided audio segments have different tempo change tendencies, and the vibration feedback signals finally matching them are also different from each other. This indicates that the target vibration feedback signal spliced from these four different vibration feedback signals finally has a vibration effect that is at least a combination of four vibration effects. Therefore, the more the number of preset energy variation thresholds, the more the number of divided audio segments, the more the types of vibration feedback signals finally matching each audio segment, and the richer the vibration effect of the target vibration feedback signal spliced by each vibration feedback signal finally becomes.

[0025] As can be seen from the above, in the embodiment of the present application, the tempo change tendency of the audio is indicated by the comparison result between the energy fluctuation value in the energy fluctuation tendency curve and the preset energy fluctuation threshold, and the audio is divided into a plurality of audio segments according to the tempo change tendency of the audio. For audio segments with different tempo change tendencies, the vibration feedback signals finally matched thereto are different, that is, the vibration feedback signals finally matched thereto have different vibration effects. This shows that the target vibration feedback signal obtained by splicing the vibration feedback signal finally matched to each audio segment is compatible with the tempo change tendency of the entire audio, and the matching rationality between the audio and the vibration feedback signal is effectively improved. In addition, different types of audio have different tempo change tendencies, and in the embodiment of the present application, for different types of audio, the corresponding target vibration feedback signals have different vibration effects on the premise of being compatible with the respective tempo change tendencies, which not only improves the richness of the vibration feedback signal, but also allows different types of audio to bring users a completely new sensory experience.

[0026] In one embodiment, step 101 specifically includes: generating an audio energy accumulation curve according to audio data; and generating an audio energy variation trend curve according to the energy accumulation curve. Figure 3 is a schematic diagram of the energy accumulation curve in this embodiment, where the horizontal axis is the frame number and the vertical axis is the energy accumulation value, which establishes the correspondence between the audio energy accumulation value and the frame number, and well reflects the tempo change trend of the entire audio.

[0027] In one specific implementation, "generating an audio energy cumulative curve according to audio data" may specifically include generating an audio energy cumulative curve according to the number of frames, time length, beats per minute, and energy curve of audio. FIG. 4 is a schematic diagram of an energy curve in this specific implementation, in which the horizontal axis is the number of frames, and the vertical axis is the energy value, establishing a correspondence relationship between the energy value of audio and the number of frames. Preferably, the energy curve can adopt a mel spectrogram energy curve (the horizontal axis is the number of frames, and the vertical axis is the energy value of mel spectrogram) to show the original spectrum energy of the audio data. It can be understood that the number of frames, the time length, the beats per minute, and the energy curve are all types of audio data. Of course, in addition to the items listed above, other audio data commonly used in the art may also be included, such as the spectrum of audio (the horizontal axis is the number of frames or the horizontal axis is the time) and the corresponding sampling rate. In this specific implementation, they will not be listed one by one. In addition, the process of inputting audio data requires some data processing for the single / dual channel of audio. In other words, when audio is a dual channel input, the average value of the dual channel data must be read and used as the final input audio data.

[0028] In addition, as described above, due to a series of standardization operations (such as logarithmization, rectification, difference, etc.) when performing energy analysis of mel spectrogram on audio data, the directly generated energy fluctuation trend curve is likely to have a certain deviation, so in this embodiment, the energy envelope of the original spectrum energy of the audio data is obtained, and the energy fluctuation trend curve is modified by the energy envelope, and the schematic diagram of the modified energy fluctuation trend curve is shown in Figure 5. It can be understood that steps 102 and 103 are actually performed by the modified energy fluctuation trend curve, that is, the energy fluctuation value in the modified energy fluctuation trend curve is compared with a preset energy fluctuation threshold, and the modified energy fluctuation trend curve is divided into a plurality of mutually connected regions according to the comparison result, and then the audio is divided into a plurality of time-series continuous audio segments with reference to the mutually connected regions. Here, the division diagram of the modified energy fluctuation trend curve according to the comparison result is shown in Figure 6. In FIG. 6, all energy fluctuation values ​​in the areas selected by the rectangular boxes are greater than or equal to a pre-set energy fluctuation threshold (where the tempo change in the corresponding audio segment is noticeable), and all energy fluctuation values ​​in the areas not selected by the rectangular boxes are less than a pre-set energy fluctuation threshold (where the tempo change in the corresponding audio segment is not noticeable).

[0029] Furthermore, after modifying the energy fluctuation trend curve by the energy envelope, the present embodiment adjusts the preset energy fluctuation threshold according to the maximum energy fluctuation value in the modified energy fluctuation trend curve. As can be understood, the preset energy fluctuation threshold is essentially a preset energy fluctuation value, and the preset energy fluctuation threshold is different according to the type of audio. The preset energy fluctuation threshold may be much smaller than, much larger than, or close to the maximum energy fluctuation value in the pre-modification / post-modification energy fluctuation trend curve, and the preset energy fluctuation threshold may be not the appropriate threshold in the modified energy fluctuation trend curve but the appropriate threshold in the pre-modification energy fluctuation trend curve. Thus, the present embodiment needs to adjust the preset energy fluctuation threshold according to the maximum energy fluctuation value in the modified energy fluctuation trend curve, so that the preset energy fluctuation threshold is a relatively appropriate value, and facilitates the smooth division of the audio thereafter.

[0030] As an embodiment, when there is only one preset energy fluctuation threshold, step 103 may specifically include dividing the audio into at least one first audio segment or at least one second audio segment according to the comparison result, where the first audio segment indicates that the corresponding energy fluctuation value in the energy fluctuation trend curve is equal to or greater than the preset energy fluctuation threshold, the second audio segment indicates that the corresponding energy fluctuation value in the energy fluctuation trend curve is smaller than the preset energy fluctuation threshold, and the tempo change trend corresponding to the first audio segment is greater than that of the second audio segment, i.e., the tempo change of the first audio segment is noticeable, and the tempo change of the second audio segment is not noticeable.

[0031] Also, as described above, when the number of preset energy fluctuation thresholds is n, the n preset energy fluctuation thresholds can form n+1 threshold ranges. In this case, the energy fluctuation trend curve may be divided into at least n+1 regions that are connected to each other according to the threshold ranges in which the energy fluctuation values ​​in the energy fluctuation trend curve are located, and the audio may be further divided into at least n+1 audio segments that are continuous in time series, but this need not be described repeatedly in this embodiment.

[0032] It should be noted that the above embodiment is only a preferred realization of the embodiment of the present application, and is not the only limitation on the correction of the energy variation trend curve, the appropriate adjustment of the preset energy variation threshold, and the specific flow of each step in steps 101 to 105. In contrast, a person skilled in the art can flexibly set according to the actual application scene based on the embodiment of the present application.

[0033] In some embodiments, to simplify the process of matching a corresponding vibration feedback signal to each audio segment, audio segments with short durations may be cancelled to make the process of matching the vibration feedback signal shorter and less difficult.

[0034] In one embodiment, "canceling an audio segment having a short duration" may specifically include incorporating an audio segment having a duration equal to or less than a preset duration threshold into a previous audio segment, or incorporating an audio segment having a duration equal to or less than a preset duration threshold into a next audio segment.

[0035] In another embodiment, "canceling an audio segment with a short duration" specifically includes dividing an audio segment whose duration is equal to or less than a preset duration threshold into two sub-audio segments, and incorporating the two sub-audio segments into the previous audio segment and the next audio segment, respectively.

[0036] It should be noted that the above embodiment is only a preferred implementation of the embodiment of the present application, and is not the only limitation for canceling short audio segments. On the other hand, those skilled in the art can flexibly configure according to actual application scenarios based on the embodiment of the present application.

[0037] As described above, the embodiment of the present application relates to the generation and use of a vibration feedback signal. The process from the generation to the use of a vibration feedback signal is as shown in FIG. 7. The process is specifically as follows: Step 701 of receiving input audio data; Step 702: generating an audio energy accumulation curve according to the number of frames, time length, beats per minute and energy curve of the audio, and obtaining an energy envelope of the original spectral energy of the audio data; Step 703: generating an audio energy fluctuation trend curve according to the energy accumulation curve, and then modifying the energy fluctuation trend curve according to the energy envelope of the original spectrum energy, and adjusting the preset energy fluctuation threshold according to the maximum energy fluctuation value in the modified energy fluctuation trend curve; Step 704: comparing the energy fluctuation value in the modified energy fluctuation trend curve with the adjusted preset energy fluctuation threshold, and dividing the audio into a plurality of audio segments according to the comparison result, where the comparison result indicates a tempo change trend corresponding to each audio segment; Step 705: combining an audio segment whose duration is equal to or less than a preset duration threshold into a previous / next audio segment, or splitting an audio segment whose duration is equal to or less than a preset duration threshold into two, and then combining them into a previous audio segment and a next audio segment, respectively; and step 706, matching corresponding vibration feedback signals to each audio segment according to a tempo change tendency corresponding to each audio segment, and performing splicing processing on all vibration feedback signals to obtain a target vibration feedback signal, in which the target vibration feedback signal is input into a vibration feedback device, so that during the process of the electronic device playing audio, the vibration feedback device can vibrate synchronously with the target vibration feedback signal to achieve a corresponding vibration effect.

[0038] For more detailed flow of each step in steps 701 to 706, please refer to the explanation of the relevant part shown above, and there is no need to repeat the explanation in this embodiment.

[0039] FIG. 8 is a module block diagram of an electronic device provided according to an embodiment of the present application.

[0040] As shown in FIG. 8 , an embodiment of the present application further provides an electronic device 800 including a memory 820 and at least one processor 810, where the memory 820 is used to store at least one program, and when the at least one program is executed by the at least one processor 810, causes the at least one processor 810 to perform the method for generating a vibration feedback signal provided by the embodiment of the present application.

[0041] Further, the electronic device 800 includes a vibration feedback device 830, which is used to vibrate synchronously with a target vibration feedback signal output from the processor 810 during audio playback to achieve a corresponding vibration effect.

[0042] FIG. 9 is a module block diagram of a computer-readable storage medium provided by an embodiment of the present application.

[0043] As shown in FIG. 9 , an embodiment of the present application further provides a computer-readable storage medium 900 having executable instructions 910 stored therein, which, when executed, perform a method for generating a vibration feedback signal provided by an embodiment of the present application.

[0044] The steps of a method or algorithm described in the embodiments disclosed herein may be embodied directly in hardware, in a software module executed by a processor, or in a combination of both. A software module may be embodied in a random access memory (RAM), memory, a read-only memory (ROM), an electrically programmable ROM, an electrically erasable programmable ROM, a register, a hard disk, a removable disk, a CD-ROM, or any other form of storage medium known in the art.

[0045] In the above embodiments, all or part of the invention may be realized by software, hardware, firmware, or any combination thereof. When realized using software, all or part of the invention may be realized in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded or executed on a computer, the flow or function described herein is generated in whole or in part. The computer may be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions may be stored in a computer-readable storage medium, or may be transmitted from one computer-readable storage medium to another computer-readable storage medium. For example, the computer instructions may be transmitted from one website, computer, server, or data center to another website, computer, server, or data center by wire (coaxial cable, optical fiber, digital subscriber line, etc.) or wireless (infrared, radio, microwave, etc.). The computer-readable storage medium may be any available medium accessible by a computer, or may be a data storage device such as a server, data center, etc. that integrates one or more available media. The available media may be magnetic media (eg, floppy disk, hard disk, magnetic tape), optical media (eg, DVD) or semiconductor media (solid state disk), etc.

[0046] In addition, each embodiment of the present application is described in a progressive manner, and each embodiment is described focusing on the differences from other embodiments, and common parts between the embodiments may be referred to each other. Since the product embodiments are similar to the method embodiments, the description thereof is relatively simple, and it is only necessary to refer to the description of some of the method embodiments for related points.

[0047] It should be noted that in the context of this application, terms such as first and second are used only to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply that such an actual relationship or sequence exists between these entities or operations. Furthermore, the terms "comprise", "include", "comprises" or any other variation thereof are meant to cover a non-exclusive inclusion. Thus, a process, method, article or installation that includes a set of elements includes not only those elements, but also other elements not expressly listed or contained in such process, method, article or installation itself. In the absence of further limitations, an element limited by a sentence "comprising a" does not exclude the presence of other identical elements in the process, method, article or installation that includes the element.

[0048] The above description of the disclosed embodiments enables those skilled in the art to realize or use the contents of the present application. Various modifications of these embodiments will be apparent to those skilled in the art, and the general principles defined in the contents of the present application can be realized in other embodiments without departing from the spirit or scope of the contents of the present application. Therefore, the contents of the present application are not limited to these embodiments shown in the contents of the present application, but should be accorded the widest scope consistent with the principles and novel features disclosed in the contents of the present application.

Claims

1. Generate an audio energy fluctuation trend curve according to audio data, the energy fluctuation trend curve having a frame number on the horizontal axis and an energy fluctuation value on the vertical axis; comparing the energy fluctuation value in the energy fluctuation trend curve with a preset energy fluctuation threshold value; Dividing the audio into a plurality of audio segments according to a comparison result, the comparison result indicating a tempo change trend corresponding to each of the audio segments; Matching a corresponding vibration feedback signal to each of the audio segments according to a tempo change trend corresponding to each of the audio segments; and performing a splicing process on all of the vibration feedback signals to obtain a target vibration feedback signal.

13. A method for generating a vibration feedback signal, comprising:

2. Generating an audio energy fluctuation trend curve according to the audio data generating an audio energy accumulation curve according to audio data, the energy accumulation curve having a horizontal axis representing a frame number and a vertical axis representing an energy accumulation value; generating an audio energy fluctuation trend curve according to the energy accumulation curve; 2. The method of claim 1, wherein the vibration feedback signal is generated by:

3. Generating an audio energy accumulation curve from the audio data includes: Generate an energy accumulation curve of the audio according to the number of frames, the time length, the number of beats per minute, and an energy curve, the energy curve including a horizontal axis of the energy curve representing the number of frames and a vertical axis of the energy curve representing the energy value; 3. The method for generating a vibration feedback signal according to claim 2.

4. the energy curve is an energy curve of a mel spectrogram, wherein the horizontal axis of the energy curve of the mel spectrogram is a frame number and the vertical axis is an energy value of the mel spectrogram; 4. The method for generating a vibration feedback signal according to claim 3.

5. Generating an audio energy fluctuation trend curve according to the audio data further includes: Obtaining an energy envelope of an original spectral energy of the audio data; and modifying the energy variation trend curve according to the energy envelope.

4. The method for generating a vibration feedback signal according to claim 3.

6. After correcting the energy variation trend curve according to the energy envelope, further adjusting a preset energy fluctuation threshold value according to a maximum energy fluctuation value in the modified energy fluctuation trend curve; 6. The method for generating a vibration feedback signal according to claim 5.

7. Splitting the audio into multiple audio segments according to the comparison results is and dividing the audio into at least one first audio segment or at least one second audio segment according to a comparison result, where the first audio segment indicates that a corresponding energy fluctuation value in the energy fluctuation trend curve is equal to or greater than a preset energy fluctuation threshold, the second audio segment indicates that a corresponding energy fluctuation value in the energy fluctuation trend curve is smaller than a preset energy fluctuation threshold, and a tempo change trend corresponding to the first audio segment is larger than that of the second audio segment.

2. The method of claim 1, wherein the vibration feedback signal is generated by:

8. Matching a corresponding vibration feedback signal to each of the audio segments according to a tempo change trend corresponding to each of the audio segments includes: matching a corresponding vibration feedback signal from a pre-created signal library to each of the audio segments according to a tempo change trend corresponding to each of the audio segments; 2. The method of claim 1, wherein the vibration feedback signal is generated by:

9. before matching the corresponding vibration feedback signal to each of the audio segments according to a tempo change tendency corresponding to each of the audio segments, further Incorporating the audio segment whose duration is equal to or less than a predefined duration threshold into the previous audio segment or the next audio segment; or Dividing the audio segment, the duration of which is equal to or less than a preset duration threshold, into two sub-audio segments, and incorporating the two sub-audio segments into the previous audio segment and the next audio segment, respectively.

2. The method of claim 1, wherein the vibration feedback signal is generated by:

10. a memory and at least one processor, wherein the memory is adapted to store at least one program, and the at least one program, when executed by the at least one processor, causes the at least one processor to perform the method for generating a vibration feedback signal according to any one of claims 1 to 9.

1. An electronic device comprising:

11. Further, a vibration feedback device is included, and the vibration feedback device is used to vibrate synchronously with a target vibration feedback signal output from the processor during audio playback.

11. The electronic device according to claim 10.

12. 1. A computer-readable storage medium, comprising: The computer-readable storage medium has executable instructions stored thereon, the executable instructions, when executed, performing a method for generating a vibration feedback signal according to any one of claims 1 to 9. A computer-readable storage medium comprising:

Images