Audio-based Dynamic Adjustment Vibration Feedback Method, System and Related Devices

The dynamic adjustment of vibration feedback methods addresses the real-time limitations of existing technologies by self-adaptively matching audio power envelope characteristics, ensuring accurate and timely vibration feedback.

JP7711358B2Active Publication Date: 2025-07-23AAC ACOUSTIC TECH (SHANGHAI) CO LTD
View PDF 5 Cites 0 Cited by

Patent Information

Application Number
JP2023532247
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Priority Date
2022-12-29
Filing Date
2023-01-17
Publication Date
2025-07-23
Estimated Expiration
2043-01-17

AI Technical Summary

Technical Problem

Existing music vibration feedback methods require large model occupancy and long conversion times, making them unsuitable for real-time applications.

Method used

A dynamic adjustment vibration feedback method that tracks audio instantaneous power envelope characteristics to self-adaptively adjust vibration thresholds and amplitudes, generating vibration feedback signals that match the audio in real time.

Benefits of technology

Enables real-time, accurate vibration feedback that enhances user experience by dynamically adjusting vibration signals to match audio power characteristics.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007711358000001
    Figure 0007711358000001
  • Figure 0007711358000002
    Figure 0007711358000002
  • Figure 0007711358000003
    Figure 0007711358000003
Patent Text Reader

Abstract

The present invention relates to the field of audio technology, and in particular to an audio dynamically adjusted vibration feedback method, system and related devices. The method includes: obtaining original audio data, setting a preset signal vibration threshold, and tracking the audio instantaneous power envelope of the original audio data to obtain the corresponding instantaneous power characteristic, and making a self-adaptive adjustment to the preset signal vibration threshold according to the instantaneous power characteristic, dividing the vibration range of the original audio data according to the instantaneous power characteristic and the signal amplitude threshold, and dynamically adjusting the vibration signal amplitude envelope of the original audio data to generate a vibration drive signal, and outputting vibration feedback according to the vibration drive signal.Compared with the prior art, the present invention dynamically adjusts the vibration drive signal amplitude according to the audio itself, completes the real-time vibration feedback of audio, and achieves the technical effect of obtaining matching vibration feedback according to audio data in real time, and enhances the user experience of vibration feedback.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the field of audio technology, and particularly to a dynamic adjustment vibration feedback method, system and related devices by audio.

Background Art

[0002] Music vibration feedback has been gradually applied to ringtones, music playback software, video music playback, etc. Music has become richer and more interesting tactile experience based on traditional voice playback.

[0003] In the prior art, music vibration feedback often adopts a realization method by neural network, with a large model occupancy space, long conversion time, and it is necessary to call vibration files from the converted library to complete music vibration feedback during application, which is difficult to meet the needs of the real-time scene in the market.

[0004] Therefore, in order to meet the need for real-time and accurate vibration feedback, it is necessary to provide a real-time audio vibration feedback method.

Summary of the Invention

Problems to be Solved by the Invention

[0005] The technical problem to be solved by the present invention is to provide a method capable of generating vibration output matching music in real time.

Means for Solving the Problems

[0006] To solve the above technical problems, on the first aspect, the present invention provides a dynamic adjustment vibration feedback method by audio. The vibration feedback method includes obtaining original audio data, setting a preset signal vibration threshold, tracking the audio instantaneous power envelope of the original audio data to obtain corresponding instantaneous power characteristics, and performing self-adaptive adjustment on the preset signal vibration threshold according to the instantaneous power characteristics to obtain a signal vibration threshold. Then, dividing the vibration range of the original audio data according to the instantaneous power characteristics and the signal amplitude threshold, and dynamically adjusting the vibration signal amplitude envelope of the original audio data to generate a vibration drive signal. Finally, outputting vibration feedback by the vibration drive signal.

[0007] Preferably, the step of setting a preset signal vibration threshold, tracking the audio instantaneous power envelope of the original audio data to obtain corresponding instantaneous power characteristics, and performing self-adaptive adjustment on the preset signal vibration threshold according to the instantaneous power characteristics to obtain a signal vibration threshold is as follows: In the i-th frame, the preset signal vibration threshold is T i (1). At the t-th moment of the original audio data, the preset signal vibration threshold is T i (t), and the instantaneous power characteristic obtained by tracking the audio instantaneous power envelope is C i (t). Set a ratio r, and adjust the instantaneous power characteristic C i (t) according to the ratio to obtain a second instantaneous power characteristic C i `(t), where C i `(t)=r·C i (t). Compare the magnitude of the second instantaneous power characteristic C i `(t) with the signal vibration threshold T i (t - 1) at the (t - 1)-th moment, and perform self-adaptive adjustment on T i (t), where C iWhen `(t) is T i and is greater than (t - 1), the preset signal oscillation threshold T i adjusts (t) upward, and C i When `(t) is T i and is less than (t - 1), the preset signal oscillation threshold T i adjusts (t) downward, including

[0008] Preferably, the range of the ratio r is [0, 1].

[0009] Preferably, the step of dividing the oscillation range of the original audio data by the instantaneous power characteristic and the signal amplitude threshold, and dynamically adjusting the oscillation signal amplitude envelope of the original audio data to generate an oscillation drive signal includes Among the original audio data, C i compares `(t) with T i (t), where C i When `(t) is greater than T i (t), dividing the time region where the corresponding t-th moment is located into the oscillation range With the resonance frequency of the vibrator being f and the rated voltage being vrms, filling the single-frequency short-long signal of the resonance frequency f and the rated voltage vrms corresponding to the length of the region and the magnitude of the power within the region into the corresponding oscillation range, and adjusting the oscillation signal amplitude envelope by the audio instantaneous power envelope to generate the oscillation drive signal within the oscillation range, including

[0010] Preferably, the step of outputting oscillation feedback by the oscillation drive signal includes Filling the short-long signal of the oscillation signal amplitude envelope frame by frame within the time region of the original audio data, obtaining the oscillation drive signal that completely corresponds to the original audio data, and retaining the power characteristic and threshold of the last bit of each frame as the initial value of the next frame Outputting the oscillation drive signal to the vibrator to generate oscillation feedback, including

[0011] Preferably, when acquiring the original audio data, the original audio data is divided at a preset time interval, and the original audio data corresponding to each preset time interval is taken as one frame.

[0012] Preferably, when acquiring the original audio data, it is determined whether the first frame of the original audio data is single-channel data. If it is single-channel data, the next each frame data is directly acquired. If it is not single-channel data, when acquiring the next each frame data, the average value of the data of different channels in the original audio data is taken for acquisition.

[0013] On the second aspect, the present invention further provides a dynamic adjustment vibration feedback system by audio, including an audio acquisition module for acquiring original audio data, setting a preset signal vibration threshold, tracking the audio instantaneous power envelope of the original audio data to obtain the corresponding instantaneous power characteristics, and performing self-adaptive adjustment on the preset signal vibration threshold according to the instantaneous power characteristics to obtain a threshold adjustment module for obtaining the signal vibration threshold, an amplitude adjustment module for dividing the vibration range of the original audio data according to the instantaneous power characteristics and the signal vibration threshold, and adjusting the vibration signal amplitude envelope of the original audio data to generate a vibration drive signal, and a vibration feedback module for outputting vibration feedback by the vibration drive signal.

[0014] In the third aspect, the present invention further provides a computer device, including a processor, a memory, and a computer program stored in the memory and executable by the processor. When the processor executes the computer program, it realizes the steps in the audio-based dynamic adjustment vibration feedback method according to any one of the above items.

[0015] In the fourth aspect, the present invention further provides a computer-readable storage medium, in which a computer program is stored. When the computer program is executed by a processor, it realizes the steps in the audio-based dynamic adjustment vibration feedback method according to any one of the above items.

Advantages of the Invention

[0016] Compared with the prior art, in the audio-based dynamic adjustment vibration feedback method of the present invention, audio is loaded frame by frame, data is analyzed to obtain its power envelope characteristics, self-adaptive vibration threshold adjustment is performed based on the obtained characteristics, and further, the relationship between the characteristics and the threshold is judged to match the vibration drive signal corresponding to the vibration range. Thereby, the amplitude of the vibration drive signal is dynamically adjusted according to the audio itself, the real-time vibration feedback of the audio is completed, and the technical effect of obtaining the vibration feedback matched by the audio data in real time is realized, improving the user experience of the vibration feedback.

Brief Description of the Drawings

[0017] To more clearly explain the technical solutions in the embodiments of the present invention, the following briefly describes the drawings required for the description of the embodiments. Obviously, the following-described drawings are only some embodiments of the present invention. A person skilled in the art can obtain other drawings based on these drawings without creative labor. Among them,

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

DETAILED DESCRIPTION OF THE INVENTION

[0018] Hereinafter, the technical solutions in the embodiments of the present invention will be clearly and completely described with reference to the drawings in the embodiments of the present invention. Obviously, the described embodiments are only a part of the embodiments of the present invention, not all of them. All other embodiments obtained by those skilled in the art without creative labor based on the embodiments of the present invention shall fall within the protection scope of the present invention.

[0019] FIG. 1 is a flowchart of an audio-based dynamic adjustment vibration feedback method provided by an embodiment of the present invention. As shown in FIG. 1, the vibration feedback method includes the following steps.

[0020] S1: Obtain original audio data.

[0021] Specifically, the method for obtaining the original audio data in the embodiments of the present invention includes, but is not limited to, obtaining from existing audio data, or extracting in real time by methods such as tape recorders or video shooting and then converting it into an independent audio data file or the like.

[0022] Preferably, when obtaining the original audio data, the original audio data is divided at a preset time interval, and the original audio data corresponding to each preset time interval is regarded as one frame. For example, the original audio data is divided at an interval of 200 ms, and the original audio data is divided into a processing part with 200 ms as one frame.

[0023] Preferably, when obtaining the original audio data, it is determined whether the first frame of the original audio data is single-channel data. If it is single-channel data, the subsequent frame data is directly obtained. If it is not single-channel data, when obtaining the subsequent frame data, the average value of the data of different channels in the original audio data is taken for acquisition.

[0024] S2: Set a preset signal oscillation threshold, and track the audio instantaneous power envelope of the original audio data to obtain the corresponding instantaneous power characteristics, and perform self-adaptive adjustment on the preset signal oscillation threshold according to the instantaneous power characteristics to obtain the signal oscillation threshold.

[0025] Preferably, the step of setting a preset signal oscillation threshold, tracking the audio instantaneous power envelope of the original audio data, obtaining the corresponding instantaneous power characteristics, and performing self-adaptive adjustment on the preset signal oscillation threshold according to the instantaneous power characteristics to obtain the signal oscillation threshold includes the following sub-steps.

[0026] S21: In the i-th frame, the preset signal oscillation threshold is T i (1), and at the t-th moment of the original audio data, the preset signal oscillation threshold is T i (t), and the instantaneous power characteristic C obtained by tracking the audio instantaneous power envelope i (t) is used.

[0027] Specifically, referring to FIG. 2, FIG. 2 is a diagram showing the relationship between the instantaneous power envelope, the instantaneous power characteristic, and the preset signal oscillation threshold provided by an embodiment of the present invention. The instantaneous power characteristic C i (t) includes at least the following power information, for example, the data of the i-th frame in the original audio data and the characteristic energy of the instantaneous power mu . The instantaneous power characteristic C obtained by monitoring performing the following on the audio instantaneous power envelope i (t) has continuous characteristics and can be represented as a continuous curve.

[0028] S22: Set the ratio r, and adjust the instantaneous power characteristic C i (t) according to the ratio to obtain the second instantaneous power characteristic C i `(t), where C i `(t)=r·C i (t).

[0029] S23: Compare the magnitude of the second instantaneous power characteristic C i `(t) with the signal oscillation threshold T i (t - 1) at the (t - 1)-th moment, and perform self-adaptive adjustment on T i (t). Here, C i `(t) is greater than T i (t - 1), the preset signal oscillation threshold T i (t) is adjusted upward. C i `(t) is less than T iWhen it is smaller than (t - 1), the preset signal oscillation threshold value T i Adjust (t) downward.

[0030] In an embodiment of the present invention, the signal oscillation threshold value is set so that the oscillation drive signal becomes more matching compared to the power of the original audio data. Therefore, the preset width can be adjusted according to the width of the instantaneous power characteristic itself.

[0031] Preferably, the range of the ratio r is [0, 1].

[0032] S3: Divide the oscillation range of the original audio data by the instantaneous power characteristic and the signal amplitude threshold value, and dynamically adjust the oscillation signal amplitude envelope of the original audio data to generate an oscillation drive signal.

[0033] Preferably, the step of dividing the oscillation range of the original audio data by the instantaneous power characteristic and the signal oscillation threshold value, and dynamically adjusting the oscillation signal amplitude envelope of the original audio data to generate the oscillation drive signal includes the following sub-steps.

[0034] S31: Among the original audio data, C i `(t) and T i Compare (t), and C i If `(t) is greater than T i (t), divide the time region where the corresponding t-th moment is located into the oscillation range.

[0035] S32: Let the resonance frequency of the vibrator be f and the rated voltage be vrms. Fill the resonance frequency f and the short-long signal of a single frequency of the rated voltage vrms into the corresponding oscillation range according to the length of the region and the magnitude of the power within the region, and adjust the oscillation signal amplitude envelope by the audio instantaneous power envelope to generate the oscillation drive signal within the oscillation range.

[0036] Specifically, referring to FIG. 3, FIG. 3 is a diagram showing the amplification of the vibration drive signal provided by an embodiment of the present invention. Compared with the amplitude of the original vibrator, after amplitude adjustment is performed by a single-frequency signal of the resonance frequency f, the final vibration drive signal has a higher amplitude, and the variation range is also reduced, and the vibration feedback becomes more continuous.

[0037] S4: Output vibration feedback by the vibration drive signal.

[0038] Preferably, the step of outputting vibration feedback by the vibration drive signal includes the following sub-steps.

[0039] S41: Fill the short-long signal of the vibration signal amplitude envelope for each frame within the time domain of the original audio data, obtain the vibration drive signal that exactly corresponds to the original audio data, and retain the power characteristic and threshold of the last bit of each frame as the initial value of the next frame.

[0040] S42: Output the vibration drive signal to a vibrator to generate vibration feedback.

[0041] Specifically, in the embodiment of the present invention, the tactile feedback effect needs to be realized by a vibration feedback system mainly using a vibrator. Referring to FIG. 4, FIG. 4 is a schematic diagram of the vibration drive signal obtained from the original audio data in the embodiment of the present invention. As is obvious, in the embodiment of the present invention, the vibration drive signal obtained by the dynamic adjustment vibration feedback method by the audio can accurately correspond to the original audio data.

[0042] Compared with the prior art, in the audio-based dynamic adjustment vibration feedback method of the present invention, audio is loaded frame by frame, the data is analyzed to obtain its power envelope characteristics, self-adaptive vibration threshold adjustment is performed based on the obtained characteristics, and further, the relationship between the characteristics and the threshold is judged to match the vibration drive signal corresponding to the vibration range. Thereby, the amplitude of the vibration drive signal is dynamically adjusted according to the audio itself, the real-time vibration feedback of the audio is completed, the technical effect of obtaining the vibration feedback matched by the audio data in real time is realized, and the user experience of the vibration feedback is improved.

[0043] In an embodiment of the present invention, an audio-based dynamic adjustment vibration feedback system is further provided. Referring to FIG. 5, FIG. 5 is a diagram showing the configuration of an audio-based dynamic adjustment vibration feedback system 200 provided by an embodiment of the present invention. The audio-based dynamic adjustment vibration feedback system 200 includes an audio acquisition module 201 for acquiring original audio data, a threshold adjustment module 202 for setting a preset signal vibration threshold, tracking the audio instantaneous power envelope of the original audio data to obtain corresponding instantaneous power characteristics, and performing self-adaptive adjustment on the preset signal vibration threshold according to the instantaneous power characteristics to obtain a signal vibration threshold, an amplitude adjustment module 203 for dividing the vibration range of the original audio data by the instantaneous power characteristics and the preset signal vibration threshold, and dynamically adjusting the vibration signal amplitude envelope of the original audio data to generate a vibration drive signal, and a vibration feedback module 204 for outputting vibration feedback by the vibration drive signal.

[0044] The audio dynamic adjustment vibration feedback system 200 provided by the embodiments of the present invention can implement the steps in the audio dynamic adjustment vibration feedback method in the above embodiments and can achieve the same technical effects. Specifically, reference can be made to the description of the above embodiments, and there is no need to repeat the description here.

[0045] In the embodiments of the present invention, a computer device is further provided. Referring to FIG. 6, FIG. 6 is a diagram showing the configuration of a computer device provided by the embodiments of the present invention. The computer device 300 includes a processor 301, a memory 302, and a computer program stored in the memory 302 and executable by the processor 301.

[0046] As shown in FIG. 1, when the processor 301 calls the computer program stored in the memory 302 and executes the computer program, the steps for implementing the audio dynamic adjustment vibration feedback method in the above embodiments are as follows: Obtaining original audio data; Setting a preset signal vibration threshold, tracking the audio instantaneous power envelope of the original audio data to obtain corresponding instantaneous power characteristics, and performing self-adaptive adjustment on the preset signal vibration threshold according to the instantaneous power characteristics to obtain a signal vibration threshold; Dividing the vibration range of the original audio data according to the instantaneous power characteristics and the signal amplitude threshold, and dynamically adjusting the vibration signal amplitude envelope of the original audio data to generate a vibration drive signal; Outputting vibration feedback by means of the vibration drive signal.

[0047] Preferably, a preset signal oscillation threshold is set, and the audio instantaneous power envelope of the original audio data is tracked to obtain corresponding instantaneous power characteristics, and self-adaptive adjustment is performed on the preset signal oscillation threshold according to the instantaneous power characteristics to obtain a signal oscillation threshold. The steps are as follows: In the i-th frame, the preset signal oscillation threshold is T i (1), and at the t-th moment of the original audio data, the preset signal oscillation threshold is T i (t), and the instantaneous power characteristic C obtained by tracking the audio instantaneous power envelope i (t); and A ratio r is set, and the second instantaneous power characteristic C is obtained by adjusting the instantaneous power characteristic C i (t) according to the ratio i `(t); and The magnitude of the second instantaneous power characteristic C i `(t) is compared with the signal oscillation threshold T i (t - 1) at the (t - 1)-th moment, and self-adaptive adjustment is performed on T i (t). Here, when C i `(t) is greater than T i (t - 1), the preset signal oscillation threshold T i (t) is adjusted upward; when C i `(t) is less than T i (t - 1), the preset signal oscillation threshold T i (t) is adjusted downward. This includes:

[0048] Preferably, the range of the ratio r is [0, 1].

[0049] Preferably, the oscillation range of the original audio data is divided according to the instantaneous power characteristic and the signal amplitude threshold, and the oscillation signal amplitude envelope of the original audio data is dynamically adjusted to generate an oscillation drive signal. The steps are as follows: Among the original audio data, C i `(t) and T iCompare (t), where C i `(t) is T i When it is greater than (t), divide the time region where the corresponding t-th time is located into the vibration range, Let the resonance frequency of the vibrator be f and the rated voltage be vrms. According to the length of the region and the magnitude of the power within the region, fill the vibration range corresponding to the resonance frequency f and the short-long signal of a single frequency of the rated voltage vrms, and adjust the vibration signal amplitude envelope by the audio instantaneous power envelope to generate the vibration drive signal within the vibration range.

[0050] Preferably, the step of outputting vibration feedback by the vibration drive signal Within the time region of the original audio data, fill the short-long signal of the vibration signal amplitude envelope for each frame, obtain the vibration drive signal that completely corresponds to the original audio data, and retain the power characteristics and threshold of the last bit of each frame as the initial value of the next frame. Output the vibration drive signal to the vibrator to generate vibration feedback.

[0051] Preferably, when acquiring the original audio data, divide the original audio data into one frame at a preset time interval.

[0052] Preferably, when acquiring the original audio data, determine whether the first frame of the original audio data is single-channel data, If it is single-channel data, directly acquire the next frame data, If it is not single-channel data, when acquiring the next frame data, obtain the average value of the data of different channels in the original audio data.

[0053] The computer device 300 provided by the embodiments of the present invention can implement each step of the audio-based dynamic adjustment vibration feedback method in the above embodiments and can achieve the same technical effects. Specifically, reference can be made to the description of the above embodiments, and it is not necessary to repeat the description here.

[0054] In an embodiment of the present invention, a computer-readable storage medium is further provided. A computer program is stored in the computer-readable storage medium. When the computer program is executed by a processor, each process and step in the audio-based dynamic adjustment vibration feedback method provided by the embodiments of the present invention can be implemented, and the same technical effects can be achieved. To avoid repetition, it is not necessary to repeat the description here.

[0055] What has been described above is only one embodiment of the present invention. Those skilled in the art can make improvements without departing from the creative idea of the present invention, and it should be pointed out here that all of these are included in the protection scope of the present invention.

Claims

1. Obtaining original audio data, Setting a preset signal oscillation threshold, monitoring the audio instantaneous power envelope of the original audio data to obtain corresponding instantaneous power characteristics, and performing self-adaptive adjustment on the preset signal oscillation threshold according to the instantaneous power characteristics to obtain a signal oscillation threshold, Dividing the oscillation range of the original audio data according to the instantaneous power characteristics and the signal oscillation threshold, and dynamically adjusting the oscillation signal amplitude envelope of the original audio data to generate an oscillation drive signal, Outputting oscillation feedback by means of the oscillation drive signal, The audio instantaneous power envelope is a waveform of the temporal change of audio instantaneous power, The instantaneous power characteristic is a curve of the dynamic change of the audio instantaneous power envelope, The step of setting a preset signal oscillation threshold, monitoring the audio instantaneous power envelope of the original audio data to obtain corresponding instantaneous power characteristics, and performing self-adaptive adjustment on the preset signal oscillation threshold according to the instantaneous power characteristics to obtain a signal oscillation threshold is as follows: In the i-th frame, the preset signal oscillation threshold is Ti(1), and at the t-th moment of the original audio data, the preset signal oscillation threshold is Ti(t), and the instantaneous power characteristic obtained by tracking the audio instantaneous power envelope is set as Ci(t), Setting a ratio r, and obtaining a second instantaneous power characteristic Ci'(t) by adjusting the instantaneous power characteristic Ci(t) according to the ratio, where Ci'(t)=r·Ci(t), Comparing the magnitude of the second instantaneous power characteristic Ci'(t) with the signal oscillation threshold Ti(t - 1) at the (t - 1)-th moment, and performing self-adaptive adjustment on Ti(t). Here, when Ci'(t) is greater than Ti(t - 1), the preset signal oscillation threshold Ti(t) is adjusted upward; when Ci'(t) is smaller than Ti(t - 1), the preset signal oscillation threshold Ti(t) is adjusted downward, A method for dynamic adjustment oscillation feedback by audio, characterized in that.

2. The range of the ratio r is [0, 1]. The method for dynamically adjusted vibration feedback by audio according to claim 1, characterized in that...

3. The step of dividing the vibration range of the original audio data according to the instantaneous power characteristic and the signal vibration threshold, and dynamically adjusting the vibration signal amplitude envelope of the original audio data to generate a vibration drive signal is as follows: Among the original audio data, C i `(t) and T i (t) are compared, where C i `(t) is T i (t), when it is larger, divide the time region where the corresponding t-th moment is located into the vibration range, and Taking the resonance frequency of the vibrator as f and the rated voltage as vrms, filling the single-frequency short-long signal of the resonance frequency f and the rated voltage vrms corresponding to the vibration range according to the length of the region and the magnitude of the power in the region, and adjusting the vibration signal amplitude envelope by the audio instantaneous power envelope to generate the vibration drive signal within the vibration range, including: The method for dynamically adjusted vibration feedback by audio according to claim 1, characterized in that...

4. The step of outputting vibration feedback by the vibration drive signal is as follows: Within the time domain of the original audio data, filling the short-long signal of the vibration signal amplitude envelope for each frame, obtaining the vibration drive signal that completely corresponds to the original audio data, and retaining the power characteristic and threshold of the last bit of each frame as the initial value of the next frame; Outputting the vibration drive signal to a vibrator to generate vibration feedback, including: The method for dynamically adjusted vibration feedback by audio according to claim 3, characterized in that...

5. When obtaining the original audio data, dividing the original audio data at a preset time interval, and taking the original audio data corresponding to each preset time interval as one frame. The method for dynamically adjusted vibration feedback by audio according to claim 1, characterized in that...

6. When obtaining the original audio data, determining whether the first frame of the original audio data is single-channel data. If it is single-channel data, directly obtaining the subsequent frame data. If it is not single-channel data, when obtaining the subsequent frame data, taking the average value of the data of different channels in the original audio data. The method for dynamically adjusted vibration feedback by audio according to claim 5, characterized in that...

7. An audio acquisition module for acquiring original audio data, a threshold adjustment module that sets a preset signal oscillation threshold, monitors the audio instantaneous power envelope of the original audio data to obtain corresponding instantaneous power characteristics, and performs self-adaptive adjustment on the preset signal oscillation threshold according to the instantaneous power characteristics to obtain a signal oscillation threshold, an amplitude adjustment module that divides the oscillation range of the original audio data according to the instantaneous power characteristics and the signal oscillation threshold, and adjusts the oscillation signal amplitude envelope of the original audio data to generate an oscillation drive signal, and an oscillation feedback module that outputs oscillation feedback according to the oscillation drive signal. The audio instantaneous power envelope is a waveform of the temporal change of the audio instantaneous power. The instantaneous power characteristic is a curve of the dynamic change of the audio instantaneous power envelope. The threshold adjustment module In the i-th frame, the preset signal oscillation threshold is T i (1). At the t-th moment of the original audio data, the preset signal oscillation threshold is T i (t), and the instantaneous power characteristic obtained by tracking the audio instantaneous power envelope is denoted as C i (t). Set a ratio r, and adjust the instantaneous power characteristic C i (t) according to the ratio to obtain a second instantaneous power characteristic C i '(t), where C i '(t) = r · C i (t). Compare the magnitude of the second instantaneous power characteristic C i '(t) with the signal oscillation threshold T i (t - 1) at the t - 1-th moment, and perform self-adaptive adjustment on T i (t). Here, when C i '(t) is greater than T i (t - 1), the preset signal oscillation threshold T i (t) is adjusted upward; when C i '(t) is less than T i (t - 1), the preset signal oscillation threshold T i (t) is adjusted downward. An audio-based dynamic adjustment oscillation feedback system, characterized by the above. Claim 8 A processor, a memory, and a computer program stored in the memory and executable by the processor, wherein when the processor executes the computer program, the steps in the audio-based dynamic adjustment vibration feedback method according to any one of claims 1 to 6 are realized. A computer device characterized by the above. **Claim 9** A computer-readable storage medium, wherein a computer program is stored in the computer-readable storage medium, and when the computer program is executed by a processor, the steps in the audio-based dynamic adjustment vibration feedback method according to any one of claims 1 to 6 are realized. A computer-readable storage medium characterized by the above.

Citation Information

Patent Citations

  • System and method for automatically generating haptic events from digital audio signals

    JP2009533714A

  • Systems and methods for generating haptic effects associated with envelope in audio signals

    JP2015053053A

  • Information provision device, information provision method, and program

    JP2022097227A

  • Adaptive haptic signal generating apparatus and method

    JP2022501699A

  • System and method for use in haptic signal generation

    US20210052980A1