Audio signal processing method and device, storage medium and electronic device

Abstract

The embodiment of the invention provides an audio signal processing method and device, a storage medium and an electronic device. The method comprises the following steps: determining the resonant frequency of a vibrating diaphragm of the loudspeaker; based on a preset relation between the vibrating diaphragm resonant frequency and the ambient air pressure of the loudspeaker, obtaining predicted ambient air pressure corresponding to the vibrating diaphragm resonant frequency; predicting the diaphragm displacement of the loudspeaker based on the input audio signal of the loudspeaker and the predicted ambient air pressure to obtain the diaphragm predicted displacement of the loudspeaker playing the input audio signal under the predicted ambient air pressure; when the diaphragm predicted displacement satisfies a preset diaphragm displacement condition, calculating a diaphragm displacement gain corresponding to the diaphragm predicted displacement based on a preset relationship between the diaphragm predicted displacement and a diaphragm displacement gain; and adjusting the diaphragm displacement of the loudspeaker based on the diaphragm displacement gain, and applying the adjusted diaphragm displacement to the input audio signal. Therefore, the diaphragm of the loudspeaker is protected, the use performance of the loudspeaker is fully released, and the hearing feeling of a user is improved.

Description

Technical Field

[0001] The present application relates to the technical field of loudspeakers, and in particular to an audio signal processing method and device thereof, a storage medium and an electronic device. Background Art

[0002] Nowadays, various electronic devices (such as mobile phones, computers, etc.) are usually equipped with speakers to support the sound playback function of various electronic devices. Among them, when the speaker is working, the diaphragm vibration is controlled by electrical signals to make sound. When the external environment changes, causing the ambient air pressure difference to increase or decrease, it will affect the diaphragm. For example, in high-altitude areas, the ambient air pressure is low, which causes the physical properties of the speaker diaphragm to change (the diaphragm displacement is larger under low ambient air pressure). If the sound source processing method under standard ambient air pressure is used, it is easy to cause damage to the speaker diaphragm or airtightness in a short period of time, which manifests as undesirable phenomena such as broken sound or explosive sound.

[0003] In the related art, in order to protect the speaker in different environmental air pressure scenarios, a static speaker displacement model is usually used to protect the diaphragm. That is, the predicted diaphragm displacement of the static speaker displacement model in any environment is usually a relatively conservative fixed parameter. The diaphragm of the speaker is controlled to vibrate according to the predicted diaphragm displacement to achieve audio playback, resulting in the speaker's performance not being fully released, thus affecting the listening experience. Summary of the invention

[0004] In view of this, the embodiments of the present application provide an audio signal processing method and device, a storage medium and an electronic device to solve or alleviate the problem in the related art that the performance of the speaker is not fully released, thereby affecting the listening experience.

[0005] According to a first aspect of an embodiment of the present application, a method for processing an audio signal is provided, the method comprising: determining a diaphragm resonance frequency of a loudspeaker; obtaining a predicted ambient air pressure corresponding to the diaphragm resonance frequency based on a preset relationship between the diaphragm resonance frequency and the ambient air pressure of the loudspeaker; predicting a diaphragm displacement of the loudspeaker based on an input audio signal of the loudspeaker and the predicted ambient air pressure, to obtain a predicted diaphragm displacement of the loudspeaker when the loudspeaker plays the input audio signal under the predicted ambient air pressure; calculating a diaphragm displacement gain corresponding to the predicted diaphragm displacement based on a preset relationship between the predicted diaphragm displacement and a diaphragm displacement gain when the predicted diaphragm displacement meets a preset diaphragm displacement condition; adjusting the diaphragm displacement of the loudspeaker based on the diaphragm displacement gain, and applying the adjusted diaphragm displacement to the input audio signal.

[0006] In some embodiments of the present application, determining the diaphragm resonance frequency of the speaker includes: determining the real-time diaphragm resonance frequency and the corresponding real-time ambient temperature; when the real-time ambient temperature meets the preset ambient temperature condition, determining the real-time diaphragm resonance frequency as the diaphragm resonance frequency of the speaker.

[0007] In some embodiments of the present application, determining the diaphragm resonance frequency of the speaker also includes: determining the real-time diaphragm resonance frequency and the corresponding real-time ambient temperature; calculating the theoretical diaphragm resonance frequency corresponding to the real-time ambient temperature based on a fitting function, and calculating the difference between the theoretical diaphragm resonance frequency and the preset diaphragm resonance frequency to obtain the diaphragm resonance frequency change value, wherein the fitting function is a function obtained by fitting discrete data consisting of different historical ambient temperatures and the corresponding historical diaphragm resonance frequencies; and determining the difference between the real-time diaphragm resonance frequency and the diaphragm resonance frequency change value as the diaphragm resonance frequency of the speaker.

[0008] In some embodiments of the present application, determining the real-time resonant frequency includes: calculating the ratio between the real-time voltage in the received real-time voltage and current signal and the preset initial impedance of the speaker to obtain a predicted current, wherein the real-time voltage and current signal is a voltage-current conversion signal corresponding to the input audio signal; iterating the speaker impedance model according to the difference between the predicted current and the real-time current in the real-time voltage and current signal until the difference reaches a preset condition, and determining that the impedance output by the speaker impedance model is the target impedance; and querying the diaphragm resonant frequency corresponding to the target impedance from a preset diaphragm resonant frequency and impedance curve to determine it as the real-time resonant frequency.

[0009] In some embodiments of the present application, determining the real-time ambient temperature includes: performing data processing on the received real-time voltage and current signals to obtain the voltage and current signals after data processing; calculating the ratio between the voltage and the current in the voltage and current signals to obtain the real-time impedance; inputting the real-time impedance into the preset relationship between the real-time impedance and the real-time ambient temperature, and calculating the real-time ambient temperature corresponding to the real-time impedance.

[0010] In some embodiments of the present application, before predicting the speaker diaphragm displacement based on the speaker's input audio signal and the predicted ambient air pressure, the audio signal processing method also includes: obtaining the original audio signal of the speaker; determining whether the frequency value of the original audio signal meets a preset frequency condition; if so, adjusting the voltage of the original audio signal to obtain the input audio signal after voltage adjustment.

[0011] In some embodiments of the present application, the diaphragm displacement of a speaker is predicted based on the input audio signal of the speaker and the predicted ambient air pressure to obtain the predicted diaphragm displacement when the speaker plays the input audio signal under the predicted ambient air pressure, including: adjusting the gain based on the preset filter gain and the predicted ambient air pressure to obtain the adjusted filter gain; and predicting the displacement based on the adjusted filter gain, the preset cutoff frequency, the preset quality factor and the input audio signal to obtain the predicted diaphragm displacement.

[0012] In some embodiments of the present application, before obtaining the predicted ambient air pressure corresponding to the diaphragm resonance frequency based on the preset relationship between the diaphragm resonance frequency and the ambient air pressure of the speaker, the audio signal processing method also includes: determining the preset relationship between ambient air pressure and air resistance according to the preset relationship between ambient air pressure and air density and the preset relationship between air resistance and air density; determining the preset relationship between ambient air pressure and the stiffness of the elastic diaphragm of the speaker according to the preset relationship between air resistance and the stiffness of the elastic diaphragm of the speaker and the preset relationship between ambient air pressure and air resistance; determining the preset relationship between the diaphragm resonance frequency and ambient air pressure according to the preset relationship between the stiffness of the elastic diaphragm of the speaker and the diaphragm resonance frequency and the preset relationship between ambient air pressure and the stiffness of the elastic diaphragm of the speaker.

[0013] According to a second aspect of an embodiment of the present application, there is provided an audio signal processing device, the device comprising: a first determination module, determining a diaphragm resonance frequency of a loudspeaker; a second determination module, obtaining a predicted ambient air pressure corresponding to the diaphragm resonance frequency based on a preset relationship between the diaphragm resonance frequency and the ambient air pressure of the loudspeaker; a prediction module, predicting a diaphragm displacement of a loudspeaker based on an input audio signal of the loudspeaker and the predicted ambient air pressure, to obtain a predicted diaphragm displacement of the loudspeaker when the loudspeaker plays the input audio signal under the predicted ambient air pressure; a calculation module, calculating a diaphragm displacement gain corresponding to the predicted diaphragm displacement based on a preset relationship between the predicted diaphragm displacement and the diaphragm displacement gain when the predicted diaphragm displacement meets a preset diaphragm displacement condition; and an adjustment module, adjusting the diaphragm displacement of the loudspeaker based on the diaphragm displacement gain, and applying the adjusted diaphragm displacement to the input audio signal.

[0014] According to a third aspect of an embodiment of the present application, an electronic device is provided, comprising: a processor, a memory, a communication interface and a communication bus, wherein the processor, the memory and the communication interface communicate with each other via the communication bus; the memory is used to store at least one executable instruction, and the executable instruction enables the processor to perform an operation corresponding to the audio signal processing method of any of the above embodiments.

[0015] According to a fourth aspect of the embodiments of the present application, a computer storage medium is provided, on which a computer program is stored. When the program is executed by a processor, the audio signal processing method of any of the above embodiments is implemented.

[0016] According to the audio signal processing method and its equipment, storage medium and electronic device provided in the embodiments of the present application, the predicted ambient air pressure corresponding to the diaphragm of the speaker is determined by the resonance frequency of the diaphragm, and the predicted diaphragm displacement is obtained according to the input audio signal and the predicted ambient air pressure. When the predicted diaphragm displacement meets the preset diaphragm displacement condition, it is adaptively adjusted, thereby protecting the speaker diaphragm and enabling the diaphragm of the speaker to act on the input audio signal according to the adjusted diaphragm displacement, fully releasing the performance of the speaker and improving the user's listening experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0017] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments recorded in the embodiments of the present application. For ordinary technicians in this field, other drawings can also be obtained based on these drawings.

[0018] Figure 1 A flowchart of an audio data processing method according to an embodiment of the present application;

[0019] Figure 2 is a schematic structural diagram of a displacement prediction model according to an embodiment of the present application;

[0020] Figure 3 is a schematic diagram of a curve of a preset diaphragm resonance frequency and impedance according to an embodiment of the present application;

[0021] Figure 4 is a schematic diagram of a voltage-frequency curve of a speaker according to an embodiment of the present application;

[0022] Figure 5 A schematic diagram of the structure of an audio signal processing system applying an audio signal processing method according to an embodiment of the present application;

[0023] Figure 6 is a structural block diagram of an audio signal processing device according to an embodiment of the present application;

[0024] Figure 7 The figure is a structural block diagram of an electronic device according to an embodiment of the present application. DETAILED DESCRIPTION

[0025] In order to enable those skilled in the art to better understand the technical solutions in the embodiments of the present application, the technical solutions in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. All other embodiments obtained by ordinary technicians in this field based on the embodiments in the embodiments of the present application should fall within the scope of protection of the embodiments of the present application.

[0026] The specific implementation of the embodiments of the present application is further explained below in combination with the embodiments of the present application and the accompanying drawings.

[0027] Figure 1 The figure is a flowchart of an audio signal processing method according to an embodiment of the present application.

[0028] like Figure 1As shown, the audio signal processing method includes:

[0029] S11: Determine the diaphragm resonance frequency of the speaker.

[0030] Specifically, as a device that converts electrical signals into sounds, the main working principle of a speaker is to receive an input electrical signal, pass the electrical signal through the AC coil inside the speaker, and generate an alternating magnetic field. The alternating magnetic field interacts with the magnet on the speaker, causing the diaphragm of the speaker to begin to vibrate, thereby making a sound. Different diaphragm resonance frequencies will produce different sounds. Therefore, when processing audio signals, it is necessary to detect the diaphragm resonance frequency of the speaker for subsequent processing.

[0031] S12: Based on a preset relationship between the diaphragm resonance frequency and the ambient air pressure of the speaker, a predicted ambient air pressure corresponding to the diaphragm resonance frequency is obtained.

[0032] The ambient air pressure of the speaker refers to the ambient air pressure of the environment where the speaker is located. The speaker can be set in an electronic device, such as a mobile phone, a camera, a tablet, a computer or other electronic devices.

[0033] In some embodiments, before obtaining the predicted ambient air pressure corresponding to the diaphragm resonance frequency based on the preset relationship between the diaphragm resonance frequency and the ambient air pressure of the speaker, the audio signal processing method also includes: determining the preset relationship between ambient air pressure and air resistance according to the preset relationship between ambient air pressure and air density and the preset relationship between air resistance and air density; determining the preset relationship between ambient air pressure and the stiffness of the elastic diaphragm of the speaker according to the preset relationship between air resistance and the stiffness of the elastic diaphragm of the speaker and the preset relationship between ambient air pressure and air resistance; determining the preset relationship between the diaphragm resonance frequency and ambient air pressure according to the preset relationship between the stiffness of the elastic diaphragm of the speaker and the diaphragm resonance frequency and the preset relationship between ambient air pressure and the stiffness of the elastic diaphragm of the speaker.

[0034] Specifically, firstly, according to the ideal gas state equation, that is, formula (1),

[0035] PM=ρRT Formula (1),

[0036] Where M is the molar mass of the substance, R is the proportional constant, T is the temperature, P is the ambient pressure, and ρ is the air density. It can be seen that when M, R (for any ideal gas, R is constant, about 8.31441±0.00026 J / (mol·K)) and T are the same, the ambient pressure P is proportional to the air density ρ;

[0037] According to the air resistance equation, formula (2)

[0038]

[0039] Among them, F is air resistance, C is air resistance coefficient, ρ is air density, S is windward area of ​​the object, and V is relative speed between the object and the air. It can be seen that when C, S, and V remain unchanged, air resistance F is proportional to air density ρ. Therefore, according to the preset relationship between ambient pressure and air density (i.e. ambient pressure P is proportional to air density ρ) and the preset relationship between air resistance and air density (i.e. air resistance F is proportional to air density ρ), it is determined that ambient pressure is also proportional to air resistance.

[0040] Next, during the movement of the speaker's diaphragm, if the air resistance becomes smaller, the resistance to the movement of the elastic diaphragm will become smaller, causing the stiffness of the speaker's elastic diaphragm to decrease (that is, the air resistance F is proportional to the stiffness of the speaker's elastic diaphragm), and since the air resistance F is proportional to the ambient air pressure P, the ambient air pressure P is also proportional to the stiffness of the speaker's elastic diaphragm.

[0041] Among them, the stiffness of the loudspeaker elastic diaphragm characterizes the relationship between the shape change (i.e., displacement) of the diaphragm and the driving force when the diaphragm is acted upon by the driving force. The greater the stiffness, the harder the diaphragm, so the smaller the displacement of the diaphragm under the driving force. At the same time, if the diaphragm is subjected to greater air resistance when vibrating, the smaller its displacement under the driving force. Therefore, when the air resistance increases, the harder the diaphragm, the greater the stiffness of the diaphragm, resulting in a smaller displacement of the diaphragm under the driving force. That is, the air resistance F is proportional to the stiffness of the loudspeaker elastic diaphragm.

[0042] Finally, according to the loudspeaker elastic diaphragm stiffness equation, that is, formula (3),

[0043] k d =m d (2πf0) 2 Formula (3)

[0044] Among them, k d is the elastic diaphragm stiffness of the loudspeaker, m d is the diaphragm load mass (including air), and f0 is the diaphragm resonant frequency. It can be seen that when m d When the elastic diaphragm stiffness k of the loudspeaker is constant, d It is proportional to the resonance frequency f0 of the diaphragm. Due to the difference between the ambient air pressure P and the elastic diaphragm stiffness k of the loudspeaker d It is directly proportional, so it can be determined that the ambient air pressure P is proportional to the diaphragm resonance frequency f0. The positive proportional relationship between the ambient air pressure P and the diaphragm resonance frequency f0 can be expressed by a monotonic function, so the predicted ambient air pressure corresponding to the diaphragm resonance frequency can be calculated based on the monotonic function.

[0045] The monotonic function can be obtained by placing the speaker in different air pressure environments, playing the sound source to detect the diaphragm resonance frequency f0, obtaining f0 under different ambient air pressures P, and further fitting the scattered data of P and f0. It should be noted that the expression of the monotonic function is not fixed, and can be a simple linear relationship (such as P = kf0) or a piecewise function.

[0046] S13: predicting the displacement of a diaphragm of the speaker based on the input audio signal of the speaker and the predicted ambient air pressure, and obtaining the predicted displacement of the diaphragm when the speaker plays the input audio signal under the predicted ambient air pressure.

[0047] The input audio signal of the speaker is an input audio signal obtained by voltage-adjusting an original audio signal input to the speaker.

[0048] It is understandable that when the ambient air pressure in the speaker becomes low (such as in high altitude areas), the physical properties of the speaker diaphragm will change, resulting in a larger displacement of the diaphragm. If this diaphragm displacement is applied to the input audio signal to play the input audio, it will cause damage to the speaker diaphragm or airtightness in a relatively short period of time, resulting in undesirable phenomena such as broken or explosive sounds.

[0049] Therefore, in order to avoid this phenomenon, the present application designs a displacement prediction model to adaptively adjust the gain of the displacement prediction model (i.e., the displacement prediction filter) according to the change of the predicted ambient air pressure. The displacement prediction model is used to obtain the predicted displacement of the diaphragm of the speaker according to the input audio signal and the predicted ambient air pressure, so that the predicted displacement of the diaphragm is more adapted to the ambient air pressure. Specifically, the displacement prediction model (the displacement prediction model uses the voltage displacement transfer function Hx=X / V for displacement prediction, X is the predicted displacement of the diaphragm, and V is the voltage of the input audio signal) is simplified to the form of a universal filter, that is, the frequency response curve of the filter is used to simulate the voltage displacement transfer curve of the speaker, and the voltage displacement transfer function is fitted to the greatest extent by adjusting the filter gain Gain, the quality factor Q and the cutoff frequency Fc, thereby obtaining the predicted displacement of the diaphragm.

[0050] Thus, compared with the traditional loudspeaker physical model, the present application adopts the form of a universal filter to directly calculate the filter coefficient according to the filter gain Gain, quality factor Q and cutoff frequency Fc, so that the adaptive update of the displacement prediction model saves the demand for calculation.

[0051] Further, in some embodiments, the diaphragm displacement of the speaker is predicted based on the input audio signal of the speaker and the predicted ambient pressure to obtain the predicted diaphragm displacement of the speaker when playing the input audio signal under the predicted ambient pressure, including: adjusting the gain based on the preset filter gain and the predicted ambient pressure to obtain the adjusted filter gain; and predicting the displacement based on the adjusted filter gain, the preset cutoff frequency, the preset quality factor and the input audio signal to obtain the predicted diaphragm displacement. The preset filter gain, the preset cutoff frequency and the preset quality factor are all preset parameters of the diaphragm displacement filter model.

[0052] For example, Figure 2 Schematic diagram of the structure of a displacement prediction model according to an embodiment of the present application.

[0053] like Figure 2 As shown, the displacement prediction model at least includes an adaptive gain model and a diaphragm displacement filter model. The predicted ambient air pressure and the preset filter gain are input into the adaptive gain model. The adaptive gain model performs adaptive adjustment on the basis of the preset filter gain according to the size of the predicted ambient air pressure. Specifically, a fixed update step size is set. When the predicted ambient air pressure decreases to a certain value, the preset filter gain will increase by a certain step size, thereby obtaining the adjusted filter gain. Conversely, when the predicted ambient air pressure increases to a certain value, the preset filter gain will decrease by a certain step size, thereby obtaining the adjusted filter gain.

[0054] Furthermore, the adjusted filter gain, the preset cutoff frequency, the preset quality factor and the input audio signal are input into the diaphragm displacement filter model, and the voltage-displacement transfer function is fitted to obtain the predicted diaphragm displacement and output it.

[0055] S14: when the predicted diaphragm displacement meets a preset diaphragm displacement condition, calculating a diaphragm displacement gain corresponding to the predicted diaphragm displacement based on a preset relationship between the predicted diaphragm displacement and the diaphragm displacement gain;

[0056] S15: adjusting the diaphragm displacement of the speaker based on the diaphragm displacement gain, and applying the adjusted diaphragm displacement to the input audio signal.

[0057] Specifically, the preset diaphragm displacement condition refers to the maximum amplitude of the speaker, and the maximum amplitude of the speaker usually refers to the maximum amplitude of the diaphragm in the speaker. When the predicted diaphragm displacement output by the displacement prediction model exceeds the maximum amplitude of the speaker, in order to protect the performance of the speaker, it is necessary to calculate the diaphragm displacement gain corresponding to the predicted diaphragm displacement based on the preset relationship between the predicted diaphragm displacement and the diaphragm displacement gain (such as the diaphragm displacement gain corresponding to the predicted diaphragm displacement A is g1), and then adjust the diaphragm displacement of the speaker based on the diaphragm displacement gain, and apply the adjusted diaphragm displacement to the input audio signal, so as to control the speaker amplitude within the maximum amplitude and realize adaptive protection of the speaker diaphragm in a low pressure environment.

[0058] According to the audio signal processing method of the present application, the predicted ambient air pressure corresponding to the diaphragm of the speaker is determined by the resonance frequency of the diaphragm, and the predicted diaphragm displacement is obtained according to the input audio signal and the predicted ambient air pressure, so that when the predicted diaphragm displacement meets the preset diaphragm displacement condition, it is adaptively adjusted, thereby protecting the speaker diaphragm and enabling the diaphragm of the speaker to act on the input audio signal according to the adjusted diaphragm displacement, fully releasing the performance of the speaker and improving the user's listening experience.

[0059] In some embodiments, determining the diaphragm resonance frequency of the speaker includes: determining the real-time diaphragm resonance frequency and the corresponding real-time ambient temperature; when the real-time ambient temperature meets the preset ambient temperature condition, determining the real-time diaphragm resonance frequency as the diaphragm resonance frequency of the speaker. The real-time diaphragm resonance frequency is the diaphragm resonance frequency of the speaker detected initially, and the real-time diaphragm resonance frequency is affected by temperature. Generally, the higher the temperature, the lower the real-time diaphragm resonance frequency. Therefore, when determining the corresponding predicted ambient pressure based on the diaphragm resonance frequency, in order to ensure the accuracy of the predicted ambient pressure, the real-time diaphragm resonance frequency needs to be calibrated to remove the influence of the ambient temperature on the diaphragm resonance frequency.

[0060] Exemplarily, the real-time ambient temperature and the corresponding real-time diaphragm resonance frequency are obtained, and it is determined whether the real-time ambient temperature is close to the temperature value under normal temperature, such as 25°C. If so, it is determined that the real-time ambient temperature meets the preset ambient temperature condition, and the real-time diaphragm resonance frequency corresponding to the real-time ambient temperature is used as the diaphragm resonance frequency of the speaker. If not, the real-time diaphragm resonance frequency corresponding to the real-time ambient temperature is eliminated.

[0061] In this way, the accuracy of the predicted ambient air pressure is ensured by removing the influence of temperature on the predicted ambient air pressure.

[0062] In other embodiments, determining the diaphragm resonance frequency of a speaker includes: determining a real-time diaphragm resonance frequency and a corresponding real-time ambient temperature; calculating a theoretical diaphragm resonance frequency corresponding to the real-time ambient temperature based on a fitting function, and calculating a difference between the theoretical diaphragm resonance frequency and a preset diaphragm resonance frequency to obtain a diaphragm resonance frequency change value, wherein the fitting function is a function obtained by fitting discrete data consisting of different ambient temperatures and corresponding diaphragm resonance frequencies; and determining the difference between the real-time diaphragm resonance frequency and the diaphragm resonance frequency change value as the diaphragm resonance frequency of the speaker.

[0063] Specifically, the fitting function of the historical ambient temperature and the historical diaphragm resonance frequency is obtained by measuring different historical ambient temperatures and their corresponding historical diaphragm resonance frequencies in advance, such as discrete data composed of (t1, f1), (t2, f2), (t3, f3)...(tn, fn), etc., processing the discrete data, and obtaining the fitting curve of the two, and further obtaining the fitting function of the historical ambient temperature and the historical diaphragm resonance frequency based on the fitting curve. Under normal circumstances, the historical ambient temperature is inversely proportional to the historical diaphragm resonance frequency, such as t=k / f. The preset diaphragm resonance frequency is the frequency value corresponding to the preset ambient temperature (usually the ambient temperature at room temperature, such as 25°C) calculated based on the fitting function.

[0064] Furthermore, the acquired real-time ambient temperature (such as T0) is input into the fitting function, and the theoretical diaphragm resonance frequency (f=k / T0) corresponding to the real-time ambient temperature is calculated, and the difference between the theoretical diaphragm resonance frequency and the preset diaphragm resonance frequency is calculated to obtain the diaphragm resonance frequency change value. The diaphragm resonance frequency change value is the frequency change caused by temperature change. Therefore, in order to remove the influence of temperature on the diaphragm resonance frequency, the difference between the real-time diaphragm resonance frequency and the diaphragm resonance frequency change value is determined as the diaphragm resonance frequency of the speaker.

[0065] It can be understood that the fitting function is the relationship between the ambient temperature and the diaphragm resonance frequency obtained when only the ambient temperature is changed. When the speaker is in a real environment, its diaphragm resonance frequency is not only related to the environment, but also affected by other factors (such as air pressure). For example, if the real-time ambient temperature is 10°C, the corresponding theoretical diaphragm resonance frequency is calculated by the fitting function as f1 (the diaphragm resonance frequency f1 is the frequency value only affected by the environment), and the difference between the theoretical diaphragm resonance frequency f1 and the preset diaphragm resonance frequency f (the diaphragm resonance frequency f0 is the frequency value under normal temperature) is calculated to obtain the diaphragm resonance frequency change value Δf (the change value is the frequency change value caused only by the change in ambient temperature). In a real environment, due to the influence of factors such as air pressure, the real-time diaphragm resonance frequency corresponding to the real-time ambient temperature of 10°C is f2, and f2≠f1. Therefore, the difference between f2 and Δf is calculated to obtain the diaphragm resonance frequency f0 of the speaker (the diaphragm resonance frequency is the frequency change value caused only by the change in air pressure).

[0066] In this way, it can be ensured that the resonance frequency of the diaphragm of the speaker is only affected by the ambient air pressure, and the ambient air pressure can be predicted more accurately according to the resonance frequency of the diaphragm.

[0067] In some embodiments, determining the real-time diaphragm resonance frequency includes: calculating a ratio between a real-time voltage in a received real-time voltage and current signal and a preset speaker initial impedance to obtain a predicted current, wherein the real-time voltage and current signal is a voltage and current signal corresponding to the input audio signal;

[0068] It can be understood that the real-time voltage and current signals are collected by the IV feedback module by the voltage and current signals at the speaker end.

[0069] The loudspeaker impedance model is iterated according to the difference between the predicted current and the real-time current in the real-time voltage-current signal until the difference reaches a preset condition, and the impedance output by the loudspeaker impedance model is determined to be the target impedance; the diaphragm resonance frequency corresponding to the target impedance is queried from a preset diaphragm resonance frequency and impedance curve, and is determined to be the real-time diaphragm resonance frequency.

[0070] That is to say, after obtaining the predicted current I (I=U / R) according to the ratio between the real-time voltage U in the real-time voltage and current signal fed back by the IV feedback module and the preset initial impedance R of the loudspeaker, the loudspeaker impedance model is iterated according to the difference between the predicted current and the real-time current in the real-time voltage and current signal. The loudspeaker impedance model is built based on a minimization error algorithm, such as the LMS algorithm (Least Mean Square, minimum mean square adaptive filter) or the NLMS algorithm (Normalized Least Mean Square, normalized least mean square adaptive filter), etc., until the difference reaches a preset value, it can be determined that the impedance output by the loudspeaker impedance model is a relatively stable target impedance f0. Among them, the LMS algorithm adopts the minimum mean square error criterion, and each time the filter coefficient is updated, the mean square error is minimized. The NLMS algorithm adds an adaptive step size factor, which can automatically adjust the step size according to the error size, and can improve the convergence speed and stability of the algorithm.

[0071] Figure 3 FIG. 1 is a schematic diagram of a curve of a preset diaphragm resonance frequency and impedance according to an embodiment of the present application. Figure 3 As shown, the diaphragm resonance frequency corresponding to the target impedance f0 is queried from a preset curve of the diaphragm resonance frequency Frequency and the impedance Z, and is determined as the real-time diaphragm resonance frequency.

[0072] In this way, the speaker impedance model is iterated in real time by receiving real-time voltage and current signals, and the diaphragm resonance frequency of the speaker can be obtained according to a preset curve. There is no need for the platform to provide additional parameters of the diaphragm resonance frequency, thus reducing dependence on external devices.

[0073] In some embodiments, determining the real-time ambient temperature includes: performing data processing on the received real-time voltage and current signals to obtain the voltage and current signals after data processing.

[0074] The input audio signal includes a detection audio signal and a playback audio signal. The real-time voltage and current signal is a signal corresponding to the input audio signal in the time domain, and the voltage and current signal after data processing is a signal corresponding to the detection audio signal in the frequency domain.

[0075] The data processing of the received real-time voltage and current signals is specifically performed as follows: the real-time voltage and current signals are obtained by detecting audio, and the real-time voltage and current signals in the time domain are transformed by FFT (Fast Fourier Transformation) using the Goertzel algorithm. The Goertzel algorithm is used to calculate the energy of a specific frequency signal in the time domain signal (i.e., the frequency corresponding to the detected audio, which is small and basically imperceptible to the human ear, and therefore needs to be converted to the frequency domain for processing) to obtain the voltage and current signal corresponding to the detected audio signal, thereby determining it as the voltage and current signal after data processing.

[0076] The ratio between the voltage and the current in the voltage and current signal is calculated to obtain the real-time impedance; the real-time impedance is input into the preset relationship between the real-time impedance and the real-time ambient temperature, and the real-time ambient temperature corresponding to the real-time impedance is calculated.

[0077] Further, the ratio between the voltage and the current in the voltage and current signal corresponding to the detected audio signal is calculated to obtain the real-time impedance Z(T), and the Z(T) is input into the real-time impedance input into the preset relationship between the real-time impedance and the real-time ambient temperature, that is, formula (4), and the real-time ambient temperature T corresponding to the real-time impedance Z(T) is calculated.

[0078] Z(T)=(T-T0)×Z(T0)×α coil +Z(T0) Formula (4)

[0079] Among them, Z(T) is the real-time impedance, T is the real-time temperature, T0 is the fixed temperature, Z(T0) is the impedance value at time T0, α coil is the temperature rise coefficient of the speaker coil material.

[0080] In this way, the real-time ambient temperature of the speaker can be obtained by receiving the real-time voltage and current signals and the real-time impedance input and the preset relationship between the real-time impedance and the real-time ambient temperature. There is no need for the platform to provide additional parameters of the real-time ambient temperature, reducing dependence on external devices.

[0081] In some embodiments, before predicting the speaker diaphragm displacement based on the speaker's input audio signal and the predicted ambient air pressure, the audio signal processing method also includes: obtaining the original audio signal of the speaker; determining whether the frequency value of the original audio signal meets a preset frequency condition; if so, adjusting the voltage of the original audio signal to obtain a voltage-adjusted input audio signal.

[0082] Since the method of detecting the diaphragm resonance frequency based on the voltage and current signals fed back by the IV module requires playing the audio signal for a certain period of time to iterate the diaphragm resonance frequency of the speaker and obtain a diaphragm resonance frequency with high stability and accuracy in a real-time environment, in order to ensure that the speaker diaphragm displacement does not exceed the maximum amplitude limit at the initial stage of playing the input audio signal in a low-pressure environment, the application sets an initial state pre-pressure module to adjust the voltage of the original audio signal, so that the input audio signal played by the speaker after the voltage adjustment can not exceed the maximum amplitude limit while ensuring the listening experience.

[0083] For example, Figure 4 FIG. 1 is a schematic diagram of a voltage-frequency curve of a speaker according to an embodiment of the present application. Figure 4 As shown, the speaker needs to suppress the voltage below about 1200Hz, and the maximum output voltage of 10V in this scenario is reached above 1200Hz. Usually in a low-pressure environment, the voltage below 1200Hz needs to be suppressed to a lower voltage value.

[0084] Therefore, in this scenario, the original audio signal of the speaker is obtained, and it is determined whether the frequency value of the original audio signal is less than 1200Hz. If so, the voltage of the frequency band below 1200Hz in the original audio signal is adjusted to obtain the input audio signal after voltage adjustment. In this way, the frequency part that causes the speaker to produce a large displacement is attenuated, and the mid-high frequency part of the song is retained in the input audio signal, which has little effect on the actual listening experience. Among them, the initial pre-pressure module can be implemented in different ways, such as a filter with dynamic attenuation gain, DRC (Dynamic Range Control), etc. By mapping the dynamic range of the input audio signal to the specified dynamic range, the sound can be made to sound softer or louder.

[0085] For example, Figure 5 It is a structural schematic diagram of the audio signal processing system [AW20230055ICN1][HS2410811CCN] applying the audio signal processing method according to an embodiment of the present application.

[0086] like Figure 5 As shown, the audio signal processing system includes a speaker, an IV feedback module, a real-time ambient temperature detection module, a real-time diaphragm resonance frequency detection module, a diaphragm resonance frequency detection module, an ambient air pressure prediction module, a displacement prediction module, a gain processing module and an initial preload module.

[0087] Among them, the IV feedback module collects the real-time voltage and current information of the speaker, and sends it to the real-time ambient temperature detection module and the real-time diaphragm resonance frequency detection module; the real-time ambient temperature detection module processes the real-time voltage and current signals to obtain the real-time ambient temperature and sends it to the diaphragm resonance frequency detection module; the real-time diaphragm resonance frequency detection module processes the real-time voltage and current signals to obtain the real-time diaphragm resonance frequency and sends it to the diaphragm resonance frequency detection module; the diaphragm resonance frequency detection module determines the diaphragm resonance frequency of the speaker according to the received real-time ambient temperature and real-time diaphragm resonance frequency, and sends it to the ambient air pressure prediction module; the ambient air pressure prediction module obtains the predicted ambient air pressure based on the diaphragm resonance frequency prediction, and sends it to the displacement prediction model; the displacement prediction model obtains the predicted diaphragm displacement according to the input audio signal processed by the initial preload module and the predicted ambient air pressure prediction, and sends it to the gain processing module; the gain processing module performs gain adjustment on the predicted diaphragm displacement, and outputs the diaphragm displacement after gain adjustment, so that the diaphragm displacement can be applied to the input audio signal adjusted by the initial preload module to obtain the output audio signal and send it to the speaker for playback.

[0088] Specifically, first, the IV feedback module collects the real-time voltage and current signals at the speaker end, and feeds them back to the real-time ambient temperature detection module and the real-time diaphragm resonance frequency detection module. The real-time diaphragm resonance frequency detection module obtains the predicted current based on the ratio between the real-time voltage in the real-time voltage and current signal and the preset initial impedance of the speaker, and iterates the speaker impedance model according to the difference between the predicted current and the real-time current in the real-time voltage and current signal to obtain the target impedance, so as to obtain the corresponding real-time diaphragm resonance frequency according to the target impedance and send it to the diaphragm resonance frequency detection module; the real-time ambient temperature detection module obtains the real-time voltage and current signals by detecting the audio, and performs an FFT transform of a specific frequency to obtain the voltage and current corresponding to the detected audio signal, and calculates the real-time impedance, so as to obtain the corresponding real-time ambient temperature according to the real-time impedance and send it to the diaphragm resonance frequency detection module.

[0089] Next, when the real-time ambient temperature meets the preset ambient temperature condition (such as the real-time ambient temperature is close to 25°C), the diaphragm resonance frequency detection module determines that the real-time resonance frequency corresponding to the real-time ambient temperature is the diaphragm resonance frequency of the speaker and sends it to the ambient pressure prediction module, or determines the difference between the real-time diaphragm resonance frequency and the diaphragm resonance frequency change value as the diaphragm resonance frequency of the speaker, and sends it to the ambient pressure prediction module; the ambient pressure prediction module calculates the predicted ambient pressure corresponding to the diaphragm resonance frequency based on the monotonic function of the diaphragm resonance frequency and the ambient pressure of the speaker, and sends it to the displacement prediction model.

[0090] Then, the adaptive gain model in the displacement prediction model performs gain adjustment based on the preset filter gain and the predicted ambient air pressure to obtain the adjusted filter gain and output it to the diaphragm prediction displacement filter model in the displacement prediction model. The diaphragm prediction displacement filter model outputs the diaphragm predicted displacement to the gain processing module based on the adjusted filter gain, the preset cutoff frequency, the preset quality factor and the input audio signal.

[0091] Finally, when the predicted diaphragm displacement meets the preset diaphragm displacement condition (that is, the predicted diaphragm displacement is greater than the maximum amplitude of the diaphragm in the speaker), the gain processing module calculates the diaphragm displacement gain corresponding to the predicted diaphragm displacement and adjusts it; when the frequency value of the original audio signal meets the preset frequency condition, the initial pre-pressure module adjusts the voltage of the original audio signal to obtain the input audio signal, and then applies the diaphragm displacement adjusted by the gain processing module to the input audio signal adjusted by the initial pre-pressure module to obtain the output audio signal and send it to the speaker for playback.

[0092] In summary, the audio signal processing system of the present application can automatically adapt to the performance of the speaker in different air pressure scenarios, ensuring that the speaker can normally control the displacement when the ambient air pressure becomes low (for example, in high altitude areas), and ensuring that the speaker will not be damaged due to the diaphragm exceeding the limit. The performance of the speaker is fully released and the user's hearing experience is improved. The audio signal processing system of the present application adopts internal closed-loop control, and only requires the power amplifier and audio signal processing algorithm to cooperate to adaptively adjust the diaphragm displacement of the speaker. There is no need for the platform to provide additional air pressure and temperature data. In addition, adaptation can also be performed when the platform provides air pressure and temperature data.

[0093] The audio signal processing method of this embodiment can be executed by any appropriate electronic device with data processing capability, including but not limited to: a server, a mobile terminal (such as a mobile phone, a PAD, etc.) and a PC, etc.

[0094] Figure 6 The figure is a structural block diagram of an audio signal processing device according to an embodiment of the present application.

[0095] like Figure 6As shown, the audio signal processing device 600 includes: a first determination module 601, detecting the diaphragm resonance frequency of the speaker; a second determination module 602, obtaining the predicted ambient pressure corresponding to the diaphragm resonance frequency based on the preset relationship between the diaphragm resonance frequency and the ambient pressure of the speaker; a prediction module 603, predicting the diaphragm displacement of the speaker based on the input audio signal of the speaker and the predicted ambient pressure, and obtaining the predicted diaphragm displacement of the speaker when playing the input audio signal under the predicted ambient pressure; a calculation module 604, calculating the diaphragm displacement gain corresponding to the predicted diaphragm displacement based on the preset relationship between the predicted diaphragm displacement and the diaphragm displacement gain when the predicted diaphragm displacement meets the preset diaphragm displacement condition; an adjustment module 605, adjusting the diaphragm displacement of the speaker based on the diaphragm displacement gain, and applying the adjusted diaphragm displacement to the input audio signal.

[0096] In some embodiments of the present application, the first determination module 601 is specifically used to: determine the real-time diaphragm resonance frequency and the corresponding real-time ambient temperature; when the real-time ambient temperature meets the preset ambient temperature condition, determine the real-time diaphragm resonance frequency as the diaphragm resonance frequency of the speaker.

[0097] In some embodiments of the present application, the first determination module 601 is specifically used to: determine the real-time diaphragm resonance frequency and the corresponding real-time ambient temperature; calculate the theoretical diaphragm resonance frequency corresponding to the real-time ambient temperature based on the fitting function, and calculate the difference between the theoretical diaphragm resonance frequency and the preset diaphragm resonance frequency to obtain the diaphragm resonance frequency change value, wherein the fitting function is a function obtained by fitting discrete data consisting of different historical ambient temperatures and the corresponding historical diaphragm resonance frequencies; and determine the difference between the real-time diaphragm resonance frequency and the diaphragm resonance frequency change value as the diaphragm resonance frequency of the speaker.

[0098] In some embodiments of the present application, the first determination module 601 is also used to: calculate the ratio between the real-time voltage in the received real-time voltage and current signal and the preset speaker initial impedance to obtain a predicted current, wherein the real-time voltage and current signal is a voltage-current conversion signal corresponding to the input audio signal; iterate the speaker impedance model according to the difference between the predicted current and the real-time current in the real-time voltage and current signal until the difference reaches a preset condition, and determine that the impedance output by the speaker impedance model is the target impedance; query the diaphragm resonance frequency corresponding to the target impedance from the preset diaphragm resonance frequency and impedance curve, and determine it as the real-time resonance frequency.

[0099] In some embodiments of the present application, the first determination module 601 is also used to: perform data processing on the received real-time voltage and current signals to obtain the voltage and current signals after data processing; calculate the ratio between the voltage and current in the voltage and current signals to obtain the real-time impedance; input the real-time impedance into the preset relationship between the real-time impedance and the real-time ambient temperature, and calculate the real-time ambient temperature corresponding to the real-time impedance.

[0100] In some embodiments of the present application, before predicting the speaker diaphragm displacement based on the speaker's input audio signal and the predicted ambient air pressure, an acquisition module (not shown in the figure) is also used to: obtain the original audio signal of the speaker; determine whether the frequency value of the original audio signal meets a preset frequency condition; if so, adjust the voltage of the original audio signal to obtain the input audio signal after voltage adjustment.

[0101] In some embodiments of the present application, the prediction module 603 is specifically used to: perform gain adjustment based on a preset filter gain and a predicted ambient air pressure to obtain an adjusted filter gain; perform displacement prediction based on the adjusted filter gain, a preset cutoff frequency, a preset quality factor and an input audio signal to obtain a predicted diaphragm displacement.

[0102] In some embodiments of the present application, before obtaining the predicted ambient air pressure corresponding to the diaphragm resonance frequency based on the preset relationship between the diaphragm resonance frequency and the ambient air pressure of the speaker, the second determination module 602 is also used to: determine the preset relationship between ambient air pressure and air resistance according to the preset relationship between ambient air pressure and air density and the preset relationship between air resistance and air density; determine the preset relationship between ambient air pressure and the stiffness of the elastic diaphragm of the speaker according to the preset relationship between air resistance and the stiffness of the elastic diaphragm of the speaker and the preset relationship between ambient air pressure and air resistance; determine the preset relationship between the diaphragm resonance frequency and ambient air pressure according to the preset relationship between the stiffness of the elastic diaphragm of the speaker and the diaphragm resonance frequency and the preset relationship between ambient air pressure and the stiffness of the elastic diaphragm of the speaker.

[0103] According to the audio signal processing device of the embodiment of the present application, the predicted ambient air pressure corresponding to the diaphragm of the speaker is determined by the resonance frequency of the diaphragm, and the predicted diaphragm displacement is obtained according to the input audio signal and the predicted ambient air pressure, so that when the predicted diaphragm displacement meets the preset diaphragm displacement condition, it is adaptively adjusted, thereby protecting the diaphragm of the speaker and enabling the diaphragm of the speaker to act on the input audio signal according to the adjusted diaphragm displacement, fully releasing the performance of the speaker and improving the user's listening experience.

[0104] The audio signal processing device 600 of this embodiment is used to implement the corresponding audio signal processing methods in the aforementioned multiple method embodiments, and has the beneficial effects of the corresponding method embodiments, which will not be described in detail here. In addition, the functional implementation of each module in the audio signal processing device 600 of this embodiment can refer to the description of the corresponding parts in the aforementioned method embodiments, which will not be described in detail here.

[0105] Figure 7 This is a structural block diagram of an electronic device according to an embodiment of the present application. The specific embodiment of the present application does not limit the specific implementation of the electronic device.

[0106] like Figure 7 As shown, the electronic device 700 may include: a processor 702, a memory 703, a communication interface 704 and a communication bus 705. The processor 702, the memory 703 and the communication interface 704 communicate with each other through the communication bus 705; the memory 703 is used to store at least one executable instruction, and the executable instruction enables the processor 702 to perform the operation corresponding to the audio signal processing method of any of the above embodiments.

[0107] The processor 702 may be a central processing unit (CPU), or an application-specific integrated circuit (ASIC), or one or more integrated circuits configured to implement the embodiments of the present application. The one or more processors included in the smart device may be processors of the same type, such as one or more CPUs; or processors of different types, such as one or more CPUs and one or more ASICs.

[0108] The memory 703 is used to store programs, and may include a high-speed RAM memory, and may also include a non-volatile memory (non-volatile memory), such as at least one disk memory.

[0109] According to the electronic device of the embodiment of the present application, the predicted ambient air pressure corresponding to the diaphragm of the speaker is determined by the resonance frequency of the diaphragm, and the predicted diaphragm displacement is obtained according to the input audio signal and the predicted ambient air pressure, so that when the predicted diaphragm displacement meets the preset diaphragm displacement condition, it is adaptively adjusted, thereby protecting the speaker diaphragm and enabling the diaphragm of the speaker to act on the input audio signal according to the adjusted diaphragm displacement, fully releasing the performance of the speaker and improving the user's listening experience.

[0110] An embodiment of the present application further provides a computer storage medium on which a computer program is stored. When the program is executed by a processor, the audio signal processing method of any of the above embodiments is implemented.

[0111] According to the computer storage medium of the embodiment of the present application, the predicted ambient air pressure corresponding to the diaphragm of the speaker is determined by the resonance frequency of the diaphragm, and the predicted diaphragm displacement is obtained according to the input audio signal and the predicted ambient air pressure, so that when the predicted diaphragm displacement meets the preset diaphragm displacement condition, it is adaptively adjusted, thereby protecting the speaker diaphragm and enabling the diaphragm of the speaker to act on the input audio signal according to the adjusted diaphragm displacement, fully releasing the performance of the speaker and improving the user's listening experience.

[0112] It should be pointed out that, according to the needs of implementation, the various components / steps described in the embodiments of the present application can be split into more components / steps, or two or more components / steps or partial operations of components / steps can be combined into new components / steps to achieve the purpose of the embodiments of the present application.

[0113] The above-mentioned method according to the embodiment of the present application can be implemented in hardware, firmware, or implemented as software or computer code that can be stored in a recording medium (such as a CD ROM, RAM, floppy disk, hard disk or magneto-optical disk), or implemented as computer code originally stored in a remote recording medium or a non-temporary machine-readable medium downloaded through a network and to be stored in a local recording medium, so that the method described herein can be stored in such software processing on a recording medium using a general-purpose computer, a dedicated processor or programmable or dedicated hardware (such as an ASIC or FPGA). It can be understood that a computer, a processor, a microprocessor controller or programmable hardware includes a storage component (e.g., RAM, ROM, flash memory, etc.) that can store or receive software or computer code, and when the software or computer code is accessed and executed by a computer, a processor or hardware, the audio signal processing method described herein is implemented. In addition, when a general-purpose computer accesses the code for implementing the audio signal processing method shown herein, the execution of the code converts the general-purpose computer into a dedicated computer for executing the audio signal processing method shown herein.

[0114] Those of ordinary skill in the art will appreciate that the units and method steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of the embodiments of the present application.

[0115] The above implementation methods are only used to illustrate the embodiments of the present application, and are not intended to limit the embodiments of the present application. Ordinary technicians in the relevant technical field can make various changes and modifications without departing from the spirit and scope of the embodiments of the present application. Therefore, all equivalent technical solutions also belong to the scope of the embodiments of the present application, and the scope of patent protection of the embodiments of the present application should be defined by the claims. The systems, devices or modules described in the above embodiments can be implemented by computer chips or entities, or by products with certain functions.

Claims

1. An audio signal processing method, characterized in that: The method comprises: Determine the speaker's diaphragm resonant frequency; Based on a preset relationship between the diaphragm resonance frequency and the ambient air pressure of the speaker, a predicted ambient air pressure corresponding to the diaphragm resonance frequency is obtained; Predicting the displacement of a diaphragm of the loudspeaker based on the input audio signal of the loudspeaker and the predicted ambient air pressure, to obtain the predicted displacement of the diaphragm of the loudspeaker when playing the input audio signal under the predicted ambient air pressure; When the predicted diaphragm displacement satisfies a preset diaphragm displacement condition, calculating a diaphragm displacement gain corresponding to the predicted diaphragm displacement based on a preset relationship between the predicted diaphragm displacement and the diaphragm displacement gain; The diaphragm displacement of the speaker is adjusted based on the diaphragm displacement gain, and the adjusted diaphragm displacement is applied to the input audio signal.

2. The audio signal processing method according to claim 1, characterized in that: Determine the speaker's diaphragm resonant frequency, including: Determine the real-time diaphragm resonance frequency and the corresponding real-time ambient temperature; When the real-time ambient temperature meets a preset ambient temperature condition, the real-time diaphragm resonance frequency is determined to be the diaphragm resonance frequency of the speaker.

3. The audio signal processing method according to claim 1, characterized in that: Determine the speaker's diaphragm resonant frequency, including: Determine the real-time diaphragm resonance frequency and the corresponding real-time ambient temperature; The theoretical diaphragm resonance frequency corresponding to the real-time ambient temperature is calculated based on the fitting function, and the difference between the theoretical diaphragm resonance frequency and the preset diaphragm resonance frequency is calculated to obtain the diaphragm resonance frequency change value, wherein the fitting function is a function obtained by fitting discrete data consisting of different historical ambient temperatures and corresponding historical diaphragm resonance frequencies; The difference between the real-time diaphragm resonance frequency and the diaphragm resonance frequency change value is determined as the diaphragm resonance frequency of the speaker.

4. The audio signal processing method according to claim 2, characterized in that: Determine real-time diaphragm resonance frequency, including: Calculating a ratio between a real-time voltage in a received real-time voltage and current signal and a preset speaker initial impedance to obtain a predicted current, wherein the real-time voltage and current signal is a voltage and current signal corresponding to the input audio signal; Iterating the speaker impedance model according to the difference between the predicted current and the real-time current in the real-time voltage and current signal until the difference reaches a preset condition, and determining that the impedance output by the speaker impedance model is a target impedance; The diaphragm resonance frequency corresponding to the target impedance is queried from a preset diaphragm resonance frequency and impedance curve, and is determined as the real-time diaphragm resonance frequency.

5. The audio signal processing method according to claim 2, characterized in that: Determine real-time ambient temperature, including: Performing data processing on the received real-time voltage and current signals to obtain voltage and current signals after data processing; Calculating the ratio between the voltage and the current in the voltage and current signal to obtain the real-time impedance; The real-time impedance is input into a preset relationship between the real-time impedance and the real-time ambient temperature, and the real-time ambient temperature corresponding to the real-time impedance is calculated.

6. The audio signal processing method according to claim 1, characterized in that: Before predicting the loudspeaker diaphragm displacement based on the loudspeaker input audio signal and the predicted ambient air pressure, the method further includes: Acquire the original audio signal of the speaker; Determining whether the frequency value of the original audio signal meets a preset frequency condition; If so, the voltage of the original audio signal is adjusted to obtain a voltage-adjusted input audio signal.

7. The audio signal processing method according to claim 1, characterized in that: Predicting the displacement of a diaphragm of a loudspeaker based on the input audio signal of the loudspeaker and the predicted ambient air pressure to obtain the predicted displacement of the diaphragm of the loudspeaker when playing the input audio signal under the predicted ambient air pressure includes: Performing gain adjustment based on a preset filter gain and the predicted ambient air pressure to obtain an adjusted filter gain; The displacement prediction is performed based on the adjusted filter gain, the preset cutoff frequency, the preset quality factor and the input audio signal to obtain the predicted displacement of the diaphragm.

8. The audio signal processing method according to claim 1, characterized in that: Before obtaining the predicted ambient air pressure corresponding to the diaphragm resonance frequency based on the preset relationship between the diaphragm resonance frequency and the ambient air pressure of the speaker, the method further includes: Determining a preset relationship between the ambient air pressure and the air resistance according to a preset relationship between the ambient air pressure and the air density and a preset relationship between the air resistance and the air density; Determining a preset relationship between the ambient air pressure and the elastic diaphragm stiffness of the loudspeaker according to the preset relationship between the air resistance and the elastic diaphragm stiffness of the loudspeaker and the preset relationship between the ambient air pressure and the air resistance; The preset relationship between the diaphragm resonant frequency and the ambient air pressure is determined according to the preset relationship between the elastic diaphragm stiffness of the loudspeaker and the diaphragm resonant frequency and the preset relationship between the ambient air pressure and the elastic diaphragm stiffness of the loudspeaker.

9. An audio signal processing device, characterized in that: The device comprises: A first determination module determines the resonance frequency of the diaphragm of the speaker; A second determination module, based on a preset relationship between the diaphragm resonance frequency and the ambient air pressure of the speaker, obtains a predicted ambient air pressure corresponding to the diaphragm resonance frequency; A prediction module, which predicts the displacement of a diaphragm of the speaker based on the input audio signal of the speaker and the predicted ambient air pressure, and obtains the predicted displacement of the diaphragm of the speaker when the speaker plays the input audio signal under the predicted ambient air pressure; a calculation module, which calculates a diaphragm displacement gain corresponding to the predicted diaphragm displacement based on a preset relationship between the predicted diaphragm displacement and the diaphragm displacement gain when the predicted diaphragm displacement satisfies a preset diaphragm displacement condition; The adjustment module adjusts the diaphragm displacement of the speaker based on the diaphragm displacement gain, and applies the adjusted diaphragm displacement to the input audio signal.

10. An electronic device, comprising: A processor, a memory, a communication interface and a communication bus, wherein the processor, the memory and the communication interface communicate with each other via the communication bus; The memory is used to store at least one executable instruction, and the executable instruction enables the processor to perform an operation corresponding to the audio signal processing method according to any one of claims 1 to 8.

11. A computer storage medium having a computer program stored thereon, wherein when the program is executed by a processor [AW20230055ICN1][HS2410811CCN], the audio signal processing method as described in any one of claims 1 to 8 is implemented.

Images