Audio processing method, apparatus and computer readable storage medium

Abstract

The application discloses an audio processing method and device and a computer readable storage medium, and the method comprises the following steps: determining a first audio signal and a second audio signal according to audio to be played, wherein the frequency of the first audio signal is less than or equal to a preset frequency; performing phase compensation on the first audio signal and / or the second audio signal to reduce the phase difference between the first audio signal and the second audio signal; generating a harmonic signal with a frequency greater than the preset frequency according to the first audio signal; and synthesizing target playing audio of a loudspeaker according to the harmonic signal and the second audio signal. The application aims to improve the intelligibility of the audio after bass enhancement.

Description

Technical Field

[0001] This invention relates to the field of audio processing technology, and in particular to an audio processing method, apparatus, and computer-readable storage medium. Background Technology

[0002] The speakers used in external speaker systems such as head-mounted displays are relatively small, resulting in a relatively high cutoff frequency, generally around 50 to 60 Hz. This makes it difficult to reproduce the low-frequency range properly, causing problems such as harsh drum sounds and thin vocals.

[0003] In related technologies, bass enhancement is achieved by utilizing psychoacoustic phenomena such as the fundamental frequency loss principle. This involves using the low-frequency components of the audio signal as the fundamental frequency, generating corresponding higher harmonics, and replacing the low-frequency components with these higher harmonics. This eliminates the need for external speakers to play the low-frequency components; instead, the higher-frequency harmonics are used to achieve the desired low-frequency sound. However, the low-frequency components need to be filtered from the audio signal before bass enhancement can be applied. Filtering causes a phase shift in the bass components, creating a phase difference with other parts of the audio signal, resulting in a decrease in clarity after bass enhancement.

[0004] The above content is only used to help understand the technical solution of the present invention and does not represent an admission that the above content is prior art. Summary of the Invention

[0005] The main objective of this invention is to provide an audio processing method, apparatus, and computer-readable storage medium, which aims to improve the clarity of audio after bass enhancement.

[0006] To achieve the above objectives, the present invention provides an audio processing method, the audio processing method comprising:

[0007] A first audio signal and a second audio signal are determined based on the audio to be played, wherein the frequency of the first audio signal is less than or equal to a preset frequency;

[0008] Phase compensation is performed on the first audio signal and / or the second audio signal to reduce the phase difference between the first audio signal and the second audio signal;

[0009] A harmonic signal with a frequency greater than the preset frequency is generated based on the first audio signal;

[0010] The target audio to be played by the speaker is synthesized based on the harmonic signal and the second audio signal.

[0011] Optionally, before the step of performing phase compensation on the first audio signal and / or the second audio signal, the method further includes:

[0012] Determine the phase difference between the first audio signal and the second audio signal;

[0013] The first phase response function corresponding to the first audio signal and / or the second phase response function corresponding to the second audio signal are determined based on the phase difference.

[0014] A first compensation filter is constructed based on the first phase response function, and / or a second compensation filter is constructed based on the second phase response function;

[0015] The step of performing phase compensation on the first audio signal and / or the second audio signal to reduce the phase difference between the first audio signal and the second audio signal includes:

[0016] Phase compensation is performed on the first audio signal based on the first compensation filter, and / or phase compensation is performed on the second audio signal based on the second compensation filter, to reduce the phase difference between the first audio signal and the second audio signal.

[0017] Optionally, the step of determining the phase difference between the first audio signal and the second audio signal includes:

[0018] Obtain the first phase response of the first link corresponding to the first audio signal, and the second phase response of the second link corresponding to the second audio signal;

[0019] The phase difference is determined based on the first phase response and the second phase response.

[0020] Optionally, the step of determining the first audio signal and the second audio signal based on the audio to be played includes:

[0021] The audio to be played is input into the first filter to obtain the first audio signal;

[0022] The audio to be played is input into the second filter to obtain the second audio signal;

[0023] The first filter and the second filter are constructed according to the preset frequency.

[0024] Optionally, the step of obtaining the first phase response of the first link corresponding to the first audio signal and the second phase response of the second link corresponding to the second audio signal includes:

[0025] Obtain the first filter parameters of the first filter, and determine the first phase response based on the first filter parameters;

[0026] Obtain the second filter parameters of the second filter, and determine the second phase response based on the second filter parameters.

[0027] Optionally, the step of constructing a first compensation filter based on the first phase response function and / or constructing a second compensation filter based on the second phase response function includes:

[0028] Solve the first phase response function to determine the first filter order and the first filter parameters;

[0029] The first compensation filter is constructed based on the first filter order and the first filter parameters; and / or

[0030] Solve for the second phase response function to determine the order of the second filter and the parameters of the second filter;

[0031] The second compensation filter is constructed based on the second filter order and the second filter parameters.

[0032] Optionally, before the step of determining the first audio signal and the second audio signal based on the audio to be played, the method further includes:

[0033] Obtain the cutoff frequency of the loudspeaker;

[0034] The cutoff frequency is used as the preset frequency.

[0035] Optionally, before the step of performing phase compensation on the first audio signal and / or the second audio signal, the method further includes:

[0036] Obtain the audio to be played from the speaker;

[0037] Determine the minimum playback frequency based on the application scenario of the speaker;

[0038] The filter removes audio signals from the audio to be played or from the first audio signal that have a frequency lower than the minimum playback frequency.

[0039] In addition, to achieve the above objectives, the present invention also provides an audio processing apparatus, the audio processing apparatus including a memory, a processor, and an audio processing program stored in the memory and executable on the processor, wherein the audio processing program, when executed by the processor, implements the steps of the audio processing method as described above.

[0040] In addition, to achieve the above objectives, the present invention also provides a computer-readable storage medium storing an audio processing program, which, when executed by a processor, implements the steps of the audio processing method described above.

[0041] This invention discloses an audio processing method, apparatus, and computer-readable storage medium. The method involves determining a first audio signal and a second audio signal based on the audio to be played, wherein the frequency of the first audio signal is less than or equal to a preset frequency. Phase compensation is performed on the first audio signal and / or the second audio signal to reduce the phase difference between them. A harmonic signal with a frequency greater than the preset frequency is generated based on the first audio signal. The target playback audio for a speaker is synthesized based on the harmonic signal and the second audio signal. This method first performs phase compensation on the first and second audio signals to reduce the phase difference between them. After converting the first audio signal into a harmonic signal with a frequency greater than the preset frequency, a bass enhancement effect is achieved. Since the phase difference between the harmonic signal and the second audio signal is not large or there is no phase difference, the target playback audio for the speaker is synthesized based on the harmonic signal and the second audio signal, resulting in clearer playback of the target audio. Therefore, the clarity of the bass-enhanced audio can be improved. Attached Figure Description

[0042] Figure 1 This is a schematic diagram of the terminal structure of the hardware operating environment involved in the embodiments of the present invention;

[0043] Figure 2 This is a flowchart illustrating an embodiment of the audio processing method of the present invention;

[0044] Figure 3 This is a flowchart illustrating another embodiment of the audio processing method of the present invention;

[0045] Figure 4 This is a simplified diagram of the audio processing device architecture according to an embodiment of the present invention.

[0046] The realization of the objective, functional features and advantages of the present invention will be further explained in conjunction with the embodiments and with reference to the accompanying drawings. Detailed Implementation

[0047] It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.

[0048] In related technologies, the low-frequency part needs to be obtained by filtering the audio signal in order to enhance the bass. Filtering the audio will cause a phase change in the bass part, creating a phase difference with other parts of the audio signal, resulting in a decrease in the clarity of the audio after bass enhancement.

[0049] To improve the clarity of audio after bass enhancement, embodiments of the present invention provide an audio processing method, apparatus, and computer-readable storage medium, wherein the main steps of the method include:

[0050] A first audio signal and a second audio signal are determined based on the audio to be played, wherein the frequency of the first audio signal is less than or equal to a preset frequency;

[0051] Phase compensation is performed on the first audio signal and / or the second audio signal to reduce the phase difference between the first audio signal and the second audio signal;

[0052] A harmonic signal with a frequency greater than the preset frequency is generated based on the first audio signal;

[0053] The target audio to be played by the speaker is synthesized based on the harmonic signal and the second audio signal.

[0054] In this way, the first and second audio signals separated from the audio signal are first compensated for phase. After the first audio signal is converted into a harmonic signal with a frequency greater than the preset frequency, the phase difference between the harmonic signal and the second audio signal will not be too large or there will be no phase difference. Thus, the target playback audio of the speaker is synthesized based on the harmonic signal and the second audio signal, and the target playback audio will be clearer when playing the target playback audio, thereby improving the audio clarity after bass enhancement.

[0055] The claims of this invention will be described in detail below with reference to the accompanying drawings.

[0056] like Figure 1 As shown, Figure 1 This is a schematic diagram of the terminal structure of the hardware operating environment involved in the embodiments of the present invention.

[0057] In this embodiment of the invention, the terminal can be an audio processing device.

[0058] like Figure 1 As shown, the terminal may include: a processor 1001, such as a CPU, a memory 1003, and a communication bus 1002. The communication bus 1002 is used to enable communication between these components. The memory 1003 may be a high-speed RAM or a stable, non-volatile memory, such as a disk drive. Optionally, the memory 1003 may also be a storage device independent of the aforementioned processor 1001.

[0059] Those skilled in the art will understand that Figure 1 The terminal structure shown does not constitute a limitation on the terminal and may include more or fewer components than shown, or combine certain components, or have different component arrangements.

[0060] like Figure 1 As shown, the memory 1003, which serves as a computer storage medium, may include an operating system and an audio processing program.

[0061] exist Figure 1 In the terminal shown, the processor 1001 can be used to call the audio processing program stored in the memory 1003 and perform the following operations:

[0062] A first audio signal and a second audio signal are determined based on the audio to be played, wherein the frequency of the first audio signal is less than or equal to a preset frequency;

[0063] Phase compensation is performed on the first audio signal and / or the second audio signal to reduce the phase difference between the first audio signal and the second audio signal;

[0064] A harmonic signal with a frequency greater than the preset frequency is generated based on the first audio signal;

[0065] The target audio to be played by the speaker is synthesized based on the harmonic signal and the second audio signal.

[0066] Furthermore, the processor 1001 can call the audio processing program stored in the memory 1003 and also perform the following operations:

[0067] Determine the phase difference between the first audio signal and the second audio signal;

[0068] The first phase response function corresponding to the first audio signal and / or the second phase response function corresponding to the second audio signal are determined based on the phase difference.

[0069] A first compensation filter is constructed based on the first phase response function, and / or a second compensation filter is constructed based on the second phase response function;

[0070] The step of performing phase compensation on the first audio signal and / or the second audio signal to reduce the phase difference between the first audio signal and the second audio signal includes:

[0071] Phase compensation is performed on the first audio signal based on the first compensation filter, and / or phase compensation is performed on the second audio signal based on the second compensation filter, to reduce the phase difference between the first audio signal and the second audio signal.

[0072] Furthermore, the processor 1001 can call the audio processing program stored in the memory 1003 and also perform the following operations:

[0073] Obtain the first phase response of the first link corresponding to the first audio signal, and the second phase response of the second link corresponding to the second audio signal;

[0074] The phase difference is determined based on the first phase response and the second phase response.

[0075] Furthermore, the processor 1001 can call the audio processing program stored in the memory 1003 and also perform the following operations:

[0076] The audio to be played is input into the first filter to obtain the first audio signal;

[0077] The audio to be played is input into the second filter to obtain the second audio signal;

[0078] The first filter and the second filter are constructed according to the preset frequency.

[0079] Furthermore, the processor 1001 can call the audio processing program stored in the memory 1003 and also perform the following operations:

[0080] Obtain the first filter parameters of the first filter, and determine the first phase response based on the first filter parameters;

[0081] Obtain the second filter parameters of the second filter, and determine the second phase response based on the second filter parameters.

[0082] Furthermore, the processor 1001 can call the audio processing program stored in the memory 1003 and also perform the following operations:

[0083] Solve the first phase response function to determine the first filter order and the first filter parameters;

[0084] The first compensation filter is constructed based on the first filter order and the first filter parameters; and / or

[0085] Solve for the second phase response function to determine the order of the second filter and the parameters of the second filter;

[0086] The second compensation filter is constructed based on the second filter order and the second filter parameters.

[0087] Furthermore, the processor 1001 can call the audio processing program stored in the memory 1003 and also perform the following operations:

[0088] Obtain the cutoff frequency of the loudspeaker;

[0089] The cutoff frequency is used as the preset frequency.

[0090] Furthermore, the processor 1001 can call the audio processing program stored in the memory 1003 and also perform the following operations:

[0091] Obtain the audio to be played from the speaker;

[0092] Determine the minimum playback frequency based on the application scenario of the speaker;

[0093] The filter removes audio signals from the audio to be played or from the first audio signal that have a frequency lower than the minimum playback frequency.

[0094] For example, refer to Figure 2 In one embodiment of the audio processing method of the present invention, the audio processing method includes the following steps:

[0095] Step S10: Determine a first audio signal and a second audio signal based on the audio to be played, wherein the frequency of the first audio signal is less than or equal to a preset frequency;

[0096] In this embodiment, the audio to be played is the audio waiting to be played by the speaker. However, before the speaker plays the audio to be played, it needs to be processed to improve the playback effect of the speaker.

[0097] A loudspeaker is a device that emits sound based on audio signals. However, the frequency range of sound that a loudspeaker can emit is limited. The loudspeakers used in head-mounted displays and other external speaker systems have relatively high cutoff frequencies due to their size, typically around 50-60 Hz or even higher. This prevents them from properly reproducing low-frequency audio, resulting in harsh drum sounds and poor vocal reproduction.

[0098] Bass enhancement is an algorithm that utilizes a psychoacoustic phenomenon known as the fundamental frequency deficiency. This principle states that a polyphonic tone composed of the fundamental frequency (e.g., 50Hz) and its harmonics (e.g., 100, 150, 200, 250, 300Hz) is considered equal to the fundamental frequency, allowing the reproduction of the fundamental frequency's audio even if the reproduced signal does not contain it. In other words, bass harmonics use this phenomenon to generate artificial harmonics from audio signals that are too low to be reproduced by smaller speakers, thus reproducing the low-frequency sound. Essentially, it replaces the low-frequency portion of an audio signal with higher harmonics generated from that low-frequency component. Therefore, bass signals below the cutoff frequency of the external speaker can be converted to a higher frequency range, allowing even speakers with poor low-frequency capabilities to reproduce the low-frequency sound. However, traditional bass enhancement inevitably involves filtering the audio signal to be enhanced. This filtering process alters the phase of the audio signal, creating a phase difference between it and the original signal or other signals. Since the speaker actually plays the original signal or other signals, this phase difference results in a decrease in audio clarity, particularly vocals, making them difficult to discern. Therefore, maintaining audio quality while effectively enhancing bass becomes crucial.

[0099] After acquiring the audio to be played, a first audio signal and a second audio signal are determined based on the audio. The first audio signal can be separated from the audio to be played using a filter. The frequency of the first audio signal is less than or equal to a preset frequency, and it is a portion of the audio signal in the audio to be played that requires bass enhancement. The second audio signal includes all other audio signals in the audio to be played except for the first audio signal; therefore, the second audio signal can be any of the other audio signals in the audio to be played except for the first audio signal, or it can be the entire audio signal to be played, etc.

[0100] The preset frequency is the maximum frequency of a portion of the audio signal in the audio to be played that needs bass enhancement. If the audio signal in the audio to be played is less than or equal to the preset frequency, it means that the frequency of these audio signals is too low and difficult to be reproduced by the speaker. Therefore, the audio signals in the audio to be played that are less than or equal to the preset frequency need to be bass enhanced so that these lower frequency audio signals can be reproduced by the speaker.

[0101] Step S20: Perform phase compensation on the first audio signal and / or the second audio signal to reduce the phase difference between the first audio signal and the second audio signal;

[0102] In this embodiment, since the first audio signal is an audio signal obtained by classifying the audio to be played through a filter, the phase of the first audio signal changes, and there will be a phase difference between it and the second audio signal. In order to play the audio to be played completely, it is necessary to play the first audio signal and the second audio signal together. However, the phase difference between the two will cause the audio to be unclear when the speaker plays, resulting in a deterioration in audio quality.

[0103] Phase compensation is performed on the first audio signal and / or the second audio signal. Phase compensation can be achieved through a phase compensation filter, which can adjust the phase of the audio signal as a whole or part of it. The adjustment goal is to make the phase between the first audio signal and the second audio signal closer, so as to reduce the phase difference between the first audio signal and the second audio signal, including making the phase difference between the first audio signal and the second audio signal zero.

[0104] It should be noted that the goal of phase compensation is to reduce the phase difference between the first audio signal and the second audio signal. Phase compensation can be performed on the first audio signal to make its phase closer to the second audio signal, and vice versa. Phase compensation can also be performed on the second audio signal to make its phase closer to the first audio signal. Alternatively, an intermediate phase can be found so that both the first and second audio signals are close to or have no phase difference from the intermediate phase.

[0105] Step S30: Generate a harmonic signal with a frequency greater than the preset frequency based on the first audio signal;

[0106] In this embodiment, the first audio signal is a low-frequency signal, which can serve as the fundamental frequency signal to generate harmonic signals based on the low-frequency signal. For example, if the frequency of the first audio signal is 50Hz, the harmonic generation module determines that the harmonics it can generate are 100, 150, 200, 250, and 300Hz. Since the complex tone composed of harmonics can produce the effect of the fundamental frequency tone, the harmonic signals can replace the first audio signal to control the speaker to produce sound, thereby reproducing the first audio signal.

[0107] The harmonic signal generated from the first audio signal has a higher frequency than the first audio signal. This harmonic signal has undergone phase compensation with respect to the first and / or second audio signals, reducing the phase difference between them. Since the harmonic signal is generated from the first audio signal, there is no phase difference between them. Therefore, the phase difference between the harmonic signal and the second audio signal is also relatively small.

[0108] Step S40: Synthesize the target audio for the speaker based on the harmonic signal and the second audio signal.

[0109] In this embodiment, playing the harmonic signal can reproduce the tone of the first audio signal to play the content of the first audio signal. The second audio signal includes other signals in the audio to be played besides the first audio signal, and playing the second audio signal can play the content of the other signals. Therefore, the harmonic signal and the second audio signal can completely display all the content of the audio to be played. The harmonic signal and the second audio signal are synthesized into the target playback audio of the speaker. The target playback audio is the actual audio that controls the speaker to play, and the playback content is the same as the audio to be played. Since the phase difference between the harmonic signal and the second audio signal is also small, the audio clarity of the target playback audio synthesized by the two is high, so that even if the sound played by the speaker is enhanced with bass, that is, a harmonic signal with a frequency greater than a preset frequency is generated according to the first audio signal, and the harmonic signal is used to replace the first audio signal to control the speaker to produce sound. A speaker is a device that can emit sound according to an audio signal and has a cutoff frequency. In particular, some external speakers have characteristics such as small size. The speakers involved in this embodiment include, but are not limited to, speakers on products such as mobile phones, tablets, computers, augmented display devices, virtual reality devices, smart audio glasses, neckband speakers, open headphones, audio equipment, and televisions.

[0110] For example, refer to Figure 4 The audio processing device includes a frequency division processing module, a phase correction module, a harmonic generation module, and a harmonic control module. The audio to be played is input to the frequency division processing module, which generates a first audio signal and a second audio signal. The frequency of the first audio signal is less than or equal to a preset frequency, and the frequency of the second audio signal can be greater than the preset frequency. The phase correction module performs phase compensation on the first audio signal and / or the second audio signal to reduce the phase difference between them. The harmonic generation module generates a harmonic signal with a frequency greater than the preset frequency based on the first audio signal. The harmonic control module synthesizes the target audio for the speaker based on the harmonic signal and the second audio signal, and controls the speaker to emit sound according to the target audio.

[0111] In the technical solution disclosed in this embodiment, a first audio signal and a second audio signal are determined based on the audio to be played, wherein the frequency of the first audio signal is less than or equal to a preset frequency; phase compensation is performed on the first audio signal and / or the second audio signal to reduce the phase difference between the first audio signal and the second audio signal; a harmonic signal with a frequency greater than the preset frequency is generated based on the first audio signal; and the target playback audio of the speaker is synthesized based on the harmonic signal and the second audio signal. In this way, the first audio signal and the second audio signal, separated from the audio to be played, are first phase compensated to reduce the phase difference between the first audio signal and the second audio signal. After converting the first audio signal into a harmonic signal with a frequency greater than the preset frequency, a bass enhancement effect is achieved on the first audio signal. Since the phase difference between the harmonic signal and the second audio signal is not too large or there is no phase difference, the target playback audio of the speaker is synthesized based on the harmonic signal and the second audio signal, resulting in clearer playback of the target audio. Therefore, it can be seen that not only can the low-frequency signal in the audio to be played be enhanced, but the clarity of the enhanced bass audio can also be improved, thereby improving the audio texture and eliminating the problem of muffled audio.

[0112] Furthermore, prior to the step of performing phase compensation on the first audio signal and / or the second audio signal, the method further includes:

[0113] Determine the phase difference between the first audio signal and the second audio signal;

[0114] The first phase response function corresponding to the first audio signal and / or the second phase response function corresponding to the second audio signal are determined based on the phase difference.

[0115] A first compensation filter is constructed based on the first phase response function, and / or a second compensation filter is constructed based on the second phase response function;

[0116] The step of performing phase compensation on the first audio signal and / or the second audio signal to reduce the phase difference between the first audio signal and the second audio signal includes:

[0117] Phase compensation is performed on the first audio signal based on the first compensation filter, and / or phase compensation is performed on the second audio signal based on the second compensation filter, to reduce the phase difference between the first audio signal and the second audio signal.

[0118] In this embodiment, the phase difference between a first audio signal and a second audio signal can be determined by comparison. This phase difference can be a local or global phase difference. Based on the phase difference, a first phase response function corresponding to the first audio signal and / or a second phase response function corresponding to the second audio signal are determined. The phase response function is constructed based on the first or second audio signal and is used to adjust the phase of either the first or second audio signal, with the adjustment target being to reduce the phase difference between the first and second audio signals. Since there are multiple ways to achieve the adjustment target, the first phase response function corresponding to the first audio signal and / or the second phase response function corresponding to the second audio signal can be determined based on the phase difference. Then, a first compensation filter is constructed based on the first phase response function, and / or a second compensation filter is constructed based on the second phase response function. The compensation filters are used to adjust the phase of the first audio signal and / or the second audio signal. The first compensation filter is placed on the audio link through which the first audio signal passes, and the second compensation filter is placed on the audio link through which the second audio signal passes. During phase compensation, the first audio signal is transmitted along the audio link. If there is a first compensation filter on the first audio link, the first compensation filter will perform phase compensation on the first audio signal after passing through the first compensation filter. The second audio signal is transmitted along the audio link. If there is a second compensation filter on the second audio link, the second compensation filter will perform phase compensation on the second audio signal after passing through the second compensation filter, thereby achieving the effect of reducing the phase difference between the two signals.

[0119] By determining the phase response function based on the difference between the two signals, a corresponding compensation filter can be constructed between the first audio signal and / or the second audio signal. The compensation filter can perform phase compensation on the passed audio signal, thereby reducing the phase difference between the first audio signal and the second audio signal.

[0120] Further, the step of determining the phase difference between the first audio signal and the second audio signal includes:

[0121] Obtain the first phase response of the first link corresponding to the first audio signal, and the second phase response of the second link corresponding to the second audio signal;

[0122] The phase difference is determined based on the first phase response and the second phase response.

[0123] In this embodiment, the phase difference between the first audio signal and the second audio signal can be determined not only by comparison, but also by the first link and the second link that transmits the first and second audio signals. The first link is the audio link that generates the first audio signal, and the second link is the audio link that generates the second audio signal. (Refer to...) Figure 4 The distribution processing module filters the audio to be played, generating a first audio signal on the first audio link. The phase change caused by generating the first audio signal on the first link is fixed, and this fixed phase change is called the first phase response. Similarly, the fixed phase change caused by generating the second audio signal on the second link is called the second phase response. The first and second phase responses are determined when the first and second links are constructed. When any audio signal (audio to be played) is generated as the first audio signal on the first link, its phase will change due to the first phase response; when any audio signal (audio to be played) is generated as the second audio signal on the second link, its phase will change due to the second phase response. Based on the first and second phase responses, the phase difference between the first and second audio signals can be determined in advance. Since the first and second phase responses can be determined in advance, the difference between the two can be determined before the generation of the first and second audio signals. Therefore, a compensation filter can be constructed before or after step S10, so only one compensation filter needs to be constructed to accurately process all the audio to be played by the speaker, which can improve the speaker's sound quality and the clarity of the audio after bass enhancement.

[0124] Furthermore, the step of determining the first audio signal and the second audio signal based on the audio to be played includes:

[0125] The audio to be played is input into the first filter to obtain the first audio signal;

[0126] The audio to be played is input into the second filter to obtain the second audio signal;

[0127] The first filter and the second filter are constructed according to the preset frequency.

[0128] Reference Figure 4The allocation processing module, which passes through the first and second links, needs to determine the first and second audio signals based on the audio to be played. This module can consist of two filters: a first filter to filter out frequencies less than or equal to a preset frequency in the audio to be played, resulting in the first audio signal; and a second filter to filter out frequencies greater than the preset frequency in the audio to be played, resulting in the second audio signal. Thus, the first audio signal comprises audio signals less than or equal to the preset frequency in the audio to be played, and the second audio signal comprises audio signals greater than the preset frequency in the audio to be played. The second audio signal includes all audio signals in the audio to be played except for the first audio signal. Both the first and second filters are filters constructed using preset frequencies to filter the audio signals.

[0129] This allows for the rapid extraction of the first and second audio signals from the audio to be played using a filter. This enables phase compensation of the first and / or second audio signals, making it easier to enhance the bass of the first audio signal and thus improving the clarity of the audio after bass enhancement.

[0130] Further, the step of obtaining the first phase response of the first link corresponding to the first audio signal and the second phase response of the second link corresponding to the second audio signal includes:

[0131] Obtain the first filter parameters of the first filter, and determine the first phase response based on the first filter parameters;

[0132] Obtain the second filter parameters of the second filter, and determine the second phase response based on the second filter parameters.

[0133] In this embodiment, the phase response is the phase change between the audio signal and the audio to be played after the audio signal is generated on the link. The main reason for the phase change is the filtering process of the filter on the audio to be played. The filtering process of the filter on the audio to be played does not change; it is determined according to the filter parameters. Therefore, the phase response can also be determined according to the filter parameters. The first filter parameters of the first filter are obtained, and the first phase response is determined according to the first filter parameters. The second filter parameters of the second filter are obtained, and the second phase response is determined according to the second filter parameters. Thus, the phase response can be determined in advance, the phase difference between the first audio signal and the second audio signal can be determined in advance, and the compensation filter can be set in advance on the audio link through which the first audio signal and / or the second audio signal pass. This allows for rapid processing of all the audio to be played by the speaker, improving the clarity of the audio after bass enhancement and improving the sound quality of the speaker.

[0134] Further, the steps of constructing a first compensation filter based on the first phase response function and / or constructing a second compensation filter based on the second phase response function include:

[0135] Solve the first phase response function to determine the first filter order and the first filter parameters;

[0136] The first compensation filter is constructed based on the first filter order and the first filter parameters; and / or

[0137] Solve for the second phase response function to determine the order of the second filter and the parameters of the second filter;

[0138] The second compensation filter is constructed based on the second filter order and the second filter parameters.

[0139] In this example, when a second phase response function exists, the initial solution of the first phase response function is determined using algorithms such as the group delay method. Based on the initial solution, the order of the first filter is determined. Then, based on the order of the first filter, intelligent algorithms such as genetic algorithms, particle swarm optimization, and whale swarm optimization are used to solve the first phase response function and determine the parameters of the first filter. When a second phase response function exists, the initial solution of the second phase response function is determined using algorithms such as the group delay method. Based on the initial solution, the order of the second filter is determined. Then, based on the order of the second filter, intelligent algorithms such as genetic algorithms, particle swarm optimization, and whale swarm optimization are used to solve the second phase response function and determine the parameters of the second filter.

[0140] Specifically, when using a genetic algorithm to solve for the parameters of a phase compensation filter, a set of initial solutions is first obtained through the group delay decomposition method as the initial chromosomes of the population in the genetic algorithm. Based on this, the population is generated and evolved to achieve phase difference-free operation between different branches.

[0141] By solving the phase response function, the required filter order and parameters for constructing the compensation filter can be determined, and the compensation filter can be constructed to quickly compensate for the phase difference between two signals, thereby improving the audio clarity after bass enhancement.

[0142] Optionally, refer to Figure 3 Based on any of the above embodiments, in another embodiment of the audio processing method of the present invention, before step S10, the method further includes:

[0143] Step S10: Obtain the cutoff frequency of the speaker;

[0144] Step S20: Use the cutoff frequency as the preset frequency.

[0145] In this embodiment, the audio to be played controls the speaker to emit sound. The speaker is a device capable of emitting sound according to the audio to be played, but the frequency range of sound that the speaker can emit is limited. Frequency that is too high (above the upper limit frequency) or too low (below the lower limit frequency) cannot be reproduced. The cutoff frequency is the lower limit frequency of the sound that the speaker can emit; when the frequency is below the cutoff frequency, the speaker cannot emit sound. Using the speaker's cutoff frequency as a preset frequency for separating the first audio signal allows for the accurate filtering of audio signals that cannot be reproduced by the speaker from the audio to be played.

[0146] In the technical solution disclosed in this embodiment, the cutoff frequency of the speaker is obtained; the cutoff frequency is used as the preset frequency, so that audio signals that cannot be reproduced by the speaker can be accurately filtered out from the audio to be played, so that all audio signals in the first audio signal are signals that the speaker cannot reproduce, which can improve the efficiency of bass enhancement, thereby improving the clarity of the audio bass enhancement and improving the listening experience.

[0147] Furthermore, prior to the step of performing phase compensation on the first audio signal and / or the second audio signal, the method further includes:

[0148] Obtain the audio to be played from the speaker;

[0149] Determine the minimum playback frequency based on the application scenario of the speaker;

[0150] The filter removes audio signals from the audio to be played or from the first audio signal that have a frequency lower than the minimum playback frequency.

[0151] In this embodiment, the audio signals below the preset frequency in the audio to be played include not only the audio signals that need to be reproduced by the speaker, but also some low-frequency bands that do not need to be reproduced by the speaker. These are determined according to the application scenario of the speaker. For example, when the speaker is playing a recording, it needs to filter low-frequency noise to improve the audiovisual experience. However, if these low-frequency noises are less than or equal to the preset frequency, they will actually be reproduced due to low-frequency enhancement. Therefore, it is necessary to filter out the unwanted low-frequency signals, i.e., audio signals that are lower than the minimum playback frequency corresponding to the current application scenario of the speaker, before enhancing the bass of the first audio signal. Filtering out such signals can also be achieved by a filter. The filter can be installed before the module that generates the first audio signal, or after the module that generates the first audio signal, before the phase compensation module, thereby filtering out audio signals below the minimum playback frequency in the audio to be played or the first audio signal based on the filter.

[0152] This filters out audio signals with the lowest playback frequency corresponding to the application scenario of the speaker from the audio to be played or the first audio signal, so that the bass enhancement does not process these signals, which can improve the efficiency of bass enhancement, thereby improving the clarity of the audio bass enhancement and improving the listening experience.

[0153] Furthermore, this invention also proposes an audio processing apparatus, which includes a memory, a processor, and an audio processing program stored in the memory and executable on the processor. When the audio processing program is executed by the processor, it implements the steps of the audio processing methods described in the above embodiments.

[0154] Furthermore, embodiments of the present invention also propose a computer-readable storage medium storing an audio processing program, which, when executed by a processor, implements the steps of the audio processing methods described in the above embodiments.

[0155] It should be noted that, in this document, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or system that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or system. Unless otherwise specified, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or system that includes that element.

[0156] The sequence numbers of the above embodiments of the present invention are for descriptive purposes only and do not represent the superiority or inferiority of the embodiments.

[0157] Through the above description of the embodiments, those skilled in the art can clearly understand that the methods of the above embodiments can be implemented by means of software plus necessary general-purpose hardware platforms. Of course, they can also be implemented by hardware, but in many cases the former is a better implementation method. Based on this understanding, the technical solution of the present invention, or the part that contributes to the prior art, can be embodied in the form of a software product. This computer software product is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk) as described above, and includes several instructions to cause the audio processing device to execute the methods described in the various embodiments of the present invention.

[0158] The above are merely preferred embodiments of the present invention and do not limit the patent scope of the present invention. Any equivalent structural or procedural transformations made based on the content of the present invention's specification and drawings, or direct or indirect applications in other related technical fields, are similarly included within the patent protection scope of the present invention.

Claims

1. An audio processing method, characterized in that, The audio processing method includes: A first audio signal and a second audio signal are determined based on the audio to be played, wherein the frequency of the first audio signal is less than or equal to a preset frequency; Obtain the first phase response of the first link corresponding to the first audio signal, and the second phase response of the second link corresponding to the second audio signal; The phase difference is determined based on the first phase response and the second phase response; The first phase response function corresponding to the first audio signal and / or the second phase response function corresponding to the second audio signal are determined based on the phase difference. Solve the first phase response function to determine the first filter order and the first filter parameters; A first compensation filter is constructed based on the first filter order and the first filter parameters; and / or Solve for the second phase response function to determine the order of the second filter and the parameters of the second filter; A second compensation filter is constructed based on the second filter order and the second filter parameters; Phase compensation is performed on the first audio signal and / or the second audio signal to reduce the phase difference between the first audio signal and the second audio signal, including: performing phase compensation on the first audio signal based on the first compensation filter, and / or performing phase compensation on the second audio signal based on the second compensation filter to reduce the phase difference between the first audio signal and the second audio signal; A harmonic signal with a frequency greater than the preset frequency is generated based on the first audio signal; The target audio to be played by the speaker is synthesized based on the harmonic signal and the second audio signal.

2. The audio processing method as described in claim 1, characterized in that, The step of determining the first audio signal and the second audio signal based on the audio to be played includes: The audio to be played is input into the first filter to obtain the first audio signal; The audio to be played is input into the second filter to obtain the second audio signal; The first filter and the second filter are constructed according to the preset frequency.

3. The audio processing method as described in claim 2, characterized in that, The steps of obtaining the first phase response of the first link corresponding to the first audio signal and the second phase response of the second link corresponding to the second audio signal include: Obtain the first filter parameters of the first filter, and determine the first phase response based on the first filter parameters; Obtain the second filter parameters of the second filter, and determine the second phase response based on the second filter parameters.

4. The audio processing method as described in claim 1, characterized in that, Before the step of determining the first audio signal and the second audio signal based on the audio to be played, the method further includes: Obtain the cutoff frequency of the loudspeaker; The cutoff frequency is used as the preset frequency.

5. The audio processing method as described in claim 1, characterized in that, Before the step of performing phase compensation on the first audio signal and / or the second audio signal, the method further includes: Obtain the audio to be played from the speaker; Determine the minimum playback frequency based on the application scenario of the speaker; The filter removes audio signals from the audio to be played or from the first audio signal that are lower than the minimum playback frequency.

6. An audio processing apparatus, characterized in that, The audio processing apparatus includes: a memory, a processor, and an audio processing program stored in the memory and executable on the processor, wherein the audio processing program, when executed by the processor, implements the steps of the audio processing method as described in any one of claims 1 to 5.

7. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores an audio processing program, which, when executed by a processor, implements the steps of the audio processing method as described in any one of claims 1 to 5.

Images