Audio signal processing method and device, earphone, and storage medium
By outputting mixed audio signals in the headphones to detect ear shape and wearing status and calculate the corresponding equalization parameters, the problem that traditional headphones cannot adapt to user differences is solved, and more efficient audio signal noise reduction processing is achieved.
Patent Information
- Application Number
- CN202110954133.2
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2021-08-19
- Publication Date
- 2025-10-10
- Estimated Expiration
- 2041-08-19
AI Technical Summary
Traditional audio processing methods are difficult to effectively adjust to the differences in ear shape and wearing styles of different users, resulting in the headphones being unable to perform appropriate noise reduction processing according to user needs, reducing the effectiveness of active noise reduction.
A test audio signal that is a mixture of basic audio signals and infrasonic signals is output through a speaker, and the audio signal is collected and received using a feedback microphone. The first equalization parameter is calculated for ear shape adaptive equalization, and the second equalization parameter is calculated for wearing leakage adaptive equalization to achieve personalized audio signal processing.
The effectiveness of active noise reduction of headphones on audio signals has been improved, ensuring that the target audio signal is not deformed or attenuated during the transmission process, and can more accurately restore the original sound quality to meet the actual needs of users.
Smart Images

Figure CN115942170B_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the technical field of electronic equipment, and in particular to an audio signal processing method and device, headphones, and a storage medium. Background Art
[0002] Currently, when using headphones, earphone users often experience unexpected differences in hearing due to differences in ear shape, size, and other physiological structures, as well as in how they wear them. In practice, it has been found that traditional audio processing methods (such as volume adjustment and noise reduction) are difficult to effectively adjust for these differences. Consequently, the headphones are unable to perform appropriate noise reduction on the output audio signal based on the user's actual needs, reducing the effectiveness of the headphones' active noise reduction. Summary of the Invention
[0003] The embodiments of the present application disclose an audio signal processing method and device, headphones, and a storage medium, which can enable the headphones to provide personalized ear shape adaptive equalization and wearing leakage adaptive equalization for different users, thereby improving the effectiveness of the headphones in actively reducing audio signals.
[0004] A first aspect of an embodiment of the present application discloses an audio signal processing method, which is applied to a headset, wherein the headset includes a speaker and a feedback microphone. The method includes:
[0005] Outputting a test audio signal through the speaker, wherein the test audio signal is obtained by mixing a basic audio signal and an infrasound signal;
[0006] collecting a received audio signal corresponding to the test audio signal through the feedback microphone;
[0007] A first equalization parameter corresponding to the basic audio signal is determined based on the received audio signal, and a second equalization parameter corresponding to the infrasonic wave signal is determined based on the received audio signal, wherein the first equalization parameter is used to perform ear-shape adaptive equalization on the target audio signal to be output to match the user's ear shape, and the second equalization parameter is used to perform wearing leakage adaptive equalization on the target audio signal to match the wearing state of the headphone.
[0008] A second aspect of an embodiment of the present application discloses an audio signal processing method, which is applied to a headset, wherein the headset includes a speaker and a feedback microphone. The method includes:
[0009] outputting a test audio signal through the speaker, wherein the test audio signal comprises any one of a white noise signal and an audio data signal;
[0010] collecting a received audio signal corresponding to the test audio signal through the feedback microphone;
[0011] determining, based on the received audio signal, a test ear shape transfer function corresponding to the received audio signal;
[0012] Based on the least squares criterion, a first equalization parameter corresponding to the basic audio signal is calculated according to the test ear shape transfer function and the target ear shape transfer function. The first equalization parameter is used to perform ear shape adaptive equalization on the target audio signal to be output to match the user's ear shape.
[0013] A third aspect of an embodiment of the present application discloses an audio signal processing method, which is applied to a headset, wherein the headset includes a speaker and a feedback microphone. The method includes:
[0014] outputting a test audio signal through the speaker, wherein the test audio signal comprises an infrasound signal;
[0015] collecting a received audio signal corresponding to the test audio signal through the feedback microphone;
[0016] The signal energy of the received audio signal is calculated, and a second equalization parameter corresponding to the infrasound signal is determined according to the signal energy, wherein the second equalization parameter is used to perform wearing leakage adaptive equalization on the target audio signal to be output that matches the wearing state of the headphone.
[0017] A fourth aspect of an embodiment of the present application discloses an audio signal compensation device, which is applied to headphones. The headphones include a speaker and a feedback microphone. The audio signal processing device includes:
[0018] a first output unit, configured to output a test audio signal through the speaker, wherein the test audio signal is obtained by mixing a basic audio signal and an infrasound signal;
[0019] a first receiving unit, configured to collect a received audio signal corresponding to the test audio signal through the feedback microphone;
[0020] A first parameter calculation unit is used to determine a first equalization parameter corresponding to the basic audio signal based on the received audio signal, and to determine a second equalization parameter corresponding to the infrasonic wave signal based on the received audio signal, wherein the first equalization parameter is used to perform ear-shape adaptive equalization on the target audio signal to be output so as to match the user's ear shape, and the second equalization parameter is used to perform wearing leakage adaptive equalization on the target audio signal so as to match the wearing state of the headphone.
[0021] A fifth aspect of an embodiment of the present application discloses an audio signal compensation device, which is applied to headphones. The headphones include a speaker and a feedback microphone. The audio signal processing device includes:
[0022] a second output unit, configured to output a test audio signal through the speaker, wherein the test audio signal includes any one of a white noise signal and an audio data signal;
[0023] a second receiving unit, configured to collect a received audio signal corresponding to the test audio signal through the feedback microphone;
[0024] a function determining unit, configured to determine, based on the received audio signal, a test ear shape transfer function corresponding to the received audio signal;
[0025] The second parameter calculation unit is configured to calculate, based on a least squares criterion and according to the test ear shape transfer function and the target ear shape transfer function, a first equalization parameter corresponding to the basic audio signal, wherein the first equalization parameter is used to perform ear shape adaptive equalization on the target audio signal to be output so as to match the user's ear shape.
[0026] A sixth aspect of the present application discloses an audio signal compensation device, which is applied to headphones. The headphones include a speaker and a feedback microphone. The audio signal processing device includes:
[0027] a third output unit, configured to output a test audio signal through the speaker, wherein the test audio signal comprises an infrasound signal;
[0028] a third receiving unit, configured to collect a received audio signal corresponding to the test audio signal through the feedback microphone;
[0029] a third parameter calculation unit, configured to calculate the signal energy of the received audio signal and determine a second equalization parameter corresponding to the infrasound signal based on the signal energy, wherein the second equalization parameter is used to perform wearing leakage adaptive equalization on the target audio signal to be output so as to match the wearing state of the headphone.
[0030] In a seventh aspect of an embodiment of the present application, a headset is disclosed, comprising a memory and a processor, wherein a computer program is stored in the memory. When the computer program is executed by the processor, the processor implements all or part of the steps in any one of the audio signal processing methods disclosed in the first, second or third aspects of the embodiment of the present application.
[0031] An eighth aspect of an embodiment of the present application discloses a computer-readable storage medium storing a computer program, wherein, when the computer program is executed by a processor, all or part of the steps in any one of the audio signal processing methods disclosed in the first, second or third aspects of the embodiment of the present application are implemented.
[0032] Compared with the related art, the embodiments of the present application have the following beneficial effects:
[0033] In an embodiment of the present application, a headset using an audio signal processing method may include a speaker and a feedback microphone, and output a test audio signal through the speaker, wherein the test audio signal can be obtained by mixing a basic audio signal with an infrasonic signal. On this basis, the headset can collect a received audio signal corresponding to the test audio signal through its feedback microphone, and then determine a first equalization parameter corresponding to the above-mentioned basic audio signal and a second equalization parameter corresponding to the above-mentioned infrasonic signal based on the received audio signal, wherein the first equalization parameter can be used to perform ear shape adaptive equalization on the target audio signal to be output to match the user's ear shape, and the second equalization parameter can be used to perform wear leakage adaptive equalization on the target audio signal to match the headphone wearing state. It can be seen that the implementation of the embodiment of the present application can detect personalized factors such as the ear shape and headphone wearing state of different users wearing the headset by mixing a test audio signal with different audio components, and thus achieve corresponding equalization. Based on the collected received audio signal corresponding to the above-mentioned test audio signal, the headset can respectively determine the equalization parameters that match the above-mentioned personalized factors to perform personalized ear shape adaptive equalization and wear leakage adaptive equalization on the target audio signal to be output by the headset. By achieving the above-mentioned equalization, the headphones can perform more accurate noise reduction processing on the equalized target audio signal, avoiding the noise reduction operation of the headphones that does not match the actual needs of the user due to deformation, attenuation and other problems of the unequalized target audio signal, thereby helping to improve the effectiveness of the headphones in actively reducing audio signals. BRIEF DESCRIPTION OF THE DRAWINGS
[0034] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the following is a brief introduction to the drawings required for use in the embodiments. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without any creative work.
[0035] Figure 1A This is a schematic diagram of an application scenario of the audio signal processing method disclosed in an embodiment of the present application;
[0036] Figure 1BThis is a schematic diagram of another application scenario of the audio signal processing method disclosed in the embodiment of the present application;
[0037] Figure 2 This is a flowchart of an audio signal processing method disclosed in an embodiment of the present application;
[0038] Figure 3 This is a schematic diagram of a process for mixing a basic audio signal and an infrasound signal disclosed in an embodiment of the present application;
[0039] Figure 4A is a schematic diagram of a test audio signal disclosed in an embodiment of the present application;
[0040] Figure 4B is a schematic diagram of another test audio signal disclosed in an embodiment of the present application;
[0041] Figure 5 is a flowchart of another audio signal processing method disclosed in an embodiment of the present application;
[0042] Figure 6 1 is a schematic diagram of the amplitude-frequency response corresponding to an ear shape transfer function disclosed in an embodiment of the present application;
[0043] Figure 7 is based on Figure 6 Schematic diagram of the amplitude-frequency response of the first equalizer configured by the first equalization parameter determined by the ear shape transfer function shown;
[0044] Figure 8 1 is a schematic diagram of the amplitude-frequency response of a system under different leakage levels disclosed in an embodiment of the present application;
[0045] Figure 9 is based on Figure 8 Schematic diagram of amplitude-frequency response of the second equalizer configured by the second equalization parameters determined by different leakage levels;
[0046] Figure 10 is through Figure 9 Schematic diagram of the amplitude-frequency response of the system after equalization by the second equalizer shown;
[0047] Figure 11 This is a flowchart of another audio signal processing method disclosed in an embodiment of the present application;
[0048] Figure 12 This is a schematic structural diagram of an earphone disclosed in an embodiment of the present application;
[0049] Figure 13 is a flowchart of the fourth audio signal processing method disclosed in the embodiment of the present application;
[0050] Figure 14is a flowchart of the fifth audio signal processing method disclosed in the embodiment of the present application;
[0051] Figure 15 This is a modular schematic diagram of an audio signal processing device disclosed in an embodiment of the present application;
[0052] Figure 16 This is a modular schematic diagram of another audio signal processing device disclosed in an embodiment of the present application;
[0053] Figure 17 This is a modular schematic diagram of another audio signal processing device disclosed in an embodiment of the present application;
[0054] Figure 18 This is a modular schematic diagram of an earphone disclosed in an embodiment of the present application. DETAILED DESCRIPTION
[0055] The following will be combined with the accompanying drawings in the embodiments of this application to clearly and completely describe the technical solutions in the embodiments of this application. Obviously, the embodiments described are only part of the embodiments of this application, not all of the embodiments. Based on the embodiments in this application, all other embodiments obtained by ordinary technicians in this field without making creative efforts are within the scope of protection of this application.
[0056] It should be noted that the terms "including" and "having" in the embodiments of the present application and any variations thereof are intended to cover non-exclusive inclusions. For example, a process, method, system, product or device that includes a series of steps or units is not necessarily limited to those steps or units clearly listed, but may include other steps or units that are not clearly listed or are inherent to these processes, methods, products or devices.
[0057] The embodiments of the present application disclose an audio signal processing method and device, headphones, and a storage medium, which can enable the headphones to provide personalized ear shape adaptive equalization and wearing leakage adaptive equalization for different users, effectively improving the effectiveness of the headphones in actively reducing audio signals.
[0058] The following is a detailed description with reference to the accompanying drawings.
[0059] Please also refer to Figure 1A and Figure 1B , Figure 1A This is a schematic diagram of an application scenario of the audio signal processing method disclosed in the embodiment of this application. Figure 1B This is another application scenario diagram of the audio signal processing method disclosed in the embodiment of this application. Figure 1AAs shown, the application scenario may include a user 10 and headphones 20. The user 10 can use the headphones 20 to detect the impact of personalized factors such as the user's own ear shape and the wearing status of the headphones 20 on his or her own listening effect, and then determine corresponding equalization parameters based on the above-mentioned personalized factors to configure a suitable equalizer to perform equalization filtering on the target audio signal to be output by the headphones 20, thereby achieving targeted personalized equalization, which is conducive to the headphones 20 to perform more accurate noise reduction processing on the equalized target audio signal, and improve the effectiveness of the active noise reduction of the headphones 20.
[0060] Exemplarily, the earphone 20 can use a test audio signal to detect the impact of the above-mentioned personalized factors on the listening effect of the user 10. The test audio signal can be obtained by mixing a basic audio signal and an infrasound signal. Among them, the above-mentioned basic audio signal refers to the main audio component used to constitute the test audio signal, which can be used to detect the impact of the user 10's own ear shape on his listening to the test audio signal; the above-mentioned infrasound signal refers to an audio signal with a sound frequency lower than the human ear hearing range (generally 20 to 20,000 Hz), that is, a sound frequency below 20 Hz. It can be used to detect the impact of the wearing state of the earphone 20 by the user 10 on his listening to the test audio signal, especially the low-frequency leakage of the test audio signal caused by improper wearing of the earphone, inappropriate earplug size, etc. (manifested as abnormal attenuation of the test audio signal in the mid- and low-frequency bands). By mixing the above-mentioned basic audio signal and infrasonic signal, the earphone 20 can use the obtained test audio signal to simultaneously analyze the influence of multiple different personalized factors, and then set corresponding equalization parameters for different personalized factors, so as to simultaneously achieve ear shape adaptive equalization and wearing leakage adaptive equalization, etc., which helps to improve the equalization effect of the earphone 20 on the audio signal.
[0061] In an embodiment of the present application, the headset 20 may include a speaker and a feedback microphone. When the user 10 wears the headset 20, the feedback microphone is located between the speaker and the user. Specifically, the headset 20 can output the test audio signal through its speaker. The test audio signal can be generated in real time when the headset 20 needs to detect the personalized factors, or it can be pre-generated and stored in the headset 20. For example, in the case of pre-generating the test audio signal, before the headset 20 leaves the factory, a specified basic audio signal (such as a white noise signal, an audio data signal, etc., which can include an audio data signal corresponding to audio data with actual information such as music files, recording files, and chat voice) can be mixed with the infrasound signal, and the resulting test audio signal can be stored in the memory circuit of the headset 20 for recall and output when the personalized factors need to be detected. Based on this, the headset 20 can collect a received audio signal corresponding to the test audio signal through its feedback microphone and determine a first equalization parameter corresponding to the basic audio signal based on the received audio signal. The first equalization parameter can be used to perform ear-shaped adaptive equalization on the target audio signal to be output by the headset 20. At the same time, based on the received audio signal, the earphone 20 can also determine a second equalization parameter corresponding to the above-mentioned infrasound signal. The second equalization parameter can be used to perform wearing leakage adaptive equalization on the target audio signal.
[0062] It can be seen that the above method can realize the personalized equalization function of the earphone 20 based on personalized factors such as the ear shape of the user 10 and the wearing status of the earphone, so that after the above-mentioned equalization is performed on the target audio signal to be output, the target audio signal heard by the user 10 can be restored to its actual original sound quality as much as possible (that is, the timbre, pitch, etc. of the target audio signal when it was recorded or generated are restored as much as possible). Furthermore, the above method also helps the earphone 20 to perform more accurate noise reduction processing on the target audio signal, avoiding problems such as deformation and attenuation of the unequalized target audio signal during the propagation process, which causes the earphone 20 to misjudge the initial sound quality of the target audio signal and perform noise reduction operations that do not match the actual needs of the user 10, thereby helping to improve the effectiveness of the earphone 20 in actively reducing the audio signal.
[0063] Alternatively, as Figure 1BAs shown, the earphone 20 can also establish a communication connection with the terminal device 30, so that when it is necessary to output a test audio signal to detect the impact of the above-mentioned personalized factors on the listening experience of the user 10, the user 10 can interact with the terminal device 30 to trigger the earphone 20 to perform the above-mentioned detection through the terminal device 30 and determine the corresponding equalization parameters. In some embodiments, when the terminal device 30 detects a test interaction operation by the user 10 (such as a touch operation such as clicking or swiping a test button on the terminal device 30, sending a voice operation containing a specified keyword such as "test" to the terminal device 30, or moving the terminal device 30 along a preset trajectory), it can send a corresponding test instruction to the earphone 20 to trigger the earphone 20 to output the test audio signal. The test audio signal can include a test audio signal pre-generated and stored in the earphone 20 or on the terminal device 30 (to be transmitted to the earphone 20 for output), or a test audio signal obtained by real-time mixing of a basic audio signal output by the terminal device 30 with an infrasound signal. In other embodiments, when the terminal device 30 detects that the user 10 controls its output audio data signal, it can transmit the corresponding audio data (such as music files, recording files, chat voice, etc.) to the headset 20. When the headset 20 plays the corresponding audio data signal, it can trigger itself to use the audio data signal as a basic audio signal to mix with the infrasound signal stored or generated by the headset 20 to obtain a real-time test audio signal and output it.
[0064] Among them, the above-mentioned terminal device 30 may include various devices or systems with wireless communication functions, such as mobile phones, smart wearable devices, vehicle-mounted terminals, tablet computers, PCs (Personal Computers), PDAs (Personal Digital Assistants), etc., which are not specifically limited in the embodiments of this application.
[0065] See also Figure 2 , Figure 2 FIG. 1 is a flow chart of an audio signal processing method disclosed in an embodiment of the present application. The method can be applied to the above-mentioned earphones, which may include a speaker and a feedback microphone. Figure 2 As shown, the audio signal processing method may include the following steps:
[0066] 202. Output a test audio signal through a speaker, where the test audio signal is obtained by mixing a basic audio signal and an infrasound signal.
[0067] In an embodiment of the present application, in order to determine the impact of personalized factors such as the ear shape of the headphone user, the wearing state when wearing the headphones, etc. on the user's own listening effect, a test audio signal obtained by mixing the basic audio signal and the infrasonic wave signal can be used for targeted detection.
[0068] Among them, the above-mentioned basic audio signals may include white noise signals, audio data signals (such as music files, recording files, chat voices and other audio data corresponding to actual information), etc., which can cover a larger frequency range, especially the main frequency bands included in the human ear hearing range, so that they can be used to detect the impact of the audio system in which the headset is located (that is, the path for the audio signal output by the headset to be transmitted between the headset and the user) on the test audio signal within the above-mentioned frequency range. Specifically, since the personalized differences in ear shape of different users mainly affect the audio signal transmission process in the higher frequency range (such as 1000Hz or above), by detecting the basic audio signal contained in the above-mentioned test audio signal, the higher frequency range can be analyzed in subsequent steps to achieve corresponding ear shape adaptive equalization based on the personalized differences in ear shape of different users.
[0069] Among them, the above-mentioned infrasonic signal may include a pure tone signal at a specific infrasonic frequency (i.e., less than 20Hz), such as an infrasonic signal with a frequency of 10Hz, 12Hz, 15Hz, etc., which is only for the ultra-low frequency range of infrasonic frequency, and can be used to detect the impact of the audio system in which the headset is located on the test audio signal in this ultra-low frequency range. On this basis, the low-frequency leakage that may be caused by the different headphone wearing states of the user mainly affects the audio signal transmission process in the lower frequency range (such as the frequency band below 1000Hz). By detecting the infrasonic signal contained in the above-mentioned test audio signal, the lower frequency range can be analyzed in the subsequent steps to achieve corresponding wearing leakage adaptive equalization based on the personalized differences in the headphone wearing states of different users.
[0070] For example, see Figure 3 , Figure 3 This is a flow chart of mixing a basic audio signal and an infrasound signal disclosed in an embodiment of the present application. Figure 3As shown, when a test audio signal needs to be generated, the basic audio signal can be first input into a high-pass filter, the basic audio signal is filtered by the high-pass filter, and then the filtered basic audio signal and the infrasonic signal are input into a mixer together for mixing. The mixer can be used to directly add the filtered basic audio signal to the infrasonic signal, or to adjust the gain of the filtered basic audio signal and the infrasonic signal, add them together, adjust the delay, etc., so as to obtain a mixed test audio signal. It should be noted that the cutoff frequency of the above-mentioned high-pass filter can be higher than the frequency corresponding to the infrasonic signal, thereby effectively reducing the interference of the basic audio signal on the infrasonic signal, and facilitating the independent realization of the above-mentioned ear shape adaptive equalization and wearing leakage adaptive equalization.
[0071] Optionally, the process of mixing the basic audio signal and the infrasound signal can be performed in the headset or outside the headset. In some embodiments, the basic audio signal and the infrasound signal can be pre-stored in the storage circuit of the headset respectively. When the test audio signal needs to be obtained, the headset can call the specified basic audio signal and infrasound signal, perform the above mixing process to obtain the test audio signal, and output the test audio signal through its built-in speaker. In other embodiments, the specified basic audio signal and the infrasound signal can also be pre-mixed, and the mixed test audio signal can be stored in the storage circuit of the headset. When the test audio signal needs to be output, it can be called and output again. In some other embodiments, the basic audio signal can be stored in a terminal device connected to the headset. When the terminal device outputs the basic audio signal through the headset (such as playing a music file, a recording file, a chat voice, etc.), the basic audio signal can be mixed with the specified infrasound signal in real time to obtain the mixed test audio signal and output it to the user.
[0072] For example, please refer to Figure 4A and Figure 4B . Figure 4A This is a schematic diagram of a test audio signal disclosed in an embodiment of the present application, showing a test audio signal obtained by passing the white noise signal through a high-pass filter and mixing it with an infrasound signal (taking a pure tone signal with a frequency of 10 Hz as an example) when the above-mentioned basic audio signal is a white noise signal. Figure 4B This is a schematic diagram of another test audio signal disclosed in an embodiment of the present application, showing a test audio signal obtained by passing the audio data signal through a high-pass filter and mixing it with an infrasonic signal (still taking a pure tone signal with a frequency of 10 Hz as an example) when the above-mentioned basic audio signal is an audio data signal (taking the audio data signal corresponding to a music file as an example).
[0073] 204、acquire a received audio signal corresponding to the test audio signal via a feedback microphone.
[0074] In the embodiments of the present application, the earphone can acquire a received audio signal corresponding to the test audio signal via its built-in feedback microphone immediately after outputting the test audio signal. The test audio signal is used for transmission in the audio system in which the earphone is located, and after being received by the feedback microphone, it can be used to evaluate the influence of the audio signal during the transmission in the audio system, so as to determine the corresponding equalization parameters in the subsequent steps. It can be understood that, since the feedback microphone is between the loudspeaker and the user, the above-mentioned audio system can also be approximately replaced by the path through which the audio signal is transmitted between the loudspeaker and the feedback microphone.
[0075] Exemplarily, the feedback microphone of the earphone can continuously acquire audio signals, so that the received audio signal acquired by the feedback microphone at a time point near the time stamp (such as 0.01 milliseconds later, 0.1 milliseconds later, etc.) of the time when the loudspeaker outputs the test audio signal can be obtained according to the time stamp. In some embodiments, the feedback microphone of the earphone can also not be continuously turned on, but can be triggered to be turned on by the loudspeaker after the loudspeaker outputs the test audio signal, and the audio signal acquired after the feedback microphone is turned on can be used as the received audio signal corresponding to the test audio signal. Optionally, for the received audio signal acquired by the feedback microphone, the earphone can also use its built-in signal processing module to compare the test audio signal output by the loudspeaker with the received audio signal in waveform, and when the comparison result indicates that the waveform similarity of the test audio signal and the received audio signal meets a similarity threshold (such as 50%, 80%, etc.), the received audio signal can be confirmed as the received audio signal corresponding to the test audio signal.
[0076] 206、determine a first equalization parameter corresponding to the base audio signal and a second equalization parameter corresponding to the infrasound signal according to the received audio signal, wherein the first equalization parameter is used for ear shape adaptive equalization of a target audio signal to be output according to the ear shape of the user, and the second equalization parameter is used for wearing leakage adaptive equalization of the target audio signal according to the wearing state of the earphone.
[0077] In an embodiment of the present application, after collecting the above-mentioned received audio signal, the headset can analyze the difference between the received audio signal and the above-mentioned test audio signal based on the received audio signal to evaluate the impact of the audio signal during the transmission process of the audio system in which the headset is located, and then determine the equalization parameters required to equalize the impact. Specifically, since the above-mentioned test audio signal is obtained by mixing a basic audio signal that can cover a large frequency range and an infrasonic signal that only targets the ultra-low frequency range of infrasonic frequency, based on the corresponding received audio signal, the headset can respectively calculate a first equalization parameter corresponding to the above-mentioned basic audio signal and a second equalization parameter corresponding to the above-mentioned infrasonic signal. Among them, the first equalization parameter can be used to achieve ear shape adaptive equalization to compensate for audio signals in a higher frequency range (such as 1000Hz or above) based on the personalized differences in ear shapes of different users; the second equalization parameter can be used to achieve wearing leakage adaptive equalization to compensate for audio signals in a lower frequency range (such as the frequency band below 1000Hz) based on the personalized differences in the wearing status of different users' headsets, especially the different situations of low-frequency leakage in the audio signal caused by improper wearing of the headset, inappropriate earplug size, etc. By respectively implementing the above-mentioned ear shape adaptive equalization and wearing leakage adaptive equalization, comprehensive compensation can be performed for the target audio signal to be output by the earphones to balance the possible impact on its transmission in the audio system in which the earphones are located, so that the target audio signal heard by the user can restore its actual original sound quality as much as possible.
[0078] In some embodiments, when it is necessary to equalize the target audio signal to be output, the corresponding equalizer can be configured according to the above-mentioned equalization parameters. Exemplarily, the above-mentioned filter can be composed of one or more filters. Specifically, when it is necessary to equalize the audio signal in a specific frequency range, a bandpass filter or a bandstop filter of the corresponding frequency band can be configured for equalization filtering; when it is necessary to perform more complex equalization on audio signals of multiple frequency bands, corresponding equalization filtering can also be performed by configuring a cascaded FIR (Finite Impulse Response, finite unit impulse response) filter or IIR (Infinite Impulse Response, infinite unit impulse response) filter.
[0079] It can be seen that the implementation of the audio signal processing method described in the above embodiment can achieve corresponding ear shape adaptive equalization and wearing leakage adaptive equalization based on personalized factors such as the ear shape and headphone wearing status of different users wearing headphones. By achieving the above-mentioned personalized equalization, the target audio signal heard by the user can restore its actual original sound quality as much as possible, which in turn helps to perform more accurate noise reduction processing on the target audio signal to be output by the headphones, avoiding problems such as deformation and attenuation of the unequalized target audio signal during the propagation process, which causes the headphones to misjudge the initial sound quality of the target audio signal and perform noise reduction operations that do not match the actual needs of the user, thereby helping to improve the effectiveness of the headphones in actively reducing the audio signal.
[0080] See also Figure 5 , Figure 5 FIG. 1 is a flow chart of another audio signal processing method disclosed in an embodiment of the present application. The method can be applied to the above-mentioned earphones, which may include a speaker and a feedback microphone. Figure 5 As shown, the audio signal processing method may include the following steps:
[0081] 502. When the earphone is not playing audio data, respond to the active test instruction and obtain a test audio signal corresponding to the active test instruction, wherein the test audio signal is obtained by mixing a white noise signal and a first sound wave signal.
[0082] In an embodiment of the present application, when the headset is not playing audio data, an active test instruction can be triggered by the user, or by a terminal device connected to the headset, to actively detect the impact of personalized factors such as the user's ear shape and the wearing state of the headset on the user's own listening experience when the headset is not playing music files, recording files, or chat voice. Specifically, after receiving the above-mentioned active test instruction, the headset can respond to the active test instruction and obtain a test audio signal obtained by mixing a white noise signal and a first sound wave signal, so as to perform the above-mentioned detection through the test audio signal.
[0083] The active test instruction may include a detection trigger operation (such as a specified touch operation, voice operation, movement operation, etc.) performed directly by the user on the headset, so that when the headset detects the specified detection trigger operation, it can be regarded as obtaining the corresponding active test instruction; it may also include a detection trigger operation (such as a specified touch operation, button click operation, etc.) performed by the user on a terminal device connected to the headset, so that when the terminal device detects the detection trigger operation, it can send a corresponding active test instruction to the headset. On this basis, after the headset obtains the active test instruction, it can trigger its built-in DSP (Digital Signal Process) module to obtain a test audio signal corresponding to the active test instruction, and then output the test audio signal through a speaker connected to the DSP module in a subsequent step.
[0084] Exemplarily, the test audio signal corresponding to the active test instruction can be obtained by mixing a white noise signal specified by the active test instruction with a first sound wave signal. Specifically, for example, the white noise signal can be first input into a high-pass filter (the cutoff frequency can be 20Hz, 30Hz, 40Hz, etc.) for filtering, and then the filtered white noise signal is mixed with a first sound wave signal having an infrasonic frequency (such as 8Hz, 10Hz, 12Hz, etc.) to obtain a mixed test audio signal. This can effectively reduce the interference of the white noise signal on the first sound wave signal, which is conducive to independent testing of the two.
[0085] It can be understood that the process of mixing the white noise signal and the first sound wave signal can be performed in real time in the earphone, or can be performed in advance outside the earphone, and the mixed test audio signal is stored in a storage circuit connected to the DSP module.
[0086] 504. Output a test audio signal through a speaker.
[0087] 506. Collect a received audio signal corresponding to the test audio signal through a feedback microphone.
[0088] Among them, step 504 and step 506 are similar to the above-mentioned step 202 and step 204, and are not repeated here.
[0089] 508. Determine a test ear shape transfer function corresponding to the received audio signal according to the received audio signal.
[0090] In an embodiment of the present application, after collecting the above-mentioned received audio signal, the earphone can evaluate the impact of its corresponding test audio signal during the transmission process of the audio system in which the earphone is located based on the received audio signal, thereby deriving a test ear shape transfer function determined by the personalized differences in the user's ear shape. The test ear shape transfer function can be used to calculate the first equalization parameter for achieving ear shape adaptive equalization in subsequent steps.
[0091] Exemplarily, when the earphone derives its corresponding test ear shape transfer function based on the above-mentioned received audio signal, it can first perform Fourier transform on the received audio signal, and then determine its corresponding test ear shape transfer function based on the Fourier transformed received audio signal. Specifically, the signal processing module built into the earphone (such as the above-mentioned DSP module, etc.) can first perform frame segmentation and windowing processing on the received audio signal, that is, divide the macroscopically unstable audio signal into multiple audio signal frames with short-term stability (such as audio signal frames with a frame length of 10 to 30 milliseconds), and then perform windowing and truncation on the above-mentioned audio signal frames according to the specified window function to obtain each frame of received audio signal. Exemplarily, windowing and truncation can be achieved by a window function as shown in Formula 1:
[0092] Formula 1:
[0093] w(n)=1,0≤n≤N-1;
[0094] w(n)=0,other
[0095] Wherein, the piecewise function w(n) is a window function, and N is a unit window length. By performing a time domain convolution on the received audio signal and the window function, the effect of windowing and truncation can be achieved.
[0096] Furthermore, a frame of received audio signal obtained after frame division and windowing can be subjected to a short-time Fourier transform (SFT) using an algorithm such as FFT (Fast Fourier Transform), and its expression can be shown in the following formula 2:
[0097] Formula 2:
[0098]
[0099] Where n is discrete time, ω = 2πk / N, continuous frequency = ω = 2πk / N, k = 0, 1, ..., N-1, N is the Fourier transform length, and x(m) is the mth frame of audio signal. It should be noted that because the test ear shape transfer function, which is determined by individual differences in user ear shape, only differs significantly within a higher frequency range (e.g., 1000 Hz or above), the above calculation process can be performed only for the received audio signal within this higher frequency range.
[0100] On this basis, the earphone can determine the test ear shape transfer function corresponding to the above-mentioned received audio signal. For example, when the rectangular window function shown in the above formula 1 is adopted, the test ear shape transfer function H(k) can be expressed as:
[0101] Formula 3:
[0102]
[0103] Among them, x(n) is the same as the above X n (e jω )correspond.
[0104] 510. Based on a least squares criterion, and according to the test ear shape transfer function and the target ear shape transfer function, a first equalization parameter corresponding to the white noise signal is calculated.
[0105] Specifically, after determining the above-mentioned test ear shape transfer function, the earphone can also obtain a corresponding target ear shape transfer function. The target ear shape transfer function may include the ear shape transfer function measured when the earphone is in a standard ear shape fixture (such as IEC711, etc.), that is, the earphone is placed in a standard ear shape fixture with good airtightness in an anechoic room environment, and the ear shape transfer function at this time is detected; it may also include a statistically obtained ear shape transfer function, for example, in an anechoic room environment, the transfer function of a large number of users wearing the earphones normally is obtained, and the statistical average is calculated to obtain the corresponding target ear shape transfer function; for example, if the transfer function of the large number of users wearing the earphones normally is expressed in the form of a function curve, the average curve can be obtained for the above-mentioned function curve, and the function corresponding to the average curve is determined as the target ear shape function.
[0106] On this basis, the earphones can calculate the first equalization parameters corresponding to the above-mentioned white noise signal based on the least squares criterion and according to the above-mentioned test ear shape transfer function and the target ear shape transfer function. Among them, the first equalization parameters may include tap coefficients, gain coefficients, etc. for configuring the filter contained in the corresponding first equalizer. Through the first equalizer configured by the first equalization parameters, the target audio signal to be output by the earphones can be subjected to ear-shaped adaptive equalization in subsequent steps. Optionally, the first equalizer may include an equalizer composed of FIR (finite length unit impulse response) filters, so that a regularization filter, etc. can be adopted, and the first equalizer can be designed based on the above-mentioned least squares criterion and the goal of minimizing the equalization error by the regularization filter. Exemplarily, the expression of the response M(k) of the first equalizer in the frequency domain can be as shown in the following formula 4:
[0107] Formula 4:
[0108]
[0109] Where H(k) is the test ear transfer function, D(k) is the target ear transfer function, B(k) represents the Fourier transform of the regularized filter response, and β represents the weighted scalar of the regularized filter. M(k) calculated using Equation 4 can be inverse Fourier transformed and used to configure the corresponding FIR filter. By configuring the FIR equalizer, the equalized ear transfer function can be brought as close to the target transfer function as possible based on the difference between the test and target ear transfer functions.
[0110] For example, please refer to Figure 6 and Figure 7 , Figure 6 is a schematic diagram of the amplitude-frequency response corresponding to an ear shape transfer function disclosed in an embodiment of the present application, Figure 7 It is based on Figure 6 Schematic diagram of the amplitude-frequency response of the first equalizer configured by the first equalization parameter determined by the ear shape transfer function shown. Figure 6 As shown in the figure, the dotted line represents the frequency response of the test ear transfer function, and the solid line represents the frequency response of the target ear transfer function. The difference between the two is obvious in the higher frequency range of 1000Hz or above. Figure 7 The first equalizer shown can equalize the audio signal within the above-mentioned higher frequency range so that the equalized ear shape transfer function (dashed line) is as close as possible to the target ear shape transfer function (solid line), thereby achieving ear shape adaptive equalization.
[0111] 512. Filter the received audio signal through a first bandpass filter to obtain a first low-frequency received signal.
[0112] In an embodiment of the present application, after the headset collects the above-mentioned received audio signal, the headset can input the received audio signal into a first bandpass filter to obtain a first low-frequency received signal corresponding to the above-mentioned first sound wave signal. The passband of the first bandpass filter can include the frequency corresponding to the above-mentioned first sound wave signal, and the passband can be relatively narrow, so that only the low-frequency audio signals that are affected by the wearing state of the user's headset and cause different degrees of wearing leakage can be filtered out, thereby reducing the interference caused by the above-mentioned basic audio signal (white noise signal in this embodiment). For example, taking the frequency corresponding to the above-mentioned first sound wave signal as 10Hz as an example, the center frequency of the first bandpass filter can also be 10Hz, and the bandwidth of its passband can be 4Hz, 6Hz, 8Hz, etc., which is not specifically limited in the embodiment of the present application.
[0113] Based on the above-mentioned first low-frequency received signal, the earphones can evaluate the wearing leakage that occurs during the transmission of the audio signal in the audio system in which the earphones are located in subsequent steps. The wearing leakage is mainly caused by improper earphone wearing methods, inappropriate earplug size, etc., and is concentrated in the medium and low frequency bands. Therefore, the evaluation can be achieved through the first low-frequency received signal in the ultra-low frequency range, and the second equalization parameter for achieving adaptive equalization of wearing leakage can be further calculated in subsequent steps. It can be understood that the wearing leakage adaptive equalization performed for the personalized differences in the user's earphone wearing status (i.e., personalized differences in wearing leakage) can only be performed on audio signals in a lower frequency range (such as the frequency band below 1000Hz).
[0114] 514. Calculate the normalized signal energy of the first low-frequency received signal;
[0115] In an embodiment of the present application, in order to evaluate the degree of low-frequency leakage of the test audio signal during transmission by the audio system in which the earphone is located, the signal energy of the first low-frequency received signal can be calculated to determine the corresponding low-frequency leakage situation based on the signal energy in a subsequent step, and then calculate the second equalization parameter for achieving adaptive equalization of wearing leakage. Optionally, in order to more accurately and conveniently evaluate the degree of low-frequency leakage, the calculated signal energy can be compared with the target energy (i.e., the signal energy measured by the same method when the earphone is in a standard ear-shaped fixture, such as IEC711, etc.) to obtain normalized signal energy, so as to facilitate direct table lookup in subsequent steps to determine the corresponding low-frequency leakage degree.
[0116] Exemplarily, to calculate the signal energy of the first low-frequency received signal, the processor built into the headset may first perform windowing and segmentation on the first low-frequency received signal according to a unit window length to obtain at least one frame of low-frequency sub-signals. The window function used to perform windowing and segmentation on the first low-frequency received signal may include a rectangular window function or other window functions, such as a triangular window function or a Hamming window function. Preferably, to reduce the amount of computation before and after windowing and segmentation, only the rectangular window function may be used for the aforementioned windowing and segmentation steps.
[0117] On this basis, the processor built into the headset can calculate the short-time average energy of each frame of the low-frequency sub-signal and smooth the calculated short-time average energy to obtain the smoothed short-time average energy. For example, when calculating the short-time average energy of each frame of the low-frequency sub-signal, the calculation can be performed using the method shown in the following formula 5:
[0118] Formula 5:
[0119]
[0120] Among them, En represents the short-time average energy of the low-frequency sub-signal of the nth frame (or time instant), n is the discrete time, w(nm) is the time-shifted representation of the window function w(n), x(m) represents the low-frequency sub-signal of each frame, and N is the unit window length. Furthermore, after obtaining the short-time average energy of the low-frequency sub-signal of each frame, smoothing can be performed using the method shown in the following formula 6:
[0121] Formula 6:
[0122] E n (m) = α·E n (m-1)+(1-α)·E n (m),0<α<1
[0123] Among them, E n (m) is the energy of the smoothed audio signal, and α is the coefficient for the exponential smoothing. The built-in processor of the headset can convert the energy of the smoothed audio signal E n (m) is compared with the target energy to obtain a ratio of the two, and the ratio is used as the normalized signal energy of the first low-frequency received signal. For example, the normalized signal energy can be calculated as shown in Formula 7:
[0124] Formula 7:
[0125]
[0126] Among them, Pnor is the normalized signal energy, E ng is the target energy mentioned above.
[0127] 516. Determine a leakage degree according to the normalized signal energy, and calculate a second equalization parameter corresponding to the first acoustic wave signal according to the leakage degree.
[0128] In the embodiment of the present application, the earphones can be pre-classified into different leakage levels according to different signal energy ranges. For example, the earphones can be classified into corresponding leakage levels according to a uniform step size (such as 0.2 units of normalized signal energy, 0.4 units of normalized signal energy, etc.), or they can be classified into different leakage levels according to other distribution methods. Figure 8 , Figure 8 This is a schematic diagram of the system amplitude-frequency response under different leakage levels disclosed in the embodiment of this application. Figure 8As shown, if curve A is the frequency response corresponding to when the user wears the headphones normally (that is, when no low-frequency leakage occurs), then curves B, C, D, and E can respectively represent the frequency response under different leakage levels, and can be sorted as B, C, D, and E from low to high according to the severity of the leakage. It should be noted that each different leakage level can be matched with a corresponding leakage frequency response curve, and the leakage frequency response curve that matches each leakage level can be obtained by testing the headphones when the wearing state of the headphones meets each leakage level (that is, testing the frequency response). On this basis, the headphones can uniquely determine the leakage frequency response curve that matches the leakage level based on the above leakage level, and then obtain the balanced frequency response curve that matches the leakage frequency response curve in the subsequent steps, and determine the second balanced parameter corresponding to the above-mentioned infrasound signal based on the balanced frequency response curve.
[0129] Please also refer to Figure 9 and Figure 10 , Figure 9 is based on Figure 8 Schematic diagram of the amplitude-frequency response of the second equalizer configured by the second equalization parameters determined by different leakage levels, Figure 10 is through Figure 9 The schematic diagram of the system amplitude-frequency response after the second equalizer performs equalization is shown in FIG. Figure 9 As shown, according to the different low-frequency leakage levels of the earphones determined by the above-mentioned normalized signal energy, the corresponding second equalization parameters can be calculated from the leakage levels, so as to configure the corresponding second equalizer based on the second equalization parameters to achieve corresponding wear leakage adaptive equalization. It can be understood that when the leakage level is more serious, the corresponding second equalizer has a higher degree of equalization compensation for audio signals in the lower frequency range below the 1000Hz frequency band. For example, Figure 9 The second equalizer corresponding to the mid-frequency response curve B can be used to Figure 8 Performing equalization compensation on the target audio signal to be output by the earphone at the leakage level corresponding to the mid-frequency response curve B; Figure 9 The second equalizer corresponding to the mid-frequency response curve E can be used to Figure 8 The target audio signal to be output by the earphone under the leakage degree corresponding to the mid-frequency response curve E is balanced and compensated. After the above-mentioned balanced compensation, Figure 10 As shown, the frequency response of headphones with various leakage levels will tend to be consistent, as close as possible to the state without leakage.
[0130] It can be understood that the above steps 512, 514 and 516 can be performed after the above step 506, so that the earphone can independently and simultaneously achieve the above-mentioned ear shape adaptive equalization and wearing leakage adaptive equalization.
[0131] It can be seen that the implementation of the audio signal processing method described in the above embodiment can achieve corresponding ear shape adaptive equalization and wearing leakage adaptive equalization based on personalized factors such as the ear shape and wearing status of different users wearing headphones. By achieving the above personalized equalization, the target audio signal heard by the user can restore its actual original sound quality as much as possible, which in turn helps to perform more accurate noise reduction processing on the target audio signal to be output by the headphones, thereby helping to improve the effectiveness of the headphones in actively reducing the noise of the audio signal. In addition, by simultaneously achieving the above ear shape adaptive equalization and wearing leakage adaptive equalization, it is also possible to reduce the amount of repeated calculations as much as possible, thereby improving the efficiency of the headphones in equalization and noise reduction.
[0132] See also Figure 11 , Figure 11 This is a flow chart of another audio signal processing method disclosed in an embodiment of the present application. This method can be applied to the above-mentioned earphones, which may include a speaker, a feedforward microphone, and a feedback microphone. Figure 11 As shown, the audio signal processing method may include the following steps:
[0133] 1102. When the earphone is playing audio data, mix the audio data signal to be played with the second sound wave signal to obtain a test audio signal.
[0134] In an embodiment of the present application, when the headset is already playing audio data (such as playing music files, recording files, chat voice, etc.), it can automatically detect the impact of personalized factors such as the user's ear shape and wearing posture on the user's own listening experience without the user's active trigger. To achieve such detection, the headset can mix its audio data signal to be played with the second sound wave signal to obtain a corresponding test audio signal.
[0135] For example, the audio data signal can be first input into a high-pass filter (the cutoff frequency can be 20Hz, 30Hz, 40Hz, etc.) for filtering, and then the filtered audio data signal can be mixed with a second sound wave signal having an infrasonic frequency (such as 8Hz, 10Hz, 12Hz, etc.) to obtain a mixed test audio signal, thereby effectively reducing the interference of the audio data signal on the second sound wave signal, which is conducive to independent testing of the two.
[0136] 1104. Control the speaker to output the test audio signal at intervals of a first duration, and after the speaker outputs the test audio signal for a second duration, control the speaker to resume outputting the audio data signal, wherein the first duration is greater than the second duration.
[0137] In an embodiment of the present application, the mixing of the audio data signal and the second sound wave signal can be performed periodically and intermittently, that is, the headset can first play a mixed test audio signal for a certain duration, and then play an unmixed audio data signal for a certain duration, and the two are performed alternately. For example, the headset can control the speaker to output the test audio signal every first duration (such as 8 seconds, 6 seconds, etc.), and after outputting the test audio signal for a second duration (such as 3 seconds, 1 second, etc.), control the speaker to resume outputting the audio data signal. Wherein, the first duration is greater than the second duration, so that every time the test audio signal is continuously output for the second duration, the headset will continue to output the audio data signal for (first duration - second duration) to avoid unnecessary power consumption caused by continuous and uninterrupted detection. It can be understood that since the test audio signal is only mixed with the second sound wave signal relative to the audio data signal, and the human ear is not sensitive to the second sound wave signal at the infrasonic frequency, it will not affect the audio data signal playback function of the headset.
[0138] 1106 . Collect a received audio signal corresponding to the test audio signal through a feedback microphone.
[0139] Among them, step 1106 is similar to the above-mentioned step 204 and will not be repeated here.
[0140] 1108. Determine a test ear shape transfer function corresponding to the received audio signal based on the received audio signal.
[0141] 1110. Based on a least squares criterion, and according to the test ear shape transfer function and the target ear shape transfer function, obtain a first equalization parameter corresponding to the audio data signal.
[0142] Step 1108 and step 1110 are similar to the above-mentioned step 508 and step 510. It should be noted that, in the embodiment of the present application, the white noise signal is replaced by an audio data signal.
[0143] 1112. Collect ambient sound through a feedforward microphone.
[0144] For example, see Figure 12 , Figure 12 This is a schematic diagram of the structure of a headset disclosed in an embodiment of the present application. Figure 12 As shown, in addition to the speaker 121 and the feedback microphone 122 arranged in front of the speaker 121, the headset can also include a feedforward microphone 123. The feedforward microphone 123 can be arranged behind the speaker 121 (that is, when the user wears the headset, the feedforward microphone is between the speaker and the external environment) to collect external ambient sound through the feedforward microphone 123.
[0145] As an optional embodiment, the headset can first collect ambient sound through its feedforward microphone before outputting the above-mentioned test audio signal, and then determine whether it is suitable to perform the above-mentioned test steps based on the collected ambient sound. Exemplarily, after collecting the ambient sound, the headset can filter the ambient sound through a third bandpass filter to obtain a low-frequency ambient sound signal. The passband of the third bandpass filter can include the frequency corresponding to the above-mentioned infrasound signal, so that the low-frequency ambient sound signal in the ambient sound that may interfere with the infrasound signal can be obtained in a targeted manner. Furthermore, the headset can also calculate the noise energy corresponding to the low-frequency ambient sound signal, and when the noise energy is lower than the noise energy threshold (which can be set to 0, indicating that a test environment with no interference noise is required), perform the above-mentioned step of outputting the test audio signal through the speaker. Optionally, when the earphone controls the speaker to output the above-mentioned test audio signal every first time period, the earphone can collect ambient sound for the above-mentioned calculation and judgment when the test audio signal is not output (that is, the infrasonic signal is not mixed), and when it is judged that the ultra-low frequency noise energy is lower than the noise energy threshold, perform the step of mixing the infrasonic signal to output the test audio signal, thereby effectively avoiding the interference of ultra-low frequency noise on the wearing leakage equalization of the earphone.
[0146] 1114. Calculate a correlation coefficient based on the ambient sound and the received audio signal.
[0147] In an embodiment of the present application, by collecting ambient sound and calculating the correlation between the ambient sound and the received audio signal, the degree to which the received audio signal is interfered with by the ambient sound can be determined. When the degree of interference of the ambient sound on the received audio signal is large, the correlation between the two is high, and at this time the degree of leakage of the earphone when worn is also high; when the degree of interference of the ambient sound on the received audio signal is small, the correlation between the two is low, and at this time the degree of leakage of the earphone when worn is also low. It can be understood that if the degree of interference of the ambient sound on the received audio signal is greater than a certain threshold, it will cause greater interference to the subsequent calculation of the equalization parameters of the earphone, reducing the accuracy and reliability of its audio signal equalization. To this end, the earphone can first calculate the correlation coefficient between the ambient sound and the above-mentioned received audio signal, and the calculation method can be shown in the following formula 8:
[0148] Formula 8:
[0149]
[0150] Among them, E represents the mathematical expectation, s i and s j Represent the ambient sound and the received audio signal respectively. In the subsequent steps, if the correlation coefficient between the two |P ijIf the value is greater than the relevant threshold, it can be determined that the ambient sound is significantly interfering with the received audio signal, and subsequent steps can be discontinued. If the value is less than the relevant threshold, it can be determined that the ambient sound is minimally interfering with the received audio signal, and subsequent steps of calculating the second equalization parameter can be continued. It will be appreciated that steps 1112 and 1114 need not necessarily be performed after step 1110, and need only be performed before step 1116.
[0151] Optionally, when calculating the above correlation coefficient |P ij |, the infrasound signal contained in the unoutput test audio signal can also be used as s j , to directly calculate the ambient sound s i With infrasound signal s j The correlation coefficient between them can be directly determined, which helps to judge the degree of leakage when wearing headphones.
[0152] 1116. If the correlation coefficient is not greater than the correlation threshold, filter the received audio signal through a first bandpass filter to obtain a first low-frequency received signal.
[0153] 1118. Calculate the normalized signal energy of the first low-frequency received signal.
[0154] 1120. Determine a leakage degree according to the normalized signal energy, and calculate a second equalization parameter corresponding to the second acoustic wave signal according to the leakage degree.
[0155] Among them, step 1116, step 1118 and step 1120 are similar to the above-mentioned step 512, step 514 and step 516. It should be noted that in the embodiment of the present application, the first sound wave signal is replaced by the second sound wave signal, and the first sound wave signal and the second sound wave signal can be the same or different.
[0156] 1122. Configure a first equalizer according to a first equalization parameter, and configure a second equalizer according to a second equalization parameter, wherein the first equalizer is used to perform ear shape adaptive equalization on a frequency band in the target audio signal to be output that is higher than or equal to a target frequency threshold, and the second equalizer is used to perform wearing leakage adaptive equalization on a frequency band in the target audio signal that is lower than the target frequency threshold.
[0157] Optionally, the first equalizer may include an equalizer composed of a finite-length unit impulse response (FIR) filter, and the second equalizer may include an equalizer composed of an infinite-length unit impulse response (IIR) filter.
[0158] It can be seen that the implementation of the audio signal processing method described in the above embodiment can achieve corresponding ear shape adaptive equalization and wearing leakage adaptive equalization based on personalized factors such as the ear shape and headphone wearing status of different users wearing headphones. By achieving the above-mentioned personalized equalization, the target audio signal heard by the user can restore its actual original sound quality as much as possible, which in turn helps to perform more accurate noise reduction processing on the target audio signal to be output by the headphones, thereby helping to improve the effectiveness of the headphones in actively reducing the noise of the audio signal. In addition, by configuring the corresponding compensation filter, the target audio signal to be output by the headphones can be compensated in a targeted manner, further improving the accuracy and effectiveness of audio signal compensation based on user preferences.
[0159] See also Figure 13 , Figure 13 FIG. 1 is a flow chart of the fourth audio signal processing method disclosed in the embodiment of the present application, which can be applied to the above-mentioned earphones. Figure 13 As shown, the audio signal processing method may include the following steps:
[0160] 1302. Output a test audio signal through a speaker, where the test audio signal includes any one of a white noise signal and an audio data signal;
[0161] 1304. Collecting a received audio signal corresponding to the test audio signal through a feedback microphone;
[0162] 1306. Determine, based on the received audio signal, a test ear shape transfer function corresponding to the received audio signal;
[0163] 1308. Based on the least squares criterion, according to the test ear shape transfer function and the target ear shape transfer function, a first equalization parameter corresponding to the test audio signal is calculated. The first equalization parameter is used to perform ear shape adaptive equalization on the target audio signal to be output to match the user's ear shape.
[0164] Among them, steps 1302 to 1308 are similarly described in the above embodiment. It should be noted that the test audio signal in the embodiment of the present application adopts either a white noise signal or an audio data signal, so that the headset can provide personalized ear shape adaptive equalization for different users.
[0165] In some embodiments, when the headset outputs a test audio signal through its speaker, it can also first determine whether the headset is in a worn state. Only when it is determined that the headset is in a worn state, will it respond to an active test instruction issued by the user to the headset or a device connected to the headset, and output the above-mentioned test audio signal through its speaker.
[0166] Further, after the first equalization parameter corresponding to the test audio signal is calculated, the earphone can configure a first equalizer according to the first equalization parameter, for performing ear-shaped adaptive equalization on a frequency band higher than or equal to a target frequency threshold (such as 1000 Hz) in a target audio signal to be output.
[0167] Please refer to Figure 14 , Figure 14 is a flowchart of a fifth audio signal processing method disclosed in the embodiments of the present application, which can be applied to the earphone described above. As shown in Figure 14 , the audio signal processing method can include the following steps:
[0168] 1402, outputting a test audio signal through a loudspeaker, wherein the test audio signal includes an infrasound signal;
[0169] 1404, collecting a received audio signal corresponding to the test audio signal through a feedback microphone;
[0170] 1406, calculating a signal energy of the received audio signal, and determining a second equalization parameter corresponding to the infrasound signal according to the signal energy, the second equalization parameter being used for performing wearing leakage adaptive equalization on a target audio signal to be output, which matches the wearing state of the earphone.
[0171] Among them, steps 1402-1406 have similar descriptions in the above embodiments. It needs to be particularly pointed out that the test audio signal in the embodiments of the present application only uses the infrasound signal, so that the earphone can provide individualized wearing leakage adaptive equalization for different users.
[0172] In some embodiments, when calculating the second equalization parameter, the earphone can specifically filter the received audio signal through a first band-pass filter to obtain a first low-frequency received signal, and then calculate a normalized signal energy of the first low-frequency received signal, and determine a leakage degree according to the normalized signal energy, and calculate the second equalization parameter corresponding to the infrasound signal according to the leakage degree.
[0173] In other embodiments, the earphone can also pre-collect ambient sound of the current environment to determine whether it is suitable for the above test step according to the collected ambient sound. For example, after the earphone collects ambient sound through its feed-forward microphone, it can calculate a correlation coefficient according to the ambient sound and the received audio signal, and only when the correlation coefficient is not greater than a correlation threshold, the step of filtering the received audio signal through the first band-pass filter to obtain the first low-frequency received signal is performed, so that it can avoid causing greater interference to the subsequent calculation of the equalization parameter by the earphone, and thus avoid reducing the accuracy and reliability of the equalization of the audio signal.
[0174] Further, after the earphone acquires the ambient sound through the feed-forward microphone, the earphone can further filter the ambient sound through a third band-pass filter to obtain a low-frequency ambient sound signal. The passband of the third band-pass filter can contain the frequency corresponding to the infrasound signal, so that the low-frequency ambient sound signal that can interfere with the infrasound signal in the ambient sound can be obtained. Further, the earphone can calculate the noise energy corresponding to the low-frequency ambient sound signal, and if the noise energy is lower than a noise energy threshold (which can be set to 0, indicating a test environment that requires complete interference-free noise), the earphone can execute the step of outputting the test audio signal through the loudspeaker. Alternatively, when the earphone controls the loudspeaker to output the test audio signal only every first time interval, the earphone can acquire the ambient sound at the time when the test audio signal (i.e., the infrasound signal) is not output, and perform the calculation and judgment, and if it is determined that the noise energy at the ultra-low frequency is lower than the noise energy threshold, the step of mixing the infrasound signal to output the test audio signal is executed, thereby effectively avoiding the interference of the noise at the ultra-low frequency on the wearing leakage equalization of the earphone.
[0175] Further, after the second equalization parameter corresponding to the test audio signal is calculated, the earphone can configure a second equalizer according to the second equalization parameter, to perform wearing leakage adaptive equalization on the frequency band below the target frequency threshold (such as 1000 Hz) in the target audio signal to be output.
[0176] Please refer to Figure 15 , Figure 15 is a modular schematic diagram of an audio signal processing device disclosed by the embodiments of the present application. The audio signal processing device can be applied to the earphone described above. The earphone can include a loudspeaker, a feedback microphone, and a feed-forward microphone. As shown in Figure 15 , the audio signal processing device can include a first output unit 1501, a first receiving unit 1502, and a first parameter calculation unit 1503, wherein:
[0177] The first output unit 1501 is configured to output a test audio signal through the loudspeaker, wherein the test audio signal is obtained by mixing a basic audio signal and an infrasound signal;
[0178] The first receiving unit 1502 is configured to acquire a received audio signal corresponding to the test audio signal through the feedback microphone;
[0179] The first parameter calculation unit 1503 is used to determine a first equalization parameter corresponding to the basic audio signal based on the received audio signal, and to determine a second equalization parameter corresponding to the infrasonic wave signal based on the received audio signal, wherein the first equalization parameter is used to perform ear-shape adaptive equalization on the target audio signal to be output so as to match the user's ear shape, and the second equalization parameter is used to perform wearing leakage adaptive equalization on the target audio signal so as to match the wearing state of the headphone.
[0180] It can be seen that the audio signal processing device described in the above embodiment can achieve corresponding ear shape adaptive equalization and wearing leakage adaptive equalization based on personalized factors such as the ear shape and headphone wearing status of different users wearing headphones. By achieving the above-mentioned personalized equalization, the target audio signal heard by the user can restore its actual original sound quality as much as possible, which in turn helps to perform more accurate noise reduction processing on the target audio signal to be output by the headphones, avoiding problems such as deformation and attenuation of the unequalized target audio signal during the propagation process, which causes the headphones to misjudge the initial sound quality of the target audio signal and perform noise reduction operations that do not match the actual needs of the user, thereby helping to improve the effectiveness of the headphones in actively reducing the audio signal.
[0181] In one embodiment, the test audio signal is obtained by mixing a basic audio signal filtered by a high-pass filter and an infrasound signal, wherein the cutoff frequency of the high-pass filter is higher than the frequency corresponding to the infrasound signal.
[0182] In one embodiment, the above-mentioned audio signal processing device may further include an acquisition unit (not shown), which is used to respond to an active test instruction and obtain a test audio signal corresponding to the active test instruction before the first output unit 1501 outputs the test audio signal through the speaker and when the earphone is not playing audio data, wherein the test audio signal is obtained by mixing a white noise signal and a first sound wave signal.
[0183] In one embodiment, the audio signal processing device may further include a mixing unit (not shown) configured to mix the audio data signal to be played with the second sound wave signal to obtain a test audio signal when the earphone is playing audio data before the first output unit 1501 outputs the test audio signal through the speaker.
[0184] The above-mentioned first output unit 1501 can be specifically used to control the speaker to output a test audio signal every first time period when the earphone is playing audio data, and control the speaker to resume outputting the audio data signal after the speaker outputs the test audio signal for a second time period, wherein the first time period is greater than the second time period.
[0185] In one embodiment, the first parameter calculation unit 1503 may include a first calculation subunit and a second calculation subunit (not shown), wherein:
[0186] The first calculation subunit is configured to determine, based on the received audio signal, a test ear shape transfer function corresponding to the received audio signal; and calculate, based on a least squares criterion, a first equalization parameter corresponding to the basic audio signal according to the test ear shape transfer function and the target ear shape transfer function.
[0187] The second calculation subunit is configured to filter the received audio signal through a first bandpass filter to obtain a first low-frequency received signal; calculate the normalized signal energy of the first low-frequency received signal; determine the leakage degree based on the normalized signal energy, and calculate a second equalization parameter corresponding to the infrasound signal based on the leakage degree.
[0188] The second calculation subunit, when calculating the normalized energy of the first low-frequency received signal, may specifically include:
[0189] Performing windowing and segmentation on the first low-frequency received signal according to a unit window length to obtain at least one frame of low-frequency sub-signal;
[0190] Calculate the short-time average energy of the low-frequency sub-signal of each frame respectively;
[0191] The short-time average energy of each frame of the low-frequency sub-signal is smoothed, and the ratio of the smoothed short-time average energy to the target energy is calculated as the normalized signal energy of the first low-frequency received signal.
[0192] In one embodiment, when the second calculation subunit calculates the second equalization parameter corresponding to the infrasonic wave signal according to the leakage degree, the following steps may be specifically performed:
[0193] Determining a leakage frequency response curve that matches the leakage degree according to the leakage degree, wherein the leakage frequency response curve that matches each leakage degree is obtained by testing the earphones when the earphones are worn in a state that meets each leakage degree;
[0194] An equalization frequency response curve that matches the leakage frequency response curve is obtained, and a second equalization parameter corresponding to the infrasound signal is determined according to the equalization frequency response curve.
[0195] In one embodiment, before filtering the received audio signal through the first bandpass filter to obtain the first low-frequency received signal, the second computing subunit may further collect ambient sound through a feedforward microphone; and calculate a correlation coefficient based on the ambient sound and the received audio signal. The step of filtering the received audio signal through the first bandpass filter to obtain the first low-frequency received signal may specifically include:
[0196] If the correlation coefficient is not greater than the correlation threshold, a step of filtering the received audio signal through a first band-pass filter to obtain a first low-frequency received signal is performed.
[0197] Further, when calculating the correlation coefficient, the second calculation subunit can specifically include:
[0198] filtering the ambient sound through a first low-pass filter to obtain a low-frequency ambient sound signal;
[0199] filtering the received audio signal through a second band-pass filter to obtain a second low-frequency received signal;
[0200] calculating a correlation coefficient of the low-frequency ambient sound signal and the second low-frequency received signal as the correlation coefficient between the ambient sound and the received audio signal.
[0201] It can be seen that the audio signal processing device described in the above embodiment can reduce the amount of repeated calculation as much as possible and improve the efficiency of the earphone in equalization and noise reduction by simultaneously implementing the ear-shaped adaptive equalization and the wearing leakage adaptive equalization.
[0202] In an embodiment, the audio signal processing device can further include a configuration unit not shown, which can be specifically configured to configure a first equalizer according to the first equalization parameter and configure a second equalizer according to the second equalization parameter after the first parameter calculation unit 1503 determines the first equalization parameter corresponding to the base audio signal and the second equalization parameter corresponding to the infrasound signal according to the received audio signal, wherein the first equalizer is used for ear-shaped adaptive equalization of a frequency band higher than a target frequency threshold in the target audio signal, and the second equalizer is used for wearing leakage adaptive equalization of a frequency band lower than the target frequency threshold in the target audio signal.
[0203] The first equalizer includes an equalizer composed of a finite-length unit impulse response (FIR) filter.
[0204] The second equalizer includes an equalizer composed of an infinite-length unit impulse response (IIR) filter.
[0205] In an embodiment, after the second calculation subunit collects the ambient sound through the feed-forward microphone, the second calculation subunit can further filter the ambient sound through a third band-pass filter to obtain a low-frequency ambient sound signal, calculate a noise energy corresponding to the low-frequency ambient sound signal, and perform the step of outputting the test audio signal through the loudspeaker in the case that the noise energy is lower than a noise energy threshold.
[0206] It can be seen that the audio signal processing device described in the above embodiment can achieve corresponding ear shape adaptive equalization and wearing leakage adaptive equalization based on personalized factors such as the ear shape and headphone wearing status of different users wearing headphones. By achieving the above-mentioned personalized equalization, the target audio signal heard by the user can restore its actual original sound quality as much as possible, which in turn helps to perform more accurate noise reduction processing on the target audio signal to be output by the headphones, thereby helping to improve the effectiveness of the headphones in actively reducing the noise of the audio signal. In addition, by configuring the corresponding compensation filter, the target audio signal to be output by the headphones can be compensated in a targeted manner, further improving the accuracy and effectiveness of audio signal compensation based on user preferences.
[0207] See also Figure 16 , Figure 16 This is a modular schematic diagram of another audio signal processing device disclosed in an embodiment of the present application. The audio signal processing device can be applied to the above-mentioned earphones, which may include a speaker, a feedback microphone, and a feedforward microphone. Figure 16 As shown, the audio signal processing device may include a second output unit 1601, a second receiving unit 1602, a function determination unit 1603, and a second parameter calculation unit 1604, wherein:
[0208] The second output unit 1601 is configured to output a test audio signal through a speaker, wherein the test audio signal includes any one of a white noise signal and an audio data signal;
[0209] The second receiving unit 1602 is configured to collect a received audio signal corresponding to the test audio signal through a feedback microphone;
[0210] The function determining unit 1603 is configured to determine, based on the received audio signal, a test ear shape transfer function corresponding to the received audio signal;
[0211] The second parameter calculation unit 1604 is used to calculate, based on a least squares criterion, first equalization parameters corresponding to the test audio signal according to the test ear shape transfer function and the target ear shape transfer function. The first equalization parameters are used to perform ear-shape adaptive equalization on the target audio signal to be output to match the user's ear shape.
[0212] By using the audio signal processing device described in the above embodiment, the test audio signal adopts either a white noise signal or an audio data signal, so that the earphone can provide personalized ear shape adaptive equalization for different users.
[0213] See also Figure 17 , Figure 17This is a modular schematic diagram of another audio signal processing device disclosed in an embodiment of the present application. The audio signal processing device can be applied to the above-mentioned earphones, which may include a speaker, a feedback microphone, and a feedforward microphone. Figure 17 As shown, the audio signal processing device may include a third output unit 1701, a third receiving unit 1702, and a third parameter calculation unit 1703, wherein:
[0214] The third output unit 1701 is configured to output a test audio signal through a speaker, wherein the test audio signal includes an infrasound signal;
[0215] The third receiving unit 1702 is configured to collect a received audio signal corresponding to the test audio signal through a feedback microphone;
[0216] The third parameter calculation unit 1703 is used to calculate the signal energy of the received audio signal and determine a second equalization parameter corresponding to the infrasound signal based on the signal energy. The second equalization parameter is used to perform wearing leakage adaptive equalization on the target audio signal to be output to match the wearing state of the headphone.
[0217] By using the audio signal processing device described in the above embodiment, the test audio signal only uses an infrasound signal, so that the earphone can provide personalized wearing leakage adaptive equalization for different users.
[0218] See also Figure 18 , Figure 18 This is a modular schematic diagram of a headset disclosed in an embodiment of the present application. Figure 18 As shown, the headset may include:
[0219] A memory 1801 storing executable program code;
[0220] a processor 1802 coupled to the memory 1801;
[0221] The processor 1802 calls the executable program code stored in the memory 1801 to execute all or part of the steps in any one of the audio signal processing methods described in the above embodiments.
[0222] In addition, an embodiment of the present application further discloses a computer-readable storage medium storing a computer program for electronic data exchange, wherein the computer program enables a computer to execute all or part of the steps in any one of the audio signal processing methods described in the above embodiments.
[0223] In addition, an embodiment of the present application further discloses a computer program product. When the computer program product is run on a computer, the computer can execute all or part of the steps in any one of the audio signal processing methods described in the above embodiments.
[0224] Those skilled in the art will appreciate that all or part of the steps in the various methods of the above embodiments can be completed by instructing related hardware through a program. The program can be stored in a computer-readable storage medium, and the storage medium includes a read-only memory (ROM), a random access memory (RAM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), a one-time programmable read-only memory (OTPROM), an electronically erasable programmable read-only memory (EEPROM), a compact disc read-only memory (CD-ROM) or other optical disc storage, magnetic disk storage, magnetic tape storage, or any other computer-readable medium capable of carrying or storing data.
[0225] The above is a detailed introduction to an audio signal processing method and device, headphones, and storage medium disclosed in the embodiments of the present application. Specific examples are used herein to illustrate the principles and implementation methods of the present application. The description of the above embodiments is only used to help understand the method and core ideas of the present application. At the same time, for those skilled in the art, based on the ideas of the present application, there may be changes in the specific implementation methods and application scope. In summary, the contents of this specification should not be understood as limiting the present application.
Claims
1. A method for processing an audio signal, characterized in that: Applied to headphones, the headphones including a speaker and a feedback microphone, the method comprising: Outputting a test audio signal through the speaker, wherein the test audio signal is obtained by mixing a basic audio signal filtered by a high-pass filter and an infrasound signal, wherein the cutoff frequency of the high-pass filter is higher than the frequency corresponding to the infrasound signal; collecting a received audio signal corresponding to the test audio signal through the feedback microphone; A first equalization parameter corresponding to the basic audio signal is determined based on the received audio signal, and a second equalization parameter corresponding to the infrasonic wave signal is determined based on the received audio signal, wherein the first equalization parameter is used to perform ear-shape adaptive equalization on the target audio signal to be output to match the user's ear shape, and the second equalization parameter is used to perform wearing leakage adaptive equalization on the target audio signal to match the wearing state of the headphone.
2. The method according to claim 1, characterized in that Before outputting the test audio signal through the speaker, the method further includes: When the earphone is not playing audio data, an active test instruction is responded to to obtain a test audio signal corresponding to the active test instruction, wherein the test audio signal is obtained by mixing a white noise signal and a first sound wave signal.
3. The method according to claim 1, characterized in that Before outputting the test audio signal through the speaker, the method further includes: When the earphone is playing audio data, the audio data signal to be played is mixed with the second sound wave signal to obtain a test audio signal.
4. The method according to claim 3, characterized in that Outputting the test audio signal through the speaker includes: When the earphone is playing audio data, the speaker is controlled to output the test audio signal every first time period, and after the speaker outputs the test audio signal for a second time period, the speaker is controlled to resume outputting the audio data signal, wherein the first time period is greater than the second time period.
5. The method according to any one of claims 1 to 4, characterized in that The determining, according to the received audio signal, a first equalization parameter corresponding to the basic audio signal includes: determining, based on the received audio signal, a test ear shape transfer function corresponding to the received audio signal; Based on a least squares criterion, a first equalization parameter corresponding to the basic audio signal is calculated according to the test ear shape transfer function and the target ear shape transfer function.
6. The method according to any one of claims 1 to 4, characterized in that The determining, according to the received audio signal, a second equalization parameter corresponding to the infrasound signal comprises: Filtering the received audio signal through a first bandpass filter to obtain a first low-frequency received signal; Calculating the normalized signal energy of the first low-frequency received signal; The leakage degree is determined according to the normalized signal energy, and a second equalization parameter corresponding to the infrasound signal is calculated according to the leakage degree.
7. The method according to claim 6, characterized in that The calculating the normalized signal energy of the first low-frequency received signal includes: Performing windowing and segmentation on the first low-frequency received signal according to a unit window length to obtain at least one frame of low-frequency sub-signal; Calculate the short-time average energy of the low-frequency sub-signal of each frame respectively; The short-time average energy of the low-frequency sub-signal of each frame is smoothed, and a ratio of the smoothed short-time average energy to the target energy is calculated, and the ratio is used as the normalized signal energy of the first low-frequency received signal.
8. The method according to claim 6, characterized in that The calculating, according to the leakage degree, a second equalization parameter corresponding to the infrasonic wave signal comprises: Determining, based on the leakage degree, a leakage frequency response curve that matches the leakage degree, wherein each leakage frequency response curve that matches the leakage degree is obtained by testing the earphones when the earphones are worn in a state that meets each leakage degree; An equalization frequency response curve matching the leakage frequency response curve is obtained, and a second equalization parameter corresponding to the infrasound signal is determined according to the equalization frequency response curve.
9. The method according to claim 6, characterized in that The headset further includes a feedforward microphone. Before filtering the received audio signal through the first bandpass filter to obtain the first low-frequency received signal, the method further includes: collecting ambient sound through the feedforward microphone; Calculating a correlation coefficient based on the ambient sound and the received audio signal; The filtering the received audio signal through the first bandpass filter to obtain a first low-frequency received signal includes: If the correlation coefficient is not greater than the correlation threshold, the step of filtering the received audio signal through a first bandpass filter to obtain a first low-frequency received signal is performed.
10. The method according to claim 9, characterized in that The calculating a correlation coefficient according to the ambient sound and the received audio signal includes: Filtering the ambient sound through a first low-pass filter to obtain a low-frequency ambient sound signal; filtering the received audio signal through a second bandpass filter to obtain a second low-frequency received signal; A correlation coefficient between the low-frequency ambient sound signal and the second low-frequency received signal is calculated as a correlation coefficient between the ambient sound and the received audio signal.
11. The method according to claim 9, characterized in that After collecting the ambient sound by the feedforward microphone, the method further includes: Filtering the ambient sound through a third bandpass filter to obtain a low-frequency ambient sound signal; Calculating the noise energy corresponding to the low-frequency ambient sound signal; In a case where the noise energy is lower than a noise energy threshold, the step of outputting the test audio signal through the speaker is performed.
12. The method according to any one of claims 1 to 4, characterized in that After determining the first equalization parameter corresponding to the basic audio signal according to the received audio signal, and determining the second equalization parameter corresponding to the infrasound signal according to the received audio signal, the method further includes: A first equalizer is configured according to the first equalization parameter, and a second equalizer is configured according to the second equalization parameter, wherein the first equalizer is used to perform the ear shape adaptive equalization on the frequency band in the target audio signal that is higher than or equal to the target frequency threshold, and the second equalizer is used to perform the wearing leakage adaptive equalization on the frequency band in the target audio signal that is lower than the target frequency threshold.
13. The method according to claim 12, characterized in that The first equalizer includes an equalizer composed of a finite length unit impulse response FIR filter; The second equalizer includes an equalizer composed of an infinite length unit impulse response (IIR) filter.
14. An audio signal processing device, characterized in that: Applied to headphones, the headphones include a speaker and a feedback microphone, and the audio signal processing device includes: a first output unit, configured to output a test audio signal through the speaker, wherein the test audio signal is obtained by mixing a basic audio signal filtered by a high-pass filter and an infrasound signal, wherein the cutoff frequency of the high-pass filter is higher than a frequency corresponding to the infrasound signal; a first receiving unit, configured to collect a received audio signal corresponding to the test audio signal through the feedback microphone; A first parameter calculation unit is used to determine a first equalization parameter corresponding to the basic audio signal based on the received audio signal, and to determine a second equalization parameter corresponding to the infrasonic wave signal based on the received audio signal, wherein the first equalization parameter is used to perform ear-shape adaptive equalization on the target audio signal to be output so as to match the user's ear shape, and the second equalization parameter is used to perform wearing leakage adaptive equalization on the target audio signal so as to match the wearing state of the headphone.
15. A headset, characterized in that: The method comprises a memory and a processor, wherein a computer program is stored in the memory, and when the computer program is executed by the processor, the processor implements the method according to any one of claims 1 to 13.
16. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the method according to any one of claims 1 to 13 is implemented.
Citation Information
Patent Citations
Tone quality configuration method and mobile terminal
CN108551631A
Method, device and system for configuring equalization filter in earphone and earphone
CN110996216A
Earphone control method and device and storage medium
CN111818439A
Earphone wearing state detection method and device and earphone
CN111988690A