Audio Processing Method, Apparatus, Electronic Device, and Storage Medium

By adjusting the permeability filter coefficient, the wearable device can accurately transmit ambient sound in different environments and wear methods, solving the problem of inaccurate environmental noise transmission when wearing TWS headphones and improving the user experience.

CN114598970BActive Publication Date: 2025-07-04BEIJING XIAOMI MOBILE SOFTWARE CO LTD +1
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
CN202210229393.8
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2022-03-10
Publication Date
2025-07-04
Estimated Expiration
2042-03-10

AI Technical Summary

Technical Problem

In the prior art, when wearing TWS headphones, the user cannot hear the external sounds clearly due to the obstruction of the headphones, and the passing filter cannot fully match different environments and wearing methods, resulting in inaccurate transmission of environmental noise and poor user experience.

Method used

By obtaining the audio signal received by the wearable device in the environment, adjusting the permeability filtering coefficient to match it with the processed audio signal, generating an audio signal suitable for playback, and achieving accurate transmission of ambient sound.

Benefits of technology

It improves the matching degree between the ambient sounds heard by users when wearing wearable devices and the ambient sounds in the empty ear state, and improves the user experience.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN114598970B_ABST
    Figure CN114598970B_ABST
Patent Text Reader

Abstract

The present disclosure relates to an audio processing method, apparatus, electronic device, and storage medium. The method includes: obtaining a first audio signal received by a wearable device in the environment where it is located, obtaining a second audio signal, where the second audio signal is obtained by the wearable device performing transparent filtering processing on the first audio signal based on a transparent filtering coefficient. In the case where the first audio signal does not match the second audio signal, adjusting the transparent filtering coefficient, and performing transparent filtering processing on the first audio signal through the adjusted transparent filtering coefficient to generate a third audio signal for playback, where the third audio signal matches the first audio signal. Thus, it is possible to adjust the transparent filtering coefficient according to different ambient sounds, enabling the ambient sounds heard by the user when using the wearable device to approximate the ambient sounds in the state of "empty ear".
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present disclosure relates to the field of signal processing, and in particular, to an audio processing method, apparatus, electronic device, and storage medium. Background Art

[0002] In the related art, when a user wears TWS (True Wireless Stereo) headphones, due to the blockage of the headphones, the user cannot clearly hear the external sound. By adopting the sound passthrough technology, the collected ambient sound is filtered by a passthrough filter in the headphones and then played into the user's ear canal through the speaker on the headphones, and the ambient sound leaking into the user's ear canal is superimposed to make the sound when wearing the headphones the same as the sound in the air-ear state. However, in different environments and wearing manners, the passthrough filter cannot fully match the actual environment, resulting in the inability to accurately achieve the passthrough transmission of ambient sound. The user may hear louder or smaller ambient noise, which brings a bad user experience to the user. Summary of the Invention

[0003] To overcome the problems existing in the related art, the present disclosure provides an audio processing method, apparatus, electronic device, and storage medium.

[0004] According to a first aspect of an embodiment of the present disclosure, there is provided an audio processing method, including:

[0005] Obtaining a first audio signal received by the wearable device in the environment where it is located;

[0006] Obtaining a second audio signal, where the second audio signal is obtained by the wearable device performing passthrough filtering on the first audio signal based on a passthrough filter coefficient;

[0007] In the case where the first audio signal does not match the second audio signal, adjusting the passthrough filter coefficient;

[0008] Performing passthrough filtering on the first audio signal through the adjusted passthrough filter coefficient to generate a third audio signal for playing, where the third audio signal matches the first audio signal.

[0009] Optionally, the adjusting the passthrough filter coefficient includes:

[0010] Determining a target filter coefficient from a plurality of alternative filter coefficients according to the first audio signal and the second audio signal;

[0011] Updating the passthrough filter coefficient of the wearable device with the target filter coefficient.

[0012] Optionally, the multiple alternative filtering coefficients correspond one-to-one to multiple amplitude ranges, and determining a target filtering coefficient from the multiple alternative filtering coefficients according to the first audio signal and the second audio signal includes:

[0013] Obtaining a difference between an average amplitude of the first audio signal within a preset frequency range and an average amplitude of the second audio signal within the preset frequency range;

[0014] Determining, as the target filtering coefficient, the filtering coefficient corresponding to a target amplitude range among the multiple alternative filtering coefficients, where the target amplitude range is the amplitude range in which the average amplitude difference lies.

[0015] Optionally, the audio processing method further includes:

[0016] Obtaining a difference between an average amplitude of the first audio signal and an average amplitude of the second audio signal;

[0017] Determining that the first audio signal and the second audio signal do not match when the average amplitude difference is greater than a preset average amplitude difference.

[0018] Optionally, obtaining the difference between the average amplitudes of the first audio signal and the second audio signal includes:

[0019] Generating a first frequency response curve of the first audio signal and a second frequency response curve of the second audio signal;

[0020] Determining a first average amplitude of the first frequency response curve within the preset frequency range and a second average amplitude of the second frequency response curve within the preset frequency range;

[0021] Subtracting the second average amplitude from the first average amplitude to generate the difference of the average amplitudes.

[0022] Optionally, the audio processing method further includes:

[0023] Identifying an audio attribute of the first audio signal, where the audio attribute includes an environmental background noise attribute and / or a human voice attribute of the environment where it is located;

[0024] Determining whether the first audio signal and the second audio signal match when the audio attribute does not include the human voice attribute.

[0025] Optionally, the multiple transparent filtering coefficients of the wearable device are determined by the following method:

[0026] Obtaining a test audio signal of a test audio received by the wearable device when it is not worn;

[0027] In a state where the wearable device is worn, obtain a noise-reduced audio signal of the test audio after being noise-reduced by the wearable device;

[0028] Generate a test frequency response curve of the test audio signal and a passive noise reduction frequency response curve of the noise-reduced audio signal;

[0029] Generate a compensation frequency response curve according to the test frequency response curve and the passive noise reduction frequency response curve;

[0030] Determine a reference frequency response curve of the compensation frequency response curve by setting recursive performance parameters of a recursive filter;

[0031] Adjust the recursive performance parameters of the recursive filter based on the reference frequency response curve to determine a plurality of transparent filtering coefficients.

[0032] Optionally, the determining a reference frequency response curve of the compensation frequency response curve by setting recursive performance parameters of a recursive filter includes:

[0033] Execute a first recursive performance parameter update process, and the first recursive performance parameter update step includes: input an initial recursive performance parameter into the recursive filter to generate an initial simulated frequency response curve; in a case where a difference between an average amplitude of the initial simulated frequency response curve within the preset frequency range and an average amplitude of the compensation frequency response curve within the preset frequency range is greater than the preset average amplitude difference, update the recursive performance parameter of the recursive filter based on the initial recursive performance parameter to obtain an updated recursive performance parameter;

[0034] Execute a second recursive performance parameter update process, and the second recursive performance parameter update process includes: input the updated recursive performance parameter into the recursive filter to generate a corresponding simulated frequency response curve; in a case where a difference between an average amplitude of the corresponding simulated frequency response curve within the preset frequency range and an average amplitude of the compensation frequency response curve within the preset frequency range is greater than the preset average amplitude difference and less than an average amplitude difference in the previous recursive performance parameter update process, update the recursive performance parameter of the recursive filter based on the updated recursive performance parameter, and the previous recursive performance parameter update process is the first recursive performance parameter update process or the previously executed second recursive performance parameter update process;

[0035] Repeat executing the second recursive performance parameter update process until the average amplitude difference in the current second recursive performance parameter update process reaches the preset average amplitude difference, and use the simulated frequency response curve generated in the current second recursive performance parameter update process as the reference frequency response curve.

[0036] Optionally, adjusting the recursive performance parameters of the recursive filter based on the reference frequency response curve to determine a plurality of transparent filtering coefficients includes:

[0037] Determining the recursive performance parameters of the recursive filter corresponding to the reference frequency response curve as the initial transparent filtering coefficients;

[0038] Adjusting the recursive performance parameters of the recursive filter so that the reference frequency response curve is translated multiple times in the direction of the amplitude coordinate axis according to a preset rule to generate a corresponding plurality of detected frequency response curves;

[0039] Determining the difference between the average amplitude of each detected frequency response curve and the average amplitude of the reference frequency response curve, and the transparent filtering coefficients corresponding to each detected frequency response curve, and using the transparent filtering coefficients corresponding to each detected frequency response curve and the initial transparent filtering coefficients as the plurality of transparent filtering coefficients;

[0040] Based on each detected frequency response curve, constructing a corresponding relationship between the average amplitude difference corresponding to each detected frequency response curve and the plurality of transparent filtering coefficients.

[0041] According to a second aspect of the embodiments of the present disclosure, there is provided an audio processing apparatus, including:

[0042] A first acquisition module, configured to acquire a first audio signal received by the wearable device in the environment where it is located;

[0043] A second acquisition module, configured to acquire a second audio signal, where the second audio signal is obtained by the wearable device performing transparent filtering processing on the first audio signal based on transparent filtering coefficients;

[0044] An adjustment module, configured to adjust the transparent filtering coefficients when the first audio signal does not match the second audio signal;

[0045] A generation module, configured to perform transparent filtering processing on the first audio signal through the adjusted transparent filtering coefficients to generate a third audio signal for playing, and the third audio signal matches the first audio signal.

[0046] According to a third aspect of the embodiments of the present disclosure, there is provided an electronic device, including:

[0047] A processor;

[0048] A memory for storing instructions executable by the processor;

[0049] Wherein, the processor is configured to:

[0050] Acquire a first audio signal received by the wearable device in the environment where it is located;

[0051] Obtain a second audio signal, where the second audio signal is obtained after the wearable device performs transparent filtering processing on the first audio signal based on a transparent filtering coefficient;

[0052] In a case where the first audio signal does not match the second audio signal, adjust the transparent filtering coefficient;

[0053] Perform transparent filtering processing on the first audio signal through the adjusted transparent filtering coefficient to generate a third audio signal for playback, where the third audio signal matches the first audio signal.

[0054] According to a fourth aspect of the embodiments of the present disclosure, there is provided a computer-readable storage medium having computer program instructions stored thereon, and when the program instructions are executed by a processor, the steps of the audio processing method provided in the first aspect of the present disclosure are implemented.

[0055] The technical solutions provided by the embodiments of the present disclosure may include the following beneficial effects:.

[0056] In the above solution, by obtaining the first audio signal received by the wearable device in the environment where it is located, obtaining the second audio signal, where the second audio signal is obtained after the wearable device performs transparent filtering processing on the first audio signal based on the transparent filtering coefficient, in a case where the first audio signal does not match the second audio signal, adjusting the transparent filtering coefficient, and performing transparent filtering processing on the first audio signal through the adjusted transparent filtering coefficient to generate a third audio signal for playback, where the third audio signal matches the first audio signal. In this way, by determining whether the first audio signal of the wearable device in the environment where it is located matches the second audio signal after transparent filtering processing, the transparent filtering coefficient is adjusted, so that the obtained third audio signal after adjustment matches the first audio signal, realizing the adjustment of the transparent filtering coefficient according to different ambient sounds, and enabling the ambient sound heard by the user when using the wearable device to be closer to the ambient sound in the state of having no earplugs.

[0057] It should be understood that the above general description and the following detailed description are only exemplary and explanatory, and cannot limit the present disclosure. BRIEF DESCRIPTION OF THE DRAWINGS

[0058] The accompanying drawings herein are incorporated into the specification and constitute a part of the specification, showing embodiments consistent with the present disclosure and used together with the specification to explain the principles of the present disclosure.

[0059] Figure 1 It is a flowchart of an audio processing method shown according to an exemplary embodiment.

[0060] Figure 2Schematic diagram of a method for adjusting a transparency filtering coefficient shown according to an exemplary embodiment.

[0061] Figure 3 Schematic diagram of a method for determining multiple transparency filtering coefficients of a wearable device shown according to an exemplary embodiment.

[0062] Figure 4 Schematic diagram of a frequency response curve shown according to an exemplary embodiment.

[0063] Figure 5 Schematic diagram of a method for determining a reference frequency response curve shown according to an exemplary embodiment.

[0064] Figure 6 Block diagram of an audio processing device shown according to an exemplary embodiment.

[0065] Figure 7 Block diagram of an electronic device shown according to an exemplary embodiment. Detailed implementation manners

[0066] Here, exemplary embodiments will be described in detail, and examples thereof are shown in the drawings. When the following description refers to the drawings, unless otherwise indicated, the same numbers in different drawings represent the same or similar elements. The implementation manners described in the following exemplary embodiments do not represent all implementation manners consistent with the present disclosure. On the contrary, they are merely examples of devices and methods consistent with some aspects of the present disclosure as detailed in the appended claims.

[0067] Figure 1 Flowchart of an audio processing method shown according to an exemplary embodiment. As Figure 1 shown, this audio processing method is used in a terminal and includes the following steps.

[0068] In step S11, obtain a first audio signal received by the wearable device in the environment where it is located.

[0069] It should be noted that the wearable device in this embodiment may be a wireless Bluetooth headset. For example, a TWS (True Wireless Stereo) headset, or a wireless intelligent helmet, or other wearable devices that can be used to transmit audio signals into the user's ear canal. When the wearable device is used by the user, in order to enable the audio signal to be transmitted through the wearable device to the user's ear canal, the wearable device needs to at least cover the user's ear hole. The wearable device may include a feedforward microphone for collecting environmental sounds in the environment where the wearable device is located and converting the collected environmental sounds into a first audio signal according to the wearable device.

[0070] In step S12, a second audio signal is obtained, where the second audio signal is obtained by the wearable device performing a transparency filtering process on the first audio signal based on a transparency filtering coefficient.

[0071] It can be understood that in this embodiment, the wearable device has a transparency filter. In the transparency mode, the wearable device can perform a transparency filtering process on the first audio signal collected from the surrounding environment by using a pre-set transparency filtering coefficient, so as to obtain a corresponding second audio signal. For example, the pre-set transparency filtering coefficient of the wearable device can be the transparency filtering coefficient pre-stored in the wearable device. After the wearable device is turned on, the pre-stored transparency filtering coefficient in the device is read, and the first audio signal is subjected to a transparency filtering process to generate a second audio signal. It can also be that when the wearable device is in use and moves from one audio environment to another, the transparency filter adjusts based on the audio signal in the previous environment to obtain a transparency filtering coefficient, and performs a transparency filtering process on the first audio signal in the new environment according to the transparency filtering coefficient obtained from the previous adjustment, so as to obtain a second audio signal. The transparency filtering coefficient therein is applicable to the audio signal in the previous environment, but when the ambient audio changes or the wearable device moves to other environments during use, the transparency filtering coefficient at this time may not be applicable to the new audio environment, so analysis and matching are required, and the transparency filtering coefficient is adjusted.

[0072] Optionally, after the above step S12, the audio processing method further includes:

[0073] Obtaining the difference between the average amplitude of the first audio signal and the average amplitude of the second audio signal.

[0074] In the case where the difference is greater than a preset amplitude difference, it is determined that the first audio signal and the second audio signal do not match.

[0075] It can be understood that the obtained first audio signal and the second audio signal are compared. Optionally, an audio detection device can be used to determine the audio curves of the first audio signal and the second audio signal, and by comparing the similarity of the audio curves, it is determined whether the first audio signal and the second audio signal match each other. Optionally, the average amplitude difference between the first audio signal and the second audio signal can also be calculated, and it is determined whether the average amplitude difference exceeds a preset average amplitude difference, so as to determine whether the first frequency response curve and the second frequency response curve match each other.

[0076] When the first audio signal matches the second audio signal, it is determined that the current transparent filtering coefficient can transparently process the ambient audio into a similar audio signal, which is transmitted to the user's ear canal through the wearable device so that the user can still hear an audio signal close to the ambient audio when using the wearable device, and the audio signal in the environment is filtered based on the transparent filtering coefficient. Exemplarily, in this embodiment, by calculating the average amplitude difference between the first audio signal and the second audio signal, it is determined whether the first audio signal matches the second audio signal. When the average amplitude difference between the first audio signal and the second audio signal is less than or equal to a preset average amplitude difference, it indicates that the first audio signal matches the second audio signal; when the average amplitude difference between the first audio signal and the second audio signal is greater than the preset average amplitude difference, it is determined that the first audio signal and the second audio signal do not match, and the transparent filtering coefficient needs to be adjusted accordingly. Optionally, the preset average amplitude difference is used to compare the matching degree of the first audio signal and the second audio signal. In an environment with high precision requirements, a smaller preset average amplitude difference can be set, and only when the similarity between the first audio signal and the second audio signal is relatively high can the average amplitude difference be less than or equal to the preset average amplitude difference; in an environment with low precision requirements, a smaller preset average amplitude difference can be set.

[0077] Optionally, the step of obtaining the difference between the average amplitude of the first audio signal and the average amplitude of the second audio signal may include:

[0078] Generate a first frequency response curve of the first audio signal and a second frequency response curve of the second audio signal.

[0079] Determine a first average amplitude of the first frequency response curve within a preset frequency range and a second average amplitude of the second frequency response curve within the preset frequency range.

[0080] Subtract the second average amplitude from the first average amplitude to generate the difference in average amplitude.

[0081] It should be noted that by parsing the ambient audio, amplitude signals at different frequencies can be obtained, and the frequency response curve corresponding to the audio signal can be obtained by detecting the amplitudes of the audio signal at different frequencies. In this embodiment, the obtained first audio signal and second audio signal are respectively converted into a first frequency response curve and a second frequency response curve. It can be understood that the obtained frequency response curve after conversion is the frequency response curve of the ambient audio in the full frequency band. For the human ear corresponding to the user, the audible audio frequency range of the human ear is 20 Hz - 20,000 Hz. Therefore, when comparing audio signals, only the audio signals within the frequency range that the human ear can hear need to be compared. In this embodiment, to make the matching result more accurate, the average amplitude in the frequency band of 1 kHz - 5 kHz is intercepted for calculation, the first average amplitude difference of the first frequency response curve within the frequency range of 1 kHz - 5 kHz is determined, and the second average amplitude difference of the second frequency band curve within the frequency range of 1 kHz - 5 kHz is determined. The difference between the first average amplitude and the second average amplitude is calculated and used as the average amplitude difference. It can be understood that at this time, the average amplitude difference numerically represents the numerical difference between the first average amplitude and the second average amplitude, and the positive and negative relationship represents the magnitude relationship between the first average amplitude and the second average amplitude.

[0082] Optionally, after the above step S12, the audio processing method further includes:

[0083] Identifying the audio attributes of the first audio signal, where the audio attributes include the ambient noise attribute of the environment where it is located and / or the human voice attribute.

[0084] In the case where the audio attributes do not include the human voice attribute, determining whether the first audio signal matches the second audio signal.

[0085] It can be understood that the background noise in the environment represents a series of relatively regular environmental noises. The human voice in the environment has characteristics such as large frequency fluctuations, large individual differences, and instability compared to the background noise audio in the environment, resulting in more difficult detection and analysis of the human voice compared to the background noise audio in the environment. Therefore, in this embodiment, the corresponding adjustment of the transparent filtering coefficient of the wearable device is mainly determined by analyzing the background noise audio in the environment. By performing voice activity detection (VAD) on the first audio signal collected from the environment, it is determined whether there is a human voice in the first audio signal, so as to identify the audio attribute of the first audio signal as the ambient noise attribute or the human voice attribute. For example, when there is both ambient noise audio and human voice audio in the environment, it is still determined as the human voice attribute through voice activity detection. When it is determined that the audio attribute corresponding to the first audio signal is the background noise attribute, it is determined whether the first audio signal matches the second audio signal.

[0086] In step S13, when the first audio signal does not match the second audio signal, adjust the transparency filtering coefficient.

[0087] Exemplarily, when the first frequency response signal does not match the second frequency response signal, it indicates that the current transparency filtering coefficient is not applicable to the current environment. Therefore, it is necessary to adjust the transparency filtering coefficient of the wearable device.

[0088] Figure 2 It is a schematic diagram of a method for adjusting the transparency filtering coefficient shown according to an exemplary embodiment. The above step S13 may include:

[0089] In step S131, determine a target filtering coefficient from multiple alternative filtering coefficients according to the first audio signal and the second audio signal.

[0090] In step S132, update the transparency filtering coefficient of the wearable device with the target filtering coefficient.

[0091] Exemplarily, in this embodiment, multiple alternative filtering coefficients are pre-set in the wearable device. By analyzing the first audio signal and the second audio signal, the corresponding target filtering coefficient is selected from multiple alternative filtering coefficients. Optionally, the transparency filtering test can be carried out in a silent environment to establish the corresponding relationship between the average amplitude difference between the environmental audio and the audio transmitted in the ear canal and the transparency filtering coefficient, so as to construct the one-to-one corresponding relationship between multiple alternative filtering coefficients and multiple average amplitude differences. By comparing the average amplitude difference between the first audio signal and the second audio signal, and then according to the corresponding relationship between multiple alternative filtering coefficients and the average amplitude difference, the target filtering coefficient is determined. Update the transparency filtering coefficient of the wearable device with the target filtering coefficient to perform transparency filtering processing on the first audio signal in the environment.

[0092] Optionally, the above step S131 includes:

[0093] Obtain the difference between the average amplitude of the first audio signal within a preset frequency range and the average amplitude of the second audio signal within the preset frequency range.

[0094] Determine the filtering coefficient corresponding to the target amplitude range among the multiple alternative filtering coefficients, where the target amplitude range is the amplitude range where the average amplitude difference is located.

[0095] Exemplarily, the first frequency response curve corresponding to the first audio signal and the second frequency response curve corresponding to the second audio signal can be determined in the above manner. By calculation, the first average amplitude of the first frequency response curve within the preset frequency range and the second average amplitude of the second frequency response curve within the preset frequency range are determined, and the average amplitude difference is determined according to the first average amplitude and the second average amplitude.

[0096] It is understandable that multiple alternative filtering coefficients are preset in the wearable device, and one of the alternative filtering coefficients corresponds to a range of amplitudes, and the amplitude ranges corresponding to the respective alternative filtering coefficients are all different. By identifying the amplitude range, it is determined that the amplitude range corresponding to the average amplitude difference is the target amplitude range, and the filtering coefficient corresponding to the target amplitude range is used as the target filtering coefficient.

[0097] In step S14, the first audio signal is subjected to a pass-through filtering process by the adjusted pass-through filtering coefficient to generate a third audio signal for playback, and the third audio signal matches the first audio signal.

[0098] Exemplarily, in step S14, after adjusting the pass-through filtering coefficient, the wearable device subjects the collected first audio signal to a pass-through filtering process by the adjusted pass-through filtering coefficient to obtain a third audio signal, where the third audio signal matches the first audio signal, so that the user can clearly hear the ambient sound based on the wearable device.

[0099] In the above solution, by obtaining the first audio signal received by the wearable device in the environment where it is located, when the wearable device is worn, it at least covers the ear hole; the second audio signal is obtained, and the second audio signal is obtained after the wearable device subjects the first audio signal to a pass-through filtering process based on the pass-through filtering coefficient. In the case where the first audio signal and the second audio signal do not match, the pass-through filtering coefficient is adjusted, and the first audio signal is subjected to a pass-through filtering process by the adjusted pass-through filtering coefficient to generate a third audio signal for playback, and the third audio signal matches the first audio signal. In this way, by determining whether the first audio signal of the wearable device in the environment where it is located matches the second audio signal after the pass-through filtering process, the pass-through filtering coefficient is adjusted, so that the third audio signal obtained after the adjustment matches the first audio signal, realizing the adjustment of the pass-through filtering coefficient according to different ambient sounds, and making the ambient sound heard by the user when using the wearable device closer to the ambient sound in the state of having no earplugs.

[0100] Figure 3 It is a schematic diagram of a method for determining multiple pass-through filtering coefficients of a wearable device shown according to an exemplary embodiment. Refer to Figure 3 , the multiple pass-through filtering coefficients can be determined by the following method:

[0101] In step S21, a test audio signal of the test audio received by the wearable device in the non-worn state is obtained.

[0102] It can be understood that wearable devices used for audio transmission need to undergo acoustic characteristic detection in an anechoic chamber before leaving the factory. By controlling variables in the anechoic chamber, the acoustic characteristics of the wearable device are determined. There is no other environmental noise in this anechoic chamber. By playing test audio with known frequencies and corresponding amplitudes in the anechoic chamber, the background noise in the environment is simulated. The test audio is collected through the feedforward microphone of the wearable device and converted into a test audio signal.

[0103] In step S22, in the state where the wearable device is worn, the noise-reduced audio signal after the test audio passes through the noise reduction of the wearable device is obtained.

[0104] It can be understood that the noise-reduced audio signal is part of the test audio signal that propagates into the ear canal through the gap between the wearable device and the ear when the wearable device is in use and the user's ear is blocked but not completely blocked. Due to the obstruction and interference of the propagation path, the part of the test audio signal at this time is different from the test audio signal in terms of frequency and corresponding amplitude. At this time, the wearable device is in a passive noise reduction state. The feedback sound in the user's ear canal is collected through the feedback microphone arranged facing the ear canal of the wearable device, and the noise-reduced audio signal is determined based on the feedback sound.

[0105] In step S23, the test frequency response curve of the audio signal and the passive noise reduction frequency response curve of the noise-reduced audio signal are generated.

[0106] Figure 4 is a schematic diagram of a frequency response curve shown according to an exemplary embodiment. Referring to Figure 4 as shown, it should be noted that when determining the compensation value, the audio signal needs to be converted into a frequency response curve as shown in Figure 4 as shown. By determining the amplitude difference at each frequency in the frequency response curve, the test audio signal and the noise-reduced audio signal are compared. Based on the signal conversion device in the wearable device, the received test audio signal is used to generate a test frequency response curve, and the noise-reduced audio signal is used to generate a passive noise reduction frequency response curve.

[0107] In step S24, according to the test frequency response curve and the passive noise reduction frequency response curve, a compensation frequency response curve is generated.

[0108] For example, in this embodiment, the wearable device needs to process the test audio signal through a transparency filter so that the processed audio signal is superimposed with the noise-reduced audio signal to enable the user to hear an audio signal matching the test audio signal in the ear canal. Therefore, it is necessary to compensate the test audio signal through the transparency filter, and the compensation frequency response curve that the transparency filter needs to compensate is generated by calculating the amplitude difference between the test frequency response curve and the noise reduction frequency response curve at each frequency.

[0109] In step S25, the reference frequency response curve for compensating the frequency response curve is determined by setting the recursive performance parameters of the recursive filter.

[0110] Exemplarily, in step S25, after determining the compensation frequency response curve that needs to be compensated by the above steps for the transparent filter, a corresponding relationship between the compensation frequency response curve and the filter coefficients corresponding to the transparent filter needs to be established. In this embodiment, the transparent filter can adopt an IIR (Infinite Impulse Response) digital filter, also known as a recursive filter. By setting the relevant parameters (frequency parameters, gain parameters, amplitude parameters, etc.) of the IIR filter, the IIR filter can simulate an analog frequency response curve in the same coordinate system corresponding to the compensation frequency response curve. By adjusting the relevant parameters of the IIR filter, a reference frequency response curve similar to the compensation frequency response curve is determined.

[0111] Figure 5 is a schematic diagram of a method for determining a reference frequency response curve shown according to an exemplary embodiment. Refer to Figure 5 the above step S25, which may include:

[0112] Execute the first recursive performance parameter update process. The first recursive performance parameter update step includes: inputting the initial recursive performance parameters into the recursive filter to generate an initial analog frequency response curve; in the case where the difference between the average amplitude of the initial analog frequency response curve within a preset frequency range and the average amplitude of the compensation frequency response curve within the preset frequency range is greater than the preset average amplitude difference, updating the recursive performance parameters of the recursive filter based on the initial recursive performance parameters to obtain the updated recursive performance parameters.

[0113] Execute the second recursive performance parameter update process. The second recursive performance parameter update process includes: inputting the updated recursive performance parameters into the recursive filter to generate the corresponding analog frequency response curve; in the case where the difference between the average amplitude of the corresponding analog frequency response curve within a preset frequency range and the average amplitude of the compensation frequency response curve within the preset frequency range is greater than the preset average amplitude difference and less than the average amplitude difference in the previous recursive performance parameter update process, updating the recursive performance parameters of the recursive filter based on the updated recursive performance parameters. The previous recursive performance parameter update process is the first recursive performance parameter update process or the previously executed second recursive performance parameter update process.

[0114] Repeat the execution of the second recursive performance parameter update process until the average amplitude difference in the current second recursive performance parameter update process reaches the preset average amplitude difference. Then, use the analog frequency response curve generated in the current second recursive performance parameter update process as the reference frequency response curve, thereby generating a reference frequency response curve that matches the compensation frequency response as shown in Figure 5 and shown.

[0115] Among them, performing the first recursive performance parameter update process may be randomly initializing the recursive performance parameters of the recursive filter to obtain the first recursive performance parameters, and obtaining a first recursive signal corresponding to the first recursive performance parameters.

[0116] Calculate a first difference between the sound pressure level amplitudes of the same frequency of the first recursive signal and the compensated audio signal corresponding to the compensated frequency response curve, and calculate the sum of the first differences to obtain a first sum value.

[0117] Determine whether the first recursive signal meets a preset recursive condition according to the first sum value, where the preset recursive condition may be whether the first sum value is less than a preset threshold.

[0118] If the first recursive signal meets the preset recursive condition, that is, the first sum value is less than the preset threshold, generate a reference frequency response curve corresponding to the compensated frequency response curve according to the first recursive signal.

[0119] If the first recursive signal does not meet the preset recursive condition, that is, the first sum value is greater than or equal to the preset threshold, on the basis of the first recursive performance parameters, randomly update the recursive performance parameters of the recursive filter to obtain second recursive performance parameters, and input the first recursive signal into the recursive filter to obtain a second recursive signal corresponding to the second recursive performance parameters.

[0120] Calculate a second difference between the sound pressure level amplitudes of the same frequency of the second recursive signal and the compensated audio signal, and calculate the sum of the second differences to obtain a second sum value.

[0121] Determine whether the second recursive signal meets the preset recursive condition according to the second sum value. If the second recursive signal meets the preset recursive condition, generate a reference frequency response curve corresponding to the compensated frequency response curve according to the second recursive signal.

[0122] If the second recursive signal does not meet the preset recursive condition, determine the reference recursive performance parameters from the first recursive performance parameters and the second recursive performance parameters according to the magnitude relationship between the second sum value and the first sum value. For example, in the case where the second sum value is greater than the first sum value, determine the first recursive performance parameters as the reference recursive performance parameters; in the case where the second sum value is less than the first sum value, determine the second recursive performance parameters as the reference recursive performance parameters.

[0123] Based on the reference recursive performance parameter, randomly update the recursive performance parameter of the recursive filter to obtain a third recursive performance parameter, and input the recursive signal corresponding to the reference recursive performance parameter into the recursive filter to obtain a third recursive signal corresponding to the third recursive performance parameter. For example, when the second recursive performance parameter is the reference recursive performance parameter, based on the second recursive performance parameter, randomly update the recursive performance parameter of the recursive filter to obtain a third recursive performance parameter.

[0124] Calculate a third difference between the sound pressure level amplitudes of the same frequency of the third recursive signal and the compensated audio signal, and calculate the sum of each third difference to obtain a third sum value.

[0125] Determine whether the third recursive signal meets the preset recursive condition according to the third sum value. If the third recursive signal meets the preset recursive condition, generate a reference frequency response curve corresponding to the compensated frequency response curve according to the third recursive signal;

[0126] If the third recursive signal does not meet the preset recursive condition, determine the reference recursive performance parameter for randomly updating the recursive performance parameter of the recursive filter next time according to the magnitude relationship between the third sum value and the difference between the sound pressure level amplitudes of the same frequency of the recursive signal corresponding to the reference recursive performance parameter and the compensated audio signal; and,

[0127] Execute the steps from randomly updating the recursive performance parameter of the recursive filter based on the reference recursive performance parameter to determining the reference recursive performance parameter for randomly updating the recursive performance parameter of the recursive filter next time until the recursive signal corresponding to the reference recursive performance parameter meets the preset recursive condition, and generate a reference frequency response curve corresponding to the compensated frequency response curve according to the recursive signal corresponding to the reference recursive performance parameter.

[0128] In step S26, adjust the recursive performance parameter of the recursive filter based on the reference frequency response curve to determine a plurality of transparent filtering coefficients.

[0129] It can be understood that the transparency filtering coefficient corresponding to the reference frequency response curve is obtained in a single test audio environment. In actual applications, due to factors such as the nature of the environmental background noise and the way users wear the wearable device, there is a deviation between the environmental audio signal processed by this transparency filtering coefficient and the ideal audio signal. Therefore, in this embodiment, it is necessary to determine multiple transparency filtering coefficients based on the reference frequency response curve. For example, by simulating the confirmation process of the above reference frequency response curve, taking the reference frequency response curve as a reference in the recursive filter, multiple simulated frequency response curves with the same shape as the reference frequency response curve but different amplitudes are simulated, and by reading the recursive performance parameters corresponding to the multiple simulated frequency response curves, multiple transparency filtering coefficients are determined.

[0130] Optionally, the above step S26 may include:

[0131] Determine the recursive performance parameter of the recursive filter corresponding to the reference frequency response curve as the initial transparency filtering coefficient.

[0132] Adjust the recursive performance parameter of the recursive filter so that the reference frequency response curve is translated multiple times in the direction of the amplitude coordinate axis according to a preset rule to generate corresponding multiple detected frequency response curves.

[0133] Determine the difference between the average amplitude of each detected frequency response curve and the average amplitude of the reference frequency response curve, and the transparency filtering coefficient corresponding to each detected frequency response curve. The transparency filtering coefficients corresponding to each detected frequency response curve and the initial transparency filtering coefficient are used as multiple transparency filtering coefficients.

[0134] Based on each detected frequency response curve, construct a corresponding relationship between the difference in the average amplitude of each detected frequency response curve and multiple transparency filtering coefficients.

[0135] Exemplarily, in this embodiment, the initial permeability filtering coefficient corresponding to the reference frequency response curve is determined through the recursive performance parameter corresponding to the reference frequency response curve. Through the approximation method of the above recursive filter, a curve segment of the basic frequency response curve within a preset frequency range is intercepted, and this curve segment is translated multiple times in the direction of the amplitude coordinate axis, thereby generating multiple detection frequency response curves that are similar to the reference frequency response curve and have different amplitudes at each frequency. Exemplarily, the reference frequency response curve can be translated upward by 5 amplitudes and downward by 5 amplitudes to obtain D1, D2, D3, D4, D5 detection frequency response curves with average amplitude differences of 1 dB, 2 dB, 3 dB, 4 dB, 5 dB respectively from the reference frequency response curve in the positive direction, and D6, D7, D8, D9, D10 detection frequency response curves with average amplitude differences of -1 dB, -2 dB, -3 dB, -4 dB, -5 dB respectively in the negative direction. And by reading the recursive performance parameters of each detection frequency response curve in the recursive filter, the permeability filtering coefficient corresponding to each detection frequency response curve is determined, and the corresponding relationship between the average amplitude difference and the permeability filtering coefficient is established. When the wearable device performs permeability filtering processing, by comparing the average amplitude difference between the second frequency response curve obtained after permeability filtering and the reference frequency response curve within the preset frequency range, the target filtering coefficient of the wearable device is determined based on this corresponding relationship.

[0136] Figure 6 is a block diagram of an audio processing apparatus shown according to an exemplary embodiment. Referring to Figure 6 , the audio processing apparatus 100 includes a first acquisition module 110, a second acquisition module 120, an adjustment module 130, and a generation module 140.

[0137] The first acquisition module 110 is configured to acquire a first audio signal received by the wearable device in the surrounding environment.

[0138] The second acquisition module 120 is configured to acquire a second audio signal, which is obtained by the wearable device performing permeability filtering processing on the first audio signal based on the permeability filtering coefficient.

[0139] The adjustment module 130 is configured to adjust the permeability filtering coefficient when the first audio signal and the second audio signal do not match.

[0140] The generation module 140 is configured to perform permeability filtering processing on the first audio signal through the adjusted permeability filtering coefficient to generate a third audio signal for playing, and the third audio signal matches the first audio signal.

[0141] Optionally, the adjustment module may include:

[0142] A determination sub-module, configured to determine a target filtering coefficient from multiple alternative filtering coefficients according to a first audio signal and a second audio signal.

[0143] An update sub-module, configured to update the transparent filtering coefficient of the wearable device by using the target filtering coefficient.

[0144] Optionally, the determination sub-module may be configured to:

[0145] Obtain the difference between the average amplitude of the first audio signal within a preset frequency range and the average amplitude of the second audio signal within the preset frequency range.

[0146] Determine the filtering coefficient corresponding to the target amplitude range among the multiple alternative filtering coefficients as the target filtering coefficient, where the target amplitude range is the amplitude range where the difference is located.

[0147] Optionally, the audio processing device 100 may further include:

[0148] A third acquisition module, configured to obtain the difference between the average amplitude of the first audio signal and the average amplitude of the second audio signal.

[0149] A first determination module, configured to determine that the first audio signal does not match the second audio signal when the difference is greater than a preset average amplitude difference.

[0150] Optionally, the third acquisition module may be configured to:

[0151] Generate a first frequency response curve of the first audio signal and a second frequency response curve of the second audio signal.

[0152] Determine a first average amplitude of the first frequency response curve within a preset frequency range and a second average amplitude of the second frequency response curve within the preset frequency range.

[0153] Subtract the second average amplitude from the first average amplitude to generate the difference of the average amplitudes.

[0154] Optionally, the audio processing device 100 may further include:

[0155] An identification module, configured to identify the audio attributes of the first audio signal, where the audio attributes include the ambient background noise attribute and / or the human voice attribute of the environment where it is located.

[0156] A judgment module, configured to judge whether the first audio signal matches the second audio signal when the audio attributes do not include the human voice attribute.

[0157] Optionally, the audio processing device 100 may further include:

[0158] A fourth acquisition module, configured to acquire a test audio signal of test audio received when the wearable device is in an unworn state.

[0159] A fifth acquisition module, configured to acquire a noise-reduced audio signal of the test audio after noise reduction by the wearable device when the wearable device is in a worn state.

[0160] A first execution module, configured to generate a test frequency response curve of the test audio signal and a passive noise reduction frequency response curve of the noise-reduced audio signal.

[0161] A second execution module, configured to generate a compensation frequency response curve according to the test frequency response curve and the passive noise reduction frequency response curve.

[0162] A second determination module, configured to determine a reference frequency response curve of the compensation frequency response curve by setting recursive performance parameters of a recursive filter.

[0163] A third determination module, configured to adjust the recursive performance parameters of the recursive filter based on the reference frequency response curve to determine a plurality of transparent filtering coefficients.

[0164] Optionally, the second determination module may be configured to:

[0165] Execute a first recursive performance parameter update process, and the first recursive performance parameter update step includes: inputting initial recursive performance parameters into the recursive filter to generate an initial simulated frequency response curve; in the case where the difference between the average amplitude of the initial simulated frequency response curve within a preset frequency range and the average amplitude of the compensation frequency response curve within the preset frequency range is greater than a preset average amplitude difference, updating the recursive performance parameters of the recursive filter based on the initial recursive performance parameters to obtain updated recursive performance parameters.

[0166] Execute a second recursive performance parameter update process, and the second recursive performance parameter update process includes: inputting the updated recursive performance parameters into the recursive filter to generate a corresponding simulated frequency response curve; in the case where the difference between the average amplitude of the corresponding simulated frequency response curve within a preset frequency range and the average amplitude of the compensation frequency response curve within the preset frequency range is greater than the preset average amplitude difference and less than the average amplitude difference in the previous recursive performance parameter update process, updating the recursive performance parameters of the recursive filter based on the updated recursive performance parameters, and the previous recursive performance parameter update process is the first recursive performance parameter update process or the previously executed second recursive performance parameter update process.

[0167] Repeat the execution of the second recursive performance parameter update process until the average amplitude difference in the current second recursive performance parameter update process reaches the preset average amplitude difference, and use the simulated frequency response curve generated in the current second recursive performance parameter update process as the reference frequency response curve.

[0168] Optionally, the third determination module may be configured to:

[0169] Determine the recursive performance parameter of the recursive filter corresponding to the reference frequency response curve as the initial transparency filtering coefficient.

[0170] Adjust the recursive performance parameter of the recursive filter so that the reference frequency response curve is translated multiple times in the direction of the amplitude coordinate axis according to a preset rule to generate corresponding multiple detected frequency response curves.

[0171] Determine the difference between the average amplitude of each detected frequency response curve and the average amplitude of the reference frequency response curve, and the transparency filtering coefficients corresponding to each detected frequency response curve. The transparency filtering coefficients corresponding to each detected frequency response curve and the initial transparency filtering coefficient are used as multiple transparency filtering coefficients.

[0172] Based on each detected frequency response curve, construct a corresponding relationship between the difference in the average amplitude of each detected frequency response curve and the multiple transparency filtering coefficients.

[0173] Regarding the device in the above embodiment, the specific manner in which each module performs operations has been described in detail in the embodiment related to the method, and will not be elaborated here.

[0174] The present disclosure also provides a computer-readable storage medium, on which computer program instructions are stored. When the program instructions are executed by a processor, the steps of the audio processing method provided by the present disclosure are implemented.

[0175] Figure 7 It is a block diagram of an electronic device 700 shown according to an exemplary embodiment. The electronic device 700 may be configured as a wearable device. For example, the electronic device 700 may be a mobile phone, a computer, a digital broadcast terminal, a messaging device, a medical device, a fitness device, an audio device, a personal digital assistant, etc.

[0176] Refer to Figure 7 , the electronic device 700 may include one or more of the following components: a processing component 702, a memory 704, a power component 706, a multimedia component 708, an audio component 710, an input / output (I / O) interface 712, a sensor component 714, and a communication component 716.

[0177] The processing component 702 generally controls the overall operation of the electronic device 700, such as operations associated with display, telephone calls, data communication, camera operations, and recording operations. The processing component 702 may include one or more processors 720 to execute instructions to complete all or part of the steps of the above-mentioned audio processing method. In addition, the processing component 702 may include one or more modules to facilitate the interaction between the processing component 702 and other components. For example, the processing component 702 may include a multimedia module to facilitate the interaction between the multimedia component 708 and the processing component 702.

[0178] The memory 704 is configured to store various types of data to support the operation of the electronic device 700. Examples of such data include instructions for any application or method operating on the electronic device 700, contact data, phone book data, messages, pictures, videos, and the like. The memory 704 can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic disks, or optical disks.

[0179] The power component 706 provides power to various components of the electronic device 700. The power component 706 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power for the electronic device 700.

[0180] The multimedia component 708 includes a screen that provides an output interface between the electronic device 700 and the user. In some embodiments, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen can be implemented as a touch screen to receive input signals from the user. The touch panel includes one or more touch sensors to sense touches, swipes, and gestures on the touch panel. The touch sensors can not only sense the boundaries of touch or swipe actions but also detect the duration and pressure associated with the touch or swipe operation. In some embodiments, the multimedia component 708 includes a front camera and / or a rear camera. When the electronic device 700 is in an operating mode, such as a shooting mode or a video mode, the front camera and / or the rear camera can receive external multimedia data. Each of the front camera and the rear camera can be a fixed optical lens system or have focal length and optical zoom capabilities.

[0181] The audio component 710 is configured to output and / or input audio signals. For example, the audio component 710 includes a microphone (MIC) that is configured to receive external audio signals when the electronic device 700 is in an operating mode, such as a call mode, a recording mode, and a voice recognition mode. The received audio signal can be further stored in the memory 704 or transmitted via the communication component 716. In some embodiments, the audio component 710 further includes a speaker for outputting audio signals.

[0182] The I / O interface 712 provides an interface between the processing component 702 and peripheral interface modules, and the peripheral interface modules may be a keyboard, a click wheel, buttons, etc. These buttons may include, but are not limited to: a home button, a volume button, a power button, and a lock button.

[0183] The sensor component 714 includes one or more sensors for providing an assessment of various aspects of the state of the electronic device 700. For example, the sensor component 714 can detect the on / off state of the electronic device 700, the relative positioning of components, such as the display and keypad of the electronic device 700. The sensor component 714 can also detect a change in the position of the electronic device 700 or a component of the electronic device 700, the presence or absence of user contact with the electronic device 700, the orientation or acceleration / deceleration of the electronic device 700, and a change in the temperature of the electronic device 700. The sensor component 714 may include a proximity sensor configured to detect the presence of nearby objects without any physical contact. The sensor component 714 may also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor component 714 may further include an acceleration sensor, a gyro sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.

[0184] The communication component 716 is configured to facilitate communication between the electronic device 700 and other devices in a wired or wireless manner. The electronic device 700 can access a wireless network based on communication standards, such as WiFi, 2G, or 3G, or a combination thereof. In an exemplary embodiment, the communication component 716 receives broadcast signals or broadcast-related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 716 further includes a near field communication (NFC) module to facilitate short-range communication. For example, the NFC module can be implemented based on radio frequency identification (RFID) technology, infrared data association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology, and other technologies.

[0185] In an exemplary embodiment, the electronic device 700 may be implemented by one or more application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), controllers, microcontrollers, microprocessors or other electronic components for performing the above audio processing method.

[0186] In an exemplary embodiment, a non-transitory computer-readable storage medium including instructions, such as a memory 704 including instructions, may be provided, and the above instructions may be executed by a processor 720 of the electronic device 700 to complete the above audio processing method. For example, the non-transitory computer-readable storage medium may be a ROM, a random access memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, etc.

[0187] In another exemplary embodiment, a computer program product is also provided, which includes a computer program executable by a programmable device, and the computer program has a code portion for performing the above audio processing method when executed by the programmable device.

[0188] Those skilled in the art will readily conceive of other embodiments of the present disclosure after considering the specification and practicing the present disclosure. This application is intended to cover any variations, uses, or adaptations of the present disclosure, which follow the general principles of the present disclosure and include common general knowledge or conventional technical means in the technical field not disclosed in the present disclosure. The specification and embodiments are only regarded as exemplary, and the true scope and spirit of the present disclosure are pointed out by the following claims.

[0189] It should be understood that the present disclosure is not limited to the exact structures already described and shown in the drawings, and various modifications and changes can be made without departing from its scope. The scope of the present disclosure is only limited by the appended claims.

Claims

1. An audio processing method, characterized in that, Applied to a wearable device, including: When it is determined that the audio environment where the wearable device is located has changed, obtaining a first audio signal received by the wearable device in the current environment; Obtaining a second audio signal, where the second audio signal is obtained by the wearable device performing a transparent filtering process on the first audio signal based on a transparent filtering coefficient, and the transparent filtering coefficient is the coefficient of the transparent filter of the wearable device during the transparent filtering process, and the transparent filtering coefficient is a pre-stored transparent filtering coefficient in the wearable device; Obtaining the difference between the average amplitude of the first audio signal and the average amplitude of the second audio signal; When the difference is greater than a preset amplitude difference, determining that the first audio signal does not match the second audio signal; When the first audio signal does not match the second audio signal, adjusting the transparent filtering coefficient; Performing a transparent filtering process on the first audio signal through the adjusted transparent filtering coefficient to generate a third audio signal for playback, and the third audio signal matches the first audio signal; The adjusting the transparent filtering coefficient includes: Determining a target filtering coefficient from a plurality of alternative filtering coefficients according to the first audio signal and the second audio signal; Updating the transparent filtering coefficient of the wearable device with the target filtering coefficient.

2. The audio processing method according to claim 1, wherein The plurality of alternative filtering coefficients correspond one-to-one with a plurality of amplitude ranges, and the determining a target filtering coefficient from a plurality of alternative filtering coefficients according to the first audio signal and the second audio signal includes: Obtaining the difference between the average amplitude of the first audio signal within a preset frequency range and the average amplitude of the second audio signal within the preset frequency range; Determining the filtering coefficient corresponding to the target amplitude range among the plurality of alternative filtering coefficients as the target filtering coefficient, where the target amplitude range is the amplitude range where the difference is located.

3. The audio processing method according to claim 1, wherein The obtaining the difference between the average amplitude of the first audio signal and the average amplitude of the second audio signal includes: Generating a first frequency response curve of the first audio signal and a second frequency response curve of the second audio signal; Determining a first average amplitude of the first frequency response curve within a preset frequency range and a second average amplitude of the second frequency response curve within the preset frequency range; Subtracting the second average amplitude from the first average amplitude to generate the difference of the average amplitude.

4. The audio processing method according to claim 1, wherein The method further includes: Identifying the audio attributes of the first audio signal, where the audio attributes include the ambient noise attribute and / or the human voice attribute of the current environment; When the audio attributes do not include the human voice attribute, determining whether the first audio signal matches the second audio signal.

5. The audio processing method according to any one of claims 2-4, characterized in that The plurality of transparent filtering coefficients of the wearable device are determined by the following method: Obtaining a test audio signal of a test audio received by the wearable device when it is not worn; When the wearable device is in a worn state, obtaining a noise-reduced audio signal of the test audio after being noise-reduced by the wearable device; Generate the test frequency response curve of the test audio signal and the passive noise reduction frequency response curve of the noise reduction audio signal; Generate a compensation frequency response curve according to the test frequency response curve and the passive noise reduction frequency response curve; Determine the reference frequency response curve of the compensation frequency response curve by setting the recursive performance parameters of the recursive filter; Adjust the recursive performance parameters of the recursive filter based on the reference frequency response curve to determine a plurality of transparent filtering coefficients.

6. The audio processing method according to claim 5, wherein The determining the reference frequency response curve of the compensation frequency response curve by setting the recursive performance parameters of the recursive filter includes: Execute a first recursive performance parameter update process, and the first recursive performance parameter update step includes: input an initial recursive performance parameter into the recursive filter to generate an initial simulated frequency response curve; in the case that the difference between the average amplitude of the initial simulated frequency response curve within the preset frequency range and the average amplitude of the compensation frequency response curve within the preset frequency range is greater than a preset average amplitude difference, update the recursive performance parameter of the recursive filter based on the initial recursive performance parameter to obtain an updated recursive performance parameter; Execute a second recursive performance parameter update process, and the second recursive performance parameter update process includes: input the updated recursive performance parameter into the recursive filter to generate a corresponding simulated frequency response curve; in the case that the difference between the average amplitude of the corresponding simulated frequency response curve within the preset frequency range and the average amplitude of the compensation frequency response curve within the preset frequency range is greater than the preset average amplitude difference and less than the average amplitude difference in the previous recursive performance parameter update process, update the recursive performance parameter of the recursive filter based on the updated recursive performance parameter, and the previous recursive performance parameter update process is the first recursive performance parameter update process or the previously executed second recursive performance parameter update process; Repeat the execution of the second recursive performance parameter update process until the average amplitude difference in the current second recursive performance parameter update process reaches the preset average amplitude difference, and use the simulated frequency response curve generated in the current second recursive performance parameter update process as the reference frequency response curve.

7. The audio processing method according to claim 5, wherein The adjusting the recursive performance parameters of the recursive filter based on the reference frequency response curve to determine a plurality of transparent filtering coefficients includes: Determine the recursive filter recursive performance parameter corresponding to the reference frequency response curve as the initial transparent filtering coefficient; Adjust the recursive performance parameters of the recursive filter to translate the reference frequency response curve in the direction of the amplitude coordinate axis multiple times according to a preset rule to generate corresponding multiple detected frequency response curves; Determine the difference between the average amplitude of each detected frequency response curve and the average amplitude of the reference frequency response curve, and the transparent filtering coefficient corresponding to each detected frequency response curve, and the transparent filtering coefficient corresponding to each detected frequency response curve and the initial transparent filtering coefficient are used as the plurality of transparent filtering coefficients; Based on each detected frequency response curve, construct a corresponding relationship between the difference in the average amplitude corresponding to each detected frequency response curve and the plurality of transparent filtering coefficients.

8. An audio processing device, characterized in that, Including: A first acquisition module, configured to acquire a first audio signal received by the wearable device in the environment where the wearable device is located when it is determined that the audio environment where the wearable device is located has changed; A second acquisition module, configured to acquire a second audio signal, where the second audio signal is obtained by the wearable device performing a transparency filtering process on the first audio signal based on a transparency filtering coefficient, and the transparency filtering coefficient is the coefficient of the transparency filter of the wearable device when performing the transparency filtering process, and the transparency filtering coefficient is a transparency filtering coefficient pre-stored in the wearable device; An adjustment module, configured to adjust the transparency filtering coefficient when the first audio signal does not match the second audio signal; obtain a difference between an average amplitude of the first audio signal and an average amplitude of the second audio signal; When the difference is greater than a preset amplitude difference, determine that the first audio signal does not match the second audio signal, and the adjustment of the transparency filtering coefficient includes: determining a target filtering coefficient from a plurality of alternative filtering coefficients according to the first audio signal and the second audio signal; updating the transparency filtering coefficient of the wearable device with the target filtering coefficient; A generation module, configured to perform a transparency filtering process on the first audio signal through the adjusted transparency filtering coefficient to generate a third audio signal for playing, and the third audio signal matches the first audio signal.

9. An electronic device, characterized in that, Including: A processor; A memory for storing instructions executable by the processor; Wherein, the processor is configured to: When it is determined that the audio environment where the wearable device is located has changed, acquire a first audio signal received by the wearable device in the environment where the wearable device is located; Acquire a second audio signal, where the second audio signal is obtained by the wearable device performing a transparency filtering process on the first audio signal based on a transparency filtering coefficient, and the transparency filtering coefficient is the coefficient of the transparency filter of the wearable device when performing the transparency filtering process, and the transparency filtering coefficient is a transparency filtering coefficient pre-stored in the wearable device; Obtain a difference between an average amplitude of the first audio signal and an average amplitude of the second audio signal; When the difference is greater than a preset amplitude difference, determine that the first audio signal does not match the second audio signal; When the first audio signal does not match the second audio signal, adjust the transparency filtering coefficient, and the adjustment of the transparency filtering coefficient includes: determining a target filtering coefficient from a plurality of alternative filtering coefficients according to the first audio signal and the second audio signal; updating the transparency filtering coefficient of the wearable device with the target filtering coefficient; Perform a transparency filtering process on the first audio signal through the adjusted transparency filtering coefficient to generate a third audio signal for playing, and the third audio signal matches the first audio signal.

10. A computer-readable storage medium having computer program instructions stored thereon, characterized in that, When the program instructions are executed by the processor, the steps of the method described in any one of claims 1 to 7 are implemented.

Citation Information

Patent Citations

  • Method and system for unvarnished transmission of earphone and earphone

    CN110972018A