Audio processing method and device, computer readable storage medium and electronic device

Abstract

The application discloses an audio processing method, device, computer readable storage medium and electronic equipment. The method comprises the following steps: obtaining a high-frequency signal and a medium-low-frequency signal by dividing the frequency of a target audio signal acquired in real time; obtaining a target reference signal based on a current environmental noise signal transmitted by a feed-forward microphone acquired in real time; obtaining a real-time control signal based on the target reference signal acquired in real time and a feed-forward control filter coefficient of the feed-forward microphone acquired in real time; fusing the high-frequency signal and the real-time control signal to form a first target audio signal and outputting the first target audio signal to an air conduction sound generating device so that the air conduction sound generating device plays corresponding first target audio; outputting the medium-low-frequency signal at the same time to a bone conduction sound generating device so that the bone conduction sound generating device plays corresponding second target audio; and playing the first target audio and the second target audio synchronously. The audio processing method provided by the application avoids the influence of environmental noise on the user of a bone conduction earphone when the user answers an audio, and can also eliminate the interference of external environmental noise on the user in a noisy environment.

Description

Technical Field

[0001] This application relates to the field of audio technology, and more particularly to audio processing methods, apparatus, computer-readable storage media, and electronic devices. Background Technology

[0002] In the headphone industry, current noise reduction efforts primarily focus on active noise cancellation for calls. Active noise cancellation in the industry refers to suppressing the impact of ambient noise on the other party during a call. It's evident that there are currently few technological improvements within the industry focused on reducing the impact of ambient noise on the user's own voice reception.

[0003] Unlike air conduction headphones, bone conduction headphones transmit sound through bone conduction. Environmental noise can significantly impact the user experience when using bone conduction headphones. For example, in noisy environments such as subways or high-speed trains, the audio signal transmitted by bone conduction headphones can be completely drowned out by the ambient noise that is simultaneously transmitted to the user's ears.

[0004] Therefore, there is a need to find a method that can effectively suppress the influence of environmental noise when bone conduction headphone users are listening to headphone audio signals. Summary of the Invention

[0005] The purpose of this application is to provide an audio processing method, apparatus, computer-readable storage medium, and electronic device that can effectively reduce the impact of environmental noise and improve the voice quality of the other party's voice heard by the headset user.

[0006] To achieve the above-mentioned objectives, this application proposes the following technical solution:

[0007] Firstly, the target audio signal acquired in real time is divided to obtain high-frequency signals and mid-to-low-frequency signals.

[0008] The target reference signal is obtained based on the current ambient noise signal transmitted by the feedforward microphone in real time;

[0009] The real-time control signal is obtained based on the target reference signal acquired in real time and the feedforward control filter coefficients of the feedforward microphone acquired in real time.

[0010] The high-frequency signal is fused with the real-time control signal to form a first target audio signal and output to the air conduction sound device so that it can play the corresponding first target audio. At the same time, the mid-low frequency signal is output to the bone conduction sound device so that it can play the corresponding second target audio. The first target audio and the second target audio are played synchronously.

[0011] In a preferred embodiment, obtaining the target reference signal based on the current ambient noise signal transmitted by the feedforward microphone in real time includes:

[0012] Acquire the initial reference signal transmitted in real time by the feedforward microphone;

[0013] The initial reference signal is subjected to bandpass filtering to obtain a preprocessed reference signal;

[0014] The preprocessed reference signal is restored to obtain the target reference signal.

[0015] In a preferred embodiment, the step of restoring the preprocessed reference signal to obtain the target reference signal includes:

[0016] The target reference signal is obtained based on the preprocessed reference signal and the pre-calibrated output-reference transfer path coefficients.

[0017] In a preferred embodiment, the method further includes updating the feedforward control filter coefficients in real time, including:

[0018] It can determine in real time whether there is a sudden change in environmental noise, and determine the target mutation suppression coefficient at the current moment based on the preset correspondence between the judgment result and the mutation suppression coefficient;

[0019] Real-time updates of the feedback microphone's output-error propagation path coefficients;

[0020] The target feedback signal is obtained based on the current ambient noise signal transmitted by the feedback microphone in real time.

[0021] The feedforward control filter coefficients at the current moment are obtained based on the output-error propagation path coefficients, the target mutation suppression coefficients, and the target feedback signal.

[0022] In a preferred embodiment, obtaining the target feedback signal based on the current ambient noise signal transmitted by the feedback microphone in real time includes:

[0023] Acquire the initial feedback signal transmitted in real time by the feedback microphone;

[0024] The initial feedback signal is subjected to bandpass filtering to obtain a preprocessed feedback signal;

[0025] The preprocessed feedback signal is restored to obtain the target feedback signal.

[0026] In a preferred embodiment, the real-time update of the output-error propagation path coefficients of the feedback microphone includes:

[0027] Obtain the pre-calibrated initial output-error propagation path coefficients;

[0028] The output-error propagation path coefficients are obtained by real-time compensation and updating of the initial output-error propagation path coefficients.

[0029] Secondly, an audio processing apparatus is provided, the apparatus comprising:

[0030] The first acquisition module is used to divide the target audio signal acquired in real time to obtain high-frequency signals and mid-low-frequency signals.

[0031] The second acquisition module is used to obtain the target reference signal based on the current ambient noise signal transmitted by the feedforward microphone in real time;

[0032] The processing module is used to fuse the high-frequency signal with the real-time control signal and output it to the air conduction sound generator to play and form a first target audio, and to output the mid-low frequency signal simultaneously to the bone conduction sound generator to play and form a second target audio.

[0033] In a preferred embodiment, the second acquisition module includes:

[0034] The first acquisition unit is used to acquire the initial reference signal transmitted in real time by the feedforward microphone;

[0035] The second acquisition unit is used to perform bandpass filtering on the initial reference signal to obtain a preprocessed reference signal;

[0036] The restoration unit is used to restore the preprocessed reference signal to obtain the target reference signal.

[0037] Thirdly, a computer-readable storage medium is provided having a computer program stored thereon, which, when executed by one or more processors, implements the steps of the audio processing method as described in any one of the first aspects.

[0038] Fourthly, providing electronic devices, including:

[0039] An audio receiving device, wherein the audio receiving device is communicatively connected to a target communication terminal to receive the target audio signal emitted by the target communication terminal in real time;

[0040] A feedforward microphone, the feedforward microphone being used to pick up current ambient noise signals;

[0041] One or more processors, each connected to the audio receiving device and the feedforward microphone, respectively, perform the method as described in any one of the first aspects; and

[0042] An air conduction sound generating device, wherein the air conduction sound generating device is connected to the one or more processors to receive the first target audio signal and play the corresponding first target audio;

[0043] A bone conduction sound device, the bone conduction sound device being connected to the one or more processors to play a corresponding second target audio.

[0044] Compared with the prior art, this application has the following beneficial effects:

[0045] This application provides an audio processing method, apparatus, computer-readable storage medium, and electronic device. The method includes: dividing a real-time acquired target audio signal by frequency division to obtain a high-frequency signal and a mid-to-low-frequency signal; obtaining a target reference signal based on a real-time acquired ambient noise signal transmitted by a feedforward microphone; obtaining a real-time control signal based on the real-time acquired target reference signal and the feedforward control filter coefficients of the real-time acquired feedforward microphone; fusing the high-frequency signal and the real-time control signal to form a first target audio signal and outputting it to an air conduction sound-generating device to play the corresponding first target audio; and simultaneously outputting the mid-to-low-frequency signal to a bone conduction sound-generating device to play the corresponding second target audio. The first target audio and the second target audio are played synchronously. The audio processing method provided in this application cancels out environmental noise by synchronously playing the reverse sound signal of environmental noise through the air conduction sound device set in the bone conduction headphones. This avoids the impact of environmental noise on the user's audio listening. Even in noisy environments, it can eliminate the interference of external environmental noise for the user, providing a better audio listening experience and improving the quality of the user's call or music experience. In addition, the use of frequency division to output the high-frequency part of the target audio signal through the air conduction sound device can effectively compensate for the defect of poor high-frequency experience of bone conduction headphones, and improve the user experience of bone conduction headphones.

[0046] Furthermore, the method also includes real-time updating of the feedforward control filter coefficients, including real-time determination of whether there are sudden changes in environmental noise, and determination of the target sudden change suppression coefficient at the current moment based on the preset correspondence between the determination result and the sudden change suppression coefficient; real-time updating of the output-error propagation path coefficient of the feedback microphone; obtaining the target feedback signal based on the current environmental noise signal transmitted by the feedback microphone in real time; and obtaining the feedforward control filter coefficient at the current moment based on the error propagation path coefficient, the sudden change suppression coefficient, and the target feedback signal. The adaptive updating of the feedforward control filter in this application can effectively avoid the sudden changes in environmental noise that cause sudden changes in the real-time control signal, resulting in abnormal noises such as howling, thereby further improving the user experience of bone conduction headphones. Attached Figure Description

[0047] Figure 1 This is a flowchart of the audio processing method in this embodiment;

[0048] Figure 2 This is a hardware structure layout diagram of the bone conduction headphones in one view in this embodiment;

[0049] Figure 3 This is a hardware structure layout diagram of the bone conduction headphones from another perspective in this embodiment;

[0050] Figure 4 This is a logical schematic diagram of the audio processing method in this embodiment;

[0051] Figure 5 This is a schematic diagram of the computer-readable storage medium structure provided in this embodiment. Detailed Implementation

[0052] To make the objectives, technical solutions, and advantages of this application clearer, the technical solutions in the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this application, and not all embodiments. Based on the embodiments in this application, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this application.

[0053] In the description of this application, it should be understood that the terms "first" and "second" are used for descriptive purposes only and should not be construed as indicating or implying relative importance or implicitly specifying the number of indicated technical features. Therefore, a feature defined as "first" or "second" may explicitly or implicitly include one or more of that feature. In the description of this application, unless otherwise stated, "multiple" means two or more.

[0054] In view of the current situation where headphones, especially bone conduction headphones, are easily affected by ambient noise when users listen to audio signals, this embodiment provides an audio processing method, apparatus, computer-readable storage medium, and electronic device, which can effectively improve the user experience when using headphones, especially bone conduction headphones.

[0055] The audio processing method, apparatus, computer-readable storage medium, and electronic device will be further described in detail below with reference to specific embodiments.

[0056] Example

[0057] like Figure 1 , 4 As shown, this embodiment provides an audio processing method applicable to bone conduction headphones. This method is used to suppress the impact of environmental noise on bone conduction headphone users when listening to audio by performing real-time active noise reduction, providing a quiet headphone usage environment for bone conduction headphone users even in noisy environments.

[0058] like Figure 2 and Figure 3As shown, the headphones in this embodiment include a controller, a microphone, an air conduction sound-generating device (speaker) 1, a bone conduction sound-generating device (motor vibrator), a feedforward microphone 3, and a feedback microphone 2. The controller executes the audio processing method, the feedforward microphone 3 and the feedback microphone 2 both pick up ambient noise from the headphones, and the air conduction sound-generating device outputs a first target audio signal corresponding to the first target audio signal output by the controller. Preferably, the processor is integrated into the Bluetooth controller of the bone conduction headphones, or the algorithm processing is performed in a separate MCU / DSP. Preferably, the air conduction sound-generating device is located at the main control hardware, preferably near or towards the ear, the feedback microphone 2 is located at the end of the bone conduction headphones closest to the ear, and the feedforward microphone 3 is located at a position away from the speaker on the bone conduction vibrator. Of course, the configuration is not limited to these; all configurations that can implement the audio processing method in this embodiment are within the scope of this embodiment.

[0059] Specifically, the audio processing method includes:

[0060] S1. Divide the real-time acquired target audio signal to obtain a high-frequency signal. and low- and mid-frequency signals.

[0061] Specifically, the target audio signal is divided into high-frequency and mid-to-low-frequency signals using bandpass filtering. In this embodiment, the high-frequency signal has a frequency greater than 1000Hz, and the mid-to-low-frequency signal has a frequency less than 1000Hz.

[0062] S2. Obtain the target reference signal x(n) based on the current ambient noise signal transmitted by the feedforward microphone in real time.

[0063] Specifically, step S2 includes:

[0064] S21. Obtain the initial reference signal transmitted in real time by the feedforward microphone.

[0065] S22. Perform bandpass filtering on the initial reference signal to obtain the preprocessed reference signal.

[0066] Specifically, the initial reference signal is preprocessed according to the frequency band range of the active noise reduction control to obtain the preprocessed reference signal. The preprocessing method is to use bandpass filtering to filter the signal according to the frequency band range of the active noise reduction control.

[0067] S23. Perform restoration processing on the preprocessed reference signal to obtain the target reference signal x(n).

[0068] Since the output audio corresponding to the control signal output by the air conduction sound generator and the output audio corresponding to the high-frequency part of the target audio may have a certain impact on the initial reference signal collected by the feedforward microphone, it is necessary to perform restoration processing to obtain the actual target reference signal.

[0069] Before step S23, the method includes step S0a, which involves pre-calibrating the output-reference transfer path coefficients of the feedforward microphone to obtain the calibration output-reference transfer path coefficients. Specifically, step S0a involves: emitting a white noise signal a(n) from the test loudspeaker; the feedforward microphone picking up the white noise signal and converting it into an audio electrical signal (reference signal x0(n)); and calculating the calibration output-reference transfer path coefficients Pn using the least mean square (LMS) algorithm with the reference signal x0(n) and the white noise signal, where n represents the current time n.

[0070] Similarly, it also includes step S0b, where a white noise signal a(n) is emitted by the test speaker, the feedback microphone picks up the white noise signal and converts it into an audio electrical signal (error signal e0(n)), and the error signal e0(n) and the white noise signal are used to calculate the calibration output-feedback transmission path coefficient Sn according to the least mean square algorithm (LMS), where n represents the current time n.

[0071] It should be noted that the calibration output-reference transmission path coefficient Pn and calibration output-feedback transmission path coefficient Sn mentioned above are the actual physical parameters of the bone conduction headphones, which only need to be calibrated once after the bone conduction headphones leave the factory.

[0072] Step S23 specifically includes: obtaining the target reference signal based on the preprocessed reference signal and the pre-calibrated calibration output-reference transfer path coefficients. Specifically, the target reference signal x(n) is calculated using the following formula (1):

[0073] (1)

[0074] Where n represents the current n-th time, i represents the sequence number, and M represents the filter order.

[0075] S3. Obtain the real-time control signal based on the target reference signal acquired in real time and the feedforward control filter coefficients of the feedforward microphone acquired in real time.

[0076] Before step S3, the method also includes Sa, real-time updating of the feedforward control filter coefficients, including:

[0077] Sa1. Real-time output-error propagation path coefficients are obtained by updating them in real time based on the pre-obtained calibration output-error propagation path coefficients of the feedback microphone. .

[0078] Specifically, step Sa1 includes:

[0079] Sa1-1, Obtain the calibration output - error propagation path coefficients, see step S0b;

[0080] Sa1-2, Real-time compensation and update of the calibration output-error propagation path coefficients to obtain the real-time output-error propagation path coefficients. .

[0081] Specifically, the real-time output-error propagation path coefficient is calculated using the following formula (2). :

[0082] (2)

[0083] M represents the filter order, n represents the current time n, i represents the index, and Sni(n) represents the calibration output-error propagation path coefficient of the i-th index at time n.

[0084] Sa2, obtaining the target feedback signal based on the current ambient noise signal transmitted by the feedback microphone in real time. Specifically, step Sa1 includes:

[0085] Sa2-1, Acquire the initial feedback signal transmitted in real time by the feedback microphone;

[0086] Sa2-2, Perform bandpass filtering on the initial feedback signal to obtain the preprocessed feedback signal;

[0087] Sa2-3, Feedback signal after preprocessing The target feedback signal is obtained by performing a restoration process. .

[0088] Since the output audio corresponding to the control signal output by the air conduction sound generator and the output audio corresponding to the high-frequency part of the target audio may have a certain impact on the initial feedback signal collected by the feedback microphone, it is necessary to perform restoration processing to obtain the actual target feedback signal. .

[0089] Specifically, the target feedback signal e(n) is calculated using the following formula (3):

[0090] (3)

[0091] Where M represents the filter order, n represents the current time n, and i represents the index. This represents the calibration output-error propagation path coefficient at time n, for the i-th index.

[0092] Sa3. Based on the target feedback signal, determine in real time whether there is a sudden change in environmental noise, and determine the target mutation suppression coefficient at the current moment according to the preset correspondence between the judgment result and the mutation suppression coefficient.

[0093] In one implementation, it is determined whether the target feedback signal falls within a preset feedback signal threshold. If not, a sudden change in environmental noise is identified. If so, no sudden change in environmental noise is identified.

[0094] In another implementation, it is determined whether the target feedback signal power falls within a preset feedback signal power threshold. If not, it is determined that there is a sudden change in environmental noise. If so, it is determined that there is no sudden change in environmental noise.

[0095] As described above, when no sudden change in environmental noise is detected, the mutation suppression coefficient p3 is set to 0. When a sudden change in environmental noise is detected: the mutation suppression coefficient p3 is updated to a non-zero value, causing the feedforward control filter coefficient update to decay rapidly, and the feedforward control filter coefficient update is paused.

[0096] Sa4: Based on the real-time output error propagation path coefficients, target mutation suppression coefficients, and target feedback signals at the current moment, obtain the feedforward control filter coefficients at the current moment.

[0097] Specifically, the feedforward control filter coefficients are calculated using the following equations (4) and (5):

[0098] (4)

[0099] (5)

[0100] in, Indicates step size, Indicates the minimum value to prevent divergence. Represents the normalization coefficient. Indicates the mutation suppression coefficient. Indicates the error buffer order. This indicates the current level of adaptability of the feedforward control filter (which can be used to update the coefficients of the feedforward control filter, thereby achieving adaptive feedforward control). This represents the coefficients of the feedforward control filter at the current moment.

[0101] Therefore, when updating the coefficients of the feedforward control filter, an abnormal noise suppression module is added on the basis of the fxlms algorithm, which can effectively avoid abnormal noise caused by sudden changes in the output of the control signal due to sudden changes in environmental noise.

[0102] S4. The high-frequency signal and the real-time control signal are fused to form the first target audio signal and output to the air conduction sound device so that it can play the corresponding first target audio. At the same time, the mid-low frequency signal is output to the bone conduction sound device so that it can play the corresponding second target audio. The first target audio and the second target audio are played synchronously.

[0103] In summary, this embodiment provides an audio processing method that cancels out ambient noise by synchronously playing an inverse sound signal of the ambient noise through the air conduction sound-generating device in the bone conduction headphones. This avoids the impact of ambient noise on the user's audio listening experience, eliminating external environmental noise interference even in noisy environments and providing a better audio listening experience, thus improving the quality of the user's call or music experience. Furthermore, by using a frequency division method to output the high-frequency part of the target audio signal through the air conduction sound-generating device, the defect of poor high-frequency audio experience in bone conduction headphones can be effectively compensated for, thus improving the user experience of bone conduction headphones.

[0104] Furthermore, the adaptive update based on the feedforward control filter in this application can effectively avoid the abnormal noises such as howling caused by sudden changes in environmental noise leading to sudden changes in the real-time control signal, thereby further improving the user experience of bone conduction headphones.

[0105] Corresponding to the above-described audio processing method, this embodiment further provides an audio processing apparatus corresponding to the method, which implements the method through various functional modules. The audio processing apparatus includes:

[0106] The first acquisition module is used to divide the target audio signal acquired in real time to obtain high-frequency signals and mid-low-frequency signals.

[0107] The second acquisition module is used to obtain the target reference signal based on the current ambient noise signal transmitted by the feedforward microphone in real time;

[0108] The processing module is used to fuse the high-frequency signal with the real-time control signal and output it to the air conduction sound generator to play and form the first target audio, and output the mid-low frequency signal simultaneously to the bone conduction sound generator to play and form the second target audio.

[0109] An update module is used to update the coefficients of the feedforward control filter in real time.

[0110] The second acquisition module, as described above, includes:

[0111] The first acquisition unit is used to acquire the initial reference signal transmitted in real time by the feedforward microphone;

[0112] The second acquisition unit is used to perform bandpass filtering on the initial reference signal to obtain a preprocessed reference signal;

[0113] The restoration unit is used to restore the preprocessed reference signal to obtain the target reference signal.

[0114] The second acquisition unit is specifically used to obtain the target reference signal based on the preprocessed reference signal and the pre-calibrated calibration output-reference transfer path coefficients.

[0115] The update module mentioned above includes:

[0116] The first update unit is used to update the real-time output-error propagation path coefficients in real time based on the pre-obtained calibration output-error propagation path coefficients of the feedback microphone.

[0117] The third acquisition unit is used to obtain the target feedback signal based on the current ambient noise signal transmitted by the feedback microphone in real time.

[0118] The first processing unit is used to determine in real time whether there is a sudden change in environmental noise based on the target feedback signal, and to determine the target mutation suppression coefficient at the current moment according to the preset correspondence between the judgment result and the mutation suppression coefficient.

[0119] The second processing unit is used to obtain the feedforward control filter coefficients at the current moment based on the real-time output-error propagation path coefficients, the target mutation suppression coefficients, and the target feedback signal.

[0120] The first update unit, as described above, is specifically used for:

[0121] Obtain the calibration output-error propagation path coefficient of the feedback microphone;

[0122] The real-time output-error propagation path coefficients are obtained by performing real-time compensation and updates on the calibration output-error propagation path coefficients.

[0123] The third acquisition unit is specifically used for:

[0124] Acquire the initial feedback signal transmitted in real time by the feedback microphone;

[0125] The initial feedback signal is subjected to bandpass filtering to obtain a preprocessed feedback signal;

[0126] The preprocessed feedback signal is restored to obtain the target feedback signal.

[0127] It should be noted that the audio processing device provided in the above embodiments is only illustrated by the division of the above functional modules when performing audio processing services. In actual applications, the above functions can be assigned to different functional modules as needed, that is, the internal structure of the system can be divided into different functional modules to complete all or part of the functions described above. In addition, the audio processing device and the audio processing method embodiments provided in the above embodiments belong to the same concept, that is, the device is based on the method, and its specific implementation process is detailed in the method embodiments, which will not be repeated here.

[0128] And, such as Figure 5As shown, this embodiment also provides a computer-readable storage medium storing a computer program thereon. When the computer program is executed by a processor, it implements the steps of the audio processing method provided in this embodiment, which can effectively cancel out the user's ambient noise and avoid the influence of ambient noise on the user's hearing of the headphone audio signal.

[0129] Specifically, any combination of one or more computer-readable media may be used. A computer-readable storage medium may be a computer-readable signal medium or a computer-readable storage medium, or any combination thereof. A computer-readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination thereof. More specific examples (a non-exhaustive list) of computer-readable storage media include: an electrical connection having one or more wires, a portable computer disk, a hard disk, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage device, magnetic storage device, or any suitable combination thereof. In this document, a computer-readable storage medium may be any tangible medium that contains or stores a program that may be used by or in connection with an instruction execution system, apparatus, or device.

[0130] Furthermore, this embodiment also provides an electronic device, preferably a bone conduction headphone, which includes:

[0131] An audio receiving device, wherein the audio receiving device is communicatively connected to a target communication terminal to receive the target audio signal emitted by the target communication terminal in real time;

[0132] A feedforward microphone, used to pick up current ambient noise signals;

[0133] One or more processors, each connected to the audio receiving device and the feedforward microphone, respectively, perform the method described in any one of the foregoing audio receiving methods; and

[0134] An air conduction sound-generating device, wherein the air conduction sound-generating device is connected to the one or more processors to receive the first target audio signal and play the corresponding first target audio;

[0135] A bone conduction sound device, the bone conduction sound device being connected to the one or more processors to play a corresponding second target audio.

[0136] All the above-mentioned optional technical solutions can be combined in any way to form the optional embodiments of this application. That is, any number of embodiments can be combined to meet the needs of different application scenarios. All of them are within the protection scope of this application and will not be described in detail here.

[0137] It should be noted that the above description is only a preferred embodiment of this application and is not intended to limit this application. Any modifications, equivalent substitutions, improvements, etc., made within the spirit and principles of this application should be included within the protection scope of this application.

Claims

1. An audio processing method, characterized in that, The method includes: The target audio signal acquired in real time is divided to obtain high-frequency and mid-to-low-frequency signals; The target reference signal is obtained based on the current ambient noise signal transmitted by the feedforward microphone in real time; A real-time control signal is obtained based on the target reference signal acquired in real time and the feedforward control filter coefficients of the feedforward microphone acquired in real time. The feedforward control filter coefficients of the feedforward microphone are updated in real time through the following steps: real-time output-error propagation path coefficients are obtained by updating them in real time based on the pre-acquired calibration output-error propagation path coefficients of the feedback microphone; a target feedback signal is obtained based on the current ambient noise signal transmitted by the feedback microphone acquired in real time; the presence of a sudden change in ambient noise is determined in real time based on the target feedback signal, and the target sudden change suppression coefficient is determined at the current moment according to a preset correspondence between the determination result and the sudden change suppression coefficient; the feedforward control filter coefficients at the current moment are obtained based on the real-time output-error propagation path coefficients, the target sudden change suppression coefficients, and the target feedback signal. The calculation method for the feedforward control filter coefficients is as follows: ； ； in, The coefficients of the feedforward control filter are updated based on its current fitness level, thereby achieving adaptive feedforward control. Here, M represents the normalization coefficients, and M represents the filter order. To update the obtained real-time output - error propagation path coefficients in real time; This is the mutation suppression coefficient. For the error buffer order, For target feedback signals; The current time is the feedforward controller filter coefficient. To prevent the value from diverging to a small value, u represents the step size; The high-frequency signal is fused with the real-time control signal to form a first target audio signal and output to the air conduction sound device so that it can play the corresponding first target audio. At the same time, the mid-low frequency signal is output to the bone conduction sound device so that it can play the corresponding second target audio. The first target audio and the second target audio are played synchronously.

2. The method as described in claim 1, characterized in that, The process of obtaining the target reference signal based on the current ambient noise signal transmitted by the feedforward microphone in real time includes: Acquire the initial reference signal transmitted in real time by the feedforward microphone; The initial reference signal is subjected to bandpass filtering to obtain a preprocessed reference signal; The preprocessed reference signal is restored to obtain the target reference signal.

3. The method as described in claim 2, characterized in that, The step of restoring the preprocessed reference signal to obtain the target reference signal includes: The target reference signal is obtained based on the preprocessed reference signal and the pre-calibrated calibration output-reference transfer path coefficients.

4. The method as described in claim 1, characterized in that, The process of obtaining the target feedback signal based on the current ambient noise signal transmitted by the feedback microphone in real time includes: Acquire the initial feedback signal transmitted in real time by the feedback microphone; The initial feedback signal is subjected to bandpass filtering to obtain a preprocessed feedback signal; The preprocessed feedback signal is restored to obtain the target feedback signal.

5. The method as described in claim 1, characterized in that, The process of obtaining real-time output-error propagation path coefficients by real-time updating based on pre-obtained calibration output-error propagation path coefficients of the feedback microphone includes: Obtain the calibration output-error propagation path coefficient of the feedback microphone; The real-time output-error propagation path coefficients are obtained by performing real-time compensation and updates on the calibration output-error propagation path coefficients.

6. An audio processing device, characterized in that, The device includes: The first acquisition module is used to divide the target audio signal acquired in real time to obtain high-frequency signals and mid-low-frequency signals. The second acquisition module is used to obtain the target reference signal based on the current ambient noise signal transmitted by the feedforward microphone in real time; A real-time control signal acquisition module is used to obtain a real-time control signal based on the real-time acquired target reference signal and the real-time acquired feedforward control filter coefficients of the feedforward microphone; wherein, the feedforward control filter coefficients of the feedforward microphone are updated in real time through the following steps: real-time output-error propagation path coefficients are obtained by updating in real time based on the pre-acquired calibration output-error propagation path coefficients of the feedback microphone; a target feedback signal is obtained based on the real-time acquired current ambient noise signal transmitted by the feedback microphone; the presence of a sudden change in ambient noise is determined in real time based on the target feedback signal, and the target sudden change suppression coefficient is determined at the current moment according to the correspondence between the judgment result and the sudden change suppression coefficient; the feedforward control filter coefficients at the current moment are obtained based on the real-time output-error propagation path coefficients, the target sudden change suppression coefficients, and the target feedback signal at the current moment. The calculation method for the feedforward control filter coefficients is as follows: ； ； in, The coefficients of the feedforward control filter are updated based on its current fitness level, thereby achieving adaptive feedforward control. Here, M represents the normalization coefficients, and M represents the filter order. To update the obtained real-time output - error propagation path coefficients in real time; This is the mutation suppression coefficient. For the error buffer order, For target feedback signal; The current time is the feedforward controller filter coefficient. To prevent the value from diverging to a small value, u represents the step size; The processing module is used to fuse the high-frequency signal with the real-time control signal and output it to the air conduction sound generator to play and form a first target audio, and to output the mid-low frequency signal simultaneously to the bone conduction sound generator to play and form a second target audio.

7. The apparatus as claimed in claim 6, characterized in that, The second acquisition module includes: The first acquisition unit is used to acquire the initial reference signal transmitted in real time by the feedforward microphone; The second acquisition unit is used to perform bandpass filtering on the initial reference signal to obtain a preprocessed reference signal; The restoration unit is used to restore the preprocessed reference signal to obtain the target reference signal.

8. A computer-readable storage medium having a computer program stored thereon, characterized in that, When the computer program is executed by one or more processors, it implements the steps of the audio processing method as described in any one of claims 1 to 5.

9. An electronic device, characterized in that, include: An audio receiving device, wherein the audio receiving device is communicatively connected to a target communication terminal to receive the target audio signal emitted by the target communication terminal in real time; A feedforward microphone, the feedforward microphone being used to pick up current ambient noise signals; One or more processors, each connected to the audio receiving device and the feedforward microphone, respectively, perform the method as described in any one of claims 1 to 5; and An air conduction sound generating device, wherein the air conduction sound generating device is connected to the one or more processors to receive the first target audio signal and play the corresponding first target audio; A bone conduction sound device, the bone conduction sound device being connected to the one or more processors to play a corresponding second target audio.

Images