Audio signal processing method and system for echo suppression

Abstract

The audio signal processing method and system for suppressing echo provided in this specification controls the selection of the target audio processing mode according to the speaker signal strength. The method and system generate a corresponding control signal according to the speaker signal strength, and control the target audio processing mode according to the control signal, and perform signal processing on the microphone signal to obtain better voice quality. When the speaker signal does not exceed the threshold, the system selects the first mode, and performs signal processing on the first audio signal and the second audio signal to obtain the first target audio. When the speaker signal exceeds the threshold, the system selects the second mode, and performs signal processing on the second audio signal to obtain the second target audio. The method and system can switch the target audio processing mode according to the speaker signal, ensuring better voice quality in different scenarios and improving the quality of voice communication.

Description

Technical Field

[0001] The present specification relates to the field of audio signal processing, and in particular to an audio signal processing method and system for suppressing echo. Background Art

[0002] At present, vibration sensors are used in electronic products such as headphones, and more and more applications are being used as bone conduction microphones to receive voice signals. When people speak, they will cause vibrations in bones and skin at the same time. These vibrations are bone-conducted voice signals, which can be picked up by bone conduction microphones to generate signals. The system converts the vibration signals collected by the bone conduction microphone into electrical signals or other types of signals, and transmits them to electronic devices to achieve the sound pickup function. At present, more and more electronic devices combine air conduction microphones with different characteristics with bone conduction microphones, use air conduction microphones to pick up external audio signals, use bone conduction microphones to pick up vibration signals of the vocal part, and perform voice enhancement processing and fusion on the picked-up signals. When the bone conduction microphone is placed in headphones or other electronic devices with speakers, the bone conduction microphone can not only receive the vibration signals when people speak, but also receive the vibration signals generated by the speakers of headphones or other electronic devices when playing sounds, thereby generating echo signals. At this time, it is necessary to process it with an echo cancellation algorithm. Different echo signals of the speakers will also affect the voice quality of the microphone. For example, when the speaker input signal is strong, the speaker vibration signal received by the bone conduction microphone is larger, which is much larger than the vibration signal generated by a person speaking. At this time, the traditional echo cancellation algorithm is difficult to eliminate the echo in the bone conduction microphone. At this time, the microphone signals output by the air conduction microphone and the bone conduction microphone as the sound source signal have poor voice quality. Therefore, it is unreasonable not to consider the speaker echo signal when selecting the microphone sound source signal.

[0003] Therefore, it is necessary to provide a new audio signal processing method and system for suppressing echo, so as to switch the input sound source signal according to different speaker input signals, improve the effect of echo cancellation, and enhance the voice quality. Summary of the invention

[0004] The present specification provides a new audio signal processing method and system for suppressing echo, so as to improve the effect of echo cancellation and enhance the voice quality.

[0005] In a first aspect, the present specification provides an audio signal processing method for suppressing echo, comprising: selecting a target audio processing mode of an electronic device from a first mode and a second mode based at least on a speaker signal, the speaker signal being an audio signal sent by a control device to the electronic device; processing a microphone signal by the target audio processing mode to generate a target audio, to at least reduce the echo in the target audio, the microphone signal being an output signal of a microphone module acquired by the electronic device, the microphone module comprising at least one first type microphone and at least one second type microphone, wherein the first mode comprises signal processing a first audio signal output by the at least one first type microphone and a second audio signal output by the at least one second type microphone, and the second mode comprises signal processing the second audio signal; and outputting the target audio.

[0006] In some embodiments, selecting a target audio processing mode of an electronic device from a first mode and a second mode based at least on a speaker signal includes: generating a control signal corresponding to the speaker signal based at least on the intensity of the speaker signal, the control signal including a first control signal or a second control signal; and selecting a target audio processing mode corresponding to the control signal based on the control signal, wherein the first mode corresponds to the first control signal and the second mode corresponds to the second control signal.

[0007] In some embodiments, generating a control signal corresponding to the speaker signal at least based on the strength of the speaker signal includes: determining that the strength of the speaker signal is lower than a preset speaker threshold, generating the first control signal; or determining that the strength of the speaker signal is higher than the speaker threshold, generating the second control signal.

[0008] In some embodiments, generating a control signal corresponding to the speaker signal based at least on the strength of the speaker signal includes: generating a corresponding control signal based on the strength of the speaker signal and the microphone signal.

[0009] In some embodiments, generating a corresponding control signal based on the strength of the speaker signal and the microphone signal includes: obtaining evaluation parameters of the microphone signal, the evaluation parameters including environmental noise evaluation parameters, the environmental noise evaluation parameters including at least one of environmental noise level and signal-to-noise ratio; and generating the control signal based on the strength of the speaker signal and the evaluation parameters.

[0010] In some embodiments, the control signal is generated based on the strength of the speaker signal and the evaluation parameter, including one of the following situations: determining that the strength of the speaker signal is higher than a preset speaker threshold, generating the second control signal; determining that the strength of the speaker signal is lower than the speaker threshold and the environmental noise evaluation parameter is outside the noise evaluation range, generating the first control signal; and determining that the strength of the speaker signal is lower than the speaker threshold and the environmental noise evaluation parameter is within the noise evaluation range, generating the first control signal or the second control signal.

[0011] In some embodiments, the environmental noise evaluation parameter is within the noise evaluation range, including at least one of the following situations: the environmental noise level is lower than a preset environmental noise threshold; and the signal-to-noise ratio is higher than a preset signal-to-noise ratio threshold.

[0012] In some embodiments, the evaluation parameter also includes the strength of a human voice signal, and the control signal is generated based on the strength of the speaker signal and the evaluation parameter, including one of the following situations: determining that the strength of the speaker signal is higher than a preset speaker threshold, and the strength of the human voice signal exceeds the preset human voice threshold, and the environmental noise evaluation parameter is outside the preset noise evaluation range, and the first control signal is generated; determining that the strength of the speaker signal is higher than the speaker threshold, and the strength of the human voice signal exceeds the human voice threshold, and the environmental noise evaluation parameter is within the preset noise evaluation range, and the second control signal is generated; determining that the strength of the speaker signal is higher than the speaker threshold, and the strength of the human voice signal is lower than the human voice threshold, and the second control signal is generated; determining that the strength of the speaker signal is lower than the speaker threshold, and the environmental noise evaluation parameter is outside the noise evaluation range, and the first control signal is generated; and determining that the strength of the speaker signal is lower than the speaker threshold, and the environmental noise evaluation parameter is within the noise evaluation range, and the first control signal or the second control signal is generated.

[0013] In some embodiments, the environmental noise evaluation parameter is within the noise evaluation range, including at least one of the following situations: the environmental noise level is lower than a preset environmental noise threshold; and the signal-to-noise ratio is higher than a preset signal-to-noise ratio threshold.

[0014] In some embodiments, generating the target audio includes: performing signal processing on the first audio signal and the second audio signal through a first algorithm in the first mode to generate a first target audio; or performing signal processing on the second audio signal through a second algorithm in the second mode to generate a second target audio, wherein the target audio includes one of the first target audio and the second target audio.

[0015] In some embodiments, outputting the target audio includes: smoothing the target audio, and when the target audio switches between the first target audio and the second target audio, performing the smoothing process on the connection between the first target audio and the second target audio; and outputting the target audio after the smoothing process.

[0016] In some embodiments, the method further comprises: controlling the strength of a speaker input signal of the speaker based on the control signal.

[0017] In some embodiments, controlling the strength of the speaker input signal of the speaker based on the control signal includes: determining that the control signal is the first control signal, reducing the strength of the speaker input signal input to the speaker, thereby reducing the strength of the sound output by the speaker.

[0018] In some embodiments, the at least one first type microphone is used to collect human body vibration signals; and the at least one second type microphone is used to collect air vibration signals.

[0019] In a second aspect, the present specification also provides a system for audio signal processing for echo suppression, comprising: at least one storage medium and at least one processor, the at least one storage medium storing at least one instruction set for audio signal processing for echo suppression; the at least one processor being communicatively connected to the at least one storage medium, wherein when the system is running, the at least one processor reads the at least one instruction set and executes the method for audio signal processing for echo suppression described in the first aspect of the present specification according to the instructions of the at least one instruction set.

[0020] It can be seen from the above technical solutions that the audio signal processing method and system for suppressing echo provided in this specification can generate a control signal corresponding to the speaker signal according to the strength of the speaker signal, and control or switch the audio processing mode according to the control signal, so as to perform signal processing on the sound source signal corresponding to the audio processing mode to obtain better voice quality. When the speaker signal does not exceed the threshold, the system generates a first control signal, selects a first mode, and uses the first audio signal and the second audio signal as the first sound source signal to perform signal processing on the first sound source signal to obtain the first target audio. When the speaker signal exceeds the threshold, the speaker echo in the first audio signal is large. At this time, the system generates a second control signal, selects a second mode, and uses the second audio signal as the second sound source signal to perform signal processing on the second sound source signal to obtain the second target audio. The method and system can switch different audio processing modes according to the speaker signal, thereby switching the sound source signal of the microphone signal to improve the voice quality and ensure that better voice quality can be obtained in different scenarios.

[0021] Other functions of the audio signal processing method and system for suppressing echo provided in this specification will be partially listed in the following description. Based on the description, the contents introduced by the following figures and examples will be obvious to those of ordinary skill in the art. The creative aspects of the audio signal processing method and system for suppressing echo provided in this specification can be fully explained by practicing or using the methods, devices and combinations described in the following detailed examples. BRIEF DESCRIPTION OF THE DRAWINGS

[0022] In order to more clearly illustrate the technical solutions in the embodiments of this specification, the drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of this specification. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.

[0023] Figure 1 A schematic diagram showing some application scenarios of an audio signal processing system for suppressing echo provided according to an embodiment of this specification;

[0024] Figure 2 Shown are device schematic diagrams of some electronic devices provided according to embodiments of this specification;

[0025] Figure 3 Some first mode operation schematic diagrams provided according to the embodiments of this specification are shown;

[0026] Figure 4 Some schematic diagrams of the operation of the second mode provided according to the embodiments of this specification are shown;

[0027] Figure 5 A flowchart of some audio signal processing methods for suppressing echo provided according to an embodiment of this specification is shown;

[0028] Figure 6 A flowchart of some audio signal processing methods for suppressing echo provided according to an embodiment of this specification is shown; and

[0029] Figure 7 Some flow charts of audio signal processing methods for suppressing echo provided according to the embodiments of this specification are shown. DETAILED DESCRIPTION

[0030] The following description provides specific application scenarios and requirements of this specification, with the purpose of enabling those skilled in the art to make and use the contents of this specification. Various local modifications to the disclosed embodiments will be apparent to those skilled in the art, and the general principles defined herein may be applied to other embodiments and applications without departing from the spirit and scope of this specification. Therefore, this specification is not limited to the embodiments shown, but to the widest scope consistent with the claims.

[0031] The terms used herein are only used for the purpose of describing specific example embodiments and are not restrictive. For example, unless the context clearly indicates otherwise, as used herein, the singular forms "a", "an" and "the" may also include plural forms. When used in this specification, the terms "include", "comprise" and / or "contain" mean that the associated integers, steps, operations, elements and / or components exist, but do not exclude the existence of one or more other features, integers, steps, operations, elements, components and / or groups or that other features, integers, steps, operations, elements, components and / or groups may be added in the system / method.

[0032] In view of the following description, these and other features of the present specification, as well as the operation and function of the related elements of the structure, and the economy of the combination and manufacture of the parts can be significantly improved. Reference is made to the accompanying drawings, all of which form a part of this specification. However, it should be clearly understood that the drawings are for illustration and description purposes only and are not intended to limit the scope of this specification. It should also be understood that the drawings are not drawn to scale.

[0033] The flowcharts used in this specification illustrate the operations implemented by the system according to some embodiments in this specification. It should be clearly understood that the operations of the flowcharts may not be implemented in sequence. On the contrary, the operations may be implemented in reverse order or simultaneously. In addition, one or more other operations may be added to the flowchart. One or more operations may be removed from the flowchart.

[0034] Figure 1The following is a schematic diagram showing some application scenarios of an audio signal processing system 100 (hereinafter referred to as system 100 ) for suppressing echo according to an embodiment of the present specification. The system 100 may include an electronic device 200 and a control device 400 .

[0035] The electronic device 200 may store data or instructions for executing the method for audio signal processing for echo suppression described in this specification, and may execute the data and / or instructions. In some embodiments, the electronic device 200 may be a wireless headset, a wired headset, a smart wearable device, such as a device with voice collection function and voice playback function such as smart glasses, a smart helmet or a smart watch. The electronic device 200 may also be a mobile device, a tablet computer, a laptop computer, a built-in device of a motor vehicle, or the like, or any combination thereof. In some embodiments, the mobile device may include a smart home device, a smart mobile device or the like, or any combination thereof. For example, the smart mobile device may include a mobile phone, a personal digital assistant, a gaming device, a navigation device, an ultra-mobile personal computer (UMPC), etc., or any combination thereof. In some embodiments, the smart home device may include a smart TV, a desktop computer, etc., or any combination thereof. In some embodiments, the built-in device in a motor vehicle may include an onboard computer, an onboard TV, etc.

[0036] The control device 400 may be a remote device that communicates with the electronic device 200 via wired and / or wireless audio signals. The control device 400 may also be a device that is locally connected to the electronic device 200 for communication. The electronic device 200 may collect local audio signals and output them to the control device 400. The electronic device 200 may also receive and output remote audio signals sent by the control device 400. The remote audio signal may also be referred to as a speaker signal. The control device 400 may also be a device having a voice collection function and a voice playback function. For example, a mobile phone, a tablet computer, a laptop computer, a headset, a smart wearable device, a built-in device of a motor vehicle or the like, or any combination thereof. For example, when the electronic device 200 is a headset, the control device 400 may be a terminal device that is connected to the headset for communication, such as a mobile phone, a computer, and the like.

[0037] like Figure 1As shown, the electronic device 200 may include a microphone module 240 and a speaker 280. The microphone module 240 may be configured to obtain a local audio signal and output a microphone signal, that is, an electronic signal carrying audio information. The microphone module 240 may be an external ear microphone module or an internal ear microphone module. For example, the microphone module 240 may be a microphone disposed outside the ear canal or a microphone disposed inside the ear canal. The microphone module 240 may include at least one first type microphone 242 and at least one second type microphone 244. The first type microphone 242 is different from the second type microphone 244. The first type microphone 242 may be a microphone that directly collects human body vibration signals, such as a bone conduction microphone. The second type microphone 244 may be a microphone that directly collects air vibration signals, such as an air conduction microphone. Of course, the first type microphone 242 and the second type microphone 244 may also be other types of microphones. For example, the first type microphone 242 may be an optical microphone; the second type microphone 244 may be a microphone that receives electromyographic signals, and so on. Since the first type of microphone 242 is different from the second type of microphone 244, the performance of perceiving the audio signal will be different, resulting in different noise and echo components in the corresponding audio signal. For the convenience of demonstration, the present disclosure will use a bone conduction microphone as an example of the first type of microphone 242 and an air conduction microphone as an example of the second type of microphone 244 in the following statements.

[0038] The bone conduction microphone may include a vibration sensor, such as an optical vibration sensor, an acceleration sensor, etc. The vibration sensor may collect mechanical vibration signals (for example, signals generated by the vibration of the skin or bones when the user 002 speaks), and convert the mechanical vibration signals into electrical signals. The mechanical vibration signals mentioned here mainly refer to vibrations propagated through solids. The bone conduction microphone contacts the skin or bones of the user 002 through the vibration sensor or a vibration component connected to the vibration sensor, thereby collecting vibration signals generated by the bones or skin of the user 002 when the sound is emitted, and converting the vibration signals into electrical signals. In some embodiments, the vibration sensor may be a device that is sensitive to mechanical vibrations but insensitive to air vibrations (that is, the response capability of the vibration sensor to mechanical vibrations exceeds the response capability of the vibration sensor to air vibrations). Since the bone conduction microphone can directly pick up the vibration signal of the vocal part, the bone conduction microphone can reduce the impact of environmental noise.

[0039] The air conduction microphone collects the air vibration signal caused by the user 002 when making a sound, and converts the air vibration signal into an electrical signal. The air conduction microphone can be a single air conduction microphone, or a microphone array composed of two or more air conduction microphones. The microphone array can be a beamforming microphone array or other similar microphone arrays. The microphone array can collect sounds from different directions or different positions in space.

[0040] The first type of microphone 242 can output a first audio signal 243. The second type of microphone 244 can output a second audio signal 245. The microphone signal includes the first audio signal 243 and the second audio signal 245. In a low-noise scenario, the second audio signal 245 has better voice quality than the first audio signal 243. In a scenario with high ambient noise, the voice quality of the first audio signal 243 is higher in the low-frequency part, and the voice quality of the second audio signal 245 is higher in the high-frequency part. Therefore, in a scenario with high ambient noise, the audio signal obtained by feature fusion of the first audio signal 243 and the second audio signal 245 has good voice quality. In actual use, the ambient noise may change at any time, and the low-noise scenario and the high-noise scenario may be repeatedly switched.

[0041] The speaker 280 can convert an electrical signal into an audio signal. The speaker 280 can be configured to receive and output the speaker signal from the control device 400. For the convenience of description, we define the audio signal input to the speaker 280 as a speaker input signal. In some embodiments, the speaker input signal can be the speaker signal. In some embodiments, the electronic device 200 can perform signal processing on the speaker signal and send the audio signal after signal processing to the speaker 280 for output. At this time, the speaker input signal can be an audio signal obtained after the electronic device 200 performs signal processing on the speaker signal.

[0042] The sound of the speaker input signal output by the speaker 280 can be transmitted to the user 002 by air conduction or bone conduction. The speaker 280 can be a speaker that transmits a vibration signal to the human body to transmit sound, such as a bone conduction speaker, or a speaker that transmits a vibration signal through the air, such as an air conduction speaker. The bone conduction speaker generates mechanical vibrations through a vibration module, and transmits the mechanical vibrations to the ear through the bone. For example, the speaker 280 can contact the head of the user 002 directly or through a specific medium (for example, one or more panels), and transmit the audio signal to the user's auditory nerve by means of skull vibration. The air conduction speaker generates vibrations in the air through a vibration module, and transmits the air vibrations to the ear through the air. The speaker 280 can also be a combination of a bone conduction speaker and an air conduction speaker. The speaker 280 can also be other types of speakers. The sound of the speaker input signal output by the speaker 280 may be collected by the microphone module 240 to form an echo. The greater the strength of the speaker input signal, the greater the sound intensity output by the speaker 280, and the stronger the echo signal.

[0043] It should be noted that the microphone module 240 and the speaker 280 may be integrated into the electronic device 200 , or may be external devices of the electronic device 200 .

[0044] When the first type microphone 242 and the second type microphone 244 are working, they can not only collect the sound emitted by the user 002, but also collect the environmental noise and the sound emitted by the speaker 280. The electronic device 200 can collect audio signals and generate the microphone signal through the microphone module 240. The microphone signal may include a first audio signal 243 and a second audio signal 245. In different scenarios, the voice quality of the first audio signal 243 and the second audio signal 245 is different. In order to ensure the quality of voice communication, the electronic device 200 can select a target audio processing mode from a plurality of audio processing modes according to different application scenarios, so as to select an audio signal with better voice quality from the microphone signal as the sound source signal, and output the sound source signal to the control device 400 after signal processing by the target audio processing mode. The sound source signal may be an input signal of the target audio processing mode. In some embodiments, the signal processing may include noise suppression to reduce the noise signal. In some embodiments, the signal processing may include echo suppression to reduce the echo signal. In some embodiments, the signal processing may include both the noise suppression and the echo suppression. In some embodiments, the signal processing may also directly output the sound source signal. For the convenience of illustration, in the following description, we will describe the signal processing including the echo suppression. Those skilled in the art should understand that other signal processing methods are within the protection scope of this specification.

[0045] The selection of the target audio processing mode by the electronic device 200 is related to the speaker signal in addition to the environmental noise. In some scenarios, for example, when the speaker signal is small and the sound output by the speaker 280 is also small, the voice quality of the audio signal after the feature fusion of the first audio signal 243 output by the first type microphone 242 and the second audio signal 245 output by the second type microphone 244 is better than the voice quality of the second audio signal 245 output by the second type microphone 244.

[0046] In some special scenarios, such as when the speaker signal is large and the sound output by the speaker 280 is also large, the first audio signal 243 output by the first type microphone 242 is greatly affected, resulting in a large echo in the first audio signal 243. In some embodiments, the echo signal in the first audio signal 243 will exceed the voice signal of the user 002. In particular, when the speaker 280 is a bone conduction speaker, the echo signal in the first audio signal 243 is more obvious. Traditional echo cancellation algorithms are difficult to eliminate the echo signal in the first audio signal 243, and the effect of echo cancellation cannot be guaranteed. At this time, the voice quality of the second audio signal 245 output by the second type microphone 244 is better than the voice quality of the audio signal after the first audio signal 243 output by the first type microphone 242 and the second audio signal 245 output by the second type microphone 244 are feature fused.

[0047] Therefore, the electronic device 200 can select the target audio processing mode from the plurality of audio processing modes based on the speaker signal to perform the signal processing on the microphone signal. The plurality of audio processing modes can include at least a first mode 1 and a second mode 2.

[0048] The first mode 1 can perform signal processing on the first audio signal 243 and the second audio signal 245. As mentioned above, in some embodiments, the signal processing may include noise suppression to reduce the noise signal. In some embodiments, the signal processing may include echo suppression to reduce the echo signal. In some embodiments, the signal processing may include both the noise suppression and the echo suppression. For ease of presentation, in the following description, we will describe the signal processing including the echo suppression. Those skilled in the art should understand that other signal processing methods are within the scope of protection of this specification.

[0049] The second mode 2 can perform signal processing on the second audio signal 245. In some embodiments, the signal processing can include noise suppression to reduce the noise signal. In some embodiments, the signal processing can include echo suppression to reduce the echo signal. In some embodiments, the signal processing can include both the noise suppression and the echo suppression. For the convenience of presentation, in the following description, we will describe the signal processing including the echo suppression. Those skilled in the art should understand that other signal processing methods are within the scope of protection of this specification.

[0050] The target audio processing mode is one of the first mode 1 and the second mode 2. The plurality of audio processing modes may further include other modes, for example, a processing mode for performing signal processing on the first audio signal 243 .

[0051] Therefore, when the speaker signal is small, in order to ensure that the voice used for voice communication has a high quality, the electronic device 200 selects the first mode 1, uses the first audio signal 243 and the second audio signal 245 as the sound source signal, performs signal processing on the sound source signal, generates and outputs the first target audio 291, and applies it to voice communication. When the speaker signal is large, in order to ensure that the voice used for voice communication has a high quality, the electronic device 200 selects the second mode 2, uses the second audio signal 245 as the sound source signal, performs signal processing on the sound source signal, generates and outputs the second target audio 292, and applies it to voice communication.

[0052] The electronic device 200 can execute the data or instructions of the method for audio signal processing for suppressing echo described in this specification, obtain the microphone signal and the speaker signal; the electronic device 200 can select the corresponding target audio processing mode to perform signal processing on the microphone signal based on the signal strength of the speaker signal. Specifically, the electronic device 200 can select the target audio processing mode corresponding to the speaker signal strength from a plurality of audio processing modes according to the strength of the speaker signal, select an audio signal with better voice quality or a combination thereof from the first audio signal 243 and the second audio signal 245 as the sound source signal, and use the corresponding signal processing algorithm to perform signal processing on the sound source signal (such as echo cancellation and noise reduction processing), generate a target audio and output it to reduce the echo in the target audio. The target audio may include one of the first target audio 291 and the second target audio 292. The electronic device 200 can output the target audio to the control device 400.

[0053] To sum up, in order to ensure the voice quality of communication, the electronic device 200 can control and select the target audio processing mode based on the strength of the speaker signal, thereby selecting an audio signal with better voice quality as the sound source signal of the electronic device 200, and performing signal processing on the sound source signal to obtain different target audios for different usage scenarios, thereby ensuring that the voice quality of the target audio is optimal in different usage scenarios.

[0054] Figure 2 2 shows a schematic diagram of an electronic device 200. The electronic device 200 can execute the method for audio signal processing for echo suppression described in this specification. The method for audio signal processing for echo suppression is introduced in other parts of this specification. For example, in Figures 5 to 7 The method for audio signal processing for echo suppression is introduced in the description.

[0055] like Figure 2As shown, the electronic device 200 may include a microphone module 240 and a speaker 280. In some embodiments, the electronic device 200 may further include at least one storage medium 230 and at least one processor 220.

[0056] The storage medium 230 may include a data storage device. The data storage device may be a non-temporary storage medium or a temporary storage medium. For example, the data storage device may include one or more of a disk, a read-only storage medium (ROM), or a random access storage medium (RAM). The storage medium 230 also includes at least one instruction set stored in the data storage device for audio signal processing for echo suppression. The instruction is a computer program code, and the computer program code may include a program, a routine, an object, a component, a data structure, a process, a module, etc. for executing the method for audio signal processing for echo suppression provided in this specification.

[0057] like Figure 2 As shown, the at least one instruction set may include a control instruction, which is issued by the control module 231 and is configured to generate a control signal corresponding to the speaker signal based on the speaker signal or the speaker signal and the microphone signal. The control signal includes a first control signal or a second control signal. Among them, the first control signal corresponds to the first mode 1. The second control signal corresponds to the second mode 2. The control signal can be any signal, for example, the first control signal can be signal 1, the second control signal can be signal 2, and so on. The control instruction issued by the control module 231 can generate a corresponding control signal according to the signal strength of the speaker signal or the signal strength of the speaker signal and the evaluation parameter of the microphone signal. The corresponding relationship between the control signal and the speaker signal or the speaker signal and the microphone signal will be described in detail in the following description. The control module 231 can also select a target audio signal processing mode corresponding to the control signal according to the control signal. When the control signal is the first control signal, the control module 231 selects the first mode 1; when the control signal is the second control signal, the control module 231 selects the second mode 2.

[0058] In some embodiments, the at least one instruction set may also include an echo processing instruction, which is issued by the echo processing module 233 and is configured to perform signal processing (such as echo suppression, noise reduction processing, etc.) on the microphone signal through the target audio processing mode of the electronic device 200 based on the control signal. When the control signal is the first control signal, the echo processing module 233 uses the first mode 1 to perform signal processing on the microphone signal. When the control signal is the second control signal, the echo processing module 233 uses the second mode 2 to perform signal processing on the microphone signal.

[0059] The echo processing module 233 may include a first algorithm 233-1 and a second algorithm 233-8. The first algorithm 233-1 corresponds to the first control signal and the first mode 1. The second algorithm 233-8 corresponds to the second control signal and the second mode 2.

[0060] In the first mode 1, the electronic device 200 uses the first algorithm 233-1 to perform signal processing on the first audio signal 243 and the second audio signal 245 respectively, and performs feature fusion on the first audio signal 243 and the second audio signal 245 after the signal processing, and outputs the first target audio 291.

[0061] Figure 3 FIG. 2 shows a working schematic diagram of a first mode 1 provided according to an embodiment of this specification. Figure 3 As shown, in the first mode 1, the first algorithm 233-1 can receive the first audio signal 243 and the second audio signal 245 and the speaker input signal. The first algorithm 233-1 can use the first echo cancellation module 233-2 to perform echo cancellation on the first audio signal 243 based on the speaker input signal. The speaker input signal can be an audio signal after noise reduction processing. The first echo cancellation module 233-2 receives the first audio signal 243 and the speaker input signal, and outputs the first audio signal 243 after echo cancellation. The first echo cancellation module 233-2 can be a single-microphone echo cancellation algorithm.

[0062] In some embodiments, the first algorithm 233-1 may use a second echo cancellation module 233-3 to perform echo cancellation on the second audio signal 245 based on the speaker input signal. The second echo cancellation module 233-3 receives the second audio signal 245 and the speaker input signal, and outputs the second audio signal 245 after the echo is cancelled. The second echo cancellation module 233-3 may be a single-microphone echo cancellation algorithm or a multi-microphone echo cancellation algorithm. The first echo cancellation module 233-2 and the second echo cancellation module 233-3 may be the same or different.

[0063] In some embodiments, the first algorithm 233-1 may use a first noise suppression module 233-4 to perform noise suppression on the first audio signal 243 and the second audio signal 245 after echo cancellation. The first noise suppression module 233-4 is used to suppress noise signals in the first audio signal 243 and the second audio signal 245. The first noise suppression module 233-4 receives the first audio signal 243 and the second audio signal 245 after echo cancellation, and outputs the first audio signal 243 and the second audio signal 245 after noise cancellation. The first noise suppression module 233-4 may perform noise reduction on the first audio signal 243 and the second audio signal 245 separately, or may perform noise reduction on the first audio signal 243 and the second audio signal 245 simultaneously.

[0064] In some embodiments, the first algorithm 233-1 can use a feature fusion module 233-5 to perform feature fusion processing on the first audio signal 243 and the second audio signal 245 that have been subjected to noise suppression. The feature fusion module 233-5 receives the first audio signal 243 and the second audio signal 245 that have been subjected to noise reduction processing. The feature fusion module 233-5 can analyze the voice quality of the first audio signal 243 and the second audio signal 245. For example, the feature fusion module 233-5 can analyze the effective voice signal strength, noise signal strength, echo signal strength, and signal-to-noise ratio in the first audio signal 243 and the second audio signal 245, determine the voice quality of the first audio signal 243 and the second audio signal 245, and fuse the first audio signal 243 and the second audio signal 245 into the first target audio 291 and output it.

[0065] In some embodiments, the first algorithm 233-1 may also use a second noise suppression module 233-6 to perform noise suppression on the speaker signal. The second noise suppression module 233-6 is used to suppress the noise signal in the speaker signal. The second noise suppression module 233-6 receives the speaker signal sent by the control device 400, eliminates noise signals such as far-end noise, channel noise, and electronic noise in the electronic device 200 in the speaker signal, and outputs a speaker processing signal after noise reduction processing.

[0066] It should be noted that Figure 3It is just an exemplary description. Those skilled in the art should understand that in some embodiments, the first algorithm 233-1 may include a feature fusion module 233-5. In other embodiments, the first algorithm 233-2 may also include any one of a first echo cancellation module 233-2, a second echo cancellation module 233-3, a first noise suppression module 233-4, and a second noise suppression module 233-6, or any combination thereof.

[0067] In the second mode 2 , the electronic device 200 uses the second algorithm 233 - 8 to perform signal processing on the second audio signal 245 , and outputs the second target audio 292 .

[0068] Figure 4 FIG. 2 shows a working schematic diagram of a second mode 2 provided according to an embodiment of this specification. Figure 4 As shown, in the second mode 2, the second algorithm 233-8 can receive the second audio signal 245 and the speaker input signal. The second algorithm 233-8 can use the third echo cancellation module 233-9 to perform echo cancellation on the second audio signal 245 based on the speaker input signal. The third echo cancellation module 233-9 receives the second audio signal 245 and the speaker input signal, and outputs the second audio signal 245 after the echo is cancelled. The third echo cancellation module 233-9 can be the same as the second echo cancellation module 233-3, or it can be different.

[0069] In some embodiments, the second algorithm 233-8 may use a third noise suppression module 233-10 to perform noise suppression on the echo-removed second audio signal 245. The third noise suppression module 233-10 is used to suppress the noise signal in the second audio signal 245. The third noise suppression module 233-10 receives the echo-removed second audio signal 245 and outputs the noise-reduced second audio signal 245 as the second target audio 292. The third noise suppression module 233-10 may be the same as or different from the first noise suppression module 233-4.

[0070] In some embodiments, the second algorithm 233-8 may also use a fourth noise suppression module 233-11 to perform noise suppression on the speaker signal. The fourth noise suppression module 233-11 is used to suppress the noise signal in the speaker signal. The fourth noise suppression module 233-11 receives the speaker signal sent by the control device 400, eliminates noise signals such as far-end noise, channel noise and electronic noise in the electronic device 200 in the speaker signal, and outputs a speaker processing signal after noise reduction processing. The fourth noise suppression module 233-11 may be the same as the second noise suppression module 233-6, or may be different.

[0071] It should be noted that Figure 4 This is just an exemplary description. Those skilled in the art should understand that in some embodiments, the second algorithm 233-8 may include any one of the third echo cancellation module 233-9, the third noise suppression module 233-10 and the fourth noise suppression module 233-11 or any combination thereof. In other embodiments, the second algorithm 233-8 may also not include any of the above signal processing modules and directly output the second audio signal 245.

[0072] Only one of the first mode 1 and the second mode 2 can be run to save computing resources. When the first mode 1 is running, the second mode 2 can be turned off. When the second mode 2 is running, the first mode 1 can be turned off. The first mode 1 and the second mode 2 can also be run at the same time. When one mode is running, the other mode can update the algorithm parameters. When the electronic device 200 switches between the first mode 1 and the second mode 2, some parameters in the first mode 1 and the second mode 2 can be shared (such as noise parameters obtained by the noise estimation algorithm, human voice parameters obtained by the human voice estimation algorithm, signal-to-noise ratio parameters obtained by the signal-to-noise ratio algorithm, etc.), thereby saving computing resources and making the calculation results more accurate. The first algorithm 233-1 and the second algorithm 233-8 in the first mode 1 and the second mode 2 can also be shared with some parameters in the control instruction issued by the control module 231, such as noise parameters obtained by the noise estimation algorithm, human voice parameters obtained by the human voice estimation algorithm, signal-to-noise ratio parameters obtained by the signal-to-noise ratio algorithm, etc., thereby saving computing resources and making the calculation results more accurate.

[0073] In some embodiments, the at least one instruction set may also include a microphone control instruction, which is executed by the microphone control module 235 and is configured to smooth the target audio and output the target audio after smoothing to the control device 400. The microphone control module 235 may receive the control signal generated by the control module 231 and the target audio, and perform the smoothing on the target audio based on the control signal. When the control signal is the first control signal, the first mode 1 is run, and the first target audio 291 output by the first algorithm 233-1 is used as the input signal; when the control signal is the second control signal, the second mode 2 is run, and the second target audio 292 output by the second algorithm 233-8 is used as the input signal. When the control signal switches between the first control signal and the second control signal, causing the target audio processing mode to switch between the first mode 1 and the second mode 2, in order to avoid the discontinuity of the signal caused by the switching of the first target audio 291 and the second target audio 292, the microphone control module 235 may smooth the target audio. Specifically, the microphone control module 235 can adjust the parameters of the first target audio 291 and the first target audio 291 to make the target audio continuous. The parameters can be pre-stored in the at least one storage medium 230. The parameters can be amplitude, phase, frequency response, etc. The content of the adjustment can include adjustment of the volume of the target audio, adjustment of EQ balance, adjustment of residual noise, etc. The microphone control module 235 can make the target audio a continuous signal when the target audio processing mode is switched between the first mode 1 and the second mode 2, so that the user 002 is not easily aware of the switching between the two.

[0074] In some embodiments, the at least one instruction set may also include a speaker control instruction, which is executed by the speaker control module 237 and is configured to adjust the speaker processing signal to obtain the speaker input signal, and output the speaker input signal to the speaker 280 to output the sound. The speaker control module 237 may receive the speaker processing signal and the control signal output by the first algorithm 233-1 and the second algorithm 233-8. When the control signal is the first control signal, the speaker control module 237 may control the speaker processing signal output by the first algorithm 233-1 to reduce or turn it off before outputting it to the speaker 280 for output, so as to reduce the sound output by the speaker 280, thereby reducing the echo and improving the echo cancellation effect of the first algorithm 233-1. When the control signal is the second control signal, the speaker control module 237 may not adjust the speaker processing signal output by the second algorithm 233-8. When the control signal switches between the first control signal and the second control signal, in order to avoid discontinuity of the sound output by the speaker 280, the speaker control module 237 can smooth the speaker processing signals output by the first algorithm 233-1 and the second algorithm 233-8. When switching between the first control signal and the second control signal, the speaker control module 237 tries to ensure the continuity of the switching so that the user 002 is not easily aware of the switching between the two.

[0075] In the first mode 1, the first algorithm 233-1 focuses on the voice quality of the user 002 picked up by the near-end microphone module 240. When the speaker processing signal is too large, the speaker processing signal is processed by the speaker control module 237 to reduce the speaker input signal, thereby reducing the sound output by the speaker 280 to reduce the echo and ensure the near-end voice quality. The second algorithm 233-8 focuses on the speaker input signal of the speaker 280, and does not use the first audio signal 243 output by the first type microphone 242 to ensure the voice quality and intelligibility of the speaker input signal of the speaker 280.

[0076] At least one processor 220 can be connected to at least one storage medium 230, microphone module 240 and speaker 280 for communication. The communication connection refers to any form of connection that can directly or indirectly receive information. At least one processor 220 is used to execute the above-mentioned at least one instruction set. When the system 100 is running, at least one processor 220 reads the at least one instruction set, and obtains the data of the microphone module 240 and the speaker 280 according to the instructions of the at least one instruction set, and executes the method for audio signal processing for echo suppression provided in this specification. The processor 220 can execute all steps included in the method for audio signal processing for echo suppression. The processor 220 may be in the form of one or more processors. In some embodiments, the processor 220 may include one or more hardware processors, such as a microcontroller, a microprocessor, a reduced instruction set computer (RISC), an application-specific integrated circuit (ASIC), an application-specific instruction set processor (ASIP), a central processing unit (CPU), a graphics processing unit (GPU), a physical processing unit (PPU), a microcontroller unit, a digital signal processor (DSP), a field programmable gate array (FPGA), an advanced RISC machine (ARM), a programmable logic device (PLD), any circuit or processor capable of performing one or more functions, etc., or any combination thereof. For the sake of illustration only, only one processor 220 is described in the electronic device 200 in this specification. However, it should be noted that the electronic device 200 in this specification may also include multiple processors, and therefore, the operations and / or method steps disclosed in this specification may be performed by one processor as described in this specification, or may be performed jointly by multiple processors. For example, if in the present specification the processor 220 of the electronic device 200 executes step A and step B, it should be understood that step A and step B may also be executed jointly or separately by two different processors 220 (for example, the first processor executes step A, the second processor executes step B, or the first and second processors execute steps A and B together).

[0077] In some embodiments, the system 100 may select the target audio processing mode of the electronic device 200 according to the signal strength of the speaker signal. In some embodiments, the system 100 may select the target audio processing mode of the electronic device 200 according to the signal strength of the speaker signal and the microphone signal.

[0078] Figure 5 FIG. 1 is a flowchart of an audio signal processing method P100 for suppressing echo according to an embodiment of the present specification. The method P100 is a flowchart of a method in which the system 100 selects the target audio processing mode of the electronic device 200 according to the signal strength of the speaker signal. Figure 5As shown, the method P100 may include executing, by at least one processor 220:

[0079] S120: Selecting a target audio processing mode of the electronic device 200 from the first mode 1 and the second mode 2 based at least on the speaker signal. As mentioned above, the target audio processing mode may include one of the first mode 1 and the second mode 2. Specifically, step S120 may include:

[0080] S121: Acquire the speaker signal.

[0081] S122: Generate a control signal corresponding to the speaker signal based at least on the strength of the speaker signal. The control signal includes a first control signal or a second control signal. Specifically, the electronic device 200 may receive the speaker signal sent by the control device 400, and compare the strength of the speaker signal with a preset speaker threshold, and generate the control signal according to the comparison result. Step S122 may include one of the following situations:

[0082] S122-2: Determine that the strength of the speaker signal is lower than the speaker threshold, and generate the first control signal; or

[0083] S122-4: Determine whether the strength of the speaker signal is higher than a preset speaker threshold, and generate the second control signal.

[0084] Step S120 may further include:

[0085] S124: Based on the control signal, select the target audio processing mode corresponding to the control signal. The first control signal corresponds to the first mode 1. The second control signal corresponds to the second mode 2. When the control signal is the first control signal, select the first mode 1; when the control signal is the second control signal, select the second mode 2.

[0086] When the strength of the speaker signal is higher than the speaker threshold, when the first algorithm 233-1 in the first mode 1 is used to process the first audio signal 243 and the second audio signal 245, it is not possible to eliminate the echo signal in the signal while retaining a good human voice signal, so the voice quality of the first target audio 291 obtained is poor; while the second target audio 292 obtained by signal processing the second audio signal 245 using the second algorithm 233-8 in the second mode 2 is of good quality. Therefore, when the strength of the speaker signal is higher than the speaker threshold, the electronic device 200 generates the second control signal corresponding to the second mode 2.

[0087] When the intensity of the speaker signal is lower than the speaker threshold, when the first algorithm 233-1 in the first mode 1 is used to process the first audio signal 243 and the second audio signal 245, the echo signal in the signal can be eliminated while retaining a good human voice signal, so the voice quality of the first target audio 291 obtained is good; and the second target audio 292 obtained by processing the second audio signal 245 using the second algorithm 233-8 in the second mode 2 is also good. Therefore, when the intensity of the speaker signal is lower than the speaker threshold, the electronic device 200 generates the first control signal corresponding to the first mode 1, and can also generate the second control signal corresponding to the second mode 2.

[0088] The control signal is generated by the control module 231. Specifically, the electronic device 200 can monitor the strength of the speaker signal in real time and compare it with the speaker threshold. The electronic device 200 can also periodically detect the strength of the speaker signal and compare it with the speaker threshold. The electronic device 200 can also compare the speaker signal with the speaker threshold when it is detected that the strength of the speaker signal changes significantly and the change value exceeds a preset range.

[0089] When the strength of the speaker signal is higher than the speaker threshold, the electronic device 200 generates the second control signal; when the speaker signal changes and the strength of the speaker signal is lower than the speaker threshold, the electronic device generates the first control signal. When the strength of the speaker signal is lower than the speaker threshold, the electronic device 200 generates the first control signal; when the speaker signal changes and the strength of the speaker signal is higher than the speaker threshold, the electronic device generates the second control signal.

[0090] In order to ensure that the control signal is not perceived by the user 002 when switching, the speaker threshold may be a range. The speaker threshold may be within the range of a first speaker critical value and a second speaker critical value. The first speaker critical value is less than the second speaker critical value. The intensity of the speaker signal being higher than the speaker threshold may include the intensity of the speaker signal being higher than the second speaker critical value. The intensity of the speaker signal being lower than the speaker threshold may include the intensity of the speaker signal being lower than the first speaker critical value.

[0091] When the speaker signal strength is equal to the speaker threshold, the electronic device 200 may generate the first control signal or the second control signal. When the speaker signal strength is higher than the second speaker critical value, the electronic device 200 generates the second control signal; when the speaker signal strength decreases to between the first speaker critical value and the second speaker critical value, the electronic device 200 may generate the second control signal. When the speaker signal strength is lower than the first speaker critical value, the electronic device 200 generates the first control signal; when the speaker signal strength increases to between the first speaker critical value and the second speaker critical value, the electronic device 200 may generate the first control signal.

[0092] The electronic device 200 may also obtain a control model through machine learning, input the speaker signal into the control model, and the control model outputs the control signal.

[0093] The method P100 may further include executing, by at least one processor 220:

[0094] S140: Processing the microphone signal by the target audio processing mode to generate the target audio, so as to at least reduce the echo in the microphone signal. Specifically, step S140 may include one of the following situations:

[0095] S142: Determine that the control signal is the first control signal, and perform signal processing and feature fusion on the first audio signal 243 and the second audio signal 245 based on the speaker input signal through the first algorithm 233-1 in the first mode 1 corresponding to the first control signal to generate a first target audio 291. The specific process is as described above and will not be repeated here.

[0096] S144: Determine that the control signal is the second control signal, and perform signal processing on the second audio signal 245 based on the speaker input signal by using the second algorithm 233-8 in the second mode 2 corresponding to the second control signal. The specific process is as described above and will not be repeated here.

[0097] S160: Output the target audio. The electronic device 200 may directly output the target audio. The electronic device 200 may also perform smoothing on the target audio so that the target audio is not perceived by the user 002 when switching between the first target audio 291 and the second target audio 292. Specifically, step S160 may include: performing smoothing on the target audio and outputting the target audio after the smoothing.

[0098] Specifically, the electronic device 200 can perform smoothing processing on the target audio through the microphone control module 235. When the target audio switches between the first target audio 291 and the second target audio 292, the microphone control module 235 can perform the smoothing processing on the connection between the first target audio 291 and the second target audio 292, that is, perform signal adjustment on the first target audio 291 and the second target audio 292 so that the connection has a smooth transition.

[0099] The method P100 may further include:

[0100] S180: Based on the control signal, control the strength of the speaker input signal of the speaker 280. Specifically, step S180 may be performed by the speaker control module 237. Step S180 may be that the speaker control module 237 determines that the control signal is the first control signal; the speaker control module 237 processes the speaker processing signal to reduce the strength of the speaker input signal input to the speaker 280, thereby reducing the strength of the sound output by the speaker 280, so as to reduce the echo signal in the microphone signal, so as to improve the voice quality of the first target audio.

[0101] Table 1 shows Figure 5 Corresponding target audio processing mode result diagram. As shown in Table 1, for the convenience of comparison, we divide the scene into 4 scenes, namely the first one: the near-end sound signal is less than the threshold (for example, user 002 does not make a sound) and the speaker signal does not exceed the speaker threshold; the second one: the near-end sound signal is greater than the threshold (for example, user 002 makes a sound) and the speaker signal does not exceed the speaker threshold; the third one: the near-end sound signal is less than the threshold (for example, user 002 does not make a sound) and the speaker signal exceeds the speaker threshold; and the fourth one: the near-end sound signal is greater than the threshold (for example, user 002 makes a sound) and the speaker signal exceeds the speaker threshold. Among them, whether the near-end sound signal is greater than the threshold can be judged by the control module 231 according to the microphone signal. The near-end sound signal is greater than the threshold can be that the intensity of the audio signal emitted by user 002 exceeds the preset threshold. The target audio processing modes corresponding to the four scenes are the first and second corresponding to the first mode 1; the third and fourth corresponding to the second mode 2.

[0102]

[0103]

[0104] In the method P100, the electronic device 200 can select the target audio processing mode of the electronic device 200 according to the speaker signal to ensure that the voice quality processed by the target audio processing mode selected by the electronic device 200 in any scenario is optimal to ensure the call quality.

[0105] In some embodiments, the selection of the target audio processing mode is not only related to the echo of the speaker signal, but also related to the environmental noise. The environmental noise can be evaluated by at least one of the environmental noise level and the signal-to-noise ratio in the microphone signal.

[0106] Figure 6 A flowchart of an audio signal processing method P200 for suppressing echo provided according to an embodiment of the present specification is shown. The method P200 is a flowchart of a method in which the system 100 selects the target audio processing mode of the electronic device 200 according to the signal strength of the speaker signal and the microphone signal. Specifically, the method P200 is a flowchart of a method in which the system 100 selects the target audio processing mode according to at least one of the ambient noise level and the signal-to-noise ratio in the speaker signal and the microphone signal. The method P200 may include executing, by at least one processor 220:

[0107] S220: Selecting a target audio processing mode of the electronic device 200 from the first mode 1 and the second mode 2 based at least on the speaker signal. Specifically, step S220 may include:

[0108] S222: Generate a control signal corresponding to the speaker signal based at least on the strength of the speaker signal. The control signal includes a first control signal or a second control signal. Specifically, step S222 may be that the electronic device 200 generates a corresponding control signal based on the strength of the speaker signal and the noise in the microphone signal. Step S222 may include:

[0109] S222-2: Obtain evaluation parameters of the speaker signal and the microphone signal. The evaluation parameter may be an environmental noise evaluation parameter in the microphone signal. The environmental noise evaluation parameter may include at least one of an environmental noise level and a signal-to-noise ratio. The electronic device 200 may obtain the environmental noise evaluation parameter in the microphone signal through the control module 231. Specifically, the electronic device 200 may obtain the environmental noise evaluation parameter based on at least one of the first audio signal 243 and the second audio signal 245. The electronic device 200 may obtain the environmental noise level or the signal-to-noise ratio through a noise estimation algorithm, which will not be described in detail in this specification.

[0110] S222-4: Generate the control signal based on the strength of the speaker signal and the environmental noise evaluation parameter. Specifically, the electronic device 200 may compare the strength of the speaker signal with a preset speaker threshold, and compare the environmental noise evaluation parameter with a preset noise evaluation range, and generate the control signal according to the comparison result. Step S222-4 may include one of the following situations:

[0111] S222-5: Determine that the strength of the speaker signal is higher than a preset speaker threshold, and generate the second control signal;

[0112] S222-6: Determine that the intensity of the speaker signal is lower than the speaker threshold, and the environmental noise evaluation parameter is outside a preset noise evaluation range, and generate the first control signal;

[0113] S222-7: Determine that the intensity of the speaker signal is lower than the speaker threshold and that the environmental noise evaluation parameter is within the noise evaluation range, and generate the first control signal or the second control signal.

[0114] Wherein, the environmental noise evaluation parameter being within the noise evaluation range may include at least one of the environmental noise level being lower than a preset environmental noise threshold, and the signal-to-noise ratio being higher than a preset signal-to-noise ratio threshold. At this time, the environmental noise is relatively small. The environmental noise evaluation parameter being outside the noise evaluation range may include at least one of the environmental noise level being higher than a preset environmental noise threshold, and the signal-to-noise ratio being lower than a preset signal-to-noise ratio threshold. At this time, the environmental noise is relatively large. Wherein, when the environmental noise evaluation parameter is outside the noise evaluation range, that is, in a high noise environment, the voice quality of the first target audio 291 is better than the second target audio 292. When the environmental noise evaluation parameter is within the noise evaluation range, the voice quality of the first target audio 291 is not much different from the voice quality of the second target audio 292.

[0115] Step S220 may further include:

[0116] S224: Based on the control signal, select the target audio processing mode corresponding to the control signal. The first control signal corresponds to the first mode 1. The second control signal corresponds to the second mode 2. When the control signal is the first control signal, select the first mode 1; when the control signal is the second control signal, select the second mode 2.

[0117] When the intensity of the speaker signal is higher than the speaker threshold, the first algorithm 233-1 in the first mode 1 cannot eliminate the echo signal in the signal while retaining the better human voice signal when processing the first audio signal 243 and the second audio signal 245, so the voice quality of the first target audio 291 is poor; while the second algorithm 233-8 in the second mode 2 processes the second audio signal 245 to obtain the second target audio 292 with better quality. Therefore, when the intensity of the speaker signal is higher than the speaker threshold, the electronic device 200 generates the second control signal corresponding to the second mode 2 regardless of the range of the ambient noise.

[0118] When the intensity of the speaker signal is lower than the speaker threshold, the first algorithm 233-1 in the first mode 1 can eliminate the echo signal in the signal while retaining a good human voice signal when processing the first audio signal 243 and the second audio signal 245, so that the voice quality of the first target audio 291 is good; and the second algorithm 233-8 in the second mode 2 processes the second audio signal 245 to obtain the second target audio 292 with good quality. Therefore, when the intensity of the speaker signal is lower than the speaker threshold, the control signal generated by the electronic device 200 is related to the environmental noise.

[0119] When the environmental noise level is higher than the environmental noise threshold or the signal-to-noise ratio is lower than the signal-to-noise ratio threshold, it means that the environmental noise in the microphone signal is large. When the first algorithm 233-1 in the first mode 1 performs signal processing on the first audio signal 243 and the second audio signal 245, it can reduce the noise in the signal while retaining a good human voice signal, so the voice quality of the first target audio 291 obtained is better; while the voice quality of the second target audio 292 obtained by the second algorithm 233-8 in the second mode 2 performing signal processing on the second audio signal 245 is not as good as the voice quality of the first target audio 291. Therefore, when the intensity of the speaker signal is lower than the speaker threshold, and the environmental noise level is higher than the environmental noise threshold or the signal-to-noise ratio is lower than the signal-to-noise ratio threshold, the electronic device 200 generates the first control signal corresponding to the first mode 1.

[0120] It should be noted that when the environmental noise is small, that is, when the environmental noise evaluation parameter is within the noise evaluation range, the voice quality of the first target audio 291 is not much different from the voice quality of the second target audio 292. At this time, the electronic device 200 can always generate the second control signal to select the second algorithm 233-8 in the second mode 2 to perform signal processing on the second audio signal 245, thereby reducing the amount of calculation and saving resources while ensuring the voice quality of the target audio.

[0121] When the environmental noise level is lower than the environmental noise threshold or the signal-to-noise ratio is higher than the signal-to-noise ratio threshold, it means that the environmental noise in the microphone signal is small. The first target audio 291 obtained when the first algorithm 233-1 in the first mode 1 performs signal processing on the first audio signal 243 and the second audio signal 245, and the second target audio 292 obtained by the second algorithm 233-8 in the second mode 2 performs signal processing on the second audio signal 245 have good voice quality. Therefore, when the intensity of the speaker signal is lower than the speaker threshold, and the environmental noise level is lower than the environmental noise threshold or the signal-to-noise ratio is higher than the signal-to-noise ratio threshold, the electronic device 200 generates the first control signal or the second control signal. Specifically, the electronic device 200 can determine the control signal in the current scene according to the control signal of the previous scene. That is, when the electronic device generates the first control signal in the previous scene, when it is in the current scene, the electronic device also generates the first control signal, thereby ensuring the continuity of the signal. Vice versa.

[0122] The control signal is generated by the control module 231. Specifically, the electronic device 200 can monitor the strength of the speaker signal and the environmental noise evaluation parameter in real time, and compare them with the speaker threshold and the noise evaluation range. The electronic device 200 can also periodically detect the strength of the speaker signal and the environmental noise evaluation parameter, and compare them with the speaker threshold and the noise evaluation range. The electronic device 200 can also compare the speaker signal and the environmental noise evaluation parameter with the speaker threshold and the noise evaluation range when it is detected that the strength of the speaker signal or the environmental noise evaluation parameter has changed significantly, and the change value exceeds a preset range.

[0123] In order to ensure that the control signal is not perceived by the user 002 when switching, the speaker threshold, the ambient noise threshold and the preset signal-to-noise ratio threshold may be a range. The speaker threshold is as described above and will not be repeated here. The ambient noise threshold may be within the range of the first noise critical value and the second noise critical value. The first noise critical value is less than the second noise critical value. The ambient noise level higher than the ambient noise threshold may include the ambient noise level higher than the second noise critical value. The ambient noise level lower than the ambient noise threshold may include the ambient noise level lower than the first noise critical value. The signal-to-noise ratio threshold may be within the range of the first signal-to-noise ratio critical value and the second signal-to-noise ratio critical value. The first signal-to-noise ratio critical value is less than the second signal-to-noise ratio critical value. The signal-to-noise ratio higher than the signal-to-noise ratio threshold may include the signal-to-noise ratio higher than the second signal-to-noise ratio critical value. The signal-to-noise ratio lower than the signal-to-noise ratio threshold may include the signal-to-noise ratio lower than the first signal-to-noise ratio critical value.

[0124] The method P200 may include executing, by at least one processor 220:

[0125] S240: Processing the microphone signal by the target audio processing mode to generate target audio, so as to at least reduce the echo in the microphone signal. Specifically, step S240 may include one of the following situations:

[0126] S242: Determine that the control signal is the first control signal, select the first mode 1, perform signal processing on the first audio signal 243 and the second audio signal 245, and generate the first target audio 291. Specifically, step S242 may be consistent with step S142, and will not be described in detail herein.

[0127] S244: Determine that the control signal is the second control signal, select the second mode 2, perform echo suppression on the second audio signal 245, and generate the second target audio 292. Specifically, step S244 may be consistent with step S144, and will not be described in detail herein.

[0128] S260: Output the target audio. Specifically, step S260 may be consistent with step S160, and will not be described in detail herein.

[0129] The method P200 may further include:

[0130] S280: Based on the control signal, control the strength of the speaker input signal of the speaker 280. Specifically, step S280 may be consistent with step S180, and will not be described in detail herein.

[0131] Table 2 shows Figure 6The corresponding target audio processing mode result diagram. As shown in Table 2, for the convenience of comparison, we divide the scenarios into 8 scenarios, namely the first one: the near-end sound signal is less than the threshold (for example, user 002 does not make a sound), the speaker signal does not exceed the speaker threshold, and the environmental noise is small; the second one: the near-end sound signal is greater than the threshold (for example, user 002 makes a sound), the speaker signal does not exceed the speaker threshold, and the environmental noise is small; the third one: the near-end sound signal is less than the threshold (for example, user 002 does not make a sound), the speaker signal exceeds the speaker threshold, and the environmental noise is small; and the fourth one: the near-end sound signal is greater than the threshold (for example, user 002 makes a sound), the speaker signal exceeds the speaker threshold, and the environmental noise is small. The speaker threshold, and the ambient noise is small; the fifth: the near-end sound signal is less than the threshold (for example, user 002 does not make a sound), the speaker signal does not exceed the speaker threshold, and the ambient noise is large; the sixth: the near-end sound signal is greater than the threshold (for example, user 002 makes a sound), the speaker signal does not exceed the speaker threshold, and the ambient noise is large; the seventh: the near-end sound signal is less than the threshold (for example, user 002 does not make a sound), the speaker signal exceeds the speaker threshold, and the ambient noise is large; and the eighth: the near-end sound signal is greater than the threshold (for example, user 002 makes a sound), the speaker signal exceeds the speaker threshold, and the ambient noise is large. Among them, whether the near-end sound signal is greater than the threshold can be determined by the control module 231 according to the microphone signal. The near-end sound signal is greater than the threshold can be that the intensity of the audio signal emitted by user 002 exceeds the preset threshold. The target audio processing modes corresponding to the 8 scenarios are respectively the fifth and sixth corresponding to the first mode 1; the third, fourth, seventh and eighth corresponding to the second mode 2; the remaining scenarios correspond to the first mode 1 or the second mode 2.

[0132]

[0133] The method P200 can not only control the target audio processing mode of the electronic device 200 according to the speaker signal, but also control the target audio processing mode according to the near-end ambient noise signal, thereby ensuring that the voice quality of the voice signal output by the electronic device 200 is optimal in different scenarios to ensure call quality.

[0134] In some embodiments, the selection of the target audio processing mode is not only related to the echo of the speaker signal and the environmental noise, but also to the voice signal when the user 002 speaks. The environmental noise signal can be evaluated by at least one of the environmental noise level and the signal-to-noise ratio in the microphone signal. The voice signal when the user 002 speaks can be evaluated by the human voice signal strength in the microphone signal. The human voice signal strength can be the human voice signal strength obtained by a noise estimation algorithm, and the human voice signal strength can also be the strength of the audio signal obtained after noise reduction processing.

[0135] Figure 7 A flowchart of an audio signal processing method P300 for suppressing echo provided according to an embodiment of the present specification is shown. The method P300 is a flowchart of a method in which the system 100 selects a target audio processing mode of the electronic device 200 according to the signal strength of the speaker signal and the microphone signal. Specifically, the method P300 is a flowchart of a method in which the system 100 selects the target audio processing mode according to the speaker signal, the human voice signal strength in the microphone signal, and at least one of the ambient noise level and the signal-to-noise ratio. The method P300 may include executing, by at least one processor 220:

[0136] S320: Selecting a target audio processing mode of the electronic device 200 from the first mode 1 and the second mode 2 based at least on the speaker signal. Specifically, step S320 may include:

[0137] S322: Generate a control signal corresponding to the speaker signal based at least on the strength of the speaker signal. The control signal includes a first control signal or a second control signal. Step S320 may be that the electronic device 200 generates a corresponding control signal based on the strength of the speaker signal, the noise in the microphone signal, and the strength of the human voice signal in the microphone signal. Specifically, step S322 may include:

[0138] S322-2: Obtain evaluation parameters of the speaker signal and the microphone signal. The evaluation parameters may include environmental noise evaluation parameters in the microphone signal, and may also include the strength of the human voice signal in the microphone signal. The environmental noise evaluation parameters may include at least one of the environmental noise level and the signal-to-noise ratio. The electronic device 200 may obtain the environmental noise evaluation parameters and the strength of the human voice signal in the microphone signal through the control module 231. Specifically, the electronic device 200 may obtain the evaluation parameters based on at least one of the first audio signal 243 and the second audio signal 245. The electronic device 200 may obtain the human voice signal, the environmental noise level and the signal-to-noise ratio through a noise estimation algorithm, which will not be described in detail in this specification.

[0139] S322-4: Generate the control signal based on the strength of the speaker signal and the evaluation parameter. Specifically, the electronic device 200 may compare the strength of the speaker signal with a preset speaker threshold, compare the environmental noise evaluation parameter with a preset noise evaluation range, and compare the strength of the human voice signal with a preset human voice threshold, and generate the control signal according to the comparison result. Step S322-4 may include one of the following situations:

[0140] S322-5: Determine that the strength of the speaker signal is higher than a preset speaker threshold, and the strength of the human voice signal exceeds the human voice threshold, and the environmental noise evaluation parameter is outside a preset noise evaluation range, and generate the first control signal;

[0141] S322-6: Determine that the strength of the loudspeaker signal is higher than the loudspeaker threshold, and the strength of the human voice signal exceeds the human voice threshold, and the environmental noise evaluation parameter is within the noise evaluation range, and generate the second control signal;

[0142] S322-7: Determine that the strength of the loudspeaker signal is higher than the loudspeaker threshold, and the strength of the human voice signal is lower than the human voice threshold, and generate the second control signal;

[0143] S322-8: Determine that the intensity of the speaker signal is lower than the speaker threshold and the environmental noise evaluation parameter is outside the noise evaluation range, and generate the first control signal;

[0144] S322-9: Determine that the intensity of the speaker signal is lower than the speaker threshold and that the environmental noise evaluation parameter is within the noise evaluation range, and generate the first control signal or the second control signal.

[0145] The environmental noise evaluation parameter being within the noise evaluation range may include at least one of the environmental noise level being lower than a preset environmental noise threshold, and the signal-to-noise ratio being higher than a preset signal-to-noise ratio threshold. At this time, the environmental noise is relatively small. The environmental noise evaluation parameter being outside the noise evaluation range may include at least one of the environmental noise level being higher than a preset environmental noise threshold, and the signal-to-noise ratio being lower than a preset signal-to-noise ratio threshold. At this time, the environmental noise is relatively large. Among them, when the environmental noise evaluation parameter is outside the noise evaluation range, that is, in a high noise environment, the voice quality of the first target audio 291 is better than the second target audio 292. When the environmental noise evaluation parameter is within the noise evaluation range, the voice quality of the first target audio 291 is not much different from the voice quality of the second target audio 292. The speaker threshold, the environmental noise threshold, and the signal-to-noise ratio threshold are as described above and will not be repeated here.

[0146] The fact that the human voice signal strength exceeds the human voice threshold indicates that the user 002 is speaking. At this time, in order to ensure the voice quality of the user 002, the electronic device 200 can generate the first control signal and reduce the speaker signal to ensure the voice quality of the first target audio 291.

[0147] The speaker threshold, the ambient noise threshold, the signal-to-noise ratio threshold, and the human voice threshold may be pre-stored in the electronic device 200 .

[0148] Step S320 may further include:

[0149] S324: Based on the control signal, select the target audio processing mode corresponding to the control signal. The first control signal corresponds to the first mode 1. The second control signal corresponds to the second mode 2. When the control signal is the first control signal, select the first mode 1; when the control signal is the second control signal, select the second mode 2.

[0150] When the intensity of the speaker signal is higher than the speaker threshold and the intensity of the human voice signal exceeds the human voice threshold, and the environmental noise evaluation parameter is outside the preset noise evaluation range, it proves that the user 002 is speaking at this time, and the echo is large and the noise is also large. In order to ensure the voice quality and intelligibility of the user 002, the electronic device 200 can reduce or even turn off the speaker input signal input to the speaker 280 to reduce the echo in the microphone signal and ensure the voice quality of the target audio. At this time, the voice quality of the first target audio 291 obtained by the first algorithm 233-1 in the first mode 1 performing signal processing on the first audio signal 243 and the second audio signal 245 is better than the second target audio 292 obtained by the second algorithm 233-8 in the second mode 2 performing signal processing on the second audio signal 245. Therefore, when the intensity of the speaker signal is higher than the speaker threshold and the intensity of the human voice signal exceeds the human voice threshold, and the environmental noise evaluation parameter is outside the preset noise evaluation range, the electronic device 200 generates the first control signal corresponding to the first mode 1. In this case, the electronic device 200 can ensure the intelligibility of the voice quality of the near-end user 002. Although a portion of the speaker input signal is missing, the electronic device 200 can retain most of the voice quality and intelligibility of the speaker input signal, thereby improving the voice communication quality of both parties.

[0151] When the intensity of the speaker signal is higher than the speaker threshold and the intensity of the human voice signal is lower than the human voice threshold or the intensity of the human voice signal exceeds the human voice threshold, and the environmental noise evaluation parameter is within the preset noise evaluation range, it proves that the user 002 is not speaking at this time, or the user 002 is speaking but the noise is small. At this time, the voice quality of the first target audio 291 obtained by the first algorithm 233-1 in the first mode 1 performing signal processing on the first audio signal 243 and the second audio signal 245 is worse than the second target audio 292 obtained by the second algorithm 233-8 in the second mode 2 performing signal processing on the second audio signal 245. Therefore, when the intensity of the speaker signal is higher than the speaker threshold and the intensity of the human voice signal is lower than the human voice threshold or the intensity of the human voice signal exceeds the human voice threshold, and the environmental noise evaluation parameter is within the preset noise evaluation range, the electronic device 200 generates the second control signal corresponding to the second mode 2.

[0152] The other situations in step S322-4 are basically the same as those in step S222-4 and will not be repeated here.

[0153] The control signal is generated by the control module 231. Specifically, the electronic device 200 can monitor the strength of the speaker signal and the evaluation parameter in real time, and compare them with the speaker threshold, the noise evaluation range and the human voice threshold. The electronic device 200 can also periodically detect the strength of the speaker signal and the evaluation parameter, and compare them with the speaker threshold, the noise evaluation range and the human voice threshold. The electronic device 200 can also compare the speaker signal and the evaluation parameter with the speaker threshold, the noise evaluation range and the human voice threshold when it is detected that the strength of the speaker signal or the evaluation parameter has changed significantly and the change value exceeds a preset range.

[0154] The method P300 may include executing, by at least one processor 220:

[0155] S340: Processing the microphone signal by the target audio processing mode to generate the target audio, so as to at least reduce the echo in the microphone signal. Specifically, step S340 may include one of the following situations:

[0156] S342: Determine that the control signal is the first control signal, select the first mode 1, perform signal processing on the first audio signal 243 and the second audio signal 245, and generate the first target audio 291. Specifically, step S342 may be consistent with step S142, and will not be described in detail herein.

[0157] S344: Determine that the control signal is the second control signal, select the second mode 2, perform signal processing on the second audio signal 245, and generate the second target audio 292. Specifically, step S344 may be consistent with step S144, and will not be described in detail herein.

[0158] The method P300 may include executing, by at least one processor 220:

[0159] S360: Output the target audio. Specifically, step S360 may be consistent with step S160, which will not be described in detail herein.

[0160] The method P300 may further include:

[0161] S380: Based on the control signal, control the strength of the speaker input signal of the speaker 280. Specifically, step S380 may be consistent with step S180, and will not be described in detail herein.

[0162] Table 3 shows Figure 7The corresponding target audio processing mode result diagram. As shown in Table 3, for the convenience of comparison, we divide the scenarios into 8 scenarios, namely the first one: the near-end sound signal is less than the threshold (for example, user 002 does not make a sound), the speaker signal does not exceed the speaker threshold, and the environmental noise is small; the second one: the near-end sound signal is greater than the threshold (for example, user 002 makes a sound), the speaker signal does not exceed the speaker threshold, and the environmental noise is small; the third one: the near-end sound signal is less than the threshold (for example, user 002 does not make a sound), the speaker signal exceeds the speaker threshold, and the environmental noise is small; and the fourth one: the near-end sound signal is greater than the threshold (for example, user 002 makes a sound), the speaker signal exceeds the speaker threshold, and the environmental noise is small. The speaker threshold, and the ambient noise is small; the fifth: the near-end sound signal is less than the threshold (for example, user 002 does not make a sound), the speaker signal does not exceed the speaker threshold, and the ambient noise is large; the sixth: the near-end sound signal is greater than the threshold (for example, user 002 makes a sound), the speaker signal does not exceed the speaker threshold, and the ambient noise is large; the seventh: the near-end sound signal is less than the threshold (for example, user 002 does not make a sound), the speaker signal exceeds the speaker threshold, and the ambient noise is large; and the eighth: the near-end sound signal is greater than the threshold (for example, user 002 makes a sound), the speaker signal exceeds the speaker threshold, and the ambient noise is large. Among them, whether the near-end sound signal is greater than the threshold can be determined by the control module 231 according to the microphone signal. The near-end sound signal is greater than the threshold can be that the intensity of the audio signal emitted by user 002 exceeds the preset threshold. The target audio processing modes corresponding to the 8 scenes are the fifth, sixth and eighth corresponding to the first mode 1; the third, fourth and seventh corresponding to the second mode 2; the remaining scenes correspond to the first mode 1 or the second mode 2.

[0163]

[0164] It should be noted that method P200 and method P300 are applicable to different application scenarios. When the speaker signal is more important than the near-end speech quality, method P200 can be selected to ensure the quality of the speaker signal and the intelligibility of the speaker signal. When the near-end speech quality is more important than the speaker signal, method P300 can be selected to ensure the speech quality and intelligibility of the near-end speech.

[0165] In summary, the system 100, the method P100, the method P200 and the method P300 can control the target audio processing mode of the electronic device 200 according to the speaker signal for different scenarios, thereby controlling the sound source signal of the electronic device 200, so that the voice quality of the target audio is optimal in any scenario, thereby improving the quality of voice communication.

[0166] It should be noted that the signal strength of the environmental noise is different at each frequency. At different frequencies, the voice quality of the first target audio 291 and the second target audio 292 is also different. For example, at the first frequency, the voice quality of the first target audio 291 obtained after the first audio signal 243 and the second audio signal 245 are processed by the first algorithm 233-1 is better than the voice quality of the second target audio 292 obtained after the second audio signal 245 is processed by the second algorithm 233-8. At other frequencies except the first frequency, the voice quality of the first target audio 291 obtained after the first audio signal 243 and the second audio signal 245 are processed by the first algorithm 233-1 is similar to the voice quality of the second target audio 292 obtained after the second audio signal 245 is processed by the second algorithm 233-8. At this time, the electronic device 200 can also generate the control signal according to the frequency of the environmental noise. The first control signal is generated at the first frequency, and the second control signal is generated at other frequencies except the first frequency.

[0167] When the environmental noise is low-frequency noise (such as subways, buses, etc.), the first target audio 291 obtained by the first audio signal 243 and the second audio signal 245 under the signal processing of the first algorithm 233-1 may have poor voice signal quality at low frequencies, that is, the first target audio 291 has poor voice intelligibility at low frequencies, but high voice intelligibility at high frequencies. At this time, the electronic device 200 can control the selection of the target audio processing mode according to the frequency of the environmental noise. For example, in the low-frequency range, the electronic device 200 can select the method P300 to control the target audio processing mode to ensure that the voice of the near-end user 002 is picked up, thereby ensuring the near-end voice quality; in the high-frequency range, the electronic device 200 can select the method P200 to control the target audio processing mode to ensure that the near-end user 002 can hear the speaker signal.

[0168] On the other hand, the present specification provides a non-transitory storage medium, storing at least one set of executable instructions for controlling the sound source signal based on the sound source signal. When the executable instructions are executed by the processor, the executable instructions instruct the processor to implement the steps of the audio signal processing method for suppressing echo described in the present specification. In some possible implementations, various aspects of the present specification can also be implemented in the form of a program product, which includes a program code. When the program product is run on the electronic device 200, the program code is used to enable the electronic device 200 to perform the steps of controlling the sound source signal based on the sound source signal described in the present specification. The program product for implementing the above method can use a portable compact disk read-only memory (CD-ROM) to include the program code and can be run on the electronic device 200. However, the program product of the present specification is not limited to this. In the present specification, the readable storage medium can be any tangible medium containing or storing a program, which can be used by the instruction execution system (such as the processor 220) or used in combination with it. The program product can use any combination of one or more readable media. The readable medium can be a readable signal medium or a readable storage medium. The readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination thereof. More specific examples of readable storage media include: an electrical connection with one or more conductors, a portable disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination thereof. The computer-readable storage medium may include a data signal propagated in a baseband or as part of a carrier wave, wherein a readable program code is carried. Such propagated data signals may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination thereof. The readable storage medium may also be any readable medium other than a readable storage medium, which may send, propagate, or transmit a program for use by or in combination with an instruction execution system, device, or device. The program code contained on the readable storage medium may be transmitted using any suitable medium, including but not limited to wireless, wired, optical cable, RF, etc., or any suitable combination thereof. Program code for performing the operations of the present specification may be written in any combination of one or more programming languages, including object-oriented programming languages ​​such as Java, C++, etc., and conventional procedural programming languages ​​such as "C" or similar programming languages. The program code may be executed entirely on the electronic device 200, partially on the electronic device 200, as a separate software package, partially on the electronic device 200 and partially on a remote computing device, or entirely on a remote computing device.

[0169] The above is a description of a specific embodiment of the present specification. Other embodiments are within the scope of the appended claims. In some cases, the actions or steps recorded in the claims can be performed in an order different from that in the embodiments and still achieve the desired results. In addition, the processes depicted in the drawings do not necessarily require a specific order or a continuous order to achieve the desired results. In some embodiments, multitasking and parallel processing are also possible or may be advantageous.

[0170] In summary, after reading this detailed disclosure, those skilled in the art will appreciate that the foregoing detailed disclosure may be presented only by way of example and may not be limiting. Although not explicitly stated herein, those skilled in the art will appreciate that this specification requires various reasonable changes, improvements and modifications to the embodiments. These changes, improvements and modifications are intended to be proposed by this specification and are within the spirit and scope of the exemplary embodiments of this specification.

[0171] In addition, certain terms in this specification have been used to describe embodiments of this specification. For example, "one embodiment", "an embodiment" and / or "some embodiments" mean that a particular feature, structure or characteristic described in conjunction with the embodiment may be included in at least one embodiment of this specification. Therefore, it can be emphasized and should be understood that two or more references to "an embodiment" or "one embodiment" or "an alternative embodiment" in various parts of this specification do not necessarily refer to the same embodiment. In addition, specific features, structures or characteristics may be appropriately combined in one or more embodiments of this specification.

[0172] It should be understood that in the foregoing description of the embodiments of this specification, in order to help understand a feature and for the purpose of simplifying this specification, this specification combines various features in a single embodiment, drawing or its description. However, this does not mean that the combination of these features is necessary. When reading this specification, it is entirely possible for a person skilled in the art to extract some of the features and understand them as separate embodiments. In other words, the embodiments in this specification can also be understood as the integration of multiple secondary embodiments. This is also true when the content of each secondary embodiment is less than all the features of a single aforementioned disclosed embodiment.

[0173] Each patent, patent application, patent application publication, and other materials, such as articles, books, specifications, publications, documents, articles, etc., cited herein may be incorporated herein by reference in its entirety for all purposes, except for any prosecution document history related thereto, any equivalent that may be inconsistent or conflicting with this document, or any equivalent prosecution document history that may have a limiting effect on the broadest scope of the claims now or later associated with this document. For example, if there is any inconsistency or conflict between the description, definition, and / or use of a term associated with any of the incorporated materials and the term, description, definition, and / or use associated with this document, the term in this document shall control.

[0174] Finally, it should be understood that the embodiments of the application disclosed herein are explanations of the principles of the embodiments of this specification. Other modified embodiments are also within the scope of this specification. Therefore, the embodiments disclosed in this specification are only used as examples and not as limitations. Those skilled in the art can adopt alternative configurations according to the embodiments in this specification to implement the applications in this specification. Therefore, the embodiments of this specification are not limited to the embodiments accurately described in the application.

Claims

1. An audio signal processing method for suppressing echo, characterized in that: include: selecting a target audio processing mode of the electronic device from a first mode and a second mode based at least on a speaker signal, the speaker signal being an audio signal sent by a control device to the electronic device; Processing a microphone signal by the target audio processing mode to generate a target audio, so as to at least reduce an echo in the target audio, wherein the microphone signal is an output signal of a microphone module acquired by the electronic device, and the microphone module includes at least one first-type microphone and at least one second-type microphone, wherein the first mode includes performing signal processing on a first audio signal output by the at least one first-type microphone and a second audio signal output by the at least one second-type microphone, and the second mode includes performing signal processing on the second audio signal; and The target audio is output.

2. The audio signal processing method according to claim 1, characterized in that: The step of selecting a target audio processing mode of the electronic device from a first mode and a second mode based at least on a speaker signal comprises: generating a control signal corresponding to the speaker signal based at least on the strength of the speaker signal, the control signal comprising a first control signal or a second control signal; and Based on the control signal, a target audio processing mode corresponding to the control signal is selected, wherein the first mode corresponds to the first control signal and the second mode corresponds to the second control signal.

3. The audio signal processing method according to claim 2, characterized in that: The step of generating a control signal corresponding to the speaker signal based at least on the strength of the speaker signal comprises: determining that the strength of the speaker signal is lower than a preset speaker threshold, and generating the first control signal; or It is determined that the strength of the speaker signal is higher than the speaker threshold, and the second control signal is generated.

4. The audio signal processing method according to claim 2, characterized in that: The step of generating a control signal corresponding to the speaker signal based at least on the strength of the speaker signal comprises: Based on the strength of the speaker signal and the microphone signal, a corresponding control signal is generated.

5. The audio signal processing method according to claim 4, characterized in that: The generating a corresponding control signal based on the strength of the speaker signal and the microphone signal comprises: Acquire evaluation parameters of the microphone signal, the evaluation parameters comprising an environmental noise evaluation parameter, the environmental noise evaluation parameter comprising at least one of an environmental noise level and a signal-to-noise ratio; and The control signal is generated based on the strength of the speaker signal and the evaluation parameter.

6. The audio signal processing method according to claim 5, characterized in that: The generating the control signal based on the strength of the speaker signal and the evaluation parameter includes one of the following situations: determining that the intensity of the speaker signal is higher than a preset speaker threshold, and generating the second control signal; Determining that the intensity of the speaker signal is lower than the speaker threshold and the environmental noise evaluation parameter is outside the noise evaluation range, and generating the first control signal; as well as It is determined that the intensity of the speaker signal is lower than the speaker threshold and the environmental noise evaluation parameter is within the noise evaluation range, and the first control signal or the second control signal is generated.

7. The audio signal processing method according to claim 6, characterized in that: The environmental noise evaluation parameter is within the noise evaluation range, including at least one of the following situations: The environmental noise level is lower than a preset environmental noise threshold; and The signal-to-noise ratio is higher than a preset signal-to-noise ratio threshold.

8. The audio signal processing method according to claim 5, characterized in that: The evaluation parameter further includes the strength of a human voice signal, and the generating of the control signal based on the strength of the speaker signal and the evaluation parameter includes one of the following situations: Determining that the strength of the speaker signal is higher than a preset speaker threshold, and the strength of the human voice signal exceeds a preset human voice threshold, and the environmental noise evaluation parameter is outside a preset noise evaluation range, and generating the first control signal; Determining that the strength of the loudspeaker signal is higher than the loudspeaker threshold, and the strength of the human voice signal exceeds the human voice threshold, and the environmental noise evaluation parameter is within a preset noise evaluation range, and generating the second control signal; Determine that the strength of the loudspeaker signal is higher than the loudspeaker threshold, and the strength of the human voice signal is lower than the human voice threshold, and generate the second control signal; determining that the intensity of the speaker signal is lower than the speaker threshold and the environmental noise evaluation parameter is outside the noise evaluation range, and generating the first control signal; as well as It is determined that the intensity of the speaker signal is lower than the speaker threshold and the environmental noise evaluation parameter is within the noise evaluation range, and the first control signal or the second control signal is generated.

9. The audio signal processing method according to claim 8, characterized in that: The environmental noise evaluation parameter is within the noise evaluation range, including at least one of the following situations: The environmental noise level is lower than a preset environmental noise threshold; and The signal-to-noise ratio is higher than a preset signal-to-noise ratio threshold.

10. The audio signal processing method according to claim 2, characterized in that: The generating of the target audio comprises: performing signal processing on the first audio signal and the second audio signal by using a first algorithm in the first mode to generate a first target audio; or The second audio signal is processed by a second algorithm in the second mode to generate a second target audio signal. The target audio includes one of the first target audio and the second target audio.

11. The audio signal processing method according to claim 10, characterized in that: The outputting the target audio comprises: performing smoothing processing on the target audio, and when the target audio switches between the first target audio and the second target audio, performing the smoothing processing on the connection between the first target audio and the second target audio; and The target audio after the smoothing process is output.

12. The audio signal processing method according to claim 2, characterized in that: The method further comprises: Based on the control signal, the strength of the speaker input signal of the speaker is controlled.

13. The audio signal processing method according to claim 12, characterized in that: The step of controlling the intensity of the speaker input signal of the speaker based on the control signal comprises: The control signal is determined to be the first control signal, and the intensity of the speaker input signal input to the speaker is reduced, thereby reducing the intensity of the sound output by the speaker.

14. The audio signal processing method according to claim 1, characterized in that: The at least one first type microphone is used to collect human body vibration signals; and The at least one second type microphone is used to collect air vibration signals.

15. A system for audio signal processing for echo suppression, characterized in that: include: At least one storage medium storing at least one instruction set for audio signal processing for echo suppression; as well as at least one processor, in communication with the at least one storage medium, Wherein, when the system is running, the at least one processor reads the at least one instruction set, and executes the method for audio signal processing for echo suppression according to any one of claims 1 to 14 according to the instructions of the at least one instruction set.

Images