Echo cancellation method and electronic equipment

Abstract

The invention provides an echo cancellation method, equipment and a medium. The method comprises the steps that a first microphone audio is collected, a far-end audio transmitted by a far-end audio device is obtained, and the far-end audio comprises a first audio, a second audio and a third audio; carrying out sound mixing processing on the second audio and the first microphone audio to generate a sound amplification audio for sound amplification, carrying out dodging processing on the first microphone audio according to the first audio to generate a dodging audio, and carrying out adaptive filtering processing by using the dodging audio and the second audio to obtain an echo cancellation audio; and transmitting the echo cancellation audio to a far-end audio device so that the far-end audio device performs echo cancellation processing according to the acquired second microphone audio and the echo cancellation audio to generate new far-end audio. According to the invention, efficient echo elimination can be realized, the fidelity of sound is improved, simultaneous sound amplification at the near end and the far end can be realized, the sound amplification effect is good, and the pickup distance is increased.

Description

Technical Field

[0001] The present application relates to the technical field of echo cancellation, and in particular to an echo cancellation method and an electronic device. Background Art

[0002] Existing echo cancellation technologies mainly rely on adaptive filtering algorithms (such as LMS, NLMS, RLS) or methods based on time domain / frequency domain duckers. Adaptive filtering algorithms perform echo cancellation under the condition that the echo path is linear. However, in actual environments, audio equipment, microphones, and acoustic paths often have nonlinear characteristics (such as nonlinear distortion of speakers). Adaptive filters cannot accurately model these nonlinear characteristics (i.e., it is difficult to handle echoes in complex scenes), resulting in difficulty in completely eliminating residual echoes, limited echo cancellation effects, and reduced user experience. Summary of the invention

[0003] In view of the shortcomings of existing methods, the present application proposes an echo cancellation method and an electronic device, which can solve the problems that existing echo cancellation methods are difficult to handle echoes in complex scenes, cannot effectively eliminate residual echoes, have limited echo cancellation effects, and reduce user experience.

[0004] According to one aspect of an embodiment of the present application, an echo cancellation method is provided for a near-end audio device connected to a far-end audio device, the method comprising:

[0005] Collecting audio from a first microphone and acquiring remote audio transmitted by a remote audio device, wherein the remote audio includes a first audio, a second audio, and a third audio;

[0006] Mixing the second audio and the first microphone audio to generate amplified audio for sound reinforcement, performing ducking processing on the first microphone audio according to the first audio to generate ducking audio, and performing adaptive filtering processing on the ducking audio and the second audio to obtain echo-cancelled audio;

[0007] The echo-cancelled audio is transmitted to the remote audio device so that the remote audio device performs sound amplification and performs echo cancellation processing based on the collected second microphone audio and the echo-cancelled audio to generate new remote audio.

[0008] In a possible implementation, the echo cancellation process includes ducking process and adaptive filtering process, and the ducking process and the adaptive filtering process of the far-end audio device are performed in the same manner as those of the near-end audio device.

[0009] In a possible implementation, the mixing process of the second audio and the first microphone audio includes:

[0010] The second audio and the first microphone audio are mixed using an audio sharing gain to generate amplified audio.

[0011] In a possible implementation, performing ducking processing on the first microphone audio according to the first audio to generate ducking audio includes:

[0012] Acquire a ducking threshold according to a near-end sound reinforcement system of the near-end audio device;

[0013] The first microphone audio is subjected to ducking processing based on a comparison result between the ducking threshold and the first audio to generate the ducking audio.

[0014] In a possible implementation, the near-end sound reinforcement system includes a near-end microphone and a speaker, and obtaining the ducking threshold according to the sound reinforcement system of the near-end audio device includes:

[0015] The ducking information is obtained according to the near-end sound reinforcement system, and a ducking threshold is determined based on the ducking information, wherein the ducking information includes at least one of the positions of a microphone and a speaker, a microphone pickup distance, and a sound reinforcement size.

[0016] In a possible implementation, the performing ducking processing on the first microphone audio based on a comparison result between the ducking threshold and the first audio includes:

[0017] If it is determined that the volume or amplitude of the first audio is less than the ducking threshold, determining the first microphone audio as ducking audio;

[0018] If it is determined that the volume or amplitude of the first audio is greater than or equal to the ducking threshold, the first microphone audio is attenuated according to a ratio of the first audio to the first microphone audio to obtain the ducking audio.

[0019] In a possible implementation, the performing adaptive filtering processing using the ducking audio and the second audio includes:

[0020] An echo signal corresponding to the echo path is acquired, and the echo cancellation audio is generated according to the echo signal and the ducking audio.

[0021] According to one aspect of an embodiment of the present application, there is provided an echo cancellation method for a far-end audio device connected to a near-end audio device, the method comprising:

[0022] Collecting audio from a second microphone, and receiving echo-cancelled audio transmitted by the near-end audio device, wherein the echo-cancelled audio is generated by the near-end audio device using the method described above;

[0023] Perform echo cancellation processing according to the second microphone audio and the echo cancellation audio to generate far-end audio, and send the far-end audio to the near-end audio device so that the near-end audio device generates new echo cancellation audio.

[0024] Optionally, the far-end audio device includes a far-end sound reinforcement system, and the receiving of the echo-cancelled audio transmitted by the near-end audio device includes:

[0025] Determine that the echo-cancelled audio is received, generate the echo-cancelled audio and a mixed audio corresponding to the second microphone using the remote sound reinforcement system, and perform sound reinforcement processing on the mixed audio;

[0026] The sending the far-end audio to the near-end audio device includes:

[0027] The far-end audio is processed by an audio distributor to generate a first audio, a second audio, and a third audio, and the first audio, the second audio, and the third audio are sent to the near-end audio device.

[0028] According to one aspect of an embodiment of the present application, an embodiment of the present application provides an electronic device, including a memory, a processor, and a computer program stored in the memory, wherein the processor executes the computer program to implement the steps of any of the methods described above.

[0029] The beneficial technical effects brought about by the technical solution provided by the embodiment of the present application include:

[0030] The present application provides an echo cancellation method, which has the beneficial effects of collecting audio from a first microphone to obtain far-end audio transmitted by a far-end audio device, wherein the far-end audio includes the first audio, the second audio, and the third audio; mixing the second audio and the first microphone audio to generate amplified audio for sound reinforcement, ducking the first microphone audio according to the first audio to generate ducked audio, and adaptively filtering the ducked audio and the second audio to obtain echo-cancelled audio; transmitting the echo-cancelled audio to a far-end audio device so that the far-end audio device performs echo cancellation processing according to the collected second microphone audio and the echo-cancelled audio to generate new far-end audio. The present application can make full use of the accurate modeling capability of the adaptive filter for linear echoes and the suppression effect of the ducker for nonlinear residual echoes to achieve efficient echo cancellation, improve the fidelity of the sound, and can achieve simultaneous near-end and far-end sound reinforcement, with good sound reinforcement effect and increased pickup distance.

[0031] Additional aspects and advantages of the present application will be partially given in the following description, which will become apparent from the following description, or will be learned through the practice of the present application. BRIEF DESCRIPTION OF THE DRAWINGS

[0032] The above and / or additional aspects and advantages of the present application will become apparent and easily understood from the following description of the embodiments in conjunction with the accompanying drawings, in which:

[0033] Figure 1 A flowchart of an echo cancellation method applied to a near-end audio device provided in an embodiment of the present application;

[0034] Figure 2 A schematic diagram of near-end echo cancellation and far-end echo cancellation provided in an embodiment of the present application;

[0035] Figure 3 A flowchart of an echo cancellation method applied to a remote audio device provided in an embodiment of the present application;

[0036] Figure 4 A structural diagram of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0037] The embodiments of the present application are described below in conjunction with the drawings in the present application. It should be understood that the implementation methods described below in conjunction with the drawings are exemplary descriptions for explaining the technical solutions of the embodiments of the present application and do not constitute a limitation on the technical solutions of the embodiments of the present application.

[0038] It will be understood by those skilled in the art that, unless specifically stated, the "said" and "the" used herein may also include plural forms. It should be further understood that the wording "including" used in the specification of the present application refers to the presence of the features, integers, steps, operations, elements and / or components, but does not exclude the implementation of other features, information, data, steps, operations, elements, components and / or combinations thereof supported by the present technical field. It should be understood that when we say that an element is "connected" or "coupled" to another element, the element may be directly connected or coupled to the other element, or it may refer to the connection relationship between the element and the other element through an intermediate element. In addition, the "connection" or "coupling" used herein may include wireless connection or wireless coupling. The term "and / or" used herein refers to at least one of the items defined by the term, for example, "A and / or B" may be implemented as "A", or as "B", or as "A and B".

[0039] In order to make the objectives, technical solutions and advantages of the present application clearer, the implementation methods of the present application will be further described in detail below with reference to the accompanying drawings.

[0040] The embodiment of the present application provides an echo cancellation method, which can be used for a near-end audio device connected to a far-end audio device, the near-end audio device includes a near-end sound reinforcement system, the near-end sound reinforcement system may include a near-end microphone, an audio processing module, a power amplifier, and a speaker. The near-end audio device can collect the first microphone audio through the near-end microphone, use the audio processing module to perform mixing, ducking, and adaptive filtering on the audio, the power amplifier can amplify the audio to be amplified, and the audio is provided with a speaker, and the amplified audio is played through the speaker.

[0041] Optionally, the audio processing module may include a mixing submodule, a ducking submodule and an adaptive filtering submodule. The mixing submodule may be connected to a remote audio device and a near-end microphone, and receives audio transmitted by the near-end microphone and the cloud audio device and performs mixing processing on the audio. The ducking submodule may be connected to the near-end microphone and the adaptive filtering submodule respectively, and the ducking submodule transmits the audio after ducking processing to the adaptive filtering submodule, and outputs the echo-cancelled audio through the adaptive filtering submodule.

[0042] like Figure 1 , Figure 2 As shown, the echo cancellation method of the present application includes:

[0043] S101: Collecting audio from a first microphone, and obtaining remote audio transmitted by a remote audio device.

[0044] Optionally, the far-end audio includes a first audio, a second audio and a third audio. The first audio, the second audio and the third audio are the same audio signals, and these audio signals can be obtained by processing the far-end audio transmitted by the far-end audio device through an audio distributor.

[0045] Optionally, the near-end audio device collects first microphone audio through a near-end microphone, and the first microphone audio may include a local human voice (original audio) and sound reflected by a near-end sound reinforcement system.

[0046] Optionally, the far-end audio may be network audio transmitted by a far-end audio device through a network, and the far-end audio may be obtained by echo cancellation processing, wherein the echo cancellation processing includes ducking processing and adaptive filtering processing. The ducking processing and adaptive filtering processing of the far-end audio device are performed in the same manner as those of the near-end audio device.

[0047] In one embodiment, the remote audio device can be a voice communication terminal or a voice relay switch, such as a recording and broadcasting host or a video conferencing terminal. The remote audio device transmits the remote audio obtained after echo cancellation processing to an audio distributor, which then transmits the remote audio to the near-end audio device after processing by the audio distributor.

[0048] Optionally, after the near-end microphone collects the first microphone audio, the first microphone audio is transmitted to the ducking submodule and the mixing submodule. The far-end audio received by the near-end audio device is also transmitted to the ducking submodule and the mixing submodule, and the next step of processing is performed according to the first microphone audio and the far-end audio.

[0049] S102: Mixing the second audio and the first microphone audio to generate amplified audio for sound reinforcement, ducking the first microphone audio according to the first audio to generate ducked audio, and adaptively filtering the ducked audio and the second audio to obtain echo cancelled audio.

[0050] Optionally, mixing the second audio and the first microphone audio includes: performing audio sharing gain mixing processing on the second audio and the first microphone audio to generate amplified audio.

[0051] Optionally, mixing processing is performed by a mixing submodule, the mixing submodule encapsulates an audio mixing algorithm, and audio sharing gain mixing processing is performed on the second audio and the first microphone audio by the audio mixing algorithm.

[0052] In one embodiment, when performing audio shared gain mixing processing, the total energy is determined according to the volume or energy of the second audio and the first microphone audio, and the upper limit of the target output energy corresponding to the total energy is obtained. The shared gain factor is calculated according to the ratio of the total energy to the target value, and the shared gain is applied to the second audio and the first microphone audio based on the shared gain factor and the final gain of the second audio and the first microphone audio is obtained by combining the channel weights of the second audio and the first microphone audio. The second audio and the first microphone audio are gain-processed according to the final gain, and then the gain-processed signals are added to generate a mixed output audio. Finally, the mixed output audio is limited to obtain the amplified audio, thereby ensuring that it is within the allowable range.

[0053] Optionally, ducking the first microphone audio according to the first audio to generate the ducking audio includes: acquiring a ducking threshold according to a near-end sound reinforcement system of the near-end audio device; and ducking the first microphone audio based on a comparison result between the ducking threshold and the first audio to generate the ducking audio.

[0054] Optionally, a ducking submodule is used to perform ducking processing to generate ducking audio. The ducking submodule uses the received first microphone audio as a ducking channel and the first audio as a reference signal, and adjusts the first microphone audio based on the reference signal and a ducking threshold.

[0055] Optionally, obtaining a ducking threshold according to a sound reinforcement system of a near-end audio device includes: obtaining ducking information according to the near-end sound reinforcement system, and determining the ducking threshold based on the ducking information, wherein the ducking information includes at least one of positions of a microphone and a speaker, a microphone pickup distance, and a sound reinforcement size.

[0056] Optionally, the ducking information includes layout information of the near-end sound reinforcement system, reflection information of the near-end sound reinforcement system is obtained based on the layout information, a threshold of the nonlinear echo (ie, the ducking threshold) is obtained according to the reflection information, and the ducking threshold is used to perform ducking processing.

[0057] Optionally, ducking processing is performed on the first microphone audio based on the comparison result between the ducking threshold and the first audio, including: if it is determined that the volume or amplitude of the first audio is less than the ducking threshold, the first microphone audio is determined as ducking audio; if it is determined that the volume or amplitude of the first audio is greater than or equal to the ducking threshold, the first microphone audio is attenuated according to the ratio of the first audio to the first microphone audio to obtain the ducking audio.

[0058] Optionally, the ratio of the first audio to the first microphone audio may be a ratio of signal amplitudes. Specifically, 10 times the ratio may be used as the attenuation gain of the first microphone audio.

[0059] In one embodiment, when the volume of the first audio is less than the ducking threshold, it can be determined that the audio transmitted from the far end is small and will not form a nonlinear echo in the near-end sound reinforcement, and the first microphone audio can be directly determined as the ducking audio. When the volume of the first audio is greater than or equal to the ducking threshold, the ratio of the signal amplitude of the first audio and the first microphone audio is obtained, and the first microphone audio is adaptively attenuated according to the ratio (such as taking 10 times the ratio as the attenuation gain of the first microphone audio) to obtain the ducking audio. The nonlinearity in the audio and the amplitude of the audio can be effectively suppressed by the ducking processing.

[0060] Optionally, using the ducking audio and the second audio to perform adaptive filtering processing includes: obtaining an echo signal corresponding to an echo path, and generating echo cancellation audio according to the echo signal and the ducking audio. The echo path can be determined according to the layout of the near-end sound reinforcement system and the space where the near-end sound reinforcement system is located.

[0061] Optionally, the adaptive filtering submodule may include a filter, through which the echo path is modeled, and in order to make the echo path as close as possible to the real echo path, an adaptive filtering algorithm may be used to adjust the weight vector of the filter to approximate the real echo path when the echo path is obtained. Specifically, the adaptive filtering algorithm may be an NLMS algorithm, which gradually adjusts the weight vector of the filter by a gradient descent method, or may be other types of filtering algorithms that can be used for echo cancellation.

[0062] Optionally, the adaptive filtering submodule inputs the ducking audio into a filter, and the filter outputs an echo signal corresponding to the ducking audio. An audio signal obtained by subtracting the echo signal from the ducking audio is determined as the echo-canceled audio.

[0063] S103: Transmit the echo-cancelled audio to a remote audio device so that the remote audio device can amplify the sound and perform echo cancellation processing based on the collected second microphone audio and the echo-cancelled audio to generate new remote audio.

[0064] Optionally, the echo-cancelled audio may be transmitted to the remote audio device via a network transmission method, wherein the network transmission method may be at least one of wired transmission and wireless transmission.

[0065] Optionally, after receiving the echo-cancelled audio, the far-end audio device can perform echo cancellation processing on the second microphone audio according to the echo-cancelled audio to obtain new far-end audio, and use the far-end audio to perform far-end sound amplification and send the new far-end audio to the near-end audio device so that the near-end audio device can perform sound amplification and output new echo-cancelled audio.

[0066] Optionally, the structure of the far-end audio device may be the same as that of the near-end audio device, and the far-end audio device may include a far-end sound reinforcement system, and the structure of the far-end sound reinforcement system may be the same as that of the near-end sound reinforcement system. The far-end audio device collects the second microphone audio through the far-end microphone in the far-end sound reinforcement system, and after receiving the echo cancellation audio, the far-end sound reinforcement system may be used to mix the second microphone audio and the echo cancellation audio to obtain an audio signal that can be used for sound reinforcement, and the far-end sound reinforcement is performed based on the audio signal. The echo cancellation audio can also be used as a reference signal, and the echo cancellation audio is ducked based on the reference signal to obtain a first ducked audio, and the echo signal corresponding to the echo cancellation audio is obtained through the adaptive filter of the far-end sound reinforcement system, and the first ducked audio is adaptively filtered according to the echo signal to obtain the far-end audio. Among them, the mixing processing, ducking processing and adaptive filtering processing methods may be different from the processing methods of the near-end audio device.

[0067] The echo cancellation method of the present application collects audio from a first microphone and obtains far-end audio transmitted by a far-end audio device, wherein the far-end audio includes the first audio, the second audio and the third audio; mixes and processes the second audio and the first microphone audio to generate amplified audio for sound reinforcement, performs ducking processing on the first microphone audio according to the first audio to generate ducking audio, and performs adaptive filtering processing on the ducking audio and the second audio to obtain echo-cancelled audio; transmits the echo-cancelled audio to the far-end audio device so that the far-end audio device performs echo cancellation processing on the collected second microphone audio and echo-cancelled audio to generate new far-end audio. The present application can make full use of the accurate modeling capability of the adaptive filter for linear echoes and the suppression effect of the ducker for nonlinear residual echoes to achieve efficient echo cancellation, improve the fidelity of the sound, and can achieve simultaneous sound reinforcement at the near end and the far end, with good sound reinforcement effect and increased sound pickup distance.

[0068] Based on the same inventive concept, the embodiment of the present application also provides an echo cancellation method, which is used for a remote audio device connected to a near-end audio device, such as Figure 3 As shown, the method comprises:

[0069] S201: Collecting audio from a second microphone and receiving echo-cancelled audio transmitted by a near-end audio device.

[0070] Optionally, the echo-cancelled audio is generated by the near-end audio device through the method described in the above embodiment. The echo-cancelled audio can be transmitted to the far-end audio device in the form of network audio.

[0071] Optionally, the remote audio device may include a remote microphone, which may collect second microphone audio through the remote microphone. The second microphone audio may include a human voice at the location of the remote audio device and a reflected echo.

[0072] S202: Perform echo cancellation processing according to the second microphone audio and the echo cancellation audio to generate far-end audio, and send the far-end audio to the near-end audio device so that the near-end audio device generates new echo cancellation audio.

[0073] Optionally, the far-end audio device includes a far-end sound reinforcement system, and receiving the echo-cancelled audio transmitted by the near-end audio device includes: determining that the echo-cancelled audio is received, using the far-end sound reinforcement system to generate the echo-cancelled audio and the mixed audio corresponding to the second microphone, and performing sound reinforcement processing on the mixed audio; sending the far-end audio to the near-end audio device includes: using an audio distributor to process the far-end audio, generating the first audio, the second audio, and the third audio, and sending the first audio, the second audio, and the third audio to the near-end audio device. The first audio, the second audio, and the third audio are respectively sent to different submodules in the near-end audio device for different processing.

[0074] The beneficial effects of the echo cancellation method of the present application are as follows:

[0075] 1. Long sound pickup distance: By amplifying both near-end and far-end sound, the local sound pickup distance exceeds 40cm, allowing speakers to communicate naturally without deliberately aiming at the microphone or changing the speaking volume.

[0076] 2. Improve collaboration efficiency: It can simultaneously amplify near-end and far-end audio locally, ensuring that participants can clearly hear the speeches of both near-end and far-end speakers in large-space scenarios.

[0077] 3. Natural restoration of remote voice: The remote audio is restored on site through sound reinforcement, so that the audience can hear the sound in full without relying on a single sound source (such as speakers or headphones).

[0078] 4. Echo suppression: Combining ducking with adaptive filtering can amplify the sound while avoiding howling or echo interference, improving audio quality.

[0079] 5. Expand complex scenarios: It can adapt to environments with multiple nonlinear interferences (such as low-quality equipment or high sound pressure scenarios) and expand the working range and working effect of audio devices.

[0080] 6. Flexible speaking: Near-end speakers can be clearly picked up and amplified without having to deliberately aim at the microphone, increasing the flexibility and convenience of speaking.

[0081] Based on the same inventive concept, the embodiment of the present application provides an electronic device, such as Figure 4 As shown, Figure 4 The electronic device 2000 shown includes: a processor 2001 and a memory 2003. The processor 2001 and the memory 2003 are connected in communication with each other, for example, via a bus 2002.

[0082] Processor 2001 may be a CPU (Central Processing Unit), a general-purpose processor, a DSP (Digital Signal Processor), an ASIC (Application Specific Integrated Circuit), an FPGA (Field-Programmable Gate Array) or other programmable logic devices, transistor logic devices, hardware components or any combination thereof. It may implement or execute various exemplary logic blocks, modules and circuits described in conjunction with the disclosure of this application. Processor 2001 may also be a combination that implements computing functions, such as a combination of one or more microprocessors, a combination of a DSP and a microprocessor, etc.

[0083] The bus 2002 may include a path to transmit information between the above components. The bus 2002 may be a PCI (Peripheral Component Interconnect) bus or an EISA (Extended Industry Standard Architecture) bus. The bus 2002 may be divided into an address bus, a data bus, a control bus, etc. For ease of representation, only one thick line is used in the figure, but it does not mean that there is only one bus or one type of bus.

[0084] The memory 2003 can be a ROM (Read-Only Memory) or other types of static storage devices that can store static information and instructions, a RAM (random access memory) or other types of dynamic storage devices that can store information and instructions, or an EEPROM (Electrically Erasable Programmable Read Only Memory), a CD-ROM (Compact Disc Read-Only Memory) or other optical disk storage, optical disk storage (including compressed optical disk, laser disk, optical disk, digital versatile disk, Blu-ray disk, etc.), a magnetic disk storage medium or other magnetic storage device, or any other medium that can be used to carry or store the desired program code in the form of instructions or data structures and can be accessed by a computer, but is not limited to this.

[0085] Optionally, the electronic device 2000 may further include a communication unit 2004. The communication unit 2004 may be used for receiving and sending signals. The communication unit 2004 may allow the electronic device 2000 to communicate with other devices wirelessly or by wire to exchange data. It should be noted that in actual applications, the communication unit 2004 is not limited to one.

[0086] Optionally, the electronic device 2000 may further include an input unit 2005. The input unit 2005 may be used to receive input digital, character, image and / or sound information, or generate key signal input related to user settings and function control of the electronic device 2000. The input unit 2005 may include, but is not limited to, one or more of a touch screen, a physical keyboard, a function key (such as a volume control key, a switch key, etc.), a trackball, a mouse, a joystick, a camera, a microphone, etc.

[0087] Optionally, the electronic device 2000 may further include an output unit 2006. The output unit 2006 may be used to output or display information processed by the processor 2001. The output unit 2006 may include but is not limited to one or more of a display device, a speaker, a vibration device, and the like.

[0088] Although the electronic device 2000 having various devices is shown in the figure, it should be understood that it is not required to implement or possess all the devices shown. More or fewer devices may be implemented or possessed instead.

[0089] Optionally, the memory 2003 is used to store a computer program for executing the solution of the present application, and the execution is controlled by the processor 2001. The processor 2001 is used to execute the computer program stored in the memory 2003 to implement the steps of any method provided in the embodiments of the present application.

[0090] Based on the same inventive concept, an embodiment of the present application provides a computer-readable storage medium, on which a computer program is stored. When the computer program is executed by an electronic device / processor, it implements the steps of any method provided in the present application / implements the steps of various optional implementation methods of the method provided in the present application.

[0091] Those skilled in the art will appreciate that the various operations, methods, steps, measures, and schemes in the processes discussed in this application may be alternated, changed, combined, or deleted. Furthermore, other steps, measures, and schemes in the various operations, methods, and processes discussed in this application may also be alternated, changed, rearranged, decomposed, combined, or deleted. Furthermore, steps, measures, and schemes in the related art that are similar to those disclosed in this application may also be alternated, changed, rearranged, decomposed, combined, or deleted.

[0092] In the description of the present application, the directions or positional relationships indicated by words such as "center", "up", "down", "front", "back", "left", "right", "vertical", "horizontal", "top", "bottom", "inside" and "outside" are based on the exemplary directions or positional relationships shown in the accompanying drawings. They are for the convenience of describing or simplifying the description of the embodiments of the present application, and do not indicate or imply that the referred device or component must have a specific orientation, or be constructed and operated in a specific orientation. Therefore, they should not be understood as limitations on the present application.

[0093] The terms "first" and "second" are used for descriptive purposes only and should not be understood as indicating or implying relative importance or implicitly indicating the number of the indicated technical features. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of the features. In the description of this application, unless otherwise specified, "plurality" means two or more.

[0094] In the description of this application, it should be noted that, unless otherwise clearly specified and limited, the terms "installed", "connected", and "connected" should be understood in a broad sense, for example, it can be a fixed connection, a detachable connection, or an integral connection; it can be a direct connection, or an indirect connection through an intermediate medium, or it can be the internal communication of two components. For ordinary technicians in this field, the specific meanings of the above terms in this application can be understood according to specific circumstances.

[0095] In the description of this specification, specific features, structures, materials or characteristics may be combined in an appropriate manner in any one or more embodiments or examples.

[0096] The above is only a partial implementation method of the present application. It should be pointed out that for ordinary technicians in this technical field, without departing from the technical concept of the scheme of the present application, other similar implementation methods based on the technical ideas of the present application are also within the protection scope of the embodiments of the present application.

Claims

1. An echo cancellation method, characterized in that: A near-end audio device for connecting to a far-end audio device, the method comprising: Collecting audio from a first microphone and acquiring remote audio transmitted by a remote audio device, wherein the remote audio includes a first audio, a second audio, and a third audio; Mixing the second audio and the first microphone audio to generate amplified audio for sound reinforcement, performing ducking processing on the first microphone audio according to the first audio to generate ducking audio, and performing adaptive filtering processing on the ducking audio and the second audio to obtain echo-cancelled audio; The echo-cancelled audio is transmitted to the remote audio device so that the remote audio device performs sound amplification and performs echo cancellation processing based on the collected second microphone audio and the echo-cancelled audio to generate new remote audio.

2. The echo cancellation method according to claim 1, characterized in that: The echo cancellation process includes ducking process and adaptive filtering process. The ducking process and the adaptive filtering process of the far-end audio device are performed in the same manner as those of the near-end audio device.

3. The echo cancellation method according to claim 1, characterized in that: The mixing process of the second audio and the first microphone audio includes: The second audio and the first microphone audio are mixed using an audio sharing gain to generate amplified audio.

4. The echo cancellation method according to claim 1, characterized in that: The performing ducking processing on the first microphone audio according to the first audio to generate ducking audio includes: Acquire a ducking threshold according to a near-end sound reinforcement system of the near-end audio device; The first microphone audio is subjected to ducking processing based on a comparison result between the ducking threshold and the first audio to generate the ducking audio.

5. The echo cancellation method according to claim 4, characterized in that: The near-end sound reinforcement system includes a near-end microphone and a speaker, and the step of obtaining the ducking threshold according to the sound reinforcement system of the near-end audio device includes: The ducking information is obtained according to the near-end sound reinforcement system, and a ducking threshold is determined based on the ducking information, wherein the ducking information includes at least one of the positions of a microphone and a speaker, a microphone pickup distance, and a sound reinforcement size.

6. The echo cancellation method according to claim 4, characterized in that: The performing ducking processing on the first microphone audio based on the comparison result between the ducking threshold and the first audio includes: If it is determined that the volume or amplitude of the first audio is less than the ducking threshold, determining the first microphone audio as ducking audio; If it is determined that the volume or amplitude of the first audio is greater than or equal to the ducking threshold, the first microphone audio is attenuated according to a ratio of the first audio to the first microphone audio to obtain the ducking audio.

7. The echo cancellation method according to claim 1, characterized in that: The step of using the ducking audio and the second audio to perform adaptive filtering processing includes: An echo signal corresponding to the echo path is acquired, and the echo cancellation audio is generated according to the echo signal and the ducking audio.

8. An echo cancellation method, characterized in that: A method for a far-end audio device connected to a near-end audio device, comprising: Collecting audio from a second microphone, and receiving echo-cancelled audio transmitted by the near-end audio device, wherein the echo-cancelled audio is generated by the near-end audio device using the method according to any one of claims 1 to 7; Perform echo cancellation processing according to the second microphone audio and the echo cancellation audio to generate far-end audio, and send the far-end audio to the near-end audio device so that the near-end audio device generates new echo cancellation audio.

9. The echo cancellation method according to claim 8, characterized in that: The far-end audio device includes a far-end sound reinforcement system, and the receiving of the echo-cancelled audio transmitted by the near-end audio device includes: Determine that the echo-cancelled audio is received, generate the echo-cancelled audio and a mixed audio corresponding to the second microphone using the remote sound reinforcement system, and perform sound reinforcement processing on the mixed audio; The sending the far-end audio to the near-end audio device includes: The far-end audio is processed by an audio distributor to generate a first audio, a second audio, and a third audio, and the first audio, the second audio, and the third audio are sent to the near-end audio device.

10. An electronic device comprising a memory, a processor and a computer program stored in the memory, characterized in that: The processor executes the computer program to implement the steps of the method according to any one of claims 1-9.

Images