Echo cancellation system and method, and display device
By generating a calibrated audio signal and measuring the delay parameters, and using filtering and phase comparison techniques to determine the target delay parameters, the problem of poor echo cancellation performance in far-field environments by traditional echo cancellation methods is solved, achieving higher accuracy and lower computational complexity.
Patent Information
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- SHENZHEN TCL NEW-TECH CO LTD
- Filing Date
- 2025-09-16
- Publication Date
- 2026-05-21
Smart Images
Figure CN2025121583_21052026_PF_FP_ABST
Abstract
Description
Echo cancellation system, method and display device
[0001] This application claims priority to Chinese Patent Application No. 202411650557.X, filed on November 18, 2024, entitled "Echo Cancellation System, Method, Display Device and Computer-Readable Storage Medium", the entire contents of which are incorporated herein by reference. Technical Field
[0002] This application relates to the field of speech processing technology, specifically to an echo cancellation system, method, and display device. Background Technology
[0003] With the rapid development of speech recognition and voice control technologies, voice interaction systems have been widely used in smart homes, in-vehicle systems, and conferencing systems. However, in practical applications, far-field voice interaction systems face numerous challenges. One of the most significant problems is that the sound emitted by the system itself is picked up by the microphone, creating echo interference that affects the normal acquisition of external human voices. Therefore, echo cancellation technology is needed to eliminate the influence of the sound emitted by the system itself on the acquisition of external human voices. Technical issues
[0004] Traditional echo cancellation methods primarily rely on adaptive filtering techniques, which eliminate echo signals in the echo path by sampling the electrical signal output from the loudspeaker or the audio signal before the audio signal amplifier. However, due to the long and complex echo paths in far-field environments, traditional adaptive filters struggle to accurately estimate and eliminate all echo components, resulting in poor echo cancellation performance. Technical solutions
[0005] This application provides an echo cancellation system, method, and display device that can accurately measure delay parameters and improve the accuracy of echo cancellation.
[0006] In a first aspect, this application provides an echo cancellation system, comprising:
[0007] An audio signal generator is used to generate a first calibration audio signal;
[0008] An audio signal processing module is used to transmit the first calibration audio signal to the speaker;
[0009] The pickup module is used to receive the first calibration audio signal output by the speaker and obtain the second calibration audio signal;
[0010] The delay determination module, connected to the sound pickup module and the audio signal processing module, is used to determine the target delay parameter based on the first calibration audio signal and the second calibration audio signal.
[0011] The echo cancellation module, connected to the delay determination module, the pickup module, and the audio signal processing module, is used to perform echo cancellation processing on the audio signal to be processed acquired by the pickup module based on the target delay parameters and the original audio signal output by the audio signal processing module, so as to obtain the target audio signal.
[0012] In some embodiments of this application, the delay determination module includes:
[0013] The first filtering unit is connected to the audio signal processing module and is used to filter the first calibration audio signal to obtain the third calibration audio signal.
[0014] The second filtering unit, connected to the microphone module, is used to filter the second calibration audio signal to obtain the fourth calibration audio signal.
[0015] The delay determination unit, connected to the first filtering unit and the second filtering unit, is used to determine the target delay parameters based on the third calibration audio signal and the fourth calibration audio signal.
[0016] In some embodiments of this application, both the third calibration audio signal and the fourth calibration audio signal include multiple signals, with each of the multiple third calibration audio signals and the multiple fourth calibration audio signals corresponding one-to-one. The delay determination unit includes:
[0017] The first determining unit is used to perform phase comparison on each third calibration audio signal and the fourth calibration audio signal corresponding to each third calibration audio signal to obtain multiple first delay parameters;
[0018] The second determining unit is used to calculate and process multiple first delay parameters to obtain the target delay parameters.
[0019] In some embodiments of this application, multiple first delay parameters are calculated and processed to obtain target delay parameters, including:
[0020] Averaging of multiple first delay parameters;
[0021] The average value of multiple first delay parameters is determined as the target delay parameter.
[0022] In some embodiments of this application, multiple first delay parameters are calculated and processed to obtain target delay parameters, including:
[0023] Perform a weighted summation of multiple first delay parameters;
[0024] The weighted sum of multiple first delay parameters is determined as the target delay parameter.
[0025] In some embodiments of this application, both the third calibration audio signal and the fourth calibration audio signal are singular. The delay determination unit determines the target delay parameters based on the third calibration audio signal and the fourth calibration audio signal, including:
[0026] The target delay parameter is obtained by comparing the phase of the third and fourth calibration audio signals.
[0027] In some embodiments of this application, the echo cancellation module includes:
[0028] The delay processing unit, connected to the delay determination module and the audio signal processing module, is used to perform delay processing on the original audio signal output by the audio signal processing module based on the target delay parameters to obtain the first audio signal;
[0029] The echo cancellation unit, connected to the delay processing unit and the pickup module, is used to perform echo cancellation processing on the audio signal to be processed acquired by the pickup module based on the first audio signal, so as to obtain the target audio signal.
[0030] In some embodiments of this application, the audio signal processing module includes: an audio signal processing unit, an audio sampling unit, and an audio signal output unit;
[0031] The audio signal processing unit is connected to the audio signal generator, the audio sampling unit, and the audio signal output unit, and is used to transmit the first calibration audio signal and the original audio signal to the audio sampling unit and the audio signal output unit.
[0032] The audio sampling unit is connected to the delay determination module and the echo cancellation module, and is used to transmit the first calibration audio signal to the delay determination module and the original audio signal to the echo cancellation module;
[0033] An audio signal output unit is used to transmit a first calibration audio signal and a raw audio signal to a speaker so as to output the first calibration audio signal and the raw audio signal through the speaker.
[0034] In some embodiments of this application, the speaker is built into the display device, and the echo cancellation system further includes: a first signal amplification module; the first signal amplification module is connected to the audio signal output unit and the speaker;
[0035] The first signal amplification module is used to amplify the first calibration audio signal and the original audio signal output by the audio signal output unit, and transmit the amplified first calibration audio signal and the original audio signal to the speaker so as to output the first calibration audio signal and the original audio signal through the speaker.
[0036] In some embodiments of this application, the speaker is mounted on an external active speaker enclosure, which includes: an audio signal receiving module, a second signal amplification module, and a speaker; the audio signal receiving module is connected to an audio signal output unit and the second signal amplification module, and the second signal amplification module is connected to the speaker.
[0037] The audio signal receiving module is used to receive the first calibration audio signal and the original audio signal output by the audio signal output unit, and transmit the first calibration audio signal and the original audio signal to the second signal amplification module;
[0038] The second signal amplification module is used to amplify the first calibration audio signal and the original audio signal, and transmit the amplified first calibration audio signal and the original audio signal to the speaker so that the first calibration audio signal and the original audio signal can be output through the speaker.
[0039] In some embodiments of this application, the echo cancellation system further includes:
[0040] The audio recognition module, connected to the echo cancellation module, is used to recognize and process the target audio signal to obtain target recognition information.
[0041] Secondly, embodiments of this application also provide an echo cancellation method, comprising:
[0042] A first calibration audio signal is generated using an audio signal generator;
[0043] The first calibration audio signal is transmitted to the speaker;
[0044] Receive the first calibration audio signal output from the speaker to obtain the second calibration audio signal;
[0045] The target delay parameters are determined based on the first and second calibration audio signals.
[0046] Based on the target delay parameters and the original audio signal, echo cancellation processing is performed on the audio signal to be processed to obtain the target audio signal.
[0047] In some embodiments of this application, the target delay parameter is determined based on the first calibration audio signal and the second calibration audio signal, including:
[0048] The first calibration audio signal is filtered to obtain the third calibration audio signal;
[0049] The second calibration audio signal is filtered to obtain the fourth calibration audio signal;
[0050] The target delay parameters are determined based on the third and fourth calibration audio signals.
[0051] In some embodiments of this application, both the third calibration audio signal and the fourth calibration audio signal include multiple signals, and the multiple third calibration audio signals and the multiple fourth calibration audio signals correspond one-to-one.
[0052] Based on the third and fourth calibration audio signals, the target delay parameters are determined, including:
[0053] Phase comparison is performed on each third calibration audio signal and the corresponding fourth calibration audio signal to obtain multiple first delay parameters;
[0054] The target delay parameter is obtained by calculating and processing multiple first delay parameters.
[0055] In some embodiments of this application, multiple first delay parameters are calculated and processed to obtain target delay parameters, including:
[0056] Averaging of multiple first delay parameters;
[0057] The average value of multiple first delay parameters is determined as the target delay parameter.
[0058] In some embodiments of this application, multiple first delay parameters are calculated and processed to obtain target delay parameters, including:
[0059] Perform a weighted summation of multiple first delay parameters;
[0060] The weighted sum of multiple first delay parameters is determined as the target delay parameter.
[0061] In some embodiments of this application, both the third calibration audio signal and the fourth calibration audio signal are singular. Based on the third calibration audio signal and the fourth calibration audio signal, the target delay parameter is determined, including:
[0062] The target delay parameter is obtained by comparing the phase of the third and fourth calibration audio signals.
[0063] In some embodiments of this application, echo cancellation processing is performed on the audio signal to be processed based on the target delay parameter and the original audio signal to obtain the target audio signal, including:
[0064] The original audio signal is delayed based on the target delay parameter to obtain the first audio signal;
[0065] The target audio signal is obtained by performing echo cancellation processing on the audio signal to be processed based on the first audio signal.
[0066] In some embodiments of this application, after performing echo cancellation processing on the audio signal to be processed based on the target delay parameter and the original audio signal to obtain the target audio signal, the process includes:
[0067] The target audio signal is processed to obtain target identification information.
[0068] Thirdly, this application also provides a display device, which includes the echo cancellation system of any one of the first aspects.
[0069] Fourthly, embodiments of this application provide a computer-readable storage medium having a computer program stored thereon, the computer program being loaded by a processor to perform the steps of the echo cancellation method of any of the second aspects. Beneficial effects
[0070] A first calibration audio signal is generated by an audio signal generator. A second calibration audio signal is obtained by receiving the first calibration audio signal output from the speaker through a pickup module. The target delay parameter is then determined based on the first and second calibration audio signals, allowing for precise measurement of the delay parameter. Echo cancellation processing is performed on the audio signal to be processed output by the pickup module based on the target delay parameter and the original audio signal. This process can identify and eliminate sound signals actively emitted by the display device itself in the audio signal to be processed collected by the pickup module, retaining only audio signals not actively emitted by the device, thereby improving the accuracy of echo cancellation. Attached Figure Description
[0071] To more clearly illustrate the technical solutions in the embodiments of this application or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments recorded in this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.
[0072] Figure 1 is a first structural block diagram of the echo cancellation system provided in an embodiment of this application;
[0073] Figure 2 is a second structural block diagram of the echo cancellation system provided in an embodiment of this application;
[0074] Figure 3 is a third structural block diagram of the echo cancellation system provided in the embodiments of this application;
[0075] Figure 4 is a fourth structural block diagram of the echo cancellation system provided in the embodiments of this application;
[0076] Figure 5 is a fifth structural block diagram of the echo cancellation system provided in the embodiments of this application;
[0077] Figure 6 is a sixth structural block diagram of the echo cancellation system provided in the embodiments of this application;
[0078] Figure 7 is a schematic flowchart of the echo cancellation method provided in the embodiments of this application. Detailed Implementation
[0079] The technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this application, and not all embodiments. Based on the embodiments of this application, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this application.
[0080] In the description of this application, the terms "first," "second," "third," etc., are used for descriptive purposes only and should not be construed as indicating or implying relative importance or implicitly specifying the number of technical features indicated. Therefore, a feature defined with "first," "second," "third," etc., may explicitly or implicitly include one or more of the stated features.
[0081] In this application, the term "exemplary" is used to mean "used as an example, illustration, or description." Any embodiment described as "exemplary" in this application is not necessarily to be construed as being more preferred or advantageous than other embodiments. The following description is provided to enable any person skilled in the art to make and use this application. Details are set forth in the following description for purposes of explanation. It should be understood that those skilled in the art will recognize that this application can be made without using these specific details. In other instances, well-known structures and processes are not described in detail to avoid obscuring the description of this application with unnecessary detail. Therefore, this application is not intended to be limited to the embodiments shown, but is consistent with the broadest scope of the principles and features disclosed in this application.
[0082] This application provides an echo cancellation system, method, and display device, which will be described in detail below.
[0083] Please refer to Figure 1, which is a schematic diagram of an echo cancellation system provided in an embodiment of this application. The echo cancellation system includes an audio signal generator 10, an audio signal processing module 20, a pickup module 30, a delay determination module 40, and an echo cancellation module 50. The audio signal generator 10 generates a first calibration audio signal; the audio signal processing module 20 transmits the first calibration audio signal to a speaker 60; the pickup module 30 receives the first calibration audio signal output from the speaker 60 to obtain a second calibration audio signal; the delay determination module 40 is connected to the pickup module 30 and the audio signal processing module 20, and determines a target delay parameter based on the first and second calibration audio signals; the echo cancellation module 50 is connected to the delay determination module 40, the pickup module 30, and the audio signal processing module 20, and performs echo cancellation processing on the audio signal to be processed acquired by the pickup module based on the target delay parameter and the original audio signal output by the audio signal processing module to obtain the target audio signal. In this embodiment, an audio signal generator 10 generates a first calibration audio signal, and a pickup module 30 receives the first calibration audio signal output by the speaker 60 to obtain a second calibration audio signal. The target delay parameter is then determined based on the first calibration audio signal and the second calibration audio signal, which allows for accurate measurement of the delay parameter.
[0084] In one specific embodiment, the echo cancellation system is applied to a display device, such as a television, projector, or computer. The original audio signal is the sound signal actively emitted by the display device itself, and the audio signal to be processed is the ambient audio signal collected by the pickup module 30, which includes the original audio signal output by the display device through the speaker 60 and the voice signal emitted by the user to the terminal device. This embodiment performs echo cancellation processing on the audio signal to be processed collected by the pickup module 30 based on the target delay parameter and the original audio signal. It can identify and eliminate the sound signal actively emitted by the display device itself in the audio signal to be processed collected by the pickup module 30, retaining only the audio signal not actively emitted by the display device (i.e., the voice signal emitted by the user to the terminal device). This can improve the accuracy of echo cancellation and reduce the computational complexity compared to traditional echo cancellation methods that rely on adaptive filtering technology.
[0085] Optionally, the target delay parameter can be determined during the power-on to normal operation phase of the display device, or during the normal operation phase of the display device. When the target delay parameter is determined during the power-on to normal operation phase of the display device, the frequency range of the first calibration audio signal can be selected arbitrarily based on the response frequency range of the speaker 60 or the pickup module 30. When the target delay parameter is determined during the normal operation phase of the display device, in order to avoid the first calibration audio signal affecting the normal use of the display device, the frequency range of the first calibration audio signal is a frequency range that is inaudible to the human ear, for example, the frequency range of the first calibration audio signal is 20KHz to 25KHz.
[0086] In some embodiments, the display device can receive a target delay parameter determination instruction input by a user via a mouse, keyboard, or other means, and determine the target delay parameter based on the user-input instruction. In other embodiments, the display device can also automatically determine the target delay parameter at preset intervals during normal operation, thereby enabling the display device to periodically calibrate the delay parameter and ensure the accuracy of echo cancellation.
[0087] In one specific embodiment, the sound pickup module can be a microphone array. Referring to Figures 2 and 3, the audio signal processing module 20 includes an audio signal processing unit 21, an audio sampling unit 22, and an audio signal output unit 23. The audio signal processing unit 21 is connected to the audio signal generator 10, the audio sampling unit 22, and the audio signal output unit 23. The audio signal processing unit 21 is used to transmit a first calibration audio signal and a raw audio signal to the audio sampling unit 22 and the audio signal output unit 23. The audio sampling unit 22 is connected to the delay determination module 40 and the echo cancellation module 50, and is used to transmit the first calibration audio signal to the delay determination module 40 and the raw audio signal to the echo cancellation module 50. The audio signal output unit 23 is used to transmit the first calibration audio signal and the raw audio signal to the speaker 60, so that the first calibration audio signal and the raw audio signal are output through the speaker 60.
[0088] In one specific embodiment, continuing to refer to FIG2, the speaker 60 is built into the display device, and the echo cancellation system further includes: a first signal amplification module 70; the first signal amplification module 70 is connected to the audio signal output unit 23 and the speaker 60, and the first signal amplification module 70 is used to amplify the first calibration audio signal and the original audio signal output by the audio signal output unit 23, and transmit the amplified first calibration audio signal and the original audio signal to the speaker 60 so as to output the first calibration audio signal and the original audio signal through the speaker 60.
[0089] In another specific embodiment, referring to FIG3, the speaker 60 is disposed on the external active speaker 80, which includes an audio signal receiving module 81, a second signal amplification module 82, and the speaker 60. The audio signal receiving module 81 is connected to the audio signal output unit 23 and the second signal amplification module 82, and the second signal amplification module 82 is connected to the speaker 60. The audio signal output unit 23 can transmit a first calibration audio signal and a raw audio signal to the external active speaker 80 via wired or wireless means. The audio signal receiving module 81 receives the first calibration audio signal and the raw audio signal output by the audio signal output unit 23 and transmits them to the second signal amplification module 82. The second signal amplification module 82 amplifies the first calibration audio signal and the raw audio signal and transmits the amplified first calibration audio signal and the raw audio signal to the speaker 60, so that the first calibration audio signal and the raw audio signal are output through the speaker 60.
[0090] In one specific embodiment, referring to FIG4, the delay determination module 40 includes a first filtering unit 41, a second filtering unit 42, and a delay determination unit 43. The first filtering unit 41 is connected to the audio signal processing module 20, the second filtering unit 42 is connected to the pickup module 30, and the delay determination unit 43 is connected to both the first filtering unit 41 and the second filtering unit 42. Specifically, the first filtering unit 41 filters the first calibration audio signal output by the audio signal processing module 20 to obtain a third calibration audio signal; the second filtering unit 42 filters the second calibration audio signal acquired by the pickup module 30 to obtain a fourth calibration audio signal; and the delay determination unit 43 determines a target delay parameter based on the third and fourth calibration audio signals.
[0091] In this embodiment, the first filtering unit 41 can select a filter with bandpass filtering mode, high-pass filtering mode, or low-pass filtering mode, etc., according to the frequency of the first calibration audio signal. When the first filtering unit 41 filters the first calibration audio signal, it filters the first calibration audio signal based on the frequency of the first calibration audio signal. In this embodiment, by filtering the first calibration audio signal through the first filtering unit 41, interference signals in the first calibration audio signal can be filtered out, thereby improving the accuracy of the determined target delay parameter and thus improving the echo cancellation effect of the audio signal to be processed.
[0092] Furthermore, in this embodiment, the second filtering unit 42 can also select a bandpass filter, a high-pass filter, or a low-pass filter based on the frequency of the first calibration audio signal. When the second filtering unit 42 filters the second calibration audio signal, it does so based on the frequency of the first calibration audio signal. In this embodiment, by using the second filtering unit 42 to filter the second calibration audio signal, interference signals in the second calibration audio signal can be filtered out, thereby improving the accuracy of the determined target delay parameters and thus improving the echo cancellation effect of the audio signal to be processed.
[0093] In some embodiments, a first calibration audio signal can be generated by the audio signal generator 10 to determine the target delay parameter, and then both the third and fourth calibration audio signals are one. Accordingly, the delay determination unit 43 determines the target delay parameter based on the third and fourth calibration audio signals by performing a phase comparison between the third and fourth calibration audio signals to obtain the target delay parameter.
[0094] In other embodiments, the target delay parameter can be determined by generating multiple first calibration audio signals using an audio signal generator 10. In this case, both the third and fourth calibration audio signals are multiple, and each of the multiple third and fourth calibration audio signals corresponds one-to-one. Correspondingly, the delay determination unit 43 includes a first determination unit and a second determination unit. The first determination unit performs phase comparison on each third calibration audio signal and its corresponding fourth calibration audio signal to obtain multiple first delay parameters. The second determination unit performs calculations on the multiple first delay parameters to obtain the target delay parameter. This embodiment obtains the target delay parameter by calculating multiple first delay parameters, which can further improve the accuracy of the obtained target delay parameter.
[0095] When the second determining unit calculates and processes multiple first delay parameters, it can average the multiple first delay parameters and determine the average value of the multiple first delay parameters as the target delay parameter; the second determining unit can also perform a weighted summation of the multiple first delay parameters and determine the weighted summation result of the multiple first delay parameters as the target delay parameter; of course, the second determining unit can also determine any one of the multiple first delay parameters as the target delay parameter, which is not limited in this embodiment.
[0096] In one specific embodiment, referring to FIG5, the echo cancellation module 50 includes a delay processing unit 51 and an echo cancellation unit 52; the delay processing unit 51 is connected to the delay determination module 40 and the audio signal processing module 20; the echo cancellation unit 52 is connected to the delay processing unit 51 and the pickup module 30. The delay processing unit 51 is used to perform delay processing on the original audio signal output by the audio signal processing module 20 based on a target delay parameter to obtain a first audio signal; the echo cancellation unit 52 is used to perform echo cancellation processing on the audio signal to be processed acquired by the pickup module 30 based on the first audio signal to obtain a target audio signal.
[0097] In one specific embodiment, referring to FIG6, the echo cancellation system further includes an audio recognition module 90. The audio recognition module 90 is connected to the echo cancellation module 50 and is used to recognize and process the target audio signal to obtain target recognition information. The target recognition information includes user control commands for the display device, enabling voice control of the display device based on the target recognition information.
[0098] To better implement the echo cancellation system in this application embodiment, an echo cancellation method is also provided based on the echo cancellation system, as shown in Figure 7. The echo cancellation method includes:
[0099] S10. Generate a first calibration audio signal using an audio signal generator;
[0100] S20. Transmit the first calibration audio signal to the speaker;
[0101] S30: Receive the first calibration audio signal output by the speaker to obtain the second calibration audio signal;
[0102] S40. Determine the target delay parameters based on the first calibration audio signal and the second calibration audio signal;
[0103] S50. Based on the target delay parameters and the original audio signal, perform echo cancellation processing on the audio signal to be processed to obtain the target audio signal.
[0104] In one specific embodiment, the echo cancellation system is applied to a display device, such as a television, projector, or computer. The original audio signal is the sound signal actively emitted by the display device itself, and the audio signal to be processed is the ambient audio signal collected by the sound pickup module, which includes the original audio signal output by the display device through its speaker and the voice signal emitted by the user to the terminal device. In this embodiment, a first calibration audio signal is generated by an audio signal generator, and a second calibration audio signal is obtained by receiving the first calibration audio signal output by the speaker. The target delay parameter is then determined based on the first and second calibration audio signals, allowing for accurate measurement of the delay time. Furthermore, by performing echo cancellation processing on the audio signal to be processed based on the target delay parameter and the original audio signal, the sound signal actively emitted by the display device itself can be identified and eliminated, retaining only the audio signal not actively emitted by the display device (i.e., the voice signal emitted by the user to the terminal device). This improves the accuracy of echo cancellation and reduces computational complexity compared to traditional echo cancellation methods that rely on adaptive filtering techniques.
[0105] Optionally, the target delay parameter can be determined during the power-on to normal operation phase of the display device, or it can be determined during the normal operation of the display device. When the target delay parameter is determined during the power-on to normal operation phase of the display device, the frequency range of the first calibration audio signal can be selected from any frequency range based on the response frequency range of the speaker or pickup module. When the target delay parameter is determined during the normal operation of the display device, in order to avoid the first calibration audio signal affecting the normal use of the display device, the frequency range of the first calibration audio signal is a frequency range that is inaudible to the human ear, for example, the frequency range of the first calibration audio signal is 20KHz to 25KHz.
[0106] In some embodiments, the display device can receive a target delay parameter determination instruction input by a user via a mouse, keyboard, or other means, and determine the target delay parameter based on the user-input instruction. In other embodiments, the display device can also automatically determine the target delay parameter at preset intervals during normal operation, thereby enabling the display device to periodically calibrate the delay parameter and ensure the accuracy of echo cancellation.
[0107] In practical implementation, the speaker can be built into the display device or mounted on an external active speaker. When the speaker is mounted on an external active speaker, the display device can transmit the first calibration audio signal and the original audio signal to the speaker via wired or wireless means, so that the speaker can output the first calibration audio signal and the original audio signal. The echo cancellation method provided in this embodiment is applicable to display devices with different speaker configurations, such as built-in or external speakers, and has strong applicability.
[0108] In some embodiments, the step of determining the target delay parameter based on the first calibration audio signal and the second calibration audio signal in step S40 specifically includes: filtering the first calibration audio signal to obtain a third calibration audio signal; filtering the second calibration audio signal to obtain a fourth calibration audio signal; and determining the target delay parameter based on the third calibration audio signal and the fourth calibration audio signal.
[0109] In one specific embodiment, a filter with bandpass filtering mode, high-pass filtering mode, or low-pass filtering mode can be selected to filter the first calibration audio signal according to the frequency of the first calibration audio signal. In this embodiment, by filtering the first calibration audio signal, interference signals in the first calibration audio signal can be filtered out, thereby improving the accuracy of the determined target delay parameters and thus improving the echo cancellation effect of the audio signal to be processed.
[0110] Furthermore, a filter with bandpass filtering mode, high-pass filtering mode, or low-pass filtering mode can be selected according to the frequency of the first calibration audio signal to filter the second calibration audio signal. In this embodiment, by filtering the second calibration audio signal, interference signals in the second calibration audio signal can be filtered out, thereby improving the accuracy of the determined target delay parameters and thus improving the echo cancellation effect of the audio signal to be processed.
[0111] In some embodiments, a first calibration audio signal can be generated by an audio signal generator to determine the target delay parameter, and then there are one third calibration audio signal and one fourth calibration audio signal. Accordingly, the step of determining the target delay parameter based on the third calibration audio signal and the fourth calibration audio signal specifically includes: performing a phase comparison on the third calibration audio signal and the fourth calibration audio signal to obtain the target delay parameter.
[0112] In other embodiments, the target delay parameter can be determined by generating multiple first calibration audio signals using an audio signal generator. In this case, both the third and fourth calibration audio signals are multiple, and each set of third and fourth calibration audio signals corresponds one-to-one. Accordingly, the step of determining the target delay parameter based on the third and fourth calibration audio signals specifically includes: performing a phase comparison between each third calibration audio signal and its corresponding fourth calibration audio signal to obtain multiple first delay parameters; and performing calculations on the multiple first delay parameters to obtain the target delay parameter. This embodiment, by calculating and processing multiple first delay parameters to obtain the target delay parameter, can further improve the accuracy of the obtained target delay parameter.
[0113] In some embodiments, the step of calculating and processing multiple first delay parameters to obtain a target delay parameter specifically includes: averaging the multiple first delay parameters and determining the average value of the multiple first delay parameters as the target delay parameter.
[0114] In other embodiments, the step of calculating and processing multiple first delay parameters to obtain a target delay parameter specifically includes: performing a weighted summation on multiple first delay parameters, and determining the weighted summation result of multiple first delay parameters as the target delay parameter.
[0115] Of course, in this embodiment, any one of the multiple first delay parameters can be determined as the target delay parameter. For example, the maximum value among the multiple first delay parameters can be determined as the target delay parameter, or the intermediate value among the multiple first delay parameters can be determined as the target delay parameter, or the minimum value among the multiple first delay parameters can be determined as the target delay parameter, etc.
[0116] In some embodiments, the step S50 above, which involves performing echo cancellation processing on the audio signal to be processed based on the target delay parameter and the original audio signal to obtain the target audio signal, specifically includes: performing delay processing on the original audio signal based on the target delay parameter to obtain a first audio signal; and performing echo cancellation processing on the audio signal to be processed based on the first audio signal to obtain the target audio signal.
[0117] In some embodiments, after performing echo cancellation processing on the audio signal to be processed based on the target delay parameter and the original audio signal to obtain the target audio signal in step S50, the process includes: performing recognition processing on the target audio signal to obtain target recognition information. The target recognition information includes user control commands for the display device, and voice control of the display device can be achieved based on the target recognition information.
[0118] This application embodiment also provides a display device, which includes the above-described echo cancellation system. Specifically, the display device includes: an audio signal generator for generating a first calibration audio signal; an audio signal processing module for transmitting the first calibration audio signal to a speaker; a pickup module for receiving the first calibration audio signal output from the speaker to obtain a second calibration audio signal; a delay determination module connected to the pickup module and the audio signal processing module for determining a target delay parameter based on the first and second calibration audio signals; and an echo cancellation module connected to the delay determination module, the pickup module, and the audio signal processing module for performing echo cancellation processing on the audio signal to be processed acquired by the pickup module based on the target delay parameter and the original audio signal output by the audio signal processing module to obtain the target audio signal.
[0119] The display device provided in this embodiment generates a first calibration audio signal through an audio signal generator, receives the first calibration audio signal output by the speaker through a pickup module to obtain a second calibration audio signal, and then determines the target delay parameter based on the first and second calibration audio signals, which can accurately measure the delay parameter. Based on the target delay parameter and the original audio signal, echo cancellation processing is performed on the audio signal to be processed output by the pickup module, which can identify and eliminate the sound signals actively emitted by the display device itself in the audio signal to be processed collected by the pickup module, and only retain the audio signals not actively emitted by the device itself, thereby improving the accuracy of echo cancellation.
[0120] In some embodiments, the speaker can be built into the display device or placed on an external active speaker. When the speaker is placed on an external active speaker, the display device can transmit the first calibration audio signal and the original audio signal to the speaker via wired or wireless means, so as to output the first calibration audio signal and the original audio signal through the speaker.
[0121] This application also provides a computer-readable storage medium, which may include: read-only memory (ROM), random access memory (RAM), a magnetic disk, or an optical disk, etc. A computer program is stored thereon, and the computer program is loaded by a processor to execute the steps in any of the echo cancellation methods provided in this application. For example, the computer program loaded by the processor can execute the following steps:
[0122] A first calibration audio signal is generated using an audio signal generator;
[0123] The first calibration audio signal is transmitted to the speaker;
[0124] Receive the first calibration audio signal output from the speaker to obtain the second calibration audio signal;
[0125] The target delay parameters are determined based on the first and second calibration audio signals.
[0126] Based on the target delay parameters and the original audio signal, echo cancellation processing is performed on the audio signal to be processed to obtain the target audio signal.
[0127] In the above embodiments, the descriptions of each embodiment have different focuses. For parts not described in detail in a certain embodiment, please refer to the detailed descriptions of other embodiments above, which will not be repeated here.
[0128] In practice, each of the above units or structures can be implemented as an independent entity or can be arbitrarily combined to be implemented as the same or several entities. For the specific implementation of each of the above units or structures, please refer to the previous method embodiments, which will not be repeated here.
[0129] For details on the implementation of each of the above operations, please refer to the previous examples, which will not be repeated here.
[0130] The echo cancellation system, method, and display device provided in the embodiments of this application have been described in detail above. Specific examples have been used to illustrate the principles and implementation methods of this application. The description of the above embodiments is only for the purpose of helping to understand the method and core ideas of this application. At the same time, for those skilled in the art, there will be changes in the specific implementation methods and application scope based on the ideas of this application. Therefore, the content of this specification should not be construed as a limitation of this application.
Claims
1. An echo cancellation system, wherein, include: An audio signal generator is used to generate a first calibration audio signal; An audio signal processing module is used to transmit the first calibration audio signal to the speaker; The pickup module is used to receive the first calibration audio signal output by the speaker and obtain the second calibration audio signal; A delay determination module, connected to the sound pickup module and the audio signal processing module, is used to determine the target delay parameter based on the first calibration audio signal and the second calibration audio signal; An echo cancellation module, connected to the delay determination module, the pickup module, and the audio signal processing module, is used to perform echo cancellation processing on the audio signal to be processed acquired by the pickup module based on the target delay parameter and the original audio signal output by the audio signal processing module, to obtain the target audio signal.
2. The system according to claim 1, wherein, The delay determination module includes: The first filtering unit is connected to the audio signal processing module and is used to filter the first calibration audio signal to obtain the third calibration audio signal. The second filtering unit, connected to the pickup module, is used to filter the second calibration audio signal to obtain the fourth calibration audio signal. The delay determination unit, connected to the first filtering unit and the second filtering unit, is used to determine the target delay parameter based on the third calibration audio signal and the fourth calibration audio signal.
3. The system according to claim 2, wherein, The third calibration audio signal and the fourth calibration audio signal each include multiple signals, and the multiple third calibration audio signals and the multiple fourth calibration audio signals correspond one-to-one. The delay determination unit includes: The first determining unit is used to perform phase comparison on each of the third calibration audio signals and the fourth calibration audio signal corresponding to each of the third calibration audio signals to obtain a plurality of first delay parameters; The second determining unit is used to calculate and process multiple first delay parameters to obtain target delay parameters.
4. The system according to claim 3, wherein, The step of calculating and processing multiple first delay parameters to obtain target delay parameters includes: The average value of multiple first delay parameters is processed; The average value of the multiple first delay parameters is determined as the target delay parameter.
5. The system according to claim 3, wherein, The step of calculating and processing multiple first delay parameters to obtain target delay parameters includes: The first delay parameters are weighted and summed. The weighted sum of multiple first delay parameters is determined as the target delay parameter.
6. The system according to claim 2, wherein, Both the third calibration audio signal and the fourth calibration audio signal are singular. The delay determination unit determines the target delay parameters based on the third and fourth calibration audio signals, including: The target delay parameter is obtained by comparing the phase of the third calibration audio signal and the fourth calibration audio signal.
7. The system according to claim 1, wherein, The echo cancellation module includes: A delay processing unit, connected to the delay determination module and the audio signal processing module, is used to perform delay processing on the original audio signal output by the audio signal processing module based on the target delay parameter to obtain a first audio signal; An echo cancellation unit, connected to the delay processing unit and the pickup module, is used to perform echo cancellation processing on the audio signal to be processed collected by the pickup module based on the first audio signal to obtain the target audio signal.
8. The system according to claim 1, wherein, The audio signal processing module includes: an audio signal processing unit, an audio sampling unit, and an audio signal output unit; The audio signal processing unit is connected to the audio signal generator, the audio sampling unit, and the audio signal output unit, and is used to transmit the first calibration audio signal and the original audio signal to the audio sampling unit and the audio signal output unit. The audio sampling unit is connected to the delay determination module and the echo cancellation module, and is used to transmit the first calibration audio signal to the delay determination module and the original audio signal to the echo cancellation module; The audio signal output unit is used to transmit the first calibration audio signal and the original audio signal to the speaker, so as to output the first calibration audio signal and the original audio signal through the speaker.
9. The system according to claim 8, wherein, The speaker is built into the display device, and the echo cancellation system further includes: a first signal amplification module; the first signal amplification module is connected to the audio signal output unit and the speaker; The first signal amplification module is used to amplify the first calibration audio signal and the original audio signal output by the audio signal output unit, and transmit the amplified first calibration audio signal and the original audio signal to the speaker so as to output the first calibration audio signal and the original audio signal through the speaker.
10. The system according to claim 8, wherein, The speaker is mounted on an external active speaker enclosure, which includes an audio signal receiving module, a second signal amplification module, and a speaker. The audio signal receiving module is connected to the audio signal output unit and the second signal amplification module, and the second signal amplification module is connected to the speaker. The audio signal receiving module is used to receive the first calibration audio signal and the original audio signal output by the audio signal output unit, and transmit the first calibration audio signal and the original audio signal to the second signal amplification module; The second signal amplification module is used to amplify the first calibration audio signal and the original audio signal, and transmit the amplified first calibration audio signal and the original audio signal to the speaker so as to output the first calibration audio signal and the original audio signal through the speaker.
11. The system according to claim 1, wherein, Also includes: An audio recognition module, connected to the echo cancellation module, is used to recognize and process the target audio signal to obtain target recognition information.
12. An echo cancellation method, wherein, include: A first calibration audio signal is generated using an audio signal generator; The first calibration audio signal is transmitted to the speaker; The first calibration audio signal output by the speaker is received to obtain the second calibration audio signal; Based on the first calibration audio signal and the second calibration audio signal, the target delay parameter is determined; Based on the target delay parameters and the original audio signal, echo cancellation processing is performed on the audio signal to be processed to obtain the target audio signal.
13. The method according to claim 12, wherein, The step of determining the target delay parameter based on the first calibration audio signal and the second calibration audio signal includes: The first calibration audio signal is filtered to obtain the third calibration audio signal; The second calibration audio signal is filtered to obtain the fourth calibration audio signal; The target delay parameter is determined based on the third calibration audio signal and the fourth calibration audio signal.
14. The method according to claim 13, wherein, The third calibration audio signal and the fourth calibration audio signal each include multiple ones, and the multiple third calibration audio signals and the multiple fourth calibration audio signals correspond one-to-one; The determination of the target delay parameter based on the third and fourth calibration audio signals includes: A phase comparison is performed on each of the third calibration audio signals and the fourth calibration audio signal corresponding to each of the third calibration audio signals to obtain multiple first delay parameters; The target delay parameter is obtained by calculating and processing multiple first delay parameters.
15. The method according to claim 14, wherein, The step of calculating and processing multiple first delay parameters to obtain target delay parameters includes: The average value of multiple first delay parameters is processed; The average value of the multiple first delay parameters is determined as the target delay parameter.
16. The method of claim 14, wherein, The step of calculating and processing multiple first delay parameters to obtain target delay parameters includes: The first delay parameters are weighted and summed. The weighted sum of multiple first delay parameters is determined as the target delay parameter.
17. The method according to claim 13, wherein, Both the third calibration audio signal and the fourth calibration audio signal are singular. The determination of the target delay parameter based on the third calibration audio signal and the fourth calibration audio signal includes: The target delay parameter is obtained by comparing the phase of the third calibration audio signal and the fourth calibration audio signal.
18. The method according to claim 12, wherein, The process of performing echo cancellation on the audio signal to be processed based on the target delay parameter and the original audio signal to obtain the target audio signal includes: The original audio signal is delayed based on the target delay parameter to obtain the first audio signal; Based on the first audio signal, echo cancellation processing is performed on the audio signal to be processed to obtain the target audio signal.
19. The method according to claim 12, wherein, After performing echo cancellation processing on the audio signal to be processed based on the target delay parameter and the original audio signal to obtain the target audio signal, the process includes: The target audio signal is processed to obtain target identification information.
20. A display device, wherein, The display device includes the echo cancellation system as described in any one of claims 1-11.