Echo time delay detection elimination system and method

Abstract

The invention provides an echo time delay detection and elimination system and method, and the system comprises an initialization and audio playing module which is used for initializing equipment and controlling the equipment to play recorded audio data based on an initialization result; the time delay detection module is used for sending the recorded audio data to the sound mixing equipment based on the playing result, controlling the drive of the audio loudspeaker to play the sound mixing data of the sound mixing equipment based on the sending result, and meanwhile, collecting the playing audio data based on a preset microphone and sending the playing audio data to the sound mixing equipment; sending the played audio data and recorded audio data in the audio mixing equipment to echo cancellation equipment for time delay detection; and the echo cancellation module is used for carrying out parameter configuration on echo cancellation equipment based on the time delay detection result, and controlling the echo cancellation equipment to carry out echo cancellation operation based on the parameter configuration result. The method can cope with complex and changeable practical application environments, so as to improve the accuracy and reliability of echo cancellation, improve the audio quality, and meet the requirements of people for high-quality audio experience.

Description

Technical Field

[0001] The present invention relates to the technical field of data processing, and in particular to a system and method for detecting and eliminating echo delay. Background Art

[0002] With the development of audio technology, echo problems often affect audio quality and user experience in various audio application scenarios. Due to the reflection and propagation characteristics of sound, echoes may be generated. The existence of echoes can cause unclear voices and interfere with communication.

[0003] However, traditional echo cancellation methods may have shortcomings such as low accuracy and poor adaptability. Moreover, traditional echo cancellation algorithms can only be used for audio with relatively fixed delays, and cannot cope with the problem of unstable audio signal delays, which greatly reduces the effect of echo cancellation.

[0004] Therefore, in order to overcome the above problems, the present invention provides an echo delay detection and elimination system and method. Summary of the invention

[0005] The present invention provides an echo delay detection and elimination system and method, which are used to effectively detect the delay by playing the recorded audio, thereby ensuring the accuracy of the delay detection. At the same time, the echo cancellation device can be effectively configured with parameters through the detected delay value, thereby achieving effective echo cancellation operation on the audio, and can cope with complex and changeable actual application environments to improve the accuracy and reliability of echo cancellation, improve audio quality, and meet people's needs for high-quality audio experience.

[0006] The present invention provides an echo delay detection and elimination system, comprising:

[0007] The initialization and audio playback module is used to initialize the device and control the device to play the recorded audio data based on the initialization result;

[0008] A delay detection module is used to send the recorded audio data to the mixing device based on the playback result, and control the driver of the audio speaker to play the mixing data of the mixing device based on the sending result. At the same time, based on the preset microphone, the playback audio data is collected, and the playback audio data and the recorded audio data in the mixing device are sent to the echo cancellation device for delay detection;

[0009] The echo cancellation module is used to configure the parameters of the echo cancellation device based on the delay detection result, and control the echo cancellation device to perform the echo cancellation operation based on the parameter configuration result.

[0010] Preferably, an echo delay detection and elimination system, initialization and audio playback module, comprises:

[0011] Structure determination unit for:

[0012] Acquiring structural parameters of the echo delay detection and elimination device, and determining a device combination of the echo delay detection and elimination device based on the structural parameters;

[0013] Extract configuration parameters of each device in the device combination, and determine the service execution process of each device based on the configuration parameters;

[0014] Device initialization unit, used to:

[0015] Determine the initialization detection dimension for each device based on the business execution process, and detect each device based on the initialization detection dimension;

[0016] Based on the detection results, individual initialization parameters of each device are determined, and initialization configuration of the corresponding devices is performed based on the individual initialization parameters.

[0017] Preferably, an echo delay detection and elimination system, initialization and audio playback module, comprises:

[0018] An audio recording unit, used to obtain known voice text and convert the known voice text into audio based on a preset scheme to obtain recorded audio data;

[0019] An audio storage unit, used to store the recorded audio data in a preset voice library, and to construct an interactive link between the preset voice library and the device based on the storage result;

[0020] The audio playback unit is used to retrieve the recorded audio data from the preset voice library according to the interactive link based on the initialization result, and control the device to repeatedly play the recorded audio data a target number of times based on the retrieval result.

[0021] Preferably, an echo delay detection and elimination system, a delay detection module, comprises:

[0022] An audio sending unit, used to obtain a communication interface of a sound mixing device and a data length parameter of recorded audio data, and send the recorded audio data and the data length parameter to the sound mixing device based on the communication interface;

[0023] A monitoring unit, configured to monitor the length of the recorded audio data received by the mixing device based on a preset monitoring mechanism, and to generate an execution trigger instruction for the next link based on the business execution process when the mixing device completes receiving the recorded audio data based on the received length;

[0024] A playback unit, used to control the driver of the speaker to operate based on the execution of the trigger instruction, and to play the mixing data in the mixing device based on the operation result;

[0025] The sound collection unit is used to trigger a preset microphone based on the playback result, and collect playback audio data based on the preset microphone.

[0026] Preferably, an echo delay detection and elimination system, a delay detection module, comprises:

[0027] Audio transmission unit for:

[0028] Acquire recorded audio data received in the mixing device, and first send the recorded audio data to the echo cancellation device to obtain a first channel of audio;

[0029] At the same time, the playback audio data collected by the preset microphone is compressed to obtain compressed audio data, and a communication link between the preset microphone and the device signal receiver is established;

[0030] Uploading the compressed audio data to the device signal receiver based on the communication link, and sending the compressed audio data received by the device signal receiver to the echo cancellation device for a second time based on the preset driver program to obtain a second audio channel;

[0031] Audio processing unit for:

[0032] Extracting basic parameters of the first audio channel and the second audio channel respectively, parsing the basic parameters, and determining the sampling rates of the first audio channel and the second audio channel;

[0033] Obtaining a block length for dividing the first audio channel and the second audio channel into blocks based on the sampling rate, determining a maximum detectable delay length based on a preset detection requirement, and performing a division operation on the maximum detectable delay length and the block length to obtain a number of comparison steps required for delay detection;

[0034] At the same time, the duration of the first audio channel is obtained, and the number of blocks required for each comparison step is obtained based on the duration of the first audio channel and the block length of the divided blocks;

[0035] Based on the comparison steps and the number of blocks required for each comparison step, the first audio channel and the second audio channel are divided into blocks to obtain sub-audio blocks, and each sub-audio block is subjected to a fast Fourier transform to obtain a frequency domain feature parameter of each sub-audio block;

[0036] The delay determination unit is used to determine the correlation parameters between blocks in the first audio channel and the second audio channel based on the frequency domain characteristic parameters, and sort the correlation parameters to obtain the target correlation delay to complete the delay detection.

[0037] Preferably, an echo delay detection and elimination system, a delay determination unit, comprises:

[0038] The result acquisition subunit is used to:

[0039] Obtaining the obtained target related delay, and using the target related delay as the first recording parameter;

[0040] At the same time, the spatial layout feature of the current device is obtained, and the spatial layout feature is used as the second recording parameter;

[0041] The result recording subunit is used to construct a parameter recording table, and record the first recording parameter and the second recording parameter in the parameter recording table respectively, and perform attribution marking on the parameter recording table based on scene characteristics.

[0042] Preferably, an echo delay detection and elimination system, an echo cancellation module, comprises:

[0043] Parameter configuration unit, used to:

[0044] Obtain the delay detection result obtained, and use the delay detection result as the first configuration parameter. At the same time, obtain the effective width of the filter, and divide the effective width into two equal parts to obtain the second configuration parameter;

[0045] Performing parameter configuration on the echo cancellation device based on the first configuration parameter and the second configuration parameter;

[0046] The echo cancellation unit is used to control the echo cancellation device to perform an echo cancellation operation based on the parameter configuration result to obtain echo-cancelled audio.

[0047] Preferably, an echo delay detection and elimination system, an echo elimination unit, comprises:

[0048] A visualization subunit, used for visually displaying the echo cancellation audio and the playback audio data based on an oscilloscope, and determining the compatibility parameters of the echo cancellation device under the target delay based on the visualization result;

[0049] The optimization subunit is used to compare the difference between the echo cancellation audio and the playback audio data to obtain an error signal when the compatibility parameter does not meet the preset threshold;

[0050] The parameter configuration results of the echo cancellation device are iteratively optimized based on the error signal.

[0051] The present invention provides a method for detecting and eliminating echo delay, comprising:

[0052] Step 1: Initialize the device and control the device to play the recorded audio data based on the initialization result;

[0053] Step 2: Send the recorded audio data to the mixing device based on the playback result, and control the driver of the audio speaker to play the mixed data of the mixing device based on the sending result. At the same time, collect the playback audio data based on the preset microphone, and send the playback audio data and the recorded audio data in the mixing device to the echo cancellation device for delay detection;

[0054] Step 3: Parameters of the echo cancellation device are configured based on the delay detection result, and the echo cancellation device is controlled to perform an echo cancellation operation based on the parameter configuration result.

[0055] Preferably, in a method for detecting and eliminating echo delay, in step 1, initializing a device includes:

[0056] Acquiring structural parameters of the echo delay detection and elimination device, and determining a device combination of the echo delay detection and elimination device based on the structural parameters;

[0057] Extract configuration parameters of each device in the device combination, and determine the business execution process of each device based on the configuration parameters;

[0058] Determine the initialization detection dimension for each device based on the business execution process, and detect each device based on the initialization detection dimension;

[0059] Based on the detection results, individual initialization parameters of each device are determined, and initialization configuration of the corresponding devices is performed based on the individual initialization parameters.

[0060] Compared with the prior art, the present invention has the following beneficial effects:

[0061] 1. Effective detection of delay is achieved by playing the recorded audio, ensuring the accuracy of delay detection. At the same time, the detected delay value can be used to effectively configure the parameters of the echo cancellation device, thereby achieving effective echo cancellation operation on the audio. It can cope with complex and changeable actual application environments to improve the accuracy and reliability of echo cancellation, improve audio quality, and meet people's demand for high-quality audio experience.

[0062] 2. By analyzing the structural parameters of the echo delay detection and elimination device, the device combination can be accurately and effectively determined. At the same time, the initialization detection dimension of each device is determined to achieve effective initial parameter detection of each device. Finally, the individual initialization parameters of each device are determined according to the initial parameter detection results to achieve effective initialization configuration of each device, providing reliable guarantee for echo cancellation operations.

[0063] Other features and advantages of the present invention will be described in the following description, and partly become apparent from the description, or understood by practicing the present invention. The purpose and other advantages of the present invention can be realized and obtained by the structures specifically pointed out in this application document.

[0064] The technical solution of the present invention is further described in detail below through the accompanying drawings and embodiments. BRIEF DESCRIPTION OF THE DRAWINGS

[0065] The accompanying drawings are used to provide a further understanding of the present invention and constitute a part of the specification. Together with the embodiments of the present invention, they are used to explain the present invention and do not constitute a limitation of the present invention. In the accompanying drawings:

[0066] Figure 1 It is a structural diagram of an echo delay detection and elimination system in an embodiment of the present invention;

[0067] Figure 2 It is a structural diagram of an initialization and audio playback module in an echo delay detection and elimination system in an embodiment of the present invention;

[0068] Figure 3 The present invention is a flowchart of a method for detecting and eliminating echo delay in an embodiment of the present invention. DETAILED DESCRIPTION

[0069] The preferred embodiments of the present invention are described below in conjunction with the accompanying drawings. It should be understood that the preferred embodiments described herein are only used to illustrate and explain the present invention, and are not used to limit the present invention.

[0070] Embodiment 1:

[0071] This embodiment provides an echo delay detection and elimination system, such as Figure 1 As shown, including:

[0072] The initialization and audio playback module is used to initialize the device and control the device to play the recorded audio data based on the initialization result;

[0073] A delay detection module is used to send the recorded audio data to the mixing device based on the playback result, and control the driver of the audio speaker to play the mixing data of the mixing device based on the sending result. At the same time, based on the preset microphone, the playback audio data is collected, and the playback audio data and the recorded audio data in the mixing device are sent to the echo cancellation device for delay detection;

[0074] The echo cancellation module is used to configure the parameters of the echo cancellation device based on the delay detection result, and control the echo cancellation device to perform the echo cancellation operation based on the parameter configuration result.

[0075] In this embodiment, the device being initialized refers to all modules included in the echo cancellation system.

[0076] In this embodiment, the recorded audio data is recorded in advance, for example, it may be "Connecting you, please wait" and the like.

[0077] In this embodiment, the audio mixer is preset and is a device in the echo cancellation operation, which is used to mix multiple audio channels into one audio output.

[0078] In this embodiment, controlling the driver of the audio speaker to play the mixing data of the mixing device based on the sending result means controlling the speaker to play the result obtained by the mixing device, thereby facilitating delay detection.

[0079] In this embodiment, the preset microphone is set in advance and is used to collect the sound played by the speaker and the sound existing in the environment.

[0080] In this embodiment, the echo cancellation device may be a filter.

[0081] The working principle and beneficial effects of the above technical solution are: effective detection of delay is achieved by playing the recorded audio, ensuring the accuracy of delay detection. At the same time, the echo cancellation device can be effectively configured with parameters through the detected delay value, thereby achieving effective echo cancellation operation on the audio. It can cope with complex and changeable actual application environments to improve the accuracy and reliability of echo cancellation, improve audio quality, and meet people's demand for high-quality audio experience.

[0082] Embodiment 2:

[0083] Based on the technology of embodiment 1, this embodiment provides an echo delay detection and elimination system, such as Figure 2 As shown, the initialization and audio playback module includes:

[0084] Structure determination unit for:

[0085] Acquiring structural parameters of the echo delay detection and elimination device, and determining a device combination of the echo delay detection and elimination device based on the structural parameters;

[0086] Extract configuration parameters of each device in the device combination, and determine the service execution process of each device based on the configuration parameters;

[0087] Device initialization unit, used to:

[0088] Determine the initialization detection dimension for each device based on the business execution process, and detect each device based on the initialization detection dimension;

[0089] Based on the detection results, individual initialization parameters of each device are determined, and initialization configuration of the corresponding devices is performed based on the individual initialization parameters.

[0090] In this embodiment, the structural parameters refer to the components included in the echo delay detection and cancellation device and the association relationship between the components.

[0091] In this embodiment, the configuration parameters refer to parameters such as the working environment and operating conditions of each device.

[0092] In this embodiment, the service execution process refers to the corresponding processing steps and the processing order between each step when each device executes the corresponding service.

[0093] In this embodiment, the initialization detection dimension refers to the type of initialization detection performed on each device, including device status parameters and the like.

[0094] In this embodiment, the personalized initialization parameters refer to the current device state parameters obtained by each device after performing initialization detection dimension detection.

[0095] The working principle and beneficial effects of the above technical solution are: by analyzing the structural parameters of the echo delay detection and elimination device, the device combination can be accurately and effectively determined. At the same time, the initialization detection dimension of each device is determined to achieve effective initial parameter detection of each device. Finally, the individual initialization parameters of each device are determined according to the initial parameter detection results, and effective initialization configuration of each device is achieved, providing reliable guarantee for echo cancellation operations.

[0096] Embodiment 3:

[0097] Based on the technology of embodiment 1, this embodiment provides an echo delay detection and elimination system, an initialization and audio playback module, including:

[0098] An audio recording unit, used to obtain known voice text and convert the known voice text into audio based on a preset scheme to obtain recorded audio data;

[0099] An audio storage unit, used to store the recorded audio data in a preset voice library, and to construct an interactive link between the preset voice library and the device based on the storage result;

[0100] The audio playback unit is used to retrieve the recorded audio data from the preset voice library according to the interactive link based on the initialization result, and control the device to repeatedly play the recorded audio data a target number of times based on the retrieval result.

[0101] In this embodiment, the known voice text is known in advance, for example, it may be the specific data content corresponding to "asking you to connect, please wait".

[0102] In this embodiment, the preset solution is known in advance, for example, the text may be converted into speech through TTS (text to speech) idea generation technology.

[0103] In this embodiment, the preset voice library is used to store a variety of different voice data.

[0104] In this embodiment, the target number of times is set in advance, for example, three times.

[0105] The working principle and beneficial effects of the above technical solution are: by performing voice conversion on known speech text and storing the recorded audio data obtained by the conversion, at the same time, storing the obtained recorded audio data, and building an interactive link between the preset voice library and the device based on the storage results, it is convenient for the device to retrieve the recorded audio data from the preset voice library for playback, which provides convenience and guarantee for delay detection.

[0106] Embodiment 4:

[0107] Based on the technology of Embodiment 1, this embodiment provides an echo delay detection and elimination system, a delay detection module, including:

[0108] An audio sending unit, used to obtain a communication interface of a sound mixing device and a data length parameter of recorded audio data, and send the recorded audio data and the data length parameter to the sound mixing device based on the communication interface;

[0109] A monitoring unit, configured to monitor the length of the recorded audio data received by the mixing device based on a preset monitoring mechanism, and to generate an execution trigger instruction for the next link based on the business execution process when the mixing device completes receiving the recorded audio data based on the received length;

[0110] A playback unit, used to control the driver of the speaker to run based on the execution of the trigger instruction, and to play the mixing data in the mixing device based on the operation result;

[0111] The sound collection unit is used to trigger a preset microphone based on the playback result, and collect playback audio data based on the preset microphone.

[0112] In this embodiment, the data length parameter refers to the data length of the recorded audio data, and is used to represent the completion parameter of the data.

[0113] In this embodiment, the preset monitoring mechanism is trained in advance and is used to monitor the length of the recorded audio data received by the mixing device, so as to facilitate the determination of whether the recorded audio data is completely received by the mixing device.

[0114] The working principle and beneficial effect of the above technical solution are: by monitoring the reception of the recorded audio data by the mixing device, when the mixing device completely receives the recorded audio data, the speaker is controlled to play the recorded audio data, and at the same time, the microphone is triggered to collect the played audio, thereby providing reliable data support for delay detection, ensuring the reliability of delay detection, and facilitating echo delay elimination.

[0115] Embodiment 5:

[0116] Based on the technology of Embodiment 1, this embodiment provides an echo delay detection and elimination system, a delay detection module, including:

[0117] Audio transmission unit for:

[0118] Acquire recorded audio data received in the mixing device, and first send the recorded audio data to the echo cancellation device to obtain a first channel of audio;

[0119] At the same time, the playback audio data collected by the preset microphone is compressed to obtain compressed audio data, and a communication link between the preset microphone and the device signal receiver is established;

[0120] Uploading the compressed audio data to the device signal receiver based on the communication link, and sending the compressed audio data received by the device signal receiver to the echo cancellation device for a second time based on the preset driver program to obtain a second audio channel;

[0121] Audio processing unit for:

[0122] Extracting basic parameters of the first audio channel and the second audio channel respectively, parsing the basic parameters, and determining the sampling rates of the first audio channel and the second audio channel;

[0123] Obtaining a block length for dividing the first audio channel and the second audio channel into blocks based on the sampling rate, determining a maximum detectable delay length based on a preset detection requirement, and performing a division operation on the maximum detectable delay length and the block length to obtain a number of comparison steps required for delay detection;

[0124] At the same time, the duration of the first audio channel is obtained, and the number of blocks required for each comparison step is obtained based on the duration of the first audio channel and the block length of the divided blocks;

[0125] Based on the comparison steps and the number of blocks required for each comparison step, the first audio channel and the second audio channel are divided into blocks to obtain sub-audio blocks, and each sub-audio block is subjected to a fast Fourier transform to obtain a frequency domain feature parameter of each sub-audio block;

[0126] The delay determination unit is used to determine the correlation parameters between blocks in the first audio channel and the second audio channel based on the frequency domain characteristic parameters, and sort the correlation parameters to obtain the target correlation delay to complete the delay detection.

[0127] In this embodiment, the duration of each block is related to the sampling rate. For a 16K sampling rate, the block length is 4 milliseconds, and for an 8K sampling rate, the block length is 8 milliseconds, both of which have 64 sample points.

[0128] The number of steps to be compared is the maximum detectable delay (in milliseconds) divided by the duration of each block. Assuming the preset maximum detectable delay is 1 second, that is, 1000 milliseconds, and assuming the block size is 4 milliseconds, the number of steps to be compared is 125.

[0129] The number of blocks to be compared in each step is the length of the near-end audio divided by the block length. Assuming that the length of the near-end audio to be sampled is 2 seconds, that is, 2000 milliseconds, and that the sampling rate is 16K and the block length is 4 milliseconds, the number of blocks to be compared is 500.

[0130] The frequency domain representation between blocks can calculate the correlation, which is between 0 and 1;

[0131] The correlation at each step is expressed as the mean of all blocks;

[0132] By sorting the relevance of each step, the most relevant delay can be found and used as the final result.

[0133] In this embodiment, the first sending refers to sending the recorded audio data to the echo cancellation device, wherein the first channel of audio is the recorded audio data, which is one of the parameters used for delay detection.

[0134] In this embodiment, audio compression refers to compressing the played audio data into characters, in order to quickly and effectively transmit the played audio data to the echo cancellation device.

[0135] In this embodiment, the device signal receiver is pre-set to receive the compressed audio data, and then transmit the received compressed audio data to the echo cancellation device.

[0136] In this embodiment, the preset driver is a code parameter used to execute the device signal receiver.

[0137] In this embodiment, the second sending refers to sending the playback audio data collected by the preset microphone to the echo cancellation device, wherein the second audio channel is the playback audio data collected by the preset microphone, which is another parameter for delay detection.

[0138] In this embodiment, the basic parameters refer to information such as the wavelengths of the first audio channel and the second audio channel.

[0139] In this embodiment, the block length refers to a standard for splitting the first audio channel and the second audio channel.

[0140] In this embodiment, the preset detection requirement is set in advance and is used to represent the maximum detectable duration that can be detected, for example, it may be 1 second.

[0141] In this embodiment, the sub-audio block refers to a portion of audio data obtained by dividing the first audio channel and the second audio channel into blocks.

[0142] In this embodiment, the frequency domain characteristic parameter refers to the data value and distribution change of each sub-audio block in the frequency domain obtained after each sub-audio block is subjected to a fast Fourier transform.

[0143] The working principle and beneficial effects of the above technical solution are: by respectively transmitting the recorded audio data and the playback audio data collected by the preset microphone to the echo cancellation device, reliable data guarantee is provided for delay detection; secondly, by parsing the obtained first-channel audio and the second-channel audio, the number of comparison steps required for the first-channel audio and the second-channel audio and the number of blocks required for each comparison step are effectively determined, so as to effectively split the first-channel audio and the second-channel audio, which provides convenience for delay detection; finally, the split self-audio is fast-transformed, and the correlation analysis of the fast Fourier change is performed, so as to finally achieve effective detection of the delay, which provides convenience for echo cancellation, thereby improving the quality of the audio data and enhancing the user experience.

[0144] Embodiment 6:

[0145] Based on the technology of Embodiment 5, this embodiment provides an echo delay detection and elimination system, wherein the delay determination unit includes:

[0146] The result acquisition subunit is used to:

[0147] Obtaining the obtained target related delay, and using the target related delay as the first recording parameter;

[0148] At the same time, the spatial layout feature of the current device is obtained, and the spatial layout feature is used as the second recording parameter;

[0149] The result recording subunit is used to construct a parameter recording table, and record the first recording parameter and the second recording parameter in the parameter recording table respectively, and perform attribution marking on the parameter recording table based on scene characteristics.

[0150] In this embodiment, the spatial layout feature refers to the position distribution of the current device in the current spatial environment.

[0151] In this embodiment, scene features refer to the characteristics of the spatial environment, including the composition of the environment, etc.

[0152] In this embodiment, the attribution mark description refers to distinguishing and marking parameter record tables of different spatial environments through scene features.

[0153] The working principle and beneficial effect of the above technical solution are: by recording the spatial layout characteristics of the device and the target-related delay corresponding to the device, and distinguishing and marking the recording results, it is convenient to understand the delay situation in different spatial environments, and provide a reference basis for echo cancellation and detection.

[0154] Embodiment 7:

[0155] Based on the technology of embodiment 1, this embodiment provides an echo delay detection and elimination system, an echo elimination module, including:

[0156] Parameter configuration unit, used to:

[0157] Obtain the delay detection result obtained, and use the delay detection result as the first configuration parameter. At the same time, obtain the effective width of the filter, and divide the effective width into two equal parts to obtain the second configuration parameter;

[0158] Performing parameter configuration on the echo cancellation device based on the first configuration parameter and the second configuration parameter;

[0159] The echo cancellation unit is used to control the echo cancellation device to perform an echo cancellation operation based on the parameter configuration result to obtain echo-cancelled audio.

[0160] In this embodiment, the effective width refers to the width of the filter that can effectively perform filtering operations, in order to ensure that the delay is effectively eliminated and to ensure the stability of the delay elimination.

[0161] The working principle and beneficial effects of the above technical solution are: by configuring the parameters of the echo cancellation device according to the delay detection result and the effective width of the filter, the working reliability of the echo cancellation device is ensured. Finally, the echo cancellation operation is performed after the parameter configuration is completed, thereby ensuring the reliability and high quality of the final audio.

[0162] Embodiment 8:

[0163] Based on the technology of Embodiment 7, this embodiment provides an echo delay detection and elimination system, an echo elimination unit, including:

[0164] A visualization subunit, used for visually displaying the echo cancellation audio and the playback audio data based on an oscilloscope, and determining the compatibility parameters of the echo cancellation device under the target delay based on the visualization result;

[0165] The optimization subunit is used to compare the difference between the echo cancellation audio and the playback audio data to obtain an error signal when the compatibility parameter does not meet the preset threshold;

[0166] The parameter configuration results of the echo cancellation device are iteratively optimized based on the error signal.

[0167] In this embodiment, the target delay aligns the near end and the far end in the middle of the filter, so that when there is an error in the delay detection or the delay changes during the actual operation, the filter can still be compatible, which increases the stability of the algorithm.

[0168] In this embodiment, the compatibility parameter is used to characterize the cancellation effect of the echo cancellation device on the audio echo, that is, when the delay changes during the actual operation process, the filter can still be compatible.

[0169] In this embodiment, the preset threshold is set in advance and can be adjusted according to actual needs.

[0170] In this embodiment, the error signal refers to the difference between the echo-cancelled audio and the played audio data.

[0171] The working principle and beneficial effects of the above technical solution are: by performing effect detection on the echo cancellation audio, the reliability of the final echo cancellation audio is ensured, and when the echo cancellation audio does not meet the requirements, the parameter configuration results of the echo cancellation device are iteratively optimized to ensure the reliability of the echo cancellation.

[0172] Embodiment 9:

[0173] This embodiment provides a method for detecting and eliminating echo delay, such as Figure 3 As shown, including:

[0174] Step 1: Initialize the device and control the device to play the recorded audio data based on the initialization result;

[0175] Step 2: Send the recorded audio data to the mixing device based on the playback result, and control the driver of the audio speaker to play the mixed data of the mixing device based on the sending result. At the same time, collect the playback audio data based on the preset microphone, and send the playback audio data and the recorded audio data in the mixing device to the echo cancellation device for delay detection;

[0176] Step 3: Parameters of the echo cancellation device are configured based on the delay detection result, and the echo cancellation device is controlled to perform an echo cancellation operation based on the parameter configuration result.

[0177] The working principle and beneficial effects of the above technical solution are: effective detection of delay is achieved by playing the recorded audio, ensuring the accuracy of delay detection. At the same time, the echo cancellation device can be effectively configured with parameters through the detected delay value, thereby achieving effective echo cancellation operation on the audio. It can cope with complex and changeable actual application environments to improve the accuracy and reliability of echo cancellation, improve audio quality, and meet people's demand for high-quality audio experience.

[0178] Embodiment 10:

[0179] Based on the technology of Embodiment 9, this embodiment provides a method for detecting and eliminating echo delay. In step 1, the device is initialized, including:

[0180] Acquiring structural parameters of the echo delay detection and elimination device, and determining a device combination of the echo delay detection and elimination device based on the structural parameters;

[0181] Extract configuration parameters of each device in the device combination, and determine the business execution process of each device based on the configuration parameters;

[0182] Determine the initialization detection dimension for each device based on the business execution process, and detect each device based on the initialization detection dimension;

[0183] Based on the detection results, individual initialization parameters of each device are determined, and initialization configuration of the corresponding devices is performed based on the individual initialization parameters.

[0184] The working principle and beneficial effects of the above technical solution are: by analyzing the structural parameters of the echo delay detection and elimination device, the device combination can be accurately and effectively determined. At the same time, the initialization detection dimension of each device is determined to achieve effective initial parameter detection of each device. Finally, the individual initialization parameters of each device are determined according to the initial parameter detection results, and effective initialization configuration of each device is achieved, providing reliable guarantee for echo cancellation operations.

[0185] Obviously, those skilled in the art can make various changes and modifications to the present invention without departing from the spirit and scope of the present invention. Thus, if these modifications and variations of the present invention fall within the scope of the claims of the present invention and their equivalents, the present invention is also intended to include these modifications and variations.

Claims

1. An echo delay detection and elimination system, characterized in that: include: The initialization and audio playback module is used to initialize the device and control the device to play the recorded audio data based on the initialization result; A delay detection module is used to send the recorded audio data to the mixing device based on the playback result, and control the driver of the audio speaker to play the mixing data of the mixing device based on the sending result. At the same time, based on the preset microphone, the playback audio data is collected, and the playback audio data and the recorded audio data in the mixing device are sent to the echo cancellation device for delay detection; The echo cancellation module is used to configure the parameters of the echo cancellation device based on the delay detection result, and control the echo cancellation device to perform the echo cancellation operation based on the parameter configuration result.

2. The echo delay detection and elimination system according to claim 1, characterized in that: Initialization and audio playback module, including: Structure determination unit for: Acquiring structural parameters of the echo delay detection and elimination device, and determining a device combination of the echo delay detection and elimination device based on the structural parameters; Extract configuration parameters of each device in the device combination, and determine the service execution process of each device based on the configuration parameters; Device initialization unit, used to: Determine the initialization detection dimension for each device based on the business execution process, and detect each device based on the initialization detection dimension; Based on the detection results, individual initialization parameters of each device are determined, and initialization configuration of the corresponding devices is performed based on the individual initialization parameters.

3. The echo delay detection and elimination system according to claim 1, characterized in that: Initialization and audio playback module, including: An audio recording unit, used to obtain known voice text and convert the known voice text into audio based on a preset scheme to obtain recorded audio data; An audio storage unit, used to store the recorded audio data in a preset voice library, and to construct an interactive link between the preset voice library and the device based on the storage result; The audio playback unit is used to retrieve the recorded audio data from the preset voice library according to the interactive link based on the initialization result, and control the device to repeatedly play the recorded audio data a target number of times based on the retrieval result.

4. The echo delay detection and elimination system according to claim 1, characterized in that: The delay detection module includes: An audio sending unit, used to obtain a communication interface of a sound mixing device and a data length parameter of recorded audio data, and send the recorded audio data and the data length parameter to the sound mixing device based on the communication interface; A monitoring unit, configured to monitor the length of the recorded audio data received by the mixing device based on a preset monitoring mechanism, and to generate an execution trigger instruction for the next link based on the business execution process when the mixing device completes receiving the recorded audio data based on the received length; A playback unit, used to control the driver of the speaker to operate based on the execution of the trigger instruction, and to play the mixing data in the mixing device based on the operation result; The sound collection unit is used to trigger the preset microphone based on the playback result, and collect the playback audio data based on the preset microphone.

5. The echo delay detection and elimination system according to claim 1, characterized in that: The delay detection module includes: Audio transmission unit for: Acquire recorded audio data received in the mixing device, and first send the recorded audio data to the echo cancellation device to obtain a first channel of audio; At the same time, the playback audio data collected by the preset microphone is compressed to obtain compressed audio data, and a communication link between the preset microphone and the device signal receiver is established; Uploading the compressed audio data to the device signal receiver based on the communication link, and sending the compressed audio data received by the device signal receiver to the echo cancellation device for a second time based on the preset driver program to obtain a second audio channel; Audio processing unit for: Extracting basic parameters of the first audio channel and the second audio channel respectively, parsing the basic parameters, and determining the sampling rates of the first audio channel and the second audio channel; Obtaining a block length for dividing the first audio channel and the second audio channel into blocks based on the sampling rate, determining a maximum detectable delay length based on a preset detection requirement, and performing a division operation on the maximum detectable delay length and the block length to obtain a number of comparison steps required for delay detection; At the same time, the duration of the first audio channel is obtained, and the number of blocks required for each comparison step is obtained based on the duration of the first audio channel and the block length of the divided blocks; Based on the comparison steps and the number of blocks required for each comparison step, the first audio channel and the second audio channel are divided into blocks to obtain sub-audio blocks, and each sub-audio block is subjected to a fast Fourier transform to obtain a frequency domain feature parameter of each sub-audio block; The delay determination unit is used to determine the correlation parameters between blocks in the first audio channel and the second audio channel based on the frequency domain characteristic parameters, and sort the correlation parameters to obtain the target correlation delay to complete the delay detection.

6. The echo delay detection and elimination system according to claim 5, characterized in that: The delay determination unit comprises: The result acquisition subunit is used to: Obtaining the obtained target related delay, and using the target related delay as the first recording parameter; At the same time, the spatial layout feature of the current device is obtained, and the spatial layout feature is used as the second recording parameter; The result recording subunit is used to construct a parameter recording table, and record the first recording parameter and the second recording parameter in the parameter recording table respectively, and perform attribution marking on the parameter recording table based on scene characteristics.

7. The echo delay detection and elimination system according to claim 1, characterized in that: Echo cancellation module, including: Parameter configuration unit, used to: Obtain the delay detection result obtained, and use the delay detection result as the first configuration parameter. At the same time, obtain the effective width of the filter, and divide the effective width into two equal parts to obtain the second configuration parameter; Performing parameter configuration on the echo cancellation device based on the first configuration parameter and the second configuration parameter; The echo cancellation unit is used to control the echo cancellation device to perform an echo cancellation operation based on the parameter configuration result to obtain echo-cancelled audio.

8. The echo delay detection and elimination system according to claim 7, characterized in that: Echo cancellation unit, comprising: A visualization subunit, used for visually displaying the echo cancellation audio and the playback audio data based on an oscilloscope, and determining the compatibility parameters of the echo cancellation device under the target delay based on the visualization result; The optimization subunit is used to compare the difference between the echo cancellation audio and the playback audio data to obtain an error signal when the compatibility parameter does not meet the preset threshold; The parameter configuration results of the echo cancellation device are iteratively optimized based on the error signal.

9. A method for detecting and eliminating echo delay, characterized in that: include: Step 1: Initialize the device and control the device to play the recorded audio data based on the initialization result; Step 2: Send the recorded audio data to the mixing device based on the playback result, and control the driver of the audio speaker to play the mixed data of the mixing device based on the sending result. At the same time, collect the playback audio data based on the preset microphone, and send the playback audio data and the recorded audio data in the mixing device to the echo cancellation device for delay detection; Step 3: Parameters of the echo cancellation device are configured based on the delay detection result, and the echo cancellation device is controlled to perform an echo cancellation operation based on the parameter configuration result.

10. The echo delay detection and elimination method according to claim 9, characterized in that: In step 1, the device is initialized, including: Acquiring structural parameters of the echo delay detection and elimination device, and determining a device combination of the echo delay detection and elimination device based on the structural parameters; Extract configuration parameters of each device in the device combination, and determine the service execution process of each device based on the configuration parameters; Determine the initialization detection dimension for each device based on the business execution process, and detect each device based on the initialization detection dimension; Based on the detection results, individual initialization parameters of each device are determined, and initialization configuration of the corresponding devices is performed based on the individual initialization parameters.

Images