Delay detection method, electronic device, computer storage medium, and computer program product

Abstract

A delay detection method, an electronic device, a computer storage medium, and a computer program product. The delay detection method comprises: an extended sound-pickup device receives, through a preset wireless transmission path, an ultrasonic test signal sent by a host device, to obtain a first signal (S202); the extended sound-pickup device collects, by means of a sound-pickup apparatus, the ultrasonic test signal played back by the host device, to obtain a second signal (S204); the extended sound-pickup device determines a first moment at which the first signal is received, and a second moment at which the second signal is collected (S206); and the extended sound-pickup device determines a delay detection result between the host device and the extended sound-pickup device on the basis of the first moment and the second moment (S208). The whole detection process uses an ultrasonic test signal, such that the whole detection process is not perceived by a user, and the ultrasonic test signal has stronger anti-interference performance, such that the accuracy of a detection result is higher; and in the whole detection process, it is only necessary to determine a first moment at which a first signal is received and a second moment at which a second signal is collected, and to calculate a delay between the first moment and the second moment, thereby achieving higher detection efficiency.

Description

Delay detection method, electronic device, computer storage medium and computer program product

[0001] The present application claims priority to the Chinese patent application No. 202411256542.5, filed on September 9, 2024, and entitled "Delay detection method, electronic device, computer storage medium and computer program product", the content of which is incorporated herein by reference in its entirety. TECHNICAL FIELD

[0002] Embodiments of the present application relate to the technical field of computer technology, and particularly relate to a delay detection method, an electronic device, a computer storage medium and a computer program product. BACKGROUND

[0003] The rapid development of wireless audio technology and its convenience have made wireless audio technology widely used. For example, in a wireless audio communication system, a host device and an extended pickup device such as an extended microphone device transmit audio data through wireless technology.

[0004] In terms of the wireless audio communication system, the audio signal broadcast by the host device is absorbed by the extended microphone device again, which causes the audio signal collected by the extended microphone device to contain echo signals. To avoid the above problem, a feedback canceller is usually provided in the extended microphone device to perform cancellation processing on the echo signals. The processing process of the feedback canceller has a high requirement on the wireless transmission delay between the host device and the extended microphone device, and therefore, high-precision delay detection needs to be implemented.

[0005] At present, the delay is usually detected by manual observation, which has low detection efficiency and low detection precision. SUMMARY

[0006] In view of the above, embodiments of the present application provide a delay detection method, an electronic device, a computer storage medium and a computer program product to at least partially solve the above problems.

[0007] According to a first aspect of embodiments of the present application, a delay detection method is provided, applied to an extended pickup device in a wireless audio communication system, the wireless audio communication system further comprising a host device, the host device and the extended pickup device performing signal transmission through a preset wireless transmission path, the delay detection method comprising: receiving an ultrasonic test signal sent by the host device through the preset wireless transmission path to obtain a first signal; collecting the ultrasonic test signal played by the host device through a pickup device in the extended pickup device to obtain a second signal, wherein the time at which the host device sends the ultrasonic test signal and the time at which the host device plays the ultrasonic test signal are the same time; determining a first time at which the first signal is received and a second time at which the second signal is collected; and determining a delay detection result between the host device and the extended pickup device according to the first time and the second time.

[0008] According to a second aspect of embodiments of the present application, a delay detection device is provided, applied to an extended pickup device in a wireless audio communication system, the wireless audio communication system further comprising a host device, the host device and the extended pickup device performing signal transmission through a preset wireless transmission path, the delay detection device comprising a first receiving module, a second receiving module, a receiving time determining module and a delay detection module. The first receiving module is configured to receive an ultrasonic test signal sent by the host device through the preset wireless transmission path to obtain a first signal; the second receiving module is configured to collect the ultrasonic test signal played by the host device through a pickup device in the extended pickup device to obtain a second signal, wherein the time at which the host device sends the ultrasonic test signal and the time at which the host device plays the ultrasonic test signal are the same time; the receiving time determining module is configured to determine a first time at which the first signal is received and a second time at which the second signal is collected; and the delay detection module is configured to determine a delay detection result between the host device and the extended pickup device according to the first time and the second time.

[0009] According to a third aspect of embodiments of the present application, an electronic device is provided, comprising: a processor, a memory, a communication interface and a communication bus, the processor, the memory and the communication interface performing communication with each other through the communication bus; the memory is configured to store at least one executable instruction, the executable instruction causing the processor to perform operations corresponding to the method of the first aspect.

[0010] According to a fourth aspect of embodiments of the present application, a computer storage medium is provided, having a computer program stored thereon, the program being executed by a processor to implement the method of the first aspect.

[0011] According to a fifth aspect of embodiments of the present application, a computer program product is provided, comprising computer instructions, the computer instructions instructing a computing device to perform operations corresponding to the method of the first aspect.

[0012] In the embodiment of the present application, the host device sends the ultrasonic test signal and plays the ultrasonic test signal at the same time, the extension pickup device receives the ultrasonic test signal sent by the host device through the preset wireless transmission path to obtain a first signal; the pickup device in the extension pickup device collects the ultrasonic test signal played by the host device to obtain a second signal; the first time when the first signal is received and the second time when the second signal is collected are determined in the extension pickup device; and then according to the delay between the first time and the second time, the delay detection result between the host device and the extension pickup device can be determined. The entire detection process of the embodiment of the present application uses the ultrasonic test signal, so that the user is not sensitive to the entire detection process, and the ultrasonic test signal has stronger anti-interference performance, so that the accuracy of the detection result is higher; further, only the first time when the first signal is received and the second time when the second signal is collected are determined in the entire detection process, and the delay between the two is calculated, the data processing amount is small, and the detection efficiency is higher. BRIEF DESCRIPTION OF DRAWINGS

[0013] In order to more clearly illustrate the technical solutions in the embodiments of the present application or the prior art, the drawings needed to be used in the embodiments or the prior art description will be briefly introduced. Obviously, the drawings in the following description are only some embodiments described in the embodiments of the present application, and other drawings can also be obtained by those skilled in the art according to these drawings.

[0014] Fig. 1 is a schematic diagram of an exemplary application scenario of a delay detection method according to an embodiment of the present application;

[0015] Fig. 2 is a step flowchart of a delay detection method according to an embodiment of the present application;

[0016] Fig. 3A is a schematic diagram of an exemplary host device and extension pickup device according to an embodiment of the present application;

[0017] Fig. 3B is a schematic diagram of another exemplary host device and extension pickup device according to an embodiment of the present application

[0018] Fig. 4 is a step flowchart of another delay detection method according to an embodiment of the present application;

[0019] Fig. 5 is a structural block diagram of a delay detection device according to an embodiment of the present application;

[0020] Fig. 6 is a structural schematic diagram of an electronic device according to an embodiment of the present application. DETAILED DESCRIPTION

[0021] In order to make personnel in the art better understand the technical solutions in the embodiments of the present application, the technical solutions in the embodiments of the present application will be clearly and completely described below in combination with the drawings in the embodiments of the present application. Obviously, the described embodiments are only a part of the embodiments of the present application, not all the embodiments. Based on the embodiments of the present application, all other embodiments obtained by those skilled in the art should belong to the scope of protection of the present application.

[0022] Before the delay detection method of the embodiments of the present application is described, the application scenario of the delay detection method will be briefly described to facilitate understanding.

[0023] Referring to FIG. 1, FIG. 1 is a schematic diagram of an exemplary application scenario of the delay detection method of the embodiments of the present application. The wireless audio communication system of the embodiments can include a host device 10 and one or more extension pickup devices 20, and multiple extension pickup devices are shown in FIG. 1 as an example.

[0024] The wireless audio communication system can be generally applied in a conference scenario, and the host device 10 and the one or more extension pickup devices 20 in the wireless audio communication system are located in the same acoustic space, for example, in the same conference room. The host device 10 and the extension pickup devices 20 can transmit signals through a preset wireless transmission path, which can be a wireless local area network transmission path. Exemplarily, in a local conference scenario, that is, in a scenario in which all participants are located in the same acoustic space, the pickup device (for example, a microphone) in each extension pickup device 20 can collect the sound in the conference room and convert it into a corresponding audio signal transmitted to the host device 10. The host device 10 converts and processes the audio signal and then plays it in the conference room through a loudspeaker device (for example, a loudspeaker). In addition, corresponding to the local conference scenario, there can also be a remote conference scenario, that is, participants are distributed in different acoustic spaces, and each participant in a different acoustic space communicates through the conference equipment arranged in the respective space. In terms of the participants, the local conference terminal equipment can be referred to as the near-end conference equipment, and the other conference equipment is referred to as the far-end conference equipment. In the remote conference scenario, the host device 10 can also be in communication connection with the far-end conference equipment to receive the audio signal sent by the far-end conference equipment. The host device 10 converts and processes the received audio signal and then plays it in the conference room through a loudspeaker device.

[0025] For the above conference scenario, when the speaker of the remote conference device speaks, the host device 10 receives the audio signal transmitted by the remote conference device, processes the audio signal, and then plays it out through the loudspeaker. It should be understood that the sound played out through the loudspeaker will be picked up again by the microphone of the host device 10 or the pickup device of the extension pickup device 20 and returned to the remote, thereby generating an "echo" at the remote. The audio signal played by the host device 10 and picked up again by the pickup device of the host device 10 or the extension pickup device 20 can be referred to as an "echo signal".

[0026] To improve the user's auditory experience, the above echo signal is usually subjected to echo signal cancellation with the audio signal transmitted from the remote as a reference signal. Since there are two sources of echo signals, echo cancellation operations can be performed for echo signals from the two different sources.

[0027] Among them, as for the echo signal caused by the microphone of the host device 10 picking up the played sound again, since the playing of the reference signal is performed by the host device 10, the reference signal required for echo cancellation is locally present in the host device 10 before the echo cancellation operation is performed, and thus echo cancellation can be conveniently performed based on the local reference signal.

[0028] As for the echo signal caused by the extension pickup device 20 picking up the audio signal played by the host device 10 again, the extension pickup device 20 first acquires the reference signal corresponding to the echo signal from the host device 10 through the wireless transmission path, and then performs echo cancellation processing on the echo signal through the acoustic echo canceller AEC. The echo cancellation processing process requires that the arrival time of the reference signal based on the wireless transmission path be earlier than the arrival time of the echo signal based on air propagation, and thus the echo cancellation processing has a high requirement for the wireless transmission delay between the host device 10 and the extension pickup device 20. If the above delay is large, the arrival time of the reference signal will be later than the arrival time of the echo signal, and thus the echo cancellation will fail and the echo leakage phenomenon will occur.

[0029] In order to ensure the normal operation of the acoustic echo canceller, a high-precision delay detection needs to be implemented. For this purpose, the embodiments of the present application provide a delay detection scheme to at least partially solve the above problems.

[0030] The specific implementation of the embodiments of the present application will be further described below in conjunction with the drawings of the embodiments of the present application.

[0031] Referring to FIG. 2, a step flowchart of a delay detection method according to an embodiment of the present application is shown. The delay detection method of the present embodiment includes the following steps:

[0032] S202, the extension pickup device receives the ultrasonic test signal sent by the host device through the preset wireless transmission path to obtain a first signal.

[0033] Exemplarily, the preset wireless transmission path can be a wireless local area network transmission path, and the host device sends the ultrasonic test signal to the extension pickup device through the preset wireless local area network. Correspondingly, a hardware module for realizing wireless local area network transmission, such as a wireless signal receiving unit, a wireless signal sending unit, etc., is arranged in the extension pickup device. The ultrasonic test signal received by the extension pickup device through the preset wireless transmission path is taken as the first signal.

[0034] S204, the extension pickup device collects the ultrasonic test signal played by the host device through the pickup device to obtain a second signal.

[0035] The time at which the host device sends the ultrasonic test signal is the same as the time at which the host device plays the ultrasonic test signal.

[0036] Exemplarily, at the same time at which the host device sends the ultrasonic test signal to the extension pickup device through the preset wireless local area network, the host device plays the ultrasonic test signal, and the ultrasonic test signal collected by the pickup device in the extension pickup device will be taken as the second signal.

[0037] Here, steps S202 and S204 are steps performed at the same time.

[0038] S206, the extension pickup device determines a first time at which the first signal is received and a second time at which the second signal is collected.

[0039] Exemplarily, the first time at which the first signal is received and the second time at which the second signal is collected are determined with the system time of the extension pickup device as a time axis. Before the first time and the second time are determined, the first signal and the second signal can also be filtered respectively to remove interference signals, so as to improve the accuracy of the determined first time and second time. Here, the first time refers to the time at which the first signal is input into the echo canceller in the extension pickup device, and similarly, the second time refers to the time at which the second signal is input into the echo canceller in the extension pickup device.

[0040] In an optional implementation manner, the first time at which the first signal is received and the second time at which the second signal is collected include: respectively performing matched filtering processing on the first signal and the second signal according to a preset matched filtering signal to obtain a first filtering result corresponding to the first signal and a second filtering result corresponding to the second signal; analyzing the first filtering result to obtain the first time at which the first signal is received; and analyzing the second filtering result to obtain the second time at which the second signal is received.

[0041] Exemplarily, the matched filtering processing can be implemented by a matched filter, and a definition formula of a matched filtering result y(t) is as follows: y(t) = s(t) * h(t), where h(t) represents a matched filtering signal, s(t) represents an input signal, i.e., the first signal or the second signal, * is a convolution symbol, and t represents a time. By performing the matched filtering processing on the first signal and the second signal respectively, the time at which the first signal is most matched in signal amplitude with the preset matched filtering signal, i.e., the first time, can be determined; and similarly, the time at which the second signal is most matched in signal amplitude with the preset matched filtering signal, i.e., the second time, can be determined.

[0042] In the present implementation, by performing the matched filtering processing on the first signal and the second signal respectively, the accurate positions of the first signal and the second signal on the time axis can be determined more accurately, so that the determined first time and second time are more accurate, and further, the delay detection result is more accurate.

[0043] In an optional implementation, before performing the matched filtering processing on the first signal and the second signal according to the preset matched filtering signal, the delay detection method of the present application further includes: receiving the matched filtering signal sent by the host device, the matched filtering signal being obtained by performing time domain reverse processing on the ultrasonic test signal.

[0044] Exemplarily, the matched filtering signal can be obtained by performing time domain reverse processing on the ultrasonic test signal in advance, and then the matched filtering signal is sent to the extended pickup device by the host device and stored by the extended pickup device. Here, the matched filtering signal can be obtained by performing time domain reverse processing on the ultrasonic test signal by a third-party computing device, or can be obtained by performing time domain reverse processing on the ultrasonic test signal by the host device, which is not limited in the present embodiment. The time domain reverse processing on the ultrasonic test signal can be understood as reversing the ultrasonic test signal on the time axis.

[0045] In an optional implementation, in addition to the time-domain matched filtering processing with time as a variable as described above, frequency-domain matched filtering processing with frequency as a variable can also be used to perform the matched filtering processing on the first signal and the second signal respectively, and then the filtering processing result is transformed back to the processing result corresponding to the time domain, so that the data calculation amount of the matched filtering process can be further reduced.

[0046] In the present implementation, the matching filter signal is obtained by time domain reverse processing of the ultrasonic test signal, and the matching filter signal is used to perform matching filter processing on the first signal and the second signal respectively, so that the pulses of the filtered first signal and the filtered second signal are more sharp, the signal-to-noise ratio is higher, and the anti-interference ability is stronger, thereby making the determined first time and second time more accurate, and further making the delay detection result more accurate.

[0047] In an optional implementation, according to the preset matching filter signal, the first signal and the second signal are respectively subjected to matching filter processing to obtain a first filter result corresponding to the first signal and a second filter result corresponding to the second signal, including: the first signal and the second signal are respectively subjected to low-frequency filter processing to obtain a filtered first signal and a filtered second signal; and according to the preset matching filter signal, the filtered first signal and the filtered second signal are respectively subjected to matching filter processing to obtain the first filter result corresponding to the first signal and the second filter result corresponding to the second signal.

[0048] Exemplarily, before the first signal and the second signal are subjected to matching filter processing, a high-pass filter can be used to filter the first signal and the second signal respectively to filter out low-frequency interference signals in the first signal and the second signal. Then, according to the preset matching filter signal, the filtered first signal and the filtered second signal are respectively subjected to matching filter processing to obtain the first filter result corresponding to the first signal and the second filter result corresponding to the second signal.

[0049] In the present implementation, by performing low-frequency filter processing on the first signal and the second signal in advance, low-frequency interference signals can be removed, so that the subsequent processing results of the first signal and the second signal are not affected by the interference signals, the accuracy of the determined first time and second time is improved, and further the delay detection result is more accurate.

[0050] S208, the extension sound pickup device determines a delay detection result between the host device and the extension sound pickup device according to the first time and the second time.

[0051] Exemplarily, according to the first time and the second time, the order relationship between the first time and the second time can be determined, and the interval duration can be calculated, and the order relationship between the first time and the second time and the interval duration are output as the delay detection result. Further, according to the order relationship between the first time and the second time and the interval duration, it can be judged whether the delay detection result meets the delay requirement or not. Wherein, the judgment condition meeting the delay requirement can be preset.

[0052] Specifically, in order to offset the echo contained in the collection signal (second signal) collected by the pickup device, the echo canceller in the extended microphone device usually receives the first signal received through the wireless transmission path as a reference signal, and performs echo cancellation on the collection signal (second signal) collected by the pickup device. The reference signal represents the original signal without any reflection or transmission delay, and the reference signal is the reference of the echo signal, which is used in the echo cancellation algorithm to identify the echo signal from the collection signal (second signal). If the receiving time of the reference signal is later than the collection time of the collection signal (second signal), the echo signal cannot be correctly identified, and the echo cancellation operation cannot be performed. Further, the calculation and processing of the echo cancellation algorithm also consume a certain time length, and if the reference signal and the collection signal (second signal) arrive at the same time, the echo cancellation cannot be performed.

[0053] In summary, when determining the delay detection result, the delay requirement can be set as: the first time when the first signal is received through the wireless transmission path is earlier than the second time when the second signal is collected, and the interval time between the first time and the second time is greater than or equal to the first preset threshold. The first preset threshold can be determined based on the time required to perform the echo cancellation algorithm.

[0054] When the relationship between the first time and the second time meets the above requirement, it is determined that the delay detection result between the host device and the extended pickup device meets the delay requirement.

[0055] On the contrary, if the first time is later than the second time, or the first time is earlier than the second time, but the interval time between the first time and the second time is less than the first preset threshold, it is determined that the delay detection result between the host device and the extended pickup device does not meet the delay requirement.

[0056] The entire detection process of the embodiment of the present application uses an ultrasonic test signal, so that the user is not sensitive to the entire detection process, and the ultrasonic test signal has stronger anti-interference performance, so that the accuracy of the detection result is higher. Further, only the first time when the first signal is received and the second time when the second signal is collected are determined in the entire detection process, and the delay between the two is calculated, so that the data processing amount is small and the detection efficiency is higher.

[0057] In an optional implementation, the delay detection method of the embodiment of the present application further includes: determining a plurality of delay detection results between the host device and the extended pickup device according to a preset frequency; and performing statistics on the plurality of delay detection results determined in a preset time period to obtain a delay detection statistical result.

[0058] Exemplarily, the preset time period and the preset frequency can be flexibly set by those skilled in the art according to actual technical needs, for example, the preset time period can be one day, one week, etc., and the preset frequency can be detection once per hour, etc., and the embodiment does not limit this.

[0059] In order to ensure the stability of the delay detection result, steps S202 to S208 can be performed according to the preset frequency to determine a plurality of delay detection results between the host device and the extended pickup device, and then a plurality of delay detection results determined within the preset time period are counted to obtain a delay detection statistical result. For example, the number of times when the delay detection result meets the delay requirement and the number of times when the delay detection result does not meet the delay requirement can be counted respectively to obtain the delay detection statistical result. The delay statistical result can be output as text or in the form of a chart, and the embodiment does not limit this.

[0060] In the implementation manner, the operation of delay detection can be automatically performed multiple times to meet the testing requirement for the stability of the delay, and the delay detection statistical result can be automatically output to facilitate the user to obtain the detection result.

[0061] Referring to FIG. 3A, a schematic diagram of an exemplary host device and an extended pickup device according to the embodiment of the application is shown. The data processing process of the host device and the extended pickup device in FIG. 3A is exemplarily described in the embodiment.

[0062] The ultrasonic test signal sending module in the host device is configured to send an ultrasonic test signal (which can be sent according to a preset frequency). The ultrasonic test signal can be emitted by the wireless sending module and the playing module (for example, a loudspeaker). The ultrasonic test signal emitted by the wireless sending module is transmitted to the wireless receiving unit in the extended pickup device through a preset wireless transmission path. The ultrasonic test signal played by the playing module can be propagated through the air, which is collected by the collection module in the host device again on the one hand, and can also be collected by the pickup device in the extended pickup device on the other hand.

[0063] The wireless receiving unit in the extended pickup device can receive the ultrasonic test signal transmitted by the wireless sending module of the host device through the preset wireless transmission path, thereby obtaining a first signal, and storing the first signal to a preset queue, and then sending the first signal to the echo canceller. The pickup device in the extended pickup device can collect the ultrasonic test signal played by the playing module of the host device (which also collects other audio signals in the environment in the actual application scenario), thereby obtaining a second signal, and sending the second signal to the echo canceller. The echo canceller calculates the delay according to the first signal and the second signal, and then performs audio echo cancellation according to the delay. The echo canceller can obtain a first processed signal after processing, and send the first processed signal to the wireless sending unit for emission.

[0064] The wireless receiving module in the host device receives the first processed signal sent by the wireless sending unit in the extended pickup device, and sends the first processed signal to the audio data processing module; the collection module in the host device can send the collected ultrasonic test signal to the audio data processing module; in addition, the audio data processing module can also read the original ultrasonic test signal from the ultrasonic test signal sending module, and then the audio data processing module can take the original ultrasonic test signal as a reference signal to perform echo cancellation processing on the signal collected by the collection module, so as to obtain the second processed signal. At this time, the audio data processing module can obtain two kinds of signals processed by echo cancellation: the first processed signal processed by echo cancellation on the signal collected by the extended pickup device, and the second processed signal processed by echo cancellation on the locally collected signal; then, the audio data processing module can select the better signal from the first processed signal and the second processed signal to obtain the target signal. For the local conference scene, the host device can send the target signal through the wireless sending module and the playing module again; for the remote conference scene, the host device can send the target signal to the remote conference device.

[0065] Referring to FIG. 4, a step flowchart of another delay detection method according to an embodiment of the present application is shown. As shown in FIG. 4, the embodiment mainly shows the specific implementation of step S208 of the above-mentioned embodiment, and mainly includes the following steps:

[0066] S402, receiving the ultrasonic test signal sent by the host device through the preset wireless transmission path to obtain a first signal.

[0067] S404, collecting the ultrasonic test signal played by the host device through the pickup device in the extended pickup device to obtain a second signal.

[0068] Wherein, the time of sending the ultrasonic test signal by the host device and the time of playing the ultrasonic test signal are the same time.

[0069] S406, determining a first time when the first signal is received, and a second time when the second signal is collected.

[0070] It should be noted that steps S402 to S406 can be implemented by referring to the specific implementation of steps S202 to S206 described above, and will not be repeated here.

[0071] S408, judging whether the first time is earlier than the second time, and whether the interval time length between the first time and the second time is greater than a first preset threshold.

[0072] Exemplarily, the first preset threshold value can be flexibly set by those skilled in the art according to actual technical needs, for example, 10 milliseconds, and the embodiment does not limit this. Whether the interval duration between the first time and the second time is greater than the first preset threshold value, that is, whether the interval duration between the first time and the second time is greater than the first preset threshold value is determined.

[0073] In S410, if the first time is earlier than the second time, and the interval duration between the first time and the second time is greater than or equal to the first preset threshold value, it is determined that the delay detection result between the host device and the extended pickup device meets the delay requirement.

[0074] In S412, if the first time is later than the second time, or the first time is earlier than the second time, but the interval duration between the first time and the second time is less than the first preset threshold value, it is determined that the delay detection result between the host device and the extended pickup device does not meet the delay requirement.

[0075] In the embodiment, only according to the determination result of whether the first time is earlier than the second time, and whether the interval duration between the first time and the second time is greater than the first preset threshold value, the delay detection result is determined to meet the delay requirement or not to meet the delay requirement, without complex data calculation logic, which can effectively improve the detection efficiency.

[0076] In an optional implementation, after it is determined that the delay detection result between the host device and the extended pickup device does not meet the delay requirement, the delay detection method of the embodiment of the application further includes: outputting delay exception reminding information.

[0077] Exemplarily, the delay exception reminding information can be information output only when the delay detection result does not meet the delay requirement, and the output mode can be text information with color marking, or output in the form of audio broadcast, etc., and the embodiment does not limit this.

[0078] In the implementation, the delay exception reminding information can be output only for the delay detection result that does not meet the delay requirement, and the delay detection result that meets the delay requirement is not output, thereby reducing the data transmission amount of the extended pickup device.

[0079] In an optional implementation, after receiving the ultrasonic test signal sent by the host through the preset wireless transmission path to obtain a first signal, the delay detection method of the embodiment further includes: recording a receiving time of the first signal; determining a first time of receiving the first signal includes: sending the first signal received through the preset wireless transmission path to an echo canceller in the extended pickup device through the preset firmware in the extended pickup device, and determining the time of receiving the first signal by the echo canceller as the first time of receiving the first signal; after determining that the delay detection result between the host device and the extended pickup device does not meet the delay requirement, the delay detection method of the embodiment further includes: judging whether the interval time between the first time and the receiving time exceeds a second preset threshold; if yes, outputting firmware abnormality reminding information.

[0080] Exemplarily, referring to FIG. 3A, the extended pickup device records the time of receiving the ultrasonic test signal by the wireless receiving unit as the receiving time. The preset firmware is provided with a preset queue, which can be a wireless signal receiving queue. The wireless receiving unit receives the ultrasonic test signal to obtain the first signal, and stores the first signal to the preset queue through the preset firmware, and then sends the first signal to the echo canceller from the preset queue. The time of receiving the first signal by the echo canceller is the first time. When the delay detection result does not meet the delay requirement, whether the interval time between the first time and the receiving time exceeds a second preset threshold is judged. The second preset threshold can be flexibly set by the person skilled in the art according to the actual technical needs, and the embodiment does not limit this. If the interval time between the first time and the receiving time exceeds the second preset threshold, it means that the delay of the first signal at the preset firmware is abnormal, and the firmware abnormality reminding information is outputted.

[0081] In the implementation, by detecting the time of the first signal at different positions in the transmission process in the extended pickup device, the specific reason for not meeting the delay requirement can be further located, so that the user can solve the problem in time.

[0082] In an optional implementation, after judging whether the interval time between the first time and the receiving time exceeds the second preset threshold, the delay detection method of the embodiment further includes: if the interval time between the first time and the receiving time does not exceed the second preset threshold, outputting wireless transmission path abnormality reminding information.

[0083] Exemplarily, if the interval time between the first time and the receiving time does not exceed the second preset threshold, it means that the delay at the preset firmware is normal, and the fault point causing the delay requirement not to be met is the wireless transmission path, for example, the wireless receiving unit, so that the wireless transmission path abnormality reminding information can be outputted.

[0084] In this implementation, the specific reason that does not meet the delay requirement can be quickly located according to the judgment condition, without manual checking one by one, which can help the user to quickly solve the problem.

[0085] Referring to FIG. 3B, another exemplary structure block diagram of the host device and the extended pickup device according to the embodiment of the present application is shown. The left side is the host device, and the right side is the extended pickup device. In this embodiment, the extended pickup device is an extended microphone.

[0086] The host device can include a downlink processing algorithm module (DLProcessing_FrameProcess), an ultrasonic test signal sending module, a digital signal processor ADSP, a wireless sending module, a playing module, a collecting module, a wireless receiving module, and an audio data processing module. The downlink processing algorithm module is used to process the audio signal received by the host device, so that the sound heard by the host device is better. The ultrasonic test signal sending module sends ultrasonic test signals periodically. The ultrasonic test signal can include 80ms ultrasonic data and 1s mute data. The digital signal processor ADSP is a digital signal processing chip used to realize the calculation of digital signal processing. The wireless sending module includes a wireless signal sending buffer module (pcm_write(wf) buffer_w_out), a wireless driver module (wf_driver), and a wireless hardware module (wf hardware). The wireless driver module is used to drive the wireless hardware module to send the ultrasonic test signal. The playing module includes a playing data buffer module (pcm_write(pa) buffer), a playing driver module (pa_driver), a playing hardware module (pa hardware), and a loudspeaker. The playing driver module is used to drive the playing hardware module to play the ultrasonic test signal through the loudspeaker. The collecting module includes a microphone (host Mic) of the host device, a collecting driver module (collecting driver), and a microphone signal reading buffer module (pcm_read(mic) in_buffer). The collecting driver module is used to drive the host microphone to collect the ultrasonic test signal. The wireless receiving module includes a wireless hardware module (wf hardware), a wireless driver module (wf_driver), and a wireless signal receiving buffer module (pcm_read(wf) buffer_w). The wireless driver module is used to drive the wireless hardware module to receive the ultrasonic test signal. The audio data processing module includes a 3A audio data processing thread and an echo canceller processing module (Aec Processing_FrameProcess). The echo canceller processing module is used to perform echo cancellation processing according to the two signals sent by the collecting module to obtain a second processing signal. The 3A audio data processing thread is used to select a better signal from the first processing signal and the second processing signal to obtain a target signal.

[0087] The extended microphone can include a wireless receiving unit, a preset queue, a pickup device, a pickup signal transmission queue, an echo canceller, a wireless sending queue and a wireless sending unit. The wireless receiving unit includes a wireless hardware module (wf hardware), a wireless driver module (wf_driver) and a wireless signal receiving buffer module (pcm_read buffer_wf_in); the preset queue can be a wireless signal transmission task record queue (g_wf_record_task_queue); the pickup device includes an extended microphone (extended microphone Mic), a collection driver module (collection driver) and a signal reading buffer module (pcm_read in_buffer); the pickup signal transmission queue can be a microphone signal transmission task record queue (g_mic_record_task_queue); the echo canceller includes an aec processing thread, which is used to obtain a first signal and a second signal from the preset queue and the pickup signal transmission queue respectively, and perform echo cancellation operation according to the delay between the first signal and the second signal to obtain the first processing signal, and send the first processing signal to the wireless sending queue (g_wf_play_task_queue); the wireless sending unit includes a wireless signal sending buffer module (pcm_write buffer_wf_out), a wireless driver module (wf_driver) and a wireless hardware module (wf hardware).

[0088] The labels 1 to 11 shown in FIG. 3B are time detection points. In the host device, the sending time of the ultrasonic test signal can be recorded at the detection point 1, the time when the ultrasonic test signal collected by the other microphone of the host device is received can be recorded at the detection point 2, wherein the host device includes a back pickup microphone and a microphone other than the back pickup microphone, the back pickup microphone refers to a microphone closest to the loudspeaker among all the microphones on the host device; the receiving time of the first processing signal can be recorded at the detection point 3; the time when the ultrasonic test signal sent by the playing hardware is received can be recorded at the detection point 4; the time when the ultrasonic test signal collected by the back pickup microphone of the host device is received can be recorded at the detection point 5. In the extended pickup device, the receiving time of the first signal can be recorded at the detection point 6, the sending time of the first processing signal can be recorded at the detection point 8, and the first time when the first signal is received can be recorded at the detection point 9; the receiving time of the second signal can be recorded at the detection point 7, and the second time of the second signal can be recorded at the detection point 10; the acquisition time of the first processing signal can be recorded at the detection point 11.

[0089] The embodiment of the present application can obtain a delay detection result by determining the delay between the detection point 9 and the detection point 10; when the delay detection result does not meet the delay requirement, the fault point is determined to be the preset firmware or the preset wireless transmission path by determining the delay between the detection point 6 and the detection point 9. Further, the embodiment can also determine the delay between the detection 3 and the detection point 4 to detect the delay of the entire data processing process of the extension pickup device, and determine the delay between the detection point 1 and the detection point 5 to detect the collection delay of the back-sampling microphone in the host device, and so on. The user can select two detection points from the above-mentioned multiple detection points according to the delay detection requirement to determine the delay between the two detection points, so as to achieve the delay detection target of the user, thereby facilitating the user to quickly locate the fault reason of the wireless audio communication system.

[0090] Referring to FIG. 5, a structural block diagram of a delay detection device according to an embodiment of the present application is shown.

[0091] The delay detection device of the embodiment is applied to an extension pickup device in a wireless audio communication system, and the wireless audio communication system further includes a host device, and the host device and the extension pickup device perform signal transmission through a preset wireless transmission path.

[0092] The delay detection device of the embodiment includes a first receiving module 502, a second receiving module 504, a time determining module 506, and a delay detection module 508.

[0093] The first receiving module 502 is configured to receive an ultrasonic test signal sent by the host device through the preset wireless transmission path to obtain a first signal; the second receiving module 504 is configured to collect the ultrasonic test signal played by the host device through a pickup device in the extension pickup device to obtain a second signal, wherein the time of sending the ultrasonic test signal by the host device and the time of playing the ultrasonic test signal are the same time; the time determining module 506 is configured to determine a first time of receiving the first signal and a second time of collecting the second signal; and the delay detection module 508 is configured to determine a delay detection result between the host device and the extension pickup device according to the first time and the second time.

[0094] In an optional implementation, the time delay detection module 508 is further configured to: determine whether the first time is earlier than the second time, and whether the interval between the first time and the second time is greater than or equal to the first preset threshold; if the first time is earlier than the second time, and the interval between the first time and the second time is greater than or equal to the first preset threshold, it is determined that the time delay detection result between the host device and the extended pickup device meets the time delay requirement; if the first time is later than the second time, or the first time is earlier than the second time, but the interval between the first time and the second time is less than the first preset threshold, it is determined that the time delay detection result between the host device and the extended pickup device does not meet the time delay requirement.

[0095] In an optional implementation, the time delay detection apparatus further comprises a prompt output module, configured to output time delay exception reminding information.

[0096] In an optional implementation, the time determination module 506 is further configured to: record a receiving time of the first signal; send the first signal received through the preset wireless transmission path to the echo canceller in the extended pickup device through the preset firmware in the extended pickup device, and determine the time when the echo canceller receives the first signal as the first time when the first signal is received; the prompt output module is further configured to: determine whether the interval between the first time and the receiving time exceeds a second preset threshold; if yes, output firmware exception reminding information.

[0097] In an optional implementation, the prompt output module is further configured to: if the interval between the first time and the receiving time does not exceed the second preset threshold, output wireless transmission path exception reminding information.

[0098] In an optional implementation, the time determination module 506 is further configured to: perform matched filtering processing on the first signal and the second signal respectively according to a preset matched filtering signal, to obtain a first filtering result corresponding to the first signal, and a second filtering result corresponding to the second signal; analyze the first filtering result to obtain the first time when the first signal is received; analyze the second filtering result to obtain the second time when the second signal is received.

[0099] In an optional implementation, the time determination module 506 is further configured to: receive a matched filtering signal sent by the host, the matched filtering signal being obtained by performing time domain reverse processing on the ultrasonic test signal.

[0100] In an optional implementation, the time determining module 506 is further configured to perform low-frequency filtering on the first signal and the second signal respectively to obtain a filtered first signal and a filtered second signal; and perform matching filtering on the filtered first signal and the filtered second signal respectively according to a preset matching filtering signal to obtain a first filtering result corresponding to the first signal and a second filtering result corresponding to the second signal.

[0101] In an optional implementation, the delay detecting apparatus further includes a statistics module configured to determine a plurality of delay detection results between the host device and the extension pickup device at a preset frequency; and perform statistics on the plurality of delay detection results determined within a preset time period to obtain a delay detection statistics result.

[0102] The delay detecting apparatus of the embodiment is configured to implement the corresponding delay detection method in the foregoing method embodiments, and has the beneficial effects of the corresponding method embodiments, which will not be described herein again. In addition, the functions of each module in the delay detecting apparatus of the embodiment can be implemented by referring to the description of the corresponding part in the foregoing method embodiments, which will not be described herein again.

[0103] Referring to FIG. 6, a structural schematic diagram of an electronic device according to an embodiment of the present application is shown, and the embodiment of the present application does not limit the specific implementation of the electronic device.

[0104] As shown in FIG. 6, the electronic device can include a processor 602 configured to execute a program 610, a communications interface 604, a memory 606, and a communications bus 608.

[0105] In the embodiment of the present application, the program can include a program code including computer operation instructions.

[0106] The processor, the communications interface, and the memory complete the communication among each other through the communications bus.

[0107] The communications interface is configured to communicate with other electronic devices or servers.

[0108] The processor is configured to execute the program, and specifically can execute the related steps in the foregoing method embodiments.

[0109] Specifically, the program can include a program code including computer operation instructions.

[0110] The processor can be a CPU, or an application specific integrated circuit (ASIC), or one or more integrated circuits configured to implement one or more embodiments of the present application. The one or more processors included in the smart device can be the same type of processor, such as one or more CPUs; or can be different types of processors, such as one or more CPUs and one or more ASICs.

[0111] The memory is configured to store programs. The memory can include a high-speed RAM memory, and can further include a non-volatile memory, such as at least one disk memory.

[0112] The program can include a plurality of computer instructions, and the program can specifically cause the processor to perform operations corresponding to the delay detection method described in any one of the plurality of method embodiments.

[0113] The specific implementation of each step in the program can refer to the corresponding description in the corresponding steps and units in the above method embodiments, and has corresponding beneficial effects, which will not be described here. Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working process of the above-described devices and modules can refer to the corresponding process description in the above method embodiments, which will not be described here.

[0114] The embodiments of the present application also provide a computer storage medium having a computer program stored thereon, and the program is executed by a processor to implement the delay detection method described in any one of the plurality of method embodiments. The computer storage medium includes but is not limited to: a compact disc read-only memory (CD-ROM), a random access memory (RAM), a floppy disk, a hard disk, or a magneto-optical disk, etc.

[0115] The embodiments of the present application also provide a computer program product, which includes computer instructions, and the computer instructions instruct a computing device to perform operations corresponding to any one of the plurality of method embodiments.

[0116] In addition, it needs to be explained that the information related to the user (including but not limited to user equipment information, user personal information, etc.) and data (including but not limited to sample data used for training the model, data used for analysis, stored data, displayed data, etc.) involved in the embodiments of the present application are all information and data authorized by the user or authorized by all parties, and the collection, use and processing of the related data need to comply with relevant regulations and standards, and provide corresponding operation entrances for the user to select authorization or refusal.

[0117] It should be noted that, according to the needs of implementation, each component / step described in the embodiments of the present application can be split into more components / steps, or two or more components / steps or part operations of the components / steps can be combined into a new component / step, to achieve the purpose of the embodiments of the present application.

[0118] The above method according to the embodiments of the present application can be implemented in hardware, firmware, or as software or computer code that can be stored in a recording medium such as a CD-ROM, a RAM, a floppy disk, a hard disk, or a magneto-optical disk, or be downloaded through a network originally stored in a remote recording medium or a non-transitory machine readable medium and then stored in a local recording medium, so that the method described herein can be stored on a recording medium in such software processing using a general computer, a special purpose processor, or programmable or special hardware such as an Application Specific Integrated Circuit (ASIC) or a Field Programmable Gate Array (FPGA). It can be understood that the computer, processor, microprocessor controller, or programmable hardware includes a storage component (for example, Random Access Memory (RAM), Read-Only Memory (ROM), flash memory, etc.) that can store or receive software or computer code, when the software or computer code is accessed and executed by the computer, processor, or hardware, the method described herein is implemented. In addition, when a general computer accesses the code for implementing the method shown herein, the execution of the code will convert the general computer into a special computer for executing the method shown herein.

[0119] Those of ordinary skill in the art can realize that the units and method steps of the examples described in combination with the embodiments disclosed herein can be implemented by electronic hardware, or a combination of computer software and electronic hardware. Whether the functions are implemented in hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of the embodiments of the present application.

[0120] The above embodiments are only used to illustrate the present application, and not to limit the present application, and those skilled in the art can make various changes and modifications without departing from the spirit and scope of the present application, therefore all equivalent technical solutions also belong to the scope of the present application, the patent protection scope of the present application should be defined by the claims.

Claims

1. A delay detection method applied to an extended pickup device in a wireless audio communication system, the wireless audio communication system further comprising a host device, the host device and the extended pickup device performing signal transmission through a preset wireless transmission path, the method comprising: receiving an ultrasonic test signal sent by the host device through the preset wireless transmission path to obtain a first signal; collecting the ultrasonic test signal played by the host device through a pickup device in the extended pickup device to obtain a second signal, wherein the time when the host device sends the ultrasonic test signal is the same as the time when the host device plays the ultrasonic test signal; determining a first time when the first signal is received and a second time when the second signal is collected; and determining a delay detection result between the host device and the extended pickup device according to the first time and the second time. The determination of the delay detection result between the host device and the extended pickup device according to the first time and the second time comprises: determining whether the first time is earlier than the second time and whether the interval between the first time and the second time is greater than or equal to a first preset threshold; if the first time is earlier than the second time and the interval between the first time and the second time is greater than or equal to the first preset threshold, determining that the delay detection result between the host device and the extended pickup device meets a delay requirement; and if the first time is later than the second time or the first time is earlier than the second time but the interval between the first time and the second time is less than the first preset threshold, determining that the delay detection result between the host device and the extended pickup device does not meet the delay requirement. After determining that the delay detection result between the host device and the extended pickup device does not meet the delay requirement, the method further comprises: outputting delay exception reminding information. After receiving the ultrasonic test signal sent by the host through the preset wireless transmission path to obtain the first signal, the method further comprises: recording the receiving time of the first signal. The determination of the first time when the first signal is received comprises: sending the first signal received through the preset wireless transmission path to a echo canceller in the extended pickup device through a preset firmware in the extended pickup device, and determining the time when the echo canceller receives the first signal as the first time when the first signal is received.

2. The delay detection method of claim 1, wherein, After determining that the delay detection result between the host device and the extended pickup device does not meet the delay requirement, the method further comprises: determining whether the interval between the first time and the receiving time exceeds a second preset threshold; and if yes, outputting firmware exception reminding information. After determining whether the interval between the first time and the receiving time exceeds the second preset threshold, the method further comprises: ​ ​ 3. The delay detection method of claim 2, wherein, ​ ​ 4. The delay detection method of claim 3, wherein, ​ ​ ​ ​ ​ 5. The delay detection method of claim 4, wherein, ​ If the interval between the first time and the receiving time does not exceed the second preset threshold, output wireless transmission path abnormality reminding information.

6. The delay detection method according to any one of claims 1 to 5, wherein The method further comprises: According to a preset matched filter signal, the first signal and the second signal are respectively subjected to matched filter processing, to obtain a first filter result corresponding to the first signal and a second filter result corresponding to the second signal. The first filter result is analyzed to obtain the first time when the first signal is received, and the second filter result is analyzed to obtain the second time when the second signal is received.

7. The delay detection method of claim 6, wherein, Before the step of according to a preset matched filter signal, the first signal and the second signal are respectively subjected to matched filter processing, the method further comprises: The matched filter signal is received, which is obtained by time domain reverse processing on the ultrasonic test signal.

8. The delay detection method according to claim 6 or 7, wherein The step of according to a preset matched filter signal, the first signal and the second signal are respectively subjected to matched filter processing, to obtain a first filter result corresponding to the first signal and a second filter result corresponding to the second signal, comprises: The first signal and the second signal are respectively subjected to low-frequency filter processing, to obtain a filtered first signal and a filtered second signal. According to a preset matched filter signal, the filtered first signal and the filtered second signal are respectively subjected to matched filter processing, to obtain a first filter result corresponding to the first signal and a second filter result corresponding to the second signal.

9. The delay detection method according to any one of claims 1 to 8, wherein, The method further comprises: According to a preset frequency, a plurality of delay detection results between the host device and the extended sound pickup device are respectively determined; The plurality of delay detection results determined within a preset time period are counted to obtain a delay detection statistical result.

10. An electronic device comprising: A processor, a memory, a communication interface and a communication bus, the processor, the memory and the communication interface complete communication with each other through the communication bus; The memory is used to store at least one executable instruction, and the executable instruction makes the processor execute the corresponding operation of the method according to any one of claims 1-9.

11. A computer storage medium having a computer program stored thereon, the program being executed by a processor to implement the method according to any one of claims 1-9.

12. A computer program product comprising computer instructions, the computer instructions instructing a computing device to execute the corresponding operation of the method according to any one of claims 1-9.

Images