Microphone array detection method, device and equipment

Through the Hilbert transformation and amplitude difference judgment method, the problem of high cost and low efficiency of microphone array detection in the prior art is solved, and high accuracy and high efficiency multi-channel detection is achieved.

CN114520946BActive Publication Date: 2024-11-15ALIBABA GROUP HOLDING LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202011303733.4
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2020-11-19
Publication Date
2024-11-15
Estimated Expiration
2040-11-19

AI Technical Summary

Technical Problem

The existing microphone array detection methods are difficult to take into account low cost, high accuracy, stability and high efficiency. Especially in multi-channel situations, manual detection is time-consuming and inaccurate, phase meter detection is high, and phase difference is difficult to identify when the naked eye is detected.

Method used

The Hilbert transform uses Hilbert transform to convert the audio signal output from the microphone channel into a time series signal with a stable amplitude. The phase consistency is judged through the amplitude difference, and the detection process is simplified by signal transformation processing, and the detection process is directly carried out on multiple channels, reducing detection costs and increasing efficiency.

Benefits of technology

It realizes the reduction of detection cost and improvement of detection efficiency while ensuring high detection accuracy and stability, and is suitable for microphone array phase consistency detection in multi-channel situations.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN114520946B_ABST
    Figure CN114520946B_ABST
Patent Text Reader

Abstract

The present application discloses a microphone array detection method, device and equipment. The method includes: for two microphone channels of the device under test that are combined in pairs, determine the first timing signal and the second timing signal according to the two audio signals output by the two channels, and the amplitude difference between the first timing signal and the second timing signal corresponds to the phase difference of the two audio signals; determine whether the two audio signals are consistent in phase according to whether the amplitudes of the first timing signal and the second timing signal are consistent; if the two-channel audio signals combined in pairs are consistent in phase, it is determined that the microphone array of the device under test is consistent in phase. This processing method is used to convert the detection of the microphone channel phase into a relatively simple amplitude detection, and the consistency of the phase of the microphone channel output signal is judged based on the relationship between the transformed analysis signal amplitudes; therefore, the detection cost can be effectively reduced while ensuring high detection accuracy, stability and efficiency.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the field of device detection technology, and specifically to a microphone array detection method and apparatus, a device detection method and apparatus, and an electronic device. Background Art

[0002] In recent years, microphone arrays have been widely used in smart devices, such as common smart speakers (Tmall Genie) and other devices. Whether the multi-channel audio signal is synchronized directly affects the performance of the whole device. Under the premise of inputting the same signal, the multi-channel collected signals should ensure phase consistency and amplitude consistency before reaching the processor algorithm for processing. Testing consistency in hardware testing and production is a necessary step for quality assurance.

[0003] A typical method for detecting the consistency of the audio path of a microphone array is to input a pulse signal or a pure tone signal to the device under test, and use the naked eye to identify whether the phases of the multiple output signals are consistent, or use a phase meter that can realize quantitative detection. However, in the process of implementing the present invention, the inventors found that the above technical solutions all have at least the following problems: 1) Although detection with a phase meter can ensure high detection accuracy, stability and efficiency, the detection cost is high; 2) Detection with the naked eye is not only unable to detect accurately, but also may not be detected by the naked eye if the phase difference is not much; and it is impossible to perform long-term stability detection, such as determining whether there is a problem at a certain moment in a one-hour test; and the manual detection method is extremely time-consuming, especially when there are many channels.

[0004] In summary, how to balance low detection cost with high detection accuracy, stability and efficiency has become an urgent problem that technicians in this field need to solve. Summary of the invention

[0005] The present application provides a microphone array detection method to solve the problem that the prior art cannot take into account both low detection cost and high detection accuracy, stability and efficiency. The present application also provides a microphone array detection device, a device detection method and device, and an electronic device.

[0006] The present application also provides a microphone array detection method, comprising:

[0007] For two microphone channels of the device under test that are combined in pairs, a first Hilbert transform is performed on two audio signals output by the two channels to obtain a first time sequence signal; and a second Hilbert transform is performed on the two audio signals to obtain a second time sequence signal; the first Hilbert transform and the second Hilbert transform have opposite transformation processing modes;

[0008] Determining whether the two audio signals are in phase with each other according to whether the amplitudes of the first time series signal and the second time series signal are consistent;

[0009] If the two-channel audio signals of the pairwise combination are both in phase, then it is determined that the microphone arrays of the device under test are in phase.

[0010] The present application also provides a microphone array detection method, comprising:

[0011] For two microphone channels of the device under test that are combined in pairs, determine a first timing signal and a second timing signal according to two audio signals output by the two channels; wherein the amplitude difference between the first timing signal and the second timing signal corresponds to the phase difference between the two audio signals;

[0012] Determining whether the two audio signals are in phase with each other according to whether the amplitudes of the first time series signal and the second time series signal are consistent;

[0013] If the two-channel audio signals of the pairwise combination are both in phase, then it is determined that the microphone arrays of the device under test are in phase.

[0014] Optionally, the first timing signal includes a calculation result of timing signals of two audio signals with stable amplitudes, and the second timing signal includes a calculation result of two audio signals with stable amplitudes.

[0015] Optionally, the second timing signal is determined in the following manner:

[0016] Performing an operation on the two audio signals to obtain a third time series signal;

[0017] transforming the third time series signal into a first complex signal;

[0018] Determine the second timing signal according to the real part and the imaginary part of the first complex signal;

[0019] The first timing signal is determined in the following manner:

[0020] transforming the two audio signals into a second complex signal and a third complex signal;

[0021] Determine a fourth timing signal according to the real part and the imaginary part of the second complex signal; and determine a fifth timing signal according to the real part and the imaginary part of the third complex signal;

[0022] An operation is performed on the fourth timing signal and the fifth timing signal to obtain a first timing signal.

[0023] Optionally, converting the third timing signal into the first complex signal includes:

[0024] Performing a 90-degree phase shift process on the third time series signal, so that the signal after the phase shift is a first complex signal;

[0025] The step of transforming the two audio signals into a second complex signal and a third complex signal comprises:

[0026] A 90-degree phase shift process is performed on the two audio signals, and the phase-shifted signals include a second complex signal and a third complex signal.

[0027] Optionally, the 90-degree phase shift processing includes: Hilbert transform;

[0028] The step of determining the second timing signal according to the real part and the imaginary part of the first complex signal comprises:

[0029] A norm process is performed on the first complex signal to obtain the second time series signal.

[0030] Optionally, the operation includes: summing two audio signals.

[0031] Optionally, whether the first timing signal and the second timing signal have the same amplitude is determined in the following manner:

[0032] If the statistical data of the amplitude difference between the first timing signal and the second timing signal at multiple moments is less than or equal to the amplitude difference threshold, it is determined that the amplitudes of the first timing signal and the second timing signal are consistent.

[0033] Optionally, the statistical data includes:

[0034] Amplitude difference mean, amplitude difference variance, amplitude difference standard deviation.

[0035] Optionally, also include:

[0036] Determine a sixth timing signal and a seventh timing signal according to a plurality of audio signals output by the multi-channel microphone channels of the device under test; wherein the amplitude difference between the sixth timing signal and the seventh timing signal corresponds to the phase difference of the plurality of audio signals;

[0037] Determining whether the sixth timing signal and the seventh timing signal have the same amplitude;

[0038] If the above judgment result is no, it is determined that the microphone array phases are inconsistent;

[0039] If the above judgment result is yes, the step of entering into the step of determining the first timing signal and the second timing signal for the two microphone channels of the device under test in pairs according to the two audio signals output by the two channels.

[0040] Optionally, the sixth timing signal includes a timing signal with a stable amplitude that is a result of calculation of multiple audio signals, and the seventh timing signal includes a timing signal with a stable amplitude that is a result of calculation of multiple audio signals.

[0041] Optionally, the determining whether the sixth timing signal and the seventh timing signal have the same amplitude includes:

[0042] If the statistical data of the amplitude difference between the sixth timing signal and the seventh timing signal at multiple moments is less than or equal to the amplitude difference threshold, it is determined that the amplitudes of the sixth timing signal and the seventh timing signal are consistent.

[0043] Optionally, also include:

[0044] The analog electrical signal output by the signal generator is used as the input signal of the microphone channel, and the audio signal output by the microphone channel is determined by the device under test.

[0045] Optionally, the analog electrical signal includes: a sinusoidal wave analog electrical signal.

[0046] Optionally, the sinusoidal wave analog electrical signals inputted by the multiple detections are high frequency signals of similar quality to each other.

[0047] The present application also provides a microphone array detection method, comprising:

[0048] Determine a first timing signal and a second timing signal according to a plurality of audio signals output by a plurality of microphone channels of the device under test; wherein an amplitude difference between the first timing signal and the second timing signal corresponds to a phase difference of a multi-channel output signal;

[0049] Whether the phases of the plurality of microphone channels are consistent is determined according to whether the amplitudes of the first timing signal and the second timing signal are consistent.

[0050] The present application also provides a microphone array detection method, comprising:

[0051] For two microphone channels of the device under test that are combined in pairs, determine a first timing signal and a second timing signal according to the first audio signal and the second audio signal output by the two channels; wherein the first timing signal includes a timing signal with a stable amplitude corresponding to the first audio signal, and the second timing signal includes a timing signal with a stable amplitude corresponding to the second audio signal;

[0052] If the statistical data of the amplitude difference between the first time series signal and the second time series signal at multiple moments is less than or equal to the amplitude difference threshold, it is determined that the amplitudes of the two-channel audio signals are consistent;

[0053] If the amplitudes of the two-channel audio signals in the pairwise combination are consistent, it is determined that the microphone array amplitudes of the device under test are consistent.

[0054] The present application also provides a device detection method, comprising:

[0055] Acquire a first audio signal output by a microphone channel of the device under test and a second audio signal output by a sampling channel of the device under test;

[0056] Determine a first timing signal and a second timing signal according to the first audio signal and the second audio signal; wherein the amplitude difference between the first timing signal and the second timing signal corresponds to the phase difference between the two audio signals;

[0057] Whether the microphone channel and the echo channel are in phase with each other is determined according to whether the amplitudes of the first time sequence signal and the second time sequence signal are consistent.

[0058] The present application also provides a device detection method, comprising:

[0059] Acquire a first audio signal output by a microphone channel of the device under test and a second audio signal output by a sampling channel of the device under test;

[0060] Determine a first time sequence signal and a second time sequence signal according to the first audio signal and the second audio signal; wherein the first time sequence signal includes a time sequence signal with a stable amplitude corresponding to the first audio signal, and the second time sequence signal includes a time sequence signal with a stable amplitude corresponding to the second audio signal;

[0061] If the statistical data of the amplitude difference between the first time series signal and the second time series signal at multiple moments is less than or equal to the amplitude difference threshold, it is determined that the amplitude of the microphone channel is consistent with that of the echo channel.

[0062] The present application also provides a microphone array detection device, comprising:

[0063] A two-channel signal conversion unit, for determining a first timing signal and a second timing signal according to two audio signals output by two microphone channels of the device under test in pairs; wherein the amplitude difference between the first timing signal and the second timing signal corresponds to the phase difference between the two audio signals;

[0064] A two-channel amplitude consistency detection unit, used to determine whether the two audio signals are consistent in phase according to whether the amplitudes of the first time series signal and the second time series signal are consistent;

[0065] The multi-channel detection result determination unit is used to determine that the microphone arrays of the device under test are in phase if the two-channel audio signals combined in pairs are both in phase.

[0066] The present application also provides a microphone array detection device, comprising:

[0067] A multi-channel signal conversion unit, used to determine a first timing signal and a second timing signal according to a plurality of audio signals output by a plurality of microphone channels of the device under test; wherein the amplitude difference between the first timing signal and the second timing signal corresponds to a phase difference of the multi-channel output signal;

[0068] The multi-channel amplitude consistency detection unit is used to determine whether the phases of multiple microphone channels are consistent according to whether the amplitudes of the first timing signal and the second timing signal are consistent.

[0069] The present application also provides a microphone array detection device, comprising:

[0070] A two-channel signal conversion unit, for determining a first timing signal and a second timing signal for two microphone channels of a device under test in a pairwise combination according to the first audio signal and the second audio signal output by the two channels; wherein the first timing signal comprises a timing signal with a stable amplitude corresponding to the first audio signal, and the second timing signal comprises a timing signal with a stable amplitude corresponding to the second audio signal;

[0071] A two-channel amplitude consistency detection unit, configured to determine that the amplitudes of the two-channel audio signals are consistent if the statistical data of the amplitude difference between the first time series signal and the second time series signal at multiple moments is less than or equal to an amplitude difference threshold;

[0072] The multi-channel detection result determination unit is used to determine that the microphone array amplitude of the device under test is consistent if the two-channel audio signals combined in pairs are consistent in amplitude.

[0073] The present application also provides a device detection apparatus, comprising:

[0074] A signal acquisition unit, used to acquire a first audio signal output by a microphone channel of the device under test and a second audio signal output by a re-acquisition channel of the device under test;

[0075] A signal conversion unit, configured to determine a first time sequence signal and a second time sequence signal according to the first audio signal and the second audio signal; wherein the amplitude difference between the first time sequence signal and the second time sequence signal corresponds to the phase difference between the two audio signals;

[0076] The phase consistency determination unit is used to determine whether the microphone channel and the echo channel are consistent in phase according to whether the first time sequence signal and the second time sequence signal are consistent in amplitude.

[0077] The present application also provides a device detection apparatus, comprising:

[0078] A signal acquisition unit, used to acquire a first audio signal output by a microphone channel of the device under test and a second audio signal output by a re-acquisition channel of the device under test;

[0079] A signal conversion unit, configured to determine a first time sequence signal and a second time sequence signal according to the first audio signal and the second audio signal; wherein the first time sequence signal comprises a time sequence signal with a stable amplitude corresponding to the first audio signal, and the second time sequence signal comprises a time sequence signal with a stable amplitude corresponding to the second audio signal;

[0080] The amplitude consistency determination unit is used to determine that the amplitudes of the microphone channel and the echo channel are consistent if the statistical data of the amplitude difference between the first time series signal and the second time series signal at multiple moments is less than or equal to the amplitude difference threshold.

[0081] The present application also provides an electronic device, including:

[0082] Processor and memory;

[0083] A memory is used to store a program for implementing the method according to any one of the above claims, and the device is powered on and runs the program of the method through the processor.

[0084] The present application also provides a smart speaker, comprising:

[0085] Processor and memory;

[0086] A memory is used to store a program for implementing the method according to any one of the above items, and the device is powered on and runs the program of the method through the processor.

[0087] The present application also provides a user equipment, including:

[0088] Processor and memory;

[0089] A memory is used to store a program for implementing the method according to any one of the above items, and the device is powered on and runs the program of the method through the processor.

[0090] The present application also provides a computer-readable storage medium, wherein the computer-readable storage medium stores instructions, and when the computer-readable storage medium is run on a computer, the computer executes the above-mentioned various methods.

[0091] The present application also provides a computer program product comprising instructions, which, when executed on a computer, enables the computer to execute the above-mentioned various methods.

[0092] Compared with the prior art, this application has the following advantages:

[0093] The microphone array detection method provided in the embodiment of the present application performs a first Hilbert transform on two audio signals output by two microphone channels of a device under test in pairs, thereby obtaining a first timing signal; and performs a second Hilbert transform on the two audio signals to obtain a second timing signal; the first Hilbert transform and the second Hilbert transform are opposite in processing mode; whether the two audio signals are consistent in phase is determined based on whether the amplitudes of the first timing signal and the second timing signal are consistent; if the two-channel audio signals in the pairwise combination are consistent in phase, the microphone array of the device under test is determined to be consistent in phase; this processing mode converts the detection of phase into a relatively simple amplitude detection by using the Hilbert transform, and determines the consistency of the phase of the original signal based on the relationship between the amplitudes of the analysis signals after the Hilbert transform; therefore, the detection cost can be effectively reduced while ensuring high detection accuracy, stability and efficiency.

[0094] The microphone array detection method provided in the embodiment of the present application determines the first timing signal and the second timing signal according to the two audio signals output by the two microphone channels of the device under test in pairs, wherein the amplitude difference between the first timing signal and the second timing signal corresponds to the phase difference of the two audio signals; and determines whether the two audio signals are consistent in phase according to whether the amplitudes of the first timing signal and the second timing signal are consistent; if the two-channel audio signals in the pairwise combination are consistent in phase, it is determined that the microphone array of the device under test is consistent in phase; this processing method utilizes signal conversion processing to convert the detection of the microphone channel phase into a relatively simple amplitude detection, and utilizes the transformed analysis signal to determine the consistency of the phase of the original signal output by the two microphone channels based on the relationship between the analysis signal amplitudes; therefore, the detection cost can be effectively reduced while ensuring high detection accuracy, stability and efficiency.

[0095] The microphone array detection method provided in the embodiment of the present application determines the first timing signal and the second timing signal according to the multiple audio signals output by the multiple microphone channels of the device under test; wherein the amplitude difference between the first timing signal and the second timing signal corresponds to the phase difference of the multi-channel output signal; and determines whether the multiple microphone channels are consistent in phase according to whether the amplitudes of the first timing signal and the second timing signal are consistent; this processing method uses signal conversion processing to convert the detection of the microphone channel phase into a relatively simple amplitude detection, and uses the transformed analysis signal to judge the consistency of the original signal phase output by the multiple microphone channels based on the relationship of the analysis signal amplitude; therefore, it can effectively reduce the detection cost while ensuring high detection accuracy, stability and efficiency. In addition, since this method directly detects multiple microphone channels instead of detecting two microphone channels in pairs for multiple times, this processing method has higher detection efficiency than the above method.

[0096] The microphone array detection method provided in the embodiment of the present application determines the first timing signal and the second timing signal by targeting the two microphone channels of the device under test in a pairwise combination according to the first audio signal and the second audio signal output by the two channels; wherein the first timing signal includes a timing signal with a stable amplitude corresponding to the first audio signal, and the second timing signal includes a timing signal with a stable amplitude corresponding to the second audio signal; if the statistical data of the amplitude difference between the first timing signal and the second timing signal at multiple moments is less than or equal to the amplitude difference threshold, it is determined that the amplitudes of the two-channel audio signals are consistent; if the two-channel audio signals in a pairwise combination are both consistent in amplitude, it is determined that the microphone array amplitudes of the device under test are consistent; this processing method uses signal conversion processing to convert the original audio signal output by the microphone channel into a timing signal with a stable amplitude, and uses the converted timing signal with a stable amplitude as an analysis signal, and judges the consistency of the amplitude of the original signal output by the two microphone channels based on the relationship between the analysis signal amplitudes; therefore, the detection cost can be effectively reduced while ensuring high detection accuracy, stability and efficiency.

[0097] The device detection method provided in the embodiment of the present application obtains a first audio signal including a first user voice and a second user voice echo output by a microphone channel of the device under test, and a second audio signal including a second user voice output by a recapture channel of the device under test; determines a first timing signal and a second timing signal according to the first audio signal and the second audio signal; wherein the amplitude difference between the first timing signal and the second timing signal corresponds to the phase difference between the two audio signals; determines whether the microphone channel and the recapture channel are consistent in phase according to whether the amplitudes of the first timing signal and the second timing signal are consistent; this processing method utilizes signal conversion processing to convert the detection of the phases of the microphone signal and the recapture signal into a relatively simple amplitude detection, and utilizes the transformed analysis signal to determine the consistency of the phases between the recapture signal and the microphone signal based on the relationship between the analysis signal amplitudes; therefore, the detection cost can be effectively reduced while ensuring high detection accuracy, stability and efficiency.

[0098] The device detection method provided in the embodiment of the present application obtains a first audio signal output by a microphone channel of the device under test and a second audio signal output by a re-collection channel of the device under test; determines a first timing signal and a second timing signal according to the first audio signal and the second audio signal; wherein the first timing signal includes a timing signal with a stable amplitude corresponding to the first audio signal, and the second timing signal includes a timing signal with a stable amplitude corresponding to the second audio signal; if the statistical data of the amplitude difference between the first timing signal and the second timing signal at multiple moments is less than or equal to the amplitude difference threshold, it is determined that the amplitude of the microphone channel is consistent with that of the re-collection channel; this processing method utilizes signal conversion processing to convert the audio signals output by the microphone channel and the re-collection channel into timing signals with a stable amplitude, uses the converted timing signals with a stable amplitude as analysis signals, and judges the consistency of the amplitude between the re-collection signal and the microphone signal based on the relationship between the analysis signal amplitudes; therefore, the detection cost can be effectively reduced while ensuring high detection accuracy, stability and efficiency. BRIEF DESCRIPTION OF THE DRAWINGS

[0099] Figure 1 A schematic diagram of an application scenario of an embodiment of a microphone array detection method provided in the present application;

[0100] Figure 2 A schematic diagram of a flow chart of an embodiment of a microphone array detection method provided by the present application;

[0101] Figure 3a A test signal schematic diagram of an embodiment of a microphone array detection method provided by the present application;

[0102] Figure 3b An amplified diagram of a test signal of an embodiment of a microphone array detection method provided by the present application;

[0103] Figure 3c A schematic diagram of a time series signal with a stable amplitude according to an embodiment of a microphone array detection method provided by the present application;

[0104] Figure 4 A signal processing schematic diagram of an embodiment of a microphone array detection method provided by the present application;

[0105] Figure 5 A schematic diagram of a comparison between a first timing signal and a second timing signal of an embodiment of a microphone array detection method provided in the present application;

[0106] Figure 6 A schematic diagram of a specific flow chart of an embodiment of a microphone array detection method provided in the present application;

[0107] Figure 7 Another signal processing schematic diagram of an embodiment of the microphone array detection method provided by the present application;

[0108] Figure 8 A schematic diagram of a flow chart of an embodiment of a microphone array detection method provided by the present application;

[0109] Fig. 9 A schematic diagram of a flow chart of an embodiment of a microphone array detection method provided by the present application;

[0110] Fig.10 A signal processing schematic diagram of an embodiment of a microphone array detection method provided by the present application;

[0111] Fig.11 A schematic diagram of an application scenario of an embodiment of a device detection method provided by the present application;

[0112] Fig.12 A schematic diagram of a flow chart of an embodiment of a device detection method provided by the present application;

[0113] Fig.13 A schematic diagram of a flow chart of an embodiment of a device detection method provided in the present application. DETAILED DESCRIPTION

[0114] Many specific details are described in the following description to facilitate a full understanding of the present application. However, the present application can be implemented in many other ways than those described herein, and those skilled in the art can make similar generalizations without violating the connotation of the present application, so the present application is not limited by the specific implementation disclosed below.

[0115] In the present application, a microphone array detection method and apparatus, a device detection method and apparatus, and an electronic device are provided. In the following embodiments, various solutions are described in detail one by one.

[0116] In order to explain the method more intuitively, the following briefly describes the application scenarios of the method. Figure 1 , which is a schematic diagram of the application scenario of the embodiment of the microphone array detection method of the present application. In this embodiment, the device under test is a multi-microphone audio hardware system "smart speaker", and the microphone array of the device under test is detected by a microphone array detection device. When using the detection device to perform microphone array phase consistency detection on the device under test, the microphone can be removed from the position of the microphone in the figure, so that the device under test is not connected to the microphone, but the same test signal is input at the original microphones through a signal generator, such as a sine wave signal, a cosine wave signal, a pulse signal or a pure tone signal. Then, a signal acquisition tool can be used to record the audio signals output by each microphone channel for a long time (such as half an hour, etc.) to obtain the audio signals output by each channel, such as Figure 1 Next, the audio signals 1 to the audio signals n are input to the detection device, which outputs a phase consistency detection result, such as phase consistency or inconsistency. The phase consistency may be the same phase or a fixed phase difference.

[0117] In one example, the device under test is an audio hardware system with two microphones. The same test signal is input to the original two microphones, and the audio signals output by the two microphone channels are recorded. After the two-channel audio hardware system to be tested, the audio signals output by the two channels are obtained and stored as two files, File1.wav and File2.wav. Then, the two files, File1.wav and File2.wav, are input into the detection device, and the microphone array phase consistency detection is performed on the audio hardware system with two microphones through the detection device, and the detection result is output.

[0118] First embodiment

[0119] Please refer to Figure 2 , which is a flow chart of an embodiment of the microphone array detection method of the present application. The execution subject of the method includes a microphone array detection device. In this embodiment, the method may include the following steps:

[0120] Step S101: for two microphone channels of the device under test that are combined in pairs, determine a first timing signal and a second timing signal according to two audio signals output by the two channels.

[0121] The device under test refers to a device with a microphone array, including but not limited to: audio hardware systems such as smart speakers. A microphone is an energy conversion device that converts sound signals into electrical signals. A microphone array is a system composed of a certain number of microphones used to sample and process the spatial characteristics of the sound field.

[0122] The microphone channel is a path from analog signals to digital signals, and may include the microphone itself, an analog circuit connected to the microphone, an analog-to-digital converter (ADC), etc.

[0123] like Figure 1 As shown, the method combines the multi-channel output signals of the device under test in pairs, and performs phase consistency detection processing on the output signals of the two microphone channels of the pairwise combination. If it is detected that the phases of the two-channel audio signals of the pairwise combination are consistent, it can be determined that the phases of the multi-channel audio signals of the device under test are consistent. For example, the smart speaker has 8 microphones, and phase consistency detection of two channels is performed on channel 1 and channel 2, channel 3 and channel 4, channel 5 and channel 6, channel 7 and channel 8, and channel 2 and channel 3, channel 4 and channel 5, channel 6 and channel 7. If the detection results of these two channels are the same phase or the phase difference is fixed, it is determined that the multi-channel audio signals of the device under test are the same phase or the phase difference is fixed. The amplitude consistency can be the same amplitude or the fixed amplitude difference; the phase consistency can be the same phase or the fixed phase difference.

[0124] In one example, the method further includes the following steps: using the analog electrical signal output by the signal generator as the input signal of the two microphone channels, and determining the output signals of the two channels through the device under test. For example, using the sine wave analog electrical signal as the input signal of the circuit connected to the microphone.

[0125] In specific implementation, the sine wave analog electrical signals input by multiple detections are set to high-frequency signals of mutual quality. For example, the sampling frequency Fs = 48kHz, and the frequency of the input signal of the circuit connected to the microphone can be selected as high-frequency signals of mutual quality such as 11kHz, 17kHz, 20kHz, etc., so as to avoid information duplication.

[0126] The amplitude difference between the first timing signal and the second timing signal corresponds to the phase difference between the two audio signals. The correspondence includes: if the phase difference is zero, the amplitude difference is zero; the larger the phase difference, the larger the amplitude difference; the smaller the phase difference, the smaller the amplitude difference. Therefore, based on the amplitude consistency between the first timing signal and the second timing signal, the phase consistency between the two microphone channels can be determined. In other words, the amplitude difference can reflect the phase difference between the two microphone channels.

[0127] The first time sequence signal includes but is not limited to the operation result of the time sequence signal with stable amplitude of the two audio signals, and the second time sequence signal includes but is not limited to the time sequence signal with stable amplitude of the operation result of the two audio signals. The audio signal output by the microphone channel is usually a time sequence signal with amplitude variation, such as the amplitude value of a sine wave signal has peaks and troughs, while the amplitude of the time sequence signal with stable amplitude is relatively stable at different times, and the amplitude value is the same or has only slight changes, without large changes.

[0128] In one example, the input signal of the microphone channel is a 1 kHz cosine signal 0.1*cos(2*pi*1000*t). After the signal is processed by the microphone channel with a sampling rate fs of 48000, the following is obtained: Figure 3a The audio signal output by the microphone channel shown is a discrete signal of the cosine signal 0.1*cos(2*pi*1000*t), which is a real signal. Since the sampling rate is 48khz and the frequency of the input signal is 1khz, one cycle is 48 sampling points. Figure 3b Shows Figure 3a The magnified observation effect. Figure 3c As shown in the figure, the audio signal output by the microphone channel is Hilbert transformed and the L2 norm is calculated. Figure 3b The waveform shows Figure 3c The signal shown is a time series signal with a stable amplitude.

[0129] In this embodiment, the second timing signal can be determined in the following manner: perform an operation on two audio signals to obtain a third timing signal; transform the third timing signal into a first complex signal; determine the second timing signal based on the real part and the imaginary part of the first complex signal; accordingly, the first timing signal can be determined in the following manner: transform the two audio signals into a second complex signal and a third complex signal; determine the fourth timing signal based on the real part and the imaginary part of the second complex signal; and determine the fifth timing signal based on the real part and the imaginary part of the third complex signal; perform an operation on the fourth timing signal and the fifth timing signal to obtain the first timing signal.

[0130] The operation includes, but is not limited to, summing the two audio signals, or subtracting the two audio signals. In this embodiment, the operation is summing the two audio signals; accordingly, the first time series signal is a time series signal obtained by summing the time series signals of the two audio signals with stable amplitudes, and the second time series signal is a time series signal of the time series signal with stable amplitudes after the two audio signals are summed.

[0131] The third time sequence signal is a real signal. In this embodiment, the third time sequence signal is a real signal obtained by summing the audio signals output by the two channels. The second time sequence signal can be determined by transforming the third time sequence signal into a first complex signal and according to the real part and the imaginary part of the first complex signal.

[0132] In specific implementation, to transform the third time series signal into the first complex signal, the following method can be used to implement it: perform a 90-degree phase shift process on the third time series signal, and the signal after the phase shift is the first complex signal, such as the 90-degree phase shift process can be implemented by Hilbert transform. Determining the second time series signal according to the real part and the imaginary part of the first complex signal can be implemented in the following way: perform a norm process on the first complex signal as the second time series signal, such as finding the sum of the square of the real part and the square of the imaginary part of the first complex signal, taking the square root of the sum of squares, etc. Common norm processes include L-1 norm and L-2 norm.

[0133] Similarly, the conversion of the two audio signals into the second complex signal and the third complex signal can be implemented in the following manner: a 90-degree phase shift process is performed on the two audio signals respectively, and the phase-shifted signals include the second complex signal and the third complex signal. Correspondingly, the fourth time series signal and the fifth time series signal can be obtained by performing norm processing on the second complex signal and the third complex signal respectively. The fourth time series signal and the fifth time series signal are both time series signals with stable amplitudes, and the two time series signals can be summed to obtain the first time series signal.

[0134] The audio signal output by the microphone channel is a real signal s(t) (real-valued function). The Hilbert transform of a real-valued function is to convolve the signal s(t) with 1 / (πt) to obtain s'(t). Therefore, the Hilbert transform result s'(t) can be regarded as the output of a linear time invariant system whose input is s(t), and the impulse response of this system is 1 / (πt). Therefore, the signal after the Hilbert transform is a complex signal, and the time sequence length of the transformed signal is consistent with that of the microphone channel output signal.

[0135] The physical meaning of Hilbert transform is to delay the phase of all frequency components of a signal by 90 degrees. This embodiment utilizes the characteristic that Hilbert transform has a 90-degree phase shift on the signal. Then, through mathematical operations, for a standard sine wave test signal, the real part and the imaginary part of the analysis signal obtained after Hilbert transform are exactly 90 degrees out of phase. Then, for such a complex signal, a time series signal with a relatively stable amplitude can be obtained by finding the norm, and this stable amplitude can just reflect the amplitude of the original sine wave. The norm of Hilbert transform can describe the amplitude of a sine signal in time series. For the sine wave test signal of two channels, if the signals output by the two channels are completely synchronized, then the amplitude relationship of the two output signals after summing themselves is equal to the sum of the amplitude relationships of the respective signals. If the two output signals are not synchronized, then the amplitude of the two output signals after summing is no longer the sum of the amplitudes of the two output signals themselves.

[0136] In this embodiment, this step S101 performs Hilbert transform on the original audio signals output by the two microphone channels to obtain the analysis signals after Hilbert transform, i.e., the second complex signal and the third complex signal, and then respectively takes the L-2 norm of the two complex signals to obtain the fourth time series signal and the fifth time series signal, and the sum of the two time series signals is the first time series signal. At the same time, the original audio signals output by the two microphone channels are summed to obtain the third time series signal; then, by performing Hilbert transform on the third time series signal, the analysis signal after Hilbert transform, i.e., the first complex signal, is obtained, and then the L-2 norm of the first complex signal is taken to obtain the second time series signal.

[0137] Please refer to Figure 4 , which is a signal processing schematic diagram of an embodiment of the microphone array detection method of the present application. In this embodiment, the time domain signal S_1 represents the file File1.wav, and S_2 represents the file File2.wav. Figure 4 It can be seen that the specific process of step S101 is as follows:

[0138] 1) Perform Hilbert transform on S_1 and S_2 respectively to obtain corresponding analytical signals, which are the second complex signal A1 and the third complex signal A2. The time sequence lengths of A1 and A2 are consistent with those of S_1 and S_2, but A1 and A2 will be complex signals.

[0139] A1 = HilbertTransform(S1);

[0140] A2 = HilbertTransform(S2);

[0141] 2) Calculate the L-2 norm of A1 and A2 respectively and sum them to obtain the first timing signal Pattern_1 as the first test reference signal

[0142] Pattern1=‖A1‖2+‖A2‖2

[0143] 3) After summing S_1 and S_2 in the time domain, perform Hilbert transform to obtain the corresponding analysis signal, which is the first complex signal Asum

[0144] A sum =HilbertTransform(S1+S2);

[0145] 4) Then A sum The L-2 norm is calculated to obtain the second timing signal Pattern_2 as the second test reference signal.

[0146] Pattern2=‖A sum ‖2

[0147] Depend on Figure 4 It can be seen that the determination method of the first time series signal is opposite to that of the second time series signal. The first time series signal is determined by first performing Hilbert transform and then summing, while the second time series signal is determined by first summing and then performing Hilbert transform.

[0148] After obtaining two analysis signals (the first timing signal and the second timing signal), the next step can be performed to use the two analysis signals to determine the consistency of the phases of the audio signals output by the two channels based on the relationship between the analysis signal amplitudes.

[0149] Step S103: determining whether the two audio signals are consistent in phase according to whether the amplitudes of the first time series signal and the second time series signal are consistent.

[0150] The first time series signal and the second time series signal are obtained by using two Hilbert transform methods with opposite processing orders. The inventor of the present application has found that if the amplitude difference between the two signals is large, it means that the phases of the original signals of the two channels are inconsistent; if the amplitude difference between the two signals is small, it means that the phase difference between the original signals of the two channels is fixed; if the amplitudes of the two signals are the same, it means that the phases of the two channel signals are the same. Generally, for the two situations of fixed phase difference and the same phase, the phases are both considered to be consistent.

[0151] like Figure 5As shown, if the two audio channels are out of phase, assuming that the audio signal output by one channel and the audio signal output by the other channel float one sample point, the two audio signals are mathematically expressed as follows: S_1 = 0.1*cos(2*pi*1000*t), S_2 = [0, x1(1: number of points - 1)], then the first timing signal and the second timing signal determined based on the two audio signals cannot be aligned. If the two audio signals are in phase, the first timing signal and the second timing signal will be completely overlapped. Therefore, the method provided in the embodiment of the present application transforms the phase detection problem into an amplitude detection problem.

[0152] In one example, step S103 can be implemented in the following manner: if the statistical data of the amplitude difference between the first timing signal and the second timing signal at multiple moments is less than or equal to the amplitude difference threshold, it is determined that the amplitudes of the first timing signal and the second timing signal are consistent. The amplitude difference threshold can be determined according to application requirements. The statistical data includes, but is not limited to: the average value of the amplitude difference, the variance of the amplitude difference, and the standard deviation of the amplitude difference.

[0153] like Figure 4 As shown, the method provided in the embodiment of the present application is based on the comparison and judgment of the first timing signal and the second timing signal obtained in step S101. In specific implementation, the first timing signal and the second timing signal can be subtracted to obtain a difference signal (timing sequence) between the first timing signal and the second timing signal:

[0154] bias = Pattern1-Pattern2

[0155] In general, in theory, if there is no phase difference in the output signals of the two microphone channels of the device under test, then Pattern_1 and Pattern_2 are basically coincident and equal, and bias(n) = 0, n∈ any time. However, in the actual measurement process, bias will not be completely equal to zero, but a very small time series, such as (t1: 0.2, t2: 0.19, ..., t n-1 Moment: 0.21, t n Moment: 0.18), that is, the phase difference is relatively fixed. Based on this theory, the statistical data can be the average value of the time series, the variance of the time series, the standard deviation of the time series, and so on.

[0156] The timing sequence bias includes the amplitude difference between the first timing signal and the second timing signal at multiple times. For this timing sequence, the processing idea is to convert the timing sequence into a value. In specific implementation, the paradigm can be firstly calculated for each member of the timing sequence bias, which can be the absolute value abs(bias) or the square of the absolute value abs(bias)^2, to obtain the paradigm sequence. For such a paradigm sequence, the moment can be calculated, which can be the first-order moment (mean value), the second-order moment (variance / standard deviation), or the higher-order moment, so as to obtain a value, and then compare this value with a set empirical value (threshold value). If it is greater than or equal to the empirical value, the phase is inconsistent, and if it is less than the empirical value, the phase is consistent.

[0157] In one example, step S203 includes but is not limited to the following determination method:

[0158] a) Calculate the average value of the time series bias and set an average value threshold thd_1

[0159]

[0160] It can be seen from the formula that if the average value of the amplitude difference between the first timing signal and the second timing signal at multiple times is less than the average value threshold, the two channels are determined to be phase-consistent; if the average value of the amplitude difference between the first timing signal and the second timing signal at multiple times is greater than or equal to the average value threshold, the two channels are determined to be phase-inconsistent.

[0161] b) Calculate the variance or standard deviation of the time series bias and set a variance or standard deviation threshold thd_2

[0162]

[0163] or:

[0164]

[0165] It can be seen from the formula that if the variance or standard deviation of the amplitude difference between the first timing signal and the second timing signal at multiple times is less than the variance or standard deviation threshold, the two channels are judged to be consistent in phase; if the variance or standard deviation of the amplitude difference between the first timing signal and the second timing signal at multiple times is greater than or equal to the variance or standard deviation threshold, the two channels are judged to be inconsistent in phase.

[0166] c) Set a thd_3

[0167]

[0168] It can be seen from the formula that if the logarithm of the average value of the amplitude ratio of the first timing signal to the second timing signal at multiple times is less than the logarithmic threshold, the two channels are determined to be phase-consistent; if the logarithm of the average value of the amplitude difference ratio of the first timing signal to the second timing signal at multiple times is greater than or equal to the logarithmic threshold, the two channels are determined to be phase-inconsistent.

[0169] Step S105: If the two-channel audio signals in the pairwise combination are both in phase, it is determined that the microphone arrays of the device under test are in phase.

[0170] After performing phase consistency detection on the two-channel audio signals of the device under test in pairs, if it can be determined based on the detection results of the two-channel audio signals in pairs that any two-channel audio signals of the device under test are phase-consistent, then it is determined that the multi-channel audio signals of the device under test are phase-consistent, that is, the microphone arrays are phase-consistent.

[0171] For example, a smart speaker has eight microphones, which perform phase consistency detection on channel 1 and channel 2, channel 3 and channel 4, channel 5 and channel 6, channel 7 and channel 8, as well as channel 2 and channel 3, channel 4 and channel 5, channel 6 and channel 7. If the detection results of these two channels are all phase-consistent, it means that any two-channel audio signals of the device under test are all phase-consistent.

[0172] However, it is found through experiments that the processing method of the above steps S101 to S105 has the problem of large detection amount and low detection efficiency.

[0173] Please refer to Figure 6 , which is a specific flow chart of an embodiment of the microphone array detection method of the present application. In order to solve the above-mentioned problem of low detection efficiency, in one example, before step S01, the method may further include the following steps:

[0174] Step S601: determining a sixth timing signal and a seventh timing signal according to a plurality of audio signals output by a plurality of microphone channels of a device under test.

[0175] The amplitude difference between the sixth timing signal and the seventh timing signal corresponds to the phase difference of the multiple audio signals, that is, the amplitude difference can reflect the phase difference of the multiple microphone channels. The sixth timing signal includes a timing signal with a stable amplitude of the operation results of the multiple audio signals, and the seventh timing signal includes a timing signal with a stable amplitude of the operation results of the multiple audio signals. Since the sixth timing signal and the seventh timing signal are determined in a similar manner to the first timing signal and the second timing signal, they will not be repeated here.

[0176] Step S603: Determine whether the sixth timing signal and the seventh timing signal have the same amplitude.

[0177] Step S605: If the above judgment result is no, it is determined that the microphone array phase is inconsistent, the detection ends, and step S101 and subsequent steps are no longer executed. There is no need to perform phase consistency detection on the two microphone channels of the device under test in pairs; if the above judgment result is yes, enter step S101.

[0178] In an example, step S603 may be implemented as follows: if the difference between the amplitude statistics of the sixth timing signal and the seventh timing signal is greater than or equal to the amplitude difference threshold, it is determined that the sixth timing signal and the seventh timing signal are inconsistent in phase.

[0179] Please refer to Figure 7 , which is another signal processing schematic diagram of an embodiment of the microphone array detection method of the present application. In this embodiment, time domain signals S_1, S_2, ..., S_M are used to represent multi-channel output audio files File1.wav, File2.wav, ..., FileM.wav. The phase consistency detection process is as follows:

[0180] 1) Perform Hilbert transform on S_1, S_2, ..., S_M to obtain the corresponding analytical signals A1, A2, ..., A M .

[0181]

[0182] 2) Calculate the L-2 norm of A1 and A2 respectively and sum them to obtain the sixth timing signal Pattern_3 as the third test reference signal

[0183] Pattern3=‖A1‖2+‖A2‖2+…+‖A M ‖2

[0184] 3) Perform Hilbert transform on the time domain sum of S_1 and S_2 to obtain the corresponding analysis signal:

[0185] A sum =HilbertTransform(S1+S2+…+S M );

[0186] 4) Then A sum The L-2 norm is calculated to obtain the seventh timing signal Pattern_4 as the fourth test reference signal.

[0187] Pattern4=‖A sum ‖2

[0188] 5) Finally, based on the calculated two test reference signals Pattern_3 and Pattern_4, a comparison is made. First, Pattern3 is subtracted from Pattern2 to obtain the following signal:

[0189]

[0190] In general, if there is no phase difference in the hardware system, then Pattern_3 and Pattern_4 are basically equal, bias(n) = 0, n∈ any time. However, in the actual measurement process, bias will not be completely equal to zero, but a very small time series. Based on this theory, the judgment methods include but are not limited to the following:

[0191] a) Find the average value of the time series bias and set a threshold thd_1

[0192]

[0193] b) Calculate the variance or standard deviation of the time series bias and set a threshold thd_2

[0194]

[0195] or:

[0196]

[0197] c) Set a thd_3

[0198]

[0199] The method provided in the embodiment of the present application, by executing steps S601 to S605, can first detect whether the multi-channel output signals of the device under test are phase-inconsistent through a multi-channel integrated audio signal phase consistency detection unit. If the phase inconsistency is determined in this way, there is no need to execute steps S101 to S105, which require multiple processing steps of two-channel audio signal phase consistency detection, to detect whether the device under test is phase-consistent. If the phase consistency is determined in this way, it is necessary to further execute steps S101 to S105 to perform more accurate phase consistency detection. Since the multi-channel integrated detection method is simpler and has a faster detection speed, while the multiple two-channel detection method has a slower detection speed, the detection speed of phase inconsistency can be effectively improved.

[0200] It can be seen from the above embodiments that the microphone array detection method provided in the embodiments of the present application determines the first timing signal and the second timing signal by targeting the two microphone channels of the device under test that are combined in pairs according to the two audio signals output by the two channels; wherein the amplitude difference between the first timing signal and the second timing signal corresponds to the phase difference of the two audio signals; and determines whether the two audio signals are consistent in phase according to whether the amplitudes of the first timing signal and the second timing signal are consistent; if the two-channel audio signals combined in pairs are consistent in phase, it is determined that the microphone array of the device under test is consistent in phase; this processing method utilizes signal conversion processing to convert the detection of the microphone channel phase into a relatively simple amplitude detection, and utilizes the transformed analysis signal to judge the consistency of the phase of the original signal output by the two microphone channels based on the relationship between the analysis signal amplitudes; therefore, the detection cost can be effectively reduced while ensuring high detection accuracy, stability and efficiency.

[0201] Second embodiment

[0202] In the above-mentioned embodiment, a microphone array detection method is provided, and correspondingly, the present application also provides a microphone array detection device. The device corresponds to the embodiment of the above-mentioned method. Since the device embodiment is basically similar to the method embodiment, the description is relatively simple, and the relevant parts can be referred to the partial description of the method embodiment. The device embodiment described below is only illustrative.

[0203] The present application further provides a microphone array detection device, comprising:

[0204] A two-channel signal conversion unit, for determining a first timing signal and a second timing signal according to two audio signals output by two microphone channels of the device under test in pairs; wherein the amplitude difference between the first timing signal and the second timing signal corresponds to the phase difference between the two audio signals;

[0205] A two-channel amplitude consistency detection unit, used to determine whether the two audio signals are consistent in phase according to whether the amplitudes of the first time series signal and the second time series signal are consistent;

[0206] The multi-channel detection result determination unit is used to determine that the microphone arrays of the device under test are in phase if the two-channel audio signals combined in pairs are both in phase.

[0207] Third embodiment

[0208] In the above-mentioned embodiment, a microphone array detection method is provided, and correspondingly, the present application also provides an electronic device. The device corresponds to the embodiment of the above-mentioned method. Since the device embodiment is basically similar to the method embodiment, the description is relatively simple, and the relevant parts can be referred to the partial description of the method embodiment. The device embodiment described below is only illustrative.

[0209] An electronic device of the present embodiment includes: a processor and a memory; the memory is used to store a program for implementing a microphone array detection method. After the device is powered on and the program of the method is run through the processor, the following steps are performed: for two microphone channels of the device under test that are combined in pairs, a first timing signal and a second timing signal are determined according to two audio signals output by the two channels; wherein the amplitude difference between the first timing signal and the second timing signal corresponds to the phase difference of the two audio signals; according to whether the first timing signal and the second timing signal are consistent in amplitude, it is determined whether the two audio signals are consistent in phase; if the two-channel audio signals combined in pairs are both consistent in phase, it is determined that the microphone array of the device under test is consistent in phase.

[0210] Fourth embodiment

[0211] Corresponding to the above-mentioned microphone array detection method, the present application also provides a microphone array detection method. The parts of this embodiment that are the same as those of the first embodiment are not repeated here, and please refer to the corresponding parts in the first embodiment.

[0212] Please refer to Figure 8 , which is a flow chart of an embodiment of the microphone array detection method of the present application. In this embodiment, the method may include the following steps:

[0213] Step S801: determining a first timing signal and a second timing signal according to a plurality of audio signals output by a plurality of microphone channels of a device under test.

[0214] The amplitude difference between the first timing signal and the second timing signal corresponds to the phase difference of the multiple audio signals. That is, the amplitude difference can reflect the phase difference of multiple microphone channels. The first timing signal includes a timing signal with a stable amplitude of the calculation results of multiple audio signals, and the second timing signal includes a timing signal with a stable amplitude of the calculation results of multiple audio signals. Since the first timing signal and the second timing signal are determined in a similar manner to the sixth timing signal and the seventh timing signal in Example 1, they will not be repeated here.

[0215] Step S803: determining whether the phases of the plurality of microphone channels are consistent based on whether the amplitudes of the first timing signal and the second timing signal are consistent.

[0216] In this embodiment, if the amplitudes of the first timing signal and the second timing signal are consistent, it can be determined that the phases of the multiple microphone channels are consistent; if the amplitudes of the first timing signal and the second timing signal are inconsistent, it can be determined that the phases of the multiple microphone channels are inconsistent.

[0217] In a specific implementation, if the statistical data of the amplitude difference between the first timing signal and the second timing signal at multiple moments is less than or equal to the amplitude difference threshold, it is determined that the amplitudes of the first timing signal and the second timing signal are consistent.

[0218] The signal processing process of this embodiment is the same as that of the first embodiment. Figure 7 The processing process is the same as that of the embodiment. For related descriptions, please refer to the description in the first embodiment, which will not be repeated here.

[0219] It can be seen from the above embodiments that the microphone array detection method provided in the embodiments of the present application determines the first timing signal and the second timing signal according to the multiple audio signals output by the multiple microphone channels of the device under test; wherein the amplitude difference between the first timing signal and the second timing signal corresponds to the phase difference of the multi-channel output signal; and determines whether the multiple microphone channels are consistent in phase according to whether the amplitudes of the first timing signal and the second timing signal are consistent; this processing method uses signal conversion processing to convert the detection of the microphone channel phase into a relatively simple amplitude detection, and uses the transformed analysis signal to judge the consistency of the original signal phase output by the multiple microphone channels based on the relationship of the analysis signal amplitude; therefore, it can effectively reduce the detection cost while ensuring high detection accuracy, stability and efficiency. In addition, since this method directly detects multiple microphone channels instead of detecting two microphone channels in pairs for multiple times, this processing method has higher detection efficiency than the method provided in the above embodiment 1.

[0220] Fifth embodiment

[0221] In the above-mentioned embodiment, a microphone array detection method is provided, and correspondingly, the present application also provides a microphone array detection device. The device corresponds to the embodiment of the above-mentioned method. Since the device embodiment is basically similar to the method embodiment, the description is relatively simple, and the relevant parts can be referred to the partial description of the method embodiment. The device embodiment described below is only illustrative.

[0222] The present application further provides a microphone array detection device, comprising:

[0223] A multi-channel signal conversion unit, used to determine a first timing signal and a second timing signal according to a plurality of audio signals output by a plurality of microphone channels of the device under test; wherein the amplitude difference between the first timing signal and the second timing signal corresponds to a phase difference of the multi-channel output signal;

[0224] The multi-channel amplitude consistency detection unit is used to determine whether the phases of multiple microphone channels are consistent according to whether the amplitudes of the first timing signal and the second timing signal are consistent.

[0225] Sixth embodiment

[0226] In the above-mentioned embodiment, a microphone array detection method is provided, and correspondingly, the present application also provides an electronic device. The device corresponds to the embodiment of the above-mentioned method. Since the device embodiment is basically similar to the method embodiment, the description is relatively simple, and the relevant parts can be referred to the partial description of the method embodiment. The device embodiment described below is only illustrative.

[0227] An electronic device of this embodiment includes: a processor and a memory; the memory is used to store a program for implementing a microphone array detection method. After the device is powered on and the program of the method is run through the processor, the following steps are performed: a first timing signal and a second timing signal are determined based on multiple audio signals output by multiple microphone channels of the device under test; wherein the amplitude difference between the first timing signal and the second timing signal corresponds to the phase difference of the multi-channel output signal; and whether the multiple microphone channels are consistent in phase is determined based on whether the amplitudes of the first timing signal and the second timing signal are consistent.

[0228] Seventh embodiment

[0229] Corresponding to the above-mentioned microphone array detection method, the present application also provides a microphone array detection method. The parts of this embodiment that are the same as those of the first embodiment are not repeated here, and please refer to the corresponding parts in the first embodiment.

[0230] Please refer to Fig. 9 , which is a flow chart of an embodiment of the microphone array detection method of the present application. In this embodiment, the method may include the following steps:

[0231] Step S901: for two microphone channels of the device under test that are combined in pairs, determine a first timing signal and a second timing signal according to a first audio signal and a second audio signal output by the two channels.

[0232] The first timing signal includes a timing signal with a stable amplitude corresponding to the first audio signal, and the second timing signal includes a timing signal with a stable amplitude corresponding to the second audio signal. The audio signal output by the microphone channel is usually a timing signal with a changing amplitude, such as a sine wave signal with a peak and a trough in amplitude, while the timing signal with a stable amplitude has a relatively stable amplitude at different times, with the same amplitude value or only a slight change, and no large amplitude change.

[0233] In one example, the input signal of the microphone channel is a 1 kHz cosine signal 0.1*cos(2*pi*1000*t). After the signal is processed by the microphone channel with a sampling rate fs of 48000, the following is obtained: Figure 3a The audio signal output by the microphone channel shown is a discrete signal of the cosine signal 0.1*cos(2*pi*1000*t), which is a real signal. Since the sampling rate is 48khz and the frequency of the input signal is 1khz, one cycle is 48 sampling points. Figure 3b Shows Figure 3a The magnified observation effect. Figure 3c As shown in the figure, the audio signal output by the microphone channel is Hilbert transformed and the L2 norm is calculated. Figure 3b The waveform shows Figure 3c The signal shown is a time series signal with a stable amplitude.

[0234] In this embodiment, the amplitude-stable time series signal corresponding to an audio signal may be determined in the following manner: the audio signal is converted into a complex signal; and the amplitude-stable time series signal is determined based on the real part and the imaginary part of the complex signal.

[0235] In specific implementation, if the audio signal is to be converted into a complex signal, the following method can be used to implement it: perform a 90-degree phase shift process on the audio signal, and the signal after the phase shift is a complex signal, such as the 90-degree phase shift process can be implemented by Hilbert transform. Determining the time series signal with a stable amplitude based on the real and imaginary parts of the complex signal can be implemented in the following way: perform a norm process on the complex signal to obtain a time series signal with a stable amplitude, such as calculating the sum of the square of the real part and the square of the imaginary part of the complex signal, taking the square root of the sum of squares, etc. Common norm processes include L-1 norm and L-2 norm.

[0236] This embodiment uses the characteristic that the Hilbert transform has a 90-degree phase shift on the signal. For a standard sine wave test signal, the real part and the imaginary part of the analysis signal (complex signal) obtained after the Hilbert transform are exactly 90 degrees out of phase. Then, by finding the norm for such a complex signal, a time series signal with a relatively stable amplitude can be obtained, and this stable amplitude can just reflect the amplitude of the original sine wave. The Hilbert transform norm can describe the amplitude of a sine signal in time series.

[0237] Please refer to Fig.10, which is a signal processing schematic diagram of an embodiment of the microphone array detection method of the present application. In this embodiment, the time domain signal S_1 is used to represent the first audio signal output by one microphone channel, which is stored in the file File1.wav; S_2 is used to represent the second audio signal output by another microphone channel, which is stored in the file File2.wav. Fig.10 It can be seen that the specific process of step S901 is as follows:

[0238] 1) Perform Hilbert transform on S_1 and S_2 respectively to obtain corresponding analytical signals, which are the first complex signal A1 and the second complex signal A2. The time sequence lengths of A1, A2 and S_1, S_2 are consistent, but A1, A2 will be complex signals.

[0239] 2) Calculate the L-2 norm of A1 and A2 respectively to obtain a first timing signal Pattern_1 as a first test reference signal and a second timing signal Pattern_2 as a second test reference signal.

[0240] Step S903: If the statistical data of the amplitude difference between the first time series signal and the second time series signal at multiple moments is less than or equal to the amplitude difference threshold, it is determined that the amplitudes of the two-channel audio signals are consistent.

[0241] The method provided in the embodiment of the present application is based on comparing and judging the first timing signal and the second timing signal obtained in step S901. Fig.10 As shown, in the specific implementation, the first timing signal and the second timing signal can be subtracted to obtain the difference signal (timing sequence) between the first timing signal and the second timing signal: bias = Pattern1-Pattern2. In general, in theory, if there is no amplitude difference between the two microphone channels, then Pattern_1 and Pattern_2 are basically equal. However, in the actual measurement process, bias will not be completely equal to zero, but a timing sequence with a very small value. Based on this theory, the statistical data can be the average value of the timing sequence, the variance of the timing sequence, the standard deviation of the timing sequence, and so on. Among them, the timing sequence includes the amplitude difference between the first timing signal and the second timing signal at multiple times.

[0242] In one example, step S903 includes but is not limited to the following determination method:

[0243] a) Calculate the average value of the time series bias and set an average value threshold thd_1

[0244]

[0245] It can be seen from the formula that if the average value of the amplitude difference between the first timing signal and the second timing signal at multiple times is less than the average value threshold, the amplitudes of the two channels are determined to be consistent; if the average value of the amplitude difference between the first timing signal and the second timing signal at multiple times is greater than or equal to the average value threshold, the amplitudes of the two channels are determined to be inconsistent.

[0246] b) Calculate the variance or standard deviation of the time series bias and set a variance or standard deviation threshold thd_2

[0247]

[0248] or:

[0249]

[0250] It can be seen from the formula that if the variance or standard deviation of the amplitude difference between the first timing signal and the second timing signal at multiple times is less than the variance or standard deviation threshold, the amplitudes of the two channels are determined to be consistent; if the variance or standard deviation of the amplitude difference between the first timing signal and the second timing signal at multiple times is greater than or equal to the variance or standard deviation threshold, the amplitudes of the two channels are determined to be inconsistent.

[0251] c) Set a thd_3

[0252]

[0253] It can be seen from the formula that if the logarithm of the average value of the amplitude ratio of the first timing signal to the second timing signal at multiple times is less than the logarithmic threshold, the amplitudes of the two channels are determined to be consistent; if the logarithm of the average value of the amplitude ratio of the first timing signal to the second timing signal at multiple times is greater than or equal to the logarithmic threshold, the amplitudes of the two channels are determined to be inconsistent.

[0254] Step S905: If the amplitudes of the two-channel audio signals in the pairwise combination are consistent, it is determined that the amplitudes of the microphone arrays of the device under test are consistent.

[0255] After performing amplitude consistency detection on the two-channel audio signals of the device under test in pairs, if it can be determined based on the detection results of the two-channel audio signals in pairs that any two channel audio signals of the device under test have consistent amplitudes, then it is determined that the amplitudes of the multi-channel audio signals of the device under test are consistent, that is, the microphone array amplitudes are consistent.

[0256] It can be seen from the above embodiments that the microphone array detection method provided in the embodiments of the present application determines the first timing signal and the second timing signal by targeting the two microphone channels of the device under test in pairs according to the first audio signal and the second audio signal output by the two channels; wherein the first timing signal includes a timing signal with a stable amplitude corresponding to the first audio signal, and the second timing signal includes a timing signal with a stable amplitude corresponding to the second audio signal; if the statistical data of the amplitude difference between the first timing signal and the second timing signal at multiple moments is less than or equal to the amplitude difference threshold, it is determined that the amplitudes of the two-channel audio signals are consistent; if the two-channel audio signals in the pair are consistent in amplitude, it is determined that the microphone array amplitudes of the device under test are consistent; this processing method uses signal conversion processing to convert the original audio signal output by the microphone channel into a timing signal with a stable amplitude, and uses the converted timing signal with a stable amplitude as the analysis signal, and judges the consistency of the amplitude of the original signal output by the two microphone channels based on the relationship between the analysis signal amplitudes; therefore, the detection cost can be effectively reduced while ensuring high detection accuracy, stability and efficiency.

[0257] Eighth embodiment

[0258] In the above-mentioned embodiment, a microphone array detection method is provided, and correspondingly, the present application also provides a microphone array detection device. The device corresponds to the embodiment of the above-mentioned method. Since the device embodiment is basically similar to the method embodiment, the description is relatively simple, and the relevant parts can be referred to the partial description of the method embodiment. The device embodiment described below is only illustrative.

[0259] The present application further provides a microphone array detection device, comprising:

[0260] A two-channel signal conversion unit, for determining a first timing signal and a second timing signal for two microphone channels of a device under test in a pairwise combination according to the first audio signal and the second audio signal output by the two channels; wherein the first timing signal comprises a timing signal with a stable amplitude corresponding to the first audio signal, and the second timing signal comprises a timing signal with a stable amplitude corresponding to the second audio signal;

[0261] A two-channel amplitude consistency detection unit, configured to determine that the amplitudes of the two-channel audio signals are consistent if the statistical data of the amplitude difference between the first time series signal and the second time series signal at multiple moments is less than or equal to an amplitude difference threshold;

[0262] The multi-channel detection result determination unit is used to determine that the microphone array amplitude of the device under test is consistent if the two-channel audio signals combined in pairs are consistent in amplitude.

[0263] Ninth embodiment

[0264] In the above-mentioned embodiment, a microphone array detection method is provided, and correspondingly, the present application also provides an electronic device. The device corresponds to the embodiment of the above-mentioned method. Since the device embodiment is basically similar to the method embodiment, the description is relatively simple, and the relevant parts can be referred to the partial description of the method embodiment. The device embodiment described below is only illustrative.

[0265] An electronic device of the present embodiment includes: a processor and a memory; the memory is used to store a program for implementing a microphone array detection method. After the device is powered on and the program of the method is run through the processor, the following steps are performed: for two microphone channels of the device under test that are combined in pairs, a first timing signal and a second timing signal are determined according to the first audio signal and the second audio signal output by the two channels; wherein the first timing signal includes a timing signal with a stable amplitude corresponding to the first audio signal, and the second timing signal includes a timing signal with a stable amplitude corresponding to the second audio signal; if the statistical data of the amplitude difference between the first timing signal and the second timing signal at multiple moments is less than or equal to the amplitude difference threshold, it is determined that the amplitudes of the two-channel audio signals are consistent; if the two-channel audio signals combined in pairs are both consistent in amplitude, it is determined that the microphone array amplitudes of the device under test are consistent.

[0266] Tenth embodiment

[0267] Corresponding to the above-mentioned microphone array detection method, the present application also provides a device detection method, the execution subject of the method includes a device detection device. The parts of this embodiment that are the same as the first embodiment are not repeated here, please refer to the corresponding parts in the first embodiment.

[0268] In order to explain the method more intuitively, the following briefly describes the application scenarios of the method. Fig.11 , which is a schematic diagram of the application scenario of the embodiment of the device detection method of the present application. In this embodiment, the device under test includes terminal devices such as smart phones and tablet computers that can make calls, and the signal phase consistency and amplitude consistency of the microphone channel and the re-collection channel of the device under test are detected by the device detection detection device. When using the detection device to perform phase consistency detection on the microphone channel and the re-collection channel of the device under test, the microphone can be removed from the position of the microphone in the figure so that the device under test is not connected to the microphone. At the same time, the re-collection channel can be disconnected from the hardware circuit in front of the speaker. Instead, the same test signal is input at the microphone channel and the re-collection channel through a signal generator, such as a sine wave signal, a cosine wave signal, a pulse signal or a pure tone signal. Then, a signal acquisition tool can be used to record the audio signals output by the microphone channel and the re-collection channel for a long time (such as half an hour, etc.) to obtain the audio signals output by the microphone channel and the re-collection channel, such as Fig.11Next, the first audio signal and the second audio signal are input to the detection device, which outputs a phase consistency detection result, such as phase consistency or inconsistency. Phase consistency can be the same phase or a fixed phase difference.

[0269] Please refer to Fig.12 , which is a flow chart of an embodiment of the device detection method of the present application. In this embodiment, the method may include the following steps:

[0270] Step S1201: Acquire a first audio signal output by a microphone channel of the device under test and a second audio signal output by a recollection channel of the device under test.

[0271] The device under test includes but is not limited to communication devices such as smart phones and smart speakers. The method performs phase consistency detection on the microphone channel and the sampling channel of the device under test.

[0272] In telephone systems, especially in hands-free mode, there is acoustic echo. The sound of the far-end signal (the voice signal of the caller) is emitted by the local speaker, passes through the external acoustic system, and is then transmitted back to the microphone (microphone). Together with the local user's voice signal, it is transmitted back to the far-end user through the hybrid converter to form an acoustic echo. This acoustic echo caused by the acoustic coupling between the speaker and the microphone is easily affected by a variety of environmental factors. At present, echo suppressors are used to achieve echo cancellation. An echo canceller is an echo canceller that compares the signals of the outbound channel with those of the return channel to generate a "replica" of the echo signal, thereby achieving the effect of eliminating the echo. In other words, the function of the echo canceller is to retain the local voice and eliminate the sound of the speaker.

[0273] The first audio signal refers to an audio signal output through a microphone channel. The relevant description of the microphone channel can be found in the relevant part of the first embodiment, which will not be repeated here.

[0274] When using the device under test for a call, the audio signal output by the microphone channel includes the first user's voice and the second user's voice echo. The first user refers to the local speaker, and the second user refers to the remote speaker. Among them, the second user's voice echo included in the audio signal output by the microphone channel is the sound emitted by the local speaker. After the second user's voice passes through the external acoustic system, it is transmitted back to the microphone. The microphone also collects the sound signal of the first user at the same time. Therefore, the audio signal output by the microphone channel includes the first user's voice and the second user's voice echo.

[0275] The sampling channel may include a sampling circuit and an analog-to-digital converter (ADC). The sampling circuit can be used to sample the audio data played by the speaker of the device under test. The audio signal output by the sampling channel is the sampled data, and the echo canceller uses the sampled data as a reference signal to perform echo cancellation processing.

[0276] When the phase consistency test is performed on the microphone channel and the recollection channel of the device under test by the method, a test signal, such as a sine wave signal, etc., can be input to the microphone channel and the recollection channel by a signal generator. In this way, the first audio signal output by the microphone channel and the second audio signal output by the recollection channel are similar to the two audio signals output by the two microphone channels in the first embodiment.

[0277] In actual applications, if the microphone signal (first audio signal) and the reference signal of the echo canceller (the second audio signal fed to the speaker) are not synchronously sampled, or the buffer management in the microphone channel and the echo channel link is improperly handled, the delay (phase difference) of the first audio signal relative to the second audio signal may vary in time, and the performance of the echo canceller will be greatly affected. In serious cases, the call cannot proceed normally. Therefore, this scenario also needs to detect the phase synchronization of the signal. Unlike the scenario in the above embodiment, in the acoustic echo cancellation scenario, it is necessary to detect whether the first audio signal and the second audio signal are sampled by the same clock, but there can be a fixed delay between the first audio signal and the second audio signal.

[0278] Step S1203: determining a first time sequence signal and a second time sequence signal according to the first audio signal and the second audio signal; wherein the amplitude difference between the first time sequence signal and the second time sequence signal corresponds to the phase difference between the two audio signals.

[0279] This step corresponds to step S101 in the above-mentioned embodiment 1, and will not be described in detail here.

[0280] Step S1205: Determine whether the microphone channel and the echo channel are in phase with each other based on whether the amplitudes of the first time series signal and the second time series signal are in phase with each other.

[0281] The amplitude consistency can be the same amplitude or a fixed amplitude difference; the phase consistency can be the same phase or a fixed phase difference. If it is determined that the phase of the audio signal between the microphone and the acquisition channel is consistent, the device under test passes the test; otherwise, the device under test fails the test. This step corresponds to step S103 in the above-mentioned embodiment 1, and will not be repeated here.

[0282] It can be seen from the above embodiments that the device detection method provided by the embodiments of the present application obtains the first audio signal output by the microphone channel of the tested device, which includes the first user's voice and the second user's voice echo, and the second audio signal output by the re-collection channel of the tested device, which includes the second user's voice; according to the first audio signal and the second audio signal, the first timing signal and the second timing signal are determined; wherein the amplitude difference between the first timing signal and the second timing signal corresponds to the phase difference between the two audio signals; according to whether the amplitudes of the first timing signal and the second timing signal are consistent, it is determined whether the microphone channel and the re-collection channel are consistent in phase; this processing method makes use of signal conversion processing to convert the detection of the phase of the microphone signal and the re-collection signal into a relatively simple amplitude detection, and uses the transformed analysis signal to judge the phase consistency between the re-collection signal and the microphone signal based on the relationship between the analysis signal amplitudes; therefore, the detection cost can be effectively reduced while ensuring high detection accuracy, stability and efficiency.

[0283] Eleventh Embodiment

[0284] In the above-mentioned embodiment, a device detection method is provided. Correspondingly, the present application also provides a device detection apparatus. The apparatus corresponds to the above-mentioned method embodiment. Since the apparatus embodiment is basically similar to the method embodiment, the description is relatively simple. For the relevant parts, please refer to the partial description of the method embodiment. The apparatus embodiment described below is only illustrative.

[0285] The present application further provides a device detection apparatus, comprising:

[0286] A signal acquisition unit, used to acquire a first audio signal output by a microphone channel of the device under test and a second audio signal output by a re-acquisition channel of the device under test;

[0287] A signal conversion unit, configured to determine a first time sequence signal and a second time sequence signal according to the first audio signal and the second audio signal; wherein the amplitude difference between the first time sequence signal and the second time sequence signal corresponds to the phase difference between the two audio signals;

[0288] The phase consistency determination unit is used to determine whether the microphone channel and the echo channel are consistent in phase according to whether the first time sequence signal and the second time sequence signal are consistent in amplitude.

[0289] Twelfth Embodiment

[0290] In the above-mentioned embodiment, a device detection method is provided, and correspondingly, the present application also provides an electronic device. The device corresponds to the embodiment of the above-mentioned method. Since the device embodiment is basically similar to the method embodiment, the description is relatively simple, and the relevant parts can be referred to the partial description of the method embodiment. The device embodiment described below is only illustrative.

[0291] An electronic device of the present embodiment includes: a processor and a memory; the memory is used to store a program for implementing a device detection method. After the device is powered on and the program of the method is run through the processor, the following steps are performed: a first audio signal output by a microphone channel of the device under test and a second audio signal output by a re-collection channel of the device under test are obtained; a first timing signal and a second timing signal are determined based on the first audio signal and the second audio signal; wherein the amplitude difference between the first timing signal and the second timing signal corresponds to the phase difference between the two audio signals; and whether the microphone channel and the re-collection channel are consistent in phase based on whether the amplitudes of the first timing signal and the second timing signal are consistent.

[0292] Thirteenth Embodiment

[0293] Corresponding to the above-mentioned device detection method, the present application also provides a device detection method, the execution subject of the method includes a device detection device. The parts of this embodiment that are the same as the tenth embodiment are not repeated here, please refer to the corresponding parts in the tenth embodiment.

[0294] Please refer to Fig.13 , which is a flow chart of an embodiment of the device detection method of the present application. In this embodiment, the method may include the following steps:

[0295] Step S1301: Acquire a first audio signal output by a microphone channel of the device under test and a second audio signal output by a recollection channel of the device under test.

[0296] In the acoustic echo cancellation scenario, it is also necessary to detect the amplitude synchronization of the microphone channel and the echo channel. This step corresponds to step S1001 in the above-mentioned embodiment 10, and will not be described in detail here.

[0297] Step S1303: Determine a first time sequence signal and a second time sequence signal according to the first audio signal and the second audio signal.

[0298] The first time sequence signal includes a time sequence signal with a stable amplitude corresponding to the first audio signal, and the second time sequence signal includes a time sequence signal with a stable amplitude corresponding to the second audio signal. This step corresponds to step S901 in the seventh embodiment, and will not be described again.

[0299] Step S1305: If the statistical data of the amplitude difference between the first time series signal and the second time series signal at multiple moments is less than or equal to the amplitude difference threshold, it is determined that the amplitude of the microphone channel is consistent with that of the echo channel.

[0300] This step corresponds to step S903 in the seventh embodiment, and will not be described again here.

[0301] It can be seen from the above embodiments that the device detection method provided by the embodiments of the present application obtains the first audio signal output by the microphone channel of the device under test and the second audio signal output by the re-collection channel of the device under test; determines the first timing signal and the second timing signal according to the first audio signal and the second audio signal; wherein the first timing signal includes a timing signal with a stable amplitude corresponding to the first audio signal, and the second timing signal includes a timing signal with a stable amplitude corresponding to the second audio signal; if the statistical data of the amplitude difference between the first timing signal and the second timing signal at multiple moments is less than or equal to the amplitude difference threshold, it is determined that the amplitude of the microphone channel is consistent with that of the re-collection channel; this processing method utilizes signal conversion processing to convert the audio signals output by the microphone channel and the re-collection channel into timing signals with a stable amplitude, and uses the converted timing signals with a stable amplitude as analysis signals, and judges the consistency of the amplitude between the re-collection signal and the microphone signal based on the relationship between the analysis signal amplitudes; therefore, the detection cost can be effectively reduced while ensuring high detection accuracy, stability and efficiency.

[0302] Fourteenth Embodiment

[0303] In the above-mentioned embodiment, a device detection method is provided. Correspondingly, the present application also provides a device detection apparatus. The apparatus corresponds to the above-mentioned method embodiment. Since the apparatus embodiment is basically similar to the method embodiment, the description is relatively simple. For the relevant parts, please refer to the partial description of the method embodiment. The apparatus embodiment described below is only illustrative.

[0304] The present application further provides a device detection apparatus, comprising:

[0305] A signal acquisition unit, used to acquire a first audio signal output by a microphone channel of the device under test and a second audio signal output by a re-acquisition channel of the device under test;

[0306] A signal conversion unit, configured to determine a first time sequence signal and a second time sequence signal according to the first audio signal and the second audio signal; wherein the first time sequence signal comprises a time sequence signal with a stable amplitude corresponding to the first audio signal, and the second time sequence signal comprises a time sequence signal with a stable amplitude corresponding to the second audio signal;

[0307] The amplitude consistency determination unit is used to determine that the amplitudes of the microphone channel and the echo channel are consistent if the statistical data of the amplitude difference between the first time series signal and the second time series signal at multiple moments is less than or equal to the amplitude difference threshold.

[0308] Fifteenth Embodiment

[0309] In the above-mentioned embodiment, a device detection method is provided, and correspondingly, the present application also provides an electronic device. The device corresponds to the embodiment of the above-mentioned method. Since the device embodiment is basically similar to the method embodiment, the description is relatively simple, and the relevant parts can be referred to the partial description of the method embodiment. The device embodiment described below is only illustrative.

[0310] An electronic device of the present embodiment includes: a processor and a memory; the memory is used to store a program for implementing a device detection method. After the device is powered on and the program of the method is run through the processor, the following steps are performed: a first audio signal output by a microphone channel of the device under test and a second audio signal output by a re-collection channel of the device under test are obtained; a first timing signal and a second timing signal are determined based on the first audio signal and the second audio signal; wherein the first timing signal includes a timing signal with a stable amplitude corresponding to the first audio signal, and the second timing signal includes a timing signal with a stable amplitude corresponding to the second audio signal; if the statistical data of the amplitude difference between the first timing signal and the second timing signal at multiple times is less than or equal to the amplitude difference threshold, it is determined that the amplitude of the microphone channel is consistent with that of the re-collection channel.

[0311] Sixteenth Embodiment

[0312] Corresponding to the above-mentioned microphone array detection method, the present application also provides a microphone array detection method, the execution subject of the method includes a microphone array detection device. The parts of this embodiment that are the same as the first embodiment are not repeated here, please refer to the corresponding parts in the first embodiment.

[0313] In this embodiment, the method may include the following steps:

[0314] Step 1: for two microphone channels of the device under test, performing a first Hilbert transform on two audio signals output by the two channels to obtain a first time sequence signal; and performing a second Hilbert transform on the two audio signals to obtain a second time sequence signal.

[0315] This step corresponds to a specific implementation of step S101 in the above-mentioned embodiment 1. The first Hilbert transform may include the following steps: performing Hilbert transform on the two audio signals respectively; performing norm processing (such as L-2 norm) on the two complex signals obtained after the Hilbert transform respectively; and taking the sum of the two norm signals as the first time series signal. The second Hilbert transform may include the following steps: performing a summation operation on the two audio signals; performing Hilbert transform on the summed signal; performing norm processing on the complex signal obtained after the Hilbert transform, and taking the norm signal as the second time series signal.

[0316] The transformation processing methods of the first Hilbert transform and the second Hilbert transform are opposite, which means that the first Hilbert transform first performs Hilbert transform and takes norm, and then sums, while the second Hilbert transform first sums, and then performs Hilbert transform and takes norm. In specific implementation, the operation method is not limited to summation, and other operation methods such as difference can also be used, that is: the first Hilbert transform first performs Hilbert transform and takes norm, and then takes difference, while the second Hilbert transform first takes difference, and then performs Hilbert transform and takes norm.

[0317] The transformation processing modes of the first Hilbert transform and the second Hilbert transform are opposite, so that the amplitude difference between the first time series signal and the second time series signal corresponds to the phase difference of the two audio signals. The first time series signal includes the operation result of the time series signal with stable amplitude of the two audio signals, and the second time series signal includes the time series signal with stable amplitude of the operation result of the two audio signals.

[0318] Step 2: Determine whether the two audio signals are consistent in phase based on whether the amplitudes of the first time series signal and the second time series signal are consistent.

[0319] This step corresponds to step S103 in the first embodiment, and will not be described again here.

[0320] Step 3: If the two-channel audio signals of the pairwise combination are both in phase, it is determined that the microphone array of the device under test is in phase.

[0321] This step corresponds to step S105 in the above-mentioned embodiment 1, and will not be described in detail here.

[0322] It can be seen from the above embodiments that the microphone array detection method provided in the embodiments of the present application performs a first Hilbert transform on two audio signals output by two microphone channels of the device under test in pairs to obtain a first timing signal; and performs a second Hilbert transform on the two audio signals to obtain a second timing signal; the transformation processing methods of the first Hilbert transform and the second Hilbert transform are opposite; whether the two audio signals are consistent in phase is determined based on whether the amplitudes of the first timing signal and the second timing signal are consistent; if the two-channel audio signals of the pairwise combination are consistent in phase, it is determined that the microphone array of the device under test is consistent in phase; this processing method uses the Hilbert transform to convert the phase detection into a relatively simple amplitude detection, and judges the consistency of the original signal phase based on the relationship between the analysis signal amplitudes after the Hilbert transform; therefore, the detection cost can be effectively reduced while ensuring high detection accuracy, stability and efficiency.

[0323] The methods provided in the above embodiments can be used to detect the device under test, including but not limited to: smart speakers, user devices (such as smart phones), microphones, live broadcast devices, conference phones, video conference terminals, tablet computers, etc.

[0324] In one example, the present application embodiment provides a smart speaker detection system, which includes a smart speaker and any of the above-mentioned devices. Figure 1 The description thereof will not be repeated here.

[0325] In one example, the present application embodiment provides a user equipment detection system, which includes a user equipment and any one of the above-mentioned devices. Fig.11 The description thereof will not be repeated here.

[0326] In one example, an embodiment of the present application provides a microphone detection system, which includes a microphone and any of the above-mentioned devices. A microphone is also called a monitoring head. A monitoring microphone is a device used to collect environmental sounds on site and transmit them to a back-end device. It is composed of a microphone and an audio amplifier circuit. The specific implementation method of the microphone system is similar to that of the smart speaker detection system. It only needs to replace the device under test with a microphone, which will not be described here.

[0327] In one example, the embodiment of the present application provides a live broadcast device detection system, which includes a live broadcast device (such as Xiaomi live broadcast all-in-one machine) and any of the above devices. The specific implementation of the live broadcast device system is similar to the smart speaker detection system, as long as the device under test is replaced with a live broadcast device, which will not be repeated here.

[0328] In one example, the present application embodiment provides a conference phone detection system, which includes a conference phone (such as a MIDI conference phone that Alibaba cooperates with other manufacturers), and any of the above devices. The specific implementation of the conference phone system is similar to that of the smart speaker detection system, as long as the device under test is replaced with a conference phone, which will not be repeated here.

[0329] In one example, an embodiment of the present application provides a video conferencing terminal detection system, which includes a video conferencing terminal (such as a DingTalk video conferencing all-in-one machine) and any of the above devices. The specific implementation of the video conferencing terminal system is similar to that of the smart speaker detection system, as long as the device under test is replaced with a conference phone, which will not be repeated here.

[0330] Although the present application is disclosed as above in the form of a preferred embodiment, it is not intended to limit the present application. Any technical personnel in this field may make possible changes and modifications without departing from the spirit and scope of the present application. Therefore, the scope of protection of the present application shall be based on the scope defined by the claims of the present application.

[0331] In a typical configuration, a computing device includes one or more processors (CPU), input / output interfaces, network interfaces, and memory.

[0332] The memory may include non-permanent storage in a computer-readable medium, random access memory (RAM) and / or non-volatile memory in the form of read-only memory (ROM) or flash RAM. The memory is an example of a computer-readable medium.

[0333] 1. Computer-readable media includes permanent and non-permanent, removable and non-removable media that can be used to store information by any method or technology. Information can be computer-readable instructions, data structures, program modules or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technology, compact disk read-only memory (CD-ROM), digital versatile disk (DVD) or other optical storage, magnetic cassettes, magnetic tape magnetic disk storage or other magnetic storage devices or any other non-transmission media that can be used to store information that can be accessed by a computing device. As defined herein, computer-readable media does not include non-transitory media such as modulated data signals and carrier waves.

[0334] 2. Those skilled in the art should understand that the embodiments of the present application can be provided as methods, systems or computer program products. Therefore, the present application can take the form of a complete hardware embodiment, a complete software embodiment or an embodiment combining software and hardware. Moreover, the present application can take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.

Claims

1. A microphone array detection method, It is characterized in that include: For two microphone channels of the device under test that are combined in pairs, a first Hilbert transform is performed on two audio signals output by the two channels to obtain a first time sequence signal; and a second Hilbert transform is performed on the two audio signals to obtain a second time sequence signal; the first Hilbert transform and the second Hilbert transform have opposite transformation processing modes; Determining whether the two audio signals are in phase with each other according to whether the amplitudes of the first time series signal and the second time series signal are consistent; If the two-channel audio signals of the pairwise combination are both in phase, then it is determined that the microphone arrays of the device under test are in phase.

2. A microphone array detection method, It is characterized in that include: For two microphone channels of the device under test that are combined in pairs, a first timing signal and a second timing signal are determined according to two audio signals output by the two channels; wherein the amplitude difference between the first timing signal and the second timing signal corresponds to the phase difference of the two audio signals; the first timing signal includes the operation result of the timing signals with stable amplitudes of the two audio signals, and the second timing signal includes the timing signals with stable amplitudes of the operation results of the two audio signals; Determining whether the two audio signals are in phase with each other according to whether the amplitudes of the first time series signal and the second time series signal are consistent; If the two-channel audio signals of the pairwise combination are both in phase, then it is determined that the microphone arrays of the device under test are in phase.

3. The method according to claim 2, It is characterized in that The second timing signal is determined in the following manner: Performing an operation on the two audio signals to obtain a third time series signal; transforming the third time series signal into a first complex signal; Determine the second timing signal according to the real part and the imaginary part of the first complex signal; The first timing signal is determined in the following manner: transforming the two audio signals into a second complex signal and a third complex signal; Determine a fourth timing signal according to the real part and the imaginary part of the second complex signal; and determine a fifth timing signal according to the real part and the imaginary part of the third complex signal; An operation is performed on the fourth timing signal and the fifth timing signal to obtain a first timing signal.

4. The method according to claim 3, It is characterized in that The converting the third time series signal into the first complex signal comprises: Performing a 90-degree phase shift process on the third time series signal, so that the signal after the phase shift is a first complex signal; The step of transforming the two audio signals into a second complex signal and a third complex signal comprises: A 90-degree phase shift process is performed on the two audio signals, and the phase-shifted signals include a second complex signal and a third complex signal.

5. The method according to claim 4, It is characterized in that The 90-degree phase shift processing includes: Hilbert transform; The step of determining the second timing signal according to the real part and the imaginary part of the first complex signal comprises: A norm process is performed on the first complex signal to obtain the second time series signal.

6. The method according to claim 3, It is characterized in that The operation includes summing two audio signals.

7. The method according to claim 2, It is characterized in that To determine whether the first timing signal and the second timing signal have the same amplitude, the following method is used: If the statistical data of the amplitude difference between the first timing signal and the second timing signal at multiple moments is less than or equal to the amplitude difference threshold, it is determined that the amplitudes of the first timing signal and the second timing signal are consistent.

8. The method according to claim 7, It is characterized in that The statistics include: Amplitude difference mean, amplitude difference variance, amplitude difference standard deviation.

9. The method according to claim 2, It is characterized in that Also includes: Determine a sixth timing signal and a seventh timing signal according to a plurality of audio signals output by the multi-channel microphone channels of the device under test; wherein the amplitude difference between the sixth timing signal and the seventh timing signal corresponds to the phase difference of the plurality of audio signals; Determining whether the sixth timing signal and the seventh timing signal have the same amplitude; If the above judgment result is no, it is determined that the microphone array phases are inconsistent; If the above judgment result is yes, the step of entering into the step of determining the first timing signal and the second timing signal for the two microphone channels of the device under test in pairs according to the two audio signals output by the two channels.

10. The method according to claim 9, It is characterized in that The sixth timing signal includes a timing signal with a stable amplitude that is a result of operation of a plurality of audio signals, and the seventh timing signal includes a timing signal with a stable amplitude that is a result of operation of a plurality of audio signals.

11. The method according to claim 9, It is characterized in that The determining whether the sixth timing signal and the seventh timing signal have the same amplitude includes: If the statistical data of the amplitude difference between the sixth timing signal and the seventh timing signal at multiple moments is less than or equal to the amplitude difference threshold, it is determined that the amplitudes of the sixth timing signal and the seventh timing signal are consistent.

12. The method according to claim 2, It is characterized in that Also includes: The analog electrical signal output by the signal generator is used as the input signal of the microphone channel, and the audio signal output by the microphone channel is determined by the device under test.

13. The method according to claim 12, It is characterized in that The analog electrical signal includes: a sinusoidal analog electrical signal.

14. The method according to claim 13, It is characterized in that The sinusoidal analog electrical signals input by multiple detections are high-frequency signals of mutual quality.

15. A microphone array detection method, It is characterized in that include: Determine a first timing signal and a second timing signal according to multiple audio signals output by multiple microphone channels of the device under test; wherein the amplitude difference between the first timing signal and the second timing signal corresponds to the phase difference of the multi-channel output signal; the first timing signal includes the operation result of the timing signals with stable amplitudes of the multiple audio signals, and the second timing signal includes the timing signals with stable amplitudes of the operation results of the multiple audio signals; Whether the phases of the plurality of microphone channels are consistent is determined according to whether the amplitudes of the first timing signal and the second timing signal are consistent.

16. A microphone array detection method, It is characterized in that include: For two microphone channels of the device under test that are combined in pairs, determine a first timing signal and a second timing signal according to the first audio signal and the second audio signal output by the two channels; wherein the first timing signal includes a timing signal with a stable amplitude corresponding to the first audio signal, and the second timing signal includes a timing signal with a stable amplitude corresponding to the second audio signal; If the statistical data of the amplitude difference between the first time series signal and the second time series signal at multiple moments is less than or equal to the amplitude difference threshold, it is determined that the amplitudes of the two-channel audio signals are consistent; If the amplitudes of the two-channel audio signals in the pairwise combination are consistent, it is determined that the microphone array amplitudes of the device under test are consistent.

17. A device detection method, It is characterized in that include: Acquire a first audio signal output by a microphone channel of the device under test and a second audio signal output by a sampling channel of the device under test; Determine a first timing signal and a second timing signal according to a first audio signal and a second audio signal; wherein the amplitude difference between the first timing signal and the second timing signal corresponds to the phase difference between the two audio signals; the first timing signal includes a calculation result of a timing signal with a stable amplitude of the first audio signal and a timing signal with a stable amplitude of the second audio signal, and the second timing signal includes a timing signal with a stable amplitude of the calculation result of the first audio signal and the second audio signal; Whether the microphone channel and the echo channel are in phase with each other is determined according to whether the amplitudes of the first time sequence signal and the second time sequence signal are consistent.

18. A device detection method, It is characterized in that include: Acquire a first audio signal output by a microphone channel of the device under test and a second audio signal output by a sampling channel of the device under test; Determine a first time sequence signal and a second time sequence signal according to the first audio signal and the second audio signal; wherein the first time sequence signal includes a time sequence signal with a stable amplitude corresponding to the first audio signal, and the second time sequence signal includes a time sequence signal with a stable amplitude corresponding to the second audio signal; If the statistical data of the amplitude difference between the first time series signal and the second time series signal at multiple moments is less than or equal to the amplitude difference threshold, it is determined that the amplitudes of the microphone channel and the echo channel are consistent.

19. A microphone array detection device, It is characterized in that include: A two-channel signal conversion unit, for determining a first timing signal and a second timing signal according to two audio signals output by two microphone channels of a device under test in pairs, wherein the amplitude difference between the first timing signal and the second timing signal corresponds to the phase difference of the two audio signals; the first timing signal includes the operation result of the timing signals with stable amplitudes of the two audio signals, and the second timing signal includes the timing signals with stable amplitudes of the operation results of the two audio signals; A two-channel amplitude consistency detection unit, used to determine whether the two audio signals are consistent in phase according to whether the amplitudes of the first time series signal and the second time series signal are consistent; The multi-channel detection result determination unit is used to determine that the microphone arrays of the device under test are in phase if the two-channel audio signals combined in pairs are both in phase.

20. A microphone array detection device, It is characterized in that include: A multi-channel signal conversion unit, used to determine a first timing signal and a second timing signal according to a plurality of audio signals output by a plurality of microphone channels of the device under test; wherein the amplitude difference between the first timing signal and the second timing signal corresponds to the phase difference of the multi-channel output signal; the first timing signal includes a calculation result of a timing signal with a stable amplitude of a plurality of audio signals, and the second timing signal includes a timing signal with a stable amplitude of a calculation result of a plurality of audio signals; The multi-channel amplitude consistency detection unit is used to determine whether the phases of multiple microphone channels are consistent according to whether the amplitudes of the first timing signal and the second timing signal are consistent.

21. A microphone array detection device, It is characterized in that include: A two-channel signal conversion unit, for determining a first timing signal and a second timing signal for two microphone channels of a device under test in a pairwise combination according to the first audio signal and the second audio signal output by the two channels; wherein the first timing signal comprises a timing signal with a stable amplitude corresponding to the first audio signal, and the second timing signal comprises a timing signal with a stable amplitude corresponding to the second audio signal; A two-channel amplitude consistency detection unit, configured to determine that the amplitudes of the two-channel audio signals are consistent if the statistical data of the amplitude difference between the first time series signal and the second time series signal at multiple moments is less than or equal to an amplitude difference threshold; The multi-channel detection result determination unit is used to determine that the microphone array amplitude of the device under test is consistent if the two-channel audio signals combined in pairs are consistent in amplitude.

22. A device detection device, It is characterized in that include: A signal acquisition unit, used to acquire a first audio signal output by a microphone channel of the device under test and a second audio signal output by a re-acquisition channel of the device under test; A signal conversion unit, configured to determine a first time sequence signal and a second time sequence signal according to a first audio signal and a second audio signal; wherein the amplitude difference between the first time sequence signal and the second time sequence signal corresponds to the phase difference between the two audio signals; the first time sequence signal comprises a calculation result of a time sequence signal with a stable amplitude of the first audio signal and a time sequence signal with a stable amplitude of the second audio signal, and the second time sequence signal comprises a time sequence signal with a stable amplitude of the calculation result of the first audio signal and the second audio signal; The phase consistency determination unit is used to determine whether the microphone channel and the echo channel are consistent in phase according to whether the first time sequence signal and the second time sequence signal are consistent in amplitude.

23. A device detection device, It is characterized in that include: A signal acquisition unit, used to acquire a first audio signal output by a microphone channel of the device under test and a second audio signal output by a re-acquisition channel of the device under test; A signal conversion unit, configured to determine a first time sequence signal and a second time sequence signal according to the first audio signal and the second audio signal; wherein the first time sequence signal comprises a time sequence signal with a stable amplitude corresponding to the first audio signal, and the second time sequence signal comprises a time sequence signal with a stable amplitude corresponding to the second audio signal; The amplitude consistency determination unit is used to determine that the amplitudes of the microphone channel and the echo channel are consistent if the statistical data of the amplitude difference between the first time series signal and the second time series signal at multiple moments is less than or equal to the amplitude difference threshold.

24. An electronic device, It is characterized in that include: Processor and memory; A memory for storing a program for implementing the method according to any one of claims 1 to 18, wherein the device is powered on and runs the program of the method through the processor.

25. A smart speaker detection system, It is characterized in that include: A smart speaker, according to the device according to any one of claims 19-23.

26. A user equipment detection system, It is characterized in that include: User equipment, a device according to any one of claims 19-23.

27. A pickup detection system, It is characterized in that include: A sound pickup, a device according to any one of claims 19-23.

28. A live broadcast equipment detection system, It is characterized in that include: User equipment, a device according to any one of claims 19-23.

29. A conference phone detection system, It is characterized in that include: A conference phone, according to the device according to any one of claims 19-23.

30. A video conference terminal detection system, It is characterized in that include: A video conferencing terminal, according to the device according to any one of claims 19-23.