Directional pickup method, system and equipment based on small-aperture double-microphone array
By using differential beamformer and constrained white noise gain beamformer for high-frequency and low-frequency signals in small-aperture dual microphone arrays, the problem of insufficient white noise gain in the low-frequency band of differential beamformer is solved, and directional sound pickup is improved Effects and voice quality.
Patent Information
- Application Number
- CN202410960074.3
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-07-17
- Publication Date
- 2024-11-08
- Estimated Expiration
- 2044-07-17
AI Technical Summary
In the prior art, differential beamformers have a problem of low white noise gain in the low frequency band, which leads to amplification of the microphone's own noise, affecting the voice quality, and it is difficult to effectively improve the voice quality effect of directional sound pickup.
Using a directional sound pickup method based on a small aperture dual microphone array, the differential beamformer with the smallest amplitude and the lowest amplitude are selected by using a differential beamformer and a beamformer with the smallest amplitude. The beamformer with white noise gain performs frequency domain signal conversion to extract directional voice to avoid the problem of insufficient white noise gain in low-frequency bands.
It improves the degree of suppression of interference signals in other directions, significantly improves the directional sound pickup effect of the dual-microphone array, effectively reduces the amplification of the microphone's own noise, and improves the voice quality.
Smart Images

Figure CN118921596A_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the technical field of sound signal processing, and in particular to a directional sound pickup method, system and device based on a small-aperture dual-microphone array. Background Art
[0002] When using a microphone to collect the speaker's voice, there are often interferences such as noise, other speakers' voices, and reverberation. These interferences will reduce the quality and intelligibility of the voice and easily cause auditory fatigue. In order to reduce these interferences, it is necessary to design a speech enhancement algorithm to effectively improve the efficiency of voice communication. In the prior art, speech enhancement algorithms are mainly divided into single-channel methods and multi-channel methods. The single-channel method usually performs signal processing based on a single microphone, but its performance is limited by the inability to obtain spatial information of the sound source. The multi-channel method uses multiple microphones to collect sound signals and extracts the speech signal in the target direction through spatial filtering and other methods. In the multi-channel method, beamforming technology is an important spatial filtering technology. As a type of beamforming technology, differential beamforming uses differential to approximate the differential of the sound pressure field to obtain spatial directivity. This method has the advantages of good frequency consistency of the beam pattern and is suitable for processing broadband voice signals. However, the differential beamformer has the problem of low white noise gain in the low frequency band, which will amplify the microphone's own noise and affect the voice quality. Therefore, how to improve the voice quality effect of directional pickup is an urgent problem to be solved. Summary of the invention
[0003] The main purpose of this application is to overcome the shortcomings and deficiencies of the prior art and to provide a directional sound pickup method, system and device based on a small-aperture dual-microphone array. By using different beamformers to process microphone signals in different frequency bands, speech in the target direction can be extracted, sound signals in other directions can be suppressed, and the directional sound pickup effect of the dual-microphone array can be improved.
[0004] In order to achieve the above objectives, this application adopts the following technical solutions:
[0005] In a first aspect, the present application provides a directional sound pickup method based on a small-aperture dual-microphone array, comprising the following steps:
[0006] Collecting time domain signals from dual microphones and converting the time domain signals into frequency domain signals; the frequency domain signals include low frequency band signals and high frequency band signals;
[0007] For the high frequency band signal, a plurality of differential beamformers with different zero points are preset, multiple amplitudes of the high frequency band frequency domain signal are calculated according to the plurality of differential beamformers, and the differential beamformer with the smallest amplitude is selected as the optimal differential beamformer;
[0008] For the low-frequency band signal, a low-frequency band frequency domain signal is calculated by a beamformer with constrained white noise gain;
[0009] The frequency domain signals calculated by the beamformer constraining white noise gain and the optimal differential beamformer are transformed to obtain directionally picked-up speech.
[0010] As a preferred technical solution, the collecting of time domain signals of dual microphones and converting the time domain signals into frequency domain signals includes:
[0011] The time domain signals collected by the dual microphones are subjected to short-time Fourier transform to obtain frequency domain signals; wherein the short-time Fourier transform includes using a window function.
[0012] As a preferred technical solution, the beamformer constrained by white noise gain is specifically:
[0013] min w H (f)Γ(f)w(f)
[0014] swt H (f)d(f,0)=1
[0015]
[0016] Where Γ(f) is the spatial coherence moment of the diffuse noise model, which is calculated based on the microphone spacing, sound speed, and sampling frequency information; w(f) is the beamformer that constrains the white noise gain; w H (f) represents the conjugate transpose of w(f); WNG min (f) is the minimum white noise gain.
[0017] As a preferred technical solution, the preset several different zero points are set in the interval [90°, 180°].
[0018] As a preferred technical solution, for the high frequency band signal, a plurality of differential beamformers with different zero points are preset, specifically:
[0019]
[0020] Among them, w p (f) is the pth zero point α p Differential beamformer; d H (f, α p ) is d(f, α p ), d(f, α p ) indicates that the incident angle is α p The guiding vector.
[0021] As a preferred technical solution, the frequency domain signal calculated by the beamformer with constrained white noise gain and the optimal differential beamformer is transformed to obtain a directionally picked-up speech output, including:
[0022] The frequency domain signals calculated by the constrained white noise gain beamformer and the optimal differential beamformer are subjected to inverse Fourier transformation to obtain time domain signals, and the time domain signals are overlap-added to obtain a directionally picked-up speech output.
[0023] In a second aspect, the present application provides a directional sound pickup system based on a small-aperture dual-microphone array, which is applied to the directional sound pickup method based on a small-aperture dual-microphone array.
[0024] It includes a signal acquisition module, a high-frequency band frequency domain signal calculation module, a low-frequency band frequency domain signal calculation module, and a directional voice pickup module;
[0025] The signal acquisition module is used to acquire the time domain signals of the dual microphones and convert the time domain signals into frequency domain signals; the frequency domain signals include low frequency band signals and high frequency band signals;
[0026] The module for calculating the high-frequency band frequency domain signal is used to preset a plurality of differential beamformers with different zero points for the high-frequency band signal, calculate a plurality of amplitudes of the high-frequency band frequency domain signal according to the plurality of differential beamformers, and select the differential beamformer with the smallest amplitude as the optimal differential beamformer;
[0027] The module for calculating the low-frequency band frequency domain signal is used to calculate the low-frequency band frequency domain signal for the low-frequency band signal by using a beamformer with constrained white noise gain;
[0028] The directional voice pickup module is used to transform the frequency domain signal calculated by the constrained white noise gain beamformer and the optimal differential beamformer to obtain directionally picked up voice.
[0029] As a preferred technical solution, the signal acquisition module is specifically used for:
[0030] The time domain signals collected by the dual microphones are subjected to short-time Fourier transform to obtain frequency domain signals; wherein the short-time Fourier transform includes using a window function.
[0031] In a third aspect, the present application provides an electronic device, the electronic device comprising:
[0032] at least one processor; and,
[0033] a memory communicatively connected to the at least one processor; wherein,
[0034] The memory stores computer program instructions that can be executed by the at least one processor, and the computer program instructions are executed by the at least one processor to enable the at least one processor to perform the directional sound pickup method based on a small-aperture dual-microphone array.
[0035] In a fourth aspect, the present application provides a computer-readable storage medium storing a program, which, when executed by a processor, implements the directional sound pickup method based on a small-aperture dual-microphone array.
[0036] In summary, compared with the prior art, the effective effects brought about by the technical solution provided by this application include at least:
[0037] The present application proposes a directional sound pickup method based on a small-aperture dual-microphone array, which collects time domain signals of dual microphones and converts the time domain signals into frequency domain signals; the frequency domain signals include low-frequency band signals and high-frequency band signals; for high-frequency band signals, a plurality of differential beamformers with different zero points are preset, and multiple amplitudes of high-frequency band frequency domain signals are calculated according to a plurality of differential beamformers, and the differential beamformer with the smallest amplitude is selected as the optimal differential beamformer; for low-frequency band signals, the low-frequency band frequency domain signals are calculated by a beamformer with constrained white noise gain; the frequency domain signals calculated by the beamformer with constrained white noise gain and the optimal differential beamformer are transformed to obtain directionally picked-up speech. In order to avoid the disadvantage of low white noise gain in the low frequency band of the differential beamformer, the present application performs frequency band processing, adopts a constrained white noise gain beamformer in the low frequency band, and adopts a differential beamformer in the high frequency band; in addition, a plurality of differential beamformers with different zero points are preset, and the output of the beamformer with the smallest beam result amplitude is selected as the final output, thereby improving the directional sound pickup effect; therefore, the present application improves the degree of suppression of interference signals in other directions and effectively improves the directional sound pickup effect of the dual-microphone array. BRIEF DESCRIPTION OF THE DRAWINGS
[0038] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.
[0039] Figure 1 A flow chart of a directional sound pickup method based on a small-aperture dual-microphone array provided in one embodiment of the present application;
[0040] Figure 2 A schematic diagram of a desired direction provided for an embodiment of the present application;
[0041] Figure 3 A schematic diagram of spectrum comparison between the method adopted in the present application and the method using a super-directional beamformer provided in one embodiment of the present application;
[0042] Figure 4 A block diagram of a directional sound pickup system based on a small-aperture dual-microphone array is provided for one embodiment of the present application. DETAILED DESCRIPTION
[0043] In order to enable those skilled in the art to better understand the present application, the technical solutions in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, rather than all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those skilled in the art without making creative work are within the scope of protection of the present application.
[0044] Reference to "embodiments" in this application means that a particular feature, structure, or characteristic described in conjunction with the embodiments may be included in at least one embodiment of the present application. The appearance of the phrase in various locations in the specification does not necessarily refer to the same embodiment, nor is it an independent or alternative embodiment that is mutually exclusive with other embodiments. It is explicitly and implicitly understood by those skilled in the art that the embodiments described in this application may be combined with other embodiments.
[0045] Example:
[0046] See also Figure 1 In one embodiment of the present application, a directional sound pickup method based on a small-aperture dual-microphone array is provided, comprising the following steps:
[0047] S1. Collect time domain signals from dual microphones and convert the time domain signals into frequency domain signals; the frequency domain signals include low frequency band signals and high frequency band signals.
[0048] Furthermore, the time domain signals collected by the dual microphones are subjected to short-time Fourier transform to obtain frequency domain signals; the time domain signals input in each frame are processed by frequency band division, so that different beamforming methods can be used in different frequency bands; in addition, in order to achieve better frequency consistency of the beam pattern, the present embodiment adopts a small-aperture dual-microphone array, and the small aperture can be understood as a relatively small distance between the two microphones, for example, the distance between the two microphones can be 0.8 cm.
[0049] Among them, for short-time Fourier transform, a window function can be selected, the frame length is set to F, and the frame shift can be set to 50% of the frame length. For the convenience of representation, it can be written in the form of a vector, that is, the signal of the fth frequency point of the tth frame can be expressed as:
[0050]
[0051] Where x1(t, f)∈C and x2(t, f)∈C are the signals of microphone 1 and microphone 2 at the time-frequency point {t, f}, respectively, and f∈{0, 1, …, F / 2} is the frequency index; in the far-field environment, equation (1) can be expressed as:
[0052] x(t,f)=d(f,θ)s1(t,f)+v(t,f) (2)
[0053] In the above formula (2), is the steering vector of the sound source s with an incident azimuth angle of θ, where T represents the transpose, f s represents the sampling rate, s1(t, f) is the signal of the sound source at microphone 1, and v(t, f) is the additive noise signal.
[0054] For a dual-microphone array, the pickup direction of the differential beamformer can only be the end-fire direction (0° or 180°). The 0° desired direction is used as an example. Figure 2 As shown in the figure, the 0 degree direction is the direction from microphone 1 to microphone 2, or in other words, it is the direction towards microphone 1. For the target sound source at the 0 degree direction, its steering vector can be expressed as τ0 is the time delay of the sound propagating from microphone 1 to microphone 2. Therefore, a beamformer w(f)∈C can be designed 2 , C 2 is a complex vector identifier, which can suppress the noise signal (output frequency domain signal) without distortion to the target sound source s:
[0055] y(t,f)=w H (f)x(t,f) (3)
[0056] In the above formula (3), H represents conjugate transposition.
[0057] S2. For the high frequency band signal, preset a plurality of differential beamformers with different zero points, calculate multiple amplitudes of the high frequency band frequency domain signal according to the plurality of differential beamformers, and select the differential beamformer with the smallest amplitude as the optimal differential beamformer.
[0058] Furthermore, in order to improve the degree of suppression of interference signals from other directions, for frequency index f>f TH , that is, the high-frequency signal, selects the one with the smallest amplitude as the output from the results of the differential beamformers with P (P ≥ 2) different zero points. In other words, the beamformer with the smallest output amplitude is selected.
[0059] In this embodiment, the zero point of the differential beamformer can be set within the interval [90°, 180°], where the zero point refers to the point where the beam has the lowest degree of suppression on a signal in a certain direction.
[0060] Calculate the pth zero point as α p The differential beamformer w p (f) namely:
[0061]
[0062] In the above formula (4), w p (f) is the pth zero point α p Differential beamformer; d H (f,α p ) is d(f,α p ), d(f,α p ) indicates that the incident angle is α p The steering vector of the pth beam is After that, find the index of the beamformer with the smallest beam result magnitude:
[0063]
[0064] Finally, select the pth * The beam result is output at this frequency point, namely:
[0065]
[0066] In this embodiment, a plurality of differential beamformers with different zero points (i.e., differential beamformer 1, ..., differential beamformer P) are preset, and a beam result with the smallest amplitude is finally output, thereby achieving the effect of zero point adaptation, improving the degree of suppression of interference signals, and improving the noise reduction effect.
[0067] S3. For the low-frequency band signal, calculate the low-frequency band frequency domain signal through a beamformer with constrained white noise gain.
[0068] Furthermore, in order to avoid the disadvantage that the differential beamformer has a low white noise gain in the low frequency band and amplifies the microphone self-noise, for the frequency index f≤f TH , i.e. low frequency signal, using a beamformer with constrained white noise gain; where f TH It can be set according to actual needs.
[0069] Specifically, a convex optimization toolbox such as CVX can be used to solve the following optimization problem to obtain a beamformer:
[0070]
[0071] In the above equation (7), w(f) is the beamformer with constrained white noise gain; w H (f) represents the conjugate transpose of w(f); WNG min (f) is the minimum white noise gain (this value can be set according to specific needs); Γ(f)∈R 2x2 is the spatial coherence matrix of the diffuse noise model, which can be calculated based on the microphone spacing, sound speed, and sampling frequency f s The specific calculation formula of the {i, j}th element of the Γ(f) matrix is calculated as follows:
[0072]
[0073] In the above formula, sin[·] represents the sine trigonometric function.
[0074] The white noise gain in this embodiment refers to the degree of suppression of the microphone self-noise (thermal noise of the sensor, etc.) by the beamformer. The larger the white noise gain, the better the suppression effect. When the white noise gain is negative, the self-noise of the microphone will be amplified.
[0075] In addition, for the low-frequency part in the frequency band processing, the use of a delay-and-sum beamformer or a robust super-directional beamformer (diagonally loaded super-directional beamformer) can also solve the problem of low white noise gain in the low-frequency band of the differential beam.
[0076] S4, transforming the frequency domain signals calculated by the constrained white noise gain beamformer and the optimal differential beamformer to obtain directionally picked-up speech.
[0077] Further, the frequency domain signal calculated by the constrained white noise gain beamformer and the optimal differential beamformer is subjected to inverse Fourier transform to obtain a time domain signal, and the time domain signal is overlap-added to obtain a directional voice output. The output of the beamformer (frequency domain signal) is a complex number, that is, it includes amplitude and phase.
[0078] Specifically, to illustrate the technical advantages of the method of the present application, the spectrum of the method of the present application is compared with that of the method using the super-directional beamformer. Figure 3 ; Figure 3 The audio comparison 1 in the figure represents the spectrum of the reference channel, the audio comparison 2 represents the spectrum generated by the super-directional beamformer method, and the audio comparison 3 represents the spectrum generated by the method of the present application. In this example, a speaker is used to play white noise signals at different angles. In this experimental comparison, the pickup direction is 0°. For f>f THfrequency band (high frequency band signal), the zero points of the three differential beamformers are set to 90°, 150° and 180°, that is, P = 3, α1 = 90°, α2 = 150°, α3 = 180°; for f ≤ f TH Frequency band (low frequency signal), WNG min (f) Set according to actual needs. Figure 3 It can be seen from the 90°, 150° and 180° in the spectrum diagram in that, compared with the method using the super-directional beamformer, the method used in the present application: (1) has a higher degree of suppression of signals in undesired directions, and (2) has a lower degree of amplification of the microphone's own noise; wherein, Figure 3 In the figure, the reference channel is the signal originally collected by the microphone. After passing through the super-directional beamformer, it can be seen that the amplitude of the low-frequency signal has increased a lot (this is manifested as the color of the low-frequency band on the spectrum graph becomes lighter), while this application has no obvious increase. In addition, Figure 3 The middle black vertical bar segment is a silent segment, which can be considered to contain only the microphone's own noise. This also shows that compared with the super-directional beam, the present application has a lower degree of amplification of the microphone's own noise. Overall, the method used in the present application has a better directional sound pickup effect.
[0079] To summarize, in order to avoid the shortcoming of low low-frequency white noise gain of the differential beamformer, the present application uses a beamformer with constrained white noise gain in the low frequency band and a differential beamformer in the high frequency band, and presets several differential beamformers with different zero points, and finally outputs a beam result with the minimum amplitude, thereby achieving an effect similar to zero point adaptation, improving the degree of suppression of interference signals, and improving the noise reduction effect, thereby improving the directional sound pickup effect.
[0080] It should be noted that, for the sake of convenience of description, the aforementioned method embodiments are all expressed as a series of action combinations, but those skilled in the art should know that the present application is not limited to the described order of actions, because according to the present application, certain steps can be performed in other orders or simultaneously.
[0081] Based on the same idea as the directional sound pickup method based on a small-aperture dual-microphone array in the above-mentioned embodiment, the present application also provides a directional sound pickup system based on a small-aperture dual-microphone array, which can be used to perform the above-mentioned directional sound pickup method based on a small-aperture dual-microphone array. For ease of explanation, the structural schematic diagram of the embodiment of the directional sound pickup system based on a small-aperture dual-microphone array only shows the parts related to the embodiment of the present application. Those skilled in the art can understand that the illustrated structure does not constitute a limitation on the system, and may include more or fewer components than shown in the diagram, or combine certain components, or arrange the components differently.
[0082] See also Figure 4In another embodiment of the present application, a directional sound pickup system based on a small-aperture dual-microphone array is provided, the system comprising a signal collection module 101, a high-frequency band frequency domain signal calculation module 102, a low-frequency band frequency domain signal calculation module 103, and a directional voice pickup module 104;
[0083] The signal acquisition module 101 is used to acquire time domain signals from dual microphones and convert the time domain signals into frequency domain signals; the frequency domain signals include low frequency band signals and high frequency band signals;
[0084] The high-frequency band frequency domain signal calculation module 102 is used to preset a plurality of differential beamformers with different zero points for the high-frequency band signal, calculate a plurality of amplitudes of the high-frequency band frequency domain signal according to the plurality of differential beamformers, and select the differential beamformer with the smallest amplitude as the optimal differential beamformer;
[0085] The module 103 for calculating the low-frequency band frequency domain signal is used to calculate the low-frequency band frequency domain signal for the low-frequency band signal by using a beamformer with constrained white noise gain;
[0086] The directional speech pickup module 104 is used to transform the frequency domain signal calculated by the constrained white noise gain beamformer and the optimal difference beamformer to obtain directionally picked up speech.
[0087] It should be noted that the directional sound pickup system based on a small-aperture dual-microphone array of the present application corresponds one-to-one to the directional sound pickup method based on a small-aperture dual-microphone array of the present application. The technical features and beneficial effects described in the above-mentioned embodiment of the directional sound pickup method based on a small-aperture dual-microphone array are applicable to the embodiment of the directional sound pickup system based on a small-aperture dual-microphone array. For specific contents, please refer to the description in the embodiment of the method of the present application, and will not be repeated here. This is hereby declared.
[0088] In addition, in the implementation of the directional sound pickup system based on a small-aperture dual-microphone array in the above-mentioned embodiment, the logical division of each program module is only an example. In actual applications, the above-mentioned functions can be assigned to different program modules as needed, for example, for the convenience of corresponding hardware configuration requirements or software implementation. That is, the internal structure of the directional sound pickup system based on a small-aperture dual-microphone array is divided into different program modules to complete all or part of the functions described above.
[0089] In another embodiment, an electronic device for implementing a directional sound pickup method based on a small-aperture dual-microphone array is provided, comprising a processor, a memory, and a computer program stored in the memory and configured to be executed by the processor; when the processor executes the computer program, the directional sound pickup method based on a small-aperture dual-microphone array of any embodiment of the present application is implemented.
[0090] Exemplarily, in this embodiment, the computer program may be divided into one or more modules, and the one or more modules are stored in the memory and executed by the processor to complete the present application. The one or more modules may be a series of computer program instruction segments capable of completing specific functions, and the instruction segments are used to describe the execution process of the computer program in the device;
[0091] The device may be a computing device such as a desktop computer, a notebook, a PDA, a cloud server, etc. The device may include, but is not limited to, a processor, a memory;
[0092] The processor may be a central processing unit (CPU), or other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), field-programmable gate arrays (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. A general-purpose processor may be a microprocessor or any conventional processor, etc. The processor is the control center of the device, and uses various interfaces and lines to connect various parts of the entire device;
[0093] The memory can be used to store the computer program and / or module, and the processor realizes various functions of the device by running or executing the computer program and / or module stored in the memory, and calling the data stored in the memory. The memory can mainly include a program storage area and a data storage area, wherein the program storage area can store an operating system, at least one application required for a function, etc.; in addition, the memory can include a high-speed random access memory, and can also include a non-volatile memory, such as a hard disk, a memory, a plug-in hard disk, a smart memory card (Smart Media Card, SMC), a secure digital (Secure Digital, SD) card, a flash card (Flash Card), at least one disk storage device, a flash memory device, or other volatile solid-state storage devices.
[0094] Accordingly, the present application also provides a computer-readable storage medium, which includes a stored computer program, wherein when the computer program is running, the device where the computer-readable storage medium is located is controlled to execute the directional sound pickup method based on a small-aperture dual-microphone array as described in any of the above embodiments.
[0095] Those skilled in the art can understand that all or part of the processes in the above-mentioned embodiment methods can be completed by instructing the relevant hardware through a computer program, and the program can be stored in a non-volatile computer-readable storage medium. When the program is executed, it can include the processes of the embodiments of the above-mentioned methods. Among them, any reference to memory, storage, database or other media used in the embodiments provided in this application can include non-volatile and / or volatile memory. Non-volatile memory may include read-only memory (ROM), programmable ROM (PROM), electrically programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM) or flash memory. Volatile memory may include random access memory (RAM) or external cache memory. As an illustration and not limitation, RAM is available in many forms, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rate SDRAM (DDRSDRAM), enhanced SDRAM (ESDRAM), synchronous link (Synchlink) DRAM (SLDRAM), memory bus (Rambus) direct RAM (RDRAM), direct memory bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM).
[0096] The technical features of the above embodiments may be combined arbitrarily. To make the description concise, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.
[0097] The above embodiments are preferred implementation modes of the present application, but the implementation modes of the present application are not limited to the above embodiments. Any other changes, modifications, substitutions, combinations, and simplifications that do not deviate from the spirit and principles of the present application should be equivalent replacement methods and are included in the protection scope of the present application.
Claims
1. A directional sound pickup method based on a small-aperture dual-microphone array, characterized in that: The steps include: Collecting time domain signals from dual microphones and converting the time domain signals into frequency domain signals; the frequency domain signals include low frequency band signals and high frequency band signals; For the high frequency band signal, a plurality of differential beamformers with different zero points are preset, multiple amplitudes of the high frequency band frequency domain signal are calculated according to the plurality of differential beamformers, and the differential beamformer with the smallest amplitude is selected as the optimal differential beamformer; For the low-frequency band signal, a low-frequency band frequency domain signal is calculated by a beamformer with constrained white noise gain; The frequency domain signals calculated by the beamformer constraining white noise gain and the optimal differential beamformer are transformed to obtain directionally picked-up speech.
2. The directional sound pickup method based on a small-aperture dual-microphone array according to claim 1, characterized in that: The collecting time domain signals of the dual microphones and converting the time domain signals into frequency domain signals includes: The time domain signals collected by the dual microphones are subjected to short-time Fourier transform to obtain frequency domain signals; wherein the short-time Fourier transform includes using a window function.
3. The directional sound pickup method based on a small-aperture dual-microphone array according to claim 1, characterized in that: The beamformer constrained by white noise gain is specifically: minωH(f)Γ(f)ω(f) stwH(f)d(f,0)=1 Where Γ(f) is the spatial coherence moment of the diffuse noise model, which is calculated based on the microphone spacing, sound speed, and sampling frequency information; w(f) is the beamformer that constrains the white noise gain; ω H (f) represents the conjugate transpose of ω(f); WNG min (f) is the minimum white noise gain.
4. According to claim 1, the directional sound pickup method based on a small-aperture dual-microphone array is characterized in that: The preset plurality of different zero points are set within the interval of [90°, 180°].
5. According to claim 1, the directional sound pickup method based on a small-aperture dual-microphone array is characterized in that: For the high frequency band signal, a plurality of differential beamformers with different zero points are preset, specifically: Among them, w p (f) is the pth zero point α p Differential beamformer; d H (f, α p ) is d(f, α p ), d(f, α p ) indicates that the incident angle is α p The guiding vector.
6. The directional sound pickup method based on a small-aperture dual-microphone array according to claim 1, characterized in that: The step of transforming the frequency domain signal calculated by the beamformer of the constrained white noise gain and the optimal differential beamformer to obtain a directionally picked-up speech output includes: The frequency domain signals calculated by the constrained white noise gain beamformer and the optimal differential beamformer are subjected to inverse Fourier transformation to obtain time domain signals, and the time domain signals are overlap-added to obtain a directionally picked-up speech output.
7. A directional sound pickup system based on a small-aperture dual-microphone array, characterized in that: A directional sound pickup method based on a small-aperture dual-microphone array applied to any one of claims 1-6, comprising a signal collection module, a high-frequency band frequency domain signal calculation module, a low-frequency band frequency domain signal calculation module, and a directional voice pickup module; The signal acquisition module is used to acquire the time domain signals of the dual microphones and convert the time domain signals into frequency domain signals; the frequency domain signals include low frequency band signals and high frequency band signals; The module for calculating the high-frequency band frequency domain signal is used to preset a plurality of differential beamformers with different zero points for the high-frequency band signal, calculate a plurality of amplitudes of the high-frequency band frequency domain signal according to the plurality of differential beamformers, and select the differential beamformer with the smallest amplitude as the optimal differential beamformer; The module for calculating the low-frequency band frequency domain signal is used to calculate the low-frequency band frequency domain signal for the low-frequency band signal by using a beamformer with constrained white noise gain; The directional voice pickup module is used to transform the frequency domain signal calculated by the constrained white noise gain beamformer and the optimal differential beamformer to obtain directionally picked up voice.
8. The directional sound pickup system based on a small aperture dual microphone array according to claim 7, characterized in that: The signal acquisition module is specifically used for: The time domain signals collected by the dual microphones are subjected to short-time Fourier transform to obtain frequency domain signals; wherein the short-time Fourier transform includes using a window function.
9. An electronic device, characterized in that: The electronic device comprises: at least one processor; and, a memory communicatively connected to the at least one processor; wherein, The memory stores computer program instructions that can be executed by the at least one processor, and the computer program instructions are executed by the at least one processor so that the at least one processor can execute the directional sound pickup method based on a small-aperture dual-microphone array as described in any one of claims 1-6.
10. A computer-readable storage medium storing a program, characterized in that: When the program is executed by a processor, the directional sound pickup method based on a small-aperture dual-microphone array as described in any one of claims 1 to 6 is implemented.
Citation Information
Patent Citations
Double layer ring microphone array voice enhancement method
CN108447499A
Pickup method and device and electronic equipment
CN113393856A
Beam forming method, device and equipment
CN115515038A
Audio signal processing method, electronic equipment and readable storage medium
CN116668892A
A headset and a method for audio signal processing
EP2884763A1
Cited By
Robust beam forming method and device for microphone array, equipment and medium
CN119603606A
