Signal processing method, device, chip and module equipment

Abstract

The present application discloses a signal processing method, device, chip and module device, the method is applied to an electronic device, the electronic device includes a first sound pickup device and a second sound pickup device, the method includes: obtaining a first sound signal collected by the first sound pickup device and a second sound signal collected by the second sound pickup device; using N fixed beam formers to perform spatial filtering on the first sound signal and the second sound signal respectively to obtain N third sound signals, where N is an integer greater than 1; and determining a target sound signal based on the N third sound signals. Based on the method described in the present application, the anti-interference ability of the electronic device can be improved, and the performance of the beam can be improved.

Description

Technical Field

[0001] The present invention relates to the field of computers, and in particular to a signal processing method, device, chip and module equipment. Background Art

[0002] With the development of science and technology, people have higher and higher requirements for the quality of life, and voice communication and voice interaction through electronic products are becoming more and more common. When electronic devices are in a noisy environment, interference noise from different directions will affect the quality of the voice collected by the electronic devices.

[0003] Therefore, in complex scenarios, how to process the collected voice signals to improve the anti-interference ability of electronic equipment is an urgent problem to be solved. Summary of the invention

[0004] The present application provides a signal processing method, device, chip and module equipment, which can improve the anti-interference capability of electronic equipment and improve the performance of the beam.

[0005] In a first aspect, the present application provides a signal processing method, which is applied to an electronic device, the electronic device comprising a first sound pickup device and a second sound pickup device, the method comprising: acquiring a first sound signal collected by the first sound pickup device, and a second sound signal collected by the second sound pickup device; using N fixed beam formers to perform spatial filtering processing on the first sound signal and the second sound signal respectively to obtain N third sound signals, where N is an integer greater than 1; and determining a target sound signal based on the N third sound signals.

[0006] Based on the method described in the first aspect, interference signals from different directions are suppressed by using multiple fixed beamformers with different characteristics, which can improve the anti-interference capability of electronic equipment and improve the performance of the beam.

[0007] In a possible implementation, a target sound signal is determined based on N third sound signals, including: using a blocking matrix filter to perform spatial filtering on the first sound signal and the second sound signal to obtain an interference signal; based on the interference signal, performing coherent noise elimination on the N third sound signals to obtain N fourth sound signals; selecting a fourth sound signal from the N fourth sound signals; and performing incoherent noise elimination on the selected fourth sound signal to obtain a target sound signal. Based on this possible implementation, the anti-interference capability of electronic equipment can be improved.

[0008] In a possible implementation, selecting a fourth sound signal from N fourth sound signals includes: determining a signal-to-noise ratio of each of the N fourth sound signals; and selecting a fourth sound signal with a maximum signal-to-noise ratio from the N fourth sound signals.

[0009] In a possible implementation, selecting a fourth sound signal from N fourth sound signals includes: determining the energy of each fourth sound signal in the N fourth sound signals; and selecting a fourth sound signal with the smallest energy from the N fourth sound signals.

[0010] In a possible implementation, selecting a fourth sound signal from N fourth sound signals includes: determining a direction of arrival of the interference signal, the direction of arrival being used to indicate a location direction of an interference signal source; and selecting a fourth sound signal from the N fourth sound signals based on the direction of arrival.

[0011] In a possible implementation, the N fixed beamformers include a fixed beamformer with a 90-degree directional null-steering constraint, a fixed beamformer with a 120-degree directional null-steering constraint, and a fixed beamformer with a 180-degree directional null-steering constraint.

[0012] In a second aspect, the present application provides a signal processing device, which includes: an acquisition unit, used to acquire a first sound signal collected by a first sound pickup device, and a second sound signal collected by a second sound pickup device; a processing unit, used to use N fixed beam formers to perform spatial filtering processing on the first sound signal and the second sound signal respectively, to obtain N third sound signals, where N is an integer greater than 1; and a determination unit, used to determine a target sound signal based on the N third sound signals.

[0013] In a third aspect, the present application provides a chip, comprising a processor and a communication interface, wherein the processor is configured to implement the method in the first aspect or any possible implementation thereof.

[0014] In a fourth aspect, the present application provides a module device, which includes a communication module, a power module, a storage module, a first sound pickup device module, a second sound pickup device module and a chip, wherein: the power module is used to provide power to the module device; the storage module is used to store data and instructions; the communication module is used to perform internal communication within the module device, or for the module device to communicate with an external device; the first sound pickup device module is used to collect a first sound signal; the second sound pickup device module is used to collect a second sound signal; and the chip is used to execute the method in the above-mentioned first aspect or any possible implementation thereof.

[0015] In a fifth aspect, the present application provides a computer-readable storage medium, which stores computer-readable instructions. When the computer-readable instructions are executed on a communication device, the communication device executes the method in the above-mentioned first aspect or any possible implementation thereof.

[0016] In a sixth aspect, the present application provides a computer program or a computer program product, comprising codes or instructions, which, when executed on a computer, enable the computer to execute the method in the first aspect or any possible implementation thereof. BRIEF DESCRIPTION OF THE DRAWINGS

[0017] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0018] Figure 1 An electronic device equipped with dual microphones provided in an embodiment of the present application;

[0019] Figure 2 is a flowchart of a signal processing method provided in an embodiment of the present application;

[0020] Figure 3a It is a fixed beam pattern with a 90-degree directional null-steering constraint provided in an embodiment of the present application;

[0021] Figure 3b It is a fixed beam pattern with a 120-degree directional null-steering constraint provided in an embodiment of the present application;

[0022] Figure 3c It is a fixed beam pattern with a 180-degree directional null-steering constraint provided in an embodiment of the present application;

[0023] Figure 4 It is a 0-degree blocking notch beam pattern provided in an embodiment of the present application;

[0024] Figure 5 is a flowchart of another signal processing method provided in an embodiment of the present application;

[0025] Figure 6 is a structural schematic diagram of a signal processing device provided in an embodiment of the present application;

[0026] Figure 7 is a structural schematic diagram of another signal processing device provided in an embodiment of the present application;

[0027] Figure 8 It is a structural schematic diagram of a module device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0028] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0029] The terms used in the following embodiments of the present application are only for the purpose of describing specific embodiments, and are not intended to be used as limitations to the present application. As used in the specification and appended claims of the present application, the singular expressions "one", "a kind of", "said", "above", "the" and "this" are intended to also include plural expressions, unless there is a clear indication to the contrary in the context. It should also be understood that the term "and / or" used in the present application refers to and includes any or all possible combinations of one or more listed items.

[0030] It should be noted that the terms "first", "second", "third", etc. in the specification and claims of the present application and in the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchangeable where appropriate, so that the embodiments of the present application described herein can be implemented in an order other than that illustrated or described herein. In addition, the term "comprising" and any variations thereof are intended to cover non-exclusive inclusions, for example, a process, method, system, product, or server that includes a series of steps or units is not necessarily limited to those steps or units that are clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products, or devices.

[0031] The solution provided in the embodiments of the present application is applied to electronic devices, which may be devices supporting microphone array technology, such as headphones equipped with dual microphones, mobile phones, tablet computers, computers with wireless transceiver functions, etc. Figure 1 As shown, Figure 1 An electronic device equipped with dual microphones is provided in an embodiment of the present application. The electronic device is a headset equipped with dual microphones, including a first sound pickup device and a second sound pickup device, and the first sound pickup device and the second sound pickup device are both microphones. It should be noted that the setting positions of the first sound pickup device and the second sound pickup device are not limited here.

[0032] In addition, the electronic device may also include a device that provides voice and / or data connectivity to the user, for example, the electronic device is a device with wireless transceiver function, which can be deployed on land, including indoors or outdoors, handheld, wearable or vehicle-mounted; it can also be deployed on the water surface (such as ships, etc.); it can also be deployed in the air (such as airplanes, balloons and satellites, etc.). The electronic device can also be a virtual reality (VR) electronic device, an augmented reality (AR) electronic device, a wireless terminal in industrial control, a vehicle-mounted electronic device, a wireless terminal in self-driving, a wireless terminal in remote medical, a wireless terminal in smart grid, a wireless terminal in transportation safety, a wireless terminal in smart city, a wireless terminal in smart home, a wearable electronic device, etc. The embodiments of the present application do not limit the application scenario. The electronic device may also be referred to as user equipment (UE), access electronic device, vehicle-mounted terminal, industrial control terminal, UE unit, UE station, mobile station, mobile station, remote station, remote electronic device, mobile device, UE electronic device, wireless communication device, UE agent or UE device, etc. The electronic device may also be fixed or mobile. In the embodiments of the present application, the device for realizing the function of the electronic device may be an electronic device, or a device capable of supporting the electronic device to realize the function, such as a chip system or a combination device or component capable of realizing the function of the electronic device, and the device may be installed in the electronic device.

[0033] In order to facilitate understanding of the solution provided by the embodiment of the present application, the microphone array technology is introduced below:

[0034] A microphone array is a system composed of a certain number of microphones that samples and filters the spatial characteristics of the sound field. The output of the differential microphone array is the weighted subtraction between the two microphones. The optimal beam direction can only be in the end direction, which is suitable for headset calls and other occasions. Differential microphones usually appear in the form of an array, and at least two or more microphones are required to form a differential array. Differential microphone arrays can be used to suppress noise. Take a mobile phone as an example: the mobile phone is equipped with a noise reduction microphone and a main microphone. The main microphone records large-dynamic human voices and environmental sounds, and the noise reduction microphone records small-dynamic human voices and environmental sounds. The sound recorded by the noise reduction microphone is used as a noise sample, and the sound elements in the main microphone that are the same as the noise sample are eliminated, thereby achieving noise suppression.

[0035] Based on the above description, in order to improve the anti-interference capability of electronic equipment and improve the performance of beams, the present application provides a signal processing method, device, chip and module device. The signal processing method, device, chip and module device provided in the embodiments of the present application are further described in detail below.

[0036] Figure 2 is a flow chart of a signal processing method provided by an embodiment of the present application. Figure 2 As shown, the signal processing method includes the following steps 201 to 203. Figure 2 The method shown may be performed by an electronic device. Figure 2 The method execution entity shown may be a chip in an electronic device. Figure 2 The method is described by taking an electronic device as an example of an execution subject.

[0037] 201. An electronic device obtains a first sound signal collected by a first sound pickup device and a second sound signal collected by a second sound pickup device.

[0038] In an embodiment of the present application, the electronic device includes a first sound pickup device and a second sound pickup device. The first sound pickup device or the second sound pickup device can be a microphone or other device for collecting sound, which is not limited here. Among them, the first sound pickup device and the second sound pickup device can constitute a differential microphone array. When the electronic device enters a call mode or a voice interaction mode, the first sound pickup device and the second sound pickup device are used to simultaneously collect sounds in the surrounding environment, thereby obtaining a first sound signal collected by the first sound pickup device and a second sound signal collected by the second sound pickup device.

[0039] 202. The electronic device uses N fixed beam formers to perform spatial filtering processing on the first sound signal and the second sound signal respectively to obtain N third sound signals, where N is an integer greater than 1.

[0040] In the embodiment of the present application, since the direction from which the interference noise comes changes at any time in a complex environment, it is necessary to suppress interference signals from different directions through fixed beam formers with different characteristics. The so-called fixed beam former is used to form the input signal into a fixed beam. During the beamforming process, the filter weights are fixed. Once the geometry and target direction of the microphone array are determined, its beam pattern characteristics will also be determined. The advantage of beamforming is that spatial information can be used for spatial filtering, that is, multi-channel microphone signals are combined and processed (for example, weighted subtraction of multiple sound signals), interference signals from non-target directions are suppressed, and sound signals from the target direction are enhanced. The specific principle of fixed beamforming is: adjust the basic unit parameters of the phase array so that the signal in the desired direction obtains constructive interference, while the signals in other directions obtain destructive interference; weighted summation or weighted subtraction and filtering of the output signals of each array element, and finally output the speech signal in the desired direction, which is equivalent to forming a "beam". Among them, the third sound signal can be understood as the desired sound signal. Therefore, by using fixed beamformers with different characteristics to perform spatial filtering on the first sound signal and the second sound signal respectively, interference signals from different directions can be suppressed, thereby improving the anti-interference ability of electronic equipment and further improving the performance of the beam.

[0041] In one possible implementation, the N fixed beamformers include a fixed beamformer with a 90-degree null-stuck constraint, a fixed beamformer with a 120-degree null-stuck constraint, and a fixed beamformer with a 180-degree null-stuck constraint. It should be noted that, assuming that the direction of the desired sound signal is 0 degrees, through a large number of experimental tests, there are usually more interference signals from the 90-degree direction, the 120-degree direction, and the 180-degree direction. Therefore, a fixed beamformer with a 90-degree null-stuck constraint, a fixed beamformer with a 120-degree null-stuck constraint, and a fixed beamformer with a 180-degree null-stuck constraint can be used to implement spatial filtering of the first sound signal and the second sound signal, which can further enhance the anti-interference capability of the electronic device and achieve the maximum signal-to-noise ratio improvement.

[0042] like Figure 3a As shown, Figure 3a This is a fixed beam pattern with a 90-degree null-steering constraint provided in an embodiment of the present application. The gain in the range of 0°±30° is 0 dB, and there are different degrees of attenuation in other directions, with the largest attenuation in the 90-degree direction. Therefore, a fixed beam former with a 90-degree null-steering constraint can completely suppress interference signals from the 90-degree direction.

[0043] like Figure 3b As shown, Figure 3bThis is a fixed beam pattern with a 120-degree null-steering constraint provided in an embodiment of the present application. The gain in the range of 0°±30° is 0 dB, and there are different degrees of attenuation in other directions, with the attenuation in the 120-degree direction being the largest. Therefore, a fixed beam former with a 120-degree null-steering constraint can completely suppress interference signals from the 120-degree direction.

[0044] like Figure 3c As shown, Figure 3c This is a fixed beam pattern with a 180-degree null-steering constraint provided in an embodiment of the present application. The gain in the range of 0°±30° is 0 dB, and there are different degrees of attenuation in other directions, with the attenuation in the 180-degree direction being the largest. Therefore, a fixed beam former with a 180-degree null-steering constraint can completely suppress interference signals from the 180-degree direction.

[0045] Exemplarily, the electronic device is configured with three fixed beamformers, namely, a fixed beamformer with a 90-degree directional null-steering constraint, a fixed beamformer with a 120-degree directional null-steering constraint, and a fixed beamformer with a 180-degree directional null-steering constraint. The fixed beamformer with a 90-degree directional null-steering constraint performs weighted subtraction on the first sound signal and the second sound signal, and then outputs a third sound signal based on the characteristics of the 90-degree directional null-steering constraint; the fixed beamformer with a 120-degree directional null-steering constraint performs weighted subtraction on the first sound signal and the second sound signal, and then outputs a third sound signal based on the characteristics of the 120-degree directional null-steering constraint; the fixed beamformer with a 180-degree directional null-steering constraint performs weighted subtraction on the first sound signal and the second sound signal, and then outputs a third sound signal based on the characteristics of the 180-degree directional null-steering constraint. Therefore, after spatial filtering the first sound signal and the second sound signal using three fixed beamformers, three third sound signals are obtained.

[0046] 203. The electronic device determines a target sound signal based on the N third sound signals.

[0047] In the embodiment of the present application, the electronic device further processes the N third sound signals to obtain a final output sound signal, namely, a target sound signal. The target sound signal suppresses noise and achieves an anti-interference effect.

[0048] In one possible implementation, an electronic device determines a target sound signal based on N third sound signals, including: performing spatial filtering processing on a first sound signal and a second sound signal using a blocking matrix filter to obtain an interference signal; performing coherent noise elimination on the N third sound signals based on the interference signal to obtain N fourth sound signals; selecting a fourth sound signal from the N fourth sound signals; and performing incoherent noise elimination on the selected fourth sound signal to obtain a target sound signal.

[0049] It should be noted that the blocking matrix filter is used to suppress the sound signal in the desired direction, enhance the sound signals in other directions, and finally output the interference signal. Assuming that the direction of the desired sound signal is 0 degrees, a differential filter with a zero-pitched constraint in the 0-degree direction can be used as the blocking matrix filter. Figure 4 As shown, Figure 4 This is the 0-degree blocking notch beam pattern provided in the embodiment of the present application. Among them, the gain in the range of 180°±30° is 0dB, and there are different degrees of attenuation in other directions, and the attenuation in the 0-degree direction is the largest. Therefore, the blocking matrix filter with the 0-degree direction null notch constraint can completely suppress the sound signal in the desired direction, thereby obtaining an interference signal.

[0050] Furthermore, the N third sound signals are N desired sound signals obtained using N fixed beamformers, and the interference signals can be used to perform coherent noise elimination on the N third sound signals respectively. The so-called coherent noise elimination is used to eliminate the sound signal that is associated with the interference signal in the desired sound signal. Under ideal conditions, the processed N third sound signals should be clean desired sound signals, but in real scenarios, the processed N third sound signals may still have coherent noise, so it is necessary to perform coherent noise elimination on the N third sound signals.

[0051] Coherent noise elimination can be achieved by using an adaptive filtering algorithm. The specific principle of the adaptive filter is: the input signal generates an output signal after passing through a parameter-adjustable digital filter, which is compared with the expected signal to form an error signal. The filter parameters are adjusted by an adaptive algorithm to ultimately minimize the mean square value of the error signal. Among them, the adaptive filter can be a minimum mean square error (Least Mean Square, LMS) filter, a normalized minimum mean square error (Normalized Least Mean Square, NLMS) filter, an affine projection (Affine Projection Algorithm, APA) filter, a recursive least squares (Recursive Least Squares, RLS) filter, a Kalman filter, etc. Specifically, formula (1) can be used to achieve coherent noise elimination:

[0052] Y D (k) = F out (k)-W(k)·B out (k) (1)

[0053] Among them, F out (k) is the third sound signal, B out (k) is the interference signal, W(k) is the adaptive filter, and k is the kth frequency point.

[0054] Further, a fourth sound signal is selected from the N fourth sound signals. The specific selection method may be to select the fourth sound signal with the largest signal-to-noise ratio, or to select the fourth sound signal with the smallest energy based on an energy minimization algorithm, or to select the fourth sound signal based on the direction of arrival, which is not limited here. A specific implementation method of selecting a fourth sound signal from the N fourth sound signals will be described later, which will not be elaborated here.

[0055] Finally, since the fourth sound signal is obtained by eliminating the coherent noise of the third sound signal, the selected fourth sound signal may still contain a large amount of incoherent noise, so it is necessary to further perform incoherent noise elimination on the selected fourth sound signal to reduce the impact on the selected fourth sound signal. The so-called incoherent noise elimination is used to eliminate the sound signal that is not associated with the interference signal in the desired sound signal. Specifically, the signal at the end of the coherent noise suppression can be suppressed by a single-channel noise reduction algorithm to suppress the stationary noise. When performing incoherent noise elimination, it is necessary to determine the probability of speech in the selected fourth sound signal and adjust the noise estimate to ensure that the speech is not distorted. Exemplarily, if the probability of speech is greater than or equal to the preset threshold, it indicates that the probability of speech in the selected fourth sound signal is large, and the noise estimate can be weakened; if the probability of speech is less than the preset threshold, it indicates that the probability of speech in the selected fourth sound signal is small, and the noise estimate can be increased.

[0056] Optionally, the electronic device selects a fourth sound signal from N fourth sound signals, including: determining the signal-to-noise ratio of each fourth sound signal in the N fourth sound signals; and selecting the fourth sound signal with the largest signal-to-noise ratio from the N fourth sound signals. It should be understood that the signal-to-noise ratio refers to the ratio of a signal to noise in an electronic device or electronic system, and the larger the signal-to-noise ratio, the smaller the interference noise and the higher the signal quality. Therefore, the fourth sound signal with the largest signal-to-noise ratio is selected from the N fourth sound signals.

[0057] Exemplarily, the electronic device obtains three fourth sound signals, namely, fourth sound signal A, fourth sound signal B, and fourth sound signal C. The signal-to-noise ratio of the fourth sound signal A is 110 dB, the signal-to-noise ratio of the fourth sound signal B is 120 dB, and the signal-to-noise ratio of the fourth sound signal C is 130 dB. Therefore, the fourth sound signal C will be selected from the three fourth sound signals.

[0058] Optionally, the electronic device selects a fourth sound signal from N fourth sound signals, including: determining the energy of each fourth sound signal in the N fourth sound signals; and selecting the fourth sound signal with the smallest energy from the N fourth sound signals. It should be understood that the lower the energy of the fourth sound signal, the more stable the sound signal, which proves that the noise suppression effect is better and the performance of the sound signal is better.

[0059] Exemplarily, the electronic device obtains three fourth sound signals, namely, fourth sound signal A, fourth sound signal B, and fourth sound signal C. The energy of fourth sound signal A is 60 J / Hz, the energy of fourth sound signal B is 55 J / Hz, and the energy of fourth sound signal C is 50 J / Hz. Therefore, the fourth sound signal C will be selected from the three fourth sound signals.

[0060] Optionally, the electronic device selects a fourth sound signal from N fourth sound signals, including: determining the wave direction of the interference signal, the wave direction is used to indicate the position direction of the interference source; and selecting a fourth sound signal from the N fourth sound signals based on the wave direction. It should be understood that the wave direction refers to the direction of arrival of the spatial signal, and the spatial position and orientation information of the source can be accurately obtained through the sound signal received by the microphone array. Therefore, the wave direction estimation technology can be used to determine the position direction of the interference source corresponding to the interference signal, that is, the direction from which the interference signal comes. After obtaining the direction from which the interference signal comes, a fixed beamformer that performs interference suppression in the direction of the interference signal can be determined from the N fixed beamformers, and the fourth sound signal corresponding to the determined beamformer is selected from the N fourth sound signals. It should be noted that the determined fixed beamformer can be a fixed beamformer that performs interference suppression within a preset directional error range.

[0061] Exemplarily, the arrival direction of the interference signal is 175 degrees, and the preset direction error range is "arrival direction ±10 degrees", that is, "165 degrees to 185 degrees". Fixed beamformer 1 performs interference suppression in the direction of 90 degrees, fixed beamformer 2 performs interference suppression in the direction of 120 degrees, and fixed beamformer 3 performs interference suppression in the direction of 180 degrees. Therefore, the fixed beamformer that performs interference suppression within the preset direction error range is determined to be fixed beamformer 3 from the three fixed beamformers, and then the fourth sound signal obtained after processing by fixed beamformer 3 and coherent noise elimination is selected from the three fourth sound signals.

[0062] Optionally, the electronic device selects a fourth sound signal from N fourth sound signals, including: determining the signal-to-noise ratio of each fourth sound signal in the N fourth sound signals, and the energy of each fourth sound signal; determining the direction of arrival of the interference signal; determining the weight value of each fourth sound signal based on the signal-to-noise ratio of each fourth sound signal, the energy of each fourth sound signal, and the direction of arrival of the interference signal; and selecting the fourth sound signal with the smallest weight value from the N fourth sound signals. It should be understood that selecting a fourth sound signal from the N fourth sound signals in combination with the signal-to-noise ratio of each fourth sound signal, the energy of each fourth sound signal, and the direction of arrival of the interference signal further improves the noise suppression effect.

[0063] Exemplarily, the electronic device obtains three fourth sound signals, namely, a fourth sound signal A, a fourth sound signal B, and a fourth sound signal C. The signal-to-noise ratio of the fourth sound signal A is 110 dB, the signal-to-noise ratio of the fourth sound signal B is 120 dB, and the signal-to-noise ratio of the fourth sound signal C is 130 dB. According to the signal-to-noise ratios of the three fourth sound signals, the first weight value of the fourth sound signal A is determined to be 0.2, the first weight value of the fourth sound signal B is determined to be 0.3, and the first weight value of the fourth sound signal C is determined to be 0.5.

[0064] The energy of the fourth sound signal A is 60 J / Hz, the energy of the fourth sound signal B is 55 J / Hz, and the energy of the fourth sound signal C is 50 J / Hz. According to the energy of the three fourth sound signals, the second weight value of the fourth sound signal A is determined to be 0.2, the second weight value of the fourth sound signal B is 0.2, and the second weight value of the fourth sound signal C is 0.6.

[0065] The arrival direction of the interference signal is 175 degrees, fixed beamformer 1 performs interference suppression in the direction of 90 degrees, fixed beamformer 2 performs interference suppression in the direction of 120 degrees, and fixed beamformer 3 performs interference suppression in the direction of 180 degrees. After processing by fixed beamformer 1 and eliminating coherent noise, the fourth sound signal A is obtained, after processing by fixed beamformer 2 and eliminating coherent noise, the fourth sound signal B is obtained, and after processing by fixed beamformer 3 and eliminating coherent noise, the fourth sound signal C is obtained. According to the arrival direction and the direction in which the three fixed beamformers suppress interference, the third weight value of the fourth sound signal A is determined to be 0.1, the third weight value of the fourth sound signal B is determined to be 0.2, and the third weight value of the fourth sound signal C is determined to be 0.7.

[0066] The final weight value of each fourth sound signal is determined by combining the first weight value, the second weight value, and the third weight value corresponding to each fourth sound signal: the final weight value of the fourth sound signal A is 0.5, the final weight value of the fourth sound signal B is 0.7, and the final weight value of the fourth sound signal C is 1.8. Therefore, the final weight value of the fourth sound signal C is the largest, and the fourth sound signal C is selected from the three fourth sound signals.

[0067] In general, the signal processing method provided in the embodiment of the present application can be summarized as the following signal processing flow: Figure 5 As shown. Take the electronic device equipped with three fixed beamformers as an example, the input signal is the first sound signal collected by the first sound pickup device and the second sound signal collected by the second sound pickup device, and the three fixed beamformers (i.e., fixed beamformer 1, fixed beamformer 2, and fixed beamformer 3) are used to perform spatial filtering processing on the first sound signal and the second sound signal respectively to obtain three third sound signals; the first sound signal and the second sound signal are spatially filtered using a blocking matrix filter to obtain an interference signal; the three third sound signals are respectively filtered based on the interference signal to obtain three fourth sound signals; a fourth sound signal is selected from the three fourth sound signals using a channel selection module, and then the selected fourth sound signal is subjected to incoherent noise elimination to obtain a target sound signal, i.e., an output signal.

[0068] It can be seen that based on Figure 2 In the described method, the electronic device obtains a first sound signal collected by a first sound pickup device and a second sound signal collected by a second sound pickup device, and then uses N fixed beam formers to perform spatial filtering on the first sound signal and the second sound signal respectively to obtain N third sound signals, where N is an integer greater than 1, and further determines the target sound signal based on the N third sound signals. It should be understood that suppressing interference signals from different directions by using multiple fixed beam formers with different characteristics can greatly improve the anti-interference ability of the electronic device and improve the performance of the beam.

[0069] See also Figure 6 , Figure 6 is a schematic diagram of the structure of a signal processing device provided by an embodiment of the present invention. The signal processing device may be a terminal device or a device (such as a chip) having the function of a terminal device. Figure 6 As shown, the signal processing device 600 may include:

[0070] An acquisition unit 601 is used to acquire a first sound signal collected by a first sound pickup device and a second sound signal collected by a second sound pickup device;

[0071] The processing unit 602 is configured to use N fixed beam formers to perform spatial filtering processing on the first sound signal and the second sound signal respectively to obtain N third sound signals, where N is an integer greater than 1;

[0072] The determining unit 603 is configured to determine a target sound signal based on the N third sound signals.

[0073] In one possible implementation, the determination unit 603, when determining the target sound signal based on N third sound signals, is specifically used to: perform spatial filtering processing on the first sound signal and the second sound signal using a blocking matrix filter to obtain an interference signal; perform coherent noise elimination on the N third sound signals based on the interference signal to obtain N fourth sound signals; select a fourth sound signal from the N fourth sound signals; and perform incoherent noise elimination on the selected fourth sound signal to obtain a target sound signal.

[0074] In a possible implementation, when selecting a fourth sound signal from N fourth sound signals, the determination unit 603 is specifically configured to: determine the signal-to-noise ratio of each fourth sound signal in the N fourth sound signals; and select the fourth sound signal with the largest signal-to-noise ratio from the N fourth sound signals.

[0075] In a possible implementation, when selecting a fourth sound signal from N fourth sound signals, the determination unit 603 is specifically configured to: determine the energy of each fourth sound signal in the N fourth sound signals; and select the fourth sound signal with the smallest energy from the N fourth sound signals.

[0076] In a possible implementation, the determination unit 603, when selecting a fourth sound signal from N fourth sound signals, is specifically used to: determine the direction of arrival of the interference signal, where the direction of arrival is used to indicate the location direction of the interference source; and select a fourth sound signal from the N fourth sound signals based on the direction of arrival.

[0077] In a possible implementation, the N fixed beamformers include a fixed beamformer with a 90-degree directional null-steering constraint, a fixed beamformer with a 120-degree directional null-steering constraint, and a fixed beamformer with a 180-degree directional null-steering constraint.

[0078] The present application also provides a chip that can execute the relevant steps of the electronic device in the above method embodiment. The chip includes a processor and a communication interface, and the processor is configured to enable the chip to perform the following operations:

[0079] A first sound signal collected by a first sound pickup device and a second sound signal collected by a second sound pickup device are obtained; N fixed beam formers are used to perform spatial filtering on the first sound signal and the second sound signal respectively to obtain N third sound signals, where N is an integer greater than 1; and a target sound signal is determined based on the N third sound signals.

[0080] In one possible implementation, when determining a target sound signal based on N third sound signals, the processor is configured to cause the chip to perform the following operations: performing spatial filtering on the first sound signal and the second sound signal using a blocking matrix filter to obtain an interference signal; performing coherent noise elimination on the N third sound signals based on the interference signal to obtain N fourth sound signals; selecting a fourth sound signal from the N fourth sound signals; and performing incoherent noise elimination on the selected fourth sound signal to obtain a target sound signal.

[0081] In a possible implementation, when selecting a fourth sound signal from N fourth sound signals, the processor is configured to cause the chip to perform the following operations: determining the signal-to-noise ratio of each fourth sound signal among the N fourth sound signals; and selecting the fourth sound signal with the largest signal-to-noise ratio from the N fourth sound signals.

[0082] In one possible implementation, when selecting a fourth sound signal from N fourth sound signals, the processor is configured to cause the chip to perform the following operations: determine the energy of each fourth sound signal among the N fourth sound signals; and select the fourth sound signal with the smallest energy from the N fourth sound signals.

[0083] In one possible implementation, when selecting a fourth sound signal from N fourth sound signals, the processor is configured to cause the chip to perform the following operations: determining the arrival direction of the interference signal, the arrival direction being used to indicate the location direction of the interference source; and selecting a fourth sound signal from the N fourth sound signals based on the arrival direction.

[0084] In a possible implementation, the N fixed beamformers include a fixed beamformer with a 90-degree directional null-steering constraint, a fixed beamformer with a 120-degree directional null-steering constraint, and a fixed beamformer with a 180-degree directional null-steering constraint.

[0085] In one possible implementation, the chip includes at least one processor, at least one first memory and at least one second memory; wherein the at least one first memory and the at least one processor are interconnected via lines, and instructions are stored in the first memory; the at least one second memory and the at least one processor are interconnected via lines, and the second memory stores data that needs to be stored in the method embodiment.

[0086] For each device or product applied to or integrated in the chip, each module contained therein can be implemented in the form of hardware such as circuits, or at least some of the modules can be implemented in the form of software programs, which run on a processor integrated inside the chip, and the remaining (if any) modules can be implemented in the form of hardware such as circuits.

[0087] See also Figure 7 , Figure 7 700 is a schematic diagram of a signal processing device provided by an embodiment of the present invention. The signal processing device 700 may include a memory 701, a processor 702, a first sound pickup device 704, and a second sound pickup device 705. Optionally, it also includes a communication interface 703. The memory 701, the processor 702, the first sound pickup device 704, the second sound pickup device 705, and the communication interface 703 are connected via one or more communication buses. The communication interface 703 is controlled by the processor 702 to send and receive information.

[0088] The memory 701 may include a read-only memory and a random access memory, and provides instructions and data to the processor 702. A portion of the memory 701 may also include a nonvolatile random access memory.

[0089] The communication interface 703 is used to receive or send data.

[0090] The processor 702 may be a central processing unit (CPU), or other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), field-programmable gate arrays (FPGA), or other programmable logic devices, discrete gates or transistor logic devices, discrete hardware components, etc. A general-purpose processor may be a microprocessor, and optionally, the processor 702 may also be any conventional processor, etc. Among them:

[0091] The memory 701 is used to store program instructions.

[0092] The processor 702 is used to call the program instructions stored in the memory 701.

[0093] The first sound pickup device 704 is used to collect a first sound signal.

[0094] The second sound pickup device 705 is used to collect the second sound signal.

[0095] The processor 702 calls the program instructions stored in the memory 701 to enable the signal processing device 700 to execute the method executed by the terminal device or the network device in the above method embodiment.

[0096] like Figure 8 As shown, Figure 8 800 can execute the relevant steps of the terminal device or network device in the aforementioned method embodiment, and the module device 800 includes: a communication module 801, a power module 802, a storage module 803, a chip 804, a first sound pickup device module 805 and a second sound pickup device module 806.

[0097] Among them, the power module 802 is used to provide power to the module device; the storage module 803 is used to store data and instructions; the communication module 801 is used for internal communication of the module device, or for the module device to communicate with external devices; the chip 804 is used to execute the method executed by the terminal device or the network device in the above method embodiment; the first sound pickup device module 805 is used to collect the first sound signal; the second sound pickup device module 806 is used to collect the first sound signal.

[0098] It should be noted that Figure 7 and Figure 8 The contents not mentioned in the corresponding embodiments and the specific implementation methods of each step can be found in Figure 2 The illustrated embodiments and the aforementioned contents will not be described in detail here.

[0099] An embodiment of the present application also provides a computer-readable storage medium, in which instructions are stored. When the computer-readable storage medium is executed on a processor, the method flow of the above method embodiment is implemented.

[0100] The embodiment of the present application also provides a computer program product. When the computer program product runs on a processor, the method flow of the above method embodiment is implemented.

[0101] Regarding the various modules / units included in the various devices and products described in the above embodiments, they can be software modules / units, or hardware modules / units, or they can be partially software modules / units and partially hardware modules / units. For example, for various devices and products applied to or integrated in a chip, the various modules / units included therein can all be implemented in the form of hardware such as circuits, or at least some of the modules / units can be implemented in the form of software programs, which run on the integrated processor inside the chip, and the remaining (if any) modules / units can be implemented in the form of hardware such as circuits; for various devices and products applied to or integrated in a chip module, the various modules / units included therein can all be implemented in the form of hardware such as circuits, and different modules / units can be located in the same part of the chip module (such as a chip, circuit module, etc.) or in different components, or at least some of the modules / units can be implemented in the form of software programs. The software programs run on the integrated processor inside the chip, and the remaining (if any) modules / units can be implemented in the form of hardware such as circuits. It can be implemented in the form of a software program, which runs on a processor integrated inside the chip module, and the remaining (if any) modules / units can be implemented in the form of hardware such as circuits; for various devices and products applied to or integrated in the terminal, the modules / units contained therein can all be implemented in the form of hardware such as circuits, and different modules / units can be located in the same component (for example, chip, circuit module, etc.) or in different components in the terminal, or, at least some modules / units can be implemented in the form of a software program, which runs on a processor integrated inside the terminal, and the remaining (if any) modules / units can be implemented in the form of hardware such as circuits.

[0102] It should be noted that, for the aforementioned method embodiments, for the sake of simplicity, they are all expressed as a series of action combinations, but those skilled in the art should be aware that the present application is not limited by the described order of actions, because according to the present application, certain operations can be performed in other orders or simultaneously. Secondly, those skilled in the art should also be aware that the embodiments described in the specification are all preferred embodiments, and the actions and modules involved are not necessarily required by the present application.

[0103] The descriptions of the various embodiments provided in this application can refer to each other, and the descriptions of the various embodiments have different focuses. For parts that are not described in detail in a certain embodiment, refer to the relevant descriptions of other embodiments. For the convenience and simplicity of description, for example, the functions of the various devices and equipment provided in the embodiments of this application and the operations performed can refer to the relevant descriptions of the method embodiments of this application, and the various method embodiments and the various device embodiments can also refer to, combine or quote each other.

[0104] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit it. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or replace some or all of the technical features therein with equivalents. However, these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of the present application.

Claims

1. A signal processing method, characterized in that: The method is applied to an electronic device, the electronic device comprising a first sound pickup device and a second sound pickup device, and the method comprises: Acquire a first sound signal collected by the first sound pickup device and a second sound signal collected by the second sound pickup device; Using N fixed beamformers to perform spatial filtering processing on the first sound signal and the second sound signal respectively to obtain N third sound signals, where N is an integer greater than 1; Using a blocking matrix filter to perform spatial filtering on the first sound signal and the second sound signal to obtain an interference signal; performing coherent noise elimination on the N third sound signals based on the interference signal to obtain N fourth sound signals; Selecting a fourth sound signal from the N fourth sound signals; The incoherent noise is eliminated from the selected fourth sound signal to obtain a target sound signal.

2. The method according to claim 1, characterized in that The selecting a fourth sound signal from the N fourth sound signals comprises: Determining a signal-to-noise ratio of each of the N fourth sound signals; A fourth sound signal with the largest signal-to-noise ratio is selected from the N fourth sound signals.

3. The method according to claim 1, characterized in that The selecting a fourth sound signal from the N fourth sound signals comprises: Determining the energy of each fourth sound signal among the N fourth sound signals; A fourth sound signal with the smallest energy is selected from the N fourth sound signals.

4. The method according to claim 1, characterized in that: The selecting a fourth sound signal from the N fourth sound signals comprises: Determine a direction of arrival of the interference signal, where the direction of arrival is used to indicate a location direction of an interference signal source; A fourth sound signal is selected from the N fourth sound signals based on the direction of arrival.

5. The method according to any one of claims 1 to 4, characterized in that: The N fixed beamformers include a fixed beamformer with a 90-degree directional null-steering constraint, a fixed beamformer with a 120-degree directional null-steering constraint, and a fixed beamformer with a 180-degree directional null-steering constraint.

6. A signal processing device, characterized in that: The device comprises: An acquisition unit, used to acquire a first sound signal collected by the first sound pickup device and a second sound signal collected by the second sound pickup device; a processing unit, configured to use N fixed beamformers to perform spatial filtering processing on the first sound signal and the second sound signal respectively, to obtain N third sound signals, where N is an integer greater than 1; a determining unit, configured to perform spatial filtering processing on the first sound signal and the second sound signal using a blocking matrix filter to obtain an interference signal; The determining unit is further configured to perform coherent noise elimination on the N third sound signals based on the interference signal to obtain N fourth sound signals; The determining unit is further configured to select a fourth sound signal from the N fourth sound signals; The determining unit is further configured to perform incoherent noise elimination on the selected fourth sound signal to obtain a target sound signal.

7. A chip, characterized in that: The chip comprises a processor and a communication interface, wherein the processor is configured to cause the chip to execute the method according to any one of claims 1 to 5.

8. A module device, characterized in that: The module device includes a communication module, a power module, a storage module, a first sound pickup device module, a second sound pickup device module and a chip, wherein: The power module is used to provide electrical energy to the module device; The storage module is used to store data and instructions; The communication module is used for internal communication of the module device, or for communication between the module device and an external device; The first sound pickup device module is used to collect a first sound signal; The second sound pickup device module is used to collect a second sound signal; The chip is used to execute the method according to any one of claims 1 to 5.

9. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores computer-readable instructions, and when the computer-readable instructions are executed on a communication device, the communication device executes the method according to any one of claims 1 to 5.

Images