Audio processing method, electronic device, storage medium and program product

Abstract

The invention discloses an audio processing method, electronic equipment, a storage medium and a program product. The method comprises the steps that a left sound channel output signal and a right sound channel output signal are acquired, the left sound channel output signal is obtained by processing sound signals collected by a plurality of microphones through a first filter, the right sound channel output signal is obtained by processing the sound signals through a second filter, and the first filter is used for filtering the sound signals collected by the plurality of microphones. And the first filter and the second filter adopt different reference points to construct steering vectors. According to the method, high-quality stereo output can be realized.

Description

TECHNICAL FIELD

[0001] The present disclosure relates to the technical field of communication, and particularly relates to an audio processing method, an electronic device, a storage medium and a program product. BACKGROUND

[0002] In the current electronic device, the audio processing technology is widely used in various scenes, such as video call, voice recognition, music recording, etc. In order to provide better audio experience, many electronic devices are equipped with multiple microphones. However, how to effectively use the sound signals collected by these microphones to achieve high-quality audio output has always been an important research topic in the field of audio processing. SUMMARY

[0003] In order to achieve high-quality audio output, the embodiment of the present disclosure proposes an audio processing method, an electronic device, a storage medium and a program product.

[0004] According to a first aspect of the embodiment of the present disclosure, an audio processing method is provided, which is executed by an electronic device, the electronic device is equipped with multiple microphones, and the method comprises: obtaining a left channel output signal and a right channel output signal, the left channel output signal is obtained by processing sound signals collected by the multiple microphones through a first filter, and the right channel output signal is obtained by processing the sound signals through a second filter, wherein the first filter and the second filter construct a steering vector using different reference points.

[0005] According to a second aspect of the embodiment of the present disclosure, an electronic device is provided, which is used to execute the audio processing method of the first aspect.

[0006] According to a third aspect of the embodiment of the present disclosure, a storage medium is provided, which stores instructions, when the instructions are executed on an electronic device, the electronic device executes the audio processing method of the first aspect.

[0007] According to a fourth aspect of the embodiment of the present disclosure, a program product is provided, which comprises at least one of a program and instructions, and the at least one of the program and instructions is executed by an electronic device to implement the audio processing method of the first aspect.

[0008] By using the above technical solution, high-quality stereo output can be achieved. BRIEF DESCRIPTION OF DRAWINGS

[0009] In order to more clearly illustrate the technical solutions in the embodiments of the present disclosure, the following describes the drawings required for the embodiments, and the following drawings are only some embodiments of the present disclosure, and do not specifically limit the protection scope of the present disclosure.

[0010] Figure 1 is a flowchart of an audio processing method according to an embodiment of the present disclosure.

[0011] Figure 2 is a flowchart of an audio processing method according to an embodiment of the present disclosure.

[0012] Figure 3 is a flowchart of an audio processing method according to an embodiment of the present disclosure.

[0013] Figure 4 is a structural diagram of an electronic device according to an embodiment of the present disclosure.

[0014] Figure 5 is a structural diagram of another electronic device according to an embodiment of the present disclosure.

[0015] Figure 6 is a structural diagram of a chip according to an embodiment of the present disclosure. DETAILED DESCRIPTION

[0016] Embodiments of the present disclosure provide an audio processing method, an electronic device, a storage medium and a program product.

[0017] In a first aspect, embodiments of the present disclosure provide an audio processing method, executed by an electronic device, the electronic device being provided with a plurality of microphones, the method comprising: obtaining a left-channel output signal and a right-channel output signal, the left-channel output signal being obtained by processing a sound signal collected by the plurality of microphones through a first filter, and the right-channel output signal being obtained by processing the sound signal through a second filter, wherein the first filter and the second filter construct a steering vector using different reference points.

[0018] In the above embodiments, since the first filter and the second filter construct a steering vector using different reference points, the left-channel output signal obtained by processing the sound signal collected by the plurality of microphones through the first filter and the right-channel output signal obtained by processing the sound signal through the second filter have a time difference. The time difference between the left-channel output signal and the right-channel output signal can enhance the direction and space of the sound, thereby producing stronger sound stereoscopic effect, which improves the stereo effect and realizes high-quality stereo output.

[0019] In some embodiments in combination with the first aspect, in some embodiments, the reference point refers to a reference point defining the phase or spatial position relationship of the steering vector.

[0020] In the above embodiment, in the case that the first filter and the second filter construct the steering vectors by using different reference points, by determining the reference point as the reference point for calculating the phase of the steering vector or as the reference point for describing the spatial position relationship, it can be ensured that there is a time difference between the output signals of different filters, so as to enhance the direction and space of the stereo sound, and improve the audio processing effect.

[0021] In some embodiments of the first aspect, the phase information at the reference point includes a first phase value.

[0022] In some embodiments of the first aspect, the first phase value is 0.

[0023] In the above embodiment, by setting the phase information of the reference point as 0, the signal processing process can be simplified, so that the filter can construct the steering vector more accurately, and the audio processing efficiency is improved.

[0024] In some embodiments of the first aspect, in the first steering vector of the first filter and the second steering vector of the second filter, the phase information of at least one same-position element is different.

[0025] In the above embodiment, since the phase information of at least one same-position element in the first steering vector of the first filter and the second steering vector of the second filter is different, it can be ensured that there is a difference between the left and right channel output signals, so as to enhance the direction and space of the stereo sound, and improve the stereo effect of the audio processing.

[0026] In some embodiments of the first aspect, the reference point includes: a first reference point used for constructing the first steering vector of the first filter;

[0027] The method further includes: determining the first reference point according to the position of the first microphone, the first microphone being the microphone farthest in the first direction among the plurality of microphones.

[0028] In the above embodiment, by explicitly determining the first reference point of the first filter as the position of the microphone farthest in the first direction, a fixed and explicit reference point is provided for left channel signal processing, so as to ensure the stability and consistency of the left channel output signal, and improve the accuracy and reliability of the stereo effect.

[0029] In some embodiments of the first aspect, the reference point includes: a second reference point used for constructing the second steering vector of the second filter;

[0030] The method further comprises determining the second reference point according to a position of a second microphone, the second microphone being a microphone farthest in a second direction among the plurality of microphones, the second direction being opposite to the first direction.

[0031] In the above embodiment, by explicitly determining the second reference point of the second filter as the position of the microphone farthest in the second direction, a fixed and explicit reference point is provided for right channel signal processing, thereby ensuring the stability and consistency of the right channel output signal, and further enhancing the direction and spatial sense of the stereo sound.

[0032] Moreover, by setting the reference points of the left and right channels at the positions of the microphones farthest in the first direction and the second direction respectively, and the second direction being opposite to the first direction, this differentiated reference point setting makes the processing reference of the left and right channel signals different. This design not only ensures the independence and accuracy of the left and right channel signals, but also further enhances the direction and spatial sense of the stereo sound through time difference and phase information. Specifically, the guide vector constructed by different reference points can make the left and right channel output signals have obvious differences in phase and time, and such differences can more naturally simulate the propagation characteristics of sound in a real sound field, thereby significantly improving the stereo sound effect and making the sound sound more real, natural and stereo.

[0033] In a second aspect, the embodiments of the present disclosure provide an electronic device, which comprises at least one of a transceiver module and a processing module; wherein the electronic device is configured to perform the optional implementation manner of the first aspect.

[0034] In a third aspect, the embodiments of the present disclosure provide an electronic device, which comprises one or more processors; wherein the electronic device is configured to perform the optional implementation manner of the first aspect.

[0035] In a fourth aspect, the embodiments of the present disclosure provide a storage medium, which stores instructions, when the instructions are run on an electronic device, the electronic device is caused to perform the method described in the optional implementation manner of the first aspect.

[0036] In a fifth aspect, the embodiments of the present disclosure provide a program product, which comprises at least one of a program and instructions, when the program product is executed by an electronic device, the electronic device is caused to perform the method described in the optional implementation manner of the first aspect.

[0037] In a sixth aspect, the embodiments of the present disclosure provide a computer program, when the computer program is run on a computer, the computer is caused to perform the method described in the optional implementation manner of the first aspect.

[0038] In a seventh aspect, embodiments of this disclosure provide a chip or chip system. The chip or chip system includes processing circuitry configured to perform the method described in the optional implementation of the first aspect above.

[0039] It is understood that the aforementioned audio processing apparatus, electronic device, storage medium, program product, computer program, etc., are all used to execute the methods proposed in the embodiments of this disclosure. Therefore, the beneficial effects that can be achieved can be referred to the beneficial effects in the corresponding methods, and will not be repeated here.

[0040] This disclosure provides an audio processing method, an electronic device, a storage medium, and a program product. In some embodiments, the terms audio processing method, signal processing method, stereo acquisition method, and UE stereo acquisition method with time difference construction can be used interchangeably.

[0041] This disclosure is not exhaustive, but merely illustrative of some embodiments, and is not intended to limit the scope of protection of this disclosure. Unless otherwise specified, each step in a particular embodiment can be implemented as an independent embodiment, and the steps can be arbitrarily combined. For example, a solution after removing some steps in a particular embodiment can also be implemented as an independent embodiment, and the order of the steps in a particular embodiment can be arbitrarily interchanged. Furthermore, the optional implementation methods in a particular embodiment can be arbitrarily combined; moreover, the embodiments can be arbitrarily combined, for example, some or all steps of different embodiments can be arbitrarily combined, and a particular embodiment can be arbitrarily combined with the optional implementation methods of other embodiments. In all embodiments of this disclosure, unless otherwise specified or logically conflicting, the terminology and / or descriptions between the embodiments are consistent and can be mutually referenced. Technical features in different embodiments can be combined to form new embodiments based on their inherent logical relationships.

[0042] The terminology used in the embodiments of this disclosure is for the purpose of describing particular embodiments only and is not intended to limit the scope of this disclosure.

[0043] In this embodiment of the disclosure, unless otherwise stated, elements expressed in the singular form, such as "a," "an," "the," "the," "the," "the," "the," "the," "this," etc., can mean "one and only one," or "one or more," "at least one," etc. For example, when using articles such as "a," "an," "the," etc. in translation, the noun following the article can be understood as either a singular expression or a plural expression.

[0044] In the embodiments disclosed herein, "multiple" refers to two or more.

[0045] In some embodiments, the terms "at least one of A or B", "at least one of A and B", "one or more", "a plurality of", "multiple", and the like can be interchangeable with each other.

[0046] In some embodiments, the terms "at least one of A or B", "at least one of A and B", "one or more", "a plurality of", "multiple", and the like can be interchangeable with each other.

[0047] In some embodiments, the terms "at least one of A or B", "at least one of A and B", "one or more", "a plurality of", "multiple", and the like can be interchangeable with each other.

[0048] In some embodiments, the terms "at least one of A or B", "at least one of A and B", "one or more", "a plurality of", "multiple", and the like can be interchangeable with each other.

[0047] In some embodiments, the terms "at least one of A or B", "at least one of A and B", "one or more", "a plurality of", "multiple", and the like can be interchangeable with each other.

[0048] In some embodiments, the terms "at least one of A or B", "at least one of A and B", "one or more", "a plurality of", "multiple", and the like can be interchangeable with each other.

[0047] In some embodiments, the terms "at least one of A or B", "at least one of A and B", "one or more", "a plurality of", "multiple", and the like can be interchangeable with each other.

[0048] In some embodiments, the terms "at least one of A or B", "at least one of A and B", "one or more", "a plurality of", "multiple", and the like can be interchangeable with each other.

[0047] In some embodiments, the terms "at least one of A or B", "at least one of A and B", "one or more", "a plurality of", "multiple", and the like can be interchangeable with each other.

[0048] In some embodiments, the terms "at least one of A or B", "at least one of A and B", "one or more", "a plurality of", "multiple", and the like can be interchangeable with each other.

[0047] In some embodiments, the terms "at least one of A or B", "at least one of A and B", "one or more", "a plurality of", "multiple", and the like can be interchangeable with each other.

[0048] In some embodiments, the terms "at least one of A or B", "at least one of A and B", "one or more", "a plurality of", "multiple", and the like can be interchangeable with each other.

[0047] In some embodiments, the terms "at least one of A or B", "at least one of A and B", "one or more", "a plurality of", "multiple", and the like can be interchangeable with each other.

[0048] In some embodiments, the terms "at least one of A or B", "at least one of A and B", "one or more", "a plurality of", "multiple", and the like can be interchangeable with each other.

[0049] In some embodiments, "comprising", "including", "to indicate", "carrying", can be interpreted as directly carrying A, or indirectly indicating A.

[0050] In some embodiments, the terms "in response to", "in response to determining", "in the case of", "when", "when", "if", "if" and the like can be replaced with each other, which means that the device will make corresponding processing under certain objective circumstances, not necessarily limited to time, and does not require the device to have a judgment action when implemented, nor does it mean that there must be other limitations.

[0051] In some embodiments, the terms "greater than", "greater than or equal to", "not less than", "more than", "more than or equal to", "not less than", "higher than", "higher than or equal to", "not lower than", "above" and the like can be replaced with each other, and the terms "less than", "less than or equal to", "not greater than", "less than", "less than or equal to", "not more than", "lower than", "lower than or equal to", "not higher than", "below" and the like can be replaced with each other.

[0052] In some embodiments, the device and the like can be interpreted as physical or virtual, and the name is not limited to the name recorded in the embodiment. The terms "device", "equipment", "device", "circuit", "network element", "network function", "network device", "function", "node", "unit", "section", "system", "network", "chip", "chip system", "entity", "subject" and the like can be replaced with each other.

[0053] In some embodiments, the acquisition of data, information and the like can comply with the laws and regulations of the place.

[0054] In some embodiments, data, information and the like can be obtained after obtaining the consent of the user.

[0055] In addition, each element, each row, or each column in the table of the embodiment of the disclosure can be implemented as an independent embodiment, and any element, any row, any column combination can also be implemented as an independent embodiment.

[0056] In some embodiments, the audio processing method of the disclosure is applied to an electronic device with multiple sound collectors. The sound collector is, for example, a microphone. The electronic device also has an audio processing function.

[0057] In some embodiments, the electronic device can be a terminal. The terminal includes at least one of a mobile phone, a wearable device having an audio processing function, an Internet of Things (IoT) device, a car, a smart car, a Pad, a computer having a wireless transceiver function, a virtual reality (VR) terminal device, an augmented reality (AR) terminal device, a wireless terminal device in industrial control, a wireless terminal device in self-driving, a wireless terminal device in remote medical surgery, a wireless terminal device in a smart grid, a wireless terminal device in transportation safety, a wireless terminal device in a smart city, a wireless terminal device in a smart home, and the like, but is not limited thereto.

[0058] In some embodiments, the terms "terminal", "terminal device", "user equipment (UE)", "user terminal", "mobile station (MS)", "mobile terminal (MT)", subscriber station, mobile unit, subscriber unit, wireless unit, remote unit, mobile device, wireless device, wireless communication device, remote device, mobile subscriber station, access terminal, mobile terminal, wireless terminal, remote terminal, handset, user agent, mobile client, client, and the like can be replaced with each other.

[0059] In some embodiments, the electronic device can be a network device with audio processing function. The network device can include at least one of an access network device and a core network device, without limitation.

[0060] In the current field of stereo recording, professional microphones can be used for stereo recording, but professional microphones are large in size, high in cost, and difficult or even impossible to be integrated on a mobile phone.

[0061] In some embodiments, the principle of stereo is to construct the required stereo sound image through the time difference and / or intensity difference between left and right channels.

[0062] In some embodiments, the directivity of the signal can be controlled by using beam technology, so as to control the intensity difference. However, in the related art, the reference point of the array algorithm is fixed when different signals are output, so the time difference information is not utilized.

[0063] In some embodiments, the steering vector can be represented as "D", which is a common parameter in beam, used to describe the relative phase and amplitude relationship of the signal received by each microphone in the microphone array from each direction.

[0064] In some embodiments, the reference point in the array algorithm can be a point where the steering vector has zero phase difference, or a point where the steering vector has a certain phase difference. Alternatively, the reference point is generally defined at the geometric center of the electronic device, or the geometric center of the microphone array, or at a certain microphone.

[0065] Therefore, the present disclosure proposes an audio processing method, an electronic device, a storage medium and a program product to solve the defect of lacking time difference in stereo collection technology. The audio processing method of the present disclosure can achieve better stereo effect by adding time difference in the stereo algorithm.

[0066] Figure 1 is a flowchart of an audio processing method according to an embodiment of the present disclosure. The present embodiment relates to an audio processing method, which is executed by an electronic device equipped with a plurality of sound collectors such as microphones. The microphone can be integrated on the electronic device, or can be independent of the electronic device and connected to the electronic device in communication. As shown in Figure 1 The above method includes at least one of the following steps:

[0067] Step S101, collecting sound signals by a plurality of microphones.

[0068] The number of microphones is greater than or equal to 2. More sound signals, including sound signals from different positions, can be captured through multiple microphones, providing more abundant information for subsequent audio processing, thereby facilitating more accurate restoration of stereo sound and improving the audio quality of the processing result.

[0069] In some embodiments, the position of the microphone, i.e., the microphone array, is not limited by the embodiments of the present disclosure. The microphone array can be a linear array or an array of other shapes.

[0070] In step S102, the collected sound signal is input into a first filter for processing to obtain a left-channel output signal.

[0071] In step S103, the collected sound signal is input into a second filter for processing to obtain a right-channel output signal.

[0072] In some embodiments, the terms "filter", "beamformer", "beam controller", "processor", and the like can be replaced with each other.

[0073] In some embodiments, the terms "channel" and "path" can be replaced with each other.

[0074] It should be noted that the first filter and the second filter can be two independent filters, or the first filter and the second filter can be components in the same filter. That is, the first filter and the second filter can exist independently, and the first filter and the second filter can be integrated.

[0075] In some embodiments, the first filter and the second filter use different reference points to construct the steering vectors. In some embodiments, at least one of the phase information of the same position elements in the first steering vector of the first filter and the second steering vector of the second filter is different. Alternatively, the phase information of each same position element in the first steering vector of the first filter and the second steering vector of the second filter is different.

[0076] The same position element refers to the same microphone position, i.e., the element corresponding to one microphone in the first steering vector and the element corresponding to the one microphone in the second steering vector are same position elements.

[0077] The phase information refers to the phase (such as absolute phase) of the sound wave when it reaches the microphone, or refers to the difference (such as relative phase) between the phase of the sound wave when it reaches the microphone and the phase of the sound wave reaching the reference point. It should be noted that when the sound wave reaches the microphone array from a certain direction, due to the different positions of each microphone, the time when the sound wave reaches each microphone will be different, resulting in a difference in phase.

[0078] ​In some embodiments, the reference point refers to a reference point defining a phase of a steering vector or a spatial position relationship. For example, the reference point is a reference point for calculating phase information. For example, the reference point is a reference point for describing the position of the microphone.

[0079] Optionally, the phase information of the position of the reference point includes a first phase. Optionally, the first phase is a fixed value (or a preset value or a certain value). Optionally, in an ideal state, the fixed value can be 0. Optionally, the fixed value can also be a non-zero value, wherein the fixed value can be determined according to the characteristics of the microphone itself, the diffraction of the device and other influencing factors.

[0080] In some embodiments, the reference point includes at least one of the following:

[0081] The first reference point is used to construct a first steering vector of a first filter.

[0082] The second reference point is used to construct a second steering vector of a second filter.

[0083] In some embodiments, the first reference point is determined according to the position of the first microphone, and the first microphone refers to the microphone farthest in the first direction among the plurality of microphones.

[0084] Optionally, the first direction is a direction corresponding to a -90° sound source direction in a stereo sound image, that is, the first direction is a -90° direction.

[0085] Optionally, the first direction is a direction corresponding to θ1 in the steering vector.

[0086] Optionally, the first direction is the positive left direction of the electronic device in a natural state. Taking a mobile phone as an example, when the mobile phone is in a portrait state (the screen is upward or downward), the first direction is a direction perpendicular to the long side of the left side of the mobile phone and pointing to the left. When the mobile phone is in a landscape state (the screen is upward or downward), the first direction is a direction perpendicular to the short side of the left side of the mobile phone and pointing to the left.

[0087] In some embodiments, the microphone farthest in the first direction among the plurality of microphones is the microphone located at the leftmost side (for example, the positive left direction of the electronic device in a natural state) among the plurality of microphones. In some embodiments, the first reference point is determined according to the position of the first microphone, and the first microphone refers to the microphone located at the leftmost side among the plurality of microphones. The position of the first microphone refers to the position of the first microphone on the electronic device, or the position of the first microphone refers to the position of the first microphone in the microphone array. For example, the plurality of microphones are sorted in the order from left to right to obtain a microphone sequence, and the first microphone in the microphone sequence is determined as the first microphone. The position of the first microphone is determined as the first reference point.

[0088] In some embodiments, the second reference point is determined according to a position of a second microphone, the second microphone being a microphone farthest in a second direction among the plurality of microphones. Optionally, the second direction is opposite to the first direction. Optionally, the second direction is symmetrical to the first direction.

[0089] Optionally, the second direction is a direction corresponding to a +90° sound source direction in a stereo panning diagram, i.e., the second direction is a +90° direction.

[0090] Optionally, the second direction is a direction corresponding to a θ M in a steering vector.

[0091] Optionally, the second direction is a direction of a right side of the electronic device in a natural state. Taking the electronic device as a mobile phone as an example, when the mobile phone is in a portrait state (the screen faces upward or downward), the second direction is a direction perpendicular to a long side of the right side of the mobile phone and pointing to the right side. When the mobile phone is in a landscape state (the screen faces upward or downward), the second direction is a direction perpendicular to a short side of the right side of the mobile phone and pointing to the right side.

[0092] In some embodiments, the microphone farthest in the second direction among the plurality of microphones is a microphone located at a rightmost side (e.g., a direction of a right side of the electronic device in a natural state) of the plurality of microphones. In some embodiments, the second reference point is determined according to a position of a second microphone, the second microphone being a microphone located at the rightmost side of the plurality of microphones, the position of the second microphone being a position of the second microphone on the electronic device, or the position of the second microphone being a position of the second microphone in the microphone array. For example, the plurality of microphones are sorted in a left-to-right order to obtain a microphone sequence, and a last microphone in the microphone sequence is determined as the second microphone. The position of the second microphone is determined as the second reference point.

[0093] It should be noted that, in addition to the above-described left-to-right sorting manner, the plurality of microphones can also be sorted in a right-to-left sorting manner to obtain a microphone sequence, which will not be described herein again.

[0094] In some embodiments, a first steering vector of a first filter can be constructed using the first reference point, and a second steering vector of a second filter can be constructed using the second reference point. The first steering vector can be represented as D L , and the second steering vector can be represented as D R .

[0095] Since the first filter and the second filter construct steering vectors using different reference points, the steering vectors of the first filter and the second filter can be different in phase.

[0096] It should be noted that since the steering vector represents the relative phase and amplitude relationship of the sound signal received by each microphone in the microphone array from each direction, the first steering vector and the second steering vector are different. However wherein the element d n (θ m ) represents the response of the n th microphone pair to the direction θ m , n ranges from 1 to B, B is greater than or equal to 2, and m ranges from 1 to N, N is greater than or equal to 2. It should be noted that the first steering vector and the second steering vector are both N x M matrices. Wherein N represents the number of microphones, and M represents the number of expected response directions.

[0097] In order to illustrate that the phase information of at least one co-element in the first steering vector of the first filter and the second steering vector of the second filter is different, the following takes an ideal model as an example. In an ideal case, it is assumed that there is only phase information on each microphone, and it is assumed that the phase information is only composed of the distance difference of the sound wave of the sound source reaching different microphones. For example, the function of the phase information can be represented as R(r) = e -jωr , wherein r represents the difference between the distance of the sound wave of one sound source propagating to the reference point and the distance of the sound wave of the one sound source propagating to one microphone, j represents an imaginary unit, and ω represents a frequency. Wherein the sound source can be a sound source of any angle.

[0098] For example, in the process of constructing the first steering vector D L of the first filter using the first reference point, r represents the difference between the distance of the sound wave of one sound source propagating to the first reference point and the distance of the sound wave of the one sound source propagating to one microphone. It is assumed that for the sound signal of the sound source θ1, the difference between the distance of the sound wave propagating to the first reference point and the distance of the sound wave propagating to the first microphone (i.e. the first microphone located at the leftmost side) is r = 0, i.e. the phase information is 0 (it should be noted that here the phase information is 0 in an ideal state, and in a non-ideal state, the phase information is also affected by the characteristics of the microphone itself, the diffraction of the device, etc. In addition, the steering vector also has amplitude difference), and R(r) = e -jωr R(0) = 1 can be calculated, i.e. d L1 (θ1) = 1. It is assumed that for the sound signal of the sound source θ1, the difference between the distance of the sound wave propagating to the first reference point and the distance of the sound wave propagating to the N th microphone (i.e. the second microphone located at the rightmost side) is r = R, i.e. the phase information is R, and T(r) = e -jωr can be determined, i.e. d LN (θ1) = T(R). That is, for the sound signal of the sound source θ1,

[0099] Continuing the example, in the process of constructing the second steering vector D R of the second filter using the second reference point, r represents the difference between the distance of the sound wave of one sound source propagating to the second reference point and the distance of the sound wave of the one sound source propagating to one microphone. For the sound signal at the sound source θ1, the difference between the distance of the sound wave propagating to the second reference point and the distance of the sound wave propagating to the second microphone (i.e., the Nth microphone located at the rightmost side) is r = 0, i.e., the phase information is 0, and T(r) = e -jωr is calculated to obtain T(0) = 1, i.e., d RN (r1) = 1. For the sound signal at the sound source θ1, the difference between the distance of the sound wave propagating to the first reference point and the distance of the sound wave propagating to the first microphone (i.e., the first microphone located at the leftmost side) is r = -R, and T(r) = e -jωr is calculated to determine d LN (θ1) = T(-R). That is, for the sound signal at the sound source θ1,

[0100] As can be seen from the above, in the case of the first steering vector of the first filter constructed using the first reference point and the second steering vector of the second filter constructed using the second reference point, at least one same-position element in the first steering vector of the first filter and the second steering vector of the second filter has different phase information, for example, d L1 (θ1) and d R1 (θ1) are different, for example, d LN (θ1) and d RN (θ1) are different.

[0101] It should be explained here that stereo sound refers to sound reproduced through two channels (i.e., a left channel and a right channel). Stereo sound technology utilizes the binaural hearing characteristics of humans to simulate the direction and space of sound through the signal difference of the two channels, thereby producing a stereoscopic sound. And using the above method, since the first filter and the second filter construct steering vectors using different reference points, there is a phase information difference between the same-position elements in the first steering vector of the first filter and the second steering vector of the second filter, which can cause a time difference between the left channel output signal obtained by the first filter processing the sound signal collected by the multiple microphones and the right channel output signal obtained by the second filter processing the sound signal. And the time difference between the left channel output signal and the right channel output signal can enhance the direction and space of sound, thereby producing a stronger stereoscopic sound, which improves the stereo sound effect and achieves high-quality stereo sound output.

[0102] In some embodiments, the names of signals, etc., are not limited to those described in the embodiments, and terms such as "signal," "information," and "data" can be used interchangeably.

[0103] In some embodiments, the terms “acquire”, “get”, “obtain”, “receive”, “collect”, “gather”, etc., can be used interchangeably.

[0104] The audio processing method disclosed herein may include at least one of steps S101 to S103. For example, step S102 may be implemented as a separate embodiment, step S103 may be implemented as a separate embodiment, and steps S102 and S103 may be implemented as separate embodiments, but are not limited thereto.

[0105] In some embodiments, steps S102 and S103 may be performed simultaneously or in an alternate order.

[0106] In some embodiments, the steps and their optional implementations in other embodiments described before or after this embodiment, as well as other related parts in the specification, can be referred to, and will not be repeated here.

[0107] Figure 2 This is a schematic flowchart illustrating an audio processing method according to an embodiment of the present disclosure. The embodiments of the present disclosure relate to an audio processing method executed by an electronic device equipped with (e.g., integrated or externally connected) multiple sound acquisition devices, such as microphones. Figure 2 As shown, the above method includes at least one of the following steps:

[0108] Step S201: Acquire sound signals using multiple microphones.

[0109] The number of microphones is greater than or equal to two. Multiple microphones can capture richer sound signals from different directions, providing more data support for subsequent audio processing, enabling more accurate stereo reproduction and improved audio quality of the processed results.

[0110] In some embodiments, the location of the microphone, i.e., the microphone array, is not limited in this disclosure. The microphone array may be a linear array or an array of other shapes.

[0111] Step S202: Determine a first reference point based on the position of the first microphone, and construct a first guide vector for the first filter based on the first reference point.

[0112] In some embodiments, the term "filter" can be used interchangeably with terms such as "beamformer," "beam controller," and "processor."

[0113] In some embodiments, the first reference point is determined according to a position of a first microphone, the first microphone being a farthest microphone in the plurality of microphones in the first direction.

[0114] Optionally, the first direction is a direction corresponding to a -90° sound source direction in a stereo sound image, i.e., the first direction is a -90° direction.

[0115] Optionally, the first direction is a direction corresponding to θ1 in the steering vector.

[0116] Optionally, the first direction is a direction of a left side of the electronic device in a natural state. Taking a mobile phone as an example, when the mobile phone is in a portrait state (the screen faces up or down), the first direction is a direction perpendicular to a long side of the left side of the mobile phone and pointing to the left. When the mobile phone is in a landscape state (the screen faces up or down), the first direction is a direction perpendicular to a short side of the left side of the mobile phone and pointing to the left.

[0117] In some embodiments, the farthest microphone in the plurality of microphones in the first direction is a leftmost microphone in the plurality of microphones. In some embodiments, the first reference point is determined according to a position of a first microphone, the first microphone being the leftmost microphone in the plurality of microphones, the position of the first microphone being a position of the first microphone on the electronic device, or the position of the first microphone being a position of the first microphone in the microphone array. For example, the plurality of microphones are sorted according to a left-to-right order to obtain a microphone sequence, and a first microphone in the microphone sequence is determined as the first microphone. The position of the first microphone is determined as the first reference point.

[0118] It should be noted that, in addition to the above-described left-to-right sorting manner, the plurality of microphones can also be sorted in a right-to-left sorting manner, which will not be described herein again.

[0119] In some embodiments, the first reference point can be used to construct a first steering vector of the first filter, where the first steering vector can be represented as D L .

[0120] It should be noted that, since the steering vector represents the relative phase and amplitude relationship of the sound signal received by each microphone in the microphone array from each direction, the steering vector can be represented as D where element d Ln (θ m ) represents the n-th microphone for the direction θ mIn response to the first directional vector, n is in the range of 1 to N, N is greater than or equal to 2, and m is in the range of 1 to M, M is greater than or equal to 2. It should be noted that the first directional vector is an N*M matrix. Wherein N represents the number of microphones, and M represents the number of expected response directions.

[0121] The following is an example of an ideal model. In an ideal case, it is assumed that there is only phase information on each microphone, and it is assumed that the phase information is only composed of the distance difference of the sound waves of the sound source reaching different microphones. For example, the function of the phase information can be represented as T(r) = e -jωr Wherein r represents the difference between the distance of the sound wave of one sound source propagating to the reference point and the distance of the sound wave of the one sound source propagating to one microphone, j represents an imaginary unit, and ω represents a frequency. Wherein the sound source can be a sound source of any angle.

[0122] For example, in the process of constructing the first directional vector D L of the first filter by using the first reference point, r represents the difference between the distance of the sound wave of one sound source propagating to the first reference point and the distance of the sound wave of the one sound source propagating to one microphone. It is assumed that for the sound signal at θ1, the difference between the distance of the sound wave propagating to the first reference point and the distance of the sound wave propagating to the first microphone is r = 0, that is, the phase information is 0, and T(r) = e -jωr is brought in. Calculation can obtain T(0) = 1, that is, d L1 (θ1) = 1. It is assumed that for the sound signal at θ1, the difference between the distance of the sound wave propagating to the first reference point and the distance of the sound wave propagating to the Nth microphone (that is, the second microphone located at the far right) is r = R, that is, the phase information is R, and T(r) = e -jωr is brought in. Calculation can determine d LN (θ1) = T(R). That is, for the sound signal at θ1,

[0123] In step S203, a second reference point is determined according to the position of the second microphone, and a second directional vector of a second filter is constructed according to the second reference point.

[0124] In some embodiments, the second reference point is determined according to the position of the second microphone, and the second microphone refers to the microphone farthest in the second direction among the plurality of microphones, and the second direction is opposite to the first direction.

[0125] Optionally, the second direction is a direction corresponding to a +90° sound source direction in a stereo sound image, that is, the second direction is a +90° direction.

[0126] Optionally, the second direction is a direction corresponding to θ M in the directional vector.

[0127] Optionally, the second direction is a right direction of the electronic device in a natural state. Taking the electronic device as a mobile phone for example, when the mobile phone is in a portrait state (the screen faces up or down), the second direction is a direction perpendicular to the right side long edge of the mobile phone and pointing to the right side. When the mobile phone is in a landscape state (the screen faces up or down), the second direction is a direction perpendicular to the right side short edge of the mobile phone and pointing to the right side.

[0128] In some embodiments, the microphone farthest in the second direction among the plurality of microphones is the microphone located at the rightmost side among the plurality of microphones. In some embodiments, the second reference point is determined according to the position of the second microphone, the second microphone refers to the microphone located at the rightmost side among the plurality of microphones, the position of the second microphone refers to the position of the second microphone on the electronic device, or the position of the second microphone refers to the position of the second microphone in the microphone array. For example, the plurality of microphones are sorted in a left-to-right order to obtain a microphone sequence, and the last microphone in the microphone sequence is determined as the second microphone. The position of the second microphone is determined as the second reference point.

[0129] In some embodiments, the second steering vector of the second filter can be constructed using the second reference point. Wherein the second steering vector can be represented as D R .

[0130] It should be noted that since the steering vector represents the relative phase and amplitude relationship of the sound signal received by each microphone in the microphone array from each direction, the second steering vector D Wherein the element d Rn (θ m ) represents the response of the nth microphone to the direction θ m , n ranges from 1 to N, N is greater than or equal to 2, and m ranges from 1 to M, M is greater than or equal to 2. It should be noted that the second steering vector is an N x M matrix. Wherein N represents the number of microphones, and M represents the number of expected response directions.

[0131] The following is an example using an ideal model. In an ideal case, it is assumed that there is only phase information on each microphone, and that the phase information is only composed of the distance difference of the sound wave of the sound source reaching different microphones. For example, the function of the phase information can be represented as T(r) = e -jωr , where r represents the difference between the distance of the sound wave of a sound source propagating to the reference point and the distance of the sound wave of the sound source propagating to a microphone, j represents the imaginary unit, and ω represents the frequency. Wherein the sound source can be a sound source of any angle.

[0132] For example, the second steering vector D Rr represents the difference between the distance of sound wave propagation from one sound source to the second reference point and the distance of sound wave propagation from the one sound source to one microphone. For the sound signal at the sound source θ1, the difference between the distance of sound wave propagation to the second reference point and the distance of sound wave propagation to the second microphone (i.e., the Nth microphone located at the rightmost side) is r = 0, i.e., the phase information is 0, and T(r) = e -jωr The calculation can obtain T(0) = 1, i.e., d RN (θ1) = 1. For the sound signal at the sound source θ1, the difference between the distance of sound wave propagation to the first reference point and the distance of sound wave propagation to the first microphone (i.e., the first microphone located at the leftmost side) is r = -R, and T(r) = e -jωr The calculation can determine d LN (θ1) = T(-R). That is, for the sound signal at the sound source θ1,

[0133] As can be seen from the above, in the case of constructing the first steering vector of the first filter by using the first reference point and constructing the second steering vector of the second filter by using the second reference point, the phase information of at least one same-position element in the first steering vector of the first filter and the second steering vector of the second filter is different, for example, d L1 (θ1) and d R1 (θ1) are different, for example, d LN (θ1) and d RN (θ1) are different.

[0134] In step S204, the collected sound signal is input into the first filter and the second filter for processing to obtain the left-channel output signal and the right-channel output signal.

[0135] In some embodiments, the terms of "channel", "path", and the like can be replaced with each other.

[0136] It should be noted that the first filter and the second filter can be two independent filters, and the first filter and the second filter can be components in the same filter. That is, the first filter and the second filter can exist independently, and the first filter and the second filter can also be integrated.

[0137] According to the embodiments of steps S202 and S203, in the case of constructing the first steering vector of the first filter by using the first reference point and constructing the second steering vector of the second filter by using the second reference point, at least one same-position element in the first steering vector of the first filter and the second steering vector of the second filter is different in phase information.

[0138] With the above method, since the first filter and the second filter construct the steering vector by using different reference points, there is a phase information difference between the same position elements in the first steering vector of the first filter and the second steering vector of the second filter, which can make the left channel output signal processed by the first filter from the sound signals collected by the plurality of microphones and the right channel output signal processed by the second filter from the sound signals have a time difference. The time difference between the left channel output signal and the right channel output signal can enhance the direction and space of the sound, thereby producing stronger sound stereoscopic effect, which improves the stereo effect and realizes high-quality stereo output.

[0139] The audio processing method related to the embodiments of the present disclosure can include at least one of steps S201-S204. For example, step S202 can be implemented as an independent embodiment, step S203 can be implemented as an independent embodiment, and steps S202 and S203 can be implemented as independent embodiments, but are not limited thereto.

[0140] In some embodiments, steps S202 and S203 can be executed simultaneously or in an exchanged order.

[0141] In some embodiments, the implementation manners of steps S201-S204 can refer to the steps and optional implementation manners thereof in other embodiments described before or after the corresponding description of the present embodiments in the specification, and other related parts in the specification, which will not be described here. Figure 1

[0142] Figure 3 is a flow diagram of an audio processing method according to an embodiment of the present disclosure. As shown in Figure 3 The embodiments of the present disclosure relate to an audio processing method, which is executed by an electronic device equipped with a plurality of sound collectors such as microphones. The above method includes:

[0143] In step S301, a left channel output signal and a right channel output signal are obtained, the left channel output signal is obtained by processing sound signals collected by a plurality of microphones through a first filter, and the right channel output signal is obtained by processing the sound signals through a second filter, and the first filter and the second filter construct steering vectors by using different reference points.

[0144] Optionally, the reference point refers to a reference point defining the phase or spatial position relationship of the steering vector.

[0145] Optionally, the phase information at the reference point includes a first phase value.

[0146] Optionally, the first phase value is 0.

[0147] ​Optionally, phase information of at least one same-position element in the first steering vector of the first filter and the second steering vector of the second filter is different.

[0148] Optionally, the reference point comprises a first reference point for constructing the first steering vector of the first filter.

[0149] The method further comprises determining the first reference point according to a position of a first microphone, the first microphone being a farthest microphone in a first direction among the plurality of microphones.

[0150] Optionally, the reference point comprises a second reference point for constructing the second steering vector of the second filter.

[0151] The method further comprises determining the second reference point according to a position of a second microphone, the second microphone being a farthest microphone in a second direction among the plurality of microphones.

[0152] In some embodiments, see the other embodiments described before or after the description of the present embodiment, the steps and optional implementation manners thereof, and other related parts of the description.

[0153] It should be further noted that the audio processing method of the present disclosure can be applied to stereo recording, speech enhancement, and the like.

[0154] The audio processing method of the present disclosure can be used for stereo format audio acquisition by a mobile phone with N microphones, for communication, local storage, and the like.

[0155] The audio processing method of the present disclosure processes audio signals collected by N (greater than or equal to two) microphones on a mobile phone, sets a reference point of a left channel algorithm at a leftmost microphone and a reference point of a right channel algorithm at a rightmost microphone, thereby constructing a time difference of a stereo format, and outputs audio in a stereo format.

[0156] In some embodiments, it is assumed that a plurality of microphones (greater than or equal to two) are provided on an electronic device, a first microphone is a left microphone, and a second microphone is a right microphone. Sound signals collected by the plurality of microphones are input into a first filter and a second filter for processing, to obtain a left channel output signal and a right channel output signal, the first filter taking the first microphone as a reference point for outputting the left channel output signal, and the second filter taking the second microphone as a reference point for outputting the right channel output signal.

[0157] In some embodiments, the frequency ω1 of the output signal satisfies a defined desired response g(ω1, θ1) in angle θ1 as employing signal-independent beam: H(D) = D*(D' * D) -1 The desired response refers to the ideal audio characteristics that the output signal of the left channel and / or the right channel should achieve after the filter processes the sound signal. It can be understood that the desired response defines the sound response requirements of the left channel and / or the right channel in a specific direction, and the present disclosure does not limit the desired response.

[0158] wherein each parameter represents the meaning as follows:

[0159] ω: represents the frequency.

[0160] θ: represents the angle.

[0161] D: represents the steering vector of microphone 1 to microphone N at all angles corresponding to the desired response.

[0162] D = [d1(ω1, θ1) … d N (ω n ,θ n )], which is an N*M matrix, wherein N represents the number of microphones, and M represents the number of angles corresponding to the desired response.

[0163] d N (ω1, θ1): represents the steering vector of microphone N at frequency ω1 and angle θ1.

[0164] D': represents the conjugate transpose of D.

[0165] (D' * D) -1 : represents the inverse of (D' * D).

[0166] G: represents the matrix of the desired response of frequency ω1 at angle θ1, G = [g(ω1, θ1) … g(ω n ,θ n )].

[0167] X: represents the input signal, with a dimension of N*1.

[0168] L: represents the left channel output.

[0169] R: represents the right channel output.

[0170] H L : represents the filter (which can be referred to as a beamformer, beam) of the left channel, with a dimension of 1*N.

[0171] H R : represents the filter (which can be referred to as a beamformer, beam) of the right channel, with a dimension of 1*N.

[0172] in,

[0173] In some embodiments, mic1 represents the leftmost microphone and micN represents the rightmost microphone.

[0174] In some embodiments, for the filter H used to construct the left channel L The guide vector D L The position of mic1 is used as the reference point for the guide vector.

[0175] In some embodiments, for the filter H used to construct the right channel R The guide vector D R The position of micN is used as the reference point for the guide vector.

[0176] In some embodiments, a filter H is constructed for the left channel. L D L d L With the filter H used to construct the right channel R D R d R no the same.

[0177] Taking an ideal model as an example, each microphone only contains phase information. The phase information is composed solely of the distance difference between the sound waves from the sound source reaching different microphones, and the function is T(r) = e -jωr r represents the distance difference between the sound waves from the sound source and mic1 and micN, respectively, while the distance difference between the sound waves from the opposite source and micN and mic1 is -r. The steering vector for zero-phase information is 1. For the signal at θ1, with mic1 as the reference point, assume d... L1 The phase information of (θ1) is zero, that is: d L1 (θ1)=1: When micN is taken as the reference point, assume d RN The phase information of (θ1) is zero, that is: d RN (θ1)=1:

[0178] It should be noted that the steering vector D is an N*M matrix, where N represents the number of microphones and M represents the number of directions of the desired response. The steering vector D represents the relative phase and amplitude relationship of the signal received by each microphone in the microphone array from each direction. Element d N (θ1) represents the microphone d N The response to direction θ1.

[0179] In some embodiments, d can be measured by the electronic device or estimated based on the position of the microphone.

[0180] It should be noted that the steering vector D of the same model of electronic device can be considered as the same or similar because the microphone array of the same electronic device is designed consistently, i.e., the steering vector D measured for one electronic device can be used on all electronic devices of the same model.

[0181] The audio processing method of the present disclosure can achieve better stereo effect by adding time difference in the stereo algorithm.

[0182] The embodiments of the present disclosure also propose a device (which can also be referred to as an electronic device, etc.) for implementing any of the above audio processing methods. For example, a device is proposed, which includes units or modules for implementing each step performed by the electronic device in any of the above audio processing methods.

[0183] It should be understood that the division of each unit or module in the above device is only a logical functional division, and all or part of them can be integrated into one physical entity or physically separated in actual implementation. In addition, the units or modules in the device can be implemented in the form of processor calling software: for example, the device includes a processor connected with a memory, the memory stores instructions, and the processor calls the instructions stored in the memory to implement any of the above audio processing methods or to implement the functions of each unit or module of the device, where the processor is, for example, a general-purpose processor such as a central processing unit (CPU) or a microprocessor, and the memory is a memory within the device or a memory outside the device. Alternatively, the units or modules in the device can be implemented in the form of hardware circuit, and the functions of part or all of the units or modules can be implemented by designing the hardware circuit, which can be understood as one or more processors; for example, in one implementation, the hardware circuit is an application-specific integrated circuit (ASIC), and the functions of part or all of the units or modules are implemented by designing the logical relationship of elements in the circuit; for another example, in another implementation, the hardware circuit is a programmable logic device (PLD), and a field programmable gate array (FPGA) is taken as an example, which can include a large number of logic gate circuits, and the connection relationship between the logic gate circuits is configured by a configuration file, so as to implement the functions of part or all of the units or modules. All units or modules of the above device can be implemented in the form of processor calling software, or all units or modules can be implemented in the form of hardware circuit, or part of the units or modules can be implemented in the form of processor calling software, and the remaining part can be implemented in the form of hardware circuit.

[0184] In the embodiments of the present disclosure, the processor is a circuit with signal processing capability. In one implementation, the processor can be a circuit with instruction reading and running capability, such as a central processing unit (CPU), a microprocessor, a graphics processing unit (GPU) (which can be understood as a microprocessor), a digital signal processor (DSP), and the like. In another implementation, the processor can implement certain functions through a logical relationship of hardware circuit, and the logical relationship of the hardware circuit is fixed or reconfigurable. For example, the processor is a hardware circuit implemented by an application-specific integrated circuit (ASIC) or a programmable logic device (PLD), such as an FPGA. In the reconfigurable hardware circuit, the processor loads a configuration document to implement the configuration of the hardware circuit. It can be understood that the processor loads instructions to implement the functions of the above part or all units or modules. In addition, it can also be a hardware circuit designed for artificial intelligence, which can be understood as an ASIC, such as a neural network processing unit (NPU), a tensor processing unit (TPU), a deep learning processing unit (DPU), and the like.

[0185] It should be noted that the various embodiments described above in the embodiments of the present disclosure can be used with the foregoing and / or the following embodiments, or can be used independently. Whether used alone or together with the foregoing and / or the following embodiments, the implementation principle is similar. In the embodiments of the present disclosure, some embodiments are described as implementation modes used together. Of course, such example descriptions are not a limitation of the embodiments of the present disclosure.

[0186] Figure 4 FIG. 4 is a structural schematic diagram of an electronic device 400 according to the embodiments of the present disclosure. The electronic device 400 is configured to execute any of the above methods. In some embodiments, as shown in FIG. 4, the electronic device 400 can include at least one of a transceiver module 401, a processing module 402, and the like. Figure 4

[0187] ​In some embodiments, the processing module 402 is configured to obtain a left-channel output signal and a right-channel output signal, the left-channel output signal being obtained by processing the sound signals collected by the plurality of microphones through a first filter, and the right-channel output signal being obtained by processing the sound signals through a second filter, wherein the first filter and the second filter use different reference points to construct a steering vector.

[0188] Optionally, the reference point refers to a reference point defining a phase or spatial position relationship of the steering vector.

[0189] Optionally, the phase information at the reference point includes a first phase.

[0190] Optionally, the first phase value is 0.

[0191] Optionally, at least one of the first steering vector of the first filter and the second steering vector of the second filter has different phase information of corresponding elements.

[0192] Optionally, the reference point includes a first reference point used to construct the first steering vector of the first filter.

[0193] The processing module 402 is configured to determine the first reference point according to the position of a first microphone, the first microphone being the farthest microphone in a first direction among the plurality of microphones.

[0194] Optionally, the reference point includes a second reference point used to construct the second steering vector of the second filter.

[0195] The processing module 402 is configured to determine the second reference point according to the position of a second microphone, the second microphone being the farthest microphone in a second direction among the plurality of microphones.

[0196] In some embodiments, the transceiving module can include a transmitting module and / or a receiving module, which can be separate or integrated together. Optionally, the transceiving module can be replaced by a transceiver.

[0197] In some embodiments, the processing module can be one module or include a plurality of sub-modules. Optionally, the plurality of sub-modules perform all or part of the steps required to be performed by the processing module.

[0198] In some embodiments, the processing module can be replaced by a processor, and the transceiving module can be replaced by a transceiver.

[0199] Figure 5Fig. 5 is a structural schematic diagram of an electronic device 500 according to an embodiment of the present disclosure. The electronic device 500 can be, for example, a mobile phone, a computer, a digital broadcast terminal, a messaging device, a game console, a tablet device, a medical device, a fitness device, a personal digital assistant, or the like.

[0200] Referring to Figure 5 The electronic device 500 can include one or more of the following components: a processing component 502, a memory 504, a power supply component 506, a multimedia component 508, an audio component 510, an input / output (I / O) interface 512, a sensor component 514, and a communication component 516.

[0201] The processing component 502 usually controls overall operations of the electronic device 500, such as operations associated with displaying, making phone calls, data communications, camera operations, and recording operations. The processing component 502 can include one or more processors 520 to execute instructions to complete all or part of steps of the methods described above. In addition, the processing component 502 can include one or more modules to facilitate the interaction between the processing component 502 and other components. For example, the processing component 502 can include a multimedia module to facilitate the interaction between the multimedia component 508 and the processing component 502.

[0202] In some embodiments, the processor 520 performs at least one of the processing steps (e.g., step S101, step S102, step S103, step S201, step S202, step S203, step S204, step S301, but not limited thereto).

[0203] The memory 504 is configured to store various types of data to support operations of the electronic device 500. Examples of the data include instructions for any application or method operating on the electronic device 500, contact data, phonebook data, messages, pictures, videos, and the like. The memory 504 can be implemented by any type of volatile or non-volatile memory device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, a magnetic disk or a optical disk.

[0204] The power supply component 506 supplies power to various components of the electronic device 500. The power supply component 506 can include a power supply management system, one or more power supplies, and other components associated with generating, managing and distributing power for the electronic device 500.

[0205] The multimedia component 508 includes a screen to provide an output interface between the electronic device 500 and a user. In some embodiments, the screen can include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen can be implemented as a touch screen to receive an input signal from a user. The touch panel includes one or more touch sensors to sense a touch, a slide, and a gesture on the touch panel. The touch sensor can not only sense a boundary of a touching or a sliding action, but also detect duration and intensity of the touching or sliding action. In some embodiments, the multimedia component 508 includes a front camera and / or a back camera. When the electronic device 500 is in an operating mode, such as a camera mode or a video mode, the front camera and / or the back camera can receive external multimedia data. Each of the front camera and the back camera can be a fixed optical lens system or have a focal length and optical zooming capability.

[0206] The audio component 510 is configured to output and / or input an audio signal. For example, the audio component 510 includes a microphone (MIC) to receive an external audio signal when the electronic device 500 is in an operating mode, such as a call mode, a recording mode, and a voice recognition mode. The received audio signal can be further stored in the memory 504 or transmitted via the communication component 516. In some embodiments, the audio component 510 further includes a speaker to output an audio signal.

[0207] The input / output interface 512 provides an interface between the processing component 502 and peripheral interface modules, which can be a keypad, a click wheel, buttons, and the like. The buttons can include, but are not limited to, a home button, a volume button, a start button, and a lock button.

[0208] The sensor component 514 includes one or more sensors to provide various state assessments for the electronic device 500. For example, the sensor component 514 can detect an open / closed state of the electronic device 500, relative positioning of components, such as a display and a keypad of the electronic device 500, a change in position of the electronic device 500 or a component of the electronic device 500, presence or absence of user contact with the electronic device 500, orientation or acceleration / deceleration of the electronic device 500, and a temperature change of the electronic device 500. The sensor component 514 can include a proximity sensor to detect presence of an object within a proximity range of the electronic device 500 without any physical contact. The sensor component 514 can further include a light sensor, such as a CMOS or CCD image sensor, to use in an imaging application. In some embodiments, the sensor component 514 can further include an acceleration sensor, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.

[0209] The communication component 516 is configured to facilitate wired or wireless communication between the electronic device 500 and other devices. The electronic device 500 can access a wireless network based on a communication standard, such as WiFi, 2G, or 3G, or a combination thereof. In an example embodiment, the communication component 516 receives a broadcast signal or broadcast related information from an external broadcast management system via a broadcast channel. In an example embodiment, the communication component 516 further includes a Near Field Communication (NFC) module to facilitate short-range communication. For example, the NFC module can be implemented based on Radio Frequency Identification (RFID) techniques, infrared data association (IrDA) techniques, ultra-wideband (UWB) techniques, Bluetooth (BT) techniques, and other techniques.

[0210] In an example embodiment, the electronic device 500 can be implemented by one or more application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), controllers, micro-controllers, microprocessors, or other electronic elements, for performing the above-described methods.

[0211] In an example embodiment, a non-transitory computer-readable storage medium including instructions, such as the memory 504 including instructions, is also provided, which can be executed by the processor 520 of the electronic device 500 to complete the above-described methods. For example, the non-transitory computer-readable storage medium can be a ROM, a random access memory (RAM), a CD-ROM, a magnetic tape, a floppy disc, and an optical data storage device, etc.

[0212] Figure 6 is a structural schematic diagram of a chip 600 according to an embodiment of the present disclosure. For the case where the electronic device 500 can be a chip or a chip system, reference can be made to the structural schematic diagram of the chip 600 shown in Figure 6 but is not limited thereto.

[0213] The chip 600 includes one or more processors 601. The chip 600 is configured to execute any of the above-described methods.

[0214] In some embodiments, the chip 600 further comprises one or more interface circuits 602. Optionally, the terms interface circuit, interface, transceiver pin, etc. can be replaced by each other. In some embodiments, the chip 600 further comprises one or more memories 603 for storing data and / or instructions. Optionally, all or part of the memory 603 can be outside the chip 600. Optionally, the interface circuit 602 is connected with the memory 603, the interface circuit 602 can be used to receive data and / or instructions from the memory 603 or other devices, the interface circuit 602 can be used to send data and / or instructions to the memory 603 or other devices. For example, the interface circuit 602 can read the data and / or instructions stored in the memory 603 and send the data and / or instructions to the processor 601.

[0215] In some embodiments, the processor 601 performs at least one of the processing steps (for example, step S101, step S102, step S103, step S201, step S202, step S203, step S204, step S301, but not limited to this).

[0216] The modules and / or devices described in each embodiment of the virtual device, the physical device, the chip, etc. can be combined or separated as appropriate. Optionally, part or all of the steps can also be performed by multiple modules and / or devices in cooperation, which is not limited here.

[0217] The disclosure also proposes a storage medium, and the storage medium stores instructions, when the instructions run on an electronic device, the electronic device executes any of the above methods. Optionally, the storage medium is an electronic storage medium. Optionally, the storage medium is a computer readable storage medium, but not limited to this, it can also be a storage medium readable by other devices. Optionally, the storage medium can be a non-transitory storage medium, but not limited to this, it can also be a transitory storage medium.

[0218] The disclosure also proposes a program product, including a program and / or instructions, when the program and / or instructions are executed by an electronic device, the electronic device executes any of the above methods. Optionally, the program product is a computer program product. Optionally, the program product is stored on the storage medium.

[0219] The disclosure also proposes a computer program, when it runs on a computer, the computer executes any of the above methods.

Claims

1. An audio processing method, characterized in that, Performed by an electronic device equipped with multiple microphones, the method includes: The left channel output signal and the right channel output signal are acquired. The left channel output signal is obtained by processing the sound signals collected by the multiple microphones through a first filter. The right channel output signal is obtained by processing the sound signals through a second filter. The first filter and the second filter use different reference points to construct the steering vector.

2. The method according to claim 1, characterized in that, The reference point refers to the benchmark point that defines the phase or spatial position relationship of the guide vector.

3. The method according to claim 1 or 2, characterized in that, In the first guide vector of the first filter and the second guide vector of the second filter, at least one of the co-position elements has different phase information.

4. The method according to any one of claims 1-3, characterized in that, The reference point includes: a first reference point for constructing the first steering vector of the first filter; The method further includes: The first reference point is determined based on the position of the first microphone, where the first microphone refers to the microphone located at the farthest end in the first direction among the plurality of microphones.

5. The method according to any one of claims 1-4, characterized in that, The reference point includes: a second reference point for constructing the second steering vector of the second filter; The method further includes: The second reference point is determined based on the position of the second microphone, which refers to the microphone located at the farthest end in a second direction among the plurality of microphones, and the second direction is opposite to the first direction.

6. An electronic device, characterized in that, The electronic device is used to perform the audio processing method according to any one of claims 1-5.

7. A storage medium storing instructions, characterized in that, When the instructions are executed on an electronic device, the electronic device causes the electronic device to perform the audio processing method according to any one of claims 1-5.

8. A program product comprising at least one of a program and instructions, characterized in that, When at least one of the programs or instructions is executed by an electronic device, it implements the audio processing method of any one of claims 1-5.

Images