Audio processing method, electronic device, storage medium and program product

Abstract

The invention discloses an audio processing method, electronic equipment, a storage medium and a program product. The method comprises the following steps: acquiring a left channel output signal which is obtained according to any one of two audio signals acquired by two microphones and a first audio signal, the first audio signal is obtained by processing the other audio signal in the two audio signals through a left channel filter; a right channel output signal is obtained, the right channel output signal is obtained according to any one of the two audio signals and a second audio signal, and the second audio signal is obtained by processing the other one of the two audio signals through a right channel filter. By adopting the mode, high-quality stereo output can be realized.

Description

Technical Field

[0001] This disclosure relates to the field of communication technology, and in particular to an audio processing method, electronic device, storage medium, and program product. Background Technology

[0002] Audio processing technology is widely used in various scenarios in current electronic devices, such as video calls, speech recognition, and music recording. To provide a better audio experience, many electronic devices are equipped with multiple microphones. However, how to effectively utilize the sound signals collected by these microphones to achieve high-quality audio output has always been an important research topic in the field of audio processing. Summary of the Invention

[0003] To achieve high-quality audio output, embodiments of this disclosure provide an audio processing method, an electronic device, a storage medium, and a program product.

[0004] According to a first aspect of the present disclosure, an audio processing method is provided, executed by an electronic device, the method comprising: acquiring a left channel output signal, the left channel output signal being obtained based on any one of two audio signals acquired by two microphones and a first audio signal, wherein the first audio signal is obtained by processing the other of the two audio signals using a left channel filter; and acquiring a right channel output signal, the right channel output signal being obtained based on any one of the two audio signals and a second audio signal, wherein the second audio signal is obtained by processing the other of the two audio signals using a right channel filter.

[0005] According to a second aspect of the present disclosure, an electronic device is provided for performing the audio processing method described in the first aspect.

[0006] According to a third aspect of the present disclosure, a storage medium is provided that stores instructions that, when executed on an electronic device, cause the electronic device to perform the audio processing method described in the first aspect.

[0007] According to a fourth aspect of the present disclosure, a program product is provided, including at least one of a program and instructions, wherein the at least one of the program and instructions, when executed by an electronic device, implements the audio processing method described in the first aspect.

[0008] By adopting the above technical solution, high-quality stereo output can be achieved. Attached Figure Description

[0009] To more clearly illustrate the technical solutions in the embodiments of this disclosure, the accompanying drawings required for the description of the embodiments are introduced below. The following drawings are only some embodiments of this disclosure and do not impose specific limitations on the protection scope of this disclosure.

[0010] Figure 1 This is a schematic flowchart illustrating an audio processing method according to an embodiment of the present disclosure.

[0011] Figure 2 This is a schematic flowchart illustrating an audio processing method according to an embodiment of the present disclosure.

[0012] Figure 3 This is a schematic diagram of the structure of an electronic device according to an embodiment of the present disclosure.

[0013] Figure 4 This is a schematic diagram of the structure of another electronic device according to an embodiment of the present disclosure.

[0014] Figure 5 This is a schematic diagram of the structure of a chip according to an embodiment of the present disclosure. Detailed Implementation

[0015] This disclosure provides an audio processing method, an electronic device, a storage medium, and a program product.

[0016] In a first aspect, embodiments of this disclosure provide an audio processing method executed by an electronic device, the method comprising: acquiring a left channel output signal, the left channel output signal being obtained based on any one of two audio signals acquired by two microphones and a first audio signal, wherein the first audio signal is obtained by processing the other of the two audio signals using a left channel filter; and acquiring a right channel output signal, the right channel output signal being obtained based on any one of the two audio signals and a second audio signal, wherein the second audio signal is obtained by processing the other of the two audio signals using a right channel filter.

[0017] In the above embodiment, a first audio signal is obtained by processing either of the two audio signals using a left channel filter, and a left channel output signal is obtained based on the first audio signal and the other audio signal. Similarly, a second audio signal is obtained by processing either of the two audio signals using a right channel filter, and a right channel output signal is obtained based on the second audio signal and the other audio signal. This provides left and right channel output signals that meet stereo requirements, thereby achieving high-quality stereo output.

[0018] In conjunction with some embodiments of the first aspect, in some embodiments, the electronic device is equipped with a plurality of microphones, wherein the two microphones are a first microphone and a second microphone whose projections on a horizontal line to the left or right do not overlap.

[0019] In the above embodiments, by selecting two microphones, namely the first microphone and the second microphone, that do not overlap when projected on the horizontal line to the left or right, and performing audio processing on the audio signals collected by the two microphones, not only is the processing volume small and the processing efficiency high, but it can also suppress signal interference in the specified direction, effectively enhance the stereo effect, and improve the separation and spatial sense of the left and right channel signals.

[0020] In conjunction with some embodiments of the first aspect, in some embodiments, the left channel filter is used to minimize the signal difference between the first microphone and the second microphone at a first angle.

[0021] In the above embodiment, by using a left channel filter to minimize the signal difference between the two microphones at the first angle, the directivity of the left channel signal can be optimized, the influence of noise at the first angle on the left channel can be reduced, and the effect of the left channel output signal can be improved.

[0022] In conjunction with some embodiments of the first aspect, in some embodiments, the left channel filter satisfies the following formula:

[0023] H L =D L1 *(D L1 ′*D L1 ) -1 *D L2 ;

[0024] Among them, H L D represents the left channel filter. L1 D represents the guide vector of the first microphone at the first angle. L1 ′ represents D L1 The conjugate transpose of D L2 This represents the guide vector of the second microphone at the first angle.

[0025] In the above embodiment, the left channel filter H L Based on the guide vectors of the first and second microphones at the first angle and their related conjugate transposes, the signal difference between the two microphones at the first angle is minimized. This effectively reduces the left channel signal strength in the direction corresponding to the first angle, which can facilitate the improvement of stereo separation and thus optimize the quality of the left channel output signal.

[0026] In conjunction with some embodiments of the first aspect, in some embodiments, the left channel filter satisfies the following formula:

[0027] H L =D L2 *(D L2 ′*D L2 ) -1 *D L1 ;

[0028] Among them, H L D represents the left channel filter. L2 D represents the guide vector of the second microphone at the first angle. L2 ′ represents D L2 The conjugate transpose of D L1 This represents the guide vector of the first microphone at the first angle.

[0029] In the above embodiment, the left channel filter H L Based on the guide vectors of the first and second microphones at the first angle and their related conjugate transposes, the signal difference between the two microphones at the first angle is minimized. This effectively reduces the left channel signal strength in the direction corresponding to the first angle, which can facilitate the improvement of stereo separation and thus optimize the quality of the left channel output signal.

[0030] In conjunction with some embodiments of the first aspect, in some embodiments, obtaining the left channel output signal based on any one of the two audio signals and the first audio signal includes:

[0031] The left channel output signal L is obtained according to any one of the following formulas:

[0032] L = mic1 × H L -mic2;

[0033] L = mic2 - mic1 × H L ;

[0034] L = mic1 - mic2 × H L ;

[0035] L = mic² × H L -mic1;

[0036] Where mic1 represents the audio signal captured by the first microphone, mic2 represents the audio signal captured by the second microphone, and mic1×H L and mic2×H L Both refer to the first audio signal.

[0037] In the above embodiments, by using any of the above formulas for the left channel output signal L, the interference of noise in the direction corresponding to the first angle on the left channel output signal can be suppressed or even completely eliminated, thereby improving the quality of the left channel output signal.

[0038] In conjunction with some embodiments of the first aspect, in some embodiments, the first angle is +90°, representing a horizontal direction to the right.

[0039] In the above embodiment, by setting the first angle to +90°, that is, the horizontal right direction, the sound signal incident from this direction can be specifically optimized, thereby improving the stereo effect.

[0040] In conjunction with some embodiments of the first aspect, in some embodiments, the right channel filter is used to minimize the signal difference between the first microphone and the second microphone at a second angle.

[0041] In the above embodiment, by using a right channel filter to minimize the signal difference between the two microphones at the second angle, the directivity of the right channel signal can be optimized, the influence of noise at the second angle on the right channel can be reduced, and the effect of the right channel output signal can be improved.

[0042] In conjunction with some embodiments of the first aspect, in some embodiments, the right channel filter satisfies the following formula:

[0043] H R =D R1 *(D R1 ′*D R1 ) -1 *D R2 ;

[0044] Among them, H R D represents the right channel filter. R1 D represents the guide vector of the first microphone at the second angle. R1 ′ represents D R1 The conjugate transpose of D R2 This represents the guide vector of the second microphone at the second angle.

[0045] In the above embodiment, the right channel filter H R Based on the guide vectors of the first and second microphones at the second angle and their related conjugate transposes, the signal difference between the two microphones at the second angle is minimized. This effectively reduces the right channel signal strength in the direction corresponding to the second angle, which can facilitate the improvement of stereo separation and thus optimize the quality of the right channel output signal.

[0046] In conjunction with some embodiments of the first aspect, in some embodiments, the right channel filter satisfies the following formula:

[0047] H R =D R2 *(D R2 ′*D R2 ) -1 *D R1 ;

[0048] Among them, H R D represents the right channel filter. R2 D represents the guide vector of the second microphone at the second angle. R2 ′ represents D R2 The conjugate transpose of D R1 This represents the guide vector of the first microphone at the second angle.

[0049] In the above embodiment, the right channel filter H R Based on the guide vectors of the first and second microphones at the second angle and their related conjugate transposes, the signal difference between the two microphones at the second angle is minimized. This effectively reduces the right channel signal strength in the direction corresponding to the second angle, which can facilitate the improvement of stereo separation and thus optimize the quality of the right channel output signal.

[0050] In conjunction with some embodiments of the first aspect, in some embodiments, obtaining the right channel output signal based on any one of the two audio signals and the second audio signal includes:

[0051] The right channel output signal R is obtained according to any one of the following formulas:

[0052] R = mic1 × H R -mic2;

[0053] R = mic2 - mic1 × H R ;

[0054] R = mic1 - mic2 × H R ;

[0055] R = mic² × H R -mic1;

[0056] Where mic1 represents the audio signal captured by the first microphone, mic2 represents the audio signal captured by the second microphone, and mic1×H R and mic2×H R Both refer to the second audio signal.

[0057] In the above embodiments, by using any of the above formulas for the right channel output signal R, the interference of noise in the direction corresponding to the second angle on the right channel output signal can be suppressed or even completely eliminated, thereby improving the quality of the right channel output signal.

[0058] In conjunction with some embodiments of the first aspect, in some embodiments, the second angle is -90°, representing a horizontal leftward direction.

[0059] In the above embodiment, by setting the second angle to -90°, that is, the horizontal left direction, the sound signal incident from this direction can be specifically optimized, thereby improving the stereo effect.

[0060] In a second aspect, embodiments of this disclosure provide an audio processing apparatus, which includes at least one of a transceiver module and a processing module; wherein the electronic device is used to execute an optional implementation of the first aspect.

[0061] Thirdly, embodiments of this disclosure provide an electronic device comprising: one or more processors; wherein the electronic device is configured to perform an optional implementation of the first aspect.

[0062] Fourthly, embodiments of this disclosure provide a storage medium storing instructions that, when executed on an electronic device, cause the electronic device to perform the method described in the optional implementation of the first aspect.

[0063] Fifthly, embodiments of this disclosure provide a program product, which includes at least one of a program and instructions. When the program product is executed by an electronic device, it causes the electronic device to perform the method described in the optional implementation of the first aspect.

[0064] In a sixth aspect, embodiments of this disclosure provide a computer program that, when run on a computer, causes the computer to perform the method as described in an alternative implementation of the first aspect.

[0065] In a seventh aspect, embodiments of this disclosure provide a chip or chip system. The chip or chip system includes processing circuitry configured to perform the method described in the optional implementation of the first aspect above.

[0066] It is understood that the aforementioned audio processing apparatus, electronic device, storage medium, program product, computer program, etc., are all used to execute the methods proposed in the embodiments of this disclosure. Therefore, the beneficial effects that can be achieved can be referred to the beneficial effects in the corresponding methods, and will not be repeated here.

[0067] This disclosure provides an audio processing method, an electronic device, a storage medium, and a program product. In some embodiments, the terms audio processing method, signal processing method, stereo acquisition method, etc., may be used interchangeably.

[0068] This disclosure is not exhaustive, but merely illustrative of some embodiments, and is not intended to limit the scope of protection of this disclosure. Unless otherwise specified, each step in a particular embodiment can be implemented as an independent embodiment, and the steps can be arbitrarily combined. For example, a solution after removing some steps in a particular embodiment can also be implemented as an independent embodiment, and the order of the steps in a particular embodiment can be arbitrarily interchanged. Furthermore, the optional implementation methods in a particular embodiment can be arbitrarily combined; moreover, the embodiments can be arbitrarily combined, for example, some or all steps of different embodiments can be arbitrarily combined, and a particular embodiment can be arbitrarily combined with the optional implementation methods of other embodiments. In all embodiments of this disclosure, unless otherwise specified or logically conflicting, the terminology and / or descriptions between the embodiments are consistent and can be mutually referenced. Technical features in different embodiments can be combined to form new embodiments based on their inherent logical relationships.

[0069] The terminology used in the embodiments of this disclosure is for the purpose of describing particular embodiments only and is not intended to limit the scope of this disclosure.

[0070] In this embodiment of the disclosure, unless otherwise stated, elements expressed in the singular form, such as "a," "an," "the," "the," "the," "the," "the," "the," "this," etc., can mean "one and only one," or "one or more," "at least one," etc. For example, when using articles such as "a," "an," "the," etc. in translation, the noun following the article can be understood as either a singular expression or a plural expression.

[0071] In the embodiments disclosed herein, "multiple" refers to two or more.

[0072] In some embodiments, the terms "at least one of A or B, at least one of A and B", "one or more", "a plurality of", "multiple" and the like can be used interchangeably.

[0073] In some embodiments, the notation "at least one of A and B", "A and / or B", "A in one case, B in another", "in response to one case A, in response to another case B", etc., may include the following technical solutions depending on the situation: in some embodiments, A (execute A regardless of whether there is a branch B); in some embodiments, B (execute B regardless of whether there is a branch A); in some embodiments, execution is selected from A and B (A and B are selectively executed); in some embodiments, both A and B are executed. The same applies when there are more branches such as A, B, C, etc.

[0074] In some embodiments, the notation "A or B" may include the following technical solutions, depending on the situation: in some embodiments, A (execute A regardless of whether a branch B exists); in some embodiments, B (execute B regardless of whether a branch A exists); in some embodiments, execution is selected from A and B (A and B are selectively executed). The same applies when there are more branches such as A, B, and C.

[0075] The prefixes "first," "second," etc., used in the embodiments of this disclosure are merely for distinguishing different descriptive objects and do not impose restrictions on the position, order, priority, quantity, or content of the descriptive objects. The description of the descriptive objects is found in the claims or the context of the embodiments, and the use of prefixes should not constitute unnecessary restrictions. For example, if the descriptive object is a "field," the ordinal numbers preceding "field" in "first field" and "second field" do not restrict the position or order of the "fields." "First" and "second" do not restrict whether the "fields" they modify are in the same message, nor do they restrict the order of "first field" and "second field." Similarly, if the descriptive object is a "level," the ordinal numbers preceding "level" in "first level" and "second level" do not restrict the priority between "levels." Furthermore, the number of descriptive objects is not limited by ordinal numbers and can be one or more. For example, in "first device," the number of "devices" can be one or more. Furthermore, the objects modified by different prefixes can be the same or different. For example, if the object being described is "device", then "first device" and "second device" can be the same device or different devices, and their types can be the same or different. Similarly, if the object being described is "information", then "first information" and "second information" can be the same information or different information, and their content can be the same or different.

[0076] In some embodiments, “including A,” “containing A,” “for indicating A,” and “carrying A” can be interpreted as directly carrying A or indirectly indicating A.

[0077] In some embodiments, terms such as “in response to…”, “in response to determining…”, “in the case of…”, “when…”, “when…”, “if…”, etc. can be used interchangeably. These descriptions all refer to the device making a corresponding action under certain objective circumstances. They do not necessarily limit the time, nor do they require the device to make a judgment action when implementing it, nor do they mean that there must be other limitations.

[0078] In some embodiments, the terms “greater than,” “greater than or equal to,” “not less than,” “more than,” “more than or equal to,” “not less than,” “higher than,” “higher than or equal to,” “not lower than,” and “above” can be used interchangeably, as can the terms “less than,” “less than or equal to,” “not greater than,” “less than,” “less than or equal to,” “not more than,” “lower than,” “lower than or equal to,” “not higher than,” and “below”.

[0079] In some embodiments, devices, etc., may be interpreted as physical or virtual, and their names are not limited to those described in the embodiments. Terms such as “device,” “equipment,” “circuit,” “network element,” “network function,” “network device,” “function,” “node,” “unit,” “section,” “system,” “network,” “chip,” “chip system,” “entity,” and “subject” are interchangeable.

[0080] In some embodiments, the acquisition of data, information, etc., may comply with the laws and regulations of the country where the location is situated.

[0081] In some embodiments, data, information, etc., may be obtained with the user's consent.

[0082] Furthermore, each element, each row, or each column in the table of this disclosure can be implemented as an independent embodiment, and any combination of any element, any row, or any column can also be implemented as an independent embodiment.

[0083] In some embodiments, the audio processing method of this disclosure is applied to an electronic device having multiple sound acquisition devices, such as microphones. In some embodiments, the electronic device also has audio processing capabilities, such as the ability to execute the audio processing method of the embodiments of this disclosure.

[0084] In some embodiments, the electronic device may be a terminal. Terminals include, but are not limited to, at least one of the following: mobile phones, wearable devices with audio processing capabilities, Internet of Things (IoT) devices, automobiles, smart cars, tablets, computers with wireless transceiver capabilities, virtual reality (VR) terminal devices, augmented reality (AR) terminal devices, wireless terminal devices in industrial control, wireless terminal devices in self-driving, wireless terminal devices in remote medical surgery, wireless terminal devices in smart grids, wireless terminal devices in transportation safety, wireless terminal devices in smart cities, and wireless terminal devices in smart homes.

[0085] In some embodiments, the terms "terminal", "terminal device", "user equipment (UE)", "user terminal", "mobile station (MS)", "mobile terminal (MT)", subscriber station, mobile unit, subscriber unit, wireless unit, remote unit, mobile device, wireless device, wireless communication device, remote device, mobile subscriberstation, access terminal, mobile terminal, wireless terminal, remote terminal, handset, user agent, mobile client, and client can be used interchangeably.

[0086] In some embodiments, the electronic device may be a network device with audio processing capabilities. The network device may include at least one of access network equipment and core network equipment, which is not limited herein.

[0087] In some embodiments, stereo meets the following performance requirements:

[0088] 1. Estimated sound source direction ζ(φ) in stereo sound image i The φ should be monotonically increasing between -60° and +60°, that is, for i = 3, ..., 6, we have ζ(φ i )-ζ(φ i-1 )≥10%, where i is the source direction index. This requirement verifies that the estimated stereo image is within the relevant source direction φ. i The above is consistent.

[0089] 2. The estimated sound source direction in the stereo image should provide a minimum and symmetrical width between φ2 and φ6, i.e., |ζ(φ2)| and ζ(φ6) should be greater than or equal to 60%.

[0090] 3. The estimated sound source direction in the stereo image should remain consistent at the edge, i.e., ζ(φ1)≤ζ(φ2) and ζ(φ7)≥ζ(φ6).

[0091] 4. For a frontal incident position (φ4=0°), the estimated sound source direction should be located at the center of the stereo image, i.e., |ζ(φ4)|<3%.

[0092] 5. For all L=7 sound source directions, the absolute value of the inter-channel time difference (ICTD) should be less than 1.5 milliseconds.

[0093] The definitions of the seven sound source directions mentioned above can be found in relevant technologies, and will not be explained in this disclosure.

[0094] Figure 1 This is a schematic flowchart illustrating an audio processing method according to an embodiment of the present disclosure. The embodiments of the present disclosure relate to an audio processing method executed by an electronic device equipped with multiple sound acquisition devices, or the electronic device having multiple external sound acquisition devices, wherein the sound acquisition devices are, for example, microphones. Figure 1 As shown, the above method includes at least one of the following steps:

[0095] Step S101: Select two microphones.

[0096] In some embodiments, the electronic device can capture sound signals through multiple microphones. The number of microphones is greater than or equal to two. Multiple microphones can capture sound signals from more directions and in greater variety, thereby more accurately reproducing stereo sound and improving stereo quality.

[0097] In some embodiments, the arrangement of the multiple microphones, i.e., the microphone array, is not limited in this disclosure. The microphone array may be a linear array or other shapes.

[0098] In some embodiments, if the electronic device is equipped with only two microphones or only externally connected to two microphones, step S101 may be omitted. Furthermore, when the projections of the two microphones on the horizontal lines to the left or right do not overlap, the embodiments of this disclosure can maximize the quality of the stereo output.

[0099] In some embodiments, the horizontal lines to the left or right in this disclosure can be understood as lines parallel to or coinciding with the left or right direction of the electronic device.

[0100] The following example uses a mobile phone to illustrate the left-side direction. When the phone is in portrait mode (screen up or down, or screen forward or backward), the left-side direction refers to the direction parallel to the top / bottom short edge of the phone and pointing to the left. When the phone is in landscape mode (screen up or down, or screen forward or backward), the left-side direction refers to the direction parallel to the top / bottom long edge of the phone and pointing to the left.

[0101] The following uses a mobile phone as an example to illustrate the direction of the right side. When the phone is in portrait mode (screen up or down, or screen forward or backward), the direction of the right side refers to the direction parallel to the top / bottom short edge of the phone and pointing to the right. When the phone is in landscape mode (screen up or down, or screen forward or backward), the direction of the right side refers to the direction parallel to the top / bottom long edge of the phone and pointing to the right.

[0102] In other embodiments, it is assumed that the front of the electronic device is 0°, corresponding to the positive direction of the Y-axis in the coordinate system. Furthermore, it is assumed that the right side of the electronic device is 90°, corresponding to the positive direction of the X-axis in the coordinate system. Furthermore, it is assumed that the left side of the electronic device is -90°, corresponding to the opposite direction of the X-axis. And it is assumed that the top of the electronic device is the positive direction of the Z-axis. Based on this coordinate system, the horizontal line to the left or right in this embodiment can be understood as the X-axis, or as a line parallel to the X-axis. The non-overlapping projections of the two microphones on the horizontal line to the left or right refer to the non-overlapping projections of the two microphones on the X-axis, including at least one of the following:

[0103] The two microphones do not overlap in their projections on the X-axis, but overlap in their projections on the Y-axis and Z-axis.

[0104] The two microphones do not overlap in their projections on the X-axis and Y-axis, but they do overlap in their projections on the Z-axis.

[0105] The two microphones do not overlap in projection on the X-axis, but overlap in projection on the Y-axis and do not overlap in projection on the Z-axis.

[0106] The projections of the two microphones do not overlap on the X-axis, Y-axis, and Z-axis.

[0107] In some embodiments, if the electronic device is equipped with or has three or more microphones connected to it, then step S101 is performed.

[0108] In some embodiments, the implementation of selecting two microphones may include selecting two microphones from three or more microphones whose projections do not overlap on a horizontal line to the left or right.

[0109] In some embodiments, the two selected microphones may be referred to as a first microphone and a second microphone. The projections of the first microphone and the second microphone on a horizontal line to the left or right do not overlap.

[0110] It should be noted that the relative positions of the first microphone and the second microphone are not limited in the embodiments disclosed herein. For example, the projection position of the first microphone may be to the left of the projection position of the second microphone. For example, the projection position of the first microphone may be to the right of the projection position of the second microphone.

[0111] Since the two microphones selected in this embodiment are a first microphone and a second microphone whose projections do not overlap on the horizontal lines to the left or right, this embodiment can be well adapted to electronic devices such as mobile phones in different orientations, such as landscape and portrait modes.

[0112] Step S102: Process any one of the two audio signals acquired by the two microphones using the left channel filter to obtain the first audio signal.

[0113] In some embodiments, the terms "audio tract" and "channel" or "path" may be used interchangeably.

[0114] In some embodiments, the left channel filter is used to minimize the signal difference between the first microphone and the second microphone at a first angle.

[0115] In some embodiments, the left channel filter is used to minimize the differences in amplitude, phase, etc., between the signals corresponding to the first microphone and the second microphone at a first angle.

[0116] In some embodiments, the left channel filter is used to make the amplitude and phase of the first microphone and the second microphone equal at the first angle.

[0117] In some embodiments, the left channel filter satisfies the following formula:

[0118] H L =D L1 *(D L1 ′*D L1 ) -1 *D L2 ;

[0119] Among them, H L D represents the left channel filter. L1 D represents the guide vector of the first microphone at the first angle. L1 ′ represents D L1 The conjugate transpose of D L2 This represents the guide vector of the second microphone at the first angle, (D) L1 ′*D L1 ) -1 Indicates (D) L1 ′*D L1 The inverse operation of ).

[0120] In some embodiments, the left channel filter satisfies the following formula:

[0121] H L =D L2 *(D L2 ′*D L2 ) -1 *D L1 ;

[0122] Among them, H L D represents the left channel filter. L2 D represents the guide vector of the second microphone at the first angle. L2 ′ represents D L2 The conjugate transpose of D L1 This represents the guide vector of the first microphone at the first angle, (D) L2 ′*D L2 ) -1 D represents L2 ′*D L2 The inverse operation.

[0123] In some embodiments, assuming the front of the electronic device is 0°, the first angle can be +90°, representing a horizontal rightward direction, which can be understood as the right-side direction. The signal at the first angle refers to the signal received from the +90° direction, which can be understood as the signal incident from the +90° direction, or as the signal originating from the +90° direction, or as the signal being a right-side signal.

[0124] In some embodiments, processing any one of the two audio signals acquired by the two microphones through a left channel filter to obtain a first audio signal includes: inputting any one of the two audio signals acquired by the two microphones into a left channel filter to obtain a first audio signal.

[0125] For example, suppose mic1 represents the audio signal captured by the first microphone, and mic2 represents the audio signal captured by the second microphone. Then, mic1 can be input to the left channel filter H. L The first audio signal mic1×H is obtained. L .

[0126] For example, suppose mic1 represents the audio signal captured by the first microphone, and mic2 represents the audio signal captured by the second microphone. Then, mic2 can be input to the left channel filter H. L The first audio signal mic2×H is obtained. L .

[0127] It should be noted that the first audio signal represents the left channel filter H. L The result obtained by processing either of the two audio signals, the name of the first audio signal is not limited.

[0128] Step S103: Obtain the left channel output signal based on the first audio signal and another audio signal from the two audio signals collected by the two microphones.

[0129] In some embodiments, obtaining the left channel output signal based on the first audio signal and another audio signal from the two audio signals acquired by the two microphones includes obtaining the left channel output signal L according to any one of the following formulas:

[0130] L = mic1 × H L -mic2;

[0131] L = mic2 - mic1 × H L ;

[0132] L = mic1 - mic2 × H L ;

[0133] L = mic² × HL -mic1;

[0134] Wherein, mic1 represents the audio signal collected by the first microphone, and mic2 represents the audio signal collected by the second microphone.

[0135] For example, suppose that by processing any one of the two audio signals (e.g., mic1) acquired by the two microphones through a left channel filter, the first audio signal is mic1×H. L Then, based on the first audio signal mic1×H L The left channel output signal L = mic1 × H is obtained by combining the other audio signal (i.e., mic2) from the two audio signals collected by the two microphones. L -mic2, or, L = mic2 - mic1 × H L .

[0136] For example, suppose that by processing any one of the two audio signals (e.g., mic2) acquired by the two microphones through a left channel filter, the first audio signal is mic2×H. L Then, based on the first audio signal mic2×H L The left channel output signal L = mic1 - mic2 × H is obtained from the other audio signal (i.e., mic1) among the two audio signals collected by the two microphones. L Or, L = mic² × H L -mic1.

[0137] By using any of the above formulas for calculating the left channel output signal, it is possible to suppress or even completely eliminate the signal at the first angle (i.e., the right signal). Since the signal at the first angle (i.e., the right signal) is suppressed, it is equivalent to enhancing the signal at other angles (i.e., the left signal). By enhancing the left signal and suppressing the right signal, the quality of the left channel output signal can be improved.

[0138] Step S104: Process any one of the two audio signals acquired by the two microphones using the right channel filter to obtain the second audio signal.

[0139] In some embodiments, the right channel filter is used to minimize the signal difference between the first microphone and the second microphone at a second angle.

[0140] In some embodiments, the right channel filter is used to minimize the differences in amplitude, phase, etc., between the signals corresponding to the first microphone and the second microphone at a second angle.

[0141] In some embodiments, the right channel filter is used to make the amplitude and phase of the first microphone and the second microphone equal at the second angle.

[0142] In some embodiments, the right channel filter satisfies the following formula:

[0143] H R =D R1 *(D R1 ′*D R1 ) -1 *D R2 ;

[0144] Among them, H R D represents the right channel filter. R1 D represents the guide vector of the first microphone at the second angle. R1 ′ represents D R1 The conjugate transpose of D R2 This represents the guide vector of the second microphone at the second angle, (D) R1 ′*D R1 ) -1 D represents R1 ′*D R1 The inverse operation.

[0145] In some embodiments, the right channel filter satisfies the following formula:

[0146] H R =D R2 *(D R2 ′*D R2 ) -1 *D R1 ;

[0147] Among them, H R D represents the right channel filter. R2 D represents the guide vector of the second microphone at the second angle. R2 ′ represents D R2 The conjugate transpose of D R1 This represents the guide vector of the first microphone at the second angle, (D) R2 ′*D R2 ) -1 D represents R2 ′*D R2 The inverse operation.

[0148] In some embodiments, assuming the front of the electronic device is 0°, the second angle can be -90°, representing a horizontal leftward direction, which can be understood as the left side. The signal at the second angle refers to the signal received from the -90° direction, which can be understood as the signal incident from the -90° direction, or the signal coming from the -90° direction, or the signal being a left-side signal.

[0149] In some embodiments, the first angle and the second angle are symmetrical with respect to 0° directly in front.

[0150] In some embodiments, processing any one of the two audio signals acquired by the two microphones through a right channel filter to obtain a second audio signal includes: inputting any one of the two audio signals acquired by the two microphones into a right channel filter to obtain a second audio signal.

[0151] For example, suppose mic1 represents the audio signal captured by the first microphone, and mic2 represents the audio signal captured by the second microphone. Then, mic1 can be input to the right channel filter H. R The second audio signal is obtained as mic1×H R .

[0152] For example, suppose mic1 represents the audio signal captured by the first microphone, and mic2 represents the audio signal captured by the second microphone. Then, mic2 can be input to the right channel filter H. L The second audio signal obtained is mic2×H R .

[0153] It should be noted that the second audio signal represents the right channel filter H. R The result obtained by processing either of the two audio signals; the name of the second audio signal is not limited.

[0154] Step S105: The right channel output signal is obtained based on the second audio signal and another audio signal from the two audio signals collected by the two microphones.

[0155] In some embodiments, the implementation of the right channel output signal obtained based on the second audio signal and another audio signal from the two audio signals acquired by the two microphones includes:

[0156] The right channel output signal R can be obtained using any of the following formulas:

[0157] R = mic1 × H R -mic2;

[0158] R = mic2 - mic1 × H R ;

[0159] R = mic1 - mic2 × H R ;

[0160] R = mic² × H R -mic1;

[0161] Wherein, mic1 represents the audio signal collected by the first microphone, and mic2 represents the audio signal collected by the second microphone.

[0162] For example, suppose that by processing any one of the two audio signals (e.g., mic1) acquired by the two microphones through a right channel filter, the second audio signal is mic1×H. R Then, based on the second audio signal mic1×H R The right channel output signal R = mic1 × H is obtained by combining the other audio signal (i.e., mic2) from the two audio signals collected by the two microphones. R -mic2, or, R = mic2 - mic1 × H R .

[0163] For example, suppose that by processing any one of the two audio signals (e.g., mic2) acquired by the two microphones through the right channel filter, the second audio signal is mic2×H. R Then, according to the second audio signal mic2×H R The right channel output signal R = mic1 - mic2 × H is obtained from the other audio signal (i.e., mic1) among the two audio signals collected by the two microphones. R Or, R = mic² × H R -mic1.

[0164] By using any of the above formulas for calculating the right channel output signal, it is possible to suppress or even completely eliminate the signal at the second angle (i.e., the left signal). Since the signal at the second angle (i.e., the left signal) is suppressed, it is equivalent to enhancing the signal at other angles (i.e., the right signal). By enhancing the right signal and suppressing the left signal, the quality of the right channel output signal can be improved.

[0165] It should be explained here that stereo refers to sound reproduced through two channels (i.e., the left channel and the right channel). Stereo technology utilizes the characteristics of human binaural hearing, simulating the direction and spatial sense of sound through the signal differences between the two channels, thereby producing a sense of three-dimensionality. In this embodiment, by using a left channel filter to suppress the right-side signal (i.e., the signal in the +90-degree direction) and a right channel filter to suppress the left-side signal (i.e., the signal in the -90-degree direction), a significant difference in the output signals between the two channels can be achieved. Therefore, the left and right channel output signals obtained in this embodiment not only meet the requirements of stereo format but also improve stereo quality.

[0166] In some embodiments, the names of signals, etc., are not limited to those described in the embodiments, and terms such as "signal," "information," and "data" can be used interchangeably.

[0167] In some embodiments, the terms “acquire”, “get”, “obtain”, “receive”, “collect”, “gather”, etc., can be used interchangeably.

[0168] The audio processing method disclosed herein may include at least one of steps S101 to S105. For example, steps S102 and S103 may be implemented as independent embodiments, and steps S104 and S105 may be implemented as independent embodiments, but are not limited thereto.

[0169] In some embodiments, the order of any two steps S101 to S105 can be interchanged or they can be executed simultaneously. For example, the order of steps S102 and S104 can be interchanged or they can be executed simultaneously, and the order of steps S103 and S105 can be interchanged or they can be executed simultaneously.

[0170] In some embodiments, the steps and their optional implementations in other embodiments described before or after this embodiment, as well as other related parts in the specification, can be referred to, and will not be repeated here.

[0171] Figure 2 This is a schematic flowchart illustrating an audio processing method according to an embodiment of the present disclosure. The embodiments of this disclosure relate to an audio processing method executed by an electronic device. Figure 2 As shown, the above method includes at least one of the following steps:

[0172] Step S201: Obtain the left channel output signal. The left channel output signal is obtained by combining any one of the two audio signals collected by the two microphones with the first audio signal. The first audio signal is obtained by processing the other audio signal among the two audio signals through the left channel filter.

[0173] Step S202: Obtain the right channel output signal. The right channel output signal is obtained based on any one of the two audio signals and the second audio signal. The second audio signal is obtained by processing the other audio signal among the two audio signals through the right channel filter.

[0174] In the above embodiment, a first audio signal is obtained by processing either of the two audio signals using a left channel filter, and a left channel output signal is obtained based on the first audio signal and the other audio signal. Similarly, a second audio signal is obtained by processing either of the two audio signals using a right channel filter, and a right channel output signal is obtained based on the second audio signal and the other audio signal. This provides left and right channel output signals that meet stereo requirements, thereby achieving high-quality stereo output.

[0175] Optionally, the electronic device is equipped with multiple microphones, wherein the two microphones are a first microphone and a second microphone whose projections on a horizontal line to the left or right do not overlap.

[0176] In the above embodiments, by selecting two microphones, namely the first microphone and the second microphone, whose projections do not overlap on the horizontal lines to the left or right, and performing audio processing on the audio signals collected by the two microphones, not only is the processing volume small and the processing efficiency high, but it can also suppress signal interference in the specified direction, effectively enhance the stereo effect, and improve the separation and spatial sense of the left and right channel signals.

[0177] Optionally, the left channel filter is used to minimize the signal difference between the first microphone and the second microphone at a first angle.

[0178] In the above embodiment, by using a left channel filter to minimize the signal difference between the two microphones at the first angle, the directivity of the left channel signal can be optimized, the influence of noise at the first angle on the left channel can be reduced, and the effect of the left channel output signal can be improved.

[0179] Optionally, the left channel filter satisfies the following formula:

[0180] H L =D L1 *(D L1 ′*D L1 ) -1 *D L2 ;

[0181] Among them, H L D represents the left channel filter. L1 D represents the guide vector of the first microphone at the first angle.L1 ′ represents D L1 The conjugate transpose of D L2 This represents the guide vector of the second microphone at the first angle.

[0182] In the above embodiment, the left channel filter H L Based on the guide vectors of the first and second microphones at the first angle and their related conjugate transposes, the signal difference between the two microphones at the first angle is minimized. This effectively reduces the directivity in the direction corresponding to the first angle, which can facilitate the improvement of stereo separation and thus optimize the quality of the left channel output signal.

[0183] Optionally, the left channel filter satisfies the following formula:

[0184] H L =D L2 *(D L2 ′*D L2 ) -1 *D L1 ;

[0185] Among them, H L D represents the left channel filter. L2 D represents the guide vector of the second microphone at the first angle. L2 ′ represents D L2 The conjugate transpose of D L1 This represents the guide vector of the first microphone at the first angle.

[0186] In the above embodiment, the left channel filter H L Based on the guide vectors of the first and second microphones at the first angle and their related conjugate transposes, the signal difference between the two microphones at the first angle is minimized. This effectively reduces the left channel signal strength in the direction corresponding to the first angle, which can facilitate the improvement of stereo separation and thus optimize the quality of the left channel output signal.

[0187] Optionally, the left channel output signal is obtained based on either of the two audio signals and the first audio signal, including:

[0188] The left channel output signal L is obtained according to any one of the following formulas:

[0189] L = mic1 × H L -mic2;

[0190] L = mic2 - mic1 × H L ;

[0191] L = mic1 - mic2 × H L ;

[0192] L = mic² × H L -mic1;

[0193] Where mic1 represents the audio signal captured by the first microphone, mic2 represents the audio signal captured by the second microphone, and mic1×H L and mic2×H L Both refer to the first audio signal.

[0194] In the above embodiments, by using any of the above formulas for the left channel output signal L, the interference of noise in the direction corresponding to the first angle on the left channel output signal can be suppressed or even completely eliminated, thereby improving the quality of the left channel output signal.

[0195] Optionally, the first angle is +90°, representing a horizontal direction to the right.

[0196] In the above embodiment, by setting the first angle to +90°, that is, the horizontal right direction, the sound signal incident from this direction can be specifically optimized, thereby improving the stereo effect.

[0197] Optionally, the right channel filter is used to minimize the signal difference between the first microphone and the second microphone at a second angle.

[0198] In the above embodiment, by using a right channel filter to minimize the signal difference between the two microphones at the second angle, the directivity of the right channel signal can be optimized, the influence of noise at the second angle on the right channel can be reduced, and the effect of the right channel output signal can be improved.

[0199] Optionally, the right channel filter satisfies the following formula:

[0200] H R =D R1 *(D R1 ′*D R1 ) -1 *D R2 ;

[0201] Among them, H R D represents the right channel filter. R1 D represents the guide vector of the first microphone at the second angle. R1 ′ represents D R1 The conjugate transpose of D R2 This represents the guide vector of the second microphone at the second angle.

[0202] In the above embodiment, the right channel filter H RBased on the guide vectors of the first and second microphones at the second angle and their related conjugate transposes, the signal difference between the two microphones at the second angle is minimized. This effectively reduces the directivity in the direction corresponding to the second angle, which can facilitate the improvement of stereo separation and thus optimize the quality of the right channel output signal.

[0203] Optionally, the right channel filter satisfies the following formula:

[0204] H R =D R2 *(D R2 ′*D R2 ) -1 *D R1 ;

[0205] Among them, H R D represents the right channel filter. R2 D represents the guide vector of the second microphone at the second angle. R2 ′ represents D R2 The conjugate transpose of D R1 This represents the guide vector of the first microphone at the second angle.

[0206] In the above embodiment, the right channel filter H R Based on the guide vectors of the first and second microphones at the second angle and their related conjugate transposes, the signal difference between the two microphones at the second angle is minimized. This effectively reduces the right channel signal strength in the direction corresponding to the second angle, which can facilitate the improvement of stereo separation and thus optimize the quality of the right channel output signal.

[0207] Optionally, the right channel output signal is obtained based on either of the two audio signals and the second audio signal, including:

[0208] The right channel output signal R is obtained according to any one of the following formulas:

[0209] R = mic1 × H R -mic2;

[0210] R = mic2 - mic1 × H R ;

[0211] R = mic1 - mic2 × H R ;

[0212] R = mic² × H R -mic1;

[0213] Where mic1 represents the audio signal captured by the first microphone, mic2 represents the audio signal captured by the second microphone, and mic1×H R and mic2×H R Both refer to the second audio signal.

[0214] In the above embodiments, by using any of the above formulas for the right channel output signal R, the interference of noise in the direction corresponding to the second angle on the right channel output signal can be suppressed or even completely eliminated, thereby improving the quality of the right channel output signal.

[0215] Optionally, the second angle is -90°, representing a horizontal leftward direction.

[0216] In the above embodiment, by setting the second angle to -90°, that is, the horizontal left direction, the sound signal incident from this direction can be specifically optimized, thereby improving the stereo effect.

[0217] In some embodiments, the steps and their optional implementations in other embodiments described before or after this embodiment, as well as other related parts in the specification, can be referred to, and will not be repeated here.

[0218] It should be noted that the audio processing method disclosed herein can be applied to scenarios such as stereo recording and speech enhancement.

[0219] The audio processing method disclosed herein uses a mobile phone with N (N greater than or equal to 2) microphones to acquire stereo audio for communication, local storage, etc.

[0220] The audio processing method disclosed herein includes: selecting audio signals collected by two microphones on a mobile phone, processing them through a filter, and outputting stereo audio.

[0221] The audio processing method disclosed herein includes: performing differential beamforming based on the microphone's (mic) steering vector to output the desired stereo audio format. For ease of explanation, the angle directly in front of the UE is defined as 0 degrees, the angle directly to the left as -90°, and the angle directly to the right as 90°.

[0222] In some embodiments, the left channel output signal is L = mic1 × H L -mic2; The right channel output signal is R = mic1 × H R -mic2, where H L =D L1 *(D L1 ′*D L1 ) -1 *D L2 H R =D R1*(D R1 ′*D R1 ) -1 *D R2 .

[0223] In some embodiments, the left channel output signal is L = mic1 - mic2 × H L The right channel output signal is R = mic1 - mic2 × H. R , where H L =D L2 *(D L2 ′*D L2 ) -1 *D L1 H R =D R2 *(D R2 ′*D R2 ) -1 *D R1 .

[0224] In some embodiments, the left channel output signal is L = mic1 × H L -mic2; The right channel output signal is R = mic1 - mic2 × H R , where H L =D L1 *(D L1 ′*D L1 ) -1 *D L2 H R =D R2 *(D R2 ′*D R2 ) -1 *D R1 .

[0225] In some embodiments, the left channel output signal is L = mic1 - mic2 × H L The right channel output signal is R = mic1 × H R -mic2, where H L =D L2 *(D L2 ′*D L2 ) -1 *D L1 H R =D R1 *(D R1 ′*D R1 ) -1 *D R2 .

[0226] In some embodiments, L = mic1 × H L-mic2 and L=mic2-mic1×H L Equivalent.

[0227] In some embodiments, L = mic1 - mic2 × H L With L = mic² × H L -mic1 is equivalent.

[0228] In some embodiments, R = mic1 × H R -mic2 and R = mic2 - mic1 × H R Equivalent.

[0229] In some embodiments, R = mic1 - mic2 × H R With R = mic² × H R -mic1 is equivalent.

[0230] In some embodiments, the parameters in this disclosure are explained as follows:

[0231] D L1 =d1(90°), representing the guide vector of microphone 1 at 90° to the left;

[0232] D L2 =d2(90°), the guide vector of microphone 2 at 90° to the left;

[0233] D R1 =d1(-90°), the guide vector of microphone 1 at 90° to the right;

[0234] D R2 =d2(-90°), the guide vector of microphone 2 at 90° to the right;

[0235] θ represents an angle;

[0236] d N (θ1) represents the guiding vector of micN at angle θ1.

[0237] D′ represents the conjugate transpose of D.

[0238] (D′*D) -1 , represents the inverse of (D′*D);

[0239] mic1 represents the input signal of microphone 1, that is, the audio signal collected by the first microphone;

[0240] mic2 indicates the input signal of microphone 2, that is, the audio signal collected by the second microphone;

[0241] L indicates left channel output;

[0242] R indicates right channel output;

[0243] H L , indicating the filter for the left channel;

[0244] H R , indicating the filter for the right channel.

[0245] It should be noted that, through H L To minimize the amplitude and phase difference between mic1 and mic2 at 90°, for example, make them equal (or minimize the signal difference), thereby minimizing the suppression of the left channel at 90°.

[0246] Similarly, through H R Make mic1 equal to mic2 at -90°, thus minimizing the suppression of the right channel at -90°.

[0247] In some embodiments, the steering vector can also be a transfer function, representing the relative phase and amplitude relationship of signals received by the microphone from the corresponding direction. It can be measured by the device or calculated through simulation based on microphone parameters (e.g., position parameters). Since the design of the same UE is consistent, the steering vectors of UEs of the same model can be considered similar; that is, the obtained steering vector can be used on all similar UEs.

[0248] In some embodiments, the microphone's own steering vector is substituted into the filter, thereby enabling the solution to accommodate inconsistencies between microphones and the performance limitations of the microphones themselves.

[0249] The embodiments of this disclosure can achieve good results even with microphones that have unsatisfactory performance or quality.

[0250] The embodiments disclosed herein are adaptable to mobile phones in different orientations, such as landscape and portrait, and offer greater flexibility in the number and layout of microphones.

[0251] This disclosure also proposes an apparatus (also referred to as an electronic device, etc.) for implementing any of the above audio processing methods. For example, an apparatus is proposed that includes units or modules for implementing the steps performed by the electronic device in any of the above audio processing methods.

[0252] It should be understood that the division of units or modules in the above device is only a logical functional division. In actual implementation, they can be fully or partially integrated into a single physical entity, or they can be physically separated. Furthermore, the units or modules in the device can be implemented by a processor calling software: for example, the device includes a processor connected to a memory containing instructions. The processor calls the instructions stored in the memory to implement any of the above audio processing methods or to implement the functions of each unit or module of the above device. The processor can be, for example, a general-purpose processor, such as a Central Processing Unit (CPU) or a microprocessor, and the memory can be internal or external to the device. Alternatively, the units or modules in the device can be implemented in the form of hardware circuits. The functionality of some or all of the units or modules can be achieved through the design of these hardware circuits, which can be understood as one or more processors. For example, in one implementation, the hardware circuit is an application-specific integrated circuit (ASIC). The functionality of some or all of the units or modules is achieved through the design of the logical relationships between the components within the circuit. In another implementation, the hardware circuit can be implemented using a programmable logic device (PLD). Taking a field-programmable gate array (FPGA) as an example, it can include a large number of logic gates. The connection relationships between the logic gates are configured through a configuration file, thereby achieving the functionality of some or all of the units or modules. All units or modules of the above device can be implemented entirely through processor-called software, entirely through hardware circuits, or partially through processor-called software with the remaining parts implemented through hardware circuits.

[0253] In this embodiment, the processor is a circuit with signal processing capabilities. In one implementation, the processor can be a circuit with instruction read and execute capabilities, such as a Central Processing Unit (CPU), a microprocessor, a graphics processing unit (GPU) (which can be understood as a microprocessor), or a digital signal processor (DSP). In another implementation, the processor can implement certain functions through the logical relationships of hardware circuits. The logical relationships of the aforementioned hardware circuits are fixed or reconfigurable. For example, the processor is a hardware circuit implemented using an application-specific integrated circuit (ASIC) or a programmable logic device (PLD), such as an FPGA. In a reconfigurable hardware circuit, the process of the processor loading a configuration document and configuring the hardware circuit can be understood as the process of the processor loading instructions to implement the functions of some or all of the above units or modules. In addition, it can also be hardware circuits designed for artificial intelligence, which can be understood as ASICs, such as Neural Network Processing Units (NPUs), Tensor Processing Units (TPUs), and Deep Learning Processing Units (DPUs).

[0254] It should be noted that the various embodiments / examples described above in this disclosure can be used in conjunction with the foregoing and / or subsequent embodiments, or they can be used independently. Whether used alone or in conjunction with the foregoing and / or subsequent embodiments, the implementation principle is similar. In this disclosure, some embodiments are described as implementations used together. Of course, such illustrative examples are not intended to limit the scope of this disclosure.

[0255] Figure 3 This is a schematic diagram of an electronic device according to an embodiment of the present disclosure. The electronic device 300 is used to perform any of the above methods. In some embodiments, such as... Figure 3 As shown, the electronic device 300 may include at least one of the following: a transceiver module 301, a processing module 302, etc.

[0256] In some embodiments, the processing module 302 is configured to: acquire a left channel output signal, which is obtained based on any one of two audio signals acquired by two microphones and a first audio signal, wherein the first audio signal is obtained by processing the other audio signal through a left channel filter; and acquire a right channel output signal, which is obtained based on any one of two audio signals and a second audio signal, wherein the second audio signal is obtained by processing the other audio signal through a right channel filter.

[0257] Optionally, the electronic device is equipped with multiple microphones, wherein the two microphones are a first microphone and a second microphone whose projections on a horizontal line to the left or right do not overlap.

[0258] Optionally, the left channel filter is used to minimize the signal difference between the first microphone and the second microphone at a first angle.

[0259] Optionally, the left channel filter satisfies the following formula:

[0260] H L =D L1 *(D l1 ′*D L1 ) -1 *D L2 ;

[0261] Among them, H L D represents the left channel filter. L1 D represents the guide vector of the first microphone at the first angle. L1 ′ represents D L1 The conjugate transpose of D L2 This represents the guide vector of the second microphone at the first angle.

[0262] Optionally, the left channel filter satisfies the following formula:

[0263] H L =D L2 *(D L2 ′*D L2 ) -1 *D L1 ;

[0264] Among them, H L D represents the left channel filter. L2 D represents the guide vector of the second microphone at the first angle. L2 ′ represents D L2 The conjugate transpose of D L1This represents the guide vector of the first microphone at the first angle.

[0265] Optionally, the left channel output signal is obtained based on either of the two audio signals and the first audio signal, including:

[0266] The left channel output signal L is obtained according to any one of the following formulas:

[0267] L = mic1 × H L -mic2;

[0268] L = mic2 - mic1 × H L ;

[0269] L = mic1 - mic2 × H L ;

[0270] L = mic² × H L -mic1;

[0271] Wherein, mic1 represents the audio signal collected by the first microphone, and mic2 represents the audio signal collected by the second microphone.

[0272] Optionally, the first angle is +90°, representing a horizontal direction to the right.

[0273] Optionally, the right channel filter is used to minimize the signal difference between the first microphone and the second microphone at a second angle.

[0274] Optionally, the right channel filter satisfies the following formula:

[0275] H R =D R1 *(D R1 ′*D R1 ) -1 *D R2 ;

[0276] Among them, H R D represents the right channel filter. R1 D represents the guide vector of the first microphone at the second angle. R1 ′ represents D R1 The conjugate transpose of D R2 This represents the guide vector of the second microphone at the second angle.

[0277] Optionally, the right channel filter satisfies the following formula:

[0278] H R =D R2 *(D R2 ′*DR2 ) -1 *D R1 ;

[0279] Among them, H R D represents the right channel filter. R2 D represents the guide vector of the second microphone at the second angle. R2 ′ represents D R2 The conjugate transpose of D R1 This represents the guide vector of the first microphone at the second angle.

[0280] Optionally, the right channel output signal is obtained based on either of the two audio signals and the second audio signal, including:

[0281] The right channel output signal R is obtained according to any one of the following formulas:

[0282] R = mic1 × H R -mic2;

[0283] R = mic2 - mic1 × H R ;

[0284] R = mic1 - mic2 × H R ;

[0285] R = mic² × H R -mic1;

[0286] Wherein, mic1 represents the audio signal collected by the first microphone, and mic2 represents the audio signal collected by the second microphone.

[0287] Optionally, the second angle is -90°, representing a horizontal leftward direction.

[0288] In some embodiments, the transceiver module may include a transmitting module and / or a receiving module, which may be separate or integrated. Optionally, the transceiver module may be interchangeable with a transceiver.

[0289] In some embodiments, the processing module may be a single module or may include multiple sub-modules. Optionally, the multiple sub-modules may each perform all or part of the steps required by the processing module.

[0290] In some embodiments, the processing module can be interchanged with the processor, and the transceiver module can be interchanged with the transceiver.

[0291] Figure 4This is a schematic diagram of another electronic device 500 according to an embodiment of this disclosure. For example, the electronic device 500 may be a mobile phone, computer, digital broadcasting terminal, messaging device, game console, tablet device, medical device, fitness equipment, personal digital assistant, etc.

[0292] Reference Figure 4 The electronic device 500 may include one or more of the following components: processing component 502, memory 504, power supply component 506, multimedia component 508, audio component 510, input / output interface 512, sensor component 514, and communication component 516.

[0293] Processing component 502 typically controls the overall operation of electronic device 500, such as operations associated with display, telephone calls, data communication, camera operation, and recording. Processing component 502 may include one or more processors 520 to execute instructions to perform all or part of the steps of the methods described above. Furthermore, processing component 502 may include one or more modules to facilitate interaction between processing component 502 and other components. For example, processing component 502 may include a multimedia module to facilitate interaction between multimedia component 508 and processing component 502.

[0294] In some embodiments, the processor 520 performs at least one of the processing steps (e.g., steps S101, S102, S103, S104, S105, but not limited thereto).

[0295] Memory 504 is configured to store various types of data to support the operation of electronic device 500. Examples of such data include instructions for any application or method operating on electronic device 500, contact data, phonebook data, messages, pictures, videos, etc. Memory 504 can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic storage, flash memory, magnetic disk, or optical disk.

[0296] Power supply component 506 provides power to various components of electronic device 500. Power supply component 506 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power to electronic device 500.

[0297] Multimedia component 508 includes a screen that provides an output interface between the electronic device 500 and the user. In some embodiments, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen may be implemented as a touchscreen to receive input signals from the user. The touch panel includes one or more touch sensors to sense touches, swipes, and gestures on the touch panel. The touch sensors may sense not only the boundaries of the touch or swipe action but also the duration and pressure associated with the touch or swipe operation. In some embodiments, multimedia component 508 includes a front-facing camera and / or a rear-facing camera. When the electronic device 500 is in an operating mode, such as a shooting mode or a video mode, the front-facing camera and / or the rear-facing camera may receive external multimedia data. Each front-facing camera and rear-facing camera may be a fixed optical lens system or have focal length and optical zoom capabilities.

[0298] Audio component 510 is configured to output and / or input audio signals. For example, audio component 510 includes a microphone (MIC) configured to receive external audio signals when electronic device 500 is in an operating mode, such as call mode, recording mode, and voice recognition mode. The received audio signals may be further stored in memory 504 or transmitted via communication component 516. In some embodiments, audio component 510 also includes a speaker for outputting audio signals.

[0299] Input / output interface 512 provides an interface between processing component 502 and peripheral interface modules, which may be keyboards, click wheels, buttons, etc. These buttons may include, but are not limited to, home buttons, volume buttons, start buttons, and lock buttons.

[0300] Sensor assembly 514 includes one or more sensors for providing state assessments of various aspects of electronic device 500. For example, sensor assembly 514 may detect the on / off state of electronic device 500, the relative positioning of components such as the display and keypad of electronic device 500, changes in position of electronic device 500 or a component of electronic device 500, the presence or absence of user contact with electronic device 500, orientation or acceleration / deceleration of electronic device 500, and temperature changes of electronic device 500. Sensor assembly 514 may include a proximity sensor configured to detect the presence of nearby objects without any physical contact. Sensor assembly 514 may also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, sensor assembly 514 may also include an accelerometer, gyroscope, magnetometer, pressure sensor, or temperature sensor.

[0301] Communication component 516 is configured to facilitate wired or wireless communication between electronic device 500 and other devices. Electronic device 500 can access wireless networks based on communication standards, such as WiFi, 2G, or 3G, or combinations thereof. In one exemplary embodiment, communication component 516 receives broadcast signals or broadcast-related information from an external broadcast management system via a broadcast channel. In one exemplary embodiment, communication component 516 also includes a near-field communication (NFC) module to facilitate short-range communication. For example, the NFC module may be implemented based on radio frequency identification (RFID) technology, Infrared Data Association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology, and other technologies.

[0302] In an exemplary embodiment, the electronic device 500 may be implemented by one or more application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field-programmable gate arrays (FPGAs), controllers, microcontrollers, microprocessors, or other electronic components to perform the methods described above.

[0303] In an exemplary embodiment, a non-transitory computer-readable storage medium including instructions is also provided, such as a memory 504 including instructions, which can be executed by a processor 520 of an electronic device 500 to perform the above-described method. For example, the non-transitory computer-readable storage medium may be a ROM, random access memory (RAM), CD-ROM, magnetic tape, floppy disk, and optical data storage device, etc.

[0304] Figure 5 This is a schematic diagram of the structure of a chip 600 according to an embodiment of this disclosure. For cases where the electronic device 500 can be a chip or a chip system, please refer to... Figure 5 The diagram shown is a schematic representation of the structure of chip 600, but it is not limited to this.

[0305] Chip 600 includes one or more processors 601. Chip 600 is used to perform any of the methods described above.

[0306] In some embodiments, chip 600 further includes one or more interface circuits 602. Optionally, terms such as interface circuit, interface, and transceiver pin can be used interchangeably. In some embodiments, chip 600 further includes one or more memories 603 for storing data and / or instructions. Optionally, all or part of the memories 603 may be located outside chip 600. Optionally, interface circuit 602 is connected to memory 603, and interface circuit 602 can be used to receive data and / or instructions from memory 603 or other devices, and interface circuit 602 can be used to send data and / or instructions to memory 603 or other devices. For example, interface circuit 602 can read data and / or instructions stored in memory 603 and send the data and / or instructions to processor 601.

[0307] In some embodiments, the processor 601 performs at least one of the processing steps (e.g., steps S101, S102, S103, S104, S105, but not limited thereto).

[0308] The modules and / or devices described in the various embodiments, such as virtual devices, physical devices, and chips, can be combined or separated arbitrarily as needed. Optionally, some or all steps can also be performed collaboratively by multiple modules and / or devices, which is not limited here.

[0309] This disclosure also proposes a storage medium storing instructions that, when executed on an electronic device, cause the electronic device to perform any of the above methods. Optionally, the storage medium is an electronic storage medium. Optionally, the storage medium is a computer-readable storage medium, but not limited thereto; it may also be a storage medium readable by other devices. Optionally, the storage medium may be a non-transitory storage medium, but not limited thereto; it may also be a temporary storage medium.

[0310] This disclosure also proposes a program product, including a program and / or instructions, which, when executed by an electronic device, cause the electronic device to perform any of the above methods. Optionally, the program product is a computer program product. Optionally, the program product is stored on the storage medium.

[0311] This disclosure also proposes a computer program that, when run on a computer, causes the computer to perform any of the above methods.

Claims

1. An audio processing method, characterized in that, Performed by an electronic device, the method includes: The left channel output signal is obtained by acquiring any one of the two audio signals collected by the two microphones and a first audio signal. The first audio signal is obtained by processing the other audio signal among the two audio signals through a left channel filter. The right channel output signal is obtained based on either one of the two audio signals and the second audio signal. The second audio signal is obtained by processing the other audio signal among the two audio signals through a right channel filter.

2. The method according to claim 1, characterized in that, The electronic device is equipped with multiple microphones, and the two microphones are the first microphone and the second microphone, which are not superimposed on the horizontal lines to the left or right.

3. The method according to claim 1 or 2, characterized in that, The left channel filter is used to minimize the signal difference between the first microphone and the second microphone at a first angle.

4. The method according to claim 3, characterized in that, The left channel filter satisfies the following formula: H L =D L1 *(D L1 ′*D L1 ) -1 *D L2 ; Among them, H L D represents the left channel filter. L1 D represents the guide vector of the first microphone at the first angle. L1 ′ represents D L1 The conjugate transpose of D L2 This represents the guide vector of the second microphone at the first angle.

5. The method according to claim 3, characterized in that, The left channel filter satisfies the following formula: H L =D L2 *(D L2 ′*D L2 ) -1 *D L1 ; Among them, H L D represents the left channel filter. L2 D represents the guide vector of the second microphone at the first angle. L2 ′ represents D L2 The conjugate transpose of D L1 This represents the guide vector of the first microphone at the first angle.

6. The method according to claim 4 or 5, characterized in that, The left channel output signal is obtained based on either of the two audio signals and the first audio signal, including: The left channel output signal L is obtained according to any one of the following formulas: L=mic1×H L -mic2; L=mic2-mic1×H L ; L=mic1-mic2×H L ; L=mic2×H L -mic1; Where mic1 represents the audio signal captured by the first microphone, mic2 represents the audio signal captured by the second microphone, and mic1×H L and mic2×H L Both refer to the first audio signal.

7. The method according to any one of claims 3-6, characterized in that, The first angle is +90°, which represents a horizontal direction to the right.

8. The method according to any one of claims 1-7, characterized in that, The right channel filter is used to minimize the signal difference between the first microphone and the second microphone at a second angle.

9. The method according to claim 8, characterized in that, The right channel filter satisfies the following formula: H R =D R1 *(D R1 ′*D R1 ) -1 *D R2 ; Among them, H R D represents the right channel filter. R1 D represents the guide vector of the first microphone at the second angle. R1 ′ represents D R1 The conjugate transpose of D R2 This represents the guide vector of the second microphone at the second angle.

10. The method according to claim 8, characterized in that, The right channel filter satisfies the following formula: H R =D R2 *(D R2 ′*D R2 ) -1 *D R1 ; Among them, H R D represents the right channel filter. R2 D represents the guide vector of the second microphone at the second angle. R2 ′ represents D R2 The conjugate transpose of D R1 This represents the guide vector of the first microphone at the second angle.

11. The method according to claim 9 or 10, characterized in that, The right channel output signal is obtained based on any one of the two audio signals and the second audio signal, including: The right channel output signal R is obtained according to any one of the following formulas: R=mic1×H R -mic2; R=mic2-mic1×H R ; R=mic1-mic2×H R ; R=mic2×H R -mic1; Where mic1 represents the audio signal captured by the first microphone, mic2 represents the audio signal captured by the second microphone, and mic1×H R and mic2×H R Both refer to the second audio signal.

12. The method according to any one of claims 8-11, characterized in that, The second angle is -90°, which represents the horizontal direction to the left.

13. An electronic device, characterized in that, The electronic device is used to perform the audio processing method according to any one of claims 1-12.

14. A storage medium storing instructions, characterized in that, When the instructions are executed on an electronic device, the electronic device causes the electronic device to perform the audio processing method according to any one of claims 1-12.

15. A program product comprising at least one of a program and instructions, characterized in that, When at least one of the programs or instructions is executed by an electronic device, it implements the audio processing method according to any one of claims 1-12.

Images