Audio signal processing method, audio signal processing apparatus, terminal, and storage medium

Abstract

The present disclosure relates to an audio signal processing method, an audio signal processing apparatus, a terminal, and a storage medium. The audio signal processing method comprises: acquiring a first audio signal and a second audio signal, wherein the first audio signal is collected by a first microphone of a terminal, and the second audio signal is collected by a second microphone of the terminal; and processing the first audio signal and the second audio signal on the basis of a filter, so as to obtain a first audio output signal and a second audio output signal, wherein the filter is determined on the basis of a plurality of transfer functions, the plurality of transfer functions comprise transfer functions corresponding to signal collection using the first microphone when a sound source is at different positions, and transfer functions corresponding to signal collection using the second microphone when the sound source is at the different positions. By means of embodiments of the present disclosure, the quality of collected audio signals can be improved.

Description

Audio signal processing methods, audio signal processing devices, terminals and storage media Technical Field

[0001] This disclosure relates to the field of audio processing technology, and in particular to audio signal processing methods, audio signal processing devices, terminals and storage media. Background Technology

[0002] With the rapid development of audio processing technology and smart terminal devices, stereo playback capabilities have become widespread on multimedia devices, and terminal devices (such as mobile phones, TVs, headphones, tablets, etc.) can now support stereo playback. However, stereo acquisition technology places high demands on the hardware of audio acquisition equipment, and due to the limitations of the hardware performance of terminal devices, there are significant errors when using terminal devices for stereo acquisition.

[0003] Summary of the Invention

[0004] Improving the quality of audio signals acquired by terminal devices is a problem that needs to be solved.

[0005] This disclosure provides an audio signal processing method, an audio signal processing apparatus, a terminal, and a storage medium.

[0006] According to a first aspect of the present disclosure, an audio signal processing method is proposed, comprising: processing a first audio signal and a second audio signal based on a filter to obtain a first audio output signal and a second audio output signal; wherein the first audio signal is acquired through a first microphone of a terminal, the second audio signal is acquired through a second microphone of the terminal, the filter is determined based on a plurality of transfer functions, the plurality of transfer functions including a transfer function corresponding to the signal acquired by the first microphone when the sound source is at different positions, and a transfer function corresponding to the signal acquired by the second microphone when the sound source is at the different positions.

[0007] According to a second aspect of the present disclosure, an audio signal processing apparatus is provided, comprising: a processing module for processing a first audio signal and a second audio signal based on a filter to obtain a first audio output signal and a second audio output signal; wherein the first audio signal is acquired through a first microphone of a terminal, the second audio signal is acquired through a second microphone of the terminal, the filter is determined based on a plurality of transfer functions, the plurality of transfer functions including a transfer function corresponding to the signal acquired by the first microphone when the sound source is at different positions, and a transfer function corresponding to the signal acquired by the second microphone when the sound source is at the different positions.

[0008] According to a third aspect of the present disclosure, a terminal is provided, comprising: one or more processors; wherein the terminal is configured to perform the audio signal processing method of the first aspect.

[0009] According to a fourth aspect of the present disclosure, a storage medium is provided that stores instructions which, when executed on a communication device, cause the communication device to perform the method of the first aspect.

[0010] According to a fifth aspect of the present disclosure, a computer program is provided that, when executed by a communication device, causes the communication device to perform the method of the first aspect.

[0011] In this embodiment, a filter is determined based on the transfer function corresponding to the signal collected by the first microphone at different locations of the sound source, and the transfer function corresponding to the signal collected by the second microphone at the same different locations of the sound source. A first audio signal collected by the first microphone and a second audio signal collected by the second microphone are acquired. The first and second audio signals are processed based on the filter to obtain a first audio output signal and a second audio output signal. Since the filter is determined based on the transfer function corresponding to the signal collected by different microphones at different locations of the sound source, processing the actually acquired audio signal based on the filter can obtain a first audio output signal and a second audio output signal with a stereo format. Furthermore, the obtained audio output signal is not affected by the performance of the acquisition device, thus improving the quality of the acquired audio signal. Attached Figure Description

[0012] To more clearly illustrate the technical solutions in the embodiments of this disclosure, the accompanying drawings required for the description of the embodiments are introduced below. The following drawings are only some embodiments of this disclosure and do not impose specific limitations on the protection scope of this disclosure.

[0013] Figure 1 is a schematic diagram of the architecture of a communication system according to an embodiment of the present disclosure.

[0014] Figure 2 is a schematic flowchart of an audio signal processing method according to an embodiment of the present disclosure.

[0015] Figure 3 is a schematic flowchart of an audio signal processing method according to an embodiment of the present disclosure.

[0016] Figure 4 is a schematic diagram of the structure of the audio signal processing device proposed in the embodiments of this disclosure.

[0017] Figure 5A is a schematic diagram of the structure of the communication device proposed in an embodiment of this disclosure.

[0018] Figure 5B is a schematic diagram of the chip structure proposed in an embodiment of this disclosure. Detailed Implementation

[0019] This disclosure provides an audio signal processing method, an audio signal processing apparatus, a terminal, and a storage medium.

[0020] In a first aspect, embodiments of this disclosure propose an audio signal processing method, comprising: processing a first audio signal and a second audio signal based on a filter to obtain a first audio output signal and a second audio output signal; wherein the first audio signal is acquired through a first microphone of a terminal, the second audio signal is acquired through a second microphone of the terminal, the filter is determined based on multiple transfer functions, the multiple transfer functions including the transfer function corresponding to the signal acquired by the first microphone when the sound source is at different positions, and the transfer function corresponding to the signal acquired by the second microphone when the sound source is at the different positions.

[0021] In the above embodiments, a filter is determined based on the transfer function corresponding to the signal collected by the first microphone when the sound source is at different locations, and the transfer function corresponding to the signal collected by the second microphone when the sound source is at the same different locations. A first audio signal collected by the first microphone and a second audio signal collected by the second microphone are acquired. The first audio signal and the second audio signal are processed based on the filter to obtain a first audio output signal and a second audio output signal. Since the filter is determined based on the transfer function corresponding to the signal collected by the sound source at different locations using different microphones, processing the actual acquired audio signal based on the filter can obtain a first audio output signal and a second audio output signal with a stereo format. Furthermore, the obtained audio output signal is not affected by the performance of the acquisition device, which can improve the quality of the acquired audio signal.

[0022] In conjunction with some embodiments of the first aspect, in some embodiments, the different positions include a first position, a second position, and a third position; the horizontal angle between the first line connecting the first position and the terminal's location and the second line connecting the second position and the terminal's location is less than a preset angle; the horizontal angle between the first line connecting the first position and the third line connecting the third position and the terminal's location is less than a preset angle; the second line connecting the second position and the third line connecting the third position are respectively located on both sides of the first line connecting the second position and the third position. The plurality of transfer functions include the transfer function corresponding to the first position, the transfer function corresponding to the second position, and the transfer function corresponding to the third position.

[0023] In conjunction with some embodiments of the first aspect, in some embodiments, the transfer function corresponding to the first position includes a first transfer function and a second transfer function; the transfer function corresponding to the second position includes a third transfer function and a fourth transfer function; and the transfer function corresponding to the third position includes a fifth transfer function and a sixth transfer function. The first transfer function is the transfer function corresponding to the signal collected by the first microphone when the sound source is located at the first position; the second transfer function is the transfer function corresponding to the signal collected by the second microphone when the sound source is located at the first position; the third transfer function is the transfer function corresponding to the signal collected by the first microphone when the sound source is located at the second position; the fourth transfer function is the transfer function corresponding to the signal collected by the second microphone when the sound source is located at the second position; the fifth transfer function is the transfer function corresponding to the signal collected by the first microphone when the sound source is located at the third position; and the sixth transfer function is the transfer function corresponding to the signal collected by the second microphone when the sound source is located at the third position.

[0024] In conjunction with some embodiments of the first aspect, in some embodiments, the filter includes a first filter, a second filter, a third filter, and a fourth filter; the first filter is determined based on the transfer function corresponding to the third position; the second filter is determined based on the transfer function corresponding to the second position; the third filter is determined based on the transfer function corresponding to the first position and the first filter; and the fourth filter is determined based on the transfer function corresponding to the first position and the second filter.

[0025] In conjunction with some embodiments of the first aspect, in some embodiments, the step of processing the first audio signal and the second audio signal based on the filter to obtain a first audio output signal and a second audio output signal includes: processing the first audio signal and the second audio signal based on the first filter and the third filter to obtain a first audio output signal; and processing the second audio signal and the first audio signal based on the second filter and the fourth filter to obtain a second audio output signal.

[0026] In conjunction with some embodiments of the first aspect, in some embodiments, the first audio signal and the second audio signal are obtained by collecting signals emitted by the first sound source; when the first sound source is located at the first position, the intensity of the first audio output signal is equal to the intensity of the second audio output signal; when the first sound source is located at the second position, the intensity of the first audio output signal is greater than the intensity of the second audio output signal; when the first sound source is located at the third position, the intensity of the first audio output signal is less than the intensity of the second audio output signal.

[0027] Secondly, embodiments of this disclosure propose an audio signal processing apparatus, comprising: a processing module, configured to process a first audio signal and a second audio signal based on a filter to obtain a first audio output signal and a second audio output signal; wherein the first audio signal is acquired through a first microphone of a terminal, the second audio signal is acquired through a second microphone of the terminal, the filter is determined based on a plurality of transfer functions, the plurality of transfer functions including a transfer function corresponding to the signal acquired by the first microphone when the sound source is at different positions, and a transfer function corresponding to the signal acquired by the second microphone when the sound source is at the different positions.

[0028] In conjunction with some embodiments of the second aspect, in some embodiments, the different positions include a first position, a second position, and a third position. The horizontal angle between the first line connecting the first position and the terminal's location and the second line connecting the second position and the terminal's location is less than a preset angle. The horizontal angle between the first line connecting the first position and the third line connecting the third position and the terminal's location is less than a preset angle. The second line connecting the second position and the third line connecting the third position are located on opposite sides of the first line connecting the second and third positions, respectively. The plurality of transfer functions include the transfer function corresponding to the first position, the transfer function corresponding to the second position, and the transfer function corresponding to the third position.

[0029] In conjunction with some embodiments of the second aspect, in some embodiments, the transfer function corresponding to the first position includes a first transfer function and a second transfer function, the transfer function corresponding to the second position includes a third transfer function and a fourth transfer function, and the transfer function corresponding to the third position includes a fifth transfer function and a sixth transfer function; the first transfer function is the transfer function corresponding to the signal collected by the first microphone when the sound source is located at the first position; the second transfer function is the transfer function corresponding to the signal collected by the second microphone when the sound source is located at the first position; the third transfer function is the transfer function corresponding to the signal collected by the first microphone when the sound source is located at the second position; the fourth transfer function is the transfer function corresponding to the signal collected by the second microphone when the sound source is located at the second position; the fifth transfer function is the transfer function corresponding to the signal collected by the first microphone when the sound source is located at the third position; and the sixth transfer function is the transfer function corresponding to the signal collected by the second microphone when the sound source is located at the third position.

[0030] In conjunction with some embodiments of the second aspect, in some embodiments, the filter includes a first filter, a second filter, a third filter, and a fourth filter; the first filter is determined based on the transfer function corresponding to the third position; the second filter is determined based on the transfer function corresponding to the second position; the third filter is determined based on the transfer function corresponding to the first position and the first filter; and the fourth filter is determined based on the transfer function corresponding to the first position and the second filter.

[0031] In conjunction with some embodiments of the second aspect, in some embodiments, the processing module is used to process the first audio signal and the second audio signal based on the first filter and the third filter to obtain a first audio output signal; and to process the second audio signal and the first audio signal based on the second filter and the fourth filter to obtain a second audio output signal.

[0032] In conjunction with some embodiments of the second aspect, in some embodiments, the first audio signal and the second audio signal are obtained by collecting signals emitted by the first sound source; when the first sound source is located at the first position, the intensity of the first audio output signal is equal to the intensity of the second audio output signal; when the first sound source is located at the second position, the intensity of the first audio output signal is greater than the intensity of the second audio output signal; when the first sound source is located at the third position, the intensity of the first audio output signal is less than the intensity of the second audio output signal.

[0033] Thirdly, embodiments of this disclosure provide a terminal, including: one or more processors; wherein the terminal is used to execute the audio signal processing method of the first aspect.

[0034] Fourthly, embodiments of this disclosure provide a storage medium storing instructions that, when executed on a communication device, cause the communication device to perform any of the aforementioned audio signal processing methods.

[0035] Fifthly, embodiments of this disclosure provide a program product that, when executed by a communication device, causes the communication device to perform any of the aforementioned audio signal processing methods.

[0036] Sixthly, embodiments of this disclosure provide a computer program that, when executed by a communication device, causes the communication device to perform any of the above-described audio signal processing methods.

[0037] In a seventh aspect, embodiments of this disclosure provide a chip or chip system. The chip or chip system includes processing circuitry configured to perform any of the above-described audio signal processing methods.

[0038] It is understood that the aforementioned communication devices, storage media, program products, computer programs, chips, or chip systems are all used to execute the methods proposed in the embodiments of this disclosure. Therefore, the beneficial effects they can achieve can be referred to the beneficial effects in the corresponding methods, and will not be repeated here.

[0039] This disclosure provides an audio signal processing method, an audio signal processing apparatus, a terminal, and a storage medium. In some embodiments, the terms "audio signal processing method" and "audio processing method," "audio acquisition method," etc., may be used interchangeably.

[0040] This disclosure is not exhaustive, but merely illustrative of some embodiments, and is not intended to limit the scope of protection of this disclosure. Unless otherwise specified, each step in a particular embodiment can be implemented as an independent embodiment, and the steps can be arbitrarily combined. For example, a solution after removing some steps in a particular embodiment can also be implemented as an independent embodiment, and the order of the steps in a particular embodiment can be arbitrarily interchanged. Furthermore, the optional implementation methods in a particular embodiment can be arbitrarily combined; moreover, the embodiments can be arbitrarily combined, for example, some or all steps of different embodiments can be arbitrarily combined, and a particular embodiment can be arbitrarily combined with the optional implementation methods of other embodiments.

[0041] In each of the disclosed embodiments, unless otherwise specified or in case of logical conflict, the terminology and / or descriptions of the embodiments are consistent and can be referenced by each other. Technical features in different embodiments can be combined to form new embodiments based on their inherent logical relationships.

[0042] The terminology used in the embodiments of this disclosure is for the purpose of describing particular embodiments only and is not intended to limit the scope of this disclosure.

[0043] In this embodiment of the disclosure, unless otherwise stated, elements expressed in the singular form, such as "a," "an," "the," "the," "the," "the," "the," "the," "this," etc., can mean "one and only one," or "one or more," "at least one," etc. For example, when using articles such as "a," "an," "the," etc. in translation, the noun following the article can be understood as either a singular expression or a plural expression.

[0044] In the embodiments disclosed herein, "multiple" refers to two or more.

[0045] In some embodiments, the terms “at least one of”, “one or more”, “a plurality of”, “multiple”, etc., may be used interchangeably.

[0046] In some embodiments, the notation "at least one of A and B", "A and / or B", "A in one case, B in another", "in response to one case A, in response to another case B", etc., may include the following technical solutions depending on the situation: in some embodiments, A (execute A regardless of B); in some embodiments, B (execute B regardless of A); in some embodiments, execution is selected from A and B (A and B are selectively executed); in some embodiments, A and B (both A and B are executed). The same applies when there are more branches such as A, B, C, etc.

[0047] In some embodiments, the notation "A or B" may include the following technical solutions, depending on the situation: in some embodiments, A (execution of A regardless of B); in some embodiments, B (execution of B regardless of A); in some embodiments, execution is selected from A and B (A and B are selectively executed). The same applies when there are more branches such as A, B, C, etc.

[0048] The prefixes "first," "second," etc., used in the embodiments of this disclosure are merely for distinguishing different descriptive objects and do not impose restrictions on the position, order, priority, quantity, or content of the descriptive objects. The description of the descriptive objects is found in the claims or the context of the embodiments, and the use of prefixes should not constitute unnecessary restrictions. For example, if the descriptive object is a "field," the ordinal numbers preceding "field" in "first field" and "second field" do not restrict the position or order of the "fields." "First" and "second" do not restrict whether the "fields" they modify are in the same message, nor do they restrict the order of "first field" and "second field." Similarly, if the descriptive object is a "level," the ordinal numbers preceding "level" in "first level" and "second level" do not restrict the priority between "levels." Furthermore, the number of descriptive objects is not limited by ordinal numbers and can be one or more. For example, in "first device," the number of "devices" can be one or more. Furthermore, the objects modified by different prefixes can be the same or different. For example, if the object being described is "device", then "first device" and "second device" can be the same device or different devices, and their types can be the same or different. Similarly, if the object being described is "information", then "first information" and "second information" can be the same information or different information, and their content can be the same or different.

[0049] In some embodiments, “including A,” “containing A,” “for indicating A,” and “carrying A” can be interpreted as directly carrying A or indirectly indicating A.

[0050] In some embodiments, the terms “in response to…”, “in response to determining…”, “in the case of…”, “when…”, “if…”, “if…”, etc., can be used interchangeably.

[0051] In some embodiments, the terms “greater than,” “greater than or equal to,” “not less than,” “more than,” “more than or equal to,” “not less than,” “higher than,” “higher than or equal to,” “not lower than,” and “above” can be used interchangeably, as can the terms “less than,” “less than or equal to,” “not greater than,” “less than,” “less than or equal to,” “not more than,” “lower than,” “lower than or equal to,” “not higher than,” and “below”.

[0052] In some embodiments, devices, etc., can be interpreted as physical or virtual, and their names are not limited to the names recorded in the embodiments. Terms such as “device”, “equipment”, “circuit”, “network element”, “node”, “function”, “unit”, “section”, “system”, “network”, “chip”, “chip system”, “entity”, and “subject” can be used interchangeably.

[0053] In some embodiments, the terms "terminal", "terminal device", "user equipment (UE)", "user terminal", "mobile station (MS)", "mobile terminal (MT)", "subscriber station", "mobile unit", "subscriber unit", "wireless unit", "remote unit", "mobile device", "wireless device", "wireless communication device", "remote device", "mobile subscriber station", "access terminal", "mobile terminal", "wireless terminal", "remote terminal", "handset", "user agent", "mobile client", and "client" can be used interchangeably.

[0054] In some embodiments, the acquisition of data, information, etc., may comply with the laws and regulations of the country where the location is situated.

[0055] In some embodiments, data, information, etc., may be obtained with the user's consent.

[0056] Furthermore, each element, each row, or each column in the table of this disclosure can be implemented as an independent embodiment, and any combination of any element, any row, or any column can also be implemented as an independent embodiment.

[0057] Figure 1 is a schematic diagram of the architecture of a communication system according to an embodiment of the present disclosure.

[0058] As shown in Figure 1, the communication system 100 includes a terminal 101 and a sound source device 102.

[0059] In some embodiments, terminal 101 may be user equipment (UE), and terminals include, but are not limited to, at least one of the following: mobile phone, wearable device, Internet of Things device, car with communication function, smart car, tablet computer, computer with wireless transceiver function, virtual reality (VR) terminal device, augmented reality (AR) terminal device, wireless terminal device in industrial control, wireless terminal device in self-driving, wireless terminal device in remote medical surgery, wireless terminal device in smart grid, wireless terminal device in transportation safety, wireless terminal device in smart city, and wireless terminal device in smart home.

[0060] In some embodiments, sound source device 102 refers to a device that emits original sound signals, and the sound source device may also be a terminal device. The sound source device may be simply referred to as a sound source.

[0061] In some embodiments, the sound source device 102 emits an original sound signal, and the terminal 101 uses a microphone set on the terminal to collect the original sound signal to obtain multiple audio signals; the terminal 101 processes the first audio signal and the second audio signal based on a filter to obtain an audio output signal and a second audio output signal with stereo format.

[0062] It is understood that the communication system described in this disclosure is for the purpose of more clearly illustrating the technical solutions of this disclosure, and does not constitute a limitation on the technical solutions proposed in this disclosure. As those skilled in the art will know, with the evolution of system architecture and the emergence of new business scenarios, the technical solutions proposed in this disclosure are also applicable to similar technical problems.

[0063] The following embodiments of this disclosure can be applied to the communication system 100 shown in FIG1, or to some of the main bodies, but are not limited thereto. The main bodies shown in FIG1 are illustrative. The communication system may include all or some of the main bodies in FIG1, or may include other main bodies outside of FIG1. ​​The number and form of each main body are arbitrary. Each main body may be physical or virtual. The connection relationship between the main bodies is illustrative. The main bodies may not be connected or may be connected. The connection can be in any way, it can be a direct connection or an indirect connection, it can be a wired connection or a wireless connection.

[0064] The embodiments disclosed herein can be applied to Long Term Evolution (LTE), LTE-Advanced (LTE-A), LTE-Beyond (LTE-B), SUPER 3G, IMT-Advanced, 4th generation mobile communication system (4G), 5th generation mobile communication system (5G), 5G new radio (NR), 6th generation mobile communication system (6G), Future Radio Access (FRA), New-Radio Access Technology (RAT), New Radio (NR), New radio access (NX), Future generation radio access (FX), Global System for Mobile communications (GSM), CDMA2000, Ultra Mobile Broadband (UMB), IEEE 802.11 (Wi-Fi), IEEE 802.16 (WiMAX), and IEEE 802.20, Ultra-Wideband (UWB), Bluetooth (a registered trademark), Public Land Mobile Network (PLMN) networks, Device-to-Device (D2D) systems, Machine-to-Machine (M2M) systems, Internet of Things (IoT) systems, Vehicle-to-Everything (V2X) systems, systems utilizing other communication methods, and next-generation systems built upon them, etc. Furthermore, multiple systems can be combined (e.g., a combination of LTE or LTE-A with 5G).

[0065] With technological advancements, stereo playback capabilities have become widespread in multimedia devices. Almost all mobile phones, televisions, headphones, tablets, and other devices support stereo playback, and market demand for stereo formats is increasing daily. However, stereo acquisition technology is not yet widespread in consumer devices. Related technologies place high demands on hardware, posing additional requirements on device size and cost. Furthermore, the relevant algorithms are derived based on ideal signal models of performance-standard devices. When audio acquisition equipment has significant errors, the resulting algorithms exhibit substantial inaccuracies.

[0066] Specifically, the audio signal acquisition equipment has significant errors. Calibration, compensation, and correction of the acquisition equipment may lead to the following problems: performance can only reach the target value at a reference point; trade-offs must be made between performance at different locations, angles, and environments; additional computational load and even latency are added; the processed signal may not fully achieve the target effect, or even introduce new losses. Furthermore, the limitations of small mobile devices in terms of hardware size, cost, and computing power can result in errors, distortions, and inconsistencies in the acquired audio signals, affecting the performance of audio algorithms. The principles of related algorithms are based on calculations using ideal signal models and inter-channel relationships. Differences in the equipment itself directly affect algorithm performance. Additionally, basing calculations on standard or ideal signals introduces additional intermediate quantities, leading to further losses and increased computational costs.

[0067] In view of this, embodiments of the present disclosure provide an audio signal processing method, which determines a filter based on the transfer function corresponding to the signal collected by a first microphone at different positions of the sound source and the transfer function corresponding to the signal collected by a second microphone at the same different positions of the sound source; acquires a first audio signal collected by the first microphone and a second audio signal collected by the second microphone; processes the first audio signal and the second audio signal based on the filter to obtain a first audio output signal and a second audio output signal; since the filter is determined based on the transfer function corresponding to the signal collected by different microphones at different positions of the sound source, processing the actually collected audio signal based on the filter can obtain a first audio output signal and a second audio output signal with stereo format, and the obtained audio output signal is not affected by the performance of the acquisition device, thereby improving the quality of the acquired audio signal.

[0068] Figure 2 is a schematic flowchart of an audio signal processing method according to an embodiment of the present disclosure.

[0069] In this embodiment of the disclosure, the audio signal processing method may be executed by a terminal, but this disclosure does not limit it.

[0070] As shown in Figure 2, the present disclosure relates to an audio signal processing method, which includes the following steps.

[0071] Step S2101: Determine multiple transfer functions.

[0072] In this embodiment of the disclosure, the transfer function may also be referred to as an acoustic property, or as a transfer characteristic of the system.

[0073] In this embodiment of the disclosure, the transfer function can be predetermined, and the transfer function can be obtained through actual measurement or simulation calculation.

[0074] In this embodiment of the disclosure, the transfer function can be obtained using signals collected by each microphone of the terminal at different locations of the sound source. The transfer function can be obtained using... The expression is: where N is a positive integer, representing the sequence number of the acquired audio signal. When acquiring audio signals through multiple microphones, N also represents the microphone sequence number. This indicates the horizontal azimuth angle between the sound source and the terminal. The value range is [-90°, 90°], that is, from 90° to the left and 90° to the right. When the sound source is located in the left-side region of the terminal, the horizontal azimuth angle is used... Indicates that when the sound source is located in the right-hand region of the terminal, the horizontal azimuth angle is used. The sound source can be represented by U, and the original audio signal emitted by the sound source can be represented by U. This indicates that the signals collected by the terminal through multiple microphones can be represented by X. N This indicates that the multiple microphones in the terminal can also be considered as multiple channels.

[0075] In this embodiment of the disclosure, the horizontal azimuth angle between the sound source and the terminal is: At that time, the sound source emits the original audio signal, and the terminal collects the audio signal through multiple microphones. Multiple microphones collect audio signals The relationship between the transfer function and the transfer function is as follows: Therefore, by combining the original audio signal emitted by the sound source with the audio signals collected by multiple microphones on the terminal, the transfer function corresponding to the audio acquisition by each microphone on the terminal at different locations of the sound source can be obtained. This process can be achieved through actual measurement, simulation calculation, or modeling.

[0076] In the following illustrative example, multiple microphones, including a first microphone and a second microphone, are used as examples, but this disclosure does not limit the number of microphones.

[0077] In this embodiment of the disclosure, the multiple transfer functions include the transfer function corresponding to the sound source using the first microphone to collect signals at different locations, and the transfer function corresponding to the sound source using the second microphone to collect signals at different locations.

[0078] In this embodiment of the disclosure, the performance of the first microphone and the second microphone may be different, and the error of the signals collected by the first microphone and the second microphone may also be different. Therefore, the transfer functions corresponding to the first microphone and the second microphone are also different.

[0079] In the following examples, different positions including the first position, the second position and the third position are used as examples, but this disclosure does not limit the number of positions.

[0080] Wherein, the horizontal angle between the first line connecting the first position and the terminal position and the second line connecting the second position and the terminal position is less than a preset angle, the horizontal angle between the first line connecting the third line connecting the third position and the terminal position is less than a preset angle, and the second line connecting the third line connecting the first position and the terminal position is located on both sides of the first line connecting the second and third lines connecting the first and third lines ...

[0081] The preset angle can be, for example, 90°.

[0082] In this embodiment, the first position can be directly in front of the terminal, meaning that when the sound source is in the first position, it is located directly in front of the terminal, and the horizontal azimuth angle between the sound source and the terminal is 0°. The second position can be the left side of the terminal, meaning that when the sound source is in the second position, it is located on the left side of the terminal, and the horizontal azimuth angle between the sound source and the terminal is between 90° and 0° on the left. The horizontal azimuth angle on the left side of the terminal can be represented by a negative value, meaning the horizontal azimuth angle between the sound source and the terminal is between -90° and 0°. The third position can be the right side of the terminal, meaning that when the sound source is in the third position, it is located on the right side of the terminal, and the horizontal azimuth angle between the sound source and the terminal is between 0° and 90° on the right. The horizontal azimuth angle on the right side of the terminal can be represented by a positive value, meaning the horizontal azimuth angle between the sound source and the terminal is between 0° and 90°.

[0083] In this embodiment of the disclosure, the multiple transfer functions may include the transfer function corresponding to the first position, the transfer function corresponding to the second position, and the transfer function corresponding to the third position.

[0084] In this embodiment of the disclosure, the transfer function corresponding to the first position includes a first transfer function and a second transfer function; the transfer function corresponding to the second position includes a third transfer function and a fourth transfer function; and the transfer function corresponding to the third position includes a fifth transfer function and a sixth transfer function. The first transfer function is the transfer function corresponding to the signal collected by the first microphone when the sound source is located at the first position; the second transfer function is the transfer function corresponding to the signal collected by the second microphone when the sound source is located at the first position; the third transfer function is the transfer function corresponding to the signal collected by the first microphone when the sound source is located at the second position; the fourth transfer function is the transfer function corresponding to the signal collected by the second microphone when the sound source is located at the second position; the fifth transfer function is the transfer function corresponding to the signal collected by the first microphone when the sound source is located at the third position; and the sixth transfer function is the transfer function corresponding to the signal collected by the second microphone when the sound source is located at the third position.

[0085] In this embodiment of the disclosure, the sound source is directly in front of the terminal (i.e., When the original audio signal emitted by the sound source and the audio signal collected by the first microphone are used, the first transfer function is determined, which can be represented by TF1(0).

[0086] In this embodiment of the disclosure, the sound source is directly in front of the terminal (i.e., When the original audio signal emitted by the sound source and the audio signal collected by the second microphone are used, the second transfer function is determined. The second transfer function can be represented by TF2(0).

[0087] In this embodiment of the disclosure, the sound source is located in the left-side region of the terminal (i.e., When the sound source emits the original audio signal and the audio signal collected by the first microphone are used, the third transfer function is determined. The third transfer function can be used... express.

[0088] In this embodiment of the disclosure, the sound source is located in the left-side region of the terminal (i.e., When ( ), based on the original audio signal emitted by the sound source and the audio signal collected by the second microphone, the fourth transfer function is determined. The fourth transfer function can be used express.

[0089] In this embodiment of the disclosure, the sound source is located in the right-side region of the terminal (i.e., When ( ), based on the original audio signal emitted by the sound source and the audio signal collected by the first microphone, the fifth transfer function is determined. The fifth transfer function can be used express.

[0090] In this embodiment of the disclosure, the sound source is located in the right-side region of the terminal (i.e., When the sound source emits the original audio signal and the second microphone collects the audio signal, the sixth transfer function is determined. The sixth transfer function can be used... express.

[0091] Step S2102: Determine the filter based on multiple transfer functions.

[0092] In this embodiment of the disclosure, multiple filters can be predetermined based on the aforementioned multiple transfer functions.

[0093] In this embodiment of the disclosure, the filter includes a first filter, a second filter, a third filter, and a fourth filter.

[0094] The first filter can be represented by H1, the second filter by H2, and the third filter by H... L This indicates that the fourth filter can use H R express.

[0095] In this embodiment of the disclosure, the first filter is determined based on the transfer function corresponding to the third position; the second filter is determined based on the transfer function corresponding to the second position; the third filter is determined based on the transfer function corresponding to the first position and the first filter; and the fourth filter is determined based on the transfer function corresponding to the first position and the second filter.

[0096] In this embodiment of the disclosure, the first filter H1 can be based on the fifth transfer function. and the sixth transfer function Determine, for example, by using the following formula.

[0097] In this embodiment of the disclosure, the second filter H2 can be based on the third transfer function. and the fourth transfer function Determine, for example, by using the following formula.

[0098] In this embodiment of the disclosure, the third filter H L It can be determined based on the first transfer function TF1(0), the second transfer function TF2(0), and the first filter H1, for example, by the following formula.

[0099] In this embodiment of the disclosure, the fourth filter H R It can be determined based on the first transfer function TF1(0), the second transfer function TF2(0), and the second filter H2, for example, by the following formula.

[0100] Step S2103: Acquire the first audio signal and the second audio signal.

[0101] The first audio signal is acquired through the terminal's first microphone, and the second audio signal is acquired through the terminal's second microphone.

[0102] In this embodiment of the disclosure, the sound source emitting the original signal is referred to as the first sound source in practical application. The first sound source emits the original audio signal, and multiple microphones of the terminal collect the original audio signal to obtain multiple audio signals. Taking the first microphone and the second microphone as examples, the first sound source emits the original audio signal, the first microphone of the terminal collects the original audio signal to obtain the first audio signal, and the second microphone of the terminal collects the original audio signal to obtain the second audio signal. The first audio signal can be represented by X1, and the second audio signal can be represented by X2.

[0103] Step S2104: Process the first audio signal and the second audio signal based on the filter to obtain the first audio output signal and the second audio output signal.

[0104] The filter is determined based on multiple transfer functions, including the transfer function corresponding to the signal collected by the first microphone when the sound source is in different positions, and the transfer function corresponding to the signal collected by the second microphone when the sound source is in different positions.

[0105] In this embodiment of the disclosure, the first audio signal and the second audio signal can be processed based on a preset first filter, a second filter, a third filter and a fourth filter to obtain a first audio output signal and a second audio output signal with a stereo format.

[0106] In this embodiment of the disclosure, processing the first audio signal and the second audio signal based on filters to obtain the first audio output signal and the second audio output signal includes: processing the first audio signal and the second audio signal based on a first filter and a third filter to obtain the first audio output signal; and processing the second audio signal and the first audio signal based on a second filter and a fourth filter to obtain the second audio output signal.

[0107] In this embodiment of the disclosure, the first audio output signal and the second audio output signal can be audio output signals corresponding to different channels, for example, they can be audio output signals corresponding to the left channel and the right channel respectively. The first audio output signal can use Y... L This indicates that the second audio output signal can use Y... R express.

[0108] In this embodiment of the disclosure, the first audio output signal Y L For example, it can be determined using the following formula.

[0109] Y L= (X2 + X1 * H1) * H L (5)

[0110] In this embodiment of the disclosure, the second audio output signal Y R For example, it can be determined using the following formula.

[0111] Y R = (X1 + X2 * H2) * H R (6)

[0112] In this embodiment of the present disclosure, the first audio signal and the second audio signal are processed by a filter to obtain a first audio output signal and a second audio output signal with a stereo format. The terminal can play the first audio output signal and the second audio output signal to present a stereo effect; the terminal can also send the first audio output signal and the second audio output signal to other devices for playback to present a stereo effect.

[0113] In this embodiment of the present disclosure, the first audio signal and the second audio signal are obtained by collecting signals emitted by the first sound source; when the first sound source is located at the first position, the intensity of the first audio output signal is equal to the intensity of the second audio output signal; when the first sound source is located at the second position, the intensity of the first audio output signal is greater than the intensity of the second audio output signal; when the first sound source is located at the third position, the intensity of the first audio output signal is less than the intensity of the second audio output signal.

[0114] In other words, the first audio output signal and the second audio output signal obtained in this embodiment of the present disclosure satisfy the following conditions: when the first sound source is located directly in front of the terminal, the intensity of the first audio output signal and the intensity of the second audio output signal are the same; when the first sound source is located in the left area of ​​the terminal, the intensity of the first audio output signal is greater than the intensity of the second audio output signal; when the first sound source is located in the right area of ​​the terminal, the intensity of the first audio output signal is less than the intensity of the second audio output signal. Therefore, the first audio output signal and the second audio output signal can present a stereo effect.

[0115] In this embodiment of the disclosure, the conditions satisfied by the first audio output signal and the second audio output signal can be expressed by the following formula.

[0116] At that time, Y L (0)=Y R (0)(7)

[0117] hour,

[0118] hour, The following explanation demonstrates that the first and second audio output signals obtained in the embodiments of this disclosure can satisfy the above conditions.

[0119] The first audio signal X1 and the original audio signal emitted by the first sound source The relationship between them is:

[0120] The second audio signal X2 and the original audio signal emitted by the first sound source The relationship between them is:

[0121] Substituting formulas (10) and (11) into formulas (5) and (6), we get:

[0122] Substituting formulas (1), (2), (3), and (4) into formulas (12) and (13), we can obtain:

[0123] At that time, Y L Y R They are respectively:

[0124] Therefore, the condition is met.

[0125] At that time, Y L Y R They are respectively:

[0126] Therefore, the condition is met.

[0127] At that time, Y L Y R They are respectively

[0128] Y L (0)=U(0) (18)

[0129] Y R (0)=U(0) (19)

[0130] Therefore, condition Y is satisfied. L (0)=Y R (0).

[0131] The audio signal processing method disclosed herein may include at least one of steps S2101 to S2104. For example, steps S2103 and S2104 may be implemented as independent embodiments, but are not limited thereto.

[0132] In some embodiments, step S2101 is optional, and one or more of these steps may be omitted or substituted in different embodiments.

[0133] In some embodiments, step S2102 is optional, and one or more of these steps may be omitted or substituted in different embodiments.

[0134] In some embodiments, other optional implementations described before or after the specification corresponding to FIG2 may be referred to.

[0135] In some embodiments, the names of information, etc., are not limited to the names described in the embodiments. Terms such as "information", "message", "signal", "signaling", "report", "configuration", "indication", "instruction", "command", "channel", "parameter", "domain", "field", "symbol", "symbol", "codebook", "codeword", "codepoint", "bit", "data", "program", and "chip" can be used interchangeably.

[0136] In some embodiments, terms such as “moment,” “point in time,” “time,” and “time location” can be used interchangeably, as can terms such as “duration,” “segment,” “time window,” “window,” and “time.”

[0137] In some embodiments, “get,” “obtain,” “receive,” “transmit,” “bidirectional transmission,” and “send and / or receive” can be used interchangeably and can be interpreted as receiving from other entities, obtaining from protocols, obtaining from higher layers, obtaining through self-processing, or autonomous implementation, among other meanings.

[0138] In some embodiments, terms such as “send,” “transmit,” “report,” “distribute,” “transfer,” “bidirectional transmission,” “send and / or receive” can be used interchangeably.

[0139] In some embodiments, terms such as "certain," "preset," "default," "set," "indicated," "a certain," "any," and "first" can be used interchangeably. "Certain A," "preset A," "default A," "set A," "indicated A," "a certain A," "any A," and "first A" can be interpreted as A pre-defined in a protocol or the like, or as A obtained through setting, configuration, or instruction, or as specific A, a certain A, any A, or first A, but are not limited thereto.

[0140] In some embodiments, the determination or judgment can be made by a value represented by 1 bit (0 or 1), or by a true or false value (Boolean value (bool)) represented by true or false, or by a numerical comparison (e.g., a comparison with a predetermined value), but is not limited thereto.

[0141] In some embodiments, "not expecting to receive" can be interpreted as not receiving on time domain resources and / or frequency domain resources, or as not performing subsequent processing on the data after receiving it; "not expecting to send" can be interpreted as not sending, or as sending but not expecting the receiver to respond to the sent content.

[0142] Figure 3 is a schematic flowchart of an audio signal processing method according to an embodiment of the present disclosure.

[0143] As shown in Figure 3, the present disclosure relates to an audio signal processing method, which includes the following steps.

[0144] Step S3101: Acquire the first audio signal and the second audio signal.

[0145] In some embodiments, the terminal may acquire a first audio signal through a first microphone and a second audio signal through a second microphone.

[0146] The optional implementation of step S3101 can be found in the optional implementation of step S2103 in Figure 2, as well as other related parts in the embodiments involved in Figure 2, which will not be repeated here.

[0147] Step S3102: Process the first audio signal and the second audio signal based on the filter to obtain the first audio output signal and the second audio output signal.

[0148] In some embodiments, the terminal may process the first audio signal and the second audio signal based on a predetermined filter to obtain a first audio output signal and a second audio output signal with a stereo format.

[0149] The optional implementation of step S3102 can be found in the optional implementation of step S2104 in Figure 2 and other related parts in the embodiments involved in Figure 2, which will not be repeated here.

[0150] In this embodiment of the disclosure, a filter is designed according to the actual device performance so that the final acquired stereo audio meets different performance requirements for sound sources at different angles.

[0151] In this embodiment of the disclosure, the required filter is determined by measuring and calculating the transfer function (also known as acoustic property) of the device in each direction, based on the performance requirements of the target output audio.

[0152] In this embodiment of the disclosure, audio signals collected from various directions by the target device are obtained through analysis and calculation. transfer function, acoustic properties Determine the required output signal based on stereo performance requirements. For different angles Above, to There are different performance requirements.

[0153] In this embodiment of the disclosure, according to Design a filter: The designed filter is a matrix with TF as a parameter.

[0154] In this embodiment of the disclosure, the final signal link is: By multiplying the input signal X with a manually designed filter H with TF as the parameter, the final output audio can meet the corresponding performance requirements for sound sources at different angles.

[0155] The parameter descriptions are as follows:

[0156] The following calculations are performed in the frequency domain, and the ω (frequency) symbol in the relevant formulas is omitted (Y(ω)=Y).

[0157] Horizontal azimuth [-90, 90], from 90° on the left to 90° on the right (since stereo can only reproduce the sound image from 90° on the left to 90° on the right, we only consider the case where the horizontal azimuth is [-90, 90]).

[0158] Y: Two-channel stereo output audio signal Y L Y R ;

[0159] X: At least two channels of input audio signal X1...X N (N≥1);

[0160] U: Sound source;

[0161] The transfer function, acoustic properties, and system transfer characteristics of the signal ultimately acquired by the input channel from the sound source to the device are described, where N is the index of the corresponding input signal. The transfer function (TF) differs at different angles.

[0162] by The target filter is designed for the parameters.

[0163] In this embodiment of the disclosure, the algorithm is designed based on the actual response of the device, taking into account the error of the device itself, and ensuring the performance of the algorithm even when the device has errors.

[0164] In this embodiment of the disclosure, no additional optimization and processing is required for the device's errors, thus reducing computing power and labor costs.

[0165] In this embodiment, unnecessary calibration and other modules can be reduced, avoiding the introduction of new losses and computing power expenditures.

[0166] The following example illustrates the stereo output from a device with two microphones.

[0167] Due to the poor hardware performance of the device itself, the signal error between the two microphones is large, and the errors of the microphones are different, so they need to be processed separately.

[0168] The algorithm is designed based on the actual performance of the equipment, and the actual performance of the equipment can be obtained by calculating the transfer function.

[0169] In this embodiment of the disclosure, the performance requirement for stereo is: the sound source U at different angles At that time, in the output channel Y L Y R There are different relationships between the output L and R channels: for the acquired sound source, the sound source is on the left. At that time, the component of the sound source in the L channel is greater than the component in the R channel. The sound source is on the right side. When the sound source is in the middle, the component of the sound source in the L channel is less than the component of the R channel. When the sound source is in the middle, the component of the sound source in the L channel is equal to the component of the R channel.

[0170] In this embodiment of the disclosure, four filters H1, H2, H3 are designed. L H R TF is an attribute of the device itself, which can be obtained through calculation, measurement, and modeling. The signal link is defined by formulas (5) and (6).

[0171] This disclosure proposes a method for processing audio signals, which involves constructing filters based on the obtained target device transfer function, acoustic properties, and transfer characteristics. Filter parameters are determined according to the target performance of the output signal. By combining input signals from multiple channels with multiple filters, the output signal is made to meet corresponding target performance in different directions.

[0172] This disclosure also provides an apparatus for implementing any of the above methods. For example, an apparatus is provided that includes units or modules for implementing the steps performed by the terminal in any of the above methods. Alternatively, another apparatus is provided that includes units or modules for implementing the steps performed by a network device (e.g., an access network device, a core network functional node, a core network device, etc.) in any of the above methods.

[0173] It should be understood that the division of units or modules in the above device is only a logical functional division. In actual implementation, they can be fully or partially integrated into a single physical entity, or they can be physically separated. Furthermore, the units or modules in the device can be implemented by a processor calling software: for example, the device includes a processor connected to a memory containing instructions. The processor calls the instructions stored in the memory to implement any of the above methods or to implement the functions of the units or modules in the above device. The processor can be, for example, a general-purpose processor, such as a Central Processing Unit (CPU) or a microprocessor, and the memory can be internal or external to the device. Alternatively, the units or modules in the device can be implemented in the form of hardware circuits. The functionality of some or all of the units or modules can be achieved through the design of these hardware circuits, which can be understood as one or more processors. For example, in one implementation, the hardware circuit is an application-specific integrated circuit (ASIC). The functionality of some or all of the units or modules is achieved through the design of the logical relationships between the components within the circuit. In another implementation, the hardware circuit can be implemented using a programmable logic device (PLD). Taking a field-programmable gate array (FPGA) as an example, it can include a large number of logic gates. The connection relationships between the logic gates are configured through configuration files, thereby achieving the functionality of some or all of the units or modules. All units or modules of the above device can be implemented entirely through processor-called software, entirely through hardware circuits, or partially through processor-called software with the remaining parts implemented through hardware circuits.

[0174] In this embodiment, the processor is a circuit with signal processing capabilities. In one implementation, the processor can be a circuit with instruction read and execute capabilities, such as a Central Processing Unit (CPU), a microprocessor, a graphics processing unit (GPU) (which can be understood as a microprocessor), or a digital signal processor (DSP). In another implementation, the processor can implement certain functions through the logical relationships of hardware circuits. The logical relationships of the aforementioned hardware circuits are fixed or reconfigurable. For example, the processor is a hardware circuit implemented using an application-specific integrated circuit (ASIC) or a programmable logic device (PLD), such as an FPGA. In a reconfigurable hardware circuit, the process of the processor loading a configuration document and configuring the hardware circuit can be understood as the process of the processor loading instructions to implement the functions of some or all of the above units or modules. Furthermore, it can also be a hardware circuit designed for artificial intelligence, which can be understood as an ASIC, such as a Neural Network Processing Unit (NPU), a Tensor Processing Unit (TPU), or a Deep Learning Processing Unit (DPU).

[0175] Figure 4 is a schematic diagram of the structure of the audio signal processing device proposed in an embodiment of this disclosure. This audio signal processing device can be applied to a terminal. As shown in Figure 4, the audio signal processing device 4100 may include a processing module 4101.

[0176] In some embodiments, the processing module 4101 is used to process a first audio signal and a second audio signal based on a filter to obtain a first audio output signal and a second audio output signal; wherein the first audio signal is acquired through a first microphone of the terminal, the second audio signal is acquired through a second microphone of the terminal, the filter is determined based on a plurality of transfer functions, the plurality of transfer functions including the transfer function corresponding to the signal acquired by the first microphone when the sound source is at different positions, and the transfer function corresponding to the signal acquired by the second microphone when the sound source is at the different positions.

[0177] In some embodiments, the different positions include a first position, a second position, and a third position. The horizontal angle between the first line connecting the first position and the terminal's location and the second line connecting the second position and the terminal's location is less than a preset angle. The horizontal angle between the first line connecting the first position and the third line connecting the third position and the terminal's location is less than a preset angle. The second line connecting the first position and the third line connecting the third position are located on opposite sides of the first line connecting the second and third positions, respectively. The plurality of transfer functions include the transfer function corresponding to the first position, the transfer function corresponding to the second position, and the transfer function corresponding to the third position.

[0178] In some embodiments, the transfer function corresponding to the first position includes a first transfer function and a second transfer function, the transfer function corresponding to the second position includes a third transfer function and a fourth transfer function, and the transfer function corresponding to the third position includes a fifth transfer function and a sixth transfer function; the first transfer function is the transfer function corresponding to the signal collected by the first microphone when the sound source is located at the first position; the second transfer function is the transfer function corresponding to the signal collected by the second microphone when the sound source is located at the first position; the third transfer function is the transfer function corresponding to the signal collected by the first microphone when the sound source is located at the second position; the fourth transfer function is the transfer function corresponding to the signal collected by the second microphone when the sound source is located at the second position; the fifth transfer function is the transfer function corresponding to the signal collected by the first microphone when the sound source is located at the third position; and the sixth transfer function is the transfer function corresponding to the signal collected by the second microphone when the sound source is located at the third position.

[0179] In some embodiments, the filter includes a first filter, a second filter, a third filter, and a fourth filter; the first filter is determined based on the transfer function corresponding to the third position; the second filter is determined based on the transfer function corresponding to the second position; the third filter is determined based on the transfer function corresponding to the first position and the first filter; and the fourth filter is determined based on the transfer function corresponding to the first position and the second filter.

[0180] In some embodiments, the processing module is configured to process the first audio signal and the second audio signal based on the first filter and the third filter to obtain a first audio output signal; and to process the second audio signal and the first audio signal based on the second filter and the fourth filter to obtain a second audio output signal.

[0181] In some embodiments, the first audio signal and the second audio signal are obtained by collecting signals emitted by the first sound source; when the first sound source is located at the first position, the intensity of the first audio output signal is equal to the intensity of the second audio output signal; when the first sound source is located at the second position, the intensity of the first audio output signal is greater than the intensity of the second audio output signal; when the first sound source is located at the third position, the intensity of the first audio output signal is less than the intensity of the second audio output signal.

[0182] Figure 5A is a schematic diagram of the structure of the communication device 5100 proposed in an embodiment of this disclosure. The communication device 5100 can be a network device (e.g., access network device, core network device, etc.), a terminal (e.g., user equipment, etc.), a chip, chip system, or processor that supports the network device in implementing any of the above methods, or a chip, chip system, or processor that supports the terminal in implementing any of the above methods. The communication device 5100 can be used to implement the methods described in the above method embodiments; for details, please refer to the descriptions in the above method embodiments.

[0183] As shown in Figure 5A, the communication device 5100 includes one or more processors 5101. The processor 5101 can be a general-purpose processor or a dedicated processor, such as a baseband processor or a central processing unit (CPU). The baseband processor can be used to process communication protocols and communication data, while the CPU can be used to control audio signal processing devices (e.g., base stations, baseband chips, terminal devices, terminal device chips, DUs or CUs, etc.), execute programs, and process program data. Optionally, the communication device 5100 can be used to execute any of the above methods. Optionally, one or more processors 5101 can be used to invoke instructions to cause the communication device 5100 to execute any of the above methods.

[0184] In some embodiments, the communication device 5100 further includes one or more transceivers 5102. When the communication device 5100 includes one or more transceivers 5102, the transceiver 5102 performs at least one of the communication steps such as sending and / or receiving in the above method, and the processor 5101 performs at least one of the other steps. In optional embodiments, the transceiver may include a receiver and / or a transmitter, which may be separate or integrated. Optionally, the terms transceiver, transceiver unit, transceiver, transceiver circuit, interface circuit, interface, etc., can be used interchangeably; the terms transmitter, transmitting unit, transmitter, transmitting circuit, etc., can be used interchangeably; and the terms receiver, receiving unit, receiver, receiving circuit, etc., can be used interchangeably.

[0185] In some embodiments, the communication device 5100 further includes one or more memories 5103 for storing data. Optionally, all or part of the memories 5103 may be located outside the communication device 5100. In optional embodiments, the communication device 5100 may include one or more interface circuits 5104. Optionally, the interface circuits 5104 are connected to the memories 5103 and can be used to receive data from the memories 5103 or other devices, and to send data to the memories 5103 or other devices. For example, the interface circuits 5104 can read data stored in the memories 5103 and send the data to the processor 5101.

[0186] The communication device 5100 described in the above embodiments may be a network device or a terminal, but the scope of the communication device 5100 described in this disclosure is not limited thereto, and the structure of the communication device 5100 may not be limited by FIG. 5A. The communication device may be a standalone device or a part of a larger device. For example, the communication device may be: (1) a standalone integrated circuit IC, or chip, or chip system or subsystem; (2) a collection of one or more ICs, optionally, the IC collection may also include storage components for storing data and programs; (3) an ASIC, such as a modem; (4) a module that can be embedded in other devices; (5) a receiver, terminal device, smart terminal device, cellular phone, wireless device, handheld device, mobile unit, vehicle device, network device, cloud device, artificial intelligence device, etc.; (6) others, etc.

[0187] Figure 5B is a schematic diagram of the structure of chip 5200 according to an embodiment of this disclosure. For cases where the communication device 5100 can be a chip or a chip system, please refer to the schematic diagram of chip 5200 shown in Figure 5B, but it is not limited thereto.

[0188] Chip 5200 includes one or more processors 5201. Chip 5200 is used to perform any of the methods described above.

[0189] In some embodiments, chip 5200 further includes one or more interface circuits 5202. Optionally, terms such as interface circuit, interface, and transceiver pin can be used interchangeably. In some embodiments, chip 5200 further includes one or more memories 5203 for storing data. Optionally, all or part of the memories 5203 may be located outside of chip 5200. Optionally, interface circuit 5202 is connected to memory 5203, and interface circuit 5202 can be used to receive data from memory 5203 or other devices, and interface circuit 5202 can be used to send data to memory 5203 or other devices. For example, interface circuit 5202 can read data stored in memory 5203 and send the data to processor 5201.

[0190] In some embodiments, the interface circuit 5202 performs at least one of the communication steps such as sending and / or receiving in the above-described method (e.g., step S2101, but not limited thereto). For example, the interface circuit 5202 performing the communication steps such as sending and / or receiving in the above-described method means that the interface circuit 5202 performs data interaction between the processor 5201, the chip 5200, the memory 5203, or the transceiver device. In some embodiments, the processor 5201 performs at least one of the other steps.

[0191] The modules and / or devices described in the various embodiments, such as virtual devices, physical devices, and chips, can be combined or separated arbitrarily as needed. Optionally, some or all steps can also be performed collaboratively by multiple modules and / or devices, which is not limited here.

[0192] This disclosure also proposes a storage medium storing instructions that, when executed on the communication device 5100, cause the communication device 5100 to perform any of the above methods. Optionally, the storage medium is an electronic storage medium. Optionally, the storage medium is a computer-readable storage medium, but not limited thereto; it may also be a storage medium readable by other devices. Optionally, the storage medium may be a non-transitory storage medium, but not limited thereto; it may also be a temporary storage medium.

[0193] This disclosure also provides a program product that, when executed by the communication device 5100, causes the communication device 5100 to perform any of the above methods. Optionally, the program product is a computer program product.

[0194] This disclosure also proposes a computer program that, when run on a computer, causes the computer to perform any of the above methods.

Claims

1. An audio signal processing method, characterized in that, The method includes: The first audio signal and the second audio signal are processed by a filter to obtain the first audio output signal and the second audio output signal. The first audio signal is acquired through the first microphone of the terminal, the second audio signal is acquired through the second microphone of the terminal, and the filter is determined based on multiple transfer functions, including the transfer function corresponding to the signal acquired by the first microphone when the sound source is in different positions, and the transfer function corresponding to the signal acquired by the second microphone when the sound source is in different positions.

2. The method according to claim 1, characterized in that, The different positions include a first position, a second position, and a third position. The horizontal angle between the first line connecting the first position and the terminal's location and the second line connecting the second position and the terminal's location is less than a preset angle. The horizontal angle between the first line connecting the first position and the third line connecting the third position and the terminal's location is less than a preset angle. The second line connecting the second position and the third line connecting the third position are located on both sides of the first line connecting the second and third positions. The plurality of transfer functions include the transfer function corresponding to the first position, the transfer function corresponding to the second position, and the transfer function corresponding to the third position.

3. The method according to claim 2, characterized in that, The transfer function corresponding to the first position includes a first transfer function and a second transfer function, the transfer function corresponding to the second position includes a third transfer function and a fourth transfer function, and the transfer function corresponding to the third position includes a fifth transfer function and a sixth transfer function; The first transfer function is the transfer function corresponding to the signal collected by the first microphone when the sound source is located at the first position; The second transfer function is the transfer function corresponding to the signal collected by the second microphone when the sound source is located at the first position; The third transfer function is the transfer function corresponding to the signal collected by the first microphone when the sound source is located at the second position; The fourth transfer function is the transfer function corresponding to the signal collected by the second microphone when the sound source is located at the second position; The fifth transfer function is the transfer function corresponding to the signal collected by the first microphone when the sound source is located at the third position; The sixth transfer function is the transfer function corresponding to the signal collected by the second microphone when the sound source is located at the third position.

4. The method according to claim 2 or 3, characterized in that, The filter includes a first filter, a second filter, a third filter, and a fourth filter; The first filter is determined based on the transfer function corresponding to the third position; The second filter is determined based on the transfer function corresponding to the second position; The third filter is determined based on the transfer function corresponding to the first position and the first filter; The fourth filter is determined based on the transfer function corresponding to the first position and the second filter.

5. The method according to claim 4, characterized in that, The filter-based processing of the first audio signal and the second audio signal to obtain a first audio output signal and a second audio output signal includes: The first audio signal and the second audio signal are processed based on the first filter and the third filter to obtain the first audio output signal; The second audio signal and the first audio signal are processed based on the second filter and the fourth filter to obtain the second audio output signal.

6. The method according to claim 2, characterized in that, The first audio signal and the second audio signal are obtained by collecting signals emitted by the first sound source; when the first sound source is located at the first position, the intensity of the first audio output signal is equal to the intensity of the second audio output signal; when the first sound source is located at the second position, the intensity of the first audio output signal is greater than the intensity of the second audio output signal; when the first sound source is located at the third position, the intensity of the first audio output signal is less than the intensity of the second audio output signal.

7. An audio signal processing device, characterized in that, The device includes: The processing module is used to process the first audio signal and the second audio signal based on the filter to obtain the first audio output signal and the second audio output signal; The first audio signal is acquired through the first microphone of the terminal, the second audio signal is acquired through the second microphone of the terminal, and the filter is determined based on multiple transfer functions, including the transfer function corresponding to the signal acquired by the first microphone when the sound source is in different positions, and the transfer function corresponding to the signal acquired by the second microphone when the sound source is in different positions.

8. The apparatus according to claim 7, characterized in that, The different positions include a first position, a second position, and a third position. The horizontal angle between the first line connecting the first position and the terminal's location and the second line connecting the second position and the terminal's location is less than a preset angle. The horizontal angle between the first line connecting the first position and the third line connecting the third position and the terminal's location is less than a preset angle. The second line connecting the second position and the third line connecting the third position are located on both sides of the first line connecting the second and third positions. The plurality of transfer functions include the transfer function corresponding to the first position, the transfer function corresponding to the second position, and the transfer function corresponding to the third position.

9. The apparatus according to claim 8, characterized in that, The transfer function corresponding to the first position includes a first transfer function and a second transfer function, the transfer function corresponding to the second position includes a third transfer function and a fourth transfer function, and the transfer function corresponding to the third position includes a fifth transfer function and a sixth transfer function; The first transfer function is the transfer function corresponding to the signal collected by the first microphone when the sound source is located at the first position; The second transfer function is the transfer function corresponding to the signal collected by the second microphone when the sound source is located at the first position; The third transfer function is the transfer function corresponding to the signal collected by the first microphone when the sound source is located at the second position; The fourth transfer function is the transfer function corresponding to the signal collected by the second microphone when the sound source is located at the second position; The fifth transfer function is the transfer function corresponding to the signal collected by the first microphone when the sound source is located at the third position; The sixth transfer function is the transfer function corresponding to the signal collected by the second microphone when the sound source is located at the third position.

10. The apparatus according to claim 8 or 9, characterized in that, The filter includes a first filter, a second filter, a third filter, and a fourth filter; The first filter is determined based on the transfer function corresponding to the third position; The second filter is determined based on the transfer function corresponding to the second position; The third filter is determined based on the transfer function corresponding to the first position and the first filter; The fourth filter is determined based on the transfer function corresponding to the first position and the second filter.

11. The apparatus according to claim 10, characterized in that, The processing module is used to process the first audio signal and the second audio signal based on the first filter and the third filter to obtain a first audio output signal; and to process the second audio signal and the first audio signal based on the second filter and the fourth filter to obtain a second audio output signal.

12. The apparatus according to claim 8, characterized in that, The first audio signal and the second audio signal are obtained by collecting signals emitted by the first sound source; when the first sound source is located at the first position, the intensity of the first audio output signal is equal to the intensity of the second audio output signal; when the first sound source is located at the second position, the intensity of the first audio output signal is greater than the intensity of the second audio output signal; when the first sound source is located at the third position, the intensity of the first audio output signal is less than the intensity of the second audio output signal.

13. A terminal, characterized in that, include: One or more processors; The terminal is used to execute the method according to any one of claims 1 to 6.

14. A storage medium storing instructions, characterized in that, When the instructions are executed on the communication device, the communication device performs the method as described in any one of claims 1 to 6.

15. A program product, characterized in that, include: A computer program, when executed by a communication device, causes the communication device to perform the method as described in any one of claims 1 to 6.

Images