Signal processing method, device, and storage medium
Through signal model and actual signal calibration methods, the problem of poor signal consistency in the microphone array is solved, the signal consistency and performance of the microphone array are improved, and the usage needs are adapted to complex environments.
Patent Information
- Application Number
- PCT/CN2024/074341
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2024-01-26
- Publication Date
- 2025-07-31
AI Technical Summary
In the prior art, the signal consistency between multiple microphones in the microphone array is poor, resulting in a degradation in the performance of the device in complex environments, especially in multimedia devices, it is difficult to ensure the consistency of the signal and the effectiveness of algorithm design.
By obtaining the reference signal, calibrate the received signal of each microphone in the microphone array based on the signal model or actual signal, and compensate for the differences in the signal model and the transmission path parameters to ensure the consistency of each microphone signal.
It improves the consistency of the microphone array signal, reduces calibration difficulty, improves the performance of the signal model and the overall performance of the microphone array, and adapts to the needs of actual use scenarios.
Smart Images

Figure CN2024074341_31072025_PF_FP_ABST
Abstract
Description
Signal processing method, device and storage medium Technical Field
[0001] The present disclosure relates to the field of communication technologies, and in particular to a signal processing method, device, and storage medium. Background Art
[0002] The problem of consistency in existing microphone (mic) arrays is solved by selecting sensor elements with consistent performance, and the corresponding compensation and calibration schemes are also performed for the sensor elements that are not installed.
[0003] Summary of the Invention
[0004] Embodiments of the present disclosure provide a signal processing method, device, and storage medium.
[0005] According to a first aspect of the present disclosure, a signal processing method is provided, the method comprising:
[0006] Obtain a reference signal;
[0007] Calibrate the received signal of each microphone in the microphone array based on the reference signal;
[0008] The reference signal includes any one of the following:
[0009] Target signal determined based on the signal model;
[0010] The actual signal at each microphone position in the microphone array.
[0011] According to a second aspect of the present disclosure, a terminal is provided, including:
[0012] a processing module, configured to obtain a reference signal and calibrate a received signal of each microphone in the microphone array based on the reference signal;
[0013] The reference signal includes any one of the following:
[0014] Target signal determined based on the signal model;
[0015] The actual signal at each microphone position in the microphone array.
[0016] According to a third aspect of the present disclosure, a terminal is provided, including:
[0017] one or more processors;
[0018] The terminal is used to execute the optional implementation of the aforementioned first aspect.
[0019] According to a fourth aspect of an embodiment of the present disclosure, a computer-readable storage medium is provided, in which executable instructions are stored. The executable instructions are loaded and executed by the processor to implement the method described in the optional implementation manner of the first aspect.
[0020] It is to be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the disclosure. BRIEF DESCRIPTION OF THE DRAWINGS
[0021] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the invention and, together with the description, serve to explain the principles of the invention.
[0022] FIG1a is a flow chart showing a signal processing method according to an exemplary embodiment;
[0023] FIG1b is a schematic flow chart showing a signal processing method according to an exemplary embodiment;
[0024] FIG1c is a schematic flow chart showing a signal processing method according to an exemplary embodiment;
[0025] FIG2 is a schematic diagram showing a microphone array according to an exemplary embodiment;
[0026] FIG3 is a schematic diagram of the structure of a terminal proposed in an embodiment of the present disclosure;
[0027] FIG4 is a schematic structural diagram of a communication device proposed in an embodiment of the present disclosure;
[0028] FIG5 is a schematic diagram of the structure of a terminal proposed in an embodiment of the present disclosure. DETAILED DESCRIPTION
[0029] The embodiments of the present disclosure provide a signal processing method, a device, and a storage medium.
[0030] In a first aspect, an embodiment of the present disclosure provides a signal processing method, the method comprising:
[0031] Obtain a reference signal;
[0032] Calibrate the received signal of each microphone in the microphone array based on the reference signal;
[0033] The reference signal includes any of the following:
[0034] Target signal determined based on the signal model;
[0035] The actual signal at each microphone position in the microphone array.
[0036] In the above embodiment, the received signal of each microphone in the microphone array is calibrated according to the target signal determined based on the signal model, or the actual signal at the position of each microphone in the microphone array, thereby solving the problem of poor consistency of signals collected between multiple microphones in the microphone array on the current device.
[0037] In conjunction with some embodiments of the first aspect, in some embodiments, the reference signal is the target signal, and calibrating the received signal of each microphone in the microphone array based on the reference signal includes:
[0038] using a received signal of a first microphone in the microphone array as the target signal;
[0039] Based on the reception signal of the first microphone, reception signals of other microphones in the microphone array except the first microphone are calibrated.
[0040] In the above embodiment, the received signal of the first microphone is selected as the reference signal to calibrate the received signals of other microphones in the microphone array, thereby achieving consistency compensation of multiple microphone signals in the microphone array and reducing the difficulty of calibration.
[0041] In conjunction with some embodiments of the first aspect, in some embodiments, calibrating the received signals of other microphones in the microphone array except the first microphone based on the received signal of the first microphone includes:
[0042] determining a first compensation parameter based on the first parameter and the second parameter;
[0043] calibrating a received signal of the second microphone according to the first compensation parameter;
[0044] Wherein, the second microphone is any one of the other microphones;
[0045] The first parameter represents a difference between a signal received by the first microphone and a signal received by the second microphone;
[0046] The second parameter represents a difference between a first transfer path parameter from the sound source to the first microphone and a second transfer path parameter from the sound source to the second microphone.
[0047] In the above embodiment, by utilizing the signal model and determining the first supplementary parameter based on the difference between the received signals of the two microphones and the difference between the influences of the transmission paths from the sound source to the two microphones, the received signal of one of the microphones is calibrated. This can reduce the error so that the calibrated signal meets the consistency requirements, and can also make the received signal of the microphone closer to the theoretical model, thereby improving the performance of the signal model.
[0048] In conjunction with some embodiments of the first aspect, in some embodiments, the method further includes:
[0049] The first microphone is determined from the microphone array, wherein the first transfer path parameter is the same as the second transfer path parameter.
[0050] In the above embodiment, by selecting the first microphone so that the transfer path parameters from the sound source to other microphones are equal to the transfer path parameters from the sound source to the first microphone, the influence of the path transfer function on the microphone signal can be eliminated.
[0051] In combination with some embodiments of the first aspect, in some embodiments, the first compensation parameter is determined based on the first parameter.
[0052] In combination with some embodiments of the first aspect, in some embodiments, if there are at least two first microphones, the first compensation parameter is determined based on at least two compensation parameters, wherein each compensation parameter corresponds to one first microphone.
[0053] In the above embodiment, by selecting multiple first microphones as reference points to perform consistency compensation for microphone signals, the compensation result can be made more accurate, and the algorithm performance of the signal model can be further improved.
[0054] In combination with some embodiments of the first aspect, in some embodiments, the calibrated signal of the second microphone includes the second transfer path parameter.
[0055] In conjunction with some embodiments of the first aspect, in some embodiments, calibrating the received signal of the second microphone according to the first compensation parameter includes:
[0056] After removing the second transfer path parameter from the received signal of the second microphone, calibration is performed based on the first compensation parameter.
[0057] In the above embodiment, the microphones may be calibrated when the propagation paths from the sound source to the microphones are different.
[0058] In conjunction with some embodiments of the first aspect, in some embodiments, the reference signal is an actual signal at the position of each microphone in the microphone array, and calibrating the received signal of each microphone in the microphone array based on the reference signal includes:
[0059] determining a second compensation parameter according to an actual signal at a position of a third microphone and a received signal of the third microphone;
[0060] calibrating a received signal of the third microphone according to the second compensation parameter;
[0061] The third microphone is any microphone in the microphone array.
[0062] In the above embodiment, each microphone signal can be calibrated to be consistent with the actual signal at its own position, thereby meeting the requirements of actual applications of the microphone array.
[0063] In combination with some embodiments of the first aspect, in some embodiments, the second compensation parameter is determined based on the actual signal at the position of the third microphone and the received signal of the third microphone, and a third parameter, and the third parameter is used to characterize the performance required by the microphone.
[0064] In the above embodiment, while maintaining consistency among the microphones, the performance of each microphone can also be improved.
[0065] In combination with some embodiments of the first aspect, in some embodiments, the third parameter is the same for each microphone in the microphone array, or the third parameter corresponds to the third microphone.
[0066] In the above embodiment, each microphone in the microphone array may have the same third parameter, thereby improving the performance of the microphone array, or each microphone in the microphone array may have its own corresponding third parameter, thereby improving the performance of each microphone.
[0067] In a second aspect, an embodiment of the present disclosure provides a terminal, including:
[0068] a processing module, configured to obtain a reference signal and calibrate a received signal of each microphone in the microphone array based on the reference signal;
[0069] The reference signal includes any one of the following:
[0070] Target signal determined based on the signal model;
[0071] The actual signal at each microphone position in the microphone array.
[0072] In a third aspect, an embodiment of the present disclosure provides a terminal, including:
[0073] one or more processors;
[0074] The terminal executes the method described in the optional implementation manner of the first aspect.
[0075] In a fourth aspect, an embodiment of the present disclosure proposes a communication system, including a terminal, wherein the terminal is used to implement the method described in the optional implementation manner of the first aspect.
[0076] In a fifth aspect, an embodiment of the present disclosure proposes a storage medium, which stores instructions. When the instructions are executed on a communication device, the communication device executes the method described in the optional implementation manner of the first aspect.
[0077] In a sixth aspect, an embodiment of the present disclosure proposes a program product. When the program product is executed by a communication device, the communication device executes the method described in the optional implementation manner of the first aspect.
[0078] In a seventh aspect, an embodiment of the present disclosure proposes a computer program, which, when executed on a computer, enables the computer to execute the method described in the optional implementation manner of the first aspect.
[0079] In an eighth aspect, an embodiment of the present disclosure proposes a chip or a chip system, which includes a processing circuit for executing the method described in the optional implementation manner of the first aspect above.
[0080] It is understood that the above-mentioned communication devices, communication systems, storage media, program products, and computer programs are all used to perform the methods proposed in the embodiments of the present disclosure. Therefore, the beneficial effects that can be achieved can refer to the beneficial effects of the corresponding methods and will not be repeated here. Among them, the communication device can be a terminal that implements the authorization function or the core functions of the universal application program interface framework.
[0081] The embodiments of the present disclosure provide a signal processing method, a communication device, a communication system, and a storage medium. In some embodiments, the terms signal processing method, information processing method, and determining information processing methods are interchangeable, and the terms information processing system and communication system are interchangeable.
[0082] The embodiments of the present disclosure are not exhaustive and are merely illustrative of some embodiments, and are not intended to be a specific limitation on the scope of protection of the embodiments of the present disclosure. In the absence of contradiction, each step in a certain embodiment can be implemented as an independent embodiment, and the steps can be arbitrarily combined. For example, a solution after removing some steps in a certain embodiment can also be implemented as an independent embodiment, and the order of the steps in a certain embodiment can be arbitrarily exchanged. In addition, the optional implementation methods in a certain embodiment can be arbitrarily combined; in addition, the embodiments can be arbitrarily combined. For example, some or all steps of different embodiments can be arbitrarily combined, and a certain embodiment can be arbitrarily combined with the optional implementation methods of other embodiments.
[0083] In each embodiment of the present disclosure, unless otherwise specified or provided for by logic, the terms and / or descriptions between the embodiments are consistent and can be referenced by each other. The technical features in different embodiments can be combined to form a new embodiment based on their inherent logical relationships.
[0084] The terms used in the embodiments of the present disclosure are only for the purpose of describing specific embodiments and are not intended to limit the embodiments of the present disclosure.
[0085] In the embodiments of the present disclosure, unless otherwise specified, elements expressed in the singular, such as "a", "an", "the", "above", "said", "the", "the", etc., may mean "one and only one", or "one or more", "at least one", etc. For example, when using articles such as "a", "an", "the" in English in translation, the noun following the article may be understood as a singular expression or a plural expression.
[0086] In the embodiments of the present disclosure, “plurality” refers to two or more.
[0087] In some embodiments, the terms "at least one of", "at least one of", "at least one of", "one or more", "a plurality of", "multiple", etc. can be used interchangeably.
[0088] In the embodiments of the present disclosure, descriptions such as “at least one of A, B, C…”, “A and / or B and / or C…”, etc. include the situation where any one of A, B, C… exists alone, and also include any combination of any multiple of A, B, C…, and each situation can exist alone; for example, “at least one of A, B, C” includes the situation where A exists alone, B exists alone, C exists alone, the combination of A and B, the combination of A and C, the combination of B and C, and the combination of A, B, and C; for example, A and / or B includes the situation where A exists alone, B exists alone, and the combination of A and B.
[0089] In some embodiments, descriptions such as "in one case A, in another case B," or "in response to one case A, in response to another case B," may include the following technical solutions depending on the situation: executing A independently of B (in some embodiments, A); executing B independently of A (in some embodiments, B); selectively executing A and B (in some embodiments, selecting between A and B); and executing both A and B (in some embodiments, A and B). The same applies when there are more branches, such as A, B, and C.
[0090] The prefixes such as "first" and "second" in the embodiments of the present disclosure are only used to distinguish different description objects and do not constitute any restriction on the position, order, priority, quantity or content of the description objects. For the statement of the description object, please refer to the description in the context of the claims or embodiments, and no unnecessary restriction should be constituted due to the use of prefixes. For example, if the description object is a "field", the ordinal number before the "field" in the "first field" and the "second field" does not limit the position or order between the "fields". "First" and "second" do not limit whether the "fields" they modify are in the same message, nor do they limit the order of the "first field" and the "second field". For another example, if the description object is a "level", the ordinal number before the "level" in the "first level" and the "second level" does not limit the priority between the "levels". For another example, the number of description objects is not limited by the ordinal number and can be one or more. Taking "first device" as an example, the number of "devices" can be one or more. In addition, the objects modified by different prefixes can be the same or different. For example, if the description object is "device", then the "first device" and the "second device" can be the same device or different devices, and their types can be the same or different. For another example, if the description object is "information", then the "first configuration" and the "second configuration" can be the same information or different information, and their contents can be the same or different.
[0091] In some embodiments, “including A,” “comprising A,” “used to indicate A,” and “carrying A” can be interpreted as directly carrying A or indirectly indicating A.
[0092] In some embodiments, terms such as "in response to...", "in response to determining...", "in the case of...", "at the time of...", "when...", "if...", "if...", etc. can be used interchangeably.
[0093] In some embodiments, terms such as "greater than", "greater than or equal to", "not less than", "more than", "more than or equal to", "not less than", "higher than", "higher than or equal to", "not less than", and "above" can be replaced with each other, and terms such as "less than", "less than or equal to", "not greater than", "less than", "less than or equal to", "not more than", "lower than", "lower than or equal to", "not higher than", and "below" can be replaced with each other.
[0094] In some embodiments, devices, etc. can be interpreted as physical or virtual, and their names are not limited to the names recorded in the embodiments. Terms such as "device", "equipment", "device", "circuit", "network element", "node", "function", "unit", "section", "system", "network", "chip", "chip system", "entity", and "subject" can be used interchangeably.
[0095] In some embodiments, obtaining data, information, etc. may comply with the laws and regulations of the country where the data is obtained.
[0096] In some embodiments, data, information, etc. may be obtained with the user's consent.
[0097] The problem of consistency in existing microphone (mic) arrays is solved by selecting sensor elements with consistent performance, and the corresponding compensation and calibration schemes are also performed for the sensor elements that are not installed.
[0098] However, the operating environment of microphones on terminal devices is even more complex. This is especially true for multimedia devices. Sensor system design and installation are constrained and influenced by other hardware, making it difficult to ensure device consistency during design. Ultimately, the issue of sensor signal consistency remains unresolved, negatively impacting algorithm design and performance.
[0099] In the prior art, microphone compensation typically involves compensating the microphone signal at a reference point. This involves applying a compensation filter to the microphone output, based on the reference signal, to a target signal. Consistency is ensured by ensuring that each microphone is consistent with the target signal.
[0100] However, for devices with multiple mics (i.e., mic arrays), each mic has its own reference point. Therefore, applying the aforementioned compensation scheme for a single mic to multiple mics becomes a complex process. Furthermore, for devices with complex mic designs, the actual setting of each mic's reference point can lead to errors, severely impacting final performance.
[0101] Specifically, the signal transmitted from the sound source X0 to each mic can be regarded as:
[0102] Among them, X0 is the sound source signal; X N is the signal at the micN position; The sound source 0 is from the angle θ N Incident to mic N The transfer function of the propagation path.
[0103] mic N The actual signal at the position is:
[0104] in, For mic N The transfer function of the incident sound source at an angle of θ is affected by the performance of the mic itself, the shielding of the signal by the UE, etc.; v is the noise.
[0105] The above X0, X N 、Y N These are all actually available signals.
[0106] To compensate for the mic, the sound source propagation path needs to be preserved The differences caused by different mics, while keeping the consistency of each mic.
[0107] In the related art, calibration is performed by fixing the propagation path from the test signal to the mic. In case of:
[0108] Through the compensation filter H N (θ N ) Let Y1H1(θ1)=Y2H2(θ2)=·······=Y N H N (θ N )=Y0, so that the final output signal of the mic is close to the compensated target signal Y0.
[0109] Usually, a signal whose frequency and phase response meet expectations is selected as the target signal for compensation.
[0110] Calibration is performed by making the signal output by each mic at its own reference point equal to the target signal. This method is too difficult for UE to operate, and for mic arrays with small spacing, the setting of the reference point will have errors, making it difficult to ensure In addition, the incident angle of the sound source during calibration will be different from the incident angle of the sound source in actual use. The calibration scenario and the actual use scenario are also inconsistent. There is no guarantee that the device can maintain consistency in the actual use scenario.
[0111] Therefore, the problem of poor signal consistency between multiple sensors or microphone arrays on terminal devices needs to be solved urgently.
[0112] In some embodiments, the terms "terminal", "terminal device", "user equipment (UE)", "user terminal", "mobile station (MS)", "mobile terminal (MT)", subscriber station, mobile unit, subscriber unit, wireless unit, remote unit, mobile device, wireless device, wireless communication device, remote device, mobile subscriber station, access terminal, mobile terminal, wireless terminal, remote terminal, handset, user agent, mobile client, client, etc. can be used interchangeably.
[0113] In some embodiments, the terminal can be at least one of a computer, a mobile phone, a wearable device, an Internet of Things device, a car with communication capabilities, a smart car, a tablet computer, a computer with wireless transceiver capabilities, a virtual reality (VR) terminal device, an augmented reality (AR) terminal device, a wireless terminal device in industrial control, a wireless terminal device in self-driving, a wireless terminal device in remote medical surgery, a wireless terminal device in a smart grid, a wireless terminal device in transportation safety, a wireless terminal device in a smart city, a wireless terminal device in a smart home, and a server, but is not limited thereto.
[0114] The embodiments of the present disclosure may be applied to Long Term Evolution (LTE), LTE-Advanced (LTE-A), LTE-Beyond (LTE-B), SUPER 3G, IMT-Advanced, 4th generation mobile communication system (4G), 5th generation mobile communication system (5G), 5G new radio (NR), future radio access (FRA), new radio access technology (RAT), new radio (NR), new radio access (NX), future generation radio access (FX), Global System for Mobile communications (GSM (registered trademark)), CDMA2000, Ultra Mobile Broadband (UMB), IEEE 802.11 (Wi-Fi (registered trademark)), IEEE 802.16 (WiMAX (registered trademark)), IEEE 802.20, Ultra-WideBand (UWB), Bluetooth (registered trademark), Public Land Mobile Network (PLMN) networks, Device-to-Device (D2D) systems, Machine-to-Machine (M2M) systems, Internet of Things (IoT) systems, Vehicle-to-Everything (V2X), other systems utilizing random access, and next-generation systems based on and extending these systems. Furthermore, multiple systems may be combined (for example, a combination of LTE or LTE-A with 5G).
[0115] The method provided by the embodiment of the present disclosure is applied on a mobile terminal or a multimedia device.
[0116] Various embodiments of the signal processing method proposed in the present disclosure are described in detail below.
[0117] FIG1a is a flow chart of a signal processing method according to an embodiment of the present disclosure. As shown in FIG1a , the method can be executed by a terminal, and the method includes:
[0118] S101: Acquire a reference signal.
[0119] S102: Calibrate the received signal of each microphone in the microphone array based on the reference signal.
[0120] In some embodiments, multiple microphones may form a microphone array.
[0121] In some embodiments, the received signal of the microphone is a signal captured by the microphone or a signal collected by the microphone.
[0122] In some embodiments, the reference signal may be a target signal determined based on a signal model.
[0123] In some embodiments, the target signal may be a signal preset in a signal model.
[0124] In some embodiments, the target signal may be set based on the performance requirements of the signal model.
[0125] Optionally, the target signal may be a signal that meets the performance requirements of the signal model.
[0126] In some embodiments, the target signal may be an actual signal at a certain microphone position in the microphone array.
[0127] In some embodiments, the actual signal at the microphone position may be a real sound field signal at the microphone position.
[0128] In some embodiments, the reference signal may be the actual signal at each microphone position in the microphone array.
[0129] In the above embodiment, in order to ensure the consistency of the signals of each microphone in the microphone array, it is necessary to supplement the received signal of the microphone to achieve consistency calibration of the microphone signal. The signal of the microphone array can be compensated and calibrated based on the performance requirements of the signal model, that is, the signals of each microphone in the microphone array can be calibrated to be consistent with the target signal, thereby improving the performance of the signal model, or each microphone signal can be calibrated to be consistent with the actual signal at its own position, thereby meeting the actual application requirements of the microphone array.
[0130] In some embodiments, a received signal of the first microphone in the microphone array may be used as the target signal.
[0131] Optionally, if the received signal of the first microphone in the microphone array meets the performance requirements of the signal model, the received signal of the first microphone is used as the target signal.
[0132] In some embodiments, the above step S102 may include: calibrating the received signals of other microphones in the microphone array except the first microphone based on the received signal of the first microphone.
[0133] FIG1b is a flow chart of a signal processing method according to an embodiment of the present disclosure. As shown in FIG1b , the method can be executed by a terminal, and the method includes:
[0134] S111 . Determine a first compensation parameter based on the first parameter and the second parameter.
[0135] Optionally, the first parameter represents a difference between a signal received by the first microphone and a signal received by the second microphone.
[0136] Optionally, the second parameter represents a difference between a first transfer path parameter from the sound source to the first microphone and a second transfer path parameter from the sound source to the second microphone.
[0137] In some embodiments, the first supplementary parameter may be determined based on a difference between a received signal of the first microphone and a received signal of the second microphone, and a difference between effects of transfer paths of the sound source to the two microphones.
[0138] Optionally, the transfer path parameters from the sound source to each microphone may be characterized by a path transfer function.
[0139] Exemplarily, the first transfer path parameter from the sound source to the first microphone may be characterized by a first path transfer function.
[0140] Exemplarily, the second transfer path parameter from the sound source to the second microphone may be characterized by a second path transfer function.
[0141] S112: Calibrate the received signal of the second microphone according to the first compensation parameter.
[0142] Optionally, the second microphone is any microphone other than the first microphone in the microphone array.
[0143] In this embodiment, a certain microphone in the microphone array is used as a reference to perform consistency calibration on the signals of other microphones so that the signals of other microphones are consistent with the signal of the specific microphone.
[0144] In some embodiments, terms such as "certain", "preset", "preset", "set", "some", "any", and "first" can be interchangeable. "Specific A", "preset A", "preset A", "set A", "some A", "any A", and "first A" can be interpreted as a pre-determined A, or as an A obtained through setting, configuration, etc., or as specific A, some A, any A, or first A, etc., but are not limited to this.
[0145] In this embodiment, by utilizing the signal model and determining the first supplementary parameter based on the difference between the received signals of the two microphones and the difference between the influences of the transmission paths from the sound source to the two microphones, the received signal of one of the microphones is calibrated. This can reduce the error so that the calibrated signal meets the consistency requirements, and can also make the received signal of the microphone closer to the theoretical model, thereby improving the performance of the signal model.
[0146] In some embodiments, before step S111, the following steps may also be included:
[0147] S110: Determine the first microphone from the microphone array.
[0148] In some embodiments, the first transfer path parameter is the same as the second transfer path parameter.
[0149] Optionally, a first microphone may be selected from the microphone array so that a first transfer path parameter from the sound source to the first microphone is equal to a second transfer path parameter from the sound source to the second microphone.
[0150] That is, by selecting the first microphone so that the transfer path parameters from the sound source to other microphones are equal to the transfer path parameters from the sound source to the first microphone, the influence of the path transfer function on the microphone signal can be eliminated.
[0151] In some embodiments, the first compensation parameter is determined based on the first parameter.
[0152] In some embodiments, the first microphone is selected so that the transfer path parameters from the sound source to the other microphones are equal to the transfer path parameters from the sound source to the first microphone, and the first compensation parameter is determined based on the first parameter.
[0153] Optionally, the first microphone is selected so that the transfer path parameters from the sound source to the other microphones are equal to the transfer path parameters from the sound source to the first microphone, and the value of the second parameter is 1.
[0154] In some embodiments, there may be more than one, or at least two, first microphones. Then: the first compensation parameter is determined based on at least two compensation parameters, wherein each compensation parameter corresponds to one first microphone.
[0155] Optionally, the first compensation parameter may be an average of at least two compensation parameters.
[0156] Optionally, for each first microphone, a compensation parameter may be obtained by referring to the above step S111.
[0157] In this embodiment, by selecting multiple mics as reference points to perform consistency compensation on mic signals, the compensation result can be made more accurate, and the algorithm performance of the signal model can be further improved.
[0158] In some embodiments, the calibrated signal of the second microphone includes a second transfer path parameter.
[0159] Optionally, the calibrated signal of the second microphone includes the influence of the path propagation from the sound source to the second microphone.
[0160] In some embodiments, the step S112 may include: removing the second transfer path parameter from the received signal of the second microphone and then performing calibration based on the first compensation parameter.
[0161] Optionally, before calibrating the received signal of the second microphone based on the first compensation parameter, the influence of the path propagation from the sound source to the second microphone may be removed from the received signal of the second microphone.
[0162] Optionally, after removing the “influence of the transmission path from the sound source to the second microphone” from the signal of the second microphone, calibration is performed based on the first compensation parameter.
[0163] In some embodiments, the reference signal may be the actual signal at each microphone position in the microphone array.
[0164] In some embodiments, the above step S102 may include: calibrating the received signals of the corresponding microphones in the microphone array based on the actual signal at each microphone position in the microphone array.
[0165] Optionally, based on the i-th microphone mic in the microphone array i The actual signal at the position, to the mic i The received signal is calibrated. Wherein, the value of i ranges from 1 to N, and N is a positive integer greater than 1.
[0166] FIG1c is a flow chart of a signal processing method according to an embodiment of the present disclosure. As shown in FIG1c , the method can be executed by a terminal, and the method includes:
[0167] S121 . Determine a second compensation parameter according to an actual signal at the position of the third microphone and a received signal of the third microphone.
[0168] Optionally, the third microphone is any microphone in the microphone array. i .
[0169] In some embodiments, a difference between an actual signal at the position of the third microphone and a received signal of the third microphone is determined as the second compensation parameter.
[0170] S122: Calibrate the received signal of the third microphone according to the second compensation parameter.
[0171] In some embodiments, for each microphone in the microphone array, the signal of the microphone is calibrated using a compensation parameter determined by the difference between the actual signal at the microphone position and the received signal of the microphone, so that the signals of each microphone in the microphone array meet the consistency requirements.
[0172] In some embodiments, the second compensation parameter is determined based on an actual signal at the position of the third microphone, a received signal of the third microphone, and the third parameter.
[0173] Optionally, the third parameter is used to characterize the performance required of the microphone. For example, when recording music, if special sound effects need to be added to the microphone, this can be achieved by adding a sound effect filter. In this case, the third parameter is the parameters or filter coefficients of the sound effect filter.
[0174] In some embodiments, the second compensation parameter may be determined based on the actual signal at the position of the third microphone, the received signal of the third microphone, and the third parameter.
[0175] Optionally, the third parameter may be understood as a filter parameter related to the required performance of the microphone.
[0176] In some embodiments, the third parameter is the same for each microphone in the microphone array.
[0177] Optionally, the same third parameter may be used for each microphone in the microphone array.
[0178] Exemplarily, an all-pass filter is set for the microphone array so that each microphone in the microphone array has the same third parameter, thereby improving the performance of the microphone array.
[0179] In some embodiments, the third parameter corresponds to a third microphone.
[0180] Optionally, a third parameter corresponding to each microphone in the microphone array is used respectively.
[0181] Exemplarily, a fixed filter is set for each microphone in the microphone array, so that each microphone in the microphone array has its own corresponding third parameter, thereby improving the performance of each microphone.
[0182] The embodiment of the present disclosure further proposes a signal processing method for simultaneously calibrating multiple microphones according to the actual usage status of a device (which may be the terminal device mentioned above or the multimedia device mentioned above).
[0183] In some embodiments, the actual usage status of the device can be understood as the sound source position and mic working status in an actual scenario.
[0184] Optionally, taking a mobile phone as an example, it can be understood that the sound source is placed at the position of the human mouth when the mobile phone is normally used, and the position of the mobile phone is also placed according to the posture of the user when using it normally.
[0185] Alternatively, using a mobile phone as an example, the sound source can be understood as being directly facing the center of the mobile phone screen, with the sound source and the mobile phone on the same horizontal plane. The distance between the sound source reference point used to determine the specific location of the sound source and the mobile phone can be fixed, for example, 42 cm.
[0186] In some embodiments, the performance requirements of the mic are calibrated according to the actual usage scenario of the device or the backend of the device.
[0187] In some embodiments, a reference point (which can be understood as a reference signal) is set based on the actual usage scenario of the device. At the same reference point, compensation is performed on each mic. The compensated target signal includes a transfer function from the sound source to each mic (see the second equation in method 1 below for details). Alternatively, during calibration, the transfer function from the sound source to each mic is removed from each mic signal before calibration is performed (see the first equation in method 1 below for details).
[0188] The target signal for compensation of each mic can be obtained by the following two methods:
[0189] Method 1: Determine the signal of each mic based on the signal model
[0190] or,
[0191] Among them, Y0 is the target signal, Y N is the received signal of the Nth microphone in the microphone array (which may correspond to the second microphone mentioned above).
[0192] Method 2: Determine the signal of each mic according to the actual measurement value of each mic (which may correspond to the actual signal at the position of the third microphone mentioned above).
[0193] The actual measured value includes the transfer function of the propagation path from the sound source to each mic, which can also be described as a path transfer function.
[0194] In some embodiments, calibration may be performed based on a single reference point or may be performed based on multiple points to improve the performance of each mic within a certain range.
[0195] In some embodiments, the specific implementation of the above method 1 is as follows:
[0196] According to the sound source X0 to the Nth microphone mic N The transfer function of the propagation path The signal at each mic position can be determined.
[0197] Compensate for each mic signal so that
[0198] in, This can be determined by:
[0199] Obtained using general acoustic modeling analysis methods (such as ray acoustics);
[0200] The signal is modeled according to the actual audio algorithm or the requirements of the audio algorithm for the signal (making the input signal closer to the ideal value of the algorithm);
[0201] The model is obtained based on the relative position relationship between the sound source and the sound source to different mics.
[0202] Optionally, use a mic M As the reference point (which can correspond to the first microphone above), calibrate each mic to mic M In this way, the signals of each mic are made consistent, which can further reduce the parameters required for calibration.
[0203] Specifically:
[0204] Among them, Y M is the received signal of the Mth microphone in the microphone array (which may correspond to the first microphone mentioned above), H N (θ N ) is the filter coefficient or parameter of the compensation filter (which may correspond to the first compensation parameter above), is the difference between the received signals of the two mics (corresponding to the first parameter above), is the difference in the path transfer function between the sound source and the two mics (which can correspond to the second parameter above).
[0205] Calculating the difference in the path transfer function from the sound source to the two mics, and the difference between the received signals of the two mics, is simpler and has smaller errors than directly calculating the transfer function from the sound source to the two mics.
[0206] In some embodiments, the reference point may be selected so that This simplifies the compensation filter coefficients to That is, calibrate the signals of the two mics to be consistent.
[0207] Select a mic in the above method M Using the reference point as the reference point, multiple mics in the microphone array are compensated and calibrated to achieve consistent compensation of the mics and reduce the difficulty of calibration.
[0208] Optionally, in the above method, multiple mics may be selected as reference points.
[0209] In some embodiments, if multiple mics are selected as reference points, then for each mic as a reference point, the mic can be calculated according to the above equation. N The corresponding H N (θ N ), and then multiple H N (θ N ) as the mean of mic N The final compensation filter coefficients for mic N signal to calibrate.
[0210] For example, the following describes the solution of method 1 in detail by taking a UE having three mics (mic1, mic2, and mic3) as an example. As shown in FIG2 , mic1 and mic3 are symmetrically distributed on both sides of the UE, and mic2 is between mic1 and mic3.
[0211] Assume: mic1 is at -8 cm, mic2 is at 5 cm, and mic3 is at 8 cm. The UE uses a differential beamforming algorithm for audio capture. Calibrate mic3 as a reference to ensure that mic1 performs the same as mic2 and mic3.
[0212] According to the signal model of the beam, there is only a phase difference between the mics caused by the distance.
[0213] Therefore, according to the signal model, we can get:
[0214] in, For delay Seconds, r N For mic N is the distance to the sound source, and C is the speed of sound.
[0215] Substitute:
[0216] Available
[0217] Right now:
[0218] The distance between the test sound source and the UE is 34 cm, the central axis points to the midpoint of the UE and is perpendicular to the line connecting mic1 and mic3, so that mic1 and mic3 are symmetrical about the test signal.
[0219] Because mic1 and mic3 are symmetrical about the reference point and the test sound source, the propagation paths from the test sound source to mic1 and mic3 are symmetrical. That is:
[0220] therefore, Make the signals of mic1 and mic3 consistent (that is, not only the influence of mic1 itself on the transfer function of the sound source is eliminated, but also the influence of the path transfer function from the sound source to mic1 is eliminated). H2(θ2) makes the delay of mic2 signal 1.655*10^(-5) seconds ahead of the signal of mic3 (that is, the influence of mic2 itself on the transfer function of the sound source is eliminated, but the influence of the path transfer function from the sound source to mic2 is not eliminated).
[0221] In the solution of the above embodiment, the mic signal is compensated by the signal model, so that the signal obtained by the mic is closer to the theoretical model of the algorithm, thereby improving the algorithm performance of the signal model.
[0222] In some embodiments, the specific implementation of the above method 2 is as follows:
[0223] Due to X N It is a signal that actually exists in the space and can be obtained by measurement, and includes the signal transmitted from the sound source in the actual space to the microphone. N Therefore, the signal of the mic can be compensated to the actual signal measured at the mic to ensure consistency between the mics. N *H N (θ N )=X N
[0224] In some embodiments, the signal of the mic can be compensated to the actual signal measured at the mic multiplied by H, so that the performance of each mic is improved while maintaining consistency between the mics. N *H N (θ N )=X N *H
[0225] Among them, H can be the coefficient of the all-pass filter to make the mic signal consistent with the signal in the actual sound field. It can also be achieved by multiplying each X by a fixed filter coefficient to calibrate the performance of each mic to a certain target value while maintaining consistency.
[0226] It should be noted that, in the above embodiment, Y N The noise included in can be considered as an error within the allowable error range and will not affect the calibration results of each mic.
[0227] The embodiments of the present disclosure further provide a device for implementing any of the above methods. For example, a device is provided, which includes units or modules for implementing each step executed by the terminal in any of the above methods.
[0228] It should be understood that the division of the various units or modules in the above device is merely a division of logical functions. In actual implementation, they may be fully or partially integrated into a physical entity, or they may be physically separated. In addition, the units or modules in the device may be implemented in the form of a processor calling software: for example, the device includes a processor, the processor is connected to a memory, and the memory stores instructions. The processor calls the instructions stored in the memory to implement any of the above methods or implement the functions of the various units or modules of the above device, wherein the processor is, for example, a general-purpose processor, such as a central processing unit (CPU) or a microprocessor, and the memory is a memory within the device or a memory outside the device. Alternatively, the units or modules in the device can be implemented in the form of hardware circuits, and the functions of some or all of the units or modules can be realized by designing the hardware circuits. The above-mentioned hardware circuits can be understood as one or more processors; for example, in one implementation, the above-mentioned hardware circuit is an application-specific integrated circuit (ASIC), and the functions of some or all of the above units or modules are realized by designing the logical relationship of the elements in the circuit; for example, in another implementation, the above-mentioned hardware circuit can be implemented by a programmable logic device (PLD), taking a field programmable gate array (FPGA) as an example, which can include a large number of logic gate circuits, and the connection relationship between the logic gate circuits is configured by a configuration file, thereby realizing the functions of some or all of the above units or modules.
[0229] All units or modules of the above devices can be implemented in the form of software called by the processor, or in the form of hardware circuits, or partially implemented in the form of software called by the processor, and the remaining part implemented in the form of hardware circuits. In the embodiment of the present disclosure, the processor is a circuit with signal processing capability. In one implementation, the processor can be a circuit with instruction reading and execution capability, such as a central processing unit (CPU), a microprocessor, a graphics processing unit (GPU) (which can be understood as a microprocessor), or a digital signal processor (DSP); in another implementation, the processor can implement certain functions through the logical relationship of the hardware circuit, and the logical relationship of the above hardware circuit is fixed or reconfigurable, such as a hardware circuit implemented by a processor as an application-specific integrated circuit (ASIC) or a programmable logic device (PLD), such as an FPGA. In a reconfigurable hardware circuit, the process of the processor loading a configuration document to implement the hardware circuit configuration can be understood as the process of the processor loading instructions to implement the functions of some or all of the above units or modules. In addition, it can also be a hardware circuit designed for artificial intelligence, which can be understood as ASIC, such as a neural network processing unit (NPU), a tensor processing unit (TPU), a deep learning processing unit (DPU), etc.
[0230] FIG3 is a schematic diagram of the structure of a terminal proposed in an embodiment of the present disclosure. As shown in FIG3 , the terminal may include: at least one of a transceiver module 301 and a processing module 302 .
[0231] In some embodiments, the processing module 302 is configured to obtain a reference signal and calibrate a received signal of each microphone in the microphone array based on the reference signal;
[0232] The reference signal includes any one of the following:
[0233] Target signal determined based on the signal model;
[0234] The actual signal at each microphone position in the microphone array.
[0235] Optionally, the above-mentioned processing module 302 is also used to execute the calibration-related steps performed by the terminal in any of the above methods, for example: at least one of step S101 shown in Figure 1a, steps S111 and S112 shown in Figure 1b, and steps S121 and S122 shown in Figure 1c, which are not repeated here.
[0236] Figure 4 is a schematic diagram of the structure of a communication device 400 proposed in an embodiment of the present disclosure. Communication device 400 may be a chip, chip system, or processor that supports the aforementioned terminal in implementing any of the above methods. Communication device 400 may be used to implement the methods described in the above method embodiments. For details, please refer to the description of the above method embodiments.
[0237] As shown in Figure 4, the communication device 400 includes one or more processors 401. The processor 401 can be a general-purpose processor or a dedicated processor, for example, a baseband processor or a central processing unit. The baseband processor can be used to process communication protocols and communication data, and the central processing unit can be used to control the communication device (such as a base station, baseband chip, terminal device, terminal device chip, DU or CU, etc.), execute programs, and process program data. The processor 401 is used to call instructions to enable the communication device 400 to perform any of the above methods.
[0238] In some embodiments, the communication device 400 further includes one or more transceivers 402. When the communication device 400 includes one or more transceivers 402, the transceiver 402 performs the communication steps such as sending and / or receiving in the above method, and the processor 401 performs at least one of the other steps (for example, at least one of step S101 shown in FIG. 1a , steps S111 and S112 shown in FIG. 1b , and steps S121 and S122 shown in FIG. 1c , but not limited thereto). In an optional embodiment, the transceiver may include a receiver and / or a transmitter, and the receiver and transmitter may be separate or integrated. Optionally, the terms transceiver, transceiver unit, transceiver, transceiver circuit, interface circuit, and interface may be interchangeable, the terms transmitter, transmitting unit, transmitter, and transmitting circuit may be interchangeable, and the terms receiver, receiving unit, receiver, and receiving circuit may be interchangeable.
[0239] In some embodiments, the communication device 400 further includes one or more memories 403 for storing instructions. Optionally, all or part of the memories 403 may be located outside the communication device 400.
[0240] In some embodiments, a transceiver may include a receiver and a transmitter, which may be separate or integrated. Optionally, the terms transceiver, transceiver unit, transceiver, and transceiver circuit may be used interchangeably; the terms transmitter, transmitting unit, transmitter, and transmitting circuit may be used interchangeably; and the terms receiver, receiving unit, receiver, and receiving circuit may be used interchangeably.
[0241] Optionally, the communication device 400 further includes one or more interface circuits 404, which are connected to the memory 402. The interface circuits 404 can be used to receive signals from the memory 402 or other devices, and can be used to send signals to the memory 402 or other devices. For example, the interface circuits 404 can read instructions stored in the memory 402 and send the instructions to the processor 401.
[0242] The communication device 400 described in the above embodiment may be a terminal that implements the authorization function, or a terminal that implements the core function of the general application program interface framework, but the scope of the communication device 400 described in the embodiment of the present disclosure is not limited to this, and the structure of the communication device 400 may not be limited by Figure 4. The communication device may be an independent device or may be part of a larger device. For example, the communication device may be: 1) an independent integrated circuit IC, or a chip, or a chip system or subsystem; (2) a collection of one or more ICs, optionally, the above IC collection may also include a storage component for storing data and programs; (3) an ASIC, such as a modem; (4) a module that can be embedded in other devices; (5) a receiver, a terminal device, an intelligent terminal device, a cellular phone, a wireless device, a handheld device, a mobile unit, an in-vehicle device, a network device, a cloud device, an artificial intelligence device, etc.; (6) others, etc.
[0243] The present disclosure also provides a program product, which, when executed by the communication device 400, enables the communication device 400 to perform any of the above methods. Optionally, the program product is a computer program product.
[0244] The present disclosure also proposes a computer program, which, when executed on a computer, causes the computer to perform any one of the above methods.
[0245] Figure 5 is a block diagram of a terminal 500 according to an exemplary embodiment. For example, the terminal 500 may be a mobile phone, a computer, a digital broadcast terminal, a messaging device, a game console, a tablet device, a medical device, a fitness device, a personal digital assistant, etc.
[0246] 5 , terminal 500 may include one or more of the following components: a processing component 502 , a memory 504 , a power component 506 , a multimedia component 508 , an audio component 510 , an input / output (I / O) interface 512 , a sensor component 514 , and a communication component 516 .
[0247] The processing component 502 generally controls the overall operation of the terminal 500, such as operations associated with display, phone calls, data communications, camera operation, and recording operations. The processing component 502 may include one or more processors 520 to execute instructions to perform all or part of the steps of the above-described method. In addition, the processing component 502 may include one or more modules to facilitate interaction between the processing component 502 and other components. For example, the processing component 502 may include a multimedia module to facilitate interaction between the multimedia component 508 and the processing component 502.
[0248] The memory 504 is configured to store various types of data to support operations on the terminal 500. Examples of such data include instructions for any application or method operating on the terminal 500, contact data, phone book data, messages, pictures, videos, etc. The memory 504 can be implemented by any type of volatile or non-volatile storage device, or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic disk, or optical disk.
[0249] Power component 506 provides power to various components of terminal 500. Power component 506 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power to terminal 500.
[0250] The multimedia component 508 includes a screen that provides an output interface between the terminal 500 and the user. In some embodiments, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen can be implemented as a touch screen to receive input signals from the user. The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor can not only sense the boundaries of the touch or slide action, but also detect the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia component 508 includes a front camera and / or a rear camera. When the terminal 500 is in an operating mode, such as a shooting mode or a video mode, the front camera and / or the rear camera can receive external multimedia data. Each front camera and rear camera can be a fixed optical lens system or have a focal length and optical zoom capability.
[0251] The audio component 510 is configured to output and / or input audio signals. For example, the audio component 510 includes a microphone array. When the terminal 500 is in an operating mode, such as a call mode, a recording mode, and a voice recognition mode, the microphone array is configured to receive external audio signals. The received audio signals can be further stored in the memory 504 or transmitted via the communication component 516. In some embodiments, the audio component 510 also includes a speaker for outputting audio signals.
[0252] I / O interface 512 provides an interface between processing component 502 and peripheral interface modules, such as a keyboard, click wheel, buttons, etc. These buttons may include but are not limited to: a home button, volume buttons, a start button, and a lock button.
[0253] The sensor assembly 514 includes one or more sensors for providing various aspects of status assessment for the terminal 500. For example, the sensor assembly 514 can detect the open / closed state of the terminal 500, the relative positioning of components, such as the display and keypad of the terminal 500. The sensor assembly 514 can also detect changes in the position of the terminal 500 or a component of the terminal 500, the presence or absence of user contact with the terminal 500, the orientation or acceleration / deceleration of the terminal 500, and temperature changes of the terminal 500. The sensor assembly 514 can include a proximity sensor configured to detect the presence of nearby objects without any physical contact. The sensor assembly 514 can also include an optical sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 514 can also include an accelerometer, a gyroscope, a magnetic sensor, a pressure sensor, or a temperature sensor.
[0254] The communication component 516 is configured to facilitate wired or wireless communication between the terminal 500 and other devices. The terminal 500 can access a wireless network based on a communication standard, such as WiFi, 2G or 3G, or a combination thereof. In an exemplary embodiment, the communication component 516 receives a broadcast signal or broadcast-related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 516 also includes a near field communication (NFC) module to facilitate short-range communication. For example, the NFC module can be implemented based on radio frequency identification (RFID) technology, infrared data association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology and other technologies.
[0255] In an exemplary embodiment, the terminal 500 may be implemented by one or more application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), controllers, microcontrollers, microprocessors, or other electronic components to perform the above methods.
[0256] In an exemplary embodiment, a non-transitory computer-readable storage medium including instructions is also provided, such as a memory 504 including instructions, which can be executed by the processor 520 of the terminal 500 to perform the above method. For example, the non-transitory computer-readable storage medium can be a ROM, a random access memory 4 (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, etc.
[0257] The technical solutions described in the embodiments of the present disclosure can be arbitrarily combined without conflict.
[0258] Other embodiments of the present invention will readily occur to those skilled in the art after considering the specification and practicing the invention disclosed herein. This disclosure is intended to cover any variations, uses, or adaptations of the invention that follow from the general principles of the invention and include common knowledge or customary techniques in the art not disclosed herein. The description and examples are to be considered as exemplary only, with the true scope and spirit of the invention being indicated by the following claims.
[0259] It should be understood that the present invention is not limited to the exact construction described above and shown in the drawings, and that various modifications and changes may be made without departing from the scope thereof. The scope of the present invention is limited only by the appended claims.
Claims
1. A signal processing method, characterized in that, Including: Obtaining a reference signal; Calibrating the received signals of each microphone in the microphone array based on the reference signal; Wherein, the reference signal includes any one of the following: A target signal determined based on a signal model; The actual signal at the position of each microphone in the microphone array.
2. The method according to claim 1, characterized in that, When the reference signal is the target signal, calibrating the received signals of each microphone in the microphone array based on the reference signal includes: Taking the received signal of a first microphone in the microphone array as the target signal; Based on the received signal of the first microphone, calibrating the received signals of the other microphones in the microphone array except the first microphone.
3. The method according to claim 2, characterized in that, The calibrating the received signals of the other microphones in the microphone array except the first microphone based on the received signal of the first microphone includes: Determining a first compensation parameter based on a first parameter and a second parameter; Calibrating the received signal of a second microphone according to the first compensation parameter; Wherein, the second microphone is any one of the other microphones; Wherein, the first parameter characterizes the difference between the received signal of the first microphone and the received signal of the second microphone; Wherein, the second parameter characterizes the difference between the first transmission path parameter from the sound source to the first microphone and the second transmission path parameter from the sound source to the second microphone.
4. The method according to claim 3, wherein The method further includes: Determining the first microphone from the microphone array, wherein the first transmission path parameter is the same as the second transmission path parameter.
5. The method according to claim 4, wherein The first compensation parameter is determined based on the first parameter.
6. The method according to claim 3, characterized in that, If there are at least two first microphones, the first compensation parameter is determined based on at least two compensation parameters, wherein each compensation parameter corresponds to a first microphone.
7. The method according to any one of claims 3-6, characterized in that, The signal of the calibrated second microphone includes the second transmission path parameter.
8. The method according to any one of claims 3-6, characterized in that, The calibrating the received signal of the second microphone according to the first compensation parameter includes: After removing the second transmission path parameter from the received signal of the second microphone, calibrating based on the first compensation parameter.
9. The method according to claim 1, wherein When the reference signal is the actual signal at the position of each microphone in the microphone array, calibrating the received signals of each microphone in the microphone array based on the reference signal includes: Determining a second compensation parameter according to the actual signal at the position of a third microphone and the received signal of the third microphone; Calibrating the received signal of the third microphone according to the second compensation parameter; Wherein, the third microphone is any one of the microphones in the microphone array.
10. The method according to claim 9, wherein The second compensation parameter is determined based on the actual signal at the position of the third microphone, the received signal of the third microphone, and a third parameter, and the third parameter is used to characterize the required performance of the microphone.
11. The method according to claim 10, wherein The third parameter is the same for each microphone in the microphone array, or the third parameter corresponds to the third microphone.
12. A terminal, characterized in that, Including: A processing module, configured to obtain a reference signal and, based on the reference signal, calibrate the received signals of each microphone in the microphone array; Wherein, the reference signal includes any one of the following: A target signal determined based on a signal model; The actual signal at the position of each microphone in the microphone array.
13. A terminal, characterized in that, Comprising: One or more processors; Wherein, the terminal is configured to execute the signal processing method according to any one of claims 1 to 11.
14. A computer-readable storage medium, characterized in that, Executable instructions are stored in the computer-readable storage medium, and the executable instructions are loaded and executed by the processor to implement the method according to any one of claims 1 to 11.
Citation Information
Patent Citations
Microphone calibration method, device and mobile terminal
CN105554674A
Acoustic echo canceling
CN110140346A
Microphone array extension calibration method and device, electronic equipment and storage medium
CN116887099A
Apparatas and method for selecting a mic of detecting a voice signal intensity in an electronic device
KR1020140025939A