Audio processing method and apparatus and storage medium

Abstract

The present disclosure relates to an audio processing method and apparatus and a storage medium. The audio processing method comprises: acquiring audio signals of a plurality of channels, the plurality of channels being corresponding to a plurality of orientations of a terminal; during the acquisition process, detecting related information of a shielding object, the related information of the shielding object comprising the orientation of shielding relative to the terminal; and on the basis of the related information of the shielding object, compensating the audio signal of the channel in the orientation where the shielding object is located. The present disclosure solves the problem that overall audio signals are uneven because audio signals of channels in the orientations where shielding objects are located are weak due to the presence of the shielding objects.

Description

Audio processing method, device and storage medium Technical Field

[0001] The present disclosure relates to the field of communication technologies, and in particular to an audio processing method, device, and storage medium. Background Art

[0002] Currently, terminals can capture spatial audio, that is, stereo audio, to achieve an immersive audio experience.

[0003] Summary of the Invention

[0004] However, when the terminal collects spatial audio, it often collects uneven spatial audio.

[0005] The embodiments of the present disclosure provide an audio processing method, an audio processing device, and a storage medium.

[0006] According to a first aspect of an embodiment of the present disclosure, an audio processing method is proposed, the method comprising: collecting multi-channel audio signals, the multi-channels corresponding to multiple orientations of a terminal; during the collection process, detecting relevant information of an obstruction, the relevant information of the obstruction including the orientation of the obstruction relative to the terminal; and based on the relevant information of the obstruction, compensating for the audio signal of the channel at the orientation of the obstruction.

[0007] According to the second aspect of an embodiment of the present disclosure, an audio processing device is proposed, which includes: an acquisition module for acquiring multi-channel audio signals, where the multi-channels correspond to multiple orientations of a terminal; a detection module for detecting relevant information of an obstruction during the acquisition process, where the relevant information of the obstruction includes the orientation of the obstruction relative to the terminal; and a processing module for compensating for the audio signal of the channel at the orientation of the obstruction based on the relevant information of the obstruction.

[0008] According to a third aspect of an embodiment of the present disclosure, an electronic device is proposed, comprising: a memory for storing instructions; and a processor for calling the instructions stored in the memory to execute the audio processing method as described in the first aspect and any one of the first aspects.

[0009] According to a fourth aspect of an embodiment of the present disclosure, a storage medium is proposed, wherein the storage medium stores instructions. When the instructions are executed by a processor, the audio processing method as described in the first aspect and any one of the first aspects is executed.

[0010] The present disclosure collects multi-channel audio signals and detects relevant information of the obstruction during the collection process, the relevant information including the orientation of the obstruction, and compensates the audio signal of the channel at the orientation of the obstruction to solve the problem of weak audio signals of the channel at the orientation of the obstruction and uneven overall audio signals due to the presence of the obstruction. BRIEF DESCRIPTION OF THE DRAWINGS

[0011] In order to more clearly illustrate the technical solutions in the embodiments of the present disclosure, the following drawings required for describing the embodiments are introduced. The following drawings are merely some embodiments of the present disclosure and do not impose specific limitations on the protection scope of the present disclosure.

[0012] FIG1 is a flowchart showing an audio processing method according to an embodiment of the present disclosure.

[0013] FIG. 2 is a flow chart of a method for compensating an audio signal according to an exemplary embodiment of the present disclosure.

[0014] FIG3 is a flowchart of a method for determining a correspondence relationship according to an exemplary embodiment of the present disclosure.

[0015] Fig. 4 is a block diagram of an audio processing apparatus 100 according to an exemplary embodiment.

[0016] Fig. 5 is a block diagram of an audio processing apparatus 200 according to an exemplary embodiment. DETAILED DESCRIPTION

[0017] The embodiments of the present disclosure provide an audio processing method, an audio processing device, and a storage medium.

[0018] In a first aspect, an embodiment of the present disclosure proposes an audio processing method, comprising: collecting multi-channel audio signals, wherein the multi-channels correspond to multiple positions of a terminal; during the collection process, detecting relevant information of an obstruction, wherein the relevant information of the obstruction includes the position of the obstruction relative to the terminal; and based on the relevant information of the obstruction, compensating for the audio signal of the channel at the position where the obstruction is located.

[0019] In the above embodiment, by collecting multi-channel audio signals and detecting the location of obstructions during the collection process, the audio signals of the channels located in the obstruction are compensated. This solves the problem of weak audio signals in the channels located in the obstruction, resulting in uneven overall audio signals. In other words, uniform and more natural spatial audio can be obtained, providing the user with a better audio experience.

[0020] In some optional embodiments of the first aspect, the compensating for the audio signal of the channel at the location of the obstruction includes: in response to the directionality of the audio signal, compensating for the audio signal of the channel at the location of the obstruction; and / or in response to the directionality of the audio signal, compensating for the audio signal of the channel at the location of the obstruction after processing the audio signal to obtain an audio signal in a stereo format.

[0021] In the above embodiment, for directional audio signals, i.e., if the microphone collecting the audio signal is a directional microphone, compensation can be performed on the directly collected original audio signal to ensure a better audio signal for subsequent processing, resulting in a better processing result. Alternatively, compensation can be performed on a stereo audio signal obtained after processing the original audio signal to achieve a better effect. Alternatively, compensation can be performed simultaneously using both of the above methods to achieve a better effect.

[0022] In some optional embodiments of the first aspect, the compensating for the audio signal of the channel at the location of the obstruction includes: in response to the audio signal being non-directional, processing the audio signal to obtain an audio signal in a stereo format, and then compensating for the audio signal of the channel at the location of the obstruction.

[0023] In the above embodiment, for audio signals that are not directional, that is, the microphone collecting the audio signal may be a non-directional microphone, the processed stereo audio signal may be compensated, so that even a simpler non-directional microphone can produce good and uniform audio.

[0024] In some optional embodiments of the first aspect, the method further includes: determining a compensation amount based on the orientation of the obstruction relative to the terminal and a first correspondence, the compensation amount being used to compensate for the audio signal of the channel at the orientation of the obstruction; wherein the first correspondence represents the correspondence between the orientation of the obstruction relative to the terminal and the compensation amount.

[0025] In the above embodiment, the compensation amount for the audio signal can be determined according to the position of the obstruction, so as to quickly determine the compensation amount, efficiently and accurately compensate the audio signal, reduce the delay in the compensation process, and improve the user experience.

[0026] In some optional embodiments of the first aspect, the relevant information of the obstruction also includes the size of the obstruction, and the method further includes: determining the compensation amount based on the size of the obstruction and a second correspondence; or, determining the compensation amount based on the size of the obstruction, the position of the obstruction relative to the terminal, and a third correspondence; the compensation amount is used to compensate for the audio signal of the channel at the position of the obstruction; wherein the second correspondence represents the correspondence between the size of the obstruction and the compensation amount, and the third correspondence represents the correspondence between the size of the obstruction, the position relationship of the obstruction relative to the terminal, and the compensation amount.

[0027] In the above embodiment, the compensation amount for the audio signal can be determined according to the size of the obstruction, or can be determined based on the orientation of the obstruction and the size of the obstruction, so as to quickly determine the compensation amount, efficiently and accurately compensate the audio signal, reduce the delay in the compensation process, and improve the user experience.

[0028] In some optional embodiments of the first aspect, the terminal pre-stores a corresponding relationship, and the corresponding relationship is determined in the following manner: when there is no obstruction on the terminal, a first audio signal is collected; when there is an obstruction on the terminal, a second audio signal is collected under different conditions, and the different conditions indicate that the obstruction has different sizes and / or the orientation of the obstruction relative to the terminal is different; based on the first audio signal and the second audio signal under different conditions, the corresponding relationship is obtained; wherein, if the different conditions indicate the orientation of the obstruction relative to the terminal, the corresponding relationship is a first corresponding relationship; if the different conditions indicate the size of the obstruction, the corresponding relationship is a second corresponding relationship; if the different conditions indicate the orientation of the obstruction relative to the terminal and the size of the obstruction, the corresponding relationship is a third corresponding relationship.

[0029] In the above embodiment, the first corresponding relationship and / or the second corresponding relationship and / or the third corresponding relationship may be predetermined to facilitate determination of the compensation amount.

[0030] In the second aspect, an embodiment of the present disclosure proposes an audio processing device, which includes: an acquisition module for acquiring multi-channel audio signals, where the multi-channels correspond to multiple positions of the terminal; a detection module for detecting relevant information of an obstruction during the acquisition process, where the relevant information of the obstruction includes the position of the obstruction relative to the terminal; and a processing module for compensating the audio signal of the channel at the position of the obstruction based on the relevant information of the obstruction.

[0031] In some optional embodiments of the second aspect, the processing module compensates for the audio signal of the channel at the location of the obstruction in the following manner: in response to the directionality of the audio signal, the audio signal of the channel at the location of the obstruction is compensated; and / or in response to the directionality of the audio signal, after processing the audio signal to obtain an audio signal in a stereo format, the audio signal of the channel at the location of the obstruction is compensated.

[0032] In some optional embodiments of the second aspect, the compensating for the audio signal of the channel at the location of the obstruction includes: in response to the audio signal being non-directional, processing the audio signal to obtain an audio signal in a stereo format, and then compensating for the audio signal of the channel at the location of the obstruction.

[0033] In some optional embodiments of the second aspect, the processing module is also used to: determine a compensation amount based on the orientation of the obstruction relative to the terminal and a first corresponding relationship, and the compensation amount is used to compensate for the audio signal of the channel where the obstruction is located; wherein the first corresponding relationship represents the corresponding relationship between the orientation of the obstruction relative to the terminal and the compensation amount.

[0034] In some optional embodiments of the second aspect, the relevant information of the obstruction also includes the size of the obstruction, and the processing module is further used to: determine the compensation amount based on the size of the obstruction and a second corresponding relationship; or, determine the compensation amount based on the size of the obstruction, the position of the obstruction relative to the terminal, and a third corresponding relationship; the compensation amount is used to compensate for the audio signal of the channel where the obstruction is located; wherein the second corresponding relationship represents the corresponding relationship between the size of the obstruction and the compensation amount, and the third corresponding relationship represents the corresponding relationship between the size of the obstruction, the position relationship of the obstruction relative to the terminal, and the compensation amount.

[0035] In some optional embodiments of the second aspect, the terminal pre-stores a corresponding relationship, and the processing module is further used to determine the corresponding relationship in the following manner: when there is no obstruction at the terminal, a first audio signal is collected; when there is an obstruction at the terminal, a second audio signal is collected under different conditions, and the different conditions indicate that the obstruction has different sizes and / or the obstruction has different orientations relative to the terminal; based on the first audio signal and the second audio signal under different conditions, the corresponding relationship is obtained; wherein, if the different conditions indicate the orientation of the obstruction relative to the terminal, the corresponding relationship is a first corresponding relationship; if the different conditions indicate the size of the obstruction, the corresponding relationship is a second corresponding relationship; if the different conditions indicate the orientation of the obstruction relative to the terminal and the size of the obstruction, the corresponding relationship is a third corresponding relationship.

[0036] In a third aspect, an embodiment of the present disclosure proposes an electronic device, comprising: a memory for storing instructions; and a processor for calling the instructions stored in the memory to execute the audio processing method as in the first aspect and any one of the first aspects.

[0037] In a fourth aspect, an embodiment of the present disclosure proposes a storage medium storing instructions. When the instructions are executed by a processor, the audio processing method according to the first aspect and any one of the first aspects is executed.

[0038] In a fifth aspect, an embodiment of the present disclosure proposes a program product. When the program product is executed by an electronic device, the electronic device executes the method described in the optional implementation manner of the first aspect.

[0039] In a sixth aspect, an embodiment of the present disclosure proposes a computer program, which, when executed on a computer, enables the computer to execute the method described in the optional implementation manner of the first aspect.

[0040] In a seventh aspect, an embodiment of the present disclosure provides a chip or a chip system, which includes a processing circuit configured to execute the method described in the optional implementation of the first aspect.

[0041] It is understood that the audio processing devices, electronic devices, storage media, program products, computer programs, chips, or chip systems involved in each embodiment of the present disclosure are all used to perform the methods proposed in the embodiments of the present disclosure. Therefore, the beneficial effects that can be achieved can refer to the beneficial effects of the corresponding methods and will not be repeated here.

[0042] The present disclosure provides an audio processing method, device, and storage medium. In some embodiments, the terms audio processing method and data processing method are interchangeable, and the terms audio processing device and data processing device are interchangeable.

[0043] The embodiments of the present disclosure are not exhaustive and are merely illustrative of some embodiments, and are not intended to be a specific limitation on the scope of protection of the present disclosure. In the absence of contradiction, each step in a certain embodiment can be implemented as an independent embodiment, and the steps can be arbitrarily combined. For example, a solution after removing some steps in a certain embodiment can also be implemented as an independent embodiment, and the order of the steps in a certain embodiment can be arbitrarily exchanged. In addition, the optional implementation methods in a certain embodiment can be arbitrarily combined; in addition, the embodiments can be arbitrarily combined. For example, some or all steps of different embodiments can be arbitrarily combined, and a certain embodiment can be arbitrarily combined with the optional implementation methods of other embodiments.

[0044] In each embodiment of the present disclosure, unless otherwise specified or provided for, the terms and / or descriptions between the embodiments are consistent and may be referenced by each other. The technical environments in different embodiments may be combined to form new embodiments based on their inherent logical relationships.

[0045] The terms used in the embodiments of the present disclosure are only for the purpose of describing specific embodiments and are not intended to limit the present disclosure.

[0046] In the embodiments of the present disclosure, unless otherwise specified, elements expressed in the singular, such as "a", "an", "the", "above", "said", "the", "the", etc., may mean "one and only one", or "one or more", "at least one", etc. For example, when using articles such as "a", "an", "the" in English in translation, the noun following the article may be understood as a singular expression or a plural expression.

[0047] In the embodiments of the present disclosure, “plurality” refers to two or more.

[0048] In some embodiments, the terms "at least one," "one or more," "a plurality of," "multiple," etc. may be used interchangeably.

[0049] In some embodiments, descriptions such as "at least one of A and B," "A and / or B," "A in one case, B in another case," or "in response to one case A, in response to another case B" may include the following technical solutions depending on the situation: in some embodiments, A (A is executed independently of B); in some embodiments, B (B is executed independently of A); in some embodiments, execution is selected from A and B (A and B are selectively executed); and in some embodiments, A and B (both A and B are executed). The above is also applicable when there are more branches such as A, B, and C.

[0050] In some embodiments, "A or B" and other descriptions may include the following technical solutions depending on the situation: in some embodiments, A (A is executed independently of B); in some embodiments, B (B is executed independently of A); in some embodiments, execution is selected from A and B (A and B are selectively executed). The above is also applicable when there are more branches such as A, B, C, etc.

[0051] The prefixes such as "first" and "second" in the embodiments of the present disclosure are only used to distinguish different description objects and do not constitute any restriction on the position, order, priority, quantity or content of the description objects. For the statement of the description object, please refer to the description in the context of the claims or embodiments, and no unnecessary restriction should be constituted due to the use of prefixes. For example, if the description object is a "field", the ordinal number before the "field" in the "first field" and the "second field" does not limit the position or order between the "fields". "First" and "second" do not limit whether the "fields" they modify are in the same message, nor do they limit the order of the "first field" and the "second field". For another example, if the description object is a "level", the ordinal number before the "level" in the "first level" and the "second level" does not limit the priority between the "levels". For another example, the number of description objects is not limited by the ordinal number and can be one or more. Taking "first device" as an example, the number of "devices" can be one or more. In addition, the objects modified by different prefixes can be the same or different. For example, if the description object is "device", then the "first device" and the "second device" can be the same device or different devices, and their types can be the same or different; for example, if the description object is "information", then the "first information" and "the performance of each AI model" can be the same information or different information, and their contents can be the same or different.

[0052] In some embodiments, “including A,” “comprising A,” “used to indicate A,” and “carrying A” can be interpreted as directly carrying A or indirectly indicating A.

[0053] In some embodiments, terms such as "in response to...", "in response to determining...", "in the case of...", "at the time of...", "when...", "if...", "if...", etc. can be used interchangeably.

[0054] In some embodiments, terms such as "greater than", "greater than or equal to", "not less than", "more than", "more than or equal to", "not less than", "higher than", "higher than or equal to", "not less than", and "above" can be replaced with each other, and terms such as "less than", "less than or equal to", "not greater than", "less than", "less than or equal to", "not more than", "lower than", "lower than or equal to", "not higher than", and "below" can be replaced with each other.

[0055] In some embodiments, devices and equipment can be interpreted as physical or virtual, and their names are not limited to the names recorded in the embodiments. In some cases, they can also be understood as "equipment", "device", "circuit", "network element", "node", "function", "unit", "section", "system", "network", "chip", "chip system", "entity", "subject", etc.

[0056] In some embodiments, obtaining data, information, etc. may comply with the laws and regulations of the country where the data is obtained.

[0057] In some embodiments, data, information, etc. may be obtained with the user's consent.

[0058] In addition, each element, each row, or each column in the table of the embodiment of the present disclosure can be implemented as an independent embodiment, and the combination of any elements, any rows, and any columns can also be implemented as an independent embodiment.

[0059] In some embodiments, the audio processing method can be applied to a terminal. A "terminal" or "terminal device" may be referred to as "user equipment (UE)", "user terminal", "mobile station (MS)", "mobile terminal (MT)", subscriber station, mobile unit, subscriber unit, wireless unit, remote unit, mobile device, wireless device, wireless communication device, remote device, mobile subscriber station, access terminal, mobile terminal, wireless terminal, remote terminal, handset, user agent, mobile client, client, etc.

[0060] In some embodiments, the terminal includes, for example, a mobile phone, a wearable device, an Internet of Things device, a car with communication function, a smart car, a tablet computer, a computer with wireless transceiver function, a virtual reality (VR) terminal device, an augmented reality (AR) terminal device, a wireless terminal device in industrial control, a wireless terminal device in self-driving, a wireless terminal device in remote medical surgery, a wireless terminal device in a smart grid, a wireless terminal device in transportation safety, a wireless terminal device in a smart city, and at least one of a wireless terminal device in a smart home, but is not limited thereto.

[0061] FIG1 is a flowchart showing an audio processing method according to an embodiment of the present disclosure.

[0062] As shown in FIG1 , the audio processing method provided by the present disclosure includes the following steps.

[0063] Step S11 : collecting multi-channel audio signals, where the multi-channels correspond to multiple positions of the terminal.

[0064] In some embodiments, multi-channel audio signals can be collected. For example, multiple microphones can be used to collect audio signals from multiple channels, with each microphone corresponding to a channel. The terminal orientation of the microphone is then the orientation corresponding to the channel. That is, multiple channels correspond to multiple orientations of the terminal. For example, if a terminal has two microphones, the audio signal of the left channel collected by the left microphone corresponds to the terminal orientation of left, and the audio signal of the right channel collected by the right microphone corresponds to the terminal orientation of right.

[0065] It is understandable that one microphone can correspond to one channel, multiple microphones can correspond to one channel, or one microphone can correspond to multiple channels, and this disclosure does not limit this. For example, when multiple microphones correspond to one channel, the terminal orientation corresponding to the channel is jointly determined by the multiple microphones. Alternatively, when one microphone corresponds to multiple channels, the terminal orientations corresponding to the multiple channels are all the terminal orientations where the microphone is located. The left and right microphones mentioned above are only illustrative examples. A terminal can have multiple microphones, for example, four microphones such as the upper left, lower left, upper right, and lower right, and this disclosure does not limit this.

[0066] Step S12: During the collection process, detecting relevant information of the obstruction, the relevant information of the obstruction including the position of the obstruction relative to the terminal.

[0067] In some embodiments, information related to obstructions can be detected during audio signal collection. The obstruction information includes the obstruction's position relative to the terminal. The obstruction can be, for example, a person or an object. For example, when a terminal is collecting audio signals in handheld mode, the human body can obstruct the audio signals collected by the terminal.

[0068] In some embodiments, sensors may be used to detect information related to the obstruction. For example, a camera, infrared sensor, etc. may be used to detect the position of the obstruction relative to the terminal and / or the size of the obstruction.

[0069] Optionally, the position of the obstruction relative to the terminal may be detected, and the position of the obstruction relative to the terminal may be used to subsequently compensate for the audio signal of the channel at the position of the obstruction.

[0070] Optionally, the position of the obstruction relative to the terminal and the size of the obstruction can be detected. The larger the obstruction, the greater the amount of compensation for the audio signal may need to be. Relatively speaking, the smaller the obstruction, the smaller the amount of compensation for the audio signal may need to be.

[0071] Step S13: Based on the relevant information of the obstruction, the audio signal of the channel where the obstruction is located is compensated.

[0072] In some embodiments, the audio signal of the channel at the location of the obstruction may be compensated based on the location of the obstruction relative to the terminal. For example, the amount of compensation may vary depending on the location of the obstruction relative to the terminal.

[0073] In some embodiments, the audio signal of the channel located at the obstruction can be compensated based on the position of the position relative to the terminal and the size of the obstruction. For example, the larger the obstruction, the greater the compensation, and the smaller the obstruction, the smaller the compensation.

[0074] The present invention collects multi-channel audio signals, detects the position of the obstruction during the collection process, and compensates the audio signal of the channel at the position of the obstruction to solve the problem of weak audio signal of the channel at the position of the obstruction and uneven overall audio signal due to the presence of the obstruction.

[0075] The present disclosure provides a method for compensating an audio signal, comprising: in response to the directionality of the audio signal, compensating the audio signal of the channel in the direction of the obstruction; and / or in response to the directionality of the audio signal, compensating the audio signal of the channel in the direction of the obstruction after processing the audio signal to obtain an audio signal in a stereo format.

[0076] In some embodiments, if the audio signal is directional, compensation can be performed on the audio signal of the channel in the direction of the obstruction, that is, compensation can be performed on the original collected audio signal. The directional nature of the audio signal can be understood as meaning that the collected audio signal comes from a certain direction, or that the intensity of the collected audio signal in a certain direction is much greater than that in other directions. For example, a directional microphone can be used to collect a directional audio signal.

[0077] In some embodiments, if the audio signal is directional, the audio signal can be processed to obtain a stereo audio signal, and then the audio signal of the channel located in the direction of the obstruction can be compensated. That is, the collected original audio signal can be processed to obtain a stereo audio signal, and then the audio signal of the channel located in the direction of the obstruction in this stereo audio signal can be compensated.

[0078] In some embodiments, if the audio signal is directional, compensation can be performed on the audio signal of the channel located in the direction of the obstruction. After the audio signal is processed to obtain a stereo audio signal, compensation can be performed on the audio signal of the channel located in the direction of the obstruction. That is, compensation can be performed on the audio signal of the channel located in the direction of the obstruction both before and after the audio signal is processed to obtain a stereo audio signal.

[0079] In the present disclosure, for directional audio signals, i.e., if the microphone collecting the audio signal is a directional microphone, compensation can be performed on the original audio signal that is directly collected, so that the audio signal used in subsequent processing is better and the processing results are also better. Alternatively, compensation can be performed on the stereo audio signal obtained after processing the original audio signal to achieve better results. Alternatively, compensation can be performed simultaneously using the above two methods to achieve better results.

[0080] The present disclosure provides a method for compensating an audio signal, comprising: in response to the audio signal not having directionality, processing the audio signal to obtain an audio signal in a stereo format, and then compensating the audio signal of a channel where an obstruction is located.

[0081] In some embodiments, if the audio signal is non-directional, the audio signal can be processed to obtain a stereo audio signal, and then the audio signal of the channel in the direction of the obstruction can be compensated. The non-directional audio signal can be collected by a non-directional microphone, for example. When the audio signal is non-directional, the audio signal can be processed to obtain a stereo audio signal, and then the stereo audio signal can be compensated to obtain uniform audio.

[0082] In the present disclosure, for audio signals that are not directional, that is, the microphone used to collect the audio signals can be a non-directional microphone, the stereoscopic audio signal obtained by processing can be compensated. This allows the simpler non-directional microphone to also produce good and uniform audio.

[0083] FIG2 is a flow chart of a method for compensating an audio signal according to an exemplary embodiment of the present disclosure. As shown in FIG2 , the present disclosure provides a method for compensating an audio signal.

[0084] Step S21: Detecting human body posture information using a sensor.

[0085] In some embodiments, a camera or infrared sensor can be used to detect human posture information. This posture information includes whether the user is holding the terminal and which hand the user is holding the terminal. The sensor can be controlled to transmit this posture information to a processing module after detection. The processing module can be controlled to compensate the audio signal based on the posture information. For example, the posture information can be used to determine the position of an obstruction relative to the terminal, or the size of the obstruction, and determine the compensation amount.

[0086] Step S22: Compensate the original microphone audio signal or compensate the audio signal in a stereo format.

[0087] In some embodiments, the compensation amount may be used to compensate the original microphone audio signal, wherein the original microphone audio signal may be the audio signal collected in the above embodiment.

[0088] In some embodiments, front-end signal processing may be performed on the original microphone audio line signal to obtain an audio signal in a stereo format, that is, an immersive audio signal, and the immersive audio signal may be compensated.

[0089] Step S23: output the compensated audio signal.

[0090] In some embodiments, the compensated audio signal can be used as an output audio signal to enhance the user's audio experience.

[0091] The present disclosure provides a method for determining a compensation amount, including: determining a compensation amount based on the orientation of an obstruction relative to a terminal and a first corresponding relationship, the compensation amount being used to compensate for an audio signal of a channel at the orientation of the obstruction; wherein the first corresponding relationship represents a corresponding relationship between the orientation of the obstruction relative to the terminal and the compensation amount.

[0092] In some embodiments, the compensation amount can be determined based on the position of the obstruction relative to the terminal and the first corresponding relationship. The first corresponding relationship represents the corresponding relationship between the position of the obstruction relative to the terminal and the compensation amount. That is, the first corresponding relationship can be determined in advance based on the compensation amount when the obstruction is in different positions of the terminal. Subsequently, the compensation amount can be determined directly based on the position of the obstruction relative to the terminal and the first corresponding relationship. For example, the state of the terminal in the handset mode is relatively fixed, so the influence of obstructions such as people on the audio signals collected by the terminal can be obtained by measurement. By measuring enough samples, the influence of people on the audio signals collected by the terminal is modeled, and the relationship between the position of people relative to the terminal and the audio signals output by the terminal is statistically obtained. The corresponding compensation amount can be pre-stored in the terminal, and in actual use, the corresponding compensation amount is called according to the position of people relative to the terminal.

[0093] It is understandable that in this embodiment, the terminal may not detect the size of the obstruction, that is, it may only detect the position of the obstruction relative to the terminal, and determine the compensation amount according to the position of the obstruction relative to the terminal.

[0094] In the present disclosure, the compensation amount for the audio signal can be determined according to the position of the obstruction, so as to quickly determine the compensation amount, efficiently and accurately compensate the audio signal, reduce the delay in the compensation process, and improve the user experience.

[0095] The present disclosure provides a method for determining a compensation amount, including: determining the compensation amount based on the size of the obstruction and a second corresponding relationship, or determining the compensation amount based on the size of the obstruction, the position of the obstruction relative to the terminal, and a third corresponding relationship; the compensation amount is used to compensate for the audio signal of the channel at the position of the obstruction; wherein the second corresponding relationship represents the corresponding relationship between the size of the obstruction and the compensation amount, and the third corresponding relationship represents the corresponding relationship between the size of the obstruction, the position relationship of the obstruction relative to the terminal, and the compensation amount.

[0096] In some embodiments, the obstruction-related information may also include the obstruction's size. The compensation amount may be determined based on the obstruction's size and a second correspondence. The second correspondence represents the correspondence between obstruction size and compensation amount. Specifically, experiments may be conducted with obstructions of varying sizes to determine the compensation amounts corresponding to each obstruction's size and determine the second correspondence. Subsequently, the compensation amount may be determined directly based on the obstruction's size and the second correspondence.

[0097] In some embodiments, the compensation amount can be determined based on the obstruction's position relative to the terminal, the obstruction's size, and a third correspondence. The third correspondence represents the correspondence between the obstruction's position relative to the terminal, the obstruction's size, and the compensation amount. Specifically, experiments can be conducted in advance using obstructions of different sizes placed at different terminal positions to determine the compensation amount for the same obstruction at different terminal positions, and for different obstructions at the same terminal position. In other words, the obstruction's position relative to the terminal and its size jointly determine this compensation amount.

[0098] In the present disclosure, the amount of compensation for the audio signal can be determined based on the size of the obstruction, or can be determined based on the orientation of the obstruction and the size of the obstruction, so as to quickly determine the amount of compensation, efficiently and accurately compensate the audio signal, reduce the delay in the compensation process, and improve the user experience.

[0099] FIG3 is a flow chart of a method for determining a corresponding relationship according to an exemplary embodiment of the present disclosure. As shown in FIG3 , the present disclosure provides a method for determining a corresponding relationship, including the following steps:

[0100] Step S31: When there is no obstruction on the terminal, collect a first audio signal.

[0101] Step S32 : When there is an obstruction on the terminal, second audio signals under different conditions are collected, where different conditions indicate that the obstruction has different sizes and / or different positions relative to the terminal.

[0102] Step S33: Obtain a corresponding relationship based on the first audio signal and the second audio signal under different conditions.

[0103] In some embodiments, a first audio signal can be collected when there is no obstruction on the terminal, and a second audio signal under different conditions can be collected when there is an obstruction on the terminal. The different conditions can represent different positions of the obstruction relative to the terminal, and / or different sizes of the obstruction. For example, the second audio signal may include audio signals collected when the obstruction is located at different positions of the terminal. The second audio signal may also include audio signals collected when the obstruction is of different sizes. The second audio signal may also include audio signals collected when the obstruction is of different sizes at different positions of the terminal. The effect of the obstruction on the audio signal collected by the terminal is determined by the difference between the first audio signal and the second audio signal. Exemplarily, the effects of the first audio signal, the second audio signal, and the signal collected by the terminal by the obstruction can be as shown in Formula 1. Y1(a)=H(a)Y2 Formula 1

[0104] Formula 1 represents the relationship between the audio signal output by the terminal when an obstruction interferes, namely, the second audio signal Y1(a); the audio signal output by the terminal when no obstruction interferes, namely, the first audio signal Y2; and the impact of the obstruction on the output audio signal, H(a). Here, a can represent the position of the obstruction relative to the terminal, i.e., H(a) varies depending on the position of the obstruction relative to the terminal. Alternatively, it can represent the size of the obstruction, i.e., H(a) varies depending on the size of the obstruction. Alternatively, a can represent both the position of the obstruction relative to the terminal and the size of the obstruction. Assuming that the position of the obstruction relative to the terminal is represented by P and the size of the obstruction is represented by Q, then a can be (P, Q). H(a) varies depending on either the position of the obstruction relative to the terminal or the size of the obstruction. That is, H(a) also varies depending on (P, Q). H(a) is a matrix. Y represents the amplitude spectrum of the audio signal. That is, Y1(a) represents the amplitude spectrum of the audio signal output by the terminal when an obstruction interferes. Y2 represents the amplitude spectrum of the audio signal output by the terminal in the presence of an obstruction. Audio signal Y2 can be collected without an obstruction. Then, the obstruction can be placed at different positions on the terminal to collect Y1(a). Based on Y2 and Y1(a) and the above formula 1, H(a) is obtained. For example, if the obstruction is placed at positions a1 and a2 of the terminal, Y1(a1) = H(a1)Y2, and Y1(a2) = H(a2)Y2. That is, when the obstruction is at position a1, the impact on the output audio signal is H(a1). When the obstruction is at position a2, the impact on the output audio signal is H(a2).

[0105] We can find the inverse matrix of H(a) and get H -1 (a). The audio signal of the channel at the direction of the obstruction relative to the terminal can be multiplied by H -1 (a) is to eliminate the influence of the occluder on the audio signal heard in the direction where the occluder is located, that is, to compensate for the audio signal. -1 (a) can be called a filter. For details, please refer to formula 2. Y4=H -1 (a)Y3(a) Formula 2

[0106] Formula 2 represents the audio signal Y3(a) of the channel at the location of the obstruction in the multi-channel audio signal collected by the terminal, the audio signal Y4 of the channel at the location of the obstruction after compensation, and H -1 (a). That is, using H -1 (a) Compensate the original audio signal collected by the terminal at the location of the obstruction to obtain a compensated audio signal.

[0107] In some embodiments, Formula 2 can be pre-stored in the terminal, and Formula 2 represents the corresponding relationship. When a represents the position of the obstruction relative to the terminal, Formula 2 represents a first corresponding relationship. When a represents the size of the obstruction, Formula 2 represents a second corresponding relationship. When a represents both the position of the obstruction relative to the terminal and the size of the obstruction, Formula 2 represents a third corresponding relationship.

[0108] In the present disclosure, the first corresponding relationship and / or the second corresponding relationship and / or the third corresponding relationship may be predetermined so as to be stored in the terminal for efficiently and accurately determining the compensation amount.

[0109] In some embodiments, the present disclosure uses the following scenario as an example to illustrate the audio processing method provided herein: a terminal captures audio in first-order ambisonics (FOA) format. A user holds the terminal in their left hand while recording a concert. The audio signal captured by the terminal is blocked by the user's left hand, weakening the audio signal in that direction.

[0110] In some embodiments, an audio signal in the FOA format can be decoded to obtain an audio signal in the B-format. The four channels in the B-format are arranged according to a specific encoding method, and can be subsequently decoded and rendered to achieve surround sound playback and experience. The decoding matrix can be referred to as the following formula 3.

[0111] In formula 3, g wxyz (θ) represents the decoded B-Format audio signal. g(θ) represents the pre-decoded FOA format audio signal. The FOA format audio signal is a four-directional signal, typically directed toward the four diagonals of the FOA device quadrilateral. The four directional signals are front left upper (FLU), front right lower (FRD), back left lower (BLD), and back right upper (BRU). That is, the four directional signals are (FLU, FRD, BLD, BRU). Based on the device's sensor's identification of the obstructed direction, for example, if the user's left hand is behind the device, the BLD audio signal is enhanced to boost the signal in the obstructed direction, offsetting the user's obstruction of the device and balancing the four microphone signals. The resulting output sound field signal is balanced in all directions. During use, if the user turns the device over and takes a selfie with the rear camera, the sensor recognizes that the obstructed direction has changed from the back lower left to the front upper right and changes the corresponding compensation amount, adjusting the signal compensation based on the real-time scenario.

[0112] Based on the same concept, an embodiment of the present disclosure also provides an audio processing device.

[0113] It is understandable that the audio processing device provided by the embodiment of the present disclosure includes hardware structures and / or software modules corresponding to the execution of each function in order to realize the above functions. In combination with the units and algorithm steps of the various examples disclosed in the embodiment of the present disclosure, the embodiment of the present disclosure can be implemented in the form of hardware or a combination of hardware and computer software. Whether a function is executed in the form of hardware or computer software driving hardware depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered to exceed the scope of the technical solution of the embodiment of the present disclosure.

[0114] It should be noted that those skilled in the art will appreciate that the various implementation methods / embodiments involved in the embodiments of the present disclosure can be used in conjunction with the aforementioned embodiments or can be used independently. Whether used alone or in conjunction with the aforementioned embodiments, the implementation principles are similar. In the implementation of the present disclosure, some embodiments are described in terms of implementation methods used together. Of course, those skilled in the art will appreciate that such examples are not limitations on the embodiments of the present disclosure.

[0115] FIG4 is a block diagram of an audio processing device 100 according to an exemplary embodiment. Referring to FIG4 , the device 100 includes: a collection module 101 , a detection module 102 , and a processing module 103 .

[0116] The acquisition module 101 is used to collect multi-channel audio signals corresponding to multiple terminal positions. The detection module 102 is used to detect the position and size of obstructions relative to the terminal during the acquisition process. The processing module 103 is used to compensate for the audio signals of the channels located in the obstruction's position based on the position and size of the obstruction.

[0117] In some embodiments, the processing module compensates for the audio signal of the channel located at the obstruction in the following manner: In response to the directionality of the audio signal, the processing module compensates for the audio signal of the channel located at the obstruction. And / or in response to the directionality of the audio signal, the processing module compensates for the audio signal of the channel located at the obstruction after processing the audio signal to obtain a stereo audio signal.

[0118] In some embodiments, compensating for the audio signal of the channel at the location of the obstruction includes: in response to the audio signal not having directionality, processing the audio signal to obtain an audio signal in a stereo format, and then compensating for the audio signal of the channel at the location of the obstruction.

[0119] In some embodiments, the processing module 103 is also used to: determine a compensation amount based on the position of the obstruction relative to the terminal and a first corresponding relationship, and the compensation amount is used to compensate for the audio signal of the channel where the obstruction is located; wherein the first corresponding relationship represents the corresponding relationship between the position of the obstruction relative to the terminal and the compensation amount.

[0120] In some embodiments, the processing module 103 is also used to: determine the compensation amount based on the size of the obstruction and the second correspondence; or, determine the compensation amount based on the size of the obstruction, the position of the obstruction relative to the terminal, and a third correspondence; the compensation amount is used to compensate for the audio signal of the channel where the obstruction is located; wherein the second correspondence represents the correspondence between the size of the obstruction and the compensation amount, and the third correspondence represents the correspondence between the size of the obstruction, the position relationship of the obstruction relative to the terminal, and the compensation amount.

[0121] In some embodiments, the terminal pre-stores a corresponding relationship, and the processing module 103 is also used to determine the corresponding relationship in the following manner: when there is no obstruction at the terminal, a first audio signal is collected. When there is an obstruction at the terminal, a second audio signal is collected under different conditions, and the different conditions indicate that the obstruction has different sizes and / or different orientations of the obstruction relative to the terminal. Based on the first audio signal and the second audio signal under different conditions, a corresponding relationship is obtained. Among them, if the different conditions indicate the orientation of the obstruction relative to the terminal, the corresponding relationship is a first corresponding relationship. If the different conditions indicate the size of the obstruction, the corresponding relationship is a second corresponding relationship. If the different conditions indicate the orientation of the obstruction relative to the terminal and the size of the obstruction, the corresponding relationship is a third corresponding relationship.

[0122] Fig. 5 is a block diagram of an audio processing apparatus 200 according to an exemplary embodiment.

[0123] As shown in FIG. 5 , apparatus 200 may include one or more of the following components: a processing component 202 , a memory 204 , a power component 206 , a multimedia component 208 , an audio component 210 , an input / output (I / O) interface 212 , a sensor component 214 , and a communication component 216 .

[0124] The processing component 202 generally controls the overall operation of the device 200, such as operations associated with display, phone calls, data communications, camera operation, and recording operations. The processing component 202 may include one or more processors 220 to execute instructions to perform all or part of the steps of the above-described method. In addition, the processing component 202 may include one or more modules to facilitate interaction between the processing component 202 and other components. For example, the processing component 202 may include a multimedia module to facilitate interaction between the multimedia component 208 and the processing component 202.

[0125] The memory 204 is configured to store various types of data to support operations on the device 200. Examples of such data include instructions for any application or method operating on the device 200, contact data, phone book data, messages, pictures, videos, etc. The memory 204 can be implemented by any type of volatile or non-volatile storage device, or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic disk, or optical disk.

[0126] The power component 206 provides power to the various components of the device 200. The power component 206 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power to the device 200.

[0127] The multimedia component 208 includes a screen that provides an output interface between the device 200 and the user. In some embodiments, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive input signals from the user. The touch panel includes one or more touch sensors to sense touches, slides, and gestures on the touch panel. The touch sensor can not only sense the boundaries of a touch or slide action, but also detect the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia component 208 includes a front camera and / or a rear camera. When the device 200 is in an operating mode, such as a shooting mode or a video mode, the front camera and / or the rear camera can receive external multimedia data. Each front camera and rear camera can be a fixed optical lens system or have focal length and optical zoom capabilities.

[0128] The audio component 210 is configured to output and / or input audio signals. For example, the audio component 210 includes a microphone (MIC) that is configured to receive external audio signals when the device 200 is in an operating mode, such as a call mode, a recording mode, and a voice recognition mode. The received audio signals may be further stored in the memory 204 or transmitted via the communication component 216. In some embodiments, the audio component 210 further includes a speaker for outputting audio signals.

[0129] I / O interface 212 provides an interface between processing component 202 and peripheral interface modules, such as a keyboard, click wheel, buttons, etc. These buttons may include but are not limited to: a home button, volume buttons, a start button, and a lock button.

[0130] The sensor assembly 214 includes one or more sensors for providing various aspects of the status assessment of the device 200. For example, the sensor assembly 214 can detect the open / closed state of the device 200, the relative positioning of components, such as the display and keypad of the device 200. The sensor assembly 214 can also detect changes in the position of the device 200 or a component of the device 200, the presence or absence of user contact with the device 200, the orientation or acceleration / deceleration of the device 200, and temperature changes of the device 200. The sensor assembly 214 may include a proximity sensor configured to detect the presence of nearby objects without any physical contact. The sensor assembly 214 may also include an optical sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 214 may also include an accelerometer, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.

[0131] The communication component 216 is configured to facilitate wired or wireless communication between the device 200 and other devices. The device 200 can access a wireless network based on a communication standard, such as WiFi, 2G or 3G, or a combination thereof. In an exemplary embodiment, the communication component 216 receives a broadcast signal or broadcast-related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 216 also includes a near field communication (NFC) module to facilitate short-range communication. For example, the NFC module can be implemented based on radio frequency identification (RFID) technology, infrared data association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology and other technologies.

[0132] In an exemplary embodiment, the apparatus 200 may be implemented by one or more application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), controllers, microcontrollers, microprocessors, or other electronic components to perform the above-described method.

[0133] In an exemplary embodiment, a non-transitory computer-readable storage medium including instructions is also provided, such as the memory 204 including instructions, which can be executed by the processor 220 of the apparatus 200 to perform the above method. For example, the non-transitory computer-readable storage medium can be a ROM, a random access memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, etc.

[0134] The present invention collects multi-channel audio signals, detects the position of the obstruction during the collection process, and compensates the audio signal of the channel at the position of the obstruction to solve the problem of weak audio signal of the channel at the position of the obstruction and uneven overall audio signal due to the presence of the obstruction.

[0135] It is understood that in this disclosure, "plurality" refers to two or more than two, and other quantifiers are similar. "And / or" describes the association relationship of associated objects, indicating that three relationships may exist. For example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone. The character " / " generally indicates that the related objects before and after are in an "or" relationship. The singular forms "a", "an", and "the" are also intended to include plural forms, unless the context clearly indicates otherwise.

[0136] It will be further understood that the terms "first," "second," and the like are used to describe various types of information, but such information should not be limited to these terms. These terms are used solely to distinguish information of the same type from one another and do not indicate a particular order or level of importance. In fact, the terms "first," "second," and the like are fully interchangeable. For example, first information could be referred to as second information, and similarly, second information could be referred to as first information without departing from the scope of this disclosure.

[0137] It is further understood that although operations are described in a particular order in the drawings in the embodiments of the present disclosure, this should not be construed as requiring that the operations be performed in the particular order shown or in a serial order, or that all of the operations shown be performed to obtain the desired results. In certain circumstances, multitasking and parallel processing may be advantageous.

[0138] Those skilled in the art will readily appreciate other embodiments of the present disclosure after considering the specification and practicing the invention disclosed herein. This application is intended to cover any variations, uses, or adaptations of the present disclosure that follow the general principles of the present disclosure and include common knowledge or customary techniques in the art not disclosed herein.

[0139] Regarding the apparatus in the above embodiment, the specific manner in which each module performs operations has been described in detail in the embodiment of the method, and will not be elaborated here.

Claims

1. An audio processing method, characterized in that: The method comprises: Collecting multi-channel audio signals, where the multi-channels correspond to multiple positions of the terminal; During the acquisition process, detecting relevant information of the obstruction, wherein the relevant information of the obstruction includes the orientation of the obstruction relative to the terminal; Based on the relevant information of the obstruction, the audio signal of the channel at the location of the obstruction is compensated.

2. The method according to claim 1, characterized in that The compensating the audio signal of the channel at the location of the obstruction includes: In response to the audio signal having directionality, compensating for the audio signal of the channel in the direction where the obstruction is located; and / or In response to the audio signal having directionality, after processing the audio signal to obtain an audio signal in a stereo format, compensation is performed on the audio signal of the channel in the direction where the obstruction is located.

3. The method according to claim 1, characterized in that The compensating the audio signal of the channel at the location of the obstruction includes: In response to the audio signal not having directionality, after processing the audio signal to obtain an audio signal in a stereo format, compensation is performed on the audio signal of the channel in the direction where the obstruction is located.

4. The method according to claim 1, wherein The method further comprises: Determining a compensation amount based on the position of the obstruction relative to the terminal and the first corresponding relationship, wherein the compensation amount is used to compensate the audio signal of the channel at the position of the obstruction; The first corresponding relationship represents the corresponding relationship between the position of the obstruction relative to the terminal and the compensation amount.

5. The method according to claim 1, wherein The relevant information of the obstruction also includes the size of the obstruction, and the method further includes: Determining the compensation amount based on the size of the obstruction and the second correspondence; or determining the compensation amount based on the size of the obstruction, the orientation of the obstruction relative to the terminal, and a third correspondence; The compensation amount is used to compensate the audio signal of the channel where the obstruction is located; The second corresponding relationship represents the corresponding relationship between the size of the obstruction and the compensation amount, and the third corresponding relationship represents the corresponding relationship between the size of the obstruction, the position relationship of the obstruction relative to the terminal, and the compensation amount.

6. The method according to claim 4 or 5, characterized in that The terminal pre-stores a corresponding relationship, which is determined in the following manner: When there is no obstruction on the terminal, collecting the first audio signal; When there is an obstruction on the terminal, collecting second audio signals under different conditions, where the different conditions indicate that the obstruction has different sizes and / or different orientations of the obstruction relative to the terminal; Obtaining the corresponding relationship based on the first audio signal and the second audio signal under different conditions; Among them, if the different conditions represent the position of the obstruction relative to the terminal, the corresponding relationship is the first corresponding relationship; if the different conditions represent the size of the obstruction, the corresponding relationship is the second corresponding relationship; if the different conditions represent the position of the obstruction relative to the terminal and the size of the obstruction, the corresponding relationship is the third corresponding relationship.

7. An audio processing device, characterized in that: The device comprises: An acquisition module, configured to acquire multi-channel audio signals corresponding to multiple positions of the terminal; A detection module, configured to detect information related to an obstruction during the acquisition process, wherein the information related to the obstruction includes the position of the obstruction relative to the terminal; The processing module is configured to compensate the audio signal of the channel at the location of the obstruction based on the relevant information of the obstruction.

8. The device according to claim 7, characterized in that The processing module compensates the audio signal of the channel at the location of the obstruction in the following manner: In response to the audio signal having directionality, compensating for the audio signal of the channel in the direction where the obstruction is located; and / or In response to the audio signal having directionality, after processing the audio signal to obtain an audio signal in a stereo format, compensation is performed on the audio signal of the channel in the direction where the obstruction is located.

9. The device according to claim 7, characterized in that The compensating the audio signal of the channel at the location of the obstruction includes: In response to the audio signal not having directionality, after processing the audio signal to obtain an audio signal in a stereo format, compensation is performed on the audio signal of the channel in the direction where the obstruction is located.

10. The device according to claim 7, characterized in that The processing module is further configured to: The compensation amount is determined based on the position of the obstruction relative to the terminal and the first corresponding relationship, and the compensation amount is used to adjust the position of the obstruction relative to the terminal. Compensate the audio signal of the channel; The first corresponding relationship represents the corresponding relationship between the position of the obstruction relative to the terminal and the compensation amount.

11. The device according to claim 7, characterized in that The relevant information of the obstruction also includes the size of the obstruction, and the processing module is further configured to: Determining the compensation amount based on the size of the obstruction and the second correspondence; or determining the compensation amount based on the size of the obstruction, the orientation of the obstruction relative to the terminal, and a third correspondence; The compensation amount is used to compensate the audio signal of the channel where the obstruction is located; The second corresponding relationship represents the corresponding relationship between the size of the obstruction and the compensation amount, and the third corresponding relationship represents the corresponding relationship between the size of the obstruction, the position relationship of the obstruction relative to the terminal, and the compensation amount.

12. The device according to claim 10 or 11, characterized in that The terminal pre-stores a corresponding relationship, and the processing module is further configured to determine the corresponding relationship in the following manner: When there is no obstruction on the terminal, collecting the first audio signal; When there is an obstruction on the terminal, collecting second audio signals under different conditions, where the different conditions indicate that the obstruction has different sizes and / or different orientations of the obstruction relative to the terminal; Obtaining the corresponding relationship based on the first audio signal and the second audio signal under different conditions; Among them, if the different conditions represent the position of the obstruction relative to the terminal, the corresponding relationship is the first corresponding relationship; if the different conditions represent the size of the obstruction, the corresponding relationship is the second corresponding relationship; if the different conditions represent the position of the obstruction relative to the terminal and the size of the obstruction, the corresponding relationship is the third corresponding relationship.

13. An electronic device, characterized in that: include: a memory for storing instructions; as well as A processor, configured to call the instructions stored in the memory to execute the method according to any one of claims 1 to 6.

14. A storage medium, characterized in that The storage medium stores instructions, and when the instructions are executed by the processor, the method according to any one of claims 1 to 6 is executed.

Images