Audio processing method and device, electronic equipment and storage medium

Abstract

The invention relates to an audio processing method and device, electronic equipment and a storage medium, and the method comprises the steps: converting a collected audio signal of target audio equipment into a frequency domain, and obtaining the first frequency domain information of the audio signal; wherein the first frequency domain information comprises amplitude values of different frequency components of the audio signal; determining a reference value according to the amplitude value; determining bottom noise information of the audio signal according to a difference value between the amplitude values of different frequency components and the reference value; the ground noise information is used for reflecting the ground noise processing capability of the target audio equipment.

Description

Technical Field

[0001] The present disclosure relates to the technical field of audio detection, and in particular to an audio processing method and device, an electronic device and a storage medium. Background Art

[0002] In the prior art, the background noise of audio equipment is measured by audio compression. It only measures whether the background noise current sound of the audio equipment exceeds a certain benchmark. When it is determined that there is a signal exceeding the benchmark, it is determined that there is background noise in the audio equipment. However, this background noise determination method can only determine whether there is background noise, but cannot determine the specific size of the background noise current sound. At the same time, the benchmark in the above method is set by artificial evaluation and is not accurate enough; when determining whether the signal exceeds the benchmark, it is easy to miss the test due to the background noise value being too low, which affects the detection result. Summary of the invention

[0003] The present disclosure provides an audio processing method and device, an electronic device and a storage medium.

[0004] According to a first aspect of an embodiment of the present disclosure, there is provided an audio processing method, comprising:

[0005] Based on the collected audio signal of the target audio device, the first frequency domain information of the audio signal is obtained by converting the audio signal into the frequency domain; wherein the first frequency domain information includes: amplitude values ​​of different frequency components of the audio signal;

[0006] Determining a reference value according to the amplitude value;

[0007] The noise floor information of the audio signal is determined according to the difference between the amplitude value of different frequency components and the reference value; the noise floor information is used to reflect the noise floor processing capability of the target audio device.

[0008] Based on the above solution, the audio signal of the target audio device acquired is converted into the frequency domain to obtain the first frequency domain information of the audio signal, including:

[0009] Convert the audio signal from the time domain to the frequency domain to generate second frequency domain information;

[0010] Retaining the frequency domain information of the first frequency band in the second frequency domain information through the first filter to obtain the third frequency domain information;

[0011] The first frequency domain information is obtained by retaining the frequency domain information of the second frequency band in the third frequency domain information through the second filter; the second frequency band is a sub-frequency band of the first frequency band.

[0012] Based on the above solution, converting the audio signal from the time domain to the frequency domain to generate second frequency domain information includes:

[0013] Framing the audio signal in the time domain to obtain a plurality of audio frames;

[0014] Performing a window function on the audio frame;

[0015] The audio frame after executing the window function is converted into the frequency domain to generate second frequency domain information.

[0016] Based on the above solution, determining the reference value according to the amplitude value includes:

[0017] Determine confidence level;

[0018] Taking the confidence level as probability, performing interval estimation on the amplitude value in the first frequency domain information to determine the amplitude value range;

[0019] Determining the amplitude value range as the confidence interval;

[0020] Based on the confidence interval, the reference value is determined.

[0021] Based on the above solution, the background noise information at least includes:

[0022] Noise floor decibel value, and / or noise floor frequency range.

[0023] Based on the above solution, determining the background noise information of the audio signal according to the difference between the amplitude value of different frequency components and the reference value includes:

[0024] Determine the difference between the amplitude values ​​of different frequency components in the first frequency domain information and the reference value;

[0025] When the difference exceeds a preset threshold, determining the difference as the noise floor decibel value in the audio signal;

[0026] and / or,

[0027] When the difference exceeds a preset threshold, a frequency component corresponding to the amplitude value corresponding to the difference is determined as the background noise frequency interval.

[0028] According to a second aspect of an embodiment of the present disclosure, there is provided an audio processing device, the device comprising:

[0029] A first acquisition module is used to convert the collected audio signal of the target audio device into the frequency domain to obtain first frequency domain information of the audio signal; wherein the first frequency domain information includes: amplitude values ​​of different frequency components of the audio signal;

[0030] A first determining module, used to determine a reference value according to the amplitude value;

[0031] The second determination module is used to determine the background noise information of the audio signal according to the difference between the amplitude value of different frequency components and the reference value; the background noise information is used to reflect the background noise processing capability of the target audio device.

[0032] Based on the above solution, the first acquisition module is specifically used for:

[0033] Convert the audio signal from the time domain to the frequency domain to generate second frequency domain information;

[0034] Retaining the frequency domain information of the first frequency band in the second frequency domain information through the first filter to obtain the third frequency domain information;

[0035] The first frequency domain information is obtained by retaining the frequency domain information of the second frequency band in the third frequency domain information through the second filter; the second frequency band is a sub-frequency band of the first frequency band.

[0036] Based on the above solution, the first acquisition module is further specifically used for:

[0037] Framing the audio signal in the time domain to obtain a plurality of audio frames;

[0038] Performing a window function on the audio frame;

[0039] The audio frame after executing the window function is converted into the frequency domain to generate second frequency domain information.

[0040] Based on the above solution, the first determining module is specifically used to:

[0041] Determine confidence level;

[0042] Taking the confidence level as probability, performing interval estimation on the amplitude value in the first frequency domain information to determine the amplitude value range;

[0043] Determining the amplitude value range as the confidence interval;

[0044] Based on the confidence interval, the reference value is determined.

[0045] Based on the above solution, the background noise information at least includes:

[0046] Noise floor decibel value, and / or noise floor frequency range.

[0047] Based on the above solution, the second determining module is specifically used for:

[0048] Determine the difference between the amplitude values ​​of different frequency components in the first frequency domain information and the reference value;

[0049] When the difference exceeds a preset threshold, determining the difference as the noise floor decibel value in the audio signal;

[0050] and / or,

[0051] When the difference exceeds a preset threshold, a frequency component corresponding to the amplitude value corresponding to the difference is determined as the background noise frequency interval.

[0052] According to a third aspect of an embodiment of the present disclosure, there is provided an electronic device, including:

[0053] a memory for storing processor-executable instructions;

[0054] A processor connected to the memory;

[0055] Wherein, the processor is configured to execute the above audio processing method.

[0056] According to a fourth aspect of an embodiment of the present disclosure, a non-temporary computer-readable storage medium is provided. When instructions in the storage medium are executed by a processor of a computer, the computer is enabled to perform the above audio processing method.

[0057] The technical solution provided by the embodiments of the present disclosure may have the following beneficial effects:

[0058] It can be seen from the above embodiments that the technical solution provided by the present disclosure converts the collected audio signal of the target audio device into the frequency domain to obtain the first frequency domain information including the amplitude values ​​of different frequency components of the audio signal; determines the reference value through the amplitude value in the first frequency domain information of the audio signal, thereby reducing the problem of inaccurate noise measurement results caused by setting the noise floor reference value by subjective human evaluation; at the same time, determines the noise floor information of the audio signal according to the difference between the amplitude values ​​of different frequency components in the frequency domain information and the reference value, so that not only all the noise floors existing in the target audio device can be determined, but also the specific size of the noise floor of the target audio device can be accurately determined.

[0059] It is to be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the invention. BRIEF DESCRIPTION OF THE DRAWINGS

[0060] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and, together with the description, serve to explain the principles of the present disclosure.

[0061] Figure 1 is a schematic diagram showing an existing method for determining background noise according to an exemplary embodiment;

[0062] Figure 2 is a flowchart of an audio processing method according to an exemplary embodiment;

[0063] Figure 3 is a flowchart of another audio processing method according to an exemplary embodiment;

[0064] Figure 4 is a flowchart of another audio processing method according to an exemplary embodiment;

[0065] Figure 5 is a schematic diagram showing a result of third frequency domain information according to an exemplary embodiment;

[0066] Figure 6 is a schematic diagram showing a result of first frequency domain information according to an exemplary embodiment;

[0067] Figure 7 is a result schematic diagram of a benchmark value according to an exemplary embodiment;

[0068] Figure 8 is a schematic diagram of a background noise result according to an exemplary embodiment;

[0069] Fig. 9 is a schematic diagram of an application scenario of an audio processing method according to an exemplary embodiment;

[0070] Fig.10 is a flowchart of an audio processing method according to an exemplary embodiment;

[0071] Fig.11 is a structural block diagram of an audio processing device according to an exemplary embodiment;

[0072] Fig.12 The present invention is a structural block diagram of a device for audio processing according to an exemplary embodiment. DETAILED DESCRIPTION

[0073] Exemplary embodiments will be described in detail herein, examples of which are shown in the accompanying drawings. When the following description refers to the drawings, the same numbers in different drawings represent the same or similar elements unless otherwise indicated. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present disclosure. Instead, they are merely examples of devices consistent with some aspects of the present disclosure as detailed in the appended claims.

[0074] The terms used in the embodiments of the present invention are only for the purpose of describing specific embodiments, and are not intended to limit the embodiments of the present invention. The singular forms of "a", "said" and "the" used in the embodiments of the present invention and the appended claims are also intended to include plural forms, unless the context clearly indicates other meanings. It should also be understood that the term "and / or" used herein refers to and includes any or all possible combinations of one or more associated listed items.

[0075] It should be understood that although the terms first, second, third, etc. may be used to describe various information in embodiments of the present invention, these information should not be limited to these terms. These terms are only used to distinguish the same type of information from each other. For example, without departing from the scope of embodiments of the present invention, the first information may also be referred to as the second information, and similarly, the second information may also be referred to as the first information. Depending on the context, the word "if" as used herein may be interpreted as "at the time of" or "when" or "in response to determining".

[0076] At present, the audio performance detection of True Wireless Stereo (TWS) headphones is usually based on audio compression Audio Pression. According to the Bluetooth transmission protocol of TWS headphones, audio performance detection is usually divided into call detection (Hands-free Profile, HFP) and Bluetooth audio transmission model agreement music detection (Advanced Audio Distribution Profile, A2DP).

[0077] In some implementations, the headphone noise floor is generally measured by audio compression, such as Figure 1 As shown, it only measures whether the noise floor current sound of the headphones exceeds a certain baseline. When it is determined that there is a signal exceeding the baseline, it is determined that there is noise floor in the headphones. However, this method can only determine whether the noise floor in the headphones exceeds a certain range, and cannot determine the specific size of the noise floor current sound. By determining whether the signal exceeds the baseline, it is easy to miss the test due to the low noise floor value, which affects the test results and further affects the quality assessment of the audio equipment. At the same time, the baseline in the above method is usually set by manual evaluation and is not accurate.

[0078] like Figures 2 to 8 As shown, the present disclosure provides an audio processing method, the method comprising:

[0079] 101: Convert the collected audio signal of the target audio device into the frequency domain to obtain first frequency domain information of the audio signal; wherein the first frequency domain information includes: amplitude values ​​of different frequency components of the audio signal;

[0080] 102: Determine a reference value according to the amplitude value;

[0081] 103: Determine background noise information of the audio signal according to differences between the amplitude values ​​of different frequency components and the reference values; the background noise information is used to reflect the background noise processing capability of the target audio device.

[0082] Exemplarily, the target audio device may be a headset, such as a Bluetooth headset, a wired headset, etc.; also exemplarily, the target audio device may also be a speaker, an amplifier or a microphone, etc.; in this embodiment, the target audio device is a headset.

[0083] Noise floor generally refers to all interference that is unrelated to the presence or absence of a signal in a generation, inspection, measurement or recording system. In industrial noise or environmental noise measurement, it refers to the ambient noise other than the noise source being measured. For example, the noise floor can refer to the inherent electronic and electromagnetic noise in the target audio device, and the decibel value of the noise floor is one of the quality measurement criteria for the target audio device.

[0084] In this embodiment, the larger the noise floor value in the noise floor information is, the worse the noise floor processing capability of the target audio device is; and the smaller the noise floor value is, the better the noise floor processing capability of the target audio device is.

[0085] The technical solution provided by the present disclosure converts the collected audio signal of the target audio device into the frequency domain to obtain first frequency domain information including amplitude values ​​of different frequency components of the audio signal; determines a reference value through the amplitude value in the first frequency domain information, thereby reducing the problem of inaccurate noise floor measurement results caused by setting the noise floor reference value by subjective human evaluation; at the same time, determines the noise floor information of the audio signal according to the difference between the amplitude values ​​of different frequency components in the frequency domain information and the reference value, so that not only all the noise floors existing in the target audio device can be determined, but also the specific size of the noise floor of the target audio device can be accurately determined.

[0086] For example, Figure 3 As shown, the above step 101 includes:

[0087] 201: Convert the audio signal from the time domain to the frequency domain to generate second frequency domain information;

[0088] 202: retaining frequency domain information of a first frequency band in the second frequency domain information through a first filter to obtain third frequency domain information;

[0089] 203: Retain frequency domain information of a second frequency band in the third frequency domain information through a second filter to obtain first frequency domain information; the second frequency band is a sub-frequency band of the first frequency band.

[0090] In some embodiments, in the above step 201, the audio signal is a time domain signal, and any method that can convert the audio signal from the time domain to the frequency domain is within the protection scope of this embodiment.

[0091] Exemplarily, the first filter may be a bandpass filter, and the frequency domain information of the first frequency band in the second frequency domain information is retained by the first filter to obtain the third frequency domain information. Figure 5 This is a schematic diagram of a result of the third frequency domain information shown in this embodiment.

[0092] Exemplarily, the first frequency band can be any frequency range from 0 Hz to 48000 Hz; preferably, in this embodiment, the first frequency band can be 700 Hz to 16000 Hz; here, the first frequency band is a sound frequency range audible to the human ear; the third frequency domain information is obtained through the first filter, and the third frequency domain information is the second frequency domain information of the frequency band corresponding to the first frequency band; in this way, the background noise of the target audio device when the target audio device plays an audio signal within the frequency range audible to the human ear can be better determined.

[0093] Exemplarily, the second filter is a high-pass filter, such as a Butterworth filter, a Gaussian high-pass filter, etc.;

[0094] Exemplarily, the second frequency band may be smaller than the first frequency band, or may be equal to the first frequency band; in this embodiment, the second frequency band is equal to the first frequency band, and the second frequency band is also 700 Hz to 16000 Hz.

[0095] Specifically, the third frequency domain information is passed through a high-pass filter to retain the frequency domain information of the second frequency band in the third frequency domain information to obtain the first frequency domain information; the high-pass filter is used to remove the low-frequency envelope in the third frequency domain information and retain the high-frequency detail part; Figure 6 This is a schematic diagram of a result of first frequency domain information shown in this embodiment.

[0096] It should be noted that before step 203, the third frequency domain information can also be passed through a Hilbert filter to extract the frequency domain information corresponding to the high-frequency signal in the third frequency domain information. In this way, the amplitude value in the third frequency domain information obtained through the Hilbert filter can be smoother, thereby improving the quality of the third frequency domain information.

[0097] The high frequency information in the third frequency domain information after extraction is used as input information of step 203 , and step 203 is executed.

[0098] In some embodiments, Figure 4 As shown, the above step 201 includes:

[0099] 2011: framing the audio signal in the time domain to obtain a plurality of audio frames;

[0100] 2012: Execute a window function on the audio frame;

[0101] 2013: Convert the audio frame after executing the window function into the frequency domain to generate second frequency domain information.

[0102] Exemplarily, the audio signal is acquired based on a certain sampling rate; here, the sampling rate may be 48000 Hz, 16000 Hz, 8000 Hz or 4000 Hz, etc., and the sampling rate here may be adjusted dynamically.

[0103] In the above step 2011, the frame length of the sub-frame is determined; illustratively, the frame length of the sub-frame may be 16ms, 64ms, 120ms or 1000ms, etc.; preferably, the frame length may be 1000ms, i.e., 1s;

[0104] The collected audio signal is divided into frames based on the frame length in the time domain to obtain a plurality of audio frames with a frame length of 1 s.

[0105] Exemplarily, the window length of the window function is smaller than the frame length; in this embodiment, preferably, the window length may be 500 ms, i.e., 0.5 s.

[0106] Taking 0.5s as the window length, multiple audio frames with a frame length of 1s are windowed and the window function is executed, so that spectrum leakage can be reduced.

[0107] The error between the framed signal and the original signal can be reduced by windowing, so that the framed signal becomes continuous and each frame shows the characteristics of a periodic function. For example, a window function such as a Hamming window or a Hanning window can be used.

[0108] Exemplarily, in the above step 2013, the audio frame after executing the window function may be converted into the frequency domain by Fourier transform to generate the second frequency domain information.

[0109] Here, the windowed audio frames are arranged in frame order through Fourier transform to obtain the second frequency domain information.

[0110] In some embodiments, the above step 102 includes:

[0111] Determine confidence level;

[0112] Taking the confidence level as probability, performing interval estimation on the amplitude value in the first frequency domain information to determine the amplitude value range;

[0113] Determining the amplitude value range as the confidence interval;

[0114] Based on the confidence interval, the reference value is determined.

[0115] Exemplarily, the confidence level may be 90%, 80%, or 95%. Preferably, in this embodiment, the confidence level is 80%.

[0116] In some embodiments, the confidence level may be a preset confidence level.

[0117] Specifically, with a confidence level of 80%, an interval estimation is performed on the amplitude value in the first frequency domain information, and the determined amplitude value range is represented by [A, B]; the amplitude value range is determined as the confidence interval, that is, the confidence interval is also [A, B].

[0118]

[0119] Schematic diagram of the results of the benchmark values.

[0120] In the embodiment of the present disclosure, by determining the noise reference value based on the frequency domain information of the audio signal played by the target audio device, the problem that the artificially set noise reference value affects the accuracy of the subsequent determination of the background noise reference value is solved.

[0121] In some embodiments, in the above step 103, the background noise information at least includes: background noise decibel value, and / or background noise frequency range.

[0122] In some embodiments, the above step 103 includes:

[0123] Determine the difference between the amplitude values ​​of different frequency components in the first frequency domain information and the reference value;

[0124] When the difference exceeds a preset threshold, determining the difference as the noise floor decibel value in the audio signal;

[0125] and / or,

[0126] When the difference exceeds a preset threshold, a frequency component corresponding to the amplitude value corresponding to the difference is determined as the background noise frequency interval.

[0127] Exemplarily, the preset threshold may be a default value, or may be dynamically adjusted according to an application scenario or a standard noise floor value of a target audio device; exemplarily, in one embodiment, the preset threshold may be 5 dB.

[0128] Specifically, the difference between the amplitude value of different frequency components in the first frequency domain information and the reference value is represented by Delta.

[0129] The absolute value of the amplitude value of different frequency components in the first frequency domain information is subtracted from the reference value X; when the difference Delta exceeds the preset threshold, the difference Delta is determined as the noise floor decibel value in the audio signal, and the frequency of the amplitude value corresponding to the difference Delta is determined as the noise floor frequency. In this way, the noise floor decibel value in the target audio device and the frequency range of its noise floor can be accurately determined. Figure 8 As shown, Figure 8 It is a schematic diagram of a background noise result shown in an embodiment of the present disclosure.

[0130] In one embodiment, the method further includes: summing the noise floor decibel values ​​in the determined noise floor information to determine a total noise floor decibel value of the target audio device.

[0131] The technical solution provided by the present disclosure converts the collected audio signal of the target audio device into the frequency domain to obtain frequency domain information including the amplitude values ​​of different frequency components of the audio signal; determines the reference value through the amplitude value in the frequency domain information of the audio signal, thereby reducing the problem of inaccurate noise floor measurement results caused by setting the noise floor reference value by subjective human evaluation; at the same time, determines the noise floor information of the audio signal according to the difference between the amplitude values ​​of different frequency components in the frequency domain information and the reference value, thereby not only determining whether the target audio device has noise floor, but also accurately determining the specific size of the noise floor of the target audio device.

[0132] The audio processing method and its application scenarios provided by the present disclosure are further explained below through specific embodiments.

[0133] Fig. 9 Schematic diagram of an application scenario of the audio processing method provided in the embodiment of the present disclosure; the audio processing method is applied in Fig. 9 The application scenario runs in the test environment shown, and includes a test terminal 11, a sound card 12, a mobile terminal 13, a TWS headset 14, and a low-noise artificial ear 15.

[0134] The TWS headset 14 is connected to the mobile terminal 13 by Bluetooth. In a relatively quiet scene, the low-noise artificial ear 15 collects the audio signal played by the TWS headset 14, and the audio signal collected by the artificial ear 15 is converted into a digital signal through the sound card 12 to generate a digital signal; the digital signal is input into the value test terminal 11 for calculation and analysis. By ensuring the quietness of the test site, the environmental noise in the collected audio signal can be reduced.

[0135] Fig.10 The following is a flow chart of an audio processing method according to an exemplary embodiment; the specific flow of the method may include the following steps:

[0136] Step 1: Collect the audio signal played by the target audio device;

[0137] Specifically, the audio signal played by the TWS headset is collected through a low-noise artificial ear.

[0138] Step 2: performing short-time Fourier transform on the audio signal to generate second frequency domain information;

[0139] Specifically, the audio signal is processed by performing short-time Fourier transform on the audio signal, and the audio signal is converted from the time domain to the frequency domain to generate the second frequency domain information.

[0140] Step 2.1: Frame the audio signal in the time domain to obtain multiple audio frames;

[0141] Exemplarily, the frame length of the subframe may be 16ms, 64ms, 120ms or 1000ms, etc.; preferably, the frame length may be 1000ms, i.e. 1s.

[0142] Specifically, the collected audio signal is divided into frames based on the frame length in the time domain to obtain a plurality of audio frames with a frame length of 1 s.

[0143] Step 2.2: Execute a window function on the audio frame;

[0144] Exemplarily, the window length of the window function is smaller than the frame length; in this embodiment, preferably, the window length may be 500 ms, i.e., 0.5 s.

[0145] Specifically, the audio signal is divided into overlapping frames by using a window length that is smaller than the frame length; a plurality of audio frames with a frame length of 1 second are windowed with a window length of 0.5 second, and a window function is executed; in this way, the error between the framed signal and the original signal can be reduced, so that the framed signal becomes continuous and each frame exhibits the characteristics of a periodic function.

[0146] Step 2.3: Convert the audio frame after executing the window function into the frequency domain through Fourier transform to generate second frequency domain information.

[0147] Step 3: Perform bandpass filtering on the second frequency domain information to generate third frequency domain information.

[0148] Specifically, the second frequency domain information is band-pass filtered by a band-pass filter, and the frequency domain information of the first frequency band in the second frequency domain information is retained to obtain the third frequency domain information;

[0149] Exemplarily, the first frequency band is 700 Hz to 16000 Hz; here, the first frequency band is the sound frequency range audible to the human ear; the third frequency domain information is obtained through the first filter, and the third frequency domain information is the second frequency domain information of the frequency band corresponding to the first frequency band; in this way, the background noise of the target audio device when the target audio device plays an audio signal within the frequency range audible to the human ear can be better determined.

[0150] Step 4: extract the frequency domain information corresponding to the high-frequency signal in the third frequency domain information through a Hilbert filter to generate fourth frequency domain information.

[0151] Here, the Hilbert filter can be used to make the amplitude value in the third frequency domain information smoother, thereby improving the fourth frequency domain information with higher quality.

[0152] Step 5: retain the frequency domain information of the second frequency band in the fourth frequency domain information through a high-pass filter to obtain the first frequency domain information; the second frequency band is a sub-frequency band of the first frequency band.

[0153] Exemplarily, the second frequency band may be smaller than the first frequency band, or may be equal to the first frequency band; in this embodiment, the second frequency band is equal to the first frequency band, and the second frequency band is 700 Hz to 16000 Hz.

[0154] Here, the low-frequency envelope in the fourth frequency domain information is removed by a high-pass filter, and the high-frequency detail part is retained;

[0155] Step 6: Determine the baseline value.

[0156] Step 6.1: Determine the confidence level;

[0157] Here, the confidence level may be a preset confidence level or may be dynamically adjusted;

[0158] Exemplarily, the confidence level may be 90%, 80%, or 95%. Preferably, in this embodiment, the confidence level is 80%.

[0159] Step 6.2: Taking the confidence level as probability, performing interval estimation on the amplitude value in the first frequency domain information to determine a confidence interval;

[0160] Specifically, with a confidence level of 80%, an interval estimation is performed on the amplitude value in the first frequency domain information, and the determined amplitude value range is represented by [A, B]; the amplitude value range is determined as the confidence interval, that is, the confidence interval is also [A, B].

[0161] Step 6.3: Determine the reference value based on the confidence interval;

[0162] Specifically, the reference value is represented by X, and the interval average value of the confidence interval is used as the reference value.

[0163]

[0164] Step 7: Determine the background noise information;

[0165] Step 7.1: Determine the difference between the amplitude values ​​of different frequency components in the first frequency domain information and the reference value;

[0166] Specifically, the amplitude values ​​of different frequency components in the first frequency domain information are subtracted from the reference value X to determine the difference; and the difference is represented by Delta.

[0167] Step 7.2: When the difference exceeds a preset threshold, determine the difference as the noise floor decibel value in the audio signal; and / or, when the difference exceeds a preset threshold, determine the frequency component corresponding to the amplitude value corresponding to the difference as the noise floor frequency interval;

[0168] Exemplarily, the preset threshold may be a default value, or may be dynamically adjusted according to an application scenario or a standard noise floor value of a target audio device; exemplarily, in this embodiment, the preset threshold may be 5 dB.

[0169] Specifically, when the difference Delta exceeds 5 dB, the difference Delta is determined as the noise floor decibel value in the audio signal, and the frequency at which the amplitude value corresponding to the difference Delta is located is determined as the noise floor frequency. In this way, the noise floor decibel value in the target audio device and the frequency range in which the noise floor is located can be accurately determined.

[0170] Step 8: Determine the total decibel value of the noise floor of the target audio device;

[0171] Specifically, the noise floor decibel values ​​in the determined noise floor information are summed to determine the total noise floor decibel value of the target audio device.

[0172] The technical solution provided by the present disclosure converts the collected audio signal of the target audio device into the frequency domain to obtain frequency domain information including the amplitude values ​​of different frequency components of the audio signal; determines the reference value through the amplitude value in the frequency domain information of the audio signal, thereby reducing the problem of inaccurate noise floor measurement results caused by setting the noise floor reference value by subjective human evaluation; at the same time, determines the noise floor information of the audio signal according to the difference between the amplitude values ​​of different frequency components in the frequency domain information and the reference value, thereby not only determining whether the target audio device has noise floor, but also accurately determining the specific size of the noise floor of the target audio device.

[0173] Fig.11 is a structural block diagram of an audio processing device according to an exemplary embodiment. Fig.10 , the audio processing device 300 may include:

[0174] The first acquisition module 301 is used to convert the collected audio signal of the target audio device into the frequency domain to obtain the first frequency domain information of the audio signal; wherein the first frequency domain information includes: the amplitude values ​​of different frequency components of the audio signal;

[0175] A first determining module 302, configured to determine a reference value according to the amplitude value;

[0176] The second determination module 303 is used to determine the background noise information of the audio signal according to the difference between the amplitude value of different frequency components and the reference value; the background noise information is used to reflect the background noise processing capability of the target audio device.

[0177] In some embodiments, the first acquisition module 301 is specifically used to:

[0178] Convert the audio signal from the time domain to the frequency domain to generate second frequency domain information;

[0179] Retaining the frequency domain information of the first frequency band in the second frequency domain information through the first filter to obtain the third frequency domain information;

[0180] The first frequency domain information is obtained by retaining the frequency domain information of the second frequency band in the third frequency domain information through the second filter; the second frequency band is a sub-frequency band of the first frequency band.

[0181] In some embodiments, the first acquisition module 301 specifically further includes:

[0182] Framing the audio signal in the time domain to obtain a plurality of audio frames;

[0183] Performing a window function on the audio frame;

[0184] The audio frame after executing the window function is converted into the frequency domain to generate second frequency domain information.

[0185] In some embodiments, the first determining module 302 is specifically configured to:

[0186] Determine confidence level;

[0187] Taking the confidence level as probability, performing interval estimation on the amplitude value in the first frequency domain information to determine the amplitude value range;

[0188] Determining the amplitude value range as the confidence interval;

[0189] Based on the confidence interval, the reference value is determined.

[0190] In some embodiments, the background noise information at least includes:

[0191] Noise floor decibel value, and / or noise floor frequency range.

[0192] In some embodiments, the second determining module 303 is specifically configured to:

[0193] Determine the difference between the amplitude values ​​of different frequency components in the first frequency domain information and the reference value;

[0194] When the difference exceeds a preset threshold, determining the difference as the noise floor decibel value in the audio signal;

[0195] and / or,

[0196] When the difference exceeds a preset threshold, a frequency component corresponding to the amplitude value corresponding to the difference is determined as the background noise frequency interval.

[0197] Regarding the device in the above embodiment, the specific manner in which each module performs operations has been described in detail in the embodiment of the method, and will not be elaborated here.

[0198] In an exemplary embodiment, the first acquisition module 301, the first determination module 302, the second determination module 303, etc. can be implemented by one or more central processing units (CPU), graphics processing units (GPU), baseband processors (BP), application specific integrated circuits (ASIC), DSPs, programmable logic devices (PLD), complex programmable logic devices (CPLD), field programmable gate arrays (FPGA), general-purpose processors, controllers, microcontrollers (MCU), microprocessors, or other electronic components to execute the aforementioned method.

[0199] Fig.124 is a block diagram of an audio processing device 400 according to an exemplary embodiment. For example, the device 400 may be a mobile phone, a computer, a digital broadcast terminal, a messaging device, a game console, a tablet device, a medical device, a fitness device, a personal digital assistant, etc.

[0200] Reference Fig.12 , the device 400 may include one or more of the following components: a processing component 402 , a memory 404 , a power component 406 , a multimedia component 408 , an audio component 410 , an input / output (I / O) interface 412 , a sensor component 414 , and a communication component 416 .

[0201] The processing component 402 generally controls the overall operation of the device 400, such as operations associated with display, phone calls, data communications, camera operations, and recording operations. The processing component 402 may include one or more processors 420 to execute instructions to complete all or part of the steps of the above-mentioned method. In addition, the processing component 402 may include one or more modules to facilitate the interaction between the processing component 402 and other components. For example, the processing component 402 may include a multimedia module to facilitate the interaction between the multimedia component 408 and the processing component 402.

[0202] The memory 404 is configured to store various types of data to support operations on the device 400. Examples of such data include instructions for any application or method operating on the device 400, contact data, phone book data, messages, pictures, videos, etc. The memory 404 can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic disk or optical disk.

[0203] The power supply component 406 provides power to the various components of the device 400. The power supply component 806 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power for the device 400.

[0204] The multimedia component 408 includes a screen that provides an output interface between the device 400 and the user. In some embodiments, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive input signals from the user. The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor may not only sense the boundaries of the touch or slide action, but also detect the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia component 408 includes a front camera and / or a rear camera. When the device 400 is in an operating mode, such as a shooting mode or a video mode, the front camera and / or the rear camera may receive external multimedia data. Each front camera and rear camera may be a fixed optical lens system or have a focal length and optical zoom capability.

[0205] The audio component 410 is configured to output and / or input audio signals. For example, the audio component 410 includes a microphone (MIC), and when the device 400 is in an operating mode, such as a call mode, a recording mode, and a speech recognition mode, the microphone is configured to receive an external audio signal. The received audio signal can be further stored in the memory 404 or sent via the communication component 416. In some embodiments, the audio component 410 also includes a speaker for outputting audio signals.

[0206] I / O interface 412 provides an interface between processing component 402 and peripheral interface modules, such as keyboards, click wheels, buttons, etc. These buttons may include but are not limited to: a home button, a volume button, a start button, and a lock button.

[0207] The sensor assembly 414 includes one or more sensors for providing various aspects of the status assessment of the device 400. For example, the sensor assembly 414 can detect the open / closed state of the device 400, the relative positioning of components, such as the display and keypad of the device 400, and the sensor assembly 414 can also detect the position change of the device 400 or a component of the device 400, the presence or absence of user contact with the device 400, the orientation or acceleration / deceleration of the device 400, and the temperature change of the device 400. The sensor assembly 414 may include a proximity sensor configured to detect the presence of a nearby object without any physical contact. The sensor assembly 414 may also include an optical sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 414 may also include an accelerometer, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.

[0208] The communication component 416 is configured to facilitate wired or wireless communication between the device 400 and other devices. The device 400 can access a wireless network based on a communication standard, such as WiFi, 2G or 3G, or a combination thereof. In an exemplary embodiment, the communication component 416 receives a broadcast signal or broadcast-related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 416 also includes a near field communication (NFC) module to facilitate short-range communication. For example, the NFC module can be implemented based on radio frequency identification (RFID) technology, infrared data association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology and other technologies.

[0209] In an exemplary embodiment, the apparatus 400 may be implemented by one or more application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), controllers, microcontrollers, microprocessors, or other electronic components to perform the above method.

[0210] In an exemplary embodiment, a non-transitory computer-readable storage medium including instructions is also provided, such as a memory 404 including instructions, and the instructions can be executed by a processor 420 of the device 400 to perform the above method. For example, the non-transitory computer-readable storage medium can be a ROM, a random access memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, etc.

[0211] After the instructions are executed by the processor, the following operations can be performed:

[0212] Based on the collected audio signal of the target audio device, the first frequency domain information of the audio signal is obtained by converting the audio signal into the frequency domain; wherein the first frequency domain information includes: amplitude values ​​of different frequency components of the audio signal;

[0213] Determining a reference value according to the amplitude value;

[0214] The noise floor information of the audio signal is determined according to the difference between the amplitude value of different frequency components and the reference value; the noise floor information is used to reflect the noise floor processing capability of the target audio device.

[0215] It can be understood that the step of converting the acquired audio signal of the target audio device into the frequency domain to obtain the first frequency domain information of the audio signal includes:

[0216] Convert the audio signal from the time domain to the frequency domain to generate second frequency domain information;

[0217] Retaining the frequency domain information of the first frequency band in the second frequency domain information through the first filter to obtain the third frequency domain information;

[0218] The first frequency domain information is obtained by retaining the frequency domain information of the second frequency band in the third frequency domain information through the second filter; the second frequency band is a sub-frequency band of the first frequency band.

[0219] It can be understood that converting the audio signal from the time domain to the frequency domain to generate the second frequency domain information includes:

[0220] Framing the audio signal in the time domain to obtain a plurality of audio frames;

[0221] Performing a window function on the audio frame;

[0222] The audio frame after executing the window function is converted into the frequency domain to generate second frequency domain information.

[0223] It can be understood that determining the reference value according to the amplitude value includes:

[0224] Determine confidence level;

[0225] Taking the confidence level as probability, performing interval estimation on the amplitude value in the first frequency domain information to determine the amplitude value range;

[0226] Determining the amplitude value range as the confidence interval;

[0227] Based on the confidence interval, the reference value is determined.

[0228] It can be understood that the background noise information at least includes:

[0229] Noise floor decibel value, and / or noise floor frequency range.

[0230] It can be understood that determining the background noise information of the audio signal according to the difference between the amplitude value of different frequency components and the reference value includes:

[0231] Determine the difference between the amplitude values ​​of different frequency components in the first frequency domain information and the reference value;

[0232] When the difference exceeds a preset threshold, determining the difference as the noise floor decibel value in the audio signal;

[0233] and / or,

[0234] When the difference exceeds a preset threshold, a frequency component corresponding to the amplitude value corresponding to the difference is determined as the background noise frequency interval.

[0235] Those skilled in the art will readily appreciate other embodiments of the present invention after considering the specification and practicing the invention disclosed herein. This application is intended to cover any variations, uses or adaptations of the present invention that follow the general principles of the present invention and include common knowledge or customary techniques in the art that are not disclosed by the present invention. The specification and examples are to be considered exemplary only, and the true scope and spirit of the present invention are indicated by the claims.

[0236] It should be understood that the present invention is not limited to the exact construction that has been described above and shown in the drawings and that various modifications and changes may be made without departing from the scope thereof. The scope of the present invention is limited only by the appended claims.

Claims

1. An audio processing method, characterized in that: include: Based on the collected audio signal of the target audio device, the first frequency domain information of the audio signal is obtained by converting the audio signal into the frequency domain; wherein the first frequency domain information includes: amplitude values ​​of different frequency components of the audio signal; Determining a reference value according to the amplitude value; The noise floor information of the audio signal is determined according to the difference between the amplitude value of different frequency components and the reference value; the noise floor information is used to reflect the noise floor processing capability of the target audio device.

2. The method according to claim 1, characterized in that The step of converting the collected audio signal of the target audio device into the frequency domain to obtain first frequency domain information of the audio signal includes: Convert the audio signal from the time domain to the frequency domain to generate second frequency domain information; Retaining the frequency domain information of the first frequency band in the second frequency domain information through the first filter to obtain the third frequency domain information; The first frequency domain information is obtained by retaining the frequency domain information of the second frequency band in the third frequency domain information through the second filter; the second frequency band is a sub-frequency band of the first frequency band.

3. The method according to claim 2, characterized in that The converting the audio signal from the time domain to the frequency domain to generate second frequency domain information includes: Framing the audio signal in the time domain to obtain a plurality of audio frames; Performing a window function on the audio frame; The audio frame after executing the window function is converted into the frequency domain to generate second frequency domain information.

4. The method according to any one of claims 1 to 3, characterized in that: Determining a reference value according to the amplitude value includes: Determine confidence level; Taking the confidence level as probability, performing interval estimation on the amplitude value in the first frequency domain information to determine the amplitude value range; Determining the amplitude value range as the confidence interval; Based on the confidence interval, the reference value is determined.

5. The method according to claim 1, characterized in that The background noise information at least includes: Noise floor decibel value, and / or noise floor frequency range.

6. The method according to claim 5, characterized in that The determining the background noise information of the audio signal according to the difference between the amplitude value of the different frequency components and the reference value comprises: Determine the difference between the amplitude values ​​of different frequency components in the first frequency domain information and the reference value; When the difference exceeds a preset threshold, determining the difference as the noise floor decibel value in the audio signal; and / or, When the difference exceeds a preset threshold, a frequency component corresponding to the amplitude value corresponding to the difference is determined as the background noise frequency interval.

7. An audio processing device, characterized in that: The device comprises: A first acquisition module is used to convert the collected audio signal of the target audio device into the frequency domain to obtain first frequency domain information of the audio signal; wherein the first frequency domain information includes: amplitude values ​​of different frequency components of the audio signal; A first determining module, used to determine a reference value according to the amplitude value; The second determination module is used to determine the background noise information of the audio signal according to the difference between the amplitude value of different frequency components and the reference value; the background noise information is used to reflect the background noise processing capability of the target audio device.

8. The device according to claim 7, characterized in that The first acquisition module is specifically used for: Convert the audio signal from the time domain to the frequency domain to generate second frequency domain information; Retaining the frequency domain information of the first frequency band in the second frequency domain information through the first filter to obtain the third frequency domain information; The first frequency domain information is obtained by retaining the frequency domain information of the second frequency band in the third frequency domain information through the second filter; the second frequency band is a sub-frequency band of the first frequency band.

9. The device according to claim 8, characterized in that The first acquisition module is further specifically used for: Framing the audio signal in the time domain to obtain a plurality of audio frames; Performing a window function on the audio frame; The audio frame after executing the window function is converted into the frequency domain to generate second frequency domain information.

10. The device according to any one of claims 7 to 9, characterized in that The first determining module is specifically configured to: Determine confidence level; Taking the confidence level as probability, performing interval estimation on the amplitude value in the first frequency domain information to determine the amplitude value range; Determining the amplitude value range as the confidence interval; Based on the confidence interval, the reference value is determined.

11. The device according to claim 7, characterized in that The background noise information at least includes: Noise floor decibel value, and / or noise floor frequency range.

12. The device according to claim 11, characterized in that The second determining module is specifically used for: Determine the difference between the amplitude values ​​of different frequency components in the first frequency domain information and the reference value; When the difference exceeds a preset threshold, determining the difference as the noise floor decibel value in the audio signal; and / or, When the difference exceeds a preset threshold, a frequency component corresponding to the amplitude value corresponding to the difference is determined as the background noise frequency interval.

13. An electronic device, characterized in that: include: a memory for storing processor-executable instructions; A processor connected to the memory; The processor is configured to execute the audio processing method provided in any one of claims 1 to 6.

14. A non-transitory computer-readable storage medium, characterized in that: When the instructions in the storage medium are executed by a processor of a computer, the computer is enabled to perform the audio processing method according to any one of claims 1 to 6.

Images