Headphone noise reduction method, device, electronic device and readable storage medium
By setting multiple feedforward pickup paths in the headset and using detection and identification models, the problem of difficulty in processing non-steady state noise signals is solved, improving the noise reduction effect and user experience of the headset.
Patent Information
- Application Number
- CN202210301776.1
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2022-03-25
- Publication Date
- 2024-11-22
- Estimated Expiration
- 2042-03-25
AI Technical Summary
When existing headphones process non-steady-state noise signals, it is difficult to accurately capture signal characteristics, affecting the noise reduction effect.
By setting multiple feedforward pickup paths, we can detect whether there is a non-steady state noise signal in the initial sound signal, and select an appropriate feedforward pickup signal based on the non-steady state noise amplitude for headphone noise reduction, and use the preset signal amplitude to detect models and features Identify the model to extract and identify non-steady state noise signals.
It improves the noise reduction effect of the headphones in non-steady state noise environments, avoids the non-steady state noise pickup path with a large amplitude, and improves the user's auditory experience.
Smart Images

Figure CN114615586B_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of sound processing technology, and in particular to a headphone noise reduction method, device, electronic device and readable storage medium. Background Art
[0002] Currently, when performing headphone noise reduction, accurate noise reduction can be performed through feedforward microphones and feedback microphones. The feedforward microphone collects external environmental noise and reversely cancels it, while the feedback microphone detects residual noise in the ear canal and suppresses it through feedback. The specific principle is: based on the amplitude or phase information of the noise signal picked up by the MIC, the corresponding signal filter processing is performed. However, when the noise signal is a non-steady-state noise signal, the feedforward microphone usually cannot accurately capture the signal characteristics of the non-steady-state noise signal, which will affect the noise reduction effect of the headphone. Summary of the invention
[0003] The main purpose of the present application is to provide a headphone noise reduction method, device, electronic device and readable storage medium, aiming to solve the technical problem of poor headphone noise reduction effect in the prior art.
[0004] To achieve the above object, the present application provides a headphone noise reduction method, wherein the headphone is provided with multiple feedforward pickup paths, and the headphone noise reduction method comprises:
[0005] Acquire the initial sound signal picked up by each of the feedforward picking paths, and detect whether there is a non-steady-state noise signal in each of the initial sound signals;
[0006] If a non-steady-state noise signal exists, detecting the non-steady-state noise amplitude corresponding to each of the initial sound signals;
[0007] Selecting a feedforward pickup signal from each of the initial sound signals according to the amplitude of each of the non-steady-state noises;
[0008] Headphone noise reduction is performed according to the feedforward pickup signal.
[0009] Optionally, the step of selecting a feedforward pickup signal from each of the initial sound signals according to each of the non-steady-state noise amplitudes comprises:
[0010] If the amplitudes of the non-steady-state noises are all greater than the preset noise amplitude threshold, determining a first target amplitude with the smallest amplitude among the amplitudes of the non-steady-state noises;
[0011] using the initial sound signal corresponding to the first target amplitude as the feedforward pickup signal;
[0012] If the amplitudes of the non-steady-state noises are not all greater than the preset noise amplitude threshold, determining second target amplitudes smaller than the preset noise amplitude threshold among the amplitudes of the non-steady-state noises;
[0013] The feedforward pickup signal is selected from the initial sound signals corresponding to the second target amplitudes.
[0014] Optionally, the step of detecting the amplitude of the non-steady-state noise corresponding to each of the initial sound signals comprises:
[0015] Respectively extracting audio features corresponding to each of the initial sound signals;
[0016] The non-steady-state noise amplitude corresponding to each of the initial sound signals is detected by inputting each of the audio features into a preset signal amplitude detection model.
[0017] Optionally, the preset signal amplitude detection model includes a first feature extractor,
[0018] The step of detecting the amplitude of the non-steady-state noise corresponding to each of the initial sound signals by inputting each of the audio features into a preset signal amplitude detection model comprises:
[0019] Extracting a non-steady-state noise amplitude feature from the audio feature by inputting the audio feature into the first feature extractor;
[0020] The corresponding non-steady-state noise amplitude is determined according to the non-steady-state noise amplitude characteristic.
[0021] Optionally, the step of detecting whether a non-steady-state noise signal exists in each of the initial sound signals comprises:
[0022] According to a preset noise feature recognition model, feature recognition is performed on the audio features of each of the initial sound signals to obtain feature recognition results corresponding to each of the initial sound signals;
[0023] According to each of the feature recognition results, it is determined whether the non-steady-state noise signal exists in each of the initial sound signals.
[0024] Optionally, the preset noise feature recognition model includes a second feature extractor, and the feature recognition result includes a feature category label.
[0025] The step of performing feature recognition on the audio features of each of the initial sound signals according to the preset noise feature recognition model to obtain feature recognition results corresponding to each of the initial sound signals comprises:
[0026] Extracting non-steady-state noise features from the audio features by inputting the audio features into the second feature extractor;
[0027] The non-stationary noise feature is classified to obtain the feature category label.
[0028] Optionally, the step of performing headphone noise reduction according to the feedforward pickup signal includes:
[0029] Picking up the feedback signal through a feedback pickup path of the earphone;
[0030] generating a corresponding feedforward anti-phase noise signal according to the feedforward pickup signal, and generating a corresponding feedback anti-phase noise signal according to the feedback signal;
[0031] Headphone noise reduction is performed according to the feedforward anti-phase noise signal and the feedback anti-phase noise signal.
[0032] To achieve the above object, the present application further provides an earphone noise reduction device, wherein the earphone is provided with a plurality of feedforward pickup paths, and the earphone noise reduction device comprises:
[0033] A first detection module is used to obtain initial sound signals picked up by different feedforward pickup paths of the earphone, and detect whether there is a non-steady-state noise signal in each of the initial sound signals;
[0034] A second detection module, configured to detect the amplitude of the non-steady-state noise corresponding to each of the initial sound signals if a non-steady-state noise signal exists;
[0035] A selection module, used for selecting a feedforward pickup signal from each of the initial sound signals according to the amplitude of each of the non-steady-state noises;
[0036] The noise reduction module is used to perform headphone noise reduction according to the feedforward pickup signal.
[0037] Optionally, the selection module is further used for:
[0038] If the amplitudes of the non-steady-state noises are all greater than the preset noise amplitude threshold, determining a first target amplitude with the smallest amplitude among the amplitudes of the non-steady-state noises;
[0039] using the initial sound signal corresponding to the first target amplitude as the feedforward pickup signal;
[0040] If the amplitudes of the non-steady-state noises are not all greater than the preset noise amplitude threshold, determining second target amplitudes smaller than the preset noise amplitude threshold among the amplitudes of the non-steady-state noises;
[0041] The feedforward pickup signal is selected from the initial sound signals corresponding to the second target amplitudes.
[0042] Optionally, the first detection module is further used for:
[0043] Respectively extracting audio features corresponding to each of the initial sound signals;
[0044] The non-steady-state noise amplitude corresponding to each of the initial sound signals is detected by inputting each of the audio features into a preset signal amplitude detection model.
[0045] Optionally, the preset signal amplitude detection model includes a first feature extractor, and the first detection module is further used for:
[0046] Extracting a non-steady-state noise amplitude feature from the audio feature by inputting the audio feature into the first feature extractor;
[0047] The corresponding non-steady-state noise amplitude is determined according to the non-steady-state noise amplitude characteristic.
[0048] Optionally, the second detection module is further used for:
[0049] According to a preset noise feature recognition model, feature recognition is performed on the audio features of each of the initial sound signals to obtain feature recognition results corresponding to each of the initial sound signals;
[0050] According to each of the feature recognition results, it is determined whether the non-steady-state noise signal exists in each of the initial sound signals.
[0051] Optionally, the preset noise feature recognition model includes a second feature extractor, and the second detection module is further used for:
[0052] Extracting non-steady-state noise features from the audio features by inputting the audio features into the second feature extractor;
[0053] The non-stationary noise feature is classified to obtain the feature category label.
[0054] Optionally, the noise reduction module is further used for:
[0055] Picking up the feedback signal through a feedback pickup path of the earphone;
[0056] generating a corresponding feedforward anti-phase noise signal according to the feedforward pickup signal, and generating a corresponding feedback anti-phase noise signal according to the feedback signal;
[0057] Headphone noise reduction is performed according to the feedforward anti-phase noise signal and the feedback anti-phase noise signal.
[0058] The present application also provides an electronic device, which is a physical device, and includes: a memory, a processor, and a program of the headphone noise reduction method stored in the memory and executable on the processor. When the program of the headphone noise reduction method is executed by the processor, the steps of the headphone noise reduction method as described above can be implemented.
[0059] The present application also provides a computer-readable storage medium, on which is stored a program for implementing the headphone noise reduction method. When the program for the headphone noise reduction method is executed by a processor, the steps of the headphone noise reduction method as described above are implemented.
[0060] The present application also provides a computer program product, including a computer program, which implements the steps of the headphone noise reduction method as described above when executed by a processor.
[0061] The present application provides a headphone noise reduction method, device, electronic device and readable storage medium, that is, obtaining initial sound signals picked up by different feedforward pickup paths of the headphone, detecting whether there is a non-steady-state noise signal in each of the initial sound signals; if so, selecting a feedforward pickup signal from each of the initial sound signals according to the non-steady-state noise amplitude corresponding to each of the initial sound signals; and performing headphone noise reduction according to the feedforward pickup signal. In the present application, multiple feedforward pickup paths are set for the headphones to pick up the initial sound signal. Therefore, when there is a non-steady-state noise signal in the external environment, the initial sound signal with a smaller noise amplitude can be selected from each initial sound signal as the feedforward pickup signal according to the amplitude of the non-steady-state noise signal carried in each initial sound signal, and the corresponding headphone noise reduction process is performed according to the signal characteristics of the feedforward pickup signal. In this way, it is possible to avoid picking up the feedforward pickup signal with a pickup path where there is a non-steady-state noise with a larger amplitude, and to achieve the purpose of headphone noise reduction with a feedforward pickup signal with a non-steady-state noise with a smaller amplitude, thereby improving the noise reduction effect of the headphone. BRIEF DESCRIPTION OF THE DRAWINGS
[0062] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present application and, together with the description, serve to explain the principles of the present application.
[0063] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, for ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative labor.
[0064] Figure 1 This is a flow chart of the first embodiment of the headphone noise reduction method of the present application;
[0065] Figure 2 This is a schematic diagram of the principle of noise reduction based on feedforward control and feedback control in the headphone noise reduction method of this application;
[0066] Figure 3 This is a flow chart of the second embodiment of the headphone noise reduction method of the present application;
[0067] Figure 4 Schematic diagram of the device structure of the hardware operating environment involved in the headphone noise reduction method in the embodiment of the present application.
[0068] The purpose, features and advantages of this application will be further described in conjunction with the embodiments and with reference to the accompanying drawings. DETAILED DESCRIPTION
[0069] In order to make the above-mentioned purposes, features and advantages of the present application more obvious and understandable, the technical solutions in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work belong to the scope of protection of this application.
[0070] Embodiment 1
[0071] The embodiment of the present application provides a headphone noise reduction method, which is applied to a VR device. In a first embodiment of the headphone noise reduction method of the present application, the headphone is provided with a plurality of feedforward pickup paths, and the headphone noise reduction method includes:
[0072] Step S10, acquiring the initial sound signal picked up by each of the feedforward picking paths, and detecting whether there is a non-steady-state noise signal in each of the initial sound signals;
[0073] Step S20, if there is a non-steady-state noise signal, detecting the non-steady-state noise amplitude corresponding to each of the initial sound signals;
[0074] Step S30, selecting a feedforward pickup signal from each of the initial sound signals according to the amplitude of each of the non-steady-state noises;
[0075] Step S40: performing headphone noise reduction according to the feedforward pickup signal.
[0076] In this embodiment, it should be noted that currently, a feedforward pickup path and a feedback pickup path are usually set on the headset. The feedforward pickup path can be a feedforward microphone, and the feedback pickup path can be a feedback microphone. The feedforward pickup path is used to pick up the external environmental noise, thereby performing reverse cancellation, and the feedback pickup path is used to pick up the residual noise inside the ear canal, thereby performing feedback suppression. However, in actual application scenarios, non-steady-state noise often exists. The non-steady-state noise is noise that does not have a steady-state feature. The steady-state feature can be an amplitude feature or a phase feature with a certain distribution law. As an example, the non-steady-state noise can be the wind in a wind noise scene, or it can be the noise generated by hair or nails scratching the headset. Therefore, the headset usually cannot effectively capture the signal characteristics of the non-steady-state noise within the detection time, so as to perform relatively accurate noise reduction in the active noise reduction mode or the transparent transmission mode, which affects the noise reduction effect of the headset. The feedforward pickup signal is a sound signal among the initial sound signals that has non-steady-state noise that does not affect the user's auditory experience, or it can be a sound signal among the initial sound signals that has non-steady-state noise that has the least impact on the user's auditory experience, wherein the user's auditory experience is related to the amplitude of the non-steady-state noise. When the amplitude of the non-steady-state noise is less than a preset noise amplitude threshold, it has almost no impact on the user's auditory experience. When the amplitude of the non-steady-state noise is not less than the preset noise amplitude threshold, the larger the amplitude of the non-steady-state noise, the worse the user's auditory experience.
[0077] As an example, step S10 to step S20 include: picking up initial sound signals in the external environment respectively through multiple feedforward microphones of the headset, and the multiple feedforward microphones are deployed at different preset positions of the headset; judging whether each of the initial sound signals is a non-steady-state noise signal according to a preset noise discrimination model, and detecting whether there is a non-steady-state noise signal in each of the initial sound signals, wherein the non-steady-state noise signal may be a sound signal carrying non-steady-state noise; if there is a non-steady-state noise signal in each of the initial sound signals, performing feature extraction on each of the initial sound signals to extract the non-steady-state noise amplitude in each of the initial sound signals; selecting the sound signal with the smallest non-steady-state noise amplitude in each of the initial sound signals as the feedforward pickup signal; generating a feedforward inverse noise signal corresponding to the feedforward pickup signal according to the current mode of the headset, and performing headphone noise reduction based on the feedforward inverse noise signal.
[0078] In addition, it should be noted that since non-steady-state noise is usually generated near the earphone, the amplitude of the non-steady-state noise picked up at different positions of the earphone will be different. For example, when the non-steady-state noise is the noise of hair scratching the earphone, the hair usually scratches the area above the ear handle of the earphone. Therefore, the amplitude of the non-steady-state noise picked up by the microphone arranged in the area above the ear handle is larger, while the amplitude of the non-steady-state noise picked up by the microphone arranged in the area below the ear handle is smaller. Therefore, in the embodiment of the present application, multiple feedforward microphones are arranged at different preset positions of the earphone as feedforward pickup paths. Therefore, when there is a non-steady-state noise signal, by detecting the non-steady-state noise amplitude of the initial sound signal picked up by each feedforward microphone, a feedforward pickup path with the smallest non-steady noise amplitude is selected from each feedforward microphone, thereby minimizing the influence of non-steady noise on the noise reduction of the earphone, thereby improving the noise reduction effect of the earphone.
[0079] The step of detecting the amplitude of the non-steady-state noise corresponding to each of the initial sound signals comprises:
[0080] Step S11, extracting audio features corresponding to each of the initial sound signals respectively;
[0081] Step S12, detecting the amplitude of the non-steady-state noise corresponding to each of the initial sound signals by inputting each of the audio features into a preset signal amplitude detection model.
[0082] As an example, step S11 to step S12 include: converting the initial sound signal from the time domain to the frequency domain to obtain a frequency domain sound signal; extracting features from the frequency domain sound signal to obtain audio features; inputting the audio features into a preset signal amplitude detection model, mapping the audio features to corresponding model output values, and using the model output values as the non-steady-state noise amplitude corresponding to the audio features. Among them, the preset signal amplitude detection model can be a logistic regression model, and the model output value can be a logistic regression value. The embodiment of the present application achieves the purpose of combining deep learning to detect the amplitude of non-steady-state noise in the sound signal, and can estimate the amplitude of non-steady-state noise in the sound signal.
[0083] As an example, the feature extraction of the frequency domain sound signal to obtain the audio feature includes: periodically sampling the frequency domain sound signal for a preset number of times within a preset frequency range and a preset frequency range to collect a preset number of frequency response values in the frequency domain sound signal to obtain the audio feature. For example, the preset frequency range and the preset frequency range can be set by the user. The preset frequency can be set to 20 to 1000 Hz, the preset frequency range can be set to one twelfth, the sampling period can be set to 100 ms, the preset number of periodic sampling is 32 times, and the preset number is 32*32. Each sampling will obtain a vector consisting of 32 frequency response values, a total of 32 vectors, and the 32 vectors will form a 32*32 matrix. The 32*32 matrix is the audio feature.
[0084] The preset signal amplitude detection model includes a first feature extractor, and the step of detecting the amplitude of the non-steady-state noise corresponding to each of the initial sound signals by inputting each of the audio features into the preset signal amplitude detection model includes:
[0085] Step S121, extracting a non-steady-state noise amplitude feature from the audio feature by inputting the audio feature into the first feature extractor;
[0086] Step S122: determining the corresponding non-steady-state noise amplitude according to the non-steady-state noise amplitude characteristic.
[0087] As an example, step S121 to step S122 include: inputting the audio feature into the first feature extractor for feature transformation to map the audio feature to a preset first feature dimension to obtain a non-steady noise amplitude feature, wherein the preset first feature dimension can be a preset matrix size or a preset vector length, and the non-steady noise amplitude feature can be a feature matrix of a preset size or a feature vector of a preset length; performing full connection on the non-steady noise amplitude feature to obtain a fully connected vector, and mapping the fully connected vector to the non-steady noise amplitude. The non-steady noise amplitude feature is a feature that characterizes the amplitude information of the non-steady noise in the audio feature, and the amplitude information can be the amplitude size or the distribution of the amplitude, etc.
[0088] As an example, step S122 also includes: determining a target amplitude feature having the highest similarity to the non-steady-state noise amplitude feature among the preset amplitude features by calculating the similarity between the non-steady-state noise amplitude feature and each preset amplitude feature; and determining the noise amplitude corresponding to the target amplitude feature as the non-steady-state noise amplitude according to the corresponding relationship between the preset amplitude feature and the amplitude size.
[0089] The step of detecting whether there is a non-steady-state noise signal in each of the initial sound signals comprises:
[0090] Step S21, performing feature recognition on the audio features of each of the initial sound signals according to a preset noise feature recognition model, and obtaining feature recognition results corresponding to each of the initial sound signals;
[0091] Step S22: determining whether the non-steady-state noise signal exists in each of the initial sound signals according to each of the feature recognition results.
[0092] As an example, step S21 to step S22 include: obtaining the audio features corresponding to the initial sound signal; by inputting the audio features into the preset noise feature recognition model, the audio features are classified into two categories to obtain feature two-category labels, and the feature two-category labels are used as feature recognition results; judging whether there is a preset two-category label in the feature two-category labels corresponding to each of the initial sound signals, if there is, it is determined that there is a non-steady-state noise signal in each of the initial sound signals; if not, it is determined that there is no non-steady-state noise signal in each of the initial sound signals. For example, the feature two-category label can be set to 1 or 0, 1 identifies the audio feature as a feature of a non-steady-state noise signal, and 0 identifies the audio feature as not a feature of a non-steady-state noise signal, so that the preset two-category label is set to 1, if there is 1 in each feature two-category label, it is determined that there is a non-steady-state noise signal in each of the initial sound signals, and if there is no 1 in each feature two-category label, it is determined that there is no non-steady-state noise signal in each of the initial sound signals. The embodiment of the present application achieves the purpose of combining deep learning to detect non-steady-state noise signals, and can accurately determine whether a sound signal is a non-steady-state noise signal.
[0093] The preset noise feature recognition model includes a second feature extractor, the feature recognition result includes a feature category label, and the step of performing feature recognition on the audio features of each of the initial sound signals according to the preset noise feature recognition model to obtain the feature recognition result corresponding to each of the initial sound signals includes:
[0094] Step S211, extracting a non-steady-state noise feature from the audio feature by inputting the audio feature into the second feature extractor;
[0095] Step S212: classify the non-stationary noise features to obtain the feature category labels.
[0096] In this embodiment, it should be noted that the non-stationary noise feature is a feature that characterizes non-stationary noise information in audio features, and the non-stationary noise information may be one or more of phase information, amplitude information, and frequency information.
[0097] As an example, steps S211 to S212 include: inputting the audio features into a second feature extractor for feature transformation to map the audio features to a preset second feature dimension to obtain a non-steady-state noise feature, wherein the preset second feature dimension can be a preset matrix size or a preset vector length, and the non-steady-state noise feature can be a feature matrix of a preset size or a feature vector of a preset length; inputting the non-steady-state noise feature into a classifier in the preset noise feature recognition model for classification to obtain the feature category label, wherein the feature category label can be a feature binary classification label.
[0098] The step of performing headphone noise reduction according to the feedforward pickup signal comprises:
[0099] Step S41, picking up the feedback signal through the feedback pickup path of the earphone;
[0100] Step S42, generating a corresponding feedforward anti-phase noise signal according to the feedforward pickup signal, and generating a corresponding feedback anti-phase noise signal according to the feedback signal;
[0101] Step S43: performing headphone noise reduction according to the feedforward inverted noise signal and the feedback inverted noise signal.
[0102] In this embodiment, it should be noted that in the active noise reduction mode or transparent transmission mode of the headset, the feedforward sound signal and the feedback sound signal can be picked up for noise reduction. Figure 2 , Figure 2 This is a schematic diagram of the principle of noise reduction based on feedforward control and feedback control in an embodiment of the present application, wherein the feedforward MIC is a feedforward microphone, the feedback MIC is a feedback microphone, the feedforward PCB is a feedforward control for generating a feedforward inverse noise electrical signal, and the feedback PCB is a feedback control for generating a feedback inverse noise electrical signal.
[0103] As an example, step S41 to step S43 include: picking up the feedback signal through the feedback pickup path of the earphone; generating a corresponding feedforward anti-phase noise signal according to the amplitude and phase information of the feedforward pickup signal; generating a corresponding feedback anti-phase noise signal according to the amplitude and phase information of the feedback signal; combining the feedforward anti-phase noise signal and the feedback anti-phase noise signal into an anti-phase noise signal, and performing earphone noise reduction based on the anti-phase noise signal.
[0104] The embodiment of the present application provides a headphone noise reduction method, that is, obtaining the initial sound signals picked up by different feedforward pickup paths of the headphone, detecting whether there is a non-steady-state noise signal in each of the initial sound signals; if there is, selecting the feedforward pickup signal in each of the initial sound signals according to the non-steady-state noise amplitude corresponding to each of the initial sound signals; and performing headphone noise reduction according to the feedforward pickup signal. In the embodiment of the present application, multiple feedforward pickup paths are set for the headphone to pick up the initial sound signal, so that when there is a non-steady-state noise signal in the external environment, the initial sound signal with a small noise amplitude can be selected from each of the initial sound signals according to the amplitude of the non-steady-state noise signal carried in each of the initial sound signals as the feedforward pickup signal, and the corresponding headphone noise reduction process is performed according to the signal characteristics of the feedforward pickup signal, so that the feedforward pickup signal can be avoided from being picked up by the pickup path with a large amplitude of non-steady-state noise, and the feedforward pickup signal can be picked up by the pickup path with a small amplitude of non-steady-state noise, thereby achieving the purpose of performing headphone noise reduction with the feedforward pickup signal with a small amplitude of non-steady-state noise amplitude, thereby improving the effect of headphone noise reduction.
[0105] Embodiment 2
[0106] Further, refer to Figure 3 In another embodiment of the present application, the same or similar contents as those in the above-mentioned embodiment 1 can be referred to the above description and will not be described in detail later. On this basis, the step of selecting a feedforward pickup signal from each of the initial sound signals according to the amplitude of each of the non-steady-state noises includes:
[0107] Step S31, if the amplitudes of the non-steady-state noises are all greater than a preset noise amplitude threshold, determining a first target amplitude with the smallest amplitude among the amplitudes of the non-steady-state noises;
[0108] Step S32, using the initial sound signal corresponding to the first target amplitude as the feedforward pickup signal;
[0109] Step S33, if the amplitudes of the non-steady-state noises are not all greater than the preset noise amplitude threshold, determining second target amplitudes smaller than the preset noise amplitude threshold from among the amplitudes of the non-steady-state noises;
[0110] Step S34: selecting the feedforward pickup signal from the initial sound signals corresponding to the second target amplitudes.
[0111] In this embodiment, it should be noted that the preset noise amplitude threshold is a threshold set according to the user's headphone listening experience. When the noise amplitude is less than the preset noise amplitude threshold, the noise will not affect the user's headphone listening experience. When the noise amplitude is not less than the preset noise amplitude threshold, the noise will affect the user's headphone listening experience, and the greater the noise amplitude, the worse the user's headphone listening experience.
[0112] As an example, steps S31 to S35 include: comparing each of the non-steady noise amplitudes with a preset noise amplitude threshold, respectively, to determine whether each of the non-steady noise amplitudes is greater than the preset noise amplitude threshold; if each of the non-steady noise amplitudes is greater than the preset noise amplitude threshold, determining a first target amplitude with the smallest amplitude among each of the non-steady noise amplitudes, and using an initial sound signal corresponding to the first target amplitude as the feedforward pickup signal; if each of the non-steady noise amplitudes is not greater than the preset noise amplitude threshold, determining each second target amplitude less than the preset noise amplitude threshold among each of the non-steady noise amplitudes, wherein the non-steady noise in the initial sound signal corresponding to each second target amplitude does not affect the user's headphone listening experience; randomly selecting the feedforward pickup signal from the initial sound signal corresponding to each of the second target amplitudes, or selecting a sound signal with the smallest amplitude from the initial sound signal corresponding to each of the second target amplitudes as the feedforward pickup signal.
[0113] The embodiment of the present application provides a feedforward signal selection method based on multiple pickup paths, that is, if the amplitudes of the non-steady-state noises are all greater than the preset noise amplitude threshold, then a first target amplitude with the smallest amplitude is determined among the non-steady-state noise amplitudes; the initial sound signal corresponding to the first target amplitude is used as the feedforward pickup signal; if the amplitudes of the non-steady-state noises are not all greater than the preset noise amplitude threshold, then second target amplitudes less than the preset noise amplitude threshold are determined among the non-steady-state noise amplitudes; and the feedforward pickup signal is selected from the initial sound signals corresponding to the second target amplitudes. The purpose of selecting the feedforward pickup path with the smallest auditory experience for the user from multiple feedforward pickup paths is achieved, and the feedforward pickup signal can be picked up by avoiding the pickup path with non-steady-state noise with a large amplitude, laying a foundation for improving the noise reduction effect of the headphones.
[0114] Embodiment 3
[0115] The present application also provides an earphone noise reduction device, wherein the earphone is provided with a plurality of feedforward pickup paths, and the earphone noise reduction device comprises:
[0116] A first detection module is used to obtain initial sound signals picked up by different feedforward pickup paths of the earphone, and detect whether there is a non-steady-state noise signal in each of the initial sound signals;
[0117] A second detection module, configured to detect the amplitude of the non-steady-state noise corresponding to each of the initial sound signals if a non-steady-state noise signal exists;
[0118] A selection module, used for selecting a feedforward pickup signal from each of the initial sound signals according to the amplitude of each of the non-steady-state noises;
[0119] The noise reduction module is used to perform headphone noise reduction according to the feedforward pickup signal.
[0120] Optionally, the selection module is further used for:
[0121] If the amplitudes of the non-steady-state noises are all greater than the preset noise amplitude threshold, determining a first target amplitude with the smallest amplitude among the amplitudes of the non-steady-state noises;
[0122] using the initial sound signal corresponding to the first target amplitude as the feedforward pickup signal;
[0123] If the amplitudes of the non-steady-state noises are not all greater than the preset noise amplitude threshold, determining second target amplitudes smaller than the preset noise amplitude threshold among the amplitudes of the non-steady-state noises;
[0124] The feedforward pickup signal is selected from the initial sound signals corresponding to the second target amplitudes.
[0125] Optionally, the first detection module is further used for:
[0126] Respectively extracting audio features corresponding to each of the initial sound signals;
[0127] The non-steady-state noise amplitude corresponding to each of the initial sound signals is detected by inputting each of the audio features into a preset signal amplitude detection model.
[0128] Optionally, the preset signal amplitude detection model includes a first feature extractor, and the first detection module is further used for:
[0129] Extracting a non-steady-state noise amplitude feature from the audio feature by inputting the audio feature into the first feature extractor;
[0130] The corresponding non-steady-state noise amplitude is determined according to the non-steady-state noise amplitude characteristic.
[0131] Optionally, the second detection module is further used for:
[0132] According to a preset noise feature recognition model, feature recognition is performed on the audio features of each of the initial sound signals to obtain feature recognition results corresponding to each of the initial sound signals;
[0133] According to each of the feature recognition results, it is determined whether the non-steady-state noise signal exists in each of the initial sound signals.
[0134] Optionally, the preset noise feature recognition model includes a second feature extractor, and the second detection module is further used for:
[0135] Extracting non-steady-state noise features from the audio features by inputting the audio features into the second feature extractor;
[0136] The non-stationary noise features are classified to obtain the feature category labels.
[0137] Optionally, the noise reduction module is further used for:
[0138] Picking up the feedback signal through a feedback pickup path of the earphone;
[0139] generating a corresponding feedforward anti-phase noise signal according to the feedforward pickup signal, and generating a corresponding feedback anti-phase noise signal according to the feedback signal;
[0140] Headphone noise reduction is performed according to the feedforward anti-phase noise signal and the feedback anti-phase noise signal.
[0141] The headphone noise reduction device provided by the present application adopts the headphone noise reduction method in the above embodiment to solve the technical problem of poor headphone noise reduction effect. Compared with the prior art, the beneficial effects of the headphone noise reduction device provided by the embodiment of the present application are the same as the beneficial effects of the headphone noise reduction method provided by the above embodiment, and other technical features in the headphone noise reduction device are the same as the features disclosed in the above embodiment method, which will not be repeated here.
[0142] Embodiment 4
[0143] An embodiment of the present application provides an electronic device, which may be a VR device, and the electronic device includes: at least one processor; and a memory communicatively connected to the at least one processor; wherein the memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor so that the at least one processor can execute the headphone noise reduction method in the above-mentioned embodiment one.
[0144] Reference below Figure 4 , which shows a schematic diagram of the structure of an electronic device suitable for implementing the embodiments of the present disclosure. The electronic device in the embodiments of the present disclosure may include, but is not limited to, mobile terminals such as mobile phones, notebook computers, digital broadcast receivers, PDAs (personal digital assistants), PADs (tablet computers), PMPs (portable multimedia players), vehicle-mounted terminals (such as vehicle-mounted navigation terminals), etc., and fixed terminals such as digital TVs, desktop computers, etc. Figure 4The electronic device shown is only an example and should not bring any limitation to the functions and scope of use of the embodiments of the present disclosure.
[0145] like Figure 4 As shown, the electronic device may include a processing device (e.g., a central processing unit, a graphics processing unit, etc.), which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) or a program loaded from a storage device into a random access memory (RAM). In the RAM, various programs and data required for the operation of the electronic device are also stored. The processing device, ROM, and RAM are connected to each other via a bus. An input / output (I / O) interface is also connected to the bus.
[0146] Typically, the following systems can be connected to the I / O interface: input devices including, for example, a touch screen, a touchpad, a keyboard, a mouse, an image sensor, a microphone, an accelerometer, a gyroscope, etc.; output devices including, for example, a liquid crystal display (LCD), a speaker, a vibrator, etc.; storage devices including, for example, a magnetic tape, a hard disk, etc.; and communication devices. The communication device can allow the electronic device to communicate with other devices wirelessly or by wire to exchange data. Although the figure shows an electronic device with various systems, it should be understood that it is not required to implement or have all the systems shown. More or fewer systems may be implemented or have alternatively.
[0147] In particular, according to an embodiment of the present disclosure, the process described above with reference to the flowchart can be implemented as a computer software program. For example, an embodiment of the present disclosure includes a computer program product, which includes a computer program carried on a computer-readable medium, and the computer program contains a program code for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from a network through a communication device, or installed from a storage device, or installed from a ROM. When the computer program is executed by a processing device, the above-mentioned functions defined in the method of the embodiment of the present disclosure are executed.
[0148] The electronic device provided by the present application adopts the headphone noise reduction method in the above embodiment to solve the technical problem of poor headphone noise reduction effect. Compared with the prior art, the beneficial effects of the electronic device provided by the embodiment of the present application are the same as the beneficial effects of the headphone noise reduction method provided by the above embodiment, and other technical features in the electronic device are the same as the features disclosed in the above embodiment method, which will not be repeated here.
[0149] It should be understood that the various parts of the present disclosure can be implemented with hardware, software, firmware or a combination thereof. In the description of the above embodiments, specific features, structures, materials or characteristics can be combined in any one or more embodiments or examples in a suitable manner.
[0150] The above is only a specific implementation of the present application, but the protection scope of the present application is not limited thereto. Any person skilled in the art who is familiar with the present technical field can easily think of changes or substitutions within the technical scope disclosed in the present application, which should be included in the protection scope of the present application. Therefore, the protection scope of the present application should be based on the protection scope of the claims.
[0151] Embodiment 5
[0152] This embodiment provides a computer-readable storage medium having computer-readable program instructions stored thereon, and the computer-readable program instructions are used to execute the headphone noise reduction method in the above-mentioned embodiment 1.
[0153] The computer-readable storage medium provided in the embodiment of the present application can be, for example, a USB flash drive, but is not limited to electrical, magnetic, optical, electromagnetic, infrared, or semiconductor systems, systems or devices, or any combination of the above. More specific examples of computer-readable storage media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In the present embodiment, the computer-readable storage medium can be any tangible medium containing or storing a program, which can be used by an instruction execution system, a system or a device or used in combination with it. The program code contained on the computer-readable storage medium can be transmitted with any appropriate medium, including but not limited to: wires, optical cables, RF (radio frequency), etc., or any suitable combination of the above.
[0154] The computer-readable storage medium may be included in the electronic device, or may exist independently without being installed in the electronic device.
[0155] The above-mentioned computer-readable storage medium carries one or more programs. When the above-mentioned one or more programs are executed by an electronic device, the electronic device: obtains the initial sound signal picked up by each of the feedforward pickup paths, and detects whether there is a non-steady-state noise signal in each of the initial sound signals; if a non-steady-state noise signal exists, detects the non-steady-state noise amplitude corresponding to each of the initial sound signals; selects a feedforward pickup signal from each of the initial sound signals according to each of the non-steady-state noise amplitudes; and performs headphone noise reduction according to the feedforward pickup signal.
[0156] Computer program code for performing the operations of the present disclosure may be written in one or more programming languages, or a combination thereof, including object-oriented programming languages, such as Java, Smalltalk, C++, and conventional procedural programming languages, such as "C" or similar programming languages. The program code may be executed entirely on the user's computer, partially on the user's computer, as a separate software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving a remote computer, the remote computer may be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., through the Internet using an Internet service provider).
[0157] The flow chart and block diagram in the accompanying drawings illustrate the possible architecture, function and operation of the system, method and computer program product according to various embodiments of the present application. In this regard, each square box in the flow chart or block diagram can represent a module, a program segment or a part of a code, and the module, the program segment or a part of the code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the square box can also occur in a sequence different from that marked in the accompanying drawings. For example, two square boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each square box in the block diagram and / or flow chart, and the combination of the square boxes in the block diagram and / or flow chart can be implemented with a dedicated hardware-based system that performs a specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.
[0158] The modules involved in the embodiments described in the present disclosure may be implemented by software or hardware, wherein the name of the module does not limit the unit itself in some cases.
[0159] The computer-readable storage medium provided by the present application stores computer-readable program instructions for executing the above-mentioned headphone noise reduction method, which solves the technical problem of poor headphone noise reduction effect. Compared with the prior art, the beneficial effects of the computer-readable storage medium provided by the embodiment of the present application are the same as the beneficial effects of the headphone noise reduction method provided by the above-mentioned embodiment, and will not be repeated here.
[0160] Embodiment 6
[0161] The present application also provides a computer program product, including a computer program, which implements the steps of the headphone noise reduction method as described above when executed by a processor.
[0162] The computer program product provided by the present application solves the technical problem of poor noise reduction effect of headphones. Compared with the prior art, the beneficial effects of the computer program product provided by the embodiment of the present application are the same as the beneficial effects of the headphone noise reduction method provided by the above embodiment, which will not be repeated here.
[0163] The above are only preferred embodiments of the present application, and are not intended to limit the patent scope of the present application. Any equivalent structure or equivalent process transformation made using the contents of the present application specification and drawings, or directly or indirectly applied in other related technical fields, are also included in the patent processing scope of the present application.
Claims
1. A method for reducing noise in headphones, characterized in that: The earphone is provided with a plurality of feedforward pickup paths, wherein the plurality of feedforward pickup paths are a plurality of feedforward microphones arranged at different preset positions of the earphone, and the earphone noise reduction method comprises: Acquire the initial sound signal picked up by each of the feedforward picking paths, and detect whether there is a non-steady-state noise signal in each of the initial sound signals; If a non-steady-state noise signal exists, detecting the non-steady-state noise amplitude corresponding to each of the initial sound signals; Selecting a feedforward pickup signal from each of the initial sound signals according to the amplitude of each of the non-steady-state noises; Performing headphone noise reduction according to the feedforward pickup signal; The step of performing headphone noise reduction according to the feedforward pickup signal comprises: Picking up a feedback signal through a feedback pickup path of the earphone; Generate a corresponding feedforward anti-phase noise signal according to the amplitude and phase information of the feedforward pickup signal; Generate a corresponding feedback anti-phase noise signal according to the amplitude and phase information of the feedback signal; The feedforward inverted noise signal and the feedback inverted noise signal are combined into an inverted noise signal, and headphone noise reduction is performed according to the inverted noise signal.
2. The headphone noise reduction method according to claim 1, characterized in that: The step of selecting a feedforward pickup signal from each of the initial sound signals according to the amplitude of each of the non-steady-state noises comprises: If the amplitudes of the non-steady-state noises are all greater than the preset noise amplitude threshold, determining a first target amplitude with the smallest amplitude among the amplitudes of the non-steady-state noises; using the initial sound signal corresponding to the first target amplitude as the feedforward pickup signal; If the amplitudes of the non-steady-state noises are not all greater than the preset noise amplitude threshold, determining second target amplitudes smaller than the preset noise amplitude threshold among the amplitudes of the non-steady-state noises; The feedforward pickup signal is selected from the initial sound signals corresponding to the second target amplitudes.
3. The headphone noise reduction method according to claim 1, characterized in that: The step of detecting the amplitude of the non-steady-state noise corresponding to each of the initial sound signals comprises: Respectively extracting audio features corresponding to each of the initial sound signals; The non-steady-state noise amplitude corresponding to each of the initial sound signals is detected by inputting each of the audio features into a preset signal amplitude detection model.
4. The headphone noise reduction method according to claim 3, characterized in that: The preset signal amplitude detection model includes a first feature extractor, The step of detecting the amplitude of the non-steady-state noise corresponding to each of the initial sound signals by inputting each of the audio features into a preset signal amplitude detection model comprises: Extracting a non-steady-state noise amplitude feature from the audio feature by inputting the audio feature into the first feature extractor; The corresponding non-steady-state noise amplitude is determined according to the non-steady-state noise amplitude characteristic.
5. The headphone noise reduction method according to any one of claims 1 to 4, characterized in that: The step of detecting whether there is a non-steady-state noise signal in each of the initial sound signals comprises: According to a preset noise feature recognition model, feature recognition is performed on the audio features of each of the initial sound signals to obtain feature recognition results corresponding to each of the initial sound signals; According to each of the feature recognition results, it is determined whether the non-steady-state noise signal exists in each of the initial sound signals.
6. The headphone noise reduction method according to claim 5, characterized in that: The preset noise feature recognition model includes a second feature extractor, and the feature recognition result includes a feature category label. The step of performing feature recognition on the audio features of each of the initial sound signals according to the preset noise feature recognition model to obtain feature recognition results corresponding to each of the initial sound signals comprises: Extracting non-steady-state noise features from the audio features by inputting the audio features into the second feature extractor; The non-stationary noise feature is classified to obtain the feature category label.
7. A headphone noise reduction device, characterized in that: The earphone is provided with a plurality of feedforward pickup paths, wherein the plurality of feedforward pickup paths are a plurality of feedforward microphones arranged at different preset positions of the earphone, and the earphone noise reduction device comprises: A first detection module is used to obtain initial sound signals picked up by different feedforward pickup paths of the earphone, and detect whether there is a non-steady-state noise signal in each of the initial sound signals; A second detection module, configured to detect the amplitude of the non-steady-state noise corresponding to each of the initial sound signals if a non-steady-state noise signal exists; A selection module, used for selecting a feedforward pickup signal from each of the initial sound signals according to the amplitude of each of the non-steady-state noises; The noise reduction module is used to perform headphone noise reduction according to the feedforward pickup signal; pick up the feedback signal through the feedback pickup path of the headphone; generate a corresponding feedforward anti-phase noise signal according to the amplitude and phase information of the feedforward pickup signal; generate a corresponding feedback anti-phase noise signal according to the amplitude and phase information of the feedback signal; combine the feedforward anti-phase noise signal and the feedback anti-phase noise signal into an anti-phase noise signal, and perform headphone noise reduction according to the anti-phase noise signal.
8. An electronic device, characterized in that: The electronic device comprises: at least one processor; and, a memory communicatively connected to the at least one processor; wherein, The memory stores instructions that can be executed by the at least one processor, and the instructions are executed by the at least one processor to enable the at least one processor to perform the steps of the headphone noise reduction method according to any one of claims 1 to 6.
9. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a program for implementing the headphone noise reduction method, and the program for implementing the headphone noise reduction method is executed by a processor to implement the steps of the headphone noise reduction method according to any one of claims 1 to 6.
