A noise cancellation method, device, electronic equipment, earphone and storage medium

Abstract

Embodiments of the present application disclose a noise elimination method and device, electronic equipment, earphones and a storage medium. The method comprises: obtaining original sound source information; performing noise reduction processing on the original sound source information using ANC to obtain first sound information; and simultaneously performing noise reduction processing on the original sound source information using ENC to obtain second sound information; performing noise reduction processing on the original sound source information using ANC to obtain first sound information, comprising: performing noise phase inversion processing on the original sound source information through a phase inverter to obtain an inverted wave signal; performing noise cancellation on the original sound source information according to the inverted wave signal to obtain first sound information; mixing and adding the first sound information and the second sound information to obtain target sound information, and playing the target sound information. The method can perform ANC and ENC noise reduction processing on sound, distinguish environmental noise and human voice, improve noise elimination performance, and enable a user to hear clearer sound.

Description

Technical Field

[0001] This invention relates to the field of audio processing technology, and in particular to a noise cancellation method, apparatus, electronic device, headphones, and storage medium. Background Technology

[0002] In some headphone-related products, such as over-ear headphones, on-ear headphones, in-ear headphones, hearing aids, or hearing devices, the original sound signal usually contains noise. Directly transmitting the original sound signal to the user will cause interference.

[0003] In existing technologies, noise removal of the original sound signal is typically achieved through Active Noise Cancellation (ANC). However, noise removal using ANC alone cannot effectively distinguish between environmental and human voices, resulting in poor noise removal performance and the user still hearing a noisy sound. Summary of the Invention

[0004] This invention provides a noise cancellation method, apparatus, electronic device, headphones, and storage medium, which can improve noise cancellation performance and allow users to hear clearer sound.

[0005] According to one aspect of the present invention, a noise cancellation method is provided, the method comprising: acquiring original sound source information;

[0006] The original sound source information is processed by active noise cancellation (ANC) to obtain the first sound information; and at the same time, the original sound source information is processed by environmental noise cancellation (ENC) to obtain the second sound information.

[0007] The first sound information and the second sound information are mixed and added together to obtain the target sound information, and then the target sound information is played.

[0008] According to another aspect of the present invention, a noise cancellation device is provided, the device comprising:

[0009] The raw sound source information acquisition module is used to acquire raw sound source information;

[0010] The noise reduction processing module is used to perform noise reduction processing on the original sound source information using active noise cancellation (ANC) to obtain the first sound information; and at the same time, it performs noise reduction processing on the original sound source information using ambient noise cancellation (ENC) to obtain the second sound information.

[0011] The sound playback module is used to mix and add the first sound information and the second sound information to obtain the target sound information, and then play the target sound information.

[0012] According to another aspect of the present invention, an electronic device is provided, the electronic device comprising:

[0013] At least one processor; and

[0014] A memory that is communicatively connected to at least one processor; wherein,

[0015] The memory stores a computer program that can be executed by at least one processor, such that the at least one processor is able to perform the noise cancellation method of any embodiment of the present invention.

[0016] According to another aspect of the present invention, a noise-canceling headphone is provided, comprising: a microphone, a noise-canceling processor, and a speaker; wherein:

[0017] Microphone, used to acquire raw sound source information;

[0018] A noise reduction processor is used to perform noise reduction processing on the original sound source information using the method provided in any embodiment of the present invention to obtain target sound information;

[0019] A loudspeaker for playing target sound information using the method provided in any embodiment of the present invention.

[0020] According to another aspect of the present invention, a noise-canceling headphone is provided, comprising: a first microphone, a second microphone, a noise-canceling processor, and a speaker; wherein:

[0021] The first microphone is used to acquire information from the first sound source.

[0022] The second microphone is used to acquire information from the second sound source.

[0023] A noise reduction processor is used to perform active noise cancellation (ANC) noise reduction processing on the first sound source information based on the second sound source information to obtain the third sound information.

[0024] The noise reduction processor is used to take the first sound source information as the original sound source information and perform environmental noise cancellation (ENC) noise reduction processing using the method provided in any embodiment of the present invention to obtain the second sound information.

[0025] The noise reduction processor is also used to mix and add the third sound information with the second sound information to obtain the target sound information;

[0026] A loudspeaker for playing target sound information using the method provided in any embodiment of the present invention.

[0027] According to another aspect of the present invention, a computer-readable storage medium is provided, which stores computer instructions for causing a processor to execute and implement the noise cancellation method of any embodiment of the present invention.

[0028] The technical solution of this invention obtains the original sound source information; performs noise reduction processing on the original sound source information using ANC to obtain the first sound information; and simultaneously performs noise reduction processing on the original sound source information using ENC to obtain the second sound information; mixes and adds the first sound information and the second sound information to obtain the target sound information, and plays the target sound information. This solves the problem of noise cancellation. By performing ANC and ENC noise reduction processing on the sound, environmental noise and human voice can be distinguished, improving noise cancellation performance and allowing users to hear clearer sound.

[0029] It should be understood that the description in this section is not intended to identify key or essential features of the embodiments of the present invention, nor is it intended to limit the scope of the invention. Other features of the invention will become readily apparent from the following description. Attached Figure Description

[0030] To more clearly illustrate the technical solutions in the embodiments of the present invention, the accompanying drawings used in the description of the embodiments will be briefly introduced below. Obviously, the accompanying drawings described below are only some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0031] Figure 1a This is a flowchart of a noise cancellation method provided in Embodiment 1 of the present invention;

[0032] Figure 1b This is a flowchart of another noise cancellation method provided in Embodiment 1 of the present invention;

[0033] Figure 2a A flowchart of a noise cancellation method provided in Embodiment 2 of the present invention;

[0034] Figure 2b This is a flowchart of another noise cancellation method provided in Embodiment 2 of the present invention;

[0035] Figure 2c This is a schematic diagram illustrating an application scenario of a noise cancellation method provided in Embodiment 2 of the present invention;

[0036] Figure 3 This is a schematic diagram of the structure of a noise cancellation device according to Embodiment 3 of the present invention;

[0037] Figure 4This is a schematic diagram of the structure of a noise-canceling headphone according to Embodiment 4 of the present invention;

[0038] Figure 5 This is a schematic diagram of the structure of a noise-canceling headphone according to Embodiment 5 of the present invention;

[0039] Figure 6 This is a schematic diagram of the structure of an electronic device that implements the noise cancellation method of the present invention. Detailed Implementation

[0040] To enable those skilled in the art to better understand the present invention, the technical solutions of the present invention will be clearly and completely described below with reference to the accompanying drawings of the embodiments. Obviously, the described embodiments are only some embodiments of the present invention, and not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort should fall within the scope of protection of the present invention.

[0041] It should be noted that the terms "first," "second," "original," "target," etc., used in the specification, claims, and accompanying drawings of this invention are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It should be understood that such data can be interchanged where appropriate so that embodiments of the invention described herein can be implemented in orders other than those illustrated or described herein. Furthermore, the terms "comprising" and "having," and any variations thereof, are intended to cover non-exclusive inclusion; for example, a process, method, system, product, or apparatus that comprises a series of steps or units is not necessarily limited to those steps or units explicitly listed, but may include other steps or units not explicitly listed or inherent to such processes, methods, products, or apparatus.

[0042] Example 1

[0043] Figure 1a This is a flowchart of a noise cancellation method according to Embodiment 1 of the present invention. This embodiment is applicable to noise cancellation in headphone-related products. The method can be executed by a noise cancellation device, which can be implemented in hardware and / or software. The noise cancellation device can be configured in electronic devices such as headphones, computers, and mobile phones. Figure 1a As shown, the method includes:

[0044] Step 110: Obtain the original sound source information.

[0045] The original sound source information can include both environmental noise and human voices. Specifically, the original sound source information can be generated by collecting sounds from the surrounding environment using a microphone.

[0046] Specifically, in an optional embodiment of the present invention, obtaining the original sound source information includes: obtaining the sound signal of the original sound source through a microphone and converting the sound signal of the original sound source into an electrical signal of the original sound source; converting the electrical signal of the original sound source into a digital signal of the original sound source through an analog-to-digital converter and using the digital signal of the original sound source as the original sound source information.

[0047] In the original sound source, human voices and noise are mixed together and can be captured simultaneously by a microphone (such as an FFMIC). The microphone converts the sound signal into an electrical signal. The electrical signal can be converted into a digital signal by an analog-to-digital converter (ADC). The digital signal can be simultaneously allocated to ANC and Environmental Noise Cancellation (ENC) for processing, facilitating noise reduction of the sound.

[0048] Step 120: Perform noise reduction processing on the original sound source information using ANC to obtain the first sound information; and simultaneously perform noise reduction processing on the original sound source information using ENC to obtain the second sound information.

[0049] ANC (Average Noise Cancellation) can generate anti-noise with the same magnitude but opposite phase as the original noise by performing digital signal processing (DSP) on the original sound source information. This anti-noise then cancels out the original noise, achieving noise reduction. However, current ANC technologies do not distinguish between environmental noise and human voices, eliminating both indiscriminately, resulting in poor sound quality for the user.

[0050] ENC (Enhanced Noise Reduction) can process the original sound source information using an ENC chip, distinguishing between human voice and environmental noise, retaining only the human voice, and eliminating environmental noise. However, using ENC alone for DSP processing to achieve noise reduction requires a long computation time, such as 30-50 milliseconds. Due to the latency of ENC computation, users may easily perceive two sounds: the original sound source and the sound of the computation delay. Consequently, the user experience will be very poor.

[0051] In this embodiment of the invention, the original sound source information is simultaneously processed using both ANC and ENC for noise reduction. This reduces the processing time of ENC while still using ANC for noise reduction. Therefore, it avoids the problem of ANC alone failing to separate environmental noise from human voice, resulting in the simultaneous elimination of both. It also avoids the inefficiency of environmental noise cancellation when using ENC alone. Furthermore, when the user is near the source, it prevents external noise from penetrating to the user's ears due to the long processing time of ENC, thus avoiding the user perceiving two sounds. In summary, by simultaneously processing the original sound source information using ANC and ENC, a clearer signal processing and preservation of the complete human voice can be achieved, allowing the user to hear external human voices more clearly.

[0052] Step 130: Mix and add the first sound information and the second sound information to obtain the target sound information, and then play the target sound information.

[0053] The method in this embodiment of the invention can mix the sound information obtained by ANC and ENC processing to obtain a complete and clean human voice, which improves the problem of noisy sound when using the transparency mode of headphones, hearing aids or hearing devices in the prior art, enhances the ambient noise cancellation effect and enhances human voice, so that users can hear clearer external human voices.

[0054] Specifically, in an optional embodiment of the present invention, mixing and adding the first sound information and the second sound information to obtain the target sound information includes: converting the mixed and added sound information into a target electrical signal through a digital-to-analog converter, and converting the target electrical signal into a target sound signal through a speaker to obtain the target sound information.

[0055] The digital-to-analog converter (DAC) converts the signal obtained by mixing and adding the signals processed by ANC and ENC into an electrical signal. The electrical signal obtained by the DAC can then be transmitted to a speaker. The speaker can convert the electrical signal back into an audio signal and play it.

[0056] The technical solution of this embodiment obtains the original sound source information; performs noise reduction processing on the original sound source information using Active Noise Cancellation (ANC) to obtain the first sound information; and simultaneously performs noise reduction processing on the original sound source information using Environmental Noise Cancellation (ENC) to obtain the second sound information; mixes and adds the first sound information and the second sound information to obtain the target sound information, and plays the target sound information. This solves the noise cancellation problem. By performing ANC and ENC noise reduction processing on the sound, environmental noise and human voice can be distinguished, improving noise cancellation performance and allowing users to hear clearer sound.

[0057] Figure 1bThis is a flowchart of another noise cancellation method provided according to Embodiment 1 of the present invention. Figure 1b As shown, the microphone can pick up external signals. However, since human voices and environmental noise are indistinguishable, users will perceive the sound as noisy if they directly listen to the external signal. The technical solution of this invention combines the characteristics of ANC and ENC for voice signal processing. ANC reduces low-frequency noise, while ENC independently processes the speech frequency bands, preserving the human voice and reducing processing time. Specifically, ANC eliminates noise through inverted waves, while ENC removes both human voice and environmental noise. The signals processed by ANC and ENC can then be mixed together and played through a speaker, improving the noisy sound problem in the transparency mode of traditional headphones, enhancing environmental noise cancellation, and amplifying human voices, allowing users to hear clearer external voices. Even when using transparency mode, the reduced ENC processing time prevents users from perceiving two distinct sounds.

[0058] Example 2

[0059] Figure 2a According to the flowchart of a noise cancellation method provided in Embodiment 2 of the present invention, this embodiment is a further refinement of the above technical solution, and the technical solution in this embodiment can be combined with various optional solutions in one or more of the above embodiments. For example... Figure 2a As shown, the method includes:

[0060] Step 210: Obtain the original sound source information.

[0061] In an optional embodiment of the present invention, obtaining the original sound source information includes: obtaining the sound signal of the original sound source through a microphone and converting the sound signal of the original sound source into an electrical signal of the original sound source; converting the electrical signal of the original sound source into a digital signal of the original sound source through an analog-to-digital converter and using the digital signal of the original sound source as the original sound source information.

[0062] Step 220: The original sound source information is processed by a phase inverter to invert the noise phase and obtain an inverted wave signal.

[0063] In an optional embodiment of the present invention, before the original sound source information is processed by a phase inverter to invert the noise phase and obtain an inverted wave signal, the method further includes: performing low-pass filtering on the original sound source information to obtain the original sound source information of the first target frequency band.

[0064] The low-pass filter filters the original sound source information, selecting the first target frequency band where ANC noise reduction is most effective. Specifically, due to the physical limitations of sound wavelength and the delay between the out-of-phase wave and the ANC signal, it filters out high frequencies with poor noise reduction performance, avoiding the negative effect of high-frequency flipping during ANC processing. In other words, the first target frequency band can be a low-frequency band. Specifically, based on specific research, the first target frequency band can be set to a band ranging from 20 Hz to 4 kHz.

[0065] Although the higher the DSP processing speed of ANC is in the frequency band after 1 kHz, the higher the frequency that noise reduction can handle, considering the need to avoid the effect of high frequency reversal, that is, to avoid the original noise reduction becoming the increase of noise, the embodiments of the present invention use a low-pass filter to process only the original sound source information from 20 Hz to 4 kHz through ANC, which can avoid high frequency noise affecting the noise reduction quality.

[0066] Specifically, in an optional embodiment of the present invention, low-pass filtering is performed on the original sound source information to obtain the original sound source information of the first target frequency band, including: low-pass filtering the original sound source information through a double second-order filter to obtain the original sound source information of the first target frequency band.

[0067] Among them, a biquad filter is a filter whose transfer function has both numerator and denominator as second-order polynomials. Using a biquad filter can avoid the filter's sensitivity to coefficients and can be used alone to achieve better filtering results.

[0068] After obtaining the original sound source information for the first target frequency band through low-pass filtering, the filtered original sound source information can be phase-inverted using a phase inverter to obtain an inverted wave signal. Then, noise cancellation can be performed on the original sound source information based on the inverted wave signal to obtain the first sound information, thus achieving low-frequency noise reduction.

[0069] Step 230: Based on the inverted wave signal, noise cancellation is performed on the original sound source information to obtain the first sound information.

[0070] In an optional embodiment of the present invention, noise cancellation is performed on the original sound source information based on the anti-phase wave signal to obtain first sound information, including: adjusting the volume of the anti-phase wave signal by gain adjustment to obtain a target anti-phase wave signal with the same noise level as the original sound source information; and performing noise cancellation on the original sound source information based on the target anti-phase wave signal to obtain the first sound information.

[0071] After obtaining the inverted wave signal, the volume of the inverted wave signal can be adjusted using gain to bring it to a target inverted wave signal with the same level as the residual noise currently in the ear. This target inverted wave signal can directly cancel out the noise from the original sound source, thus achieving low-frequency noise reduction.

[0072] Step 240: Separate human voice from environmental noise using a software noise reduction algorithm, while retaining the human voice signal.

[0073] The software noise reduction (NR) algorithm can be an operation that preserves human voice while removing noise. However, based on the original sound source information in this embodiment of the invention, noise reduction can be performed using ANC, leaving minimal residual noise. Therefore, the NR operation can be appropriately reduced, i.e., the computational load can be decreased to increase the computational speed. Furthermore, filtering can be performed before NR to further reduce residual noise, thereby further reducing the intensity of the NR operation, lowering noise processing latency, and preventing the user from perceiving two voices. For example, by controlling the NR operation to complete within 0-30 milliseconds, the user can avoid perceiving two voices.

[0074] Specifically, in an optional embodiment of the present invention, before separating human voice from environmental noise and retaining human voice signal by using a software noise reduction algorithm on the original sound source information, the method further includes: performing bandpass filtering on the original sound source information to obtain the original sound source information of the second target frequency band.

[0075] Band-pass filtering involves filtering the original sound source information and selecting a second target frequency band corresponding to the human voice audio segment for ENC noise reduction. Filtering the original sound source information reduces the processing latency of ENC, thus reducing the computational load of NR. Specifically, based on specific research, the second target frequency band can be set to a band consisting of 100 Hz to 8 kHz. By selecting the original sound source information from this second target frequency band for processing, the difficulty of ENC adaptation and the processing time of ENC can be reduced. Simultaneously, leaving frequency bands outside the 100 Hz to 8 kHz range unprocessed avoids the impact of non-speech noise on speech quality.

[0076] Specifically, in an optional embodiment of the present invention, bandpass filtering is performed on the original sound source information to obtain the original sound source information of the second target frequency band, including: bandpass filtering the original sound source information through a double second-order filter to obtain the original sound source information of the second target frequency band.

[0077] Among them, a dual second-order filter is a filter in which both the numerator and denominator of the transfer function are second-order polynomials. Using a dual second-order filter can avoid the filter's sensitivity to coefficients and can be used alone to achieve better filtering results.

[0078] After obtaining the original sound source information of the second target frequency band by bandpass filtering of the original sound source information, the filtered original sound source information can be processed by NR to obtain the human voice signal.

[0079] Step 250: Enhance the human voice signal to obtain the second sound information.

[0080] Enhancement processing of human voice signals can be used to enable users to hear clean speech signals clearly. Enhancement processing can include various methods. Specifically, in an optional embodiment of the present invention, enhancing the human voice signal to obtain second sound information includes: performing audio enhancement processing and / or volume enhancement processing on the human voice signal to obtain the second sound information.

[0081] Audio enhancement processing can dynamically adjust the amplitude of the human voice signal to make the sound softer. Volume enhancement processing can amplify the volume of the human voice signal to make the sound louder.

[0082] Specifically, in an optional embodiment of the present invention, audio enhancement processing and / or volume enhancement processing of the human voice signal includes: performing audio enhancement processing on the human voice signal by dynamically adjusting the audio output amplitude through multiple frequency bands. That is, enhancing low-frequency audio signals and suppressing momentarily excessively loud signals by dynamically adjusting the audio output amplitude through multiple frequency bands (multiband DRC), making the signal clearer.

[0083] Furthermore, in an optional embodiment of the present invention, audio enhancement processing and / or volume enhancement processing of the human voice signal includes: volume enhancement processing of the human voice signal through gain adjustment. Appropriately adjusting the volume of the human voice signal through gain can make the user's listening experience more comfortable and clear.

[0084] Step 260: Mix and add the first sound information and the second sound information to obtain the target sound information, and then play the target sound information.

[0085] In an optional embodiment of the present invention, mixing and adding the first sound information and the second sound information to obtain the target sound information includes: converting the mixed and added sound information into a target electrical signal through a digital-to-analog converter, and converting the target electrical signal into a target sound signal through a speaker to obtain the target sound information.

[0086] The technical solution of this invention involves: acquiring original sound source information; processing the original sound source information through a phase inverter to invert the noise phase and obtain an inverted wave signal; canceling noise from the original sound source information based on the inverted wave signal to obtain first sound information; separating human voice from environmental noise using a software noise reduction algorithm while retaining the human voice signal; enhancing the human voice signal to obtain second sound information; mixing and adding the first and second sound information to obtain target sound information; and playing the target sound information. This solves the noise cancellation problem. By performing ANC and ENC noise reduction processing on the sound, environmental noise and human voice can be distinguished, improving noise cancellation performance and reducing NR processing latency, allowing users to hear clearer sound and enhancing the user experience.

[0087] Figure 2b This is a flowchart of another noise cancellation method provided according to Embodiment 2 of the present invention. Figure 2b As shown, a microphone can pick up sound from its environment, including ambient noise and human voices. The microphone converts the ambient sound into an acoustic signal. This electrical signal is then converted into a digital signal via an ADC. The digital signal can then be distributed to the ANC and ENC for processing.

[0088] like Figure 2b As shown, in the ANC section, the original sound source information can be adjusted using a biquad filter. A low-pass filter is used to select the frequency band with better noise reduction performance, namely the 20Hz to 4kHz band, for ANC adjustment. Signals beyond 1kHz are not processed to avoid high-frequency noise affecting the noise reduction quality. After the biquad filter, a phase inverter is used to obtain an inverted wave signal. The volume of the inverted wave signal is adjusted using gain to make it the same as the level of residual noise in the ear. Next, the DAC converts the digital signal into an electrical signal and transmits it to the speaker (spearker), where it is converted into an audio signal to cancel out the residual noise, thus achieving noise reduction.

[0089] like Figure 2bAs shown, in the ENC section, the original sound source information can be adjusted using a Biquad filter. A Band-pass filter selects speech signals from 100 Hz to 8 kHz for ENC adjustment, filtering out signals from other frequency bands to prevent non-speech noise from affecting speech quality. After the Biquad filter, Noise Reduction (NR) can be performed to preserve human voice while removing noise. Since a certain amount of noise has already been filtered out by the Biquad filter before NR, and this embodiment of the invention can combine ANC noise reduction, the residual noise is not too much. Therefore, NR can complete the processing within 0-30 milliseconds, avoiding excessive delays that would cause the user to perceive two voices. Afterwards, multiband DRC can be used to enhance small audio frequencies and suppress momentarily excessive signals, making the speech signal clearer. Finally, the volume of the preserved speech can be appropriately adjusted using Gain.

[0090] Finally, as Figure 2b As shown, the processing results of the ANC and ENC sections can be mixed and added together, and then the DAC converts the digital signal into an electrical signal and transmits it to the speaker for playback, achieving a high-definition and transparent mode with clear vocals and noise elimination.

[0091] Figure 2c This is a schematic diagram illustrating an application scenario of a noise cancellation method provided in Embodiment 2 of the present invention. For example... Figure 2c As shown, the noise cancellation method provided in this embodiment of the invention can be applied to users answering telephone calls. Specifically, the sound processed by ENC can be used for normal conversations. When a user needs to speak, the boom microphone or boomless microphone responsible for sound pickup can use ENC to cancel ambient noise, so the caller on the other end will not hear the noise around the user, thus providing better call quality.

[0092] The acquisition, storage, and application of the original sound source information involved in the technical solutions of this invention comply with the provisions of relevant laws and regulations and do not violate public order and good morals.

[0093] Example 3

[0094] Figure 3 This is a schematic diagram of a noise cancellation device according to Embodiment 3 of the present invention. Figure 3 As shown, the device includes: a raw sound source information acquisition module 310, a noise reduction processing module 320, and a sound playback module 330. Wherein:

[0095] The original sound source information acquisition module 310 is used to acquire original sound source information;

[0096] The noise reduction processing module 320 is used to perform noise reduction processing on the original sound source information using active noise cancellation (ANC) to obtain the first sound information; and at the same time, it performs noise reduction processing on the original sound source information using environmental noise cancellation (ENC) to obtain the second sound information.

[0097] The sound playback module 330 is used to mix and add the first sound information and the second sound information to obtain the target sound information, and then play the target sound information.

[0098] Optional, the noise reduction processing module 320 includes:

[0099] The anti-phase wave signal determination unit is used to process the original sound source information through a phase inverter to reverse the noise phase and obtain an anti-phase wave signal.

[0100] The first sound information determination unit is used to perform noise cancellation on the original sound source information based on the anti-phase wave signal to obtain the first sound information.

[0101] Optionally, the first sound information determining unit includes:

[0102] The target antiphase wave signal determination subunit is used to adjust the volume of the antiphase wave signal through gain adjustment to obtain a target antiphase wave signal with the same noise level as the original sound source information.

[0103] The first sound information determination subunit is used to cancel noise from the original sound source information based on the target anti-phase wave signal to obtain the first sound information.

[0104] Optionally, the device may also include:

[0105] The original sound source information filtering module is used to perform low-pass filtering on the original sound source information before passing it through the phase inverter to perform noise phase inversion processing to obtain the inverted wave signal, so as to obtain the original sound source information of the first target frequency band.

[0106] Optional, the raw sound source information filtering module includes:

[0107] The original sound source information filtering unit is used to perform low-pass filtering on the original sound source information through a double second-order filter to obtain the original sound source information of the first target frequency band.

[0108] Optionally, the first target frequency band includes a band consisting of 20 Hz to 4 kHz.

[0109] Optional, the noise reduction processing module 320 includes:

[0110] The human voice signal determination unit is used to separate human voice from environmental noise by using a software noise reduction algorithm, while retaining the human voice signal;

[0111] The second sound information determination unit is used to enhance the human voice signal to obtain the second sound information.

[0112] Optionally, the device may also include:

[0113] Another original sound source information filtering module is used to perform bandpass filtering on the original sound source information before separating human voice from environmental noise through software noise reduction algorithm and retaining human voice signal, so as to obtain the original sound source information of the second target frequency band.

[0114] Optional, another raw sound source information filtering module, including:

[0115] Another raw sound source information filtering unit is used to perform bandpass filtering on the raw sound source information through a double second-order filter to obtain the raw sound source information of the second target frequency band.

[0116] Optional, the second target frequency band includes: a band consisting of 100 Hz to 8 kHz.

[0117] Optionally, the second sound information determining unit includes:

[0118] The second sound information determination subunit is used to perform audio enhancement processing and / or volume enhancement processing on the human voice signal to obtain the second sound information.

[0119] Optionally, the second sound information determining subunit is used specifically for:

[0120] The human voice signal is enhanced by dynamically adjusting the audio output amplitude across multiple frequency bands.

[0121] Optionally, the second sound information determining subunit is specifically used for:

[0122] The volume of the human voice signal is enhanced by adjusting the gain.

[0123] Optionally, the raw sound source information acquisition module 310 includes:

[0124] The signal conversion unit is used to acquire the sound signal of the original sound source through the microphone and convert the sound signal of the original sound source into the electrical signal of the original sound source.

[0125] The digital signal conversion unit is used to convert the electrical signal of the original sound source into a digital signal of the original sound source through an analog-to-digital converter, and to use the digital signal of the original sound source as the original sound source information.

[0126] Optional, the sound playback module 330 includes:

[0127] The target sound information determination unit is used to convert the mixed sound information into a target electrical signal through a digital-to-analog converter, and then convert the target electrical signal into a target sound signal through a loudspeaker to obtain the target sound information.

[0128] The noise cancellation device provided in the embodiments of the present invention can execute the noise cancellation method provided in any embodiment of the present invention, and has the corresponding functional modules and beneficial effects of executing the method.

[0129] Example 4

[0130] Figure 4 This is a structural schematic diagram of a noise-canceling headphone according to Embodiment 4 of the present invention. Figure 4 As shown, the noise-canceling headphones include: a microphone, a noise-canceling processor, and a speaker; wherein: the microphone is used to acquire original sound source information;

[0131] A noise reduction processor is used to perform noise reduction processing on the original sound source information using the noise cancellation method provided in any embodiment of the present invention to obtain target sound information;

[0132] A loudspeaker for playing target sound information using a noise cancellation method as provided in any embodiment of the present invention.

[0133] The noise reduction processor can eliminate noise through ANC and ENC, allowing users to hear clear human voices.

[0134] The noise-canceling headphones provided in this invention can improve the problem of noisy sound in the transparency mode of traditional headphones, hearing aids or hearing devices, enhance the noise cancellation effect of environmental noise and enhance human voices, thereby allowing users to hear clearer external human voices.

[0135] Example 5

[0136] Figure 5 This is a structural schematic diagram of a noise-canceling headphone according to Embodiment 5 of the present invention. Figure 5 As shown, the noise-canceling headphones include: a first microphone, a second microphone, a noise-canceling processor, and a speaker; wherein: the first microphone is used to acquire information about a first sound source;

[0137] The second microphone is used to acquire information from the second sound source.

[0138] A noise reduction processor is used to perform active noise cancellation (ANC) noise reduction processing on the first sound source information based on the second sound source information to obtain the third sound information.

[0139] The noise reduction processor is used to take the first sound source information as the original sound source information and perform ENC noise reduction processing using the noise cancellation method provided in any embodiment of the present invention to obtain the second sound information;

[0140] The noise reduction processor is also used to mix and add the third sound information with the second sound information to obtain the target sound information;

[0141] A loudspeaker for playing target sound information using the noise cancellation method provided in any embodiment of the present invention.

[0142] The first microphone can be an FB microphone, and the second microphone can be an FF microphone. The FB microphone can enhance the noise cancellation effect of ANC, while the original FF microphone is mainly used to pick up noise and speech. The third audio information can be the information obtained after enhancing the ANC noise cancellation through the FB microphone, or it can be the result of optimizing the first audio information.

[0143] In other words, the noise cancellation method provided in this embodiment of the invention can be applied to hybrid headphones (Hybrid ANC) to improve the noise reduction effect of hybrid ANC, so that users can hear clearer sounds, and without affecting the processing speed and causing users to perceive two sounds.

[0144] Example 6

[0145] Figure 6 A schematic diagram of an electronic device 10 that can be used to implement embodiments of the present invention is shown. The electronic device is intended to represent various forms of digital computers, such as laptop computers, desktop computers, workstations, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. The electronic device can also represent various forms of mobile devices, such as personal digital processors, cellular phones, smartphones, wearable devices (e.g., helmets, glasses, watches, etc.), and other similar computing devices. The components shown herein, their connections and relationships, and their functions are merely illustrative and are not intended to limit the implementation of the invention described and / or claimed herein.

[0146] like Figure 6As shown, the electronic device 10 includes at least one processor 11 and a memory, such as a read-only memory (ROM) 12 or a random access memory (RAM) 13, communicatively connected to the at least one processor 11. The memory stores computer programs executable by the at least one processor. The processor 11 can perform various appropriate actions and processes based on the computer program stored in the ROM 12 or loaded from storage unit 18 into the RAM 13. The RAM 13 may also store various programs and data required for the operation of the electronic device 10. The processor 11, ROM 12, and RAM 13 are interconnected via a bus 14. An input / output (I / O) interface 15 is also connected to the bus 14.

[0147] Multiple components in electronic device 10 are connected to I / O interface 15, including: input unit 16, such as keyboard, mouse, etc.; output unit 17, such as various types of displays, speakers, etc.; storage unit 18, such as disk, optical disk, etc.; and communication unit 19, such as network card, modem, wireless transceiver, etc. Communication unit 19 allows electronic device 10 to exchange information / data with other devices through computer networks such as the Internet and / or various telecommunications networks.

[0148] Processor 11 can be a variety of general-purpose and / or special-purpose processing components with processing and computing capabilities. Some examples of processor 11 include, but are not limited to, a central processing unit (CPU), a graphics processing unit (GPU), various special-purpose artificial intelligence (AI) computing chips, various processors running machine learning model algorithms, a digital signal processor (DSP), and any suitable processor, controller, microcontroller, etc. Processor 11 performs the various methods and processes described above, such as noise cancellation methods.

[0149] In some embodiments, the noise cancellation method may be implemented as a computer program tangibly contained in a computer-readable storage medium, such as storage unit 18. In some embodiments, part or all of the computer program may be loaded and / or mounted on electronic device 10 via ROM 12 and / or communication unit 19. When the computer program is loaded into RAM 13 and executed by processor 11, one or more steps of the noise cancellation method described above may be performed. Alternatively, in other embodiments, processor 11 may be configured to perform the noise cancellation method by any other suitable means (e.g., by means of firmware).

[0150] Various embodiments of the systems and techniques described above herein can be implemented in digital electronic circuit systems, integrated circuit systems, field-programmable gate arrays (FPGAs), application-specific integrated circuits (ASICs), application-specific standard products (ASSPs), systems-on-a-chip (SoCs), payload-programmable logic devices (CPLDs), computer hardware, firmware, software, and / or combinations thereof. These various embodiments may include implementations in one or more computer programs that can be executed and / or interpreted on a programmable system including at least one programmable processor, which may be a dedicated or general-purpose programmable processor, capable of receiving data and instructions from a storage system, at least one input device, and at least one output device, and transmitting data and instructions to the storage system, the at least one input device, and the at least one output device.

[0151] Computer programs used to implement the methods of the present invention may be written in any combination of one or more programming languages. These computer programs may be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing device, such that when executed by the processor, the computer programs cause the functions / operations specified in the flowcharts and / or block diagrams to be performed. The computer programs may be executed entirely on a machine, partially on a machine, or as a standalone software package, partially on a machine and partially on a remote machine, or entirely on a remote machine or server.

[0152] In the context of this invention, a computer-readable storage medium can be a tangible medium that may contain or store a computer program for use by or in conjunction with an instruction execution system, apparatus, or device. A computer-readable storage medium may include, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, apparatus, or devices, or any suitable combination thereof. Alternatively, a computer-readable storage medium may be a machine-readable signal medium. More specific examples of machine-readable storage media include electrical connections based on one or more wires, portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fibers, portable compact disk read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination thereof.

[0153] To provide interaction with a user, the systems and techniques described herein can be implemented on an electronic device having: a display device for displaying information to the user (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor); and a keyboard and pointing device (e.g., a mouse or trackball) through which the user provides input to the electronic device. Other types of devices can also be used to provide interaction with the user; for example, feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user can be received in any form (including sound input, voice input, or tactile input).

[0154] The systems and technologies described herein can be implemented in computing systems that include backend components (e.g., as data servers), or computing systems that include middleware components (e.g., application servers), or computing systems that include frontend components (e.g., user computers with graphical user interfaces or web browsers through which users can interact with implementations of the systems and technologies described herein), or any combination of such backend, middleware, or frontend components. The components of the system can be interconnected via digital data communication of any form or medium (e.g., communication networks). Examples of communication networks include local area networks (LANs), wide area networks (WANs), blockchain networks, and the Internet.

[0155] A computing system can include clients and servers. Clients and servers are generally located far apart and typically interact through communication networks. The client-server relationship is created by computer programs running on the respective computers and having a client-server relationship with each other. The server can be a cloud server, also known as a cloud computing server or cloud host, which is a hosting product within the cloud computing service system to address the shortcomings of traditional physical hosts and VPS services, such as high management difficulty and weak business scalability.

[0156] It should be understood that the various forms of processes shown above can be used, with steps reordered, added, or deleted. For example, the steps described in this invention can be executed in parallel, sequentially, or in different orders, as long as the desired result of the technical solution of this invention can be achieved, and this is not limited herein.

[0157] The specific embodiments described above do not constitute a limitation on the scope of protection of this invention. Those skilled in the art should understand that various modifications, combinations, sub-combinations, and substitutions can be made according to design requirements and other factors. Any modifications, equivalent substitutions, and improvements made within the spirit and principles of this invention should be included within the scope of protection of this invention.

Claims

1. A noise cancellation method, characterized by, The noise cancellation method is used in the transparency mode of headphones, assistive devices, or hearing aids to allow the user to hear external human voices, and the method includes: Obtain the original sound source information; The original sound source information is processed by active noise cancellation (ANC) to obtain the first sound information; and at the same time, the original sound source information is processed by ambient noise cancellation (ENC) to obtain the second sound information. Based on the physical characteristics of the sound wavelength and the delay of the inverted wave in ANC processing, the original sound source information is low-pass filtered to obtain the original sound source information of the first target frequency band, so as to avoid the adverse effect of high-frequency flipping during ANC processing; the first target frequency band includes a frequency band consisting of 20 Hz to 4 kHz. The process of using ANC to reduce noise in the original sound source information to obtain first sound information includes: passing the original sound source information through a phase inverter to perform noise phase inversion processing to obtain an inverted wave signal; and performing noise cancellation on the original sound source information based on the inverted wave signal to obtain the first sound information. The process of using ENC to denoise the original sound source information to obtain the second sound information includes: separating human voice from environmental noise using a software noise reduction algorithm while retaining the human voice signal; and enhancing the human voice signal to obtain the second sound information. Before separating human voice from environmental noise and preserving the human voice signal by using a software noise reduction algorithm on the original sound source information, the method further includes: performing bandpass filtering on the original sound source information to obtain the original sound source information of the second target frequency band; the second target frequency band includes a frequency band consisting of 100 Hz to 8 kHz; by selecting the original sound source information of the second target frequency band for processing, the computational load of the software noise reduction algorithm NR is reduced, the ENC processing delay is reduced, and the user is prevented from perceiving two sounds; The process of enhancing the human voice signal to obtain second sound information includes: performing audio enhancement processing and / or volume enhancement processing on the human voice signal to obtain second sound information; mixing and adding the first sound information and the second sound information to obtain target sound information; and playing the target sound information. The audio enhancement processing and / or volume enhancement processing of the human voice signal includes: performing audio enhancement processing on the human voice signal by dynamically adjusting the audio output amplitude through multiple frequency bands.

2. The method according to claim 1, characterized in that, Based on the inverted wave signal, noise cancellation is performed on the original sound source information to obtain first sound information, including: The volume of the antiphase wave signal is adjusted by gain adjustment to obtain a target antiphase wave signal with the same noise level as the original sound source information. Based on the target antiphase wave signal, noise cancellation is performed on the original sound source information to obtain the first sound information.

3. The method according to claim 1, characterized in that, The original sound source information is low-pass filtered to obtain the original sound source information of the first target frequency band, including: The original sound source information is low-pass filtered by a double second-order filter to obtain the original sound source information of the first target frequency band.

4. The method according to claim 1, characterized in that, Bandpass filtering is performed on the original sound source information to obtain the original sound source information of the second target frequency band, including: The original sound source information is obtained by bandpass filtering the original sound source information using a double second-order filter to obtain the original sound source information of the second target frequency band.

5. The method according to claim 1, characterized in that, The original sound source information is separated from the ambient noise within 0-30 milliseconds using a software noise reduction algorithm, while retaining the human voice signal.

6. The method according to claim 1, characterized in that, Performing audio enhancement processing and / or volume enhancement processing on the human voice signal includes: The human voice signal is enhanced by gain adjustment.

7. The method according to claim 1, characterized in that, Obtain the original sound source information, including: The original sound source's sound signal is acquired through a microphone, and the original sound source's sound signal is converted into the original sound source's electrical signal. The electrical signal of the original sound source is converted into a digital signal of the original sound source by an analog-to-digital converter, and the digital signal of the original sound source is used as the original sound source information.

8. The method according to claim 1, characterized in that, The first sound information and the second sound information are mixed and added together to obtain the target sound information, including: The mixed audio information is converted into a target electrical signal by a digital-to-analog converter, and then converted into a target audio signal by a speaker to obtain the target audio information.

9. A noise cancellation device, characterized in that, The noise cancellation device is used in the transparency mode of headphones, assistive devices, or hearing aids to allow the user to hear external human voices. The device includes: The raw sound source information acquisition module is used to acquire raw sound source information; The noise reduction processing module is used to perform noise reduction processing on the original sound source information using active noise cancellation (ANC) to obtain first sound information; and simultaneously perform noise reduction processing on the original sound source information using ambient noise cancellation (ENC) to obtain second sound information. The original sound source information filtering module is used to perform low-pass filtering on the original sound source information based on the physical characteristics of the sound wavelength and the delay of the ANC processing antiphase wave to obtain the original sound source information of the first target frequency band, so as to avoid the adverse effect of high frequency flipping during ANC processing; the first target frequency band includes a frequency band consisting of 20 Hz to 4 kHz. The noise reduction processing module includes: an inverted wave signal determination unit, used to process the original sound source information through a phase inverter to perform noise phase inversion processing to obtain an inverted wave signal; and a first sound information determination unit, used to perform noise cancellation on the original sound source information based on the inverted wave signal to obtain first sound information. The noise reduction processing module includes: a human voice signal determination unit, used to separate human voice from environmental noise using a software noise reduction algorithm and retain the human voice signal; and a second sound information determination unit, used to enhance the human voice signal to obtain second sound information. Another original sound source information filtering module is used to perform bandpass filtering on the original sound source information before separating human voice from environmental noise through software noise reduction algorithm and retaining human voice signal, to obtain the original sound source information of the second target frequency band; the second target frequency band includes a frequency band consisting of 100 Hz to 8 kHz; by selecting the original sound source information of the second target frequency band for processing, the computational load of the software noise reduction algorithm NR is reduced, the ENC processing delay is reduced, and the user is prevented from perceiving two sounds; The second sound information determination unit includes: a second sound information determination subunit, used to perform audio enhancement processing and / or volume enhancement processing on the human voice signal to obtain second sound information; The sound playback module is used to mix and add the first sound information and the second sound information to obtain target sound information, and then play the target sound information; The second sound information determination subunit is specifically used to: perform audio enhancement processing on the human voice signal by dynamically adjusting the audio output amplitude through multiple frequency bands.

10. An electronic device, characterized in that, The electronic device includes: At least one processor; and A memory communicatively connected to the at least one processor; wherein, The memory stores a computer program that can be executed by the at least one processor to enable the at least one processor to perform the noise cancellation method according to any one of claims 1-8.

11. A noise-canceling headphone, characterized in that, The noise-canceling headphones include: a microphone, a noise-canceling processor, and a speaker; wherein: The microphone is used to acquire raw sound source information; The noise reduction processor is used to perform noise reduction processing on the original sound source information using the method described in any one of claims 1 to 6 to obtain target sound information; The speaker is used to play the target sound information using the method described in claim 1 or 8.

12. A noise-canceling headphone, characterized in that, The noise-canceling headphones include: a first microphone, a second microphone, a noise-canceling processor, and a speaker; wherein: The first microphone is used to acquire information about the first sound source; The second microphone is used to acquire information from the second sound source; The noise reduction processor is used to perform active noise cancellation (ANC) noise reduction processing on the first sound source information based on the second sound source information to obtain the third sound information. The noise reduction processor is further configured to use the first sound source information as the original sound source information and perform environmental noise cancellation (ENC) noise reduction processing using the method described in any one of claims 1 and 4-6 to obtain the second sound information; The noise reduction processor is further configured to mix and add the third sound information with the second sound information to obtain the target sound information; The speaker is used to play the target sound information using the method described in claim 1 or 8.

13. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores computer instructions that cause a processor to execute the noise cancellation method according to any one of claims 1-8.

Images