Noise cancellation method, device, electronic equipment, earphone and storage medium

Abstract

This invention discloses a noise cancellation method, apparatus, electronic device, headphones, and storage medium. The method includes: acquiring original sound source information; performing noise reduction processing on the original sound source information using ANC to obtain a first sound message; and simultaneously performing noise reduction processing on the original sound source information using ENC to obtain a second sound message; performing noise reduction processing on the original sound source information using ANC to obtain the first sound message includes: passing the original sound source information through a phase inverter to perform noise phase inversion processing to obtain an inverted wave signal; performing noise cancellation on the original sound source information based on the inverted wave signal to obtain the first sound message; mixing and adding the first sound message and the second sound message to obtain a target sound message, and playing the target sound message. Acquiring the original sound source information includes: acquiring the sound signal of the original sound source through a microphone and converting the sound signal of the original sound source into an electrical signal of the original sound source; converting the electrical signal of the original sound source into a digital signal of the original sound source through an analog-to-digital converter, and using the digital signal of the original sound source as the original sound source information. This method can perform ANC and ENC noise reduction on sound, distinguish between environmental noise and human voice, improve noise cancellation performance, and allow users to hear clearer sound.

Description

Technical Field

[0001] The present invention relates to the technical field of audio processing, and in particular to a noise elimination method, device, electronic equipment, earphone and storage medium. Prior Art

[0002] In some headphone-related products, such as headphones, on-ear headphones, in-ear headphones, hearing aids or hearing aids, the original sound signals usually contain noise, and directly transmitting the original sound signals to the user will cause interference.

[0003] In the prior art, active noise cancellation (ANC) is usually used to cancel the original sound signal. However, noise cancellation using ANC alone cannot achieve the effect of distinguishing the environment from the human voice, resulting in poor noise cancellation performance, and the sound heard by the user is still noisy. Summary of the invention

[0004] The present invention provides a noise elimination method, device, electronic equipment, earphone and storage medium, which can improve the noise elimination performance and enable the user to hear clearer sound.

[0005] According to one aspect of the present invention, a noise elimination method is provided, the method comprising: obtaining an original sound source message; The original sound source message is subjected to noise reduction processing by using active noise cancellation ANC to obtain a first sound message; and the original sound source message is subjected to noise reduction processing by using environmental noise cancellation ENC to obtain a second sound message; The first sound message and the second sound message are mixed and added to obtain a target sound message, and the target sound message is played.

[0006] According to another aspect of the present invention, there is provided a noise elimination device, the device comprising: The original sound source information acquisition module is used to obtain the original sound source information; A noise reduction processing module, used to perform noise reduction processing on the original sound source message by using active noise cancellation ANC to obtain a first sound message; and simultaneously perform noise reduction processing on the original sound source message by using environmental noise cancellation ENC to obtain a second sound message; The sound playing module is used for mixing and adding the first sound message and the second sound message to obtain the target sound message, and playing the target sound message.

[0007] According to another aspect of the present invention, an electronic device is provided, the electronic device comprising: at least one processor; and A memory communicatively connected to at least one processor; wherein, The memory stores a computer program that can be executed by at least one processor. The computer program is executed by at least one processor so that the at least one processor can execute the noise elimination method of any embodiment of the present invention.

[0008] According to another aspect of the present invention, a noise cancelling headset is provided, the noise cancelling headset comprising: a microphone, a noise reduction processor, and a speaker; wherein: Microphone, used to obtain original sound source information; A noise reduction processor, used to perform noise reduction processing on the original sound source message using the method provided by any embodiment of the present invention to obtain a target sound message; A loudspeaker is used to play a target sound message using the method provided by any embodiment of the present invention.

[0009] According to another aspect of the present invention, a noise cancelling headset is provided, the noise cancelling headset comprising: a first microphone, a second microphone, a noise reduction processor, and a speaker; wherein: A first microphone, used to obtain a first sound source message; A second microphone, used to obtain a second sound source message; A noise reduction processor, configured to perform active noise cancellation (ANC) noise reduction processing on the first sound source message according to the second sound source message to obtain a third sound message; The noise reduction processor is used to use the first sound source message as the original sound source message and perform environmental noise elimination (ENC) noise reduction processing using the method provided in any embodiment of the present invention to obtain a second sound message; The noise reduction processor is further used to mix and add the third sound message with the second sound message to obtain a target sound message; A loudspeaker is used to play a target sound message using a method provided by any embodiment of the present invention.

[0010] According to another aspect of the present invention, a computer-readable storage medium is provided, wherein the computer-readable storage medium stores computer instructions, and the computer instructions are used to implement the noise elimination method of any embodiment of the present invention when executed by a processor.

[0011] The technical means of the embodiment of the present invention solves the problem of noise elimination by obtaining an original sound source message; performing noise reduction processing on the original sound source message using ANC to obtain a first sound message; and simultaneously performing noise reduction processing on the original sound source message using ENC to obtain a second sound message; mixing and adding the first sound message and the second sound message to obtain a target sound message, and playing the target sound message. By performing ANC and ENC noise reduction processing on the sound, environmental noise and human voice can be distinguished, and the noise elimination performance is improved, so that the user can hear clearer sound.

[0012] It should be understood that the content described in this section is not intended to identify the key or important features of the embodiments of the present invention, nor is it intended to limit the scope of the present invention. Other features of the present invention will become easily understood through the following description. Simple diagram description

[0013] In order to more clearly illustrate the technical means in the embodiments of the present invention, the following briefly introduces the diagrams required for use in the description of the embodiments. Obviously, the diagrams described below are only some embodiments of the present invention. For those with ordinary knowledge in the relevant technical field, other diagrams can be obtained based on these diagrams without paying any creative work. [Figure 1a] is a flow chart of a noise elimination method provided according to Embodiment 1 of the present invention. [Fig. 1b] is a flow chart of another noise elimination method provided according to the first embodiment of the present invention. [Fig. 2a] is a flow chart of a noise elimination method provided according to the second embodiment of the present invention. [Fig. 2b] is a flow chart of another noise elimination method provided according to the second embodiment of the present invention. [Figure 2c] is a schematic diagram of an application scenario of a noise elimination method provided according to Embodiment 2 of the present invention. [Fig. 3] is a schematic diagram of the structure of a noise elimination device provided according to Embodiment 3 of the present invention. [Fig. 4] is a schematic diagram of the structure of a noise-canceling headset provided according to Embodiment 4 of the present invention. [Fig. 5] is a schematic diagram of the structure of a noise-canceling headset provided according to Embodiment 5 of the present invention. [Fig. 6] is a schematic diagram of the structure of an electronic device that implements the noise elimination method according to an embodiment of the present invention. Implementation

[0014] In order to enable those with ordinary knowledge in the relevant technical field to better understand the scheme of the present invention, the technical means in the embodiments of the present invention will be clearly and completely described below in combination with the drawings in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those with ordinary knowledge in the relevant technical field without creative work should fall within the scope of protection of the present invention.

[0015] It should be noted that the terms "first", "second", "original", "target", etc. in the specification of the present invention, the scope of the invention application and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchanged where appropriate, so that the embodiments of the present invention described herein can be implemented in an order other than those illustrated or described herein. In addition, the terms "including" and "having" and any of their variations are intended to cover non-exclusive inclusions, for example, a process, method, system, product or device that includes a series of steps or units is not necessarily limited to those steps or units that are clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices. [Example 1]

[0016] FIG. 1a is a flow chart of a noise elimination method provided according to Embodiment 1 of the present invention. This embodiment is applicable to the case of noise elimination in earphone-related products. The method can be executed by a noise elimination device. The noise elimination device can be implemented in the form of hardware and / or software. The noise elimination device can be configured in an electronic device, such as earphones, computers, mobile phones, etc. As shown in FIG. 1a, the method includes: Step 110: Obtain original sound source information.

[0017] The original sound source message may be a message containing environmental noise and human voice. Specifically, the original sound source message may be generated by collecting the sound in the environment through a microphone.

[0018] Specifically, in an optional implementation of an embodiment of the present invention, obtaining the original sound source information includes: obtaining the sound signal of the original sound source through a microphone, and converting the sound signal of the original sound source into an electrical signal of the original sound source; converting the electrical signal of the original sound source into a digital signal of the original sound source through an analog-to-digital converter, and using the digital signal of the original sound source as the original sound source information.

[0019] The human voice and noise contained in the original sound source are mixed together and can be captured by a microphone (such as FF MIC) at the same time. The microphone can convert the sound signal into an electrical signal. The electrical signal can be converted into a digital signal through an analog-to-digital converter (ADC), and the digital signal can be simultaneously allocated to ANC and environmental noise cancellation (ENC) for operation, so as to facilitate noise reduction processing of the sound.

[0020] Step 120: The original sound source message is subjected to noise reduction processing using ANC to obtain a first sound message; and the original sound source message is subjected to noise reduction processing using ENC to obtain a second sound message.

[0021] Among them, ANC can generate anti-noise with the same magnitude and opposite phase as the noise by performing digital signal processing (DSP) on the original sound source information, so as to achieve noise reduction by using the anti-noise and the original noise to cancel each other out. However, the ANC elimination in the previous technology does not distinguish between environmental noise and human voice, but eliminates both, resulting in poor sound quality for users.

[0022] ENC can use the ENC chip to process the original sound source information, distinguish between human voice and environmental noise, retain only human voice, and eliminate environmental noise. However, using ENC alone for DSP processing to achieve noise reduction requires a long operation time, such as 30-50 milliseconds. Due to the delay of ENC operation, users can easily perceive that there are two sounds: the original sound source and the sound of operation delay. As a result, the user experience will be very poor.

[0023] In the embodiment of the present invention, the original sound source message is processed by ANC and ENC at the same time for noise reduction, and the processing time of ENC can be reduced on the basis of using ANC noise reduction. Therefore, the problem that the environmental noise and the human voice cannot be separated and the environmental noise and the human voice are eliminated together due to the use of ANC alone can be avoided. It can also be avoided that the noise reduction processing using ENC alone cannot achieve efficient environmental noise elimination. In addition, when the user uses it at the near end, the problem that the external noise penetrates from the outside to the user's ears due to the long ENC processing time, causing the user to perceive two sounds, can be avoided. In summary, by processing the original sound source message by ANC and ENC at the same time, the signal processing can be clearer and the complete human voice can be retained, so that the user can hear the external human voice more clearly.

[0024] Step 130: Mix and add the first sound message and the second sound message to obtain a target sound message, and play the target sound message.

[0025] Among them, the method of the embodiment of the present invention can mix the sound information obtained by ANC and ENC processing to obtain a complete and clean human voice, improve the problem of noisy listening in the transparency mode of headphones, hearing aids or hearing aids in the prior art, enhance the ambient sound noise reduction effect and enhance the human voice, so that the user can hear clearer external human voice.

[0026] Specifically, in an optional implementation of an embodiment of the present invention, the first sound message and the second sound message are mixed and added to obtain a target sound message, including: converting the mixed and added sound messages into a target electrical signal through a digital-to-analog converter, and converting the target electrical signal into a target sound signal through a speaker to obtain the target sound message.

[0027] Among them, the digital-to-analog converter (DAC) can convert the mixed and added signals after ANC and ENC processing into electrical signals. Then, the electrical signals converted by the DAC can be transmitted to the speakers. The speakers can convert the electrical signals into audio signals and play them.

[0028] The technical means of this embodiment obtains the original sound source message; performs noise reduction processing on the original sound source message using active noise cancellation ANC to obtain a first sound message; and simultaneously performs noise reduction processing on the original sound source message using environmental noise cancellation ENC to obtain a second sound message; mixes and adds the first sound message and the second sound message to obtain a target sound message, and plays the target sound message, thereby solving the problem of noise cancellation. By performing ANC and ENC noise reduction processing on the sound, environmental noise and human voice can be distinguished, thereby improving noise cancellation performance and allowing the user to hear clearer sound.

[0029] FIG1b is a flow chart of another noise elimination method provided according to the first embodiment of the present invention. As shown in FIG1b, the microphone can pick up external signals. At this time, since the human voice and the environmental noise cannot be distinguished, if the user directly listens to the external signal, the sound will feel noisy. The technical means of the embodiment of the present invention can combine the respective characteristics of ANC and ENC to process voice signals. Among them, ANC can be responsible for reducing the noise of low-frequency signals, and ENC can independently process the voice frequency band of the human voice, retain the human voice, and reduce the operation time. That is, the noise is eliminated by the anti-phase wave through ANC, and the human voice and environmental noise are removed through ENC. Afterwards, the signals processed by ANC and ENC can be mixed together, and the mixed signal can be played through the speaker to improve the problem of noisy listening in the transparent mode of traditional headphone products, enhance the environmental noise elimination effect and enhance the human voice, so that the user can hear a clearer external human voice. When using the transparent mode, the user can also avoid perceiving two sounds based on the shortening of the ENC operation time. [Example 2]

[0030] FIG2a is a flow chart of a noise elimination method provided in Embodiment 2 of the present invention. This embodiment is a further refinement of the above technical means. The technical means in this embodiment can be combined with various optional solutions in one or more of the above embodiments. As shown in FIG2a, the method includes: Step 210: Obtain original sound source information.

[0031] In an optional implementation of the embodiment of the present invention, obtaining the original sound source information includes: obtaining the sound signal of the original sound source through a microphone, and converting the sound signal of the original sound source into an electrical signal of the original sound source; converting the electrical signal of the original sound source into a digital signal of the original sound source through an analog-to-digital converter, and using the digital signal of the original sound source as the original sound source information.

[0032] Step 220: The original sound source information is passed through a phase inverter to perform noise phase inversion processing to obtain an inverted wave signal.

[0033] In an optional implementation of an embodiment of the present invention, before the original sound source message is passed through a phase inverter to perform noise phase inversion processing to obtain an inverted wave signal, it also includes: low-pass filtering the original sound source message to obtain the original sound source message of the first target frequency band.

[0034] Among them, the low-pass filter can be to filter the original sound source information and select the first target frequency band with good ANC noise reduction processing effect. Specifically, due to the delay between the sound wavelength and the anti-phase wave of the ANC processing in physical characteristics, the high frequency with poor noise reduction processing effect can be filtered out to avoid the adverse effect of high frequency flipping during ANC processing. That is, the first target frequency band can be a low frequency band. Specifically, according to specific research, the first target frequency band can be set to a frequency band consisting of 20 Hz to 4 kHz.

[0035] Although in the frequency band after 1 kHz, the faster the DSP processing speed of ANC is, the higher the frequency that can be processed by noise reduction can be; however, considering the need to avoid the effect of high-frequency inversion, that is, the need to avoid the original noise reduction from becoming noise increase, the embodiment of the present invention only processes the original sound source information of 20 Hz to 4 kHz through ANC through a low-pass filter, which can avoid the high-frequency noise from affecting the noise reduction quality.

[0036] Specifically, in an optional implementation of an embodiment of the present invention, the original sound source message is low-pass filtered to obtain the original sound source message of the first target frequency band, including: low-pass filtering the original sound source message through a biquadratic filter to obtain the original sound source message of the first target frequency band.

[0037] Among them, the biquad filter is a filter whose numerator and denominator of the transfer function are both second-order polynomials. The use of a biquad filter can avoid the filter being sensitive to the coefficients and can be used alone to achieve better filtering effects.

[0038] After the original sound source message is low-pass filtered to obtain the original sound source message of the first target frequency band, the filtered original sound source message can be subjected to phase inversion processing through a phase inverter to obtain an anti-phase wave signal. Furthermore, the original sound source message can be noise-cancelled according to the anti-phase wave signal to obtain the first sound message, thereby achieving low-frequency noise reduction.

[0039] Step 230: Perform noise cancellation on the original sound source message according to the anti-phase wave signal to obtain a first sound message.

[0040] In an optional implementation of an embodiment of the present invention, noise is canceled on an original sound source message according to an inverted wave signal to obtain a first sound message, including: adjusting the volume of the inverted wave signal by gain adjustment to obtain a target inverted wave signal having the same noise level as that in the original sound source message; and canceling the noise of the original sound source message according to the target inverted wave signal to obtain the first sound message.

[0041] After the inverted wave signal is obtained, the volume of the inverted wave signal can be adjusted through the gain (Gain), and the inverted wave signal is adjusted to the target inverted wave signal with the same volume as the current residual noise in the ear. The target inverted wave signal can directly cancel the noise with the original sound source information, thereby achieving the effect of low-frequency noise reduction.

[0042] Step 240: Separate the original sound source information from human voice and environmental noise using a software noise reduction algorithm, and retain the human voice signal.

[0043] Among them, the software noise reduction algorithm (Noise Reduce, NR) can be an operation that retains human voice and removes noise. However, based on the original sound source information in the embodiment of the present invention, the noise reduction process can be performed through ANC, and the residual amount of noise is not much, and the NR operation can be appropriately weakened, that is, the operation rate is increased by reducing the amount of operation. In addition, filtering processing can be performed before NR is performed to further reduce the residual noise, thereby further reducing the intensity of the NR operation, reducing the noise processing delay, and avoiding the user from perceiving two sounds. Exemplarily, by controlling the NR operation to be completed within 0 to 30 milliseconds, the user can avoid perceiving two sounds.

[0044] Specifically, in an optional implementation of an embodiment of the present invention, before the original sound source message is separated from the human voice and the environmental noise by a software noise reduction algorithm and the human voice signal is retained, it also includes: bandpass filtering the original sound source message to obtain the original sound source message of the second target frequency band.

[0045] Among them, the band-pass filter can be to filter the original sound source message and select the second target frequency band corresponding to the human voice audio band for ENC noise reduction processing. The original sound source message can be filtered by the filter to reduce the processing delay of ENC, that is, to reduce the amount of NR calculation. Specifically, according to specific research, the second target frequency band can be set to a frequency band consisting of 100 Hz to 8 kHz. By selecting the original sound source message of the second target frequency band for processing, the difficulty of ENC adjustment can be reduced and the processing time of ENC can be reduced. At the same time, the frequency band other than 100 Hz to 8 kHz is not processed to avoid the noise of the non-speech segment from affecting the voice quality.

[0046] Specifically, in an optional implementation of an embodiment of the present invention, the original sound source message is bandpass filtered to obtain the original sound source message of the second target frequency band, including: bandpass filtering the original sound source message through a biquadratic filter to obtain the original sound source message of the second target frequency band.

[0047] Among them, the biquad filter is a filter whose numerator and denominator of the transfer function are both second-order polynomials. The use of biquad filters can avoid the filter being sensitive to coefficients and can be used alone to achieve better filtering effects.

[0048] After the original sound source message is band-pass filtered to obtain the original sound source message of the second target frequency band, the filtered original sound source message can be processed by NR to obtain a human voice signal.

[0049] Step 250: Enhance the human voice signal to obtain a second voice message.

[0050] The enhancement processing of the human voice signal may be to enable the user to clearly hear a clean voice signal. The enhancement processing may include multiple processing. Specifically, in an optional implementation of the embodiment of the present invention, the human voice signal is enhanced to obtain a second sound message, including: performing audio enhancement processing and / or volume enhancement processing on the human voice signal to obtain the second sound message.

[0051] Among them, audio enhancement processing can be to dynamically adjust the amplitude of the human voice signal to make the sound softer. Volume enhancement processing can be to amplify the volume dimension of the human voice signal to make the sound signal louder.

[0052] Specifically, in an optional implementation of the embodiment of the present invention, performing audio enhancement processing and / or volume enhancement processing on the human voice signal includes: performing audio enhancement processing on the human voice signal by dynamically adjusting the audio output amplitude in multiple frequency bands. That is, by dynamically adjusting the audio output amplitude in multiple frequency bands (multiband DRC), the small audio is enhanced and the instantaneous excessively loud signal is suppressed to make the signal clearer.

[0053] Furthermore, in an optional implementation of the embodiment of the present invention, performing audio enhancement processing and / or volume enhancement processing on the human voice signal includes: performing volume enhancement processing on the human voice signal by gain adjustment. By appropriately adjusting the volume of the human voice signal by gain (Gain), the user can hear the voice more comfortably and clearly.

[0054] Step 260: Mix and add the first sound message and the second sound message to obtain a target sound message, and play the target sound message.

[0055] In an optional implementation of the embodiment of the present invention, the first sound message and the second sound message are mixed and added to obtain a target sound message, including: converting the mixed and added sound messages into a target electrical signal through a digital-to-analog converter, and converting the target electrical signal into a target sound signal through a speaker to obtain the target sound message.

[0056] The technical means of the embodiment of the present invention obtains the original sound source message; performs noise phase inversion processing on the original sound source message through a phase inverter to obtain an inverted wave signal; performs noise cancellation on the original sound source message according to the inverted wave signal to obtain a first sound message; separates the human voice from the environmental noise through a software noise reduction algorithm on the original sound source message, and retains the human voice signal; performs enhancement processing on the human voice signal to obtain a second sound message; mixes and adds the first sound message and the second sound message to obtain a target sound message, and plays the target sound message, thereby solving the problem of noise elimination. By performing ANC and ENC noise reduction processing on the sound, it is possible to distinguish between environmental noise and human voice, improve noise elimination performance, and reduce the delay of NR processing, so that the user can hear clearer sound and enhance the user experience.

[0057] FIG2b is a flow chart of another noise elimination method provided according to the second embodiment of the present invention. As shown in FIG2b, the microphone can pick up the sound in the environment, and the sound in the environment includes environmental noise and human voice. The microphone can convert the sound in the environment from an acoustic signal to an electrical signal. The electrical signal can be converted into a digital signal through an ADC. The digital signal can be distributed to the ANC and ENC for calculation and processing respectively.

[0058] As shown in Figure 2b, in the ANC part, the original sound source information can be adjusted by Biquad filter, and the frequency band with better noise reduction performance, namely, the frequency band from 20 Hz to 4 kHz, is selected through Low-pass filter for ANC adjustment. The signal after 1 kHz is filtered out without processing to prevent high-frequency noise from affecting the quality of noise reduction. After the Biquad filter, the Phase inverter can be performed to obtain the anti-phase wave signal. And the volume of the anti-phase wave signal is adjusted through Gain so that the anti-phase wave signal is the same as the current residual noise in the ear. Then, the DAC converts the digital signal into an electrical signal and transmits it to the speaker (Spearker), which is converted into an audio signal to offset the residual noise, thereby achieving the effect of noise reduction.

[0059] As shown in FIG. 2b, in the ENC part, the original sound source information can be adapted by Biquad filter, and the voice signal of 100 Hz to 8 kHz is selected by Band-pass filter for ENC adaptation, and the signals of other frequency bands are filtered out to avoid the noise of non-voice segments affecting the voice quality. After the Biquad filter, the NR noise elimination can be performed to retain the human voice and remove the noise. Since the Biquad filter has been used to filter out a certain amount of noise before the NR, and the embodiment of the present invention can be combined with ANC noise reduction, the residual noise will not be too much at this time, so the NR can complete the processing within 0 to 30 milliseconds, avoiding too long delay so that the user perceives two sounds. Afterwards, the multiband DRC can be used to enhance the small audio and suppress the instantaneous excessive signal, so that the voice signal can be clearer. Then, the retained voice volume can be appropriately adjusted through Gain.

[0060] Finally, as shown in FIG. 2b , the processing results of the ANC part and the ENC part can be mixed and added, and then the DAC converts the digital signal into an electrical signal and transmits it to the speaker for broadcast, thereby achieving a high-definition transparent mode with clear vocals and noise elimination.

[0061] FIG2c is a schematic diagram of an application scenario of a noise elimination method provided according to Embodiment 2 of the present invention. As shown in FIG2c, the noise elimination method provided by the embodiment of the present invention can be applied when a user answers a call. Specifically, the sound processed by ENC can be used as a general call. When the user needs to speak, the boom microphone (Boom Microphone) or boomless microphone (Boom less Microphone) responsible for receiving the sound can eliminate the environmental noise through ENC, and the caller on the other end will not hear the noise around the user, which can provide a better call quality.

[0062] The acquisition, storage and application of the original sound source information involved in the technical means of the embodiments of the present invention are in compliance with the provisions of relevant laws and regulations and do not violate public order and good morals. [Example 3]

[0063] FIG3 is a schematic diagram of the structure of a noise elimination device provided according to Embodiment 3 of the present invention. As shown in FIG3 , the device includes: an original sound source information acquisition module 310, a noise reduction processing module 320, and a sound playing module 330. Among them: The original sound source information acquisition module 310 is used to obtain the original sound source information; The noise reduction processing module 320 is used to perform noise reduction processing on the original sound source message using active noise cancellation ANC to obtain a first sound message; and simultaneously perform noise reduction processing on the original sound source message using environmental noise cancellation ENC to obtain a second sound message; The sound playing module 330 is used to mix and add the first sound message and the second sound message to obtain a target sound message, and then play the target sound message.

[0064] Optionally, the noise reduction processing module 320 includes: The anti-phase wave signal determination unit is used to process the original sound source information through the phase inverter to perform noise phase inversion processing to obtain an anti-phase wave signal; The first sound message determination unit is used to perform noise cancellation on the original sound source message according to the anti-phase wave signal to obtain the first sound message.

[0065] Optionally, the first sound message determination unit includes: The target inverted phase wave signal determination subunit is used to adjust the volume of the inverted phase wave signal by gain adjustment to obtain a target inverted phase wave signal having the same noise level as the original sound source message; The first sound message determination subunit is used to perform noise cancellation on the original sound source message according to the target anti-phase wave signal to obtain the first sound message.

[0066] Optionally, the device further comprises: The original sound source information filtering module is used to perform low-pass filtering on the original sound source information before passing the original sound source information through a phase inverter to perform noise phase inversion processing to obtain an inverted wave signal, so as to obtain the original sound source information of the first target frequency band.

[0067] Optional, original sound source information filtering module, including: The original sound source information filtering unit is used to perform low-pass filtering on the original sound source information through a biquad filter to obtain the original sound source information of the first target frequency band.

[0068] Optionally, the first target frequency band includes: a frequency band consisting of 20 Hz to 4 kHz.

[0069] Optionally, the noise reduction processing module 320 includes: The human voice signal determination unit is used to separate the human voice from the ambient noise through the software noise reduction algorithm and retain the human voice signal; The second sound message determination unit is used to enhance the human voice signal to obtain the second sound message.

[0070] Optionally, the device further comprises: Another original sound source information filtering module is used to perform bandpass filtering on the original sound source information before separating the human voice from the environmental noise through the software noise reduction algorithm and retaining the human voice signal to obtain the original sound source information of the second target frequency band.

[0071] Optional, another original sound source information filtering module, including: Another original sound source information filtering unit is used to perform bandpass filtering on the original sound source information through a biquad filter to obtain the original sound source information of the second target frequency band.

[0072] Optionally, the second target frequency band includes: a frequency band consisting of 100 Hz to 8 kHz.

[0073] Optionally, the second sound message determination unit includes: The second sound message determination subunit is used to perform audio enhancement processing and / or volume enhancement processing on the human voice signal to obtain the second sound message.

[0074] Optionally, the second voice message determination subunit is specifically used to: The audio output amplitude is dynamically adjusted in multiple frequency bands to enhance the human voice signal.

[0075] Optionally, the second voice message determination subunit is further specifically used for: The volume of the vocal signal can be enhanced by adjusting the gain.

[0076] Optionally, the original sound source information acquisition module 310 includes: The electric signal conversion unit is used to obtain the sound signal of the original sound source through the microphone, and convert the sound signal of the original sound source into the electric signal of the original sound source; The digital signal conversion unit is used to convert the electrical signal of the original sound source into the digital signal of the original sound source through an analog-to-digital converter, and use the digital signal of the original sound source as the original sound source information.

[0077] Optionally, the sound playing module 330 includes: The target sound message determination unit is used to convert the mixed and added sound messages into target electrical signals through an analog-to-digital converter, and convert the target electrical signals into target sound signals through a loudspeaker to obtain the target sound message.

[0078] The noise elimination device provided in the embodiment of the present invention can execute the noise elimination method provided in any embodiment of the present invention, and has functional modules and functions corresponding to the execution method. [Example 4]

[0079] FIG4 is a schematic diagram of the structure of a noise cancelling headset provided according to Embodiment 4 of the present invention. As shown in FIG4 , the noise cancelling headset comprises: a microphone, a noise reduction processor, and a speaker; wherein: the microphone is used to obtain the original sound source information; A noise reduction processor, configured to perform noise reduction processing on the original sound source message by using the noise elimination method provided by any embodiment of the present invention to obtain a target sound message; A loudspeaker is used to play a target sound message using the noise elimination method provided by any embodiment of the present invention.

[0080] Among them, the noise reduction processor can eliminate noise through ANC and ENC, allowing users to hear clear human voices.

[0081] The noise-canceling earphones provided in the embodiments of the present invention can improve the problem of noisy listening in the transparent mode of traditional earphones, auxiliary hearing devices or hearing aids, and can enhance the noise cancellation effect of environmental noise and enhance the human voice, thereby allowing the user to hear clearer external human voices. [Example 5]

[0082] FIG5 is a schematic diagram of the structure of a noise cancelling headset provided according to Embodiment 5 of the present invention. As shown in FIG5 , the noise cancelling headset comprises: a first microphone, a second microphone, a noise reduction processor, and a speaker; wherein: the first microphone is used to obtain a first sound source message; A second microphone, used to obtain a second sound source message; A noise reduction processor, configured to perform active noise cancellation (ANC) noise reduction processing on the first sound source message according to the second sound source message to obtain a third sound message; The noise reduction processor is used to use the first sound source message as the original sound source message and perform ENC noise reduction processing using the noise elimination method provided in any embodiment of the present invention to obtain a second sound message; The noise reduction processor is further used to mix and add the third sound message with the second sound message to obtain a target sound message; A loudspeaker is used to play a target sound message using the noise elimination method provided by any embodiment of the present invention.

[0083] The first microphone may be an FB Microphone, and the second microphone may be an FF Microphone. The FB Microphone can enhance the noise cancellation effect of ANC, while the original FF Microphone is mainly used to collect noise and voice. The third sound message may be a message obtained by enhancing the noise cancellation of ANC through the FB Microphone, and may be a result of optimizing the first sound message.

[0084] In other words, the noise cancellation method provided in the embodiment of the present invention can be applied to hybrid headphones (Hybrid ANC) to improve the Hybrid ANC and enhance the noise reduction effect of the Hybrid ANC, so that the user can hear clearer sound without affecting the computing rate and causing the user to perceive two sounds. [Example 6]

[0085] FIG6 shows a schematic diagram of the structure of an electronic device 10 that can be used to implement an embodiment of the present invention. The electronic device is intended to represent various forms of digital computers, such as notebook computers, desktop computers, workstations, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. The electronic device can also represent various forms of mobile devices, such as personal digital processing, mobile phones, smart phones, wearable devices (such as helmets, glasses, watches, etc.) and other similar computing devices. The components shown in this specification, their connections and relationships, and their functions are only examples and are not intended to limit the implementation of the present invention described and / or required in this specification.

[0086] As shown in FIG6 , the electronic device 10 includes at least one processor 11, and a memory connected to the at least one processor 11, such as a read-only memory (ROM) 12, a random access memory (RAM) 13, etc., wherein the memory stores a computer program that can be executed by at least one processor, and the processor 11 can perform various appropriate actions and processes according to the computer program stored in the read-only memory (ROM) 12 or the computer program loaded from the memory unit 18 to the random access memory (RAM) 13. In the RAM 13, various programs and data required for the operation of the electronic device 10 can also be stored. The processor 11, the ROM 12, and the RAM 13 are connected to each other through a bus 14. The input / output (I / O) interface 15 is also connected to the bus 14.

[0087] Multiple components in the electronic device 10 are connected to the I / O interface 15, including: an input unit 16, such as a keyboard, a mouse, etc.; an output unit 17, such as various types of displays, speakers, etc.; a memory unit 18, such as a hard disk, an optical disk, etc.; and a communication unit 19, such as a network card, a modem, a wireless communication transceiver, etc. The communication unit 19 allows the electronic device 10 to exchange information / data with other devices through a computer network such as the Internet and / or various telecommunication networks.

[0088] The processor 11 may be a variety of general and / or special processing components with processing and computing capabilities. Some examples of the processor 11 include, but are not limited to, a central processing unit (CPU), a graphics processing unit (GPU), various special artificial intelligence (AI) computing chips, various processors running machine learning model algorithms, a digital signal processor (DSP), and any appropriate processor, controller, microcontroller, etc. The processor 11 performs the various methods and processes described above, such as the noise elimination method.

[0089] In some embodiments, the noise cancellation method may be implemented as a computer program, which is tangibly contained in a computer-readable storage medium, such as a memory unit 18. In some embodiments, part or all of the computer program may be loaded and / or installed on the electronic device 10 via the ROM 12 and / or the communication unit 19. When the computer program is loaded into the RAM 13 and executed by the processor 11, one or more steps of the noise cancellation method described above may be performed. Alternatively, in other embodiments, the processor 11 may be configured to perform the noise cancellation method in any other appropriate manner (e.g., by means of firmware).

[0090] Various embodiments of the systems and techniques described above in this specification can be implemented in digital electronic circuit systems, integrated circuit systems, field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), system-on-chips (SOCs), complex programmable logic devices (CPLDs), computer hardware, firmware, software, and / or combinations thereof. These various embodiments can include: being implemented in one or more computer programs that can be executed and / or interpreted on a programmable system including at least one programmable logic controller, which can be a special purpose or general purpose programmable logic controller that can receive data and instructions from a memory system, at least one input device, and at least one output device, and transmit data and instructions to the memory system, the at least one input device, and the at least one output device.

[0091] Computer programs for implementing the methods of the present invention may be written in any combination of one or more programming languages. These computer programs may be provided to a processor of a general-purpose computer, a special-purpose computer or other programmable data processing device, so that when the computer program is executed by the processor, the functions / operations specified in the flow chart and / or block diagram are implemented. The computer program may be executed entirely on the machine, partially on the machine, partially on the machine as a stand-alone software package and partially on a remote machine, or entirely on a remote machine or server.

[0092] In the context of the present invention, a computer readable storage medium may be a tangible medium that may contain or store a computer program for use by or in conjunction with an instruction execution system, device, or apparatus. A computer readable storage medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or device, or any suitable combination of the foregoing. Alternatively, a computer readable storage medium may be a machine readable signal medium. More specific examples of machine readable storage media would include electrical connections based on one or more wires, a portable computer hard drive, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), optical fiber, a compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0093] To provide interaction with a user, the systems and techniques described herein may be implemented on an electronic device having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to the user; and a keyboard and a pointing device (e.g., a mouse trackball) through which the user can provide input to the electronic device. Other types of devices may also be used to provide interaction with the user; for example, the feedback provided to the user may be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user may be received in any form (including acoustic input, voice input, or tactile input).

[0094] The systems and techniques described herein may be implemented in a computing system that includes backend components (e.g., as a data server), or a computing system that includes middleware components (e.g., an application server), or a computing system that includes frontend components (e.g., a user computer with a graphical user interface or a web browser through which a user can interact with implementations of the systems and techniques described herein), or a computing system that includes any combination of such backend components, middleware components, or frontend components. The components of the system may be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: a local area network (LAN), a wide area network (WAN), a blockchain network, and the Internet.

[0095] A computing system may include a client and a server. The client and the server are generally remote from each other and usually interact through a communication network. The client-server relationship is created by computer programs running on the corresponding computers and having a client-server relationship with each other. The server may be a cloud server, also known as cloud computing or cloud hosting, which is a host product in the cloud computing server system to solve the defects of difficult management and weak business scalability in traditional physical hosting and VPS services.

[0096] It should be understood that the various forms of processes shown above can be used to reorder, add or delete steps. For example, the steps described in the present invention can be executed in parallel, sequentially or in different orders, as long as the expected results of the technical means of the present invention can be achieved, and this specification does not limit it here.

[0097] The above specific implementations do not constitute a limitation on the protection scope of the present invention. It should be understood by those with ordinary knowledge in the relevant technical field that various modifications, combinations, sub-combinations and substitutions can be made according to design requirements and other factors. Any modification, equivalent substitution and improvement made within the spirit and principle of the present invention should be included in the protection scope of the present invention.

[0098] 110,120,130: Steps 210,220,230,240,250,260: Steps 310: Original sound source information acquisition module 320: Noise reduction processing module 330: Sound playback module 10: Electronic devices 11: Processor 12: Read-only memory 13: Random Access Memory 14: Bus 15: Input / output interface 16: Input unit 17: Output unit 18: Memory Unit 19: Communication unit

Claims

1. A noise cancellation method, characterized by comprising: Obtain the original sound source information; The original sound source information is processed by active noise cancellation (ANC) to reduce noise and obtain the first sound information. Simultaneously, the original sound source message is denoised using Environmental Noise Cancellation (ENC) to obtain a second sound message; the original sound source message is then denoised using ANC to obtain a first sound message, including: passing the original sound source message through a phase inverter to invert the noise phase and obtain an inverted wave signal; using the inverted wave signal to cancel noise in the original sound source message and obtain the first sound message; using the inverted wave signal to cancel noise in the original sound source message and obtain the first sound message, including: adjusting the volume of the inverted wave signal through gain adjustment to obtain a target inverted wave signal with the same noise level as in the original sound source message; using the target inverted wave signal to cancel noise in the original sound source message and obtain the first sound message; the original sound source message is then denoised using ENC to obtain a second sound message, including: separating human voice from environmental noise using a software denoising algorithm and preserving the human voice signal; and enhancing the human voice signal to obtain the second sound message. The first sound message and the second sound message are mixed and added together to obtain the target sound message, and the target sound message is played. Obtaining the original sound source message includes: acquiring the sound signal of the original sound source through a microphone and converting the sound signal of the original sound source into an electrical signal of the original sound source; converting the electrical signal of the original sound source into a digital signal of the original sound source through an analog-to-digital converter, and using the digital signal of the original sound source as the original sound source message.

2. The method as described in claim 1, wherein, Before passing the original sound source information through a phase inverter to perform noise phase inversion processing to obtain an inverted wave signal, the process further includes: performing low-pass filtering on the original sound source information to obtain the original sound source information of the first target frequency band.

3. The method as described in claim 2, wherein, The original sound source information is low-pass filtered to obtain the original sound source information of the first target frequency band, including: low-pass filtering the original sound source information through a double second-order filter to obtain the original sound source information of the first target frequency band.

4. The method as described in claim 3, wherein, The first target frequency band includes the frequency band consisting of 20 Hz to 4 kHz.

5. The method as described in claim 1, wherein, Before separating human voice from environmental noise using a software noise reduction algorithm and preserving the human voice signal, the process also includes: performing bandpass filtering on the original sound source information to obtain the original sound source information for the second target frequency band.

6. The method as described in claim 5, wherein, The original sound source information is bandpass filtered to obtain the original sound source information of the second target frequency band, including: bandpass filtering the original sound source information through a double second-order filter to obtain the original sound source information of the second target frequency band.

7. The method as described in claim 5, wherein, The second target frequency band includes the band consisting of 100 Hz to 8 kHz.

8. The method as described in claim 1, wherein, The original sound source information is separated from the ambient noise within 0 to 30 milliseconds using a software noise reduction algorithm, while preserving the human voice signal.

9. The method as described in claim 1, wherein, The voice signal is enhanced to obtain a second sound message, including: audio enhancement processing and / or volume enhancement processing of the voice signal to obtain a second sound message.

10. The method as described in claim 9, wherein, Perform audio enhancement processing and / or volume enhancement processing on the human voice signal, including: performing audio enhancement processing on the human voice signal by dynamically adjusting the audio output amplitude through multiple frequency bands.

11. The method as described in claim 9, wherein, Perform audio enhancement processing and / or volume enhancement processing on the human voice signal, including: enhancing the volume of the human voice signal through gain adjustment.

12. The method as described in claim 10, wherein, The process of mixing and adding the first audio message with the second audio message to obtain the target audio message includes: converting the mixed audio message into a target electrical signal using an analog-to-digital converter, and converting the target electrical signal into a target audio signal using a speaker to obtain the target audio message.

13. A noise cancellation device, characterized in that it comprises: The original sound source information acquisition module is used to acquire the original sound source information; The noise reduction module is used to perform noise reduction processing on the original sound source information using active noise cancellation (ANC) to obtain the first sound information. Simultaneously, the original sound source information is processed by environmental noise cancellation (ENC) to reduce noise and obtain the second sound information. The noise reduction processing module includes: an inverted wave signal determination unit, used to perform noise phase inversion processing on the original sound source message through a phase inverter to obtain an inverted wave signal; a first sound message determination unit, used to perform noise cancellation on the original sound source message based on the inverted wave signal to obtain a first sound message; a human voice signal determination unit, used to separate human voice from environmental noise in the original sound source message through a software noise reduction algorithm and retain the human voice signal; and a second sound message determination unit, used to enhance the human voice signal to obtain a second sound message. The first sound message determination unit includes: a target inverted wave signal determination subunit, used to adjust the volume of the inverted wave signal through gain adjustment to obtain a target inverted wave signal with the same noise level as the original sound source message; the first sound message determination subunit, used to perform noise cancellation on the original sound source message based on the target inverted wave signal to obtain a first sound message; and a sound playback module, used to mix and add the first sound message and the second sound message to obtain a target sound message and play the target sound message. The original sound source information acquisition module includes: an electrical signal conversion unit, used to acquire the sound signal of the original sound source through a microphone and convert the sound signal of the original sound source into an electrical signal of the original sound source; and a digital signal conversion unit, used to convert the electrical signal of the original sound source into a digital signal of the original sound source through an analog-to-digital converter and use the digital signal of the original sound source as the original sound source information.

14. An electronic device, characterized in that the electronic device comprises: At least one processor; And a memory communicatively connected to the at least one processor; wherein the memory stores a computer program executable by the at least one processor, the computer program being executed by the at least one processor to enable the at least one processor to perform the noise cancellation method as described in any one of claims 1 to 12.

15. A noise-canceling headphone, characterized in that the noise-canceling headphone comprises: A microphone, a noise reduction processor, and a speaker; wherein: the microphone is used to acquire original sound source information; the noise reduction processor is used to perform noise reduction processing on the original sound source information using the method described in any one of claims 1 to 11 to obtain target sound information; and the speaker is used to play the target sound information using the method described in any one of claims 1 to 12.

16. A noise-canceling headset, characterized in that the noise-canceling headset comprises: The system comprises a first microphone, a second microphone, a noise reduction processor, and a speaker; wherein: the first microphone is used to acquire a first sound source message; the second microphone is used to acquire a second sound source message; the noise reduction processor is used to perform active noise cancellation (ANC) noise reduction processing on the first sound source message based on the second sound source message to obtain a third sound message; the noise reduction processor is also used to use the first sound source message as the original sound source message and perform environmental noise cancellation (ENC) noise reduction processing using the method described in any one of claims 1, 5 to 11 to obtain a second sound message; the noise reduction processor is also used to mix and add the third sound message with the second sound message to obtain a target sound message; and the speaker is used to play the target sound message using the method described in claim 1 or 12.

17. A computer-readable storage medium, characterized in that the computer-readable storage medium stores computer instructions for causing a processor to perform, when executed, the noise cancellation method as described in any one of claims 1 to 12.

Images