Noise Cancellation Method, Device, Storage Medium and Headphone

Abstract

The present application discloses a noise cancellation method, device, storage medium, and earphone, which relates to the technical field of sound acquisition. First, when a microphone acquires a first audio signal, a vibration signal acquired by a first sensor is obtained, and then the first audio signal is denoised based on the vibration signal to obtain a second audio signal, wherein the first audio signal includes a noise signal generated due to vibration. When the first audio signal includes a noise signal generated due to the vibration of the earphone, the vibration signal acquired by the first sensor during the acquisition of the first audio signal by the microphone can be obtained. Then, there is a corresponding relationship between the noise signal in the first audio signal and the vibration signal. Therefore, the noise signal in the first audio signal can be eliminated based on the vibration signal to obtain the second audio signal, improving the effect and accuracy of eliminating the noise signal generated due to the vibration of the earphone in the first audio signal.

Description

Technical Field

[0001] This application relates to the technical field of sound collection, and particularly to a noise cancellation method, device, storage medium, and earphone. Background Art

[0002] With the development of science and technology, people use various earphones more and more frequently in their lives. Users can make calls and use voice through the microphones set in the earphones.

[0003] However, in the related art, when an earphone collects external sounds through a microphone, external noise is usually collected as well. Therefore, there is an urgent need for a noise cancellation method to eliminate the noise in the sound data collected by the microphone. Summary of the Invention

[0004] This application provides a noise cancellation method, device, storage medium, and earphone, which can solve the technical problem that in the related art, when an earphone collects external sounds through a microphone, external noise is usually collected as well.

[0005] In a first aspect, an embodiment of this application provides a noise cancellation method applied to an earphone. The method includes:

[0006] When a microphone collects a first audio signal, obtaining a vibration signal collected by a first sensor;

[0007] Performing noise cancellation processing on the first audio signal based on the vibration signal to obtain a second audio signal;

[0008] wherein the first audio signal includes a noise signal generated due to vibration.

[0009] Optionally, the performing noise cancellation processing on the first audio signal based on the vibration signal includes: performing an inverting process on the vibration signal, and superimposing the first audio signal and the vibration signal after the inverting process to eliminate the noise signal in the first audio signal.

[0010] Optionally, the performing noise cancellation processing on the first audio signal based on the vibration signal includes: subtracting the vibration signal from the first audio signal to eliminate the noise signal in the first audio signal.

[0011] Optionally, the obtaining a vibration signal collected by a first sensor includes: obtaining a motion signal collected by a second sensor, and when it is determined according to the motion signal that the earphone is in a motion state, obtaining a vibration signal collected by the first sensor.

[0012] Optionally, the first sensor and the second sensor are the same sensor, and the sensor type is a heavy acceleration sensor.

[0013] Optionally, obtaining the vibration signal collected by the first sensor includes: obtaining the first audio signal collected by the microphone, and when it is determined that there is a noise signal in the first audio signal, obtaining the vibration signal collected by the first sensor.

[0014] Optionally, performing noise cancellation processing on the first audio signal based on the vibration signal includes: when the noise signal in the first audio signal and the vibration signal come from the same vibration source, performing noise cancellation processing on the first audio signal based on the vibration signal.

[0015] In a second aspect, an embodiment of the present application provides a noise cancellation device, and the device includes:

[0016] A vibration signal acquisition module, configured to obtain the vibration signal collected by the first sensor when the microphone collects the first audio signal;

[0017] A noise cancellation module, configured to perform noise cancellation processing on the first audio signal based on the vibration signal to obtain a second audio signal;

[0018] Wherein, the first audio signal includes a noise signal generated due to vibration.

[0019] In a third aspect, an embodiment of the present application provides a computer storage medium, and the computer storage medium stores multiple instructions, and the instructions are adapted to be loaded and executed by a processor to perform the steps of the above method.

[0020] In a fourth aspect, an embodiment of the present application provides a headset, including a memory, a processor, and a computer program stored on the memory and executable on the processor.

[0021] The beneficial effects brought by the technical solutions provided by some embodiments of the present application at least include:

[0022] The present application provides a noise cancellation method. First, when the microphone collects the first audio signal, the vibration signal collected by the first sensor is obtained, and then the first audio signal is subjected to noise cancellation processing based on the vibration signal to obtain a second audio signal. Among them, the first audio signal includes a noise signal generated due to vibration. When the first audio signal includes a noise signal generated due to the vibration of the headset, the vibration signal collected by the first sensor during the collection of the first audio signal by the microphone can be obtained. Then, there is a corresponding relationship between the noise signal and the vibration signal in the first audio signal. Then, the noise signal in the first audio signal can be eliminated based on the vibration signal to obtain a second audio signal, improving the effect and accuracy of eliminating the noise signal generated due to the vibration of the headset in the first audio signal. Description of the Drawings

[0023] To more clearly illustrate the technical solutions in the embodiments of the present application or the prior art, the following will briefly introduce the accompanying drawings required in the description of the embodiments or the prior art. Obviously, the accompanying drawings in the following description are only some embodiments of the present application. For those skilled in the art, without creative efforts, other accompanying drawings can be obtained based on these drawings.

[0024] Figure 1 Schematic diagram of the working principle of a Bluetooth headset provided by an embodiment of the present application;

[0025] Figure 2 Schematic flowchart of a noise cancellation method provided by an embodiment of the present application;

[0026] Figure 3 Schematic diagram of the structure of a neck-hanging headset provided by an embodiment of the present application;

[0027] Figure 4 Schematic flowchart of a noise cancellation method provided by another embodiment of the present application;

[0028] Figure 5 Schematic waveform diagram provided by another embodiment of the present application;

[0029] Figure 6 Another schematic waveform diagram provided by another embodiment of the present application;

[0030] Figure 7 Schematic diagram of the structure of a noise cancellation device provided by another embodiment of the present application;

[0031] Figure 8 Schematic diagram of the structure of a headset provided by an embodiment of the present application. Detailed implementation manners

[0032] To make the features and advantages of the present application more obvious and understandable, the following will clearly and completely describe the technical solutions in the embodiments of the present application with reference to the accompanying drawings in the embodiments of the present application. Obviously, the described embodiments are only some embodiments of the present application, rather than all embodiments. Based on the embodiments of the present application, all other embodiments obtained by those skilled in the art without creative efforts belong to the scope of protection of the present application.

[0033] In the embodiments of the present application, the noise cancellation method can be mainly applied to headsets, but can also be applied to other electronic devices with microphones as needed. The electronic devices include but are not limited to smart watches, smart phones, tablet computers, laptop portable computers, and desktop computers, etc.

[0034] For ease of description, the following takes the application of the noise cancellation method to headphones as an example for introduction, where the headphones include but are not limited to wireless headphones or wired headphones. For ease of description below, the headphones are taken as an example of Bluetooth headphones in wireless headphones for introduction.

[0035] Please refer to Figure 1 , Figure 1 which is a schematic diagram of the working principle of a pair of Bluetooth headphones provided by an embodiment of the present application.

[0036] As Figure 1 shown, the Bluetooth headphones 100 may include a Bluetooth chip 110, an antenna 120, a power supply 130, a speaker 140, a microphone 150, and a first sensor 160. Among them, the Bluetooth chip 110 is used for the system control of the entire Bluetooth headphones 100, such as controlling charging, audio signal processing, etc.; the function of the antenna 120 is to radiate and receive electromagnetic waves, mainly for communication between the Bluetooth headphones 100 and terminals such as mobile phones, and communication between the left and right headphones; the power supply 130 is used to supply power to each module in the Bluetooth headphones 100, charge the headphones and charge the battery, etc.; the speaker 140 is used to play audio signals according to the control of the Bluetooth chip 110, including music playing, calls and other scenarios; the main function of the microphone 150 is to collect external audio signals in scenarios such as calls or recordings, so that the Bluetooth chip 110 sends the collected audio signals to the terminal to implement functions such as calls and recordings; the main function of the first sensor 160 is to collect vibration signals generated in the Bluetooth headphones 100 and send the collected vibration signals to the Bluetooth chip 110.

[0037] Please refer to Figure 2 , Figure 2 which is a schematic flowchart of a noise cancellation method provided by an embodiment of the present application.

[0038] As Figure 2 shown, the method includes:

[0039] S201. When the microphone collects the first audio signal, obtain the vibration signal collected by the first sensor.

[0040] When the noise cancellation method provided by the embodiment of the present application is applied to headphones, the headphones can be any kind of headphones equipped with a microphone.

[0041] Please refer to Figure 3 , Figure 3 which is a schematic structural diagram of a neckband headphone provided by an embodiment of the present application.

[0042] As Figure 3As shown, the earphone in the embodiment of the present application may specifically be a neck-worn earphone 300, that is, a neck-hung earphone. The neck-worn earphone 300 is a product between true wireless earphones and wired earphones. In terms of design, there is enough space on the neck-hung part 310 of the neck-worn earphone 300 to place devices such as batteries and decoding amplifiers. Therefore, generally speaking, it can bring longer battery life and better sound quality experience than true wireless earphones. The neck-worn earphone 300 generally adopts a single microphone algorithm, and the microphone 320 is placed on the main board bin of the neck-hung part 310 of the neck-worn earphone 300. When the user wears the neck-worn earphone 300, during the user's movement, the neck-worn earphone 300 will vibrate, and then the neck-hung part 310 of the neck-worn earphone 300 will rub against the neck or the collar. The friction sound generated by the friction will be transmitted to the microphone 320. In this way, when the microphone 320 collects external audio information in scenarios such as calls or recordings, it will also collect the friction sound, resulting in the audio information collected by the microphone 320 including the noise signal generated by vibration.

[0043] In order to solve the problem of noise generated by the above earphone in scenarios such as calls or recordings, in the embodiment of the present application, a first sensor may be set in the earphone. The first sensor can obtain the vibration signal generated when the earphone vibrates. The specific model and working principle of the first sensor may not be limited, and the setting position of the first sensor may not be limited. In order to improve the accuracy of the first sensor in collecting vibration signals, the first sensor may be set near the microphone of the earphone.

[0044] When the earphone is in scenarios such as calls or recordings, for example, when the user needs to make a call with another terminal through the terminal, then the microphone in the earphone connected to the terminal needs to collect the voice emitted by the user; for another example, when the user needs to record through the terminal, then the microphone in the earphone connected to the terminal needs to collect the sound emitted from the outside. Therefore, when the earphone is in scenarios such as calls or recordings, the earphone will receive a sound collection instruction, and then the earphone can wake up the microphone to work so that the microphone collects the first audio signal in the current environment of the earphone.

[0045] Since the microphone starts to collect the first audio signal in the current environment of the earphone after the earphone wakes up the microphone to work, if the earphone vibrates at this time, for example, the earphone rubs against the limb or collar of the earphone-wearing user, causing the earphone to vibrate, then the first audio signal collected by the microphone may include not only the normal audio signal in the user or the outside, but also the noise signal generated by the vibration of the earphone.

[0046] Since there may be noise signals in the first audio signal, in order to eliminate the possible noise signals in the first audio signal, the first sensor in the earphone can also be awakened when the microphone collects the first audio signal, so that the first sensor collects the vibration signal of the earphone in the current environment, and obtains the vibration signal collected by the first sensor.

[0047] S202. Perform noise cancellation processing on the first audio signal based on the vibration signal to obtain a second audio signal.

[0048] After obtaining the vibration signal of the earphone collected by the first sensor in the current environment, if the noise signal in the first audio signal is caused by the vibration of the earphone, that is, the noise signal in the first audio signal has the same waveform and characteristics as the vibration signal collected by the first sensor, then the noise cancellation processing can be directly performed on the first audio signal based on the vibration signal to obtain the second audio signal, that is, the noise signal in the first audio signal is eliminated based on the vibration signal to obtain the second audio signal, so that the second audio signal does not contain the noise signal caused by the vibration of the earphone. Optionally, in the embodiments of the present application, the method for eliminating the noise signal in the first audio signal based on the vibration signal may not be limited.

[0049] It can be understood that the noise cancellation method in the embodiments of the present application can be applied not only to earphones, but also to other electronic devices equipped with microphones. The electronic devices include but are not limited to smart watches, smart phones, tablet computers, laptop portable computers, and desktop computers, etc. For example, when the electronic device is a smart phone, then when the smart phone is in scenarios such as a call or recording, the smart phone may vibrate due to the user's finger or clothes touching the smart phone, and then noise is generated in the smart phone in scenarios such as a call or recording. Then, as long as the first sensor is set in the smart phone, the noise cancellation method in the embodiments of the present application can also be applied to the smart phone.

[0050] In the embodiments of the present application, first, when the microphone collects the first audio signal, the vibration signal collected by the first sensor is obtained, and then the noise cancellation processing is performed on the first audio signal based on the vibration signal to obtain the second audio signal, where the first audio signal includes the noise signal generated due to vibration. When the first audio signal includes the noise signal generated due to the vibration of the earphone, the vibration signal collected by the first sensor during the collection of the first audio signal by the microphone can be obtained. Then, there is a corresponding relationship between the noise signal in the first audio signal and the vibration signal, and then the noise signal in the first audio signal can be eliminated based on the vibration signal to obtain the second audio signal, improving the effect and accuracy of eliminating the noise signal generated due to the vibration of the earphone in the first audio signal.

[0051] Please refer to Figure 4 ,Figure 4 A flowchart of a noise cancellation method provided by another embodiment of the present application.

[0052] As Figure 4 shown, the method includes:

[0053] S401. When the microphone collects the first audio signal, obtain the motion signal collected by the second sensor. When it is determined that the headset is in a motion state according to the motion signal, obtain the vibration signal collected by the first sensor.

[0054] Since most components in the headset need to work continuously when obtaining the vibration signal collected by the first sensor and performing noise cancellation processing on the first audio signal based on the vibration signal, for a Bluetooth headset with limited battery capacity, the power consumption is relatively high when most components in the headset work continuously. Therefore, it can be first determined whether the headset meets the conditions for noise cancellation, and only when the headset meets the conditions for noise cancellation, then obtain the vibration signal collected by the first sensor and perform noise cancellation processing on the first audio signal based on the vibration signal.

[0055] A feasible implementation is that when the current motion amplitude of the headset is small, the vibration generated when the headset moves has little impact on calls or recordings. At this time, the noise signal generated by the headset vibration in the first audio signal can be not cancelled. Specifically, a second sensor can be further provided in the headset first. The second sensor can also be provided near the microphone of the headset. The second sensor is a motion sensor to obtain the motion signal collected by the second sensor during the microphone collects the first audio signal.

[0056] Then it can be determined whether the headset is in a motion state according to the motion signal collected by the second sensor. Specifically, the corresponding motion amplitude can be determined according to the motion signal collected by the second sensor. This motion amplitude is also the motion amplitude of the headset, and it is determined whether this motion amplitude reaches the motion amplitude threshold, and then it is determined whether the headset is in a motion state according to the judgment. That is, when the motion amplitude reaches the motion amplitude threshold, it is determined that the headset is in a motion state; when the motion amplitude does not reach the motion amplitude threshold, it is determined that the headset is not in a motion state.

[0057] When it is determined that the headset is in a motion state according to the motion signal, it means that the current motion amplitude of the headset is large at this time. Then the vibration generated when the headset moves has a greater impact on calls or recordings. Then the vibration signal collected by the first sensor can be obtained, and the subsequent steps of performing noise cancellation processing on the first audio signal based on the vibration signal can be carried out.

[0058] Regarding the method of obtaining the vibration signal of the first sensor, reference can be made to the description in step S201, which will not be elaborated here.

[0059] Further, the first sensor and the second sensor can also be the same sensor. In this case, the sensor type can be a gravity acceleration sensor, which can detect the motion signal and vibration signal of an object by using the principles of gravity and inertia.

[0060] Optionally, before acquiring the vibration signal collected by the first sensor and performing noise cancellation processing on the first audio signal based on the vibration signal, the first sensor and the related devices for noise cancellation processing can be in a sleep state. In this way, only when it is determined that the earphone is in a moving state according to the motion signal, the first sensor and the related devices for noise cancellation processing in the sleep state are awakened, which can reduce the operating power consumption of the first sensor and the related devices for noise cancellation processing.

[0061] S402. When the microphone collects the first audio signal, acquire the first audio signal collected by the microphone. When it is determined that there is a noise signal in the first audio signal, acquire the vibration signal collected by the first sensor.

[0062] Another feasible implementation is that when there is no noise signal in the first audio signal, it has no impact on the call or recording at this time, and the noise signal in the first audio signal can be not eliminated. Specifically, after the earphone wakes up the microphone to work so that the microphone collects the first audio signal in the current environment of the earphone, the first audio signal collected by the microphone can be acquired, and it is determined whether there is a noise signal in the first chip signal.

[0063] Optionally, a way to determine whether there is a noise signal in the first chip signal can be to determine whether the noise signal in the first audio signal reaches a noise threshold, and then determine whether there is a noise signal in the first chip signal. Among them, the way to determine whether the noise signal in the first audio signal reaches the noise threshold can be not limited. For example, waveform analysis can be performed on the first audio signal, and the waveforms corresponding to normal voice signals are relatively regular. If it is determined that there is an abnormal signal with an amplitude greater than the preset amplitude in the terminal waveform of the first audio signal, it can be determined that the noise signal in the first audio signal reaches the noise threshold, and it can be determined that there is a noise signal in the first audio signal.

[0064] When it is determined that there is a noise signal in the first audio signal, it means that the noise signal in the first audio signal has a greater impact on the call or recording at this time. Then, the first sensor in the sleep state can be awakened so that the first sensor works to acquire the vibration signal collected by the first sensor when the microphone collects the first audio signal.

[0065] If the noise signal in the first audio signal does not reach the noise threshold, it means that the noise in the first audio signal is small. At this time, the noise signal in the first audio signal has little impact on the call or recording. Then, the vibration signal collected by the first sensor can be obtained, and the subsequent steps of denoising the first audio signal based on the vibration signal can be performed.

[0066] Regarding the method of obtaining the vibration signal of the first sensor, please refer to the description in step S201 and will not be elaborated here.

[0067] Similarly, before obtaining the vibration signal collected by the first sensor and performing denoising processing on the first audio signal based on the vibration signal, the first sensor and the related devices for denoising processing can be in a sleep state. In this way, only when it is determined that there is a noise signal in the first audio signal, the first sensor and the related devices for denoising processing in the sleep state are awakened, which can reduce the operating power consumption of the first sensor and the related devices for denoising processing.

[0068] It can be understood that the specific execution order and process of the above steps S401 and S402 can be selected according to needs. Then, the above steps S401 and S402 can be executed separately, that is, as two parallel trigger conditions, respectively triggering the acquisition of the vibration signal collected by the first sensor and the subsequent steps of denoising the first audio signal based on the vibration signal.

[0069] In addition, in order to improve the trigger accuracy, the above steps S401 and S402 can also be executed successively as an overall trigger condition, that is, step S401 can be executed first and then step S402. Specifically, the motion signal collected by the second sensor can be obtained first. When it is determined that the earphone is in a motion state according to the motion signal, the first audio signal collected by the microphone is obtained. Then, when it is determined that there is a noise signal in the first audio signal, the vibration signal collected by the first sensor is obtained to trigger the acquisition of the vibration signal collected by the first sensor and the subsequent steps of denoising the first audio signal based on the vibration signal; or step S402 is executed first and then step S401. Specifically, the first audio signal collected by the microphone is obtained first. When it is determined that there is a noise signal in the first audio signal, the motion signal collected by the second sensor is obtained. Then, when it is determined that the earphone is in a motion state according to the motion signal, it triggers the acquisition of the vibration signal collected by the first sensor and the subsequent steps of denoising the first audio signal based on the vibration signal.

[0070] S403. When the noise signal and the vibration signal in the first audio signal come from the same vibration source, denoise the first audio signal based on the vibration signal to obtain a second audio signal.

[0071] Understandably, when the earphone is in a scenario such as a call or recording, the earphone will receive a sound collection instruction. Then the earphone can wake up the microphone to work, so that the microphone collects the first audio signal in the current environment of the earphone. Since the environment where the earphone is located is relatively complex, the first audio signal collected by the microphone in the current environment of the earphone may include a noise signal generated by the vibration of the earphone, and may also include other types of noise signals (for example, sharp signals in the outside world, car honking sounds, etc.). If there are other types of noise signals in the first audio signal, at this time, the noise signal in the first audio signal cannot be eliminated by the vibration signal collected by the first sensor.

[0072] Therefore, in order to accurately eliminate the noise signal generated by the vibration of the earphone in the first audio signal, after the microphone collects the first audio signal and the vibration signal collected by the first sensor is obtained, it is necessary to determine whether the noise signal and the vibration signal in the first audio signal come from the same vibration source, so as to select whether to perform subsequent elimination steps according to the judgment situation.

[0073] Among them, the method of determining whether the noise signal and the vibration signal in the first audio signal come from the same vibration source may not be limited. A feasible implementation manner is that when the noise signal and the vibration signal in the first audio signal come from the same vibration source, the waveforms of the first audio signal and the vibration signal are generally similar. Therefore, waveform similarity analysis is performed on the first audio signal and the vibration signal. If the waveform similarity between the first audio signal and the vibration signal is greater than the preset similarity threshold, it can be determined that the noise signal and the vibration signal in the first audio signal come from the same vibration source.

[0074] If the noise signal and the vibration signal in the first audio signal come from the same vibration source, then in the case where the noise signal and the vibration signal in the first audio signal come from the same vibration source, it means that the noise signal in the first audio signal at this time is generated by the vibration of the earphone. Therefore, subsequent elimination steps can be executed, that is, the noise signal in the first audio signal is eliminated based on the vibration signal to obtain the second audio signal.

[0075] If the noise signal and the vibration signal in the first audio signal do not come from the same vibration source, then in the case where the noise signal and the vibration signal in the first audio signal do not come from the same vibration source, it means that the noise signal in the first audio signal at this time is not generated by the vibration of the earphone. Therefore, subsequent elimination steps may not be executed.

[0076] Optionally, in the process of eliminating the noise signal in the first audio signal based on the vibration signal to obtain the second audio signal, if the noise signal in the first audio signal is generated due to the vibration of the earphone, that is, the noise signal in the first audio signal has the same waveform and characteristics as the vibration signal collected by the first sensor, a feasible implementation is to superimpose or subtract the first audio signal and the audio adjustment signal to eliminate the noise signal in the first audio signal and obtain the second audio signal.

[0077] Specifically, since the first audio signal includes a normal audio signal and a noise signal generated due to vibration, the vibration signal can be subjected to an inverting process so that the phase of the vibration signal after the inverting process is opposite to that of the vibration signal before the inverting process. Then, the vibration signal after the inverting process has the same amplitude but opposite phase to the noise signal in the first audio signal. Then, the first audio signal can be superimposed on the vibration signal after the inverting process so that the vibration signal after the inverting process cancels out the noise signal generated by the vibration, and the noise signal in the first audio signal is eliminated to obtain the second audio signal.

[0078] Please refer to Figure 5 , Figure 5 which is a waveform schematic diagram provided by another embodiment of the present application.

[0079] As Figure 5 shown, the first audio signal 500 includes a normal audio signal 510 and a noise signal 520 generated due to vibration. If the noise signal 520 in the first audio signal 500 is generated due to the vibration of the earphone, that is, the noise signal 520 in the first audio signal 500 has the same waveform and characteristics as the vibration signal 530 collected by the first sensor, then the vibration signal 520 can be subjected to an inverting process so that the phase of the vibration signal 540 after the inverting process is opposite to that of the vibration signal 530 before the inverting process. Then, the vibration signal 540 after the inverting process has the same amplitude but opposite phase to the noise signal 520 in the first audio signal. By superimposing the first audio signal 500 and the vibration signal 540 after the inverting process, the vibration signal 540 after the inverting process can be made to cancel out the noise signal 520 generated by the vibration in the first audio signal 500, and the obtained second audio signal 550 only includes the normal audio signal 510.

[0080] Optionally, since the first audio signal includes a normal audio signal and a noise signal generated due to vibration, and the noise signal in the first audio signal has the same waveform and characteristics as the vibration signal collected by the first sensor, then the first audio signal can be directly subtracted from the vibration signal so that the vibration signal cancels out the noise signal generated by the vibration, and the noise signal in the first audio signal is eliminated to obtain the second audio signal.

[0081] Please refer to Figure 6 , Figure 6 which is another waveform schematic diagram provided for another embodiment of this application.

[0082] As Figure 6 shown, the first audio signal 600 includes a normal audio signal 610 and a noise signal 620 generated due to vibration. Then, if the noise signal 620 in the first audio signal 600 is generated due to the vibration of the earphone, that is, the noise signal 620 in the first audio signal 600 has the same waveform and characteristics as the vibration signal 630 collected by the first sensor, then the first audio signal 600 can be directly subtracted from the vibration signal 630, so that the vibration signal 630 can cancel out the noise signal 620 generated due to vibration in the first audio signal 600, and the obtained second audio signal 640 only includes the normal audio signal 610.

[0083] After eliminating the noise signal in the first audio signal based on the vibration signal to obtain the second audio signal, relevant processing can be performed based on the second audio signal. For example, when the earphone is in a scenario such as a call or recording, the earphone can send the second audio signal to the terminal so that the terminal can achieve a call or recording.

[0084] In the embodiment of this application, it can be first determined whether to trigger the acquisition of the vibration signal collected by the first sensor. After determining to trigger the acquisition of the vibration signal collected by the first sensor, the first audio signal can be denoised based on the vibration signal to eliminate the noise signal in the first audio signal and obtain the second audio signal, which can improve the accuracy and speed of eliminating the noise signal in the first audio signal based on the vibration signal to obtain the second audio signal.

[0085] Please refer to Figure 7 , Figure 7 which is a schematic structural diagram of a noise cancellation device provided for another embodiment of this application.

[0086] As Figure 7 shown, the noise cancellation device 700 includes:

[0087] a vibration signal acquisition module 710, configured to acquire the vibration signal collected by the first sensor when the microphone collects the first audio signal;

[0088] a noise cancellation module 720, configured to perform denoising processing on the first audio signal based on the vibration signal to obtain a second audio signal.

[0089] Wherein, the first audio signal includes a noise signal generated due to vibration.

[0090] Optionally, the noise cancellation module 720 is further configured to perform an inverting process on the vibration signal, and superimpose the first audio signal and the vibration signal after the inverting process to cancel the noise signal in the first audio signal.

[0091] Optionally, the noise cancellation module 720 is further configured to subtract the first audio signal from the vibration signal to cancel the noise signal in the first audio signal.

[0092] Optionally, the vibration signal acquisition module 710 is further configured to acquire the motion signal collected by the second sensor, and acquire the vibration signal collected by the first sensor when it is determined that the earphone is in a motion state according to the motion signal.

[0093] Optionally, the first sensor and the second sensor are the same sensor, and the sensor type is a heavy acceleration sensor.

[0094] Optionally, the vibration signal acquisition module 710 is further configured to acquire the first audio signal collected by the microphone, and acquire the vibration signal collected by the first sensor when it is determined that there is a noise signal in the first audio signal.

[0095] Optionally, the noise cancellation module 720 is further configured to perform noise cancellation processing on the first audio signal based on the vibration signal when the noise signal and the vibration signal in the first audio signal come from the same vibration source.

[0096] In an embodiment of the present application, a noise cancellation device includes: a vibration signal acquisition module, configured to acquire a vibration signal collected by a first sensor when a microphone collects a first audio signal; a noise cancellation module, configured to perform noise cancellation processing on the first audio signal based on the vibration signal to obtain a second audio signal; wherein, the first audio signal includes a noise signal generated by vibration. When the first audio signal includes a noise signal generated by the vibration of the earphone, the vibration signal collected by the first sensor during the collection of the first audio signal by the microphone can be acquired, so there is a corresponding relationship between the noise signal and the vibration signal in the first audio signal, and then the noise signal in the first audio signal can be cancelled based on the vibration signal to obtain the second audio signal, improving the effect and accuracy of cancelling the noise signal generated by the vibration of the earphone in the first audio signal.

[0097] An embodiment of the present application further provides a computer storage medium, which stores multiple instructions, and the instructions are suitable for being loaded and executed by a processor to perform the steps of the method according to any one of the above embodiments.

[0098] Further, please refer to Figure 8 , Figure 8 which is a schematic structural diagram of an earphone provided by an embodiment of the present application. As Figure 8As shown in the figure, the headset 800 may include: at least one central processing unit 801, at least one network interface 804, a user interface 803, a memory 805, and at least one communication bus 802.

[0099] Among them, the communication bus 802 is used to implement connection communication between these components.

[0100] Among them, the user interface may include a standard wired interface and a wireless interface.

[0101] Among them, the network interface 804 may optionally include a standard wired interface and a wireless interface (such as a WI-FI interface).

[0102] Among them, the central processing unit 801 may include one or more processing cores. The central processing unit 801 connects various parts within the entire headset 800 using various interfaces and lines. By running or executing instructions, programs, code sets, or instruction sets stored in the memory 805, and by calling data stored in the memory 805, it performs various functions of the headset 800 and processes data. Optionally, the central processing unit 801 may be implemented in at least one hardware form of Digital Signal Processing (DSP), Field-Programmable Gate Array (FPGA), or Programmable Logic Array (PLA). The central processing unit 801 may integrate a combination of one or more of a Central Processing Unit (CPU), a Graphics Processing Unit (GPU), and a modem, etc. Among them, the CPU mainly processes the operating system, user interface, and application programs, etc.; the GPU is responsible for rendering and drawing the content to be displayed on the display screen; the modem is used to process wireless communication. It can be understood that the above modem may not be integrated into the central processing unit 801 and may be implemented separately by a single chip.

[0103] Among them, the memory 805 may include a Random Access Memory (RAM), or may also include a Read-Only Memory. Optionally, the memory 805 includes a non-transitory computer-readable storage medium. The memory 805 can be used to store instructions, programs, codes, code sets, or instruction sets. The memory 805 may include a program storage area and a data storage area. Among them, the program storage area may store instructions for implementing an operating system, instructions for at least one function (such as a touch function, a sound playback function, an image playback function, etc.), instructions for implementing the above-mentioned various method embodiments, etc.; the data storage area may store the data involved in the above-mentioned various method embodiments. Optionally, the memory 805 may also be at least one storage device located far from the aforementioned central processing unit 801. As Figure 8 shown, the memory 805, as a computer storage medium, may include an operating system, a network communication module, a user interface module, and a noise cancellation program.

[0104] In Figure 8 the earphone 800 shown, the user interface 803 is mainly used to provide an input interface for the user to obtain the data input by the user; and the central processing unit 801 can be used to call the noise cancellation program stored in the memory 805 and specifically perform the following operations:

[0105] When the microphone collects the first audio signal, obtain the vibration signal collected by the first sensor;

[0106] Based on the vibration signal, perform noise cancellation processing on the first audio signal to obtain a second audio signal;

[0107] Among them, the first audio signal includes a noise signal generated due to vibration.

[0108] Optionally, performing noise cancellation processing on the first audio signal based on the vibration signal includes: performing an inversion process on the vibration signal, and superimposing the first audio signal and the vibration signal after the inversion process to eliminate the noise signal in the first audio signal.

[0109] Optionally, performing noise cancellation processing on the first audio signal based on the vibration signal includes: subtracting the first audio signal from the vibration signal to eliminate the noise signal in the first audio signal.

[0110] Optionally, obtaining the vibration signal collected by the first sensor includes: obtaining the motion signal collected by the second sensor, and when it is determined according to the motion signal that the earphone is in a motion state, obtaining the vibration signal collected by the first sensor.

[0111] Optionally, the first sensor and the second sensor are the same sensor, and the sensor type is a heavy acceleration sensor.

[0112] Optionally, obtaining the vibration signal collected by the first sensor includes: obtaining the first audio signal collected by the microphone, and when it is determined that there is a noise signal in the first audio signal, obtaining the vibration signal collected by the first sensor.

[0113] Optionally, performing noise cancellation processing on the first audio signal based on the vibration signal includes: when the noise signal and the vibration signal in the first audio signal come from the same vibration source, performing noise cancellation processing on the first audio signal based on the vibration signal.

[0114] In several embodiments provided in the present application, it should be understood that the disclosed devices and methods can be implemented in other ways. For example, the device embodiments described above are merely illustrative. For example, the division of modules is only a logical function division. In actual implementation, there may be other division methods. For example, multiple modules or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the displayed or discussed couplings or direct couplings or communication connections to each other can be through some interfaces. The indirect couplings or communication connections of devices or modules can be in electrical, mechanical or other forms.

[0115] The modules described as separate components may or may not be physically separated. The components shown as modules may or may not be physical modules, that is, they may be located in one place, or they may be distributed to multiple network modules. Some or all of the modules can be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0116] In addition, the functional modules in each embodiment of the present application can be integrated into one processing module, or each module can exist physically alone, or two or more modules can be integrated into one module. The above integrated modules can be implemented in the form of hardware or in the form of software functional modules.

[0117] When the integrated module is implemented in the form of a software functional module and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application, in essence, or the part that contributes to the prior art, or all or part of the technical solution, can be embodied in the form of a software product. The computer software product is stored in a storage medium and includes several instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the methods in various embodiments of the present application. The foregoing storage medium includes: various media that can store program codes, such as USB flash drives, mobile hard disks, read-only memories (ROM, Read-Only Memory), random access memories (RAM, Random Access Memory), magnetic disks, or optical discs.

[0118] It should be noted that, for the foregoing method embodiments, for the sake of simplicity of description, they are all expressed as a series of action combinations. However, those skilled in the art should know that the present application is not limited by the described action sequence, because according to the present application, some steps can be performed in other sequences or simultaneously. Secondly, those skilled in the art should also know that the embodiments described in the specification are all preferred embodiments, and the actions and modules involved are not necessarily essential to the present application.

[0119] In the above embodiments, the descriptions of the various embodiments have their own emphases. For the parts not detailed in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.

[0120] The above is the description of a noise cancellation method, device, storage medium, and earphone provided by the present application. For those skilled in the art, according to the idea of the embodiments of the present application, there will be changes in the specific implementation manners and application scopes. In summary, the content of this specification should not be construed as a limitation to the present application.

Claims

1. A noise cancellation method, characterized in that, Applied to headphones, the method includes: When a microphone collects a first audio signal, obtaining a motion signal collected by a second sensor; wherein, the motion signal is used to determine the motion amplitude of the headphones; when the motion amplitude of the headphones reaches a motion amplitude threshold, it is determined that the headphones are in a motion state; When it is determined that the headphones are in a motion state according to the motion signal, obtaining the first audio signal collected by the microphone, and when it is determined that there is a noise signal in the first audio signal, obtaining a vibration signal generated when the headphones vibrate and collected by a first sensor; When the noise signal in the first audio signal and the vibration signal come from the same vibration source, performing noise cancellation processing on the first audio signal based on the vibration signal to obtain a second audio signal; Wherein, the first audio signal includes a noise signal generated due to the vibration of the headphones.

2. The method according to claim 1, wherein The performing noise cancellation processing on the first audio signal based on the vibration signal includes: Performing an inverting process on the vibration signal, and superimposing the first audio signal and the vibration signal after the inverting process to eliminate the noise signal in the first audio signal.

3. The method according to claim 1, wherein The performing noise cancellation processing on the first audio signal based on the vibration signal includes: Subtracting the first audio signal from the vibration signal to eliminate the noise signal in the first audio signal.

4. The method according to claim 1, wherein The first sensor and the second sensor are the same sensor, and the sensor type is a heavy acceleration sensor.

5. A noise cancellation device, characterized in that, Applied to headphones, the apparatus includes: A vibration signal acquisition module, configured to obtain a motion signal collected by a second sensor when a microphone collects a first audio signal; wherein, the motion signal is used to determine the motion amplitude of the headphones; when the motion amplitude of the headphones reaches a motion amplitude threshold, it is determined that the headphones are in a motion state; when it is determined that the headphones are in a motion state according to the motion signal, obtaining the first audio signal collected by the microphone, and when it is determined that there is a noise signal in the first audio signal, obtaining a vibration signal generated when the headphones vibrate and collected by a first sensor; A noise cancellation module, configured to perform noise cancellation processing on the first audio signal based on the vibration signal to obtain a second audio signal when the noise signal in the first audio signal and the vibration signal come from the same vibration source; Wherein, the first audio signal includes a noise signal generated due to the vibration of the headphones.

6. A computer storage medium, characterized in that, The computer storage medium stores multiple instructions, and the instructions are suitable for being loaded and executed by a processor to perform the steps of the method according to any one of claims 1 to 4.

7. A headphone, characterized in that, Including a memory, a processor, and a computer program stored on the memory and executable on the processor, and when the processor executes the program, the steps of the method according to any one of claims 1 to 4 are implemented.

Images