Audio playback method, device, earphone and storage medium

Abstract

The present application relates to an audio playback method, device, headset and storage medium. Applied to a headset, the headset includes a bone conduction microphone and a speaker, and the method includes: obtaining a first sound wave signal collected by the bone conduction microphone; the first sound wave signal is a sound wave signal conducted using the user's bones as a medium; generating a first audio signal according to the first sound wave signal; and controlling the speaker to play the first audio signal. This method can reduce the interference of ambient sound on the user's voice, thereby improving the playback effect of the audio signal.

Description

Technical Field

[0001] The present application relates to the field of earphone technology, and in particular to an audio playback method, device, earphone and storage medium. Background Art

[0002] Headphones are a widely used electronic device that allows users to listen to audio alone without disturbing others, or to answer calls. Whether it is a headset or an in-ear headset, it will block part of the air transmission of sound. Therefore, when users wear headphones to talk, they will hear their own voices relatively low, and thus involuntarily increase the volume.

[0003] Currently, this problem is usually solved by playing a side tone signal, that is, a microphone in the headset collects the user's voice, and then a speaker in the headset plays the side tone signal generated according to the user's voice.

[0004] However, the microphone will also collect ambient sound while collecting the user's voice. If it is in a high-noise environment, the ambient sound will cause relatively large interference to the user's voice, resulting in poor sidetone signal effect. Summary of the invention

[0005] Based on this, it is necessary to provide an audio playback method, device, headphones and storage medium that can reduce the interference of ambient sound on user voice and improve the audio playback effect in response to the above technical problems.

[0006] In a first aspect, an embodiment of the present disclosure provides an audio playback method, which is applied to headphones, where the headphones include a bone conduction microphone and a speaker, and the method includes:

[0007] Acquire a first sound wave signal collected by a bone conduction microphone; the first sound wave signal is a sound wave signal conducted through the user's bones as a medium;

[0008] generating a first audio signal according to the first sound wave signal;

[0009] The speaker is controlled to play the first audio signal.

[0010] In one embodiment, the method further comprises:

[0011] Detect the noise level of the headset's surrounding environment;

[0012] Correspondingly, the above-mentioned generating the first audio signal according to the first sound wave signal includes:

[0013] If the noise level is higher than the preset noise level threshold, a first audio signal is generated according to the first sound wave signal.

[0014] In one embodiment, the headset further includes a first air conduction microphone, and the method further includes:

[0015] If the noise level is lower than a preset noise level threshold, generating a second audio signal according to the second sound wave signal collected by the first air conduction microphone;

[0016] The speaker is controlled to play the second audio signal.

[0017] In one embodiment, the method further comprises:

[0018] Detecting the noise level of the surrounding environment of the headset;

[0019] Correspondingly, the above-mentioned obtaining of the first sound wave signal collected by the bone conduction microphone includes:

[0020] If the noise level is higher than the preset noise level threshold, the bone conduction microphone is turned on and the first sound wave signal collected by the bone conduction microphone is obtained.

[0021] In one embodiment, the headset further includes a first air conduction microphone, and the method further includes:

[0022] If the noise level is lower than the preset noise level threshold, the first air conduction microphone is turned on, and a second sound wave signal collected by the first air conduction microphone is obtained; the second sound wave signal is a sound wave signal conducted using air as a medium;

[0023] generating a second audio signal according to the second sound wave signal;

[0024] The speaker is controlled to play the second audio signal.

[0025] In one embodiment, the headset further includes a second air conduction microphone, and the above-mentioned detecting the noise level of the surrounding environment of the headset includes:

[0026] Acquire an ambient sound wave signal collected by a second air conduction microphone;

[0027] The signal-to-noise ratio between the speech audio signal and the noise audio signal in the environmental sound wave signal is detected to obtain the noise level.

[0028] In one embodiment, the step of generating the first audio signal according to the first sound wave signal includes:

[0029] Converting the first sound wave signal into an electrical signal to obtain a bone vibration electrical signal;

[0030] The bone vibration electrical signal is processed to obtain a first audio signal.

[0031] In a second aspect, an embodiment of the present disclosure provides an audio playback device, which is applied to headphones, wherein the headphones include a bone conduction microphone and a speaker, and the device includes:

[0032] A first sound wave acquisition module is used to acquire a first sound wave signal acquired by a bone conduction microphone; the first sound wave signal is a sound wave signal conducted using the user's bones as a medium;

[0033] A first audio generation module, used to generate a first audio signal according to the first sound wave signal;

[0034] The first audio playing module is used to control the speaker to play a first audio signal.

[0035] In one embodiment, the device further comprises:

[0036] A noise level detection module, used to detect the noise level of the surrounding environment of the headset;

[0037] Correspondingly, the first audio generation module is specifically configured to generate a first audio signal according to the first sound wave signal if the noise level is higher than a preset noise level threshold.

[0038] In one embodiment, the headset further includes a first air conduction microphone, and the device further includes:

[0039] A second audio generation module is used to generate a second audio signal according to a second sound wave signal collected by the first air conduction microphone if the noise level is lower than a preset noise level threshold; the second sound wave signal is a sound wave signal conducted using air as a medium;

[0040] The second audio playing module is used to control the speaker to play the second audio signal.

[0041] In one embodiment, the device further comprises:

[0042] A noise level detection module, used to detect the noise level of the surrounding environment of the headset;

[0043] Correspondingly, the first sound wave collection module is specifically configured to turn on the bone conduction microphone and obtain the first sound wave signal collected by the bone conduction microphone if the noise level is higher than a preset noise level threshold.

[0044] In one embodiment, the headset further includes a first air conduction microphone, and the device further includes:

[0045] A second sound wave acquisition module is used to turn on the first air conduction microphone to acquire a second sound wave signal acquired by the first air conduction microphone if the noise level is lower than a preset noise level threshold; the second sound wave signal is a sound wave signal conducted using air as a medium;

[0046] A second audio generation module, used to generate a second audio signal according to the second sound wave signal;

[0047] The second audio playing module is used to control the speaker to play the second audio signal.

[0048] In one of the embodiments, the headset also includes a second air conduction microphone, and the above-mentioned noise level detection module is specifically used to obtain the ambient sound wave signal collected by the second air conduction microphone; detect the signal-to-noise ratio between the voice audio signal and the noise audio signal in the ambient sound wave signal to obtain the noise level.

[0049] In one embodiment, the first audio generation module includes:

[0050] A signal conversion submodule, used for converting the first sound wave signal into an electrical signal to obtain a bone vibration electrical signal;

[0051] The signal processing submodule is used to process the bone vibration electrical signal to obtain a first audio signal.

[0052] In a third aspect, an embodiment of the present disclosure provides an earphone, comprising a bone conduction microphone, an air conduction microphone and a speaker, for implementing any of the steps described in the first aspect.

[0053] In a fourth aspect, an embodiment of the present disclosure provides a computer-readable storage medium having a computer program stored thereon, wherein the computer program, when executed by a processor, implements any of the steps described in the first aspect.

[0054] The above-mentioned audio playback method, device, headset and storage medium, the headset obtains the first sound wave signal collected by the bone conduction microphone; generates a first audio signal according to the first sound wave signal; and controls the speaker to play the first audio signal. Since in the audio collection stage, the first sound wave signal collected by the bone conduction microphone is generated by the vibration of the jaw when the user speaks, and the environmental sound (including noise) cannot cause bone vibration, the first audio signal generated according to the first sound wave signal does not contain the environmental sound, so it can reduce the interference of the environmental sound on the user's voice, thereby improving the playback effect of the audio signal. BRIEF DESCRIPTION OF THE DRAWINGS

[0055] Figure 1 A diagram showing an application environment of an audio playback method in an embodiment;

[0056] Figure 2 A schematic diagram of a flow chart of an audio playback method in one embodiment;

[0057] Figure 3 is a flowchart of an audio playing method in another embodiment;

[0058] Figure 4 A schematic diagram of a flow chart of an audio playing method in another embodiment;

[0059] Figure 5 A schematic diagram of a flow chart of an audio playing method in another embodiment;

[0060] Figure 6 A schematic diagram of a flow chart of an audio playing method in another embodiment;

[0061] Figure 7 is a flow chart of a step of detecting the noise level of the surrounding environment of the earphone in one embodiment;

[0062] Figure 8 A schematic diagram of a flow chart of a step of generating a first audio signal according to a first sound wave signal in an embodiment;

[0063] Fig. 9 One of the structural block diagrams of an audio playback device in an embodiment;

[0064] Fig.10 This is a second structural block diagram of an audio playback device in an embodiment;

[0065] Fig.11 This is a third structural block diagram of an audio playback device in an embodiment;

[0066] Fig.12 This is a fourth structural block diagram of an audio playback device in an embodiment;

[0067] Fig.13 This is the fifth structural block diagram of the audio playback device in one embodiment. DETAILED DESCRIPTION

[0068] In order to make the purpose, technical solution and advantages of the present application more clearly understood, the present application is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application and are not used to limit the present application.

[0069] The audio playback method provided in this application can be applied to Figure 1 In the application environment shown. The application environment includes headphones, and the headphones include a bone conduction microphone 101 and a speaker 102. Among them, the bone conduction microphone 101 includes a sound wave signal acquisition device. When a user wears the headphones, the headphones are in contact with the human body; when the user speaks, the jaw vibrates to generate a sound wave signal, and the sound wave signal acquisition device of the bone conduction microphone collects the sound wave signal. The above-mentioned sound wave signal acquisition device may include a variable capacitor, and the capacitance value of the variable capacitor changes with the change of the sound wave signal generated by the jaw vibration.

[0070] In an optional embodiment, the headset may further include an air conduction microphone. The air conduction microphone changes the air pressure through the sound waves of the user's voice. The air pressure causes the diaphragm of the air conduction microphone to vibrate, thereby collecting sound wave signals.

[0071] In an optional embodiment, the air conduction microphone includes a first air conduction microphone and a second air conduction microphone. The first air conduction microphone is located close to the wearer's mouth and is used to collect the user's voice; the second air conduction microphone is located on the earphone shell away from the ear canal and is used to collect ambient sound. The air conduction microphone can improve the signal ratio, cover the user's usage needs in most scenarios, and maintain the voice restoration and authenticity.

[0072] In one embodiment, the headset may be a TWS (True Wireless Stereo) Bluetooth headset. The working principle of the headset includes: the terminal is connected to the main headset wirelessly, and then the main headset is connected to the auxiliary headset wirelessly, so as to realize the wireless separation of the left and right channels of Bluetooth.

[0073] In one embodiment, Figure 2 As shown, an audio playback method is provided, which is applied to Figure 1 The following steps are used as an example to illustrate the use of the headset in Figure 1:

[0074] Step 201: Acquire a first sound wave signal collected by a bone conduction microphone.

[0075] The first sound wave signal is a sound wave signal transmitted through the user's bones.

[0076] When the user wearing the headset speaks, the jawbone vibrates to generate a first sound wave signal, and the headset collects the first sound wave signal through the bone conduction microphone. Since the bone conduction microphone collects the sound wave signal generated by the jawbone vibration, and the ambient sound (including noise) cannot cause bone vibration, the first audio signal generated according to the first sound wave signal does not contain the ambient sound. In this way, the denoising effect can be achieved in the initial signal collection stage.

[0077] Step 202: Generate a first audio signal according to the first sound wave signal.

[0078] After the earphone collects the first sound wave signal, the earphone processes the first sound wave signal. Exemplarily, the earphone converts the first sound wave signal into a bone vibration electrical signal, and generates the first audio signal according to the bone vibration electrical signal.

[0079] Step 203: Control the speaker to play the first audio signal.

[0080] After the earphone generates the first audio signal, the earphone sends the first audio signal to the speaker, and controls the speaker to play the first audio signal.

[0081] In the above audio playback method, the earphone obtains the first sound wave signal collected by the bone conduction microphone; generates the first audio signal according to the first sound wave signal; and controls the speaker to play the first audio signal. Since in the signal collection stage, the bone conduction microphone collects the first sound wave signal generated by the vibration of the jaw when the user speaks, and the environmental sound (including noise) cannot cause bone vibration, the first audio signal generated according to the first sound wave signal does not contain the environmental sound, so it can reduce the interference of the environmental sound on the user's voice, thereby improving the playback effect of the audio signal.

[0082] In one embodiment, Figure 3 As shown, based on the above embodiments, the embodiments of the present disclosure may further include:

[0083] Step 204: Detect the noise level of the surrounding environment of the earphone.

[0084] When the user wears the headset, the headset can automatically detect the noise level of the surrounding environment. One detection method may include: determining the noise volume in the ambient sound wave signal, if the noise volume is greater than a preset decibel value, then determining that the noise level is higher than a preset noise level threshold; if the noise volume is less than the preset decibel value, then determining that the noise level is lower than the preset noise level threshold. Other parameters can also be used to characterize the noise level, which is not limited in the embodiments of the present disclosure and can be set according to actual conditions.

[0085] In one embodiment, the earphone can adopt different audio signal processing modes according to whether the surrounding environment is detected to have a high noise level or a low noise level.

[0086] like Figure 3 As shown, in an audio signal processing method, step 202 may include: if the noise level is higher than a preset noise level threshold, generating a first audio signal according to the first sound wave signal.

[0087] In actual applications, the bone conduction microphone and the first air conduction microphone provided in the headset can collect signals at the same time. If the noise level is higher than the preset noise level threshold, it means that the noise level of the environment around the headset is a high noise level. At this time, if the user's voice is collected through the first air conduction microphone, a large amount of noise will be collected at the same time as the user's voice, which will increase the difficulty of subsequent audio signal processing and reduce the audio playback effect. Therefore, when it is detected that the noise level is higher than the preset noise level threshold, the headset generates a first audio signal based on the first sound wave signal collected by the bone conduction microphone.

[0088] In the above embodiment, the noise level of the surrounding environment of the headset is detected; if the noise level is higher than the preset noise level threshold, the first audio signal is generated according to the first sound wave signal. Through the embodiment of the present disclosure, the headset can automatically distinguish the noise level of the surrounding environment, and when the noise level is higher than the preset noise level threshold, the first audio signal is generated according to the first sound wave signal collected by the bone conduction microphone, so as to avoid the interference of the ambient sound on the user's voice, thereby improving the playback effect of the audio signal.

[0089] like Figure 4 As shown, in another audio signal processing method, the embodiment of the present disclosure may further include:

[0090] Step 205: if the noise level is lower than the preset noise level threshold, generate a second audio signal according to the second sound wave signal collected by the first air conduction microphone.

[0091] The second sound wave signal is a sound wave signal conducted using air as a medium.

[0092] In actual applications, the bone conduction microphone and the first air conduction microphone set in the headset collect signals at the same time. If the noise level is lower than the preset noise level threshold, it means that the surrounding environment of the headset is at a low noise level, and the noise in the environment does not interfere much with the user's voice. At this time, a second audio signal can be generated based on the second sound wave signal collected by the first air conduction microphone. Since the characteristic bandwidth of the sound wave signal collected by the first air conduction microphone is relatively wide, the restoration degree of the second audio signal can be guaranteed and the distortion can be reduced, thereby better ensuring the quality and clarity of the user's voice and improving the user experience.

[0093] There are many ways to generate the second audio signal, one of which may include: filtering the second sound wave signal and generating the second audio signal based on the filtered second sound wave signal. The filtering process may be to adjust the filter to focus on the voice content and filter out noise audio signals with different frequency bands from the voice content.

[0094] Step 206: Control the speaker to play the second audio signal.

[0095] In the above embodiment, if the noise level is lower than the preset noise level threshold, a second audio signal is generated according to the second sound wave signal collected by the first air conduction microphone, and the speaker is controlled to play the second audio signal. Through the embodiment of the present disclosure, when the noise level is lower than the preset noise level threshold, the second sound wave signal is collected by the first air conduction microphone. Since the characteristic bandwidth of the sound wave signal collected by the first air conduction microphone is relatively wide, the restoration degree of the second audio signal can be guaranteed and the distortion can be reduced, thereby better ensuring the quality and clarity of the user's voice and improving the user experience.

[0096] In one embodiment, the headset can also adopt different signal collection modes according to whether the surrounding environment is detected to have a high noise level or a low noise level. Figure 5 As shown, step 201 may include: if the noise level is higher than a preset noise level threshold, turning on the bone conduction microphone and acquiring a first sound wave signal collected by the bone conduction microphone.

[0097] In actual applications, the bone conduction microphone and the first air conduction microphone do not collect signals at the same time. The headset first detects the noise level of the surrounding environment. If the noise level is higher than the preset noise level threshold, the bone conduction microphone is turned on and used for signal collection.

[0098] Afterwards, the earphone obtains the first sound wave signal collected by the bone conduction microphone, generates a first audio signal according to the first sound wave signal, and then controls the speaker to play the first audio signal.

[0099] like Figure 6 As shown, the embodiment of the present disclosure may also include:

[0100] Step 207: If the noise level is lower than the preset noise level threshold, the first air conduction microphone is turned on, and a second sound wave signal collected by the first air conduction microphone is acquired.

[0101] The second sound wave signal is a sound wave signal conducted using air as a medium.

[0102] When the headset detects that the noise level of the surrounding environment is lower than the preset noise level threshold, the bone conduction microphone is not turned on, but the first air conduction microphone is turned on to obtain the second sound wave signal collected by the first air conduction microphone.

[0103] Step 208: Generate a second audio signal according to the second sound wave signal.

[0104] Step 209: Control the speaker to play the second audio signal.

[0105] In the above embodiment, the headset turns on the corresponding microphone to collect signals according to whether the surrounding environment has a high noise level or a low noise level, that is, when the bone conduction microphone is working, the first air conduction microphone is not working; when the first air conduction microphone is working, the bone conduction microphone is not working. In this way, the power consumption of the microphone can be saved.

[0106] In one embodiment, Figure 7 As shown, the earphone further includes a second air conduction microphone, and the step of detecting the noise level of the surrounding environment of the earphone may include:

[0107] Step 2041: Acquire the ambient sound wave signal collected by the second air conduction microphone.

[0108] The second air conduction microphone in the headset can be set to a normally open state to collect ambient sound wave signals in real time. Alternatively, the headset first determines whether the current state meets the detection trigger condition. If it is determined that the current state meets the detection trigger condition, the ambient sound wave signal is collected through the second air conduction microphone. Exemplarily, an infrared sensor is provided in the headset. When it is determined that the user is wearing the headset based on the infrared signal collected by the infrared sensor, it is determined that the current state meets the detection trigger condition, and the second air conduction microphone is turned on to collect the ambient sound wave signal. The disclosed embodiment does not limit the timing of the second air conduction microphone collecting the ambient sound wave signal.

[0109] In one embodiment, the second air conduction microphone and the first air conduction microphone may be the same microphone or different microphones.

[0110] Step 2042: Detect the signal-to-noise ratio between the speech audio signal and the noise audio signal in the ambient sound wave signal to obtain the noise level.

[0111] After collecting the ambient sound wave signal through the second air conduction microphone, the user's voice audio signal and the noise audio signal in the environment are identified from the ambient sound wave signal; then, the signal-to-noise ratio between the voice audio signal and the noise audio signal is calculated, and the calculated signal-to-noise ratio is used as the noise level.

[0112] In the above embodiment, the second air conduction microphone is used to collect the ambient sound wave signal; the signal-to-noise ratio between the voice audio signal and the noise audio signal in the ambient sound wave signal is detected to obtain the noise level. Through the embodiment of the present disclosure, the signal-to-noise ratio is used to characterize the noise level, and the calculation method of the signal-to-noise ratio is simple and easy to implement, so that the headset can quickly distinguish the noise level of the surrounding environment, thereby selecting a suitable audio signal collection method.

[0113] In one embodiment, Figure 8 As shown, the step of generating the first audio signal according to the first sound wave signal may include:

[0114] Step 2021: convert the first sound wave signal into an electrical signal to obtain a bone vibration electrical signal.

[0115] The bone conduction microphone is provided with a variable capacitor, and the capacitance value of the variable capacitor changes with the change of the first sound wave signal. Therefore, the first sound wave signal can be converted into a bone vibration electrical signal represented by the capacitance value of the variable capacitor.

[0116] Alternatively, an inductor is also provided in the bone conduction microphone, and a capacitor-inductor circuit is formed by a variable capacitor and an inductor. The resonant frequency of the capacitor-inductor circuit changes with the capacitance value of the variable capacitor. Therefore, when the capacitance value of the variable capacitor changes with the change of the first sound wave signal, the resonant frequency of the capacitor-inductor circuit also changes accordingly, and different frequency values ​​are obtained, thereby forming a bone vibration electrical signal by different frequency values.

[0117] Step 2022: Process the bone vibration electrical signal to obtain a first audio signal.

[0118] Since the bone vibration electrical signal may also include an echo audio signal and a noise audio signal, the generated audio signal is not clear enough; or the gain of the bone vibration electrical signal is not large enough, resulting in a low volume of the audio signal when it is played. Therefore, after obtaining the bone vibration electrical signal, it is necessary to perform some processing on the bone vibration electrical signal to obtain the first audio signal for the speaker to play.

[0119] Among them, the signal processing of the bone vibration electrical signal may include at least one of the following: performing echo elimination processing on the bone vibration electrical signal; performing filtering processing on the bone vibration electrical signal; and performing gain adjustment processing on the bone vibration electrical signal.

[0120] The above-mentioned echo cancellation processing of the bone vibration electrical signal may include: taking the audio signal played by the speaker as the echo audio signal, removing the echo audio signal from the bone vibration electrical signal, and obtaining the first audio signal with the echo cancelled.

[0121] The above-mentioned filtering process of the bone vibration electrical signal may include: filtering out the audio signal exceeding the preset frequency range in the bone vibration electrical signal to obtain the first audio signal of filtered noise. The embodiment of the present disclosure does not limit the preset frequency range.

[0122] The above-mentioned gain adjustment processing of the bone vibration electrical signal includes: if the gain of the bone vibration electrical signal is lower than the first gain threshold, then the gain of the bone vibration electrical signal is increased; if the gain of the bone vibration electrical signal is higher than the second gain threshold, then the gain of the bone vibration electrical signal is reduced. Wherein, the first gain threshold is lower than the second gain threshold, and the first gain threshold and the second gain threshold are not limited in the embodiment of the present disclosure.

[0123] Exemplarily, an automatic gain control (AGC) module is provided in the earphone, which increases the gain of the bone vibration electrical signal when the user's voice is low, and reduces the gain of the bone vibration electrical signal when the user's voice is high, so that the generated first audio signal always remains in a relatively stable state.

[0124] In addition, in order to make the audio signal sound more real and natural and improve the user experience, the part of the bone vibration electrical signal that is reduced during the noise reduction process can also be compensated to ensure that the complete user voice can be played when the speaker plays the first audio signal.

[0125] In the above embodiment, the first sound wave signal is converted into an electrical signal to obtain a bone vibration electrical signal; the bone vibration electrical signal is processed to obtain a first audio signal. Through the disclosed embodiment, the headset converts the first sound wave signal into a bone vibration electrical signal, and performs echo cancellation, filtering, and gain adjustment on the bone vibration electrical signal, which can not only ensure the playback effect of the audio signal, but also make the audio signal sound more real and natural, thereby improving the user experience.

[0126] It should be understood that although Figures 2 to 8 The steps in the flowchart are shown in sequence as indicated by the arrows, but these steps are not necessarily executed in the order indicated by the arrows. Unless otherwise specified in this document, there is no strict order restriction for the execution of these steps, and these steps can be executed in other orders. Moreover, Figures 2 to 8 At least part of the steps may include multiple steps or multiple stages. These steps or stages are not necessarily performed at the same time, but can be performed at different times. The execution order of these steps or stages is not necessarily sequential, but can be performed in turn or alternately with other steps or at least part of the steps or stages in other steps.

[0127] In one embodiment, Fig. 9 As shown, an audio playback device is provided, comprising:

[0128] The first sound wave acquisition module 301 is used to acquire a first sound wave signal acquired by a bone conduction microphone; the first sound wave signal is a sound wave signal conducted through the user's bones as a medium;

[0129] A first audio generation module 302, configured to generate a first audio signal according to a first sound wave signal;

[0130] The first audio playing module 303 is used to control the speaker to play the first audio signal.

[0131] In one embodiment, if Fig.10 As shown, the device also includes:

[0132] A noise level detection module 304, used to detect the noise level of the surrounding environment of the headset;

[0133] Correspondingly, the first audio generation module 302 is specifically configured to generate a first audio signal according to the first sound wave signal if the noise level is higher than a preset noise level threshold.

[0134] In one embodiment, the headset further includes a first air conduction microphone, such as Fig.11 As shown, the device also includes:

[0135] A second audio generation module 305 is configured to generate a second audio signal according to the second sound wave signal collected by the first air conduction microphone if the noise level is lower than a preset noise level threshold;

[0136] The second audio playing module 306 is used to control the speaker to play the second audio signal.

[0137] In one embodiment, if Fig.12 As shown, the device also includes:

[0138] A noise level detection module 304, used to detect the noise level of the surrounding environment of the headset;

[0139] The first sound wave collection module 301 is specifically configured to turn on the bone conduction microphone and obtain the first sound wave signal collected by the bone conduction microphone if the noise level is higher than a preset noise level threshold.

[0140] In one embodiment, the headset further includes a first air conduction microphone, such as Fig.13 As shown, the device also includes:

[0141] The second sound wave acquisition module 307 is used to turn on the first air conduction microphone and acquire the second sound wave signal acquired by the first air conduction microphone if the noise level is lower than a preset noise level threshold;

[0142] A second audio generation module 305, configured to generate a second audio signal according to the second sound wave signal;

[0143] The second audio playing module 306 is used to control the speaker to play the second audio signal.

[0144] In one embodiment, the headset also includes a second air conduction microphone, and the above-mentioned noise level detection module 304 is specifically used to obtain the ambient sound wave signal collected by the second air conduction microphone; detect the signal-to-noise ratio between the voice audio signal and the noise audio signal in the ambient sound wave signal to obtain the noise level.

[0145] In one embodiment, the first audio generation module 302 includes:

[0146] A signal conversion submodule, used for converting the first sound wave signal into an electrical signal to obtain a bone vibration electrical signal;

[0147] The signal processing submodule is used to process the bone vibration electrical signal to obtain a first audio signal.

[0148] For the specific definition of the audio playback device, please refer to the definition of the audio playback method above, which will not be repeated here. Each module in the above audio playback device can be implemented in whole or in part by software, hardware and a combination thereof. The above modules can be embedded in or independent of the processor in the headset in hardware form, or can be stored in the memory in the headset in software form, so that the processor can call and execute the operations corresponding to the above modules.

[0149] In one embodiment, a headset is provided, the headset comprising a bone conduction microphone, an air conduction microphone and a speaker, and the headset is used to implement the following steps:

[0150] Acquire a first sound wave signal collected by a bone conduction microphone; the first sound wave signal is a sound wave signal conducted through the user's bones as a medium;

[0151] generating a first audio signal according to the first sound wave signal;

[0152] The speaker is controlled to play the first audio signal.

[0153] In one embodiment, the headset further implements the following steps:

[0154] Detect the noise level of the headset's surrounding environment;

[0155] If the noise level is higher than the preset noise level threshold, a first audio signal is generated according to the first sound wave signal.

[0156] In one embodiment, the headset further includes a first air conduction microphone, and the headset further implements the following steps:

[0157] If the noise level is lower than the preset noise level threshold, a second audio signal is generated according to the second sound wave signal collected by the first air conduction microphone; the second sound wave signal is a sound wave signal conducted using air as a medium;

[0158] The speaker is controlled to play the second audio signal.

[0159] In one embodiment, the headset further implements the following steps:

[0160] Detect the noise level of the headset's surrounding environment;

[0161] If the noise level is higher than the preset noise level threshold, the bone conduction microphone is turned on and the first sound wave signal collected by the bone conduction microphone is obtained.

[0162] In one embodiment, the headset further includes a first air conduction microphone, and the headset further implements the following steps:

[0163] If the noise level is lower than the preset noise level threshold, the first air conduction microphone is turned on, and a second sound wave signal collected by the first air conduction microphone is obtained; the second sound wave signal is a sound wave signal conducted using air as a medium;

[0164] generating a second audio signal according to the second sound wave signal;

[0165] The speaker is controlled to play the second audio signal.

[0166] In one embodiment, the headset further includes a second air conduction microphone, and the headset further implements the following steps:

[0167] Acquire a second air conduction microphone to collect ambient sound wave signals;

[0168] The signal-to-noise ratio between the speech audio signal and the noise audio signal in the environmental sound wave signal is detected to obtain the noise level.

[0169] In one embodiment, the headset further implements the following steps:

[0170] Converting the first sound wave signal into an electrical signal to obtain a bone vibration electrical signal;

[0171] The bone vibration electrical signal is processed to obtain a first audio signal.

[0172] In one embodiment, a computer readable storage medium is provided, on which a computer program is stored, and when the computer program is executed by a processor, the following steps are implemented:

[0173] Acquire a first sound wave signal collected by a bone conduction microphone; the first sound wave signal is a sound wave signal conducted through the user's bones as a medium;

[0174] generating a first audio signal according to the first sound wave signal;

[0175] The speaker is controlled to play the first audio signal.

[0176] In one embodiment, when the computer program is executed by a processor, the following steps are also implemented:

[0177] Detect the noise level of the headset's surrounding environment;

[0178] If the noise level is higher than the preset noise level threshold, a first audio signal is generated according to the first sound wave signal.

[0179] In one embodiment, the headset further includes a first air conduction microphone, and when the computer program is executed by the processor, the following steps are further implemented:

[0180] If the noise level is lower than the preset noise level threshold, a second audio signal is generated according to the second sound wave signal collected by the first air conduction microphone; the second sound wave signal is a sound wave signal conducted using air as a medium;

[0181] The speaker is controlled to play the second audio signal.

[0182] In one embodiment, when the computer program is executed by a processor, the following steps are also implemented:

[0183] Detect the noise level of the headset's surrounding environment;

[0184] If the noise level is higher than the preset noise level threshold, the bone conduction microphone is turned on and the first sound wave signal collected by the bone conduction microphone is obtained.

[0185] In one embodiment, the headset further includes a first air conduction microphone, and when the computer program is executed by the processor, the following steps are further implemented:

[0186] If the noise level is lower than the preset noise level threshold, the first air conduction microphone is turned on to obtain a second sound wave signal collected by the first air conduction microphone; the second sound wave signal is a sound wave signal conducted using air as a medium;

[0187] generating a second audio signal according to the second sound wave signal;

[0188] The speaker is controlled to play the second audio signal.

[0189] In one embodiment, the headset further includes a second air conduction microphone, and when the computer program is executed by the processor, the following steps are further implemented:

[0190] Acquire a second air conduction microphone to collect ambient sound wave signals;

[0191] The signal-to-noise ratio between the speech audio signal and the noise audio signal in the environmental sound wave signal is detected to obtain the noise level.

[0192] In one embodiment, when the computer program is executed by a processor, the following steps are also implemented:

[0193] Converting the first sound wave signal into an electrical signal to obtain a bone vibration electrical signal;

[0194] The bone vibration electrical signal is processed to obtain a first audio signal.

[0195] Those of ordinary skill in the art can understand that all or part of the processes in the above-mentioned embodiment methods can be completed by instructing the relevant hardware through a computer program, and the computer program can be stored in a non-volatile computer-readable storage medium. When the computer program is executed, it can include the processes of the embodiments of the above-mentioned methods. Among them, any reference to memory, storage, database or other media used in the embodiments provided in this application can include at least one of non-volatile and volatile memory. Non-volatile memory can include read-only memory (ROM), magnetic tape, floppy disk, flash memory or optical memory, etc. Volatile memory can include random access memory (RAM) or external cache memory. As an illustration and not limitation, RAM can be in various forms, such as static random access memory (SRAM) or dynamic random access memory (DRAM).

[0196] The technical features of the above embodiments may be combined arbitrarily. To make the description concise, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.

[0197] The above-mentioned embodiments only express several implementation methods of the present application, and the descriptions thereof are relatively specific and detailed, but they cannot be understood as limiting the scope of the invention patent. It should be pointed out that, for a person of ordinary skill in the art, several variations and improvements can be made without departing from the concept of the present application, and these all belong to the protection scope of the present application. Therefore, the protection scope of the patent of the present application shall be subject to the attached claims.

Claims

1. An audio playback method, characterized in that: Applied to earphones, the earphones comprising a bone conduction microphone, a speaker, a first air conduction microphone and a second air conduction microphone; wherein the first air conduction microphone is located close to the wearer's mouth for collecting the user's voice; the second air conduction microphone is located on the earphone housing away from the ear canal for collecting ambient sound; the method comprises: Detecting a noise level of an environment surrounding the headset according to the ambient sound collected by the second air conduction microphone; If the noise level is higher than a preset noise level threshold, the bone conduction microphone is turned on, and a first sound wave signal collected by the bone conduction microphone is acquired; the first sound wave signal is a sound wave signal conducted through the user's bones as a medium; generating a first audio signal according to the first sound wave signal; Controlling the speaker to play the first audio signal; If the noise level is lower than the preset noise level threshold, the first air conduction microphone is turned on, and a second sound wave signal collected by the first air conduction microphone is obtained; the second sound wave signal is a sound wave signal conducted using air as a medium; generating a second audio signal according to the second sound wave signal; The speaker is controlled to play the second audio signal.

2. The method according to claim 1, characterized in that The method further comprises: Detecting the noise level of the surrounding environment of the headset; Correspondingly, generating a first audio signal according to the first sound wave signal includes: If the noise level is higher than a preset noise level threshold, a first audio signal is generated according to the first sound wave signal.

3. The method according to claim 2, characterized in that The headset includes a first air conduction microphone, and the method further includes: If the noise level is lower than the preset noise level threshold, generating a second audio signal according to the second sound wave signal collected by the first air conduction microphone; the second sound wave signal is a sound wave signal conducted using air as a medium; The speaker is controlled to play the second audio signal.

4. The method according to claim 1, characterized in that: The method further comprises: Acquiring an ambient sound wave signal collected by the second air conduction microphone; The signal-to-noise ratio between the speech audio signal and the noise audio signal in the environmental sound wave signal is detected to obtain the noise level.

5. The method according to claim 1, characterized in that The step of generating a first audio signal according to the first sound wave signal comprises: Converting the first sound wave signal into an electrical signal to obtain a bone vibration electrical signal; The bone vibration electrical signal is processed to obtain the first audio signal.

6. An audio playback device, characterized in that: Applied to earphones, the earphones include a bone conduction microphone, a speaker, a first air conduction microphone and a second air conduction microphone; wherein the first air conduction microphone is located close to the wearer's mouth for collecting the user's voice; the second air conduction microphone is located on the earphone housing away from the ear canal for collecting ambient sound; the device includes: a noise level detection module, configured to detect the noise level of the surrounding environment of the headset according to the ambient sound collected by the second air conduction microphone; A first sound wave acquisition module, configured to turn on the bone conduction microphone and acquire a first sound wave signal acquired by the bone conduction microphone if the noise level is higher than a preset noise level threshold; the first sound wave signal is a sound wave signal conducted through the user's bones; A first audio generating module, configured to generate a first audio signal according to the first sound wave signal; A first audio playing module, used for controlling the speaker to play the first audio signal; a second sound wave acquisition module, configured to, if the noise level is lower than the preset noise level threshold, turn on the first air conduction microphone and acquire a second sound wave signal acquired by the first air conduction microphone; the second sound wave signal is a sound wave signal conducted using air as a medium; A second audio generating module, used for generating a second audio signal according to the second sound wave signal; The second audio playing module is used to control the speaker to play the second audio signal.

7. A headset, characterized in that: The earphone includes a bone conduction microphone and a speaker, and is characterized in that the earphone also includes a first air conduction microphone and a second air conduction microphone; wherein the first air conduction microphone is located close to the wearer's mouth for collecting the user's voice; the second air conduction microphone is located on the earphone shell away from the ear canal for collecting ambient sound; the earphone is used to implement the steps of any one of the methods of claims 1 to 5.

8. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 5 are implemented.

Images