Pickup method and device and sound playing method and device

Abstract

The embodiment of the invention discloses a pickup method and device, a sound playing method and device, terminal equipment, an earphone and a storage medium. According to the embodiment of the invention, the terminal equipment collects the external sound signal, processes the sound signal, and then sends the sound signal to the earphone for playing. As the distance between the terminal equipment and the earphone is relatively long, while the squeal phenomenon is avoided, the gain of the sound signal can be improved in the process of processing the sound signal, so that the gain reaches 50db or even higher, the hearing aid effect is improved, the requirements of a user with serious hearing loss can be met, and the user experience is improved. The technical problem that hearing aid equipment in the prior art is poor in hearing aid effect is solved. In addition, most functions of signal acquisition, signal processing and the like are integrated on the terminal equipment to be executed, so that the power consumption of the earphone is reduced, and the endurance time of the earphone is prolonged.

Description

Technical Field

[0001] The embodiments of the present application relate to the field of hearing aids, and in particular to a sound pickup method and device, a sound playback method and device, a terminal device, headphones, and a storage medium. Background Art

[0002] At present, in order to ensure the normal life of the hearing-impaired, hearing-assistive devices are generally used to assist the hearing-impaired to obtain external sounds, such as hearing aids. A hearing aid is a small loudspeaker that can amplify sounds that are originally inaudible, and then use the residual hearing of the hearing-impaired to send the sound to the auditory center of the brain, so that the sound can be felt, which brings great convenience to the hearing-impaired. The hearing-assistive devices on the market generally use microphones to pick up sounds. However, due to the small size of the hearing-assistive devices, the distance between the microphone and the speaker is relatively close. When the sound gain is large, howling is likely to occur. When the sound source is slightly far away, the sound pickup effect is not good, and the hearing-assistive effect is poor.

[0003] In summary, the hearing aid devices in the prior art have the technical problem of poor hearing aid effect. Summary of the invention

[0004] The embodiments of the present invention provide a sound pickup method and device, a sound playback method and device, a terminal device, headphones and a storage medium, which can improve the hearing aid effect of the hearing assistive device and solve the technical problem that the hearing assistive device in the prior art has a poor hearing aid effect.

[0005] In a first aspect, an embodiment of the present invention provides a sound pickup method, the method being applicable to a terminal device connected to a headset for communication, the method comprising:

[0006] Switch to the sound pickup auxiliary state to collect the initial sound signal from the outside world in real time;

[0007] Performing gain processing on the initial sound signal to obtain a first sound signal;

[0008] The first sound signal is sent to the earphone in real time so that the earphone plays the first sound signal.

[0009] Preferably, performing gain processing on the initial sound signal to obtain the first sound signal includes:

[0010] Preprocessing the initial sound signal to obtain a preprocessed sound signal;

[0011] Perform gain processing on the preprocessed sound signal to obtain the first sound signal.

[0012] Preferably, the preprocessing of the initial sound signal to obtain a preprocessed sound signal includes:

[0013] The initial sound signal is subjected to noise reduction processing, voice enhancement processing, howling suppression processing and spectrum shifting processing to obtain a preprocessed sound signal.

[0014] Preferably, performing gain processing on the preprocessed sound signal to obtain the first sound signal includes:

[0015] The preprocessed sound signal is gain-processed according to a pre-obtained hearing curve to obtain the first sound signal.

[0016] In a second aspect, an embodiment of the present invention provides a sound playing method, the method being applicable to a headset connected to a terminal device for communication, the method comprising:

[0017] Receiving in real time a first sound signal sent by the terminal device;

[0018] Play the first sound signal.

[0019] In a third aspect, an embodiment of the present invention provides a sound pickup device, which is applicable to a terminal device connected to a headset for communication, and the sound pickup device includes:

[0020] The sound acquisition module is used to switch to the sound pickup auxiliary state and collect the initial sound signal from the outside in real time;

[0021] A gain processing module, used for performing gain processing on the initial sound signal to obtain a first sound signal;

[0022] The sound sending module is used to send the first sound signal to the earphone in real time so that the earphone plays the first sound signal.

[0023] In a fourth aspect, an embodiment of the present invention provides a sound playing device, the sound playing device being applicable to a headset connected to a terminal device for communication, the sound playing device comprising:

[0024] A sound receiving module, used for receiving in real time a first sound signal sent by the terminal device;

[0025] The sound playing module is used to play the first sound signal.

[0026] In a fifth aspect, an embodiment of the present invention provides a terminal device, comprising a microphone, a first Bluetooth module and a first processor, wherein the first processor is connected to the microphone and the first Bluetooth module.

[0027] The microphone is used to acquire sound signals.

[0028] The first Bluetooth module is used to establish a communication connection with the headset.

[0029] The first processor is used to switch to the sound pickup auxiliary state, and collect the initial sound signal from the outside in real time through the microphone; to perform gain processing on the initial sound signal to obtain a first sound signal; and to send the first sound signal to the headset in real time through the first Bluetooth module, so that the headset plays the first sound signal.

[0030] In a sixth aspect, an embodiment of the present invention provides an earphone, the earphone comprising a speaker, a second Bluetooth module and a second processor, wherein the second processor is connected to the speaker and the second Bluetooth module;

[0031] The speaker is used to play sound;

[0032] The second Bluetooth module is used to establish a communication connection with the terminal device;

[0033] The second processor is used to receive the first sound signal sent by the terminal device in real time through the second Bluetooth module, and play the first sound signal through the speaker.

[0034] In a seventh aspect, an embodiment of the present invention provides a storage medium storing computer executable instructions, which, when executed by a computer processor, are used to execute a sound pickup method as described in the first aspect or a sound playback method as described in the second aspect.

[0035] As mentioned above, in this embodiment, the terminal device collects external sound signals, processes the sound signals, and then sends them to the headphones for playback. Since the terminal device is far away from the headphones, while avoiding the howling phenomenon, the gain of the sound signal can be increased during the processing of the sound signal, so that the gain reaches 50db or even higher, thereby improving the hearing aid effect and meeting the needs of users with severe hearing loss, solving the technical problem of poor hearing aid effect in the prior art hearing aid devices. In addition, the embodiment of the present invention integrates most of the functions such as signal acquisition and signal processing into the terminal device for execution, which reduces the power consumption of the headphones and increases the battery life of the headphones. BRIEF DESCRIPTION OF THE DRAWINGS

[0036] Figure 1 A schematic flow chart of a sound pickup method provided by an embodiment of the present invention.

[0037] Figure 2 A schematic diagram of a hearing curve provided by an embodiment of the present invention.

[0038] Figure 3 A schematic diagram of a user using a terminal device and a headset provided in an embodiment of the present invention.

[0039] Figure 4 A schematic diagram of the structure of a terminal device provided by an embodiment of the present invention.

[0040] Figure 5 A schematic diagram of a terminal device provided in an embodiment of the present invention includes multiple microphones.

[0041] Figure 6 A flowchart of a sound playing method provided by an embodiment of the present invention.

[0042] Figure 7 A schematic structural diagram of an earphone provided in an embodiment of the present invention.

[0043] Figure 8 A schematic structural diagram of a sound pickup device provided by an embodiment of the present invention.

[0044] Fig. 9 A schematic diagram of the structure of a sound playing device provided by an embodiment of the present invention.

[0045] Reference numerals:

[0046] Smart watch 1, earphones 2. DETAILED DESCRIPTION

[0047] The following description and accompanying drawings fully illustrate the specific embodiments of the present application so that those skilled in the art can practice them. The examples represent possible variations only. Unless explicitly required, separate components and functions are optional, and the order of operation can vary. The parts and features of some embodiments may be included in or replace the parts and features of other embodiments. The scope of the embodiments of the present application includes the entire scope of the claims, and all available equivalents of the claims. In this article, each embodiment may be represented individually or generally by the term "invention", which is only for convenience, and if more than one invention is disclosed in fact, it is not intended to automatically limit the scope of the application to any single invention or inventive concept. In this article, relational terms such as first and second, etc. are only used to distinguish one entity or operation from another entity or operation, without requiring or implying any actual relationship or order between these entities or operations. Moreover, the term "include", "comprise" or any other variant thereof is intended to cover non-exclusive inclusion, so that the process, method or device including a series of elements includes not only those elements, but also other elements that are not explicitly listed. The various embodiments are described in a progressive manner herein, and each embodiment focuses on the differences from other embodiments. The same or similar parts between the various embodiments can be referred to each other. As for the structures, products, etc. disclosed in the embodiments, since they correspond to the parts disclosed in the embodiments, the description is relatively simple, and the relevant parts can be referred to the description of the method part.

[0048] like Figure 1 As shown, Figure 1 A flowchart of a sound pickup method provided in an embodiment of the present invention. The sound pickup method provided in an embodiment of the present invention is applicable to a terminal device that is communicatively connected to a headset. The terminal device may be implemented by software and / or hardware. The terminal device may be composed of two or more physical entities or one physical entity. In this embodiment, the terminal device has functions such as sound signal collection and sound signal processing. For example, the terminal device may be a wearable device such as a smart bracelet, a smart watch, and smart glasses. In addition, the communication connection method between the terminal device and the headset may be a wireless connection or a wired connection, which is not specifically limited in this embodiment. The sound pickup method provided in an embodiment of the present invention includes the following steps:

[0049] Step 101, switching to the sound pickup auxiliary state, collecting the initial sound signal from the outside in real time.

[0050] In this embodiment, when the user needs hearing assistance, he can wear headphones. When the headphones detect that they are worn by the user, the headphones will establish a Bluetooth connection with the terminal device. After that, when the user sends a sound pickup assistance instruction to the terminal device, the terminal device switches to the sound pickup assistance state after receiving the sound pickup assistance instruction. In the sound pickup assistance state, the terminal device will collect the initial sound signal from the outside in real time.

[0051] Step 102: Perform gain processing on the initial sound signal to obtain a first sound signal.

[0052] After acquiring the initial sound signal in real time, the terminal device performs gain processing on the initial sound signal to filter out noise in the initial sound signal and improve the quality of the initial sound signal, thereby obtaining a first sound signal.

[0053] Based on the above embodiment, in step 102, the initial sound signal is subjected to gain processing to obtain a first sound signal, including:

[0054] Step 1021: preprocess the initial sound signal to obtain a preprocessed sound signal.

[0055] In one embodiment, the initial sound signal may be preprocessed to obtain a preprocessed sound signal. Exemplarily, the process of preprocessing the initial sound signal includes: performing noise reduction processing, voice enhancement processing, howling suppression processing and spectrum shifting processing on the initial sound signal.

[0056] Among them, noise reduction processing refers to reducing the noise in the initial sound signal. The noise reduction processing method can be any one of the frequency domain noise reduction method, time domain noise reduction method, wavelet domain noise reduction method, Kalman filtering method and deep learning-based noise reduction method. The frequency domain noise reduction algorithm is based on the frequency characteristics of the signal. By analyzing the difference between the noise and the signal in the signal spectrum, the noise component is separated from the signal to achieve noise elimination. In the field of audio processing, the commonly used frequency domain noise reduction algorithms are FIR filters and Kalman filters based on fast Fourier transform. The time domain noise reduction algorithm mainly separates and eliminates noise by analyzing the time domain waveform characteristics of the noise signal and the non-noise signal. The time domain noise reduction algorithm usually includes an adaptive noise reduction algorithm and a noise reduction algorithm based on deep learning. Wavelet transform is a signal decomposition and reconstruction technology that can decompose the signal into multiple frequency components and perform corresponding processing on each component. In the field of noise reduction, the wavelet domain noise reduction algorithm can be analyzed and processed based on both the frequency domain and the time domain. Kalman filtering is a common state estimation algorithm that can achieve modeling and prediction of noise signals, and then eliminate noise through modeling. The Kalman filter algorithm is often used in fields such as noise elimination and image interpolation. Its characteristic is that it can be improved and optimized based on the estimated value of the previous moment and the current observed value. The basic idea of ​​the denoising method based on deep learning is to enable the model to automatically analyze and optimize the signal under different noise scenarios through training.

[0057] Voice enhancement processing aims to reduce noise, eliminate echoes, and handle other interference to provide clearer and more understandable speech. The commonly used voice enhancement algorithms include: Noise Suppression: By analyzing the difference between the voice signal and the background noise, the noise is partially suppressed or reduced, thereby improving the quality of the voice signal. Echo Cancellation: Used to remove the echo caused by feedback between the microphone and the speaker to ensure clear two-way communication. Adaptive Filtering: Automatically adjust the filter parameters to suppress noise and retain the important features of the voice signal according to the noise and noise in the real-time environment. Spectral Enhancement: By performing spectral analysis and processing on the voice signal, the information within the voice frequency range is highlighted to improve the clarity and intelligibility of the voice. Speech Codec: Use compression and decompression algorithms to reduce the storage and transmission overhead of voice data while maintaining the voice quality as much as possible.

[0058] Howling suppression processing refers to eliminating the howling phenomenon in the initial sound signal. The howling phenomenon refers to the audio signal being picked up by the microphone again after being played through the speaker, after a certain propagation path, and after being processed by the amplifier, and finally played through the speaker. If there is some positive feedback in the closed-loop circuit of "speaker-microphone-speaker" that causes some audio frequencies to self-oscillate, howling will occur. At present, phase modulation method, gain control method and adaptive feedback cancellation method can generally be used to suppress the howling phenomenon. Phase modulation method is essentially frequency shift method and phase shift method. The principle of frequency shift method and phase shift method for howling suppression is to move the frequency component of the input signal forward or backward, so that the superposition phenomenon between the input signal and the acoustic feedback signal frequency disappears, or the acoustic feedback phase and the input signal phase deviate, destroying the phase condition for howling formation, thereby achieving the purpose of suppressing howling. The gain control method destroys the amplitude condition for howling formation by reducing the gain in the positive feedback loop, thereby achieving the effect of howling suppression. The adaptive feedback cancellation method (AFC) models and identifies the sound propagation path according to the input signal, thereby estimating the acoustic feedback signal, and finally subtracts the estimated acoustic feedback signal from the input signal of the microphone to achieve howling suppression.

[0059] Spectrum shifting is a digital signal processing technology used to shift the spectrum of a signal to a higher or lower frequency. The principle of spectrum shifting is to use the sampling theorem of digital signals to shift the spectrum of the signal in the frequency domain. Specifically, if you want to shift the spectrum of a signal to a high frequency, you can multiply the signal by a sine wave in the time domain so that its frequency is the target frequency being shifted. Conversely, if you want to shift the spectrum of a signal to a low frequency, you can multiply the signal by a cosine wave in the time domain so that its frequency is the negative value of the target frequency being shifted. Spectrum shifting can be used in applications such as tone shifting, pitch conversion, and music synthesis in digital audio processing.

[0060] The above is the specific process of preprocessing the initial sound signal to obtain the preprocessed sound signal.

[0061] Step 1022: Perform gain processing on the preprocessed sound signal to obtain a first sound signal.

[0062] After obtaining the preprocessed sound signal, the preprocessed sound signal may be further subjected to gain processing to obtain the first sound signal. In one embodiment, the preprocessed sound signal may be subjected to gain processing according to the pre-obtained hearing curve to obtain the first sound signal. It should be noted that the core algorithm for compensating for hearing loss is the multi-channel compression algorithm, or the WDRC (wide dynamic range compression) algorithm. The WDRC algorithm can compress the external sound signal into the range that the user can hear according to the hearing curve tested by the user, such as Figure 2As shown, the user can hear some sounds that cannot be heard without wearing hearing aids. Each user has a different hearing curve. When the user's hearing loss is more serious, a stronger gain is required. Therefore, in this embodiment, the wearable device can use the WDRC algorithm to perform gain processing on the preprocessed sound signal according to the hearing curve obtained by pre-measuring the user's hearing, thereby obtaining a first sound signal. Since the terminal device is far away from the headset, a gain in the range of 25db-50db or even higher can be achieved.

[0063] Step S103: Send the first sound signal to the earphone in real time, so that the earphone plays the first sound signal.

[0064] After receiving the first sound signal, the terminal device can send the first sound signal to the headset in real time. In one embodiment, the terminal device and the headset are connected via Bluetooth, and the terminal device can transmit the first sound signal to the headset via the BLE AUDIO (Bluetooth LEAudio, low-power Bluetooth audio) protocol, so that the delay can be controlled within 50ms, and the use effect is consistent with that of conventional auxiliary listening headsets, achieving a better auxiliary listening effect. After receiving the first sound signal, the headset plays the first sound signal, and uses the first sound signal played by the headset to listen to the headset. Figure 3 As shown, Figure 3 In the figure, the terminal device is a smart watch 1. After the user wears the earphone 2, the user can control the smart watch 1 to enter the sound pickup auxiliary state. The smart watch 1 starts to collect external sound signals and perform gain processing on the sound signals. After the smart watch 1 obtains the first sound signal, the first sound signal can be sent to the earphone 2 for playback.

[0065] In one embodiment, a terminal device has a structure such as Figure 4 As shown, Figure 4 In the embodiment, the terminal device includes a microphone, a first Bluetooth module and a first processor, and the first processor is connected to the microphone and the first Bluetooth module.

[0066] The microphone is used to acquire sound signals.

[0067] In this embodiment, a microphone is provided on the terminal device. The microphone is an energy conversion device that converts sound signals into electrical signals. There are classifications such as dynamic, capacitor, electret, silicon micro-microphone, liquid microphone and laser microphone. Most microphones are electret capacitor microphones, and their working principle is to use a polymer material vibration membrane with permanent charge isolation to convert the vibration signal into an electrical signal, thereby realizing sound collection. In this embodiment, the microphone is used to collect external sound signals. In one embodiment, in order to avoid poor sound pickup due to angles, multiple microphones can be set in the terminal device to collect sound signals in different directions, thereby improving the multi-directional sound pickup effect of the microphone, such as Figure 5 shown.

[0068] The first Bluetooth module is used to establish a communication connection with the headset.

[0069] The first processor is used to switch to the sound pickup auxiliary state, and collect the initial sound signal from the outside world in real time through the microphone; to perform gain processing on the initial sound signal to obtain a first sound signal; and to send the first sound signal to the earphone in real time through the first Bluetooth module, so that the earphone plays the first sound signal.

[0070] The first processor is used to switch to the sound pickup auxiliary state. After receiving the sound pickup auxiliary instruction, the microphone collects the initial sound signal from the outside in real time, and then performs gain processing on the initial sound signal to obtain the first sound signal. The gain processing of the initial sound signal can refer to the above description process, which will not be repeated in this embodiment. After obtaining the first sound signal, the first sound signal can be sent to the headset in real time through the first Bluetooth module. After receiving the first sound signal, the headset plays the first sound signal.

[0071] As described above, an embodiment of the present invention provides a sound pickup method. In this embodiment, the terminal device collects external sound signals, processes the sound signals, and then sends them to the headphones for playback. Since the terminal device is far away from the headphones, while avoiding the howling phenomenon, the gain of the sound signal can be increased during the processing of the sound signal, so that the gain reaches 50db or even higher, thereby improving the hearing aid effect and meeting the needs of users with severe hearing loss, solving the technical problem of poor hearing aid effect in the prior art hearing aid devices. In addition, the embodiment of the present invention integrates most of the functions such as signal acquisition and signal processing into the terminal device for execution, which reduces the power consumption of the headphones and increases the battery life of the headphones.

[0072] like Figure 6 As shown, Figure 6 A sound playing method provided in an embodiment of the present invention is applicable to a headset connected to a terminal device for communication. The method includes:

[0073] Step 201: Receive a first sound signal sent by a terminal device in real time.

[0074] Step 202: Play a first sound signal.

[0075] In this embodiment, the headset is used to receive the first sound signal sent by the terminal device in real time, and after receiving the first sound signal, play the first sound signal. In another embodiment, after receiving the first sound signal, the headset can further perform noise reduction processing and howling suppression processing on the first sound signal to generate a second sound signal, thereby ensuring that the second sound signal will not cause noise damage to the user's hearing. Afterwards, the headset plays the second sound signal.

[0076] In one embodiment, Figure 7 As shown, Figure 7 A schematic diagram of the structure of an earphone provided by an embodiment of the present invention, Figure 7 In the embodiment, the earphone includes a speaker, a second Bluetooth module and a second processor, and the second processor is connected to the speaker and the second Bluetooth module;

[0077] The speaker is used to play sound.

[0078] The second Bluetooth module is used to establish a communication connection with the terminal device.

[0079] The second processor is used to receive the first sound signal sent by the terminal device in real time through the second Bluetooth module, and play the first sound signal through the speaker.

[0080] In this embodiment, after the second processor is used to receive the first sound signal sent by the terminal device in real time through the second Bluetooth module, the second processor can play the first sound signal through the speaker. In another embodiment, the second processor can also further perform noise reduction processing and howling suppression processing on the first sound signal to obtain a second sound signal, and then play the second sound signal through the speaker.

[0081] As described above, an embodiment of the present invention provides a sound pickup method. In this embodiment, the terminal device collects external sound signals, processes the sound signals, and then sends them to the headphones for playback. Since the terminal device is far away from the headphones, while avoiding the howling phenomenon, the gain of the sound signal can be increased during the processing of the sound signal, so that the gain reaches 50db or even higher, thereby improving the hearing aid effect and meeting the needs of users with severe hearing loss, solving the technical problem of poor hearing aid effect in the prior art hearing aid devices. In addition, the embodiment of the present invention integrates most of the functions such as signal acquisition and signal processing into the terminal device for execution, which reduces the power consumption of the headphones and increases the battery life of the headphones.

[0082] like Figure 8 As shown, Figure 8 A schematic diagram of the structure of a sound pickup device provided by an embodiment of the present invention, Figure 8 In the embodiment, the sound pickup device is suitable for a terminal device connected to the earphone for communication, and the sound pickup device includes:

[0083] The sound acquisition module 301 is used to switch to the sound pickup auxiliary state and collect the initial sound signal from the outside in real time;

[0084] The gain processing module 302 is used to perform gain processing on the initial sound signal to obtain a first sound signal;

[0085] The sound sending module 303 is used to send the first sound signal to the earphone in real time so that the earphone plays the first sound signal.

[0086] Based on the above embodiment, the gain processing module includes:

[0087] A preprocessing submodule, used for preprocessing the initial sound signal to obtain a preprocessed sound signal;

[0088] The gain processing submodule is used to perform gain processing on the preprocessed sound signal to obtain a first sound signal.

[0089] On the basis of the above-mentioned embodiment, the preprocessing submodule is specifically used to perform noise reduction processing, voice enhancement processing, howling suppression processing and spectrum shifting processing on the initial sound signal to obtain a preprocessed sound signal.

[0090] On the basis of the above embodiment, it is specifically used to perform gain processing on the preprocessed sound signal according to the pre-obtained hearing curve to obtain the first sound signal.

[0091] The sound pickup device provided in the embodiment of the present invention is included in a terminal device and can be used to execute the sound pickup method provided in the above embodiment, and has corresponding functions and beneficial effects.

[0092] It is worth noting that in the embodiment of the above-mentioned sound pickup device, the various units and modules included are only divided according to functional logic, but are not limited to the above-mentioned division, as long as the corresponding functions can be achieved; in addition, the specific names of the functional units are only for the convenience of distinguishing each other, and are not used to limit the scope of protection of the present invention.

[0093] like Fig. 9 As shown, Fig. 9 A schematic diagram of the structure of a sound playing device provided by an embodiment of the present invention, Fig. 9 In the embodiment, the sound playing device is suitable for a headset connected to the terminal device for communication, and the sound playing device includes:

[0094] The sound receiving module 304 is used to receive the first sound signal sent by the terminal device in real time;

[0095] The sound noise reduction module 305 is used to play the first sound signal.

[0096] The sound playing device provided in the embodiment of the present invention is included in the earphone and can be used to execute the sound playing method provided in the above embodiment, and has corresponding functions and beneficial effects.

[0097] It is worth noting that in the embodiment of the above-mentioned sound playback device, the various units and modules included are only divided according to functional logic, but are not limited to the above-mentioned division, as long as the corresponding functions can be achieved; in addition, the specific names of the functional units are only for the convenience of distinguishing each other, and are not used to limit the scope of protection of the present invention.

[0098] The embodiment of the present invention further provides a storage medium containing computer executable instructions, and the computer executable instructions are used to perform a sound pickup method when executed by a computer processor, the method comprising:

[0099] Switch to the sound pickup auxiliary state to collect the initial sound signal from the outside world in real time;

[0100] Performing gain processing on the initial sound signal to obtain a first sound signal;

[0101] The first sound signal is sent to the earphone in real time so that the earphone plays the first sound signal.

[0102] Or execute a sound playing method, the method comprising:

[0103] Receiving a first sound signal sent by a terminal device in real time;

[0104] Play the first sound signal.

[0105] Note that the above are only preferred embodiments of the present invention and the technical principles used. Those skilled in the art will understand that the embodiments of the present invention are not limited to the specific embodiments herein, and that various obvious changes, readjustments and substitutions can be made by those skilled in the art without departing from the protection scope of the embodiments of the present invention. Therefore, although the embodiments of the present invention are described in more detail through the above embodiments, the embodiments of the present invention are not limited to the above embodiments, and may include more other equivalent embodiments without departing from the concept of the embodiments of the present invention, and the scope of the embodiments of the present invention is determined by the scope of the appended claims.

Claims

1. A sound pickup method, characterized in that: The method is applicable to a terminal device connected to the headset for communication, and the method comprises: Switch to the sound pickup auxiliary state to collect the initial sound signal from the outside world in real time; Performing gain processing on the initial sound signal to obtain a first sound signal; The first sound signal is sent to the earphone in real time so that the earphone plays the first sound signal.

2. A sound pickup method according to claim 1, characterized in that: The step of performing gain processing on the initial sound signal to obtain a first sound signal includes: Preprocessing the initial sound signal to obtain a preprocessed sound signal; Perform gain processing on the preprocessed sound signal to obtain the first sound signal.

3. A sound pickup method according to claim 2, characterized in that: The preprocessing of the initial sound signal to obtain a preprocessed sound signal includes: The initial sound signal is subjected to noise reduction processing, voice enhancement processing, howling suppression processing and spectrum shifting processing to obtain a preprocessed sound signal.

4. A sound pickup method according to claim 2, characterized in that: The step of performing gain processing on the preprocessed sound signal to obtain the first sound signal includes: The preprocessed sound signal is gain-processed according to a pre-obtained hearing curve to obtain the first sound signal.

5. A sound playing method, characterized in that: The method is applicable to a headset connected to a terminal device for communication, and the method comprises: Receiving in real time a first sound signal sent by the terminal device; Play the first sound signal.

6. A sound pickup device, characterized in that: The sound pickup device is suitable for a terminal device connected to a headset for communication, and the sound pickup device comprises: The sound acquisition module is used to switch to the sound pickup auxiliary state and collect the initial sound signal from the outside in real time; A gain processing module, used for performing gain processing on the initial sound signal to obtain a first sound signal; The sound sending module is used to send the first sound signal to the earphone in real time so that the earphone plays the first sound signal.

7. A sound playing device, characterized in that: The sound playing device is suitable for a headset connected to the terminal device for communication, and the sound playing device includes: A sound receiving module, used for receiving in real time a first sound signal sent by the terminal device; The sound playing module is used to play the first sound signal.

8. A terminal device, characterized in that: The terminal device includes a microphone, a first Bluetooth module and a first processor, and the first processor is connected to the microphone and the first Bluetooth module; The microphone is used to obtain sound signals; The first Bluetooth module is used to establish a communication connection with the headset; The first processor is used to switch to the sound pickup auxiliary state, and collect the initial sound signal from the outside in real time through the microphone; and is used to perform gain processing on the initial sound signal to obtain the first sound signal; And used for sending the first sound signal to the earphone in real time through the first Bluetooth module, so that the earphone plays the first sound signal.

9. A headset, characterized in that: The headset includes a speaker, a second Bluetooth module and a second processor, and the second processor is connected to the speaker and the second Bluetooth module; The speaker is used to play sound; The second Bluetooth module is used to establish a communication connection with the terminal device; The second processor is used to receive the first sound signal sent by the terminal device in real time through the second Bluetooth module, and play the first sound signal through the speaker.

10. A storage medium storing computer executable instructions, characterized in that: The computer executable instructions are used to execute a sound pickup method as described in any one of claims 1 to 4 or a sound playing method as described in claim 5 when executed by a computer processor.

Images