Method for reducing sound gain of wearing user, earphone and storage medium

Abstract

The embodiment of the invention discloses a method for reducing the sound gain of a wearing user, an earphone and a storage medium, and the method comprises the steps: obtaining the current vibration information of the earphone through a vibration sensor, and obtaining the current audio through a microphone, and the current audio comprises the audio of the wearing user and the audio of a non-wearing user; generating a target audio corresponding to the current vibration information according to the correlation relationship; the correlation relationship comprises a corresponding relationship between the amplitude of the vibration information of the earphone and the amplitude of the audio frequency under different frequency bands; the phase of the target audio is opposite to the phase of the audio corresponding to the current vibration information determined according to the corresponding relation; and carrying out superposition and amplification processing on the target audio and the current audio, and obtaining and outputting the processed audio. By implementing the method, the sound of the earphone wearing user can be filtered and amplified during conversation, and the processed audio is output, so that the earphone wearing user can hear the audio content of the conversation object more clearly.

Description

Technical Field

[0001] The present application relates to the technical field of sound processing, and in particular to a method for reducing the sound gain of a user wearing the headset, a headset, and a storage medium. Background Art

[0002] Modern technology and environment make it easier for people to be exposed to high volume environments, causing hearing loss at a younger age. At the same time, with the current aging population, the number of people with hearing loss has increased significantly. People with hearing loss need to use hearing aids, auxiliary hearing headphones and other products to amplify external sounds for listening, which has led to an explosive growth in the research and development of such sound gain methods and related products. At the same time, in some specific scenarios, people without hearing loss also need to use the transparency mode or other similar functions of existing headphones to receive external sounds and amplify and process them before feeding them back to the wearer.

[0003] In the current sound gain solution, the conversation noise reduction algorithm only eliminates ambient noise. When the headphone wearer and the conversation partner speak at the same time during a conversation, the voice of the headphone wearer will be picked up and amplified. Since the voice of the headphone wearer is closer to the headphone microphone, the sound pressure level is higher than that of the other party's voice. After being amplified by the sound gain algorithm, the voice of the wearer is much louder than the voice of the conversation partner, and there is a problem of not being able to hear the other party's voice. Summary of the invention

[0004] The embodiment of the present application discloses a method for reducing the sound gain of a wearing user, headphones, and a storage medium. By implementing the method, the voice of the wearing user of the headphones can be filtered out during a conversation, and the audio of the filtered-out part of the wearing user's voice can be amplified.

[0005] In order to achieve the above-mentioned object, a first aspect of an embodiment of the present application provides a method for reducing the sound gain of a user wearing the headset, the method being applied to the headset, comprising:

[0006] Acquire current vibration information of the headset through a vibration sensor of the headset, and acquire current audio through a microphone of the headset, wherein the current audio includes audio of a wearing user and a non-wearing user;

[0007] Generate a target audio corresponding to the current vibration information according to the correlation relationship; the correlation relationship includes a correspondence between the amplitude of the vibration information of the earphone and the amplitude of the audio in different frequency bands; the phase of the target audio is opposite to the phase of the audio corresponding to the current vibration information determined according to the correspondence relationship;

[0008] The target audio and the current audio are superimposed and amplified to obtain and output the processed audio.

[0009] In the embodiment of the present application, generating a target audio corresponding to the current vibration information according to the correlation relationship includes:

[0010] Determining an initial audio amplitude corresponding to the amplitude of the current vibration information from the correlation relationship;

[0011] Inverting the initial audio amplitude to obtain a target audio amplitude;

[0012] The target audio is obtained according to the target audio amplitude.

[0013] In the embodiment of the present application, the correlation relationship is pre-stored in a storage medium of the headset, or,

[0014] The correlation relationship is calculated based on collected sample data; the sample data includes sample vibration information of the earphone obtained by the vibration sensor when the wearing user is in a sounding state, and sample audio of the wearing user obtained by the microphone.

[0015] In the embodiment of the present application, the superimposing and amplifying the target audio and the current audio to obtain and output the processed audio includes:

[0016] Superimposing the target audio with the current audio in a time domain alignment manner to obtain superimposed audio;

[0017] The superimposed audio is amplified by adopting a segmented gain algorithm to obtain the processed audio.

[0018] In the embodiment of the present application, before generating the target audio corresponding to the current vibration information according to the correlation relationship, the method provided in the embodiment of the present application further includes:

[0019] Determining whether the wearing user is in a sounding state according to the current vibration information;

[0020] When the wearing user is in the sound-emitting state, the function of controlling the earphone to reduce the sound gain of the wearing user is turned on, a target audio corresponding to the current vibration information is generated according to the correlation relationship, the target audio and the current audio are superimposed and amplified, and the processed audio is obtained and output.

[0021] In the embodiment of the present application, after determining whether the wearing user is in a sounding state according to the current vibration information, the method provided in the embodiment of the present application further includes:

[0022] When the wearing user is not in the sound-generating state, the function of reducing the wearing user's sound gain of the headset is controlled to be in a closed state to output the current audio.

[0023] In the embodiment of the present application, the vibration information includes at least one of a vibration frequency and an amplitude, and judging whether the wearing user is in a sounding state according to the current vibration information includes:

[0024] Determine whether the parameter value of the vibration information is within a corresponding parameter threshold interval, where the parameter threshold interval is a value range of at least one parameter of the vibration frequency and amplitude when the wearing user is in the sounding state;

[0025] When the parameter value of the vibration information is within the corresponding parameter threshold interval, it is determined that the wearing user is in the sound emitting state.

[0026] In the embodiment of the present application, after the function of controlling the headset to reduce the sound gain of the wearing user is turned on, the method further includes:

[0027] When the time duration during which the wearing user is not in the sound emitting state is greater than or equal to a preset time duration, the function of controlling the headset to reduce the sound gain of the wearing user is in a closed state.

[0028] In the embodiment of the present application, the current audio is audio obtained by performing noise reduction processing on the initial audio collected by the microphone.

[0029] A second aspect of the embodiment of the present application provides a headset, comprising:

[0030] A collection module, used to obtain current vibration information of the headset through the vibration sensor, and to obtain current audio through the microphone, wherein the current audio includes audio of the wearing user and the non-wearing user;

[0031] A processing module is used to generate a target audio corresponding to the current vibration information according to a correlation relationship; the correlation relationship includes a correspondence between the amplitude of the vibration information of the earphone and the amplitude of the audio in different frequency bands; the phase of the target audio is opposite to the phase of the audio corresponding to the current vibration information determined according to the correspondence; and the target audio and the current audio are superimposed and amplified.

[0032] The output module is used to output the audio after the target audio and the current audio are superimposed and amplified.

[0033] A third aspect of an embodiment of the present application provides a headset, including:

[0034] A memory storing executable program code;

[0035] and a processor coupled to the memory;

[0036] The processor calls the executable program code stored in the memory, and when the executable program code is executed by the processor, the processor implements the method provided in the embodiment of the present application.

[0037] A fourth aspect of an embodiment of the present application provides a computer-readable storage medium having executable program code stored thereon. When the executable program code is executed by a processor, the method provided in the embodiment of the present application is implemented.

[0038] The present application provides a method for reducing the sound gain of a wearing user, a headset, and a storage medium. In the method, the microphone of the headset collects the current audio containing the conversation content of the wearing user and the non-wearing user. The vibration sensor of the headset collects the current vibration information containing the conversation content of the wearing user. Since the vibration sensor and the microphone have different sensitivities in collecting data of different frequency bands, that is, the amplitude of the current vibration information of the conversation content collected by the wearing user is different from the amplitude of the current audio, the current vibration information needs to be processed to complete subsequent operations. The current vibration information is adjusted according to the correlation relationship to conform to the corresponding relationship between the amplitude of the vibration information and the amplitude of the audio in different frequency bands, and a target audio with a phase opposite to the phase of the audio corresponding to the current vibration information determined according to the corresponding relationship is obtained. For example, the processed data is inverted according to the corresponding relationship, that is, the amplitude value of the processed data is inverted, so as to obtain the target audio. Then, the target audio obtained by the vibration information processing is superimposed with the current audio, wherein the opposite phase part will be offset, thereby filtering out the sound information of the wearing user in the audio collected by the microphone, and finally amplifying and outputting the processed audio. By using this method, the user wearing the headset can filter out his or her own voice when talking to others and hear the amplified audio content more clearly. BRIEF DESCRIPTION OF THE DRAWINGS

[0039] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings required for use in the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0040] Figure 1 A schematic diagram of an example of the structure of the earphone provided in an embodiment of the present application;

[0041] Figure 2 A flowchart illustrating a method for reducing the sound gain of a wearing user provided in an embodiment of the present application;

[0042] Figure 3Another flowchart of the method for reducing the sound gain of a wearing user provided in an embodiment of the present application;

[0043] Figure 4 A flowchart illustrating the activation state of the function of reducing the sound gain of the wearing user in the method provided in an embodiment of the present application;

[0044] Figure 5 A schematic diagram of converting sound waves from the time domain to the frequency domain in the method provided in an embodiment of the present application;

[0045] Figure 6 A schematic diagram of the structure of the earphone provided in an embodiment of the present application;

[0046] Figure 7 A schematic diagram of the structure of the earphone provided in an embodiment of the present application. DETAILED DESCRIPTION

[0047] To make the purpose, technical solution and advantages of the embodiments of the present application clearer, the specific technical solution of the present application will be further described in detail below in conjunction with the drawings in the embodiments of the present application. The following embodiments are used to illustrate the present application, but are not used to limit the scope of the present application.

[0048] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as those commonly understood by those skilled in the art to which this application belongs. The terms used herein are only for the purpose of describing the embodiments of this application and are not intended to limit this application.

[0049] In the following description, reference is made to “some embodiments”, which describe a subset of all possible embodiments, but it will be understood that “some embodiments” may be the same subset or different subsets of all possible embodiments and may be combined with each other without conflict.

[0050] It should be pointed out that the terms "first\second\third" involved in the embodiments of the present application are used to distinguish similar or different objects, and do not represent a specific ordering of the objects. It can be understood that "first\second\third" can be interchanged in a specific order or sequence where permitted, so that the embodiments of the present application described here can be implemented in an order other than that illustrated or described here.

[0051] Using headphones to collect external audio content and amplify the volume of the audio content is a common method of sound gain processing. This method provides convenience for the majority of hearing-impaired people and those in need in special scenarios. However, for the current sound gain method, if noise processing is required, only environmental noise is considered to be filtered out. When the headphone wearer is talking to others, the voice of the headphone wearer is closer to the microphone that collects sound information, so the sound pressure level is greater than that of the other party. This also causes the voice of the headphone wearer to be louder than the other party in the audio information after sound gain processing, and the other party's voice cannot be heard clearly. At this time, the voice of the wearer is a kind of noise that needs to be filtered out for the sound gain algorithm. The existing noise reduction processing algorithm is not ideal for filtering out the voice of the specified wearer in the set conversation scenario, or requires a large amount of real-time computing operations that are not applicable to headphones.

[0052] It can be seen that the sound processing method in the related art will cause the volume of the voice of the user wearing the earphone to be too loud when the volume of the conversation audio is gain processed, and thus the user cannot hear the other party's conversation content clearly.

[0053] In view of this, an embodiment of the present application provides a method for reducing the sound gain of the wearer. During implementation, the method can filter out the wearer's own voice when the earphone collects external sounds and amplifies the volume, so that the wearer can listen to the conversation content more clearly.

[0054] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0055] See also Figure 1 , is a schematic diagram of an example structure of an earphone provided in an embodiment of the present application. Figure 1 As shown, the headset includes a vibration sensor 101 and a microphone 102, wherein:

[0056] like Figure 1 As shown, a structure of an earphone using the method for reducing the sound gain of the user provided in the embodiment of the present application is shown. The illustrated structure is only for demonstration purposes. The earphone provided in the embodiment of the present application can be in a wired form, a neck-hanging Bluetooth form, a wireless Bluetooth form, a head-mounted form, etc., which will not be described here.

[0057] The vibration sensor 101 is used to collect vibration information of the earphone.

[0058] In some application embodiments, the vibration sensor may be a bone voiceprint sensor, which is a vibration sensor that recognizes a speaker's voice information through bone conduction.

[0059] In the embodiment of the present application, the vibration information collected by the vibration sensor includes vibration frequency and amplitude. It can be understood that the vibration sensor collects data by sensing the vibration of bones or skin. When the user wearing the headset is talking to the non-wearing user, due to the way the vibration sensor collects data itself, the external sound or other environmental variables have little interference with the vibration sensor, so the vibration information collected by the vibration sensor can be used to represent the voice information of the wearing user, and the subsequent operations are completed according to the collected vibration frequency and amplitude.

[0060] It should be noted that the function of the vibration sensor is to collect vibration information of the headset. In some application embodiments, the vibration sensor can be installed in the headband part of the headset, inside the earmuff, or the contact surface between the headset and the wearer, so as to ensure that the vibration sensor can contact the head or ear of the wearer and accurately collect the vibration signal. The choice of installation position depends on the specific headset design and is not limited here.

[0061] The microphone 102 is used to collect audio content outside the headset.

[0062] In some application embodiments, the microphone may be a micro-electro-mechanical system (MEMS) microphone, or may also be referred to as a MEMS microphone, which is a miniaturized microphone having the advantages of miniaturization, low energy consumption, high sensitivity, and high reliability.

[0063] In the embodiment of the present application, the audio collected by the microphone includes the audio content of the wearing user and the non-wearing user, and the audio may include parameters such as frequency and amplitude information. Since the absolute value of the sound intensity is too different from the sound with the smallest intensity that people can hear to the sound with such intensity that it can cause people's pain, it is inconvenient to use the absolute value of the sound intensity to represent the size of the sound, so the concept of sound pressure level is used. The sound pressure level is defined based on the logarithmic ratio of the sound pressure, so as to describe a very wide range of sound energy. It can be understood that the sound pressure level is an indicator of the size of the sound pressure. It can be understood that the audio collected by the microphone is transmitted through the air medium. During the conversation between the headphone wearing user and the non-wearing user, the microphone will inevitably collect the audio content of the wearing user and the non-wearing user at the same time. Since the sound source of the wearing user is closer to the microphone when speaking, this also leads to a larger sound pressure level of the wearing user's voice. When the collected audio is gain processed to amplify the volume, the volume of the wearer's voice in the amplified audio will be much larger than the volume of the conversation object's voice. At this time, it is necessary to use the method provided in the embodiment of the present application to filter out the audio part of the wearing user in the collected audio.

[0064] It should be noted that in some application embodiments, the headphones implement a directional sound pickup function through a specific algorithm or device. This function allows the device to selectively receive sounds in a specific direction through the sound pickup device, while reducing or suppressing sounds in other directions. However, the headphones equipped with a directional sound pickup function still have a portion of the sound made by the wearing user being picked up and amplified. It is still necessary to filter out the audio portion of the wearing user through the method of reducing the sound gain of the wearing user provided in the embodiment of the present application, so as to achieve the purpose of amplifying the audio portion of the non-wearing user.

[0065] In the above scheme, vibration information containing the conversation content of the wearing user is collected by the vibration sensor, and audio containing the conversation content between the wearing user and the non-wearing user is collected by the microphone.

[0066] After collecting the vibration information and audio, the collected data needs to be further processed so that the wearer can filter out his or her own voice when talking to others and hear the amplified audio content more clearly.

[0067] See also Figure 2 , which is a flowchart of a method for reducing the sound gain of a wearing user provided in an embodiment of the present application, may include the following steps:

[0068] Step 201: Acquire current vibration information of the earphone through a vibration sensor, and acquire current audio through a microphone.

[0069] The method comprises acquiring current vibration information of the headset through a vibration sensor of the headset, and acquiring current audio through a microphone of the headset, wherein the current audio includes audio of a wearing user and a non-wearing user.

[0070] Step 202: Generate target audio corresponding to the current vibration information according to the correlation relationship.

[0071] The correlation relationship includes the correspondence between the amplitude of the vibration information of the earphone and the amplitude of the audio in different frequency bands; the phase of the target audio is opposite to the phase of the audio corresponding to the current vibration information determined according to the correspondence.

[0072] It should be noted that in the low-frequency range, the vibration sensor has a higher sensitivity to the collection of vibration information, so the vibration sensor is more sensitive than the microphone in capturing low-frequency vibrations. This is because the solid medium has a better transmission effect on vibrations at low frequencies, so the vibration sensor can effectively monitor these low-frequency vibration information. However, in the high-frequency range, since the microphone directly collects audio content transmitted through the air, the microphone is more sensitive to high-frequency audio. In contrast, the transmission effect of vibration information in the high-frequency range is poor. Because the vibration sensor and the microphone have different sensitivities to sound frequencies, when the vibration sensor and the microphone collect the same content, there will be a certain difference between the waveform of the collected vibration information and the waveform of the audio. Due to the certain difference in the waveform, if the vibration information is inverted and superimposed with the audio, the amplitude of the inverted vibration information cannot offset the amplitude of the audio of the user wearing the audio, and the collected vibration information needs to be adjusted.

[0073] Exemplarily, when the data collected by the vibration sensor and the microphone only contains the voice of the wearer, the waveform of the vibration information collected by the vibration sensor and the waveform of the audio collected by the microphone will still be different due to the difference in the performance of the sound broadcasting medium and the sensor itself. In the technical field related to sound processing, the processing of waveforms mainly includes: sampling quantization, feature extraction, filtering, waveform adjustment, and waveform analysis. In the embodiment of the present application, since the reverse superposition method will be used in the subsequent processing to filter out the audio part of the wearer in the audio collected by the microphone, and the error in the time domain, that is, the frequency, when different sensors collect data is small, the processing method of the waveform in the embodiment of the present application is to adjust the waveform amplitude, and the waveform of the vibration information collected by the vibration sensor needs to be adjusted to make it close to the waveform of the audio collected when the microphone receives the same sound. It should be noted that the adjustment of the waveform of the vibration information in the above description to make it close to the waveform of the audio means that the amplitude of the vibration information is adjusted in the corresponding frequency band so that its amplitude is close to the amplitude of the corresponding audio.

[0074] In the method provided in the embodiment of the present application, generating a target audio corresponding to the current vibration information according to the correlation relationship includes:

[0075] Determining an initial audio amplitude corresponding to the amplitude of the current vibration information from the correlation relationship;

[0076] Inverting the initial audio amplitude to obtain a target audio amplitude;

[0077] The target audio is obtained according to the target audio amplitude.

[0078] In an embodiment of the present application, the correlation relationship may include, in different frequency bands, the corresponding relationship between the amplitude of the vibration information collected by the vibration sensor and the amplitude of the audio collected by the microphone. After obtaining the corresponding relationship, the target audio corresponding to the current vibration information is generated according to the corresponding relationship. It can be seen from the above description that the vibration sensor and the microphone have different collection sensitivities to the sound frequency, and the amplitude modulation factor is obtained by the corresponding relationship between the vibration information obtained by the vibration sensor and the audio obtained by the microphone in different frequency bands. Because the amplitude of different frequency bands needs to be adjusted, in order to facilitate the operation, the current vibration information is first Fourier transformed to obtain the spectrum diagram of the current vibration information. The spectrum diagram shows the distribution of the signal in frequency, usually using the horizontal axis to represent the frequency, and the vertical axis to represent the amplitude or energy of the signal. The spectrum diagram can show the relative strength and distribution of each frequency component in the signal, which can help analyze the frequency components, spectrum characteristics and frequency domain characteristics of the sound. The amplitude of the vibration information in the corresponding frequency band can be adjusted through the spectrum diagram of the vibration information. According to the amplitude modulation factor and the spectrum diagram, the amplitude of the current vibration information is changed in the frequency domain, so that the amplitude of the processed current vibration information is close to the amplitude of the audio of the user wearing the device collected by the microphone. After adjusting the amplitude of the vibration information, the adjusted vibration information needs to be inverted and superimposed with the audio collected by the microphone. Since the superposition operation requires the vibration information to be aligned with the revelation point of the audio, the current vibration information that has been amplitude modulated and is in the frequency domain needs to be inverse Fourier transformed and converted back to the time domain. At this time, the numerical value of the amplitude of the current vibration information that has been amplitude modulated and is in the time domain is inverted to obtain the target audio.

[0079] In the embodiment of the present application, the correlation relationship is pre-stored in a storage medium of the headset, or,

[0080] The correlation relationship is calculated based on collected sample data; the sample data includes sample vibration information of the earphone obtained by the vibration sensor when the wearing user is in a sounding state, and sample audio of the wearing user obtained by the microphone.

[0081] In some application embodiments, the manufacturer collects audio from the user at different frequency bands, compares the amplitude of the vibration information collected by the vibration sensor and the amplitude of the audio collected by the microphone, obtains the amplitude modulation factor at different frequency bands, and then obtains the correlation relationship. The headset stores the correlation relationship in the memory of the headset in advance during production, so as to generate the target audio corresponding to the current vibration information according to the correlation relationship. Different frequency bands may include 100Hz to 500Hz, 500Hz to 750Hz, 750 to 1KHz, etc. The specific division range of each frequency band and the number of frequency band divisions are not limited here.

[0082] In some application embodiments, due to the difference in the model of the sensor carried by the headset and the sensor used when calculating the preset correlation relationship, the aging and damage of the sensor, and the factors of the wearer himself, when the correlation relationship preset by the manufacturer in the headset memory is used to reduce the sound gain of the wearer, the filtering effect of part of the audio of the wearer is not good. An environmental volume threshold can be preset. When the wearer is in a silent state, when the volume of the environmental audio collected by the microphone is less than or equal to the set environmental volume threshold, the current environment is considered to be a quiet environment. In a quiet environment, the wearer can choose to use a vibration sensor and a microphone to collect his own conversation sound, and perform Fourier transform on the collected vibration information and audio to obtain a spectrum diagram. According to the amplitude and amplitude values ​​of the corresponding frequency bands of the vibration information spectrum diagram and the audio spectrum diagram, the amplitude modulation factor is calculated, and then the correlation relationship is obtained.

[0083] Among them, in some application embodiments, due to the performance limitation of the headphone processor, the headphone can transmit the collected vibration information and audio to a device connected to the headphone for auxiliary calculation, and transmit and save the obtained correlation relationship to the memory of the headphone.

[0084] It should be noted that in the embodiment of the present application, when the headset stores both the correlation relationship pre-stored by the manufacturer in the headset memory and the correlation relationship obtained through collection and calculation, only one of them can be selected to reduce the sound gain of the wearer. The selection strategy can be that when there is a correlation relationship obtained through collection and calculation, the correlation relationship is used to implement the method provided in the embodiment of the present application. The selection strategy can also be that the wearer conducts experiments according to his own needs, which is not limited in the embodiment of the present application.

[0085] Step 203: superimpose and amplify the target audio and the current audio to obtain and output the processed audio.

[0086] It should be noted that the superimposing and amplifying the target audio and the current audio to obtain and output the processed audio includes:

[0087] Superimposing the target audio with the current audio in a time domain alignment manner to obtain superimposed audio;

[0088] The superimposed audio is amplified by adopting a segmented gain algorithm to obtain the processed audio.

[0089] In an embodiment of the present application, the target audio is superimposed on the current audio by time domain alignment to obtain superimposed audio. First, the use of time domain alignment refers to the time alignment of the target audio and the current audio, and time alignment refers to the alignment of the waveforms of the two audios in the time domain according to the starting point so that their moments match. After the time alignment is completed, waveform superposition and volume amplification processing are performed. The superposition and amplification operation refers to the addition of the target audio amplitude involved in the superposition processing with the current audio amplitude after the aligned starting point, and the amplification processing is performed to obtain and output the processed audio.

[0090] It should be noted that the process of superimposing and amplifying the target audio and the current audio to obtain and output the processed audio may be to generate a superimposed audio, then amplify and output the superimposed audio. Alternatively, the processed audio may be amplified while being superimposed, in which case no process data will be generated, and the embodiments of the present application are not limited to this.

[0091] In some application embodiments, a segmented gain algorithm is used to amplify the superimposed audio. The segmented gain algorithm divides the audio into several continuous time periods, and the interval size of the time period is not limited; for each segment, the maximum amplitude of the audio in the segment is calculated; based on the maximum amplitude value, the gain coefficient in the segment is calculated, and the gain coefficient can be determined by setting a compensation value for the difference between a target maximum amplitude value and a current maximum amplitude value; the gain coefficient is used to perform gain processing on the audio amplitude in the segment, and this operation can be achieved by multiplying the amplitude of each sampling point by the gain coefficient; repeat the above operation, and complete the segmented gain processing of the audio by processing all time periods of the audio.

[0092] It should be noted that there are many methods for gain processing of audio in the relevant field of audio processing technology, such as linear boost, which simply multiplies the amplitude of the audio signal by a fixed gain factor. This method is suitable for simple audio enhancement operations, but there may be a risk of distortion in audio with a large dynamic range. Ramp gain, this method gradually adjusts the gain algorithm according to time. Ramp gain can be achieved by specifying the gain change rate over a period of time, so that the sound gradually becomes larger or smaller when starting or ending. And the above-mentioned segmented gain algorithm, etc. The embodiment of the present application does not limit the sound gain algorithm used.

[0093] In the above technical solution, the wearing user can filter out his own voice when talking with others, so that the wearing user can listen to the amplified audio content more clearly.

[0094] In the embodiment of the present application, the earphone can be equipped with an energy storage structure, or the earphone can be powered by other devices connected to the earphone, which is not limited here. If the function of controlling the reduction of the sound gain of the wearer is always in the on state, the energy consumption of the earphone or the system in which the earphone is located will be increased. The method provided in the embodiment of the present application also includes, when the function of reducing the sound gain of the wearer is not needed, providing control of the on state of the function to achieve the purpose of reducing the energy consumption of the earphone or the system in which the earphone is located.

[0095] See also Figure 3 , which is another flowchart of a method for reducing the sound gain of a wearing user in the method provided in an embodiment of the present application, may include the following steps:

[0096] Step 301: When the user wearing the headset is in a state of speaking, a function of controlling the headset to reduce the gain of the user's voice is turned on.

[0097] In an embodiment of the present application, after the headset determines that a function of reducing the sound gain of the wearer is needed, the headset controls the function to be turned on. This step is before generating the target audio corresponding to the current vibration information.

[0098] Before generating the target audio corresponding to the current vibration information according to the correlation relationship, the method further includes:

[0099] Determining whether the wearing user is in a sounding state according to the current vibration information;

[0100] When the wearing user is in the sound-emitting state, the function of controlling the earphone to reduce the sound gain of the wearing user is turned on, a target audio corresponding to the current vibration information is generated according to the correlation relationship, the target audio and the current audio are superimposed and amplified, and the processed audio is obtained and output.

[0101] The vibration information includes at least one of a vibration frequency and an amplitude, and judging whether the wearing user is in a sounding state according to the current vibration information includes:

[0102] Determine whether the parameter value of the vibration information is within a corresponding parameter threshold interval, where the parameter threshold interval is a value range of at least one parameter of the vibration frequency and amplitude when the wearing user is in the sounding state;

[0103] When the parameter value of the vibration information is within the corresponding parameter threshold interval, it is determined that the wearing user is in the sound emitting state.

[0104] When the function of reducing the sound gain of the wearing user is turned on, the functions of the above steps 201-203 will be implemented, and the target audio corresponding to the current vibration information will be generated according to the correlation relationship, and the target audio and the current audio will be superimposed and amplified to obtain and output the processed audio.

[0105] Step 302: Acquire current vibration information of the earphone through the vibration sensor, and acquire current audio through the microphone.

[0106] Step 303: Generate target audio corresponding to the current vibration information according to the correlation relationship.

[0107] Step 304: superimpose and amplify the target audio and the current audio to obtain and output the processed audio.

[0108] The implementation method of steps 302-304 is similar to that of steps 201-203, and will not be described in detail here.

[0109] Step 305: When the user is not in a state of making a sound, the function of controlling the earphone to reduce the sound gain of the user is turned off.

[0110] In the embodiment of the present application, after the function of controlling the headset to reduce the sound gain of the wearing user is turned on, the method provided in the embodiment of the present application further includes:

[0111] When the time duration during which the wearing user is not in the sound emitting state is greater than or equal to a preset time duration, the function of controlling the headset to reduce the sound gain of the wearing user is in a closed state.

[0112] In an embodiment of the present application, if the function of reducing the sound gain of the wearing user is in an off state, the current audio collected by the microphone is amplified and output.

[0113] In the above scheme, by detecting the vocalization state of the wearing user and controlling the activation state of the function of reducing the sound gain of the wearing user, the function can be turned off when not in use, thereby achieving the purpose of reducing the power consumption of the earphone or the system in which the earphone is located.

[0114] The following will explain the implementation method of the function of controlling the reduction of the sound gain of the wearing user in the form of drawings.

[0115] See also Figure 4 , which is a flowchart illustrating the activation state of the function of controlling the reduction of the sound gain of the wearing user in the method provided in an embodiment of the present application.

[0116] Among them, the operation of controlling the on state of the function of reducing the sound gain of the wearing user is performed before generating the target audio corresponding to the current vibration information according to the correlation relationship. If the function of reducing the sound gain of the wearing user of the headset is on, the target audio corresponding to the current vibration information is generated according to the correlation relationship, the target audio is superimposed and amplified with the current audio, and the processed audio is obtained and output. If the function of reducing the sound gain of the wearing user is off, the current audio is amplified and output.

[0117] It should be noted that, if the activation state of the function of reducing the sound gain of the wearing user is not controlled and the function is always activated, the method for reducing the sound gain of the wearing user and the earphone provided in the embodiment of the present application can complete the function of filtering the sound of the wearing user and amplifying the audio volume. In some application embodiments, the earphone is a wireless earphone equipped with an energy storage structure. Since the volume of the earphone is usually small, but the power volume of the energy storage structure is positively correlated with the volume of the earphone, if the function of reducing the sound gain of the wearing user is always activated, it will have a great impact on the battery life of the earphone, and the battery life of wireless earphones is an important criterion for this category of earphones. In some application embodiments, the earphone does not have an energy storage structure. During the use of the earphone, it is necessary to rely on other devices connected to the earphone to power the earphone. If the activation of the function of reducing the sound gain of the wearing user is not restricted, it will affect the overall power consumption of the system where the earphone is located. In summary, the method for reducing the sound gain of the wearing user provided in the embodiment of the present application can control the activation state of the function of reducing the sound gain of the wearing user to reduce the power consumption of the earphone or the system where the earphone is located. The control function activation method includes the following steps:

[0118] Step 401: Acquire current vibration information through a vibration sensor.

[0119] Step 402: Determine whether the user is in a voicing state based on the current vibration information.

[0120] In the embodiment of the present application, the vibration information obtained includes vibration frequency and amplitude. Since the vibration frequency and amplitude collected by the vibration sensor when different individuals in the crowd make sounds have an interval range, the interval range can be used to determine whether the vibration information collected by the vibration sensor is generated by the sound of the wearer.

[0121] It should be noted that the interval ranges of vibration frequency and amplitude used to determine the sound are pre-stored in the storage medium of the headset after a large number of tests. If at least one of the two parameters meets the corresponding interval range, it is determined that the user is in the state of sounding, and the function of controlling the headset to reduce the sound gain of the user is turned on. If neither of them meets the corresponding interval range, the current vibration information is repeatedly obtained and it is determined whether the user is in the state of sounding based on the vibration information.

[0122] Step 403: Control the function of the headset to reduce the sound gain of the wearer to be turned on.

[0123] In the embodiment of the present application, when the headset determines that the wearer is in a state of speaking according to the current vibration information, the headset is controlled to turn on the function of reducing the sound gain of the wearer. When the function of reducing the sound gain of the wearer is turned on, a target audio corresponding to the current vibration information is generated according to the correlation relationship, and the target audio is superimposed and amplified with the current audio to obtain and output the processed audio.

[0124] Step 404: Detect the duration during which the user is not in a state of uttering sound.

[0125] In the embodiment of the present application, after the function of reducing the sound gain of the user wearing the headset is turned on, when the function is not used, it is also necessary to control the function of reducing the sound gain of the user wearing the headset to be turned off to achieve the purpose of reducing energy consumption. When it is determined based on the vibration information that the user wearing the headset is not in a speaking state, the duration of the continuous period of time when the user wearing the headset is not in a speaking state is obtained. The continuous period of time when the user wearing the headset is not in a speaking state refers to the time interval from the time when the user wearing the headset is detected to the time when the user wearing the headset is not detected to the time when the user wearing the headset is not in a speaking state.

[0126] Step 405: Determine whether the time duration during which the user is not in a sound-generating state is greater than or equal to a preset time duration.

[0127] In an embodiment of the present application, a duration threshold is set, and the time threshold may be pre-stored in the headset memory or may be set by the wearer himself, and the embodiment of the present application is not limited here. If it is detected that the duration of the wearer's continuous non-sounding state is greater than or equal to the preset duration threshold, the function of the headset to reduce the wearer's sound gain is controlled to be in an off state. When the function of reducing the wearer's sound gain is in an off state, the collected current audio is amplified and output. If the duration of the wearer's continuous non-sounding state is less than the preset duration threshold, the process of repeatedly detecting the duration of the wearer's non-sounding state and determining whether the duration of the wearer's non-sounding state is greater than or equal to the preset duration is repeated.

[0128] Step 406: Control the function of the headset to reduce the sound gain of the wearer to be in a closed state.

[0129] In an embodiment of the present application, if the function of reducing the sound gain of the wearing user is in an off state, the current audio collected by the microphone is amplified and output.

[0130] In some application embodiments, in addition to controlling the activation state of the function of reducing the sound gain of the wearer through the above process, the activation state of the function of reducing the sound gain of the wearer can also be controlled by the wearer's manual setting. For example, the function of reducing the sound gain of the wearer can be controlled by triggering a function button integrated on the headset or by controlling an electronic device connected to the headset.

[0131] In the above scheme, a method for controlling the activation state of the function of reducing the sound gain of the wearer is implemented. By controlling the activation state of this function, the power consumption of the headset or the system in which the headset is located can be reduced, the battery life can be improved or energy can be saved.

[0132] Through the above content, the method provided in the embodiment of the present application is explained. The following will describe the step of generating the target audio corresponding to the current vibration information according to the correlation relationship in the embodiment of the present application, and the process of converting the current vibration information from the time domain to the frequency domain with reference to the accompanying drawings.

[0133] See also Figure 5 , which is a schematic diagram of converting sound waves from the time domain to the frequency domain in the method provided in an embodiment of the present application.

[0134] like Figure 5 The figure shows the representation of the same sound wave in the time domain and frequency domain. The frequency domain diagram contains the amplitude values ​​of the sound wave at different frequencies. The representation of the frequency domain image can also be changed according to the size of the divided frequency band. This figure is used to illustrate the difference between sound waves in the time domain and frequency band, and to understand the reason for converting the current vibration information from the time domain to the frequency domain in the embodiment of the present application, and does not limit the method of converting the current vibration information from the time domain to the frequency domain.

[0135] In the embodiment of the present application, generating a target audio corresponding to the current vibration information according to the correlation relationship includes:

[0136] Determining an initial audio amplitude corresponding to the amplitude of the current vibration information from the correlation relationship;

[0137] Inverting the initial audio amplitude to obtain a target audio amplitude;

[0138] The target audio is obtained according to the target audio amplitude.

[0139] It is understandable that the current vibration information also has waveform information similar to sound waves. It is mentioned above that the vibration sensor and microphone have different sensitivities in collecting data in different frequency bands, and the amplitude of the current vibration information needs to be adjusted. After the vibration information is converted from the time domain to the frequency domain, it is convenient to adjust the amplitude of different frequency bands according to the amplitude modulation factor. The method of converting from the time domain to the frequency domain is to use Fourier transform. After adjusting the amplitude of the vibration information, it is also necessary to invert the adjusted vibration information and superimpose the audio collected by the microphone. Since the superposition operation requires the vibration information to be aligned with the revelation point of the audio, it is also necessary to perform an inverse Fourier transform on the current vibration information that has been amplitude modulated and is in the frequency domain and convert it back to the time domain.

[0140] In the above scheme, the current vibration information is converted from the time domain to the frequency domain, which facilitates the adjustment of the amplitude of different frequency bands of the current vibration information.

[0141] The earphones provided in the embodiments of the present application will be described below with reference to the accompanying drawings.

[0142] See also Figure 6 , is a structural diagram of an earphone 600 provided in an embodiment of the present application. Figure 6 As shown, the headset includes a collection module 601, a processing module 602 and an output module 603, wherein:

[0143] The acquisition module 601 is used to obtain the current vibration information of the headset through the vibration sensor, and obtain the current audio through the microphone, where the current audio includes the audio of the wearing user and the non-wearing user;

[0144] The processing module 602 is used to generate a target audio corresponding to the current vibration information according to a correlation relationship; the correlation relationship includes a correspondence between the amplitude of the vibration information of the earphone and the amplitude of the audio in different frequency bands; the phase of the target audio is opposite to the phase of the audio corresponding to the current vibration information determined according to the correspondence; and the target audio and the current audio are superimposed and amplified.

[0145] In some application embodiments, the acquisition module 601 can also be used to: after obtaining the current vibration information of the headset through the vibration sensor and obtaining the current audio through the microphone, the current audio includes the audio of the wearing user and the non-wearing user, and then detecting the current vibration information. The detection of the current vibration information includes detecting the vocalization state of the wearing user, and controlling the activation state of the function of reducing the sound gain of the wearing user according to the vocalization state.

[0146] In some application embodiments, in order to ensure that the final audio is clearer, the audio collected by the microphone needs to be processed, and the acquisition module 601 can also be used to perform noise reduction processing on the data collected by the microphone, filter out environmental noise, and obtain the current audio. Noise reduction processing can be achieved through algorithms such as adaptive filtering, spectrum subtraction, model noise reduction, etc., which are not limited here.

[0147] In some application embodiments, when the function of reducing the sound gain of the wearer is in a turned-off state, the processing module 602 can also be used to amplify and output the current audio collected by the microphone.

[0148] The output module 603 is used to output the audio after the target audio and the current audio are superimposed and amplified.

[0149] In some application embodiments, when the function of reducing the sound gain of the wearer is turned on, the output module 603 is used to output the audio processed by reducing the sound gain of the wearer.

[0150] In some application embodiments, when the function of reducing the sound gain of the wearer is in a turned-off state, the output module 603 is also used to output the audio after amplifying the current audio.

[0151] The description of the above earphone device embodiment is similar to the description of the above method embodiment, and has similar beneficial effects as the method embodiment. For technical details not disclosed in the earphone device embodiment of the present application, please refer to the description of the method embodiment of the present application for understanding.

[0152] It should be noted that in the embodiments of this application Figure 6 The division of the earphones into modules shown is schematic and is only a logical functional division. There may be other division methods in actual implementation. In addition, each functional unit in each embodiment of the present application may be integrated into a processing unit, or may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of a software functional unit. It may also be implemented in the form of a combination of software and hardware.

[0153] See also Figure 7 , is a schematic diagram of the structure of the earphone provided in the embodiment of the present application. Figure 7 The headset 700 shown may include a memory 701 and a processor 702 coupled to the memory 701 .

[0154] In the embodiment of the present application, the processor 702 also has the following functions:

[0155] A target audio corresponding to the current vibration information is generated according to a correlation relationship; the correlation relationship includes a correspondence between the amplitude of the vibration information of the earphone and the amplitude of the audio in different frequency bands; the phase of the target audio is opposite to the phase of the audio corresponding to the current vibration information determined according to the correspondence relationship; the target audio and the current audio are superimposed and amplified.

[0156] In the embodiment of the present application, the processor 702 also has the following functions:

[0157] Obtain current vibration information collected by the vibration sensor; determine whether the wearer is in a vocal state based on the current vibration information; control the function of the headset to reduce the sound gain of the wearer to be in an on state; detect the length of time that the wearer is not in a vocal state; determine whether the length of time that the wearer is not in a vocal state is greater than or equal to a preset length of time; control the function of the headset to reduce the sound gain of the wearer to be in an off state.

[0158] The embodiment of the present application discloses a computer-readable storage medium on which an executable program code is stored. When the executable program code is executed by a processor, the method described in the embodiment of the present application is implemented.

[0159] It should be noted here that the description of the above storage medium and device embodiments is similar to the description of the above method embodiments, and has similar beneficial effects as the method embodiments. For technical details not disclosed in the storage medium, storage medium and device embodiments of this application, please refer to the description of the method embodiments of this application for understanding.

[0160] It should be understood that "one embodiment" or "an embodiment" or "some embodiments" mentioned throughout the specification means that specific features, structures or characteristics related to the embodiment are included in at least one embodiment of the present application. Therefore, "in one embodiment" or "in one embodiment" or "in some embodiments" appearing throughout the specification may not necessarily refer to the same embodiment. In addition, these specific features, structures or characteristics can be combined in one or more embodiments in any suitable manner. It should be understood that in various embodiments of the present application, the size of the sequence number of the above-mentioned processes does not mean the order of execution, and the execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiment of the present application. The above-mentioned sequence numbers of the embodiments of the present application are only for description and do not represent the advantages and disadvantages of the embodiments. The above description of each embodiment tends to emphasize the differences between the various embodiments, and the same or similar aspects can be referenced to each other. For the sake of brevity, this article will not repeat them.

[0161] The term "and / or" in this article is only a description of the association relationship of associated objects, indicating that there may be three relationships. For example, object A and / or object B can represent three situations: object A exists alone, object A and object B exist at the same time, and object B exists alone.

[0162] It should be noted that, in this article, the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, an element defined by the sentence "comprises a ..." does not exclude the existence of other identical elements in the process, method, article or device including the element.

[0163] In the several embodiments provided in the present application, it should be understood that the disclosed devices and methods can be implemented in other ways. The embodiments described above are only schematic. For example, the division of the modules is only a logical function division. There may be other division methods in actual implementation, such as: multiple modules or components can be combined, or can be integrated into another system, or some features can be ignored, or not executed. In addition, the coupling, direct coupling, or communication connection between the components shown or discussed can be through some interfaces, and the indirect coupling or communication connection of devices or modules can be electrical, mechanical or other forms.

[0164] The modules described above as separate components may or may not be physically separated, and the components displayed as modules may or may not be physical modules; they may be located in one place or distributed on multiple network units; some or all of the modules may be selected according to actual needs to achieve the purpose of the present embodiment.

[0165] In addition, all functional modules in the embodiments of the present application may be integrated into one processing unit, or each module may be a separate unit, or two or more modules may be integrated into one unit; the above-mentioned integrated modules may be implemented in the form of hardware or in the form of hardware plus software functional units.

[0166] A person skilled in the art can understand that: all or part of the steps of implementing the above method embodiment can be completed by hardware related to program instructions, and the aforementioned program can be stored in a computer-readable storage medium. When the program is executed, it executes the steps of the above method embodiment; and the aforementioned storage medium includes: mobile storage devices, read-only memories (ROM), disks or optical disks, etc. Various media that can store program codes.

[0167] Alternatively, if the above-mentioned integrated unit of the present application is implemented in the form of a software function module and sold or used as an independent product, it can also be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the embodiment of the present application can essentially or in other words, the part that contributes to the relevant technology can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including a number of instructions for enabling an electronic device to execute all or part of the methods described in each embodiment of the present application. The aforementioned storage medium includes: various media that can store program codes, such as mobile storage devices, ROMs, magnetic disks, or optical disks.

[0168] The methods disclosed in several method embodiments provided in this application can be arbitrarily combined without conflict to obtain new method embodiments.

[0169] The features disclosed in several product embodiments provided in this application can be arbitrarily combined without conflict to obtain new product embodiments.

[0170] The features disclosed in several method or device embodiments provided in this application can be arbitrarily combined without conflict to obtain new method embodiments or device embodiments.

[0171] The above is only an implementation method of the present application, but the protection scope of the present application is not limited thereto. Any person skilled in the art who is familiar with the present technical field can easily think of changes or substitutions within the technical scope disclosed in the present application, which should be included in the protection scope of the present application. Therefore, the protection scope of the present application should be based on the protection scope of the claims.

Claims

1. A method for reducing the sound gain of a user wearing a headset, characterized in that: The method is applied to headphones, and the method comprises: Acquiring current vibration information of the headset through a vibration sensor of the headset, and acquiring current audio through a microphone of the headset, wherein the current audio includes audio of a wearing user and a non-wearing user; Generate a target audio corresponding to the current vibration information according to the correlation relationship; the correlation relationship includes a correspondence between the amplitude of the vibration information of the earphone and the amplitude of the audio in different frequency bands; the phase of the target audio is opposite to the phase of the audio corresponding to the current vibration information determined according to the correspondence relationship; The target audio and the current audio are superimposed and amplified to obtain and output the processed audio.

2. The method according to claim 1, characterized in that The step of generating a target audio corresponding to the current vibration information according to the correlation relationship includes: Determining an initial audio amplitude corresponding to the amplitude of the current vibration information from the correlation relationship; Inverting the initial audio amplitude to obtain a target audio amplitude; The target audio is obtained according to the target audio amplitude.

3. The method according to claim 2, characterized in that The correlation relationship is pre-stored in a storage medium of the headset, or, The correlation relationship is calculated based on collected sample data; the sample data includes sample vibration information of the earphone obtained by the vibration sensor when the wearing user is in a sounding state, and sample audio of the wearing user obtained by the microphone.

4. The method according to claim 1, characterized in that: The superimposing and amplifying the target audio and the current audio to obtain and output the processed audio includes: Superimposing the target audio with the current audio in a time domain alignment manner to obtain superimposed audio; The superimposed audio is amplified by adopting a segmented gain algorithm to obtain the processed audio.

5. The method according to any one of claims 1 to 4, characterized in that Before generating the target audio corresponding to the current vibration information according to the correlation relationship, the method further includes: Determining whether the wearing user is in a sounding state according to the current vibration information; When the wearing user is in the sound-emitting state, the function of controlling the earphone to reduce the sound gain of the wearing user is turned on, a target audio corresponding to the current vibration information is generated according to the correlation relationship, the target audio and the current audio are superimposed and amplified, and the processed audio is obtained and output.

6. The method according to claim 5, characterized in that After determining whether the wearing user is in a sound emitting state according to the current vibration information, the method further includes: When the wearing user is not in the sound-generating state, the function of reducing the wearing user's sound gain is controlled to be in a closed state, so as to output the current audio after amplification processing.

7. The method according to claim 5, characterized in that The vibration information includes at least one of a vibration frequency and an amplitude, and judging whether the wearing user is in a sounding state according to the current vibration information includes: Determine whether the parameter value of the vibration information is within a corresponding parameter threshold interval, where the parameter threshold interval is a value range of at least one parameter of the vibration frequency and amplitude when the wearing user is in the sounding state; When the parameter value of the vibration information is within the corresponding parameter threshold interval, it is determined that the wearing user is in the sound emitting state.

8. The method according to claim 5, characterized in that After the function of controlling the earphone to reduce the sound gain of the wearing user is turned on, the method further includes: When the time duration during which the wearing user is not in the sound emitting state is greater than or equal to a preset time duration, the function of controlling the headset to reduce the sound gain of the wearing user is in a closed state.

9. The method according to claim 1, characterized in that: The current audio is audio obtained by performing noise reduction processing on the initial audio collected by the microphone.

10. A headset, characterized in that: include: A collection module, used to obtain current vibration information of the headset through a vibration sensor of the headset, and to obtain current audio through a microphone of the headset, wherein the current audio includes audio of a wearing user and a non-wearing user; A processing module, configured to generate a target audio corresponding to the current vibration information according to a correlation relationship; the correlation relationship includes a correspondence between the amplitude of the vibration information of the earphone and the amplitude of the audio in different frequency bands; the phase of the target audio is opposite to the phase of the audio corresponding to the current vibration information determined according to the correspondence relationship; and the target audio and the current audio are superimposed and amplified; The output module is used to output the audio after the target audio and the current audio are superimposed and amplified.

11. A headset, characterized in that: include: A memory storing executable program code; and a processor coupled to the memory; The processor calls the executable program code stored in the memory, and when the executable program code is executed by the processor, the processor implements the method according to any one of claims 1 to 9.

12. A computer-readable storage medium having executable program code stored thereon, characterized in that: When the executable program code is executed by a processor, the method according to any one of claims 1 to 9 is implemented.

Images