Noise reduction method of open earphone, open earphone, medium and program product

Abstract

The invention is applicable to the field of audio processing, and provides a noise reduction method of an open earphone, the open earphone, a medium and a program product, and the method comprises the steps: obtaining first audio data collected by at least two first microphones respectively, and second audio data collected by a second microphone of the open earphone; based on the second audio data, audio analysis is carried out on each first audio data, a noise reduction parameter corresponding to each first audio data is determined, and the noise reduction parameter is used for representing the weight of each first audio data in noise reduction processing; according to the noise reduction parameter corresponding to each piece of first audio data, noise reduction processing is performed on each piece of first audio data, and first noise reduction data corresponding to each piece of first audio data is obtained; and controlling the loudspeaker to output the target audio data based on the first noise reduction data and the second noise reduction data. According to the method, the noise reduction parameter representing the weight of each piece of first audio data in noise reduction processing can be accurately determined, the noise reduction processing effect is improved, and the wearing experience of a user is improved.

Description

Technical Field

[0001] The present application belongs to the technical field of audio processing, and in particular, relates to a noise reduction method for open-type headphones, open-type headphones, a medium and a program product. Background Art

[0002] With the continuous development of technology, open-back headphones came into being. Since the sound propagation of open-back headphones is not restricted by the ear shell, it can create a wider and more natural sound field, allowing users to feel a more spatial and layered sound. At the same time, open-back headphones usually do not need to be worn in the ears, which reduces the pressure and friction on the ear canal.

[0003] However, when users wear open-back headphones to listen to audio data such as music or voice, the ambient noise in the outside world can easily affect the clarity of the audio data heard by the user and reduce the wearing experience. Therefore, how to achieve the active noise reduction function of open-back headphones is a problem that needs to be solved urgently. Summary of the invention

[0004] The embodiments of the present application provide a noise reduction method for open-type headphones, open-type headphones, a medium, and a program product, which can realize the active noise reduction function of the open-type headphones and improve the effect of the noise reduction processing.

[0005] In a first aspect, an embodiment of the present application provides a noise reduction method for an open-type headset, comprising:

[0006] Acquire first audio data collected by at least two first microphones of the open-type earphone, and second audio data collected by a second microphone of the open-type earphone, wherein the first microphone and the second microphone are respectively arranged on the outside and the inside of the open-type earphone;

[0007] Performing audio analysis on each first audio data based on the second audio data, and determining a noise reduction parameter corresponding to each first audio data, where the noise reduction parameter is used to characterize a weight of each first audio data in the noise reduction process;

[0008] According to the noise reduction parameters corresponding to each first audio data, each first audio data is subjected to noise reduction processing to obtain first noise reduction data corresponding to each first audio data;

[0009] Performing noise reduction processing on the second audio data to obtain second noise reduction data corresponding to the second audio data;

[0010] Target audio data is generated based on the first noise reduction data and the second noise reduction data to control a speaker in the open-type earphone to output the target audio data.

[0011] In some embodiments, performing audio analysis on each first audio data based on the second audio data to determine the noise reduction parameter corresponding to each first audio data includes:

[0012] Performing gain processing on each of the first audio data and the second audio data respectively to obtain first gain-processed data corresponding to each of the first audio data and second gain-processed data corresponding to the second audio data;

[0013] For each first gain processed data, performing audio analysis on each first gain processed data based on the second gain processed data to obtain audio information of each first gain processed data;

[0014] According to the audio information of each first gain processed data, the noise reduction parameter corresponding to each first gain processed data is determined respectively.

[0015] In some embodiments, the audio information includes at least a delay parameter and a wind noise parameter, and audio analysis is performed on each first gain processing data based on the second gain processing data to obtain audio information of each first gain processing data, including:

[0016] calculating a delay parameter between each first gain-processed data and the second gain-processed data;

[0017] Wind noise analysis is performed on each first gain processed data to obtain a wind noise parameter of each first gain processed data.

[0018] In some embodiments, determining the noise reduction parameter corresponding to each first gain processed data according to the audio information of each first gain processed data includes:

[0019] Setting the priority of the wind noise parameter to the first priority, and setting the priority of the delay parameter to the second priority;

[0020] According to the delay parameter and the wind noise parameter of each first gain processing data, the noise reduction parameter corresponding to each first gain processing data is determined respectively by using the first priority and the second priority.

[0021] In some embodiments, the noise reduction parameter is a gain parameter for gain processing, and according to the noise reduction parameter corresponding to each first audio data, noise reduction processing is performed on each first audio data to obtain first noise reduction data corresponding to each first audio data, including:

[0022] Performing filtering processing on each first gain processed data respectively to obtain first filtered data corresponding to each first gain processed data;

[0023] According to the gain parameters corresponding to each first gain processed data, gain processing is performed on the first filtered data corresponding to each first gain processed data to obtain the first noise reduction data corresponding to each first audio data.

[0024] In some embodiments, according to the gain parameter corresponding to each first gain processing data, gain processing is performed on the first filtering data corresponding to each first gain processing data to obtain the first noise reduction data corresponding to each first audio data, including:

[0025] For each first filtered data corresponding to each first gain processed data, according to the gain parameter and the initial gain value corresponding to each first gain processed data, a target gain value corresponding to each first filtered data is calculated;

[0026] For each first filtered data corresponding to the first gain processed data, a target gain value is used to perform gain processing on each first filtered data to obtain first noise reduction data corresponding to each first audio data.

[0027] In some embodiments, the first microphone is disposed at an edge position of the outer side of the open-type earphone, and the second microphone is disposed at a center position of the inner side of the open-type earphone.

[0028] In a second aspect, an embodiment of the present application provides an open-type earphone, comprising:

[0029] At least two first microphones are disposed outside the open-type earphones and are used to respectively collect first audio data;

[0030] A second microphone is disposed on the inner side of the open earphone and is used to collect second audio data;

[0031] A processing module, configured to perform audio analysis on each first audio data based on the second audio data, and determine a noise reduction parameter corresponding to each first audio data, where the noise reduction parameter is used to characterize a weight of each first audio data in the noise reduction process;

[0032] A first noise reduction module, configured to perform noise reduction processing on each first audio data according to the noise reduction parameter corresponding to each first audio data, to obtain first noise reduction data corresponding to each first audio data;

[0033] A second noise reduction module, used to perform noise reduction processing on the second audio data to obtain second noise reduction data corresponding to the second audio data;

[0034] The mixing module is used to generate target audio data based on the first noise reduction data and the second noise reduction data to control the speaker in the open earphone to output the target audio data.

[0035] In some embodiments, the first noise reduction module includes: a first gain unit,

[0036] A first gain unit, used to perform gain processing on each first audio data respectively to obtain first gain processed data corresponding to each first audio data;

[0037] The processing module is also used to perform audio analysis on each first gain processing data based on the second gain processing data to obtain audio information of each first gain processing data; and determine the noise reduction parameters corresponding to each first gain processing data according to the audio information of each first gain processing data.

[0038] In some embodiments, the first noise reduction module further includes: a filter and a second gain unit,

[0039] A filter, used for filtering each first gain processed data respectively to obtain first filtered data corresponding to each first gain processed data;

[0040] The second gain unit is used to perform gain processing on the first filtering data corresponding to each first gain processing data according to the gain parameter corresponding to each first gain processing data, so as to obtain the first noise reduction data corresponding to each first audio data.

[0041] In a third aspect, an embodiment of the present application provides a computer-readable storage medium, which stores a computer program. When the computer program is executed by a processor, it implements any method of the first aspect.

[0042] In a fourth aspect, an embodiment of the present application provides a computer program product. When the computer program product is run on an open-ear headset, the open-ear headset executes any one of the methods in the first aspect.

[0043] The embodiment of the present application provides a noise reduction method for open-type headphones, open-type headphones, media and program products, the method comprising: obtaining first audio data collected by at least two first microphones of the open-type headphones, and second audio data collected by the second microphone of the open-type headphones, wherein the first microphone and the second microphone are respectively arranged on the outside and the inside of the open-type headphones; performing audio analysis on each first audio data based on the second audio data, determining the noise reduction parameters corresponding to each first audio data, and the noise reduction parameters are used to characterize the weight of each first audio data in the noise reduction process; performing noise reduction processing on each first audio data according to the noise reduction parameters corresponding to each first audio data, and obtaining the first noise reduction data corresponding to each first audio data; performing noise reduction processing on the second audio data, and obtaining the second noise reduction data corresponding to the second audio data; generating target audio data based on the first noise reduction data and the second noise reduction data, so as to control the speaker in the open-type headphones to output the target audio data. By using the above technical solution, by performing audio analysis on each first audio data based on the second audio data collected by the second microphone, the noise reduction parameters characterizing the weight of each first audio data in the noise reduction process can be accurately determined, thereby improving the effect of the noise reduction process and thus improving the wearing experience of the user. BRIEF DESCRIPTION OF THE DRAWINGS

[0044] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.

[0045] Figure 1 It is a flow chart of a noise reduction method provided by the prior art;

[0046] Figure 2 It is a flowchart of a noise reduction method for an open-type headset provided in one embodiment of the present application;

[0047] Figure 3 is a flow chart of a noise reduction method for open-type headphones provided by another embodiment of the present application;

[0048] Figure 4 is a structural schematic diagram of an open-type earphone provided by an embodiment of the present application;

[0049] Figure 5 is a schematic structural diagram of another open-type earphone provided in an embodiment of the present application;

[0050] Figure 6 It is a structural schematic diagram of a noise reduction method for open-type headphones provided by an embodiment of the present application;

[0051] Figure 7 It is a schematic structural diagram of an open-type earphone provided in one embodiment of the present application. DETAILED DESCRIPTION

[0052] In the following description, specific details such as specific system structures, technologies, etc. are provided for the purpose of illustration rather than limitation, so as to provide a thorough understanding of the embodiments of the present application. However, it should be clear to those skilled in the art that the present application may also be implemented in other embodiments without these specific details. In other cases, detailed descriptions of well-known systems, devices, circuits, and methods are omitted to prevent unnecessary details from obstructing the description of the present application.

[0053] It should be understood that when used in the present specification and the appended claims, the term "comprising" indicates the presence of described features, wholes, steps, operations, elements and / or components, but does not exclude the presence or addition of one or more other features, wholes, steps, operations, elements, components and / or combinations thereof.

[0054] It should also be understood that the term “and / or” used in the specification and appended claims refers to any and all possible combinations of one or more of the associated listed items, and includes these combinations.

[0055] As used in the specification and appended claims of this application, the term "if" can be interpreted as "when" or "uponce" or "in response to determining" or "in response to detecting", depending on the context. Similarly, the phrase "if it is determined" or "if [described condition or event] is detected" can be interpreted as meaning "uponce it is determined" or "in response to determining" or "uponce [described condition or event] is detected" or "in response to detecting [described condition or event]", depending on the context.

[0056] In addition, in the description of the present application specification and the appended claims, the terms "first", "second", "third", etc. are only used to distinguish the descriptions and cannot be understood as indicating or implying relative importance.

[0057] References to "one embodiment" or "some embodiments" etc. described in the specification of this application mean that one or more embodiments of the present application include specific features, structures or characteristics described in conjunction with the embodiment. Therefore, the statements "in one embodiment", "in some embodiments", "in some other embodiments", "in some other embodiments", etc. that appear in different places in this specification do not necessarily refer to the same embodiment, but mean "one or more but not all embodiments", unless otherwise specifically emphasized in other ways. The terms "including", "comprising", "having" and their variations all mean "including but not limited to", unless otherwise specifically emphasized in other ways.

[0058] It can be considered that noise-canceling headphones are widely used in multiple scenarios. For example, when users take subways, buses and other means of transportation, the surrounding environment is often noisy. Wearing noise-canceling headphones can effectively reduce the roar of the engine, the friction of the tracks and the noise of the crowd, allowing users to quietly enjoy music, listen to audiobooks or make phone calls, etc., to improve the comfort of travel; or, in open office environments and learning environments, there are various interfering sounds, such as colleagues' conversations, keyboard tapping, air conditioning operation, etc. Wearing noise-canceling headphones can help users better focus on work tasks and improve work efficiency. At the same time, the noise reduction function can reduce the impact of surrounding noise on call quality.

[0059] Figure 1 It is a flow chart of a noise reduction method provided by the prior art, such as Figure 1 As shown, the audio data collected by the microphone first passes through the gain module to adjust the audio to a suitable amplitude, then passes through the filter for filtering, and finally passes through the gain module to adjust the output amplitude of the audio for output to the speaker.

[0060] Among them, there are various types of noise-cancelling headphones, but the active noise cancellation (ANC) function of open-back headphones is different from the ANC function of traditional headphones and in-ear headphones. The reason is that the noise of headphones and in-ear headphones is the noise leaked after the headphones passively reduce noise, while the sound of open-back headphones is directly transmitted to the ear canal through the environment. The sound is not obviously obstructed, the noise intensity is high, and the difficulty of active noise reduction is increased.

[0061] Figure 2 It is a flowchart of a noise reduction method for open-type headphones provided in one embodiment of the present application. As an example but not a limitation, the method can be applied to open-type headphones.

[0062] S101. Acquire first audio data collected by at least two first microphones of an open-type earphone and second audio data collected by a second microphone of the open-type earphone, wherein the first microphone and the second microphone are respectively disposed on an outer side and an inner side of the open-type earphone.

[0063] Among them, the first microphone and the second microphone are respectively arranged on the outside and inside of the open-type earphone. The first microphone can be considered as a microphone using feedforward (FF) active noise reduction technology, which is arranged on the outside of the open-type earphone and can collect all noise outside the open-type earphone. The position and number of the first microphones are not limited and can be configured according to actual needs. For example, the first microphone can be arranged at the edge position of the outside of the open-type earphone. The number of the first microphones can be at least two, and the arrangement of multiple first microphones can be configured according to preset positions. For example, they can be respectively arranged at positions close to the top corners on the outer surface of the open-type earphone, which can better collect audio data from different directions.

[0064] The second microphone can be considered as a microphone using feedback (Feed Back, FB) active noise reduction technology, which is configured on the inside of the open earphone and can obtain the noise inside the earphone shell. For example, the second microphone can be configured at the center of the inside of the open earphone. Furthermore, the second microphone can be set on the inside of the speaker near the user's ear canal hole, or configured at other positions according to other requirements. The first audio data can refer to the audio data collected by at least two first microphones respectively, and the second audio data can refer to the audio data collected by the second microphone.

[0065] S102: Perform audio analysis on each first audio data based on the second audio data to determine a noise reduction parameter corresponding to each first audio data, where the noise reduction parameter is used to characterize a weight of each first audio data in the noise reduction process.

[0066] The noise reduction parameter can be used to characterize the weight of each first audio data in the noise reduction process, indicating the importance of each first audio data in the noise reduction process. The specific content of the noise reduction parameter can be a weight coefficient or gain-related adjustment data, such as an increased or decreased gain value.

[0067] Specifically, this step can perform audio analysis on each first audio data based on the second audio data collected by the second microphone, so as to determine the noise reduction parameters corresponding to each first audio data. For example, the second audio data can be directly used to perform audio analysis on each first audio data to obtain the corresponding noise reduction parameters. The second audio data and each first audio data can also be preprocessed to a certain extent, and then the audio analysis of each first audio data can be performed more accurately. The preprocessing means are not limited, such as gain amplification processing, preliminary filtering of larger noise, or other processing that can provide more accurate audio data for subsequent audio analysis, etc. The audio analysis process is not expanded here, and can be determined based on the actual situation of the audio data.

[0068] S103: Perform noise reduction processing on each first audio data according to the noise reduction parameter corresponding to each first audio data to obtain first noise reduction data corresponding to each first audio data.

[0069] S104: Perform noise reduction processing on the second audio data to obtain second noise reduction data corresponding to the second audio data.

[0070] The first noise reduction data and the second noise reduction data may be noise reduction data obtained after noise reduction processing is performed on the first audio data and the second noise reduction data, respectively.

[0071] After obtaining the noise reduction parameters corresponding to each first audio data through the above steps, this step can perform specific noise reduction processing. According to the noise reduction parameters corresponding to each first audio data, each first audio data is subjected to noise reduction processing to obtain the first noise reduction data corresponding to each first audio data, and the second audio data is subjected to noise reduction processing to obtain the second noise reduction data corresponding to the second audio data. The means of noise reduction processing are not limited. For example, by adopting a noise reduction model, the noise reduction parameters of each first audio data and each first audio data are input into the noise reduction model to directly output the first noise reduction data. The noise reduction model can be a pre-trained neural network model; or the means of noise reduction processing can be filtering and / or gain amplification based on the above preprocessing, which is not limited in this embodiment.

[0072] S105: Generate target audio data based on the first noise reduction data and the second noise reduction data to control the speaker in the open-type earphone to output the target audio data.

[0073] The target audio data may be understood as audio data that will eventually be transmitted to a speaker.

[0074] In a specific implementation, after the noise reduction processing is completed, multiple noise reduction data after the noise reduction processing can be mixed into one target audio data, such as generating the target audio data based on the first noise reduction data and the second noise reduction data, transmitting it to the digital-to-analog converter, and then controlling the speaker in the open headphone to output the target audio data.

[0075] The present embodiment provides a noise reduction method for an open-type headset, which obtains first audio data collected by at least two first microphones of the open-type headset, and second audio data collected by the second microphone of the open-type headset, wherein the first microphone and the second microphone are respectively arranged on the outside and the inside of the open-type headset; based on the second audio data, each first audio data is respectively subjected to audio analysis to determine the noise reduction parameter corresponding to each first audio data, and the noise reduction parameter is used to characterize the weight of each first audio data in the noise reduction process; according to the noise reduction parameter corresponding to each first audio data, each first audio data is respectively subjected to noise reduction process to obtain the first noise reduction data corresponding to each first audio data; the second audio data is subjected to noise reduction process to obtain the second noise reduction data corresponding to the second audio data; the target audio data is generated based on the first noise reduction data and the second noise reduction data to control the speaker in the open-type headset to output the target audio data. By using this method, by performing audio analysis on each first audio data based on the second audio data collected by the second microphone, the noise reduction parameter characterizing the weight of each first audio data in the noise reduction process can be accurately determined, thereby improving the effect of the noise reduction process and thus improving the wearing experience of the user.

[0076] Figure 3 This is a flow chart of a noise reduction method for open headphones provided by another embodiment of the present application. This embodiment will perform audio analysis on each first audio data based on the second audio data, and determine the noise reduction parameters corresponding to each first audio data, and further optimize it as follows: perform gain processing on each first audio data and second audio data, respectively, to obtain first gain processed data corresponding to each first audio data and second gain processed data corresponding to the second audio data; for each first gain processed data, perform audio analysis on each first gain processed data based on the second gain processed data, to obtain the audio information of each first gain processed data; and determine the noise reduction parameters corresponding to each first gain processed data based on the audio information of each first gain processed data. Figure 3 As shown, the method includes:

[0077] S201. Acquire first audio data collected by at least two first microphones of an open-type earphone and second audio data collected by a second microphone of the open-type earphone, wherein the first microphone and the second microphone are respectively disposed on an outer side and an inner side of the open-type earphone.

[0078] S202 , perform gain processing on each first audio data and second audio data respectively to obtain first gain-processed data corresponding to each first audio data and second gain-processed data corresponding to each second audio data.

[0079] It can be considered that the gain of the audio data originally collected by the first microphone and the second microphone is relatively low, and the sensitivity is low, and the audio data needs to be gain-amplified, so as to adjust the audio data to a suitable amplitude, so as to ensure that no data is lost. Therefore, in this embodiment, each first audio data and second audio data can be gain-processed respectively to obtain first gain-processed data corresponding to each first audio data and second gain-processed data corresponding to the second audio data.

[0080] S203 . For each first gain processed data, perform audio analysis on each first gain processed data based on the second gain processed data to obtain audio information of each first gain processed data.

[0081] The audio information may be various information related to the first gain processing data, and may specifically include a delay parameter, or other information that can accurately determine the noise reduction parameter.

[0082] Specifically, for each first gain processing data, audio analysis can be performed on each first gain processing data based on the second gain processing data to obtain audio information of each first gain processing data. Different audio information can correspond to different audio analysis processes, or the audio analysis processes corresponding to different first gain processing data can also be different.

[0083] Exemplarily, the audio information may include at least a delay parameter and a wind noise parameter. From the physical properties of acoustics, it can be seen that if the noise signal is directional, the first microphone close to the noise signal can receive the noise signal earliest, and the time delay between the audio signal collected by the first microphone close to the noise signal and the audio signal collected by the second microphone is the largest; if the noise signal comes from the front side of the open earphone, the time delay between the audio signal collected by each first microphone and the audio signal collected by the second microphone is the same, so this embodiment can accurately calculate the time delay parameter formed between each first audio data and the second audio data. If the time delay between the first audio signal collected by a first microphone and the audio signal collected by the second microphone is large, it means that the direction of the noise source is closer to the arrangement direction of the first microphone, and the first audio signal collected by the first microphone can obtain a better noise reduction effect, and the weight of the first audio data in the noise reduction process can be increased subsequently.

[0084] Among them, there is no limit to the method of calculating the delay parameter. For example, the cross-correlation method can be used to calculate the cross-correlation function of the two signals and find the peak position of the cross-correlation function. The time difference corresponding to the peak position is the delay parameter of the two signals. The generalized cross-correlation method can also be used. On the basis of the cross-correlation method, a preprocessing weighted function can be added to enhance the display of the peak position. The short-time Fourier transform method can also be used to analyze the signal delay in the frequency domain, divide the signal into short time windows, and calculate the frequency components and phase differences segment by segment, so as to estimate the obtained time difference as the delay parameter.

[0085] Furthermore, it is also necessary to analyze the influence of wind noise on the microphone. In general wind noise scenarios, due to the great differences in the configuration position and opening direction of the first microphone, each microphone is affected by wind noise in different ways, and the microphone facing the wind is most affected. The purpose of this embodiment is to reduce or close the microphone channel that is more seriously affected by wind noise, so that the open-type headphones can achieve a good noise reduction effect even under the influence of wind noise. Therefore, this embodiment can perform wind noise analysis on each first gain processing data to obtain the wind noise parameters of each first gain processing data. The process of wind noise analysis can, for example, include analyzing whether there is a wind noise spectrum and determining the wind noise intensity.

[0086] S204: Determine noise reduction parameters corresponding to each first gain processed data according to audio information of each first gain processed data.

[0087] After determining the audio information of each first gain processed data, this step can determine the noise reduction parameters corresponding to each first gain processed data separately according to the audio information of each first gain processed data. For example, the noise reduction parameters corresponding to each first gain processed data can be obtained by calculating each parameter in the audio information of each first gain processed data. The importance of each first gain processed data can also be measured by comparing the audio information between multiple first gain processed data to determine the noise reduction parameters corresponding to each first gain processed data. The measurement standard can be determined according to the degree of influence of different audio information on the noise reduction processing. At the same time, multiple noise reduction parameters need to comply with specified regular requirements or meet certain logic.

[0088] In some embodiments, determining the noise reduction parameter corresponding to each first gain processed data according to the audio information of each first gain processed data includes:

[0089] Setting the priority of the wind noise parameter to the first priority, and setting the priority of the delay parameter to the second priority;

[0090] According to the delay parameter and the wind noise parameter of each first gain processing data, the noise reduction parameter corresponding to each first gain processing data is determined respectively by using the first priority and the second priority.

[0091] In a specific implementation, when the audio information includes at least a delay parameter and a wind noise parameter, the sound source direction and the impact of wind noise are analyzed according to the delay parameters, wind noise data and other parameters, the weights of each microphone channel in active noise reduction are dynamically changed, and the optimal weight distribution coefficient is selected. For example, when the delay parameters corresponding to each first microphone are basically the same, the same weight can be assigned to each microphone, that is, the noise reduction parameters corresponding to each first gain processing data can be the same; if it is analyzed that the current noise has obvious directionality, the weight of the microphone that receives the noise earliest can be set to the highest. For example, the gain parameters corresponding to each microphone channel can be changed. The larger the gain parameter, the higher the energy output by the microphone channel, and the greater the weight in active noise reduction, thereby improving the noise reduction effect.

[0092] Furthermore, priorities between different parameters can be set. For example, the priority of the wind noise parameter can be set as the first priority, and the priority of the delay parameter can be set as the second priority. Different audio information can be weighed according to different priorities, and the noise reduction parameters corresponding to each first gain processing data can be determined respectively. For example, when the noise reduction parameters are specifically determined, if the delay parameter of a certain first gain processing data is the smallest, but it is detected that the first gain processing data has a wind noise spectrum, the wind noise parameter is mainly used, and the noise reduction parameter corresponding to the first gain processing data is reduced according to the specific size of the wind noise parameter; more specifically,

[0093] When it is detected that the first gain processed data of a first microphone has a wind noise spectrum, if the wind noise intensity of the first gain processed data is detected to be greater than 65dB, the weight of the first audio data in the noise reduction processing can be reduced, such as attenuating the gain of the microphone by 12dB; if the wind noise intensity of the first gain processed data is detected to be greater than 75dB, the weight of the first audio data in the noise reduction processing can be directly set to zero, that is, the noise reduction processing of this microphone channel is turned off. Correspondingly, the noise reduction parameters of other microphone channels can be adaptively adjusted, such as increasing their corresponding weight coefficients.

[0094] S205 . Perform noise reduction processing on each first audio data according to the noise reduction parameter corresponding to each first audio data to obtain first noise reduction data corresponding to each first audio data.

[0095] In some embodiments, the noise reduction parameter is a gain parameter for gain processing, and according to the noise reduction parameter corresponding to each first audio data, noise reduction processing is performed on each first audio data to obtain first noise reduction data corresponding to each first audio data, including:

[0096] Performing filtering processing on each first gain processed data respectively to obtain first filtered data corresponding to each first gain processed data;

[0097] According to the gain parameters corresponding to each first gain processed data, gain processing is performed on the first filtered data corresponding to each first gain processed data to obtain the first noise reduction data corresponding to each first audio data.

[0098] The noise reduction parameter may be a gain parameter used for gain processing, such as an increased or decreased gain value.

[0099] In a specific implementation, each first microphone corresponds to its own filter and gain module, and can process the collected audio data respectively, and filter each first gain-processed data in turn, and perform gain processing on the first filtered data corresponding to each first gain-processed data according to the gain parameters corresponding to each first gain-processed data, so as to obtain the first noise reduction data corresponding to each first audio data, wherein, for the first filtered data corresponding to each first gain-processed data, the process of performing gain processing specifically according to the gain parameters can include determining a target gain value based on an initial gain value, so as to adjust the amplitude of the corresponding audio data according to the target gain value, such as first calculating the target gain value corresponding to each first filtered data according to the gain parameters and the initial gain value corresponding to each first gain-processed data, and then using the target gain value to perform gain processing on each first filtered data, so as to obtain the first noise reduction data corresponding to each first audio data.

[0100] Furthermore, in practical applications, the above processing can be combined with echo cancellation, beamforming technology and other means for further processing to obtain better quality audio data.

[0101] In some embodiments, in open headphones, since the microphone and the speaker are fixed in the same cavity and are relatively close, the vibration of the speaker will be transmitted into the microphone, and the sound of the speaker will also be transmitted to the microphone through the air, resulting in the echo formed by the conduction having a negative impact on subsequent audio processing. Therefore, this embodiment can perform echo cancellation processing on the audio data in the audio processing (which can be the first audio data, the second audio data, and any audio data obtained in the intermediate audio processing process), and the means of echo cancellation processing are not limited, such as using time domain or frequency domain methods to perform echo cancellation, so that a cleaner sound signal can be obtained after echo cancellation, including the user's audio data and environmental sounds.

[0102] For example, when there are multiple first audio data, the same or different echo cancellation processing means may be used for specific processing respectively, or multiple first audio data may be mixed together for echo cancellation, which is not limited in this embodiment.

[0103] In some embodiments, in order to better recognize the user's voice, beamforming technology can be further used to pick up more directional sounds. For example, in the design of two microphones, the connection between the microphones can point to the direction of the user's voice source. A certain audio data may include audio data from the user's voice source to the microphone, surrounding environmental noise, or audio data of surrounding people (such as sound that is not emitted from the user's mouth but transmitted to the microphone). Beamforming technology can be used to process at least two arbitrary audio data to enhance the user's audio data in any audio data and reduce the surrounding environmental noise and the audio data of surrounding people, so that the voice in the direction of the human mouth can be picked up more clearly and the environmental noise in other directions can be suppressed.

[0104] In some embodiments, since the microphone will recognize ambient sounds and play them through the speaker, it is easy to cause howling. This howling is caused by the mid- and high-frequency noise formed by the sound signal looping back to the microphone from the speaker. The mid- and high-frequency noise is sharp and harsh. Therefore, the audio data at any stage can be processed for howling suppression through feedback elimination and spectrum adjustment and other technologies to avoid the howling effect, effectively helping users to obtain a more stable and clear listening experience in different environments.

[0105] In some embodiments, equalization processing can be used to adjust the frequency response of audio data at any stage, and can be fine-tuned in the low, mid, and high frequency bands. For example, by enhancing or cutting the frequency of a specific frequency band, the sound can be made clearer, fuller, or softer to meet the needs of different music styles.

[0106] In some embodiments, the excitation processing can make the audio data at any stage sound more dynamic and bright by adding high-frequency harmonics, thereby enhancing the clarity and appeal of the sound.

[0107] In some embodiments, the compression process may include controlling the dynamic range of the audio signal, reducing portions of the audio that are too high or too low in volume, making the sound more stable and consistent, helping to avoid sudden increases or decreases in the sound, making the audio data smoother, and protecting the device from being damaged by peak volumes.

[0108] Based on the above embodiments, audio defects can be concealed and the sound quality of audio data can be further improved.

[0109] S206: Perform noise reduction processing on the second audio data to obtain second noise reduction data corresponding to the second audio data.

[0110] S207: Generate target audio data based on the first noise reduction data and the second noise reduction data to control the speaker in the open-type earphone to output the target audio data.

[0111] The present embodiment provides a noise reduction method for open-ear headphones, which ensures the integrity of the audio data by performing gain processing on each first audio data and second audio data in advance, and obtains the audio information of each first gain processed data by performing audio analysis on each first gain processed data based on the second gain processed data, thereby providing an accurate information basis for determining noise reduction parameters and further improving the effect of noise reduction processing.

[0112] Figure 4 is a schematic diagram of the structure of an open-type earphone provided in an embodiment of the present application, such as Figure 4 As shown, the open earphones are schematically arranged with three channels of first microphones, including FF1, FF2 and FF3. The FF1, FF2 and FF3 microphones can collect audio data from all directions.

[0113] Figure 5 FIG. 1 is a schematic diagram of the structure of another open-type earphone provided by an embodiment of the present application. Due to the characteristics of the open-type earphone, the sound will leak into the ear canal of the user from all sides of the earphone, such as Figure 5 It can be seen from (a) that if a noise signal is generated by a sound source on the upper side of the open-type earphone, the noise signal is first received by the microphone FF1 of the open-type earphone, and then the ear canal and the microphone FF2 collect the noise signal. According to the causality of the active noise reduction system, the microphone FF2 receives the noise signal and processes it later than the ear canal, and cannot provide the optimal noise reduction effect. Therefore, the noise signal collected by the microphone FF1 can produce a better noise reduction effect.

[0114] like Figure 5 As can be seen from (b), if the noise signal comes from the front and side of the open earphones, the microphones FF1 and FF2 collect the noise signal almost at the same time, and then the ear canal collects the noise signal. Therefore, using either microphone FF1 or FF2 can produce a good noise reduction effect.

[0115] Figure 6 is a structural schematic diagram of a noise reduction method for an open-type earphone provided in an embodiment of the present application, such as Figure 6As shown, taking an open-ear headset configured with three first microphones (i.e., FF1, FF2, and FF3) and one second microphone (i.e., FB) as an example, this embodiment designs a multi-channel ANC system according to the arrangement of each microphone, and the data processing of each microphone channel is consistent with the single-microphone channel ANC. Furthermore, while realizing the multi-microphone channel ANC, this embodiment also adds the processing of the noise analysis module and the noise reduction strategy management module, and performs noise reduction analysis on the audio data of the multiple microphone channels respectively. In addition to being transmitted to the filter, the data passed through the gain module is also sent to the noise analysis module. The noise analysis module separately analyzes the data of each FF microphone channel and FB The time delay between the two microphones is analyzed, and the influence of wind noise on each first microphone is analyzed. The delay parameters and each wind noise parameter obtained by the analysis are sent to the noise reduction strategy management module. The noise reduction strategy management module analyzes the direction of the noise source and the influence of wind noise according to the delay parameters and wind noise parameters of each FF microphone, and dynamically determines the weight coefficient of each microphone channel in active noise reduction, that is, determines the noise reduction parameters corresponding to each microphone channel, and sends the determined noise reduction parameters to the gain modules of each microphone channel respectively. The gain modules of each microphone channel can adjust the gain of the audio signal transmitted by each filter according to the noise reduction parameters, and obtain the final noise reduction processed audio data of each microphone channel. Finally, the audio after gain processing of the four channels is input to the mixer to mix into one audio, and then output to the speaker.

[0116] The noise reduction method of the open-earphone corresponding to the above embodiment, Figure 7 This is a schematic diagram of the structure of an open-type earphone provided in one embodiment of the present application. For the sake of ease of explanation, only the parts related to the embodiment of the present application are shown.

[0117] Reference Figure 7 , the open-back headphones include:

[0118] At least two first microphones (the figure takes the first microphone 1 and the first microphone 2 as examples), which are arranged outside the open-type earphone and are used to collect first audio data respectively;

[0119] A second microphone 3 is disposed on the inner side of the open earphone and is used to collect second audio data;

[0120] A processing module 4 is used to perform audio analysis on each first audio data based on the second audio data, and determine a noise reduction parameter corresponding to each first audio data, where the noise reduction parameter is used to characterize the weight of each first audio data in the noise reduction process;

[0121] The first noise reduction modules 5 and 6 are used to perform noise reduction processing on each first audio data according to the noise reduction parameters corresponding to each first audio data, so as to obtain first noise reduction data corresponding to each first audio data;

[0122] A second noise reduction module 7, configured to perform noise reduction processing on the second audio data to obtain second noise reduction data corresponding to the second audio data;

[0123] The audio mixing module 8 is used to generate target audio data based on the first noise reduction data and the second noise reduction data, so as to control the speaker in the open-type earphone to output the target audio data.

[0124] The open-type earphone provided in this embodiment collects first audio data through at least two first microphones respectively; collects second audio data through a second microphone; performs audio analysis on each first audio data based on the second audio data through a processing module to determine the noise reduction parameter corresponding to each first audio data, and the noise reduction parameter is used to characterize the weight of each first audio data in the noise reduction process; performs noise reduction processing on each first audio data according to the noise reduction parameter corresponding to each first audio data through a first noise reduction module to obtain first noise reduction data corresponding to each first audio data; performs noise reduction processing on the second audio data through a second noise reduction module to obtain second noise reduction data corresponding to the second audio data; generates target audio data based on the first noise reduction data and the second noise reduction data through a mixing module to control the speaker in the open-type earphone to output the target audio data. With the open-type earphone, by performing audio analysis on each first audio data based on the second audio data collected by the second microphone, the noise reduction parameter characterizing the weight of each first audio data in the noise reduction process can be accurately determined, thereby improving the effect of the noise reduction process and thus improving the wearing experience of the user.

[0125] Optionally, the first noise reduction module includes: a first gain unit,

[0126] A first gain unit, used to perform gain processing on each first audio data respectively to obtain first gain processed data corresponding to each first audio data;

[0127] The processing module is also used to perform audio analysis on each first gain processing data based on the second gain processing data to obtain audio information of each first gain processing data; and determine the noise reduction parameters corresponding to each first gain processing data according to the audio information of each first gain processing data.

[0128] Optionally, the first noise reduction module further includes: a first filter and a second gain unit,

[0129] A first filter is used to perform filtering processing on each first gain processed data respectively to obtain first filtered data corresponding to each first gain processed data;

[0130] The second gain unit is used to perform gain processing on the first filtered data corresponding to each first gain processed data according to the gain parameter corresponding to each first gain processed data, so as to obtain the first noise reduction data corresponding to each first audio data.

[0131] Optionally, the second noise reduction module includes: a third gain unit,

[0132] The third gain unit is used to perform gain processing on the second audio data to obtain third gain processed data corresponding to the second audio data.

[0133] Optionally, the second noise reduction module further includes: a second filter and a fourth gain unit,

[0134] a second filter, configured to filter the third gain processed data to obtain second filtered data corresponding to the third gain processed data;

[0135] The fourth gain unit is used to perform gain processing on the second filtered data to obtain second noise reduction data corresponding to the second audio data.

[0136] It should be noted that the information interaction, execution process, etc. between the above-mentioned devices / units are based on the same concept as the method embodiment of the present application. Their specific functions and technical effects can be found in the method embodiment part and will not be repeated here.

[0137] The technicians in the relevant field can clearly understand that for the convenience and simplicity of description, only the division of the above-mentioned functional units and modules is used as an example for illustration. In practical applications, the above-mentioned function allocation can be completed by different functional units and modules as needed, that is, the internal structure of the device can be divided into different functional units or modules to complete all or part of the functions described above. The functional units and modules in the embodiment can be integrated in a processing unit, or each unit can exist physically separately, or two or more units can be integrated in one unit. The above-mentioned integrated unit can be implemented in the form of hardware or in the form of software functional units. In addition, the specific names of the functional units and modules are only for the convenience of distinguishing each other, and are not used to limit the scope of protection of this application. The specific working process of the units and modules in the above-mentioned system can refer to the corresponding process in the aforementioned method embodiment, which will not be repeated here.

[0138] The embodiment of the present application further provides a computer-readable storage medium, which stores a computer program. When the computer program is executed by a processor, the steps in the above-mentioned method embodiments can be implemented.

[0139] An embodiment of the present application provides a computer program product. When the computer program product is run on an open-ear headset, the open-ear headset can implement the steps in the above-mentioned various method embodiments.

[0140] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the present application implements all or part of the processes in the above-mentioned embodiment method, which can be completed by instructing the relevant hardware through a computer program, and the computer program can be stored in a computer-readable storage medium. When the computer program is executed by the processor, the steps of the above-mentioned various method embodiments can be implemented. Among them, the computer program includes computer program code, and the computer program code can be in source code form, object code form, executable file or some intermediate form. The computer-readable medium may at least include: any entity or device that can carry the computer program code to the device / open earphone, a recording medium, a computer memory, a read-only memory (ROM, Read-Only Memory), a random access memory (RAM, Random Access Memory), an electric carrier signal, a telecommunication signal, and a software distribution medium. For example, a USB flash drive, a mobile hard disk, a magnetic disk or an optical disk. In some jurisdictions, according to legislation and patent practice, computer-readable media cannot be electric carrier signals and telecommunication signals.

[0141] In the above embodiments, the description of each embodiment has its own emphasis. For parts that are not described or recorded in detail in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.

[0142] Those of ordinary skill in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of this application.

[0143] In the embodiments provided in the present application, it should be understood that the disclosed device / open-earphone and method can be implemented in other ways. For example, the device / open-earphone embodiments described above are merely schematic. For example, the division of modules or units is only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.

[0144] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0145] The above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit them. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. These modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present application, and should all be included in the protection scope of the present application.

Claims

1. A noise reduction method for open-type headphones, characterized in that: include: Acquire first audio data collected by at least two first microphones of an open-type earphone, and second audio data collected by a second microphone of the open-type earphone, wherein the first microphone and the second microphone are respectively arranged on the outside and the inside of the open-type earphone; Performing audio analysis on each of the first audio data based on the second audio data, and determining a noise reduction parameter corresponding to each of the first audio data, wherein the noise reduction parameter is used to characterize a weight of each of the first audio data in noise reduction processing; According to the noise reduction parameter corresponding to each of the first audio data, each of the first audio data is subjected to noise reduction processing to obtain first noise reduction data corresponding to each of the first audio data; Performing noise reduction processing on the second audio data to obtain second noise reduction data corresponding to the second audio data; Target audio data is generated based on the first noise reduction data and the second noise reduction data to control a speaker in the open headphone to output the target audio data.

2. The noise reduction method for open-ear headphones according to claim 1, characterized in that: The performing audio analysis on each of the first audio data based on the second audio data to determine the noise reduction parameter corresponding to each of the first audio data includes: Performing gain processing on each of the first audio data and the second audio data respectively to obtain first gain-processed data corresponding to each of the first audio data and second gain-processed data corresponding to each of the second audio data; For each of the first gain processed data, performing audio analysis on each of the first gain processed data based on the second gain processed data to obtain audio information of each of the first gain processed data; According to the audio information of each piece of the first gain processed data, the noise reduction parameter corresponding to each piece of the first gain processed data is determined respectively.

3. The noise reduction method for open-ear headphones according to claim 2, characterized in that: The audio information at least includes a delay parameter and a wind noise parameter, and the audio analysis is performed on each of the first gain processing data based on the second gain processing data to obtain the audio information of each of the first gain processing data, including: calculating a delay parameter between each of the first gain-processed data and the second gain-processed data; Wind noise analysis is performed on each of the first gain processed data to obtain a wind noise parameter of each of the first gain processed data.

4. The noise reduction method for open-ear headphones according to claim 3, characterized in that: The step of determining the noise reduction parameter corresponding to each of the first gain processed data according to the audio information of each of the first gain processed data comprises: Setting the priority of the wind noise parameter to the first priority, and setting the priority of the delay parameter to the second priority; According to the delay parameter and the wind noise parameter of each of the first gain processing data, the noise reduction parameter corresponding to each of the first gain processing data is determined respectively by using the first priority and the second priority.

5. The noise reduction method for open-ear headphones according to claim 2, characterized in that: The noise reduction parameter is a gain parameter used for gain processing, and the noise reduction processing is performed on each of the first audio data according to the noise reduction parameter corresponding to each of the first audio data to obtain the first noise reduction data corresponding to each of the first audio data, including: Performing filtering processing on each of the first gain-processed data respectively to obtain first filtered data corresponding to each of the first gain-processed data; According to the gain parameter corresponding to each of the first gain processed data, gain processing is performed on the first filtered data corresponding to each of the first gain processed data to obtain the first noise reduction data corresponding to each of the first audio data.

6. The noise reduction method for open-ear headphones according to claim 5, characterized in that: The step of performing gain processing on the first filter data corresponding to each of the first gain processed data according to the gain parameter corresponding to each of the first gain processed data to obtain the first noise reduction data corresponding to each of the first audio data includes: For each first filtered data corresponding to the first gain processed data, calculating a target gain value corresponding to each first filtered data according to a gain parameter and an initial gain value corresponding to each first gain processed data; For each first filtered data corresponding to the first gain processed data, the target gain value is used to perform gain processing on each first filtered data to obtain first noise reduction data corresponding to each first audio data.

7. The noise reduction method for open-ear headphones according to claim 1, characterized in that: The first microphone is arranged at an edge position of the outer side of the open-type earphone, and the second microphone is arranged at a center position of the inner side of the open-type earphone.

8. An open-type headphone, characterized in that: include: At least two first microphones are disposed outside the open-type earphones and are used to respectively collect first audio data; A second microphone is disposed on the inner side of the open earphone and is used to collect second audio data; a processing module, configured to perform audio analysis on each of the first audio data based on the second audio data, and determine a noise reduction parameter corresponding to each of the first audio data, wherein the noise reduction parameter is used to characterize a weight of each of the first audio data in noise reduction processing; A first noise reduction module, configured to perform noise reduction processing on each of the first audio data according to the noise reduction parameter corresponding to each of the first audio data, to obtain first noise reduction data corresponding to each of the first audio data; A second noise reduction module, configured to perform noise reduction processing on the second audio data to obtain second noise reduction data corresponding to the second audio data; A mixing module is used to generate target audio data based on the first noise reduction data and the second noise reduction data, so as to control the speaker in the open-type earphone to output the target audio data.

9. The earphone according to claim 8, characterized in that The first noise reduction module includes: a first gain unit, The first gain unit is used to perform gain processing on each of the first audio data respectively to obtain first gain processed data corresponding to each of the first audio data; The processing module is also used to perform audio analysis on each of the first gain processing data based on the second gain processing data to obtain audio information of each of the first gain processing data; and determine the noise reduction parameters corresponding to each of the first gain processing data according to the audio information of each of the first gain processing data.

10. The earphone according to claim 9, characterized in that The first noise reduction module further includes: a first filter and a second gain unit, The first filter is used to perform filtering processing on each of the first gain-processed data to obtain first filtered data corresponding to each of the first gain-processed data; The second gain unit is used to perform gain processing on the first filtered data corresponding to each of the first gain processed data according to the gain parameter corresponding to each of the first gain processed data, so as to obtain the first noise reduction data corresponding to each of the first audio data.

11. A computer-readable storage medium storing a computer program, characterized in that: When the computer program is executed by a processor, the method according to any one of claims 1 to 7 is implemented.

12. A computer program product, characterized in that The invention comprises a computer program, which, when executed by a processor, enables the method according to any one of claims 1 to 7 to be performed.

Images