A noise suppression method and system for headphones

By conducting detailed analysis of the audio signals received by the headset, the noise suppression characteristic amount is determined, which solves the problem of poor high-frequency noise suppression effect in the prior art, and achieves a more accurate noise suppression effect and improves the clarity of the audio signal.

CN118803501BActive Publication Date: 2025-04-11ONWAY TECH LTD
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202410972905.9
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2024-07-19
Publication Date
2025-04-11
Estimated Expiration
2044-07-19

AI Technical Summary

Technical Problem

The existing noise suppression scheme for headphones is weak in high-frequency noise suppression and is easily affected by rapidly changing environmental noise, resulting in insufficient accuracy of noise suppression.

Method used

By collecting the audio signals received by the target headset, analyzing the deviation of the signal points, determining the jitter response and phase mismatch information of the audio signal, combining the phase difference diagram and path characteristics of the noise, determining the noise disturbance domain and suppressing feature quantity, and then suppressing the noise in the audio signals received by the target headset.

Benefits of technology

Effectively weaken the impact of high-frequency noise on noise suppression in headphones, improve the accuracy of noise suppression, and ensure that users have a clearer audio experience when receiving audio.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118803501B_ABST
    Figure CN118803501B_ABST
Patent Text Reader

Abstract

The present application provides a method and system for noise suppression for headphones, which determines multiple signal outliers of a signal in an audio signal, determines the audio jitter response of the audio signal through all the signal outliers; determines phase mismatch information based on the signal-to-interference ratio of the audio signal and the intensity characteristics of the audio signal, and determines the phase difference diagram of the noise when the audio signal is converted in the target headphone based on the phase mismatch information; determines the noise disturbance domain of the audio signal based on the path characteristics of the audio signal and the phase difference diagram of the noise, and determines the suppression characteristic quantity of the noise in the audio signal through the noise disturbance domain and the jitter response of the audio; finally, suppresses the noise in the audio signal received by the target headphone based on the suppression characteristic quantity of the noise. The above scheme can weaken the influence of high-frequency noise on noise suppression in headphones, thereby improving the accuracy of noise suppression in headphones.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the field of earphone technology, and more specifically, to a method and system for suppressing noise in headphones. Background Art

[0002] Headphones are an electronic device that is mainly used to receive audio signals and convert them into sounds for users to listen to. Headphones can be divided into many types, including wired headphones, wireless headphones, in-ear headphones, headphones, etc. In order to enable users to listen to music or other audio content more attentively, technical means can be used to reduce environmental noise so that users can get better listening effects.

[0003] Existing noise suppression solutions for headphones generally detect noise signals that have been transmitted to the earmuffs and generate anti-phase sound waves to cancel them out. By capturing noise signals early, they are canceled out before they enter the ears. This is especially effective for mid- and low-frequency noise, but the suppression effect on high-frequency noise is weaker and is easily affected by rapidly changing environmental noise. Therefore, how to weaken the impact of high-frequency noise on noise suppression in headphones and thus improve the accuracy of noise suppression in headphones has become a difficult problem faced by the industry. Summary of the invention

[0004] The present application provides a noise suppression method and system for headphones, which can weaken the influence of high-frequency noise on noise suppression in headphones, thereby improving the accuracy of noise suppression in headphones.

[0005] In a first aspect, the present application provides a noise suppression method for headphones, comprising the following steps:

[0006] Collect the audio signal received by the target headphone;

[0007] Performing adjacent comparison on signal points in the audio signal to obtain a plurality of signal outliers in the audio signal, and determining the audio jitter response when the target headphone outputs the audio signal through all the signal outliers;

[0008] Determine a signal-to-interference ratio of the audio signal, and then determine phase mismatch information generated by a target headphone when receiving audio based on the signal-to-interference ratio and the intensity characteristics of the audio signal, and determine a phase difference diagram of noise when the audio signal is converted in the target headphone according to the phase mismatch information;

[0009] Acquire a path feature during the transmission of the audio signal, determine a noise disturbance domain of the audio signal according to the path feature and a phase difference diagram of the noise, and determine a noise suppression feature value in the audio signal according to the noise disturbance domain and a jitter response of the audio;

[0010] Noise in an audio signal received by a target headphone is suppressed according to the noise suppression feature amount.

[0011] In some embodiments, performing adjacent comparison on the signal points in the audio signal to obtain a plurality of signal outliers in the audio signal specifically includes:

[0012] Determining a sliding window of the audio signal;

[0013] determining a plurality of audio signal segments of the audio signal according to the sliding window;

[0014] Selecting an audio signal segment as a selected audio signal segment, and determining a deviation coefficient of each signal point in the selected audio signal segment;

[0015] determining a deviation domain of an audio signal;

[0016] Judging the signal points in the selected audio signal segment according to all deviation coefficients and the deviation domain, thereby obtaining a plurality of signal outliers in the selected audio signal segment;

[0017] Continue to determine a plurality of signal outliers of the remaining audio signal segments in the audio signal to obtain a plurality of signal outliers of the signal in the audio signal.

[0018] In some embodiments, determining the audio jitter response when the target headphone outputs the audio signal through all signal outliers specifically includes:

[0019] Determine the signal point deviation entropy based on all signal outliers;

[0020] Determine, by using the signal point deviation entropy and the audio signal, an instability signal when the audio signal is output in a target headphone;

[0021] The instability signal is used as a jitter response of the audio when the target headphone outputs the audio signal.

[0022] In some embodiments, determining the phase mismatch information generated by the target headphone when receiving audio based on the signal-to-interference ratio and the intensity characteristics of the audio signal specifically includes:

[0023] Acquire the signal strength of each signal point in the audio signal, and use all the signal strengths as the strength features of the audio signal;

[0024] Determine, by using the intensity feature and the audio signal, a noise evaluation signal generated by the target headphone when receiving audio;

[0025] Phase mismatch information generated by the target headphone when receiving audio is determined according to the signal-to-interference ratio and the noise estimation signal.

[0026] In some embodiments, determining a phase difference diagram of noise when the audio signal is converted in the target headphone according to the phase mismatch information specifically includes:

[0027] Acquiring audio phase information of the audio signal;

[0028] Determine a plurality of noise phase differences using the phase mismatch information and the audio phase information;

[0029] A phase difference diagram of the noise when the audio signal is converted in the target headphone is determined according to all the noise phase differences.

[0030] In some embodiments, determining the noise disturbance domain of the audio signal according to the path characteristics and the phase difference diagram of the noise specifically includes:

[0031] Determine a path disturbance signal of the audio signal by using the path feature;

[0032] A noise disturbance domain of the audio signal is determined according to a phase difference diagram between the path disturbance signal and the noise.

[0033] In some embodiments, determining the suppression characteristic amount of the noise in the audio signal through the noise disturbance domain and the jitter response of the audio specifically includes:

[0034] determining a noise frequency of the audio signal according to the noise disturbance domain;

[0035] Determining a noise suppression frequency by using the noise frequency and a jitter response of the audio;

[0036] A suppression feature amount of noise in the audio signal is determined according to the noise suppression frequency.

[0037] In a second aspect, the present application provides a noise suppression system for headphones, comprising:

[0038] An acquisition module, used to collect audio signals received by the target headphone;

[0039] A processing module, configured to perform adjacent comparison on signal points in the audio signal, thereby obtaining a plurality of signal outliers in the audio signal, and determining the jitter response of the audio when the target headphone outputs the audio signal through all the signal outliers;

[0040] The processing module is further used to determine a signal-to-interference ratio of the audio signal, and then determine phase mismatch information generated by the target headphone when receiving audio based on the signal-to-interference ratio and the intensity characteristics of the audio signal, and determine a phase difference diagram of noise when the audio signal is converted in the target headphone according to the phase mismatch information;

[0041] The processing module is further used to obtain the path characteristics of the audio signal during transmission, and then determine the noise disturbance domain of the audio signal according to the path characteristics and the phase difference diagram of the noise, and determine the suppression characteristic amount of the noise in the audio signal through the noise disturbance domain and the jitter response of the audio;

[0042] The execution module is used to suppress the noise in the audio signal received by the target headphone according to the noise suppression feature.

[0043] In a third aspect, the present application provides a computer device, comprising a memory and a processor, wherein the memory stores codes, and the processor is configured to obtain the codes and execute the above-mentioned noise suppression method for headphones.

[0044] In a fourth aspect, the present application provides a computer-readable storage medium, wherein the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the above-mentioned noise suppression method for headphones is implemented.

[0045] The technical solution provided by the embodiments disclosed in this application has the following beneficial effects:

[0046] In the noise suppression method and system for headphones provided by the present application, first, an audio signal received by a target headphone is collected; adjacent signal points in the audio signal are compared to obtain multiple signal outliers in the audio signal, and the jitter response of the audio when the target headphone outputs the audio signal is determined through all the signal outliers; then the signal-to-interference ratio of the audio signal is determined, and then the phase mismatch information generated by the target headphone when receiving the audio is determined based on the signal-to-interference ratio and the intensity characteristics of the audio signal, and the phase difference diagram of the noise when the audio signal is converted in the target headphone is determined based on the phase mismatch information; thereby, the path characteristics of the audio signal during transmission are obtained, and then the noise disturbance domain of the audio signal is determined based on the path characteristics and the phase difference diagram of the noise, and the suppression characteristic amount of the noise in the audio signal is determined based on the noise disturbance domain and the jitter response of the audio; finally, the noise in the audio signal received by the target headphone is suppressed based on the noise suppression characteristic amount.

[0047] It can be seen that in the process of noise suppression of headphones, the present application first analyzes the signal points where deviations occur in the audio signal to determine the unstable or distorted state of the audio signal when it is output, and then obtains the audio jitter response of the audio signal when it is output in the target headphone, and the audio jitter response is used to judge the state of the high-frequency noise integrated in the audio signal during the transmission process, so as to obtain the noise situation in the audio signal; secondly, by analyzing the signal-to-interference ratio of the audio signal and the intensity characteristics of the audio signal, the visual spectrum of the phase difference corresponding to the noise in the audio signal is determined, and then the degree of noise suppression in the audio signal is analyzed according to the visual spectrum combined with the path situation during the transmission of the audio signal, and the suppression characteristic quantity of the noise in the audio signal is obtained, and the suppression characteristic quantity of the noise can suppress the high-frequency noise received by the headphone; finally, according to the suppression characteristic quantity of the noise, the noise in the audio signal received by the target headphone is suppressed. The above scheme can weaken the influence of high-frequency noise on noise suppression in headphones, thereby improving the accuracy of noise suppression in headphones. BRIEF DESCRIPTION OF THE DRAWINGS

[0048] Figure 1 is an exemplary flow chart of a noise suppression method for headphones according to some embodiments of the present application;

[0049] Figure 2 is an exemplary flow chart of determining a jitter response of an audio according to some embodiments of the present application;

[0050] Figure 3 is an exemplary flow chart of determining a phase difference diagram of noise according to some embodiments of the present application;

[0051] Figure 4 is a schematic diagram of exemplary hardware and / or software of a noise suppression system for headphones according to some embodiments of the present application;

[0052] Figure 5 It is a structural schematic diagram of a computer device for implementing a noise suppression method for headphones according to some embodiments of the present application. DETAILED DESCRIPTION

[0053] The core of this application is to collect the audio signal received by the target headset; compare the adjacent signal points in the audio signal, and then obtain multiple signal outliers in the audio signal, and determine the jitter response of the audio when the target headset outputs the audio signal through all the signal outliers; and then determine the signal-to-interference ratio of the audio signal, and then determine the phase mismatch information generated by the target headset when receiving the audio from the signal-to-interference ratio and the intensity characteristics of the audio signal, and determine the phase difference diagram of the noise when the audio signal is converted in the target headset according to the phase mismatch information; thereby obtaining the path characteristics of the audio signal during transmission, and then determine the noise disturbance domain of the audio signal according to the path characteristics and the phase difference diagram of the noise, and determine the suppression characteristic quantity of the noise in the audio signal through the noise disturbance domain and the jitter response of the audio; finally, suppress the noise in the audio signal received by the target headset according to the suppression characteristic quantity of the noise. The above scheme can weaken the influence of high-frequency noise on noise suppression in the headset, thereby improving the accuracy of noise suppression in the headset.

[0054] In order to better understand the above technical solution, the above technical solution will be described in detail below in conjunction with the accompanying drawings and specific implementation methods. Figure 1 , which is an exemplary flow chart of a noise suppression method for headphones according to some embodiments of the present application. The noise suppression method 100 for headphones mainly includes the following steps:

[0055] In step 101, an audio signal received by a target headphone is collected.

[0056] In specific implementation, the audio signal received by the target headset can be collected by the audio collection device in the existing device, wherein the audio signal represents the signal collected by the target headset through the Bluetooth connection, the audio signal may include an electrical signal of sound information, and the audio signal is represented by the characteristics of the sound wave such as frequency, amplitude and phase. The target headset is connected to the audio emitting device by Bluetooth, and the audio is transmitted through the Bluetooth channel, so that the audio transmitted through the Bluetooth channel is collected by the target headset to obtain the audio signal.

[0057] In step 102, adjacent signal points in the audio signal are compared to obtain a plurality of signal outliers in the audio signal, and the audio jitter response when the target headphone outputs the audio signal is determined through all the signal outliers.

[0058] In some embodiments, performing adjacent comparison on the signal points in the audio signal to obtain a plurality of signal outliers in the audio signal may be implemented by using the following steps:

[0059] Determining a sliding window of the audio signal;

[0060] determining a plurality of audio signal segments of the audio signal according to the sliding window;

[0061] Selecting an audio signal segment as a selected audio signal segment, and determining a deviation coefficient of each signal point in the selected audio signal segment;

[0062] determining a deviation domain of an audio signal;

[0063] Judging the signal points in the selected audio signal segment according to all deviation coefficients and the deviation domain, thereby obtaining a plurality of signal outliers in the selected audio signal segment;

[0064] Continue to determine a plurality of signal outliers of the remaining audio signal segments in the audio signal to obtain a plurality of signal outliers of the signal in the audio signal.

[0065] In a specific implementation, the sliding window represents a window for performing regional analysis on the audio signal, which is used to segment the audio signal, thereby facilitating the analysis of the audio signal. As a preferred embodiment, the sliding window of the audio signal can be determined by combining the sliding window algorithm in the prior art with the historical audio signal data, the audio duration, the audio signal strength data, etc., wherein the sliding window algorithm is, for example, a fixed-size sliding window algorithm, a variable-length sliding window, and a double-ended queue sliding window. Determining the multiple audio signal segments of the audio signal according to the sliding window can be implemented in the following manner, namely, segmenting the audio signal according to the size of the sliding window to obtain multiple audio signal segments of the audio signal. For example, the size of the sliding window is 2, and the audio signal is (2, 3, 4, 2, 4, 3, 2, 4). The audio signal (2, 3, 4, 2, 4, 3, 2, 4) is segmented according to the sliding window size of 2 to obtain 4 audio signal segments (2, 3), (4, 2), (4, 3), and (2, 4). In other embodiments, other methods can also be used for determination, which are not limited here.

[0066] In specific implementation, determining the deviation coefficient of each signal point in the selected audio signal segment can be achieved in the following manner, namely: selecting a signal point in the selected audio signal segment, subtracting the average value of all audio amplitudes in the selected audio signal segment from the audio amplitude corresponding to the signal point, dividing the value obtained by the subtraction by the standard deviation of all audio amplitudes in the selected audio signal segment, using the value obtained by the division as the deviation coefficient of the signal point, and continuing to determine the deviation coefficients of the remaining signal points in the selected audio signal segment, wherein the deviation coefficient represents a parameter value of the deviation degree of the corresponding signal point in the selected audio signal segment, and is used to analyze the audio signal; determining the deviation domain of the audio signal can be achieved in the following manner, namely: the deviation domain represents a threshold range of the deviation degree of the signal point in the audio signal, and is used to analyze the audio signal The signal points in the signal are judged. As a preferred embodiment, the deviation domain can be judged by combining the deviation domain algorithm in the prior art with the historical audio signal, the historical deviation points, the audio signal strength data, etc.; the signal points in the selected audio signal segment are judged according to all the deviation coefficients and the deviation domain, and then the multiple signal outliers of the selected audio signal segment are obtained. The following method can be used, namely: a deviation coefficient is selected. If the deviation coefficient is within the range of the deviation domain, the signal point corresponding to the deviation coefficient is used as a signal outlier of the signal in the selected audio signal segment; if the deviation coefficient is not within the range of the deviation domain, no processing is performed, and the multiple signal outliers of the signal in the selected audio signal segment are continued to be determined; in other embodiments, other methods can be used for determination, which are not limited here.

[0067] It should be noted that the signal outlier in the present application represents a signal point where a deviation occurs in an audio signal, and is used to analyze the deviation of the audio signal, so as to facilitate the analysis of the noise of the audio signal; adjacent signal points in the audio signal are compared, that is: the deviation coefficient of each signal point in the audio signal segment is determined, the deviation domain of the audio signal is determined, and the signal points in the audio signal segment are judged according to all the deviation coefficients and the deviation domain, thereby obtaining multiple signal outliers.

[0068] In some embodiments, reference Figure 2 As shown, this figure is a schematic diagram of the process of determining the jitter response of the audio in some embodiments of the present application. In this embodiment, the jitter response of the audio when the target headphone outputs the audio signal is determined by all signal outliers, which can be implemented by the following steps:

[0069] First, in step 1021, the signal point deviation entropy is determined according to all signal outliers;

[0070] Secondly, in step 1022, an instability signal when the audio signal is output in a target headphone is determined by using the signal point deviation entropy and the audio signal;

[0071] Finally, in step 1023, the instability signal is used as a jitter response of the audio when the target headphone outputs the audio signal.

[0072] In a specific implementation, determining the signal point deviation entropy based on all signal outliers can be achieved by the following steps, namely: dividing the average of the audio amplitudes corresponding to all signal outliers by the average of all audio amplitudes in the audio signal, performing a logarithmic operation with a base of 2 on the value obtained by the division, and using the value obtained by the logarithmic operation as the signal point deviation entropy, wherein the signal point deviation entropy represents a parameter value of the random degree of the deviation signal, which is used to analyze the noise situation in the audio signal; determining the instability signal of the audio signal when it is output in the target headphone through the signal point deviation entropy and the audio signal can be achieved in the following manner, namely: initializing a An unstable signal prediction model is provided, the signal point deviation entropy is used as a constraint parameter of the unstable signal prediction model, the audio signal is used as an initial parameter of the unstable signal prediction model, and the unstable signal of the audio signal when it is output in the target headphone is predicted by the unstable signal prediction model to obtain the unstable signal of the audio signal when it is output in the target headphone; wherein the unstable signal generally indicates an unstable or distorted signal generated when the audio signal is output, which may be caused by equipment problems, signal processing problems or transmission problems. In other embodiments, other methods may be used for determination, which is not limited here.

[0073] It should be noted that the audio jitter response in the present application reflects the response of the jitter (instability or distortion) generated when the audio signal is output, which is used to analyze the state of the audio signal during the transmission process and then suppress the noise of the audio signal.

[0074] In step 103, the signal-to-interference ratio of the audio signal is determined, and then the phase mismatch information generated by the target headphone when receiving the audio is determined based on the signal-to-interference ratio and the intensity characteristics of the audio signal, and the phase difference diagram of the noise when the audio signal is converted in the target headphone is determined based on the phase mismatch information.

[0075] It should be noted that the signal-to-interference ratio described in the present application represents a parameter value of the proportion of the interference signal in the audio signal, which is used to predict the proportion between the useful signal and the interference signal, so as to facilitate the analysis of the audio signal. As a preferred embodiment, the signal-to-interference ratio can be determined by the signal-to-interference ratio algorithm in the prior art combined with the audio signal, audio signal strength, acquisition time, etc., wherein the signal-to-interference ratio algorithm, for example: spectrum analysis method, time domain analysis method, power meter, etc., can also be determined in other ways in other embodiments, which is not limited here.

[0076] In some embodiments, determining the phase mismatch information generated by the target headphone when receiving audio based on the signal-to-interference ratio and the intensity characteristics of the audio signal can be implemented by the following steps:

[0077] Acquire the signal strength of each signal point in the audio signal, and use all the signal strengths as the strength features of the audio signal;

[0078] Determine, by using the intensity feature and the audio signal, a noise evaluation signal generated by the target headphone when receiving audio;

[0079] Phase mismatch information generated by the target headphone when receiving audio is determined according to the signal-to-interference ratio and the noise estimation signal.

[0080] It should be noted that the signal strength of each signal point in the audio signal described in the present application represents the parameter value of the strength degree of each signal point. Usually, the amplitude of the signal point can be used as the signal strength of the signal point. As a preferred embodiment, the signal strength of each signal point in the audio signal can be obtained by a signal strength device in the prior art, wherein the signal strength device is, for example, an audio analyzer, a spectrum analyzer, an oscilloscope, etc. In other embodiments, other methods can also be used to obtain it, which is not limited here.

[0081] In specific implementation, determining the noise evaluation signal generated by the target headphone when receiving audio through the intensity feature and the audio signal can be implemented in the following manner, namely: initialize a noise signal evaluation model, use the intensity feature as a constraint parameter of the noise signal evaluation model, use the audio signal as an initial parameter of the noise signal evaluation model, and evaluate the noise signal of the audio signal through the noise signal evaluation model to obtain a noise evaluation signal, wherein the noise evaluation signal represents a signal of noise in the audio signal and is used to perform noise analysis on the audio signal; determining the phase mismatch information generated by the target headphone when receiving audio according to the signal-to-interference ratio and the noise estimation signal can be implemented in the following manner, namely: perform a fast Fourier transform (FFT) on the noise estimation signal, extract all phases from the result obtained by the fast Fourier transform (FFT), perform a logarithm operation on the signal-to-interference ratio with a base of 2, multiply the absolute values ​​of the values ​​obtained by the logarithm operation by the extracted phases, use all the multiplied values ​​as noise phases, and use the set of all noise phases as phase mismatch information. In other embodiments, other methods can also be used for determination, which is not limited here.

[0082] It should be noted that the phase mismatch information in the present application indicates that there is inconsistent phase information of the noise signal in the audio signal in the headphones (i.e., the phase information of the noise signal received by the headphones), which is used to eliminate the noise signal in the audio signal and to enhance the audio signal to better suppress noise.

[0083] In some embodiments, reference Figure 3 As shown, this figure is a schematic diagram of the process of determining the phase difference diagram in some embodiments of the present application. In this embodiment, the phase difference diagram of the noise when the audio signal is converted in the target headphone according to the phase mismatch information can be implemented by the following steps:

[0084] First, in step 1031, audio phase information of the audio signal is obtained;

[0085] Secondly, in step 1032, a plurality of noise phase differences are determined using the phase mismatch information and the audio phase information;

[0086] Finally, in step 1033, a phase difference diagram of the noise when the audio signal is converted in the target headphone is determined according to all the noise phase differences.

[0087] In specific implementation, obtaining the audio phase information of the audio signal can be achieved in the following manner, namely: performing a fast Fourier transform (FFT) on the audio signal, extracting all phases in the result obtained by the fast Fourier transform (FFT), taking each phase as the audio phase, and taking the set of all audio phases as the audio phase information, wherein the audio phase information represents information about the phase condition of the audio signal; determining multiple phase differences of the noise through the phase mismatch information and the audio phase information can be achieved in the following manner, namely: selecting a noise phase in the phase mismatch information, subtracting the average value of all audio phases in the audio phase information from the audio phase information from the audio phase phase corresponding to the noise phase in the audio phase information, taking the value obtained by subtraction as the first value, subtracting the audio phase corresponding to the noise phase in the audio phase information from the noise phase, taking the value obtained by subtraction as the second value, adding the first value to the second value, and taking the added value as the noise phase difference of the noise phase, repeating the above steps to obtain the noise phase difference of the sound noise phase, wherein a noise phase pair an audio phase, the noise phase difference represents a parameter value of the difference degree between the corresponding noise phase and the audio phase, and is used to analyze the noise in the audio signal; determining the phase difference diagram of the noise when the audio signal is converted in the target headphone according to all the noise phase differences can be implemented in the following manner, namely: arranging all the noise phase differences in the order of the corresponding noise phases, taking the sequence obtained by the arrangement as the noise phase difference sequence, selecting a group of adjacent noise phase differences as selected adjacent noise phase differences, extracting the total number of all audio phases between two audio phases corresponding to the selected adjacent noise phase differences in the audio phase information, taking the total number as the connection length between the selected adjacent noise phase differences, repeating the above steps to obtain the connection length between the remaining adjacent noise phase differences in the noise phase difference sequence, connecting all the noise phase differences through all the connection lengths, and taking the connection result as the phase difference diagram of the noise when the audio signal is converted in the target headphone. In other embodiments, other methods can also be used for connection, which are not limited here.

[0088] It should be noted that the phase difference diagram of noise in the present application is a visualized diagram reflecting the phase difference corresponding to the noise in the audio signal, and is used to analyze the noise in the audio signal.

[0089] In step 104, the path characteristics of the audio signal during transmission are obtained, and then the noise disturbance domain of the audio signal is determined according to the path characteristics and the phase difference diagram of the noise, and the suppression characteristic quantity of the noise in the audio signal is determined by the noise disturbance domain and the jitter response of the audio.

[0090] It should be noted that the path characteristics described in the present application represent the distance of the audio signal from the output terminal to the middle path of the target headphone. As a preferred embodiment, the path characteristics of the audio signal during transmission can be obtained through a path acquisition device in the prior art, wherein the path acquisition device is, for example: an ultrasonic rangefinder, a radar rangefinder, an optical fiber rangefinder, etc. In other embodiments, other methods can also be used to obtain it, which will not be repeated here.

[0091] In some embodiments, determining the noise disturbance domain of the audio signal according to the path characteristics and the phase difference diagram of the noise may be implemented by the following steps:

[0092] Determine a path disturbance signal of the audio signal by using the path feature;

[0093] A noise disturbance domain of the audio signal is determined according to a phase difference diagram between the path disturbance signal and the noise.

[0094] In a specific implementation, the path disturbance signal of the audio signal determined by the path characteristics can be implemented in the following manner, namely: first, the signal adjustment value of the audio signal can be determined by combining the path characteristics with the multipath device in the prior art, wherein the multipath device is, for example, an equalizer, a Rake receiver, a space-time coding device, etc.; secondly, the opposite number of the distance in the path characteristics is subjected to a natural exponential operation, 1 is subtracted from the value obtained by the natural exponential operation, the subtracted value is multiplied by the signal adjustment value, and then the multiplied value is multiplied by the amplitude of each signal point in the audio signal; finally, the multiplied signal is used as the path disturbance signal of the audio signal, wherein the path disturbance The signal represents the audio signal after combining the path characteristics, which is used to adjust the audio signal and then analyze the path interference of the audio signal; determining the noise disturbance domain of the audio signal according to the phase difference diagram of the path disturbance signal and the noise can be achieved in the following manner, namely: extracting a prominent phase difference (i.e., a phase difference exceeding the average value of all phase differences) from the phase difference diagram of the noise, determining whether all the extracted phase differences are connected in the phase difference diagram of the noise, and taking all signal point areas corresponding to the total number of all connected phase differences in the path disturbance signal as the noise disturbance domain of the audio signal. In other embodiments, other methods can also be used for determination, which are not limited here.

[0095] It should be noted that the noise disturbance domain in the present application is an area reflecting the presence of noise interference in the audio signal, and is used to analyze the noise suppression situation in the audio signal, so that the target headphones play the audio after noise removal.

[0096] In some embodiments, determining the suppression characteristic amount of the noise in the audio signal by using the noise disturbance domain and the jitter response of the audio signal may be implemented by the following steps:

[0097] determining a noise frequency of the audio signal according to the noise disturbance domain;

[0098] Determining a noise suppression frequency by using the noise frequency and a jitter response of the audio;

[0099] A suppression feature amount of noise in the audio signal is determined according to the noise suppression frequency.

[0100] In specific implementation, determining the noise frequency of the audio signal according to the noise disturbance domain can be implemented in the following manner, namely: extracting all signal points corresponding to the noise disturbance domain in the path disturbance signal, and determining the noise frequency of the audio signal by combining the audio signals corresponding to all signal points through a frequency algorithm in the prior art, and the frequency algorithm is, for example, fast Fourier transform (FFT), discrete Fourier transform (DFT), Hilbert transform, etc.; determining the noise suppression frequency by the noise frequency and the jitter response of the audio can be implemented in the following manner, namely: determining the signal frequency of the unstable signal corresponding to the jitter response of the audio through the frequency algorithm in the prior art, and taking the average of the signal frequency and the noise frequency as the noise suppression frequency, wherein the noise suppression frequency is the suppression frequency of the noise signal in the audio signal under the jitter response of the audio, improving the frequency accuracy of the noise signal in the audio signal, and facilitating the suppression of the noise signal in the audio signal; determining the suppression feature quantity of the noise in the audio signal according to the noise suppression frequency can be implemented in the following manner, namely: taking the noise suppression frequency as the suppression feature quantity of the noise in the audio signal, and in other embodiments, other methods can also be used for determination, which is not limited here.

[0101] It should be noted that the noise suppression feature in the present application is a parameter that reflects the degree of noise suppression in the audio signal, and is used to suppress the noise in the audio signal so that the headphones receive the audio signal after the noise is removed.

[0102] In step 105, noise in the audio signal received by the target headphone is suppressed according to the noise suppression feature.

[0103] In some embodiments, suppressing the noise in the audio signal received by the target headphone according to the noise suppression feature may be implemented by the following steps:

[0104] Determining an anti-noise signal of the audio signal according to the suppression characteristic amount of the noise;

[0105] The anti-noise signal is combined with the audio signal in the headphone, thereby suppressing noise in the audio signal received by the target headphone.

[0106] In specific implementation, the anti-noise signal represents a noise signal that has a suppressive effect on the noise in the audio signal, and is used to suppress the noise in the audio signal, so that the headphone outputs a clear audio signal. As a preferred embodiment, the anti-noise signal of the audio signal can be determined by combining the noise generation method in the prior art with the noise suppression feature and the audio signal, wherein the noise generation method is, for example, a time domain inversion method, a frequency domain inversion method, a feedback control method, etc.; by combining the anti-noise signal with the audio signal in the headphone, the noise in the audio signal received by the target headphone can be suppressed. The following method can be used, namely: the anti-noise signal can be combined with the audio signal in the headphone by a linear mixing method in the prior art, and the combined signal is used as the signal output by the headphone, so that the combined signal is used as the audio signal received by the target headphone, thereby completing the noise suppression in the audio signal received by the target headphone; in other embodiments, other methods can also be used for implementation, which are not limited here.

[0107] In addition, in another aspect of the present application, in some embodiments, the present application provides a noise suppression system for headphones, referring to Figure 4 , which is a schematic diagram of exemplary hardware and / or software of a noise suppression system for headphones according to some embodiments of the present application, the noise suppression system 400 for headphones includes: an acquisition module 401, a processing module 402 and an execution module 403, which are described as follows:

[0108] Acquisition module 401, in this application, acquisition module 401 is mainly used to collect audio signals received by the target headphone;

[0109] Processing module 402, in the present application, is used to perform adjacent comparison on signal points in the audio signal, thereby obtaining multiple signal outliers in the audio signal, and determining the audio jitter response when the target headphone outputs the audio signal through all the signal outliers;

[0110] It should be noted that the processing module 402 in the present application is also used to determine the signal-to-interference ratio of the audio signal, and then determine the phase mismatch information generated by the target headphone when receiving the audio based on the signal-to-interference ratio and the intensity characteristics of the audio signal, and determine the phase difference diagram of the noise when the audio signal is converted in the target headphone according to the phase mismatch information;

[0111] In addition, it should be noted that the processing module 402 in the present application is also used to obtain the path characteristics of the audio signal during transmission, and then determine the noise disturbance domain of the audio signal according to the path characteristics and the phase difference diagram of the noise, and determine the suppression characteristic amount of the noise in the audio signal through the noise disturbance domain and the jitter response of the audio;

[0112] The execution module 403 in the present application is mainly used to suppress the noise in the audio signal received by the target headphone according to the noise suppression feature.

[0113] In addition, the present application also provides a computer device, which includes a memory and a processor, wherein the memory stores codes, and the processor is configured to obtain the codes and execute the above-mentioned noise suppression method for headphones.

[0114] In some embodiments, reference Figure 5 , which is a schematic diagram of the structure of a computer device for implementing a noise suppression method for headphones according to some embodiments of the present application. The noise suppression method for headphones in the above embodiments can be achieved by Figure 5 The computer device 500 shown in the figure is implemented, and the computer device 500 includes at least one processor 501, a communication bus 502, a memory 503 and at least one communication interface 504.

[0115] The processor 501 may be a general-purpose central processing unit (CPU) or an application-specific integrated circuit (ASIC).

[0116] The communication bus 502 may be used to transmit information between the above-mentioned components.

[0117] The memory 503 may be a read-only memory (ROM) or other types of static storage devices that can store static information and instructions, a random access memory (RAM) or other types of dynamic storage devices that can store information and instructions, or an electrically erasable programmable read-only memory (EEPROM), a compact disc read-only memory (CD-ROM) or other optical disc storage, optical disc storage (including compressed optical disc, laser disc, optical disc, digital versatile disc, Blu-ray disc, etc.), a disk or other magnetic storage device, or any other medium that can be used to carry or store the desired program code in the form of instructions or data structures and can be accessed by a computer, but is not limited thereto. The memory 503 may exist independently and be connected to the processor 501 via the communication bus 502. The memory 503 may also be integrated with the processor 501.

[0118] The memory 503 is used to store the program code for executing the solution of the present application, and the execution is controlled by the processor 501. The processor 501 is used to execute the program code stored in the memory 503. The program code may include one or more software modules. The method used in the above embodiment can be implemented by the processor 501 and one or more software modules in the program code in the memory 503.

[0119] The communication interface 504 uses any transceiver or other device for communicating with other devices or communication networks, such as Ethernet, radio access network (RAN), wireless local area networks (WLAN), etc.

[0120] In a specific implementation, as an embodiment, a computer device may include multiple processors, each of which may be a single-CPU processor or a multi-CPU processor. The processor here may refer to one or more devices, circuits, and / or processing cores for processing data (e.g., computer program instructions).

[0121] The above-mentioned computer device can be a general-purpose computer device or a special-purpose computer device. In a specific implementation, the computer device can be a desktop computer, a portable computer, a network server, a personal digital assistant (PDA), a mobile phone, a tablet computer, a wireless terminal device, a communication device or an embedded device. The embodiment of the present application does not limit the type of computer device.

[0122] In addition, the present application also provides a computer-readable storage medium, wherein the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the above-mentioned noise suppression method for headphones is implemented.

[0123] Although the preferred embodiments of the present application have been described, those skilled in the art may make other changes and modifications to these embodiments once they have learned the basic creative concept. Therefore, the appended claims are intended to be interpreted as including the preferred embodiments and all changes and modifications falling within the scope of the present application.

[0124] Obviously, those skilled in the art can make various changes and modifications to the present application without departing from the spirit and scope of the present application. Thus, if these modifications and variations of the present application fall within the scope of the claims of the present application and their equivalents, the present application is also intended to include these modifications and variations.

Claims

1. A noise suppression method for headphones, characterized in that: The steps include: Collect the audio signal received by the target headphone; Performing adjacent comparison on signal points in the audio signal to obtain a plurality of signal outliers in the audio signal, and determining the audio jitter response when the target headphone outputs the audio signal through all the signal outliers; Determine a signal-to-interference ratio of the audio signal, and then determine phase mismatch information generated by a target headphone when receiving audio based on the signal-to-interference ratio and the intensity characteristics of the audio signal, and determine a phase difference diagram of noise when the audio signal is converted in the target headphone according to the phase mismatch information; Acquire a path feature during the transmission of the audio signal, determine a noise disturbance domain of the audio signal according to the path feature and a phase difference diagram of the noise, and determine a noise suppression feature value in the audio signal according to the noise disturbance domain and a jitter response of the audio; Suppressing noise in an audio signal received by a target headphone according to the noise suppression feature; The step of performing adjacent comparison on the signal points in the audio signal to obtain a plurality of signal outliers in the audio signal specifically includes: Determining a sliding window of the audio signal; determining a plurality of audio signal segments of the audio signal according to the sliding window; Selecting an audio signal segment as a selected audio signal segment, and determining a deviation coefficient of each signal point in the selected audio signal segment; determining a deviation domain of an audio signal; Judging the signal points in the selected audio signal segment according to all deviation coefficients and the deviation domain, thereby obtaining a plurality of signal outliers in the selected audio signal segment; Continue to determine a plurality of signal outliers of the remaining audio signal segments in the audio signal to obtain a plurality of signal outliers of the signal in the audio signal; The signal strength of each signal point in the audio signal is obtained, and all signal strengths are used as the strength features of the audio signal.

2. The method according to claim 1, characterized in that Determining the audio jitter response when the target headphone outputs the audio signal through all signal outliers specifically includes: Determine the signal point deviation entropy based on all signal outliers; Determine, by using the signal point deviation entropy and the audio signal, an instability signal when the audio signal is output in a target headphone; The instability signal is used as a jitter response of the audio when the target headphone outputs the audio signal.

3. The method according to claim 1, characterized in that Determining the phase mismatch information generated by the target headphone when receiving audio based on the signal-to-interference ratio and the intensity characteristics of the audio signal specifically includes: Acquire the signal strength of each signal point in the audio signal, and use all the signal strengths as the strength features of the audio signal; Determine, by using the intensity feature and the audio signal, a noise evaluation signal generated by the target headphone when receiving audio; Phase mismatch information generated by the target headphone when receiving audio is determined according to the signal-to-interference ratio and the noise estimation signal.

4. The method according to claim 1, characterized in that Determining the phase difference diagram of the noise when the audio signal is converted in the target headphone according to the phase mismatch information specifically includes: Acquiring audio phase information of the audio signal; Determine a plurality of noise phase differences using the phase mismatch information and the audio phase information; A phase difference diagram of the noise when the audio signal is converted in the target headphone is determined according to all the noise phase differences.

5. The method according to claim 1, characterized in that Determining the noise disturbance domain of the audio signal according to the path characteristics and the phase difference diagram of the noise specifically includes: Determine a path disturbance signal of the audio signal by using the path feature; A noise disturbance domain of the audio signal is determined according to a phase difference diagram between the path disturbance signal and the noise.

6. The method according to claim 1, characterized in that Determining the suppression characteristic amount of the noise in the audio signal by using the noise disturbance domain and the jitter response of the audio specifically includes: determining a noise frequency of the audio signal according to the noise disturbance domain; Determining a noise suppression frequency by using the noise frequency and a jitter response of the audio; A suppression feature amount of noise in the audio signal is determined according to the noise suppression frequency.

7. A noise suppression system for headphones, which uses the method according to any one of claims 1 to 6 to suppress noise, characterized in that: The noise suppression system for headphones includes: An acquisition module, used to collect audio signals received by the target headphone; A processing module, configured to perform adjacent comparison on signal points in the audio signal, thereby obtaining a plurality of signal outliers in the audio signal, and determining the jitter response of the audio when the target headphone outputs the audio signal through all the signal outliers; The processing module is further used to determine a signal-to-interference ratio of the audio signal, and then determine phase mismatch information generated by the target headphone when receiving audio based on the signal-to-interference ratio and the intensity characteristics of the audio signal, and determine a phase difference diagram of noise when the audio signal is converted in the target headphone according to the phase mismatch information; The processing module is further used to obtain the path characteristics of the audio signal during transmission, and then determine the noise disturbance domain of the audio signal according to the path characteristics and the phase difference diagram of the noise, and determine the suppression characteristic amount of the noise in the audio signal through the noise disturbance domain and the jitter response of the audio; The execution module is used to suppress the noise in the audio signal received by the target headphone according to the noise suppression feature.

8. A computer device, characterized in that: The computer device includes a memory and a processor, wherein the memory stores codes, and the processor is configured to obtain the codes and execute the noise suppression method for headphones according to any one of claims 1 to 6.

9. A computer-readable storage medium storing a computer program, characterized in that: When the computer program is executed by a processor, the noise suppression method for headphones is implemented as claimed in any one of claims 1 to 6.

Citation Information

Patent Citations

  • Audio processing method and device, computer equipment and storage medium

    CN111986691A

  • Audio signal audio segment endpoint detection method and system

    CN115376548A